*MAFIA* Forums

*MAFIA* Forums

  • May 06, 2024, 08:34:00 AM
  • Welcome, Guest
Please login or register.

Login with username, password and session length
Advanced search  

News:

Welcome back the Arcade! Play over 100+ games to get the high score and compete against other forum members.

http://www.mafiaowns.com/index.php?action=arcade;sa=list;sortby=a2z;

Author Topic: For all those interested.  (Read 1869 times)

*MAFIA* Balthazar

  • *MAFIA* Head
  • Forum Member
  • Reputation: 2654
  • Offline Offline
  • Posts: 2,412
    • View Profile
For all those interested.
« on: July 18, 2006, 04:29:38 PM »
Some of you may have noticed a user by the name of "Yahoo! Slurp Spider" browsing through the forums from time to time.

Well....

[ATTACH]1155[/ATTACH]

http://help.yahoo.com/help/us/ysearch/slurp/index.html

Yahoo! Slurp is Yahoo!'s web-indexing robot. The Yahoo! Slurp crawler collects documents from the Web to build a searchable index for search services using the Yahoo! search engine. These documents are discovered and crawled because other web pages contain links directing to these documents. As part of the crawling effort, the Yahoo! Slurp crawler will take robots.txt standards into account to ensure we do not crawl and index content from those pages whose content you do not want included in Yahoo! Search Technology. If a page is disallowed to be crawled by robots.txt standards, Yahoo! will not read or use the contents of that page. The URL of a protected page may be included in Yahoo! Search Technology as a "thin" document with no text content. Links and reference text from other public web pages provide identifiable information about a URL and may be indexed as part of web search coverage.
Logged

*MAFIA* Bonehead

  • *MAFIA* Founder
  • Forum Member
  • Reputation: 2584
  • Offline Offline
  • Posts: 8,007
    • View Profile
    • *MAFIA*
For all those interested.
« Reply #1 on: July 18, 2006, 05:11:06 PM »
You know balth, I already explained this ;)
Logged

*MAFIA* Balthazar

  • *MAFIA* Head
  • Forum Member
  • Reputation: 2654
  • Offline Offline
  • Posts: 2,412
    • View Profile
For all those interested.
« Reply #2 on: July 18, 2006, 05:27:49 PM »
Quote from: *MAFIA* Bonehead
You know balth, I already explained this ;)


Show's how much I investigate the forums before posting... sorry Boner, I was just looking around and it peaked my interest.
Logged

*MAFIA* Kingpin

  • *MAFIA* Admin
  • Forum Member
  • Reputation: 222
  • Offline Offline
  • Posts: 473
    • View Profile
    • http://thetribusgroup.com
For all those interested.
« Reply #3 on: July 18, 2006, 06:09:36 PM »
ya no shit
Logged

*MAFIA* Beatlejuice

  • *MAFIA* Head
  • Forum Member
  • Reputation: 2313
  • Offline Offline
  • Posts: 8,317
    • View Profile
For all those interested.
« Reply #4 on: July 18, 2006, 06:25:08 PM »
Hey if it makes you feel any better, it peaked my interest as well and I had no clue about it, along with the Google person who is always on here.  Cheers.
Logged

*MAFIA* Bonehead

  • *MAFIA* Founder
  • Forum Member
  • Reputation: 2584
  • Offline Offline
  • Posts: 8,007
    • View Profile
    • *MAFIA*
For all those interested.
« Reply #5 on: July 18, 2006, 06:48:24 PM »
Its ok balth, its expected from you :D
Logged

*MAFIA* ßlåkjáx

  • *MAFIA* Admin
  • Forum Member
  • Reputation: 1472
  • Offline Offline
  • Posts: 3,936
    • View Profile
For all those interested.
« Reply #6 on: July 18, 2006, 06:53:20 PM »
Quote from: *MAFIA* Bonehead
Its ok balth, its expected from you :D

lawl, anyone know why its called a "slurp" spider? its it cause its slurps up all shit from our site?
Logged
 

Page created in 0.034 seconds with 27 queries.