Search Engines -- Spiders or Crawler Name
Google -- Googlebot
Yahoo -- Yahoo Slurp
MSN -- MSNbot
Ask -- Teoma
Excite -- Architext spider
Inktomi.com -- Slurp
Alexa -- ia_archiver
Altavista -- Scooter
Lycus -- Lycos_Spider_(T-Rex)
Cuil -- Twiceler (New Search Engine)
Looksmart -- MantraAgent
Yahoo -- Yahoo Slurp
MSN -- MSNbot
Ask -- Teoma
Excite -- Architext spider
Inktomi.com -- Slurp
Alexa -- ia_archiver
Altavista -- Scooter
Lycus -- Lycos_Spider_(T-Rex)
Cuil -- Twiceler (New Search Engine)
Looksmart -- MantraAgent
These are the name of major search engines crawler.
Resource 1 2
1 comment:
Hi,
Nice list....
Thanks,
Software Development Company
Post a Comment