AbachoBOT
abcdatos_botlink
http://www.abcdatos.com/botlink/
AESOP_com_SpiderMan
ah-ha.com crawler (crawler@ah-ha.com)
ia_archiver
Scooter
Mercator
Scooter2_Mercator_3-1.0
roach.smo.av.com-1.0
Tv<nn>_Merc_resh_26_1_D-1.0
AltaVista-Intranet
jan.gelin@av.com
FAST-WebCrawler
crawler@fast.no
Wget
Acoon Robot
antibot
Atomz
AxmoRobot
Buscaplus Robi
http://www.buscaplus.com/robi/
CanSeek/
support@canseek.ca
ChristCRAWLER
http://www.christcrawler.com/
Clushbot
http://www.clush.com/bot.html
Crawler
admin@crawler.de
DaAdLe.com ROBOT/
RaBot
Agent-admin/ phortse@hanmail.net
contact/jylee@kies.co.kr
RaBot
Agent-admin/ webmaster@kisco.go.kr
DeepIndex
DittoSpyder
Jack
EARTHCOM.info
Speedy Spider
ArchitextSpider
ArchitectSpider
EuripBot
Arachnoidea
arachnoidea@euroseek.net
EZResult
Fast PartnerSite Crawler
FAST Data Search Crawler
FAST Data Search Document Retriever
KIT-Fireball
france.misesajour.com
FyberSearch
GalaxyBot
http://www.galaxy.com/galaxybot.html
geckobot
GenCrawler
GeonaBot
getRAX
Googlebot
googlebot@googlebot.com
http://googlebot.com/
moget/2.0
moget@goo.ne.jp
Aranha
Slurp.so/1.0
slurp@inktomi.com
Slurp/2.0j
slurp@inktomi.com
www.inktomisearch.com
Slurp/2.0-KiteHourly
slurp@inktomi.com;
www.inktomi.com/slurp.html
Slurp/2.0-OwlWeekly
spider@aeneid.com
www.inktomi.com/slurp.html
Slurp/3.0-AU
slurp@inktomi.com
Toutatis 2.5-2
Hubater
http://www.almaden.ibm.com/cs/crawler
IlTrovatore-Setaccio
IncyWincy
UltraSeek
InfoSeek Sidewinder
Mole2/1.0
webmaster@intags.de
MP3Bot
C-PBWF-ip3000.com-crawler
ip3000.com-crawler
http://www.istarthere.com
spider@istarthere.com
Knowledge.com/
kuloko-bot/0.2
LNSpiderguy
Linknzbot
lookbot
MantraAgent
NetResearchServer
www.loopimprovements.com/robot.html
Lycos_Spider_(T-Rex)
JoocerBot
HenryTheMiragoRobot
MojeekBot
mozDex/
MSNBOT/0.1
http://search.msn.com/msnbot.htm)
Navadoo Crawler
Gulliver
ObjectsSearch/0.01
PicoSearch/
PJspider
DIIbot
nttdirectory_robot
super-robot@super.navi.ocn.ne.jp
griffon
griffon@super.navi.ocn.ne.jp
Spider/maxbot.com
admin@maxbot.com
various (fakes agent on each access)
gazz/1.0
gazz@nttrd.com
???
NationalDirectory-SuperSpider
dloader(NaverRobot)/
dumrobo(NaverRobot)/
Openfind piranha,Shark
robot-response@openfind.com.tw
Openbot/
psbot
www.picsearch.org/bot.html
CrawlerBoy Pinpoint.com
user<n>.ip3000.com
QweeryBot
http://qweerybot.qweery.com)
AlkalineBOT
SeznamBot
Search-10
Fluffy the spider
info@searchhippo.com)
Scrubby/
asterias
speedfind ramBot xtreme
Kototoi/0.1
SearchByUsa
Searchspider/
SightQuestBot/
http://www.sightquest.com/bot.htm
Spider_Monkey/
Surfnomore Spider v1.1
Robot@SuperSnooper.Com
teoma_agent1
teoma_admin@hawkholdings.com
Teradex_Mapper
mapper@teradex.com
ESISmartSpider
Spider TraficDublu
Tutorial Crawler
http://www.tutorgig.com/crawler
updated/0.1beta
crawler@updated.com
UK Searcher Spider
Vivante Link Checker
appie
Nazilla
www.WebWombat.com.au
marvin/infoseek
marvin-team@webseek.de
MuscatFerret
WhizBang! Lab
ZyBorg
(info@WISEnut.com)
WIRE WebRefiner:
webrefiner@wire.co.uk
WSCbot
Yandex
Yellopet-Spider
libwww-perl
Iron33
