| Name |
Details |
| Acme.Spider |
| Agent: | Due to a deficiency in Java it's not currently possible to set the User-Agent. |
|---|
| Host: | * |
|---|
| Email: | jef@acme.com |
|---|
|
| ActiveAgent |
| Agent: | no |
|---|
| Host: | anywhere |
|---|
| Email: | agent@hipcrime.com |
|---|
|
| Ahoy! The Homepage Finder |
| Agent: | 'Ahoy! The Homepage Finder' |
|---|
| Host: | cs.washington.edu |
|---|
| Email: | marclang@cs.washington.edu |
|---|
|
| Alkaline |
| Agent: | AlkalineBOT |
|---|
| Host: | * |
|---|
| Email: | dblock@vestris.com |
|---|
|
| Arachnophilia |
| Agent: | Arachnophilia |
|---|
| Host: | halsoft.com |
|---|
| Email: | taluskie@utpapa.ph.utexas.edu |
|---|
|
| ArchitextSpider |
| Agent: | ArchitextSpider |
|---|
| Host: | *.atext.com |
|---|
| Email: | spider@atext.com |
|---|
|
| Aretha |
| Agent: | |
|---|
| Host: | |
|---|
| Email: | davew@well.com |
|---|
|
| ASpider (Associative Spider) |
| Agent: | ASpider/0.09 |
|---|
| Host: | nova.pvv.unit.no |
|---|
| Email: | fredj@pvv.ntnu.no |
|---|
|
| Atomz.com Search Robot |
| Agent: | Atomz/1.0 |
|---|
| Host: | www.atomz.com |
|---|
| Email: | mike@atomz.com |
|---|
|
| AURESYS |
| Agent: | AURESYS/1.0 |
|---|
| Host: | crrm.univ-mrs.fr, 192.134.99.192 |
|---|
| Email: | mannina@crrm.univ-mrs.fr |
|---|
|
| BackRub |
| Agent: | BackRub/*.* |
|---|
| Host: | *.stanford.edu |
|---|
| Email: | page@leland.stanford.edu |
|---|
|
| Big Brother |
| Agent: | Big Brother |
|---|
| Host: | * |
|---|
| Email: | Francois.Pottier@inria.fr |
|---|
|
| Bjaaland |
| Agent: | Bjaaland/0.5 |
|---|
| Host: | barry.bitmovers.net |
|---|
| Email: | tbray@textuality.com |
|---|
|
| BlackWidow |
| Agent: | BlackWidow |
|---|
| Host: | 140.190.65.* |
|---|
| Email: | khooghee@marys.smumn.edu |
|---|
|
| Die Blinde Kuh |
| Agent: | Die Blinde Kuh |
|---|
| Host: | minerva.sozialwiss.uni-hamburg.de |
|---|
| Email: | maschinist@blinde-kuh.de |
|---|
|
| bright.net caching robot |
| Agent: | Mozilla/3.01 (compatible;) |
|---|
| Host: | 209.143.1.46 |
|---|
| Email: | |
|---|
|
| BSpider |
| Agent: | BSpider/1.0 libwww-perl/0.40 |
|---|
| Host: | 210.159.73.34, 210.159.73.35 |
|---|
| Email: | okumura@rsl.crl.fujixerox.co.jp |
|---|
|
| CACTVS Chemistry Spider |
| Agent: | CACTVS Chemistry Spider |
|---|
| Host: | utamaro.organik.uni-erlangen.de |
|---|
| Email: | wdi@eros.ccc.uni-erlangen.de |
|---|
|
| Calif |
| Agent: | Calif/0.6 (kosarev@tnps.net; http://www.tnps.dp.ua) |
|---|
| Host: | cobra.tnps.dp.ua |
|---|
| Email: | kosarev@tnps.net |
|---|
|
| Cassandra |
| Agent: | |
|---|
| Host: | www.aha.ru |
|---|
| Email: | billy168@aha.ru |
|---|
|
| Digimarc Marcspider/CGI |
| Agent: | Digimarc CGIReader/1.0 |
|---|
| Host: | 206.102.3.* |
|---|
| Email: | wmreader@digimarc.com |
|---|
|
| Checkbot |
| Agent: | Checkbot/x.xx LWP/5.x |
|---|
| Host: | * |
|---|
| Email: | graaff@xs4all.nl |
|---|
|
| churl |
| Agent: | |
|---|
| Host: | |
|---|
| Email: | yunke@umich.edu |
|---|
|
| CMC/0.01 |
| Agent: | CMC/0.01 |
|---|
| Host: | haruna.next.ne.jp, 203.183.218.4 |
|---|
| Email: | shinobu@po.next.ne.jp |
|---|
|
| Combine System |
| Agent: | combine/0.0 |
|---|
| Host: | *.ub2.lu.se |
|---|
| Email: | tsao@munin.ub2.lu.se |
|---|
|
| Conceptbot |
| Agent: | conceptbot/0.3 |
|---|
| Host: | router.sifry.com |
|---|
| Email: | david@sifry.com |
|---|
|
| Web Core / Roots |
| Agent: | root/0.1 |
|---|
| Host: | shiva.di.uminho.pt, from www.di.uminho.pt |
|---|
| Email: | wc@di.uminho.pt |
|---|
|
| CS-HKUST WISE: WWW Index and Search Engine |
| Agent: | CS-HKUST-IndexServer/1.0 |
|---|
| Host: | dbx.cs.ust.hk |
|---|
| Email: | yuwono-b@cs.ust.hk |
|---|
|
| Cusco |
| Agent: | Cusco/3.2 |
|---|
| Host: | *.cusco.pt, *.viatecla.pt |
|---|
| Email: | clerigo@viatecla.pt |
|---|
|
| CyberSpyder Link Test |
| Agent: | CyberSpyder/2.1 |
|---|
| Host: | * |
|---|
| Email: | amant@cyberspyder.com |
|---|
|
| DeWeb(c) Katalog/Index |
| Agent: | Deweb/1.01 |
|---|
| Host: | deweb.orbit.de |
|---|
| Email: | dewebmaster@orbit.de |
|---|
|
| DienstSpider |
| Agent: | dienstspider/1.0 |
|---|
| Host: | sappho.csi.forth.gr |
|---|
| Email: | asidirop@csi.forth.gr |
|---|
|
| DNAbot |
| Agent: | DNAbot/1.0 |
|---|
| Host: | xx.dnainc.co.jp |
|---|
| Email: | tomatell@xx.dnainc.co.jp |
|---|
|
| DownLoad Express |
| Agent: | |
|---|
| Host: | * |
|---|
| Email: | dlxpress@mediaone.net |
|---|
|
| DragonBot |
| Agent: | DragonBot/1.0 libwww/5.0 |
|---|
| Host: | *.paczone.com |
|---|
| Email: | admin@paczone.com |
|---|
|
| DWCP (Dridus' Web Cataloging Project) |
| Agent: | DWCP/2.0 |
|---|
| Host: | *.dridus.com |
|---|
| Email: | rmm@dridus.com |
|---|
|
| EIT Link Verifier Robot |
| Agent: | EIT-Link-Verifier-Robot/0.2 |
|---|
| Host: | * |
|---|
| Email: | mcguire@eit.COM |
|---|
|
| Emacs-w3 Search Engine |
| Agent: | Emacs-w3/v[0-9\.]+ |
|---|
| Host: | * |
|---|
| Email: | wmperry@spry.com |
|---|
|
| ananzi |
| Agent: | EMC Spider |
|---|
| Host: | bilbo.internal.empirical.com |
|---|
| Email: | hpayne@u-media.com |
|---|
|
| Esther |
| Agent: | esther |
|---|
| Host: | *.falconsoft.com |
|---|
| Email: | tim@falconsoft.com |
|---|
|
| nzexplorer |
| Agent: | explorersearch |
|---|
| Host: | bitz.co.nz |
|---|
| Email: | paul@bourke.gen.nz |
|---|
|
| Felix IDE |
| Agent: | FelixIDE/1.0 |
|---|
| Host: | * |
|---|
| Email: | felix@pentone.com |
|---|
|
| Wild Ferret Web Hopper #1, #2, #3 |
| Agent: | Hazel's Ferret Web hopper, |
|---|
| Host: | |
|---|
| Email: | ghbos@postoffice.worldnet.att.net |
|---|
|
| FetchRover |
| Agent: | ESIRover v1.0 |
|---|
| Host: | * |
|---|
| Email: | ken@engsoftware.com |
|---|
|
| fido |
| Agent: | fido/0.9 Harvest/1.4.pl2 |
|---|
| Host: | fido.planetsearch.com, *.planetsearch.com, 206.64.113.* |
|---|
| Email: | fido@planetsearch.com |
|---|
|
| Hämähäkki |
| Agent: | Hämähäkki/0.2 |
|---|
| Host: | *.www.fi |
|---|
| Email: | Timo.Metsala@www.fi |
|---|
|
| KIT-Fireball |
| Agent: | KIT-Fireball/2.0 libwww/5.0a |
|---|
| Host: | *.fireball.de |
|---|
| Email: | info@fireball.de |
|---|
|
| Fish search |
| Agent: | Fish-Search-Robot |
|---|
| Host: | www.win.tue.nl |
|---|
| Email: | debra@win.tue.nl |
|---|
|
| Fouineur |
| Agent: | Mozilla/2.0 (compatible fouineur v2.0; fouineur.9bit.qc.ca) |
|---|
| Host: | * |
|---|
| Email: | jvandal@9bit.qc.ca |
|---|
|
| Robot Francoroute |
| Agent: | Robot du CRIM 1.0a |
|---|
| Host: | zorro.crim.ca |
|---|
| Email: | maparent@crim.ca |
|---|
|
| Freecrawl |
| Agent: | Freecrawl |
|---|
| Host: | *.freeside.net |
|---|
| Email: | ekhall@freeside.net |
|---|
|
| FunnelWeb |
| Agent: | FunnelWeb-1.0 |
|---|
| Host: | earth.planets.com.au |
|---|
| Email: | eaglesd@pc.com.au |
|---|
|
| gazz |
| Agent: | gazz/1.0 |
|---|
| Host: | *.nttrd.com, *.infobee.ne.jp |
|---|
| Email: | gazz@nttrd.com |
|---|
|
| GCreep |
| Agent: | gcreep/1.0 |
|---|
| Host: | mbx.instrumentpolen.se |
|---|
| Email: | anders@instrumentpolen.se |
|---|
|
| GetBot |
| Agent: | ??? |
|---|
| Host: | |
|---|
| Email: | zav@macromedia.com |
|---|
|
| GetURL |
| Agent: | GetURL.rexx v1.05 |
|---|
| Host: | * |
|---|
| Email: | James@Snark.apana.org.au |
|---|
|
| Golem |
| Agent: | Golem/1.1 |
|---|
| Host: | *.quibble.com |
|---|
| Email: | geoff@quibble.com |
|---|
|
| Googlebot |
| Agent: | Googlebot//1.0 |
|---|
| Host: | *.googlebot.com |
|---|
| Email: | googlebot@googlebot.com |
|---|
|
| Grapnel/0.01 Experiment |
| Agent: | |
|---|
| Host: | varies |
|---|
| Email: | v93_kat@ce.kth.se |
|---|
|
| Gromit |
| Agent: | Gromit/1.0 |
|---|
| Host: | *.austlii.edu.au |
|---|
| Email: | dan@austlii.edu.au |
|---|
|
| Northern Light Gulliver |
| Agent: | Gulliver/1.1 |
|---|
| Host: | scooby.northernlight.com, taz.northernlight.com, gulliver.northernlight.com |
|---|
| Email: | crawler@northernlight.com |
|---|
|
| HamBot |
| Agent: | |
|---|
| Host: | *.hamrad.com |
|---|
| Email: | john@futureone.com |
|---|
|
| Harvest |
| Agent: | yes |
|---|
| Host: | bruno.cs.colorado.edu |
|---|
| Email: | |
|---|
|
| havIndex |
| Agent: | havIndex/X.xx[bxx] |
|---|
| Host: | * |
|---|
| Email: | havIndex@hav.com |
|---|
|
| HI (HTML Index) Search |
| Agent: | AITCSRobot/1.1 |
|---|
| Host: | |
|---|
| Email: | a94385@cs.ait.ac.th |
|---|
|
| Wired Digital |
| Agent: | wired-digital-newsbot/1.5 |
|---|
| Host: | gossip.hotwired.com |
|---|
| Email: | bowen@hotwired.com |
|---|
|
| ht://Dig |
| Agent: | htdig/3.1.0b2 |
|---|
| Host: | * |
|---|
| Email: | andrew@contigo.com |
|---|
|
| HTMLgobble |
| Agent: | HTMLgobble v2.2 |
|---|
| Host: | tp70.rz.uni-karlsruhe.de |
|---|
| Email: | ley@rz.uni-karlsruhe.de |
|---|
|
| Hyper-Decontextualizer |
| Agent: | no |
|---|
| Host: | |
|---|
| Email: | cliff@tricon.net |
|---|
|
| IBM_Planetwide |
| Agent: | IBM_Planetwide, |
|---|
| Host: | www.ibm.com www2.ibm.com |
|---|
| Email: | epc@www.ibm.com" |
|---|
|
| Popular Iconoclast |
| Agent: | gestaltIconoclast/1.0 libwww-FM/2.17 |
|---|
| Host: | gestalt.sewanee.edu |
|---|
| Email: | chris@gestalt.sewanee.edu |
|---|
|
| Ingrid |
| Agent: | INGRID/0.1 |
|---|
| Host: | bart.ilse.nl |
|---|
| Email: | ilse@ilse.nl |
|---|
|
| Imagelock |
| Agent: | Mozilla 3.01 PBWF (Win95) |
|---|
| Host: | 209.111.133.* |
|---|
| Email: | belanger@imagelock.com |
|---|
|
| IncyWincy |
| Agent: | IncyWincy/1.0b1 |
|---|
| Host: | osiris.sunderland.ac.uk |
|---|
| Email: | simon.stobart@sunderland.ac.uk |
|---|
|
| Informant |
| Agent: | Informant |
|---|
| Host: | informant.dartmouth.edu |
|---|
| Email: | info_adm@cosmo.dartmouth.edu |
|---|
|
| InfoSeek Robot 1.0 |
| Agent: | InfoSeek Robot 1.0 |
|---|
| Host: | corp-gw.infoseek.com |
|---|
| Email: | stk@infoseek.com |
|---|
|
| Infoseek Sidewinder |
| Agent: | Infoseek Sidewinder |
|---|
| Host: | |
|---|
| Email: | mna@infoseek.com |
|---|
|
| InfoSpiders |
| Agent: | InfoSpiders/0.1 |
|---|
| Host: | *.ucsd.edu |
|---|
| Email: | fil@cs.ucsd.edu |
|---|
|
| Inspector Web |
| Agent: | inspectorwww/1.0 http://www.greenpac.com/inspectorwww.html |
|---|
| Host: | www.corpsite.com, www.greenpac.com, 38.234.171.* |
|---|
| Email: | doug@greenpac.com |
|---|
|
| IntelliAgent |
| Agent: | 'IAGENT/1.0' |
|---|
| Host: | sand.it.bond.edu.au |
|---|
| Email: | s1523@sand.it.bond.edu.au |
|---|
|
| Iron33 |
| Agent: | Iron33/0.0 |
|---|
| Host: | *.folon.ueda.info.waseda.ac.jp, 133.9.215.* |
|---|
| Email: | watanabe@ueda.info.waseda.ac.jp |
|---|
|
| Israeli-search |
| Agent: | IsraeliSearch/1.0 |
|---|
| Host: | dylan.ius.cs.cmu.edu |
|---|
| Email: | etamar@xpert.co |
|---|
|
| Digital Integrity Robot |
| Agent: | JavaDIIbot/0.0 |
|---|
| Host: | robot.digital-integrity.com |
|---|
| Email: | anthony.tomasic@digital-integrity.com |
|---|
|
| JCrawler |
| Agent: | JCrawler/0.2 |
|---|
| Host: | db.netimages.com |
|---|
| Email: | snowhare@netimages.com |
|---|
|
| Jeeves |
| Agent: | Jeeves v0.05alpha (PERL, LWP, lglb@doc.ic.ac.uk) |
|---|
| Host: | *.doc.ic.ac.uk |
|---|
| Email: | lglb@doc.ic.ac.uk |
|---|
|
| Jobot |
| Agent: | Jobot/0.1alpha libwww-perl/4.0 |
|---|
| Host: | supernova.micrognosis.com |
|---|
| Email: | ajack@corp.micrognosis.com |
|---|
|
| JoeBot |
| Agent: | JoeBot/x.x, |
|---|
| Host: | |
|---|
| Email: | rwaldin@primenet.com |
|---|
|
| The Jubii Indexing Robot |
| Agent: | JubiiRobot/version# |
|---|
| Host: | any host in the cybernet.dk domain |
|---|
| Email: | jakob@jubii.dk |
|---|
|
| JumpStation |
| Agent: | jumpstation |
|---|
| Host: | *.stir.ac.uk |
|---|
| Email: | j.fletcher@stirling.ac.uk |
|---|
|
| Katipo |
| Agent: | Katipo/1.0 |
|---|
| Host: | * |
|---|
| Email: | Michael.Newbery@vuw.ac.nz |
|---|
|
| KDD-Explorer |
| Agent: | KDD-Explorer/0.1 |
|---|
| Host: | mlc.kddvw.kcom.or.jp |
|---|
| Email: | matsu@lab.kdd.co.jp |
|---|
|
| Kilroy |
| Agent: | yes |
|---|
| Host: | *.oclc.org |
|---|
| Email: | kilroy@oclc.org |
|---|
|
| KO_Yappo_Robot |
| Agent: | KO_Yappo_Robot/1.0.4(http://yappo.com/info/robot.html) |
|---|
| Host: | yappo.com,209.25.40.1 |
|---|
| Email: | office_KO@yappo.com |
|---|
|
| LabelGrabber |
| Agent: | LabelGrab/1.1 |
|---|
| Host: | head.w3.org |
|---|
| Email: | jamieson@mit.edu |
|---|
|
| LinkWalker |
| Agent: | LinkWalker |
|---|
| Host: | *.seventwentyfour.com |
|---|
| Email: | rbryant@seventwentyfour.com |
|---|
|
| Lockon |
| Agent: | Lockon/xxxxx |
|---|
| Host: | *.hitech.tuis.ac.jp |
|---|
| Email: | search@rsch.tuis.ac.jp |
|---|
|
| logo.gif Crawler |
| Agent: | logo.gif crawler |
|---|
| Host: | *.inm.de |
|---|
| Email: | sevo@inm.de |
|---|
|
| Lycos |
| Agent: | Lycos/x.x |
|---|
| Host: | fuzine.mt.cs.cmu.edu, lycos.com |
|---|
| Email: | fuzzy@cmu.edu |
|---|
|
| Mac WWWWorm |
| Agent: | |
|---|
| Host: | |
|---|
| Email: | lemieuse@ERE.UMontreal.CA |
|---|
|
| Magpie |
| Agent: | Magpie/1.0 |
|---|
| Host: | *.blueberry.co.uk, 194.70.52.*, 193.131.167.144 |
|---|
| Email: | Keith.Jones@blueberry.co.uk |
|---|
|
| MediaFox |
| Agent: | MediaFox/x.y |
|---|
| Host: | 141.99.*.* |
|---|
| Email: | sfx@uni-media.de |
|---|
|
| MerzScope |
| Agent: | MerzScope |
|---|
| Host: | (Client Based) |
|---|
| Email: | |
|---|
|
| NEC-MeshExplorer |
| Agent: | NEC-MeshExplorer |
|---|
| Host: | meshsv300.tk.mesh.ad.jp |
|---|
| Email: | web-dir@mxa.meshnet.or.jp |
|---|
|
| MOMspider |
| Agent: | MOMspider/1.00 libwww-perl/0.40 |
|---|
| Host: | * |
|---|
| Email: | fielding@ics.uci.edu |
|---|
|
| Monster |
| Agent: | Monster/vX.X.X -$TYPE ($OSTYPE) |
|---|
| Host: | wild.stu.neva.ru |
|---|
| Email: | diwil@wild.stu.neva.ru |
|---|
|
| Motor |
| Agent: | Motor/0.2 |
|---|
| Host: | Michael.cybercon.technopark.gmd.de |
|---|
| Email: | Motor@cybercon.technopark.gmd.de |
|---|
|
| Muscat Ferret |
| Agent: | MuscatFerret/ |
|---|
| Host: | 193.114.89.*, 194.168.54.11 |
|---|
| Email: | olly@muscat.co.uk |
|---|
|
| Mwd.Search |
| Agent: | MwdSearch/0.1 |
|---|
| Host: | *.fifi.net |
|---|
| Email: | Antti.Westerberg@mwd.sci.fi |
|---|
|
| NetCarta WebMap Engine |
| Agent: | NetCarta CyberPilot Pro |
|---|
| Host: | |
|---|
| Email: | info@netcarta.com |
|---|
|
| NetMechanic |
| Agent: | NetMechanic |
|---|
| Host: | 206.26.168.18 |
|---|
| Email: | tdahm@iquest.com |
|---|
|
| NetScoop |
| Agent: | NetScoop/1.0 libwww/5.0a |
|---|
| Host: | alpha.is.tokushima-u.ac.jp, beta.is.tokushima-u.ac.jp |
|---|
| Email: | kita@is.tokushima-u.ac.jp |
|---|
|
| newscan-online |
| Agent: | newscan-online/1.1 |
|---|
| Host: | *newscan-online.de |
|---|
| Email: | mueller@newscan-online.de |
|---|
|
| NHSE Web Forager |
| Agent: | NHSEWalker/3.0 |
|---|
| Host: | *.mcs.anl.gov |
|---|
| Email: | olson@mcs.anl.gov |
|---|
|
| Nomad |
| Agent: | Nomad-V2.x |
|---|
| Host: | *.cs.colostate.edu |
|---|
| Email: | sonnen@cs.colostat.edu |
|---|
|
| The NorthStar Robot |
| Agent: | NorthStar |
|---|
| Host: | frognot.utdallas.edu, utdallas.edu, cnidir.org |
|---|
| Email: | barrie@unr.edu |
|---|
|
| Occam |
| Agent: | Occam/1.0 |
|---|
| Host: | gentian.cs.washington.edu, sekiu.cs.washington.edu, saxifrage.cs.washington.edu |
|---|
| Email: | friedman@cs.washington.edu |
|---|
|
| HKU WWW Octopus |
| Agent: | HKU WWW Robot, |
|---|
| Host: | phoenix.cs.hku.hk |
|---|
| Email: | jax@cs.hku.hk |
|---|
|
| Orb Search |
| Agent: | Orbsearch/1.0 |
|---|
| Host: | cow.dyn.ml.org, *.dyn.ml.org |
|---|
| Email: | webernet@geocities.com |
|---|
|
| Pack Rat |
| Agent: | PackRat/1.0 |
|---|
| Host: | cps.msu.edu |
|---|
| Email: | dexterte@cps.msu.edu |
|---|
|
| Patric |
| Agent: | Patric/0.01a |
|---|
| Host: | *.nwnet.net |
|---|
| Email: | webmaster@nwnet.net |
|---|
|
| The Peregrinator |
| Agent: | Peregrinator-Mathematics/0.7 |
|---|
| Host: | |
|---|
| Email: | jimr@maths.su.oz.au |
|---|
|
| PerlCrawler 1.0 |
| Agent: | PerlCrawler/1.0 Xavatoria/2.0 |
|---|
| Host: | server5.hypermart.net |
|---|
| Email: | webmaster@perlsearch.hypermart.net |
|---|
|
| Phantom |
| Agent: | Duppies |
|---|
| Host: | |
|---|
| Email: | lburke@aktiv.com |
|---|
|
| Pioneer |
| Agent: | Pioneer |
|---|
| Host: | *.uncfsu.edu or flyer.ncsc.org |
|---|
| Email: | micah@sequent.uncfsu.edu |
|---|
|
| html_analyzer |
| Agent: | |
|---|
| Host: | |
|---|
| Email: | pitkow@aries.colorado.edu |
|---|
|
| Portal Juice Spider |
| Agent: | PortalJuice.com/4.0 |
|---|
| Host: | *.portaljuice.com, *.nextopia.com |
|---|
| Email: | pjspider@portaljuice.com |
|---|
|
| PGP Key Agent |
| Agent: | PGP-KA/1.2 |
|---|
| Host: | salerno.starnet.it |
|---|
| Email: | puma@comm2000.it |
|---|
|
| PlumtreeWebAccessor |
| Agent: | PlumtreeWebAccessor/0.9 |
|---|
| Host: | |
|---|
| Email: | josephs@plumtree.com |
|---|
|
| GetterroboPlus Puu |
| Agent: | straight FLASH!! GetterroboPlus 1.5 |
|---|
| Host: | straight FLASH!! Getterrobo-Plus, *.homing.net |
|---|
| Email: | marunaka@homing.net |
|---|
|
| The Python Robot |
| Agent: | |
|---|
| Host: | |
|---|
| Email: | guido@python.org |
|---|
|
| RBSE Spider |
| Agent: | |
|---|
| Host: | rbse.jsc.nasa.gov (192.88.42.10) |
|---|
| Email: | eichmann@rbse.jsc.nasa.gov |
|---|
|
| Resume Robot |
| Agent: | Resume Robot |
|---|
| Host: | |
|---|
| Email: | proquest@onramp.net |
|---|
|
| RoadHouse Crawling System |
| Agent: | RHCS/1.0a |
|---|
| Host: | stage.perceval.be |
|---|
| Email: | |
|---|
|
| Road Runner: The ImageScape Robot |
| Agent: | Road Runner: ImageScape Robot (lim@cs.leidenuniv.nl) |
|---|
| Host: | |
|---|
| Email: | lim@cs.leidenuniv.nl |
|---|
|
| Robbie the Robot |
| Agent: | Robbie/0.1 |
|---|
| Host: | *.lmco.com |
|---|
| Email: | robert.h.pollack@lmco.com |
|---|
|
| ComputingSite Robi/1.0 |
| Agent: | ComputingSite Robi/1.0 (robi@computingsite.com) |
|---|
| Host: | robi.computingsite.com |
|---|
| Email: | robi@computingsite.com |
|---|
|
| Roverbot |
| Agent: | Roverbot |
|---|
| Host: | roverbot.com |
|---|
| Email: | gmd@spyder.net |
|---|
|
| SafetyNet Robot |
| Agent: | SafetyNet Robot 0.1, |
|---|
| Host: | *.urlabs.com |
|---|
| Email: | m.l.nelson@urlabs.com |
|---|
|
| Scooter |
| Agent: | Scooter/2.0 G.R.A.B. V1.1.0 |
|---|
| Host: | *.av.pa-x.dec.com |
|---|
| Email: | scooter@pa.dec.com |
|---|
|
| Search.Aus-AU.COM |
| Agent: | not available |
|---|
| Host: | Search.Aus-AU.COM, 203.55.124.29, 203.2.239.29 |
|---|
| Email: | dez@geko.com |
|---|
|
| Senrigan |
| Agent: | Senrigan/xxxxxx |
|---|
| Host: | aniki.olu.info.waseda.ac.jp |
|---|
| Email: | kent@muraoka.info.waseda.ac.jp |
|---|
|
| SG-Scout |
| Agent: | SG-Scout |
|---|
| Host: | beta.xerox.com |
|---|
| Email: | ptbb@ai.mit.edu, beebee@parc.xerox.com |
|---|
|
| Shai'Hulud |
| Agent: | Shai'Hulud |
|---|
| Host: | *.rdtex.ru |
|---|
| Email: | shawdow@usa.net |
|---|
|
| Simmany Robot Ver1.0 |
| Agent: | SimBot/1.0 |
|---|
| Host: | sansam.hnc.net |
|---|
| Email: | ailove@hnc.co.kr |
|---|
|
| Open Text Index Robot |
| Agent: | Open Text Site Crawler V1.0 |
|---|
| Host: | *.opentext.com |
|---|
| Email: | faichney@opentext.com |
|---|
|
| SiteTech-Rover |
| Agent: | SiteTech-Rover |
|---|
| Host: | |
|---|
| Email: | adasilva@sitetech.com |
|---|
|
| Inktomi Slurp |
| Agent: | Slurp/2.0 |
|---|
| Host: | *.inktomi.com |
|---|
| Email: | slurp@inktomi.com |
|---|
|
| Smart Spider |
| Agent: | ESISmartSpider/2.0 |
|---|
| Host: | 207.16.241.* |
|---|
| Email: | ken@engsoftware.com |
|---|
|
| Snooper |
| Agent: | Snooper/b97_01 |
|---|
| Host: | |
|---|
| Email: | melnicki@sit.ca |
|---|
|
| Solbot |
| Agent: | Solbot/1.0 LWP/5.07 |
|---|
| Host: | robot*.sol.no |
|---|
| Email: | ftj@sys.sol.no |
|---|
|
| Spanner |
| Agent: | Spanner/1.0 (Linux 2.0.27 i586) |
|---|
| Host: | *.kluge.net |
|---|
| Email: | felicity@kluge.net |
|---|
|
| SpiderBot |
| Agent: | SpiderBot/1.0 |
|---|
| Host: | * |
|---|
| Email: | spidrboticruzado@solaria.emp.ubu.es |
|---|
|
| Spry Wizard Robot |
| Agent: | no |
|---|
| Host: | wizard.spry.com or tiger.spry.com |
|---|
| Email: | info@spry.com |
|---|
|
| Site Searcher |
| Agent: | ssearcher100 |
|---|
| Host: | * |
|---|
| Email: | zackware@hotmail.com |
|---|
|
| Suke |
| Agent: | suke/*.* |
|---|
| Host: | * |
|---|
| Email: | robot@kuro.net |
|---|
|
| Sven |
| Agent: | |
|---|
| Host: | 24.113.12.29 |
|---|
| Email: | rhondle@home.com |
|---|
|
| TACH Black Widow |
| Agent: | Mozilla/3.0 (Black Widow v1.1.0; Linux 2.0.27; Dec 31 1997 12:25:00 |
|---|
| Host: | *.theautochannel.com |
|---|
| Email: | mjenn@theautochannel.com |
|---|
|
| Tarantula |
| Agent: | Tarantula/1.0 |
|---|
| Host: | yes |
|---|
| Email: | Markus.Hoevener@evision.de |
|---|
|
| tarspider |
| Agent: | tarspider |
|---|
| Host: | |
|---|
| Email: | chakl@fu-berlin.de |
|---|
|
| Tcl W3 Robot |
| Agent: | dlw3robot/x.y (in TclX by http://hplyot.obspm.fr/~dl/) |
|---|
| Host: | hplyot.obspm.fr |
|---|
| Email: | dl@hplyot.obspm.fr |
|---|
|
| TechBOT |
| Agent: | TechBOT |
|---|
| Host: | techaid.net |
|---|
| Email: | techbot@techaid.net |
|---|
|
| Templeton |
| Agent: | Templeton/{version} for {platform} |
|---|
| Host: | * |
|---|
| Email: | nealk@net66.com |
|---|
|
| TitIn |
| Agent: | TitIn/0.2 |
|---|
| Host: | barok.foi.hr |
|---|
| Email: | dpavlin@foi.hr |
|---|
|
| TITAN |
| Agent: | TITAN/0.1 |
|---|
| Host: | nlptitan.isl.ntt.jp |
|---|
| Email: | hayashi@nttnly.isl.ntt.jp |
|---|
|
| The TkWWW Robot |
| Agent: | |
|---|
| Host: | |
|---|
| Email: | scott@cs.sunyit.edu |
|---|
|
| UCSD Crawl |
| Agent: | UCSD-Crawler |
|---|
| Host: | nuthaus.mib.org scilib.ucsd.edu |
|---|
| Email: | atilghma@mib.org |
|---|
|
| URL Check |
| Agent: | urlck/1.2.3 |
|---|
| Host: | * |
|---|
| Email: | dave@cutternet.com |
|---|
|
| URL Spider Pro |
| Agent: | URL Spider Pro |
|---|
| Host: | * |
|---|
| Email: | greg@innerprise.net |
|---|
|
| Valkyrie |
| Agent: | Valkyrie/1.0 libwww-perl/0.40 |
|---|
| Host: | *.c.u-tokyo.ac.jp |
|---|
| Email: | harada@graco.c.u-tokyo.ac.jp |
|---|
|
| Victoria |
| Agent: | Victoria/1.0 |
|---|
| Host: | |
|---|
| Email: | adrianh@oneworld.co.uk |
|---|
|
| vision-search |
| Agent: | vision-search/3.0' |
|---|
| Host: | dylan.ius.cs.cmu.edu |
|---|
| Email: | har@cs.cmu.edu |
|---|
|
| Voyager |
| Agent: | Voyager/0.0 |
|---|
| Host: | *.lisa.co.jp |
|---|
| Email: | voyager@lisa.co.jp |
|---|
|
| VWbot |
| Agent: | VWbot_K/4.2 |
|---|
| Host: | vancouver-webpages.com |
|---|
| Email: | andrew@vancouver-webpages.com |
|---|
|
| The NWI Robot |
| Agent: | w3index |
|---|
| Host: | nwi.ub2.lu.se, mars.dtv.dk and a few others |
|---|
| Email: | siglun@munin.ub2.lu.se |
|---|
|
| W3M2 |
| Agent: | W3M2/x.xxx |
|---|
| Host: | * |
|---|
| Email: | tronche@lri.fr |
|---|
|
| the World Wide Web Wanderer |
| Agent: | WWWWanderer v3.0 |
|---|
| Host: | *.mit.edu |
|---|
| Email: | mkgray@mit.edu |
|---|
|
| WebBandit Web Spider |
| Agent: | WebBandit/1.0 |
|---|
| Host: | ix.netcom.com |
|---|
| Email: | wooger@ix.netcom.com |
|---|
|
| WebCatcher |
| Agent: | WebCatcher/1.0 |
|---|
| Host: | oscar.lang.nagoya-u.ac.jp |
|---|
| Email: | reiji@infonia.ne.jp |
|---|
|
| WebCopy |
| Agent: | WebCopy/(version) |
|---|
| Host: | * |
|---|
| Email: | vparada@inf.utfsm.cl |
|---|
|
| webfetcher |
| Agent: | WebFetcher/0.8, |
|---|
| Host: | * |
|---|
| Email: | webfetch@ontv.com |
|---|
|
| The Webfoot Robot |
| Agent: | |
|---|
| Host: | phoenix.doc.ic.ac.uk |
|---|
| Email: | L.McLoughlin@doc.ic.ac.uk |
|---|
|
| weblayers |
| Agent: | weblayers/0.0 |
|---|
| Host: | |
|---|
| Email: | loic@afp.com |
|---|
|
| WebLinker |
| Agent: | WebLinker/0.0 libwww-perl/0.1 |
|---|
| Host: | |
|---|
| Email: | jcasey@maths.tcd.ie |
|---|
|
| WebMirror |
| Agent: | no |
|---|
| Host: | |
|---|
| Email: | sfchan@mailhost.net |
|---|
|
| The Web Moose |
| Agent: | WebMoose/0.0.0000 |
|---|
| Host: | msn.com |
|---|
| Email: | mikeblas@nwlink.com |
|---|
|
| WebQuest |
| Agent: | WebQuest/1.0 |
|---|
| Host: | 210.121.146.2, 210.113.104.1, 210.113.104.2 |
|---|
| Email: | cty@cosmonet.co.kr |
|---|
|
| Digimarc MarcSpider |
| Agent: | Digimarc WebReader/1.2 |
|---|
| Host: | 206.102.3.* |
|---|
| Email: | wmreader@digimarc.com |
|---|
|
| WebReaper |
| Agent: | WebReaper [webreaper@otway.com] |
|---|
| Host: | * |
|---|
| Email: | webreaper@otway.com |
|---|
|
| webs |
| Agent: | webs@recruit.co.jp |
|---|
| Host: | lemon.recruit.co.jp |
|---|
| Email: | dew@wwwadmin.rnet.or.jp |
|---|
|
| Websnarf |
| Agent: | |
|---|
| Host: | |
|---|
| Email: | charles@fma.com |
|---|
|
| WebSpider |
| Agent: | |
|---|
| Host: | several |
|---|
| Email: | u610468@csi.uottawa.ca |
|---|
|
| WebVac |
| Agent: | webvac/1.0 |
|---|
| Host: | |
|---|
| Email: | tim@federated.com |
|---|
|
| webwalk |
| Agent: | webwalk |
|---|
| Host: | |
|---|
| Email: | |
|---|
|
| WebWalker |
| Agent: | WebWalker/1.10 |
|---|
| Host: | * |
|---|
| Email: | fccheong@cs.berkeley.edu |
|---|
|
| WebWatch |
| Agent: | WebWatch |
|---|
| Host: | |
|---|
| Email: | janos@specter.com |
|---|
|
| Wget |
| Agent: | Wget/1.4.0 |
|---|
| Host: | * |
|---|
| Email: | hniksic@srce.hr |
|---|
|
| WhoWhere Robot |
| Agent: | |
|---|
| Host: | spica.whowhere.com |
|---|
| Email: | rupesh@whowhere.com |
|---|
|
| w3mir |
| Agent: | w3mir |
|---|
| Host: | |
|---|
| Email: | w3mir-core@usit.uio.no |
|---|
|
| WebStolperer |
| Agent: | WOLP/1.0 mda/1.0 |
|---|
| Host: | www.suchfibel.de |
|---|
| Email: | mda@suchfibel.de |
|---|
|
| The Web Wombat |
| Agent: | no |
|---|
| Host: | qwerty.intercom.com.au |
|---|
| Email: | phill@intercom.com.au |
|---|
|
| The World Wide Web Worm |
| Agent: | |
|---|
| Host: | piper.cs.colorado.edu |
|---|
| Email: | mcbryan@piper.cs.colorado.edu |
|---|
|
| WWWC Ver 0.2.5 |
| Agent: | WWWC/0.25 (Win95) |
|---|
| Host: | |
|---|
| Email: | naka@kinet.or.jp |
|---|
|
| WebZinger |
| Agent: | none |
|---|
| Host: | http://www.imaginon.com/wzindex.html * |
|---|
| Email: | info@imaginon.com |
|---|
|
| XGET |
| Agent: | XGET/0.7 |
|---|
| Host: | * |
|---|
| Email: | shige@mh1.117.ne.jp |
|---|
|
| Nederland.zoek |
| Agent: | Nederland.zoek |
|---|
| Host: | 193.67.110.* |
|---|
| Email: | zoek@nederland.net |
|---|
|
