Skip to content

Instantly share code, notes, and snippets.

@f0r34chb3t4
Created August 23, 2018 05:13
Show Gist options
  • Save f0r34chb3t4/de53e0c8873c731bf27bc929b525e90f to your computer and use it in GitHub Desktop.
Save f0r34chb3t4/de53e0c8873c731bf27bc929b525e90f to your computer and use it in GitHub Desktop.
AbachoBOT
anarchie
antibot
appie
ASPSeek
asterias
attach
autoemailspider
B2w
BackDoorBot
BackWeb
Baidu
Bandit
BatchFTP
Black Hole
BlackWidow
BlowFish
Bot
Bot mailto
BotALot
Buddy
BuiltBotTough
Bullseye
bumblebee
BunnySlippers
CheeseBot
CherryPicker
CherryPickerElite
CherryPickerSE
ChinaClaw
ClariaBot
clsHTTP
COAST WebMaster
ColdFusion
Collector
Copier
CopyRightCheck
cosmos
Crescent
curl
DA
Diamond
DISCo Pump
discobot
DittoSpyder
dloader
Download Demon
Download Wonder
Downloader
Drip
DTS Agent
EasyDL
eCatch
EirGrabber
EmailCollector
EmailSiphon
EmailWolf
EroCrawler
Express WebPictures
ExtractorPro
Extreme Picture Finder
EyeNetIE
FAST WebCrawler
Fetch API Request
FileHound
FlashGet
FlickBot
FreeFind.com
FrontPage
Generic
GetRight
GetSmart
Go!Zilla
Go-Ahead-Got-It
gotit
Grabber
GrabNet
Grafula
Gulliver
Harvest
Heretrix
HitboxDoctor
hloader
HMView
HTTPapp
httpfetcher
httplib
httpscraper
HTTPTrack
HTTPviewer
HTTrack
humanlinks
ia_archiver
InfoNaviRobot
InterGET
Internet Ninja
InternetSeer.com
Iria
IRLbot
Java
JennyBot
JetCar
JoBo
JOC
JOC Web Spider
Jonzilla
JustView
Kenjin Spider
Keyword Density
Lachesis
larbin
LeechFTP
LexiBot
lftp
Libby_
libWeb
libwww-perl
libwwwperl
likse
Link
LinkextractorPro
LinkScan
LinkWalker
lwp request
lwp-trivial
Mag-Net
Magnet
Mass Downloader
Mata Hari
Memo
Mercator
Metacarta
Mewsoft Search Engine
MFC_Tear_Sample
Microsoft URL Control
MicrosoftURL
MIDown tool
MIIxpc
Mirror
Missigua
Mister PiX
moget
MSFrontPage
MSIECrawler
NationalDirectory WebSpider
Navroad
NearSite
Net Probe
Net Vampire
NetAnts
NetMechanic
NetResearchServer
NetSpider
NetZip
nexuscache
NICErsPRO
Nikto
Ninja
NPBot
oBot
Octopus
Offline Explorer
onestop
Openfind
Openfind data gatherer
OrangeBot
our agent
PageGrabber
Papa Foto
pavuk
pcBrowser
Perl
PHP
PHP version
PHPot
Ping
PingALink Monitoring Services
Pockey
Pompos
ProPowerBot
ProWebWalker
psbot
Pump
Python urllib
Python-urllib
QueryN
RealDownload
Reaper
Recorder
RepoMonkey
Scooter
ScoutAbout
Siphon
sitecheck.internetseer.com
SiteSnagger
slysearch
SmartDownload
Snake
Snapbot
Snoopy
SpaceBison
SpankBot
spanner
Spinne
Sqworm
Stealer
Stripper
Sucker
SuperBot
SuperHTTP
Surfbot
suzuran
Szukacz
tAkeOut
Teleport Pro
Telesoft
The Intraformant
TheNomad
TightTwatBot
Titan
toCrawl
True_Robot
turingos
TurnitinBot
UrlDispatcher
URLy Warning
Vacuum
Vagabondo
Vayala
VCI
Vintage
VoidEYE
W3C_Validator
Web Downloader
Web Image Collector
Web Sucker
WebAuto
WebCopier
Webdownloader
WebEnhancer
WebFetch
Webhook
Webminer
Webmirror
Webmole
WebReaper
WebSauger
Website
Website Quester
Websites
Webster
Webster Pro
WebStripper
Websucker
WebViewer
WebWhacker
WebZIP
WebZip
Wells
Wget
Whacker
Widow
Wildsoft Surfer
WinHttp
WinHttpRequest
WWW-Collector-E
WWWOFFLE
Xaldon
Xaldon WebSpider
Xara
Xenu
YahooYSMcm
Yandex
Zade
ZBot
zermelo
zerxbot
Zeus
ZyBorg
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment