archive.org

List of most popular Bot/Crawler user agents of archive.org

UseragentInfo
Mozilla/5.0 (compatible; archive.org_bot; Archive-It; +http://archive-it.org/files/site-owners.html)
Mozilla/5.0 (compatible; archive.org_bot; Archive-It; http://archive-it.org/files/site-owners.html)
Mozilla/5.0 (compatible; special_archiver/3.3.0 [email protected] https://archive.org/details/archive.org_bot)
Mozilla/5.0 (compatible; archive.org_bot/3.3.0 +http://pandora.nla.gov.au/crawl.html)
ia_archiver/8.9 (Windows NT 3.1; en-US;)
ia_archiver/8.9 (Windows 3.9; en-US;)
ia_archiver/8.9 (Linux 1.0; en-US;)
ia_archiver/8.8 (Windows XP 7.2; en-US;)
ia_archiver/8.8 (Windows XP 3.0; en-US;)
ia_archiver/8.2 (Windows 7.6; en-US;)
ia_archiver/8.1 (Windows 2000 1.9; en-US;)
ia_archiver/8.0 (Windows 2.4; en-US;)
ia_archiver-web.archive.org
Mozilla/5.0 (compatible; special_archiver/3.3.0 [email protected] +https://archive.org/details/archive.org_bot)
Mozilla/5.0 (compatible; archive.org_bot/heritrix-1.15.4 +http://www.archive.org)
Mozilla/5.0 (compatible; archive.org_bot/3.3.0 +http://www.archive.org/details/archive.org_bot)