Answer: webcrawler

AnswerCrossword Clue
WEBCRAWLERInternet bot
WEBCRAWLERBingbot, for one
WEBCRAWLERBot that systematically browses the Internet