New York University Libraries   New York University Libraries.

GLOSSARY DEFINITION

Spider, Robot, Wanderer, Crawler, Webcrawler:

A computer program that travels the Internet to locate such resources as Web documents, FTP archives, and Gopher documents. It indexes the documents in a database, which is then searched using a search engine.

Return/Close