---
title: Crawler
slug: Glossary/Crawler
tags:
  - Browser
  - Crawler
  - Glossary
  - Infrastructure
---
A web crawler is a program, often called a bot or robot, which systematically browses the {{glossary("World Wide Web","Web")}} to collect data from webpages. Typically search engines (e.g. Google, Bing, etc.) use crawlers to build indexes.

## See also

- {{Interwiki("wikipedia", "Web crawler")}} on Wikipedia
- {{Glossary("Search engine")}} (Glossary)
