← Back to glossary definition
Web scraping and extraction
Crawl
A run of a web crawler across a site or set of sites, discovering and fetching pages according to rules on scope, depth and rate.
In practice
Scope rules matter: an unbounded crawl spends budget on pages that will never yield a record.
at import.io
Import.io extractors are built by point-and-click, AI assistance or engineers, with rendering, pagination and schema detection built in.
Web data extraction →