Use case
Web Scraping
Collect public pages at a steady rate.
Point a collector at public catalog, listing, or documentation pages. Respect robots.txt, the site’s terms, and the ProxyOnly acceptable use policy. Do not use proxies to bypass logins or access controls.