Skip to content

fix(crawlers): Report robots.txt skips in AdaptivePlaywrightCrawler sub crawlers - #2452

Open
Mantisus wants to merge 2 commits into
apify:masterfrom
Mantisus:adaptive-robots-txt
Open

Mantisus wants to merge 2 commits into
apify:masterfrom
Mantisus:adaptive-robots-txt

Commits

  1. Commits on Nov 15, 2026

  2. Commits on Nov 16, 2026