Skip to content

fix(crawlers): Report robots.txt skips in AdaptivePlaywrightCrawler sub crawlers - #2452

Open
Mantisus wants to merge 2 commits into
apify:masterfrom
Mantisus:adaptive-robots-txt
Open

Mantisus wants to merge 2 commits into
apify:masterfrom
Mantisus:adaptive-robots-txt

address review

37c83aa
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 notice
factory-review / Look up the review state
succeeded Nov 16, 2026 in 6s