Thanks for all the suggestions, guys! I’ve been trying out Scrapy with Bright Data proxies, and it’s been working way better than my previous attempts.
Still running into some CAPTCHAs, though. Anyone have tips on how to handle those without getting blocked? Also, has anyone tried using headless browsers like Puppeteer for scraping craigslist with phone numbers? Curious if it’s worth the extra effort.
Still running into some CAPTCHAs, though. Anyone have tips on how to handle those without getting blocked? Also, has anyone tried using headless browsers like Puppeteer for scraping craigslist with phone numbers? Curious if it’s worth the extra effort.