What’s the Best Way to Scrape a Site Without Getting Blocked? or How Can I Legally and Ethically Scra

12 Replies, 1144 Views

OP reply:
Wow, thanks for all the tips! Tried slowing down my requests + using proxies, and it’s working way better.

Still struggling with CAPTCHAs tho—anyone got a fav service for that? Also, is Scrapy *that* much better than BeautifulSoup for big projects?

Appreciate y’all!

Messages In This Thread



Users browsing this thread: 1 Guest(s)