How to setup web scrapper – any tips for beginners? or What’s the easiest way to setup web scrapper f

18 Replies, 1390 Views

Wow, thanks everyone! Didn’t expect so many tips on how to setup web scrapper.

Tried BeautifulSoup last night and it worked! Scraped my first page (just titles, but still).

Quick Q: How do I know if a site’s okay with scraping? Just robots.txt? Also, what’s a good delay—2 seconds or more?

P.S. The quotes.toscrape.com site was clutch. 🙌

Messages In This Thread



Users browsing this thread: 1 Guest(s)