How to setup web scrapper – any tips for beginners? or What’s the easiest way to setup web scrapper f

18 Replies, 1612 Views

For how to setup web scrapper, I’d say:

- Start with static sites (no JS).
- Use browser dev tools (F12) to find elements.
- BeautifulSoup is easier, but Scrapy’s better for big projects.

Also, don’t forget `try-except` blocks! Sites change, and your scraper will break. A lot.

PS: If you get blocked, try proxies (free ones are meh tho).

Messages In This Thread



Users browsing this thread: 1 Guest(s)