For how to setup web scrapper, I’d say:
- Start with static sites (no JS).
- Use browser dev tools (F12) to find elements.
- BeautifulSoup is easier, but Scrapy’s better for big projects.
Also, don’t forget `try-except` blocks! Sites change, and your scraper will break. A lot.
PS: If you get blocked, try proxies (free ones are meh tho).
- Start with static sites (no JS).
- Use browser dev tools (F12) to find elements.
- BeautifulSoup is easier, but Scrapy’s better for big projects.
Also, don’t forget `try-except` blocks! Sites change, and your scraper will break. A lot.
PS: If you get blocked, try proxies (free ones are meh tho).
