Yo, scraping jobs from the internet is a grind, but you’re on the right track with BeautifulSoup and Scrapy. If you’re looking for something more job-specific, check out Jobinja or Indeed’s API. They’re not exactly scraping tools, but they give you access to job listings without all the headaches of captchas and blocks.
For proxies, I’ve had decent luck with free ones from ProxyScrape, but they’re hit or miss. If you’re serious, invest in a paid service like Oxylabs.
For proxies, I’ve had decent luck with free ones from ProxyScrape, but they’re hit or miss. If you’re serious, invest in a paid service like Oxylabs.