Hey! Newbie here too. I found that screen scraping web pages works best if you throttle requests. Like, 1 request every 3-5 seconds.
Tools? Start with Requests + BeautifulSoup. If it’s JS-heavy, Selenium or Puppeteer.
Proxies help, but free ones are sketchy. I use Luminati when I’m feeling fancy.
Tools? Start with Requests + BeautifulSoup. If it’s JS-heavy, Selenium or Puppeteer.
Proxies help, but free ones are sketchy. I use Luminati when I’m feeling fancy.
