Thanks for all the tips, y’all!
Tried BeautifulSoup + requests first and it worked for a basic site, but then hit a wall with JS-heavy pages.
Gonna test `requests-html` next since it seems lighter than Selenium.
Quick Q: How do you handle captchas? Ran into one after like 20 requests lol.
Tried BeautifulSoup + requests first and it worked for a basic site, but then hit a wall with JS-heavy pages.
Gonna test `requests-html` next since it seems lighter than Selenium.
Quick Q: How do you handle captchas? Ran into one after like 20 requests lol.
