Wow, thanks everyone! Didn’t expect so many replies.
I tried the `requests` + `BeautifulSoup` combo and it worked for a test scrape. Got blocked once lol but added `time.sleep(3)` and it’s fine now.
Didn’t know about the GitHub API—gonna look into that next.
Quick Q: Anyone know how to handle login walls? Some articles are private.
(And yeah, the API sounds way better. Should’ve started there haha.)
I tried the `requests` + `BeautifulSoup` combo and it worked for a test scrape. Got blocked once lol but added `time.sleep(3)` and it’s fine now.
Didn’t know about the GitHub API—gonna look into that next.
Quick Q: Anyone know how to handle login walls? Some articles are private.
(And yeah, the API sounds way better. Should’ve started there haha.)