What's the best way to start crawling with Python for web data? or Need advice on crawling with Pytho

18 Replies, 1917 Views

Wow, thanks for all the replies! Super helpful.

I tried `requests` + `BeautifulSoup` last night and it worked like a charm for a simple site. Gonna check out `playwright` next for the dynamic stuff.

Quick Q: How do you guys handle CAPTCHAs? Ran into one and got stuck lol.

Also, big shoutout for the Real Python tip—their stuff is gold.

Messages In This Thread



Users browsing this thread: 1 Guest(s)