[b]"What's the best way to scrape cards data using Python?"[/b] or [b]"How can I efficiently scrape cards data wit

20 Replies, 1799 Views

Subject: What's the best way to scrape cards data using Python?

Hey everyone!

I'm kinda new to this whole scrape cards python thing and could use some advice.

Tried BeautifulSoup + requests, but some sites are throwing JS-rendered content at me. Heard Selenium might work better? Or is there a lighter lib like `scrapy` or `playwright` that y'all recommend?

Also, how do you handle pagination or dynamic loading? Some sites lazy-load cards, and it's a pain.

Any tips for a beginner? Even basic stuff like rate-limiting or avoiding bans would help.

Thanks in advance!

(PS: If you’ve got code snippets, even better—I learn better by seeing examples.)

Messages In This Thread
[b]"What's the best way to scrape cards data using Python?"[/b] or [b]"How can I efficiently scrape cards data wit - by - 08-09-2024, 05:22 AM



Users browsing this thread: 1 Guest(s)