OP here—thanks for all the tips! Gonna try Scrapy with rotating proxies and see how it goes.
Quick Q: Anyone got a good tutorial for setting up Scrapy with Redis? Found a few but not sure which one’s up-to-date.
Also, shoutout to the person who suggested checking for APIs—totally saved me from overcomplicating it lol.
Quick Q: Anyone got a good tutorial for setting up Scrapy with Redis? Found a few but not sure which one’s up-to-date.
Also, shoutout to the person who suggested checking for APIs—totally saved me from overcomplicating it lol.
