Wow, thanks for all the tips, everyone! 🙌
I tried out Scrapy like a few of you suggested, and it’s definitely faster than my old setup. Still getting the hang of it, though.
Also, I set up a proxy rotation with ScrapingBee, and it’s been a game-changer for avoiding blocks.
One quick question—anyone know if airnow has an API? I feel like that might be easier than webscraping airnow data manually.
Thanks again, y’all are awesome! 🍻
I tried out Scrapy like a few of you suggested, and it’s definitely faster than my old setup. Still getting the hang of it, though.
Also, I set up a proxy rotation with ScrapingBee, and it’s been a game-changer for avoiding blocks.
One quick question—anyone know if airnow has an API? I feel like that might be easier than webscraping airnow data manually.
Thanks again, y’all are awesome! 🍻