Hey, I’ve been scraping airnow for a project, and yeah, it’s a pain. I ended up using their API with a caching layer to reduce the number of requests.
If you’re scraping, try using a headless Chrome with Puppeteer. It’s faster than Selenium and handles JS-heavy sites better.
If you’re scraping, try using a headless Chrome with Puppeteer. It’s faster than Selenium and handles JS-heavy sites better.