I’ve scraped dynamic sites with n8n, but it’s a bit hacky.
The HTTP node alone won’t cut it—you gotta use the Browserless node or the Puppeteer workaround. Also, some sites detect headless browsers, so you might need to tweak user-agents.
Rate-limiting? Yeah, it’s a pain. Try adding random delays between requests. Or just use ScrapingBee if you wanna avoid the hassle.
The HTTP node alone won’t cut it—you gotta use the Browserless node or the Puppeteer workaround. Also, some sites detect headless browsers, so you might need to tweak user-agents.
Rate-limiting? Yeah, it’s a pain. Try adding random delays between requests. Or just use ScrapingBee if you wanna avoid the hassle.