Hey! I’ve been scraping semrush with selenium for a project too. For dynamic elements, I use `ExpectedConditions` with `WebDriverWait`. It’s way better than hardcoding delays.
To avoid blocks, I use a proxy service called Oxylabs. It’s not cheap, but it’s reliable.
Also, if you’re open to it, try using Pyppeteer. It’s like Puppeteer but for Python, and it’s lighter than Selenium.
To avoid blocks, I use a proxy service called Oxylabs. It’s not cheap, but it’s reliable.
Also, if you’re open to it, try using Pyppeteer. It’s like Puppeteer but for Python, and it’s lighter than Selenium.