Hey! Selenium web scraping can definitely be a pain with dynamic content. One thing that helped me was using `execute_script` to interact with elements directly through JavaScript. It’s faster than waiting for the DOM to update.
For avoiding blocks, rotating proxies is a must. I use Bright Data (formerly Luminati) for proxies, and it’s been solid. Also, tweaking headers like `User-Agent` and `Referer` can help you blend in.
If you’re tired of `WebDriverWait`, check out Playwright. It’s like Selenium but handles dynamic content way better.
Good luck!
For avoiding blocks, rotating proxies is a must. I use Bright Data (formerly Luminati) for proxies, and it’s been solid. Also, tweaking headers like `User-Agent` and `Referer` can help you blend in.
If you’re tired of `WebDriverWait`, check out Playwright. It’s like Selenium but handles dynamic content way better.
Good luck!