Hey! I feel your pain with scrap semrush selenium. Dynamic elements can be such a pain. Have you tried using `wait.until` in Selenium? It’s a lifesaver for waiting until elements load.
Also, for avoiding blocks, rotating proxies is key. I use ScraperAPI, and it’s been pretty solid for me.
As for libraries, Selenium is great for dynamic stuff, but BeautifulSoup is faster for static pages. Maybe try combining both?
Also, for avoiding blocks, rotating proxies is key. I use ScraperAPI, and it’s been pretty solid for me.
As for libraries, Selenium is great for dynamic stuff, but BeautifulSoup is faster for static pages. Maybe try combining both?