Man, I feel your pain. Tried to scrap semrush selenium last month and got blocked in like 10 mins lol.
What worked for me was:
- Using headless mode BUT with realistic mouse movements (check out PyAutoGUI for that).
- Rotating proxies every 5-10 requests.
- Adding random delays (not fixed ones!).
SEMrush is brutal, so don’t go too fast.
What worked for me was:
- Using headless mode BUT with realistic mouse movements (check out PyAutoGUI for that).
- Rotating proxies every 5-10 requests.
- Adding random delays (not fixed ones!).
SEMrush is brutal, so don’t go too fast.
