Selenium scraping youtube yt-dlp is a nightmare sometimes, but here’s what I do:
- Use `--proxy` in yt-dlp to avoid IP bans.
- For dynamic content, I use `wait.until` with specific element locators.
- And yeah, YouTube’s layout changes are the worst. I’ve started using a headless browser to reduce detection.
Check out Scrapy if you want to try something other than Selenium. It’s a bit of a learning curve but worth it.
- Use `--proxy` in yt-dlp to avoid IP bans.
- For dynamic content, I use `wait.until` with specific element locators.
- And yeah, YouTube’s layout changes are the worst. I’ve started using a headless browser to reduce detection.
Check out Scrapy if you want to try something other than Selenium. It’s a bit of a learning curve but worth it.