Thanks, everyone! This is super helpful. I tried the `--proxy` flag with my brightdata proxy URL, and it seems to be working now. I also added `--sleep-interval` to slow things down, and that’s made a big difference.
One quick follow-up: has anyone had issues with metadata not being fully scraped? I’m getting most of the data, but some fields like upload date are missing. Any ideas?
Also, big thanks for the tip about `--force-ipv4`—that fixed a weird connection issue I was having. You guys are lifesavers!
One quick follow-up: has anyone had issues with metadata not being fully scraped? I’m getting most of the data, but some fields like upload date are missing. Any ideas?
Also, big thanks for the tip about `--force-ipv4`—that fixed a weird connection issue I was having. You guys are lifesavers!