Best Practices for Using wget to Scrape URLs: Any Tips or Pitfalls to Avoid?

Hey! For scraping, I’d recommend using `--restrict-file-names=unix` to avoid weird filenames. Makes organizing easier.

Also, `--no-parent` is a must if you’re scraping specific directories.

For rate-limiting, I use `--wait=10` to add a 10-second delay. Works well for most sites.