Wow, thanks for all the tips! I tried `--limit-rate` and `--random-wait`, and it’s way smoother now. Still hitting some 403s though—maybe I’ll test `grab-site` next.
One follow-up: anyone know how to handle sites that load content via JS? wget whole site offline just grabs the empty shells.
(Also, `archivebox` looks sick—definitely checking that out!)
One follow-up: anyone know how to handle sites that load content via JS? wget whole site offline just grabs the empty shells.
(Also, `archivebox` looks sick—definitely checking that out!)
