How to use wget to save a whole site offline for browsing later? or What's the best way to download a

16 Replies, 1878 Views

If you’re doing wget whole site offline, don’t forget `--random-wait` to mimic human behavior. Servers hate getting slammed with back-to-back requests.

And yeah, skip the junk with `--exclude-directories=/tmp,/feed`.

But if wget’s not cutting it, `grab-site` is a newer tool that handles JS-heavy sites better. Worth a look!

Messages In This Thread



Users browsing this thread: 1 Guest(s)