How to use wget to save a whole site offline for browsing later? or What's the best way to download a

16 Replies, 1894 Views

wget whole site offline works, but it’s *very* 90s. For modern sites, you might need `--execute robots=off` (careful, tho—don’t be a jerk).

Also, `--convert-links` is a lifesaver for local browsing.

But if you’re dealing with dynamic content, `scrapy` or even `puppeteer` might be better. Overkill for simple stuff, but wget can’t do *everything*.

Messages In This Thread



Users browsing this thread: 1 Guest(s)