How to use curl commnsf to download from url list file efficiently? or Best way to run curl commnsf t

20 Replies, 2244 Views

Hey! For curl commnsf to download from url list file, you can use `xargs` to speed things up. Try this:

`xargs -n 1 curl -O < urls.txt`

If you wanna go parallel, install GNU parallel and do:

`parallel -j 8 curl -O {} :::: urls.txt`

Handles spaces fine if the URLs are properly formatted.

Messages In This Thread



Users browsing this thread: 1 Guest(s)