14 May 2012

Download a list of Urls

cat urls.txt | wget -i- -T 10 -t 3 --waitretry 1
 
or
 
cat urls.txt | xargs -n1 curl -O --max-time 10 --retry 3
 
or even better:
 
Use wget's --input-file option directly:

wget -i urls.txt -T 10 -t 3 --waitretry 1




biOos

No comments: