wget

Updated: September 28, 2024

Wget will non-interactively download files off the web using HTTP HTTPS FTP.


DOWNLOAD FILES FROM FULL PATHS

wget -r https://www.ubuntu.com    # possible, but grabs a lot of files you dont need.

wget -r -A "iso" https://www.ubuntu.com   # this is still a bit smash n grab

wget -i filestodownload.txt   # file contains just urls of files

wget -T 5 -i filestodownload.txt    # specify a timeout

wget --quota=100m - filestodownload.txt   # limits amount of data to retrieve (100mb)

wget -c   # continue a download after a connection drops

-p, --page-requisites   # grabs all files necessary to display a given page

-k, --convert-links     #  makes links work loacally so the website copy will function

wget -p -k http://www.example.com/

Download file from Google Drive

wget --no-check-certificate 'https://docs.google.com/uc?export=download&id=FILEID' -O FILENAME