Welcome to DataDownloader’s documentation!#

Make downloading scientific data much easier

Introduction#

DataDownloader is a user-friendly package for downloading files using HTTP/HTTPS. It currently includes a downloader module for downloading files, a parse_urls module for parsing URLs, and a services module for managing well-known online services.

Highlight Features#

DataDownloader has several features to make retrieving files easy, including:

Resumable: You can resume aborted downloads automatically when you re-execute the code if website support resuming (status code is 216 or 416 when send a HEAD request to the server supplying a Range header)
Asynchronous: Can download multiple files at the same time when download a single file very slow.
Convenient: Provide a easy way to manage your username and password and parse urls from different sources:
- netrc: Provide a convenient way to manage your username and password via .netrc file, avoiding providing your login information over and over again. See sections netrc for more details.
- parse_urls: Provide various methods to parse urls from different sources. See sections parse_urls for more details
- services: Provide a convenient way to manage well-known online services, currently support: HyP3, LiCSAR, Sentinel-1 orbit data. See sections services for more details