dlmanager

dlmanager is Python 2 and 3 download manager library, with the following features:

• Download files in background and in parallel
• Cancel downloads
• store downloads in a given directory, avoiding re-downloading files
• Limit the size of this directory, removing oldest files

Example

from dlmanager import DownloadManager, PersistLimit

manager = DownloadManager(
    "dlmanager-destir",
    persist_limit=PersistLimit(
        size_limit=1073741824,  #  1 GB max
        file_limit=10,  # force to keep 10 files even if size_limit is reached
    )
)

# Start downloads in background
# Note that if files are already present, this is a no-op.
manager.download(url1)
manager.download(url2)

# Wait for completion
try:
    manager.wait()
except:
    manager.cancel()
    raise

Installation

Use pip:

pip install -U dlmanager