Sign inSign up

j4ym0/gallery-dl

By j4ym0

Updated about 4 years ago

gallery-dl is a command-line program to download image collections from several image hosting sites.

Image
0

2.2K

j4ym0/gallery-dl repository overview

gallery-dl is a command-line program to download image galleries and collections from several image hosting sites (see Supported Sites). It is a cross-platform tool with many configuration options and powerful filenaming capabilities <Formatting_>.

Please refer to https://github.com/mikf/gallery-dl

Start with

docker -v ./downloads:/downlodas j4ym0/gallery-dl ...

then add any options from usage excluding gallery-dl e.g. docker -v ./downloads:/downlodas j4ym0/gallery-dl -u "<username>" -p "<password>" "https://twitter.com/i/web/status/604341487988576256"

Usage

To use gallery-dl simply call it with the URLs you wish to download images from:

.. code:: bash

gallery-dl [OPTION]... URL...

See also :code:gallery-dl --help.

Examples

Download images; in this case from danbooru via tag search for 'bonocho':

.. code:: bash

gallery-dl "https://danbooru.donmai.us/posts?tags=bonocho"

Get the direct URL of an image from a site supporting authentication with username & password:

.. code:: bash

gallery-dl -g -u "<username>" -p "<password>" "https://twitter.com/i/web/status/604341487988576256"

Filter manga chapters by language and chapter number:

.. code:: bash

gallery-dl --chapter-filter "lang == 'fr' and 10 <= chapter < 20" "https://mangadex.org/title/2354/"

| Search a remote resource for URLs and download images from them: | (URLs for which no extractor can be found will be silently ignored)

.. code:: bash

gallery-dl "r:https://pastebin.com/raw/FLwrCYsT"

If a site's address is nonstandard for its extractor, you can prefix the URL with the extractor's name to force the use of a specific extractor:

.. code:: bash

gallery-dl "tumblr:https://sometumblrblog.example"

Configuration

Configuration files for gallery-dl use a JSON-based file format.

| For a (more or less) complete example with options set to their default values, see gallery-dl.conf_. | For a configuration file example with more involved settings and options, see gallery-dl-example.conf_. | A list of all available configuration options and their descriptions can be found in configuration.rst_. |

gallery-dl searches for configuration files in the following places:

Windows: * %APPDATA%\gallery-dl\config.json * %USERPROFILE%\gallery-dl\config.json * %USERPROFILE%\gallery-dl.conf

(``%USERPROFILE%`` usually refers to the user's home directory,
i.e. ``C:\Users\<username>\``)

Linux, macOS, etc.: * /etc/gallery-dl.conf * ${XDG_CONFIG_HOME}/gallery-dl/config.json * ${HOME}/.config/gallery-dl/config.json * ${HOME}/.gallery-dl.conf

Values in later configuration files will override previous ones.

Command line options will override all related settings in the configuration file(s), e.g. using --write-metadata will enable writing metadata using the default values for all postprocessors.metadata.* settings, overriding any specific settings in configuration files.

Authentication

Username & Password

Some extractors require you to provide valid login credentials in the form of a username & password pair. This is necessary for nijie and optional for aryion, danbooru, e621, exhentai, idolcomplex, imgbb, inkbunny, instagram, mangadex, mangoxo, pillowfort, sankaku, subscribestar, tapas, tsumino, twitter, and zerochan.

You can set the necessary information in your configuration file (cf. gallery-dl.conf_)

.. code:: json

{
    "extractor": {
        "twitter": {
            "username": "<username>",
            "password": "<password>"
        }
    }
}

or you can provide them directly via the :code:-u/--username and :code:-p/--password or via the :code:-o/--option command-line options

.. code:: bash

gallery-dl -u <username> -p <password> URL
gallery-dl -o username=<username> -o password=<password> URL

Cookies

For sites where login with username & password is not possible due to CAPTCHA or similar, or has not been implemented yet, you can use the cookies from a browser login session and input them into gallery-dl.

This can be done via the cookies <https://github.com/mikf/gallery-dl/blob/master/docs/configuration.rst#extractorcookies>__ option in your configuration file by specifying

  • | the path to a Mozilla/Netscape format cookies.txt file exported by a browser addon | (e.g. Get cookies.txt <https://chrome.google.com/webstore/detail/get-cookiestxt/bgaddhkoddajcdgocldbbfleckgcbcid/>__ for Chrome, Export Cookies <https://addons.mozilla.org/en-US/firefox/addon/export-cookies-txt/>__ for Firefox)

  • | a list of name-value pairs gathered from your browser's web developer tools | (in Chrome <https://developers.google.com/web/tools/chrome-devtools/storage/cookies>, in Firefox <https://developer.mozilla.org/en-US/docs/Tools/Storage_Inspector>)

For example:

.. code:: json

{
    "extractor": {
        "instagram": {
            "cookies": "$HOME/path/to/cookies.txt"
        },
        "patreon": {
            "cookies": {
                "session_id": "K1T57EKu19TR49C51CDjOJoXNQLF7VbdVOiBrC9ye0a"
            }
        }
    }
}

You can also specify a cookies.txt file with the :code:--cookies command-line option:

.. code:: bash

gallery-dl --cookies "$HOME/path/to/cookies.txt" URL

OAuth

gallery-dl supports user authentication via OAuth_ for deviantart, flickr, reddit, smugmug, tumblr, and mastodon instances. This is mostly optional, but grants gallery-dl the ability to issue requests on your account's behalf and enables it to access resources which would otherwise be unavailable to a public user.

To link your account to gallery-dl, start by invoking it with oauth:<sitename> as an argument. For example:

.. code:: bash

gallery-dl oauth:flickr

You will be sent to the site's authorization page and asked to grant read access to gallery-dl. Authorize it and you will be shown one or more "tokens", which should be added to your configuration file.

To authenticate with a mastodon instance, run gallery-dl with oauth:mastodon:<instance> as argument. For example:

.. code:: bash

gallery-dl oauth:mastodon:pawoo.net
gallery-dl oauth:mastodon:https://mastodon.social/

.. _gallery-dl.conf: https://github.com/mikf/gallery-dl/blob/master/docs/gallery-dl.conf .. _gallery-dl-example.conf: https://github.com/mikf/gallery-dl/blob/master/docs/gallery-dl-example.conf .. _configuration.rst: https://github.com/mikf/gallery-dl/blob/master/docs/configuration.rst .. _Supported Sites: https://github.com/mikf/gallery-dl/blob/master/docs/supportedsites.md .. _Formatting: https://github.com/mikf/gallery-dl/blob/master/docs/formatting.md

.. _Python: https://www.python.org/downloads/ .. _PyPI: https://pypi.org/ .. _pip: https://pip.pypa.io/en/stable/ .. _Requests: https://requests.readthedocs.io/en/master/ .. _FFmpeg: https://www.ffmpeg.org/ .. _yt-dlp: https://github.com/yt-dlp/yt-dlp .. _youtube-dl: https://ytdl-org.github.io/youtube-dl/ .. _PySocks: https://pypi.org/project/PySocks/ .. _brotli: https://github.com/google/brotli .. _brotlicffi: https://github.com/python-hyper/brotlicffi .. _pyOpenSSL: https://pyopenssl.org/ .. _Snapd: https://docs.snapcraft.io/installing-snapd .. _OAuth: https://en.wikipedia.org/wiki/OAuth .. _Chocolatey: https://chocolatey.org/install .. _Scoop: https://scoop.sh

.. |pypi| image:: https://img.shields.io/pypi/v/gallery-dl.svg :target: https://pypi.org/project/gallery-dl/

.. |build| image:: https://github.com/mikf/gallery-dl/workflows/tests/badge.svg :target: https://github.com/mikf/gallery-dl/actions

.. |gitter| image:: https://badges.gitter.im/gallery-dl/main.svg :target: https://gitter.im/gallery-dl/main

Tag summary

Content type

Image

Digest

sha256:f66e45e5f

Size

71.9 MB

Last updated

about 4 years ago

docker pull j4ym0/gallery-dl