pddg/galaxy-analyzer repository overview

$ pip isntall -e .
# For MySQL/MariaDB user
$ pip install -e .[mysql]
# For PostgreSQL user
# This will require that PostgreSQL's libraries are installed
$ pip install -e .[postgres]

$ galaxy --help
usage: galaxy [-h] [--version] [--debug] [--log-dir LOG_DIR]
              {crawl,db,load} ...

Ansible Galaxy crawler

optional arguments:
  -h, --help         show this help message and exit
  --version          Show version

LOGGING:
  --debug            Enable debug logging
  --log-dir LOG_DIR  Log output directory

Sub commands:
  {crawl,db,load}
    crawl            Crawl Ansible Galaxy API
    db               Sub command for DB
    load             Role info from JSON to DB

$ galaxy crawl \
    /path/to/output \
    --interval 5

$ galaxy load \
    /path/to/json_dir \
    --storage postgresql://user:password@host:port/db \
    --interval 5

$ galaxy repo clone /path/to/clone \
    --interval 5 \
    --percentile 0.9 \
    --date-from 2018/10/22

$ tree -L 3 /path/to/clone
repos
├── 2019-11-01_12-26-23.log
└── github.com
    ├── user1
    │   ├── role1
    │   ├── role2
    │   └── role3
    └── user2
        └── role4