Sign inSign up

cisagov/saver

By cisagov

•Updated about 20 hours ago

Save scan results to a database

Image
0

100K+

cisagov/saver repository overview

⁠pshtt, trustymail, and sslyze Saver

GitHub Build Status License CodeQL

⁠Docker Image

Docker Pulls Docker Image Size (latest by date) Platforms

This is a Docker container for saving to a Mongo database⁠ pshtt⁠, trustymail⁠, and sslyze⁠ results collected via domain-scan⁠. To keep the database size manageable, it also deletes any results that are older than a year.

This Docker container is intended to be run via orchestrator⁠.

N.B.: The secrets in the src/secrets directory are only used when testing via the docker-compose.yml composition. Normally this Docker container is run via the Docker composition in cisagov/orchestrator⁠, which expects the secrets in a different location.

⁠Running

⁠Running with Docker

To run the cisagov/saver image via Docker:

docker run cisagov/saver:1.6.4
⁠Running with Docker Compose
  1. Create a compose.yml file similar to the one below to use Docker Compose⁠.

    ---
    name: saver
    
    services:
      saver:
        image: cisagov/saver:1.6.4
        volumes:
          - source: <your_log_dir>
            target: /home/cisa/shared
            type: bind
    
  2. Start the container and detach:

    docker compose up --detach
    

⁠Using secrets with your container

This container also supports passing sensitive values via Docker secrets⁠. Passing sensitive values like your credentials can be more secure using secrets than using environment variables. See the secrets⁠ section below for a table of all supported secret files.

  1. To use secrets, create a database_creds.yml file in this format⁠:

    ---
    version: '1'
    
    database:
      name: cyhy
      uri: mongodb://user:[email protected]:27017/cyhy
    
    
  2. Then add the secrets to your compose.yml file:

    ---
    name: saver
    
    secrets:
      database_creds:
        file: database_creds.yml
    
    services:
      trustymail_reporter:
        image: cisagov/saver:1.6.4
        volumes:
          - source: <your_log_dir>
            target: /home/cisa/shared
            type: bind
        secrets:
          - source: database_creds
            target: database_creds.yml
    

⁠Updating your container

⁠Docker Compose
  1. Pull the new image from Docker Hub:

    docker compose pull
    
  2. Recreate the running container by following the previous instructions⁠:

    docker compose up --detach
    
⁠Docker
  1. Stop the running container:

    docker stop <container_id>
    
  2. Pull the new image:

    docker pull cisagov/saver:1.6.4
    
  3. Recreate and run the container by following the previous instructions⁠.

⁠Updating Python dependencies

This image uses Pipenv⁠ to manage Python dependencies using a Pipfile⁠. Both updating dependencies and changing the Pipenv⁠ configuration in src/Pipfile will result in a modified src/Pipfile.lock file that should be committed to the repository.

⁠Updating dependencies

If you want to update existing dependencies you would run the following command in the src/ subdirectory:

pipenv lock
⁠Modifying dependencies

If you want to add or remove dependencies you would update the src/Pipfile file and then update dependencies as you would above.

Note

You should only specify packages that are direct requirements of your Docker configuration. Allow [Pipenv] to manage the dependencies of the specified packages.

⁠Image tags

The images of this container are tagged with semantic versions⁠ of the underlying saver project that they containerize. It is recommended that most users use a version tag (e.g. :1.6.4).

Image:tagDescription
cisagov/saver:1.6.4An exact release version.
cisagov/saver:1.6The most recent release matching the major and minor version numbers.
cisagov/saver:1The most recent release matching the major version number.
cisagov/saver:edgeThe most recent image built from a merge into the develop branch of this repository.
cisagov/saver:nightlyA nightly build of the develop branch of this repository.
cisagov/saver:latestThe most recent release image pushed to a container registry. Pulling an image using the :latest tag should be avoided.⁠

See the tags tab⁠ on Docker Hub for a list of all the supported tags.

⁠Volumes

Mount pointPurpose
/home/cisa/sharedOutput

⁠Ports

There are no ports exposed by this container.

⁠Environment variables

⁠Required

There are no required environment variables.

⁠Optional
NamePurposeDefault
AWS_CONFIG_FILEThe location of the config file containing AWS credentials.null
AWS_SDK_LOAD_CONFIGIf set to a truthy value (such as 1), ensures that the config file (and not just any credentials file that is present) is loaded.null

⁠Secrets

FilenamePurpose
aws_configAWS CLI configuration in this format⁠.
scan_write_creds.ymlCyber Hygiene read-write database credentials in this format⁠.

⁠Building from source

Build the image locally using this git repository as the build context⁠:

docker build \
  --tag cisagov/saver:1.6.4 \
  https://github.com/cisagov/saver.git#develop

⁠Cross-platform builds

To create images that are compatible with other platforms, you can use the buildx⁠ feature of Docker:

  1. Copy the project to your machine using the Code button above or the command line:

    git clone https://github.com/cisagov/saver.git
    cd saver
    
  2. Create the Dockerfile-x file with buildx platform support:

    ./buildx-dockerfile.sh
    
  3. Build the image using buildx:

    docker buildx build \
      --file Dockerfile-x \
      --platform linux/amd64 \
      --output type=docker \
      --tag cisagov/saver:1.6.4 .
    

⁠Contributing

We welcome contributions! Please see CONTRIBUTING.md⁠ for details.

⁠License

This project is in the worldwide public domain⁠.

This project is in the public domain within the United States, and copyright and related rights in the work worldwide are waived through the CC0 1.0 Universal public domain dedication⁠.

All contributions to this project will be released under the CC0 dedication. By submitting a pull request, you are agreeing to comply with this waiver of copyright interest.

Tag summary

Content type

Image

Digest

sha256:99a70287e…

Size

45 MB

Last updated

about 1 month ago

docker pull cisagov/saver