Sign inSign up

andreclaudino/mongodb-uploader

By andreclaudino

•Updated over 3 years ago

A system to upload JSONL or CSV files to MongoDB from local file os s3-like object storage.

Image
0

615

andreclaudino/mongodb-uploader repository overview

⁠mongodb-uploader

A system to upload JSON or CSV files to MongoDB from local file os s3-like object storage.

Source code on docker repository: https://github.com/driyca/mongodb-uploader⁠

⁠Usage

$> docker run docker.io/andreclaudino/mongodb-uploader --help

Usage: mongodb-uploader [OPTIONS] --source-path <SOURCE_PATH> --connection-string <CONNECTION_STRING> --database-name <DATABASE_NAME> --database-collection <DATABASE_COLLECTION> --batch-size <BATCH_SIZE> --s3-access-key <S3_ACCESS_KEY> --s3-secret-access-key <S3_SECRET_ACCESS_KEY>

Options:
  -s, --source-path <SOURCE_PATH>
          Source path [env: SOURCE_PATH=]
      --source-file-type <SOURCE_FILE_TYPE>
          Source file type [env: SOURCE_FILE_PATH=] [default: json] [possible values: json, csv]
      --connection-string <CONNECTION_STRING>
          Database connection String [env: CONNECTION_STRING=]
      --database-name <DATABASE_NAME>
          Database name [env: DATABASE_NAME=]
      --database-collection <DATABASE_COLLECTION>
          Database collection [env: DATABASE_COLLECTION=]
      --batch-size <BATCH_SIZE>
          Database collection [env: BATCH_SIZE=]
      --s3-endpoint <S3_ENDPOINT>
          The S3 endpoint to connect and save file [env: S3_ENDPOINT=] [default: http://minio.storage.svc]
      --s3-region <S3_REGION>
          S3 Region to connect (blank for minio) [env: S3_NEW_PATH_STYLE=] [default: ]
      --s3-access-key <S3_ACCESS_KEY>
          S3 Access key [env: S3_ACCESS_KEY=]
      --s3-secret-access-key <S3_SECRET_ACCESS_KEY>
          S3 Secret Access key [env: S3_SECRET_ACCESS_KEY=]
  -h, --help
          Print help
  -V, --version
          Print version

Tag summary

Content type

Image

Digest

sha256:9c5fd87e3…

Size

36.4 MB

Last updated

over 3 years ago

docker pull andreclaudino/mongodb-uploader