totem/docker-mongo-es repository overview

⁠docker-mongo-es

Docker based wrapper for mongo connector⁠ to send data to elasticsearch.

⁠Status

In Development

⁠Issues

https://github.com/totem/docker-mongo-es/issues⁠

⁠Requirements

• Docker 1.6.2+
• MongoDB Replica Set (1 or more nodes)
• Admin access to replicaset
• ElasticSearch Instance

⁠Running

docker run --rm -it -e MONGO_URL=172.17.42.1:27017 -e ES_URL=172.17.42.1:9200 totem/docker-mongo-es

⁠Environment Variables

⁠MONGO_URL

Specifies the mongo replicaset url. (e.g.: 172.17.42.1:27017)

⁠ES_URL

Specified the elastic search url (e.g.: 172.17.42.1:9200)

⁠MONGO_USERNAME

Admin username for mongodb. If blank, no credentials are used. (Defaults to blank)

⁠MONGO_PASSWORD

Admin password for mongodb.(Default to blank)

⁠MONGO_INCLUDES

List of database.collection separated by comma that needs to be included for indexing. e.g.: totem.events,totem.deployments to include database collections events and deployments from totem database.

⁠CONFIG_LOCATION

Optional config file location. (Defaults to blank). e.g.: file:///tmp/config.yml or https://my-config-server/config.yml⁠. Example config file:

defaults:
  index-defaults: &index-defaults
    mappings:
      _default_:
        _all:
          enabled: true
        dynamic_templates:
          - string_fields:
              mapping:
                index: not_analyzed
                type: string
              match: '*'
              match_mapping_type: string
es:
  indexes:
    totem:
      <<: *index-defaults
mongo-connector:
  logging:
    type: stream

Note: List of complete mongo-connector settings can be found in mongo-connector wiki⁠

⁠LOG_VERBOSITY

Verbosity for logging (between 0 - 3, where 0 is ERROR, 3 is DEBUG)