Public Repository

Last pushed: 3 years ago
Short Description
ELK configured to process Google Cloud Appengine logs
Full Description

Basic configuration of ELK (Elasticsearch, Logstash, Kibana) for Google Appengine Logs packed as Docker container

Run:

docker run -d -t \
  -p 9200:9200 -p 5601:5601 \
  -v $(pwd)/volumes/inputlogs:/var/inputlogs \
  -v $(pwd)/volumes/sincedb:/var/sincedb \
  -v $(pwd)/volumes/elastic:/opt/elasticsearch/data/elasticsearch \
  splix/appengine-logs-kibana

Download logs:

gsutil -m cp -R -n "gs://__MY_BUCKET_WITH_LOGS__/appengine.googleapis.com/request_log/" volumes/inputlogs/

Open Kibana at port 5601 (like http://192.168.59.103:5601/) and setup metadata.timestamp as timestamp field.

Enjoy

Docker Pull Command
Owner
splix