upload-to-s3

Description

Daemonset⁠ that monitors hostPath and uploads files to an s3 bucket.

Logic Overview

Upload-to-s3 is monitoring a kubernetes volume of type hostPath⁠ using the inotify-tools⁠.

Applications running on kubernetes can use hostPath modifying /proc/sys/kernel/core_pattern file to populate the directory with coredumps, see core manpage⁠ for details.

For consistency reasons we're using non-privileged user called gather with user id 1000. The requirement for the LOCAL_PATH directory is to have at least r permissions for user with ID 1000.

AWS credentials (region, id, bucket_name and key) are passed as environment variables.

The daemonset is using a hardcoded nodeSelector to limit the daemonset deployment to a specific nodepool.

Implementation based on Handling Core-Dumps in Kubernetes Clusters in GCP⁠.

License

See LICENSE⁠ file.

Repository: https://github.com/gathertown/upload-to-s3⁠