Sign inSign up

konstellation/kdl-backup

By konstellation

•Updated almost 2 years ago

Image
0

10K+

konstellation/kdl-backup repository overview

⁠kdl-server

Konstellation AI Lab, formerly known as kdl-server, is the training server of Konstellation AI.

The main goal of KAI Lab is to provide a user-friendly environment for Data Scientists where they can carry out their experiments. At the same time, it integrates a powerful solution for project management, user environments with GPU capabilities and job management.

⁠Builds

ComponentBugsCoverageMaintainability RatingGo reportSecurity
app-apiapi-report-bugs-badgeapi-report-coverage-badgeapi-report-maintain-badgego-reportapi-report-security-badge
app-uiui-report-bugs-badgeui-report-coverage-badgeui-report-maintain-badge-ui-report-security-badge
cleanercleaner-report-bugs-badgecleaner-report-coverage-badgecleaner-report-maintain-badgego-reportcleaner-report-security-badge
repo-clonerrepo-cloner-report-bugs-badgerepo-cloner-report-coverage-badgerepo-cloner-report-maintain-badgego-reportrepo-cloner-report-security-badge

⁠Components

  • app-api: main component of the application, providing API access for other components and managing interactions with MongoDB.
  • app-ui: web application offering the interface for data scientists.
  • backup: Kubernetes cronJob that backs up PostgreSQL and MongoDB databases and stores Kubernetes etcd manifests in AWS S3
  • cleaner: currently unused, potentially slated for deprecation.
  • gitea: git server mirroring project repositories.
  • minio: s3-compatible object storage, holding artifacts from training jobs; MinIO is installed as a pinned dependency, with only the console deployed through the chart.
  • postgresql: database storing gitea data.
  • project-operator: Kubernetes operator listening to KAI Lab API; on new project creation in the UI, it deploys a project-specific pod with mlflow and file browser.
  • repo-cloner: in-house solution that clones all accessible repositories into the user's user-tools pod.
  • user-tools-operator: Kubernetes operator monitoring kai lab api; each time a user starts or changes runtime in the UI, this operator deploys a pod with vscode server and runtime containers based on selected image.

⁠Matrix compatibility

Note

If component isn't on the matrix, that means it component hasn't dependencies.
ComponentDependenciesVersionCompatibility
appcode.gitea.io/sdk/giteav0.19.0-
github.com/minio/minio-go/v7v7.0.78-
go.mongodb.org/mongo-driverv1.17.1MongoDB >=3.6, =<7.X⁠
k8s.io/apiv0.31.1Kubernetes >=1.24, =<1.30⁠
k8s.io/apimachineryv0.31.1Kubernetes >=1.24, =<1.30⁠
k8s.io/client-gov0.31.1Kubernetes >=1.24, =<1.30⁠
repo-clonergo.mongodb.org/mongo-driverv1.17.1MongoDB >=3.6, =<7.X⁠
giteak8s.io/apiv0.31.1Kubernetes >=1.24, =<1.30⁠
k8s.io/apimachineryv0.31.1Kubernetes >=1.24, =<1.30⁠
k8s.io/client-gov0.31.1Kubernetes >=1.24, =<1.30⁠

⁠Development

Install our tools⁠ and follow the kdlctl⁠ guide to deploy your local environment.

⁠GitFlow

We use the GitFlow branching model. Read more about it here⁠.

⁠Documentation

Refer to the docs⁠ folder for more information:

⁠Helm Chart

Refer to the kdl-server⁠ Helm chart for more information.

⁠Contributing

Please read CONTRIBUTING.md⁠ for details on our code of conduct, and the process for submitting pull requests to us.

⁠License

This project is licensed under the MIT License - see the LICENSE⁠ file for details.

Tag summary

Content type

Image

Digest

sha256:f1287f5b5…

Size

286.3 MB

Last updated

almost 2 years ago

docker pull konstellation/kdl-backup