Sign inSign up

mtsrus/syncmaster-scheduler

By mtsrus

•Updated about 24 hours ago

No-code ETL tool, based on onETL + PySpark (Scheduler)

Image
1

10K+

mtsrus/syncmaster-scheduler repository overview

Data.SyncMaster logo

Repo Status Docker image PyPI PyPI License PyPI Python Version Documentation Build Status Coverage pre-commit.ci

⁠What is Data.SyncMaster?

Data.SyncMaster is as no-code ETL tool for transferring data between databases and file systems. List of currently supported connections:

  • Apache Hive
  • Clickhouse
  • Iceberg (REST Catalog + S3)
  • MSSQL
  • MySQL
  • Oracle
  • Postgres
  • FTP
  • FTPS
  • HDFS
  • S3
  • Samba
  • SFTP
  • WebDAV

Based on onETL⁠ and Apache Spark⁠.

⁠Goals

  • Make transferring data between databases and file systems as simple as possible
  • Provide a lot of builtin connectors to transfer data in heterogeneous environment
  • RBAC and multitenancy support

⁠Non-goals

  • No streaming support for now, only batch operations
  • This is not a change data capture (CDC) solution

⁠Documentation

See https://syncmaster.readthedocs.io⁠

Tag summary

Content type

Image

Digest

sha256:aaf90b156…

Size

81.9 MB

Last updated

about 1 month ago

docker pull mtsrus/syncmaster-scheduler