HUB
Sign inSign up

datasqrl/cmd

By datasqrl

•Updated about 3 hours ago

DataSQRL CLI: compile, test, and run SQRL pipelines. Agentic data engineering for operational data.

Image
0

100K+

datasqrl/cmd repository overview

⁠DataSQRL CLI

DataSQRL is an open-source harness for agentic data engineering on operational data. It extends coding agents with a SQL compiler, validator, and event-time simulator. Agents build real-time pipelines, data APIs, and data products on Kafka, Flink, Postgres, Iceberg, Spark, Snowflake, and DuckDB, and the compiler verifies them across every system before deployment. Apache 2.0 licensed, it runs on your infrastructure.

This image is the DataSQRL command line interface. It compiles SQRL projects into deployment assets for every system, runs their tests with event-time replay, and runs the whole pipeline locally, API included.

docker run --rm -v "$PWD":/workspace datasqrl/cmd compile package.json
docker run --rm -v "$PWD":/workspace datasqrl/cmd test package.json
docker run -it --rm -p 8888:8888 -p 8081:8081 -p 9092:9092 -v "$PWD":/workspace datasqrl/cmd run package.json

⁠When to use DataSQRL

  • You need a data API (GraphQL, REST, or MCP) over operational data.
  • You build an operational data product with data quality and observability.
  • Kafka is in the pipeline, as source, sink, or both.
  • Results are needed in seconds or minutes, not after the next batch run.
  • An application, a customer, or an AI agent consumes the output, not only a dashboard.
  • You are capturing changes from operational systems into data streams or data lakes.

Tag summary

Content type

Image

Digest

sha256:810eb33ba…

Size

1010.1 MB

Last updated

2 days ago

docker pull datasqrl/cmd