A data generator platform made with Streamlit, DuckDB and is able to transfer data to Postgres
251
A Streamlit application that generates datasets, stores in DuckDB, can perform queries in DuckDB, can connect into PostgreSQL natively, and can export tables into CSV, JSON or directly into PostgreSQL.
The following docker-compose will give you everything working
in one command, for connecting to your postgres container the host
will be postgres and the credentials the one that is setted in
the definition.
# docker-compose.yml
services:
streamlit:
image: jasonjimnz/streamlit_data_generator:latest
container_name: dataset_generator
ports:
- "8501:8501"
volumes:
- duckdb_data:/opt/app/data
environment:
- PYTHONUNBUFFERED=1
depends_on:
- postgres
networks:
- app-network
restart: unless-stopped
postgres:
image: postgres:15
container_name: dataset_postgres
ports:
- "5432:5432"
environment:
- POSTGRES_USER=postgres
- POSTGRES_PASSWORD=postgres
- POSTGRES_DB=datasets
volumes:
- postgres_data:/var/lib/postgresql/data
networks:
- app-network
restart: unless-stopped
networks:
app-network:
driver: bridge
volumes:
postgres_data:
duckdb_data:
Content type
Image
Digest
sha256:5abeed000…
Size
503.3 MB
Last updated
over 1 year ago
docker pull jasonjimnz/streamlit_data_generator