DBConvert Streams Source Reader
1.1K
"DBConvert Streams" is distributed, event-driven replication for databases.
The DBS platform consists of the following parts:
DBS Source Reader is one of the integral components of the DBConvert Streams platform. Source Reader is used for continuous data collection from a specified source.
DBS Source Reader instance listens on port 8021 by default.
Since DBConvert Streams depends on multiple services, the best way to start docker containers using Docker Compose.
Here is a simple example of docker-compose configuration for staring DBConvert Streams.
version: "3.9"
services:
dbs-api:
container_name: api
image: slotix/dbs-api
entrypoint:
- ./dbs-api
- --nats=nats:4222
- --source=source-reader:8021
- --target=target-writer:8022
ports:
- 8020:8020
depends_on:
- nats
dbs-source-reader:
container_name: source-reader
image: slotix/dbs-source-reader
entrypoint:
- ./dbs-source-reader
- --nats=nats:4222
ports:
- 8021:8021
depends_on:
- nats
dbs-target-writer:
container_name: target-writer
image: slotix/dbs-target-writer
entrypoint:
- ./dbs-target-writer
- --nats=nats:4222
ports:
- 8022:8022
depends_on:
- nats
# dbs-target-writer2:
# container_name: target-writer2
# image: slotix/dbs-target-writer
# entrypoint:
# - ./dbs-target-writer
# - --nats=nats:4222
# ports:
# - 8023:8023
# depends_on:
# - nats
#
# dbs-target-writer3:
# container_name: target-writer3
# image: slotix/dbs-target-writer
# entrypoint:
# - ./dbs-target-writer
# - --nats=nats:4222
# ports:
# - 8024:8024
# depends_on:
# - nats
nats:
container_name: nats
image: nats
entrypoint: /nats-server
command: "--jetstream -m 8222 --store_dir /data/nats-server"
ports:
- 4222:4222
- 8222:8222
volumes:
- ./_storage/nats:/data/nats-server/jetstream
prometheus:
image: slotix/dbs-prometheus:latest
container_name: prom
user: root
ports:
- 9090:9090
volumes:
- ./_storage/prometheus:/prometheus
You can run multiple instances of Target writer to improve overall performance. Just uncomment dbs-target-writer-2 and dbs-target-writer-3 services to distribute processing of multiple INSERT statements between several target writers, greatly speeding up the whole process.
Copy content of the docker-compose config above and save it as docker-compose.yml file.
docker-compose up
For actual examples and configurations, refer to the public DBConvert Streams Github repository
Content type
Image
Digest
sha256:af73f1118…
Size
29.5 MB
Last updated
over 2 years ago
docker pull slotix/dbs-source-reader