mariadb/columnstore
MariaDB ColumnStore Engine for Analytics
50K+
MariaDB ColumnStore is a columnar storage engine that utilizes a massively parallel distributed data architecture. It was built by porting InfiniDB to MariaDB and has been released under the GPL license.
MariaDB ColumnStore is designed for big data scaling to process petabytes of data, linear scalability and exceptional performance with real-time response to analytical queries. It leverages the I/O benefits of columnar storage, compression, just-in-time projection, and horizontal and vertical partitioning to deliver tremendous performance when analyzing large data sets.
Please install the following software packages before you begin.
docker run -d -p 3307:3306 --shm-size=512m -e PM1=mcs1 --hostname=mcs1 --name mcs1 mariadb/columnstore
docker exec -it mcs1 provision mcs1
Waiting for PM1 To Be Initialized .. done
Adding PM(s) To Cluster ... done
Restarting Cluster ... done
Validating ColumnStore Engine ... done
Variable | Type | Default | Required |
---|---|---|---|
ADMIN_HOST | String | % | No |
ADMIN_PASS | String | C0lumnStore! | No |
ADMIN_USER | String | Admin | No |
CEJ_PASS | String | C0lumnStore! | No |
CEJ_USER | String | cej | No |
CGROUP | String | ./ | Yes |
CMAPI_KEY | String | somekey123 | No |
PM1 | Hostname | - | Yes |
S3_ACCESS_KEY_ID | String | None | No |
S3_BUCKET | String | None | No |
S3_ENDPOINT | URL | None | No |
S3_REGION | String | None | No |
S3_SECRET_ACCESS_KEY | String | None | No |
USE_S3_STORAGE | Boolean | false | No |
git clone https://github.com/mariadb-corporation/mariadb-columnstore-docker
cd mariadb-columnstore-docker
cp .env_example .env
docker compose up -d
docker exec -it mcs1 provision mcs1 mcs2 mcs3
Waiting for PM1 To Be Initialized .... done
Adding PM(s) To Cluster ... done
Restarting Cluster ... done
Validating ColumnStore Engine ... done
git clone https://github.com/mariadb-corporation/mariadb-columnstore-docker
cd mariadb-columnstore-docker
cp .env_example .env
cp .secrets_example .secrets
./build
Database Access
mysql -h 127.0.0.1 -P 3307 -u admin -p
The default password is: C0lumnStore!
MaxScale 1 GUI Access
http://127.0.0.1:8989
admin
mariadb
MaxScale 2 GUI Access
http://127.0.0.1:8990
admin
mariadb
Glossary Items
mcs cluster set api-key --key <api_key>
Get Status:
mcs cluster status
Start Cluster:
mcs cluster start
Stop Cluster:
mcs cluster stop
Add Node:
mcs cluster node add --node <node>
Remove Node:
mcs cluster node remove --node <node>
Mode Set Read Only:
mcs cluster set mode --mode readonly
Mode Set Read/Write:
mcs cluster set mode --mode readwrite
Logs are stored in /var/log/mariadb/columnstore
They are also available via the following command:
docker logs mcs1
#!/bin/bash
rm -rf /backup
mkdir -p /backup/{mysql,columnstore}
mariadb-backup --user=root --backup --rsync --target-dir=/backup/mysql
mcs cluster set mode --mode readonly
rsync -av /var/lib/columnstore/ /backup/columnstore/
mcs cluster set mode --mode readwrite
docker pull mariadb/columnstore