bexhoma/loader_tpch_mariadb repository overview

⁠Loader for TPC-H data into MariaDB

Loads pre-generated TPC-H .tbl files into MariaDB using mysql LOAD DATA LOCAL INFILE. The child index is read from /tmp/tpch/BEXHOMA_CHILD (written by the generator pod running in the same Kubernetes pod). Sets BEXHOMA_DATABASE=$BEXHOMA_VOLUME at startup. nation and region are only loaded by pod 1.

⁠Environment variables

⁠Scaling and parallelism

• SF: Scale factor - used to locate the correct data subdirectory. Default: 1.
• BEXHOMA_NUM_PODS: Total number of loader pods. Default: 4.
• BEXHOMA_CHILD: Pod index (1-based). Overwritten at runtime from /tmp/tpch/BEXHOMA_CHILD. Default: 1.
• BEXHOMA_RNGSEED: Not used by this loader. Default: 123.

⁠Target DBMS connection

• BEXHOMA_HOST: MariaDB hostname. Default: www.example.com.
• BEXHOMA_PORT: MariaDB port. Default: 3306.
• BEXHOMA_USER: MariaDB username. Default: root.
• BEXHOMA_PASSWORD: MariaDB password. Default: root.
• BEXHOMA_DATABASE: Default database name - overridden at startup by BEXHOMA_VOLUME. Default: demo.
• BEXHOMA_VOLUME: Actual target database name. The loader script sets BEXHOMA_DATABASE=$BEXHOMA_VOLUME at startup. Default: "".
• BEXHOMA_URL, BEXHOMA_JAR, BEXHOMA_DRIVER: Not used by this loader - declared for compatibility.

⁠Bexhoma experiment identity

• BEXHOMA_CONNECTION: Logical connection name - used to address the Redis synchronisation counter. Default: mysql.
• BEXHOMA_EXPERIMENT: Experiment ID. Default: 12345.
• BEXHOMA_EXPERIMENT_RUN: Run counter within the experiment. Default: 1.
• BEXHOMA_CONFIGURATION: Configuration label echoed in log output.
• BEXHOMA_CLIENT: Client index echoed in log output. Default: 1.

⁠Data storage and loading control

• STORE_RAW_DATA: 0 = read data from /tmp/tpch/; 1 = read from /data/tpch/. Default: 0.
• BEXHOMA_SYNCH_LOAD: 1 = wait on Redis counter bexhoma-loader-podcount-<CONNECTION>-<EXPERIMENT> until all loader pods have checked in before starting. Default: 0.
• TPCH_TABLE: When set to a table name only that table is loaded; all others are skipped. Default: "".
• MYSQL_LOADING_FROM: Must be LOCAL to use LOAD DATA LOCAL INFILE. Default: LOCAL.