Sign inSign up

bexhoma/loader_tpcds_postgresql

By bexhoma

Updated 7 days ago

Image
0

7.5K

bexhoma/loader_tpcds_postgresql repository overview

Loader for TPC-DS data into PostgreSQL

Loads pre-generated TPC-DS .dat files into PostgreSQL using psql \COPY. The child index is read from /tmp/tpcds/BEXHOMA_CHILD (written by the generator pod running in the same Kubernetes pod). Does not have multi-tenancy support.

Environment variables

Scaling and parallelism
  • SF: Scale factor - used to locate the correct data subdirectory. Default: 1.
  • BEXHOMA_NUM_PODS: Total number of loader pods. Default: 4.
  • BEXHOMA_CHILD: Pod index (1-based). Overwritten at runtime from /tmp/tpcds/BEXHOMA_CHILD. Default: 1.
  • BEXHOMA_RNGSEED: Not used by this loader. Default: 123.
Target DBMS connection
  • BEXHOMA_HOST: PostgreSQL hostname. Default: www.example.com.
  • BEXHOMA_PORT: PostgreSQL port. Default: 5432.
  • BEXHOMA_USER: PostgreSQL username. Default: postgres.
  • BEXHOMA_PASSWORD: PostgreSQL password. Default: postgres.
  • BEXHOMA_DATABASE: Target database name. Default: tpcds.
  • BEXHOMA_URL, BEXHOMA_JAR, BEXHOMA_DRIVER: Not used by this loader - declared for compatibility.
Bexhoma experiment identity
  • BEXHOMA_CONNECTION: Logical connection name - used to address the Redis synchronisation counter. Default: mysql.
  • BEXHOMA_EXPERIMENT: Experiment ID. Default: 12345.
  • BEXHOMA_EXPERIMENT_RUN: Run counter within the experiment. Default: 1.
  • BEXHOMA_CONFIGURATION: Configuration label echoed in log output.
  • BEXHOMA_CLIENT: Client index echoed in log output. Default: 1.
Data storage and loading control
  • STORE_RAW_DATA: 0 = read data from /tmp/tpcds/; 1 = read from /data/tpcds/. Default: 0.
  • BEXHOMA_SYNCH_LOAD: 1 = wait on Redis counter bexhoma-loader-podcount-<CONNECTION>-<EXPERIMENT> until all loader pods have checked in before starting. Default: 0.
  • TPCDS_TABLE: When set to a table name only that table is loaded; all others are skipped. Default: "".

Tag summary

Content type

Image

Digest

sha256:34ed8eea5

Size

70.1 MB

Last updated

7 days ago

docker pull bexhoma/loader_tpcds_postgresql