chiefj/quality-baseline-worker repository overview

[ PostgreSQL: quality_scores ] ─── (Reads scores & flags from last 7 days)
               │
               ▼
   [ quality-baseline-worker ] (Temporal Scheduled Workflows)
         │               │
         │ (F-Q-09)      │ (F-Q-10)
         │ Hourly        │ Daily at 00:00 UTC
         │               │
         ▼               ▼
   [   Redis   ]   [ ClickHouse ] ──► [ Grafana Dashboards ]
  Overwrites drifted  Appends daily      Plots 30-day quality
  baseline averages   rollup metrics     trend performance

  [PostgreSQL: quality_scores]
               │
               ▼ SELECT avg(composite_score), count(*) ... WHERE scored_at > now() - 7 days
     [recompute_baseline_scores] (Activity)
               │
               ▼ Return List[BaselineRecomputeResult]
     [write_redis_baselines] (Activity)
               │
               ▼ SET baseline:quality:{model}:{endpoint}:{prompt_type} -> average_score
            [Redis]

  [PostgreSQL: quality_scores]
               │
               ▼ SELECT avg(composite_score), sum(cardinality(flags)), count(*) ... for yesterday
       [rollup_quality_trend] (Activity)
               │
               ▼ INSERT INTO quality_trend (rollup_date, model, endpoint, prompt_type, ...)
        [ClickHouse]

./scripts/deploy_docker.sh

cd deploy/docker
docker compose up -d --build