je_load_density.utils.regression.diff
Cross-run regression diff.
Loads two runs from a SQLite persistence database and compares per-name latency percentiles + failure rate. Returns a structured diff so CI can gate on regressions above a configurable tolerance.
Functions
|
Compare two runs in |
|
Aggregate raw records into |
- je_load_density.utils.regression.diff.diff_runs(database_path: str, baseline_run_id: int, current_run_id: int, tolerance: float = 0.1) Dict[str, Any]
Compare two runs in
database_path.toleranceis the fractional increase allowed (e.g.0.10= 10 %). Metrics that breach the tolerance are listed underregressions.
- je_load_density.utils.regression.diff.summarise_records(records: Iterable[Dict[str, Any]]) Dict[str, Dict[str, float]]
Aggregate raw records into
{name: {count, failures, p50, p95, p99, mean}}.