je_load_density.utils.regression

je_load_density.utils.regression.diff_runs(database_path: str, baseline_run_id: int, current_run_id: int, tolerance: float = 0.1) Dict[str, Any]

Compare two runs in database_path. tolerance is the fractional increase allowed (e.g. 0.10 = 10 %). Metrics that breach the tolerance are listed under regressions.

je_load_density.utils.regression.summarise_records(records: Iterable[Dict[str, Any]]) Dict[str, Dict[str, float]]

Aggregate raw records into {name: {count, failures, p50, p95, p99, mean}}.

Modules

diff

Cross-run regression diff.