pytest_park.core.history

source module pytest_park.core.history

Classes

• HistoryAnalyzer — Analyzes benchmark performance history and trends across multiple runs.

Functions

• build_trends — Build time-series means per case across run history.

• build_method_history — Build method mean history across runs.

• compare_method_history_to_reference — Compare method mean over runs against reference run mean.

• compare_method_to_all_prior_runs — Compare candidate method means against all prior runs.

source class HistoryAnalyzer(runs: list[BenchmarkRun])

Analyzes benchmark performance history and trends across multiple runs.

Methods

• build_trends — Build time-series means per case across run history.

• build_method_history — Build method mean history across runs.

• compare_to_reference — Compare method mean over runs against a fixed reference run mean.

• compare_to_all_prior — Compare candidate method means against every prior run in history.

source method HistoryAnalyzer.build_trends() → dict[str, list[TrendPoint]]

Build time-series means per case across run history.

source method HistoryAnalyzer.build_method_history(method: str, distinct_params: list[str] | None = None) → list[MethodHistoryPoint]

Build method mean history across runs.

source method HistoryAnalyzer.compare_to_reference(reference_run: BenchmarkRun, method: str, distinct_params: list[str] | None = None) → list[MethodHistoryComparison]

Compare method mean over runs against a fixed reference run mean.

source method HistoryAnalyzer.compare_to_all_prior(candidate_run: BenchmarkRun, method: str, distinct_params: list[str] | None = None) → list[PriorRunComparison]

Compare candidate method means against every prior run in history.

source build_trends(runs: list[BenchmarkRun]) → dict[str, list[TrendPoint]]

Build time-series means per case across run history.

source build_method_history(runs: list[BenchmarkRun], method: str, distinct_params: list[str] | None = None) → list[MethodHistoryPoint]

Build method mean history across runs.

source compare_method_history_to_reference(runs: list[BenchmarkRun], reference_run: BenchmarkRun, method: str, distinct_params: list[str] | None = None) → list[MethodHistoryComparison]

Compare method mean over runs against reference run mean.

source compare_method_to_all_prior_runs(runs: list[BenchmarkRun], candidate_run: BenchmarkRun, method: str, distinct_params: list[str] | None = None) → list[PriorRunComparison]

Compare candidate method means against all prior runs.