feat(mip8): storage perf-regression suite + consume timing report

[pdobacz]

I wanted to get the performance regression stack into main, but it resulted huge. I trimmed it down considerably over the course of these commits, but still huge.

I am hesitant whether we need it, but not rejecting the idea, since most of this change is purely additive and would be easy to get rid of.

There's a bunch of tests and also the benchmark tests are going to be filled on CI to ensure they do not rot [that badly].

Happy to hear that it's better not to merge this and re-create when new need arises.

Greptile Summary

The PR adds a MIP-8 storage performance-regression suite and the supporting workflow for collecting, aggregating, and documenting Monad block-execution timings.

• Adds pageified-storage benchmark fixtures spanning storage operations, transaction shapes, halt behavior, and adversarial access patterns.
• Adds direct-consume timing CSV generation and Monad runner timing support.
• Adds statistical NINE-versus-TEN report generation, orchestration scripts, tests, CI configuration, and usage documentation.
• Updates merged-fixture handling so unnamed multi-fixture files are streamed and fully consumed.

Confidence Score: 5/5

The PR appears safe to merge because no blocking failure remains.

No blocking failure remains.

Important Files Changed

Filename	Overview
tests/benchmark/stateful/mip8_pageified_storage/test_perf_regression.py	Defines the storage performance workloads, sizing logic, fixture state, and fork-comparison cases.
packages/testing/src/execution_testing/cli/pytest_commands/plugins/consume/direct/timing_report.py	Adds serial per-block timing collection and writes dynamically shaped client metrics to CSV.
packages/testing/src/execution_testing/cli/perf_regression.py	Parses repeated timing reports and produces paired statistical comparisons with multiple-testing adjustment.
packages/testing/src/execution_testing/client_clis/clis/monad.py	Adds Monad timing extraction and correctly iterates every fixture in unnamed merged fixture files.
scripts/perf_cycle.sh	Orchestrates fixture generation, repeated timed consumption, provenance capture, and report creation.

Flowchart

%%{init: {'theme': 'neutral'}}%%
flowchart LR
    B[MIP-8 benchmark definitions] --> F[Fill MONAD_NINE and MONAD_TEN fixtures]
    F --> C[Consume fixtures with Monad runloop]
    C --> T[Collect per-block timing metrics]
    T --> CSV[timing_consume.csv per run]
    CSV --> P[Pair fork samples by test and parameters]
    P --> S[Wilcoxon tests and BH adjustment]
    S --> M[Markdown regression report]

Loading

_{Reviews (3): Last reviewed commit: "fix(monad): verify every fixture when gi..." | Re-trigger Greptile}