Skip to content

About

Load tests, soak runs, and reproducible benchmark stands for Tracewick — reports, charts, and env anyone can spin up to verify results.

Topics

Resources

Code of conduct

Contributing

Security policy

Stars

0 stars

Watchers

0 watching

Forks

Tracewick Benchmarks

Load tests, soak runs, and reproducible benchmark stands for Tracewick — reports, charts, and an environment anyone can spin up to verify results.

This is a sibling of the library repo. Capacity / soak / load harness lives here. The library keeps only short summaries, selected screenshots, and a link.

Packagist: tracewick/tracewick (pin recorded in every report).

Quick start

Prerequisites: Docker with Compose v2, outbound network for the first image build (Packagist + pecl Excimer).

git clone https://github.com/tracewick/benchmarks.git
cd benchmarks
cp .env.example .env   # optional
make up                # build + Pyroscope + Grafana + PHP workload + drain
make bench-smoke       # wiring smoke (profiles → Pyroscope)
make bench-overhead    # M2: baseline vs on @ fixed RPS (~2× duration)
# Long soaks run separately: see docs/soak.md for pins and the pilot.
make down
URL What
http://127.0.0.1:8080/health Workload liveness
http://127.0.0.1:8080/work Profiled work unit
http://127.0.0.1:3000 Grafana (anonymous Admin). Explore → Profiles (or Drilldown → Profiles), service benchmarks-workload
http://127.0.0.1:4040 Pyroscope

Pinned k6: grafana/k6:1.8.2 (make k6-version). First make up compiles Excimer via PECL and may take several minutes.

Documentation

Doc Purpose
METHOD.md How we measure (canon)
LIMITATIONS.md What we do not claim
CONTRIBUTING.md How to change this repo
scenarios/ Named profiles
reports/ Checked-in reports + template

Layout

stand/           compose support + PHP workload (Packagist Tracewick)
generators/k6/   primary load scripts
scenarios/       scenario catalog
reports/         checked-in reports; local scratch under reports/_local/

Make targets

Target Meaning
make build Build PHP-FPM + nginx images
make up Build + start full smoke stand
make up-chaos Also start Toxiproxy
make down Stop and remove volumes
make k6-version Print / run pinned k6 image
make bench-smoke Short k6 smoke + Pyroscope app check
make bench-overhead M2 A/B at RATE req/s (default 20) for DURATION (default 2m)
make bench-spool-pressure M3: stop drain, fill spool, measure catch-up
make bench-chaos M3: Toxiproxy latency toward Pyroscope
make bench-soak Observed soak: explicit pins, RR/agent by default; runbook
make bench-rps High-RPS pipeline: deep stacks + spool series (default 500 / 5m)
make collect-report Stash host meta under reports/_local/

Observed soak (manual)

Follow docs/soak.md: explicit source pins → short pilot → calibrated 72-hour run under tmux. The runner starts its own Compose project; do not run make up alongside it on the same ports. Defaults: RR/agent, one RR worker, depth 48, sample rate 0.1, 15-second telemetry. Raw evidence and validity/resource reports are under reports/_local/soak-<utc>/. make check-soak runs regression checks; make plot-soak RUN_DIR=... renders preserved telemetry.

High-RPS pipeline (manual)

Uses the same /work wall budget (WORK_BUSY_MS / WORK_SLEEP_MS) as overhead/soak. Opt-in WORK_STACK_DEPTH deepens call stacks so spool payloads are larger (closer to a real app). Other legacy scenarios keep WORK_STACK_DEPTH=0; observed soak defaults to 48.

Honesty: these runs are one instance (typically app + drain + Pyroscope + k6 on a single VPS). The sustained RPS you publish is the ceiling of that server configuration and synthetic work unit, not “Tracewick handles N RPS everywhere” and not a multi-node fleet result. On the Timeweb 8 vCPU stand with depth-48 /work (~25 ms busy + 10 ms sleep, 32 FPM workers), overload probes showed ~760 achieved RPS with multi-second latency — so a clean hold is expected around ~700 RPS, not 1.5–3k.

cd /root/benchmarks && git pull --ff-only
# first time after pull: rebuild FPM image (entrypoint / max_children)
make up
RATE=700 DURATION=5m PRE_VUS=500 MAX_VUS=2000 make bench-rps
# optional admission stress: READER=off RATE=700 DURATION=2m ...
# go-agent sidecar (alpha 0.1.0) instead of PHP drain:
# READER=agent WORK_STACK_DEPTH=48 RATE=700 DURATION=5m make bench-rps
# RoadRunner (same /work + UnitOfWorkProfiler; not ContinuousProfiler):
# make up-rr READER=agent
# RUNTIME=rr READER=agent BASE_URL=http://127.0.0.1:8082 WORK_STACK_DEPTH=48 \
#   RR_NUM_WORKERS=32 RATE=700 DURATION=5m make bench-rps
# Swoole (ContinuousProfiler + SpoolSink):
# make up-swoole READER=agent
# RUNTIME=swoole READER=agent BASE_URL=http://127.0.0.1:8083 WORK_STACK_DEPTH=48 \
#   SWOOLE_WORKER_NUM=32 RATE=700 DURATION=5m make bench-rps

Artifacts: reports/_local/rps-pipeline-<utc>/ and rps-pipeline-latest.md. Checked-in reports must repeat the single-instance / host-ceiling caveat. READER=drain|agent|off (default drain). RUNTIME=fpm|rr|swoole (default fpm).

Post-fix exact signal-weight verification checks native events through CLI/FPM/RR, spool, agent pprof and live Pyroscope. It is correctness evidence, not a replacement for the capacity reports below. Those reports predate the explicit-flush fix; do not reuse their absolute profile weights as post-fix evidence or apply a blanket divide-by-two correction.

Local run scratch: reports/_local/. Canonical cloud goldens (cite these — WORK_STACK_DEPTH=48 on the 8 vCPU stand, except soak):

Historical (Nov-3, depth 0, 2 vCPU — kept for depth/host comparison, not for citing SLOs):

Boundary with the library

Here There (tracewick/tracewick)
Capacity compose, k6, scenarios, reports Unit / integration / Infection / smoke wiring
Long-lived charts and raw artifacts Brief docs blurb + link + a couple of screenshots
Depend on Packagist / pinned git ref Do not accept “add 10k RPS k6” PRs into the library

License

Apache-2.0, same as Tracewick.

About

Load tests, soak runs, and reproducible benchmark stands for Tracewick — reports, charts, and env anyone can spin up to verify results.

Topics

Resources

Code of conduct

Contributing

Security policy

Stars

0 stars

Watchers

0 watching

Forks

Contributors

Languages