DRAFT Kotlin exploration tests

[jpbempel]

What Does This Do

Motivation

Additional Notes

Contributor Checklist

• Format the title according to the contribution guidelines
• Assign the type: and (comp: or inst:) labels in addition to any other useful labels
• Avoid using close, fix, or any linking keywords when referencing an issue
  Use solves instead, and assign the PR milestone to the issue
• Update the CODEOWNERS file on source file addition, migration, or deletion
• Update public documentation with any new configuration flags or behaviors
• Once approved, use merge queue to merge the PR

Jira ticket: [PROJ-IDENT]

[datadog-official]

🎯 Code Coverage (details)
• Patch Coverage: 100.00%
• Overall Coverage: 57.03% (-0.02%)

_{This comment will be updated automatically if new data arrives.
🔗 Commit SHA: b550046 | Docs | Datadog PR Page | Give us feedback!}

[pr-commenter]

Debugger benchmarks

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
ci_job_date	1783953563	1783953917
end_time	2026-07-13T14:40:49	2026-07-13T14:46:43
git_branch	master	jpbempel/kotlin-exploration-tests
git_commit_sha	dfc9070	b550046
start_time	2026-07-13T14:39:24	2026-07-13T14:45:18

See matching parameters

	Baseline	Candidate
ci_job_id	1854200744	1854200744
ci_pipeline_id	124322544	124322544
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date	1783952964	1783952964

Summary

Found 5 performance improvements and 0 performance regressions! Performance is the same for 5 metrics, 5 unstable metrics.

scenario	Δ mean agg_http_req_duration_min	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p75	Δ mean agg_http_req_duration_p99	Δ mean throughput
scenario:loop	better [-491.330µs; -312.149µs] or [-5.286%; -3.358%]	better [-506.340µs; -322.530µs] or [-5.385%; -3.430%]	better [-512.131µs; -330.523µs] or [-5.406%; -3.489%]	better [-515.539µs; -326.297µs] or [-5.376%; -3.403%]	better [+3.373op/s; +5.881op/s] or [+3.204%; +5.587%]

See unchanged results

scenario	Δ mean agg_http_req_duration_min	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p75	Δ mean agg_http_req_duration_p99	Δ mean throughput
scenario:noprobe	unstable [-20.227µs; +16.755µs] or [-6.913%; +5.726%]	unstable [-32.146µs; +25.604µs] or [-9.602%; +7.648%]	unstable [-43.849µs; +34.297µs] or [-12.494%; +9.772%]	unstable [+18.482µs; +233.439µs] or [+1.512%; +19.093%]	same
scenario:basic	same	same	same	unstable [+19.328µs; +336.503µs] or [+1.693%; +29.478%]	same

Request duration reports for reports

gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (334.766 µs) : 305, 364
.   : milestone, 335,
basic (297.213 µs) : 291, 304
.   : milestone, 297,
loop (9.402 ms) : 9282, 9523
.   : milestone, 9402,
section candidate
noprobe (331.495 µs) : 306, 357
.   : milestone, 331,
basic (293.941 µs) : 288, 300
.   : milestone, 294,
loop (8.988 ms) : 8983, 8992
.   : milestone, 8988,

Loading

• baseline results

Scenario	Request median duration [CI 0.99]
noprobe	334.766 µs [305.269 µs, 364.262 µs]
basic	297.213 µs [290.829 µs, 303.596 µs]
loop	9.402 ms [9.282 ms, 9.523 ms]

• candidate results

Scenario	Request median duration [CI 0.99]
noprobe	331.495 µs [306.26 µs, 356.729 µs]
basic	293.941 µs [288.062 µs, 299.819 µs]
loop	8.988 ms [8.983 ms, 8.992 ms]

[dd-octo-sts]

🟢 Java Benchmark SLOs — All performance SLOs passed

Suite	Status
Startup	🟢 pass

SLO thresholds are defined here based on automatically generated metrics. A warning is raised when results are within 5% of the threshold.

PR vs. master results

Scenario	Candidate	master	Δ (95% CI of mean)
startup:insecure-bank:iast:Agent	14.80 s	14.68 s	[+0.1%; +1.6%] (maybe worse)
startup:insecure-bank:tracing:Agent	13.61 s	13.72 s	[-1.5%; -0.1%] (maybe better)
startup:petclinic:appsec:Agent	16.88 s	16.61 s	[+0.5%; +2.7%] (maybe worse)
startup:petclinic:iast:Agent	16.83 s	17.01 s	[-1.9%; -0.3%] (maybe better)
startup:petclinic:profiling:Agent	16.81 s	16.78 s	[-0.8%; +1.2%] (no difference)
startup:petclinic:sca:Agent	16.75 s	16.65 s	[-0.4%; +1.7%] (no difference)
startup:petclinic:tracing:Agent	16.01 s	15.66 s	[-2.0%; +6.6%] (no difference)

Commit: b550046f · CI Pipeline · Benchmarking Platform UI

---

Load and DaCapo benchmarks can be triggered manually in the GitLab pipeline. Results will appear in the Benchmarking Platform UI after completion.

[datadog-official]

Bits couldn’t fix the CI

🟢 Investigated · 🔴 Fix failed · ⚪ Validate · ⚪ Ready

OkHttp exploration jobs were running against prebuilt repository checkouts that could miss branch-provided *_exploration-tests.patch files, so disabled test fixes like FastFallbackTest were not applied before jvmTest. .gitlab/exploration-tests.yml now copies the patch files into /exploration-tests, and run-exploration-tests.sh applies the matching project patch idempotently before running the project command.

---

View in Datadog | Reviewed commit b550046