Skip to content

Upgrade jacoco to 0.8.15 and ASM to 9.10.1#11908

Draft
sarahchen6 wants to merge 3 commits into
masterfrom
sarahchen6/upgrade-asm-jacoco
Draft

Upgrade jacoco to 0.8.15 and ASM to 9.10.1#11908
sarahchen6 wants to merge 3 commits into
masterfrom
sarahchen6/upgrade-asm-jacoco

Conversation

@sarahchen6

@sarahchen6 sarahchen6 commented Jul 10, 2026

Copy link
Copy Markdown
Contributor

What Does This Do

Upgrade jacoco to 0.8.15 and ASM to 9.10.1

Unskip debugger tests for JDK 27

Motivation

Add support for JDK 27 (jacoco 0.8.15 and ASM 9.10 support JDK 27) and use latest dependency versions

Additional Notes

GitLab pipeline running non-default JVMs, including JDK 27: https://gitlab.ddbuild.io/DataDog/apm-reliability/dd-trace-java/-/pipelines/124030762

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@sarahchen6 sarahchen6 added type: feature Enhancements and improvements tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Jul 10, 2026
@datadog-datadog-prod-us1

This comment has been minimized.

@pr-commenter

pr-commenter Bot commented Jul 10, 2026

Copy link
Copy Markdown

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1783950816 1783951162
end_time 2026-07-13T13:55:03 2026-07-13T14:00:48
git_branch master sarahchen6/upgrade-asm-jacoco
git_commit_sha dfc9070 07c64c8
start_time 2026-07-13T13:53:37 2026-07-13T13:59:23
See matching parameters
Baseline Candidate
ci_job_id 1853921936 1853921936
ci_pipeline_id 124308284 124308284
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1783950140 1783950140

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 5 unstable metrics.

See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-22.481µs; +16.222µs] or [-7.617%; +5.496%]
unstable
[-33.429µs; +26.392µs] or [-9.840%; +7.769%]
unstable
[-43.104µs; +37.905µs] or [-12.140%; +10.675%]
unstable
[-279.034µs; -67.629µs] or [-20.323%; -4.926%]
same
scenario:basic same same same unstable
[-288.102µs; -43.918µs] or [-24.110%; -3.675%]
same
scenario:loop unsure
[-6.018µs; -0.140µs] or [-0.068%; -0.002%]
unsure
[+9.348µs; +20.030µs] or [+0.104%; +0.223%]
same same same
Request duration reports for reports
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (339.723 µs) : 316, 364
.   : milestone, 340,
basic (296.533 µs) : 290, 303
.   : milestone, 297,
loop (8.971 ms) : 8966, 8976
.   : milestone, 8971,
section candidate
noprobe (336.204 µs) : 304, 368
.   : milestone, 336,
basic (298.94 µs) : 291, 307
.   : milestone, 299,
loop (8.985 ms) : 8981, 8990
.   : milestone, 8985,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 339.723 µs [315.622 µs, 363.824 µs]
basic 296.533 µs [289.911 µs, 303.156 µs]
loop 8.971 ms [8.966 ms, 8.976 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 336.204 µs [304.021 µs, 368.387 µs]
basic 298.94 µs [291.26 µs, 306.62 µs]
loop 8.985 ms [8.981 ms, 8.99 ms]

@dd-octo-sts

dd-octo-sts Bot commented Jul 10, 2026

Copy link
Copy Markdown
Contributor

🟢 Java Benchmark SLOs — All performance SLOs passed

Suite Status
Startup 🟢 pass

SLO thresholds are defined here based on automatically generated metrics. A warning is raised when results are within 5% of the threshold.

PR vs. master results
Scenario Candidate master Δ (95% CI of mean)
startup:insecure-bank:iast:Agent 14.00 s 13.95 s [-0.4%; +1.1%] (no difference)
startup:insecure-bank:tracing:Agent 12.94 s 13.08 s [-2.0%; -0.3%] (maybe better)
startup:petclinic:appsec:Agent 16.79 s 16.64 s [-0.3%; +2.1%] (no difference)
startup:petclinic:iast:Agent 16.79 s 16.93 s [-1.6%; -0.0%] (maybe better)
startup:petclinic:profiling:Agent 16.43 s 16.70 s [-6.0%; +2.8%] (no difference)
startup:petclinic:sca:Agent 16.88 s 16.61 s [+0.6%; +2.6%] (maybe worse)
startup:petclinic:tracing:Agent 16.12 s 15.53 s [-1.8%; +9.5%] (unstable)

Commit: 07c64c84 · CI Pipeline · Benchmarking Platform UI


Load and DaCapo benchmarks can be triggered manually in the GitLab pipeline. Results will appear in the Benchmarking Platform UI after completion.

@pr-commenter

pr-commenter Bot commented Jul 10, 2026

Copy link
Copy Markdown

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/upgrade-asm-jacoco
git_commit_date 1783693314 1783695771
git_commit_sha 674ebf5 a39d5a2
See matching parameters
Baseline Candidate
ci_job_date 1783697016 1783697016
ci_job_id 1849674502 1849674502
ci_pipeline_id 124030762 124030762
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce unsure
[+1459.014op/s; +8709.809op/s] or [+0.865%; +5.167%]
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce same

@pr-commenter

pr-commenter Bot commented Jul 10, 2026

Copy link
Copy Markdown

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/upgrade-asm-jacoco
git_commit_date 1783949042 1783950140
git_commit_sha dfc9070 07c64c8
See matching parameters
Baseline Candidate
ci_job_date 1783951454 1783951454
ci_job_id 1853921934 1853921934
ci_pipeline_id 124308284 124308284
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 2 metrics, 0 unstable metrics.

scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume worse
[-17700.359op/s; -3071.645op/s] or [-5.931%; -1.029%]
See unchanged results
scenario Δ mean throughput
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume same

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes type: feature Enhancements and improvements

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant