Skip to content

Marked as flaky.#10608

Merged
gh-worker-dd-mergequeue-cf854d[bot] merged 1 commit intomasterfrom
alexeyk/flaky-smoke-test-vt
Feb 18, 2026
Merged

Marked as flaky.#10608
gh-worker-dd-mergequeue-cf854d[bot] merged 1 commit intomasterfrom
alexeyk/flaky-smoke-test-vt

Conversation

@AlexeyKuznetsov-DD
Copy link
Contributor

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD commented Feb 17, 2026

What Does This Do

Marked test Thread.startVirtualThread() runnable as flaky.

Motivation

Green CI.

Additional Notes

Test is flaky almost every day on master branch.

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD self-assigned this Feb 17, 2026
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD added tag: no release notes Changes to exclude from release notes tag: flaky test Flaky tests inst: java Core Java language instrumentation labels Feb 17, 2026
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD marked this pull request as ready for review February 17, 2026 16:33
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD requested a review from a team as a code owner February 17, 2026 16:33
@pr-commenter
Copy link

pr-commenter bot commented Feb 17, 2026

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/flaky-smoke-test-vt
git_commit_date 1771338181 1771345580
git_commit_sha 27522ae 9fc68d9
release_version 1.60.0-SNAPSHOT~27522ae525 1.60.0-SNAPSHOT~9fc68d96bf
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1771347568 1771347568
ci_job_id 1432343008 1432343008
ci_pipeline_id 96961538 96961538
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-j2x7avgq 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-j2x7avgq 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 63 metrics, 8 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~9fc68d96bf, baseline=1.60.0-SNAPSHOT~27522ae525

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.077 s) : 0, 1076764
Total [baseline] (8.798 s) : 0, 8798302
Agent [candidate] (1.064 s) : 0, 1063738
Total [candidate] (8.719 s) : 0, 8719208
section iast
Agent [baseline] (1.229 s) : 0, 1228849
Total [baseline] (9.378 s) : 0, 9377527
Agent [candidate] (1.231 s) : 0, 1231243
Total [candidate] (9.307 s) : 0, 9307206
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.077 s -
Agent iast 1.229 s 152.085 ms (14.1%)
Total tracing 8.798 s -
Total iast 9.378 s 579.224 ms (6.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.064 s -
Agent iast 1.231 s 167.506 ms (15.7%)
Total tracing 8.719 s -
Total iast 9.307 s 587.998 ms (6.7%) 
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~9fc68d96bf, baseline=1.60.0-SNAPSHOT~27522ae525

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.213 ms) : 0, 1213
crashtracking [candidate] (1.191 ms) : 0, 1191
BytebuddyAgent [baseline] (637.265 ms) : 0, 637265
BytebuddyAgent [candidate] (628.897 ms) : 0, 628897
AgentMeter [baseline] (29.509 ms) : 0, 29509
AgentMeter [candidate] (28.948 ms) : 0, 28948
GlobalTracer [baseline] (260.323 ms) : 0, 260323
GlobalTracer [candidate] (257.555 ms) : 0, 257555
AppSec [baseline] (33.388 ms) : 0, 33388
AppSec [candidate] (32.809 ms) : 0, 32809
Debugger [baseline] (61.286 ms) : 0, 61286
Debugger [candidate] (61.942 ms) : 0, 61942
Remote Config [baseline] (626.308 µs) : 0, 626
Remote Config [candidate] (650.354 µs) : 0, 650
Telemetry [baseline] (11.524 ms) : 0, 11524
Telemetry [candidate] (12.033 ms) : 0, 12033
Flare Poller [baseline] (6.058 ms) : 0, 6058
Flare Poller [candidate] (4.452 ms) : 0, 4452
section iast
crashtracking [baseline] (1.18 ms) : 0, 1180
crashtracking [candidate] (1.207 ms) : 0, 1207
BytebuddyAgent [baseline] (794.033 ms) : 0, 794033
BytebuddyAgent [candidate] (796.297 ms) : 0, 796297
AgentMeter [baseline] (11.235 ms) : 0, 11235
AgentMeter [candidate] (11.242 ms) : 0, 11242
GlobalTracer [baseline] (247.605 ms) : 0, 247605
GlobalTracer [candidate] (248.012 ms) : 0, 248012
IAST [baseline] (26.852 ms) : 0, 26852
IAST [candidate] (26.902 ms) : 0, 26902
AppSec [baseline] (34.969 ms) : 0, 34969
AppSec [candidate] (34.777 ms) : 0, 34777
Debugger [baseline] (65.109 ms) : 0, 65109
Debugger [candidate] (64.864 ms) : 0, 64864
Remote Config [baseline] (536.565 µs) : 0, 537
Remote Config [candidate] (540.599 µs) : 0, 541
Telemetry [baseline] (8.603 ms) : 0, 8603
Telemetry [candidate] (8.607 ms) : 0, 8607
Flare Poller [baseline] (3.507 ms) : 0, 3507
Flare Poller [candidate] (3.55 ms) : 0, 3550
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~9fc68d96bf, baseline=1.60.0-SNAPSHOT~27522ae525

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.062 s) : 0, 1062061
Total [baseline] (10.922 s) : 0, 10922144
Agent [candidate] (1.063 s) : 0, 1062902
Total [candidate] (10.948 s) : 0, 10947695
section appsec
Agent [baseline] (1.247 s) : 0, 1247466
Total [baseline] (11.067 s) : 0, 11067413
Agent [candidate] (1.237 s) : 0, 1236629
Total [candidate] (10.985 s) : 0, 10984884
section iast
Agent [baseline] (1.235 s) : 0, 1235471
Total [baseline] (11.159 s) : 0, 11159031
Agent [candidate] (1.233 s) : 0, 1232825
Total [candidate] (11.114 s) : 0, 11113822
section profiling
Agent [baseline] (1.19 s) : 0, 1189848
Total [baseline] (10.883 s) : 0, 10882611
Agent [candidate] (1.198 s) : 0, 1197957
Total [candidate] (11.057 s) : 0, 11057301
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.062 s -
Agent appsec 1.247 s 185.406 ms (17.5%)
Agent iast 1.235 s 173.411 ms (16.3%)
Agent profiling 1.19 s 127.787 ms (12.0%)
Total tracing 10.922 s -
Total appsec 11.067 s 145.269 ms (1.3%)
Total iast 11.159 s 236.886 ms (2.2%)
Total profiling 10.883 s -39.533 ms (-0.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.063 s -
Agent appsec 1.237 s 173.728 ms (16.3%)
Agent iast 1.233 s 169.923 ms (16.0%)
Agent profiling 1.198 s 135.055 ms (12.7%)
Total tracing 10.948 s -
Total appsec 10.985 s 37.189 ms (0.3%)
Total iast 11.114 s 166.127 ms (1.5%)
Total profiling 11.057 s 109.606 ms (1.0%) 
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~9fc68d96bf, baseline=1.60.0-SNAPSHOT~27522ae525

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.162 ms) : 0, 1162
crashtracking [candidate] (1.182 ms) : 0, 1182
BytebuddyAgent [baseline] (626.668 ms) : 0, 626668
BytebuddyAgent [candidate] (627.832 ms) : 0, 627832
AgentMeter [baseline] (28.802 ms) : 0, 28802
AgentMeter [candidate] (28.853 ms) : 0, 28853
GlobalTracer [baseline] (256.532 ms) : 0, 256532
GlobalTracer [candidate] (256.815 ms) : 0, 256815
AppSec [baseline] (32.639 ms) : 0, 32639
AppSec [candidate] (32.731 ms) : 0, 32731
Debugger [baseline] (62.147 ms) : 0, 62147
Debugger [candidate] (62.161 ms) : 0, 62161
Remote Config [baseline] (618.35 µs) : 0, 618
Remote Config [candidate] (626.892 µs) : 0, 627
Telemetry [baseline] (12.164 ms) : 0, 12164
Telemetry [candidate] (11.389 ms) : 0, 11389
Flare Poller [baseline] (6.051 ms) : 0, 6051
Flare Poller [candidate] (6.14 ms) : 0, 6140
section appsec
crashtracking [baseline] (1.185 ms) : 0, 1185
crashtracking [candidate] (1.177 ms) : 0, 1177
BytebuddyAgent [baseline] (663.229 ms) : 0, 663229
BytebuddyAgent [candidate] (656.605 ms) : 0, 656605
AgentMeter [baseline] (12.051 ms) : 0, 12051
AgentMeter [candidate] (11.932 ms) : 0, 11932
GlobalTracer [baseline] (259.577 ms) : 0, 259577
GlobalTracer [candidate] (257.837 ms) : 0, 257837
AppSec [baseline] (168.686 ms) : 0, 168686
AppSec [candidate] (167.764 ms) : 0, 167764
Debugger [baseline] (67.6 ms) : 0, 67600
Debugger [candidate] (67.009 ms) : 0, 67009
Remote Config [baseline] (649.794 µs) : 0, 650
Remote Config [candidate] (661.123 µs) : 0, 661
Telemetry [baseline] (9.771 ms) : 0, 9771
Telemetry [candidate] (9.654 ms) : 0, 9654
Flare Poller [baseline] (3.873 ms) : 0, 3873
Flare Poller [candidate] (3.731 ms) : 0, 3731
IAST [baseline] (25.466 ms) : 0, 25466
IAST [candidate] (25.055 ms) : 0, 25055
section iast
crashtracking [baseline] (1.182 ms) : 0, 1182
crashtracking [candidate] (1.177 ms) : 0, 1177
BytebuddyAgent [baseline] (798.395 ms) : 0, 798395
BytebuddyAgent [candidate] (795.606 ms) : 0, 795606
AgentMeter [baseline] (11.288 ms) : 0, 11288
AgentMeter [candidate] (11.265 ms) : 0, 11265
GlobalTracer [baseline] (249.025 ms) : 0, 249025
GlobalTracer [candidate] (248.561 ms) : 0, 248561
AppSec [baseline] (33.12 ms) : 0, 33120
AppSec [candidate] (32.253 ms) : 0, 32253
Debugger [baseline] (67.384 ms) : 0, 67384
Debugger [candidate] (68.964 ms) : 0, 68964
Remote Config [baseline] (535.052 µs) : 0, 535
Remote Config [candidate] (542.155 µs) : 0, 542
Telemetry [baseline] (8.582 ms) : 0, 8582
Telemetry [candidate] (8.665 ms) : 0, 8665
Flare Poller [baseline] (3.5 ms) : 0, 3500
Flare Poller [candidate] (3.506 ms) : 0, 3506
IAST [baseline] (27.197 ms) : 0, 27197
IAST [candidate] (27.041 ms) : 0, 27041
section profiling
ProfilingAgent [baseline] (98.802 ms) : 0, 98802
ProfilingAgent [candidate] (99.699 ms) : 0, 99699
crashtracking [baseline] (1.216 ms) : 0, 1216
crashtracking [candidate] (1.23 ms) : 0, 1230
BytebuddyAgent [baseline] (681.847 ms) : 0, 681847
BytebuddyAgent [candidate] (686.722 ms) : 0, 686722
AgentMeter [baseline] (8.62 ms) : 0, 8620
AgentMeter [candidate] (8.652 ms) : 0, 8652
GlobalTracer [baseline] (215.962 ms) : 0, 215962
GlobalTracer [candidate] (217.155 ms) : 0, 217155
AppSec [baseline] (32.584 ms) : 0, 32584
AppSec [candidate] (32.944 ms) : 0, 32944
Debugger [baseline] (67.653 ms) : 0, 67653
Debugger [candidate] (67.884 ms) : 0, 67884
Remote Config [baseline] (618.593 µs) : 0, 619
Remote Config [candidate] (631.164 µs) : 0, 631
Telemetry [baseline] (8.938 ms) : 0, 8938
Telemetry [candidate] (9.018 ms) : 0, 9018
Flare Poller [baseline] (3.802 ms) : 0, 3802
Flare Poller [candidate] (3.799 ms) : 0, 3799
Profiling [baseline] (99.372 ms) : 0, 99372
Profiling [candidate] (100.274 ms) : 0, 100274
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/flaky-smoke-test-vt
git_commit_date 1771338181 1771345580
git_commit_sha 27522ae 9fc68d9
release_version 1.60.0-SNAPSHOT~27522ae525 1.60.0-SNAPSHOT~9fc68d96bf
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1771348065 1771348065
ci_job_id 1432343011 1432343011
ci_pipeline_id 96961538 96961538
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-tpvuxslz 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-tpvuxslz 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 2 performance regressions! Performance is the same for 17 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load worse
[+81.215µs; +229.489µs] or [+2.993%; +8.456%]		 same
[-6.173µs; +499.991µs] or [-0.079%; +6.413%]		 unstable
[-182.867op/s; +89.492op/s] or [-13.993%; +6.848%]		 2.869ms 8.044ms 1260.188op/s 2.714ms 7.797ms 1306.875op/s
scenario:load:insecure-bank:iast_FULL:high_load worse
[+208.917µs; +419.936µs] or [+4.152%; +8.346%]		 unsure
[+185.554µs; +704.707µs] or [+1.549%; +5.883%]		 unstable
[-120.476op/s; +39.851op/s] or [-14.768%; +4.885%]		 5.346ms 12.423ms 775.500op/s 5.032ms 11.978ms 815.812op/s
scenario:load:petclinic:iast:high_load better
[-1148.368µs; -787.944µs] or [-6.370%; -4.370%]		 unsure
[-1395.462µs; -386.628µs] or [-4.773%; -1.322%]		 unstable
[-12.826op/s; +41.764op/s] or [-5.050%; +16.444%]		 17.061ms 28.346ms 268.438op/s 18.029ms 29.237ms 253.969op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~9fc68d96bf, baseline=1.60.0-SNAPSHOT~27522ae525
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.156 ms) : 18958, 19354
.   : milestone, 19156,
appsec (18.487 ms) : 18298, 18676
.   : milestone, 18487,
code_origins (17.753 ms) : 17579, 17927
.   : milestone, 17753,
iast (18.374 ms) : 18193, 18556
.   : milestone, 18374,
profiling (19.5 ms) : 19297, 19703
.   : milestone, 19500,
tracing (17.476 ms) : 17303, 17649
.   : milestone, 17476,
section candidate
no_agent (19.705 ms) : 19499, 19910
.   : milestone, 19705,
appsec (18.431 ms) : 18242, 18620
.   : milestone, 18431,
code_origins (17.488 ms) : 17312, 17664
.   : milestone, 17488,
iast (17.38 ms) : 17206, 17555
.   : milestone, 17380,
profiling (18.724 ms) : 18535, 18913
.   : milestone, 18724,
tracing (17.653 ms) : 17477, 17829
.   : milestone, 17653,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.156 ms [18.958 ms, 19.354 ms] -
appsec 18.487 ms [18.298 ms, 18.676 ms] -669.008 µs (-3.5%)
code_origins 17.753 ms [17.579 ms, 17.927 ms] -1.403 ms (-7.3%)
iast 18.374 ms [18.193 ms, 18.556 ms] -781.784 µs (-4.1%)
profiling 19.5 ms [19.297 ms, 19.703 ms] 343.845 µs (1.8%)
tracing 17.476 ms [17.303 ms, 17.649 ms] -1.68 ms (-8.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.705 ms [19.499 ms, 19.91 ms] -
appsec 18.431 ms [18.242 ms, 18.62 ms] -1.274 ms (-6.5%)
code_origins 17.488 ms [17.312 ms, 17.664 ms] -2.216 ms (-11.2%)
iast 17.38 ms [17.206 ms, 17.555 ms] -2.324 ms (-11.8%)
profiling 18.724 ms [18.535 ms, 18.913 ms] -980.508 µs (-5.0%)
tracing 17.653 ms [17.477 ms, 17.829 ms] -2.051 ms (-10.4%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~9fc68d96bf, baseline=1.60.0-SNAPSHOT~27522ae525
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.179 ms) : 1168, 1191
.   : milestone, 1179,
iast (3.199 ms) : 3152, 3246
.   : milestone, 3199,
iast_FULL (5.664 ms) : 5609, 5719
.   : milestone, 5664,
iast_GLOBAL (3.508 ms) : 3443, 3574
.   : milestone, 3508,
profiling (2.014 ms) : 1997, 2032
.   : milestone, 2014,
tracing (1.799 ms) : 1784, 1814
.   : milestone, 1799,
section candidate
no_agent (1.197 ms) : 1185, 1209
.   : milestone, 1197,
iast (3.138 ms) : 3094, 3181
.   : milestone, 3138,
iast_FULL (5.963 ms) : 5904, 6022
.   : milestone, 5963,
iast_GLOBAL (3.64 ms) : 3580, 3701
.   : milestone, 3640,
profiling (1.968 ms) : 1951, 1986
.   : milestone, 1968,
tracing (1.752 ms) : 1739, 1766
.   : milestone, 1752,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.179 ms [1.168 ms, 1.191 ms] -
iast 3.199 ms [3.152 ms, 3.246 ms] 2.02 ms (171.3%)
iast_FULL 5.664 ms [5.609 ms, 5.719 ms] 4.485 ms (380.2%)
iast_GLOBAL 3.508 ms [3.443 ms, 3.574 ms] 2.329 ms (197.5%)
profiling 2.014 ms [1.997 ms, 2.032 ms] 834.968 µs (70.8%)
tracing 1.799 ms [1.784 ms, 1.814 ms] 619.664 µs (52.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.197 ms [1.185 ms, 1.209 ms] -
iast 3.138 ms [3.094 ms, 3.181 ms] 1.94 ms (162.0%)
iast_FULL 5.963 ms [5.904 ms, 6.022 ms] 4.766 ms (398.0%)
iast_GLOBAL 3.64 ms [3.58 ms, 3.701 ms] 2.443 ms (204.0%)
profiling 1.968 ms [1.951 ms, 1.986 ms] 771.019 µs (64.4%)
tracing 1.752 ms [1.739 ms, 1.766 ms] 555.088 µs (46.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/flaky-smoke-test-vt
git_commit_date 1771338181 1771345580
git_commit_sha 27522ae 9fc68d9
release_version 1.60.0-SNAPSHOT~27522ae525 1.60.0-SNAPSHOT~9fc68d96bf
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1771347766 1771347766
ci_job_id 1432343014 1432343014
ci_pipeline_id 96961538 96961538
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-qgvmskqx 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-qgvmskqx 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 1 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.419ms; -1.072ms] or [-37.867%; -28.603%]		 2.503ms 3.748ms
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~9fc68d96bf, baseline=1.60.0-SNAPSHOT~27522ae525
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.015 s) : 15015000, 15015000
.   : milestone, 15015000,
appsec (14.773 s) : 14773000, 14773000
.   : milestone, 14773000,
iast (18.276 s) : 18276000, 18276000
.   : milestone, 18276000,
iast_GLOBAL (17.701 s) : 17701000, 17701000
.   : milestone, 17701000,
profiling (14.855 s) : 14855000, 14855000
.   : milestone, 14855000,
tracing (14.852 s) : 14852000, 14852000
.   : milestone, 14852000,
section candidate
no_agent (15.429 s) : 15429000, 15429000
.   : milestone, 15429000,
appsec (14.897 s) : 14897000, 14897000
.   : milestone, 14897000,
iast (17.984 s) : 17984000, 17984000
.   : milestone, 17984000,
iast_GLOBAL (17.799 s) : 17799000, 17799000
.   : milestone, 17799000,
profiling (14.879 s) : 14879000, 14879000
.   : milestone, 14879000,
tracing (14.69 s) : 14690000, 14690000
.   : milestone, 14690000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.015 s [15.015 s, 15.015 s] -
appsec 14.773 s [14.773 s, 14.773 s] -242.0 ms (-1.6%)
iast 18.276 s [18.276 s, 18.276 s] 3.261 s (21.7%)
iast_GLOBAL 17.701 s [17.701 s, 17.701 s] 2.686 s (17.9%)
profiling 14.855 s [14.855 s, 14.855 s] -160.0 ms (-1.1%)
tracing 14.852 s [14.852 s, 14.852 s] -163.0 ms (-1.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.429 s [15.429 s, 15.429 s] -
appsec 14.897 s [14.897 s, 14.897 s] -532.0 ms (-3.4%)
iast 17.984 s [17.984 s, 17.984 s] 2.555 s (16.6%)
iast_GLOBAL 17.799 s [17.799 s, 17.799 s] 2.37 s (15.4%)
profiling 14.879 s [14.879 s, 14.879 s] -550.0 ms (-3.6%)
tracing 14.69 s [14.69 s, 14.69 s] -739.0 ms (-4.8%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~9fc68d96bf, baseline=1.60.0-SNAPSHOT~27522ae525
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.467 ms) : 1456, 1478
.   : milestone, 1467,
appsec (3.748 ms) : 3527, 3970
.   : milestone, 3748,
iast (2.242 ms) : 2172, 2311
.   : milestone, 2242,
iast_GLOBAL (2.287 ms) : 2217, 2356
.   : milestone, 2287,
profiling (2.46 ms) : 2300, 2620
.   : milestone, 2460,
tracing (2.05 ms) : 1997, 2104
.   : milestone, 2050,
section candidate
no_agent (1.47 ms) : 1459, 1482
.   : milestone, 1470,
appsec (2.503 ms) : 2448, 2557
.   : milestone, 2503,
iast (2.248 ms) : 2179, 2318
.   : milestone, 2248,
iast_GLOBAL (2.293 ms) : 2223, 2362
.   : milestone, 2293,
profiling (2.069 ms) : 2015, 2123
.   : milestone, 2069,
tracing (2.046 ms) : 1993, 2099
.   : milestone, 2046,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.467 ms [1.456 ms, 1.478 ms] -
appsec 3.748 ms [3.527 ms, 3.97 ms] 2.281 ms (155.5%)
iast 2.242 ms [2.172 ms, 2.311 ms] 774.436 µs (52.8%)
iast_GLOBAL 2.287 ms [2.217 ms, 2.356 ms] 819.498 µs (55.9%)
profiling 2.46 ms [2.3 ms, 2.62 ms] 992.828 µs (67.7%)
tracing 2.05 ms [1.997 ms, 2.104 ms] 582.952 µs (39.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.459 ms, 1.482 ms] -
appsec 2.503 ms [2.448 ms, 2.557 ms] 1.032 ms (70.2%)
iast 2.248 ms [2.179 ms, 2.318 ms] 777.959 µs (52.9%)
iast_GLOBAL 2.293 ms [2.223 ms, 2.362 ms] 822.364 µs (55.9%)
profiling 2.069 ms [2.015 ms, 2.123 ms] 598.719 µs (40.7%)
tracing 2.046 ms [1.993 ms, 2.099 ms] 575.823 µs (39.2%)

PerfectSlayer
PerfectSlayer approved these changes Feb 18, 2026
View reviewed changes
Copy link
Contributor

@PerfectSlayer PerfectSlayer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks. I wonder if we will have to make the other tested method flaky as well...

@PerfectSlayer PerfectSlayer added the tag: flaky test/disabled Disabled flaky tests label Feb 18, 2026
@AlexeyKuznetsov-DD
Copy link
Contributor Author

AlexeyKuznetsov-DD commented Feb 18, 2026

Thanks. I wonder if we will have to make the other tested method flaky as well...

So far only 2 of them, but I will monitor CI state.

@gh-worker-dd-mergequeue-cf854d gh-worker-dd-mergequeue-cf854d bot merged commit 88c2434 into master Feb 18, 2026
557 checks passed
@gh-worker-dd-mergequeue-cf854d gh-worker-dd-mergequeue-cf854d bot deleted the alexeyk/flaky-smoke-test-vt branch February 18, 2026 16:16
@github-actions github-actions bot added this to the 1.60.0 milestone Feb 18, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@PerfectSlayer PerfectSlayer PerfectSlayer approved these changes

Assignees

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD

Labels

inst: java Core Java language instrumentation tag: flaky test/disabled Disabled flaky tests tag: flaky test Flaky tests tag: no release notes Changes to exclude from release notes

Projects

None yet

Milestone

1.60.0

Development

Successfully merging this pull request may close these issues.

2 participants

@AlexeyKuznetsov-DD @PerfectSlayer

Comments