Skip to content

Improve TempLocationManagerTest stability #10118

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
jbachorik merged 2 commits into from
Jan 8, 2026
Merged

Improve TempLocationManagerTest stability #10118

jbachorik merged 2 commits into from
Jan 8, 2026
+94 −53

Conversation

@jbachorik
Copy link
Contributor

@jbachorik jbachorik commented Dec 9, 2025 •
edited
Loading

What does this PR do?

Improves the stability of TempLocationManagerTest by fixing timing-related test flakiness. The changes ensure proper timeout handling in the cleanup hook interface and improve test synchronization using phaser coordination with timeouts.

Motivation

The test was previously marked as @Flaky due to intermittent failures related to race conditions and timing issues in the cleanup process. This PR addresses those issues by:

  1. Enhanced CleanupHook interface: Added a timeout parameter to all callback methods to explicitly signal when cleanup operations are timing out, allowing hooks to handle timeouts gracefully
  2. Better test synchronization: Replaced indefinite waits with timeout-aware phaser coordination to prevent tests from hanging
  3. Removed flaky test annotation: The test is now stable and no longer requires the @Flaky annotation

Changes

TempLocationManager.java:

  • Modified CleanupHook interface methods to accept a timeout boolean parameter
  • Updated cleanup visitor to pass timeout state to all hook callback methods
  • Ensured hooks are notified when cleanup terminates due to timeout

TempLocationManagerTest.java:

  • Removed @Flaky annotation from timeout test
  • Added timeout handling to phaser coordination (arriveOrAwaitAdvance with 5-second timeout)
  • Improved timeout test to verify that the timeout flag is correctly set
  • Replaced LockSupport.parkNanos with more robust waitFor helper method
  • Added assertions to validate timeout behavior

Contributor Checklist

Jira ticket: PROF-13219

@jbachorik jbachorik added comp: testing Testing type: refactoring tag: no release notes Changes to exclude from release notes labels Dec 9, 2025
@jbachorik jbachorik marked this pull request as ready for review December 9, 2025 11:58
@jbachorik jbachorik requested a review from a team as a code owner December 9, 2025 11:58
@pr-commenter
Copy link

pr-commenter bot commented Dec 9, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jb/tlm_test_stability
git_commit_date 1765286973 1765288209
git_commit_sha 0d1a541 739ec92
release_version 1.57.0-SNAPSHOT~0d1a541243 1.57.0-SNAPSHOT~739ec923e5
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1765290018 1765290018
ci_job_id 1279485410 1279485410
ci_pipeline_id 85580388 85580388
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-3-q4k2wn76 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-3-q4k2wn76 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 7 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~739ec923e5, baseline=1.57.0-SNAPSHOT~0d1a541243

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.081 s) : 0, 1081003
Total [baseline] (10.912 s) : 0, 10912272
Agent [candidate] (1.082 s) : 0, 1081973
Total [candidate] (10.837 s) : 0, 10836894
section appsec
Agent [baseline] (1.273 s) : 0, 1273373
Total [baseline] (11.22 s) : 0, 11220268
Agent [candidate] (1.27 s) : 0, 1270219
Total [candidate] (11.122 s) : 0, 11121580
section iast
Agent [baseline] (1.232 s) : 0, 1231612
Total [baseline] (11.102 s) : 0, 11101639
Agent [candidate] (1.232 s) : 0, 1232165
Total [candidate] (11.211 s) : 0, 11210950
section profiling
Agent [baseline] (1.221 s) : 0, 1220821
Total [baseline] (11.227 s) : 0, 11226581
Agent [candidate] (1.213 s) : 0, 1213034
Total [candidate] (11.075 s) : 0, 11074604
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.081 s -
Agent appsec 1.273 s 192.37 ms (17.8%)
Agent iast 1.232 s 150.609 ms (13.9%)
Agent profiling 1.221 s 139.818 ms (12.9%)
Total tracing 10.912 s -
Total appsec 11.22 s 307.996 ms (2.8%)
Total iast 11.102 s 189.367 ms (1.7%)
Total profiling 11.227 s 314.31 ms (2.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.082 s -
Agent appsec 1.27 s 188.246 ms (17.4%)
Agent iast 1.232 s 150.192 ms (13.9%)
Agent profiling 1.213 s 131.061 ms (12.1%)
Total tracing 10.837 s -
Total appsec 11.122 s 284.687 ms (2.6%)
Total iast 11.211 s 374.056 ms (3.5%)
Total profiling 11.075 s 237.71 ms (2.2%) 
gantt
    title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~739ec923e5, baseline=1.57.0-SNAPSHOT~0d1a541243

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.201 ms) : 0, 1201
crashtracking [candidate] (1.181 ms) : 0, 1181
BytebuddyAgent [baseline] (648.539 ms) : 0, 648539
BytebuddyAgent [candidate] (648.412 ms) : 0, 648412
GlobalTracer [baseline] (281.823 ms) : 0, 281823
GlobalTracer [candidate] (282.379 ms) : 0, 282379
AppSec [baseline] (32.416 ms) : 0, 32416
AppSec [candidate] (32.451 ms) : 0, 32451
Debugger [baseline] (68.106 ms) : 0, 68106
Debugger [candidate] (68.45 ms) : 0, 68450
Remote Config [baseline] (673.397 µs) : 0, 673
Remote Config [candidate] (645.844 µs) : 0, 646
Telemetry [baseline] (8.95 ms) : 0, 8950
Telemetry [candidate] (9.105 ms) : 0, 9105
Flare Poller [baseline] (3.706 ms) : 0, 3706
Flare Poller [candidate] (3.776 ms) : 0, 3776
section appsec
crashtracking [baseline] (1.217 ms) : 0, 1217
crashtracking [candidate] (1.195 ms) : 0, 1195
BytebuddyAgent [baseline] (693.452 ms) : 0, 693452
BytebuddyAgent [candidate] (691.977 ms) : 0, 691977
GlobalTracer [baseline] (262.171 ms) : 0, 262171
GlobalTracer [candidate] (260.269 ms) : 0, 260269
IAST [baseline] (25.134 ms) : 0, 25134
IAST [candidate] (24.812 ms) : 0, 24812
AppSec [baseline] (175.434 ms) : 0, 175434
AppSec [candidate] (174.636 ms) : 0, 174636
Debugger [baseline] (66.722 ms) : 0, 66722
Debugger [candidate] (68.108 ms) : 0, 68108
Remote Config [baseline] (712.708 µs) : 0, 713
Remote Config [candidate] (704.261 µs) : 0, 704
Telemetry [baseline] (9.124 ms) : 0, 9124
Telemetry [candidate] (9.093 ms) : 0, 9093
Flare Poller [baseline] (3.886 ms) : 0, 3886
Flare Poller [candidate] (3.915 ms) : 0, 3915
section iast
crashtracking [baseline] (1.203 ms) : 0, 1203
crashtracking [candidate] (1.204 ms) : 0, 1204
BytebuddyAgent [baseline] (796.828 ms) : 0, 796828
BytebuddyAgent [candidate] (797.686 ms) : 0, 797686
GlobalTracer [baseline] (257.833 ms) : 0, 257833
GlobalTracer [candidate] (257.021 ms) : 0, 257021
IAST [baseline] (26.794 ms) : 0, 26794
IAST [candidate] (27.013 ms) : 0, 27013
AppSec [baseline] (35.498 ms) : 0, 35498
AppSec [candidate] (35.465 ms) : 0, 35465
Debugger [baseline] (65.568 ms) : 0, 65568
Debugger [candidate] (65.53 ms) : 0, 65530
Remote Config [baseline] (551.714 µs) : 0, 552
Remote Config [candidate] (608.558 µs) : 0, 609
Telemetry [baseline] (8.344 ms) : 0, 8344
Telemetry [candidate] (8.501 ms) : 0, 8501
Flare Poller [baseline] (3.446 ms) : 0, 3446
Flare Poller [candidate] (3.496 ms) : 0, 3496
section profiling
crashtracking [baseline] (1.217 ms) : 0, 1217
crashtracking [candidate] (1.195 ms) : 0, 1195
BytebuddyAgent [baseline] (710.71 ms) : 0, 710710
BytebuddyAgent [candidate] (706.79 ms) : 0, 706790
GlobalTracer [baseline] (223.431 ms) : 0, 223431
GlobalTracer [candidate] (222.542 ms) : 0, 222542
AppSec [baseline] (32.758 ms) : 0, 32758
AppSec [candidate] (32.569 ms) : 0, 32569
Debugger [baseline] (68.824 ms) : 0, 68824
Debugger [candidate] (68.365 ms) : 0, 68365
Remote Config [baseline] (665.616 µs) : 0, 666
Remote Config [candidate] (644.483 µs) : 0, 644
Telemetry [baseline] (9.164 ms) : 0, 9164
Telemetry [candidate] (9.071 ms) : 0, 9071
Flare Poller [baseline] (3.835 ms) : 0, 3835
Flare Poller [candidate] (3.86 ms) : 0, 3860
ProfilingAgent [baseline] (99.73 ms) : 0, 99730
ProfilingAgent [candidate] (98.011 ms) : 0, 98011
Profiling [baseline] (100.329 ms) : 0, 100329
Profiling [candidate] (98.592 ms) : 0, 98592
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~739ec923e5, baseline=1.57.0-SNAPSHOT~0d1a541243

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.08 s) : 0, 1079839
Total [baseline] (8.725 s) : 0, 8725281
Agent [candidate] (1.088 s) : 0, 1088343
Total [candidate] (8.769 s) : 0, 8769333
section iast
Agent [baseline] (1.222 s) : 0, 1221809
Total [baseline] (9.468 s) : 0, 9468191
Agent [candidate] (1.223 s) : 0, 1222634
Total [candidate] (9.46 s) : 0, 9459558
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.08 s -
Agent iast 1.222 s 141.97 ms (13.1%)
Total tracing 8.725 s -
Total iast 9.468 s 742.91 ms (8.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.088 s -
Agent iast 1.223 s 134.291 ms (12.3%)
Total tracing 8.769 s -
Total iast 9.46 s 690.225 ms (7.9%) 
gantt
    title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~739ec923e5, baseline=1.57.0-SNAPSHOT~0d1a541243

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.182 ms) : 0, 1182
crashtracking [candidate] (1.191 ms) : 0, 1191
BytebuddyAgent [baseline] (648.133 ms) : 0, 648133
BytebuddyAgent [candidate] (653.393 ms) : 0, 653393
GlobalTracer [baseline] (281.381 ms) : 0, 281381
GlobalTracer [candidate] (284.01 ms) : 0, 284010
AppSec [baseline] (32.449 ms) : 0, 32449
AppSec [candidate] (32.663 ms) : 0, 32663
Debugger [baseline] (67.648 ms) : 0, 67648
Debugger [candidate] (67.765 ms) : 0, 67765
Remote Config [baseline] (661.05 µs) : 0, 661
Remote Config [candidate] (632.972 µs) : 0, 633
Telemetry [baseline] (8.999 ms) : 0, 8999
Telemetry [candidate] (9.087 ms) : 0, 9087
Flare Poller [baseline] (3.761 ms) : 0, 3761
Flare Poller [candidate] (3.736 ms) : 0, 3736
section iast
crashtracking [baseline] (1.18 ms) : 0, 1180
crashtracking [candidate] (1.184 ms) : 0, 1184
BytebuddyAgent [baseline] (790.927 ms) : 0, 790927
BytebuddyAgent [candidate] (790.724 ms) : 0, 790724
GlobalTracer [baseline] (255.721 ms) : 0, 255721
GlobalTracer [candidate] (255.619 ms) : 0, 255619
IAST [baseline] (26.753 ms) : 0, 26753
IAST [candidate] (26.899 ms) : 0, 26899
AppSec [baseline] (35.432 ms) : 0, 35432
AppSec [candidate] (34.679 ms) : 0, 34679
Debugger [baseline] (63.996 ms) : 0, 63996
Debugger [candidate] (65.733 ms) : 0, 65733
Remote Config [baseline] (543.696 µs) : 0, 544
Remote Config [candidate] (561.485 µs) : 0, 561
Telemetry [baseline] (8.411 ms) : 0, 8411
Telemetry [candidate] (8.424 ms) : 0, 8424
Flare Poller [baseline] (3.433 ms) : 0, 3433
Flare Poller [candidate] (3.423 ms) : 0, 3423
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jb/tlm_test_stability
git_commit_date 1765286973 1765288209
git_commit_sha 0d1a541 739ec92
release_version 1.57.0-SNAPSHOT~0d1a541243 1.57.0-SNAPSHOT~739ec923e5
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1765290496 1765290496
ci_job_id 1279485412 1279485412
ci_pipeline_id 85580388 85580388
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-aey161np 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-aey161np 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 1 performance regressions! Performance is the same for 16 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:petclinic:code_origins:high_load better
[-958.287µs; -427.807µs] or [-5.326%; -2.378%]		 better
[-2.032ms; -0.779ms] or [-6.847%; -2.625%]		 unstable
[-14.996op/s; +37.934op/s] or [-5.927%; +14.992%]		 17.298ms 28.268ms 264.500op/s 17.991ms 29.673ms 253.031op/s
scenario:load:petclinic:profiling:high_load unstable
[+1.229ms; +3.401ms] or [+6.783%; +18.775%]		 worse
[+1.687ms; +3.651ms] or [+5.747%; +12.437%]		 unstable
[-56.167op/s; -0.478op/s] or [-22.231%; -0.189%]		 20.432ms 32.029ms 224.333op/s 18.117ms 29.359ms 252.656op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~739ec923e5, baseline=1.57.0-SNAPSHOT~0d1a541243
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.209 ms) : 1197, 1221
.   : milestone, 1209,
iast (3.152 ms) : 3113, 3192
.   : milestone, 3152,
iast_FULL (5.693 ms) : 5636, 5750
.   : milestone, 5693,
iast_GLOBAL (3.465 ms) : 3415, 3514
.   : milestone, 3465,
profiling (2.249 ms) : 2228, 2269
.   : milestone, 2249,
tracing (1.819 ms) : 1804, 1835
.   : milestone, 1819,
section candidate
no_agent (1.212 ms) : 1200, 1224
.   : milestone, 1212,
iast (3.256 ms) : 3216, 3296
.   : milestone, 3256,
iast_FULL (5.659 ms) : 5604, 5714
.   : milestone, 5659,
iast_GLOBAL (3.563 ms) : 3512, 3615
.   : milestone, 3563,
profiling (2.057 ms) : 2040, 2075
.   : milestone, 2057,
tracing (1.785 ms) : 1771, 1799
.   : milestone, 1785,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.209 ms [1.197 ms, 1.221 ms] -
iast 3.152 ms [3.113 ms, 3.192 ms] 1.943 ms (160.7%)
iast_FULL 5.693 ms [5.636 ms, 5.75 ms] 4.483 ms (370.7%)
iast_GLOBAL 3.465 ms [3.415 ms, 3.514 ms] 2.256 ms (186.5%)
profiling 2.249 ms [2.228 ms, 2.269 ms] 1.039 ms (85.9%)
tracing 1.819 ms [1.804 ms, 1.835 ms] 610.046 µs (50.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.212 ms [1.2 ms, 1.224 ms] -
iast 3.256 ms [3.216 ms, 3.296 ms] 2.044 ms (168.6%)
iast_FULL 5.659 ms [5.604 ms, 5.714 ms] 4.447 ms (366.9%)
iast_GLOBAL 3.563 ms [3.512 ms, 3.615 ms] 2.351 ms (194.0%)
profiling 2.057 ms [2.04 ms, 2.075 ms] 845.145 µs (69.7%)
tracing 1.785 ms [1.771 ms, 1.799 ms] 572.826 µs (47.3%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~739ec923e5, baseline=1.57.0-SNAPSHOT~0d1a541243
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.891 ms) : 17711, 18070
.   : milestone, 17891,
appsec (18.611 ms) : 18420, 18802
.   : milestone, 18611,
code_origins (18.442 ms) : 18258, 18626
.   : milestone, 18442,
iast (17.69 ms) : 17517, 17863
.   : milestone, 17690,
profiling (18.47 ms) : 18289, 18651
.   : milestone, 18470,
tracing (18.036 ms) : 17850, 18223
.   : milestone, 18036,
section candidate
no_agent (17.802 ms) : 17623, 17981
.   : milestone, 17802,
appsec (18.488 ms) : 18297, 18678
.   : milestone, 18488,
code_origins (17.635 ms) : 17460, 17810
.   : milestone, 17635,
iast (17.606 ms) : 17433, 17780
.   : milestone, 17606,
profiling (20.194 ms) : 19981, 20408
.   : milestone, 20194,
tracing (17.98 ms) : 17800, 18159
.   : milestone, 17980,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.891 ms [17.711 ms, 18.07 ms] -
appsec 18.611 ms [18.42 ms, 18.802 ms] 719.686 µs (4.0%)
code_origins 18.442 ms [18.258 ms, 18.626 ms] 551.345 µs (3.1%)
iast 17.69 ms [17.517 ms, 17.863 ms] -200.65 µs (-1.1%)
profiling 18.47 ms [18.289 ms, 18.651 ms] 579.518 µs (3.2%)
tracing 18.036 ms [17.85 ms, 18.223 ms] 145.508 µs (0.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.802 ms [17.623 ms, 17.981 ms] -
appsec 18.488 ms [18.297 ms, 18.678 ms] 685.656 µs (3.9%)
code_origins 17.635 ms [17.46 ms, 17.81 ms] -166.491 µs (-0.9%)
iast 17.606 ms [17.433 ms, 17.78 ms] -195.608 µs (-1.1%)
profiling 20.194 ms [19.981 ms, 20.408 ms] 2.392 ms (13.4%)
tracing 17.98 ms [17.8 ms, 18.159 ms] 177.673 µs (1.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jb/tlm_test_stability
git_commit_date 1765286973 1765288209
git_commit_sha 0d1a541 739ec92
release_version 1.57.0-SNAPSHOT~0d1a541243 1.57.0-SNAPSHOT~739ec923e5
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1765290212 1765290212
ci_job_id 1279485415 1279485415
ci_pipeline_id 85580388 85580388
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-tocvtcxi 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-tocvtcxi 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~739ec923e5, baseline=1.57.0-SNAPSHOT~0d1a541243
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.47 ms) : 1459, 1482
.   : milestone, 1470,
appsec (3.629 ms) : 3413, 3845
.   : milestone, 3629,
iast (2.207 ms) : 2142, 2271
.   : milestone, 2207,
iast_GLOBAL (2.245 ms) : 2181, 2310
.   : milestone, 2245,
profiling (2.063 ms) : 2011, 2116
.   : milestone, 2063,
tracing (2.036 ms) : 1985, 2087
.   : milestone, 2036,
section candidate
no_agent (1.47 ms) : 1459, 1482
.   : milestone, 1470,
appsec (3.688 ms) : 3468, 3907
.   : milestone, 3688,
iast (2.196 ms) : 2132, 2260
.   : milestone, 2196,
iast_GLOBAL (2.243 ms) : 2178, 2308
.   : milestone, 2243,
profiling (2.08 ms) : 2026, 2134
.   : milestone, 2080,
tracing (2.036 ms) : 1985, 2087
.   : milestone, 2036,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.459 ms, 1.482 ms] -
appsec 3.629 ms [3.413 ms, 3.845 ms] 2.159 ms (146.8%)
iast 2.207 ms [2.142 ms, 2.271 ms] 736.077 µs (50.1%)
iast_GLOBAL 2.245 ms [2.181 ms, 2.31 ms] 774.646 µs (52.7%)
profiling 2.063 ms [2.011 ms, 2.116 ms] 592.831 µs (40.3%)
tracing 2.036 ms [1.985 ms, 2.087 ms] 565.709 µs (38.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.459 ms, 1.482 ms] -
appsec 3.688 ms [3.468 ms, 3.907 ms] 2.217 ms (150.8%)
iast 2.196 ms [2.132 ms, 2.26 ms] 725.342 µs (49.3%)
iast_GLOBAL 2.243 ms [2.178 ms, 2.308 ms] 772.677 µs (52.6%)
profiling 2.08 ms [2.026 ms, 2.134 ms] 609.335 µs (41.4%)
tracing 2.036 ms [1.985 ms, 2.087 ms] 565.838 µs (38.5%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~739ec923e5, baseline=1.57.0-SNAPSHOT~0d1a541243
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.694 s) : 14694000, 14694000
.   : milestone, 14694000,
appsec (14.544 s) : 14544000, 14544000
.   : milestone, 14544000,
iast (18.134 s) : 18134000, 18134000
.   : milestone, 18134000,
iast_GLOBAL (17.972 s) : 17972000, 17972000
.   : milestone, 17972000,
profiling (14.47 s) : 14470000, 14470000
.   : milestone, 14470000,
tracing (14.723 s) : 14723000, 14723000
.   : milestone, 14723000,
section candidate
no_agent (15.33 s) : 15330000, 15330000
.   : milestone, 15330000,
appsec (14.801 s) : 14801000, 14801000
.   : milestone, 14801000,
iast (18.442 s) : 18442000, 18442000
.   : milestone, 18442000,
iast_GLOBAL (17.946 s) : 17946000, 17946000
.   : milestone, 17946000,
profiling (14.54 s) : 14540000, 14540000
.   : milestone, 14540000,
tracing (14.605 s) : 14605000, 14605000
.   : milestone, 14605000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.694 s [14.694 s, 14.694 s] -
appsec 14.544 s [14.544 s, 14.544 s] -150.0 ms (-1.0%)
iast 18.134 s [18.134 s, 18.134 s] 3.44 s (23.4%)
iast_GLOBAL 17.972 s [17.972 s, 17.972 s] 3.278 s (22.3%)
profiling 14.47 s [14.47 s, 14.47 s] -224.0 ms (-1.5%)
tracing 14.723 s [14.723 s, 14.723 s] 29.0 ms (0.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.33 s [15.33 s, 15.33 s] -
appsec 14.801 s [14.801 s, 14.801 s] -529.0 ms (-3.5%)
iast 18.442 s [18.442 s, 18.442 s] 3.112 s (20.3%)
iast_GLOBAL 17.946 s [17.946 s, 17.946 s] 2.616 s (17.1%)
profiling 14.54 s [14.54 s, 14.54 s] -790.0 ms (-5.2%)
tracing 14.605 s [14.605 s, 14.605 s] -725.0 ms (-4.7%)

amarziali
amarziali approved these changes Jan 8, 2026
View reviewed changes
Copy link
Contributor

@amarziali amarziali left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. FYI I noticed that there are often issues deleting the temp dirs because they are not empty but it's perhaps due to other issues.

@jbachorik jbachorik merged commit 8987088 into master Jan 8, 2026
539 checks passed
@jbachorik jbachorik deleted the jb/tlm_test_stability branch January 8, 2026 10:23
@github-actions github-actions bot added this to the 1.59.0 milestone Jan 8, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@amarziali amarziali amarziali approved these changes

@PerfectSlayer PerfectSlayer Awaiting requested review from PerfectSlayer PerfectSlayer is a code owner automatically assigned from DataDog/apm-java

@dougqh dougqh Awaiting requested review from dougqh

Assignees

No one assigned

Labels

comp: testing Testing tag: no release notes Changes to exclude from release notes type: refactoring

Projects

None yet

Milestone

1.59.0

Development

Successfully merging this pull request may close these issues.

3 participants

@jbachorik @amarziali