Skip to content

Conversation

@avara1986
Copy link
Member

Update benchmark functions, we need this changes in the main branches

@avara1986 avara1986 added changelog/no-changelog A changelog entry is not required for this PR. backport 4.0 backport 3.19 labels Dec 5, 2025
@github-actions
Copy link
Contributor

github-actions bot commented Dec 5, 2025

CODEOWNERS have been resolved as:

benchmarks/appsec_iast_aspects/functions.py                             @DataDog/asm-python

@github-actions
Copy link
Contributor

github-actions bot commented Dec 5, 2025

Bootstrap import analysis

Comparison of import times between this PR and base.

Summary

The average import time from this PR is: 252 ± 3 ms.

The average import time from base is: 255 ± 4 ms.

The import time difference between this PR and base is: -2.7 ± 0.2 ms.

Import time breakdown

The following import paths have shrunk:

ddtrace.auto 2.694 ms (1.07%)
ddtrace 1.364 ms (0.54%)
ddtrace._logger 0.683 ms (0.27%)
ddtrace.internal.telemetry 0.683 ms (0.27%)
ddtrace.internal.telemetry.writer 0.683 ms (0.27%)
ddtrace.internal.utils.version 0.683 ms (0.27%)
ddtrace.version 0.683 ms (0.27%)
ddtrace.internal._unpatched 0.028 ms (0.01%)
json 0.028 ms (0.01%)
json.decoder 0.028 ms (0.01%)
re 0.028 ms (0.01%)
enum 0.028 ms (0.01%)
types 0.028 ms (0.01%)
ddtrace.bootstrap.sitecustomize 1.330 ms (0.53%)
ddtrace.bootstrap.preload 1.330 ms (0.53%)
ddtrace.internal.remoteconfig.client 0.654 ms (0.26%)

@pr-commenter
Copy link

pr-commenter bot commented Dec 5, 2025

Performance SLOs

Comparing candidate avara1986/APPSEC-60151_update_benchmarks (1e6a7d5) with baseline main (ca3c521)

📈 Performance Regressions (3 suites)
📈 iastaspects - 116/116

✅ add_aspect

Time: ✅ 0.447µs (SLO: <10.000µs 📉 -95.5%) vs baseline: -0.8%

Memory: ✅ 40.167MB (SLO: <41.500MB -3.2%) vs baseline: +5.0%


✅ add_inplace_aspect

Time: ✅ 0.444µs (SLO: <10.000µs 📉 -95.6%) vs baseline: -0.4%

Memory: ✅ 40.128MB (SLO: <41.500MB -3.3%) vs baseline: +4.5%


✅ add_inplace_noaspect

Time: ✅ 0.285µs (SLO: <10.000µs 📉 -97.1%) vs baseline: -0.8%

Memory: ✅ 40.246MB (SLO: <41.500MB -3.0%) vs baseline: +4.7%


✅ add_noaspect

Time: ✅ 0.362µs (SLO: <10.000µs 📉 -96.4%) vs baseline: +1.0%

Memory: ✅ 40.305MB (SLO: <41.500MB -2.9%) vs baseline: +5.0%


✅ bytearray_aspect

Time: ✅ 1.364µs (SLO: <10.000µs 📉 -86.4%) vs baseline: -0.4%

Memory: ✅ 40.501MB (SLO: <41.500MB -2.4%) vs baseline: +5.3%


✅ bytearray_extend_aspect

Time: ✅ 1.497µs (SLO: <10.000µs 📉 -85.0%) vs baseline: -2.3%

Memory: ✅ 40.305MB (SLO: <41.500MB -2.9%) vs baseline: +5.2%


✅ bytearray_extend_noaspect

Time: ✅ 0.616µs (SLO: <10.000µs 📉 -93.8%) vs baseline: -0.5%

Memory: ✅ 40.206MB (SLO: <41.500MB -3.1%) vs baseline: +4.7%


✅ bytes_aspect

Time: ✅ 1.309µs (SLO: <10.000µs 📉 -86.9%) vs baseline: ~same

Memory: ✅ 40.324MB (SLO: <41.500MB -2.8%) vs baseline: +5.3%


✅ bytes_noaspect

Time: ✅ 0.493µs (SLO: <10.000µs 📉 -95.1%) vs baseline: -0.8%

Memory: ✅ 40.265MB (SLO: <41.500MB -3.0%) vs baseline: +4.7%


✅ bytesio_aspect

Time: ✅ 1.346µs (SLO: <10.000µs 📉 -86.5%) vs baseline: +2.3%

Memory: ✅ 40.324MB (SLO: <41.500MB -2.8%) vs baseline: +5.0%


✅ bytesio_noaspect

Time: ✅ 0.498µs (SLO: <10.000µs 📉 -95.0%) vs baseline: -0.7%

Memory: ✅ 40.324MB (SLO: <41.500MB -2.8%) vs baseline: +5.2%


✅ capitalize_aspect

Time: ✅ 0.740µs (SLO: <10.000µs 📉 -92.6%) vs baseline: ~same

Memory: ✅ 40.285MB (SLO: <41.500MB -2.9%) vs baseline: +4.7%


✅ capitalize_noaspect

Time: ✅ 0.439µs (SLO: <10.000µs 📉 -95.6%) vs baseline: -0.5%

Memory: ✅ 40.265MB (SLO: <41.500MB -3.0%) vs baseline: +5.0%


✅ casefold_aspect

Time: ✅ 0.738µs (SLO: <10.000µs 📉 -92.6%) vs baseline: -1.0%

Memory: ✅ 40.246MB (SLO: <41.500MB -3.0%) vs baseline: +5.0%


✅ casefold_noaspect

Time: ✅ 0.372µs (SLO: <10.000µs 📉 -96.3%) vs baseline: +0.3%

Memory: ✅ 40.226MB (SLO: <41.500MB -3.1%) vs baseline: +4.6%


✅ decode_aspect

Time: ✅ 0.728µs (SLO: <10.000µs 📉 -92.7%) vs baseline: +0.3%

Memory: ✅ 40.206MB (SLO: <41.500MB -3.1%) vs baseline: +4.8%


✅ decode_noaspect

Time: ✅ 0.419µs (SLO: <10.000µs 📉 -95.8%) vs baseline: +0.1%

Memory: ✅ 40.128MB (SLO: <41.500MB -3.3%) vs baseline: +4.3%


✅ encode_aspect

Time: ✅ 0.715µs (SLO: <10.000µs 📉 -92.8%) vs baseline: -0.4%

Memory: ✅ 40.226MB (SLO: <41.500MB -3.1%) vs baseline: +4.6%


✅ encode_noaspect

Time: ✅ 0.407µs (SLO: <10.000µs 📉 -95.9%) vs baseline: +0.6%

Memory: ✅ 40.226MB (SLO: <41.500MB -3.1%) vs baseline: +4.7%


✅ format_aspect

Time: ✅ 3.463µs (SLO: <10.000µs 📉 -65.4%) vs baseline: -0.4%

Memory: ✅ 40.324MB (SLO: <41.500MB -2.8%) vs baseline: +4.8%


✅ format_map_aspect

Time: ✅ 3.612µs (SLO: <10.000µs 📉 -63.9%) vs baseline: -0.9%

Memory: ✅ 40.226MB (SLO: <41.500MB -3.1%) vs baseline: +4.8%


✅ format_map_noaspect

Time: ✅ 0.813µs (SLO: <10.000µs 📉 -91.9%) vs baseline: -0.7%

Memory: ✅ 40.285MB (SLO: <41.500MB -2.9%) vs baseline: +5.4%


✅ format_noaspect

Time: ✅ 0.598µs (SLO: <10.000µs 📉 -94.0%) vs baseline: ~same

Memory: ✅ 40.305MB (SLO: <41.500MB -2.9%) vs baseline: +4.8%


✅ index_aspect

Time: ✅ 0.359µs (SLO: <10.000µs 📉 -96.4%) vs baseline: -0.4%

Memory: ✅ 40.344MB (SLO: <41.500MB -2.8%) vs baseline: +5.4%


✅ index_noaspect

Time: ✅ 0.315µs (SLO: <10.000µs 📉 -96.8%) vs baseline: -1.2%

Memory: ✅ 40.206MB (SLO: <41.500MB -3.1%) vs baseline: +4.8%


✅ join_aspect

Time: ✅ 1.376µs (SLO: <10.000µs 📉 -86.2%) vs baseline: +0.6%

Memory: ✅ 40.128MB (SLO: <41.500MB -3.3%) vs baseline: +4.4%


✅ join_noaspect

Time: ✅ 0.533µs (SLO: <10.000µs 📉 -94.7%) vs baseline: ~same

Memory: ✅ 40.167MB (SLO: <41.500MB -3.2%) vs baseline: +4.5%


✅ ljust_aspect

Time: ✅ 2.624µs (SLO: <20.000µs 📉 -86.9%) vs baseline: +2.1%

Memory: ✅ 40.049MB (SLO: <41.500MB -3.5%) vs baseline: +4.2%


✅ ljust_noaspect

Time: ✅ 0.406µs (SLO: <10.000µs 📉 -95.9%) vs baseline: -0.5%

Memory: ✅ 40.226MB (SLO: <41.500MB -3.1%) vs baseline: +4.7%


✅ lower_aspect

Time: ✅ 2.274µs (SLO: <10.000µs 📉 -77.3%) vs baseline: +0.9%

Memory: ✅ 40.285MB (SLO: <41.500MB -2.9%) vs baseline: +4.8%


✅ lower_noaspect

Time: ✅ 0.374µs (SLO: <10.000µs 📉 -96.3%) vs baseline: +1.6%

Memory: ✅ 40.246MB (SLO: <41.500MB -3.0%) vs baseline: +4.8%


✅ lstrip_aspect

Time: ✅ 2.226µs (SLO: <20.000µs 📉 -88.9%) vs baseline: +1.7%

Memory: ✅ 40.364MB (SLO: <41.500MB -2.7%) vs baseline: +5.6%


✅ lstrip_noaspect

Time: ✅ 0.387µs (SLO: <10.000µs 📉 -96.1%) vs baseline: -0.4%

Memory: ✅ 40.108MB (SLO: <41.500MB -3.4%) vs baseline: +4.4%


✅ modulo_aspect

Time: ✅ 1.075µs (SLO: <10.000µs 📉 -89.3%) vs baseline: +2.6%

Memory: ✅ 40.285MB (SLO: <41.500MB -2.9%) vs baseline: +4.9%


✅ modulo_aspect_for_bytearray_bytearray

Time: ✅ 1.587µs (SLO: <10.000µs 📉 -84.1%) vs baseline: -1.2%

Memory: ✅ 40.088MB (SLO: <41.500MB -3.4%) vs baseline: +4.3%


✅ modulo_aspect_for_bytes

Time: ✅ 1.016µs (SLO: <10.000µs 📉 -89.8%) vs baseline: -0.2%

Memory: ✅ 40.206MB (SLO: <41.500MB -3.1%) vs baseline: +4.3%


✅ modulo_aspect_for_bytes_bytearray

Time: ✅ 1.293µs (SLO: <10.000µs 📉 -87.1%) vs baseline: +1.9%

Memory: ✅ 40.187MB (SLO: <41.500MB -3.2%) vs baseline: +4.5%


✅ modulo_noaspect

Time: ✅ 0.670µs (SLO: <10.000µs 📉 -93.3%) vs baseline: ~same

Memory: ✅ 40.167MB (SLO: <41.500MB -3.2%) vs baseline: +4.4%


✅ replace_aspect

Time: ✅ 4.854µs (SLO: <10.000µs 📉 -51.5%) vs baseline: -1.4%

Memory: ✅ 40.147MB (SLO: <41.500MB -3.3%) vs baseline: +4.7%


✅ replace_noaspect

Time: ✅ 0.462µs (SLO: <10.000µs 📉 -95.4%) vs baseline: -0.5%

Memory: ✅ 40.206MB (SLO: <41.500MB -3.1%) vs baseline: +4.7%


✅ repr_aspect

Time: ✅ 0.948µs (SLO: <10.000µs 📉 -90.5%) vs baseline: -1.1%

Memory: ✅ 40.147MB (SLO: <41.500MB -3.3%) vs baseline: +4.9%


✅ repr_noaspect

Time: ✅ 0.455µs (SLO: <10.000µs 📉 -95.4%) vs baseline: -0.1%

Memory: ✅ 40.128MB (SLO: <41.500MB -3.3%) vs baseline: +4.9%


✅ rstrip_aspect

Time: ✅ 1.897µs (SLO: <20.000µs 📉 -90.5%) vs baseline: +0.6%

Memory: ✅ 40.108MB (SLO: <41.500MB -3.4%) vs baseline: +4.3%


✅ rstrip_noaspect

Time: ✅ 0.376µs (SLO: <10.000µs 📉 -96.2%) vs baseline: -3.3%

Memory: ✅ 40.305MB (SLO: <41.500MB -2.9%) vs baseline: +5.0%


✅ slice_aspect

Time: ✅ 0.496µs (SLO: <10.000µs 📉 -95.0%) vs baseline: -0.5%

Memory: ✅ 40.167MB (SLO: <41.500MB -3.2%) vs baseline: +4.2%


✅ slice_noaspect

Time: ✅ 0.450µs (SLO: <10.000µs 📉 -95.5%) vs baseline: -0.2%

Memory: ✅ 40.167MB (SLO: <41.500MB -3.2%) vs baseline: +4.8%


✅ stringio_aspect

Time: ✅ 1.909µs (SLO: <10.000µs 📉 -80.9%) vs baseline: 📈 +12.8%

Memory: ✅ 40.029MB (SLO: <41.500MB -3.5%) vs baseline: +4.6%


✅ stringio_noaspect

Time: ✅ 0.919µs (SLO: <10.000µs 📉 -90.8%) vs baseline: -0.7%

Memory: ✅ 40.246MB (SLO: <41.500MB -3.0%) vs baseline: +5.0%


✅ strip_aspect

Time: ✅ 2.191µs (SLO: <20.000µs 📉 -89.0%) vs baseline: ~same

Memory: ✅ 40.324MB (SLO: <41.500MB -2.8%) vs baseline: +5.2%


✅ strip_noaspect

Time: ✅ 0.385µs (SLO: <10.000µs 📉 -96.2%) vs baseline: -1.4%

Memory: ✅ 40.265MB (SLO: <41.500MB -3.0%) vs baseline: +4.9%


✅ swapcase_aspect

Time: ✅ 2.516µs (SLO: <10.000µs 📉 -74.8%) vs baseline: +3.0%

Memory: ✅ 40.285MB (SLO: <41.500MB -2.9%) vs baseline: +5.2%


✅ swapcase_noaspect

Time: ✅ 0.538µs (SLO: <10.000µs 📉 -94.6%) vs baseline: ~same

Memory: ✅ 40.187MB (SLO: <41.500MB -3.2%) vs baseline: +4.7%


✅ title_aspect

Time: ✅ 2.461µs (SLO: <10.000µs 📉 -75.4%) vs baseline: +3.1%

Memory: ✅ 40.206MB (SLO: <41.500MB -3.1%) vs baseline: +4.6%


✅ title_noaspect

Time: ✅ 0.502µs (SLO: <10.000µs 📉 -95.0%) vs baseline: -0.3%

Memory: ✅ 40.108MB (SLO: <41.500MB -3.4%) vs baseline: +4.4%


✅ translate_aspect

Time: ✅ 3.305µs (SLO: <10.000µs 📉 -67.0%) vs baseline: ~same

Memory: ✅ 40.206MB (SLO: <41.500MB -3.1%) vs baseline: +4.3%


✅ translate_noaspect

Time: ✅ 1.043µs (SLO: <10.000µs 📉 -89.6%) vs baseline: +0.5%

Memory: ✅ 40.226MB (SLO: <41.500MB -3.1%) vs baseline: +4.7%


✅ upper_aspect

Time: ✅ 2.303µs (SLO: <10.000µs 📉 -77.0%) vs baseline: +2.3%

Memory: ✅ 40.187MB (SLO: <41.500MB -3.2%) vs baseline: +4.1%


✅ upper_noaspect

Time: ✅ 0.369µs (SLO: <10.000µs 📉 -96.3%) vs baseline: -0.9%

Memory: ✅ 40.305MB (SLO: <41.500MB -2.9%) vs baseline: +4.9%


📈 iastaspectsospath - 24/24

✅ ospathbasename_aspect

Time: ✅ 5.156µs (SLO: <10.000µs 📉 -48.4%) vs baseline: 📈 +25.9%

Memory: ✅ 40.265MB (SLO: <41.000MB 🟡 -1.8%) vs baseline: +4.7%


✅ ospathbasename_noaspect

Time: ✅ 1.077µs (SLO: <10.000µs 📉 -89.2%) vs baseline: -1.3%

Memory: ✅ 40.069MB (SLO: <41.000MB -2.3%) vs baseline: +4.8%


✅ ospathjoin_aspect

Time: ✅ 6.155µs (SLO: <10.000µs 📉 -38.5%) vs baseline: +0.1%

Memory: ✅ 40.088MB (SLO: <41.000MB -2.2%) vs baseline: +4.6%


✅ ospathjoin_noaspect

Time: ✅ 2.276µs (SLO: <10.000µs 📉 -77.2%) vs baseline: -1.0%

Memory: ✅ 40.206MB (SLO: <41.000MB 🟡 -1.9%) vs baseline: +4.7%


✅ ospathnormcase_aspect

Time: ✅ 3.420µs (SLO: <10.000µs 📉 -65.8%) vs baseline: -0.5%

Memory: ✅ 40.108MB (SLO: <41.000MB -2.2%) vs baseline: +4.4%


✅ ospathnormcase_noaspect

Time: ✅ 0.574µs (SLO: <10.000µs 📉 -94.3%) vs baseline: +0.5%

Memory: ✅ 40.128MB (SLO: <41.000MB -2.1%) vs baseline: +4.8%


✅ ospathsplit_aspect

Time: ✅ 4.693µs (SLO: <10.000µs 📉 -53.1%) vs baseline: -1.1%

Memory: ✅ 40.167MB (SLO: <41.000MB -2.0%) vs baseline: +4.7%


✅ ospathsplit_noaspect

Time: ✅ 1.591µs (SLO: <10.000µs 📉 -84.1%) vs baseline: +0.4%

Memory: ✅ 40.324MB (SLO: <41.000MB 🟡 -1.6%) vs baseline: +4.8%


✅ ospathsplitdrive_aspect

Time: ✅ 3.595µs (SLO: <10.000µs 📉 -64.0%) vs baseline: -0.6%

Memory: ✅ 40.246MB (SLO: <41.000MB 🟡 -1.8%) vs baseline: +4.6%


✅ ospathsplitdrive_noaspect

Time: ✅ 0.696µs (SLO: <10.000µs 📉 -93.0%) vs baseline: -1.3%

Memory: ✅ 40.167MB (SLO: <41.000MB -2.0%) vs baseline: +4.7%


✅ ospathsplitext_aspect

Time: ✅ 4.488µs (SLO: <10.000µs 📉 -55.1%) vs baseline: +0.3%

Memory: ✅ 40.285MB (SLO: <41.000MB 🟡 -1.7%) vs baseline: +5.0%


✅ ospathsplitext_noaspect

Time: ✅ 1.377µs (SLO: <10.000µs 📉 -86.2%) vs baseline: +0.6%

Memory: ✅ 40.206MB (SLO: <41.000MB 🟡 -1.9%) vs baseline: +5.0%


📈 telemetryaddmetric - 30/30

✅ 1-count-metric-1-times

Time: ✅ 3.393µs (SLO: <20.000µs 📉 -83.0%) vs baseline: 📈 +15.4%

Memory: ✅ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +4.8%


✅ 1-count-metrics-100-times

Time: ✅ 201.618µs (SLO: <220.000µs -8.4%) vs baseline: -0.1%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.7%


✅ 1-distribution-metric-1-times

Time: ✅ 3.309µs (SLO: <20.000µs 📉 -83.5%) vs baseline: ~same

Memory: ✅ 34.741MB (SLO: <35.500MB -2.1%) vs baseline: +3.8%


✅ 1-distribution-metrics-100-times

Time: ✅ 218.601µs (SLO: <230.000µs -5.0%) vs baseline: ~same

Memory: ✅ 34.937MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.4%


✅ 1-gauge-metric-1-times

Time: ✅ 2.178µs (SLO: <20.000µs 📉 -89.1%) vs baseline: +0.8%

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.0%


✅ 1-gauge-metrics-100-times

Time: ✅ 135.686µs (SLO: <150.000µs -9.5%) vs baseline: +0.1%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.9%


✅ 1-rate-metric-1-times

Time: ✅ 3.139µs (SLO: <20.000µs 📉 -84.3%) vs baseline: +1.5%

Memory: ✅ 34.741MB (SLO: <35.500MB -2.1%) vs baseline: +4.3%


✅ 1-rate-metrics-100-times

Time: ✅ 215.415µs (SLO: <250.000µs 📉 -13.8%) vs baseline: -0.3%

Memory: ✅ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +5.0%


✅ 100-count-metrics-100-times

Time: ✅ 20.253ms (SLO: <22.000ms -7.9%) vs baseline: ~same

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.7%


✅ 100-distribution-metrics-100-times

Time: ✅ 2.269ms (SLO: <2.550ms 📉 -11.0%) vs baseline: -1.6%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.7%


✅ 100-gauge-metrics-100-times

Time: ✅ 1.411ms (SLO: <1.550ms -9.0%) vs baseline: +1.0%

Memory: ✅ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +5.0%


✅ 100-rate-metrics-100-times

Time: ✅ 2.226ms (SLO: <2.550ms 📉 -12.7%) vs baseline: +0.6%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +5.1%


✅ flush-1-metric

Time: ✅ 4.634µs (SLO: <20.000µs 📉 -76.8%) vs baseline: -0.1%

Memory: ✅ 35.095MB (SLO: <35.500MB 🟡 -1.1%) vs baseline: +4.9%


✅ flush-100-metrics

Time: ✅ 174.811µs (SLO: <250.000µs 📉 -30.1%) vs baseline: ~same

Memory: ✅ 35.134MB (SLO: <35.500MB 🟡 -1.0%) vs baseline: +4.8%


✅ flush-1000-metrics

Time: ✅ 2.185ms (SLO: <2.500ms 📉 -12.6%) vs baseline: -0.5%

Memory: ✅ 35.960MB (SLO: <36.500MB 🟡 -1.5%) vs baseline: +4.9%

🟡 Near SLO Breach (16 suites)
🟡 djangosimple - 30/30

✅ appsec

Time: ✅ 19.597ms (SLO: <22.300ms 📉 -12.1%) vs baseline: ~same

Memory: ✅ 68.223MB (SLO: <70.500MB -3.2%) vs baseline: +5.0%


✅ exception-replay-enabled

Time: ✅ 1.358ms (SLO: <1.450ms -6.3%) vs baseline: -0.4%

Memory: ✅ 66.264MB (SLO: <67.500MB 🟡 -1.8%) vs baseline: +4.8%


✅ iast

Time: ✅ 19.585ms (SLO: <22.250ms 📉 -12.0%) vs baseline: +0.2%

Memory: ✅ 68.223MB (SLO: <70.000MB -2.5%) vs baseline: +4.8%


✅ profiler

Time: ✅ 15.402ms (SLO: <16.550ms -6.9%) vs baseline: -0.4%

Memory: ✅ 56.336MB (SLO: <57.500MB -2.0%) vs baseline: +4.9%


✅ resource-renaming

Time: ✅ 19.592ms (SLO: <21.750ms -9.9%) vs baseline: +0.4%

Memory: ✅ 68.262MB (SLO: <70.500MB -3.2%) vs baseline: +5.1%


✅ span-code-origin

Time: ✅ 20.072ms (SLO: <28.200ms 📉 -28.8%) vs baseline: +1.5%

Memory: ✅ 68.151MB (SLO: <71.000MB -4.0%) vs baseline: +4.9%


✅ tracer

Time: ✅ 19.582ms (SLO: <21.750ms -10.0%) vs baseline: ~same

Memory: ✅ 68.184MB (SLO: <70.000MB -2.6%) vs baseline: +4.9%


✅ tracer-and-profiler

Time: ✅ 21.818ms (SLO: <23.500ms -7.2%) vs baseline: +0.9%

Memory: ✅ 69.226MB (SLO: <71.000MB -2.5%) vs baseline: +4.8%


✅ tracer-dont-create-db-spans

Time: ✅ 19.705ms (SLO: <21.500ms -8.3%) vs baseline: +0.3%

Memory: ✅ 68.184MB (SLO: <70.000MB -2.6%) vs baseline: +4.9%


✅ tracer-minimal

Time: ✅ 16.817ms (SLO: <17.500ms -3.9%) vs baseline: ~same

Memory: ✅ 67.790MB (SLO: <70.000MB -3.2%) vs baseline: +4.8%


✅ tracer-native

Time: ✅ 19.538ms (SLO: <21.750ms 📉 -10.2%) vs baseline: ~same

Memory: ✅ 68.262MB (SLO: <72.500MB -5.8%) vs baseline: +5.0%


✅ tracer-no-caches

Time: ✅ 17.583ms (SLO: <19.650ms 📉 -10.5%) vs baseline: -0.3%

Memory: ✅ 67.888MB (SLO: <70.000MB -3.0%) vs baseline: +4.4%


✅ tracer-no-databases

Time: ✅ 19.115ms (SLO: <20.100ms -4.9%) vs baseline: ~same

Memory: ✅ 67.810MB (SLO: <70.000MB -3.1%) vs baseline: +4.9%


✅ tracer-no-middleware

Time: ✅ 19.283ms (SLO: <21.500ms 📉 -10.3%) vs baseline: -0.3%

Memory: ✅ 68.066MB (SLO: <70.000MB -2.8%) vs baseline: +5.0%


✅ tracer-no-templates

Time: ✅ 19.551ms (SLO: <22.000ms 📉 -11.1%) vs baseline: +0.6%

Memory: ✅ 68.115MB (SLO: <70.500MB -3.4%) vs baseline: +4.6%


🟡 errortrackingdjangosimple - 6/6

✅ errortracking-enabled-all

Time: ✅ 16.300ms (SLO: <19.850ms 📉 -17.9%) vs baseline: -0.1%

Memory: ✅ 69.796MB (SLO: <70.000MB 🟡 -0.3%) vs baseline: +4.8%


✅ errortracking-enabled-user

Time: ✅ 16.356ms (SLO: <19.400ms 📉 -15.7%) vs baseline: +0.4%

Memory: ✅ 69.776MB (SLO: <70.000MB 🟡 -0.3%) vs baseline: +4.9%


✅ tracer-enabled

Time: ✅ 16.363ms (SLO: <19.450ms 📉 -15.9%) vs baseline: -0.3%

Memory: ✅ 69.796MB (SLO: <70.000MB 🟡 -0.3%) vs baseline: +4.9%


🟡 errortrackingflasksqli - 6/6

✅ errortracking-enabled-all

Time: ✅ 2.072ms (SLO: <2.300ms -9.9%) vs baseline: +0.3%

Memory: ✅ 55.738MB (SLO: <56.500MB 🟡 -1.3%) vs baseline: +4.9%


✅ errortracking-enabled-user

Time: ✅ 2.078ms (SLO: <2.250ms -7.7%) vs baseline: +0.2%

Memory: ✅ 55.660MB (SLO: <56.500MB 🟡 -1.5%) vs baseline: +4.6%


✅ tracer-enabled

Time: ✅ 2.064ms (SLO: <2.300ms 📉 -10.3%) vs baseline: ~same

Memory: ✅ 55.797MB (SLO: <56.500MB 🟡 -1.2%) vs baseline: +5.0%


🟡 flasksimple - 18/18

✅ appsec-get

Time: ✅ 3.371ms (SLO: <4.750ms 📉 -29.0%) vs baseline: -0.2%

Memory: ✅ 55.450MB (SLO: <66.500MB 📉 -16.6%) vs baseline: +4.9%


✅ appsec-post

Time: ✅ 2.865ms (SLO: <6.750ms 📉 -57.6%) vs baseline: +0.4%

Memory: ✅ 55.469MB (SLO: <66.500MB 📉 -16.6%) vs baseline: +4.4%


✅ appsec-telemetry

Time: ✅ 3.399ms (SLO: <4.750ms 📉 -28.4%) vs baseline: +0.5%

Memory: ✅ 55.368MB (SLO: <66.500MB 📉 -16.7%) vs baseline: +4.8%


✅ debugger

Time: ✅ 1.868ms (SLO: <2.000ms -6.6%) vs baseline: +0.1%

Memory: ✅ 47.883MB (SLO: <49.500MB -3.3%) vs baseline: +5.0%


✅ iast-get

Time: ✅ 1.859ms (SLO: <2.000ms -7.0%) vs baseline: +0.3%

Memory: ✅ 44.580MB (SLO: <49.000MB -9.0%) vs baseline: +5.0%


✅ profiler

Time: ✅ 1.909ms (SLO: <2.100ms -9.1%) vs baseline: +0.3%

Memory: ✅ 48.766MB (SLO: <50.000MB -2.5%) vs baseline: +4.8%


✅ resource-renaming

Time: ✅ 3.363ms (SLO: <3.650ms -7.9%) vs baseline: ~same

Memory: ✅ 55.426MB (SLO: <56.000MB 🟡 -1.0%) vs baseline: +4.9%


✅ tracer

Time: ✅ 3.362ms (SLO: <3.650ms -7.9%) vs baseline: -0.3%

Memory: ✅ 55.433MB (SLO: <56.500MB 🟡 -1.9%) vs baseline: +4.9%


✅ tracer-native

Time: ✅ 3.363ms (SLO: <3.650ms -7.9%) vs baseline: ~same

Memory: ✅ 55.370MB (SLO: <60.000MB -7.7%) vs baseline: +4.8%


🟡 flasksqli - 6/6

✅ appsec-enabled

Time: ✅ 2.061ms (SLO: <4.200ms 📉 -50.9%) vs baseline: +0.2%

Memory: ✅ 55.679MB (SLO: <66.000MB 📉 -15.6%) vs baseline: +4.8%


✅ iast-enabled

Time: ✅ 2.072ms (SLO: <2.800ms 📉 -26.0%) vs baseline: +0.4%

Memory: ✅ 55.797MB (SLO: <62.500MB 📉 -10.7%) vs baseline: +5.0%


✅ tracer-enabled

Time: ✅ 2.062ms (SLO: <2.250ms -8.4%) vs baseline: +0.4%

Memory: ✅ 55.778MB (SLO: <56.500MB 🟡 -1.3%) vs baseline: +4.9%


🟡 httppropagationextract - 60/60

✅ all_styles_all_headers

Time: ✅ 81.102µs (SLO: <100.000µs 📉 -18.9%) vs baseline: +0.4%

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.8%


✅ b3_headers

Time: ✅ 14.204µs (SLO: <20.000µs 📉 -29.0%) vs baseline: ~same

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.7%


✅ b3_single_headers

Time: ✅ 13.380µs (SLO: <20.000µs 📉 -33.1%) vs baseline: +1.1%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +5.2%


✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

Time: ✅ 64.044µs (SLO: <80.000µs 📉 -19.9%) vs baseline: +0.6%

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +4.9%


✅ datadog_tracecontext_tracestate_propagated_on_trace_id_match

Time: ✅ 69.462µs (SLO: <80.000µs 📉 -13.2%) vs baseline: +5.1%

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +5.2%


✅ empty_headers

Time: ✅ 1.634µs (SLO: <10.000µs 📉 -83.7%) vs baseline: +1.3%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.8%


✅ full_t_id_datadog_headers

Time: ✅ 22.621µs (SLO: <30.000µs 📉 -24.6%) vs baseline: +1.2%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +5.0%


✅ invalid_priority_header

Time: ✅ 6.533µs (SLO: <10.000µs 📉 -34.7%) vs baseline: +0.6%

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +5.1%


✅ invalid_span_id_header

Time: ✅ 6.517µs (SLO: <10.000µs 📉 -34.8%) vs baseline: -0.3%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.2%


✅ invalid_tags_header

Time: ✅ 6.512µs (SLO: <10.000µs 📉 -34.9%) vs baseline: +0.1%

Memory: ✅ 34.937MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +5.2%


✅ invalid_trace_id_header

Time: ✅ 6.541µs (SLO: <10.000µs 📉 -34.6%) vs baseline: +0.6%

Memory: ✅ 34.721MB (SLO: <35.500MB -2.2%) vs baseline: +4.6%


✅ large_header_no_matches

Time: ✅ 27.612µs (SLO: <30.000µs -8.0%) vs baseline: +0.3%

Memory: ✅ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +4.6%


✅ large_valid_headers_all

Time: ✅ 28.728µs (SLO: <40.000µs 📉 -28.2%) vs baseline: +0.4%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.9%


✅ medium_header_no_matches

Time: ✅ 9.861µs (SLO: <20.000µs 📉 -50.7%) vs baseline: +0.3%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.7%


✅ medium_valid_headers_all

Time: ✅ 11.285µs (SLO: <20.000µs 📉 -43.6%) vs baseline: ~same

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.4%


✅ none_propagation_style

Time: ✅ 1.726µs (SLO: <10.000µs 📉 -82.7%) vs baseline: +1.0%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.6%


✅ tracecontext_headers

Time: ✅ 34.868µs (SLO: <40.000µs 📉 -12.8%) vs baseline: +0.3%

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.8%


✅ valid_headers_all

Time: ✅ 6.515µs (SLO: <10.000µs 📉 -34.8%) vs baseline: +0.6%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.9%


✅ valid_headers_basic

Time: ✅ 6.083µs (SLO: <10.000µs 📉 -39.2%) vs baseline: +0.4%

Memory: ✅ 34.721MB (SLO: <35.500MB -2.2%) vs baseline: +4.6%


✅ wsgi_empty_headers

Time: ✅ 1.617µs (SLO: <10.000µs 📉 -83.8%) vs baseline: +0.3%

Memory: ✅ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +4.7%


✅ wsgi_invalid_priority_header

Time: ✅ 6.557µs (SLO: <10.000µs 📉 -34.4%) vs baseline: +0.6%

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.7%


✅ wsgi_invalid_span_id_header

Time: ✅ 1.622µs (SLO: <10.000µs 📉 -83.8%) vs baseline: +0.9%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.9%


✅ wsgi_invalid_tags_header

Time: ✅ 6.543µs (SLO: <10.000µs 📉 -34.6%) vs baseline: -0.7%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.0%


✅ wsgi_invalid_trace_id_header

Time: ✅ 6.568µs (SLO: <10.000µs 📉 -34.3%) vs baseline: +0.3%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +5.0%


✅ wsgi_large_header_no_matches

Time: ✅ 28.773µs (SLO: <40.000µs 📉 -28.1%) vs baseline: ~same

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +5.0%


✅ wsgi_large_valid_headers_all

Time: ✅ 30.022µs (SLO: <40.000µs 📉 -24.9%) vs baseline: +0.4%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.5%


✅ wsgi_medium_header_no_matches

Time: ✅ 10.139µs (SLO: <20.000µs 📉 -49.3%) vs baseline: ~same

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +5.0%


✅ wsgi_medium_valid_headers_all

Time: ✅ 11.496µs (SLO: <20.000µs 📉 -42.5%) vs baseline: -0.7%

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.2%


✅ wsgi_valid_headers_all

Time: ✅ 6.556µs (SLO: <10.000µs 📉 -34.4%) vs baseline: +0.2%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.3%


✅ wsgi_valid_headers_basic

Time: ✅ 6.131µs (SLO: <10.000µs 📉 -38.7%) vs baseline: ~same

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.7%


🟡 httppropagationinject - 16/16

✅ ids_only

Time: ✅ 22.211µs (SLO: <30.000µs 📉 -26.0%) vs baseline: +5.5%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.1%


✅ with_all

Time: ✅ 27.805µs (SLO: <40.000µs 📉 -30.5%) vs baseline: ~same

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.9%


✅ with_dd_origin

Time: ✅ 24.943µs (SLO: <30.000µs 📉 -16.9%) vs baseline: +0.5%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.9%


✅ with_priority_and_origin

Time: ✅ 24.381µs (SLO: <40.000µs 📉 -39.0%) vs baseline: -0.3%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.1%


✅ with_sampling_priority

Time: ✅ 21.209µs (SLO: <30.000µs 📉 -29.3%) vs baseline: ~same

Memory: ✅ 35.016MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +5.4%


✅ with_tags

Time: ✅ 26.026µs (SLO: <40.000µs 📉 -34.9%) vs baseline: +0.2%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.9%


✅ with_tags_invalid

Time: ✅ 27.610µs (SLO: <40.000µs 📉 -31.0%) vs baseline: +0.8%

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.9%


✅ with_tags_max_size

Time: ✅ 26.456µs (SLO: <40.000µs 📉 -33.9%) vs baseline: +0.3%

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.5%


🟡 iast_aspects - 40/40

✅ re_expand_aspect

Time: ✅ 33.857µs (SLO: <40.000µs 📉 -15.4%) vs baseline: +6.6%

Memory: ✅ 40.088MB (SLO: <41.000MB -2.2%) vs baseline: +4.6%


✅ re_expand_noaspect

Time: ✅ 28.695µs (SLO: <40.000µs 📉 -28.3%) vs baseline: -0.4%

Memory: ✅ 40.108MB (SLO: <41.000MB -2.2%) vs baseline: +4.8%


✅ re_findall_aspect

Time: ✅ 2.930µs (SLO: <10.000µs 📉 -70.7%) vs baseline: +1.1%

Memory: ✅ 40.128MB (SLO: <41.000MB -2.1%) vs baseline: +4.3%


✅ re_findall_noaspect

Time: ✅ 1.405µs (SLO: <10.000µs 📉 -86.0%) vs baseline: -0.2%

Memory: ✅ 40.167MB (SLO: <41.000MB -2.0%) vs baseline: +4.4%


✅ re_finditer_aspect

Time: ✅ 4.468µs (SLO: <10.000µs 📉 -55.3%) vs baseline: ~same

Memory: ✅ 40.029MB (SLO: <41.000MB -2.4%) vs baseline: +4.5%


✅ re_finditer_noaspect

Time: ✅ 1.410µs (SLO: <10.000µs 📉 -85.9%) vs baseline: +0.7%

Memory: ✅ 40.226MB (SLO: <41.000MB 🟡 -1.9%) vs baseline: +4.6%


✅ re_fullmatch_aspect

Time: ✅ 2.702µs (SLO: <10.000µs 📉 -73.0%) vs baseline: -0.5%

Memory: ✅ 40.226MB (SLO: <41.000MB 🟡 -1.9%) vs baseline: +4.6%


✅ re_fullmatch_noaspect

Time: ✅ 1.324µs (SLO: <10.000µs 📉 -86.8%) vs baseline: +0.9%

Memory: ✅ 40.265MB (SLO: <41.000MB 🟡 -1.8%) vs baseline: +5.1%


✅ re_group_aspect

Time: ✅ 3.016µs (SLO: <10.000µs 📉 -69.8%) vs baseline: +1.6%

Memory: ✅ 40.344MB (SLO: <41.000MB 🟡 -1.6%) vs baseline: +4.8%


✅ re_group_noaspect

Time: ✅ 1.622µs (SLO: <10.000µs 📉 -83.8%) vs baseline: +0.4%

Memory: ✅ 40.187MB (SLO: <41.000MB 🟡 -2.0%) vs baseline: +4.6%


✅ re_groups_aspect

Time: ✅ 3.129µs (SLO: <10.000µs 📉 -68.7%) vs baseline: +0.7%

Memory: ✅ 40.167MB (SLO: <41.000MB -2.0%) vs baseline: +4.8%


✅ re_groups_noaspect

Time: ✅ 1.739µs (SLO: <10.000µs 📉 -82.6%) vs baseline: +1.3%

Memory: ✅ 40.128MB (SLO: <41.000MB -2.1%) vs baseline: +4.4%


✅ re_match_aspect

Time: ✅ 2.760µs (SLO: <10.000µs 📉 -72.4%) vs baseline: +1.6%

Memory: ✅ 40.305MB (SLO: <41.000MB 🟡 -1.7%) vs baseline: +5.2%


✅ re_match_noaspect

Time: ✅ 1.315µs (SLO: <10.000µs 📉 -86.9%) vs baseline: -0.4%

Memory: ✅ 40.167MB (SLO: <41.000MB -2.0%) vs baseline: +4.9%


✅ re_search_aspect

Time: ✅ 2.569µs (SLO: <10.000µs 📉 -74.3%) vs baseline: -1.0%

Memory: ✅ 40.206MB (SLO: <41.000MB 🟡 -1.9%) vs baseline: +4.7%


✅ re_search_noaspect

Time: ✅ 1.206µs (SLO: <10.000µs 📉 -87.9%) vs baseline: ~same

Memory: ✅ 40.108MB (SLO: <41.000MB -2.2%) vs baseline: +4.3%


✅ re_sub_aspect

Time: ✅ 3.408µs (SLO: <10.000µs 📉 -65.9%) vs baseline: -0.3%

Memory: ✅ 40.285MB (SLO: <41.000MB 🟡 -1.7%) vs baseline: +4.8%


✅ re_sub_noaspect

Time: ✅ 1.553µs (SLO: <10.000µs 📉 -84.5%) vs baseline: +1.1%

Memory: ✅ 40.344MB (SLO: <41.000MB 🟡 -1.6%) vs baseline: +5.2%


✅ re_subn_aspect

Time: ✅ 3.663µs (SLO: <10.000µs 📉 -63.4%) vs baseline: -0.6%

Memory: ✅ 40.167MB (SLO: <41.000MB -2.0%) vs baseline: +5.0%


✅ re_subn_noaspect

Time: ✅ 1.603µs (SLO: <10.000µs 📉 -84.0%) vs baseline: ~same

Memory: ✅ 40.206MB (SLO: <41.000MB 🟡 -1.9%) vs baseline: +4.6%


🟡 iastaspectssplit - 12/12

✅ rsplit_aspect

Time: ✅ 1.532µs (SLO: <10.000µs 📉 -84.7%) vs baseline: +4.1%

Memory: ✅ 40.344MB (SLO: <41.000MB 🟡 -1.6%) vs baseline: +5.0%


✅ rsplit_noaspect

Time: ✅ 0.577µs (SLO: <10.000µs 📉 -94.2%) vs baseline: -0.3%

Memory: ✅ 40.187MB (SLO: <41.000MB 🟡 -2.0%) vs baseline: +4.9%


✅ split_aspect

Time: ✅ 1.429µs (SLO: <10.000µs 📉 -85.7%) vs baseline: +0.1%

Memory: ✅ 40.246MB (SLO: <41.000MB 🟡 -1.8%) vs baseline: +4.8%


✅ split_noaspect

Time: ✅ 0.569µs (SLO: <10.000µs 📉 -94.3%) vs baseline: -0.3%

Memory: ✅ 40.147MB (SLO: <41.000MB -2.1%) vs baseline: +4.2%


✅ splitlines_aspect

Time: ✅ 1.405µs (SLO: <10.000µs 📉 -86.0%) vs baseline: -2.5%

Memory: ✅ 40.187MB (SLO: <41.000MB 🟡 -2.0%) vs baseline: +4.2%


✅ splitlines_noaspect

Time: ✅ 0.580µs (SLO: <10.000µs 📉 -94.2%) vs baseline: ~same

Memory: ✅ 40.206MB (SLO: <41.000MB 🟡 -1.9%) vs baseline: +4.4%


🟡 otelspan - 22/22

✅ add-event

Time: ✅ 39.475ms (SLO: <47.150ms 📉 -16.3%) vs baseline: -0.3%

Memory: ✅ 39.566MB (SLO: <47.000MB 📉 -15.8%) vs baseline: +4.9%


✅ add-metrics

Time: ✅ 262.354ms (SLO: <344.800ms 📉 -23.9%) vs baseline: +0.8%

Memory: ✅ 43.811MB (SLO: <47.500MB -7.8%) vs baseline: +5.0%


✅ add-tags

Time: ✅ 316.334ms (SLO: <321.000ms 🟡 -1.5%) vs baseline: +0.2%

Memory: ✅ 43.823MB (SLO: <47.500MB -7.7%) vs baseline: +4.8%


✅ get-context

Time: ✅ 80.022ms (SLO: <92.350ms 📉 -13.3%) vs baseline: +0.2%

Memory: ✅ 39.617MB (SLO: <46.500MB 📉 -14.8%) vs baseline: +4.5%


✅ is-recording

Time: ✅ 37.068ms (SLO: <44.500ms 📉 -16.7%) vs baseline: -0.5%

Memory: ✅ 39.448MB (SLO: <47.500MB 📉 -17.0%) vs baseline: +4.9%


✅ record-exception

Time: ✅ 58.136ms (SLO: <67.650ms 📉 -14.1%) vs baseline: -0.1%

Memory: ✅ 39.977MB (SLO: <47.000MB 📉 -14.9%) vs baseline: +5.1%


✅ set-status

Time: ✅ 43.453ms (SLO: <50.400ms 📉 -13.8%) vs baseline: -0.2%

Memory: ✅ 39.410MB (SLO: <47.000MB 📉 -16.1%) vs baseline: +5.1%


✅ start

Time: ✅ 37.537ms (SLO: <43.450ms 📉 -13.6%) vs baseline: +2.8%

Memory: ✅ 39.570MB (SLO: <47.000MB 📉 -15.8%) vs baseline: +5.0%


✅ start-finish

Time: ✅ 81.657ms (SLO: <88.000ms -7.2%) vs baseline: -0.1%

Memory: ✅ 37.316MB (SLO: <46.500MB 📉 -19.8%) vs baseline: +5.0%


✅ start-finish-telemetry

Time: ✅ 83.180ms (SLO: <89.000ms -6.5%) vs baseline: -0.1%

Memory: ✅ 37.297MB (SLO: <46.500MB 📉 -19.8%) vs baseline: +4.6%


✅ update-name

Time: ✅ 37.952ms (SLO: <45.150ms 📉 -15.9%) vs baseline: -0.7%

Memory: ✅ 39.678MB (SLO: <47.000MB 📉 -15.6%) vs baseline: +5.1%


🟡 packagespackageforrootmodulemapping - 4/4

✅ cache_off

Time: ✅ 342.761ms (SLO: <354.300ms -3.3%) vs baseline: -0.8%

Memory: ✅ 41.120MB (SLO: <41.500MB 🟡 -0.9%) vs baseline: +4.5%


✅ cache_on

Time: ✅ 0.382µs (SLO: <10.000µs 📉 -96.2%) vs baseline: -0.2%

Memory: ✅ 40.127MB (SLO: <41.000MB -2.1%) vs baseline: +5.3%


🟡 ratelimiter - 12/12

✅ defaults

Time: ✅ 2.359µs (SLO: <10.000µs 📉 -76.4%) vs baseline: -0.6%

Memory: ✅ 35.095MB (SLO: <35.500MB 🟡 -1.1%) vs baseline: +4.6%


✅ high_rate_limit

Time: ✅ 2.430µs (SLO: <10.000µs 📉 -75.7%) vs baseline: ~same

Memory: ✅ 35.114MB (SLO: <35.500MB 🟡 -1.1%) vs baseline: +5.0%


✅ long_window

Time: ✅ 2.368µs (SLO: <10.000µs 📉 -76.3%) vs baseline: +0.2%

Memory: ✅ 35.075MB (SLO: <35.500MB 🟡 -1.2%) vs baseline: +4.9%


✅ low_rate_limit

Time: ✅ 2.358µs (SLO: <10.000µs 📉 -76.4%) vs baseline: +0.5%

Memory: ✅ 35.095MB (SLO: <35.500MB 🟡 -1.1%) vs baseline: +4.8%


✅ no_rate_limit

Time: ✅ 0.835µs (SLO: <10.000µs 📉 -91.7%) vs baseline: +1.1%

Memory: ✅ 35.095MB (SLO: <35.500MB 🟡 -1.1%) vs baseline: +4.8%


✅ short_window

Time: ✅ 2.482µs (SLO: <10.000µs 📉 -75.2%) vs baseline: -0.2%

Memory: ✅ 35.154MB (SLO: <35.500MB 🟡 -1.0%) vs baseline: +5.0%


🟡 recursivecomputation - 8/8

✅ deep

Time: ✅ 309.590ms (SLO: <320.950ms -3.5%) vs baseline: +0.3%

Memory: ✅ 35.999MB (SLO: <36.500MB 🟡 -1.4%) vs baseline: +4.9%


✅ deep-profiled

Time: ✅ 328.938ms (SLO: <359.150ms -8.4%) vs baseline: +0.2%

Memory: ✅ 39.872MB (SLO: <40.500MB 🟡 -1.6%) vs baseline: +5.1%


✅ medium

Time: ✅ 6.990ms (SLO: <7.400ms -5.5%) vs baseline: ~same

Memory: ✅ 34.721MB (SLO: <35.500MB -2.2%) vs baseline: +4.7%


✅ shallow

Time: ✅ 0.948ms (SLO: <1.050ms -9.8%) vs baseline: +1.2%

Memory: ✅ 34.682MB (SLO: <35.500MB -2.3%) vs baseline: +4.4%


🟡 sethttpmeta - 32/32

✅ all-disabled

Time: ✅ 10.627µs (SLO: <20.000µs 📉 -46.9%) vs baseline: +0.9%

Memory: ✅ 35.783MB (SLO: <36.000MB 🟡 -0.6%) vs baseline: +5.1%


✅ all-enabled

Time: ✅ 41.042µs (SLO: <50.000µs 📉 -17.9%) vs baseline: +2.4%

Memory: ✅ 35.645MB (SLO: <36.000MB 🟡 -1.0%) vs baseline: +4.7%


✅ collectipvariant_exists

Time: ✅ 40.786µs (SLO: <50.000µs 📉 -18.4%) vs baseline: -0.2%

Memory: ✅ 35.684MB (SLO: <36.000MB 🟡 -0.9%) vs baseline: +4.6%


✅ no-collectipvariant

Time: ✅ 40.039µs (SLO: <50.000µs 📉 -19.9%) vs baseline: -0.1%

Memory: ✅ 35.468MB (SLO: <36.000MB 🟡 -1.5%) vs baseline: +4.2%


✅ no-useragentvariant

Time: ✅ 38.755µs (SLO: <50.000µs 📉 -22.5%) vs baseline: -0.3%

Memory: ✅ 35.645MB (SLO: <36.000MB 🟡 -1.0%) vs baseline: +4.7%


✅ obfuscation-no-query

Time: ✅ 40.539µs (SLO: <50.000µs 📉 -18.9%) vs baseline: -0.2%

Memory: ✅ 35.232MB (SLO: <36.000MB -2.1%) vs baseline: +3.5%


✅ obfuscation-regular-case-explicit-query

Time: ✅ 76.083µs (SLO: <90.000µs 📉 -15.5%) vs baseline: +0.2%

Memory: ✅ 35.665MB (SLO: <36.500MB -2.3%) vs baseline: +4.7%


✅ obfuscation-regular-case-implicit-query

Time: ✅ 76.570µs (SLO: <90.000µs 📉 -14.9%) vs baseline: ~same

Memory: ✅ 35.704MB (SLO: <36.500MB -2.2%) vs baseline: +4.9%


✅ obfuscation-send-querystring-disabled

Time: ✅ 153.967µs (SLO: <170.000µs -9.4%) vs baseline: -0.5%

Memory: ✅ 35.645MB (SLO: <36.500MB -2.3%) vs baseline: +4.8%


✅ obfuscation-worst-case-explicit-query

Time: ✅ 148.905µs (SLO: <160.000µs -6.9%) vs baseline: ~same

Memory: ✅ 35.566MB (SLO: <36.500MB -2.6%) vs baseline: +4.7%


✅ obfuscation-worst-case-implicit-query

Time: ✅ 154.712µs (SLO: <170.000µs -9.0%) vs baseline: -0.2%

Memory: ✅ 35.724MB (SLO: <36.500MB -2.1%) vs baseline: +4.9%


✅ useragentvariant_exists_1

Time: ✅ 39.473µs (SLO: <50.000µs 📉 -21.1%) vs baseline: -0.4%

Memory: ✅ 35.370MB (SLO: <36.000MB 🟡 -1.8%) vs baseline: +4.0%


✅ useragentvariant_exists_2

Time: ✅ 40.666µs (SLO: <50.000µs 📉 -18.7%) vs baseline: +0.1%

Memory: ✅ 35.429MB (SLO: <36.000MB 🟡 -1.6%) vs baseline: +4.0%


✅ useragentvariant_exists_3

Time: ✅ 39.961µs (SLO: <50.000µs 📉 -20.1%) vs baseline: -0.2%

Memory: ✅ 35.566MB (SLO: <36.000MB 🟡 -1.2%) vs baseline: +4.6%


✅ useragentvariant_not_exists_1

Time: ✅ 39.410µs (SLO: <50.000µs 📉 -21.2%) vs baseline: -0.3%

Memory: ✅ 35.645MB (SLO: <36.000MB 🟡 -1.0%) vs baseline: +5.0%


✅ useragentvariant_not_exists_2

Time: ✅ 39.404µs (SLO: <50.000µs 📉 -21.2%) vs baseline: ~same

Memory: ✅ 35.547MB (SLO: <36.000MB 🟡 -1.3%) vs baseline: +4.3%


🟡 span - 26/26

✅ add-event

Time: ✅ 18.156ms (SLO: <22.500ms 📉 -19.3%) vs baseline: ~same

Memory: ✅ 36.838MB (SLO: <53.000MB 📉 -30.5%) vs baseline: +4.6%


✅ add-metrics

Time: ✅ 88.909ms (SLO: <93.500ms -4.9%) vs baseline: +0.1%

Memory: ✅ 40.974MB (SLO: <53.000MB 📉 -22.7%) vs baseline: +4.5%


✅ add-tags

Time: ✅ 143.536ms (SLO: <155.000ms -7.4%) vs baseline: +0.6%

Memory: ✅ 41.121MB (SLO: <53.000MB 📉 -22.4%) vs baseline: +5.0%


✅ get-context

Time: ✅ 17.014ms (SLO: <20.500ms 📉 -17.0%) vs baseline: -0.6%

Memory: ✅ 36.723MB (SLO: <53.000MB 📉 -30.7%) vs baseline: +4.6%


✅ is-recording

Time: ✅ 17.286ms (SLO: <20.500ms 📉 -15.7%) vs baseline: +0.6%

Memory: ✅ 36.762MB (SLO: <53.000MB 📉 -30.6%) vs baseline: +5.3%


✅ record-exception

Time: ✅ 36.529ms (SLO: <40.000ms -8.7%) vs baseline: ~same

Memory: ✅ 37.335MB (SLO: <53.000MB 📉 -29.6%) vs baseline: +5.0%


✅ set-status

Time: ✅ 18.709ms (SLO: <22.000ms 📉 -15.0%) vs baseline: +0.5%

Memory: ✅ 36.762MB (SLO: <53.000MB 📉 -30.6%) vs baseline: +4.9%


✅ start

Time: ✅ 17.403ms (SLO: <20.500ms 📉 -15.1%) vs baseline: +2.9%

Memory: ✅ 36.782MB (SLO: <53.000MB 📉 -30.6%) vs baseline: +4.9%


✅ start-finish

Time: ✅ 50.901ms (SLO: <52.500ms -3.0%) vs baseline: -0.5%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +5.2%


✅ start-finish-telemetry

Time: ✅ 52.188ms (SLO: <54.500ms -4.2%) vs baseline: -0.3%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +5.0%


✅ start-finish-traceid128

Time: ✅ 54.020ms (SLO: <57.000ms -5.2%) vs baseline: -0.4%

Memory: ✅ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +5.2%


✅ start-traceid128

Time: ✅ 17.285ms (SLO: <22.500ms 📉 -23.2%) vs baseline: +0.1%

Memory: ✅ 36.724MB (SLO: <53.000MB 📉 -30.7%) vs baseline: +4.9%


✅ update-name

Time: ✅ 17.229ms (SLO: <22.000ms 📉 -21.7%) vs baseline: -0.2%

Memory: ✅ 36.849MB (SLO: <53.000MB 📉 -30.5%) vs baseline: +5.0%


🟡 tracer - 6/6

✅ large

Time: ✅ 29.322ms (SLO: <32.950ms 📉 -11.0%) vs baseline: +0.4%

Memory: ✅ 35.901MB (SLO: <36.500MB 🟡 -1.6%) vs baseline: +4.7%


✅ medium

Time: ✅ 2.876ms (SLO: <3.200ms 📉 -10.1%) vs baseline: ~same

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +5.0%


✅ small

Time: ✅ 332.360µs (SLO: <370.000µs 📉 -10.2%) vs baseline: +1.5%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +5.2%

⚠️ Unstable Tests (2 suites)
⚠️ coreapiscenario - 10/10 (1 unstable)

⚠️ context_with_data_listeners

Time: ⚠️ 13.281µs (SLO: <20.000µs 📉 -33.6%) vs baseline: +0.2%

Memory: ✅ 34.721MB (SLO: <35.500MB -2.2%) vs baseline: +4.4%


✅ context_with_data_no_listeners

Time: ✅ 3.274µs (SLO: <10.000µs 📉 -67.3%) vs baseline: -0.3%

Memory: ✅ 34.682MB (SLO: <35.500MB -2.3%) vs baseline: +4.5%


✅ get_item_exists

Time: ✅ 0.586µs (SLO: <10.000µs 📉 -94.1%) vs baseline: +0.7%

Memory: ✅ 34.741MB (SLO: <35.500MB -2.1%) vs baseline: +4.8%


✅ get_item_missing

Time: ✅ 0.635µs (SLO: <10.000µs 📉 -93.7%) vs baseline: +0.2%

Memory: ✅ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +4.9%


✅ set_item

Time: ✅ 24.214µs (SLO: <30.000µs 📉 -19.3%) vs baseline: -0.9%

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.6%


⚠️ packagesupdateimporteddependencies - 24/24 (1 unstable)

✅ import_many

Time: ✅ 154.455µs (SLO: <170.000µs -9.1%) vs baseline: -0.9%

Memory: ✅ 39.156MB (SLO: <41.000MB -4.5%) vs baseline: +3.7%


✅ import_many_cached

Time: ✅ 121.280µs (SLO: <130.000µs -6.7%) vs baseline: -0.2%

Memory: ✅ 39.234MB (SLO: <41.000MB -4.3%) vs baseline: +4.0%


✅ import_many_stdlib

Time: ✅ 0.754ms (SLO: <1.750ms 📉 -56.9%) vs baseline: ~same

Memory: ✅ 39.346MB (SLO: <41.000MB -4.0%) vs baseline: +5.1%


⚠️ import_many_stdlib_cached

Time: ⚠️ 0.171ms (SLO: <1.100ms 📉 -84.4%) vs baseline: -0.1%

Memory: ✅ 39.265MB (SLO: <41.000MB -4.2%) vs baseline: +4.5%


✅ import_many_unknown

Time: ✅ 830.830µs (SLO: <890.000µs -6.6%) vs baseline: -1.0%

Memory: ✅ 39.407MB (SLO: <41.000MB -3.9%) vs baseline: +4.4%


✅ import_many_unknown_cached

Time: ✅ 792.152µs (SLO: <870.000µs -8.9%) vs baseline: -0.2%

Memory: ✅ 39.441MB (SLO: <41.000MB -3.8%) vs baseline: +4.3%


✅ import_one

Time: ✅ 19.752µs (SLO: <30.000µs 📉 -34.2%) vs baseline: ~same

Memory: ✅ 39.354MB (SLO: <41.000MB -4.0%) vs baseline: +5.1%


✅ import_one_cache

Time: ✅ 6.283µs (SLO: <10.000µs 📉 -37.2%) vs baseline: +0.1%

Memory: ✅ 39.319MB (SLO: <41.000MB -4.1%) vs baseline: +4.3%


✅ import_one_stdlib

Time: ✅ 18.627µs (SLO: <20.000µs -6.9%) vs baseline: -0.2%

Memory: ✅ 39.247MB (SLO: <41.000MB -4.3%) vs baseline: +4.2%


✅ import_one_stdlib_cache

Time: ✅ 6.304µs (SLO: <10.000µs 📉 -37.0%) vs baseline: -0.5%

Memory: ✅ 39.557MB (SLO: <41.000MB -3.5%) vs baseline: +5.1%


✅ import_one_unknown

Time: ✅ 45.153µs (SLO: <50.000µs -9.7%) vs baseline: -0.6%

Memory: ✅ 39.361MB (SLO: <41.000MB -4.0%) vs baseline: +4.6%


✅ import_one_unknown_cache

Time: ✅ 6.303µs (SLO: <10.000µs 📉 -37.0%) vs baseline: ~same

Memory: ✅ 39.441MB (SLO: <41.000MB -3.8%) vs baseline: +5.3%

✅ All Tests Passing (3 suites)
iastpropagation - 8/8

✅ no-propagation

Time: ✅ 48.373µs (SLO: <60.000µs 📉 -19.4%) vs baseline: -0.1%

Memory: ✅ 40.088MB (SLO: <42.000MB -4.6%) vs baseline: +4.9%


✅ propagation_enabled

Time: ✅ 174.113µs (SLO: <190.000µs -8.4%) vs baseline: -0.3%

Memory: ✅ 40.010MB (SLO: <42.000MB -4.7%) vs baseline: +4.4%


✅ propagation_enabled_100

Time: ✅ 1.922ms (SLO: <2.300ms 📉 -16.5%) vs baseline: ~same

Memory: ✅ 40.128MB (SLO: <42.000MB -4.5%) vs baseline: +4.9%


✅ propagation_enabled_1000

Time: ✅ 32.694ms (SLO: <34.550ms -5.4%) vs baseline: +0.2%

Memory: ✅ 40.128MB (SLO: <42.000MB -4.5%) vs baseline: +4.8%


otelsdkspan - 24/24

✅ add-event

Time: ✅ 40.470ms (SLO: <42.000ms -3.6%) vs baseline: +0.5%

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.7%


✅ add-link

Time: ✅ 36.250ms (SLO: <38.550ms -6.0%) vs baseline: ~same

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.3%


✅ add-metrics

Time: ✅ 219.505ms (SLO: <232.000ms -5.4%) vs baseline: +0.4%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.9%


✅ add-tags

Time: ✅ 211.902ms (SLO: <221.600ms -4.4%) vs baseline: +0.3%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.2%


✅ get-context

Time: ✅ 29.226ms (SLO: <31.300ms -6.6%) vs baseline: +0.6%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +5.0%


✅ is-recording

Time: ✅ 29.403ms (SLO: <31.000ms -5.2%) vs baseline: +1.8%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.6%


✅ record-exception

Time: ✅ 62.890ms (SLO: <65.850ms -4.5%) vs baseline: -0.7%

Memory: ✅ 37.513MB (SLO: <39.000MB -3.8%) vs baseline: +4.4%


✅ set-status

Time: ✅ 32.052ms (SLO: <34.150ms -6.1%) vs baseline: +1.1%

Memory: ✅ 37.572MB (SLO: <39.000MB -3.7%) vs baseline: +4.6%


✅ start

Time: ✅ 29.423ms (SLO: <30.150ms -2.4%) vs baseline: +2.0%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.5%


✅ start-finish

Time: ✅ 34.046ms (SLO: <35.350ms -3.7%) vs baseline: +0.3%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%


✅ start-finish-telemetry

Time: ✅ 34.174ms (SLO: <35.450ms -3.6%) vs baseline: +1.0%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%


✅ update-name

Time: ✅ 31.112ms (SLO: <33.400ms -6.9%) vs baseline: +0.4%

Memory: ✅ 37.572MB (SLO: <39.000MB -3.7%) vs baseline: +4.8%


samplingrules - 8/8

✅ average_match

Time: ✅ 137.707µs (SLO: <290.000µs 📉 -52.5%) vs baseline: ~same

Memory: ✅ 34.741MB (SLO: <35.500MB -2.1%) vs baseline: +4.7%


✅ high_match

Time: ✅ 173.833µs (SLO: <480.000µs 📉 -63.8%) vs baseline: +0.6%

Memory: ✅ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +4.8%


✅ low_match

Time: ✅ 98.161µs (SLO: <120.000µs 📉 -18.2%) vs baseline: -1.0%

Memory: ✅ 603.553MB (SLO: <700.000MB 📉 -13.8%) vs baseline: +4.9%


✅ very_low_match

Time: ✅ 2.647ms (SLO: <8.500ms 📉 -68.9%) vs baseline: -0.7%

Memory: ✅ 71.017MB (SLO: <75.000MB -5.3%) vs baseline: +4.9%

ℹ️ Scenarios Missing SLO Configuration (10 scenarios)

The following scenarios exist in candidate data but have no SLO thresholds configured:

  • coreapiscenario-core_dispatch_listeners
  • coreapiscenario-core_dispatch_no_listeners
  • coreapiscenario-core_dispatch_with_results_listeners
  • coreapiscenario-core_dispatch_with_results_no_listeners
  • djangosimple-baseline
  • errortrackingdjangosimple-baseline
  • errortrackingflasksqli-baseline
  • flasksimple-baseline
  • flasksqli-baseline
  • sethttpmeta-obfuscation-disabled

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport 3.19 backport 4.0 changelog/no-changelog A changelog entry is not required for this PR.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants