fix(ci_visibility): coverage on compiler-generated bytecode #14863

gnufede · 2025-10-14T15:56:10Z

Description

Fix coverage tracking crash in Python 3.12+ with compiler-generated bytecode.

Python 3.12+ can generate bytecode that doesn't map to a specific source line
(e.g., from comprehensions, lambdas, decorator application). When using
dis.findlinestarts(), these appear as entries with line number None.

Without proper handling, this causes:

TypeError: unsupported operand type(s) for //: 'NoneType' and 'int'

Testing

Added subprocess tests with common patterns that generate compiler-implicit bytecode:

Module-level comprehensions
Lambda functions and nested functions
Complex expressions with comprehensions

Risks

None

github-actions · 2025-10-14T15:56:49Z

CODEOWNERS have been resolved as:

releasenotes/notes/fix-civisibility-coverage-3-12-6dcb5833f1fe838a.yaml  @DataDog/apm-python
tests/coverage/included_path/synthetic_opcodes_module.py                @DataDog/apm-core-python @DataDog/ci-app-libraries
tests/coverage/test_coverage_py312_synthetic_opcodes.py                 @DataDog/apm-core-python @DataDog/ci-app-libraries
ddtrace/internal/coverage/instrumentation_py3_12.py                     @DataDog/apm-core-python @datadog/ci-app-libraries

github-actions · 2025-10-14T16:22:51Z

Bootstrap import analysis

Comparison of import times between this PR and base.

Summary

The average import time from this PR is: 240 ± 3 ms.

The average import time from base is: 245 ± 5 ms.

The import time difference between this PR and base is: -4.6 ± 0.2 ms.

Import time breakdown

The following import paths have shrunk:

ddtrace.auto 2.232 ms (0.93%)

ddtrace.bootstrap.sitecustomize 1.552 ms (0.65%)

ddtrace.bootstrap.preload 1.552 ms (0.65%)

ddtrace.internal.remoteconfig.client 0.720 ms (0.30%)

ddtrace 0.679 ms (0.28%)

ddtrace.internal._unpatched 0.030 ms (0.01%)

json 0.030 ms (0.01%)

json.decoder 0.030 ms (0.01%)

re 0.030 ms (0.01%)

enum 0.030 ms (0.01%)

types 0.030 ms (0.01%)

pr-commenter · 2025-10-14T16:48:53Z

Performance SLOs

Comparing candidate gnufede/coverage-line-none-fix (2f56209) with baseline main (8235d03)

📈 Performance Regressions (2 suites)

📈 iastaspects - 118/118

✅ add_aspect

Time: ✅ 0.411µs (SLO: <10.000µs 📉 -95.9%) vs baseline: ~same

Memory: ✅ 38.004MB (SLO: <39.000MB -2.6%) vs baseline: +4.6%

✅ add_inplace_aspect

Time: ✅ 0.411µs (SLO: <10.000µs 📉 -95.9%) vs baseline: +0.7%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +4.9%

✅ add_inplace_noaspect

Time: ✅ 0.319µs (SLO: <10.000µs 📉 -96.8%) vs baseline: +0.8%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +5.0%

✅ add_noaspect

Time: ✅ 0.274µs (SLO: <10.000µs 📉 -97.3%) vs baseline: -1.7%

Memory: ✅ 38.044MB (SLO: <39.000MB -2.5%) vs baseline: +4.7%

✅ bytearray_aspect

Time: ✅ 1.322µs (SLO: <10.000µs 📉 -86.8%) vs baseline: +0.4%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +4.7%

✅ bytearray_extend_aspect

Time: ✅ 1.465µs (SLO: <10.000µs 📉 -85.3%) vs baseline: +1.6%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +4.8%

✅ bytearray_extend_noaspect

Time: ✅ 0.618µs (SLO: <10.000µs 📉 -93.8%) vs baseline: +0.3%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +5.0%

✅ bytearray_noaspect

Time: ✅ 0.480µs (SLO: <10.000µs 📉 -95.2%) vs baseline: -0.9%

Memory: ✅ 38.044MB (SLO: <39.000MB -2.5%) vs baseline: +4.6%

✅ bytes_aspect

Time: ✅ 1.277µs (SLO: <10.000µs 📉 -87.2%) vs baseline: -1.0%

Memory: ✅ 38.024MB (SLO: <39.000MB -2.5%) vs baseline: +4.9%

✅ bytes_noaspect

Time: ✅ 0.491µs (SLO: <10.000µs 📉 -95.1%) vs baseline: -2.2%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +4.9%

✅ bytesio_aspect

Time: ✅ 1.367µs (SLO: <10.000µs 📉 -86.3%) vs baseline: -0.2%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +5.0%

✅ bytesio_noaspect

Time: ✅ 0.494µs (SLO: <10.000µs 📉 -95.1%) vs baseline: ~same

Memory: ✅ 38.004MB (SLO: <39.000MB -2.6%) vs baseline: +4.5%

✅ capitalize_aspect

Time: ✅ 0.740µs (SLO: <10.000µs 📉 -92.6%) vs baseline: +0.8%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +5.0%

✅ capitalize_noaspect

Time: ✅ 0.434µs (SLO: <10.000µs 📉 -95.7%) vs baseline: -0.9%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +4.9%

✅ casefold_aspect

Time: ✅ 0.737µs (SLO: <10.000µs 📉 -92.6%) vs baseline: -0.4%

Memory: ✅ 38.044MB (SLO: <39.000MB -2.5%) vs baseline: +5.0%

✅ casefold_noaspect

Time: ✅ 0.365µs (SLO: <10.000µs 📉 -96.4%) vs baseline: -0.1%

Memory: ✅ 38.024MB (SLO: <39.000MB -2.5%) vs baseline: +4.9%

✅ decode_aspect

Time: ✅ 0.722µs (SLO: <10.000µs 📉 -92.8%) vs baseline: ~same

Memory: ✅ 37.985MB (SLO: <39.000MB -2.6%) vs baseline: +4.5%

✅ decode_noaspect

Time: ✅ 0.416µs (SLO: <10.000µs 📉 -95.8%) vs baseline: -0.4%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +4.8%

✅ encode_aspect

Time: ✅ 0.708µs (SLO: <10.000µs 📉 -92.9%) vs baseline: -0.5%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +5.0%

✅ encode_noaspect

Time: ✅ 0.402µs (SLO: <10.000µs 📉 -96.0%) vs baseline: +0.6%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +5.0%

✅ format_aspect

Time: ✅ 3.373µs (SLO: <10.000µs 📉 -66.3%) vs baseline: +0.5%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +4.9%

✅ format_map_aspect

Time: ✅ 3.666µs (SLO: <10.000µs 📉 -63.3%) vs baseline: +0.9%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +4.8%

✅ format_map_noaspect

Time: ✅ 0.777µs (SLO: <10.000µs 📉 -92.2%) vs baseline: +1.0%

Memory: ✅ 38.044MB (SLO: <39.000MB -2.5%) vs baseline: +4.7%

✅ format_noaspect

Time: ✅ 0.593µs (SLO: <10.000µs 📉 -94.1%) vs baseline: -0.2%

Memory: ✅ 38.044MB (SLO: <39.000MB -2.5%) vs baseline: +4.9%

✅ index_aspect

Time: ✅ 0.361µs (SLO: <10.000µs 📉 -96.4%) vs baseline: +0.9%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +5.0%

✅ index_noaspect

Time: ✅ 0.278µs (SLO: <10.000µs 📉 -97.2%) vs baseline: -1.2%

Memory: ✅ 38.004MB (SLO: <39.000MB -2.6%) vs baseline: +5.0%

✅ join_aspect

Time: ✅ 1.388µs (SLO: <10.000µs 📉 -86.1%) vs baseline: +0.3%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +4.8%

✅ join_noaspect

Time: ✅ 0.494µs (SLO: <10.000µs 📉 -95.1%) vs baseline: +1.1%

Memory: ✅ 38.024MB (SLO: <39.000MB -2.5%) vs baseline: +4.7%

✅ ljust_aspect

Time: ✅ 2.475µs (SLO: <20.000µs 📉 -87.6%) vs baseline: +0.8%

Memory: ✅ 38.044MB (SLO: <39.000MB -2.5%) vs baseline: +4.8%

✅ ljust_noaspect

Time: ✅ 0.404µs (SLO: <10.000µs 📉 -96.0%) vs baseline: -0.8%

Memory: ✅ 38.024MB (SLO: <39.000MB -2.5%) vs baseline: +4.7%

✅ lower_aspect

Time: ✅ 2.200µs (SLO: <10.000µs 📉 -78.0%) vs baseline: -1.5%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +4.9%

✅ lower_noaspect

Time: ✅ 0.367µs (SLO: <10.000µs 📉 -96.3%) vs baseline: +0.7%

Memory: ✅ 38.044MB (SLO: <39.000MB -2.5%) vs baseline: +4.7%

✅ lstrip_aspect

Time: ✅ 2.240µs (SLO: <20.000µs 📉 -88.8%) vs baseline: -0.8%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +5.0%

✅ lstrip_noaspect

Time: ✅ 0.382µs (SLO: <10.000µs 📉 -96.2%) vs baseline: ~same

Memory: ✅ 38.024MB (SLO: <39.000MB -2.5%) vs baseline: +4.7%

✅ modulo_aspect

Time: ✅ 1.008µs (SLO: <10.000µs 📉 -89.9%) vs baseline: -0.3%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +4.9%

✅ modulo_aspect_for_bytearray_bytearray

Time: ✅ 1.524µs (SLO: <10.000µs 📉 -84.8%) vs baseline: -0.6%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +4.7%

✅ modulo_aspect_for_bytes

Time: ✅ 0.986µs (SLO: <10.000µs 📉 -90.1%) vs baseline: +0.3%

Memory: ✅ 38.044MB (SLO: <39.000MB -2.5%) vs baseline: +4.9%

✅ modulo_aspect_for_bytes_bytearray

Time: ✅ 1.201µs (SLO: <10.000µs 📉 -88.0%) vs baseline: +0.6%

Memory: ✅ 38.004MB (SLO: <39.000MB -2.6%) vs baseline: +4.7%

✅ modulo_noaspect

Time: ✅ 0.625µs (SLO: <10.000µs 📉 -93.7%) vs baseline: ~same

Memory: ✅ 38.024MB (SLO: <39.000MB -2.5%) vs baseline: +4.7%

✅ replace_aspect

Time: ✅ 4.812µs (SLO: <10.000µs 📉 -51.9%) vs baseline: +0.2%

Memory: ✅ 38.044MB (SLO: <39.000MB -2.5%) vs baseline: +4.9%

✅ replace_noaspect

Time: ✅ 0.461µs (SLO: <10.000µs 📉 -95.4%) vs baseline: +0.1%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +4.9%

✅ repr_aspect

Time: ✅ 0.913µs (SLO: <10.000µs 📉 -90.9%) vs baseline: +0.4%

Memory: ✅ 38.004MB (SLO: <39.000MB -2.6%) vs baseline: +4.7%

✅ repr_noaspect

Time: ✅ 0.413µs (SLO: <10.000µs 📉 -95.9%) vs baseline: -0.4%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +4.8%

✅ rstrip_aspect

Time: ✅ 1.944µs (SLO: <20.000µs 📉 -90.3%) vs baseline: +1.2%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +4.7%

✅ rstrip_noaspect

Time: ✅ 0.381µs (SLO: <10.000µs 📉 -96.2%) vs baseline: +1.2%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +4.7%

✅ slice_aspect

Time: ✅ 0.497µs (SLO: <10.000µs 📉 -95.0%) vs baseline: +0.2%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +4.9%

✅ slice_noaspect

Time: ✅ 0.447µs (SLO: <10.000µs 📉 -95.5%) vs baseline: ~same

Memory: ✅ 38.004MB (SLO: <39.000MB -2.6%) vs baseline: +4.7%

✅ stringio_aspect

Time: ✅ 1.528µs (SLO: <10.000µs 📉 -84.7%) vs baseline: -1.5%

Memory: ✅ 38.044MB (SLO: <39.000MB -2.5%) vs baseline: +4.9%

✅ stringio_noaspect

Time: ✅ 0.726µs (SLO: <10.000µs 📉 -92.7%) vs baseline: +1.4%

Memory: ✅ 38.024MB (SLO: <39.000MB -2.5%) vs baseline: +4.7%

✅ strip_aspect

Time: ✅ 2.535µs (SLO: <20.000µs 📉 -87.3%) vs baseline: 📈 +15.3%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +4.9%

✅ strip_noaspect

Time: ✅ 0.385µs (SLO: <10.000µs 📉 -96.1%) vs baseline: +0.6%

Memory: ✅ 38.044MB (SLO: <39.000MB -2.5%) vs baseline: +4.6%

✅ swapcase_aspect

Time: ✅ 2.436µs (SLO: <10.000µs 📉 -75.6%) vs baseline: +1.1%

Memory: ✅ 38.044MB (SLO: <39.000MB -2.5%) vs baseline: +4.9%

✅ swapcase_noaspect

Time: ✅ 0.534µs (SLO: <10.000µs 📉 -94.7%) vs baseline: +0.1%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +5.0%

✅ title_aspect

Time: ✅ 2.346µs (SLO: <10.000µs 📉 -76.5%) vs baseline: -0.2%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +5.0%

✅ title_noaspect

Time: ✅ 0.500µs (SLO: <10.000µs 📉 -95.0%) vs baseline: -0.9%

Memory: ✅ 38.004MB (SLO: <39.000MB -2.6%) vs baseline: +4.6%

✅ translate_aspect

Time: ✅ 3.217µs (SLO: <10.000µs 📉 -67.8%) vs baseline: -1.2%

Memory: ✅ 38.004MB (SLO: <39.000MB -2.6%) vs baseline: +4.7%

✅ translate_noaspect

Time: ✅ 1.047µs (SLO: <10.000µs 📉 -89.5%) vs baseline: +0.6%

Memory: ✅ 37.985MB (SLO: <39.000MB -2.6%) vs baseline: +4.6%

✅ upper_aspect

Time: ✅ 2.201µs (SLO: <10.000µs 📉 -78.0%) vs baseline: -1.0%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +4.8%

✅ upper_noaspect

Time: ✅ 0.371µs (SLO: <10.000µs 📉 -96.3%) vs baseline: -0.6%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +5.1%

📈 iastaspectsospath - 24/24

✅ ospathbasename_aspect

Time: ✅ 4.374µs (SLO: <10.000µs 📉 -56.3%) vs baseline: +1.5%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%

✅ ospathbasename_noaspect

Time: ✅ 1.090µs (SLO: <10.000µs 📉 -89.1%) vs baseline: +1.0%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%

✅ ospathjoin_aspect

Time: ✅ 6.099µs (SLO: <10.000µs 📉 -39.0%) vs baseline: -0.2%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%

✅ ospathjoin_noaspect

Time: ✅ 2.316µs (SLO: <10.000µs 📉 -76.8%) vs baseline: +1.2%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%

✅ ospathnormcase_aspect

Time: ✅ 3.902µs (SLO: <10.000µs 📉 -61.0%) vs baseline: 📈 +11.8%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ ospathnormcase_noaspect

Time: ✅ 0.582µs (SLO: <10.000µs 📉 -94.2%) vs baseline: +1.7%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%

✅ ospathsplit_aspect

Time: ✅ 4.920µs (SLO: <10.000µs 📉 -50.8%) vs baseline: +0.6%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%

✅ ospathsplit_noaspect

Time: ✅ 1.612µs (SLO: <10.000µs 📉 -83.9%) vs baseline: +1.0%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.6%

✅ ospathsplitdrive_aspect

Time: ✅ 3.668µs (SLO: <10.000µs 📉 -63.3%) vs baseline: +1.2%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ ospathsplitdrive_noaspect

Time: ✅ 0.705µs (SLO: <10.000µs 📉 -93.0%) vs baseline: +0.6%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%

✅ ospathsplitext_aspect

Time: ✅ 4.584µs (SLO: <10.000µs 📉 -54.2%) vs baseline: -0.4%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%

✅ ospathsplitext_noaspect

Time: ✅ 1.388µs (SLO: <10.000µs 📉 -86.1%) vs baseline: -0.3%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%

🟡 Near SLO Breach (5 suites)

🟡 djangosimple - 30/30

✅ appsec

Time: ✅ 20.495ms (SLO: <22.300ms -8.1%) vs baseline: -0.2%

Memory: ✅ 65.537MB (SLO: <67.000MB -2.2%) vs baseline: +5.0%

✅ exception-replay-enabled

Time: ✅ 1.350ms (SLO: <1.450ms -6.9%) vs baseline: +0.4%

Memory: ✅ 64.603MB (SLO: <67.000MB -3.6%) vs baseline: +4.8%

✅ iast

Time: ✅ 20.500ms (SLO: <22.250ms -7.9%) vs baseline: +0.2%

Memory: ✅ 65.425MB (SLO: <67.000MB -2.4%) vs baseline: +4.8%

✅ profiler

Time: ✅ 15.292ms (SLO: <16.550ms -7.6%) vs baseline: ~same

Memory: ✅ 53.713MB (SLO: <54.500MB 🟡 -1.4%) vs baseline: +4.9%

✅ resource-renaming

Time: ✅ 20.568ms (SLO: <21.750ms -5.4%) vs baseline: +0.1%

Memory: ✅ 65.378MB (SLO: <67.000MB -2.4%) vs baseline: +4.7%

✅ span-code-origin

Time: ✅ 26.184ms (SLO: <28.200ms -7.1%) vs baseline: +0.2%

Memory: ✅ 67.490MB (SLO: <69.500MB -2.9%) vs baseline: +4.8%

✅ tracer

Time: ✅ 20.414ms (SLO: <21.750ms -6.1%) vs baseline: -0.2%

Memory: ✅ 65.421MB (SLO: <67.000MB -2.4%) vs baseline: +4.8%

✅ tracer-and-profiler

Time: ✅ 22.077ms (SLO: <23.500ms -6.1%) vs baseline: -0.2%

Memory: ✅ 66.622MB (SLO: <67.500MB 🟡 -1.3%) vs baseline: +5.0%

✅ tracer-dont-create-db-spans

Time: ✅ 19.326ms (SLO: <21.500ms 📉 -10.1%) vs baseline: ~same

Memory: ✅ 65.495MB (SLO: <66.000MB 🟡 -0.8%) vs baseline: +5.0%

✅ tracer-minimal

Time: ✅ 16.615ms (SLO: <17.500ms -5.1%) vs baseline: -0.1%

Memory: ✅ 65.517MB (SLO: <66.000MB 🟡 -0.7%) vs baseline: +5.0%

✅ tracer-native

Time: ✅ 20.570ms (SLO: <21.750ms -5.4%) vs baseline: +0.1%

Memory: ✅ 71.439MB (SLO: <72.500MB 🟡 -1.5%) vs baseline: +5.0%

✅ tracer-no-caches

Time: ✅ 18.428ms (SLO: <19.650ms -6.2%) vs baseline: -0.4%

Memory: ✅ 65.477MB (SLO: <67.000MB -2.3%) vs baseline: +4.9%

✅ tracer-no-databases

Time: ✅ 18.819ms (SLO: <20.100ms -6.4%) vs baseline: -0.2%

Memory: ✅ 65.108MB (SLO: <67.000MB -2.8%) vs baseline: +4.2%

✅ tracer-no-middleware

Time: ✅ 20.200ms (SLO: <21.500ms -6.0%) vs baseline: ~same

Memory: ✅ 65.429MB (SLO: <67.000MB -2.3%) vs baseline: +4.8%

✅ tracer-no-templates

Time: ✅ 20.282ms (SLO: <22.000ms -7.8%) vs baseline: -0.2%

Memory: ✅ 65.482MB (SLO: <67.000MB -2.3%) vs baseline: +4.9%

🟡 errortrackingdjangosimple - 6/6

✅ errortracking-enabled-all

Time: ✅ 18.089ms (SLO: <19.850ms -8.9%) vs baseline: +0.2%

Memory: ✅ 65.215MB (SLO: <66.500MB 🟡 -1.9%) vs baseline: +4.8%

✅ errortracking-enabled-user

Time: ✅ 18.090ms (SLO: <19.400ms -6.8%) vs baseline: +0.4%

Memory: ✅ 65.251MB (SLO: <66.500MB 🟡 -1.9%) vs baseline: +4.9%

✅ tracer-enabled

Time: ✅ 18.123ms (SLO: <19.450ms -6.8%) vs baseline: +0.1%

Memory: ✅ 65.254MB (SLO: <66.500MB 🟡 -1.9%) vs baseline: +4.9%

🟡 flasksimple - 18/18

✅ appsec-get

Time: ✅ 4.572ms (SLO: <4.750ms -3.7%) vs baseline: ~same

Memory: ✅ 61.951MB (SLO: <65.000MB -4.7%) vs baseline: +4.8%

✅ appsec-post

Time: ✅ 6.566ms (SLO: <6.750ms -2.7%) vs baseline: ~same

Memory: ✅ 62.049MB (SLO: <65.000MB -4.5%) vs baseline: +5.0%

✅ appsec-telemetry

Time: ✅ 4.562ms (SLO: <4.750ms -4.0%) vs baseline: -0.4%

Memory: ✅ 61.991MB (SLO: <65.000MB -4.6%) vs baseline: +4.8%

✅ debugger

Time: ✅ 1.856ms (SLO: <2.000ms -7.2%) vs baseline: +0.2%

Memory: ✅ 45.475MB (SLO: <47.000MB -3.2%) vs baseline: +4.9%

✅ iast-get

Time: ✅ 1.860ms (SLO: <2.000ms -7.0%) vs baseline: -0.3%

Memory: ✅ 42.349MB (SLO: <49.000MB 📉 -13.6%) vs baseline: +4.8%

✅ profiler

Time: ✅ 1.911ms (SLO: <2.100ms -9.0%) vs baseline: +0.1%

Memory: ✅ 46.478MB (SLO: <47.000MB 🟡 -1.1%) vs baseline: +4.9%

✅ resource-renaming

Time: ✅ 3.377ms (SLO: <3.650ms -7.5%) vs baseline: -0.5%

Memory: ✅ 52.199MB (SLO: <53.500MB -2.4%) vs baseline: +4.8%

✅ tracer

Time: ✅ 3.373ms (SLO: <3.650ms -7.6%) vs baseline: ~same

Memory: ✅ 52.239MB (SLO: <53.500MB -2.4%) vs baseline: +4.8%

✅ tracer-native

Time: ✅ 3.370ms (SLO: <3.650ms -7.7%) vs baseline: +0.3%

Memory: ✅ 58.291MB (SLO: <60.000MB -2.8%) vs baseline: +4.9%

🟡 otelspan - 22/22

✅ add-event

Time: ✅ 43.491ms (SLO: <47.150ms -7.8%) vs baseline: +2.3%

Memory: ✅ 44.506MB (SLO: <47.000MB -5.3%) vs baseline: +5.1%

✅ add-metrics

Time: ✅ 318.523ms (SLO: <344.800ms -7.6%) vs baseline: +0.6%

Memory: ✅ 595.673MB (SLO: <600.000MB 🟡 -0.7%) vs baseline: +4.9%

✅ add-tags

Time: ✅ 291.330ms (SLO: <314.000ms -7.2%) vs baseline: +1.1%

Memory: ✅ 596.017MB (SLO: <600.000MB 🟡 -0.7%) vs baseline: +4.8%

✅ get-context

Time: ✅ 81.155ms (SLO: <92.350ms 📉 -12.1%) vs baseline: +0.3%

Memory: ✅ 39.910MB (SLO: <46.500MB 📉 -14.2%) vs baseline: +4.8%

✅ is-recording

Time: ✅ 38.830ms (SLO: <44.500ms 📉 -12.7%) vs baseline: -0.6%

Memory: ✅ 43.936MB (SLO: <47.500MB -7.5%) vs baseline: +4.8%

✅ record-exception

Time: ✅ 59.850ms (SLO: <67.650ms 📉 -11.5%) vs baseline: +1.9%

Memory: ✅ 40.246MB (SLO: <47.000MB 📉 -14.4%) vs baseline: +4.7%

✅ set-status

Time: ✅ 45.007ms (SLO: <50.400ms 📉 -10.7%) vs baseline: +0.5%

Memory: ✅ 43.910MB (SLO: <47.000MB -6.6%) vs baseline: +4.8%

✅ start

Time: ✅ 38.090ms (SLO: <43.450ms 📉 -12.3%) vs baseline: -0.9%

Memory: ✅ 43.925MB (SLO: <47.000MB -6.5%) vs baseline: +4.7%

✅ start-finish

Time: ✅ 82.603ms (SLO: <88.000ms -6.1%) vs baseline: ~same

Memory: ✅ 34.583MB (SLO: <46.500MB 📉 -25.6%) vs baseline: +4.9%

✅ start-finish-telemetry

Time: ✅ 85.736ms (SLO: <89.000ms -3.7%) vs baseline: +1.9%

Memory: ✅ 34.524MB (SLO: <46.500MB 📉 -25.8%) vs baseline: +4.7%

✅ update-name

Time: ✅ 40.364ms (SLO: <45.150ms 📉 -10.6%) vs baseline: ~same

Memory: ✅ 44.242MB (SLO: <47.000MB -5.9%) vs baseline: +4.9%

🟡 span - 26/26

✅ add-event

Time: ✅ 20.983ms (SLO: <22.500ms -6.7%) vs baseline: +2.6%

Memory: ✅ 50.343MB (SLO: <53.000MB -5.0%) vs baseline: +4.9%

✅ add-metrics

Time: ✅ 91.495ms (SLO: <93.500ms -2.1%) vs baseline: +0.8%

Memory: ✅ 661.205MB (SLO: <961.000MB 📉 -31.2%) vs baseline: +4.8%

✅ add-tags

Time: ✅ 148.403ms (SLO: <155.000ms -4.3%) vs baseline: +0.6%

Memory: ✅ 661.684MB (SLO: <962.500MB 📉 -31.3%) vs baseline: +4.9%

✅ get-context

Time: ✅ 19.441ms (SLO: <20.500ms -5.2%) vs baseline: +0.9%

Memory: ✅ 49.111MB (SLO: <53.000MB -7.3%) vs baseline: +4.8%

✅ is-recording

Time: ✅ 19.815ms (SLO: <20.500ms -3.3%) vs baseline: +1.0%

Memory: ✅ 49.117MB (SLO: <53.000MB -7.3%) vs baseline: +4.8%

✅ record-exception

Time: ✅ 38.615ms (SLO: <40.000ms -3.5%) vs baseline: +1.0%

Memory: ✅ 42.737MB (SLO: <53.000MB 📉 -19.4%) vs baseline: +4.7%

✅ set-status

Time: ✅ 21.486ms (SLO: <22.000ms -2.3%) vs baseline: +2.1%

Memory: ✅ 49.172MB (SLO: <53.000MB -7.2%) vs baseline: +4.7%

✅ start

Time: ✅ 19.484ms (SLO: <20.500ms -5.0%) vs baseline: +1.9%

Memory: ✅ 49.201MB (SLO: <53.000MB -7.2%) vs baseline: +4.9%

✅ start-finish

Time: ✅ 51.511ms (SLO: <52.500ms 🟡 -1.9%) vs baseline: -0.2%

Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +4.9%

✅ start-finish-telemetry

Time: ✅ 53.097ms (SLO: <54.500ms -2.6%) vs baseline: +1.0%

Memory: ✅ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +4.5%

✅ start-finish-traceid128

Time: ✅ 54.986ms (SLO: <56.000ms 🟡 -1.8%) vs baseline: +0.2%

Memory: ✅ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +4.9%

✅ start-traceid128

Time: ✅ 19.737ms (SLO: <22.500ms 📉 -12.3%) vs baseline: +0.3%

Memory: ✅ 49.059MB (SLO: <53.000MB -7.4%) vs baseline: +4.8%

✅ update-name

Time: ✅ 20.555ms (SLO: <22.000ms -6.6%) vs baseline: +2.9%

Memory: ✅ 49.765MB (SLO: <53.000MB -6.1%) vs baseline: +4.7%

⚠️ Unstable Tests (1 suite)

⚠️

coreapiscenario - 10/10 (1 unstable)

⚠️ context_with_data_listeners

Time: ⚠️ 13.254µs (SLO: <20.000µs 📉 -33.7%) vs baseline: ~same

Memory: ✅ 32.106MB (SLO: <33.500MB -4.2%) vs baseline: +5.2%

✅ context_with_data_no_listeners

Time: ✅ 3.309µs (SLO: <10.000µs 📉 -66.9%) vs baseline: +0.7%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +5.2%

✅ get_item_exists

Time: ✅ 0.589µs (SLO: <10.000µs 📉 -94.1%) vs baseline: +1.2%

Memory: ✅ 32.106MB (SLO: <33.500MB -4.2%) vs baseline: +4.6%

✅ get_item_missing

Time: ✅ 0.638µs (SLO: <10.000µs 📉 -93.6%) vs baseline: +0.7%

Memory: ✅ 32.145MB (SLO: <33.500MB -4.0%) vs baseline: +5.0%

✅ set_item

Time: ✅ 24.374µs (SLO: <30.000µs 📉 -18.8%) vs baseline: +0.6%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +5.2%

✅ All Tests Passing (16 suites)

✅ errortrackingflasksqli - 6/6

✅ errortracking-enabled-all

Time: ✅ 2.084ms (SLO: <2.300ms -9.4%) vs baseline: +0.4%

Memory: ✅ 52.042MB (SLO: <53.500MB -2.7%) vs baseline: +5.0%

✅ errortracking-enabled-user

Time: ✅ 2.086ms (SLO: <2.250ms -7.3%) vs baseline: +0.2%

Memory: ✅ 52.022MB (SLO: <53.500MB -2.8%) vs baseline: +4.8%

✅ tracer-enabled

Time: ✅ 2.107ms (SLO: <2.300ms -8.4%) vs baseline: +1.6%

Memory: ✅ 52.199MB (SLO: <53.500MB -2.4%) vs baseline: +4.9%

✅ flasksqli - 6/6

✅ appsec-enabled

Time: ✅ 3.923ms (SLO: <4.200ms -6.6%) vs baseline: +0.3%

Memory: ✅ 62.207MB (SLO: <66.000MB -5.7%) vs baseline: +4.8%

✅ iast-enabled

Time: ✅ 2.452ms (SLO: <2.800ms 📉 -12.4%) vs baseline: -0.6%

Memory: ✅ 58.609MB (SLO: <60.000MB -2.3%) vs baseline: +4.8%

✅ tracer-enabled

Time: ✅ 2.065ms (SLO: <2.250ms -8.2%) vs baseline: ~same

Memory: ✅ 52.180MB (SLO: <54.500MB -4.3%) vs baseline: +4.9%

✅ httppropagationextract - 60/60

✅ all_styles_all_headers

Time: ✅ 82.504µs (SLO: <100.000µs 📉 -17.5%) vs baseline: +1.1%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +5.2%

✅ b3_headers

Time: ✅ 14.298µs (SLO: <20.000µs 📉 -28.5%) vs baseline: +1.2%

Memory: ✅ 32.145MB (SLO: <33.500MB -4.0%) vs baseline: +4.8%

✅ b3_single_headers

Time: ✅ 13.344µs (SLO: <20.000µs 📉 -33.3%) vs baseline: +0.5%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +5.1%

✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

Time: ✅ 64.136µs (SLO: <80.000µs 📉 -19.8%) vs baseline: +0.2%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ datadog_tracecontext_tracestate_propagated_on_trace_id_match

Time: ✅ 66.375µs (SLO: <80.000µs 📉 -17.0%) vs baseline: +0.6%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +5.0%

✅ empty_headers

Time: ✅ 1.614µs (SLO: <10.000µs 📉 -83.9%) vs baseline: +0.9%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.9%

✅ full_t_id_datadog_headers

Time: ✅ 23.125µs (SLO: <30.000µs 📉 -22.9%) vs baseline: +1.7%

Memory: ✅ 32.145MB (SLO: <33.500MB -4.0%) vs baseline: +4.7%

✅ invalid_priority_header

Time: ✅ 6.537µs (SLO: <10.000µs 📉 -34.6%) vs baseline: +0.9%

Memory: ✅ 32.106MB (SLO: <33.500MB -4.2%) vs baseline: +4.5%

✅ invalid_span_id_header

Time: ✅ 6.565µs (SLO: <10.000µs 📉 -34.4%) vs baseline: +0.3%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.8%

✅ invalid_tags_header

Time: ✅ 6.552µs (SLO: <10.000µs 📉 -34.5%) vs baseline: +0.5%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +5.0%

✅ invalid_trace_id_header

Time: ✅ 6.645µs (SLO: <10.000µs 📉 -33.5%) vs baseline: +2.1%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +5.0%

✅ large_header_no_matches

Time: ✅ 27.578µs (SLO: <30.000µs -8.1%) vs baseline: -0.3%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +5.1%

✅ large_valid_headers_all

Time: ✅ 28.734µs (SLO: <40.000µs 📉 -28.2%) vs baseline: +0.4%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%

✅ medium_header_no_matches

Time: ✅ 9.826µs (SLO: <20.000µs 📉 -50.9%) vs baseline: +0.1%

Memory: ✅ 32.145MB (SLO: <33.500MB -4.0%) vs baseline: +5.0%

✅ medium_valid_headers_all

Time: ✅ 11.206µs (SLO: <20.000µs 📉 -44.0%) vs baseline: ~same

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +5.0%

✅ none_propagation_style

Time: ✅ 1.710µs (SLO: <10.000µs 📉 -82.9%) vs baseline: +0.2%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%

✅ tracecontext_headers

Time: ✅ 36.007µs (SLO: <40.000µs -10.0%) vs baseline: +4.9%

Memory: ✅ 32.145MB (SLO: <33.500MB -4.0%) vs baseline: +4.9%

✅ valid_headers_all

Time: ✅ 6.570µs (SLO: <10.000µs 📉 -34.3%) vs baseline: +1.3%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +5.1%

✅ valid_headers_basic

Time: ✅ 6.101µs (SLO: <10.000µs 📉 -39.0%) vs baseline: +0.3%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.9%

✅ wsgi_empty_headers

Time: ✅ 1.599µs (SLO: <10.000µs 📉 -84.0%) vs baseline: -0.8%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +5.1%

✅ wsgi_invalid_priority_header

Time: ✅ 6.622µs (SLO: <10.000µs 📉 -33.8%) vs baseline: +1.2%

Memory: ✅ 32.086MB (SLO: <33.500MB -4.2%) vs baseline: +4.7%

✅ wsgi_invalid_span_id_header

Time: ✅ 1.616µs (SLO: <10.000µs 📉 -83.8%) vs baseline: +0.6%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.7%

✅ wsgi_invalid_tags_header

Time: ✅ 6.618µs (SLO: <10.000µs 📉 -33.8%) vs baseline: +0.8%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +5.1%

✅ wsgi_invalid_trace_id_header

Time: ✅ 6.589µs (SLO: <10.000µs 📉 -34.1%) vs baseline: -0.1%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.8%

✅ wsgi_large_header_no_matches

Time: ✅ 28.718µs (SLO: <40.000µs 📉 -28.2%) vs baseline: +0.2%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +5.0%

✅ wsgi_large_valid_headers_all

Time: ✅ 29.876µs (SLO: <40.000µs 📉 -25.3%) vs baseline: +0.4%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.8%

✅ wsgi_medium_header_no_matches

Time: ✅ 10.131µs (SLO: <20.000µs 📉 -49.3%) vs baseline: -0.2%

Memory: ✅ 32.145MB (SLO: <33.500MB -4.0%) vs baseline: +4.7%

✅ wsgi_medium_valid_headers_all

Time: ✅ 11.528µs (SLO: <20.000µs 📉 -42.4%) vs baseline: +0.2%

Memory: ✅ 32.145MB (SLO: <33.500MB -4.0%) vs baseline: +4.7%

✅ wsgi_valid_headers_all

Time: ✅ 6.528µs (SLO: <10.000µs 📉 -34.7%) vs baseline: -0.8%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +5.0%

✅ wsgi_valid_headers_basic

Time: ✅ 6.144µs (SLO: <10.000µs 📉 -38.6%) vs baseline: +0.3%

Memory: ✅ 32.145MB (SLO: <33.500MB -4.0%) vs baseline: +4.7%

✅ httppropagationinject - 16/16

✅ ids_only

Time: ✅ 21.846µs (SLO: <30.000µs 📉 -27.2%) vs baseline: +0.5%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +5.2%

✅ with_all

Time: ✅ 28.828µs (SLO: <40.000µs 📉 -27.9%) vs baseline: -0.2%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.7%

✅ with_dd_origin

Time: ✅ 25.682µs (SLO: <30.000µs 📉 -14.4%) vs baseline: +1.2%

Memory: ✅ 32.145MB (SLO: <33.500MB -4.0%) vs baseline: +4.8%

✅ with_priority_and_origin

Time: ✅ 24.740µs (SLO: <40.000µs 📉 -38.1%) vs baseline: ~same

Memory: ✅ 32.086MB (SLO: <33.500MB -4.2%) vs baseline: +4.5%

✅ with_sampling_priority

Time: ✅ 21.637µs (SLO: <30.000µs 📉 -27.9%) vs baseline: +0.3%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ with_tags

Time: ✅ 27.248µs (SLO: <40.000µs 📉 -31.9%) vs baseline: +1.0%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.8%

✅ with_tags_invalid

Time: ✅ 29.987µs (SLO: <40.000µs 📉 -25.0%) vs baseline: +5.6%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.8%

✅ with_tags_max_size

Time: ✅ 28.547µs (SLO: <40.000µs 📉 -28.6%) vs baseline: +4.1%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.7%

✅ iast_aspects - 40/40

✅ re_expand_aspect

Time: ✅ 32.216µs (SLO: <40.000µs 📉 -19.5%) vs baseline: +0.2%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%

✅ re_expand_noaspect

Time: ✅ 28.575µs (SLO: <40.000µs 📉 -28.6%) vs baseline: -0.3%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ re_findall_aspect

Time: ✅ 2.915µs (SLO: <10.000µs 📉 -70.9%) vs baseline: +1.0%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%

✅ re_findall_noaspect

Time: ✅ 1.411µs (SLO: <10.000µs 📉 -85.9%) vs baseline: -0.6%

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.6%

✅ re_finditer_aspect

Time: ✅ 4.505µs (SLO: <10.000µs 📉 -55.0%) vs baseline: +0.2%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +5.0%

✅ re_finditer_noaspect

Time: ✅ 1.409µs (SLO: <10.000µs 📉 -85.9%) vs baseline: -0.3%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%

✅ re_fullmatch_aspect

Time: ✅ 2.686µs (SLO: <10.000µs 📉 -73.1%) vs baseline: -0.9%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ re_fullmatch_noaspect

Time: ✅ 1.296µs (SLO: <10.000µs 📉 -87.0%) vs baseline: ~same

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%

✅ re_group_aspect

Time: ✅ 2.945µs (SLO: <10.000µs 📉 -70.6%) vs baseline: ~same

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%

✅ re_group_noaspect

Time: ✅ 1.615µs (SLO: <10.000µs 📉 -83.8%) vs baseline: +1.1%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ re_groups_aspect

Time: ✅ 3.065µs (SLO: <10.000µs 📉 -69.4%) vs baseline: -0.3%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ re_groups_noaspect

Time: ✅ 1.680µs (SLO: <10.000µs 📉 -83.2%) vs baseline: -1.2%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%

✅ re_match_aspect

Time: ✅ 2.732µs (SLO: <10.000µs 📉 -72.7%) vs baseline: +0.7%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.6%

✅ re_match_noaspect

Time: ✅ 1.299µs (SLO: <10.000µs 📉 -87.0%) vs baseline: +0.2%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ re_search_aspect

Time: ✅ 2.581µs (SLO: <10.000µs 📉 -74.2%) vs baseline: +1.1%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%

✅ re_search_noaspect

Time: ✅ 1.215µs (SLO: <10.000µs 📉 -87.9%) vs baseline: +1.5%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.1%

✅ re_sub_aspect

Time: ✅ 3.441µs (SLO: <10.000µs 📉 -65.6%) vs baseline: +0.2%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%

✅ re_sub_noaspect

Time: ✅ 1.580µs (SLO: <10.000µs 📉 -84.2%) vs baseline: +2.8%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ re_subn_aspect

Time: ✅ 3.636µs (SLO: <10.000µs 📉 -63.6%) vs baseline: ~same

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.7%

✅ re_subn_noaspect

Time: ✅ 1.601µs (SLO: <10.000µs 📉 -84.0%) vs baseline: -0.5%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%

✅ iastaspectssplit - 12/12

✅ rsplit_aspect

Time: ✅ 1.437µs (SLO: <10.000µs 📉 -85.6%) vs baseline: +1.1%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%

✅ rsplit_noaspect

Time: ✅ 0.580µs (SLO: <10.000µs 📉 -94.2%) vs baseline: -0.4%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ split_aspect

Time: ✅ 1.420µs (SLO: <10.000µs 📉 -85.8%) vs baseline: ~same

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%

✅ split_noaspect

Time: ✅ 0.574µs (SLO: <10.000µs 📉 -94.3%) vs baseline: +0.7%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%

✅ splitlines_aspect

Time: ✅ 1.426µs (SLO: <10.000µs 📉 -85.7%) vs baseline: +1.2%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%

✅ splitlines_noaspect

Time: ✅ 0.586µs (SLO: <10.000µs 📉 -94.1%) vs baseline: ~same

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.9%

✅ iastpropagation - 2/2

✅ no-propagation

Time: ✅ 49.045µs (SLO: <60.000µs 📉 -18.3%) vs baseline: -0.7%

Memory: ✅ 37.749MB (SLO: <39.000MB -3.2%) vs baseline: +4.9%

✅ otelsdkspan - 24/24

✅ add-event

Time: ✅ 40.505ms (SLO: <42.000ms -3.6%) vs baseline: ~same

Memory: ✅ 34.505MB (SLO: <39.000MB 📉 -11.5%) vs baseline: +4.8%

✅ add-link

Time: ✅ 36.299ms (SLO: <38.550ms -5.8%) vs baseline: -0.7%

Memory: ✅ 34.524MB (SLO: <39.000MB 📉 -11.5%) vs baseline: +5.0%

✅ add-metrics

Time: ✅ 219.296ms (SLO: <232.000ms -5.5%) vs baseline: ~same

Memory: ✅ 34.741MB (SLO: <39.000MB 📉 -10.9%) vs baseline: +4.3%

✅ add-tags

Time: ✅ 212.555ms (SLO: <221.600ms -4.1%) vs baseline: +1.0%

Memory: ✅ 34.524MB (SLO: <39.000MB 📉 -11.5%) vs baseline: +4.9%

✅ get-context

Time: ✅ 29.176ms (SLO: <31.300ms -6.8%) vs baseline: ~same

Memory: ✅ 34.505MB (SLO: <39.000MB 📉 -11.5%) vs baseline: +4.5%

✅ is-recording

Time: ✅ 29.597ms (SLO: <31.000ms -4.5%) vs baseline: +1.4%

Memory: ✅ 34.524MB (SLO: <39.000MB 📉 -11.5%) vs baseline: +4.6%

✅ record-exception

Time: ✅ 63.466ms (SLO: <65.850ms -3.6%) vs baseline: -0.3%

Memory: ✅ 34.898MB (SLO: <39.000MB 📉 -10.5%) vs baseline: +4.7%

✅ set-status

Time: ✅ 32.004ms (SLO: <34.150ms -6.3%) vs baseline: +0.2%

Memory: ✅ 34.721MB (SLO: <39.000MB 📉 -11.0%) vs baseline: +4.6%

✅ start

Time: ✅ 28.780ms (SLO: <30.150ms -4.5%) vs baseline: -0.4%

Memory: ✅ 34.544MB (SLO: <39.000MB 📉 -11.4%) vs baseline: +4.5%

✅ start-finish

Time: ✅ 34.352ms (SLO: <35.350ms -2.8%) vs baseline: +1.0%

Memory: ✅ 34.564MB (SLO: <39.000MB 📉 -11.4%) vs baseline: +3.8%

✅ start-finish-telemetry

Time: ✅ 34.152ms (SLO: <35.450ms -3.7%) vs baseline: -0.4%

Memory: ✅ 34.524MB (SLO: <39.000MB 📉 -11.5%) vs baseline: +4.4%

✅ update-name

Time: ✅ 31.808ms (SLO: <33.400ms -4.8%) vs baseline: +2.4%

Memory: ✅ 34.623MB (SLO: <39.000MB 📉 -11.2%) vs baseline: +4.3%

✅ packagespackageforrootmodulemapping - 4/4

✅ cache_off

Time: ✅ 342.969ms (SLO: <354.300ms -3.2%) vs baseline: -0.5%

Memory: ✅ 37.734MB (SLO: <40.000MB -5.7%) vs baseline: +5.0%

✅ cache_on

Time: ✅ 0.381µs (SLO: <10.000µs 📉 -96.2%) vs baseline: -1.2%

Memory: ✅ 36.118MB (SLO: <39.000MB -7.4%) vs baseline: +5.0%

✅ packagesupdateimporteddependencies - 24/24

✅ import_many

Time: ✅ 155.268µs (SLO: <170.000µs -8.7%) vs baseline: -0.3%

Memory: ✅ 36.930MB (SLO: <38.500MB -4.1%) vs baseline: +4.7%

✅ import_many_cached

Time: ✅ 121.398µs (SLO: <130.000µs -6.6%) vs baseline: ~same

Memory: ✅ 37.002MB (SLO: <38.500MB -3.9%) vs baseline: +5.3%

✅ import_many_stdlib

Time: ✅ 1.626ms (SLO: <1.750ms -7.1%) vs baseline: -0.6%

Memory: ✅ 37.139MB (SLO: <38.500MB -3.5%) vs baseline: +4.9%

✅ import_many_stdlib_cached

Time: ✅ 0.984ms (SLO: <1.100ms 📉 -10.6%) vs baseline: +1.3%

Memory: ✅ 37.209MB (SLO: <38.500MB -3.4%) vs baseline: +5.5%

✅ import_many_unknown

Time: ✅ 828.146µs (SLO: <890.000µs -6.9%) vs baseline: -1.1%

Memory: ✅ 37.158MB (SLO: <38.500MB -3.5%) vs baseline: +5.0%

✅ import_many_unknown_cached

Time: ✅ 791.075µs (SLO: <870.000µs -9.1%) vs baseline: -0.9%

Memory: ✅ 37.178MB (SLO: <38.500MB -3.4%) vs baseline: +5.3%

✅ import_one

Time: ✅ 19.728µs (SLO: <30.000µs 📉 -34.2%) vs baseline: -0.4%

Memory: ✅ 37.028MB (SLO: <39.000MB -5.1%) vs baseline: +5.0%

✅ import_one_cache

Time: ✅ 6.271µs (SLO: <10.000µs 📉 -37.3%) vs baseline: +0.3%

Memory: ✅ 36.906MB (SLO: <38.500MB -4.1%) vs baseline: +4.9%

✅ import_one_stdlib

Time: ✅ 18.579µs (SLO: <20.000µs -7.1%) vs baseline: -0.6%

Memory: ✅ 36.966MB (SLO: <38.500MB -4.0%) vs baseline: +4.9%

✅ import_one_stdlib_cache

Time: ✅ 6.290µs (SLO: <10.000µs 📉 -37.1%) vs baseline: +0.6%

Memory: ✅ 36.889MB (SLO: <38.500MB -4.2%) vs baseline: +4.7%

✅ import_one_unknown

Time: ✅ 45.294µs (SLO: <50.000µs -9.4%) vs baseline: +0.1%

Memory: ✅ 36.997MB (SLO: <38.500MB -3.9%) vs baseline: +5.0%

✅ import_one_unknown_cache

Time: ✅ 6.274µs (SLO: <10.000µs 📉 -37.3%) vs baseline: +0.4%

Memory: ✅ 36.819MB (SLO: <38.500MB -4.4%) vs baseline: +4.7%

✅ ratelimiter - 12/12

✅ defaults

Time: ✅ 2.332µs (SLO: <10.000µs 📉 -76.7%) vs baseline: -0.5%

Memory: ✅ 31.792MB (SLO: <34.000MB -6.5%) vs baseline: +5.1%

✅ high_rate_limit

Time: ✅ 2.395µs (SLO: <10.000µs 📉 -76.1%) vs baseline: +0.6%

Memory: ✅ 31.733MB (SLO: <34.000MB -6.7%) vs baseline: +4.5%

✅ long_window

Time: ✅ 2.353µs (SLO: <10.000µs 📉 -76.5%) vs baseline: -0.3%

Memory: ✅ 31.733MB (SLO: <34.000MB -6.7%) vs baseline: +4.9%

✅ low_rate_limit

Time: ✅ 2.349µs (SLO: <10.000µs 📉 -76.5%) vs baseline: -0.6%

Memory: ✅ 31.831MB (SLO: <34.000MB -6.4%) vs baseline: +5.0%

✅ no_rate_limit

Time: ✅ 0.817µs (SLO: <10.000µs 📉 -91.8%) vs baseline: -2.0%

Memory: ✅ 31.792MB (SLO: <34.000MB -6.5%) vs baseline: +4.8%

✅ short_window

Time: ✅ 2.484µs (SLO: <10.000µs 📉 -75.2%) vs baseline: -0.5%

Memory: ✅ 31.792MB (SLO: <34.000MB -6.5%) vs baseline: +4.9%

✅ recursivecomputation - 8/8

✅ deep

Time: ✅ 309.699ms (SLO: <320.950ms -3.5%) vs baseline: -0.3%

Memory: ✅ 32.893MB (SLO: <34.500MB -4.7%) vs baseline: +4.7%

✅ deep-profiled

Time: ✅ 325.977ms (SLO: <359.150ms -9.2%) vs baseline: -0.3%

Memory: ✅ 37.297MB (SLO: <39.000MB -4.4%) vs baseline: +5.0%

✅ medium

Time: ✅ 7.085ms (SLO: <7.400ms -4.3%) vs baseline: +0.3%

Memory: ✅ 32.185MB (SLO: <34.000MB -5.3%) vs baseline: +5.1%

✅ shallow

Time: ✅ 0.956ms (SLO: <1.050ms -9.0%) vs baseline: +0.2%

Memory: ✅ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +4.9%

✅ samplingrules - 8/8

✅ average_match

Time: ✅ 147.730µs (SLO: <290.000µs 📉 -49.1%) vs baseline: -0.7%

Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +4.9%

✅ high_match

Time: ✅ 195.241µs (SLO: <480.000µs 📉 -59.3%) vs baseline: -0.3%

Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +5.0%

✅ low_match

Time: ✅ 100.837µs (SLO: <120.000µs 📉 -16.0%) vs baseline: +1.0%

Memory: ✅ 632.594MB (SLO: <700.000MB -9.6%) vs baseline: +4.8%

✅ very_low_match

Time: ✅ 2.917ms (SLO: <8.500ms 📉 -65.7%) vs baseline: +1.4%

Memory: ✅ 70.362MB (SLO: <75.000MB -6.2%) vs baseline: +4.9%

✅ sethttpmeta - 32/32

✅ all-disabled

Time: ✅ 10.474µs (SLO: <20.000µs 📉 -47.6%) vs baseline: -0.4%

Memory: ✅ 32.558MB (SLO: <34.000MB -4.2%) vs baseline: +4.6%

✅ all-enabled

Time: ✅ 39.996µs (SLO: <50.000µs 📉 -20.0%) vs baseline: -0.2%

Memory: ✅ 32.578MB (SLO: <34.000MB -4.2%) vs baseline: +4.7%

✅ collectipvariant_exists

Time: ✅ 40.839µs (SLO: <50.000µs 📉 -18.3%) vs baseline: +0.6%

Memory: ✅ 32.519MB (SLO: <34.000MB -4.4%) vs baseline: +4.5%

✅ no-collectipvariant

Time: ✅ 39.707µs (SLO: <50.000µs 📉 -20.6%) vs baseline: -0.2%

Memory: ✅ 32.598MB (SLO: <34.000MB -4.1%) vs baseline: +4.9%

✅ no-useragentvariant

Time: ✅ 38.548µs (SLO: <50.000µs 📉 -22.9%) vs baseline: -0.1%

Memory: ✅ 32.617MB (SLO: <34.000MB -4.1%) vs baseline: +5.0%

✅ obfuscation-no-query

Time: ✅ 40.292µs (SLO: <50.000µs 📉 -19.4%) vs baseline: -0.4%

Memory: ✅ 32.578MB (SLO: <34.000MB -4.2%) vs baseline: +4.9%

✅ obfuscation-regular-case-explicit-query

Time: ✅ 75.866µs (SLO: <90.000µs 📉 -15.7%) vs baseline: +0.8%

Memory: ✅ 33.010MB (SLO: <34.000MB -2.9%) vs baseline: +5.0%

✅ obfuscation-regular-case-implicit-query

Time: ✅ 76.277µs (SLO: <90.000µs 📉 -15.2%) vs baseline: +0.2%

Memory: ✅ 32.912MB (SLO: <34.000MB -3.2%) vs baseline: +4.7%

✅ obfuscation-send-querystring-disabled

Time: ✅ 154.223µs (SLO: <170.000µs -9.3%) vs baseline: ~same

Memory: ✅ 32.971MB (SLO: <34.500MB -4.4%) vs baseline: +4.9%

✅ obfuscation-worst-case-explicit-query

Time: ✅ 148.287µs (SLO: <160.000µs -7.3%) vs baseline: +0.1%

Memory: ✅ 32.991MB (SLO: <34.500MB -4.4%) vs baseline: +4.8%

✅ obfuscation-worst-case-implicit-query

Time: ✅ 154.664µs (SLO: <170.000µs -9.0%) vs baseline: ~same

Memory: ✅ 32.952MB (SLO: <34.500MB -4.5%) vs baseline: +4.7%

✅ useragentvariant_exists_1

Time: ✅ 39.351µs (SLO: <50.000µs 📉 -21.3%) vs baseline: +0.5%

Memory: ✅ 32.598MB (SLO: <34.000MB -4.1%) vs baseline: +5.0%

✅ useragentvariant_exists_2

Time: ✅ 40.615µs (SLO: <50.000µs 📉 -18.8%) vs baseline: +0.6%

Memory: ✅ 32.598MB (SLO: <34.000MB -4.1%) vs baseline: +5.0%

✅ useragentvariant_exists_3

Time: ✅ 39.832µs (SLO: <50.000µs 📉 -20.3%) vs baseline: ~same

Memory: ✅ 32.598MB (SLO: <34.000MB -4.1%) vs baseline: +5.0%

✅ useragentvariant_not_exists_1

Time: ✅ 39.410µs (SLO: <50.000µs 📉 -21.2%) vs baseline: ~same

Memory: ✅ 32.617MB (SLO: <34.000MB -4.1%) vs baseline: +5.0%

✅ useragentvariant_not_exists_2

Time: ✅ 40.171µs (SLO: <50.000µs 📉 -19.7%) vs baseline: +2.3%

Memory: ✅ 32.539MB (SLO: <34.000MB -4.3%) vs baseline: +4.5%

✅ telemetryaddmetric - 30/30

✅ 1-count-metric-1-times

Time: ✅ 3.214µs (SLO: <20.000µs 📉 -83.9%) vs baseline: +3.8%

Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +5.2%

✅ 1-count-metrics-100-times

Time: ✅ 214.527µs (SLO: <250.000µs 📉 -14.2%) vs baseline: +0.7%

Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +4.7%

✅ 1-distribution-metric-1-times

Time: ✅ 3.211µs (SLO: <20.000µs 📉 -83.9%) vs baseline: +9.0%

Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +5.0%

✅ 1-distribution-metrics-100-times

Time: ✅ 191.253µs (SLO: <220.000µs 📉 -13.1%) vs baseline: -0.7%

Memory: ✅ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +4.8%

✅ 1-gauge-metric-1-times

Time: ✅ 2.094µs (SLO: <20.000µs 📉 -89.5%) vs baseline: +2.1%

Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +4.9%

✅ 1-gauge-metrics-100-times

Time: ✅ 125.096µs (SLO: <150.000µs 📉 -16.6%) vs baseline: +0.7%

Memory: ✅ 32.086MB (SLO: <34.000MB -5.6%) vs baseline: +4.7%

✅ 1-rate-metric-1-times

Time: ✅ 3.219µs (SLO: <20.000µs 📉 -83.9%) vs baseline: +3.5%

Memory: ✅ 32.165MB (SLO: <34.000MB -5.4%) vs baseline: +5.1%

✅ 1-rate-metrics-100-times

Time: ✅ 213.281µs (SLO: <250.000µs 📉 -14.7%) vs baseline: +0.3%

Memory: ✅ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +4.8%

✅ 100-count-metrics-100-times

Time: ✅ 21.508ms (SLO: <23.500ms -8.5%) vs baseline: -0.5%

Memory: ✅ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +5.0%

✅ 100-distribution-metrics-100-times

Time: ✅ 1.993ms (SLO: <2.250ms 📉 -11.4%) vs baseline: -0.6%

Memory: ✅ 32.086MB (SLO: <34.000MB -5.6%) vs baseline: +4.9%

✅ 100-gauge-metrics-100-times

Time: ✅ 1.296ms (SLO: <1.550ms 📉 -16.4%) vs baseline: +0.5%

Memory: ✅ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +4.7%

✅ 100-rate-metrics-100-times

Time: ✅ 2.199ms (SLO: <2.550ms 📉 -13.8%) vs baseline: -0.3%

Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +5.0%

✅ flush-1-metric

Time: ✅ 4.660µs (SLO: <20.000µs 📉 -76.7%) vs baseline: +9.1%

Memory: ✅ 32.067MB (SLO: <34.000MB -5.7%) vs baseline: +4.6%

✅ flush-100-metrics

Time: ✅ 181.333µs (SLO: <250.000µs 📉 -27.5%) vs baseline: +0.3%

Memory: ✅ 32.086MB (SLO: <34.000MB -5.6%) vs baseline: +4.5%

✅ flush-1000-metrics

Time: ✅ 2.228ms (SLO: <2.500ms 📉 -10.9%) vs baseline: +0.6%

Memory: ✅ 32.912MB (SLO: <34.500MB -4.6%) vs baseline: +4.8%

✅ tracer - 6/6

✅ large

Time: ✅ 30.382ms (SLO: <32.950ms -7.8%) vs baseline: +0.3%

Memory: ✅ 33.266MB (SLO: <34.500MB -3.6%) vs baseline: +4.7%

✅ medium

Time: ✅ 2.968ms (SLO: <3.200ms -7.2%) vs baseline: +0.9%

Memory: ✅ 32.106MB (SLO: <34.000MB -5.6%) vs baseline: +4.7%

✅ small

Time: ✅ 336.721µs (SLO: <370.000µs -9.0%) vs baseline: +0.6%

Memory: ✅ 31.968MB (SLO: <34.000MB -6.0%) vs baseline: +4.3%

ℹ️ Scenarios Missing SLO Configuration (9 scenarios)

The following scenarios exist in candidate data but have no SLO thresholds configured:

coreapiscenario-core_dispatch_listeners
coreapiscenario-core_dispatch_no_listeners
coreapiscenario-core_dispatch_with_results_listeners
coreapiscenario-core_dispatch_with_results_no_listeners
djangosimple-baseline
errortrackingdjangosimple-baseline
errortrackingflasksqli-baseline
flasksimple-baseline
flasksqli-baseline

fix issue in coverage with code that isn't mapped to line

74c2dfc

gnufede changed the title ~~fix issue in coverage with code that isn't mapped to line~~ fix(ci-visibility): coverage on compiler-generated bytecode Oct 14, 2025

gnufede added 2 commits October 14, 2025 17:57

Merge branch 'main' into gnufede/coverage-line-none-fix

5aa8212

Merge branch 'main' into gnufede/coverage-line-none-fix

3f4118e

gnufede added 3 commits October 14, 2025 19:09

added noqa comments

f960f68

noqa comments

82680f3

Merge branch 'main' into gnufede/coverage-line-none-fix

fc84e96

vitor-de-araujo approved these changes Oct 14, 2025

View reviewed changes

add release note

9b71d27

gnufede added the CI App label Oct 15, 2025

Merge branch 'main' into gnufede/coverage-line-none-fix

66498e9

gnufede marked this pull request as ready for review October 15, 2025 07:32

gnufede requested review from a team as code owners October 15, 2025 07:32

gnufede requested review from emmettbutler and juanjux October 15, 2025 07:32

gnufede changed the title ~~fix(ci-visibility): coverage on compiler-generated bytecode~~ fix(ci_visibility): coverage on compiler-generated bytecode Oct 15, 2025

gnufede enabled auto-merge (squash) October 15, 2025 07:43

Merge branch 'main' into gnufede/coverage-line-none-fix

abebd40

emmettbutler approved these changes Oct 15, 2025

View reviewed changes

Merge branch 'main' into gnufede/coverage-line-none-fix

2f56209

gnufede merged commit b9ec105 into main Oct 15, 2025
442 checks passed

gnufede deleted the gnufede/coverage-line-none-fix branch October 15, 2025 18:29

fix(ci_visibility): coverage on compiler-generated bytecode #14863

fix(ci_visibility): coverage on compiler-generated bytecode #14863

Uh oh!

Conversation

gnufede commented Oct 14, 2025

Description

Testing

Risks

Uh oh!

github-actions bot commented Oct 14, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Oct 14, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Bootstrap import analysis

Summary

Import time breakdown

Uh oh!

pr-commenter bot commented Oct 14, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Performance SLOs

✅ add_aspect

✅ add_inplace_aspect

✅ add_inplace_noaspect

✅ add_noaspect

✅ bytearray_aspect

✅ bytearray_extend_aspect

✅ bytearray_extend_noaspect

✅ bytearray_noaspect

✅ bytes_aspect

✅ bytes_noaspect

✅ bytesio_aspect

✅ bytesio_noaspect

✅ capitalize_aspect

✅ capitalize_noaspect

✅ casefold_aspect

✅ casefold_noaspect

✅ decode_aspect

✅ decode_noaspect

✅ encode_aspect

✅ encode_noaspect

✅ format_aspect

✅ format_map_aspect

✅ format_map_noaspect

✅ format_noaspect

✅ index_aspect

✅ index_noaspect

✅ join_aspect

✅ join_noaspect

✅ ljust_aspect

✅ ljust_noaspect

✅ lower_aspect

✅ lower_noaspect

✅ lstrip_aspect

✅ lstrip_noaspect

✅ modulo_aspect

✅ modulo_aspect_for_bytearray_bytearray

✅ modulo_aspect_for_bytes

✅ modulo_aspect_for_bytes_bytearray

✅ modulo_noaspect

✅ replace_aspect

✅ replace_noaspect

✅ repr_aspect

✅ repr_noaspect

✅ rstrip_aspect

✅ rstrip_noaspect

✅ slice_aspect

✅ slice_noaspect

✅ stringio_aspect

✅ stringio_noaspect

✅ strip_aspect

✅ strip_noaspect

✅ swapcase_aspect

✅ swapcase_noaspect

✅ title_aspect

✅ title_noaspect

✅ translate_aspect

✅ translate_noaspect

✅ upper_aspect

✅ upper_noaspect

github-actions bot commented Oct 14, 2025 •

edited

Loading

github-actions bot commented Oct 14, 2025 •

edited

Loading

pr-commenter bot commented Oct 14, 2025 •

edited

Loading