ci: consistently use httpbin instead of httpbin-local #14856

brettlangdon · 2025-10-14T13:31:04Z

Description

Inconsistency between CI and local development makes spinning up and getting correct hostnames and etc correct challenging.

Testing

Risks

Additional Notes

github-actions · 2025-10-14T13:31:47Z

CODEOWNERS have been resolved as:

.gitlab/services.yml                                                    @DataDog/python-guild @DataDog/apm-core-python
docker-compose.yml                                                      @DataDog/apm-core-python
tests/contrib/httpx/test_httpx.py                                       @DataDog/apm-core-python @DataDog/apm-idm-python
tests/contrib/httpx/test_httpx_pre_0_11.py                              @DataDog/apm-core-python @DataDog/apm-idm-python
tests/contrib/suitespec.yml                                             @DataDog/apm-core-python @DataDog/apm-idm-python
tests/contrib/urllib3/test_urllib3.py                                   @DataDog/apm-core-python @DataDog/apm-idm-python
tests/wait-for-services.py                                              @DataDog/apm-core-python

dubloom

LGTM,
Out of curiosity, where httpbin_local was used before this PR ?

github-actions · 2025-10-14T13:57:05Z

Bootstrap import analysis

Comparison of import times between this PR and base.

Summary

The average import time from this PR is: 246 ± 5 ms.

The average import time from base is: 251 ± 6 ms.

The import time difference between this PR and base is: -5.3 ± 0.2 ms.

Import time breakdown

The following import paths have shrunk:

ddtrace.auto 2.216 ms (0.90%)

ddtrace.bootstrap.sitecustomize 1.532 ms (0.62%)

ddtrace.bootstrap.preload 1.532 ms (0.62%)

ddtrace.internal.remoteconfig.client 0.708 ms (0.29%)

ddtrace 0.684 ms (0.28%)

ddtrace.internal._unpatched 0.031 ms (0.01%)

json 0.031 ms (0.01%)

json.decoder 0.031 ms (0.01%)

re 0.031 ms (0.01%)

enum 0.031 ms (0.01%)

types 0.031 ms (0.01%)

pr-commenter · 2025-10-14T14:28:24Z

Performance SLOs

Comparing candidate brettlangdon/httpbin (04f5e61) with baseline main (8235d03)

🟡 Near SLO Breach (5 suites)

🟡 djangosimple - 30/30

✅ appsec

Time: ✅ 20.469ms (SLO: <22.300ms -8.2%) vs baseline: ~same

Memory: ✅ 65.410MB (SLO: <67.000MB -2.4%) vs baseline: +4.7%

✅ exception-replay-enabled

Time: ✅ 1.347ms (SLO: <1.450ms -7.1%) vs baseline: -0.2%

Memory: ✅ 64.671MB (SLO: <67.000MB -3.5%) vs baseline: +5.2%

✅ iast

Time: ✅ 20.436ms (SLO: <22.250ms -8.2%) vs baseline: -0.4%

Memory: ✅ 65.503MB (SLO: <67.000MB -2.2%) vs baseline: +4.9%

✅ profiler

Time: ✅ 15.312ms (SLO: <16.550ms -7.5%) vs baseline: +0.6%

Memory: ✅ 53.785MB (SLO: <54.500MB 🟡 -1.3%) vs baseline: +4.9%

✅ resource-renaming

Time: ✅ 20.561ms (SLO: <21.750ms -5.5%) vs baseline: -0.2%

Memory: ✅ 65.413MB (SLO: <67.000MB -2.4%) vs baseline: +4.8%

✅ span-code-origin

Time: ✅ 26.210ms (SLO: <28.200ms -7.1%) vs baseline: +0.3%

Memory: ✅ 67.688MB (SLO: <69.500MB -2.6%) vs baseline: +3.1%

✅ tracer

Time: ✅ 20.497ms (SLO: <21.750ms -5.8%) vs baseline: ~same

Memory: ✅ 65.410MB (SLO: <67.000MB -2.4%) vs baseline: +4.8%

✅ tracer-and-profiler

Time: ✅ 22.076ms (SLO: <23.500ms -6.1%) vs baseline: ~same

Memory: ✅ 66.633MB (SLO: <67.500MB 🟡 -1.3%) vs baseline: +4.9%

✅ tracer-dont-create-db-spans

Time: ✅ 19.361ms (SLO: <21.500ms -9.9%) vs baseline: -0.2%

Memory: ✅ 65.417MB (SLO: <66.000MB 🟡 -0.9%) vs baseline: +4.8%

✅ tracer-minimal

Time: ✅ 16.590ms (SLO: <17.500ms -5.2%) vs baseline: -0.3%

Memory: ✅ 65.400MB (SLO: <66.000MB 🟡 -0.9%) vs baseline: +4.9%

✅ tracer-native

Time: ✅ 20.511ms (SLO: <21.750ms -5.7%) vs baseline: ~same

Memory: ✅ 71.429MB (SLO: <72.500MB 🟡 -1.5%) vs baseline: +4.8%

✅ tracer-no-caches

Time: ✅ 18.487ms (SLO: <19.650ms -5.9%) vs baseline: +0.2%

Memory: ✅ 65.456MB (SLO: <67.000MB -2.3%) vs baseline: +5.0%

✅ tracer-no-databases

Time: ✅ 18.751ms (SLO: <20.100ms -6.7%) vs baseline: +0.2%

Memory: ✅ 65.090MB (SLO: <67.000MB -2.9%) vs baseline: +4.3%

✅ tracer-no-middleware

Time: ✅ 20.192ms (SLO: <21.500ms -6.1%) vs baseline: ~same

Memory: ✅ 65.452MB (SLO: <67.000MB -2.3%) vs baseline: +4.9%

✅ tracer-no-templates

Time: ✅ 20.340ms (SLO: <22.000ms -7.5%) vs baseline: -0.2%

Memory: ✅ 65.396MB (SLO: <67.000MB -2.4%) vs baseline: +4.6%

🟡 errortrackingdjangosimple - 6/6

✅ errortracking-enabled-all

Time: ✅ 18.033ms (SLO: <19.850ms -9.2%) vs baseline: -0.5%

Memory: ✅ 65.294MB (SLO: <66.500MB 🟡 -1.8%) vs baseline: +4.9%

✅ errortracking-enabled-user

Time: ✅ 18.019ms (SLO: <19.400ms -7.1%) vs baseline: ~same

Memory: ✅ 65.195MB (SLO: <66.500MB 🟡 -2.0%) vs baseline: +4.9%

✅ tracer-enabled

Time: ✅ 18.038ms (SLO: <19.450ms -7.3%) vs baseline: -0.5%

Memory: ✅ 65.235MB (SLO: <66.500MB 🟡 -1.9%) vs baseline: +4.8%

🟡 flasksimple - 18/18

✅ appsec-get

Time: ✅ 4.578ms (SLO: <4.750ms -3.6%) vs baseline: -0.4%

Memory: ✅ 61.971MB (SLO: <65.000MB -4.7%) vs baseline: +5.0%

✅ appsec-post

Time: ✅ 6.599ms (SLO: <6.750ms -2.2%) vs baseline: +0.5%

Memory: ✅ 61.951MB (SLO: <65.000MB -4.7%) vs baseline: +4.5%

✅ appsec-telemetry

Time: ✅ 4.570ms (SLO: <4.750ms -3.8%) vs baseline: +0.3%

Memory: ✅ 62.030MB (SLO: <65.000MB -4.6%) vs baseline: +5.0%

✅ debugger

Time: ✅ 1.859ms (SLO: <2.000ms -7.0%) vs baseline: ~same

Memory: ✅ 45.397MB (SLO: <47.000MB -3.4%) vs baseline: +4.9%

✅ iast-get

Time: ✅ 1.865ms (SLO: <2.000ms -6.8%) vs baseline: -0.2%

Memory: ✅ 42.408MB (SLO: <49.000MB 📉 -13.5%) vs baseline: +5.1%

✅ profiler

Time: ✅ 1.913ms (SLO: <2.100ms -8.9%) vs baseline: -0.1%

Memory: ✅ 46.439MB (SLO: <47.000MB 🟡 -1.2%) vs baseline: +4.9%

✅ resource-renaming

Time: ✅ 3.386ms (SLO: <3.650ms -7.2%) vs baseline: -0.1%

Memory: ✅ 52.199MB (SLO: <53.500MB -2.4%) vs baseline: +4.8%

✅ tracer

Time: ✅ 3.381ms (SLO: <3.650ms -7.4%) vs baseline: ~same

Memory: ✅ 52.180MB (SLO: <53.500MB -2.5%) vs baseline: +4.7%

✅ tracer-native

Time: ✅ 3.369ms (SLO: <3.650ms -7.7%) vs baseline: ~same

Memory: ✅ 58.296MB (SLO: <60.000MB -2.8%) vs baseline: +4.8%

🟡 otelspan - 22/22

✅ add-event

Time: ✅ 42.395ms (SLO: <47.150ms 📉 -10.1%) vs baseline: -0.1%

Memory: ✅ 44.427MB (SLO: <47.000MB -5.5%) vs baseline: +4.7%

✅ add-metrics

Time: ✅ 320.584ms (SLO: <344.800ms -7.0%) vs baseline: +0.7%

Memory: ✅ 594.899MB (SLO: <600.000MB 🟡 -0.9%) vs baseline: +4.7%

✅ add-tags

Time: ✅ 290.732ms (SLO: <314.000ms -7.4%) vs baseline: +0.4%

Memory: ✅ 596.431MB (SLO: <600.000MB 🟡 -0.6%) vs baseline: +4.8%

✅ get-context

Time: ✅ 80.926ms (SLO: <92.350ms 📉 -12.4%) vs baseline: ~same

Memory: ✅ 39.976MB (SLO: <46.500MB 📉 -14.0%) vs baseline: +5.0%

✅ is-recording

Time: ✅ 39.035ms (SLO: <44.500ms 📉 -12.3%) vs baseline: -0.6%

Memory: ✅ 43.937MB (SLO: <47.500MB -7.5%) vs baseline: +4.9%

✅ record-exception

Time: ✅ 59.851ms (SLO: <67.650ms 📉 -11.5%) vs baseline: +2.0%

Memory: ✅ 40.285MB (SLO: <47.000MB 📉 -14.3%) vs baseline: +4.9%

✅ set-status

Time: ✅ 44.737ms (SLO: <50.400ms 📉 -11.2%) vs baseline: -0.8%

Memory: ✅ 43.950MB (SLO: <47.000MB -6.5%) vs baseline: +5.0%

✅ start

Time: ✅ 38.104ms (SLO: <43.450ms 📉 -12.3%) vs baseline: -0.2%

Memory: ✅ 43.945MB (SLO: <47.000MB -6.5%) vs baseline: +4.8%

✅ start-finish

Time: ✅ 82.653ms (SLO: <88.000ms -6.1%) vs baseline: -0.2%

Memory: ✅ 34.544MB (SLO: <46.500MB 📉 -25.7%) vs baseline: +5.0%

✅ start-finish-telemetry

Time: ✅ 84.312ms (SLO: <89.000ms -5.3%) vs baseline: +0.1%

Memory: ✅ 34.505MB (SLO: <46.500MB 📉 -25.8%) vs baseline: +4.7%

✅ update-name

Time: ✅ 40.156ms (SLO: <45.150ms 📉 -11.1%) vs baseline: -0.8%

Memory: ✅ 44.234MB (SLO: <47.000MB -5.9%) vs baseline: +5.0%

🟡 span - 26/26

✅ add-event

Time: ✅ 20.576ms (SLO: <22.500ms -8.6%) vs baseline: +0.8%

Memory: ✅ 50.395MB (SLO: <53.000MB -4.9%) vs baseline: +5.0%

✅ add-metrics

Time: ✅ 91.411ms (SLO: <93.500ms -2.2%) vs baseline: +1.0%

Memory: ✅ 660.931MB (SLO: <961.000MB 📉 -31.2%) vs baseline: +4.8%

✅ add-tags

Time: ✅ 148.343ms (SLO: <155.000ms -4.3%) vs baseline: +0.7%

Memory: ✅ 661.673MB (SLO: <962.500MB 📉 -31.3%) vs baseline: +4.8%

✅ get-context

Time: ✅ 19.901ms (SLO: <20.500ms -2.9%) vs baseline: +3.3%

Memory: ✅ 49.173MB (SLO: <53.000MB -7.2%) vs baseline: +4.9%

✅ is-recording

Time: ✅ 19.534ms (SLO: <20.500ms -4.7%) vs baseline: +0.5%

Memory: ✅ 49.152MB (SLO: <53.000MB -7.3%) vs baseline: +4.9%

✅ record-exception

Time: ✅ 38.474ms (SLO: <40.000ms -3.8%) vs baseline: +0.4%

Memory: ✅ 42.768MB (SLO: <53.000MB 📉 -19.3%) vs baseline: +4.9%

✅ set-status

Time: ✅ 21.351ms (SLO: <22.000ms -3.0%) vs baseline: +1.5%

Memory: ✅ 49.152MB (SLO: <53.000MB -7.3%) vs baseline: +4.8%

✅ start

Time: ✅ 19.585ms (SLO: <20.500ms -4.5%) vs baseline: +2.5%

Memory: ✅ 49.190MB (SLO: <53.000MB -7.2%) vs baseline: +4.7%

✅ start-finish

Time: ✅ 51.948ms (SLO: <52.500ms 🟡 -1.1%) vs baseline: +1.2%

Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +4.7%

✅ start-finish-telemetry

Time: ✅ 52.772ms (SLO: <54.500ms -3.2%) vs baseline: +0.3%

Memory: ✅ 32.047MB (SLO: <34.000MB -5.7%) vs baseline: +4.7%

✅ start-finish-traceid128

Time: ✅ 54.734ms (SLO: <56.000ms -2.3%) vs baseline: ~same

Memory: ✅ 32.185MB (SLO: <34.000MB -5.3%) vs baseline: +5.0%

✅ start-traceid128

Time: ✅ 19.448ms (SLO: <22.500ms 📉 -13.6%) vs baseline: +0.3%

Memory: ✅ 49.089MB (SLO: <53.000MB -7.4%) vs baseline: +4.7%

✅ update-name

Time: ✅ 20.469ms (SLO: <22.000ms -7.0%) vs baseline: +2.7%

Memory: ✅ 49.802MB (SLO: <53.000MB -6.0%) vs baseline: +4.9%

⚠️ Unstable Tests (1 suite)

⚠️

coreapiscenario - 10/10 (1 unstable)

⚠️ context_with_data_listeners

Time: ⚠️ 13.274µs (SLO: <20.000µs 📉 -33.6%) vs baseline: -0.3%

Memory: ✅ 32.086MB (SLO: <33.500MB -4.2%) vs baseline: +4.7%

✅ context_with_data_no_listeners

Time: ✅ 3.287µs (SLO: <10.000µs 📉 -67.1%) vs baseline: +0.4%

Memory: ✅ 32.145MB (SLO: <33.500MB -4.0%) vs baseline: +4.8%

✅ get_item_exists

Time: ✅ 0.583µs (SLO: <10.000µs 📉 -94.2%) vs baseline: -1.1%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +5.2%

✅ get_item_missing

Time: ✅ 0.633µs (SLO: <10.000µs 📉 -93.7%) vs baseline: -0.6%

Memory: ✅ 32.126MB (SLO: <33.500MB -4.1%) vs baseline: +4.8%

✅ set_item

Time: ✅ 24.234µs (SLO: <30.000µs 📉 -19.2%) vs baseline: +0.4%

Memory: ✅ 32.106MB (SLO: <33.500MB -4.2%) vs baseline: +4.7%

✅ All Tests Passing (18 suites)

✅ errortrackingflasksqli - 6/6

✅ errortracking-enabled-all

Time: ✅ 2.085ms (SLO: <2.300ms -9.3%) vs baseline: +0.2%

Memory: ✅ 52.219MB (SLO: <53.500MB -2.4%) vs baseline: +5.2%

✅ errortracking-enabled-user

Time: ✅ 2.088ms (SLO: <2.250ms -7.2%) vs baseline: +0.9%

Memory: ✅ 52.101MB (SLO: <53.500MB -2.6%) vs baseline: +4.9%

✅ tracer-enabled

Time: ✅ 2.081ms (SLO: <2.300ms -9.5%) vs baseline: +0.2%

Memory: ✅ 52.199MB (SLO: <53.500MB -2.4%) vs baseline: +4.8%

✅ flasksqli - 6/6

✅ appsec-enabled

Time: ✅ 3.916ms (SLO: <4.200ms -6.8%) vs baseline: +0.3%

Memory: ✅ 62.305MB (SLO: <66.000MB -5.6%) vs baseline: +5.0%

✅ iast-enabled

Time: ✅ 2.457ms (SLO: <2.800ms 📉 -12.3%) vs baseline: +0.1%

Memory: ✅ 58.629MB (SLO: <60.000MB -2.3%) vs baseline: +4.7%

✅ tracer-enabled

Time: ✅ 2.064ms (SLO: <2.250ms -8.3%) vs baseline: +0.2%

Memory: ✅ 52.160MB (SLO: <54.500MB -4.3%) vs baseline: +4.8%

✅ httppropagationextract - 60/60

✅ all_styles_all_headers

Time: ✅ 81.978µs (SLO: <100.000µs 📉 -18.0%) vs baseline: +0.4%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +5.2%

✅ b3_headers

Time: ✅ 14.180µs (SLO: <20.000µs 📉 -29.1%) vs baseline: +0.2%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ b3_single_headers

Time: ✅ 13.316µs (SLO: <20.000µs 📉 -33.4%) vs baseline: +0.5%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

Time: ✅ 64.130µs (SLO: <80.000µs 📉 -19.8%) vs baseline: +0.7%

Memory: ✅ 32.145MB (SLO: <33.500MB -4.0%) vs baseline: +4.5%

✅ datadog_tracecontext_tracestate_propagated_on_trace_id_match

Time: ✅ 66.211µs (SLO: <80.000µs 📉 -17.2%) vs baseline: -0.1%

Memory: ✅ 32.106MB (SLO: <33.500MB -4.2%) vs baseline: +4.7%

✅ empty_headers

Time: ✅ 1.629µs (SLO: <10.000µs 📉 -83.7%) vs baseline: +1.9%

Memory: ✅ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +5.1%

✅ full_t_id_datadog_headers

Time: ✅ 22.939µs (SLO: <30.000µs 📉 -23.5%) vs baseline: +0.3%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.8%

✅ invalid_priority_header

Time: ✅ 6.538µs (SLO: <10.000µs 📉 -34.6%) vs baseline: +0.3%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.8%

✅ invalid_span_id_header

Time: ✅ 6.521µs (SLO: <10.000µs 📉 -34.8%) vs baseline: +0.4%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.9%

✅ invalid_tags_header

Time: ✅ 6.576µs (SLO: <10.000µs 📉 -34.2%) vs baseline: +1.2%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +5.1%

✅ invalid_trace_id_header

Time: ✅ 6.660µs (SLO: <10.000µs 📉 -33.4%) vs baseline: +2.3%

Memory: ✅ 32.145MB (SLO: <33.500MB -4.0%) vs baseline: +4.9%

✅ large_header_no_matches

Time: ✅ 27.493µs (SLO: <30.000µs -8.4%) vs baseline: +0.1%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +5.1%

✅ large_valid_headers_all

Time: ✅ 28.705µs (SLO: <40.000µs 📉 -28.2%) vs baseline: +0.4%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ medium_header_no_matches

Time: ✅ 9.873µs (SLO: <20.000µs 📉 -50.6%) vs baseline: +0.3%

Memory: ✅ 32.106MB (SLO: <33.500MB -4.2%) vs baseline: +4.8%

✅ medium_valid_headers_all

Time: ✅ 11.148µs (SLO: <20.000µs 📉 -44.3%) vs baseline: -0.7%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.9%

✅ none_propagation_style

Time: ✅ 1.709µs (SLO: <10.000µs 📉 -82.9%) vs baseline: +1.0%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.9%

✅ tracecontext_headers

Time: ✅ 34.523µs (SLO: <40.000µs 📉 -13.7%) vs baseline: +0.3%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +5.0%

✅ valid_headers_all

Time: ✅ 6.560µs (SLO: <10.000µs 📉 -34.4%) vs baseline: +0.7%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ valid_headers_basic

Time: ✅ 6.086µs (SLO: <10.000µs 📉 -39.1%) vs baseline: +0.2%

Memory: ✅ 32.145MB (SLO: <33.500MB -4.0%) vs baseline: +4.8%

✅ wsgi_empty_headers

Time: ✅ 1.608µs (SLO: <10.000µs 📉 -83.9%) vs baseline: +1.2%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%

✅ wsgi_invalid_priority_header

Time: ✅ 6.600µs (SLO: <10.000µs 📉 -34.0%) vs baseline: +0.5%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.7%

✅ wsgi_invalid_span_id_header

Time: ✅ 1.600µs (SLO: <10.000µs 📉 -84.0%) vs baseline: +0.1%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.7%

✅ wsgi_invalid_tags_header

Time: ✅ 6.578µs (SLO: <10.000µs 📉 -34.2%) vs baseline: +0.7%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ wsgi_invalid_trace_id_header

Time: ✅ 6.648µs (SLO: <10.000µs 📉 -33.5%) vs baseline: +0.6%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.7%

✅ wsgi_large_header_no_matches

Time: ✅ 28.616µs (SLO: <40.000µs 📉 -28.5%) vs baseline: -0.2%

Memory: ✅ 32.145MB (SLO: <33.500MB -4.0%) vs baseline: +4.7%

✅ wsgi_large_valid_headers_all

Time: ✅ 29.830µs (SLO: <40.000µs 📉 -25.4%) vs baseline: -0.3%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ wsgi_medium_header_no_matches

Time: ✅ 10.130µs (SLO: <20.000µs 📉 -49.3%) vs baseline: +0.7%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +5.1%

✅ wsgi_medium_valid_headers_all

Time: ✅ 11.591µs (SLO: <20.000µs 📉 -42.0%) vs baseline: +1.1%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.8%

✅ wsgi_valid_headers_all

Time: ✅ 6.596µs (SLO: <10.000µs 📉 -34.0%) vs baseline: +0.1%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ wsgi_valid_headers_basic

Time: ✅ 6.105µs (SLO: <10.000µs 📉 -38.9%) vs baseline: ~same

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ httppropagationinject - 16/16

✅ ids_only

Time: ✅ 21.698µs (SLO: <30.000µs 📉 -27.7%) vs baseline: -0.7%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +5.2%

✅ with_all

Time: ✅ 29.625µs (SLO: <40.000µs 📉 -25.9%) vs baseline: +2.4%

Memory: ✅ 32.106MB (SLO: <33.500MB -4.2%) vs baseline: +4.6%

✅ with_dd_origin

Time: ✅ 25.453µs (SLO: <30.000µs 📉 -15.2%) vs baseline: ~same

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ with_priority_and_origin

Time: ✅ 24.791µs (SLO: <40.000µs 📉 -38.0%) vs baseline: -0.4%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ with_sampling_priority

Time: ✅ 22.370µs (SLO: <30.000µs 📉 -25.4%) vs baseline: +3.3%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +5.0%

✅ with_tags

Time: ✅ 27.496µs (SLO: <40.000µs 📉 -31.3%) vs baseline: +1.3%

Memory: ✅ 32.145MB (SLO: <33.500MB -4.0%) vs baseline: +4.9%

✅ with_tags_invalid

Time: ✅ 28.559µs (SLO: <40.000µs 📉 -28.6%) vs baseline: +0.2%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ with_tags_max_size

Time: ✅ 27.704µs (SLO: <40.000µs 📉 -30.7%) vs baseline: +0.5%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +5.2%

✅ iast_aspects - 40/40

✅ re_expand_aspect

Time: ✅ 31.892µs (SLO: <40.000µs 📉 -20.3%) vs baseline: -0.4%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%

✅ re_expand_noaspect

Time: ✅ 28.840µs (SLO: <40.000µs 📉 -27.9%) vs baseline: -0.7%

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.7%

✅ re_findall_aspect

Time: ✅ 2.924µs (SLO: <10.000µs 📉 -70.8%) vs baseline: +0.7%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%

✅ re_findall_noaspect

Time: ✅ 1.431µs (SLO: <10.000µs 📉 -85.7%) vs baseline: +0.6%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ re_finditer_aspect

Time: ✅ 4.478µs (SLO: <10.000µs 📉 -55.2%) vs baseline: -0.3%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.1%

✅ re_finditer_noaspect

Time: ✅ 1.419µs (SLO: <10.000µs 📉 -85.8%) vs baseline: ~same

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%

✅ re_fullmatch_aspect

Time: ✅ 2.689µs (SLO: <10.000µs 📉 -73.1%) vs baseline: ~same

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.7%

✅ re_fullmatch_noaspect

Time: ✅ 1.307µs (SLO: <10.000µs 📉 -86.9%) vs baseline: +1.1%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ re_group_aspect

Time: ✅ 2.939µs (SLO: <10.000µs 📉 -70.6%) vs baseline: -0.3%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%

✅ re_group_noaspect

Time: ✅ 1.598µs (SLO: <10.000µs 📉 -84.0%) vs baseline: -0.7%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%

✅ re_groups_aspect

Time: ✅ 3.077µs (SLO: <10.000µs 📉 -69.2%) vs baseline: +0.4%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.2%

✅ re_groups_noaspect

Time: ✅ 1.710µs (SLO: <10.000µs 📉 -82.9%) vs baseline: +1.7%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.1%

✅ re_match_aspect

Time: ✅ 2.725µs (SLO: <10.000µs 📉 -72.7%) vs baseline: +1.2%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%

✅ re_match_noaspect

Time: ✅ 1.305µs (SLO: <10.000µs 📉 -86.9%) vs baseline: +0.4%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%

✅ re_search_aspect

Time: ✅ 2.579µs (SLO: <10.000µs 📉 -74.2%) vs baseline: -0.2%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%

✅ re_search_noaspect

Time: ✅ 1.208µs (SLO: <10.000µs 📉 -87.9%) vs baseline: +0.6%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%

✅ re_sub_aspect

Time: ✅ 3.433µs (SLO: <10.000µs 📉 -65.7%) vs baseline: +0.5%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.9%

✅ re_sub_noaspect

Time: ✅ 1.548µs (SLO: <10.000µs 📉 -84.5%) vs baseline: +1.3%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%

✅ re_subn_aspect

Time: ✅ 3.633µs (SLO: <10.000µs 📉 -63.7%) vs baseline: -0.6%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%

✅ re_subn_noaspect

Time: ✅ 1.635µs (SLO: <10.000µs 📉 -83.7%) vs baseline: +1.8%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +5.0%

✅ iastaspects - 118/118

✅ add_aspect

Time: ✅ 0.410µs (SLO: <10.000µs 📉 -95.9%) vs baseline: +2.0%

Memory: ✅ 38.044MB (SLO: <39.000MB -2.5%) vs baseline: +4.9%

✅ add_inplace_aspect

Time: ✅ 0.415µs (SLO: <10.000µs 📉 -95.9%) vs baseline: +1.7%

Memory: ✅ 38.004MB (SLO: <39.000MB -2.6%) vs baseline: +4.6%

✅ add_inplace_noaspect

Time: ✅ 0.317µs (SLO: <10.000µs 📉 -96.8%) vs baseline: -0.4%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +4.9%

✅ add_noaspect

Time: ✅ 0.281µs (SLO: <10.000µs 📉 -97.2%) vs baseline: +0.6%

Memory: ✅ 38.044MB (SLO: <39.000MB -2.5%) vs baseline: +5.0%

✅ bytearray_aspect

Time: ✅ 1.334µs (SLO: <10.000µs 📉 -86.7%) vs baseline: +0.8%

Memory: ✅ 38.044MB (SLO: <39.000MB -2.5%) vs baseline: +4.8%

✅ bytearray_extend_aspect

Time: ✅ 1.444µs (SLO: <10.000µs 📉 -85.6%) vs baseline: -0.7%

Memory: ✅ 38.024MB (SLO: <39.000MB -2.5%) vs baseline: +4.6%

✅ bytearray_extend_noaspect

Time: ✅ 0.610µs (SLO: <10.000µs 📉 -93.9%) vs baseline: -0.5%

Memory: ✅ 38.024MB (SLO: <39.000MB -2.5%) vs baseline: +4.6%

✅ bytearray_noaspect

Time: ✅ 0.483µs (SLO: <10.000µs 📉 -95.2%) vs baseline: +1.1%

Memory: ✅ 38.044MB (SLO: <39.000MB -2.5%) vs baseline: +4.9%

✅ bytes_aspect

Time: ✅ 1.297µs (SLO: <10.000µs 📉 -87.0%) vs baseline: +1.2%

Memory: ✅ 38.024MB (SLO: <39.000MB -2.5%) vs baseline: +4.7%

✅ bytes_noaspect

Time: ✅ 0.494µs (SLO: <10.000µs 📉 -95.1%) vs baseline: +1.1%

Memory: ✅ 37.985MB (SLO: <39.000MB -2.6%) vs baseline: +4.5%

✅ bytesio_aspect

Time: ✅ 1.356µs (SLO: <10.000µs 📉 -86.4%) vs baseline: -1.6%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +4.9%

✅ bytesio_noaspect

Time: ✅ 0.494µs (SLO: <10.000µs 📉 -95.1%) vs baseline: +0.2%

Memory: ✅ 38.024MB (SLO: <39.000MB -2.5%) vs baseline: +4.6%

✅ capitalize_aspect

Time: ✅ 0.733µs (SLO: <10.000µs 📉 -92.7%) vs baseline: -0.2%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +5.0%

✅ capitalize_noaspect

Time: ✅ 0.440µs (SLO: <10.000µs 📉 -95.6%) vs baseline: +1.5%

Memory: ✅ 38.044MB (SLO: <39.000MB -2.5%) vs baseline: +4.7%

✅ casefold_aspect

Time: ✅ 0.737µs (SLO: <10.000µs 📉 -92.6%) vs baseline: ~same

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +5.0%

✅ casefold_noaspect

Time: ✅ 0.370µs (SLO: <10.000µs 📉 -96.3%) vs baseline: +1.4%

Memory: ✅ 37.985MB (SLO: <39.000MB -2.6%) vs baseline: +4.5%

✅ decode_aspect

Time: ✅ 0.720µs (SLO: <10.000µs 📉 -92.8%) vs baseline: -0.5%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +4.9%

✅ decode_noaspect

Time: ✅ 0.419µs (SLO: <10.000µs 📉 -95.8%) vs baseline: -0.5%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +5.1%

✅ encode_aspect

Time: ✅ 0.709µs (SLO: <10.000µs 📉 -92.9%) vs baseline: ~same

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +4.9%

✅ encode_noaspect

Time: ✅ 0.402µs (SLO: <10.000µs 📉 -96.0%) vs baseline: +1.1%

Memory: ✅ 38.004MB (SLO: <39.000MB -2.6%) vs baseline: +4.7%

✅ format_aspect

Time: ✅ 3.327µs (SLO: <10.000µs 📉 -66.7%) vs baseline: -1.0%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +5.0%

✅ format_map_aspect

Time: ✅ 3.631µs (SLO: <10.000µs 📉 -63.7%) vs baseline: -0.8%

Memory: ✅ 37.827MB (SLO: <39.000MB -3.0%) vs baseline: +4.2%

✅ format_map_noaspect

Time: ✅ 0.774µs (SLO: <10.000µs 📉 -92.3%) vs baseline: +0.6%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +4.7%

✅ format_noaspect

Time: ✅ 0.603µs (SLO: <10.000µs 📉 -94.0%) vs baseline: +0.9%

Memory: ✅ 38.004MB (SLO: <39.000MB -2.6%) vs baseline: +4.7%

✅ index_aspect

Time: ✅ 0.358µs (SLO: <10.000µs 📉 -96.4%) vs baseline: -0.3%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +5.0%

✅ index_noaspect

Time: ✅ 0.275µs (SLO: <10.000µs 📉 -97.3%) vs baseline: -1.7%

Memory: ✅ 38.024MB (SLO: <39.000MB -2.5%) vs baseline: +4.8%

✅ join_aspect

Time: ✅ 1.398µs (SLO: <10.000µs 📉 -86.0%) vs baseline: +0.3%

Memory: ✅ 37.985MB (SLO: <39.000MB -2.6%) vs baseline: +4.6%

✅ join_noaspect

Time: ✅ 0.491µs (SLO: <10.000µs 📉 -95.1%) vs baseline: +0.2%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +5.0%

✅ ljust_aspect

Time: ✅ 2.469µs (SLO: <20.000µs 📉 -87.7%) vs baseline: -0.3%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +4.9%

✅ ljust_noaspect

Time: ✅ 0.402µs (SLO: <10.000µs 📉 -96.0%) vs baseline: -1.8%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +5.0%

✅ lower_aspect

Time: ✅ 2.216µs (SLO: <10.000µs 📉 -77.8%) vs baseline: +0.8%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +4.9%

✅ lower_noaspect

Time: ✅ 0.367µs (SLO: <10.000µs 📉 -96.3%) vs baseline: -1.8%

Memory: ✅ 38.044MB (SLO: <39.000MB -2.5%) vs baseline: +4.9%

✅ lstrip_aspect

Time: ✅ 2.364µs (SLO: <20.000µs 📉 -88.2%) vs baseline: +5.6%

Memory: ✅ 38.044MB (SLO: <39.000MB -2.5%) vs baseline: +4.9%

✅ lstrip_noaspect

Time: ✅ 0.380µs (SLO: <10.000µs 📉 -96.2%) vs baseline: -0.2%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +5.0%

✅ modulo_aspect

Time: ✅ 1.001µs (SLO: <10.000µs 📉 -90.0%) vs baseline: -0.2%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +5.1%

✅ modulo_aspect_for_bytearray_bytearray

Time: ✅ 1.530µs (SLO: <10.000µs 📉 -84.7%) vs baseline: +0.2%

Memory: ✅ 38.044MB (SLO: <39.000MB -2.5%) vs baseline: +4.9%

✅ modulo_aspect_for_bytes

Time: ✅ 0.986µs (SLO: <10.000µs 📉 -90.1%) vs baseline: +0.6%

Memory: ✅ 38.044MB (SLO: <39.000MB -2.5%) vs baseline: +4.7%

✅ modulo_aspect_for_bytes_bytearray

Time: ✅ 1.202µs (SLO: <10.000µs 📉 -88.0%) vs baseline: -0.6%

Memory: ✅ 38.004MB (SLO: <39.000MB -2.6%) vs baseline: +4.8%

✅ modulo_noaspect

Time: ✅ 0.625µs (SLO: <10.000µs 📉 -93.8%) vs baseline: -0.6%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +5.0%

✅ replace_aspect

Time: ✅ 4.859µs (SLO: <10.000µs 📉 -51.4%) vs baseline: +1.2%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +4.9%

✅ replace_noaspect

Time: ✅ 0.461µs (SLO: <10.000µs 📉 -95.4%) vs baseline: -0.3%

Memory: ✅ 38.024MB (SLO: <39.000MB -2.5%) vs baseline: +4.7%

✅ repr_aspect

Time: ✅ 0.905µs (SLO: <10.000µs 📉 -90.9%) vs baseline: -0.1%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +5.0%

✅ repr_noaspect

Time: ✅ 0.417µs (SLO: <10.000µs 📉 -95.8%) vs baseline: +0.7%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +4.9%

✅ rstrip_aspect

Time: ✅ 1.942µs (SLO: <20.000µs 📉 -90.3%) vs baseline: +0.9%

Memory: ✅ 37.985MB (SLO: <39.000MB -2.6%) vs baseline: +4.6%

✅ rstrip_noaspect

Time: ✅ 0.389µs (SLO: <10.000µs 📉 -96.1%) vs baseline: +3.1%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +5.0%

✅ slice_aspect

Time: ✅ 0.496µs (SLO: <10.000µs 📉 -95.0%) vs baseline: +0.5%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +5.0%

✅ slice_noaspect

Time: ✅ 0.449µs (SLO: <10.000µs 📉 -95.5%) vs baseline: -0.6%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +4.8%

✅ stringio_aspect

Time: ✅ 1.538µs (SLO: <10.000µs 📉 -84.6%) vs baseline: -0.4%

Memory: ✅ 38.024MB (SLO: <39.000MB -2.5%) vs baseline: +4.8%

✅ stringio_noaspect

Time: ✅ 0.725µs (SLO: <10.000µs 📉 -92.8%) vs baseline: +1.1%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +4.9%

✅ strip_aspect

Time: ✅ 2.209µs (SLO: <20.000µs 📉 -89.0%) vs baseline: -0.3%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +4.7%

✅ strip_noaspect

Time: ✅ 0.383µs (SLO: <10.000µs 📉 -96.2%) vs baseline: -0.7%

Memory: ✅ 38.044MB (SLO: <39.000MB -2.5%) vs baseline: +4.7%

✅ swapcase_aspect

Time: ✅ 2.428µs (SLO: <10.000µs 📉 -75.7%) vs baseline: +0.1%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +4.8%

✅ swapcase_noaspect

Time: ✅ 0.542µs (SLO: <10.000µs 📉 -94.6%) vs baseline: +1.2%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +4.9%

✅ title_aspect

Time: ✅ 2.355µs (SLO: <10.000µs 📉 -76.4%) vs baseline: +0.7%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +4.9%

✅ title_noaspect

Time: ✅ 0.498µs (SLO: <10.000µs 📉 -95.0%) vs baseline: -2.2%

Memory: ✅ 38.004MB (SLO: <39.000MB -2.6%) vs baseline: +4.6%

✅ translate_aspect

Time: ✅ 3.220µs (SLO: <10.000µs 📉 -67.8%) vs baseline: -0.2%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +5.0%

✅ translate_noaspect

Time: ✅ 1.037µs (SLO: <10.000µs 📉 -89.6%) vs baseline: +0.1%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +4.7%

✅ upper_aspect

Time: ✅ 2.296µs (SLO: <10.000µs 📉 -77.0%) vs baseline: +3.2%

Memory: ✅ 38.024MB (SLO: <39.000MB -2.5%) vs baseline: +4.6%

✅ upper_noaspect

Time: ✅ 0.370µs (SLO: <10.000µs 📉 -96.3%) vs baseline: -0.4%

Memory: ✅ 38.044MB (SLO: <39.000MB -2.5%) vs baseline: +4.9%

✅ iastaspectsospath - 24/24

✅ ospathbasename_aspect

Time: ✅ 4.337µs (SLO: <10.000µs 📉 -56.6%) vs baseline: +1.3%

Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +4.6%

✅ ospathbasename_noaspect

Time: ✅ 1.090µs (SLO: <10.000µs 📉 -89.1%) vs baseline: +1.1%

Memory: ✅ 37.552MB (SLO: <39.000MB -3.7%) vs baseline: +4.6%

✅ ospathjoin_aspect

Time: ✅ 6.117µs (SLO: <10.000µs 📉 -38.8%) vs baseline: ~same

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.9%

✅ ospathjoin_noaspect

Time: ✅ 2.302µs (SLO: <10.000µs 📉 -77.0%) vs baseline: +0.2%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%

✅ ospathnormcase_aspect

Time: ✅ 3.505µs (SLO: <10.000µs 📉 -65.0%) vs baseline: +1.5%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%

✅ ospathnormcase_noaspect

Time: ✅ 0.574µs (SLO: <10.000µs 📉 -94.3%) vs baseline: +1.2%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%

✅ ospathsplit_aspect

Time: ✅ 4.916µs (SLO: <10.000µs 📉 -50.8%) vs baseline: ~same

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%

✅ ospathsplit_noaspect

Time: ✅ 1.610µs (SLO: <10.000µs 📉 -83.9%) vs baseline: +0.9%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ ospathsplitdrive_aspect

Time: ✅ 3.628µs (SLO: <10.000µs 📉 -63.7%) vs baseline: -1.4%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%

✅ ospathsplitdrive_noaspect

Time: ✅ 0.708µs (SLO: <10.000µs 📉 -92.9%) vs baseline: +1.6%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%

✅ ospathsplitext_aspect

Time: ✅ 4.659µs (SLO: <10.000µs 📉 -53.4%) vs baseline: +2.2%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ ospathsplitext_noaspect

Time: ✅ 1.388µs (SLO: <10.000µs 📉 -86.1%) vs baseline: +0.7%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%

✅ iastaspectssplit - 12/12

✅ rsplit_aspect

Time: ✅ 1.423µs (SLO: <10.000µs 📉 -85.8%) vs baseline: -0.9%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%

✅ rsplit_noaspect

Time: ✅ 0.582µs (SLO: <10.000µs 📉 -94.2%) vs baseline: +0.9%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%

✅ split_aspect

Time: ✅ 1.427µs (SLO: <10.000µs 📉 -85.7%) vs baseline: +0.6%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ split_noaspect

Time: ✅ 0.570µs (SLO: <10.000µs 📉 -94.3%) vs baseline: +0.3%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%

✅ splitlines_aspect

Time: ✅ 1.402µs (SLO: <10.000µs 📉 -86.0%) vs baseline: -2.1%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.6%

✅ splitlines_noaspect

Time: ✅ 0.591µs (SLO: <10.000µs 📉 -94.1%) vs baseline: +1.4%

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.6%

✅ iastpropagation - 2/2

✅ no-propagation

Time: ✅ 49.192µs (SLO: <60.000µs 📉 -18.0%) vs baseline: -0.3%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%

✅ otelsdkspan - 24/24

✅ add-event

Time: ✅ 40.329ms (SLO: <42.000ms -4.0%) vs baseline: -0.4%

Memory: ✅ 34.583MB (SLO: <39.000MB 📉 -11.3%) vs baseline: +5.2%

✅ add-link

Time: ✅ 36.549ms (SLO: <38.550ms -5.2%) vs baseline: +0.2%

Memory: ✅ 34.426MB (SLO: <39.000MB 📉 -11.7%) vs baseline: +4.6%

✅ add-metrics

Time: ✅ 219.472ms (SLO: <232.000ms -5.4%) vs baseline: +0.3%

Memory: ✅ 34.485MB (SLO: <39.000MB 📉 -11.6%) vs baseline: +4.6%

✅ add-tags

Time: ✅ 212.799ms (SLO: <221.600ms -4.0%) vs baseline: +0.8%

Memory: ✅ 34.544MB (SLO: <39.000MB 📉 -11.4%) vs baseline: +4.9%

✅ get-context

Time: ✅ 28.968ms (SLO: <31.300ms -7.4%) vs baseline: -0.2%

Memory: ✅ 34.485MB (SLO: <39.000MB 📉 -11.6%) vs baseline: +5.0%

✅ is-recording

Time: ✅ 29.209ms (SLO: <31.000ms -5.8%) vs baseline: +0.7%

Memory: ✅ 34.583MB (SLO: <39.000MB 📉 -11.3%) vs baseline: +5.0%

✅ record-exception

Time: ✅ 63.252ms (SLO: <65.850ms -3.9%) vs baseline: +0.2%

Memory: ✅ 34.918MB (SLO: <39.000MB 📉 -10.5%) vs baseline: +4.9%

✅ set-status

Time: ✅ 31.870ms (SLO: <34.150ms -6.7%) vs baseline: -0.3%

Memory: ✅ 34.485MB (SLO: <39.000MB 📉 -11.6%) vs baseline: +4.9%

✅ start

Time: ✅ 28.531ms (SLO: <30.150ms -5.4%) vs baseline: -0.5%

Memory: ✅ 34.564MB (SLO: <39.000MB 📉 -11.4%) vs baseline: +4.9%

✅ start-finish

Time: ✅ 33.767ms (SLO: <35.350ms -4.5%) vs baseline: -0.4%

Memory: ✅ 34.485MB (SLO: <39.000MB 📉 -11.6%) vs baseline: +4.6%

✅ start-finish-telemetry

Time: ✅ 33.985ms (SLO: <35.450ms -4.1%) vs baseline: ~same

Memory: ✅ 34.485MB (SLO: <39.000MB 📉 -11.6%) vs baseline: +4.7%

✅ update-name

Time: ✅ 31.030ms (SLO: <33.400ms -7.1%) vs baseline: +0.4%

Memory: ✅ 34.583MB (SLO: <39.000MB 📉 -11.3%) vs baseline: +5.2%

✅ packagespackageforrootmodulemapping - 4/4

✅ cache_off

Time: ✅ 339.140ms (SLO: <354.300ms -4.3%) vs baseline: -0.7%

Memory: ✅ 37.528MB (SLO: <40.000MB -6.2%) vs baseline: +4.6%

✅ cache_on

Time: ✅ 0.385µs (SLO: <10.000µs 📉 -96.2%) vs baseline: +0.7%

Memory: ✅ 37.322MB (SLO: <39.000MB -4.3%) vs baseline: +5.7%

✅ packagesupdateimporteddependencies - 24/24

✅ import_many

Time: ✅ 155.587µs (SLO: <170.000µs -8.5%) vs baseline: +0.7%

Memory: ✅ 37.380MB (SLO: <38.500MB -2.9%) vs baseline: +5.6%

✅ import_many_cached

Time: ✅ 121.636µs (SLO: <130.000µs -6.4%) vs baseline: +0.7%

Memory: ✅ 37.274MB (SLO: <38.500MB -3.2%) vs baseline: +5.1%

✅ import_many_stdlib

Time: ✅ 1.639ms (SLO: <1.750ms -6.3%) vs baseline: +0.4%

Memory: ✅ 37.449MB (SLO: <38.500MB -2.7%) vs baseline: +5.3%

✅ import_many_stdlib_cached

Time: ✅ 0.984ms (SLO: <1.100ms 📉 -10.6%) vs baseline: +0.6%

Memory: ✅ 37.401MB (SLO: <38.500MB -2.9%) vs baseline: +5.5%

✅ import_many_unknown

Time: ✅ 836.892µs (SLO: <890.000µs -6.0%) vs baseline: +0.6%

Memory: ✅ 37.349MB (SLO: <38.500MB -3.0%) vs baseline: +5.0%

✅ import_many_unknown_cached

Time: ✅ 792.184µs (SLO: <870.000µs -8.9%) vs baseline: +0.1%

Memory: ✅ 37.350MB (SLO: <38.500MB -3.0%) vs baseline: +5.1%

✅ import_one

Time: ✅ 19.766µs (SLO: <30.000µs 📉 -34.1%) vs baseline: +0.3%

Memory: ✅ 37.502MB (SLO: <39.000MB -3.8%) vs baseline: +6.6%

✅ import_one_cache

Time: ✅ 6.285µs (SLO: <10.000µs 📉 -37.2%) vs baseline: ~same

Memory: ✅ 37.494MB (SLO: <38.500MB -2.6%) vs baseline: +5.9%

✅ import_one_stdlib

Time: ✅ 18.741µs (SLO: <20.000µs -6.3%) vs baseline: +0.1%

Memory: ✅ 37.496MB (SLO: <38.500MB -2.6%) vs baseline: +5.8%

✅ import_one_stdlib_cache

Time: ✅ 6.263µs (SLO: <10.000µs 📉 -37.4%) vs baseline: +0.5%

Memory: ✅ 37.514MB (SLO: <38.500MB -2.6%) vs baseline: +6.4%

✅ import_one_unknown

Time: ✅ 45.322µs (SLO: <50.000µs -9.4%) vs baseline: -0.3%

Memory: ✅ 37.403MB (SLO: <38.500MB -2.8%) vs baseline: +5.9%

✅ import_one_unknown_cache

Time: ✅ 6.343µs (SLO: <10.000µs 📉 -36.6%) vs baseline: +1.6%

Memory: ✅ 37.436MB (SLO: <38.500MB -2.8%) vs baseline: +6.0%

✅ ratelimiter - 12/12

✅ defaults

Time: ✅ 2.345µs (SLO: <10.000µs 📉 -76.6%) vs baseline: -1.4%

Memory: ✅ 31.831MB (SLO: <34.000MB -6.4%) vs baseline: +5.0%

✅ high_rate_limit

Time: ✅ 2.410µs (SLO: <10.000µs 📉 -75.9%) vs baseline: +0.1%

Memory: ✅ 31.792MB (SLO: <34.000MB -6.5%) vs baseline: +5.0%

✅ long_window

Time: ✅ 2.331µs (SLO: <10.000µs 📉 -76.7%) vs baseline: -1.5%

Memory: ✅ 31.772MB (SLO: <34.000MB -6.6%) vs baseline: +4.6%

✅ low_rate_limit

Time: ✅ 2.363µs (SLO: <10.000µs 📉 -76.4%) vs baseline: +0.4%

Memory: ✅ 31.772MB (SLO: <34.000MB -6.6%) vs baseline: +4.9%

✅ no_rate_limit

Time: ✅ 0.825µs (SLO: <10.000µs 📉 -91.8%) vs baseline: ~same

Memory: ✅ 31.811MB (SLO: <34.000MB -6.4%) vs baseline: +5.1%

✅ short_window

Time: ✅ 2.503µs (SLO: <10.000µs 📉 -75.0%) vs baseline: ~same

Memory: ✅ 31.752MB (SLO: <34.000MB -6.6%) vs baseline: +5.1%

✅ recursivecomputation - 8/8

✅ deep

Time: ✅ 309.913ms (SLO: <320.950ms -3.4%) vs baseline: +0.1%

Memory: ✅ 32.971MB (SLO: <34.500MB -4.4%) vs baseline: +5.0%

✅ deep-profiled

Time: ✅ 326.631ms (SLO: <359.150ms -9.1%) vs baseline: -0.2%

Memory: ✅ 37.198MB (SLO: <39.000MB -4.6%) vs baseline: +5.0%

✅ medium

Time: ✅ 7.074ms (SLO: <7.400ms -4.4%) vs baseline: +0.2%

Memory: ✅ 32.204MB (SLO: <34.000MB -5.3%) vs baseline: +5.2%

✅ shallow

Time: ✅ 0.958ms (SLO: <1.050ms -8.8%) vs baseline: +0.7%

Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +5.1%

✅ samplingrules - 8/8

✅ average_match

Time: ✅ 149.019µs (SLO: <290.000µs 📉 -48.6%) vs baseline: +0.9%

Memory: ✅ 32.106MB (SLO: <34.000MB -5.6%) vs baseline: +4.8%

✅ high_match

Time: ✅ 194.231µs (SLO: <480.000µs 📉 -59.5%) vs baseline: -0.3%

Memory: ✅ 32.047MB (SLO: <34.000MB -5.7%) vs baseline: +4.5%

✅ low_match

Time: ✅ 100.628µs (SLO: <120.000µs 📉 -16.1%) vs baseline: -0.2%

Memory: ✅ 632.634MB (SLO: <700.000MB -9.6%) vs baseline: +4.8%

✅ very_low_match

Time: ✅ 2.886ms (SLO: <8.500ms 📉 -66.0%) vs baseline: ~same

Memory: ✅ 70.280MB (SLO: <75.000MB -6.3%) vs baseline: +4.9%

✅ sethttpmeta - 32/32

✅ all-disabled

Time: ✅ 10.494µs (SLO: <20.000µs 📉 -47.5%) vs baseline: -0.2%

Memory: ✅ 32.637MB (SLO: <34.000MB -4.0%) vs baseline: +4.9%

✅ all-enabled

Time: ✅ 39.853µs (SLO: <50.000µs 📉 -20.3%) vs baseline: ~same

Memory: ✅ 32.598MB (SLO: <34.000MB -4.1%) vs baseline: +5.0%

✅ collectipvariant_exists

Time: ✅ 40.641µs (SLO: <50.000µs 📉 -18.7%) vs baseline: +0.5%

Memory: ✅ 32.598MB (SLO: <34.000MB -4.1%) vs baseline: +4.9%

✅ no-collectipvariant

Time: ✅ 39.758µs (SLO: <50.000µs 📉 -20.5%) vs baseline: -0.6%

Memory: ✅ 32.519MB (SLO: <34.000MB -4.4%) vs baseline: +4.6%

✅ no-useragentvariant

Time: ✅ 39.573µs (SLO: <50.000µs 📉 -20.9%) vs baseline: +2.5%

Memory: ✅ 32.598MB (SLO: <34.000MB -4.1%) vs baseline: +4.9%

✅ obfuscation-no-query

Time: ✅ 41.048µs (SLO: <50.000µs 📉 -17.9%) vs baseline: +1.1%

Memory: ✅ 32.598MB (SLO: <34.000MB -4.1%) vs baseline: +4.9%

✅ obfuscation-regular-case-explicit-query

Time: ✅ 75.659µs (SLO: <90.000µs 📉 -15.9%) vs baseline: ~same

Memory: ✅ 33.010MB (SLO: <34.000MB -2.9%) vs baseline: +5.0%

✅ obfuscation-regular-case-implicit-query

Time: ✅ 76.337µs (SLO: <90.000µs 📉 -15.2%) vs baseline: +0.1%

Memory: ✅ 32.991MB (SLO: <34.000MB -3.0%) vs baseline: +4.8%

✅ obfuscation-send-querystring-disabled

Time: ✅ 154.431µs (SLO: <170.000µs -9.2%) vs baseline: ~same

Memory: ✅ 32.952MB (SLO: <34.500MB -4.5%) vs baseline: +4.7%

✅ obfuscation-worst-case-explicit-query

Time: ✅ 148.216µs (SLO: <160.000µs -7.4%) vs baseline: ~same

Memory: ✅ 32.991MB (SLO: <34.500MB -4.4%) vs baseline: +5.0%

✅ obfuscation-worst-case-implicit-query

Time: ✅ 154.441µs (SLO: <170.000µs -9.2%) vs baseline: -0.2%

Memory: ✅ 32.952MB (SLO: <34.500MB -4.5%) vs baseline: +4.7%

✅ useragentvariant_exists_1

Time: ✅ 39.280µs (SLO: <50.000µs 📉 -21.4%) vs baseline: -0.2%

Memory: ✅ 32.578MB (SLO: <34.000MB -4.2%) vs baseline: +5.0%

✅ useragentvariant_exists_2

Time: ✅ 40.483µs (SLO: <50.000µs 📉 -19.0%) vs baseline: -0.5%

Memory: ✅ 32.519MB (SLO: <34.000MB -4.4%) vs baseline: +4.6%

✅ useragentvariant_exists_3

Time: ✅ 39.851µs (SLO: <50.000µs 📉 -20.3%) vs baseline: ~same

Memory: ✅ 32.499MB (SLO: <34.000MB -4.4%) vs baseline: +5.0%

✅ useragentvariant_not_exists_1

Time: ✅ 39.350µs (SLO: <50.000µs 📉 -21.3%) vs baseline: ~same

Memory: ✅ 32.539MB (SLO: <34.000MB -4.3%) vs baseline: +4.5%

✅ useragentvariant_not_exists_2

Time: ✅ 39.235µs (SLO: <50.000µs 📉 -21.5%) vs baseline: -0.7%

Memory: ✅ 32.558MB (SLO: <34.000MB -4.2%) vs baseline: +4.7%

✅ telemetryaddmetric - 30/30

✅ 1-count-metric-1-times

Time: ✅ 3.126µs (SLO: <20.000µs 📉 -84.4%) vs baseline: +1.2%

Memory: ✅ 32.165MB (SLO: <34.000MB -5.4%) vs baseline: +5.0%

✅ 1-count-metrics-100-times

Time: ✅ 214.895µs (SLO: <250.000µs 📉 -14.0%) vs baseline: +0.5%

Memory: ✅ 32.067MB (SLO: <34.000MB -5.7%) vs baseline: +4.6%

✅ 1-distribution-metric-1-times

Time: ✅ 2.931µs (SLO: <20.000µs 📉 -85.3%) vs baseline: +0.7%

Memory: ✅ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +4.9%

✅ 1-distribution-metrics-100-times

Time: ✅ 192.060µs (SLO: <220.000µs 📉 -12.7%) vs baseline: +1.1%

Memory: ✅ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +4.9%

✅ 1-gauge-metric-1-times

Time: ✅ 2.094µs (SLO: <20.000µs 📉 -89.5%) vs baseline: +2.1%

Memory: ✅ 32.106MB (SLO: <34.000MB -5.6%) vs baseline: +4.8%

✅ 1-gauge-metrics-100-times

Time: ✅ 126.163µs (SLO: <150.000µs 📉 -15.9%) vs baseline: +1.5%

Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +4.9%

✅ 1-rate-metric-1-times

Time: ✅ 3.108µs (SLO: <20.000µs 📉 -84.5%) vs baseline: +0.5%

Memory: ✅ 32.027MB (SLO: <34.000MB -5.8%) vs baseline: +4.6%

✅ 1-rate-metrics-100-times

Time: ✅ 214.411µs (SLO: <250.000µs 📉 -14.2%) vs baseline: +1.3%

Memory: ✅ 32.106MB (SLO: <34.000MB -5.6%) vs baseline: +4.9%

✅ 100-count-metrics-100-times

Time: ✅ 21.766ms (SLO: <23.500ms -7.4%) vs baseline: +1.1%

Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +4.9%

✅ 100-distribution-metrics-100-times

Time: ✅ 1.991ms (SLO: <2.250ms 📉 -11.5%) vs baseline: -0.5%

Memory: ✅ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +4.9%

✅ 100-gauge-metrics-100-times

Time: ✅ 1.297ms (SLO: <1.550ms 📉 -16.3%) vs baseline: +0.5%

Memory: ✅ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +5.0%

✅ 100-rate-metrics-100-times

Time: ✅ 2.209ms (SLO: <2.550ms 📉 -13.4%) vs baseline: +0.3%

Memory: ✅ 32.106MB (SLO: <34.000MB -5.6%) vs baseline: +4.9%

✅ flush-1-metric

Time: ✅ 4.306µs (SLO: <20.000µs 📉 -78.5%) vs baseline: +0.3%

Memory: ✅ 32.106MB (SLO: <34.000MB -5.6%) vs baseline: +4.7%

✅ flush-100-metrics

Time: ✅ 182.079µs (SLO: <250.000µs 📉 -27.2%) vs baseline: -0.7%

Memory: ✅ 32.086MB (SLO: <34.000MB -5.6%) vs baseline: +4.5%

✅ flush-1000-metrics

Time: ✅ 2.239ms (SLO: <2.500ms 📉 -10.4%) vs baseline: +1.1%

Memory: ✅ 32.912MB (SLO: <34.500MB -4.6%) vs baseline: +5.1%

✅ tracer - 6/6

✅ large

Time: ✅ 30.523ms (SLO: <32.950ms -7.4%) vs baseline: +0.9%

Memory: ✅ 33.266MB (SLO: <34.500MB -3.6%) vs baseline: +4.5%

✅ medium

Time: ✅ 2.984ms (SLO: <3.200ms -6.8%) vs baseline: +0.9%

Memory: ✅ 31.968MB (SLO: <34.000MB -6.0%) vs baseline: +4.3%

✅ small

Time: ✅ 337.930µs (SLO: <370.000µs -8.7%) vs baseline: +0.8%

Memory: ✅ 31.870MB (SLO: <34.000MB -6.3%) vs baseline: +4.0%

ℹ️ Scenarios Missing SLO Configuration (9 scenarios)

The following scenarios exist in candidate data but have no SLO thresholds configured:

coreapiscenario-core_dispatch_listeners
coreapiscenario-core_dispatch_no_listeners
coreapiscenario-core_dispatch_with_results_listeners
coreapiscenario-core_dispatch_with_results_no_listeners
djangosimple-baseline
errortrackingdjangosimple-baseline
errortrackingflasksqli-baseline
flasksimple-baseline
flasksqli-baseline

emmettbutler

Looks good. I think some tests will probably have to change to match.

brettlangdon · 2025-10-14T17:09:08Z

LGTM, Out of curiosity, where httpbin_local was used before this PR ?

docker-compose was always httpbin-local, and I guess we named the gitlab service "httpbin_local" so suitespec needed to say "httpbin_local" for services needed to start, but if you wanted to test locally you needed to know to "docker compose up -d httpbin-local" instead of "httpbin_local".

brettlangdon · 2025-10-15T17:39:38Z

Apparently we cannot use httpbin_local as the gitlab alias because _ is not allowed... so we have to go the other way

ci: consistently use httpbin_local instead of httpbin-local

5152a7e

brettlangdon requested a review from a team as a code owner October 14, 2025 13:31

brettlangdon added the changelog/no-changelog A changelog entry is not required for this PR. label Oct 14, 2025

brettlangdon requested review from a team as code owners October 14, 2025 13:31

brettlangdon requested review from ZStriker19, juanjux and quinna-h October 14, 2025 13:31

brettlangdon enabled auto-merge (squash) October 14, 2025 13:31

dubloom approved these changes Oct 14, 2025

View reviewed changes

dubloom requested review from dubloom and removed request for dubloom October 14, 2025 13:49

emmettbutler approved these changes Oct 14, 2025

View reviewed changes

Merge branch 'main' into brettlangdon/httpbin

9435d1d

emmettbutler self-requested a review October 14, 2025 17:07

emmettbutler approved these changes Oct 14, 2025

View reviewed changes

brettlangdon added 2 commits October 15, 2025 13:51

use httpbin instead of httpbin_local

ca58667

Merge remote-tracking branch 'origin/main' into brettlangdon/httpbin

04f5e61

brettlangdon changed the title ~~ci: consistently use httpbin_local instead of httpbin-local~~ ci: consistently use httpbin instead of httpbin-local Oct 15, 2025

brettlangdon merged commit 8bb5536 into main Oct 16, 2025
1048 of 1054 checks passed

brettlangdon deleted the brettlangdon/httpbin branch October 16, 2025 00:17

ci: consistently use httpbin instead of httpbin-local #14856

ci: consistently use httpbin instead of httpbin-local #14856

Conversation

brettlangdon commented Oct 14, 2025

Description

Testing

Risks

Additional Notes

Uh oh!

github-actions bot commented Oct 14, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

dubloom left a comment

Choose a reason for hiding this comment

Uh oh!

github-actions bot commented Oct 14, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Bootstrap import analysis

Summary

Import time breakdown

Uh oh!

pr-commenter bot commented Oct 14, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Performance SLOs

✅ appsec

✅ exception-replay-enabled

✅ iast

✅ profiler

✅ resource-renaming

✅ span-code-origin

✅ tracer

✅ tracer-and-profiler

✅ tracer-dont-create-db-spans

✅ tracer-minimal

✅ tracer-native

✅ tracer-no-caches

✅ tracer-no-databases

✅ tracer-no-middleware

✅ tracer-no-templates

✅ errortracking-enabled-all

✅ errortracking-enabled-user

✅ tracer-enabled

✅ appsec-get

✅ appsec-post

✅ appsec-telemetry

✅ debugger

✅ iast-get

✅ profiler

✅ resource-renaming

✅ tracer

✅ tracer-native

✅ add-event

✅ add-metrics

✅ add-tags

✅ get-context

✅ is-recording

✅ record-exception

✅ set-status

✅ start

✅ start-finish

✅ start-finish-telemetry

✅ update-name

✅ add-event

✅ add-metrics

✅ add-tags

✅ get-context

✅ is-recording

✅ record-exception

✅ set-status

✅ start

✅ start-finish

✅ start-finish-telemetry

✅ start-finish-traceid128

✅ start-traceid128

✅ update-name

⚠️ context_with_data_listeners

✅ context_with_data_no_listeners

✅ get_item_exists

✅ get_item_missing

✅ set_item

github-actions bot commented Oct 14, 2025 •

edited

Loading

github-actions bot commented Oct 14, 2025 •

edited

Loading

pr-commenter bot commented Oct 14, 2025 •

edited

Loading