Skip to content

Fix GrpcWrapperAsyncIO.close for OpenTelemetry intercepted streams #684

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Fix GrpcWrapperAsyncIO.close for OpenTelemetry intercepted streams #684

wants to merge 1 commit into from

Conversation

r7sa
Copy link

@r7sa r7sa commented Jun 25, 2025

When OpenTelemetry intercepts grpc stream calls it returns generator.
So in GrpcWrapperAsyncIO.close in case of intercepted call, member self._stream_call has no method cancel but has method close.

Pull request type

Please check the type of change your PR introduces:

  • Bugfix
  • Feature
  • Code style update (formatting, renaming)
  • Refactoring (no functional changes, no api changes)
  • Build related changes
  • Documentation content changes
  • Other (please describe):

What is the current behavior?

Always called self._stream_call.cancel().

What is the new behavior?

self._stream_call.cancel() or self._stream_call.close() is called depending on which one exists.

Other information

Link to OpenTelemetry code:
https://github.com/open-telemetry/opentelemetry-python-contrib/blob/main/instrumentation/opentelemetry-instrumentation-grpc/src/opentelemetry/instrumentation/grpc/_client.py#L216

@r7sa
Update common_utils.py
9089d6c 
When OpenTelemetry intercepts grpc stream calls it returns generator. So in `GrpcWrapperAsyncIO.close` in case of intercepted call `self._stream_call` have no method `cancel` but have method `close`.
@github-actions GitHub Actions
Copy link

🌋 Here are results of SLO test for sync-table:

Operation Success Rate

---
config:
    xyChart:
        width: 1200
        height: 400
    themeVariables:
        xyChart:
            titleColor: "#222"
            backgroundColor: "#fff"
            xAxisLineColor: "#222"
            yAxisLineColor: "#222"
            plotColorPalette: "#FF7F0E,#1F77B4,#D62728,#2CA02C,#9467BD,#8C564B,#E377C2,#7F7F7F,#BCBD22,#17BECF"
---
xychart-beta
    title "operation_type=read"
    x-axis "Time, m" 0 --> 10
    y-axis "Success Rate, %" 89 --> 111
    line [100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,99.978,99.978,99.978,99.978,99.978,99.978,99.978,99.978,99.978,99.978,99.978,99.978,99.978,99.978,99.978,99.978,99.978,99.978,99.978,99.978,99.978,99.978,99.978,99.978,99.978,99.978,99.978,99.978,99.978,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100]
Loading 
---
config:
    xyChart:
        width: 1200
        height: 400
    themeVariables:
        xyChart:
            titleColor: "#222"
            backgroundColor: "#fff"
            xAxisLineColor: "#222"
            yAxisLineColor: "#222"
            plotColorPalette: "#FF7F0E,#1F77B4,#D62728,#2CA02C,#9467BD,#8C564B,#E377C2,#7F7F7F,#BCBD22,#17BECF"
---
xychart-beta
    title "operation_type=write"
    x-axis "	Time, m" 0 --> 10
    y-axis "Success Rate, %" 89 --> 111
    line [100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100]
Loading

Operations Per Second

---
config:
    xyChart:
        width: 1200
        height: 400
    themeVariables:
        xyChart:
            titleColor: "#222"
            backgroundColor: "#fff"
            xAxisLineColor: "#222"
            yAxisLineColor: "#222"
            plotColorPalette: "#FF7F0E,#1F77B4,#D62728,#2CA02C,#9467BD,#8C564B,#E377C2,#7F7F7F,#BCBD22,#17BECF"
---
xychart-beta
    title "operation_type=read"
    x-axis "Time, m" 0 --> 10
    y-axis "Operations" 804 --> 1096
    line [894.102,927.506,958.759,957.621,958.655,957.103,956.241,958.448,956.931,956.621,956.828,961.931,961.897,958.345,956.655,957.103,956.379,956.69,957.793,979.862,980.69,981.655,984.966,986.276,982.621,985.931,981.31,981.379,980.862,981.793,981.207,979.793,981.862,980.483,973.621,968.448,964.586,964.517,962.897,964.138,962.862,965.034,967.276,969.517,968.621,970,967.897,968.379,967.655,965.862,964.966,964.69,965.276,964.276,960.759,964.759,965.138,964.276,964.517,964.931,965.621,965.759,965.724,974.621,980.586,984.345,985.552,987.276,985.069,983.621,982.103,983.276,983.517,984,983.759,985.241,984.931,985.379,986.138,987.517,985.517,985.103,988.414,992.621,992.828,992.897,992.828,992.207,992.621,992.483,989.379,991.207,988.828,988.793,986.897,986.621,986.069,988.69,990,989.759,990.414,987.103,989.379,989.552,987.138,987.276,987.241,987.379,984.31,985.345,984.759,983.517,982.931,983.345,982.034,978.862,978.483,977.69,977.966,980.517,978.828,980.241,977.931,980.034,979.621,979.724,978.103,979.034,979.379,978.828,980.724,979.034,977.621,980.483,980.724,980.414,978.621,983.517,984.069,984.862,983.138,981.655,982.931,983.586,987.103,988.483,989.103,988.966,988.414,987,988.345,991,989.379,989.931,989.172,967.931,949.828,949.828,949.897,949.103,948.862,947.414,945.897,936.241,936.517,938.31,936.276,936.69,936.414,938.448,940.862,940.207,936.483,936.379,935.931,934.621,935.103,935.828,932.552,932.069,932.241,931.793,931.172,931.862,954.138,971.655,971.586,971.448,972.862,973.483,975.241,977.379,985.345,985.034,985.483,984.759,986.172,984.069,983.759,984.172,982.931,987.862,989,989.138,990.345,989.862,990.069,994.655,994.586,992.897,993,995.655,994.828,995.207,995.241,994.759,991.517,991.241,991.207,991.897,991.241,991.966,992.103,991.31,991.483,990.069,991.828,991.759,991.345,992.586,991.069,989.828,990.103,989.828,989.552,989.138,989.276,989.345,989.034,990.793,988.897,990.241,989.828,989.793,990.172,993.483,993.862,993.655,993.862,994.69,992.966,994.172,994.207,995,994.414,995.828,995.379,989.966,988.172,989.345,989.828,989.793,989.759,991.034,991.138,989.414,987.586,988.586,988,988,988,987.862,988.724,988.276,986.759,987.586,987.172,986.552,987.103,989.655,987.345,987.655,987.379,984,981.724,983.034,987.897,989.31,989,988.517,988.241,988.034,987.207,986.793,987,988.655,988.207,987.931,987.966,987.931,987.966,987.103,987.724,989.172,988.241,987.103,987.552,983.862,980.931,980,980.621,979.69,982.966,984.207,983.345,983.897,984,983.828,984.724,984.586,985.138,984.966,984.552,984.552,984.724,985.172,986.069,985,985,984.897,985.276,980.276,979.414,978.207,980.345,979.379,983.276,985.414,988.069,987.138,986.966,987.483,986.931,985.931,985.517,985.862,985.207,983.828,983.897,982.966,983.793,981.931,983,982.655,981.448,982.31,983.897,982.172,980.517,980.103,984.966,986.862,977.276,976.828,978.103,976.862,977.552,977.103,977.414,978.552,978.69,979.276,980.276,980.69,980.621,981.345,982.483,982.621,983.517,982.448,984.931,984.759,982.793,982.379,980.759,979.724,981.31,982.034,983,982.724,976.655,986.828,986.552,984.172,982.552,982.207,981.345,980.448,980.448,982.069,980.69,982.241,980.138,979.138,979.793,979,978.931,978.931,979.103,978.517,974.793,977.483,980,978.828,979.724,980.828,980,978.828,979.828,982.931,985,985.103,986.897,988.862,988.724,987.31,986.828,986.655,985.621,985.414,984.207,985.862,986.862,986.207,987.138,987.069,987.138,987.241,988.345,992.276,991.414,990.69,992.828,992.207,991.483,993.069,993.31,992.828,987.552,986.483,986.207,986.862,986.207,985.586,987.828,987.552,986.793,986.31,987.069,986.862,985.862,986.241,983.31,982.759,982.552,981.345,980.034,980.034,981.379,980.793,981.172,979.448,980.103,979.862,981.31,979.552,978.276,983.414,982.448,983.345,984.103,984.414,980.276,980.069,976.586,977.517,977.448,978.207,978.069,978.31,976.793,978.31,979.897,979.448,980.552,981.034,980.034,976.586,976.31,977.655,976.207,976.655,975.345,974.103,972.793,974.655,975.172,975.621,974.966,974.345,974.069,979.069,979.345,984.483,985.897,985.655,985.241,984.621,984.241,985.552,986.966,985.345,986.276,986.207,987.276,987.69,988.552,990.586,988.897,991.897,990.621,989.552,987.759,988.828,988.276,989,989.621,988.724,988.586,988.862,989.103,990.414,990.517,983.793,984.207,984.552,984.828,986,986.103,986.103,985.276,985.345,984.897,984.31,983.103,984.586,985.241,985.069,987.034,985.621,987.931,989.207,992.103,991.552,987.414,985.586,986.759,985.483,984.414,982.724,980.724,981.483,987.276,968.103,928.806]
Loading 
---
config:
    xyChart:
        width: 1200
        height: 400
    themeVariables:
        xyChart:
            titleColor: "#222"
            backgroundColor: "#fff"
            xAxisLineColor: "#222"
            yAxisLineColor: "#222"
            plotColorPalette: "#FF7F0E,#1F77B4,#D62728,#2CA02C,#9467BD,#8C564B,#E377C2,#7F7F7F,#BCBD22,#17BECF"
---
xychart-beta
    title "operation_type=write"
    x-axis "Time, m" 0 --> 10
    y-axis "Operations" 69 --> 103
    line [76.903,80.262,83.103,83.103,83.103,83.103,83.103,84.621,86.483,86.448,89.828,86.448,86.483,86.448,84,85.552,85.172,83.034,83.034,83.034,83.034,83.034,83.034,83.897,86.414,86.379,86.276,89.69,88.552,86.483,86.517,86.517,86.517,86.517,86.517,86.517,86.517,86.172,83.31,83.345,86.69,86.69,86.724,89.172,89.517,90.103,93.517,93.483,90.069,90.069,90.069,90.069,90.069,90.069,90.034,86.966,86.966,88.103,90.172,90.138,90.138,90.138,90.138,90.138,90.138,90.138,90.483,93.345,93.31,89.966,89.966,89.966,89.966,89.966,89.241,86.586,83.207,86.621,86.621,86.621,86.621,86.621,86.621,86.655,86.483,86.517,86.517,86.517,86.517,86.517,86.517,86.517,86.517,83.172,83.103,79.724,79.724,79.724,83.069,83.034,79.621,79.621,79.621,80.345,83,86.414,86.414,86.414,86.414,83.034,83.069,83.069,83.069,86.448,86.414,84.931,83.138,83.138,83.172,83.172,83.172,83.172,86.517,83.241,86.552,83.172,83.172,83.172,83.207,86.586,83.172,83.172,83.172,83.172,83.172,83.172,83.172,83.172,86.552,86.517,86.517,84.552,84.793,84.517,85.552,86.966,86.69,86.724,86.586,86.586,86.586,86.586,89.931,90,93.379,90.379,86.931,87.034,87.069,90.483,90.483,90.483,87.103,83.69,83.69,83.69,83.69,83.69,83.69,80.345,82.31,82.138,79,79.448,79.828,80.103,80.034,80.172,80.172,80.172,80.172,76.897,76.897,76.897,79.897,83.345,83.241,83.241,83.241,83.241,83.241,83.241,86.69,86.69,83.276,79.862,79.862,79.862,83.207,83.207,83.138,86.552,86.552,86.552,86.552,86.552,86.552,86.552,86.552,86.552,89.828,89.828,87.034,86.69,86.621,83.207,82.759,82.552,82.586,82.345,85.448,84.897,84.862,87.034,90.138,90.069,90.069,90.103,90.103,90.138,90.172,90,90.103,90,89.793,89.379,89.448,89.448,86.828,86.759,86.793,87.138,87.897,87.31,90.172,90.552,90.724,90.69,90.966,91.207,91.69,88.379,89.621,89.931,90,90,89.966,89.966,86.586,86.586,86.759,86.655,86.759,86.966,87.379,87.31,87.31,86.517,86.586,86.552,89,88.586,89.241,89.793,89.862,89.897,89.897,86.724,86.759,86.793,90.138,90.138,90.138,89.724,86.759,85.241,84.897,87.828,87.862,86.69,86.69,86.69,86.69,86.69,83.276,83.276,86.69,86.69,86.69,86.69,83.276,83.276,83.276,83.276,83.276,83.276,86.414,86.414,86.414,83.034,83,82.379,82.759,85.724,87.276,85,85.414,85.345,86.517,86.517,86.552,86.552,86.552,87.034,87,86.621,86.655,86.621,86.621,90.069,90.069,90.034,86.724,86.655,86.655,86.621,86.69,86.655,90.069,90.103,90.69,90.724,90.724,90.69,93.31,90.069,90.069,90.069,90.069,90.034,90.034,90.034,92.966,89.621,90.034,90,90.034,90.034,90,90,90.034,93.345,93.414,93.414,90.069,90.034,90.069,90.034,90.034,90.069,90.069,90.069,90.069,86.655,89.897,89.897,89.897,89.897,89.897,89.897,89.897,89.897,93.276,93.241,90.138,90.276,90.172,90,90.069,90.034,90.034,90.034,90.034,92.931,93.31,92.966,90.138,90.069,90,90,89.966,86.552,87.621,87.207,87.552,86.621,86.655,86.586,86.69,86.517,86.552,86.552,86.552,89.655,89.517,89.621,86.379,86.345,86.379,86.379,86.379,86.379,86.862,86.448,83.448,86.241,85.586,85.552,85.793,83.034,86.448,88.793,89.207,88.862,89.793,89.759,89.828,89.724,86.69,86.655,86.655,86.483,86.448,83.069,83.069,86.483,86.448,86.448,86.448,86.448,86.448,86.517,86.448,89.793,89.828,90.552,87.31,87.069,89.862,89.862,89.862,89.862,89.862,86.517,86.517,86.517,86.517,89.724,89.724,89.069,89.276,86.655,90.034,90.034,90.034,90.034,90.034,87.931,86.655,86.69,86.621,86.69,86.69,86.69,86.69,88.793,86.69,86.621,83.241,83.241,83.241,83.241,86.586,86.586,86.586,86.586,86.586,86.586,83.897,83.862,86.517,86.517,86.517,86.517,86.103,86.414,85.414,86.724,86.69,86.655,83.517,83.276,83.276,83.276,84.552,86.655,86.724,90.103,86.69,83.276,83.276,83.276,83.276,83.276,83.276,83.276,79.931,83.276,83.276,83.276,83.276,83.276,83.276,80.31,80.034,83.138,83.103,83.103,83.138,86.276,83.103,83.103,83.103,83.069,83.069,83.069,83.069,86.483,89.897,89.897,86.552,86.552,86.552,86.552,86.552,89.897,89.897,89.897,89.897,86.759,86.552,86.483,89.931,89.862,89.828,89.828,89.828,89.862,86.586,90,90,90,90,90,86.099]
Loading

95th Percentile Latency

---
config:
    xyChart:
        width: 1200
        height: 400
    themeVariables:
        xyChart:
            titleColor: "#222"
            backgroundColor: "#fff"
            xAxisLineColor: "#222"
            yAxisLineColor: "#222"
            plotColorPalette: "#FF7F0E,#1F77B4,#D62728,#2CA02C,#9467BD,#8C564B,#E377C2,#7F7F7F,#BCBD22,#17BECF"
---
xychart-beta
    title "operation_type=read"
    x-axis "Time, m" 0 --> 10
    y-axis "Latency, ms" 10 --> 20
    line [14.666,14.545,14.159,13.87,13.917,13.877,13.988,14.049,13.871,13.748,13.726,13.361,12.889,12.543,12.72,12.824,12.66,12.583,12.721,12.632,12.07,11.522,11.275,11.303,11.517,11.497,11.97,12.331,12.61,12.982,13.441,13.724,13.971,14.06,14.319,14.657,14.842,14.917,14.937,14.97,15.027,15.052,15.338,15.547,15.665,15.785,16.031,16.049,16.053,16.19,16.316,16.42,16.524,16.616,16.638,16.556,16.587,16.596,16.597,16.536,16.509,16.469,16.436,16.4,16.201,16.117,16.119,16.127,16.211,16.178,16.31,16.196,16.096,15.964,15.783,15.628,15.523,15.615,15.561,15.502,15.456,15.437,15.348,15.343,15.3,15.278,15.305,15.291,15.197,15.295,15.381,15.476,15.487,15.492,15.599,15.685,15.666,15.621,15.67,15.527,15.43,15.478,15.49,15.56,15.581,15.72,15.817,15.901,15.925,15.776,15.723,15.663,15.572,15.677,15.701,15.707,15.729,15.89,15.894,15.906,15.901,15.933,16.004,15.864,15.882,15.829,15.862,15.906,15.932,16.051,16.005,16.049,16.081,16.098,16.149,16.088,16.038,16.047,16.145,16.136,16.18,16.224,16.287,16.261,16.311,16.351,16.297,16.359,16.238,16.242,16.249,16.242,16.294,16.209,16.31,16.321,16.406,16.587,16.635,16.686,16.716,16.778,16.829,16.778,16.892,16.935,16.987,17.12,17.2,17.156,17.181,17.132,17.183,17.262,17.327,17.381,17.367,17.474,17.546,17.587,17.651,17.672,17.778,17.782,17.755,17.685,17.545,17.497,17.442,17.409,17.404,17.354,17.396,17.297,17.217,17.12,17.071,17.101,17.157,17.149,17.187,17.209,17.094,17.03,16.996,16.958,16.954,16.873,16.844,16.83,16.872,16.794,16.82,16.887,16.943,16.918,16.903,16.996,17.016,17.021,17.089,17.097,17.15,17.188,17.277,17.271,17.239,17.318,17.357,17.396,17.372,17.39,17.355,17.328,17.3,17.265,17.236,17.197,17.108,17.134,17.186,17.136,17.057,17,17.041,17.062,16.972,16.98,16.944,16.929,16.916,16.795,16.796,16.722,16.643,16.615,16.542,16.542,16.43,16.424,16.431,16.457,16.424,16.426,16.392,16.399,16.424,16.497,16.49,16.513,16.654,16.763,16.852,16.943,16.987,17.054,17.05,17.021,17.02,16.996,17.084,17.089,17.154,17.178,17.142,17.055,17.009,17.11,17.095,17.072,17.13,17.185,17.223,17.267,17.229,17.277,17.312,17.283,17.183,17.099,16.926,16.932,16.997,17.04,17.046,17.134,17.231,17.296,17.313,17.237,17.217,17.129,17.076,17.086,17.129,17.086,17.077,17.121,17.193,17.174,17.244,17.308,17.432,17.484,17.451,17.454,17.497,17.6,17.658,17.727,17.646,17.565,17.528,17.569,17.53,17.481,17.414,17.44,17.552,17.608,17.681,17.756,17.794,17.858,17.932,17.881,17.894,17.859,17.848,17.785,17.679,17.626,17.677,17.661,17.641,17.579,17.485,17.425,17.444,17.466,17.404,17.416,17.396,17.387,17.401,17.482,17.51,17.503,17.524,17.515,17.508,17.579,17.614,17.537,17.543,17.48,17.462,17.453,17.538,17.643,17.617,17.633,17.715,17.767,17.779,17.854,17.897,17.928,18.01,18.072,18.063,18.104,18.114,18.139,18.133,18.124,18.095,18.071,18.068,18.066,18.007,17.888,17.908,17.953,17.966,17.989,18.004,17.962,17.92,17.892,17.868,17.866,17.82,17.837,17.78,17.741,17.658,17.544,17.521,17.44,17.282,17.278,17.195,17.158,17.025,17.038,17.002,16.969,17,16.945,17.005,17.039,16.934,16.884,16.813,16.715,16.636,16.582,16.541,16.485,16.388,16.394,16.459,16.448,16.374,16.422,16.416,16.436,16.593,16.726,16.741,16.812,16.844,16.913,16.867,16.926,16.931,16.939,17.068,17.111,17.097,17.144,17.224,17.255,17.356,17.404,17.436,17.502,17.536,17.51,17.489,17.389,17.434,17.499,17.517,17.582,17.58,17.549,17.54,17.483,17.399,17.331,17.275,17.324,17.295,17.336,17.298,17.281,17.257,17.321,17.402,17.447,17.47,17.443,17.472,17.51,17.544,17.565,17.56,17.587,17.642,17.606,17.598,17.606,17.597,17.601,17.57,17.605,17.654,17.679,17.621,17.701,17.618,17.541,17.453,17.419,17.327,17.303,17.159,16.965,16.87,16.873,16.887,16.814,16.822,16.775,16.652,16.729,16.716,16.682,16.678,16.752,16.753,16.66,16.622,16.608,16.414,16.271,16.268,16.289,16.118,16.263,16.435,16.526,16.703,16.858,16.998,17.16,17.32,17.334,17.231,17.205,17.197,17.092,17.022,17.032,16.952,16.93,16.94,16.911,16.853,16.901,17,16.999,17.042,17.162,17.32,17.378,17.372,17.482,17.49,17.397,17.436,17.37,17.285]
Loading 
---
config:
    xyChart:
        width: 1200
        height: 400
    themeVariables:
        xyChart:
            titleColor: "#222"
            backgroundColor: "#fff"
            xAxisLineColor: "#222"
            yAxisLineColor: "#222"
            plotColorPalette: "#FF7F0E,#1F77B4,#D62728,#2CA02C,#9467BD,#8C564B,#E377C2,#7F7F7F,#BCBD22,#17BECF"
---
xychart-beta
    title "operation_type=write"
    x-axis "Time, m" 0 --> 10
    y-axis "Latency, ms" 14 --> 22
    line [18.705,18.612,18.51,18.492,18.492,18.469,18.374,18.329,18.253,18.209,18.126,17.921,17.639,17.58,17.759,17.829,17.625,17.488,17.741,17.862,17.566,17.239,17.01,16.989,16.95,17.064,17.504,17.57,17.793,18.033,18.309,18.418,18.664,18.763,18.897,19.082,19.359,19.362,19.369,19.393,19.367,19.364,19.428,19.422,19.488,19.48,19.617,19.614,19.649,19.746,19.764,19.808,19.892,19.956,19.958,19.899,19.974,19.967,19.921,19.885,19.895,19.809,19.781,19.753,19.655,19.43,19.439,19.43,19.532,19.557,19.623,19.628,19.614,19.525,19.536,19.408,19.451,19.47,19.43,19.442,19.443,19.418,19.417,19.467,19.458,19.441,19.419,19.369,19.363,19.463,19.52,19.608,19.661,19.713,19.77,19.811,19.822,19.758,19.718,19.661,19.656,19.682,19.72,19.71,19.708,19.721,19.743,19.79,19.839,19.817,19.853,19.798,19.712,19.71,19.636,19.684,19.734,19.804,19.717,19.693,19.679,19.669,19.651,19.644,19.662,19.662,19.667,19.692,19.688,19.655,19.646,19.657,19.641,19.578,19.586,19.558,19.519,19.495,19.45,19.348,19.317,19.364,19.348,19.365,19.342,19.373,19.334,19.413,19.349,19.353,19.34,19.337,19.279,19.215,19.211,19.186,19.19,19.332,19.34,19.282,19.295,19.328,19.394,19.35,19.352,19.291,19.225,19.298,19.374,19.446,19.406,19.32,19.324,19.332,19.35,19.317,19.14,19.17,19.093,19.027,18.958,19.049,19.173,19.165,19.131,19.086,18.903,18.96,18.954,18.911,18.858,18.858,18.779,18.602,18.595,18.58,18.558,18.652,18.629,18.656,18.763,18.818,18.7,18.534,18.462,18.409,18.44,18.392,18.295,18.268,18.178,17.911,17.903,17.935,18.173,18.202,18.203,18.346,18.237,18.22,18.219,18.345,18.452,18.448,18.455,18.426,18.344,18.373,18.373,18.406,18.4,18.552,18.606,18.682,18.754,18.784,18.793,18.796,18.854,18.883,18.974,18.914,18.897,18.748,18.727,18.772,18.658,18.604,18.663,18.623,18.542,18.575,18.556,18.522,18.462,18.369,18.298,18.444,18.41,18.398,18.351,18.386,18.31,18.256,18.126,18.103,18.134,18.139,18.25,18.295,18.395,18.458,18.502,18.564,18.47,18.592,18.607,18.542,18.608,18.67,18.665,18.704,18.801,18.828,18.873,18.893,18.774,18.787,18.629,18.523,18.614,18.653,18.674,18.763,18.788,18.957,19.012,19,18.891,18.837,18.816,18.835,18.938,18.951,18.859,19.034,19.014,19.036,19.086,19.103,19.129,19.008,18.983,18.921,18.889,18.912,18.97,19.092,19.166,19.109,19.174,19.196,19.26,19.269,19.14,19.061,19.01,19.062,19.076,18.992,18.847,18.593,18.571,18.743,18.65,18.628,18.578,18.505,18.577,18.518,18.598,18.64,18.714,18.799,18.752,18.687,18.603,18.451,18.31,18.119,17.953,17.98,17.964,17.969,17.926,17.869,17.751,17.617,17.564,17.578,17.576,17.427,17.023,16.74,16.669,16.809,16.944,16.938,16.988,17.08,17.128,17.187,17.271,17.266,17.094,16.951,16.93,16.841,17.038,17.132,16.85,16.93,17.037,17.252,17.317,17.631,17.938,18.205,18.422,18.606,18.786,19.01,19.07,19.1,19.07,19.063,19,18.963,19.024,19.056,19.073,19.03,19.04,19.197,19.261,19.376,19.442,19.521,19.627,19.598,19.622,19.622,19.581,19.512,19.402,19.25,19.216,19.135,19.073,18.909,18.675,18.594,18.4,18.391,18.379,18.48,18.542,18.405,18.355,18.297,18.244,18.275,18.19,18.194,18.053,17.916,17.735,17.53,17.561,17.272,17.156,16.969,17.108,17.252,17.176,16.98,16.815,16.582,16.582,17.14,17.533,17.945,17.934,17.943,17.715,17.668,17.637,17.55,17.539,17.555,17.341,17.133,17.218,17.298,17.623,17.785,17.859,17.92,18.077,18.07,18.179,18.157,18.182,18.286,18.372,18.504,18.647,18.768,18.696,18.454,18.183,18.008,17.86,17.784,17.55,17.451,17.401,17.587,17.611,17.83,18.081,18.115,18.056,17.771,17.692,17.631,17.642,17.632,17.668,17.761,17.856,17.726,17.863,17.992,17.979,17.888,17.852,17.942,18.151,18.38,18.525,18.641,18.694,18.743,18.822,18.864,18.89,18.852,18.834,18.797,18.702,18.672,18.702,18.578,18.61,18.59,18.519,18.586,18.551,18.453,18.527,18.628,18.637,18.644,18.742,18.78,18.642,18.569,18.553,18.485,18.51,18.627,18.802,18.848,18.849,18.769,18.814,18.857,18.905,19.007,19.072,19.165,19.233,19.197,19.222,19.176,19.097,19.145,19.138,19.16,19.079,19.088,19.077,18.966,18.943,19.001,19.065,19.137,19.198,19.213,19.236,19.181,19.122,19.094,19.094]
Loading

@github-actions GitHub Actions
Copy link

🌋 Here are results of SLO test for sync-query:

Operation Success Rate

---
config:
    xyChart:
        width: 1200
        height: 400
    themeVariables:
        xyChart:
            titleColor: "#222"
            backgroundColor: "#fff"
            xAxisLineColor: "#222"
            yAxisLineColor: "#222"
            plotColorPalette: "#FF7F0E,#1F77B4,#D62728,#2CA02C,#9467BD,#8C564B,#E377C2,#7F7F7F,#BCBD22,#17BECF"
---
xychart-beta
    title "operation_type=read"
    x-axis "Time, m" 0 --> 10
    y-axis "Success Rate, %" 0 --> 111
    line [100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,99.947,98.163,97.519,96.949,96.408,95.912,95.288,94.701,94.125,93.486,92.977,92.37,91.777,91.205,90.59,90.024,89.472,88.858,88.263,87.624,87.077,86.472,85.876,85.325,84.745,84.048,83.466,82.867,82.211,81.706,83.299,83.424,83.485,83.479,83.478,83.516,83.584,83.546,83.529,83.514,83.566,83.596,83.542,83.58,83.583,83.518,83.543,83.523,83.477,83.391,83.384,83.34,83.288,83.229,83.183,83.078,83.117,83.113,83.093,83,82.99,82.129,79.879,79.785,79.798,79.733,79.759,79.803,79.723,79.614,79.619,79.609,79.547,79.46,79.415,79.347,79.325,79.344,79.266,79.204,79.232,79.156,79.178,79.189,79.192,79.065,79.04,79.008,78.981,78.964,79.849,82.074,82.081,82.024,81.995,81.978,81.96,81.966,82.008,81.915,81.945,81.951,82.046,82.111,82.156,82.106,82.061,82.163,82.178,82.181,82.219,82.171,82.185,82.228,82.285,82.311,82.282,82.319,82.293,82.201,82.266,81.811,79.732,79.679,79.643,79.55,79.566,79.611,79.702,79.644,79.585,79.524,79.469,79.416,79.425,79.42,79.407,79.471,79.415,79.39,79.379,79.371,79.376,79.361,79.257,79.269,79.23,79.26,79.28,79.23,79.72,81.684,81.751,81.768,81.781,81.724,81.711,81.638,81.621,81.668,81.663,81.673,81.635,81.616,81.686,81.724,81.635,81.701,81.622,81.683,81.663,81.597,81.542,81.564,81.579,81.546,81.516,81.562,81.57,81.533,81.486,81.466,81.486,81.546,81.476,81.47,81.513,81.485,81.477,81.401,81.431,81.519,81.534,81.528,81.412,81.466,81.437,81.481,81.443,81.434,81.476,81.505,81.513,81.456,81.43,81.398,81.392,81.344,81.317,81.318,81.337,81.308,81.225,81.305,81.273,81.291,81.306,81.311,81.378,81.313,81.332,81.332,81.221,81.22,81.181,81.06,81.085,81.073,81.048,81.018,81.011,81.053,81.089,81.105,81.088,81.087,81.118,81.122,81.169,81.19,81.212,81.245,81.225,81.214,81.228,81.273,81.246,81.208,81.247,81.2,81.209,81.255,81.344,81.305,81.434,81.441,81.427,81.462,81.517,81.589,81.572,81.63,81.68,81.663,81.627,81.59,81.562,81.5,81.489,81.474,81.51,81.562,81.517,81.383,81.304,81.3,81.31,81.299,81.296,81.214,81.208,81.18,81.224,81.167,81.164,81.118,81.048,81.004,80.921,80.939,80.854,80.826,80.868,80.853,80.88,80.94,80.978,80.951,80.926,80.942,80.867,80.926,80.932,80.943,80.975,80.918,80.876,80.864,80.938,80.955,80.95,80.967,81.012,81.008,81.026,81.057,81.094,81.093,81.042,81.059,81.095,81.098,81.156,81.195,81.141,81.185,81.152,81.222,81.248,81.315,81.289,81.344,81.423,81.422,81.457,81.5,81.533,81.462,81.423,81.358,81.388,81.39,81.377,81.444,81.429,81.454,81.436,81.452,81.44,81.375,81.354,81.341,81.276,81.268,81.216,81.237,81.205,81.188,81.111,81.192,81.2,81.158,81.198,81.216,81.247,81.227,81.285,81.381,81.439,81.446,81.374,81.388,81.287,81.291,81.194,81.204,81.176,81.186,81.282,81.339,81.339,81.413,81.44,81.442,81.422,81.338,81.3,81.309,81.342,81.361,81.348,81.176,81.153,81.119,81.09,81.044,81.036,81.055,80.894,80.985,80.989,81.039,81.064,81.13,81.118,81.098,81.083,80.964,80.92,80.915,80.875,80.884,80.867,80.921,81.033,81.021,81.048,80.952,80.884,80.873,80.986,81.024,81.068,81.116,81.15,81.12,81.066,81.146,81.075,81.07,81.123,81.105,81.08,81.104,81.131,81.095,81.161,81.135,81.19,81.138,81.152,81.198,81.13,81.059,81.12,81.106,81.042,81.037,81.055,81.038,81.091,81.063,81.062,81.096,81.087,81.069,81.139,81.194,81.132,81.089,81.088,81.091,81.087,81.101,81.092,81.069,81.103,81.066,81.098,81.022,80.967,81.057,81.121,81.032,81.049,81.08,81.127,81.105,81.136,81.075,81.019,80.926,80.89,80.866,80.925,80.922,80.906,81.008,81.04,81.055,81.032,81.066,81.061,81.072,81.164,81.174,81.16,81.133,81.174,81.279,81.213,81.116,81.172,81.183,81.264,81.269,81.276,81.272,81.311,81.362,81.406,81.43,81.49,81.45,81.37,81.341,81.298,81.21,81.254,81.289,81.268,81.268,81.368,81.282,81.259,81.312,81.286,81.308,81.247,81.232,81.255,81.229,81.205,81.168,81.117,81.15,81.167,81.114,81.107,81.183,81.157,81.116,81.139,81.19,81.209,81.243,81.254,81.204,81.188,81.177,81.171,81.091,81.104,81.111,81.021,81.083,81.074,81.066,81.126,81.179,81.185,81.193,81.188,81.275,81.258,81.209,81.258,81.267,81.047,81.106,81.117,81.089,81.02,81.004,80.408,81,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0]
Loading 
---
config:
    xyChart:
        width: 1200
        height: 400
    themeVariables:
        xyChart:
            titleColor: "#222"
            backgroundColor: "#fff"
            xAxisLineColor: "#222"
            yAxisLineColor: "#222"
            plotColorPalette: "#FF7F0E,#1F77B4,#D62728,#2CA02C,#9467BD,#8C564B,#E377C2,#7F7F7F,#BCBD22,#17BECF"
---
xychart-beta
    title "operation_type=write"
    x-axis "	Time, m" 0 --> 10
    y-axis "Success Rate, %" 0 --> 111
    line [100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,99.96,99.919,99.922,99.921,99.918,99.918,99.918,99.918,99.918,99.918,99.921,99.921,99.918,99.918,99.918,99.917,99.916,99.916,99.917,99.917,99.917,99.917,99.917,99.917,99.92,99.92,99.92,99.92,99.917,99.959,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,99.879,99.877,99.877,99.878,99.881,99.881,99.881,99.88,99.88,99.881,99.881,99.881,99.881,99.881,99.881,99.878,99.876,99.876,99.877,99.881,99.881,99.881,99.886,99.886,99.886,99.886,99.883,99.881,99.88,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0]
Loading

Operations Per Second

---
config:
    xyChart:
        width: 1200
        height: 400
    themeVariables:
        xyChart:
            titleColor: "#222"
            backgroundColor: "#fff"
            xAxisLineColor: "#222"
            yAxisLineColor: "#222"
            plotColorPalette: "#FF7F0E,#1F77B4,#D62728,#2CA02C,#9467BD,#8C564B,#E377C2,#7F7F7F,#BCBD22,#17BECF"
---
xychart-beta
    title "operation_type=read"
    x-axis "Time, m" 0 --> 10
    y-axis "Operations" 15 --> 722
    line [604.667,626.061,647.207,648.379,648.69,650.207,649.345,649.138,650.552,651.483,651.379,651.379,651.034,650.483,651.138,653.31,653.655,653.276,652.379,651.931,651.69,651,654.379,653.621,652.241,654.103,653.069,643.897,640.655,639.759,638.345,635.241,633.724,631.828,629.241,630.966,627.517,624.103,622.759,621.414,622.207,621.517,619.034,617.138,613.759,611.862,611.586,610.759,609.621,608.138,606.034,600.31,598.966,598.552,598.966,598.448,605.172,605.793,606.759,606.138,610.897,610,610,610.276,606.276,608.241,608.931,608.345,611.172,608.793,608.069,609.448,609.966,609.828,610.241,609.759,609.103,608.31,609.103,609.414,609.793,610.103,612.931,610.552,610.862,611.759,612.207,604.517,603.241,599.586,600.31,603.483,603.069,603.552,602.172,602.517,602.483,598.31,598.69,601,600.552,600.069,599.586,600.655,600.379,599.414,600.069,598.207,597.69,597.172,596.586,592.966,591.931,591.345,590.759,591.931,599.621,600.172,600.793,599.276,595.828,595.448,594.069,596.379,595.862,594.897,595.483,595.138,592.517,592.552,591.724,591.414,588.379,588.069,588.586,587.31,587.414,587.172,588.034,587.138,586.69,589.897,588.931,588,586.759,584.69,584.897,579.172,576.586,577.103,577.793,579.034,577.483,578.586,579.966,580.517,582.241,583.034,583.31,582.966,584.897,585.448,585.724,588.414,591.31,592.621,593.31,592.069,594.207,595.138,592.966,593.966,594.69,594.207,596.448,600,606,608.862,610.345,611.103,611.724,612.828,613.517,614.448,616.345,615.483,616.241,616,616.793,615.966,616.448,616.793,615.69,614.517,614.69,615.207,619.448,617.034,617.448,616.862,618.31,618.69,618.621,617.172,614.828,613.586,614.828,612.483,611.103,610.655,609.276,608.69,609.759,609,608.931,606.621,606.862,609.759,611.552,611.172,611.448,611.724,613,613.345,615.241,613.655,617.276,618.069,619.276,619.966,620.034,621.931,627.276,627.897,630.31,631.448,633.552,635.517,640.241,641.517,641.897,641.207,640.448,641.345,644.034,644.931,646.517,645.414,647.103,647.621,647.379,647.069,648.103,647.31,649,648.517,649.207,649.172,648.759,649.31,649.276,646.897,647.759,649.345,648.414,650.069,650.448,647.724,648.69,649.414,650.103,651.483,651.448,650.862,650.759,648.586,652,651.759,653.034,652.414,653.414,654.207,653.897,652.345,652.586,654.793,655.862,654.172,655.759,655.552,654.241,653.69,651.586,651.448,650.138,650.345,649.552,651.207,651.103,649.759,649.034,649.276,649.241,649.966,649.69,645.759,646.448,644.759,645.172,646.897,646.034,647.379,647.172,645.862,643.241,642.931,645.483,645.103,646.69,647.621,647.448,647.31,647.724,646.793,646.138,649.724,647.931,648.103,647.759,648.138,647.414,647.828,647.483,647.103,648.517,647.483,648.931,649.517,650.138,649.655,648.621,649.483,650.207,650.552,649,649.379,650.069,648.552,648.69,648.586,648.931,649.345,652.586,652.448,648.931,648.862,648.517,649.138,649.655,650,651.034,653.483,653.724,651.966,651.724,651.655,650.69,646.862,646.966,646.138,644.69,647.414,646.241,647.724,645.793,644.31,644.483,646.069,645.69,646.138,645.448,642.31,642.517,642.276,641.138,641.69,643.621,641.828,643.724,641.966,638.621,638.483,639.552,638.759,639.448,641.172,641.31,641.241,641.828,641.586,639.931,641.931,641.897,642.966,643.483,643.621,640.828,641.517,639.69,639.379,639.793,638.966,641.517,641.103,639.276,636.966,637.448,634.379,633.586,633,632.207,631.414,635.31,633.241,631.31,631.276,631.207,630.345,630.793,629.172,626.586,628.655,627.069,625.483,624.966,624.621,624.207,624.31,624.138,623.552,626.483,623.931,624.621,625.103,625.034,625.034,626.586,627.483,628.207,632,632.034,628.828,629.241,629.517,629.345,629.172,629.655,629.621,629.862,630.862,628.103,628.552,630.379,630.448,631.552,632.172,636.862,638.414,638.138,636.828,639.241,639.138,640.241,643.897,645.414,645.207,645.552,646.621,642.931,643.897,645.966,646.448,650.138,649.828,648.793,650.966,650.759,651.586,651.793,653.379,654.724,654.276,655.276,655.103,655.828,652.655,651.31,652.586,651.69,650.276,651.586,651.379,648.793,648.586,648.379,649.931,650,650.655,650.69,649.69,649.69,646.724,647.448,649.103,646.931,647.793,647.552,647.793,646,644.552,647.862,646.034,646.655,645.897,645.655,645.414,644.793,645.138,645.966,645.793,645.828,645.241,644.207,644.621,642.276,641.828,643.138,643.966,643.655,642.828,642.448,644.793,643.862,643.241,641.793,640.034,639.69,639.31,639.069,635,635.345,633.828,632.759,633.138,634.552,635.172,634.103,633.414,631.31,631,630.759,631.103,631.31,631.207,630.241,627.828,626.414,624.69,624,623.828,621,623.966,624.517,621,600.483,578.897,557.655,536.517,514.966,493.448,472.207,451.345,428.897,406.138,383.862,362.759,339.966,319.207,297.31,275.862,253.897,231.586,210.483,189.414,168.655,147.103,126.552,105.759,84.483,63.172,38.897,17.241]
Loading 
---
config:
    xyChart:
        width: 1200
        height: 400
    themeVariables:
        xyChart:
            titleColor: "#222"
            backgroundColor: "#fff"
            xAxisLineColor: "#222"
            yAxisLineColor: "#222"
            plotColorPalette: "#FF7F0E,#1F77B4,#D62728,#2CA02C,#9467BD,#8C564B,#E377C2,#7F7F7F,#BCBD22,#17BECF"
---
xychart-beta
    title "operation_type=write"
    x-axis "Time, m" 0 --> 10
    y-axis "Operations" 0 --> 103
    line [85.499,88.708,91,90.862,90.862,90.759,91.414,90.759,90.862,90.172,90.172,90.103,90.138,90.448,90.724,88.966,89.552,89.448,90.138,90.138,90.103,90.034,86.586,87.138,86.931,86.966,84.724,83.517,84.931,84.897,84.897,84.483,84.448,84.552,84.793,82.103,83.241,83.103,83.793,82.379,80.414,80.414,80.414,80.517,82.276,82.172,80.379,80.414,80.414,80.414,80.448,83.862,83.793,83.897,81.828,83.931,85.69,85.69,85.655,85.759,82.793,83.31,83.379,83.379,86.759,86.759,86.759,86.759,84.897,86.862,86.828,86.828,86.828,86.828,86.552,88.207,87.724,87.586,87.414,87.207,86.897,86.897,83.931,86.69,86.759,86.828,86.69,86.724,85.621,88.517,87,83.966,83.793,83.655,83.621,83.69,83.69,86.897,86.897,84.034,83.966,83.69,83.586,82.069,82.172,82.621,82.759,82.931,83.138,83.448,83.483,86.414,86.621,86.552,86.621,83.483,83.517,84.655,85.138,86.655,89,89.276,89.069,86.759,86.724,86.724,86.793,85.172,86.31,86.414,86.69,86.793,90.207,90.207,90.207,90.207,90.207,89.552,86.931,86.931,86.931,83.517,83.517,83.517,86.759,86.759,86.759,86.759,85.483,84.379,84.276,84.621,86.966,86.931,86.793,86.552,86.103,87.034,87.034,87.034,87.034,87.034,87.034,84.793,83.69,83.69,84.345,86.966,86.966,86.966,90.379,90.379,90.379,90.379,88.793,87,86.276,87.552,89.103,88.862,88.759,88.345,87.586,87.276,87.138,89.138,87.138,87.276,87.103,86.621,86.621,86.621,88.862,90,90,90.034,88.241,88.207,88,87.379,87.414,87.034,86.828,88.448,90.172,90.828,90.759,91.069,91.31,91.414,91.828,92.379,90.276,90.034,90.138,92.517,92.379,89.483,88.586,88.034,88.103,88.103,87.931,87.793,86.897,88.655,88.552,88.69,89.241,89.172,89.586,89.724,86.31,86.379,86.448,86.517,86.448,86.448,83.069,83.103,83.31,85.862,86.483,86.448,86.862,86.276,87.103,87.897,88.483,88.414,88.414,88.241,88.172,88.897,86.897,86.345,86.448,86.517,86.552,86.517,86.586,89.207,89,86.69,86.69,85.034,84.828,88.207,87.276,86.931,87.069,87,86.793,86.759,87.379,89.552,86.759,86.724,86.724,86.724,87.034,87.241,87.379,89.414,89.552,86.724,86.724,86.724,86.724,86.724,87.483,87.69,90,90,91.655,91.862,91.862,90,89.862,89.724,89.793,90,90.034,89.966,90.034,93.414,93.414,93.414,93.414,91.414,91.138,90.138,90.172,90.724,93.517,93.517,92.828,91.517,90.138,90.172,90.172,90.172,90.172,90.172,89.966,86.793,89.586,90.069,90.069,90.069,90.069,90.069,90.069,90.069,90.069,90.069,90.069,89.966,89,89.276,90.276,90.276,90.276,90.276,90.276,89.069,88.897,90.31,90.276,90.276,90.276,89.586,86.931,87.138,90.31,90.31,90.31,90.31,90.31,90.31,89.828,86.931,86.966,86.966,86.966,86.966,87.069,90.034,90.034,90.034,89.966,86.586,86.586,86.586,88.483,89.966,89.931,86.586,86.586,86.621,87.276,89.966,89.69,89.793,89.069,88.241,86.552,86.517,83.138,83.621,86.517,86.483,86.483,86.379,83.793,83.103,83.138,83.138,83.138,83.034,85.276,83.207,83.138,82.379,82.207,81.724,84.759,84.655,84.69,83.621,83.138,83.379,79.897,80.586,81.414,83.103,83.138,86.517,86.517,86.517,86.517,86.517,83.276,85.862,86.552,86.517,86.517,86.517,86.655,87.793,89.724,86.586,87.345,87.517,88,88.31,88.414,88.345,89.448,89.897,86.724,90.103,90.172,90.069,90.069,90.069,90.069,90.069,90,86.793,86.759,90.138,89.862,89.552,89.69,89.724,89.586,89.241,89.034,89.069,91.655,91.655,91.241,90.414,90.379,90.379,86.966,86.103,85.966,89,86.862,86.759,86.828,83.448,83.448,83.448,83.448,83.517,86.724,86.759,84.172,83.621,80.517,80.379,80.345,80.483,80.828,81.034,81.138,80.31,79.862,80.138,80.655,80.345,79.759,83.138,84.069,83.828,83.862,85.69,84.69,84.759,87.828,87.897,87.138,86.724,86.69,86.655,86.655,88.586,89.138,92.517,92.172,92.138,92.172,90.759,90.138,90.172,91.621,92.069,88.828,89.138,89.483,90.103,90.138,90.069,90.379,89.966,88.69,88.552,88.552,88.862,88.793,89.552,89.931,88.897,88.241,86.828,87.793,87.586,87.552,84.517,84.552,84.517,85.931,86.552,86.517,86.517,86.517,89.897,89.448,89.483,89.034,87.862,86.586,86.621,86.931,88.621,88.724,88.586,88.414,87.862,86.759,86.793,87.862,88.621,90.034,89.69,90.172,90.241,93.552,90.138,89.483,86.759,83.31,79.862,76.414,72.966,69.517,66.517,63.034,60,57.724,55.552,52.138,48.931,45.379,43,39.655,36.379,33.483,31.138,27.69,24.241,20.724,17.276,13.828,10.379,6.931,3.552,3.517,0.724]
Loading

95th Percentile Latency

---
config:
    xyChart:
        width: 1200
        height: 400
    themeVariables:
        xyChart:
            titleColor: "#222"
            backgroundColor: "#fff"
            xAxisLineColor: "#222"
            yAxisLineColor: "#222"
            plotColorPalette: "#FF7F0E,#1F77B4,#D62728,#2CA02C,#9467BD,#8C564B,#E377C2,#7F7F7F,#BCBD22,#17BECF"
---
xychart-beta
    title "operation_type=read"
    x-axis "Time, m" 0 --> 10
    y-axis "Latency, ms" 0 --> 48
    line [40.88,40.936,40.813,40.764,40.746,40.619,40.646,40.702,40.736,40.688,40.705,40.747,40.757,40.877,40.947,40.884,40.898,40.863,40.962,41.012,40.961,40.973,40.747,40.781,40.839,40.758,40.681,40.461,40.572,40.684,40.714,40.844,40.927,41.099,41.279,41.221,41.35,41.442,41.524,41.528,41.522,41.591,41.673,41.782,41.91,41.965,41.944,41.958,42.02,42.09,42.191,42.462,42.6,42.604,42.609,42.699,42.752,42.773,42.719,42.761,42.586,42.575,42.52,42.501,42.655,42.593,42.57,42.561,42.513,42.542,42.523,42.464,42.384,42.413,42.402,42.452,42.508,42.57,42.557,42.542,42.522,42.43,42.33,42.445,42.483,42.477,42.52,42.532,42.346,42.337,42.219,41.954,41.842,41.711,41.609,41.444,41.292,41.292,41.125,40.908,40.742,40.611,40.466,40.211,40.08,39.905,39.67,39.561,39.39,39.212,39.024,39.036,38.89,38.633,38.431,37.899,37.749,38.032,38.127,38.244,38.49,38.504,38.494,38.265,38.257,38.301,38.311,38.3,38.341,38.353,38.398,38.395,38.609,38.569,38.514,38.507,38.557,38.495,38.401,38.505,38.548,38.25,38.253,38.317,38.473,38.603,38.545,38.665,38.484,38.373,38.374,38.364,38.523,38.501,38.38,38.322,38.297,38.414,38.387,38.462,38.428,38.404,38.428,38.285,38.13,37.995,38.065,38.194,38.112,38.107,38.326,38.321,38.394,38.439,38.274,38.08,37.934,38.145,38.18,38.116,38.026,37.991,37.959,37.943,37.891,37.967,37.78,37.837,37.758,37.755,37.775,37.785,37.862,37.979,38.08,37.985,37.672,37.778,37.78,37.744,37.695,37.617,37.601,37.7,37.835,37.928,37.809,37.93,37.978,38.072,38.167,38.165,38.108,38.172,38.258,38.492,38.456,38.248,38.084,38.075,38.069,38.063,38.016,37.853,37.783,37.971,37.761,37.664,37.669,37.656,37.592,37.545,37.188,37.265,37.107,37.058,36.871,36.824,36.487,36.385,36.438,36.484,36.527,36.343,36.168,36.111,36.075,36.219,36.111,36.05,36.013,36.008,36.121,36.171,36.046,36.096,36.18,36.247,36.226,36.133,36.135,36.376,36.273,36.115,36.272,36.217,36.198,36.457,36.38,36.282,36.292,36.11,36.118,36.196,36.133,36.275,36.095,36.119,35.912,35.99,35.921,35.801,35.787,35.926,35.824,35.501,35.407,35.502,35.548,35.572,35.678,35.727,36.057,35.924,36.084,36.058,36.025,35.87,35.882,35.895,36.018,36.045,36.009,36.044,36.122,36.343,36.397,36.57,36.519,36.413,36.41,36.406,36.356,36.596,36.814,36.856,36.768,36.677,36.504,36.343,36.292,36.26,36.307,36.338,36.331,36.085,36.378,36.377,36.462,36.413,36.381,36.394,36.353,36.304,36.211,36.151,36.081,36.109,36.017,36.098,36.036,36.019,35.866,35.848,35.89,35.831,35.823,35.969,36.017,36.078,36.001,35.964,35.77,35.825,36.146,36.042,36.035,35.964,35.932,35.881,35.893,35.758,35.777,35.882,35.904,36.028,36.024,36.267,36.204,36.422,36.323,36.213,36.266,36.265,36.371,36.457,36.481,36.328,36.292,36.365,36.387,36.553,36.591,36.534,36.618,36.613,36.519,36.567,36.408,36.439,36.719,36.707,36.732,36.744,36.527,36.476,36.466,36.536,36.517,36.63,36.761,36.636,36.565,36.468,36.441,36.399,36.638,36.637,36.643,36.618,36.58,36.53,36.34,36.423,36.456,36.565,36.602,36.938,36.985,36.891,36.966,36.922,36.653,36.845,36.948,36.936,36.878,36.833,36.877,36.897,37.098,36.974,37.011,37.088,37.208,37.25,37.309,37.317,37.386,37.337,37.137,37.321,37.268,37.297,37.394,37.384,37.302,37.194,37.155,36.83,36.937,37.144,37.156,37.054,37.139,37.204,37.227,37.154,37.173,37.095,37.272,37.247,37.18,37.124,37.033,36.928,36.595,36.436,36.437,36.606,36.406,36.389,36.365,35.969,35.926,35.882,35.897,35.851,36.196,36.042,35.927,35.84,35.623,35.597,35.622,35.439,35.52,35.493,35.48,35.395,35.427,35.507,35.303,35.331,35.331,35.514,35.646,35.593,35.698,35.889,35.803,35.769,36.038,36.057,36.011,35.937,35.999,36.013,35.989,36.072,36.053,36.28,36.237,36.189,36.371,36.346,36.261,36.23,36.229,36.32,36.047,36.251,36.186,36.338,36.464,36.417,36.436,36.351,36.254,36.234,36.246,36.354,36.393,36.509,36.695,36.696,36.584,36.515,36.621,36.756,36.8,36.622,36.654,36.651,36.671,36.832,36.862,36.966,36.968,37.282,37.244,37.413,37.41,37.351,37.319,37.442,37.43,37.485,37.567,37.672,37.637,37.657,37.587,37.591,37.682,37.771,37.91,37.905,37.917,37.895,38.056,37.778,37.764,37.672,37.612,37.617,37.601,37.562,37.468,37.478,37.366,37.246,37.285,37.385,37.318,37.379,37.517,37.53,37.344,37.273,37.18,37.255,37.033,36.745,36.534,36.241,35.987,35.115,34.423,33.222,36.264,32.955,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0]
Loading 
---
config:
    xyChart:
        width: 1200
        height: 400
    themeVariables:
        xyChart:
            titleColor: "#222"
            backgroundColor: "#fff"
            xAxisLineColor: "#222"
            yAxisLineColor: "#222"
            plotColorPalette: "#FF7F0E,#1F77B4,#D62728,#2CA02C,#9467BD,#8C564B,#E377C2,#7F7F7F,#BCBD22,#17BECF"
---
xychart-beta
    title "operation_type=write"
    x-axis "Time, m" 0 --> 10
    y-axis "Latency, ms" 0 --> 49
    line [41.103,40.989,40.982,40.931,40.888,40.877,40.808,40.92,41.018,41.004,40.85,40.974,40.847,40.946,40.961,41.093,41.046,40.971,41.007,41.152,41.197,41.08,41.076,41.189,41.375,41.279,41.388,41.724,41.684,41.746,42.03,42.164,42.114,42.192,42.6,42.646,42.715,42.853,43.036,43.107,43.137,43.302,43.435,43.556,43.531,43.474,43.568,43.574,43.767,43.853,43.961,43.884,43.878,43.94,43.915,43.903,43.578,43.631,43.572,43.514,43.486,43.506,43.526,43.333,43.48,43.371,43.404,43.319,43.307,43.33,43.125,43.069,43.036,43.147,43.185,43.235,43.296,43.243,43.178,43.169,43.182,43.281,43.256,43.371,43.259,43.185,43.192,43.371,43.54,43.433,43.5,43.518,43.56,43.338,43.254,43.123,42.98,42.86,42.842,42.973,42.976,42.815,42.696,42.714,42.493,42.41,42.324,42.415,42.266,42.159,41.946,41.693,41.366,41.512,41.505,41.316,41.049,40.759,40.776,40.873,40.937,40.741,40.826,40.825,40.944,40.989,41.07,40.885,40.852,40.602,40.692,40.722,40.9,40.921,40.745,40.537,40.58,40.786,40.863,41.018,41.147,41.273,41.156,41.473,41.423,41.54,41.597,41.71,41.72,41.618,41.629,41.743,41.867,41.833,41.992,41.871,42.055,42.031,42.12,42.172,42.137,42.049,42.085,42.18,42.147,42.018,42.007,42.074,41.836,41.874,41.742,41.704,41.494,41.514,41.406,41.407,41.359,41.04,41.175,41.258,41.093,41.007,40.956,40.763,40.937,40.74,40.766,40.774,40.631,40.613,40.492,40.613,40.791,41.084,41.166,41.101,41.075,41.306,41.307,41.449,41.524,41.503,41.485,41.402,41.426,41.506,41.587,41.703,41.775,41.748,41.745,41.712,41.641,41.645,41.849,42.109,42.153,42.219,42.154,42.254,42.131,41.823,41.618,41.516,41.731,41.614,41.509,41.456,41.44,41.368,41.386,41.49,41.539,41.563,41.383,41.539,41.371,41.199,41.215,41.142,41.243,41.192,40.984,40.723,40.281,40.189,40.143,40.157,40.058,40.011,40.311,40.436,40.597,40.278,40.357,40.449,40.596,40.563,40.735,40.861,40.829,40.724,40.742,40.835,40.702,40.591,40.69,40.55,40.533,40.29,40.499,40.555,40.698,40.673,40.533,40.557,40.626,40.747,40.606,40.529,40.422,40.324,40.311,40.207,40.09,40.02,39.857,39.659,39.301,39.423,39.449,39.086,39.079,38.794,38.748,38.231,38.437,38.506,38.757,38.575,38.989,38.739,38.603,38.476,38.364,38.509,38.342,38.67,38.765,38.914,38.917,39.101,39.33,39.323,39.34,39.48,39.335,39.488,39.245,39.271,39.418,39.389,39.725,39.941,40.146,40.119,40.215,40.161,40.186,39.952,40.031,40.186,40.186,40.409,40.311,40.311,40.237,40.275,40.207,40.123,40.034,39.849,39.955,39.982,39.929,40.17,40.265,40.282,40.162,40.261,40.212,40.06,39.915,40.025,40.233,39.899,39.873,39.739,39.952,40.258,40.186,40.387,40.358,40.632,40.82,41.03,41.077,40.961,40.961,41.004,40.792,40.815,40.929,40.996,40.678,40.61,40.544,40.721,40.768,40.955,40.952,41.145,41.089,40.899,41.124,41.188,41.28,41.113,40.888,41.109,40.996,40.888,40.895,40.673,40.495,40.503,40.601,40.725,40.676,40.906,40.958,40.839,40.774,40.917,40.815,40.772,40.813,40.63,40.67,40.792,40.651,40.771,40.807,40.825,40.827,40.851,40.895,40.937,40.921,41.078,40.989,40.747,40.777,40.725,40.644,40.648,40.624,40.793,40.824,40.654,40.7,40.739,40.901,41.036,40.964,40.866,40.943,40.773,40.746,40.838,40.747,40.637,40.514,40.43,40.571,40.454,40.382,40.183,39.908,40.012,39.908,39.945,40.08,40.063,39.996,40.018,39.605,39.617,39.887,39.936,40.133,40.008,39.951,40.244,40.321,40.369,40.405,40.452,40.134,40.15,40.238,40.456,40.742,40.64,40.64,40.462,40.59,40.828,40.846,40.978,40.966,40.887,40.883,41.02,41.024,41.195,41.087,40.992,40.835,40.572,40.6,40.407,40.316,40.159,40.119,40.01,40.037,40.204,40.254,40.276,40.071,39.785,39.836,39.91,40.105,39.993,39.916,39.837,39.865,39.964,40.111,39.989,39.819,39.77,39.686,39.684,39.618,39.67,39.829,39.909,40.095,40.033,40.201,40.13,40.152,39.846,39.864,39.858,39.871,39.777,39.805,39.715,39.639,39.606,39.782,39.875,39.924,39.927,39.785,39.558,39.76,39.814,39.838,39.757,39.951,39.851,39.937,39.799,39.769,39.732,39.811,39.725,39.695,39.887,40.142,40.086,40.023,40.013,40.332,40.273,40.141,40.279,40.428,40.424,40.279,40.344,40.337,40.423,40.652,40.604,40.391,40.353,40.639,40.607,40.73,40.683,40.793,40.732,40.795,40.8,40.878,40.989,40.888,40.795,40.914,41.007,41.056,40.715,40.902,41.3,41.272,41.01,40.77,40.959,40.753,40.63,40.631,39.192,38.833,42.643,42.714,43.7,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0]
Loading

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@r7sa