feature: Add automated benchmarking to GitHub (#35) #30
Annotations
1 error and 9 warnings
benchmark
# :warning: **Performance Alert** :warning:
Possible performance regression was detected for benchmark **'Python Benchmark with pytest-benchmark'**.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `2`.
| Benchmark suite | Current: c5e9bcd998286ab7e31ab2adad98316b2c4bb9e3 | Previous: 85f2ac1b83021ecf4a2f4b4b2fee99505d0af428 | Ratio |
|-|-|-|-|
| `benchmark/benchmark.py::test_exact_shots[ghz-variance y(q[0])-5-braket_dm]` | `47.12688317610862` iter/sec (`stddev: 0`) | `126.67564965919034` iter/sec (`stddev: 0`) | `2.69` |
| `benchmark/benchmark.py::test_exact_shots[ghz-variance y(q[0])-7-braket_dm_v2]` | `129.69355798623124` iter/sec (`stddev: 0`) | `314.06175057039223` iter/sec (`stddev: 0`) | `2.42` |
| `benchmark/benchmark.py::test_exact_shots[qft-density_matrix q[0], q[1]-7-braket_dm_v2]` | `87.64308105463063` iter/sec (`stddev: 0`) | `266.50541312508136` iter/sec (`stddev: 0`) | `3.04` |
| `benchmark/benchmark.py::test_exact_shots[qft-variance y(q[0])-7-braket_dm_v2]` | `71.77157393221735` iter/sec (`stddev: 0`) | `216.9578320323035` iter/sec (`stddev: 0`) | `3.02` |
| `benchmark/benchmark.py::test_nonzero_shots[ghz-expectation z(q[0])-100-12-braket_sv]` | `36.85871674963592` iter/sec (`stddev: 0`) | `77.28683394669166` iter/sec (`stddev: 0`) | `2.10` |
| `benchmark/benchmark.py::test_nonzero_shots[ghz-sample z(q[0])-100-14-braket_sv]` | `32.64162296029481` iter/sec (`stddev: 0`) | `69.25562955118954` iter/sec (`stddev: 0`) | `2.12` |
| `benchmark/benchmark.py::test_nonzero_shots[qft-probability-100-12-braket_sv_v2]` | `41.04276229808575` iter/sec (`stddev: 0`) | `120.90650474087754` iter/sec (`stddev: 0`) | `2.95` |
| `benchmark/benchmark.py::test_nonzero_shots[qft-variance y(q[0])-100-7-braket_dm_v2]` | `40.14938171679087` iter/sec (`stddev: 0`) | `97.51415359436345` iter/sec (`stddev: 0`) | `2.43` |
| `benchmark/benchmark.py::test_nonzero_shots[qft-sample z(q[0])-100-4-braket_sv]` | `36.76165196218521` iter/sec (`stddev: 0`) | `106.73945899272341` iter/sec (`stddev: 0`) | `2.90` |
This comment was automatically generated by [workflow](https://github.com/amazon-braket/amazon-braket-simulator-v2-python/actions?query=workflow%3ABenchmark) using [github-action-benchmark](https://github.com/marketplace/actions/continuous-benchmark).
Comment was generated at https://github.com/amazon-braket/amazon-braket-simulator-v2-python/commit/c5e9bcd998286ab7e31ab2adad98316b2c4bb9e3#commitcomment-147675183
|
benchmark
Performance alert! Previous value was 126.67564965919034 and current value is 47.12688317610862. It is 2.6879700315808206x worse than previous exceeding a ratio threshold 2
|
benchmark
Performance alert! Previous value was 314.06175057039223 and current value is 129.69355798623124. It is 2.4215678515330286x worse than previous exceeding a ratio threshold 2
|
benchmark
Performance alert! Previous value was 266.50541312508136 and current value is 87.64308105463063. It is 3.0408037909913315x worse than previous exceeding a ratio threshold 2
|
benchmark
Performance alert! Previous value was 216.9578320323035 and current value is 71.77157393221735. It is 3.0228936073939696x worse than previous exceeding a ratio threshold 2
|
benchmark
Performance alert! Previous value was 77.28683394669166 and current value is 36.85871674963592. It is 2.0968400628721042x worse than previous exceeding a ratio threshold 2
|
benchmark
Performance alert! Previous value was 69.25562955118954 and current value is 32.64162296029481. It is 2.1216968787192942x worse than previous exceeding a ratio threshold 2
|
benchmark
Performance alert! Previous value was 120.90650474087754 and current value is 41.04276229808575. It is 2.9458666515366745x worse than previous exceeding a ratio threshold 2
|
benchmark
Performance alert! Previous value was 97.51415359436345 and current value is 40.14938171679087. It is 2.4287834438452154x worse than previous exceeding a ratio threshold 2
|
benchmark
Performance alert! Previous value was 106.73945899272341 and current value is 36.76165196218521. It is 2.9035544730830027x worse than previous exceeding a ratio threshold 2
|