Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

benches: Explicit benches relevant to #1860 #1870

Merged
merged 3 commits into from
Aug 9, 2024

Conversation

dhedey
Copy link
Contributor

@dhedey dhedey commented Aug 7, 2024

Summary

Various benches to gauge effectiveness of #1860

@dhedey dhedey changed the title benches: Explicit benches to stress benches: Explicit benches relevant to #1860 Aug 7, 2024
Copy link

github-actions bot commented Aug 7, 2024

Phylum Report Link

Copy link

github-actions bot commented Aug 7, 2024

Docker tags
docker.io/radixdlt/private-scrypto-builder:f491cbf7cd

Copy link

github-actions bot commented Aug 7, 2024

Benchmark for f491cbf

Click to view benchmark
Test Base PR %
costing::bench_prepare_wasm 63.5±0.13ms 64.4±0.17ms +1.42%
costing::decode_encoded_i8_array_to_manifest_raw_value 19.5±0.08ms N/A N/A
costing::decode_encoded_i8_array_to_manifest_value 42.7±0.04ms N/A N/A
costing::decode_encoded_tuple_array_to_manifest_raw_value 63.3±0.18ms N/A N/A
costing::decode_encoded_tuple_array_to_manifest_value 121.4±1.09ms N/A N/A
costing::decode_encoded_u8_array_to_manifest_raw_value 32.2±0.08µs N/A N/A
costing::decode_encoded_u8_array_to_manifest_value 42.6±0.03ms N/A N/A
costing::decode_rpd_to_manifest_raw_value 12.5±0.03µs N/A N/A
costing::decode_rpd_to_manifest_value 10.7±0.03µs N/A N/A
costing::decode_sbor 10.8±0.02µs N/A N/A
costing::decode_sbor_bytes 29.2±0.02µs N/A N/A
costing::deserialize_wasm 1271.2±4.17µs 1270.0±5.26µs -0.09%
costing::execute_transaction_creating_big_vec_substates 716.8±13.69ms N/A N/A
costing::execute_transaction_reading_big_vec_substates 579.7±1.06ms N/A N/A
costing::instantiate_flash_loan 838.5±330.22µs 875.6±338.84µs +4.42%
costing::instantiate_radiswap 1123.2±1747.04µs 1147.5±1792.95µs +2.16%
costing::spin_loop 20.8±0.07ms 21.3±0.04ms +2.40%
costing::validate_sbor_payload 32.3±0.07µs 33.2±0.07µs +2.79%
costing::validate_sbor_payload_bytes 256.3±0.62ns 258.2±0.96ns +0.74%
costing::validate_secp256k1 76.8±0.26µs 76.7±0.09µs -0.13%
costing::validate_wasm 33.8±0.06ms 33.8±0.06ms 0.00%
decimal::add/0 8.4±0.00ns 8.4±0.00ns 0.00%
decimal::add/rust-native 9.9±0.01ns 9.9±0.01ns 0.00%
decimal::add/wasmi 220.4±0.25ns 226.0±9.22ns +2.54%
decimal::add/wasmi-call-native 2.1±0.00µs 2.1±0.01µs 0.00%
decimal::div/0 187.4±0.07ns 188.1±0.86ns +0.37%
decimal::from_string/0 159.6±0.40ns 159.4±0.37ns -0.13%
decimal::mul/0 150.7±0.42ns 150.0±0.67ns -0.46%
decimal::mul/rust-native 146.4±0.09ns 149.5±0.22ns +2.12%
decimal::mul/wasmi 12.1±0.09µs 12.2±0.08µs +0.83%
decimal::mul/wasmi-call-native 2.3±0.00µs 2.3±0.00µs 0.00%
decimal::pow/0 691.0±0.44ns 690.7±0.70ns -0.04%
decimal::pow/rust-native 663.9±0.67ns 664.7±0.50ns +0.12%
decimal::pow/wasmi 58.7±0.37µs 58.9±0.26µs +0.34%
decimal::pow/wasmi-call-native 2.5±0.00µs 2.5±0.00µs 0.00%
decimal::root/0 7.8±0.01µs 7.9±0.01µs +1.28%
decimal::sub/0 8.3±0.06ns 8.4±0.01ns +1.20%
decimal::to_string/0 438.6±0.56ns 433.1±0.35ns -1.25%
precise_decimal::add/0 8.8±0.01ns 8.8±0.03ns 0.00%
precise_decimal::add/rust-native 10.9±0.03ns 10.7±0.01ns -1.83%
precise_decimal::add/wasmi 277.6±0.96ns 280.1±0.57ns +0.90%
precise_decimal::add/wasmi-call-native 2.8±0.00µs 2.8±0.00µs 0.00%
precise_decimal::div/0 316.4±0.46ns 316.7±0.57ns +0.09%
precise_decimal::from_string/0 202.3±0.39ns 202.1±0.34ns -0.10%
precise_decimal::mul/0 361.5±0.21ns 361.7±0.58ns +0.06%
precise_decimal::mul/rust-native 319.4±0.26ns 320.4±0.38ns +0.31%
precise_decimal::mul/wasmi 36.1±0.31µs 35.3±0.13µs -2.22%
precise_decimal::mul/wasmi-call-native 3.2±0.01µs 3.2±0.01µs 0.00%
precise_decimal::pow/0 1949.5±1.99ns 1941.8±2.18ns -0.39%
precise_decimal::pow/rust-native 1526.6±2.14ns 1528.3±2.64ns +0.11%
precise_decimal::pow/wasmi 166.0±2.99µs 165.0±0.41µs -0.60%
precise_decimal::pow/wasmi-call-native 5.9±0.00µs 5.8±0.01µs -1.69%
precise_decimal::root/0 55.5±0.01µs 56.3±0.02µs +1.44%
precise_decimal::sub/0 9.0±0.11ns 9.0±0.13ns 0.00%
precise_decimal::to_string/0 702.5±0.80ns 697.0±2.48ns -0.78%
schema::validate_payload 380.4±0.93µs 381.5±1.50µs +0.29%
transaction::radiswap 5.2±0.02ms 5.3±0.02ms +1.92%
transaction::transfer 1943.5±3.60µs 1929.4±5.71µs -0.73%
transaction_processing::prepare 2.5±0.02ms 2.5±0.00ms 0.00%
transaction_processing::prepare_and_decompile 6.2±0.03ms 6.2±0.02ms 0.00%
transaction_processing::prepare_and_decompile_and_recompile 25.2±0.34ms 25.4±1.98ms +0.79%
transaction_validation::validate_manifest 42.8±0.05µs 42.9±0.04µs +0.23%
transaction_validation::verify_bls_2KB 1064.6±16.09µs 1002.2±8.35µs -5.86%
transaction_validation::verify_bls_32B 1038.1±32.11µs 1003.9±15.38µs -3.29%
transaction_validation::verify_ecdsa 74.6±0.07µs 74.6±0.09µs 0.00%
transaction_validation::verify_ed25519 55.1±0.11µs 55.2±0.06µs +0.18%

@dhedey dhedey marked this pull request as ready for review August 7, 2024 22:31
@dhedey dhedey merged commit dbcbea1 into develop Aug 9, 2024
29 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

2 participants