Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: update spec test version #7057

Closed

Conversation

matthewkeil
Copy link
Member

Motivation

Spec v1.5.0-alpha3 consistently doesn't download. Update to alpha5 to get specs tests running consistently

@matthewkeil matthewkeil requested a review from a team as a code owner August 28, 2024 16:58
@matthewkeil matthewkeil changed the base branch from unstable to electra-fork-rebasejul30 August 28, 2024 16:58
Copy link

codecov bot commented Aug 28, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Please upload report for BASE (electra-fork-rebasejul30@7fe30b4). Learn more about missing BASE report.

Additional details and impacted files
@@                     Coverage Diff                     @@
##             electra-fork-rebasejul30    #7057   +/-   ##
===========================================================
  Coverage                            ?   49.37%           
===========================================================
  Files                               ?      589           
  Lines                               ?    39233           
  Branches                            ?     2250           
===========================================================
  Hits                                ?    19372           
  Misses                              ?    19820           
  Partials                            ?       41           

Copy link
Member

@nflaig nflaig left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

conflicts with #7053

Copy link
Contributor

Performance Report

✔️ no performance regression detected

Full benchmark results
Benchmark suite Current: e84c2fc Previous: 5d2e1a7 Ratio
getPubkeys - index2pubkey - req 1000 vs - 250000 vc 2.3038 ms/op 2.1060 ms/op 1.09
getPubkeys - validatorsArr - req 1000 vs - 250000 vc 50.168 us/op 55.538 us/op 0.90
BLS verify - blst 946.05 us/op 961.58 us/op 0.98
BLS verifyMultipleSignatures 3 - blst 1.4728 ms/op 1.3817 ms/op 1.07
BLS verifyMultipleSignatures 8 - blst 2.1518 ms/op 1.9178 ms/op 1.12
BLS verifyMultipleSignatures 32 - blst 6.9736 ms/op 4.8652 ms/op 1.43
BLS verifyMultipleSignatures 64 - blst 11.168 ms/op 9.2313 ms/op 1.21
BLS verifyMultipleSignatures 128 - blst 17.997 ms/op 17.152 ms/op 1.05
BLS deserializing 10000 signatures 713.08 ms/op 698.07 ms/op 1.02
BLS deserializing 100000 signatures 7.2613 s/op 6.9835 s/op 1.04
BLS verifyMultipleSignatures - same message - 3 - blst 1.2010 ms/op 908.14 us/op 1.32
BLS verifyMultipleSignatures - same message - 8 - blst 1.2638 ms/op 1.1394 ms/op 1.11
BLS verifyMultipleSignatures - same message - 32 - blst 1.8039 ms/op 1.8498 ms/op 0.98
BLS verifyMultipleSignatures - same message - 64 - blst 2.7315 ms/op 2.6303 ms/op 1.04
BLS verifyMultipleSignatures - same message - 128 - blst 4.7107 ms/op 4.3425 ms/op 1.08
BLS aggregatePubkeys 32 - blst 21.783 us/op 21.077 us/op 1.03
BLS aggregatePubkeys 128 - blst 78.521 us/op 73.300 us/op 1.07
notSeenSlots=1 numMissedVotes=1 numBadVotes=10 76.709 ms/op 65.692 ms/op 1.17
notSeenSlots=1 numMissedVotes=0 numBadVotes=4 81.032 ms/op 65.548 ms/op 1.24
notSeenSlots=2 numMissedVotes=1 numBadVotes=10 39.652 ms/op 34.443 ms/op 1.15
getSlashingsAndExits - default max 111.42 us/op 92.771 us/op 1.20
getSlashingsAndExits - 2k 347.57 us/op 368.79 us/op 0.94
proposeBlockBody type=full, size=empty 6.3680 ms/op 6.3791 ms/op 1.00
isKnown best case - 1 super set check 300.00 ns/op 548.00 ns/op 0.55
isKnown normal case - 2 super set checks 344.00 ns/op 544.00 ns/op 0.63
isKnown worse case - 16 super set checks 376.00 ns/op 495.00 ns/op 0.76
InMemoryCheckpointStateCache - add get delete 3.1210 us/op 3.3460 us/op 0.93
updateUnfinalizedPubkeys - updating 10 pubkeys 1.4870 ms/op
updateUnfinalizedPubkeys - updating 100 pubkeys 2.8497 ms/op
updateUnfinalizedPubkeys - updating 1000 pubkeys 62.342 ms/op
validate api signedAggregateAndProof - struct 1.7898 ms/op 1.5182 ms/op 1.18
validate gossip signedAggregateAndProof - struct 1.5060 ms/op 1.5438 ms/op 0.98
validate gossip attestation - vc 640000 1.1419 ms/op 944.04 us/op 1.21
batch validate gossip attestation - vc 640000 - chunk 32 148.74 us/op 134.10 us/op 1.11
batch validate gossip attestation - vc 640000 - chunk 64 132.33 us/op 120.83 us/op 1.10
batch validate gossip attestation - vc 640000 - chunk 128 121.66 us/op 114.26 us/op 1.06
batch validate gossip attestation - vc 640000 - chunk 256 114.75 us/op 116.15 us/op 0.99
pickEth1Vote - no votes 1.1200 ms/op 1.1466 ms/op 0.98
pickEth1Vote - max votes 7.7782 ms/op 8.3843 ms/op 0.93
pickEth1Vote - Eth1Data hashTreeRoot value x2048 16.757 ms/op 18.825 ms/op 0.89
pickEth1Vote - Eth1Data hashTreeRoot tree x2048 19.578 ms/op 24.938 ms/op 0.79
pickEth1Vote - Eth1Data fastSerialize value x2048 455.56 us/op 614.60 us/op 0.74
pickEth1Vote - Eth1Data fastSerialize tree x2048 4.2408 ms/op 4.0200 ms/op 1.05
bytes32 toHexString 426.00 ns/op 715.00 ns/op 0.60
bytes32 Buffer.toString(hex) 252.00 ns/op 278.00 ns/op 0.91
bytes32 Buffer.toString(hex) from Uint8Array 361.00 ns/op 479.00 ns/op 0.75
bytes32 Buffer.toString(hex) + 0x 259.00 ns/op 264.00 ns/op 0.98
Object access 1 prop 0.12800 ns/op 0.19100 ns/op 0.67
Map access 1 prop 0.13100 ns/op 0.14400 ns/op 0.91
Object get x1000 5.8600 ns/op 6.5020 ns/op 0.90
Map get x1000 6.1860 ns/op 6.6910 ns/op 0.92
Object set x1000 32.536 ns/op 57.953 ns/op 0.56
Map set x1000 23.148 ns/op 38.152 ns/op 0.61
Return object 10000 times 0.29020 ns/op 0.32200 ns/op 0.90
Throw Error 10000 times 3.3880 us/op 3.5894 us/op 0.94
toHex 150.03 ns/op 175.26 ns/op 0.86
Buffer.from 133.97 ns/op 169.25 ns/op 0.79
shared Buffer 85.278 ns/op 106.39 ns/op 0.80
fastMsgIdFn sha256 / 200 bytes 2.1710 us/op 2.4660 us/op 0.88
fastMsgIdFn h32 xxhash / 200 bytes 228.00 ns/op 322.00 ns/op 0.71
fastMsgIdFn h64 xxhash / 200 bytes 266.00 ns/op 295.00 ns/op 0.90
fastMsgIdFn sha256 / 1000 bytes 7.2330 us/op 7.7460 us/op 0.93
fastMsgIdFn h32 xxhash / 1000 bytes 352.00 ns/op 442.00 ns/op 0.80
fastMsgIdFn h64 xxhash / 1000 bytes 335.00 ns/op 365.00 ns/op 0.92
fastMsgIdFn sha256 / 10000 bytes 64.098 us/op 67.017 us/op 0.96
fastMsgIdFn h32 xxhash / 10000 bytes 1.8160 us/op 2.0060 us/op 0.91
fastMsgIdFn h64 xxhash / 10000 bytes 1.1920 us/op 1.2770 us/op 0.93
send data - 1000 256B messages 12.852 ms/op 14.790 ms/op 0.87
send data - 1000 512B messages 17.660 ms/op 19.559 ms/op 0.90
send data - 1000 1024B messages 26.220 ms/op 34.545 ms/op 0.76
send data - 1000 1200B messages 26.297 ms/op 35.769 ms/op 0.74
send data - 1000 2048B messages 32.437 ms/op 43.542 ms/op 0.74
send data - 1000 4096B messages 33.190 ms/op 48.025 ms/op 0.69
send data - 1000 16384B messages 73.189 ms/op 79.058 ms/op 0.93
send data - 1000 65536B messages 218.10 ms/op 213.37 ms/op 1.02
enrSubnets - fastDeserialize 64 bits 1.1070 us/op 1.4000 us/op 0.79
enrSubnets - ssz BitVector 64 bits 368.00 ns/op 456.00 ns/op 0.81
enrSubnets - fastDeserialize 4 bits 157.00 ns/op 204.00 ns/op 0.77
enrSubnets - ssz BitVector 4 bits 351.00 ns/op 455.00 ns/op 0.77
prioritizePeers score -10:0 att 32-0.1 sync 2-0 154.27 us/op 206.55 us/op 0.75
prioritizePeers score 0:0 att 32-0.25 sync 2-0.25 199.03 us/op 248.29 us/op 0.80
prioritizePeers score 0:0 att 32-0.5 sync 2-0.5 299.50 us/op 388.33 us/op 0.77
prioritizePeers score 0:0 att 64-0.75 sync 4-0.75 650.69 us/op 425.95 us/op 1.53
prioritizePeers score 0:0 att 64-1 sync 4-1 974.15 us/op 750.92 us/op 1.30
array of 16000 items push then shift 1.6546 us/op 1.8121 us/op 0.91
LinkedList of 16000 items push then shift 7.0910 ns/op 8.2770 ns/op 0.86
array of 16000 items push then pop 115.84 ns/op 144.35 ns/op 0.80
LinkedList of 16000 items push then pop 6.9680 ns/op 8.2240 ns/op 0.85
array of 24000 items push then shift 2.4281 us/op 2.8984 us/op 0.84
LinkedList of 24000 items push then shift 7.6690 ns/op 9.7990 ns/op 0.78
array of 24000 items push then pop 141.56 ns/op 199.49 ns/op 0.71
LinkedList of 24000 items push then pop 7.1180 ns/op 8.1670 ns/op 0.87
intersect bitArray bitLen 8 6.3630 ns/op 6.8000 ns/op 0.94
intersect array and set length 8 51.013 ns/op 81.699 ns/op 0.62
intersect bitArray bitLen 128 29.756 ns/op 33.337 ns/op 0.89
intersect array and set length 128 677.19 ns/op 963.31 ns/op 0.70
bitArray.getTrueBitIndexes() bitLen 128 2.4540 us/op 2.6430 us/op 0.93
bitArray.getTrueBitIndexes() bitLen 248 3.3630 us/op 3.7350 us/op 0.90
bitArray.getTrueBitIndexes() bitLen 512 7.8460 us/op 8.5250 us/op 0.92
Buffer.concat 32 items 993.00 ns/op 1.1490 us/op 0.86
Uint8Array.set 32 items 1.8060 us/op 2.3420 us/op 0.77
Buffer.copy 1.9990 us/op 1.9960 us/op 1.00
Uint8Array.set - with subarray 2.8160 us/op 3.1020 us/op 0.91
Uint8Array.set - without subarray 1.6110 us/op 1.8120 us/op 0.89
getUint32 - dataview 241.00 ns/op 318.00 ns/op 0.76
getUint32 - manual 231.00 ns/op 240.00 ns/op 0.96
Set add up to 64 items then delete first 2.8738 us/op 2.6394 us/op 1.09
OrderedSet add up to 64 items then delete first 3.7300 us/op 3.9113 us/op 0.95
Set add up to 64 items then delete last 3.3064 us/op 2.5850 us/op 1.28
OrderedSet add up to 64 items then delete last 4.7155 us/op 4.4672 us/op 1.06
Set add up to 64 items then delete middle 3.4347 us/op 2.7569 us/op 1.25
OrderedSet add up to 64 items then delete middle 6.2591 us/op 6.7594 us/op 0.93
Set add up to 128 items then delete first 6.6373 us/op 7.0565 us/op 0.94
OrderedSet add up to 128 items then delete first 9.8138 us/op 11.330 us/op 0.87
Set add up to 128 items then delete last 6.4715 us/op 6.6222 us/op 0.98
OrderedSet add up to 128 items then delete last 9.7647 us/op 11.140 us/op 0.88
Set add up to 128 items then delete middle 6.5226 us/op 7.8775 us/op 0.83
OrderedSet add up to 128 items then delete middle 16.791 us/op 18.322 us/op 0.92
Set add up to 256 items then delete first 13.670 us/op 15.166 us/op 0.90
OrderedSet add up to 256 items then delete first 20.503 us/op 25.420 us/op 0.81
Set add up to 256 items then delete last 13.029 us/op 13.541 us/op 0.96
OrderedSet add up to 256 items then delete last 18.936 us/op 19.015 us/op 1.00
Set add up to 256 items then delete middle 13.480 us/op 11.270 us/op 1.20
OrderedSet add up to 256 items then delete middle 49.220 us/op 48.012 us/op 1.03
transfer serialized Status (84 B) 1.6790 us/op 1.4540 us/op 1.15
copy serialized Status (84 B) 1.5200 us/op 1.2750 us/op 1.19
transfer serialized SignedVoluntaryExit (112 B) 1.7360 us/op 1.6760 us/op 1.04
copy serialized SignedVoluntaryExit (112 B) 1.5700 us/op 1.4230 us/op 1.10
transfer serialized ProposerSlashing (416 B) 2.7140 us/op 2.4400 us/op 1.11
copy serialized ProposerSlashing (416 B) 2.4290 us/op 1.7720 us/op 1.37
transfer serialized Attestation (485 B) 2.4220 us/op 1.7310 us/op 1.40
copy serialized Attestation (485 B) 2.2520 us/op 2.0160 us/op 1.12
transfer serialized AttesterSlashing (33232 B) 2.8100 us/op 2.7420 us/op 1.02
copy serialized AttesterSlashing (33232 B) 8.7560 us/op 8.5460 us/op 1.02
transfer serialized Small SignedBeaconBlock (128000 B) 2.7810 us/op 3.6240 us/op 0.77
copy serialized Small SignedBeaconBlock (128000 B) 25.748 us/op 19.767 us/op 1.30
transfer serialized Avg SignedBeaconBlock (200000 B) 3.2540 us/op 3.9350 us/op 0.83
copy serialized Avg SignedBeaconBlock (200000 B) 41.205 us/op 32.664 us/op 1.26
transfer serialized BlobsSidecar (524380 B) 4.3250 us/op 3.8770 us/op 1.12
copy serialized BlobsSidecar (524380 B) 268.38 us/op 86.078 us/op 3.12
transfer serialized Big SignedBeaconBlock (1000000 B) 3.8500 us/op 3.9940 us/op 0.96
copy serialized Big SignedBeaconBlock (1000000 B) 493.44 us/op 170.22 us/op 2.90
pass gossip attestations to forkchoice per slot 3.0259 ms/op 2.8990 ms/op 1.04
forkChoice updateHead vc 100000 bc 64 eq 0 510.74 us/op 508.09 us/op 1.01
forkChoice updateHead vc 600000 bc 64 eq 0 3.3840 ms/op 3.1609 ms/op 1.07
forkChoice updateHead vc 1000000 bc 64 eq 0 5.5167 ms/op 5.4650 ms/op 1.01
forkChoice updateHead vc 600000 bc 320 eq 0 3.1457 ms/op 3.0776 ms/op 1.02
forkChoice updateHead vc 600000 bc 1200 eq 0 3.1977 ms/op 3.2059 ms/op 1.00
forkChoice updateHead vc 600000 bc 7200 eq 0 4.4253 ms/op 3.6792 ms/op 1.20
forkChoice updateHead vc 600000 bc 64 eq 1000 11.238 ms/op 10.659 ms/op 1.05
forkChoice updateHead vc 600000 bc 64 eq 10000 11.212 ms/op 10.804 ms/op 1.04
forkChoice updateHead vc 600000 bc 64 eq 300000 16.533 ms/op 15.362 ms/op 1.08
computeDeltas 500000 validators 300 proto nodes 3.9298 ms/op 3.7629 ms/op 1.04
computeDeltas 500000 validators 1200 proto nodes 3.9440 ms/op 3.7258 ms/op 1.06
computeDeltas 500000 validators 7200 proto nodes 3.8595 ms/op 3.6626 ms/op 1.05
computeDeltas 750000 validators 300 proto nodes 5.5902 ms/op 5.4985 ms/op 1.02
computeDeltas 750000 validators 1200 proto nodes 5.8020 ms/op 5.5012 ms/op 1.05
computeDeltas 750000 validators 7200 proto nodes 6.8357 ms/op 5.6196 ms/op 1.22
computeDeltas 1400000 validators 300 proto nodes 11.724 ms/op 10.270 ms/op 1.14
computeDeltas 1400000 validators 1200 proto nodes 11.564 ms/op 10.496 ms/op 1.10
computeDeltas 1400000 validators 7200 proto nodes 12.232 ms/op 10.599 ms/op 1.15
computeDeltas 2100000 validators 300 proto nodes 17.438 ms/op 14.997 ms/op 1.16
computeDeltas 2100000 validators 1200 proto nodes 18.279 ms/op 15.482 ms/op 1.18
computeDeltas 2100000 validators 7200 proto nodes 18.530 ms/op 15.557 ms/op 1.19
altair processAttestation - 250000 vs - 7PWei normalcase 2.5809 ms/op 1.7634 ms/op 1.46
altair processAttestation - 250000 vs - 7PWei worstcase 3.6243 ms/op 3.4772 ms/op 1.04
altair processAttestation - setStatus - 1/6 committees join 112.87 us/op 99.424 us/op 1.14
altair processAttestation - setStatus - 1/3 committees join 234.68 us/op 188.68 us/op 1.24
altair processAttestation - setStatus - 1/2 committees join 344.20 us/op 256.68 us/op 1.34
altair processAttestation - setStatus - 2/3 committees join 388.79 us/op 332.76 us/op 1.17
altair processAttestation - setStatus - 4/5 committees join 550.26 us/op 489.76 us/op 1.12
altair processAttestation - setStatus - 100% committees join 696.77 us/op 561.45 us/op 1.24
altair processBlock - 250000 vs - 7PWei normalcase 6.6429 ms/op 5.0858 ms/op 1.31
altair processBlock - 250000 vs - 7PWei normalcase hashState 33.534 ms/op 25.276 ms/op 1.33
altair processBlock - 250000 vs - 7PWei worstcase 44.380 ms/op 39.110 ms/op 1.13
altair processBlock - 250000 vs - 7PWei worstcase hashState 99.731 ms/op 81.264 ms/op 1.23
phase0 processBlock - 250000 vs - 7PWei normalcase 3.1808 ms/op 2.3899 ms/op 1.33
phase0 processBlock - 250000 vs - 7PWei worstcase 30.618 ms/op 24.852 ms/op 1.23
altair processEth1Data - 250000 vs - 7PWei normalcase 605.54 us/op 334.06 us/op 1.81
getExpectedWithdrawals 250000 eb:1,eth1:1,we:0,wn:0,smpl:15 12.763 us/op 8.4040 us/op 1.52
getExpectedWithdrawals 250000 eb:0.95,eth1:0.1,we:0.05,wn:0,smpl:219 65.902 us/op 37.909 us/op 1.74
getExpectedWithdrawals 250000 eb:0.95,eth1:0.3,we:0.05,wn:0,smpl:42 18.782 us/op 13.358 us/op 1.41
getExpectedWithdrawals 250000 eb:0.95,eth1:0.7,we:0.05,wn:0,smpl:18 8.8250 us/op 10.059 us/op 0.88
getExpectedWithdrawals 250000 eb:0.1,eth1:0.1,we:0,wn:0,smpl:1020 225.60 us/op 139.40 us/op 1.62
getExpectedWithdrawals 250000 eb:0.03,eth1:0.03,we:0,wn:0,smpl:11777 1.6315 ms/op 747.70 us/op 2.18
getExpectedWithdrawals 250000 eb:0.01,eth1:0.01,we:0,wn:0,smpl:16384 2.2673 ms/op 948.83 us/op 2.39
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,smpl:16384 2.2923 ms/op 990.48 us/op 2.31
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,nocache,smpl:16384 4.5916 ms/op 2.5564 ms/op 1.80
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,smpl:16384 2.2383 ms/op 1.7412 ms/op 1.29
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,nocache,smpl:16384 5.1171 ms/op 4.7903 ms/op 1.07
Tree 40 250000 create 288.78 ms/op 319.86 ms/op 0.90
Tree 40 250000 get(125000) 159.94 ns/op 169.10 ns/op 0.95
Tree 40 250000 set(125000) 754.54 ns/op 785.99 ns/op 0.96
Tree 40 250000 toArray() 21.896 ms/op 18.994 ms/op 1.15
Tree 40 250000 iterate all - toArray() + loop 22.345 ms/op 23.417 ms/op 0.95
Tree 40 250000 iterate all - get(i) 60.735 ms/op 66.141 ms/op 0.92
Array 250000 create 4.1520 ms/op 3.9560 ms/op 1.05
Array 250000 clone - spread 1.6111 ms/op 1.5895 ms/op 1.01
Array 250000 get(125000) 0.46800 ns/op 0.44800 ns/op 1.04
Array 250000 set(125000) 0.47900 ns/op 0.48000 ns/op 1.00
Array 250000 iterate all - loop 112.87 us/op 107.35 us/op 1.05
phase0 afterProcessEpoch - 250000 vs - 7PWei 102.87 ms/op 92.421 ms/op 1.11
Array.fill - length 1000000 5.3542 ms/op 3.4752 ms/op 1.54
Array push - length 1000000 21.905 ms/op 19.799 ms/op 1.11
Array.get 0.28686 ns/op 0.28835 ns/op 0.99
Uint8Array.get 0.45350 ns/op 0.43966 ns/op 1.03
phase0 beforeProcessEpoch - 250000 vs - 7PWei 18.591 ms/op 16.020 ms/op 1.16
altair processEpoch - mainnet_e81889 353.07 ms/op 386.27 ms/op 0.91
mainnet_e81889 - altair beforeProcessEpoch 19.677 ms/op 22.395 ms/op 0.88
mainnet_e81889 - altair processJustificationAndFinalization 14.911 us/op 16.196 us/op 0.92
mainnet_e81889 - altair processInactivityUpdates 5.6826 ms/op 7.7119 ms/op 0.74
mainnet_e81889 - altair processRewardsAndPenalties 50.278 ms/op 46.565 ms/op 1.08
mainnet_e81889 - altair processRegistryUpdates 3.1540 us/op 2.8940 us/op 1.09
mainnet_e81889 - altair processSlashings 863.00 ns/op 797.00 ns/op 1.08
mainnet_e81889 - altair processEth1DataReset 870.00 ns/op 978.00 ns/op 0.89
mainnet_e81889 - altair processEffectiveBalanceUpdates 1.9511 ms/op 1.9162 ms/op 1.02
mainnet_e81889 - altair processSlashingsReset 6.3020 us/op 3.7630 us/op 1.67
mainnet_e81889 - altair processRandaoMixesReset 6.5890 us/op 5.6440 us/op 1.17
mainnet_e81889 - altair processHistoricalRootsUpdate 756.00 ns/op 1.4850 us/op 0.51
mainnet_e81889 - altair processParticipationFlagUpdates 3.7530 us/op 5.2490 us/op 0.71
mainnet_e81889 - altair processSyncCommitteeUpdates 829.00 ns/op 545.00 ns/op 1.52
mainnet_e81889 - altair afterProcessEpoch 100.82 ms/op 102.91 ms/op 0.98
capella processEpoch - mainnet_e217614 1.3220 s/op 1.2961 s/op 1.02
mainnet_e217614 - capella beforeProcessEpoch 74.329 ms/op 70.280 ms/op 1.06
mainnet_e217614 - capella processJustificationAndFinalization 22.281 us/op 14.877 us/op 1.50
mainnet_e217614 - capella processInactivityUpdates 19.689 ms/op 17.280 ms/op 1.14
mainnet_e217614 - capella processRewardsAndPenalties 259.61 ms/op 220.33 ms/op 1.18
mainnet_e217614 - capella processRegistryUpdates 19.239 us/op 16.813 us/op 1.14
mainnet_e217614 - capella processSlashings 880.00 ns/op 498.00 ns/op 1.77
mainnet_e217614 - capella processEth1DataReset 473.00 ns/op 501.00 ns/op 0.94
mainnet_e217614 - capella processEffectiveBalanceUpdates 15.610 ms/op 5.8006 ms/op 2.69
mainnet_e217614 - capella processSlashingsReset 17.226 us/op 7.4210 us/op 2.32
mainnet_e217614 - capella processRandaoMixesReset 10.142 us/op 5.3290 us/op 1.90
mainnet_e217614 - capella processHistoricalRootsUpdate 1.0230 us/op 815.00 ns/op 1.26
mainnet_e217614 - capella processParticipationFlagUpdates 3.6420 us/op 3.1320 us/op 1.16
mainnet_e217614 - capella afterProcessEpoch 256.35 ms/op 262.01 ms/op 0.98
phase0 processEpoch - mainnet_e58758 431.58 ms/op 461.50 ms/op 0.94
mainnet_e58758 - phase0 beforeProcessEpoch 93.856 ms/op 110.52 ms/op 0.85
mainnet_e58758 - phase0 processJustificationAndFinalization 25.383 us/op 30.214 us/op 0.84
mainnet_e58758 - phase0 processRewardsAndPenalties 29.525 ms/op 34.516 ms/op 0.86
mainnet_e58758 - phase0 processRegistryUpdates 10.939 us/op 13.274 us/op 0.82
mainnet_e58758 - phase0 processSlashings 644.00 ns/op 560.00 ns/op 1.15
mainnet_e58758 - phase0 processEth1DataReset 515.00 ns/op 409.00 ns/op 1.26
mainnet_e58758 - phase0 processEffectiveBalanceUpdates 1.7150 ms/op 1.1334 ms/op 1.51
mainnet_e58758 - phase0 processSlashingsReset 7.1390 us/op 7.6550 us/op 0.93
mainnet_e58758 - phase0 processRandaoMixesReset 6.3490 us/op 8.3760 us/op 0.76
mainnet_e58758 - phase0 processHistoricalRootsUpdate 634.00 ns/op 865.00 ns/op 0.73
mainnet_e58758 - phase0 processParticipationRecordUpdates 5.2770 us/op 5.9460 us/op 0.89
mainnet_e58758 - phase0 afterProcessEpoch 91.832 ms/op 87.373 ms/op 1.05
phase0 processEffectiveBalanceUpdates - 250000 normalcase 1.8870 ms/op 1.9396 ms/op 0.97
phase0 processEffectiveBalanceUpdates - 250000 worstcase 0.5 3.0255 ms/op 2.2238 ms/op 1.36
altair processInactivityUpdates - 250000 normalcase 24.211 ms/op 17.435 ms/op 1.39
altair processInactivityUpdates - 250000 worstcase 26.817 ms/op 18.685 ms/op 1.44
phase0 processRegistryUpdates - 250000 normalcase 18.034 us/op 7.9050 us/op 2.28
phase0 processRegistryUpdates - 250000 badcase_full_deposits 472.52 us/op 295.25 us/op 1.60
phase0 processRegistryUpdates - 250000 worstcase 0.5 149.74 ms/op 117.37 ms/op 1.28
altair processRewardsAndPenalties - 250000 normalcase 71.662 ms/op 39.336 ms/op 1.82
altair processRewardsAndPenalties - 250000 worstcase 50.321 ms/op 39.939 ms/op 1.26
phase0 getAttestationDeltas - 250000 normalcase 11.691 ms/op 9.9926 ms/op 1.17
phase0 getAttestationDeltas - 250000 worstcase 11.625 ms/op 9.0416 ms/op 1.29
phase0 processSlashings - 250000 worstcase 136.75 us/op 110.10 us/op 1.24
altair processSyncCommitteeUpdates - 250000 184.46 ms/op 130.28 ms/op 1.42
BeaconState.hashTreeRoot - No change 454.00 ns/op 336.00 ns/op 1.35
BeaconState.hashTreeRoot - 1 full validator 149.70 us/op 103.74 us/op 1.44
BeaconState.hashTreeRoot - 32 full validator 1.6005 ms/op 1.1534 ms/op 1.39
BeaconState.hashTreeRoot - 512 full validator 17.719 ms/op 13.607 ms/op 1.30
BeaconState.hashTreeRoot - 1 validator.effectiveBalance 180.62 us/op 128.94 us/op 1.40
BeaconState.hashTreeRoot - 32 validator.effectiveBalance 2.4382 ms/op 1.8879 ms/op 1.29
BeaconState.hashTreeRoot - 512 validator.effectiveBalance 35.202 ms/op 21.627 ms/op 1.63
BeaconState.hashTreeRoot - 1 balances 139.20 us/op 97.348 us/op 1.43
BeaconState.hashTreeRoot - 32 balances 1.1379 ms/op 944.80 us/op 1.20
BeaconState.hashTreeRoot - 512 balances 11.333 ms/op 8.3400 ms/op 1.36
BeaconState.hashTreeRoot - 250000 balances 243.55 ms/op 178.46 ms/op 1.36
aggregationBits - 2048 els - zipIndexesInBitList 35.610 us/op 26.286 us/op 1.35
byteArrayEquals 32 62.189 ns/op 55.318 ns/op 1.12
Buffer.compare 32 22.038 ns/op 17.754 ns/op 1.24
byteArrayEquals 1024 1.7599 us/op 1.6067 us/op 1.10
Buffer.compare 1024 28.209 ns/op 24.617 ns/op 1.15
byteArrayEquals 16384 27.847 us/op 25.536 us/op 1.09
Buffer.compare 16384 226.43 ns/op 205.46 ns/op 1.10
byteArrayEquals 123687377 224.06 ms/op 195.01 ms/op 1.15
Buffer.compare 123687377 9.9516 ms/op 7.6452 ms/op 1.30
byteArrayEquals 32 - diff last byte 64.702 ns/op 53.152 ns/op 1.22
Buffer.compare 32 - diff last byte 21.409 ns/op 17.030 ns/op 1.26
byteArrayEquals 1024 - diff last byte 1.7381 us/op 1.6068 us/op 1.08
Buffer.compare 1024 - diff last byte 34.756 ns/op 25.318 ns/op 1.37
byteArrayEquals 16384 - diff last byte 27.237 us/op 25.864 us/op 1.05
Buffer.compare 16384 - diff last byte 203.84 ns/op 207.44 ns/op 0.98
byteArrayEquals 123687377 - diff last byte 205.59 ms/op 198.21 ms/op 1.04
Buffer.compare 123687377 - diff last byte 8.7867 ms/op 9.4539 ms/op 0.93
byteArrayEquals 32 - random bytes 5.5300 ns/op 5.4490 ns/op 1.01
Buffer.compare 32 - random bytes 19.497 ns/op 17.979 ns/op 1.08
byteArrayEquals 1024 - random bytes 5.5150 ns/op 5.4070 ns/op 1.02
Buffer.compare 1024 - random bytes 19.502 ns/op 18.166 ns/op 1.07
byteArrayEquals 16384 - random bytes 5.4800 ns/op 5.4130 ns/op 1.01
Buffer.compare 16384 - random bytes 19.540 ns/op 17.965 ns/op 1.09
byteArrayEquals 123687377 - random bytes 7.0600 ns/op 7.4700 ns/op 0.95
Buffer.compare 123687377 - random bytes 21.600 ns/op 19.700 ns/op 1.10
regular array get 100000 times 34.767 us/op 36.462 us/op 0.95
wrappedArray get 100000 times 35.400 us/op 35.196 us/op 1.01
arrayWithProxy get 100000 times 13.557 ms/op 13.799 ms/op 0.98
ssz.Root.equals 48.896 ns/op 47.472 ns/op 1.03
byteArrayEquals 47.801 ns/op 47.608 ns/op 1.00
Buffer.compare 11.370 ns/op 11.634 ns/op 0.98
shuffle list - 16384 els 6.8459 ms/op 6.4936 ms/op 1.05
shuffle list - 250000 els 102.20 ms/op 95.567 ms/op 1.07
processSlot - 1 slots 19.155 us/op 16.898 us/op 1.13
processSlot - 32 slots 3.4093 ms/op 2.8353 ms/op 1.20
getEffectiveBalanceIncrementsZeroInactive - 250000 vs - 7PWei 42.671 ms/op 37.050 ms/op 1.15
getCommitteeAssignments - req 1 vs - 250000 vc 2.3418 ms/op 2.2299 ms/op 1.05
getCommitteeAssignments - req 100 vs - 250000 vc 4.4429 ms/op 4.3122 ms/op 1.03
getCommitteeAssignments - req 1000 vs - 250000 vc 4.7959 ms/op 4.7020 ms/op 1.02
findModifiedValidators - 10000 modified validators 400.35 ms/op 284.11 ms/op 1.41
findModifiedValidators - 1000 modified validators 343.22 ms/op 208.41 ms/op 1.65
findModifiedValidators - 100 modified validators 313.48 ms/op 174.18 ms/op 1.80
findModifiedValidators - 10 modified validators 291.03 ms/op 180.23 ms/op 1.61
findModifiedValidators - 1 modified validators 288.81 ms/op 185.44 ms/op 1.56
findModifiedValidators - no difference 266.28 ms/op 159.92 ms/op 1.67
compare ViewDUs 4.1289 s/op 3.1193 s/op 1.32
compare each validator Uint8Array 1.8433 s/op 1.7027 s/op 1.08
compare ViewDU to Uint8Array 1.3869 s/op 1.1979 s/op 1.16
migrate state 1000000 validators, 24 modified, 0 new 753.57 ms/op 591.63 ms/op 1.27
migrate state 1000000 validators, 1700 modified, 1000 new 1.0622 s/op 858.97 ms/op 1.24
migrate state 1000000 validators, 3400 modified, 2000 new 1.3409 s/op 1.1011 s/op 1.22
migrate state 1500000 validators, 24 modified, 0 new 740.07 ms/op 575.59 ms/op 1.29
migrate state 1500000 validators, 1700 modified, 1000 new 1.0778 s/op 830.35 ms/op 1.30
migrate state 1500000 validators, 3400 modified, 2000 new 1.3278 s/op 1.0789 s/op 1.23
RootCache.getBlockRootAtSlot - 250000 vs - 7PWei 5.3400 ns/op 4.8700 ns/op 1.10
state getBlockRootAtSlot - 250000 vs - 7PWei 658.18 ns/op 624.74 ns/op 1.05
computeProposers - vc 250000 8.3791 ms/op 7.9971 ms/op 1.05
computeEpochShuffling - vc 250000 102.03 ms/op 96.733 ms/op 1.05
getNextSyncCommittee - vc 250000 146.13 ms/op 142.97 ms/op 1.02
computeSigningRoot for AttestationData 25.013 us/op 29.065 us/op 0.86
hash AttestationData serialized data then Buffer.toString(base64) 2.0088 us/op 1.7284 us/op 1.16
toHexString serialized data 1.2443 us/op 1.1280 us/op 1.10
Buffer.toString(base64) 245.21 ns/op 216.61 ns/op 1.13
block root to RootHex using toHex 185.26 ns/op 176.58 ns/op 1.05
block root to RootHex using toRootHex 112.72 ns/op 110.25 ns/op 1.02

by benchmarkbot/action

@matthewkeil matthewkeil deleted the mkeil/update-spec-test-version branch August 28, 2024 20:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants