fusaka light client: implement Ssz and Log EIPs to enable merkle proof generation and validation #3452

g11tech · 2024-06-13T18:22:17Z

WIP

ref: - https://github.com/ethereum/EIPs/blob/master/EIPS/eip-6493.md

How to :

git clone the repo and checkout/pull the eip-6493 branch

in repo root run: npm i this will build all packages:

test ssz spec for the ssz wrappers

cd packages/util
(build the package if changed something from last build); npm run build
run test spec: npx vitest run test/ssz.spec.ts

Fusaka light client

The endgame: https://fusaka-light.box
kurtosis params to run locally: https://fusaka-light.box/network_params_fusaka-light.yaml

Work

doesn't include 7702 support, EL p2p still stays RLP which also implies that 6493 ssz txs out of scope. so for beacon payload, it shifts to the ssz stablecontainer format for txs, as well as the roots shift to ssz HTR

txs merkelization https://eips.ethereum.org/EIPS/eip-6404 and stablecontainer format for engine api
withdrawals root merkelization
blockheader/hash merkelization
receipts root merkelization https://eips.ethereum.org/EIPS/eip-6466, https://fusaka-light.box/el_receipt.html
logs bloom refactoring: https://notes.ethereum.org/@vbuterin/parallel_post_state_roots
- state saved in a dummy system contract ivcPredeployAddress: '0x' + '6493'.repeat(10) (till actual contract is developed/
  deployed)
- also the ivcPredeployAddress is saved with nonce 1 for the first time to prevent eip 158 cleanup as a hack till actual contract is deployed
modified IVC log accum for best proofing capabilities and its placement for tx parallelization
eth transfer logs: https://eips.ethereum.org/EIPS/eip-7708

Note

please note that a dummy hardfork eip6493 has been added for ease of development testing and devnet creation (on top of prague) so that will be cleaned up later when the work will become mergable
some parts of the code will be cleaned up/optimized later

codecov · 2024-06-14T18:27:51Z

Codecov Report

Attention: Patch coverage is 33.73984% with 163 lines in your changes missing coverage. Please review.

Project coverage is 37.67%. Comparing base (4470cc3) to head (8821e70).
Report is 105 commits behind head on master.

Additional details and impacted files

Flag	Coverage Δ
block	`?`
blockchain	`83.49% <ø> (?)`
client	`?`
common	`89.90% <100.00%> (?)`
devp2p	`0.00% <ø> (?)`
evm	`65.18% <100.00%> (?)`
genesis	`0.00% <ø> (?)`
mpt	`51.69% <ø> (?)`
statemanager	`67.41% <ø> (?)`
tx	`?`
vm	`55.18% <30.63%> (?)`
wallet	`0.00% <ø> (ø)`

Flags with carried forward coverage won't be shown. Click here to find out more.

paulmillr · 2024-06-21T05:43:34Z

FYI micro-eth-signer (https://github.com/paulmillr/micro-eth-signer) ssz implementation was like 8 times smaller the last time i've checked.

It's tree-shakeable, so you won't need to use the entire package.

holgerd77 · 2024-06-21T08:04:40Z

🤔

Atm this work here is conceptual only (so: not to be merged soon), but might be worth a try.

wemeetagain · 2024-06-21T20:06:19Z

@paulmillr nice library, if you implement https://github.com/ethereum/EIPs/blob/master/EIPS/eip-7495.md there, then it can be used

etan-status · 2024-06-22T08:41:37Z

@paulmillr thanks, have added it to https://stabilitynow.box

paulmillr · 2024-09-24T12:04:37Z

@wemeetagain @etan-status SSZ stable containers have been implemented in eth-signer v0.12.

etan-status · 2024-09-24T13:27:32Z

@wemeetagain @etan-status SSZ stable containers have been implemented in eth-signer v0.12.

Cool, have added the checkmark on https://stabilitynow.box – Thanks!!

paulmillr · 2024-09-24T14:12:47Z

@etan-status doesn't seem like the site got updated? Also url to micro-eth-signer is wrong, instead of github it's some random website

etan-status · 2024-09-24T14:16:21Z

Yeah, I noticed that weird link as well and informed @philknows - something weird with that notion instance going on (the link is correct in the editor but points to this weird caching server that has wrong http headers once rendered)

philknows · 2024-09-26T22:33:25Z

Yeah, I noticed that weird link as well and informed @philknows - something weird with that notion instance going on (the link is correct in the editor but points to this weird caching server that has wrong http headers once rendered)

This has been fixed now @paulmillr , thanks for bringing it to our attention!

paulmillr · 2024-10-04T12:13:47Z

@g11tech to clarify, micro-eth-signer, which you're already using in monorepo, supports stable container ssz out-of-box, today. I will make some benchmarks, but even the code size is 5x+ smaller.

g11tech · 2024-10-04T14:51:00Z

@g11tech to clarify, micro-eth-signer, which you're already using in monorepo, supports stable container ssz out-of-box, today. I will make some benchmarks, but even the code size is 5x+ smaller.

hey @paulmillr ! awesome!
although will look into the replacement a bit down the line :)

paulmillr · 2024-10-07T09:59:03Z

SSZ benchmarks have been added to eth-signer. chainsafe/ssz is faster, however, it is not correct, and fails consensus-spec-tests. E.g. ChainSafe/ssz#406

g11tech · 2024-10-07T13:55:52Z

SSZ benchmarks have been added to eth-signer. chainsafe/ssz is faster, however, it is not correct, and fails consensus-spec-tests. E.g. ChainSafe/ssz#406

yes this is correct, for 64 bit uint, this type is supposed to be used: UintBn64 (so we choose accordingly)

paulmillr · 2024-10-07T19:19:06Z

paulmillr · 2024-10-07T19:21:19Z

Update: chainsafe maintainer mentioned consensus-spec-tests are not supposed to pass with the implementation:

ChainSafe/ssz#406 (comment)

Yes, this UintNum64 type will not pass all consensus spec tests for the uint64 type

debug and fix the legacy ssz encoding decoding add a spec test for legacy ssz encoding decoding add the ssztx boilerplate to other tx types implement sszRaw value for 2930 tx add 2930 spec test and debug/fix ssz encoding/decoding add the ssz encoding decoding to 1559 tx add eip 1559 testcase and get it working add 4844 ssz encoding decoding add eip 4844 testcase and get it working define block transactions ssz type and test ssz transactionsRoot handle ssz roots for transactions and withdrawals in block when 6493 activated handle the roots gen in the build block fix the transaction stable container update the execution payload serialization deserialization for 6493 add 6493 hardfork for the testing/devnet refactor the transaction factory ssz tx deserialization add ssz profile<>stablecontaiber conversion spec test add eip6493 support to common debug and fix the block transaction withdrawal root comparision by removing null keccak hash hardcoding enhance eip6493 tx test by testing transaction factory deserialization which uses stable container add client eip6493 end to end spec and fix the payload generation refactor tx serialization deserializion with respect to execution/beacon payload add, debug and fix the transactionv1 or hex transactions validator and debug/fix the newpayloadeip6493 spec test add 6493 to electra for kurtosis testing console log error for debugging console log error for debugging txpool fix attempt add more descriptive checks for nulloroptional add more descriptive checks for nulloroptional log full error debug and fix handling of replay vs legacy tx w.r.t. v/ypartity and confirm via spec test build fix dev and add transaction inclusion proof to the getTransactionX apis workaround to get the proof since stable container impl for proof seems buggy and breaking refactor the proof format based on feedback debug, discuss and fix the signature packing scheme add hack to schedule 6493 on prague in cli for stablecontainer devnets debug and fix newpayload eip6493 spec debug rebase and spec fixes in tx utils debug and fix block build fix the vm build debug and get 6493 end to end client spec working rebase 4844 fixes add ssz blockheader type and update the blockhash to use when ssz activated debug and update client spec with ssz blockhash update ssz field to receiptstrie updates after discussion with etan update test

…and add log proofing capabilities by multiple filters

… for cl withdrawals

…erification

…client spec

… client eip6493 spec

g11tech · 2024-10-21T11:08:54Z

superseded by #3756 because of branch rename to more appropriate one

g11tech added the PR state: WIP label Jun 13, 2024

g11tech changed the title ~~common,util,tx: implement aip 6493 stable container txs~~ common,util,tx: implement EIP-6493 stable container txs Jun 13, 2024

g11tech changed the title ~~common,util,tx: implement EIP-6493 stable container txs~~ common,util,tx,block,client: implement EIP-6493 stable container txs Jun 23, 2024

g11tech added package: block package: tx package: common package: client package: util labels Jun 23, 2024

g11tech mentioned this pull request Jun 26, 2024

Consensus-layer Call 136 ethereum/pm#1084

Closed

g11tech force-pushed the eip-6493 branch 2 times, most recently from 86eb2fa to beffd4b Compare June 30, 2024 11:37

g11tech force-pushed the eip-6493 branch 2 times, most recently from f314666 to 838f25d Compare September 23, 2024 16:05

g11tech changed the title ~~common,util,tx,block,client: implement EIP-6493 stable container txs~~ fukasa light client: implement Ssz and Log EIPs to enable merkle proof generation and validation Sep 25, 2024

g11tech force-pushed the eip-6493 branch from 2575d3a to 5baf071 Compare October 4, 2024 11:24

g11tech changed the title ~~fukasa light client: implement Ssz and Log EIPs to enable merkle proof generation and validation~~ fusaka light client: implement Ssz and Log EIPs to enable merkle proof generation and validation Oct 4, 2024

g11tech added 8 commits October 9, 2024 17:32

update and proagate ssz signature scheme as well as authroization list

73d9dca

check and remove an invalid failing spec test

8fc90ca

impl ssz receipts and dev modify the receipts rooting work

a624dae

debug and fix the client 6493 end to end spec test

e9c6f58

accumulate logs into an ivc contract for advance proofing capabilities

e8ff671

add ivc spec test in end to end client spec and debug and fix it

6e53fce

modify the ivc accumulator code for smartcontract comaptible compute …

1292329

…and add log proofing capabilities by multiple filters

g11tech force-pushed the eip-6493 branch from 841db33 to 1292329 Compare October 9, 2024 12:03

g11tech added 9 commits October 9, 2024 19:20

move the log accumulation to post executions

a2d598f

move the ivc log processing to pre 7685 to allow adding transfer logs…

0238872

… for cl withdrawals

add and process systemslogs root to header for allowing system logs v…

a45d884

…erification

debug and fix issues introduced by systemlogs field and fix the 6493 …

223ce1a

…client spec

add log for the combined miner/priority reward and debug/fix/validate…

b410d3d

… client eip6493 spec

simplify log based on discussion with etan and make changes

f6f5ad8

remove console trace

f60853e

update ssz to stablecontainer released version

61935e7

fix missing sz update

8821e70

g11tech mentioned this pull request Oct 21, 2024

fusaka light client: implement Ssz and Log EIPs to enable merkle proof generation and validation #3756

Draft

7 tasks

g11tech closed this Oct 21, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

fusaka light client: implement Ssz and Log EIPs to enable merkle proof generation and validation #3452

fusaka light client: implement Ssz and Log EIPs to enable merkle proof generation and validation #3452

g11tech commented Jun 13, 2024 •

edited

Loading

codecov bot commented Jun 14, 2024 •

edited

Loading

paulmillr commented Jun 21, 2024 •

edited

Loading

holgerd77 commented Jun 21, 2024

wemeetagain commented Jun 21, 2024

etan-status commented Jun 22, 2024

paulmillr commented Sep 24, 2024

etan-status commented Sep 24, 2024

paulmillr commented Sep 24, 2024

etan-status commented Sep 24, 2024 •

edited

Loading

philknows commented Sep 26, 2024

paulmillr commented Oct 4, 2024

g11tech commented Oct 4, 2024

paulmillr commented Oct 7, 2024

g11tech commented Oct 7, 2024

paulmillr commented Oct 7, 2024

paulmillr commented Oct 7, 2024

g11tech commented Oct 21, 2024 •

edited

Loading

fusaka light client: implement Ssz and Log EIPs to enable merkle proof generation and validation #3452

fusaka light client: implement Ssz and Log EIPs to enable merkle proof generation and validation #3452

Conversation

g11tech commented Jun 13, 2024 • edited Loading

test ssz spec for the ssz wrappers

Fusaka light client

Work

Note

codecov bot commented Jun 14, 2024 • edited Loading

Codecov Report

paulmillr commented Jun 21, 2024 • edited Loading

holgerd77 commented Jun 21, 2024

wemeetagain commented Jun 21, 2024

etan-status commented Jun 22, 2024

paulmillr commented Sep 24, 2024

etan-status commented Sep 24, 2024

paulmillr commented Sep 24, 2024

etan-status commented Sep 24, 2024 • edited Loading

philknows commented Sep 26, 2024

paulmillr commented Oct 4, 2024

g11tech commented Oct 4, 2024

paulmillr commented Oct 7, 2024

g11tech commented Oct 7, 2024

paulmillr commented Oct 7, 2024

paulmillr commented Oct 7, 2024

g11tech commented Oct 21, 2024 • edited Loading

g11tech commented Jun 13, 2024 •

edited

Loading

codecov bot commented Jun 14, 2024 •

edited

Loading

paulmillr commented Jun 21, 2024 •

edited

Loading

etan-status commented Sep 24, 2024 •

edited

Loading

g11tech commented Oct 21, 2024 •

edited

Loading