Skip to content

Latest commit

 

History

History
105 lines (75 loc) · 2.9 KB

polycli_dumpblocks.md

File metadata and controls

105 lines (75 loc) · 2.9 KB
Raw

polycli dumpblocks

Auto-generated documentation.

Table of Contents

Description

Export a range of blocks from a JSON-RPC endpoint.

polycli dumpblocks start end [flags]

Usage

For various reasons, we might want to dump a large range of blocks for analytics or replay purposes. This is a simple util to export over RPC a range of blocks.

The following command would download the first 500K blocks and zip them and then look for blocks with transactions that create an account.

$ polycli dumpblocks 0 500000 --rpc-url http://172.26.26.12:8545/ | gzip > foo.gz
$ zcat < foo.gz | jq '. | select(.transactions | length > 0) | select(.transactions[].to == null)'

Dumpblocks can also output to protobuf format.

If you wish to make changes to the protobuf.

  1. Install the protobuf compiler

On GNU/Linux:

$ sudo apt install protoc-gen-go

On a MAC:

$ brew install protobuf
  1. Install the protobuf plugin
$ go install google.golang.org/protobuf/cmd/protoc-gen-go@latest
  1. Compile the proto file
$ make generate
  1. Depending on what endpoint and chain you're querying, you may be missing some fields in the proto definition.
{
  "level": "error",
  "error": "proto: (line 1:813): unknown field \"nonce\"",
  "time": "2023-01-17T13:35:53-05:00",
  "message": "failed to unmarshal proto message"
}

To solve this, add the unknown fields to the .proto files and recompile them (step 3).

Flags

  -b, --batch-size uint    the batch size. Realistically, this probably shouldn't be bigger than 999. Most providers seem to cap at 1000. (default 150)
  -c, --concurrency uint   how many go routines to leverage (default 1)
  -B, --dump-blocks        if the blocks will be dumped (default true)
      --dump-receipts      if the receipts will be dumped (default true)
  -f, --filename string    where to write the output to (default stdout)
  -F, --filter string      filter output based on tx to and from, not setting a filter means all are allowed (default "{}")
  -h, --help               help for dumpblocks
  -m, --mode string        the output format [json, proto] (default "json")
  -r, --rpc-url string     The RPC endpoint url (default "http://localhost:8545")

The command also inherits flags from parent commands.

      --config string   config file (default is $HOME/.polygon-cli.yaml)
      --pretty-logs     Should logs be in pretty format or JSON (default true)
  -v, --verbosity int   0 - Silent
                        100 Panic
                        200 Fatal
                        300 Error
                        400 Warning
                        500 Info
                        600 Debug
                        700 Trace (default 500)

See also

  • polycli - A Swiss Army knife of blockchain tools.