This tiny blockchain indexer scrapes Transfer
events emitted by the USDC contract and saves the data in a file-based dataset in a local folder ./data
. It is built with the Subsquid framework, hence the term "squid".
The squid uses @subsquid/file-store
and @subsquid/file-store-parquet
packages to store the dataset. The result is a partitioned dataset where the data is stored in Apache Parquet files.
Dependencies: NodeJS, Squid CLI.
To see it in action, spin up a processor, a process that ingests the data from the Ethereum Archive:
$ git clone https://github.com/subsquid-labs/file-store-parquet-example
$ cd file-store-parquet-example/
$ npm i
$ sqd process
You should see a ./data
folder populated with indexer data appear in a bit:
$ tree ./data/
./data/
├── 0000000000-0007258859
│ └── transfers.parquet
├── 0007258860-0007671919
│ └── transfers.parquet
...
└── status.txt