Add support to read zstd compressed spkg files

[matthewdarwin]

Add support to read zstd compressed spkg files

When we need to re-process cache files (like in https://github.com/streamingfast/substreams/releases/tag/v1.9.0), the spkg file is stored zstd compressed by module in the substreams cache location.

Substreams cannot currently read zstd compressed files.

This enhancement request is to have substreams natively read zstd compressed files. According to @sduchesneau it already checks if the extension is a '.yaml' or '.spkg'... checking for zstd and inlining a decoder should be straightforward.

Goal is to allow for this to work:

$ substreams info  s3://[insert_details]/substreams.partial.spkg.zst --skip-package-validation

[matthewdarwin]

I believe this was implemented last week.

[abourget]

Do you have a link? Can't find it.. but should be straighforward.. and would be a great contribution :)