You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Each call to the piece upload api is limited to taking ~100 MB. We need an improvement to the pdptool for ingesting large datasets into pdp. This should be sufficient to ingest ~1 TiB of proving parameter data.
pdptool upload-file cli command
take a file, chunk it
upload to curio pdp api in a thread pool, handling errors
prepare piece for all files to get cids out
return rootcid:subroot,subroot format used by add-roots command
The text was updated successfully, but these errors were encountered:
Each call to the piece upload api is limited to taking ~100 MB. We need an improvement to the pdptool for ingesting large datasets into pdp. This should be sufficient to ingest ~1 TiB of proving parameter data.
The text was updated successfully, but these errors were encountered: