Error writing to parquet using kerchunk

[TomNicholas]

@jsignell it seems the parquet writer implementation in #72 is more fragile then it looked - I tried it in this notebook and got an error from fsspec. I'm not sure if this is fsspec's fault but it would be nice to make it a little more robust if possible.

[jsignell]

It looks like you have some alternative version of kerchunk. Can you confirm that you have 0.2.5 installed?

[jsignell]

In particular your traceback looks like it is pointing to these lines:

    out = LazyReferenceMapper.create(
        record_size, root=url, fs=fs, categorical_threshold=categorical_threshold
    )

https://github.com/fsspec/kerchunk/blob/3c4e9fc960e159875e8f258ccd20fdbc565513df/kerchunk/df.py#L154-L156

when the current version looks more like:

    out = LazyReferenceMapper.create(
        record_size=record_size,
        root=url,
        fs=fs,
        categorical_threshold=categorical_threshold,
    )

https://github.com/fsspec/kerchunk/blob/0.2.5/kerchunk/df.py#L154-L159

[TomNicholas]

You're right! Upgrading to kerchunk==0.2.5 fixed it. Sorry for the noise @jsignell .