Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ObjectStore: Ability To Write Line-By-Line / Update Via LocalFileSystem #6656

Closed
just-a-stream opened this issue Oct 31, 2024 · 1 comment
Closed

ObjectStore: Ability To Write Line-By-Line / Update Via LocalFileSystem #6656

just-a-stream opened this issue Oct 31, 2024 · 1 comment
Labels
development-process Related to development process of arrow-rs enhancement Any new improvement worthy of a entry in the changelog object-store Object Store Interface

Comments

@just-a-stream
Copy link

It appears it's not possible to use this library's LocalFileSystem store to:

  1. Create a file, writing the first line (eg/ Borsh bytes).
  2. Update an existing file, writing the second line.
  3. Etc.

It would be great to have this functionality.

Thanks!
@just-a-stream just-a-stream added the enhancement Any new improvement worthy of a entry in the changelog label Oct 31, 2024
@tustvold
Copy link
Contributor

We used to support this in form of ObjectStore::append, however, this was removed in #5016.

Ultimately supporting this sort of API is at odds with the goals of the crate to provide an atomic API that is portable to object stores.

@tustvold tustvold closed this as not planned Won't fix, can't repro, duplicate, stale Oct 31, 2024
@alamb alamb added the object-store Object Store Interface label Nov 16, 2024
@tustvold tustvold added the development-process Related to development process of arrow-rs label Dec 20, 2024
@alamb alamb mentioned this issue Dec 20, 2024
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
development-process Related to development process of arrow-rs enhancement Any new improvement worthy of a entry in the changelog object-store Object Store Interface
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@alamb @tustvold @just-a-stream