Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

dataChange incorrect in get_add_actions #1379

Closed
quartox opened this issue May 19, 2023 · 3 comments
Closed

dataChange incorrect in get_add_actions #1379

quartox opened this issue May 19, 2023 · 3 comments
Labels
bug Something isn't working

Comments

@quartox
Copy link

quartox commented May 19, 2023

Environment

Delta-rs version: 0.8.1

Binding: Python

Environment:

  • Cloud provider: AWS
  • OS: Ubuntu
  • Other:

Bug

What happened:
Attempting to find data change True records yields inconsistent results.

df = delta_table.get_add_actions().to_pandas()
df[df["data_change"] == True]

When I first read the table only the 9 most recent actions showed data change True. After a new commit to the table only the most recent action showed data change True and the previous 9 actions now showed False.

Confirmed from reading the commit logs that data change was True for all of those actions.

What you expected to happen:

Data change to match commit logs.

How to reproduce it:

Read the delta table add actions, make a new commit to the delta table with data change True and read the add actions again.

More details:

@quartox quartox added the bug Something isn't working label May 19, 2023
@ion-elgreco
Copy link
Collaborator

@quartox can you share a reproducible example? Or is this outdated by now

@quartox
Copy link
Author

quartox commented Aug 19, 2024

I haven't tested this recently. Given there are no other reports of this problem it is probably safe to close.

@quartox quartox closed this as completed Aug 19, 2024
@ion-elgreco
Copy link
Collaborator

@quartox thanks for the update!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants