Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update PUDL to work with pandas 2.2 #3219

Closed
wants to merge 0 commits into from
Closed

Update PUDL to work with pandas 2.2 #3219

wants to merge 0 commits into from

Conversation

zaneselvans
Copy link
Member

@zaneselvans zaneselvans commented Jan 8, 2024

Overview

  • Bump pandas version to 2.2
  • Bump grpcio version to 1.59.3 (can't use 1.60 b/c arrow doesn't work with it)
  • Bump ferc-xbrl-extractor to 1.3.2 which allows use of pandas 2.2
  • Switch to faster calamine Rust Excel parser
  • Fix some tests that relied on old incorrect merge sort ordering in pandas.

Failing Tests

Before Merging

@zaneselvans zaneselvans added dependencies Pull requests that update a dependency file performance Make PUDL run faster! excel Issues involving data in Microsoft Excel spreadsheets labels Jan 8, 2024
@zaneselvans zaneselvans self-assigned this Jan 8, 2024
@zaneselvans zaneselvans added the testing Writing tests, creating test data, automating testing, etc. label Jan 21, 2024
@zaneselvans zaneselvans deleted the pandas-2.2 branch January 21, 2024 04:53
@zaneselvans zaneselvans restored the pandas-2.2 branch January 21, 2024 04:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dependencies Pull requests that update a dependency file excel Issues involving data in Microsoft Excel spreadsheets performance Make PUDL run faster! testing Writing tests, creating test data, automating testing, etc.
Projects
Archived in project
Development

Successfully merging this pull request may close these issues.

1 participant