Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PARQUET-2463: Bump japicmp to 0.21.0 #1329

Merged
merged 2 commits into from
Apr 26, 2024
Merged

PARQUET-2463: Bump japicmp to 0.21.0 #1329

merged 2 commits into from
Apr 26, 2024

Conversation

wgtmac
Copy link
Member

@wgtmac wgtmac commented Apr 25, 2024

Make sure you have checked all steps below.

Jira

Tests

  • My PR adds the following unit tests OR does not need testing for this extremely good reason:

Commits

  • My commits all reference Jira issues in their subject lines. In addition, my commits follow the guidelines
    from "How to write a good git commit message":
    1. Subject is separated from body by a blank line
    2. Subject is limited to 50 characters (not including Jira issue reference)
    3. Subject does not end with a period
    4. Subject uses the imperative mood ("add", not "adding")
    5. Body wraps at 72 characters
    6. Body explains "what" and "why", not "how"

Style

  • My contribution adheres to the code style guidelines and Spotless passes.
    • To apply the necessary changes, run mvn spotless:apply -Pvector-plugins

Documentation

  • In case of new functionality, my PR adds documentation that describes how to use it.
    • All the public functions and the classes in the PR contain Javadoc that explain what it does

@wgtmac
Copy link
Member Author

wgtmac commented Apr 25, 2024

This PR aims to minimize the exclusions from japicmp plugin before releasing 1.14.0. Please take a look, thanks!
@gszadovszky @Fokko @vinooganesh @amousavigourabi

pom.xml Outdated
<exclude>org.apache.parquet.proto.ProtoParquetReader#builder(org.apache.parquet.io.InputFile,boolean)</exclude>

<!-- Due to protected field type change from Configuration to ParquetConfiguration -->
<exclude>org.apache.parquet.hadoop.CodecFactory#configuration</exclude>
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These two exclusions are reported here: #1141 (comment). I'm not sure if this should be fixed.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Well, if the field is protected, then technically we introduce breaking changes by altering them. I think, the question is how easy would it be to fix it in the code. If it requires big changes/redesign, I am fine having the exclusions. Otherwise, let's fix it in the code. We should avoid the practice of adding exclusions instead of trying to make backward compatible code.

Copy link
Contributor

@gszadovszky gszadovszky left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks a lot @wgtmac for working on this! It looks good to me. Please check the field type change issues if they are fixable. If you think it requires too much effort I'll give the +1 for as is.

protected final int pageSize;

// May be null if parquetConfiguration is not an instance of org.apache.parquet.conf.HadoopParquetConfiguration
@Deprecated
protected final Configuration configuration;
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I've added it back to be backward compatible. @amousavigourabi @Fokko

@wgtmac
Copy link
Member Author

wgtmac commented Apr 26, 2024

I have fixed all issues. Please take a look again. Thanks! @gszadovszky

@wgtmac wgtmac merged commit 23c788d into apache:master Apr 26, 2024
9 checks passed
@wgtmac
Copy link
Member Author

wgtmac commented Apr 26, 2024

Thanks @gszadovszky for the review!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants