Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GH-38011: [C++][Dataset] Change force close to tend to close on write #38030

Merged
merged 1 commit into from
Oct 5, 2023

Conversation

mapleFU
Copy link
Member

@mapleFU mapleFU commented Oct 5, 2023

Rationale for this change

CloseLargestFile() will failed to close when non of the file has written any rows.

What changes are included in this PR?

Change CloseLargestFile() to TryCloseLargestFile(), and not throw error when it cannot find a file that haven't write any rows.

Are these changes tested?

no

Are there any user-facing changes?

bugfix

@github-actions
Copy link

github-actions bot commented Oct 5, 2023

⚠️ GitHub issue #38011 has been automatically assigned in GitHub to PR creator.

@mapleFU mapleFU marked this pull request as ready for review October 5, 2023 08:15
@mapleFU mapleFU requested a review from westonpace as a code owner October 5, 2023 08:15
@github-actions github-actions bot added the awaiting review Awaiting review label Oct 5, 2023
@mapleFU
Copy link
Member Author

mapleFU commented Oct 5, 2023

cc @bkietz @westonpace

@github-actions github-actions bot added awaiting merge Awaiting merge and removed awaiting review Awaiting review labels Oct 5, 2023
Copy link
Member

@kou kou left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@kou kou changed the title GH-38011: [C++] dataset writer change force close to tend to close GH-38011: [C++][Dataset] Change force close to tend to close on write Oct 5, 2023
@kou kou merged commit 050ccee into apache:main Oct 5, 2023
37 checks passed
@kou kou removed the awaiting merge Awaiting merge label Oct 5, 2023
@conbench-apache-arrow
Copy link

After merging your PR, Conbench analyzed the 6 benchmarking runs that have been run so far on merge-commit 050ccee.

There were 3 benchmark results indicating a performance regression:

The full Conbench report has more details. It also includes information about 1 possible false positive for unstable benchmarks that are known to sometimes produce them.

JerAguilon pushed a commit to JerAguilon/arrow that referenced this pull request Oct 23, 2023
… write (apache#38030)

### Rationale for this change

`CloseLargestFile()` will failed to close when non of the file has written any rows.

### What changes are included in this PR?

Change `CloseLargestFile()` to `TryCloseLargestFile()`, and not throw error when it cannot find a file that haven't write any rows.

### Are these changes tested?

no

### Are there any user-facing changes?

bugfix

* Closes: apache#38011

Authored-by: mwish <[email protected]>
Signed-off-by: Sutou Kouhei <[email protected]>
loicalleyne pushed a commit to loicalleyne/arrow that referenced this pull request Nov 13, 2023
… write (apache#38030)

### Rationale for this change

`CloseLargestFile()` will failed to close when non of the file has written any rows.

### What changes are included in this PR?

Change `CloseLargestFile()` to `TryCloseLargestFile()`, and not throw error when it cannot find a file that haven't write any rows.

### Are these changes tested?

no

### Are there any user-facing changes?

bugfix

* Closes: apache#38011

Authored-by: mwish <[email protected]>
Signed-off-by: Sutou Kouhei <[email protected]>
dgreiss pushed a commit to dgreiss/arrow that referenced this pull request Feb 19, 2024
… write (apache#38030)

### Rationale for this change

`CloseLargestFile()` will failed to close when non of the file has written any rows.

### What changes are included in this PR?

Change `CloseLargestFile()` to `TryCloseLargestFile()`, and not throw error when it cannot find a file that haven't write any rows.

### Are these changes tested?

no

### Are there any user-facing changes?

bugfix

* Closes: apache#38011

Authored-by: mwish <[email protected]>
Signed-off-by: Sutou Kouhei <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[C++] exception caused by dataset_writer.cc:587: Check failed: (largest) != (nullptr)
3 participants