Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Support API for setting a spill directory callback in task #11572

Closed

Conversation

yuandagits
Copy link
Contributor

@yuandagits yuandagits commented Nov 18, 2024

Summary:
Add ability to set a spill directory callback in task. The callback will create the spill directory and return the directory created.

We also add the ability for mkdir to decide whether or not to fail if a directory was created.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Nov 18, 2024
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D65964247

Copy link

netlify bot commented Nov 18, 2024

Deploy Preview for meta-velox canceled.

Name Link
🔨 Latest commit b84aba5
🔍 Latest deploy log https://app.netlify.com/sites/meta-velox/deploys/674550dd219dac0008deab66

yuandagits added a commit to yuandagits/velox that referenced this pull request Nov 18, 2024
… spill directory with custom options (facebookincubator#11572)

Summary:

Add ability to create the parent spill direction with custom options.

We also add the ability for mkdir to decide whether or not to fail if a directory was created

Differential Revision: D65964247
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D65964247

@yuandagits yuandagits changed the title feature(custom options to spill directories): Add ability to make parent spill directory with custom options feat(custom options to spill directories): Add ability to make parent spill directory with custom options Nov 18, 2024
yuandagits added a commit to yuandagits/velox that referenced this pull request Nov 18, 2024
… spill directory with custom options (facebookincubator#11572)

Summary:

Add ability to create the parent spill direction with custom options.

We also add the ability for mkdir to decide whether or not to fail if a directory was created

Differential Revision: D65964247
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D65964247

yuandagits added a commit to yuandagits/velox that referenced this pull request Nov 18, 2024
… spill directory with custom options (facebookincubator#11572)

Summary:

Add ability to create the parent spill direction with custom options.

We also add the ability for mkdir to decide whether or not to fail if a directory was created

Differential Revision: D65964247
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D65964247

yuandagits added a commit to yuandagits/velox that referenced this pull request Nov 19, 2024
… spill directory with custom options (facebookincubator#11572)

Summary:

Add ability to create the parent spill direction with custom options.

We also add the ability for mkdir to decide whether or not to fail if a directory was created

Differential Revision: D65964247
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D65964247

yuandagits added a commit to yuandagits/velox that referenced this pull request Nov 19, 2024
… spill directory with custom options (facebookincubator#11572)

Summary:

Add ability to create the parent spill direction with custom options.

We also add the ability for mkdir to decide whether or not to fail if a directory was created

Differential Revision: D65964247
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D65964247

yuandagits added a commit to yuandagits/velox that referenced this pull request Nov 19, 2024
… spill directory with custom options (facebookincubator#11572)

Summary:

Add ability to create the parent spill direction with custom options.

We also add the ability for mkdir to decide whether or not to fail if a directory was created

Differential Revision: D65964247
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D65964247

yuandagits added a commit to yuandagits/velox that referenced this pull request Nov 19, 2024
… spill directory with custom options (facebookincubator#11572)

Summary:

Add ability to create the parent spill direction with custom options.

We also add the ability for mkdir to decide whether or not to fail if a directory was created

Differential Revision: D65964247
yuandagits added a commit to yuandagits/velox that referenced this pull request Nov 19, 2024
… spill directory with custom options (facebookincubator#11572)

Summary:

Add ability to create the parent spill direction with custom options.

We also add the ability for mkdir to decide whether or not to fail if a directory was created

Differential Revision: D65964247
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D65964247

1 similar comment
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D65964247

yuandagits added a commit to yuandagits/velox that referenced this pull request Nov 19, 2024
… spill directory with custom options (facebookincubator#11572)

Summary:

Add ability to create the parent spill direction with custom options.

We also add the ability for mkdir to decide whether or not to fail if a directory was created

Differential Revision: D65964247
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D65964247

yuandagits added a commit to yuandagits/velox that referenced this pull request Nov 22, 2024
…ebookincubator#11572)

Summary:

Add ability to set a spill directory callback in task. The callback will create the spill directory and return the directory created

We also add the ability for mkdir to decide whether or not to fail if a directory was created

Differential Revision: D65964247
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D65964247

yuandagits added a commit to yuandagits/velox that referenced this pull request Nov 22, 2024
…ebookincubator#11572)

Summary:

Add ability to set a spill directory callback in task. The callback will create the spill directory and return the directory created

We also add the ability for mkdir to decide whether or not to fail if a directory was created

Differential Revision: D65964247
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D65964247

yuandagits added a commit to yuandagits/velox that referenced this pull request Nov 22, 2024
…ebookincubator#11572)

Summary:

Add ability to set a spill directory callback in task. The callback will create the spill directory and return the directory created

We also add the ability for mkdir to decide whether or not to fail if a directory was created

Differential Revision: D65964247
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D65964247

yuandagits added a commit to yuandagits/velox that referenced this pull request Nov 22, 2024
…ebookincubator#11572)

Summary:

Add ability to set a spill directory callback in task. The callback will create the spill directory and return the directory created

We also add the ability for mkdir to decide whether or not to fail if a directory was created

Reviewed By: xiaoxmeng

Differential Revision: D65964247
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D65964247

yuandagits added a commit to yuandagits/velox that referenced this pull request Nov 22, 2024
…ebookincubator#11572)

Summary:

Add ability to set a spill directory callback in task. The callback will create the spill directory and return the directory created

We also add the ability for mkdir to decide whether or not to fail if a directory was created

Reviewed By: xiaoxmeng

Differential Revision: D65964247
yuandagits added a commit to yuandagits/velox that referenced this pull request Nov 25, 2024
…ebookincubator#11572)

Summary:

Add ability to set a spill directory callback in task. The callback will create the spill directory and return the directory created

We also add the ability for mkdir to decide whether or not to fail if a directory was created

Reviewed By: xiaoxmeng

Differential Revision: D65964247
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D65964247

yuandagits added a commit to yuandagits/velox that referenced this pull request Nov 26, 2024
…ebookincubator#11572)

Summary:

Add ability to set a spill directory callback in task. The callback will create the spill directory and return the directory created

We also add the ability for mkdir to decide whether or not to fail if a directory was created

Reviewed By: xiaoxmeng

Differential Revision: D65964247
…ebookincubator#11572)

Summary:

Add ability to set a spill directory callback in task. The callback will create the spill directory and return the directory created

We also add the ability for mkdir to decide whether or not to fail if a directory was created

Reviewed By: xiaoxmeng

Differential Revision: D65964247
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D65964247

@facebook-github-bot
Copy link
Contributor

This pull request has been merged in f013684.

Copy link

Conbench analyzed the 1 benchmark run on commit f0136845.

There were no benchmark performance regressions. 🎉

The full Conbench report has more details.

TongWei1105 pushed a commit to TongWei1105/velox that referenced this pull request Dec 3, 2024
…ebookincubator#11572)

Summary:
Pull Request resolved: facebookincubator#11572

Add ability to set a spill directory callback in task. The callback will create the spill directory and return the directory created

We also add the ability for mkdir to decide whether or not to fail if a directory was created

Reviewed By: xiaoxmeng

Differential Revision: D65964247

fbshipit-source-id: c35f9953ba134e0ba048213adacc101fb22b1892
athmaja-n pushed a commit to athmaja-n/velox that referenced this pull request Jan 10, 2025
…ebookincubator#11572)

Summary:
Pull Request resolved: facebookincubator#11572

Add ability to set a spill directory callback in task. The callback will create the spill directory and return the directory created

We also add the ability for mkdir to decide whether or not to fail if a directory was created

Reviewed By: xiaoxmeng

Differential Revision: D65964247

fbshipit-source-id: c35f9953ba134e0ba048213adacc101fb22b1892
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported Merged
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants