Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(hashjoin): Turn off dynamic filter push downs for null aware right semi porject join #11781

Closed

Conversation

DanielHunte
Copy link

Summary: Currently, when there are no matches for a null aware right semi project join but the build side has nulls, the dynamic push down filter filters out all the rows from the probe side. This causes the probe side to be considered empty and therefore sets the entire match column to falses, even in rows where the match value should be null.

Differential Revision: D66903863

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Dec 6, 2024
Copy link

netlify bot commented Dec 6, 2024

Deploy Preview for meta-velox canceled.

Name Link
🔨 Latest commit c464522
🔍 Latest deploy log https://app.netlify.com/sites/meta-velox/deploys/675fafcbdd7ecd0008f512cf

@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66903863

DanielHunte pushed a commit to DanielHunte/velox that referenced this pull request Dec 9, 2024
…t semi porject join (facebookincubator#11781)

Summary:

Currently, when there are no matches for a null aware right semi project join but the build side has nulls, the dynamic push down filter filters out all the rows from the probe side. This causes the probe side to be considered empty and therefore sets the entire match column to falses, even in rows where the match value should be null.

Differential Revision: D66903863
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66903863

DanielHunte pushed a commit to DanielHunte/velox that referenced this pull request Dec 9, 2024
…t semi porject join (facebookincubator#11781)

Summary:

Currently, when there are no matches for a null aware right semi project join but the build side has nulls, the dynamic push down filter filters out all the rows from the probe side. This causes the probe side to be considered empty and therefore sets the entire match column to falses, even in rows where the match value should be null.

Reviewed By: Yuhta

Differential Revision: D66903863
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66903863

DanielHunte pushed a commit to DanielHunte/velox that referenced this pull request Dec 9, 2024
…t semi porject join (facebookincubator#11781)

Summary:

Currently, when there are no matches for a null aware right semi project join but the build side has nulls, the dynamic push down filter filters out all the rows from the probe side. This causes the probe side to be considered empty and therefore sets the entire match column to falses, even in rows where the match value should be null.

Reviewed By: Yuhta

Differential Revision: D66903863
DanielHunte pushed a commit to DanielHunte/velox that referenced this pull request Dec 9, 2024
…t semi porject join (facebookincubator#11781)

Summary:

Currently, when there are no matches for a null aware right semi project join but the build side has nulls, the dynamic push down filter filters out all the rows from the probe side. This causes the probe side to be considered empty and therefore sets the entire match column to falses, even in rows where the match value should be null.

Reviewed By: Yuhta

Differential Revision: D66903863
DanielHunte pushed a commit to DanielHunte/velox that referenced this pull request Dec 9, 2024
…t semi porject join (facebookincubator#11781)

Summary:

Currently, when there are no matches for a null aware right semi project join but the build side has nulls, the dynamic push down filter filters out all the rows from the probe side. This causes the probe side to be considered empty and therefore sets the entire match column to falses, even in rows where the match value should be null.

Reviewed By: Yuhta

Differential Revision: D66903863
DanielHunte pushed a commit to DanielHunte/velox that referenced this pull request Dec 9, 2024
…t semi porject join (facebookincubator#11781)

Summary:

Currently, when there are no matches for a null aware right semi project join but the build side has nulls, the dynamic push down filter filters out all the rows from the probe side. This causes the probe side to be considered empty and therefore sets the entire match column to falses, even in rows where the match value should be null.

Reviewed By: Yuhta

Differential Revision: D66903863
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66903863

DanielHunte pushed a commit to DanielHunte/velox that referenced this pull request Dec 9, 2024
…t semi porject join (facebookincubator#11781)

Summary:

Currently, when there are no matches for a null aware right semi project join but the build side has nulls, the dynamic push down filter filters out all the rows from the probe side. This causes the probe side to be considered empty and therefore sets the entire match column to falses, even in rows where the match value should be null.

Reviewed By: Yuhta

Differential Revision: D66903863
DanielHunte pushed a commit to DanielHunte/velox that referenced this pull request Dec 9, 2024
…t semi porject join (facebookincubator#11781)

Summary:

Currently, when there are no matches for a null aware right semi project join but the build side has nulls, the dynamic push down filter filters out all the rows from the probe side. This causes the probe side to be considered empty and therefore sets the entire match column to falses, even in rows where the match value should be null.

Reviewed By: Yuhta

Differential Revision: D66903863
DanielHunte pushed a commit to DanielHunte/velox that referenced this pull request Dec 10, 2024
…t semi porject join (facebookincubator#11781)

Summary:

Currently, when there are no matches for a null aware right semi project join but the build side has nulls, the dynamic push down filter filters out all the rows from the probe side. This causes the probe side to be considered empty and therefore sets the entire match column to falses, even in rows where the match value should be null.

Reviewed By: Yuhta

Differential Revision: D66903863
DanielHunte pushed a commit to DanielHunte/velox that referenced this pull request Dec 10, 2024
…t semi porject join (facebookincubator#11781)

Summary:

Currently, when there are no matches for a null aware right semi project join but the build side has nulls, the dynamic push down filter filters out all the rows from the probe side. This causes the probe side to be considered empty and therefore sets the entire match column to falses, even in rows where the match value should be null.

Reviewed By: Yuhta

Differential Revision: D66903863
DanielHunte pushed a commit to DanielHunte/velox that referenced this pull request Dec 14, 2024
…t semi porject join (facebookincubator#11781)

Summary:

Currently, when there are no matches for a null aware right semi project join but the build side has nulls, the dynamic push down filter filters out all the rows from the probe side. This causes the probe side to be considered empty and therefore sets the entire match column to falses, even in rows where the match value should be null.

Reviewed By: Yuhta

Differential Revision: D66903863
DanielHunte pushed a commit to DanielHunte/velox that referenced this pull request Dec 14, 2024
…t semi porject join (facebookincubator#11781)

Summary:

Currently, when there are no matches for a null aware right semi project join but the build side has nulls, the dynamic push down filter filters out all the rows from the probe side. This causes the probe side to be considered empty and therefore sets the entire match column to falses, even in rows where the match value should be null.

Reviewed By: Yuhta

Differential Revision: D66903863
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66903863

DanielHunte pushed a commit to DanielHunte/velox that referenced this pull request Dec 14, 2024
…t semi porject join (facebookincubator#11781)

Summary:

Currently, when there are no matches for a null aware right semi project join but the build side has nulls, the dynamic push down filter filters out all the rows from the probe side. This causes the probe side to be considered empty and therefore sets the entire match column to falses, even in rows where the match value should be null.

Reviewed By: Yuhta

Differential Revision: D66903863
DanielHunte pushed a commit to DanielHunte/velox that referenced this pull request Dec 15, 2024
…t semi porject join (facebookincubator#11781)

Summary:

Currently, when there are no matches for a null aware right semi project join but the build side has nulls, the dynamic push down filter filters out all the rows from the probe side. This causes the probe side to be considered empty and therefore sets the entire match column to falses, even in rows where the match value should be null.

Reviewed By: Yuhta

Differential Revision: D66903863
DanielHunte pushed a commit to DanielHunte/velox that referenced this pull request Dec 15, 2024
…t semi porject join (facebookincubator#11781)

Summary:

Currently, when there are no matches for a null aware right semi project join but the build side has nulls, the dynamic push down filter filters out all the rows from the probe side. This causes the probe side to be considered empty and therefore sets the entire match column to falses, even in rows where the match value should be null.

Reviewed By: Yuhta

Differential Revision: D66903863
DanielHunte pushed a commit to DanielHunte/velox that referenced this pull request Dec 15, 2024
…t semi porject join (facebookincubator#11781)

Summary:

Currently, when there are no matches for a null aware right semi project join but the build side has nulls, the dynamic push down filter filters out all the rows from the probe side. This causes the probe side to be considered empty and therefore sets the entire match column to falses, even in rows where the match value should be null.

Reviewed By: Yuhta

Differential Revision: D66903863
DanielHunte pushed a commit to DanielHunte/velox that referenced this pull request Dec 15, 2024
…t semi porject join (facebookincubator#11781)

Summary:

Currently, when there are no matches for a null aware right semi project join but the build side has nulls, the dynamic push down filter filters out all the rows from the probe side. This causes the probe side to be considered empty and therefore sets the entire match column to falses, even in rows where the match value should be null.

Reviewed By: Yuhta

Differential Revision: D66903863
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66903863

DanielHunte pushed a commit to DanielHunte/velox that referenced this pull request Dec 15, 2024
…t semi porject join (facebookincubator#11781)

Summary:

Currently, when there are no matches for a null aware right semi project join but the build side has nulls, the dynamic push down filter filters out all the rows from the probe side. This causes the probe side to be considered empty and therefore sets the entire match column to falses, even in rows where the match value should be null.

Reviewed By: Yuhta

Differential Revision: D66903863
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66903863

DanielHunte pushed a commit to DanielHunte/velox that referenced this pull request Dec 16, 2024
…t semi porject join (facebookincubator#11781)

Summary:

Currently, when there are no matches for a null aware right semi project join but the build side has nulls, the dynamic push down filter filters out all the rows from the probe side. This causes the probe side to be considered empty and therefore sets the entire match column to falses, even in rows where the match value should be null.

Reviewed By: Yuhta

Differential Revision: D66903863
DanielHunte pushed a commit to DanielHunte/velox that referenced this pull request Dec 16, 2024
…t semi porject join (facebookincubator#11781)

Summary:

Currently, when there are no matches for a null aware right semi project join but the build side has nulls, the dynamic push down filter filters out all the rows from the probe side. This causes the probe side to be considered empty and therefore sets the entire match column to falses, even in rows where the match value should be null.

Reviewed By: Yuhta

Differential Revision: D66903863
Daniel Hunte added 4 commits December 15, 2024 20:41
…eferenceQueryRunners (facebookincubator#11566)

Summary:

This change updates both the DuckQueryRunner and PrestoQueryRunner to parse filters in their hasJoinNode toSql methods.

Reviewed By: kagamiori

Differential Revision: D66021799
…ery Runners (facebookincubator#11576)

Summary:

The select clause is completely missing in the produced query string.

Reviewed By: kagamiori

Differential Revision: D66132514
…ilters (facebookincubator#11620)

Summary:

The mayHaveNulls() method sometimes returns true when there are in fact no nulls. This change will make sure that a nullptr isn't passed to memcpy.

Reviewed By: Yuhta

Differential Revision: D66333546
…t semi porject join (facebookincubator#11781)

Summary:

Currently, when there are no matches for a null aware right semi project join but the build side has nulls, the dynamic push down filter filters out all the rows from the probe side. This causes the probe side to be considered empty and therefore sets the entire match column to falses, even in rows where the match value should be null.

Reviewed By: Yuhta

Differential Revision: D66903863
DanielHunte pushed a commit to DanielHunte/velox that referenced this pull request Dec 16, 2024
…t semi porject join (facebookincubator#11781)

Summary:

Currently, when there are no matches for a null aware right semi project join but the build side has nulls, the dynamic push down filter filters out all the rows from the probe side. This causes the probe side to be considered empty and therefore sets the entire match column to falses, even in rows where the match value should be null.

Reviewed By: Yuhta

Differential Revision: D66903863
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66903863

DanielHunte pushed a commit to DanielHunte/velox that referenced this pull request Dec 16, 2024
…t semi porject join (facebookincubator#11781)

Summary:

Currently, when there are no matches for a null aware right semi project join but the build side has nulls, the dynamic push down filter filters out all the rows from the probe side. This causes the probe side to be considered empty and therefore sets the entire match column to falses, even in rows where the match value should be null.

Reviewed By: Yuhta

Differential Revision: D66903863
@facebook-github-bot
Copy link
Contributor

This pull request has been merged in 1bf1b48.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported Merged
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants