-
Notifications
You must be signed in to change notification settings - Fork 31
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Substrait] Implement simple extensions. #853
Merged
ingomueller-net
merged 2 commits into
iree-org:main
from
ingomueller-net:substrait-simple-extensions
Jul 31, 2024
Merged
[Substrait] Implement simple extensions. #853
ingomueller-net
merged 2 commits into
iree-org:main
from
ingomueller-net:substrait-simple-extensions
Jul 31, 2024
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
ingomueller-net
force-pushed
the
substrait-simple-extensions
branch
6 times, most recently
from
July 19, 2024 09:56
df3bd1e
to
9b32ee5
Compare
ingomueller-net
changed the title
WIP: [Substrait] Implement simple extensions.
[Substrait] Implement simple extensions.
Jul 19, 2024
ingomueller-net
force-pushed
the
substrait-simple-extensions
branch
from
July 19, 2024 10:35
9b32ee5
to
8fe00d2
Compare
ingomueller-net
force-pushed
the
substrait-simple-extensions
branch
2 times, most recently
from
July 22, 2024 10:21
5f7e841
to
662a78d
Compare
ingomueller-net
added a commit
to ingomueller-net/iree-llvm-sandbox
that referenced
this pull request
Jul 22, 2024
This allows to use the externally declared functions from iree-org#853 as scalar function calls (which have the semantics of a typical function call). The current design anticipates that aggregate and window functions can be modelled with the same op, but future PR will need to show if and how that is possible. Signed-off-by: Ingo Müller <[email protected]>
jpienaar
approved these changes
Jul 22, 2024
This is a mechanism of Substrait to define functions and types external to the core specification. This PR models the declarations as `Symbol`s and references to them as symbol references in MLIR, which allows to use MLIR tooling around symbols (such as `SymbolTable`s, iterating over symbol uses, code navigation via the LSP server, etc.). The PR does not yet implement a mechanism to use the functions and types, which subsequent PRs for `ScalarFunction` and similar are going to do. While touching the `PlanOp`-related test cases, this op also merges the tests of that op, which were previously split into a "simple" and a "version" file, which probably predates the possibility to tell `mlir-translate` (and custom variants) to use output splitters. Signed-off-by: Ingo Müller <[email protected]>
In the meantime, `main` contains tests that used `func.call` ops to prevent further pattern application. This breaks with this PR, which makes `plan`s a `SymbolTable`, which become the closest symbol table of the `func.call`s, such that those symbols cannot be found anymore. As a solution, this commit changes the unit tests to use an opaque op from an unregistered dialect. Signed-off-by: Ingo Müller <[email protected]>
ingomueller-net
force-pushed
the
substrait-simple-extensions
branch
from
July 31, 2024 08:30
662a78d
to
35b8f45
Compare
ingomueller-net
added a commit
to ingomueller-net/iree-llvm-sandbox
that referenced
this pull request
Jul 31, 2024
This allows to use the externally declared functions from iree-org#853 as scalar function calls (which have the semantics of a typical function call). The current design anticipates that aggregate and window functions can be modelled with the same op, but future PR will need to show if and how that is possible. Signed-off-by: Ingo Müller <[email protected]>
ingomueller-net
added a commit
to ingomueller-net/iree-llvm-sandbox
that referenced
this pull request
Jul 31, 2024
This allows to use the externally declared functions from iree-org#853 as scalar function calls (which have the semantics of a typical function call). The current design anticipates that aggregate and window functions can be modelled with the same op, but future PR will need to show if and how that is possible. Signed-off-by: Ingo Müller <[email protected]>
ingomueller-net
added a commit
to ingomueller-net/iree-llvm-sandbox
that referenced
this pull request
Jul 31, 2024
This allows to use the externally declared functions from iree-org#853 as scalar function calls (which have the semantics of a typical function call). The current design anticipates that aggregate and window functions can be modelled with the same op, but future PR will need to show if and how that is possible. Signed-off-by: Ingo Müller <[email protected]>
ingomueller-net
added a commit
that referenced
this pull request
Jul 31, 2024
This allows to use the externally declared functions from #853 as scalar function calls (which have the semantics of a typical function call). The current design anticipates that aggregate and window functions can be modelled with the same op, but future PR will need to show if and how that is possible. Signed-off-by: Ingo Müller <[email protected]>
ingomueller-net
added a commit
to substrait-io/substrait-mlir-contrib
that referenced
this pull request
Oct 15, 2024
) This is a mechanism of Substrait to define functions and types external to the core specification. This PR models the declarations as `Symbol`s and references to them as symbol references in MLIR, which allows to use MLIR tooling around symbols (such as `SymbolTable`s, iterating over symbol uses, code navigation via the LSP server, etc.). The PR does not yet implement a mechanism to use the functions and types, which subsequent PRs for `ScalarFunction` and similar are going to do. In the meantime, `main` contains tests that used `func.call` ops to prevent further pattern application. This breaks with this PR, which makes `plan`s a `SymbolTable`, which become the closest symbol table of the `func.call`s, such that those symbols cannot be found anymore. As a solution, this PR also changes the unit tests to use an opaque op from an unregistered dialect. While touching the `PlanOp`-related test cases, this op also merges the tests of that op, which were previously split into a "simple" and a "version" file, which probably predates the possibility to tell `mlir-translate` (and custom variants) to use output splitters. Signed-off-by: Ingo Müller <[email protected]>
ingomueller-net
added a commit
to substrait-io/substrait-mlir-contrib
that referenced
this pull request
Oct 15, 2024
…g/iree-llvm-sandbox#855) This allows to use the externally declared functions from iree-org/iree-llvm-sandbox#853 as scalar function calls (which have the semantics of a typical function call). The current design anticipates that aggregate and window functions can be modelled with the same op, but future PR will need to show if and how that is possible. Signed-off-by: Ingo Müller <[email protected]>
ingomueller-net
added a commit
to substrait-io/substrait-mlir-contrib
that referenced
this pull request
Oct 15, 2024
) This is a mechanism of Substrait to define functions and types external to the core specification. This PR models the declarations as `Symbol`s and references to them as symbol references in MLIR, which allows to use MLIR tooling around symbols (such as `SymbolTable`s, iterating over symbol uses, code navigation via the LSP server, etc.). The PR does not yet implement a mechanism to use the functions and types, which subsequent PRs for `ScalarFunction` and similar are going to do. In the meantime, `main` contains tests that used `func.call` ops to prevent further pattern application. This breaks with this PR, which makes `plan`s a `SymbolTable`, which become the closest symbol table of the `func.call`s, such that those symbols cannot be found anymore. As a solution, this PR also changes the unit tests to use an opaque op from an unregistered dialect. While touching the `PlanOp`-related test cases, this op also merges the tests of that op, which were previously split into a "simple" and a "version" file, which probably predates the possibility to tell `mlir-translate` (and custom variants) to use output splitters. Signed-off-by: Ingo Müller <[email protected]>
ingomueller-net
added a commit
to substrait-io/substrait-mlir-contrib
that referenced
this pull request
Oct 15, 2024
…g/iree-llvm-sandbox#855) This allows to use the externally declared functions from iree-org/iree-llvm-sandbox#853 as scalar function calls (which have the semantics of a typical function call). The current design anticipates that aggregate and window functions can be modelled with the same op, but future PR will need to show if and how that is possible. Signed-off-by: Ingo Müller <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This is a mechanism of Substrait to define functions and types external
to the core specification. This PR models the declarations as
Symbol
sand references to them as symbol references in MLIR, which allows to use
MLIR tooling around symbols (such as
SymbolTable
s, iterating oversymbol uses, code navigation via the LSP server, etc.). The PR does not
yet implement a mechanism to use the functions and types, which
subsequent PRs for
ScalarFunction
and similar are going to do.While touching the
PlanOp
-related test cases, this op also merges thetests of that op, which were previously split into a "simple" and a
"version" file, which probably predates the possibility to tell
mlir-translate
(and custom variants) to use output splitters.