Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[KYUUBI #5446][AUTHZ] Support Create/Drop/Show/Reresh index command for Hudi #5448

Closed
wants to merge 26 commits into from

Conversation

AngersZhuuuu
Copy link
Contributor

@AngersZhuuuu AngersZhuuuu commented Oct 17, 2023

Why are the changes needed?

To close #5446. Kyuubi authz support Create/Drop/Show/Reresh index based command

IndexBasedCommand SQL grammer is in https://github.com/apache/hudi/blob/master/hudi-spark-datasource/hudi-spark/src/main/antlr4/org/apache/hudi/spark/sql/parser/HoodieSqlCommon.g4

Below command under https://github.com/apache/hudi/blob/master/hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/IndexCommands.scala

  • CreateIndexCommand
  • DropIndexCommand
  • RefreshIndexCommand
  • ShowIndexesCommand

How was this patch tested?

  • Add some test cases that check the changes thoroughly including negative and positive cases if possible

  • Add screenshots for manual tests if appropriate

  • Run test locally before make a pull request

Was this patch authored or co-authored using generative AI tooling?

No

@pan3793 pan3793 changed the title [KYUUBI-5446][AUTHZ] Support Create/Drop/Show/Reresh index command [KYUUBI #5446][AUTHZ] Support Create/Drop/Show/Reresh index command Oct 18, 2023
@codecov-commenter
Copy link

codecov-commenter commented Oct 18, 2023

Codecov Report

Merging #5448 (52f67e9) into master (03d6223) will not change coverage.
Report is 14 commits behind head on master.
The diff coverage is n/a.

❗ Current head 52f67e9 differs from pull request most recent head 1be0561. Consider uploading reports for the commit 1be0561 to get more accurate results

@@          Coverage Diff           @@
##           master   #5448   +/-   ##
======================================
  Coverage    0.00%   0.00%           
======================================
  Files         588     588           
  Lines       33480   33466   -14     
  Branches     4405    4401    -4     
======================================
+ Misses      33480   33466   -14     

see 2 files with indirect coverage changes

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@bowenliang123 bowenliang123 changed the title [KYUUBI #5446][AUTHZ] Support Create/Drop/Show/Reresh index command [KYUUBI #5446][AUTHZ] Support Create/Drop/Show/Reresh index command for Hudi Oct 18, 2023
@AngersZhuuuu
Copy link
Contributor Author

Ping @yaooqinn Could you take a view again?

@yaooqinn yaooqinn added this to the v1.9.0 milestone Oct 25, 2023
@yaooqinn
Copy link
Member

This is an excellent feature to have!

Thanks @AngersZhuuuu merged to master

@yaooqinn yaooqinn closed this in f4f5466 Oct 25, 2023
davidyuan1223 pushed a commit to davidyuan1223/kyuubi that referenced this pull request Oct 26, 2023
…mand for Hudi

### _Why are the changes needed?_
To close apache#5446. Kyuubi authz support Create/Drop/Show/Reresh index based command

IndexBasedCommand SQL grammer is in https://github.com/apache/hudi/blob/master/hudi-spark-datasource/hudi-spark/src/main/antlr4/org/apache/hudi/spark/sql/parser/HoodieSqlCommon.g4

Below command under https://github.com/apache/hudi/blob/master/hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/IndexCommands.scala

- CreateIndexCommand
- DropIndexCommand
- RefreshIndexCommand
- ShowIndexesCommand

### _How was this patch tested?_
- [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [ ] [Run test](https://kyuubi.readthedocs.io/en/master/contributing/code/testing.html#running-tests) locally before make a pull request

### _Was this patch authored or co-authored using generative AI tooling?_
No

Closes apache#5448 from AngersZhuuuu/KYUUBI-5446.

Closes apache#5446

1be0561 [Angerszhuuuu] Update ObjectType.scala
c4ae073 [Angerszhuuuu] follow comment
ed1544e [Angerszhuuuu] Update
214bb86 [Angerszhuuuu] Update OperationType.scala
97cb0f8 [Angerszhuuuu] Update PrivilegeObject.scala
bc65abd [Angerszhuuuu] update
0e6f6df [Angerszhuuuu] Update
4019f45 [Angerszhuuuu] update
dc9188d [Angerszhuuuu] update
f9a398c [Angerszhuuuu] Merge branch 'master' into KYUUBI-5446
52f67e9 [Angerszhuuuu] update
bed945e [Angerszhuuuu] Merge branch 'master' into KYUUBI-5446
f174ef2 [Angerszhuuuu] Update table_command_spec.json
4764531 [Angerszhuuuu] Merge branch 'master' into KYUUBI-5446
a78425b [Angerszhuuuu] Update HudiCommands.scala
81881db [Angerszhuuuu] Update HudiCommands.scala
544a443 [Angerszhuuuu] Update HudiCommands.scala
aed91cd [Angerszhuuuu] Merge branch 'master' into KYUUBI-5446
9632886 [Angerszhuuuu] Update HudiCatalogRangerSparkExtensionSuite.scala
c404fd7 [Angerszhuuuu] Update HudiCatalogRangerSparkExtensionSuite.scala
e70c8f1 [Angerszhuuuu] Update HudiCatalogRangerSparkExtensionSuite.scala
fefb021 [Angerszhuuuu] Update table_command_spec.json
ab8b96d [Angerszhuuuu] Merge branch 'master' into KYUUBI-5446
fcb3d45 [Angerszhuuuu] Update HudiCatalogRangerSparkExtensionSuite.scala
b1657d9 [Angerszhuuuu] follow comment
0222e02 [Angerszhuuuu] [KYUUBI-5446][AUTHZ] Support Create/Drop/Show/Reresh index command

Authored-by: Angerszhuuuu <[email protected]>
Signed-off-by: Kent Yao <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[TASK][EASY] Support Create/Drop/Refresh index command
5 participants