Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] 优化 spark-doris-connector jar 大小 #255

Open
2 of 3 tasks
melin opened this issue Jan 7, 2025 · 3 comments
Open
2 of 3 tasks

[Feature] 优化 spark-doris-connector jar 大小 #255

melin opened this issue Jan 7, 2025 · 3 comments

Comments

@melin
Copy link

melin commented Jan 7, 2025

Search before asking

  • I had searched in the issues and found no similar issues.

Description

建议优化一下spark-doris-connector jar 大小,当前jar 中包含了很多spark jars目录已经存在jar。
还包含calcite jar 是否必要?
image

Use case

No response

Related issues

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@gnehil
Copy link
Contributor

gnehil commented Jan 9, 2025

Calcite is referenced by arrow jdbc. Since arrow jdbc is not used yet, the related dependency will be removed in the next version.

@melin
Copy link
Author

melin commented Jan 9, 2025

Can eclipse collection be removed?

Calcite is referenced by arrow jdbc. Since arrow jdbc is not used yet, the related dependency will be removed in the next version.

@melin
Copy link
Author

melin commented Feb 12, 2025

Calcite is referenced by arrow jdbc. Since arrow jdbc is not used yet, the related dependency will be removed in the next version.

commons jar ,spark 中也存在,麻烦去掉,容易导致冲突。

Image Image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants