continue prost #286

jokemanfire · 2025-02-24T06:03:08Z

work continue with #173

Tim-Zhang · 2025-02-25T06:29:14Z

@jokemanfire I appreciate you taking on this work very much.
Why don't we directly reopen #173 and continue the work?
Just let me know if there are any difficulties.

Thanks agian.

jokemanfire · 2025-02-25T06:42:20Z

@jokemanfire I appreciate you taking on this work very much. Why don't we directly reopen #173 and continue the work? Just let me know if there are any difficulties.

Thanks agian.

There are some conflicts and API changes that need to be resolved and some code needs to be packaged to adapt to the current API. It's not easy to operate with the previous version of PR. I need to add some commit to complete this feature. I have communicated with the original author.

jokemanfire · 2025-03-13T07:05:43Z

@Tim-Zhang @justxuewei Local test all pass but i don't know how to install protoc in CI.

Tim-Zhang · 2025-03-31T02:55:36Z

@jokemanfire FYI
https://github.com/marketplace/actions/setup-protoc
https://www.andreamedda.com/posts/go-buf-github-actions/

jokemanfire · 2025-04-09T09:53:13Z

Basically enough @Tim-Zhang @justxuewei just take a look . :)

justxuewei · 2025-04-10T02:09:42Z

Nice work, thanks @jokemanfire! Could you cleanup your commits? It makes us easier to review and maintain.

Use git rebase instead of git merge.
Modify the commit title to {subsystem}: {brief title for your changes}, and give it a brief introduction in the commit message.
Split your commits, and don't mix bugfixes, refactoring and new features.
Please modify this PR title to something like "codegen: Introduce a new codegen using prost".

Thanks!

This commit refactors the ttrpc-codegen and the compiler, and merges the two crates into a single crate, named "codegen". The codegen uses prost crate, a protobuf compiler for Rust. Signed-off-by: Xuewei Niu <[email protected]>

The ttrpc provides a "prost" feature to support the new version of codegen. An "example2" has been added to demonstrate how to use the codegen. Signed-off-by: Xuewei Niu <[email protected]>

Install protoc when executing `make deps` of the ttrpc. Add codegen's check and build, and example2' build to the ci testing. Signed-off-by: Xuewei Niu <[email protected]>

Fix all issues reported by cargo clippy to make ci testing pass. Signed-off-by: Xuewei Niu <[email protected]>

merge from remote branch. ref: containerd#173 Co-authored-by: Xuewei Niu <[email protected]> Signed-off-by: jokemanfire <[email protected]>

fix ci for protoc Signed-off-by: jokemanfire <[email protected]>

because of the api change 1. fix the marco in prost 2. fix the test Signed-off-by: jokemanfire <[email protected]>

fix rebase error. Signed-off-by: jokemanfire <[email protected]>

jokemanfire · 2025-04-10T06:18:28Z

Nice work, thanks @jokemanfire! Could you cleanup your commits? It makes us easier to review and maintain.好的工作，谢谢！你能清理一下你的提交吗？这让我们更容易审查和维护。

Use git rebase instead of git merge.使用 git rebase 代替 git merge 。

Modify the commit title to {subsystem}: {brief title for your changes}, and give it a brief introduction in the commit message.修改提交标题为 {subsystem}: {brief title for your changes} ，并在提交信息中简要介绍。

Split your commits, and don't mix bugfixes, refactoring and new features.拆分您的提交，不要混合修复错误、重构和新功能。

Please modify this PR title to something like "codegen: Introduce a new codegen using prost".请将此 PR 标题修改为类似于“codegen：引入使用 prost 的新代码生成器”的标题。

Thanks! 谢谢！

I have changed it.

skip build example2 in windows Signed-off-by: jokemanfire <[email protected]>

justxuewei · 2025-04-10T09:15:52Z

Once this feature gets merged, I prefer to bump a major version to 2 to avoid some compatibility issues, as it nearly changes the entire codegen engine. WDYT? @jokemanfire @Tim-Zhang

jokemanfire · 2025-04-10T11:21:09Z

Once this feature gets merged, I prefer to bump a major version to 2 to avoid some compatibility issues, as it nearly changes the entire codegen engine. WDYT? 一旦这个功能合并，我更倾向于将主版本号提升到 2，以避免一些兼容性问题，因为它几乎改变了整个代码生成引擎。你怎么看？@jokemanfire @Tim-Zhang

This modification is indeed quite significant, and I agree. It depends on the maintainer's thoughts

Tim-Zhang · 2025-04-16T06:25:16Z

build.rs

@@ -7,6 +7,11 @@ fn main() {
    let path: PathBuf = [out_dir.clone(), "mod.rs".to_string()].iter().collect();
    fs::write(path, "pub mod ttrpc;").unwrap();

+    generate_ttrpc(&out_dir);


To get unified internal APIs which was defined in ttrpc.proto, how about keeping build script untouched?

I think we can try to avoid so many condition compiling sentences like #[cfg(not(feature = "prost"))] in code.

right ,I think adding a transformation to the camel hump naming convention can reduce this conditional compilation code

while use protoc,rename the Code enum. Signed-off-by: jokemanfire <[email protected]>

fix marco Signed-off-by: jokemanfire <[email protected]>

jokemanfire · 2025-05-08T06:25:28Z

I tried to minimize conditional compilation as much as possible @Tim-Zhang @justxuewei

jokemanfire changed the title ~~continue prost~~ continue prost (not complete) Feb 24, 2025

jokemanfire force-pushed the prost branch from ee4481d to 2bad764 Compare February 28, 2025 14:14

jokemanfire force-pushed the prost branch 2 times, most recently from dcf4304 to 781c816 Compare March 13, 2025 07:00

jokemanfire changed the title ~~continue prost (not complete)~~ continue prost Mar 13, 2025

jokemanfire force-pushed the prost branch 3 times, most recently from 21ebbd3 to 4a76b7b Compare April 1, 2025 12:19

jokemanfire force-pushed the prost branch 3 times, most recently from a29312f to 5fadae0 Compare April 9, 2025 09:50

jokemanfire force-pushed the prost branch from 5fadae0 to b74a116 Compare April 10, 2025 01:58

justxuewei and others added 7 commits April 10, 2025 11:19

codegen: Introduce a new codegen using prost

e777fc9

This commit refactors the ttrpc-codegen and the compiler, and merges the two crates into a single crate, named "codegen". The codegen uses prost crate, a protobuf compiler for Rust. Signed-off-by: Xuewei Niu <[email protected]>

ttrpc-rust: Support the new version of codegen

c8bacbd

The ttrpc provides a "prost" feature to support the new version of codegen. An "example2" has been added to demonstrate how to use the codegen. Signed-off-by: Xuewei Niu <[email protected]>

ci: Add codegen-related ci testing

da8166f

Install protoc when executing `make deps` of the ttrpc. Add codegen's check and build, and example2' build to the ci testing. Signed-off-by: Xuewei Niu <[email protected]>

codegen: Fix issues reported by cargo clippy

8e32522

Fix all issues reported by cargo clippy to make ci testing pass. Signed-off-by: Xuewei Niu <[email protected]>

fix: prost compile faild.

0ff5ede

merge from remote branch. ref: containerd#173 Co-authored-by: Xuewei Niu <[email protected]> Signed-off-by: jokemanfire <[email protected]>

ci: change protoc install script in ci

5237576

fix ci for protoc Signed-off-by: jokemanfire <[email protected]>

fix: fix test in protoc async

23256d3

because of the api change 1. fix the marco in prost 2. fix the test Signed-off-by: jokemanfire <[email protected]>

jokemanfire force-pushed the prost branch from b74a116 to 23256d3 Compare April 10, 2025 05:53

fix: fix the rebase caused the error

eadbd7b

fix rebase error. Signed-off-by: jokemanfire <[email protected]>

jokemanfire force-pushed the prost branch 2 times, most recently from aa000cc to 4da8148 Compare April 10, 2025 06:54

jokemanfire force-pushed the prost branch 2 times, most recently from b25b1a0 to 00fce61 Compare April 10, 2025 07:24

fix(example2): skip build example2 in windows

735a10e

skip build example2 in windows Signed-off-by: jokemanfire <[email protected]>

jokemanfire force-pushed the prost branch from 00fce61 to 735a10e Compare April 10, 2025 07:40

Tim-Zhang reviewed Apr 16, 2025

View reviewed changes

jokemanfire added 2 commits May 8, 2025 12:47

fix(build.rs): reduce the Code which is enum's difference

ce3c169

while use protoc,rename the Code enum. Signed-off-by: jokemanfire <[email protected]>

fix(macro): change marco's enum to same

26b0146

fix marco Signed-off-by: jokemanfire <[email protected]>

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

continue prost #286

continue prost #286

Uh oh!

jokemanfire commented Feb 24, 2025

Uh oh!

Tim-Zhang commented Feb 25, 2025 •

edited

Loading

Uh oh!

jokemanfire commented Feb 25, 2025

Uh oh!

jokemanfire commented Mar 13, 2025

Uh oh!

Tim-Zhang commented Mar 31, 2025

Uh oh!

jokemanfire commented Apr 9, 2025 •

edited

Loading

Uh oh!

justxuewei commented Apr 10, 2025 •

edited

Loading

Uh oh!

jokemanfire commented Apr 10, 2025

Uh oh!

justxuewei commented Apr 10, 2025

Uh oh!

jokemanfire commented Apr 10, 2025

Uh oh!

Tim-Zhang Apr 16, 2025

Uh oh!

jokemanfire Apr 30, 2025

Uh oh!

jokemanfire commented May 8, 2025

Uh oh!

Uh oh!

continue prost #286

Are you sure you want to change the base?

continue prost #286

Uh oh!

Conversation

jokemanfire commented Feb 24, 2025

Uh oh!

Tim-Zhang commented Feb 25, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

jokemanfire commented Feb 25, 2025

Uh oh!

jokemanfire commented Mar 13, 2025

Uh oh!

Tim-Zhang commented Mar 31, 2025

Uh oh!

jokemanfire commented Apr 9, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

justxuewei commented Apr 10, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

jokemanfire commented Apr 10, 2025

Uh oh!

justxuewei commented Apr 10, 2025

Uh oh!

jokemanfire commented Apr 10, 2025

Uh oh!

Tim-Zhang Apr 16, 2025

Choose a reason for hiding this comment

Uh oh!

jokemanfire Apr 30, 2025

Choose a reason for hiding this comment

Uh oh!

jokemanfire commented May 8, 2025

Uh oh!

Uh oh!

Tim-Zhang commented Feb 25, 2025 •

edited

Loading

jokemanfire commented Apr 9, 2025 •

edited

Loading

justxuewei commented Apr 10, 2025 •

edited

Loading