Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DO NOT MERGE Kafka/data/noticket/rpcs smashup #24150

Draft
wants to merge 9 commits into
base: dev
Choose a base branch
from

Conversation

oleiman
Copy link
Member

@oleiman oleiman commented Nov 15, 2024

.

Backports Required

  • none - not a bug fix
  • none - this is a backport
  • none - issue does not exist in previous branches
  • none - papercut/not impactful enough to backport
  • v24.2.x
  • v24.1.x
  • v23.3.x

Release Notes

  • none

@oleiman oleiman self-assigned this Nov 15, 2024
@oleiman oleiman force-pushed the kafka/data/noticket/rpcs-smashup branch from dae90a7 to d10b534 Compare November 16, 2024 04:31
@oleiman oleiman marked this pull request as ready for review November 18, 2024 18:18
@oleiman oleiman marked this pull request as draft November 18, 2024 18:18
and remove janky fwd declaration from audit_log_manager.h
…ring)

Probably some of this stuff could/should come OUT into k/d
But the issue here is that at some point I decided to plump
the k/d/rpc client DOWN into x/rpc/client, which mean I have
to have one all set up in order to run these tests.

maybe instead of injecting k/d/rpc into x/rpc, could just inject
into the transform service alongside the existing one. so test code
looks the same, and you don't have this weird cross dependency and
so on.

Problem with that is that I'd like to migrate all the topic creator
actions from x/rpc to k/d way (rather than using topic creator directly)
so you'd need a client in there for that. but maybe like an rpc client
is sort of the wrong place for those bits to coexist anyway...

partition manager is the other thing with a bunch of duplication.
would be cool if the xform specific stuff could be a mixin of some
sort for the basic one that works on kafka proxies.
Remove duplicated code from x/rpc and fix up tests accordingly.

Note that the "client produces records" test is not really relevant
here. It is moved to k/d/rpc/test in another commit.
requires a bunch of test fenagling but the partition manager guts diverge.

there's this produce path in local_service that's only called through the
transform specific client APIs... maybe those can be generalized out in the
x::rpc::client, but I figure there's work that wants to be done _after_ the
network hop. Or something like that.
@oleiman oleiman force-pushed the kafka/data/noticket/rpcs-smashup branch from d10b534 to c84ad42 Compare November 27, 2024 00:08
@oleiman oleiman force-pushed the kafka/data/noticket/rpcs-smashup branch from c84ad42 to 40ee469 Compare November 27, 2024 03:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant