Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feat: Add native Kafka integration for Parseable server #936

Closed
nitisht opened this issue Sep 23, 2024 · 6 comments · Fixed by #1021 · May be fixed by #1047
Closed

Feat: Add native Kafka integration for Parseable server #936

nitisht opened this issue Sep 23, 2024 · 6 comments · Fixed by #1021 · May be fixed by #1047
Labels
💎 Bounty

Comments

@nitisht
Copy link
Member

nitisht commented Sep 23, 2024

User should be able to set environment variables to integrate their Kafka cluster with Parseable.

  • Decide which env vars are needed for this integration.
  • Use a Rust Kafka client like https://github.com/kafka-rust/kafka-rust to subscribe to events from the Kafka client.
  • Ingest data from the given Kafka topic.
  • Once events are ingested, merge the binary data from Kafka to the Parseable data ingestion flow.
@parseablehq parseablehq deleted a comment from algora-pbc bot Sep 23, 2024
@algora-pbc algora-pbc bot removed the 💎 Bounty label Sep 23, 2024
@nitisht
Copy link
Member Author

nitisht commented Sep 23, 2024

/bounty 500

@algora-pbc Algora PBC
Copy link

algora-pbc bot commented Sep 23, 2024 •
edited
Loading

💎 $500 bounty • Parseable

Steps to solve:

  1. Start working: Comment /attempt #936 with your implementation plan
  2. Submit work: Create a pull request including /claim #936 in the PR body to claim the bounty
  3. Receive payment: 100% of the bounty is received 2-5 days post-reward. Make sure you are eligible for payouts

Thank you for contributing to parseablehq/parseable!

Add a bounty • Share on socials

Attempt Started (GMT+0) Solution
🟢 @onyedikachi-david Sep 23, 2024, 6:46:53 AM WIP
🟢 @TomBebb Oct 21, 2024, 8:26:21 PM WIP
🟢 @hippalus Nov 18, 2024, 12:44:10 PM WIP

@onyedikachi-david
Copy link

onyedikachi-david commented Sep 23, 2024 •
edited by algora-pbc bot
Loading

/attempt #936

@nitisht: Is this task available for assignment? If not, are you accepting open contributions with the best submission to be selected?

Algora profile Completed bounties Tech Active attempts Options
@onyedikachi-david 7 bounties from 4 projects
JavaScript, Shell
Cancel attempt

@nitisht
Copy link
Member Author

nitisht commented Sep 23, 2024

Hey @onyedikachi-david yes, we'll accept open contributions with the best submission.

@TomBebb
Copy link

TomBebb commented Oct 21, 2024 •
edited by algora-pbc bot
Loading

/attempt #936

Options

@TomBebb TomBebb mentioned this issue Nov 8, 2024
Closed
@hippalus
Copy link

hippalus commented Nov 18, 2024 •
edited by algora-pbc bot
Loading

/attempt #936

Options

This was referenced Dec 4, 2024
Closed
Merged
nitisht added a commit that referenced this issue Dec 20, 2024
@parmesant @nitisht @de-sh
Feature: Enable Kafka integration (#1021)
4d3437c 
Fixes #936

---------

Signed-off-by: parmesant <[email protected]>
Co-authored-by: Nitish Tiwari <[email protected]>
Co-authored-by: Devdutt Shenoi <[email protected]>
hippalus added a commit to hippalus/parseable that referenced this issue Dec 21, 2024
@hippalus
Feat: Add Kafka integration for Parseable server parseablehq#936 .
4cc28cd
@hippalus hippalus mentioned this issue Dec 21, 2024
Draft
7 tasks
parmesant added a commit to parmesant/parseable that referenced this issue Dec 24, 2024
@parmesant @nitisht @de-sh
Feature: Enable Kafka integration (parseablehq#1021)
1b5d433 
Fixes parseablehq#936

---------

Signed-off-by: parmesant <[email protected]>
Co-authored-by: Nitish Tiwari <[email protected]>
Co-authored-by: Devdutt Shenoi <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
💎 Bounty
Projects
None yet
Milestone
No milestone
4 participants
@nitisht @hippalus @TomBebb @onyedikachi-david