Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] Support raw API #17

Open
yarinm opened this issue Nov 7, 2018 · 10 comments
Open

[Feature] Support raw API #17

yarinm opened this issue Nov 7, 2018 · 10 comments
Labels
enhancement New feature or request

Comments

@yarinm
Copy link

yarinm commented Nov 7, 2018

It could be useful to add support for the /raw api of HEC.
When using the /event endpoint some rules (like LINEMERGE/BREAK) don't work and they only work when batching the logs in the raw endpoint.

@dtregonning
Copy link
Contributor

Hi @yarinm - i agree. For most of our connectors that are sending things to Splunk via HEC we add support for both endpoints.

@matthewmodestino matthewmodestino added the enhancement New feature or request label Dec 6, 2018
@SVPA-LenPistoria
Copy link

This feature would be greatly appreciated! The JSON endpoint for the HEC doesn't do timestamp extraction so we're unable to post-process the timestamp via props.conf. So our events (coming in through ingested CSV files) all reflect ingest time instead of the actual occurrence time (contained in a field within the csv lines). Splunk allows timestamp extraction from the raw endpoint.

@yarinm
Copy link
Author

yarinm commented Dec 19, 2018

@SVPA-LenPistoria you should take a look at my PR #18

It adds the ability to define a field in the record that will be used as the event time when sending this to HEC

@SVPA-LenPistoria
Copy link

@yarinm This would be an even-better solution to my woes! Let's hope your PR gets merged soon! Thanks!

@mark-sivill-splunk
Copy link

+1 on sending via the raw endpoint. I'm keen to use Splunk to do the timestamp extraction rather than trying to do it within fluent.

@hovu96
Copy link

hovu96 commented Jul 19, 2019

From my point of view, line breaking/merging should be done on Splunk side. I created prototype and there is also this branch, both adding an option for using the RAW endpoint instead of the EVENT endpoint. I tested it and it worked for me. Many Splunk customers are asking for this. Anyone interested in working on a PR?

@jsiegele
Copy link

Are there any news on this Issue? we are looking forward to use the raw endpoint.
Right now we are not able to get a "java-stracktrace" as a single event into splunk.

@anthonyhaussman
Copy link

I'm really interested to add the possibility to send via the raw endpoint too. Is there any news?

@leowinterde
Copy link

leowinterde commented Jul 20, 2022

Is there any plan to implement this feature?

@edgsantos
Copy link

any update on this?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

10 participants