Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

一行数据被截取成了两条 #1088

Open
libinbin-1014 opened this issue Jul 8, 2020 · 1 comment
Open

一行数据被截取成了两条 #1088

libinbin-1014 opened this issue Jul 8, 2020 · 1 comment

Comments

@libinbin-1014
Copy link

libinbin-1014 commented Jul 8, 2020

Bug Report

从文件中读取数据,写入kafka
由于日志文件使用flush刷新写入,一条数据如果如果只写进去了一半,这是logkit就已经将数据读取发送了,后半段的数据会变成第二条继续发送。

python代码写入数据
image

理论上我只写进去了2条数据,但是logkit确解析成了3条
image

@PapaPiya
Copy link
Contributor

新版会使用缓冲池存储最后一部分数据来保证读取到完整的一行。
the lastest version use buff to sotre data for a few seconds to ensure the whole line have been read. closed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants