Skip to content

Commit cbfe1e9

Browse files
Update pipeline/inputs/tail.md
Co-authored-by: Alexa Kreizinger <[email protected]> Signed-off-by: Hiroshi Hatake <[email protected]>
1 parent 13595da commit cbfe1e9

File tree

1 file changed

+3
-8
lines changed

1 file changed

+3
-8
lines changed

pipeline/inputs/tail.md

Lines changed: 3 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -79,14 +79,9 @@ If no database file is present, positioning behavior depends on the value of `re
7979
The database file essentially stores `inode=offset` so it should be unique per instance of the plugin, for example if you have two tail inputs then use two separate `db` files for each. That way each tail input can independently track its own state.
8080

8181
{% hint style="info" %}
82-
Note that `Unicode.Encoding` depends on simdutf library which is written in C++11 or above.
83-
So, the older platforms are not supported for this feature.
84-
In addition, `Unicode.Encoding auto` is not covered for the all of the usages.
85-
This is because sometimes this auto-detecting for character encodings makes a mistake to guess the correct encoding.
86-
87-
We recommend to use `UTF-16LE` or `UTF-16BE` if the target file encoding is pre-determined or known beforehand.
88-
In details, this parameter requests to use 2-bytes aligned chunk and buffer sizes.
89-
If they are not aligned for 2 bytes, Fluent Bit will use 2-bytes alignments automatically to avoid character breakages on consuming boundaries.
82+
The `Unicode.Encoding` parameter is dependent on the simdutf library, which is itself dependent on C++ version 11 or later. In environments that use earlier versions of C++, the `Unicode.Encoding` parameter will fail.
83+
84+
Additionally, the `auto` setting for `Unicode.Encoding` isn't supported in all cases, and can make mistakes when it tries to guess the correct encoding. For best results, use either the `UTF-16LE` or `UTF-16BE` setting if you know the encoding type of the target file.
9085
{% endhint %}
9186

9287
## Monitor a large number of files

0 commit comments

Comments
 (0)