Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add close_timeout config to filebeat #87

Open
hloeung opened this issue Jul 26, 2021 · 0 comments
Open

Add close_timeout config to filebeat #87

hloeung opened this issue Jul 26, 2021 · 0 comments

Comments

@hloeung
Copy link

hloeung commented Jul 26, 2021

Hi,

As reported https://bugs.launchpad.net/filebeat-charm/+bug/1875662, we're seeing few instances where filebeat is holding onto older log files. @jetpackdanger pointed out https://www.elastic.co/guide/en/beats/filebeat/current/faq-deleted-files-are-not-freed.html

Any chance we can add a option to tune Filebeat's close_timeout (and possibly set a sensible default such as an hour or two)?
al3jandrosg added a commit to al3jandrosg/layer-filebeat that referenced this issue Feb 6, 2024
@al3jandrosg
Fixing filebeat holding onto old file descriptors
2bd5e65 
Under certain scenariosFilebeat may hold onto old
log file descriptors. There are various settings
on Filebeat to prevent this from happening. This
patch adds to the charm three key settings that
help prevent this issue:

- close_timeout
- ignore_older
- clean_inactive

Fixing: [canonical#87](canonical#87)
@al3jandrosg al3jandrosg mentioned this issue Feb 6, 2024
Merged
al3jandrosg added a commit to al3jandrosg/layer-filebeat that referenced this issue Jun 28, 2024
@al3jandrosg
Fixing filebeat holding onto old file descriptors
19a0f1d 
Under certain scenariosFilebeat may hold onto old
log file descriptors. There are various settings
on Filebeat to prevent this from happening. This
patch adds to the charm three key settings that
help prevent this issue:

- ignore_older
- clean_inactive

Fixing: [canonical#87](canonical#87)
al3jandrosg added a commit to al3jandrosg/layer-filebeat that referenced this issue Jun 28, 2024
@al3jandrosg
Fixing filebeat holding onto old file descriptors
cb029c8 
Under certain scenariosFilebeat may hold onto old
log file descriptors. There are various settings
on Filebeat to prevent this from happening. This
patch adds to the charm three key settings that
help prevent this issue:

- ignore_older
- clean_inactive

Fixing: [canonical#87](canonical#87)
al3jandrosg added a commit to al3jandrosg/layer-filebeat that referenced this issue Jul 18, 2024
@al3jandrosg
Fixing filebeat holding onto old file descriptors
69a9d9f 
Under certain scenariosFilebeat may hold onto old
log file descriptors. There are various settings
on Filebeat to prevent this from happening. This
patch adds to the charm three key settings that
help prevent this issue:

- ignore_older
- clean_inactive

Fixing: [canonical#87](canonical#87)
al3jandrosg added a commit to al3jandrosg/layer-filebeat that referenced this issue Jul 18, 2024
@al3jandrosg
Fixing filebeat holding onto old file descriptors
9e6ad1f 
Under certain scenariosFilebeat may hold onto old
log file descriptors. There are various settings
on Filebeat to prevent this from happening. This
patch adds to the charm three key settings that
help prevent this issue:

- ignore_older
- clean_inactive

Fixing: [canonical#87](canonical#87)
al3jandrosg added a commit to al3jandrosg/layer-filebeat that referenced this issue Jul 18, 2024
@al3jandrosg
Fixing filebeat holding onto old file descriptors
599dd3d 
Under certain scenariosFilebeat may hold onto old
log file descriptors. There are various settings
on Filebeat to prevent this from happening. This
patch adds to the charm three key settings that
help prevent this issue:

- ignore_older
- clean_inactive

Fixing: [canonical#87](canonical#87)
al3jandrosg added a commit to al3jandrosg/layer-filebeat that referenced this issue Jul 18, 2024
@al3jandrosg
Fixing filebeat holding onto old file descriptors
e489c9b 
Under certain scenariosFilebeat may hold onto old
log file descriptors. There are various settings
on Filebeat to prevent this from happening. This
patch adds to the charm three key settings that
help prevent this issue:

- ignore_older
- clean_inactive

Fixing: [canonical#87](canonical#87)
al3jandrosg added a commit to al3jandrosg/layer-filebeat that referenced this issue Jul 18, 2024
@al3jandrosg
Fixing filebeat holding onto old file descriptors
540e638 
Under certain scenariosFilebeat may hold onto old
log file descriptors. There are various settings
on Filebeat to prevent this from happening. This
patch adds to the charm three key settings that
help prevent this issue:

- ignore_older
- clean_inactive

Fixing: [canonical#87](canonical#87)
al3jandrosg added a commit to al3jandrosg/layer-filebeat that referenced this issue Jul 18, 2024
@al3jandrosg
Fixing filebeat holding onto old file descriptors
ce20dbf 
Under certain scenariosFilebeat may hold onto old
log file descriptors. There are various settings
on Filebeat to prevent this from happening. This
patch adds to the charm three key settings that
help prevent this issue:

- ignore_older
- clean_inactive

Fixing: [canonical#87](canonical#87)
al3jandrosg added a commit to al3jandrosg/layer-filebeat that referenced this issue Jul 18, 2024
@al3jandrosg
Fixing filebeat holding onto old file descriptors
efa5b12 
Under certain scenariosFilebeat may hold onto old
log file descriptors. There are various settings
on Filebeat to prevent this from happening. This
patch adds to the charm three key settings that
help prevent this issue:

- ignore_older
- clean_inactive

Fixing: [canonical#87](canonical#87)
al3jandrosg added a commit to al3jandrosg/layer-filebeat that referenced this issue Jul 18, 2024
@al3jandrosg
Fixing filebeat holding onto old file descriptors
a520973 
Under certain scenariosFilebeat may hold onto old
log file descriptors. There are various settings
on Filebeat to prevent this from happening. This
patch adds to the charm three key settings that
help prevent this issue:

- ignore_older
- clean_inactive

Fixing: [canonical#87](canonical#87)
al3jandrosg added a commit to al3jandrosg/layer-filebeat that referenced this issue Jul 18, 2024
@al3jandrosg
Fixing filebeat holding onto old file descriptors
84019c1 
Under certain scenariosFilebeat may hold onto old
log file descriptors. There are various settings
on Filebeat to prevent this from happening. This
patch adds to the charm three key settings that
help prevent this issue:

- ignore_older
- clean_inactive

Fixing: [canonical#87](canonical#87)
al3jandrosg added a commit to al3jandrosg/layer-filebeat that referenced this issue Jul 22, 2024
@al3jandrosg
Fixing filebeat holding onto old file descriptors
54e4c27 
Under certain scenariosFilebeat may hold onto old
log file descriptors. There are various settings
on Filebeat to prevent this from happening. This
patch adds to the charm three key settings that
help prevent this issue:

- ignore_older
- clean_inactive

Fixing: [canonical#87](canonical#87)
al3jandrosg added a commit to al3jandrosg/layer-filebeat that referenced this issue Jul 22, 2024
@al3jandrosg
Fixing filebeat holding onto old file descriptors
8af1614 
Under certain scenariosFilebeat may hold onto old
log file descriptors. There are various settings
on Filebeat to prevent this from happening. This
patch adds to the charm three key settings that
help prevent this issue:

- ignore_older
- clean_inactive

Fixing: [canonical#87](canonical#87)
al3jandrosg added a commit to al3jandrosg/layer-filebeat that referenced this issue Jul 22, 2024
@al3jandrosg
Fixing filebeat holding onto old file descriptors
08e12d1 
Under certain scenariosFilebeat may hold onto old
log file descriptors. There are various settings
on Filebeat to prevent this from happening. This
patch adds to the charm three key settings that
help prevent this issue:

- ignore_older
- clean_inactive

Fixing: [canonical#87](canonical#87)
al3jandrosg added a commit to al3jandrosg/layer-filebeat that referenced this issue Jul 22, 2024
@al3jandrosg
Fixing filebeat holding onto old file descriptors
c970e25 
Under certain scenariosFilebeat may hold onto old
log file descriptors. There are various settings
on Filebeat to prevent this from happening. This
patch adds to the charm three key settings that
help prevent this issue:

- ignore_older
- clean_inactive

Fixing: [canonical#87](canonical#87)
al3jandrosg added a commit to al3jandrosg/layer-filebeat that referenced this issue Jul 23, 2024
@al3jandrosg
Fixing filebeat holding onto old file descriptors
492aa44 
Under certain scenariosFilebeat may hold onto old
log file descriptors. There are various settings
on Filebeat to prevent this from happening. This
patch adds to the charm three key settings that
help prevent this issue:

- ignore_older
- clean_inactive

Fixing: [canonical#87](canonical#87)
aieri pushed a commit that referenced this issue Jul 24, 2024
@al3jandrosg
Fixing filebeat holding onto old file descriptors (#109)
7f8e042 
Under certain scenarios Filebeat may hold onto old
log file descriptors. There are various settings
on Filebeat to prevent this from happening. This
patch adds to the charm two key settings that
help prevent this issue:

- ignore_older
- clean_inactive

Note that while these configuration parameters used
to not be specified in the filebeat config files, they will
now always be rendered. The charm configuration
however aligns with the upstream defaults so this is
not expected to alter behavior of existing
deployments upon upgrading.

Fixing: [#87](#87)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@hloeung