[bug] screenpipe uses ~400gb of disk space

[twilwa]

describe the bug
brief description of the bug.

system info

• os: [e.g. macos 10.15.7, windows 10, ubuntu 20.04] macos sequoia
• screenpipe version: [e.g. 1.2.3] 0.27

additional context
add any other context, screenshots, or error logs here.

• you can find logs in ~/.screenpipe on macOS/Linux, and %APPDATA%\.screenpipe on Windows.
• you can get app logs by right clicking in the app background and clicking the console tab.

curious if i can check if it's hallucinating, but when watching my storage it's ticking down fairly consistently while screenpipe is open. doesn't indicate where that disk usage is happening, going to uninstall and see if this helps

[twilwa]

found the culprits i think, i can't imagine this is intended behavior. will reinstall and see if issue persists

[tribhuwan-kumar]

[hunnywar]

@twilwa are you running screenpipe 24*7 ?
thats great BTW :)
@louis030195 We need log rotation

[hunnywar]

Implement Log Rotation

Limit Log Size: Rotate logs when they exceed a specified size (e.g., 50 MB).
Max Log Files: Keep only a fixed number of old log files (e.g., 5) to prevent storage issues.

Implementation:
Use Rust libraries like:

flexi_logger (recommended for simple rotation).
log4rs (more customizable).

[hunnywar]

@tribhuwan-kumar

damh !
so relatable

[louis030195]

hmm

[louis030195]

had this issue before thought we solved it

[louis030195]

[louis030195]

might be a edge case, say something crashed a lot in a loop generating bunch of logs? just guessing

screenpipe/screenpipe-server/src/bin/screenpipe-server.rs

Line 77 in 6fdd4a6

fn setup_logging(local_data_dir: &PathBuf, cli: &Cli) -> anyhow::Result<WorkerGuard> {

yeah indeed

we rotate on day not on size