Skip to content
/ clp Public

Compressed Log Processor (CLP) is a free log management tool capable of compressing logs and searching the compressed logs without decompression.

License

Notifications You must be signed in to change notification settings

y-scope/clp

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

CLP

Open bug reports Open feature requests CLP on Zulip

Compressed Log Processor (CLP) is a tool capable of losslessly compressing text logs and searching the compressed logs without decompression. To learn more about it, you can read our paper.

Getting Started

You can download a release from the releases page or you can build the latest by using the packager.

For some logs you can use to test CLP, check out our open-source datasets.

Providing Feedback

You can use GitHub issues to report a bug or request a feature.

Join us on Zulip to chat with developers and other community members.

Project Structure

CLP is currently split across a few different components in the components directory:

  • clp-py-utils contains Python utilities common to several of the other components.
  • compression-job-handler contains code to submit compression jobs to a cluster.
  • core contains code to compress uncompressed logs, decompress compressed logs, and search compressed logs.
  • job-orchestration contains code to schedule compression jobs on the cluster.
  • package-template contains the base directory structure and files of the CLP package.

Packages

The packages held by this repository are:

  1. Docker Image clp/clp-core-dependencies-x86-ubuntu-focal
    • A docker image containing all the necessary dependencies to build CLP core in an Ubuntu Focal x86 environment
  2. Docker Image clp/clp-core-dependencies-x86-ubuntu-bionic
    • A docker image containing all the necessary dependencies to build CLP core in an Ubuntu Bionic x86 environment
  3. Docker Image clp/clp-core-dependencies-x86-centos7.4
    • A docker image containing all the necessary dependencies to build CLP core in a Centos 7.4 x86 environment
  4. Docker Image clp/clp-execution-x86-ubuntu-focal
    • A docker image containing all the necessary dependencies to run the full CLP package in an x86 environment
  5. Docker Image clp/clp-core-x86-ubuntu-focal
    • A docker image containing CLP (clp, clg, clo, etc.) binaries built in an Ubuntu Focal x86 environment

Next Steps

This is our open-source release which we will be constantly updating with bug fixes, features, etc. If you would like a feature or want to report a bug, please file an issue and we'll be happy to engage. We also welcome any contributions!