Skip to content
@arcalot

Arcalot

Another Repository Containing A Lot Of Things: well-scoped & well-tested! Create workflows and workloads, write/use plugins, simplify debugging. Join us!

Arcalot logo showing a shield with the Arcalot inscription on a hill with the 
silhouette of a castle in the background

The Arcalot community is dedicated to developing modular tools, plugins, and libraries with flexible implementations to be used independently or as complete end-to-end solutions. We believe in enabling automation and portability of complex tasks and in pre-validating actions to avoid costly re-runs due to late failures and incompatible data.


Arcaflow logo showing a waterfall and a river with 3 trees symbolizing the various
plugins

Arcaflow is a workflow orchestration system consisting of three main components:



Arcaflow is highly-flexible and portable, helping you to build pipelines of actions via plugins. Plugin steps typically perform one action well, creating or manipulating data that is returned in a machine-readable format. Data is validated according to schemas as it passes through the pipeline in order to clearly diagnose type mismatch problems early. Arcaflow runs on your laptop, a jump host, or in a CI system, requiring only the Arcaflow engine binary, a workflow definition in YAML, and a compatible container runtime.

Arcaflow allows you to encapsulate and version-control expertise, making potentially very complex workflows easily portable among environments and automation systems. With an Arcaflow workflow, you can carefully craft a pipeline of actions that serves your direct needs and share that workflow virtually unchanged for others to run in different environments and CI/CD systems.

An ever-growing catalog of official plugins are maintained within the Arcalot organization and are available as versioned containers from Quay.io. You can also build your own containerized plugins using the the Arcaflow SDK, available for Python and Golang. We encourage you to contribute your plugins to the community, and you can start by adding them to the plugins incubator repo via a pull request.


image

Documentation

We work hard to bring the documentation to the user, meaning that you should find a lot of relevant documentation in the context of what you may be working on via readme files, be it the engine, the SDK, a plugin, a workflow, or a sub-component. Comprehensive documentation, developer references, and quickstart guides will always be located in the arcalot.io pages.

Community

We invite you to contribute! Check out the Issues in the individual repositories for ideas on where to get involved, or consider contributing a new plugin by starting with our python plugin template repository. Outside contributions and pull requests are of course always welcome.

If you want to get more involved with contributions, maintenance, and governance, consider joining the Arcalot Round Table (ART), our central community body. The ART currently holds bi-weekly video conference meetings. Please reach out to one of our ART chairs for more information.

You can find our general community health files like our code of conduct and contribution guidelines in the .github repository. If you have any questions or suggestions, please use the Issues in the respective repository.

Pinned Loading

  1. arcaflow-engine arcaflow-engine Public

    Arcaflow is a highly-portable workflow engine enabling modular and validated pipelines through containerized plugins.

    Go 7 9

  2. arcaflow-plugin-sdk-python arcaflow-plugin-sdk-python Public

    Python SDK for creating Arcaflow plugins

    Python 4 8

  3. arcalot-round-table arcalot-round-table Public

    The ART: Community governance and decisions with equal voting rights in our round table - come join us!

    2 15

  4. arcaflow-plugin-sdk-go arcaflow-plugin-sdk-go Public

    Go SDK for writing Arcaflow plugins

    Go 1 4

  5. arcaflow-plugin-template-python arcaflow-plugin-template-python Public template

    Template repository for Python plugins for Arcaflow

    Python 8

  6. arcaflow-workflows arcaflow-workflows Public

    Example workflows for Arcaflow

    5

Repositories

Showing 10 of 62 repositories

Top languages

Loading…

Most used topics

Loading…