Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CLI: conduit run [--connectors.path] [...] #2018

Closed
raulb opened this issue Dec 18, 2024 · 0 comments · Fixed by #2038
Closed

CLI: conduit run [--connectors.path] [...] #2018

raulb opened this issue Dec 18, 2024 · 0 comments · Fixed by #2038
Labels
feature New feature or request

Comments

@raulb
Copy link
Member

raulb commented Dec 18, 2024

This command will run Conduit with all the configured pipelines, connectors, and processors.

It is equivalent to the current conduit command as of time of this writing.

Conduit will run based on --config.path or current directory. Example:

$ pwd
/usr/code

$ ls
conduit.yaml
connectors/
pipelines/
processors/

Other flags such as connectors.path, etc. will overwrite the existing configuration on conduit.yaml.
This will need to be evaluated before specifying to Conduit to accomodate both scenarios (absolute and relative paths).

Flags

Name Description Required Default Value
connectors.path path to standalone connectors' directory No "./connectors"
db.badger.path path to badger DB No "Conduit.db"
processors.path path to standalone processors' directory No "./processors"
pipelines.path path to the directory that has the yaml pipeline configuration files, or a single pipeline configuration file No "./pipelines"
db.postgres.connection-string postgres connection string No
db.postgres.table postgres table in which to store data No "Conduit_kv_store"
db.type database type; accepts badger,postgres,inmemory No "badger"
grpc.address address for serving the gRPC API No ":8084"
http.address address for serving the HTTP API No ":8080"
log.format sets the format of the logging; accepts json, cli No "cli"
log.level sets logging level; accepts debug, info, warn, error, trace No "info"
pipelines.exit-on-error exit Conduit if a pipeline experiences an error while running No

Part of #1911

@raulb raulb moved this to Todo in Conduit Main Dec 18, 2024
@raulb raulb mentioned this issue Dec 18, 2024
34 tasks
@raulb raulb added the feature New feature or request label Dec 18, 2024
@raulb raulb mentioned this issue Dec 19, 2024
4 tasks
@github-project-automation github-project-automation bot moved this from Todo to Done in Conduit Main Dec 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature New feature or request
Projects
Status: Done
Development

Successfully merging a pull request may close this issue.

1 participant