-
Notifications
You must be signed in to change notification settings - Fork 0
OperationProgressAPI
Field | Type | Description |
---|---|---|
contentType | String | This will be application/json for the immediate term, but we might also support application/xml later |
Field | Type | Value | Notes |
---|---|---|---|
id | String | ||
operation ID | (Part of EndpointDataObject) recommend this be the id of the AgendaProgress + operation name. | ||
cid | String | (Part of EndpointDataObject) | |
customerId | String | (Part of EndpointDataObject) | |
agendaProgressId | String | AgendaProgress id If this is a separate object | |
processingState | Enum | waiting * ** added ** scheduled ** queued ** executing complete * failed ** succeeded |
|
processingStateMessage | String | Percents, sub states, whatever | |
operation | String | Workflow operation (ie: Analyze, Encode, Packaging). This is the operation.type field value | |
diagnostics | OperationDiagnostic[] | Detailed information of operation attempts | |
attemptCount | Integer | Total number of attempts (includes the first attempt that failed and the current attempt being reported) | |
attemptTime | Timestamp | UTC When did the current attempt take place | |
startedTime | Timestamp | Time the operation started (inclusive of all retries) | |
completedTime | Timestamp | Time the job phase was completed | |
resultPayload | Object | The resulting payload | |
params | ParamsMap | Free form map of parameters. |
Created when an Agenda is submitted (per operation listed).
Reaped (or possibly ttl)
We will need customerIds on everything to isolate objects from being accessed by the wrong user.
Enumeration describing the state of the given item (Operation, Agenda, whatever).
Value | Definition | Messages (examples) |
---|---|---|
waiting | waiting to start (pods or dependencies pending) | |
added | queued | |
scheduled | ||
executing | actively processing | |
percent complete values | ||
complete | ||
completed | (failed or succeeded) | |
failed | ||
succeeded |
- Submission
- Scheduling
-
Execution
the ResourcePool
Agenda
the workflow
Agenda Template
the workflow definition
Customer
Insight
the scheduling queue definition
Operation Progress
the state of the running Agenda operations
Progress
the state of the running Agendas
ResourcePool
the processing resources
Agenda Service
the workflow submission
Progress Service
rolled up agenda progress summary
ResourcePool Service
getting work and updating progress
AgendaReclaimer
restarting stuck Agendas
AgendaRetry
retrying failed Agendas
DataObjectReaper
reaping expired data objects
PodReaper
reaping stuck Kubernetes pods