Add synchronous execution option to workflow provisioning

[junweid62]

Jan 14 Revision
Added synchronous execution option to reprovision

Description

This PR introduces a new wait_for_completion_timeout feature to the Provision Workflow API in the OpenSearch Flow Framework. The feature allows users to control whether the API call waits for the entire workflow provisioning process to complete before returning a response.

What’s Changed:

1. Added support for the wait_for_completion_timeout parameter in the REST layer (RestProvisionWorkflowAction).

• Accepts a time duration value (e.g., 30s, 1m).
• If the workflow is provisioned within the specified timeout, the API returns the created resources (same response as GetWorkflowStatus).
• If the timeout is reached before provisioning completes, the API returns the workflow state without waiting further.

3. Updated the transport layer (ProvisionWorkflowTransportAction) to handle the timeout logic and ensure correct behavior during synchronous provisioning.

Success Response:

{
    "workflow_id": "K13IR5QBEpCfUu_-AQdU",
    "state": "COMPLETED",
    "resources_created": [
        {
            "workflow_step_name": "create_connector",
            "workflow_step_id": "create_connector_1",
            "resource_id": "LF3IR5QBEpCfUu_-Awd_",
            "resource_type": "connector_id"
        },
        {
            "workflow_step_id": "register_model_2",
            "workflow_step_name": "register_remote_model",
            "resource_id": "L13IR5QBEpCfUu_-BQdI",
            "resource_type": "model_id"
        },
        {
            "workflow_step_name": "deploy_model",
            "workflow_step_id": "deploy_model_3",
            "resource_id": "L13IR5QBEpCfUu_-BQdI",
            "resource_type": "model_id"
        }
    ]
}

TimeOut Response:

{
    "workflow_id": "SmACR5QBdrR0lYdqgHa9",
    "state": "PROVISIONING",
    "resources_created": [
        {
            "workflow_step_name": "create_connector",
            "workflow_step_id": "create_connector_1",
            "resource_type": "connector_id",
            "resource_id": "S2ACR5QBdrR0lYdqgXYK"
        },
        {
            "workflow_step_name": "register_remote_model",
            "workflow_step_id": "register_model_2",
            "resource_type": "model_id",
            "resource_id": "TWACR5QBdrR0lYdqgXZ-"
        }
    ]
}

Areas of Concern:

I have a few parts of the implementation that I believe can be further improved, particularly in ProvisionWorkflowTransportAction. Some of the logic feels a bit verbose and might not be the most efficient way to handle the timeout and synchronous execution. I’d appreciate the feedback from reviewers.

Related Issues

Resolves #967

Check List

• New functionality includes testing.
• New functionality has been documented.
• API changes companion pull request created.
• Commits are signed per the DCO using --signoff.
• Public documentation issue/PR created.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

[dbwiddis]

Generally looks good.

• You need to handle -1 time value; my recommendation is you use that for the default "async" rather than null
• You need to do stream version checks for the new (optional) workflow state in the response, and the new timeout parameter in the workflow request (unless you want to just keep it in the params map).

[codecov]

Codecov Report

Attention: Patch coverage is 45.34884% with 94 lines in your changes missing coverage. Please review.

Project coverage is 76.41%. Comparing base (5480cb4) to head (58b4f81).

Files with missing lines	Patch %	Lines
.../transport/ReprovisionWorkflowTransportAction.java	6.06%	29 Missing and 2 partials ⚠️
...rk/transport/ProvisionWorkflowTransportAction.java	9.09%	28 Missing and 2 partials ⚠️
...rch/flowframework/util/WorkflowTimeoutUtility.java	51.16%	19 Missing and 2 partials ⚠️
...ework/transport/CreateWorkflowTransportAction.java	76.47%	3 Missing and 1 partial ⚠️
...earch/flowframework/transport/WorkflowRequest.java	78.57%	0 Missing and 3 partials ⚠️
...ramework/transport/ReprovisionWorkflowRequest.java	71.42%	0 Missing and 2 partials ⚠️
...arch/flowframework/transport/WorkflowResponse.java	88.23%	0 Missing and 2 partials ⚠️
...h/flowframework/rest/RestCreateWorkflowAction.java	83.33%	0 Missing and 1 partial ⚠️

Additional details and impacted files

@@             Coverage Diff              @@
##               main     #990      +/-   ##
============================================
- Coverage     77.57%   76.41%   -1.17%     
- Complexity      993     1010      +17     
============================================
  Files            99      100       +1     
  Lines          4714     4871     +157     
  Branches        431      453      +22     
============================================
+ Hits           3657     3722      +65     
- Misses          877      954      +77     
- Partials        180      195      +15     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[dbwiddis]

LGTM with a few suggestions.

[joshpalis]

Overall looks good to me, great work implementing this feature @junweid62 . A few comments