Skip to content

Dynamically adapt to noisy neighbors

Latest
Compare
Choose a tag to compare
@vcschapp vcschapp released this 28 Feb 17:36

Big Features:

  • QueryManager now dynamically adapts to noisy neighbor problems (and resource constraint issues) such as being throttled by the CloudWatch Logs Insights API or failing to invoke the CloudWatch Logs Insights API's StartQuery operation due to exceeding the query concurrency limit. Throttling and concurrency limit problems are often caused by other users of the API (noisy neighbors), usually operating within the same AWS customer account. Dynamic adaptation both helps avoid overuse of the Insights API and prevents Incite queries from failing with errors simply because a given chunk is throttled too many times. This makes big, long-running, Incite queries more robust. Dynamic adaptation is on by default.

API changes:

  • Added new DisableAdaptation field to Config structure used to construct a new QueryManager. This field allows you to disable the new dynamic adaptive behavior if desired.

Improvements:

  • None.