Skip to content

Durations of Job Steps

Daniel Odievich edited this page Oct 17, 2018 · 8 revisions

The timing report is output to Reports folder as StepTimings.csv.

Duration of Extract Phase

The duration of the Extract phase depends on:

  • The number of Applications to query
    • More Applications => More work to retrieve anything)
  • The complexity of Applications being queried
    • More Tiers, Business Transactions, Configuration rules and so on => More time to retrieve Metrics and Flowmaps
  • The busy-ness of Applications being queried More Snapshots => More time to retrieve Snapshots
    • More Events => More time to retrieve Events
  • Whether sequential or parallel mode is chosen
    • Sequential => Longer
  • Ability of Controller to respond to queries in timely interval, especially for Snapshot retrieval
    • Slower Controller => Longer
  • Your network connection
    • Slower => Longer
Phase Duration
ExtractControllerApplicationsAndEntities 1-4 seconds per Application
ExtractControllerSIMApplicationsAndEntities 5-10 seconds per Controller
ExtractControllerDBApplicationsAndEntities 6/10 seconds per Collector
ExtractControllerAndApplicationConfiguration 10-40 seconds per Application
ExtractApplicationAndEntityMetrics 5-20 seconds per Entity Type (Tier, Node, Backend, etc.), depending on number of metric sets requested and number of time ranges
ExtractApplicationAndEntityFlowmaps 1-2 minutes for each 200 Entities per Application or ~100 ms per entity (Tier, Node, Backend, etc.)
ExtractEventsAndHealthRuleViolations 10-30 seconds for each Application
ExtractSnapshots 0.5-5 seconds per Snapshot, depending on Snapshot size

Duration of Index Phase

During Index phase, large number of small JSON files are read, converted in memory and results are output to CSV files.

The duration of Index phase is driven by number of CPUs and CPU speed and speed of local IO system for reading. Local SSD is highly recommended. More CPUs => More work done.

Setting Duration
IndexControllersApplicationsAndEntities 0.5-1 seconds per Application
IndexControllerSIMApplicationsAndEntities 0.5-1 seconds per Application
IndexControllerDBApplicationsAndEntities 1-2 seconds per Collector
IndexControllerAndApplicationConfiguration 2-3 seconds per Application
IndexApplicationConfigurationComparison 2-3 seconds per Application
IndexApplicationAndEntityMetrics 5-20 seconds per Application
IndexApplicationAndEntityFlowmaps 5-10 seconds for each 200 Entities per Application Or ~100 ms per entity (Tier, Node, Backend, etc.
IndexEventsAndHealthRuleViolations 3-5 seconds for each Application
IndexSnapshots ~20 ms per Snapshot

Duration of Report Phase

Setting Duration
ReportControlerApplicationsAndEntities 1-2 seconds per Application
ReportControlerSIMApplicationsAndEntities 1-2 seconds per Application
ReportControlerDBApplicationsAndEntities) 2-4 seconds per Collector
ReportControllerAndApplicationConfiguration 1-2 seconds per Application
ReportApplicationAndEntityMetrics 50 ms per Entity
ReportApplicationAndEntityMetricGraphs 30-60 seconds per Entity Type, depen
ReportEventsAndHealthRuleViolations 1-2 second per Application
ReportSnapshots 10-20 ms per Snapshot
ReportSnapshotsMethodCallLines ~50 ms per Snapshot
ReportIndividualApplicationAndEntityDetails 2-3 seconds per Entity
ReportFlameGraphs 5-10 per Application
Clone this wiki locally