Skip to content

Durations of Job Steps

Daniel Odievich edited this page Jul 19, 2018 · 8 revisions

The timing report is output to Reports folder as StepTimings.csv.

Duration of Extract Phase

The duration of the Extract phase depends on:

  • The number of Applications to query
    • More Applications => More work to retrieve anything)
  • The complexity of Applications being queried
    • More Tiers, Business Transactions, Configuration rules and so on => More time to retrieve Metrics and Flowmaps
  • The busy-ness of Applications being queried More Snapshots => More time to retrieve Snapshots
    • More Events => More time to retrieve Events
  • Whether sequential or parallel mode is chosen
    • Sequential => Longer
  • Ability of Controller to respond to queries in timely interval, especially for Snapshot retrieval
    • Slower Controller => Longer
  • Your network connection
    • Slower => Longer
Phase Duration
ExtractControllerApplicationsAndEntities (1) 1-4 seconds per Application
ExtractControllerAndApplicationConfiguration (2) 10-40 seconds per Application
ExtractApplicationAndEntityMetrics (3) 5-20 seconds per Entity Type (Tier, Node, Backend, etc.), depending on number of metric sets requested and number of time ranges
ExtractApplicationAndEntityFlowmaps (4) 1-2 minutes for each 200 Entities per Application or ~100 ms per entity (Tier, Node, Backend, etc.)
ExtractEventsAndHealthRuleViolations (5) 10-30 seconds for each Application
ExtractSnapshots (6) 0.5-5 seconds per Snapshot, depending on Snapshot size

Duration of Index Phase

During Index phase, large number of small JSON files are read, converted in memory and results are output to CSV files.

The duration of Index phase is driven by number of CPUs and CPU speed and speed of local IO system for reading. Local SSD is highly recommended. More CPUs => More work done.

Setting Duration
IndexControllersApplicationsAndEntities (11) 0.5-1 seconds per Application
IndexControllerAndApplicationConfiguration (12) Not timed yet
IndexApplicationAndEntityMetrics (13) 5-20 seconds per Application
IndexApplicationAndEntityFlowmaps (14) 5-10 seconds for each 200 Entities per Application Or ~100 ms per entity (Tier, Node, Backend, etc.
IndexEventsAndHealthRuleViolations (15) 1-2 seconds for each Application
IndexSnapshots (16) ~200 ms per Snapshot

Duration of Report Phase

Setting Duration
ReportControlerApplicationsAndEntities (21) 1-2 seconds per Application
ReportControllerAndApplicationConfiguration (22) 1-2 seconds per Application
ReportApplicationAndEntityMetrics (23) 50 ms per Entity
ReportApplicationAndEntityMetricGraphs (24) 30-60 seconds per Entity Type, depen
ReportEventsAndHealthRuleViolations (25) 1-2 second per Application
ReportSnapshots (26) 10-20 ms per Snapshot
ReportSnapshotsMethodCallLines (27) ~50 ms per Snapshot
ReportIndividualApplicationAndEntityDetails (28) 2-3 seconds per Entity
ReportFlameGraphs (29) ~5 seconds per 1000 Snapshots
Clone this wiki locally