Skip to content

Commit

Permalink
Use tictoc pkg to time pipeline steps
Browse files Browse the repository at this point in the history
  • Loading branch information
pranavanba committed Mar 15, 2024
1 parent a7ed574 commit 8e95b53
Showing 1 changed file with 8 additions and 5 deletions.
13 changes: 8 additions & 5 deletions pipeline/run-pipeline.R
Original file line number Diff line number Diff line change
@@ -1,22 +1,25 @@
a <- Sys.time()
# Fetch data
tictoc::tic(msg = "INFO: Fetch data")
source("scripts/fetch-data/fetch_data.R")
tictoc::toc()

# Process data
tictoc::tic(msg = "INFO: Process data")
source("scripts/process-data/fitbitactivitylogs.R")
source("scripts/process-data/fitbitdailydata.R")
source("scripts/process-data/fitbitintradaycombined.R")
source("scripts/process-data/fitbitsleeplogs.R")
source("scripts/process-data/healthkitv2samples.R")
source("scripts/process-data/healthkitv2statistics.R")
source("scripts/process-data/participant_devices.R")
tictoc::toc()

# Create final output concepts
tictoc::tic(msg = "INFO: Create final output concepts")
source("scripts/write-output/final-output-concepts.R")
b <- Sys.time()
b-a
tictoc::toc()

# Egress
tictoc::tic(msg = "INFO: Store in Synapse")
source("scripts/egress/egress.R")
c <- Sys.time()
c-b
tictoc::toc()

0 comments on commit 8e95b53

Please sign in to comment.