From 11e462333a2dca36113bbb17e5f5261a11cead05 Mon Sep 17 00:00:00 2001 From: Nassim Oufattole Date: Wed, 3 Jul 2024 04:25:38 +0000 Subject: [PATCH] cleaned up tables --- docs/source/prediction.md | 156 +++++++++++++++++++------------------- docs/source/profiling.md | 38 +++++----- 2 files changed, 97 insertions(+), 97 deletions(-) diff --git a/docs/source/prediction.md b/docs/source/prediction.md index 2f52452..35131d8 100644 --- a/docs/source/prediction.md +++ b/docs/source/prediction.md @@ -46,19 +46,19 @@ Since this includes every window size and aggregation, it is the most expensive #### 1.1 XGBoost Runtimes and Memory Usage on MIMIC-IV Tasks -| Task | Index Timestamp | Real Time | User Time | Sys Time | Avg Memory (MiB) | Peak Memory (MiB) | -| ------------------------------- | ----------------- | --------- | --------- | --------- | ---------------- | ----------------- | -| Post-discharge 30 day Mortality | Discharge | 2m59.807s | 3m38.285s | 0m38.274s | 9036.728 | 11955.312 | -| Post-discharge 1 year Mortality | Discharge | 5m16.958s | 6m10.065s | 0m58.964s | 10803.670 | 12330.355 | -| 30 day Readmission | Discharge | 2m30.609s | 3m3.836s | 0m39.415s | 13198.832 | 18676.605 | -| In ICU Mortality | Admission + 24 hr | 0m38.275s | 1m3.656s | 0m13.198s | 1711.942 | 2985.699 | -| In ICU Mortality | Admission + 48 hr | 0m34.669s | 1m1.389s | 0m12.742s | 1613.256 | 2770.438 | -| In Hospital Mortality | Admission + 24 hr | 2m8.912s | 2m41.180s | 0m31.707s | 9071.615 | 12055.980 | -| In Hospital Mortality | Admission + 48 hr | 1m54.025s | 2m25.322s | 0m28.925s | 8857.783 | 12370.898 | -| LOS in ICU > 3 days | Admission + 24 hr | 2m2.689s | 2m37.196s | 0m28.110s | 4650.008 | 5715.484 | -| LOS in ICU > 3 days | Admission + 48 hr | 1m44.434s | 2m18.558s | 0m23.825s | 4453.363 | 5577.164 | -| LOS in Hospital > 3 days | Admission + 24 hr | 6m4.884s | 7m5.025s | 1m4.335s | 11011.710 | 12223.449 | -| LOS in Hospital > 3 days | Admission + 48 hr | 6m9.587s | 7m12.853s | 1m3.858s | 10703.064 | 11829.742 | +| Task | Index Timestamp | Real Time | User Time | Sys Time | Avg Memory (MiB) | Peak Memory (MiB) | +| ------------------------------- | ----------------- | --------- | --------- | -------- | ---------------- | ----------------- | +| Post-discharge 30 day Mortality | Discharge | 2m59s | 3m38s | 0m38s | 9,037 | 11,955 | +| Post-discharge 1 year Mortality | Discharge | 5m16s | 6m10s | 0m59s | 10,804 | 12,330 | +| 30 day Readmission | Discharge | 2m30s | 3m3s | 0m39s | 13,199 | 18,677 | +| In ICU Mortality | Admission + 24 hr | 0m38s | 1m3s | 0m13s | 1,712 | 2,986 | +| In ICU Mortality | Admission + 48 hr | 0m34s | 1m1s | 0m13s | 1,613 | 2,770 | +| In Hospital Mortality | Admission + 24 hr | 2m8s | 2m41s | 0m32s | 9,072 | 12,056 | +| In Hospital Mortality | Admission + 48 hr | 1m54s | 2m25s | 0m29s | 8,858 | 12,371 | +| LOS in ICU > 3 days | Admission + 24 hr | 2m3s | 2m37s | 0m28s | 4,650 | 5,715 | +| LOS in ICU > 3 days | Admission + 48 hr | 1m44s | 2m18s | 0m24s | 4,453 | 5,577 | +| LOS in Hospital > 3 days | Admission + 24 hr | 6m5s | 7m5s | 1m4s | 11,012 | 12,223 | +| LOS in Hospital > 3 days | Admission + 48 hr | 6m10s | 7m12s | 1m4s | 10,703 | 11,830 | #### 1.2 MIMIC-IV Task Specific Training Cohort Size @@ -66,17 +66,17 @@ To better understand the runtimes, we also report the task specific cohort size. | Task | Index Timestamp | Number of Patients | Number of Events | | ------------------------------- | ----------------- | ------------------ | ---------------- | -| Post-discharge 30 day Mortality | Discharge | 149014 | 356398 | -| Post-discharge 1 year Mortality | Discharge | 149014 | 356398 | -| 30 day Readmission | Discharge | 17418 | 377785 | -| In ICU Mortality | Admission + 24 hr | 7839 | 22811 | -| In ICU Mortality | Admission + 48 hr | 6750 | 20802 | -| In Hospital Mortality | Admission + 24 hr | 51340 | 338614 | -| In Hospital Mortality | Admission + 48 hr | 47231 | 348289 | -| LOS in ICU > 3 days | Admission + 24 hr | 42809 | 61342 | -| LOS in ICU > 3 days | Admission + 48 hr | 42805 | 61327 | -| LOS in Hospital > 3 days | Admission + 24 hr | 152126 | 360208 | -| LOS in Hospital > 3 days | Admission + 48 hr | 152120 | 359020 | +| Post-discharge 30 day Mortality | Discharge | 149,014 | 356,398 | +| Post-discharge 1 year Mortality | Discharge | 149,014 | 356,398 | +| 30 day Readmission | Discharge | 17,418 | 377,785 | +| In ICU Mortality | Admission + 24 hr | 7,839 | 22,811 | +| In ICU Mortality | Admission + 48 hr | 6,750 | 20,802 | +| In Hospital Mortality | Admission + 24 hr | 51,340 | 338,614 | +| In Hospital Mortality | Admission + 48 hr | 47,231 | 348,289 | +| LOS in ICU > 3 days | Admission + 24 hr | 42,809 | 61,342 | +| LOS in ICU > 3 days | Admission + 48 hr | 42,805 | 61,327 | +| LOS in Hospital > 3 days | Admission + 24 hr | 152,126 | 360,208 | +| LOS in Hospital > 3 days | Admission + 48 hr | 152,120 | 359,020 | ### 2. MIMIC-IV Sweep @@ -124,19 +124,19 @@ For a complete example on MIMIC-IV and for all of our config files, see the [MIM #### 2.1 XGBoost Performance on MIMIC-IV -| Task | Index Timestamp | AUC | Minimum Code Inclusion Frequency | Number of Included Codes\* | Window Sizes | Aggregations | -| ------------------------------- | ----------------- | ------------ | -------------------------------- | -------------------------- | ---------------------- | --------------------------------------------------------------------------- | -| Post-discharge 30 day Mortality | Discharge | 0.9347633541 | 1371 | 5712 | \[7d,full\] | \[code/count,value/count,value/min,value/max\] | -| Post-discharge 1 year Mortality | Discharge | 0.8979986449 | 289 | 10048 | \[2h,12h,1d,30d,full\] | \[static/present,code/count,value/sum_sqd,value/min\] | -| 30 day Readmission | Discharge | 0.7076685566 | 303 | 9903 | \[30d,365d,full\] | \[code/count,value/count,value/sum,value/sum_sqd,value/max\] | -| In ICU Mortality | Admission + 24 hr | 0.6612338171 | 7059 | 3037 | \[12h,full\] | \[static/present,code/count,value/sum,value/min,value/max\] | -| In ICU Mortality | Admission + 48 hr | 0.671986067 | 71 | 16112 | \[1d,7d,full\] | \[static/present,code/count,value/sum,value/min,value/max\] | -| In Hospital Mortality | Admission + 24 hr | 0.8119187166 | 43 | 18989 | \[1d,full\] | \[static/present,code/count,value/sum,value/min,value/max\] | -| In Hospital Mortality | Admission + 48 hr | 0.8100362943 | 678 | 7433 | \[1d,full\] | \[static/present,code/count,value/count\] | -| LOS in ICU > 3 days | Admission + 24 hr | 0.9455099633 | 30443 | 1624 | \[2h,7d,30d\] | \[static/present,code/count,value/count,value/sum,value/sum_sqd,value/max\] | -| LOS in ICU > 3 days | Admission + 48 hr | 0.9667108784 | 2864 | 4332 | \[2h,7d,30d\] | \[code/count,value/sum_sqd,value/max\] | -| LOS in Hospital > 3 days | Admission + 24 hr | 0.9434966078 | 94633 | 912 | \[12h,1d,7d\] | \[code/count,value/count,value/sum_sqd\] | -| LOS in Hospital > 3 days | Admission + 48 hr | 0.9449770561 | 30880 | 1619 | \[1d,7d,30d\] | \[code/count,value/sum,value/min,value/max\] | +| Task | Index Timestamp | AUC | Minimum Code Inclusion Frequency | Number of Included Codes\* | Window Sizes | Aggregations | +| ------------------------------- | ----------------- | ----- | -------------------------------- | -------------------------- | ---------------------- | --------------------------------------------------------------------------- | +| Post-discharge 30 day Mortality | Discharge | 0.935 | 1,371 | 5,712 | \[7d,full\] | \[code/count,value/count,value/min,value/max\] | +| Post-discharge 1 year Mortality | Discharge | 0.898 | 289 | 10,048 | \[2h,12h,1d,30d,full\] | \[static/present,code/count,value/sum_sqd,value/min\] | +| 30 day Readmission | Discharge | 0.708 | 303 | 9,903 | \[30d,365d,full\] | \[code/count,value/count,value/sum,value/sum_sqd,value/max\] | +| In ICU Mortality | Admission + 24 hr | 0.661 | 7,059 | 3,037 | \[12h,full\] | \[static/present,code/count,value/sum,value/min,value/max\] | +| In ICU Mortality | Admission + 48 hr | 0.673 | 71 | 16,112 | \[1d,7d,full\] | \[static/present,code/count,value/sum,value/min,value/max\] | +| In Hospital Mortality | Admission + 24 hr | 0.812 | 43 | 18,989 | \[1d,full\] | \[static/present,code/count,value/sum,value/min,value/max\] | +| In Hospital Mortality | Admission + 48 hr | 0.810 | 678 | 7,433 | \[1d,full\] | \[static/present,code/count,value/count\] | +| LOS in ICU > 3 days | Admission + 24 hr | 0.946 | 30,443 | 1,624 | \[2h,7d,30d\] | \[static/present,code/count,value/count,value/sum,value/sum_sqd,value/max\] | +| LOS in ICU > 3 days | Admission + 48 hr | 0.967 | 2,864 | 4,332 | \[2h,7d,30d\] | \[code/count,value/sum_sqd,value/max\] | +| LOS in Hospital > 3 days | Admission + 24 hr | 0.943 | 94,633 | 912 | \[12h,1d,7d\] | \[code/count,value/count,value/sum_sqd\] | +| LOS in Hospital > 3 days | Admission + 48 hr | 0.945 | 30,880 | 1,619 | \[1d,7d,30d\] | \[code/count,value/sum,value/min,value/max\] | - Number of Included Codes is based on Minimum Code Inclusion Frequency -- we calculated the number of resulting codes that were above the minimum threshold and reported that. @@ -144,19 +144,19 @@ For a complete example on MIMIC-IV and for all of our config files, see the [MIM Additionally, the model parameters from the highest performing run are reported below. -| Task | Index Timestamp | Eta | Lambda | Alpha | Subsample | Minimum Child Weight | Number of Boosting Rounds | Early Stopping Rounds | Max Tree Depth | -| ------------------------------- | ----------------- | -------------- | -------------- | ------------- | ------------ | -------------------- | ------------------------- | --------------------- | -------------- | -| Post-discharge 30 day Mortality | Discharge | 0.005630897092 | 0.03218837176 | 0.3741846464 | 0.5716492359 | 52.66844896 | 703 | 9 | 16 | -| Post-discharge 1 year Mortality | Discharge | 0.008978198787 | 0.086075240914 | 0.342564218 | 0.8994363088 | 75.94359197 | 858 | 9 | 11 | -| 30 day Readmission | Discharge | 0.005970244514 | 0.3591376982 | 0.3741846464 | 0.673450045 | 52.66844896 | 712 | 9 | 16 | -| In ICU Mortality | Admission + 24 hr | 0.03824348927 | 0.06183970736 | 0.2310791064 | 0.9947482627 | 88.53086045 | 513 | 7 | 14 | -| In ICU Mortality (first 48h) | Admission + 48 hr | 0.04373178504 | 0.04100575186 | 0.2888938852 | 0.9617417624 | 90.881739 | 484 | 5 | 14 | -| In Hospital Mortality | Admission + 24 hr | 0.02790651024 | 0.01319397229 | 0.0105408763 | 0.5673852112 | 11.22281297 | 454 | 6 | 9 | -| In Hospital Mortality | Admission + 48 hr | 0.01076063059 | 0.06007544254 | 0.1791900222 | 0.9641152835 | 83.69584368 | 631 | 7 | 13 | -| LOS in ICU > 3 days | Admission + 24 hr | 0.01203878234 | 0.08963582145 | 0.1367180869 | 0.6264012852 | 26.20493325 | 650 | 8 | 14 | -| LOS in ICU > 3 days | Admission + 48 hr | 0.01203878234 | 0.04882102808 | 0.1997059646 | 0.9608288859 | 83.9736355 | 615 | 7 | 13 | -| LOS in Hospital > 3 days | Admission + 24 hr | 0.008389745342 | 0.06656965098 | 0.2553069741 | 0.9886841026 | 89.89987526 | 526 | 5 | 14 | -| LOS in Hospital > 3 days | Admission + 48 hr | 0.00121145622 | 0.03018152667 | 0.02812771908 | 0.9671829656 | 8.657613623 | 538 | 8 | 7 | +| Task | Index Timestamp | Eta | Lambda | Alpha | Subsample | Minimum Child Weight | Number of Boosting Rounds | Early Stopping Rounds | Max Tree Depth | +| ------------------------------- | ----------------- | ----- | ------ | ----- | --------- | -------------------- | ------------------------- | --------------------- | -------------- | +| Post-discharge 30 day Mortality | Discharge | 0.006 | 0.032 | 0.374 | 0.572 | 53 | 703 | 9 | 16 | +| Post-discharge 1 year Mortality | Discharge | 0.009 | 0.086 | 0.343 | 0.899 | 76 | 858 | 9 | 11 | +| 30 day Readmission | Discharge | 0.006 | 0.359 | 0.374 | 0.673 | 53 | 712 | 9 | 16 | +| In ICU Mortality | Admission + 24 hr | 0.038 | 0.062 | 0.231 | 0.995 | 89 | 513 | 7 | 14 | +| In ICU Mortality (first 48h) | Admission + 48 hr | 0.044 | 0.041 | 0.289 | 0.961 | 91 | 484 | 5 | 14 | +| In Hospital Mortality | Admission + 24 hr | 0.028 | 0.013 | 0.011 | 0.567 | 11 | 454 | 6 | 9 | +| In Hospital Mortality | Admission + 48 hr | 0.011 | 0.060 | 0.179 | 0.964 | 84 | 631 | 7 | 13 | +| LOS in ICU > 3 days | Admission + 24 hr | 0.012 | 0.090 | 0.137 | 0.626 | 26 | 650 | 8 | 14 | +| LOS in ICU > 3 days | Admission + 48 hr | 0.012 | 0.049 | 0.200 | 0.960 | 84 | 615 | 7 | 13 | +| LOS in Hospital > 3 days | Admission + 24 hr | 0.008 | 0.067 | 0.255 | 0.989 | 90 | 526 | 5 | 14 | +| LOS in Hospital > 3 days | Admission + 48 hr | 0.001 | 0.030 | 0.028 | 0.967 | 9 | 538 | 8 | 7 | ## XGBoost Model Performance on eICU Tasks @@ -168,39 +168,39 @@ For more details about eICU specific task generation and running, see the [eICU #### 1. XGBoost Performance on eICU -| Task | Index Timestamp | AUC | Minimum Code Inclusion Frequency | Window Sizes | Aggregations | -| ------------------------------- | ----------------- | ------------ | -------------------------------- | ------------------------ | -------------------------------------------------------------- | -| Post-discharge 30 day Mortality | Discharge | 0.6027428797 | 68235 | \[12h,1d,full\] | \[code/count,value/sum_sqd,value/max\] | -| Post-discharge 1 year Mortality | Discharge | 0.8745313425 | 3280 | \[30d,365d\] | \[static/present,value/sum,value/sum_sqd,value/min,value/max\] | -| In Hospital Mortality | Admission + 24 hr | 0.8552631579 | 335912 | \[2h,7d,30d,365d,full\] | \[static/present,code/count,value/count,value/min,value/max\] | -| In Hospital Mortality | Admission + 48 hr | 0.5703997648 | 89121 | \[12h,1d,30d\] | \[code/count,value/count,value/min\] | -| LOS in ICU > 3 days | Admission + 24 hr | 0.7834375547 | 7881 | \[1d,30d,full\] | \[static/present,code/count,value/count,value/sum,value/max\] | -| LOS in ICU > 3 days | Admission + 48 hr | 0.7574691571 | 1719 | \[2h,12h,7d,30d,full\] | \[code/count,value/count,value/sum,value/sum_sqd,value/min\] | -| LOS in Hospital > 3 days | Admission + 24 hr | 0.8640973238 | 160 | \[1d,30d,365d,full\] | \[static/present,code/count,value/min,value/max\] | -| LOS in Hospital > 3 days | Admission + 48 hr | 0.8950621974 | 975 | \[12h,1d,30d,365d,full\] | \[code/count,value/count,value/sum,value/sum_sqd\] | +| Task | Index Timestamp | AUC | Minimum Code Inclusion Frequency | Window Sizes | Aggregations | +| ------------------------------- | ----------------- | ----- | -------------------------------- | ------------------------ | -------------------------------------------------------------- | +| Post-discharge 30 day Mortality | Discharge | 0.603 | 68,235 | \[12h,1d,full\] | \[code/count,value/sum_sqd,value/max\] | +| Post-discharge 1 year Mortality | Discharge | 0.875 | 3,280 | \[30d,365d\] | \[static/present,value/sum,value/sum_sqd,value/min,value/max\] | +| In Hospital Mortality | Admission + 24 hr | 0.855 | 335,912 | \[2h,7d,30d,365d,full\] | \[static/present,code/count,value/count,value/min,value/max\] | +| In Hospital Mortality | Admission + 48 hr | 0.570 | 89,121 | \[12h,1d,30d\] | \[code/count,value/count,value/min\] | +| LOS in ICU > 3 days | Admission + 24 hr | 0.783 | 7,881 | \[1d,30d,full\] | \[static/present,code/count,value/count,value/sum,value/max\] | +| LOS in ICU > 3 days | Admission + 48 hr | 0.757 | 1,719 | \[2h,12h,7d,30d,full\] | \[code/count,value/count,value/sum,value/sum_sqd,value/min\] | +| LOS in Hospital > 3 days | Admission + 24 hr | 0.864 | 160 | \[1d,30d,365d,full\] | \[static/present,code/count,value/min,value/max\] | +| LOS in Hospital > 3 days | Admission + 48 hr | 0.895 | 975 | \[12h,1d,30d,365d,full\] | \[code/count,value/count,value/sum,value/sum_sqd\] | #### 2. XGBoost Optimal Found Model Parameters -| Task | Index Timestamp | Eta | Lambda | Alpha | Subsample | Minimum Child Weight | Number of Boosting Rounds | Early Stopping Rounds | Max Tree Depth | -| ------------------------------- | ----------------- | -------------- | -------------- | -------------- | ------------ | -------------------- | ------------------------- | --------------------- | -------------- | -| In Hospital Mortality | Admission + 24 hr | 0.04328401484 | 0.001377527826 | 0.3425861261 | 0.8788657019 | 13.25388316 | 574 | 9 | 14 | -| In Hospital Mortality | Admission + 48 hr | 0.00156138886 | 0.001669486342 | 0.3026235563 | 0.7250077856 | 0.05549772671 | 939 | 9 | 12 | -| LOS in ICU > 3 days | Admission + 24 hr | 0.2103487211 | 0.1889039915 | 0.05310740103 | 0.9549160412 | 4.693180409 | 359 | 6 | 14 | -| LOS in ICU > 3 days | Admission + 48 hr | 0.3399653331 | 0.3930942838 | 0.003662725623 | 0.9002656342 | 6.398461636 | 394 | 10 | 13 | -| LOS in Hospital > 3 days | Admission + 24 hr | 0.02626332529 | 0.2375031032 | 0.03299434213 | 0.9401763566 | 46.19807109 | 909 | 5 | 11 | -| LOS in Hospital > 3 days | Admission + 48 hr | 0.100031978 | 0.590017142 | 0.01514768214 | 0.9135673756 | 57.99367271 | 499 | 10 | 9 | -| Post-discharge 30 day Mortality | Discharge | 0.003120329768 | 0.01157485817 | 0.001488659801 | 0.7295192432 | 12.6755339 | 986 | 7 | 7 | -| Post-discharge 1 year Mortality | Discharge | 0.004953313969 | 0.005881577613 | 0.001786936591 | 0.6897205622 | 93.18348266 | 938 | 6 | 14 | +| Task | Index Timestamp | Eta | Lambda | Alpha | Subsample | Minimum Child Weight | Number of Boosting Rounds | Early Stopping Rounds | Max Tree Depth | +| ------------------------------- | ----------------- | ----- | ------ | ----- | --------- | -------------------- | ------------------------- | --------------------- | -------------- | +| In Hospital Mortality | Admission + 24 hr | 0.043 | 0.001 | 0.343 | 0.879 | 13 | 574 | 9 | 14 | +| In Hospital Mortality | Admission + 48 hr | 0.002 | 0.002 | 0.303 | 0.725 | 0 | 939 | 9 | 12 | +| LOS in ICU > 3 days | Admission + 24 hr | 0.210 | 0.189 | 0.053 | 0.955 | 5 | 359 | 6 | 14 | +| LOS in ICU > 3 days | Admission + 48 hr | 0.340 | 0.393 | 0.004 | 0.900 | 6 | 394 | 10 | 13 | +| LOS in Hospital > 3 days | Admission + 24 hr | 0.026 | 0.238 | 0.033 | 0.940 | 46 | 909 | 5 | 11 | +| LOS in Hospital > 3 days | Admission + 48 hr | 0.100 | 0.590 | 0.015 | 0.914 | 58 | 499 | 10 | 9 | +| Post-discharge 30 day Mortality | Discharge | 0.003 | 0.0116 | 0.001 | 0.730 | 13 | 986 | 7 | 7 | +| Post-discharge 1 year Mortality | Discharge | 0.005 | 0.006 | 0.002 | 0.690 | 93 | 938 | 6 | 14 | #### 3. eICU Task Specific Training Cohort Size | Task | Index Timestamp | Number of Patients | Number of Events | | ------------------------------- | ----------------- | ------------------ | ---------------- | -| Post-discharge 30 day Mortality | Discharge | 91405 | 91405 | -| Post-discharge 1 year Mortality | Discharge | 91405 | 91405 | -| In Hospital Mortality | Admission + 24 hr | 3585 | 3585 | -| In Hospital Mortality | Admission + 48 hr | 1527 | 1527 | -| LOS in ICU > 3 days | Admission + 24 hr | 12672 | 14004 | -| LOS in ICU > 3 days | Admission + 48 hr | 12712 | 14064 | -| LOS in Hospital > 3 days | Admission + 24 hr | 99540 | 99540 | -| LOS in Hospital > 3 days | Admission + 48 hr | 99786 | 99786 | +| Post-discharge 30 day Mortality | Discharge | 91,405 | 91,405 | +| Post-discharge 1 year Mortality | Discharge | 91,405 | 91,405 | +| In Hospital Mortality | Admission + 24 hr | 35,85 | 3,585 | +| In Hospital Mortality | Admission + 48 hr | 1,527 | 1,527 | +| LOS in ICU > 3 days | Admission + 24 hr | 12,672 | 14,004 | +| LOS in ICU > 3 days | Admission + 48 hr | 12,712 | 14,064 | +| LOS in Hospital > 3 days | Admission + 24 hr | 99,540 | 99,540 | +| LOS in Hospital > 3 days | Admission + 48 hr | 99,786 | 99,786 | diff --git a/docs/source/profiling.md b/docs/source/profiling.md index 3ed144e..5a0c083 100644 --- a/docs/source/profiling.md +++ b/docs/source/profiling.md @@ -31,17 +31,17 @@ a) 100 Patients **Table 1: 6,374 Codes, 2,065,608 Rows, Output Shape \[132,461, 6,374\]** -| Wall Time | Avg Memory | Peak Memory | Output Size | Method | -| --------- | ----------- | ------------ | ----------- | -------- | -| 0m39.426s | 5,271.85 MB | 14,791.83 MB | 362 MB | meds_tab | +| Wall Time | Avg Memory | Peak Memory | Output Size | Method | +| --------- | ---------- | ----------- | ----------- | -------- | +| 0m39.426s | 5,271 MB | 14,791 MB | 362 MB | meds_tab | b) 500 Patients **Table 2: 18,314 Codes, 8,737,355 Rows, Output Shape \[565,014, 18,314\]** -| Wall Time | Avg Memory | Peak Memory | Output Size | Method | -| --------- | ----------- | ------------ | ----------- | -------- | -| 3m4.435s | 8,335.44 MB | 15,102.55 MB | 1,326 MB | meds_tab | +| Wall Time | Avg Memory | Peak Memory | Output Size | Method | +| --------- | ---------- | ----------- | ----------- | -------- | +| 3m4.435s | 8,335 MB | 15,102 MB | 1,326 MB | meds_tab | ### MIMIC-IV Dataset @@ -53,11 +53,11 @@ This table illustrates the efficiency of MEDS-Tab in processing a small subset o **Table 3: 1,504 Codes, 23,346 Rows, Output Shape \[2,127, 1,504\]** -| Wall Time | Avg Memory | Peak Memory | Output Size | Method | -| --------- | ------------ | ------------- | ----------- | -------- | -| 0m2.071s | 423.78 MB | 943.984 MB | 7 MB | meds_tab | -| 1m41.920s | 84,159.44 MB | 265,877.86 MB | 1 MB | tsfresh | -| 0m15.366s | 2,537.46 MB | 4,781.824 MB | 1 MB | catabra | +| Wall Time | Avg Memory | Peak Memory | Output Size | Method | +| --------- | ---------- | ----------- | ----------- | -------- | +| 0m2.071s | 423 MB | 943 MB | 7 MB | meds_tab | +| 1m41.920s | 84,159 MB | 265,877 MB | 1 MB | tsfresh | +| 0m15.366s | 2,537 MB | 4,781 MB | 1 MB | catabra | b) 100 Patients @@ -65,11 +65,11 @@ The performance gap was further highlighted with an increased number of patients **Table 4: 4,154 Codes, 150,789 Rows, Output Shape \[15,664, 4,154\]** -| Wall Time | Avg Memory | Peak Memory | Output Size | Method | -| --------- | ------------- | ------------- | ----------- | -------- | -| 0m4.724s | 718.76 MB | 1,167.29 MB | 45 MB | meds_tab | -| 5m9.077s | 217,477.52 MB | 659,735.25 MB | 4 MB | tsfresh | -| 3m17.671s | 14,319.53 MB | 28,342.81 MB | 4 MB | catabra | +| Wall Time | Avg Memory | Peak Memory | Output Size | Method | +| --------- | ---------- | ----------- | ----------- | -------- | +| 0m4.724s | 718 MB | 1,167 MB | 45 MB | meds_tab | +| 5m9.077s | 217,477 MB | 659,735 MB | 4 MB | tsfresh | +| 3m17.671s | 14,319 MB | 28,342 MB | 4 MB | catabra | c) 500 Patients @@ -77,8 +77,8 @@ Scaling further to 500 patients, MEDS-Tab maintained consistent performance, rei **Table 5: 48,115 Codes, 795,368 Rows, Output Shape \[75,595, 8,115\]** -| Wall Time | Avg Memory | Peak Memory | Output Size | Method | -| --------- | ----------- | ----------- | ----------- | -------- | -| 0m15.867s | 1,410.79 MB | 3,539.32 MB | 442 MB | meds_tab | +| Wall Time | Avg Memory | Peak Memory | Output Size | Method | +| --------- | ---------- | ----------- | ----------- | -------- | +| 0m15.867s | 1,410 MB | 3,539 MB | 442 MB | meds_tab | ______________________________________________________________________