Workload | DNN Model | Load Pattern | Priority |
---|---|---|---|
A | VGG-19 | Uniform (100 reqs/s) | Real-time |
ResNet-152 | Closed-loop | Best-effort | |
B | VGG-19 | Closed-loop | Real-time |
ResNet-152 | Closed-loop | Best-effort | |
C | VGG-19 | Uniform (100 reqs/s) | Real-time |
ResNet-152 | Closed-loop | Best-effort | |
DenseNet-201 | Closed-loop | Best-effort | |
VGG-19 | Closed-loop | Best-effort | |
InceptionV3 | Closed-loop | Best-effort | |
DistilBert | Closed-loop | Best-effort | |
D | ResNet-152 | Uniform (20 reqs/s) | Real-time |
DenseNet-201 | Uniform (20 reqs/s) | Real-time | |
VGG-19 | Uniform (20 reqs/s) | Real-time | |
InceptionV3 | Uniform (20 reqs/s) | Real-time | |
DistilBert | Uniform (20 reqs/s) | Real-time | |
ResNet-152 | Closed-loop | Best-effort | |
DenseNet-201 | Closed-loop | Best-effort | |
VGG-19 | Closed-loop | Best-effort | |
InceptionV3 | Closed-loop | Best-effort | |
DistilBert | Closed-loop | Best-effort | |
E | ResNet-152 | Poisson (20 reqs/s) | Real-time |
DenseNet-201 | Poisson (20 reqs/s) | Real-time | |
VGG-19 | Poisson (20 reqs/s) | Real-time | |
InceptionV3 | Poisson (20 reqs/s) | Real-time | |
DistilBert | Poisson (20 reqs/s) | Real-time | |
ResNet-152 | Closed-loop | Best-effort | |
DenseNet-201 | Closed-loop | Best-effort | |
VGG-19 | Closed-loop | Best-effort | |
InceptionV3 | Closed-loop | Best-effort | |
DistilBert | Closed-loop | Best-effort | |
REAL | ResNet-152 | Trace | Real-time |
DenseNet-201 | Trace | Real-time | |
VGG-19 | Trace | Real-time | |
InceptionV3 | Trace | Real-time | |
DistilBert | Trace | Real-time | |
ResNet-152 | Closed-loop | Best-effort | |
DenseNet-201 | Closed-loop | Best-effort | |
VGG-19 | Closed-loop | Best-effort | |
InceptionV3 | Closed-loop | Best-effort | |
DistilBert | Closed-loop | Best-effort |