Skip to content
/ ck-mlperf Public
forked from ctuning/ck-mlperf

Collective Knowledge repository to automate MLPerf - a broad ML benchmark suite for measuring performance of ML software frameworks, ML hardware accelerators, and ML cloud platforms:

License

Notifications You must be signed in to change notification settings

me2x/ck-mlperf

 
 

Repository files navigation

Collective Knowledge workflows for MLPerf

compatibility automation

DOI License

Linux/MacOS: Travis Build Status

MLPerf Inference v0.5

Task Model Owner Contributors Implementation Environment (need more testing) CK workflow
Object Classification MobileNet dividiti dividiti TFLite Linux, Android (Windows, Mac) yes
dividiti TF (C++) Linux, Android (Windows, Mac) yes
dividiti TF (Python) Linux (Windows, Mac) yes
dividiti, NVIDIA, Microsoft ONNX Linux, Mac (Windows) yes
dividiti, Arm ArmNN Linux (Android) yes
ResNet Microsoft Microsoft ONNX Linux (?) no
Microsoft TF (Python) Linux (?) no
dividiti TFLite Linux, Android (Windows, Mac) yes
dividiti TF (C++) Linux, Android (Windows, Mac) yes
dividiti ONNX Linux, Mac (Windows) yes
dividiti, Arm ArmNN Linux (Android) yes
Object Detection SSD-MobileNet dividiti dividiti TFLite Linux (Android, Windows, Mac) yes
dividiti, Habana TF (Python) Linux (?) yes
Facebook PyTorch Linux (?) no
SSD-ResNet Habana Habana, NVIDIA PyTorch Linux (?) no
GM, Google, dividiti TF (?) coming soon!
Machine Translation GNMT Intel Intel TF (Python) Linux (?) no
Intel PyTorch Linux (?) no

NB: We generally acknowledge Google for making many pretrained TF models available (e.g. for Object Detection).

MLPerf Training v0.6

TODO

About

Collective Knowledge repository to automate MLPerf - a broad ML benchmark suite for measuring performance of ML software frameworks, ML hardware accelerators, and ML cloud platforms:

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Python 74.2%
  • Dockerfile 22.3%
  • Shell 3.5%