Skip to content

jinlmsft/QianJiangYuan

Repository files navigation

QianJiangYuan is an open source toolkit that allows AI scientists to spin up an AI cluster in turn-key fashion (either in a public cloud such as Aliyun/Azure, or in an on-perm cluster). It is derived from DLWorkspace, which has been used in daily production for Microsoft internal groups (e.g., Microsoft Cognitive Service, SwiftKey, Bing Relevance, etc...). Once setup, the QianJiangYuan provides web UI and/or restful API that allows AI scientist to run job (interactive exploration, training, inferencing, data analystics) on the cluster with resource allocated by cluster for each job (e.g., a single node job with a couple of GPUs with GPU Direct connection, or a distributed job with multiple GPUs per node). QianJiangYuan also provides unified job template and operating environment that allows AI scientists to easily share their job and setting among themselves and with outside community. QianJiangYuan out-of-box supports all major deep learning toolkits (TensorFlow, CNTK, Caffe, MxNet, etc..), and supports popular big data analytic toolkit such as hadoop/spark.

Tutorials

Here is a few short video clips that can quickly explain DLWorkspace. Note the PPT link will only work in github.com repo, not in github.com pages.

Documentations

中文文档

初稿