From 5a9dcdf8b6eff4a1a12c56f55da68ff9c76bfed6 Mon Sep 17 00:00:00 2001 From: Ziwen Ning Date: Tue, 2 Apr 2024 16:23:39 -0700 Subject: [PATCH] Add Neuron DLC images to README (#10) *Description of changes:* Add Neuron DLC images to README By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice. Signed-off-by: Ziwen Ning --- README.md | 24 +++++++++++++++++++++++- 1 file changed, 23 insertions(+), 1 deletion(-) diff --git a/README.md b/README.md index adb8654..d4888e0 100644 --- a/README.md +++ b/README.md @@ -1,6 +1,28 @@ ## AWS Neuron Deep Learning Containers -AWS Neuron Deep Learning Containers (DLCs) are a set of Docker images for training and serving models on AWS Trainium and Inferentia instances using AWS Neuron SDK. +AWS Neuron Deep Learning Containers (DLCs) are a set of Docker images for training and serving models on AWS Trainium and Inferentia instances using AWS Neuron SDK. For more documentation, please refer to [Neuron Containers Overview](https://awsdocs-neuron.readthedocs-hosted.com/en/latest/containers/index.html). + +## Containers + +### pytorch-inference-neuron + +| Framework | Neuron Packages | Neuron SDK Version | Supported EC2 Instance Types | Python Version Options | ECR Public URL | Other Packages | +|----------------------------------------------------------------------------------------------------------------------------------------|---------------------------------|--------------------|------------------------------|------------------------|------------------------------------------------------------------------------------------|------------------| +| [PyTorch 1.13.1](https://github.com/aws-neuron/deep-learning-containers/blob/2.18.0/docker/pytorch/inference/1.13.1/Dockerfile.neuron) | aws-neuronx-tools, torch-neuron | Neuron 2.18.0 | inf1 | 3.10 (py310) | public.ecr.aws/neuron/pytorch-inference-neuron:1.13.1-neuron-py310-sdk2.18.0-ubuntu20.04 | torchserve 0.9.0 | + +### pytorch-inference-neuronx + +| Framework | Neuron Packages | Neuron SDK Version | Supported EC2 Instance Types | Python Version Options | ECR Public URL | Other Packages | +|-----------------------------------------------------------------------------------------------------------------------------------------|-----------------------------------------------------------------------------|--------------------|------------------------------|------------------------|--------------------------------------------------------------------------------------------|------------------| +| [PyTorch 2.1.2](https://github.com/aws-neuron/deep-learning-containers/blob/2.18.0/docker/pytorch/inference/2.1.2/Dockerfile.neuronx) | aws-neuronx-tools, neuronx_distributed, torch-neuronx, transformers-neuronx | Neuron 2.18.0 | trn1,inf2 | 3.10 (py310) | public.ecr.aws/neuron/pytorch-inference-neuronx:2.1.2-neuronx-py310-sdk2.18.0-ubuntu20.04 | torchserve 0.9.0 | +| [PyTorch 1.13.1](https://github.com/aws-neuron/deep-learning-containers/blob/2.18.0/docker/pytorch/inference/1.13.1/Dockerfile.neuronx) | aws-neuronx-tools, neuronx_distributed, torch-neuronx, transformers-neuronx | Neuron 2.18.0 | trn1,inf2 | 3.10 (py310) | public.ecr.aws/neuron/pytorch-inference-neuronx:1.13.1-neuronx-py310-sdk2.18.0-ubuntu20.04 | torchserve 0.9.0 | + +### pytorch-training-neuronx + +| Framework | Neuron Packages | Neuron SDK Version | Supported EC2 Instance Types | Python Version Options | ECR Public URL | +|----------------------------------------------------------------------------------------------------------------------------------------|-------------------------------------------------------|--------------------|------------------------------|------------------------|-------------------------------------------------------------------------------------------| +| [PyTorch 2.1.2](https://github.com/aws-neuron/deep-learning-containers/blob/2.18.0/docker/pytorch/training/2.1.2/Dockerfile.neuronx) | aws-neuronx-tools, neuronx_distributed, torch-neuronx | Neuron 2.18.0 | trn1,inf2 | 3.10 (py310) | public.ecr.aws/neuron/pytorch-training-neuronx:2.1.2-neuronx-py310-sdk2.18.0-ubuntu20.04 | +| [PyTorch 1.13.1](https://github.com/aws-neuron/deep-learning-containers/blob/2.18.0/docker/pytorch/training/1.13.1/Dockerfile.neuronx) | aws-neuronx-tools, neuronx_distributed, torch-neuronx | Neuron 2.18.0 | trn1,inf2 | 3.10 (py310) | public.ecr.aws/neuron/pytorch-training-neuronx:1.13.1-neuronx-py310-sdk2.18.0-ubuntu20.04 | ## Security