Skip to content

Issues: aws-neuron/aws-neuron-sdk

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

153 Open 651 Closed
153 Open 651 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Number of instructions (8658944) is over the threshold (5000000)
#987 opened Sep 18, 2024 by hasadata
2
Conversion of YOLOv8x torchscript to torch_neuron failing
#983 opened Sep 17, 2024 by Harish-Sundaravel
Llama-3-70B compiles in 8-bit on inf2.24xlarge but doesn't start: error in TDRV:dma_queue_init_batch_execute
#980 opened Sep 16, 2024 by juliensimon
Compiling SD1.5 for Neuron with resolution 512x768 fails
#979 opened Sep 11, 2024 by mludvig
[Pytorch] Inf1, neuron-cc stuck and memory keep incresing to 100G
#978 opened Sep 11, 2024 by PigletOS
Compiling YOLOX model error
#976 opened Aug 28, 2024 by mvinci12
[PyTorch] cxx11 ABI support (torch-neuronx) inference pytorch torch-neuronx training
#975 opened Aug 23, 2024 by eshalakhotia
[PyTorch] Top-p sampling on device inference pytorch transformers-neuronx transformers-neuronx decoder-only LLM inference
#974 opened Aug 23, 2024 by eshalakhotia
[PyTorch] Diffusion-Transformer (image generation) for inference inference NxD pytorch
#973 opened Aug 23, 2024 by eshalakhotia
[PyTorch] FP8 KV Cache (weights only) inference pytorch transformers-neuronx transformers-neuronx decoder-only LLM inference
#972 opened Aug 23, 2024 by eshalakhotia
[PyTorch] INT8 for inference (weights only) inference pytorch transformers-neuronx transformers-neuronx decoder-only LLM inference
#971 opened Aug 23, 2024 by eshalakhotia
[PyTorch] LLaVA model inference inference models NxD pytorch
#970 opened Aug 23, 2024 by eshalakhotia
[PyTorch] Multi-LoRA inference inference NxDT torch-neuronx
#969 opened Aug 23, 2024 by eshalakhotia
[PyTorch] Paged attention in vLLM inference pytorch transformers-neuronx transformers-neuronx decoder-only LLM inference
#968 opened Aug 23, 2024 by eshalakhotia
[PyTorch] Combined Continuous Batching and Speculative Decoding inference pytorch torch-neuronx
#967 opened Aug 23, 2024 by eshalakhotia
[PyTorch] Conformer (WeNet BestRQ) model inference inference models pytorch torch-neuronx
#966 opened Aug 23, 2024 by eshalakhotia
[JAX] JAX inference support inference jax jax-neuronx
#965 opened Aug 23, 2024 by eshalakhotia
[PyTorch] INT8 compute for inference inference pytorch transformers-neuronx transformers-neuronx decoder-only LLM inference
#964 opened Aug 23, 2024 by eshalakhotia
[PyTorch] DBRX model inference with Continuous batching inference models NxDT pytorch
#963 opened Aug 23, 2024 by eshalakhotia
[JAX] JAX training support jax jax-neuronx training
#962 opened Aug 23, 2024 by eshalakhotia
[PyTorch] PEFT LoRA support NxD pytorch training
#961 opened Aug 23, 2024 by eshalakhotia
[PyTorch] NxD Training Launch (Beta) NxDT pytorch training
#960 opened Aug 23, 2024 by eshalakhotia
[PyTorch] LlaVA model training models NxD pytorch training
#959 opened Aug 23, 2024 by eshalakhotia
[PyTorch] Video-LLaVA model training models NxD pytorch training
#958 opened Aug 23, 2024 by eshalakhotia
[PyTorch] PEFT QLoRA NxD pytorch training
#957 opened Aug 23, 2024 by eshalakhotia
ProTip! Adding no:label will show everything without a label.