PyTorch Inference | onnxruntime

How to run PyTorch models efficiently and across multiple platforms

PyTorch Inference | onnxruntime Skip to main content Menu Expand (external link) Document Search Copy Copied Search onnxruntime Inference PyTorch Models Learn about PyTorch and how to perform inference with PyTorch models. PyTorch leads the deep learning landscape with its readily digestible and flexible API; the large number of ready-made models available, particularly in the natural language (NLP) domain; as well as its domain specific libraries. A growing ecosystem of developers and applications seek to use models built with PyTorch and this articles provides a quick tour of inferencing PyT

related reading

• Making Deep Learning go Brrrr From First Principleshorace.io
• PyTorch in One Hour: From Tensors to Training Neural Networks on Multiple GPUssebastianraschka.com
• PyTorch internals : ezyang's blogblog.ezyang.com
• PiTorch: ML on Baremetal Raspberry Pis | projectsmasonjwang.com
• Learning PyTorch with Examples — PyTorch Tutorials 2.12.0+cu130 documentationpytorch.org
• Get Startedpytorch.org
• Walkthrough - nnsightnnsight.net
• tutorials/Conceptual_Guide/Part_4-inference_acceleration/README.md at main · triton-inference-server/tutorials · GitHubgithub.com
• The Annotated Transformernlp.seas.harvard.edu
• Accelerating Generative AI with PyTorch II: GPT, Fast – PyTorchpytorch.org
• tutorials/HuggingFace at main · triton-inference-server/tutorials · GitHubgithub.com
• Tensors — PyTorch Tutorials 2.12.0+cu130 documentationpytorch.org