flâneur

tutorials/HuggingFace at main · triton-inference-server/tutorials

github.com · 1,130 words · saved by 1 readers

This repository contains tutorials and examples for Triton Inference Server - tutorials/HuggingFace at main · triton-inference-server/tutorials

Deploying HuggingFace models Note : If you are new to the Triton Inference Server, it is recommended to review Part 1 of the Conceptual Guide . This tutorial assumes basic understanding about the Triton Inference Server. Related Pages HuggingFace model exporting guide: ONNX , TorchScript Developers often work with open source models. HuggingFace is a popular source of many open source models. The discussion in this guide will focus on how a user can deploy almost any model from HuggingFace with the Triton Inference Server. For this example, the ViT model available on HuggingFace is being used.

related reading