About This Resource

Documentation for deploying Hugging Face's generative AI inference services. It describes packaged model-serving components and their use on supported infrastructure.

Saved Notes

Original notes saved with this link. They may describe an earlier version.

Hugging Face Generative AI Services (HUGS)

Hugging Face Generative AI Services (HUGS) are optimized, zero-configuration inference microservices designed to simplify and accelerate the development of AI applications with open models.

https://www.digitalocean.com/community/tutorials/deploy-hugs-on-gpu-droplets-open-webui

Deploying Hugging Face Generative AI Services on DigitalOcean GPU Droplet and Integrating with Open WebUI