About This Resource

A toolkit for running a local AI stack with containers. It brings together model services, interfaces, and supporting components through a shared configuration and command-line workflow.

Saved Notes

Original notes saved with this link. They may describe an earlier version.

<img src="https://app.notion.com/icons/info-alternate_gray.svg" alt="https://app.notion.com/icons/info-alternate_gray.svg" width="40px" />

This project is not related to the open-source container registry, Harbor.

Harbor

GitHub - av/harbor: Effortlessly run LLM backends, APIs, frontends, and services with one command.

Effortlessly run LLM backends, APIs, frontends, and services with one command.

Harbor is a containerized LLM toolkit that allows you to run LLMs and additional services. It consists of a CLI and a companion App that allows you to manage and run AI services with ease.