Directory
Containers
Reviewed resources in Containers. 120 resources listed.
balenaSupervisor
balena.iobalena's on-device agent for IoT hardware, responsible for installing, starting, stopping and monitoring OCI-compliant containers and managing an application's lifecycle on the device.
Self-Hosted AI Stack
selfhostedaistack.comA ready-to-run Docker Compose bundle of local AI services, including Ollama, a chat UI, an LLM gateway, embeddings, speech-to-text, text-to-speech and an MCP gateway.
Docker Hub MCP Server
github.comA Model Context Protocol server that exposes Docker Hub's API to LLMs, so AI tools can recommend container images and manage Docker Hub repositories through natural language.
LLMKube
llmkube.comA Kubernetes operator for self-hosted LLM inference across a mixed fleet of NVIDIA, AMD and Apple Silicon hardware, turning model deployment into a two-line YAML definition with GPU scheduling, caching and OpenAI-compatible endpoints.
herm
hermagent.comA model-agnostic AI coding agent that runs inside self-building Docker containers by default, so it can act on a project without approval interruptions while staying confined to the current working directory.
Ollama Operator
ollama-operator.ayaka.ioA Kubernetes operator that runs Ollama-served large language models on a cluster, letting a user deploy and manage multiple models the way they would manage any other Kubernetes workload.
KAOS
axsaucedo.github.ioA Kubernetes-native framework for deploying and orchestrating AI agents as cluster resources, with hierarchical multi-agent delegation and an OpenAI-compatible chat endpoint on every agent.
AI Tools for Developers
docker.comA Docker-based tool, now deprecated in favor of Docker Desktop's MCP Toolkit, that ran agentic workflows written in Markdown prompt files against dockerized tools and any LLM.
A Docker Compose setup that lets Intel Arc GPU owners run Ollama, Stable Diffusion and Whisper speech recognition together behind Open WebUI, using a native SYCL or Vulkan llama.cpp backend for Ollama.
Kthena
kthena.volcano.shA lightweight, modular, Kubernetes-native platform for deploying and serving large language models, separating model lifecycle management from inference traffic routing behind custom resource definitions.
K8E
k8e.shA single binary under 100 MB that turns a Linux host into a self-hosted sandbox platform for running secure, isolated AI-agent workloads at scale, with gVisor, Kata or Firecracker isolation and an E2B-compatible API.
AgentBox
agent-box.shA CLI that launches an AI coding agent inside a dedicated sandboxed VM, local or in the cloud, bringing along existing skills, plugins and settings for Claude Code, Codex or OpenCode, with a browser, screen sharing and a warmed-up IDE.
OME (Open Model Engine)
ome-projects.github.ioA Kubernetes operator for enterprise LLM serving that automates model management, GPU scheduling and deployment across runtimes such as SGLang, vLLM, TensorRT-LLM and Triton.
This project packages vLLM for serving large language models on AMD Ryzen AI Max "Strix Halo" hardware as an Ubuntu-based, Toolbx-compatible Docker or Podman container tracking stable ROCm and vLLM releases.
Docker MCP Registry
github.comA curated catalog of MCP servers that can be discovered, deployed and run through Docker tooling, including Docker Desktop's MCP Toolkit and the Docker Hub mcp namespace.
ollama-helm
artifacthub.ioollama-helm is a community Helm chart that deploys Ollama on Kubernetes, with configuration for CPU-only or GPU-accelerated clusters and for pulling or creating models automatically at startup.
Sympozium
sympozium.aiSympozium is a coordination layer for multi-agent AI systems on Kubernetes, giving agents shared situational awareness through selective permeability, structured handoffs and shared memory while each agent runs in an isolated workload defined as a Kubernetes CRD.
Self-Host Release Repository
github.comThe release repository for Bitwarden's self-hosted deployment, holding the installation scripts and signed container images used to run Bitwarden's password manager on your own infrastructure.
Docker MCP server
github.comAn MCP server that lets a large language model manage Docker with natural language: composing containers, inspecting running ones, and managing volumes, presenting a plan for approval before applying it.
Helix
helix.mlA self-hosted platform that runs a fleet of coding agents, each in its own GPU-accelerated sandbox desktop, coordinated through a spec-driven Kanban board so a team can review and merge their pull requests.
The LeaderWorkerSet and DisaggregatedSet APIs
lws.sigs.k8s.ioA Kubernetes API for deploying a group of pods as one replication unit, aimed at multi-host AI and ML inference workloads that shard a large model across multiple nodes.
dockerCopilot
github.comA Docker container management tool with one-click image updates and container lifecycle controls, working across platforms.
sandboxd
sandboxd.ioAn open-source, self-hosted engine that spins up an isolated Docker sandbox, runs a coding agent inside it against a prompt, and exposes the resulting app at a live preview URL, through a small Go program and a scriptable /v1 API.
kubectl-mcp-server
github.comAn MCP server that lets an AI assistant manage a Kubernetes cluster in natural language, covering pod debugging, cost optimization, network diagnostics, security auditing and Helm chart management.