Back to directory

Pi Coding Agent + Docker Sandbox + llama-server: Setup Guide

A setup guide for running the Pi coding agent inside an isolated Docker Sandbox microVM while it talks to a local llama-server inference backend running on the host GPU.

Pi Coding Agent + Docker Sandbox + llama-server: Setup Guide

This repository is a guide for combining three pieces: the Pi coding agent, Docker's sbx sandboxing tool, and llama.cpp's llama-server. Pi runs inside a hypervisor-isolated microVM so it cannot read host files outside its mounted workspace, cannot reach the host's keychain or SSH keys, and cannot make network requests beyond an explicit allow-list.

Inference is served by llama-server running in router mode on the host, so models load dynamically and run at full host-GPU speed while Pi itself stays sandboxed; requests cross the VM boundary through the sbx proxy's host-gateway address. The guide walks through installing sbx, installing or building llama.cpp with CUDA or ROCm acceleration, and the remaining setup steps.

More in Containers

See all 120
  • Drop

    droprun.sh

    A rootless Linux sandbox for developers, built on user namespaces with optional gVisor isolation, that confines coding agents and third-party packages without leaving your normal work environment.

  • minienv

    github.com

    Reads an existing docker compose file and deploys it as a remote preview environment with little setup, with optional public endpoints and authentication so others can review in-flight work.

  • Rig

    npmjs.com

    Gives each coding agent, such as Claude Code, Cursor or Codex, its own cloud Linux desktop with a running dev server, tests and a signed-in Chrome, so the developer's laptop stays free while several agents work at once.