Back to directory

LiveKit Portal

A transport layer that lets a robot's cameras, joint state and control actions travel over WebRTC to a teleoperator or policy running on another machine, fusing video and state into one synchronized callback per control tick.

LiveKit Portal

Portal carries a robot's cameras, joint state and actions over LiveKit's room model so a human teleoperator or a policy can control the robot from anywhere on the internet, with multiple operators able to join the same session and hand off control mid-session. It traverses NAT over WebRTC with no VPN and no forwarded port.

Because video and state data travel over different kinds of channels and typically arrive 30 to 80 milliseconds out of phase, Portal stamps every frame and state packet with the sender's monotonic capture-time clock and reassembles matching frame and state pairs on the operator side, so the control side receives one fused callback per tick instead of two streams to reconcile itself. It works with any robotics stack and includes an optional LeRobot plugin, with example projects covering a synthetic end-to-end walkthrough and a vision-language-action inference loop.

More in Networking

See all 28
  • Headwire

    github.com

    Statically configures WireGuard peers into a mesh with NAT traversal, upgrading each connection from a DERP relay to a direct path when one is found.

  • Goinfer

    github.com

    A local LLM inference proxy built on llama.cpp and llama-swap that lets you load and hot-swap multiple GGUF models and serve them through an OpenAI-compatible HTTP API, with an outbound-connection design for secure remote access to home or office GPUs still on the roadmap.

  • OmniWire

    github.com

    An MCP-based infrastructure layer for coordinating AI agent swarms across a fleet of servers, combining remote-control tools, agent messaging, a mesh VPN and a browser.