Back to directory

Snapshot

A Kubernetes-native checkpoint and restore system for NVIDIA GPU workloads. It saves a fully initialized pod's process and GPU memory, then restores that state on another node so new replicas skip cold start.

Snapshot

Snapshot is a Kubernetes-native checkpoint and restore system for NVIDIA GPU workloads. It pauses a running pod and saves its complete execution state, including CPU and GPU memory, as a portable artifact, then restores that artifact on any node with matching GPU hardware and driver versions so the process resumes where it left off, skipping model loading and warm-up.

It provides checkpoint and restore primitives only; orchestration decisions such as which pods to checkpoint and when are left to systems that integrate it. Typical uses include speeding up autoscaling for inference serving, parking idle models at scale-to-zero, and recovering a pod's state after a restart or a move to another node.

It is written in Go, licensed under Apache-2.0, and its APIs may still change, so the project is not yet recommended for production-critical workloads.

More in Inference

See all 770
  • OpenDecision

    deepanwadhwa.github.io

    An open-source Python package that answers typed questions about application state or documents using a local natural-language-inference model, returning structured choice, score, yes/no or evidence-relation values instead of free text.

  • Lifeboat

    iterate.ai

    A local inference server that puts an OpenAI- and Anthropic-compatible API in front of open-weight language models running on hardware you control, from a laptop to a GPU cluster.

  • Claude S40

    github.com

    An unofficial Claude chat client for 2007-era Nokia Series 40 phones, built as a Java ME app plus a small Go relay server, with web search, reading mode and saved chats.