Back to directory

Observe-SDK

An observability software development kit for multi-agent AI systems, extending OpenTelemetry's generative-AI semantic conventions and exporting to any OpenTelemetry-compatible backend.

Observe-SDK

Observe-SDK is an observability library for multi-agent AI applications, built as an extension of OpenTelemetry's semantic conventions for generative AI systems. It integrates with frameworks such as LangGraph and LlamaIndex, and lets exported span attributes be transformed through configurable rules.

It installs from PyPI or directly from its git repository, and because it exports through OpenTelemetry, it can send data to any OpenTelemetry-compatible backend; the project's own development setup uses an OpenTelemetry Collector, ClickHouse as the storage backend, and Grafana for visualization, all started locally with Docker Compose.

More in AI evals

See all 269
  • Provenance gate

    github.com

    A deterministic authorization gateway that sits between an AI agent and its tools, tracing where each parameter of a side-effect call came from, and blocking the call or asking a human when the source does not check out.

  • JevBench

    benchmarkheaven.com

    A reproducible benchmark from Benchmark Heaven that ranks Jev-class typed decision models on intelligence, calibration, speed, and cost, with a published harness, scoring rules, and results.

  • A co-evolutionary adversarial red-teaming tool for AI agents that uses quality-diversity evolutionary search to autonomously breed edge-case scenarios, testing whether an agent with tool access can be made to hallucinate, deadlock or leak funds.