Directory

Monitoring

Reviewed resources in Monitoring. 79 resources listed.

79 listings in Monitoring

  • kube-llmops

    github.com

    A Helm chart that deploys a complete LLM operations stack on Kubernetes in one command, covering model serving, a unified API gateway, observability, autoscaling and fine-tuning.

  • A Chromium browser extension that shows which model actually answered a ChatGPT request, so a Pro user can check whether their request was routed to a cheaper model.

  • inferock-bench

    inferock.ai

    A local proxy that measures OpenAI, Anthropic, Gemini, and OpenRouter API traffic to produce independent, per-call receipts of token usage, failures, and billing accuracy.

  • Tokens

    tokens.ci

    A CLI and public leaderboard that reads local session files 41 AI coding clients already write to disk, totals token usage locally, and uploads only aggregate counts and timestamps, never prompts or file contents, with an iOS companion app.

  • KEDA GPU Scaler

    keda-gpu-scaler.readthedocs.io

    A KEDA external scaler that reads GPU utilization and memory directly from NVIDIA's NVML library through a DaemonSet, so Kubernetes can autoscale GPU inference workloads without Prometheus or DCGM.

  • Loki MCP Server

    github.com

    A Go-based Model Context Protocol server that lets MCP clients such as Claude Desktop query Grafana Loki log data using the LogQL query language.

  • A local-first MCP tool and dashboard for investigating how Codex CLI work consumes tokens, time, tools, allowance, credits and cost, and for spotting caching and thread patterns.

  • An MCP server that exposes the full Zabbix monitoring API as 237 tools, so AI assistants such as Claude, Codex or JetBrains AI can query hosts, check problems and manage templates.

  • HomeLab Monitor

    sikamikanikobg.github.io

    A self-hosted, single-container dashboard for a home lab and AI rig, showing GPU usage and cost, container and disk health, and uptime across every machine over SSH, with a read-only MCP server for AI agents.

  • Vigil

    vigilsoc.org

    An open-source, agentic security operations center with specialized AI agents for tasks such as triage, plain-text playbooks for multi-agent workflows, and over 7,000 community detection rules, running against a locally hosted or remote LLM of the user's choice.

  • Sentry for AI

    github.com

    A source repository of skills that teach an AI coding assistant how to set up Sentry error monitoring in a project, triage and fix production issues, and configure alerts, distributed as plugins for Claude Code, Cursor, Codex and Grok rather than installed directly.

  • SecurityClaw

    github.com

    An autonomous security-operations-center agent that watches OpenSearch or Elasticsearch log data, builds a retrieval-augmented memory of normal behavior, and uses a large language model to validate whether a detected anomaly is a real threat.

  • AI Observer

    github.com

    A self-hosted, single-binary observability backend for local AI coding assistants that tracks token usage, cost, latency and error rates across tools such as Claude Code, Gemini CLI and OpenAI Codex CLI in one dashboard.

  • agentsre

    github.com

    A Python library of reliability metrics for AI agents in production, designed to catch behavior such as declining decision confidence or a growing pile of unapproved actions that conventional infrastructure monitoring reports as healthy.

  • AURA

    mezmo.com

    A production-tested SRE agent platform where a preconfigured team of specialist agents investigates infrastructure incidents by correlating traces, logs, and metrics, then recommends fixes inside operator-defined guardrails.

  • coding-plan-assistant

    chromewebstore.google.com

    coding-plan-assistant is a browser extension and macOS menu-bar app that tracks AI subscription plans and token usage across several Chinese AI platforms and surfaces deals, reviews and AI news.

  • Octopoda

    octopodas.com

    An open-source memory and observability layer for AI agents, adding persistent memory, automatic loop detection, a hash-chained audit trail and a live dashboard on top of a plain Python agent, LangChain, CrewAI, AutoGen or the OpenAI Agents SDK.

  • An MCP server that lets AI assistants query and analyze Prometheus metrics through standardized interfaces, running PromQL queries against a configured Prometheus server.

  • SOCFortress CoPilot

    socfortress.co

    A security-operations platform that provides a single interface over open-source security tools such as Wazuh, Graylog, Velociraptor, Grafana and InfluxDB, connected through their own APIs and webhooks.

  • OpenAnalytics

    getopen.so

    OpenAnalytics is an open-source, self-hostable web analytics platform that tracks page views, funnels and revenue without cookies or cross-site profiles, and includes its own MCP server and command-line tool.

  • Casbin Gateway

    gateway.casbin.org

    Casbin Gateway is a local dashboard and proxy that shows what every AI coding agent on a machine is doing, grades whether an API key's provider matches what was paid for, and centralizes model access, permissions and spend tracking across 44 vendors.

  • GitHub Copilot Metrics Viewer

    copilot-metrics-viewer-gthcc5cmd9ebf2ff.westeurope-01.azurewebsites.net

    A dashboard that charts GitHub Copilot usage metrics for an organization or enterprise account, pulled from GitHub's Copilot Usage Metrics API, with adoption and impact charts.

  • DataBuff

    databuff.ai

    DataBuff is a self-hosted, AI-native application performance monitoring backend built on OpenTelemetry, with multi-agent troubleshooting that lets LLMs query live traces, metrics and topology directly.

  • Free AI Coding

    github.com

    A tracker that watches for official announcements of usage-limit resets on AI coding tools such as Codex, Claude Code and Grok Bot, and notifies subscribers through GitHub releases.