Directory
Monitoring
Reviewed resources in Monitoring. 79 resources listed.
kube-llmops
github.comA Helm chart that deploys a complete LLM operations stack on Kubernetes in one command, covering model serving, a unified API gateway, observability, autoscaling and fine-tuning.
ChatGPT Route Inspector
github.comA Chromium browser extension that shows which model actually answered a ChatGPT request, so a Pro user can check whether their request was routed to a cheaper model.
inferock-bench
inferock.aiA local proxy that measures OpenAI, Anthropic, Gemini, and OpenRouter API traffic to produce independent, per-call receipts of token usage, failures, and billing accuracy.
Tokens
tokens.ciA CLI and public leaderboard that reads local session files 41 AI coding clients already write to disk, totals token usage locally, and uploads only aggregate counts and timestamps, never prompts or file contents, with an iOS companion app.
KEDA GPU Scaler
keda-gpu-scaler.readthedocs.ioA KEDA external scaler that reads GPU utilization and memory directly from NVIDIA's NVML library through a DaemonSet, so Kubernetes can autoscale GPU inference workloads without Prometheus or DCGM.
Loki MCP Server
github.comA Go-based Model Context Protocol server that lets MCP clients such as Claude Desktop query Grafana Loki log data using the LogQL query language.
Codex Usage Tracker
github.comA local-first MCP tool and dashboard for investigating how Codex CLI work consumes tokens, time, tools, allowance, credits and cost, and for spotting caching and thread patterns.
Zabbix MCP Server
initmax.comAn MCP server that exposes the full Zabbix monitoring API as 237 tools, so AI assistants such as Claude, Codex or JetBrains AI can query hosts, check problems and manage templates.
HomeLab Monitor
sikamikanikobg.github.ioA self-hosted, single-container dashboard for a home lab and AI rig, showing GPU usage and cost, container and disk health, and uptime across every machine over SSH, with a read-only MCP server for AI agents.
Vigil
vigilsoc.orgAn open-source, agentic security operations center with specialized AI agents for tasks such as triage, plain-text playbooks for multi-agent workflows, and over 7,000 community detection rules, running against a locally hosted or remote LLM of the user's choice.
Sentry for AI
github.comA source repository of skills that teach an AI coding assistant how to set up Sentry error monitoring in a project, triage and fix production issues, and configure alerts, distributed as plugins for Claude Code, Cursor, Codex and Grok rather than installed directly.
SecurityClaw
github.comAn autonomous security-operations-center agent that watches OpenSearch or Elasticsearch log data, builds a retrieval-augmented memory of normal behavior, and uses a large language model to validate whether a detected anomaly is a real threat.
AI Observer
github.comA self-hosted, single-binary observability backend for local AI coding assistants that tracks token usage, cost, latency and error rates across tools such as Claude Code, Gemini CLI and OpenAI Codex CLI in one dashboard.
agentsre
github.comA Python library of reliability metrics for AI agents in production, designed to catch behavior such as declining decision confidence or a growing pile of unapproved actions that conventional infrastructure monitoring reports as healthy.
AURA
mezmo.comA production-tested SRE agent platform where a preconfigured team of specialist agents investigates infrastructure incidents by correlating traces, logs, and metrics, then recommends fixes inside operator-defined guardrails.
coding-plan-assistant
chromewebstore.google.comcoding-plan-assistant is a browser extension and macOS menu-bar app that tracks AI subscription plans and token usage across several Chinese AI platforms and surfaces deals, reviews and AI news.
Octopoda
octopodas.comAn open-source memory and observability layer for AI agents, adding persistent memory, automatic loop detection, a hash-chained audit trail and a live dashboard on top of a plain Python agent, LangChain, CrewAI, AutoGen or the OpenAI Agents SDK.
Prometheus MCP Server
github.comAn MCP server that lets AI assistants query and analyze Prometheus metrics through standardized interfaces, running PromQL queries against a configured Prometheus server.
SOCFortress CoPilot
socfortress.coA security-operations platform that provides a single interface over open-source security tools such as Wazuh, Graylog, Velociraptor, Grafana and InfluxDB, connected through their own APIs and webhooks.
OpenAnalytics
getopen.soOpenAnalytics is an open-source, self-hostable web analytics platform that tracks page views, funnels and revenue without cookies or cross-site profiles, and includes its own MCP server and command-line tool.
Casbin Gateway
gateway.casbin.orgCasbin Gateway is a local dashboard and proxy that shows what every AI coding agent on a machine is doing, grades whether an API key's provider matches what was paid for, and centralizes model access, permissions and spend tracking across 44 vendors.
GitHub Copilot Metrics Viewer
copilot-metrics-viewer-gthcc5cmd9ebf2ff.westeurope-01.azurewebsites.netA dashboard that charts GitHub Copilot usage metrics for an organization or enterprise account, pulled from GitHub's Copilot Usage Metrics API, with adoption and impact charts.
DataBuff
databuff.aiDataBuff is a self-hosted, AI-native application performance monitoring backend built on OpenTelemetry, with multi-agent troubleshooting that lets LLMs query live traces, metrics and topology directly.
Free AI Coding
github.comA tracker that watches for official announcements of usage-limit resets on AI coding tools such as Codex, Claude Code and Grok Bot, and notifies subscribers through GitHub releases.