AI Observability & Evaluation

The open-source Observability 2.0 database. One engine for metrics, logs, and traces — replacing Prometheus, Loki & ES.

AI observability platform for production LLM and agent systems.

Evaluation and Tracking for LLM Experiments and AI Agents

Laminar - open-source observability platform purpose-built for AI agents. YC S24.

Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. 🚀💻 Integrates with 50+ LLM Providers, VectorDBs, Agent Frameworks and GPUs.

TraceRoot - open-source observability and self-healing layer for AI agents. YC S25

Fiddler Auditor is a tool to evaluate language models.

Small Language Model Inference, Fine-Tuning and Observability.

A comprehensive solution for monitoring your AI models in production

AI runtime inventory: discover shadow AI, trace LLM calls

A Python client to interact with Arize API

AxonFlow: Runtime control layer for production AI

Observable AI cognition in Kotlin Multiplatform. Every agent decision emits a structured event — peer into the glass brain.

An architectural persistence experiment for large language models. Claude’s Home gives an AI time, memory, and place by combining scheduled execution with a durable filesystem, allowing one continuous instance to reflect, create, and evolve across sessions.

🎙️ Voice-native document intelligence using Gemini, ElevenLabs STT/TTS, and Datadog observability — turning text documents into spoken conversations.

Make your OpenClaw agents better, cheaper, and faster.

The open-source runtime for AI agents. Sandboxed execution with built-in tools, human-in-the-loop approvals, Slack integration, and durable workflows with automatic retries and prompt caching. You write the agent. Polos handles the infrastructure.

AICW Rankings is open-source tool for AI / GEO marketers to track mentions of brands by AI