toolgrep / Monitoring & observability
Opik
End-to-end AI observability and evaluation platform for LLM applications and agents
Opik, by Comet, is an open-source LLM observability and evaluation platform. It logs traces of LLM applications and agents, detects and groups recurring errors via Diagnostics, recommends fixes through its built-in Ollie agent, and supports validation with test suites and LLM-as-a-judge metrics. It also provides production monitoring dashboards, cost tracking (including coding agent spend such as Claude Code), prompt versioning and optimization, and an MCP server that gives coding agents access to trace data. Opik offers 60+ integrations (LangChain, LlamaIndex, OpenAI, etc.), cloud and self-hosted deployment options, and is backed by Comet's enterprise platform. Comet also offers MLOps experiment management for tracking model training runs.
- Category
- Monitoring & observability
- Pricing
- freemium
- Free tier
- yes
- API
- yes
- MCP server
- yes
- SDK
- yes
- Open source
- yes
Listed 2026-10-20 · last verified 2026-10-20 · extracted by @cf/zai-org/glm-5.3-flash · confidence 0.9
Your product? Claim this listing · Report a problem · Badge
API
curl https://toolgrep.com/api/products/opik