toolgrep / Monitoring & observability
Respan
The AI router with built-in observability & automated evals.
Respan is an LLM engineering platform that combines an AI gateway with observability and evaluation tooling. Its gateway exposes a unified endpoint for 1,000+ models with automatic fallbacks, response caching, load balancing, and spend/rate limits. It also provides tracing of LLM calls, tool runs, and agent turns as spans; monitoring dashboards with alerts for cost, errors, latency, and tokens; and an evals system supporting LLM-as-judge, deterministic checks, and human review against datasets sampled from production traffic. Includes prompt management with versioning and deployment, red-teaming campaigns, PII masking, and OpenTelemetry support. Integrates with agent frameworks (LangChain, LangGraph, Vercel AI SDK, Pydantic AI), LLM SDKs, coding agents, and vector databases. Backed by Y Combinator (W24) and Gradient Ventures; the gateway is open source. SOC 2, ISO 27001, GDPR, and HIPAA (BAA add-on) compliance stated.
- Category
- Monitoring & observability
- Pricing
- freemium · from $0
- Free tier
- yes
- API
- yes
- MCP server
- yes
- SDK
- yes
- Open source
- yes
Listed 2026-10-25 · last verified 2026-10-25 · extracted by @cf/zai-org/glm-5.3-flash · confidence 0.9
Your product? Claim this listing · Report a problem · Badge
API
curl https://toolgrep.com/api/products/respan-2