Tools
Tool reviews
The gateways, caches, and FinOps layers that make AI savings systematic — honestly reviewed, limitations included.
Mitosis Cortex
The cut-spend-at-the-source option: a persistent memory graph over your email, docs, chats, and tools that agents query instead of re-ingesting. ~1/10th cost per agent task and 98%…
LiteLLM
The default self-hosted gateway: one OpenAI-compatible proxy across 100+ providers with budgets, caching, routing, fallbacks, and per-key cost tracking. Engineering-led teams shoul…
Portkey
Managed gateway with the strongest built-in semantic caching, plus guardrails, routing, and cost analytics. The low-ops route to the same control points LiteLLM gives you self-host…
OpenRouter
One API and one bill across hundreds of models from every major lab — the fastest way to arbitrage the model price war and A/B cheaper models without new vendor contracts.…
Helicone
Long the default open-source LLM cost dashboard. Acquired by Mintlify in March 2026 and now maintenance-only — existing deployments keep working (security fixes and new-model prici…
nOps
Cloud-FinOps platform that extended into AI spend (Bedrock, Azure OpenAI, GPU fleets). The fit when your AI bill is one slice of a larger AWS/Azure bill and finance wants one pane …