Why list prices mislead: OpenRouter Head of Insights on how to choose the right model
Companies now use an average of 12 models per month, yet the biggest hidden variable isn't which model you pickāit's the inference provider serving it and whether your cache hit rate stays above 85%. Peter Walker from OpenRouter explains how the same open-weight model can have wildly different cost and performance depending on the provider's caching policy, latency tail, and whether a stealth provider is reselling your prompts. The conversation covers why agentic workloads broke cache economics in February 2026, how ZDR policies vary even among "zero data retention" claims, and why the frontier labs are now competing across price...