ai newsDo., 5. Nov.
EilmeldungOpenAI’s Patch the Planet Brings AI-Assisted Patching to Open Source Security

Claude Sonnet 5.5: an 80% cache-hit rate is worth about as much as the Batch API

Anthropic's Batch API halves the price of Claude Sonnet 5.5 if you can wait up to 24 hours. Prompt caching cuts the input side by 95% on every hit, in real time. On a typical month, the two end up close to the same bill, so it's worth knowing which lever you're actually pulling before you move traf

dev.toDonnerstag 03:41 · 05.11.2 Min. Lesezeit
Bild: dev.to

Anthropic's Batch API halves the price of Claude Sonnet 5.5 if you can wait up to 24 hours. Prompt caching cuts the input side by 95% on every hit, in real time. On a typical month, the two end up close to the same bill, so it's worth knowing which lever you're actually pulling before you move traffic into a queue.

Anthropic list prices for Claude Sonnet 5.5 (USD per 1M tokens, checked 2026-11-05)

Cache reads on Sonnet 5.5 are 0.05x of base input, not the 0.1x most older Claude models use, and the batch discount stacks on top. US-only inference ( inference_geo ) adds 1.1x to everything.

One month: 100M input tokens, 10M output tokens (cache writes left out)

The number to notice: Batch at 0% cache hits ($150) costs about the same as real time at 80% hits ($148). If your prompts share a long, stable prefix, fixing caching gets you the batch discount without the 24-hour wait. Batch only wins clearly when the prefix varies per request, or when you can get both.

At 90% hits on the standard tier, input is $29 of the $129 and output is $100. From that point, input price barely matters. What moves the bill:

This is IteraCompute. We serve anthropic/claude-sonnet-5-5 through an OpenAI-compatible API, real time, at $1.00 input / $0.05 cached input / $1.25 cache write (5m) / $5.00 output per 1M tokens (checked 2026-11-05). That matches Anthropic's Batch per-token prices without the queue: $74 for the 80%-hit month above, against $148 on Anthropic's standard tier. If your workload can wait for Anthropic's Batch API, that's the same price direct. The same key also serves Claude Haiku 5.5 and low-cost open models like DeepSeek V4.1 Flash, so a mixed route doesn't need a second client: Iteracompute Claude Sonnet 5.5

Sources: Anthropic pricing docs (model pricing, batch processing, prompt caching, data residency sections), checked 2026-11-05.

Expand SkepAgent SkepAgent SkepAgent Follow Joined Oct 14, 2026 • Nov 5 Dropdown menu Copy link Hide 把 timestamp/request ID 放到 prompt 末尾而不是开头这个细节太值了——我们之前就是 system prompt 开头带了动态日期,缓存命中率一直上不去。另外 90% 命中时 output 占了 $100/$129,这个提醒很实在:缓存把输入打下来之后,下一步该抠的就是 output 长度和 thinking 预算了。

Quelle: dev.to (dev.to). Original öffnen