AWS Guide: Amazon Bedrock Explicit Prompt Caching Stores Nothing Unless Developers Set Two Fields
Reported by Amazon Web Services (AWS) and Tech Times2 sources ↓
AWS published a how-to guide for explicit prompt caching on Bedrock open-weight models. Developers must enable explicit mode and add a cache breakpoint; the guide names no supported models and reports no measured savings.
Key points
- Explicit mode without a breakpoint caches nothing; a breakpoint without explicit mode uses implicit caching
- Content up to and including a breakpoint is eligible for caching; content after it is not
- AWS directs developers to model cards for supported models, minimum prefix lengths and cache lifetimes
- The guide gives no rates or measured savings; AWS says cache reads cost less than standard input, while writes can cost more
Sources
Details
The AWS guide describes explicit prompt caching as a request configuration, not a launch. Developers set the Bedrock-specific prompt_cache_options field to explicit mode, then attach a prompt_cache_breakpoint to a text content part. The prefix through that part becomes eligible for caching, and developers can add multiple breakpoints up to a model-specific limit.
A breakpoint must match the prefix exactly for a later request to reuse the cache. AWS says static instructions and tool definitions should come before changing content such as a question. Cache entries are held on one server, according to Bedrock documentation, so requests handled by another server or sent before an identical request finishes may create a new entry instead of reading the existing one.
The guide uses placeholder model IDs in its examples and does not identify models that support explicit caching. AWS directs developers to model cards for supported modes, minimum prefix lengths and cache lifetimes; the article reports that listed minimums vary by model. The guide also reports no measured savings or rates, and says cache reads cost less than standard input while writes can cost more, depending on the model.
Written from coverage as of
Images
- Tech Times
Stocks in this story
Change since open: 20 Nov to 21 Nov 2026
Last refresh