Valid AI-500 Dumps shared by ExamDiscuss.com for Helping Passing AI-500 Exam! ExamDiscuss.com now offer the newest AI-500 exam dumps, the ExamDiscuss.com AI-500 exam questions have been updated and answers have been corrected get the newest ExamDiscuss.com AI-500 dumps with Test Engine here:
You have a multi-agent solution in Microsoft Foundry. Every request begins with the same 1,800-token instruction block and Model Context Protocol (MCP) tool definitions, and then appends a unique user message. Input-token costs and Time to First Token (TTFT) increase during peak hours. You need to reduce the input-token costs and TTFT for requests that share common instructions and tool definitions. The solution must meet the following requirements: Reuse cached work only when the common prefix matches exactly. Generate a new completion for each user request. Minimize application changes. Which type of caching should you use?
Correct Answer: D
Prompt caching is designed for requests that share a long, identical prefix but still require a new completion for the unique user input. Azure OpenAI prompt caching reuses computation for matching prompt prefixes, reducing the effective input cost and improving Time to First Token for supported models. The stable 1,800- token instruction and MCP tool-definition block is large enough to benefit from this mechanism, and the unique user message can remain at the end so each request still generates a fresh response. Response caching would reuse an old completion, which violates the requirement. Semantic caching matches similar meaning rather than exact prompt prefixes, and retrieval caching applies to knowledge retrieval rather than model prompt processing. Because prompt caching is handled automatically for supported deployments, it also minimizes application changes. Therefore D is correct. At implementation time, the same rule should be expressed through the framework or service configuration rather than left only as a natural-language convention. That makes the behavior repeatable across runs, easier to test, and less sensitive to model variability. Official Microsoft reference: Azure OpenAI - Prompt caching