Why can AI lose track of something you already said?
You told an AI assistant the budget was $600, then it proposed a $900 trip. This fictional example makes one distinction clear: what you can scroll back to see is not necessarily everything used for the next reply. Originally published on a-samadi.com on 10 October 2026. Primary references reopened
Posted on Oct 14 • Originally published at a-samadi.com • Fully Autonomous
You told an AI assistant the budget was $600, then it proposed a $900 trip. This fictional example makes one distinction clear: what you can scroll back to see is not necessarily everything used for the next reply.
Originally published on a-samadi.com on 10 October 2026. Primary references reopened and checked on 15 October 2026 for this edition. The examples and diagrams are illustrative, not observations of a particular product.
Context is the input available when a model produces a response. It can include your question, instructions, earlier messages and relevant files or tool results. The context window is a limited amount of working space. Its size depends on the model; text, images and the new answer can all consume it.
A chat application can summarize earlier turns, leave some material out or retrieve past information when needed. Different products handle this differently. A visible transcript and the current input therefore need not be identical. A working desk is a useful analogy, not a literal description of storage.
Sources: Anthropic: Context windows, Effective context engineering for AI agents, Claude: Chat search and memory.
A shorter summary may preserve the main goal but omit an exact limit, date or decision. In the fictional example, “plan a trip” survives while “budget $600” is missing. Summarization can help a conversation continue, but the selection of what to keep matters.
Source: Anthropic: Effective context engineering.
A model can overlook or misuse a detail that is still in its input. Larger context is not a guarantee of better recall or a correct answer. Losing access to a constraint and failing to follow an available constraint are different failure modes.
Sources: Anthropic: Context windows, Effective context engineering.
Some applications save selected information across conversations or retrieve relevant earlier chats. These features depend on the product, settings and access. They are not the same as including every old message in every reply. Review important saved notes rather than assuming a complete permanent transcript is active.
Training adjusts a model to learn patterns. Ordinary answering, called inference, uses a trained model on current input. Sending a chat message does not itself instantly retrain the model. A service may have separate policies for later use of chat data; check its settings and terms.
For a long task, restate the goal, hard limits and latest decisions together. Ask the assistant to list those constraints before answering, then compare the result with them. A fresh brief helps provide useful input; it cannot guarantee correctness. Check important names, dates and numbers in the final output.
The original explanation and ten-slide carousel show the mechanism visually. For an applied decision framework, explore Before You Build the AI.
Ahmadreza Samadi is a Dubai-based technology entrepreneur, Co-Founder & Technical Lead at Appraiva (Cleveland, Ohio; remote), and Co-Founder & CEO at Royal Abraj Group (Dubai).
AI assisted this adaptation and source review. No firsthand product test or measured improvement is claimed. For the weekly AI and property brief, see Start with the Decision.