- Details
- Written by: R. Vellani
- Category: Field Notes
Long chats drift. By turn thirty the model is answering a slightly different question than the one the user is actually asking, because the early context that framed everything has scrolled out of reach.
- Details
- Written by: R. Vellani
- Category: Field Notes
Treat the context window like money. You have a fixed amount, everything you add spends some of it, and the interesting question is what you refuse to buy.
- Details
- Written by: M. Okafor
- Category: Field Notes
Vector search gets you a pile of plausibly relevant chunks. That pile is not context yet. The half nobody budgets for is what you do with those chunks before they reach the model.
- Details
- Written by: M. Okafor
- Category: Field Notes
People reach for a bigger model when the real problem is that they are handing it the wrong information. Context engineering is the work of deciding what goes into the model's window, in what order, and in what shape, so the answer you want is the easy answer for it to give.