Structuring Huge Prompts
Sectioning and signposting.
Structure Is Navigation
A huge prompt without structure is a wall the model must scan linearly. Structure turns it into a navigable document: sections the model can locate, reference, and reason over selectively. At scale, organization is not cosmetic — it is the primary determinant of whether the model finds what it needs.
- Sectioning creates addressable units.
- Signposting tells the model where it is and where to look.
Delimiters That Do Not Collide
Use unambiguous, consistent delimiters to bound sections. They must not collide with content. XML-style tags are robust because they are explicit, nestable, and easy for the model to match open/close.
Pick one convention and apply it everywhere; mixed delimiters confuse boundary detection.
block = (
'<documents>\n'
' <doc id="7" title="Pricing">...</doc>\n'
' <doc id="8" title="SLA">...</doc>\n'
'</documents>'
)All lessons in this course
- Million-Token Context Windows
- Lost in the Middle
- Structuring Huge Prompts
- Caching Long Prefixes