System Prompt
AIA system prompt is the set of instructions that define an LLM’s role, behavior, and constraints before user messages are added. In RAG chat, the system prompt typically tells the model to answer only from provided excerpts and to cite sources. In extraction, high-level instructions can act like a system prompt for the extraction task.
In DocLD
- Chat — System prompt enforces grounding in retrieved chunks and citation format.
- Extraction — Schema instructions guide the model on how to fill fields and handle edge cases.
Prompt engineering often focuses on refining the system prompt to reduce hallucination and improve consistency.
Related Concepts
System prompt is part of prompting and prompt engineering. It affects completion and RAG behavior; temperature and top-p control randomness given that prompt.