Headers
Body
Request model for completion generation
1
x > 0
Number of additional chunks/pages to retrieve before and after matched chunks (ColPali only)
x >= 0
Name of the graph to use for knowledge graph-enhanced retrieval
Number of relationship hops to traverse in the graph
1 <= x <= 3
Whether to include relationship paths in the response
Optional folder scope for the operation. Accepts a single folder name or a list of folder names.
Optional end-user scope for the operation
Optional customizations for entity extraction, resolution, and query prompts Container for query-related prompt overrides.
Use this class when customizing prompts for query operations, which may include customizations for entity extraction, entity resolution, and the query/response generation itself.
This is the most feature-complete override class, supporting all customization types.
Available customizations:
- entity_extraction: Customize how entities are identified in text
- entity_resolution: Customize how entity variants are grouped
- query: Customize response generation style, format, and tone
Each type has its own required placeholders. See the specific class documentation for details and examples.
Schema for structured output, can be a Pydantic model or JSON schema dict
Optional chat session ID for persisting conversation history
Whether to stream the response back in chunks
LiteLLM-compatible model configuration (e.g., model name, API key, base URL)