Skip to main content

Documentation Index

Fetch the complete documentation index at: https://handbook.fiddler.ai/llms.txt

Use this file to discover all available pages before exploring further.

Set additional context information for LLM interactions. The LLM context allows you to provide additional background information or available options that can be tracked alongside model invocations. This context will be added to telemetry spans as ‘gen_ai.llm.context’ and can be used for debugging or analysis in Fiddler’s platform. The context persists until explicitly changed by calling this function again with a new value. Works automatically in both synchronous and asynchronous contexts.

​
Parameters

ParameterTypeRequiredDefaultDescription
modelModel✗NoneThe Model instance to attach context to
contextstr✗NoneContext string providing additional information about available options, constraints, or background for the LLM interaction

​
Example

from strands.models.openai import OpenAIModel
from fiddler_strandsagents import set_llm_context

model = OpenAIModel(api_key="...", model_id="gpt-4")
set_llm_context(
    model,
    'Available hotels: Hilton, Marriott, Hyatt...'
)

# Now when the model is invoked, the context will be
# included in the telemetry span
agent = Agent(model=model, system_prompt="You are a travel assistant")
response = agent("Which hotel should I book?")