You can stream production data to Fiddler as an alternative to batch publishing. Streaming offers lower latency, which is beneficial for high-velocity or near real-time models.Documentation Index
Fetch the complete documentation index at: https://handbook.fiddler.ai/llms.txt
Use this file to discover all available pages before exploring further.
When to Use Streaming vs. Batch Publishing
- Use streaming when low latency is a priority and you’re working with individual events or small batches
- Use batch publishing for large datasets or when you need to track longer-running processes with Job objects
Stream Individual Inference Events
To stream a single inference event:Stream Small Batches of Events
For better efficiency, you can stream multiple events at once:🚧 Note Convert a pandas DataFrame to a list of event dictionaries using the to_dict function.