You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Tool calls from MistralAI will be contained entirely in a single chunk returned from their streaming API, thus it doesn't require buffering during streaming and concatenation after streaming to reassemble the complete tool call. That being said, the current implementation of the MistralAI streaming chat completion service in .Net SK doesn't need any modification to have tool calls appear in the prompt span events.
Note: we are not sure if MistralAI supports parallel function calling and if it does how will multiple tool calls get streamed back to the client.
Describe the bug
Tool call information in model diagnostics when using Mistral streaming.
Expected behavior
Tool call information should be presented in model diagnostics when using Mistral streaming.
The text was updated successfully, but these errors were encountered: