LLMService: run function calls sequentially

This commit is contained in:
Aleix Conchillo Flaqué
2025-04-25 20:04:35 -07:00
parent 9f223442c2
commit a50a407415
9 changed files with 166 additions and 72 deletions

View File

@@ -9,6 +9,13 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
### Added
- Function calls can now be executed sequentially (in the order received in the
completion) by passing `run_in_parallel=False` when creating your LLM
service. By default, function calls run in parallel, so if the LLM completion
returns 2 or more function calls they run concurrently. In both cases,
concurrently and sequentailly, a new LLM completion will run when the last
function call finishes.
- Added OpenTelemetry tracing for `GeminiMultimodalLiveLLMService` and
`OpenAIRealtimeBetaLLMService`.