Pipeline: improve performance by using direct mode

2025-08-14 15:15:47 -07:00
parent 609a43a191
commit dc7bf98ce5
3 changed files with 7 additions and 3 deletions
--- a/CHANGELOG.md
+++ b/CHANGELOG.md
@@ -38,6 +38,10 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 - Fixed an issue where `AsyncAITTSService` had very high latency in responding
  by adding `force=true` when sending the flush command.

+### Performance
+
+- `Pipeline` performance improvements by using direct mode.
+
 ### Other

 - Added `14w-function-calling-mistal.py` using `MistralLLMService`.