frames: add EndTaskFrame and CancelTaskFrame

This commit is contained in:
Aleix Conchillo Flaqué
2024-09-24 19:10:22 -07:00
parent 31b5667cee
commit ee3786fe15
3 changed files with 39 additions and 2 deletions

View File

@@ -9,6 +9,10 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
### Added
- Added `EndTaskFrame` and `CancelTaskFrame`. These are new frames that are
meant to be pushed upstream to tell the pipeline task to stop nicely or
immediately respectively.
- Added configurable LLM parameters (e.g., temperature, top_p, max_tokens, seed)
for OpenAI, Anthropic, and Together AI services along with corresponding
setter functions.