wx44wx/pipecat
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Merge pull request #3684 from ai-coustics/goedev/aic-model-caching

Browse Source 
AIC model caching
This commit is contained in:
Mark Backman
2026-02-16 10:43:14 -05:00
committed by GitHub
parent c682a44bb6 2036757b84
commit dba4de77bf
3 changed files with 398 additions and 30 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
changelog/3684.changed.md Normal file
View File

@@ -0,0 +1,3 @@
- `AICFilter` now shares read-only AIC models via a singleton `AICModelManager` in `aic_filter.py`.
- Multiple filters using the same model path or `(model_id, model_download_dir)` share one loaded model, with reference counting and concurrent load deduplication.
- Model file I/O runs off the event loop so the filter does not block.