wx44wx/icassp2027-experiment
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Merge branch 'main' of http://182.92.86.220:8300/wx44wx/icassp2027-experiment

Browse Source
This commit is contained in:
Xin Wang
2026-09-17 01:30:39 +08:00
parent 6d0c8b733b 7344d0c469
commit 5c29457cc6
12 changed files with 1605 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

24
PROJECT_CONTEXT.md
View File

@@ -147,7 +147,16 @@ result.
described as upstream Stage-3 code because that entry point remains
unpublished. See the
[`runbook`](docs/easycom_muvap_stage3_baseline.md).
- `egospeak-omni-zero-residual` is implemented but unmeasured. It strictly
- `egospeak-omni-zero-residual` has a user-reported seed-0 screen. Causal-valid
dense mean mAP increases from `61.193` to `62.714`; raw onset/offset mean
AP increases from `24.491/38.024` to `25.091/40.604`. Offset improves at all
ten horizons; onset gains are modest. Actual checkpoint provenance and
counts were not supplied for independent verification. Opportunity-based
semantic evaluation is temporarily paused because the user suspects
provisional annotation issues; historical metrics remain archived and P0
remains unfinished. See the
[`result record`](results/easycom_egospeak_omni_residual_2026-09-16/README.md).
The implementation strictly
loads and freezes the released MiniROADA A+V/GRU/anticipation path, reuses
existing causal 5 Hz Omni readouts, adds an explicit ten-bin partial-tail
phase embedding, and learns only a zero-output residual over the original
@@ -157,6 +166,19 @@ result.
states remains a future extraction ablation. See the
[`runbook`](docs/easycom_egospeak_omni_residual.md).
### Unmeasured dual-stream continuation
Stage-two `egospeak-omni-selective-finetune` is implemented but unmeasured.
It strictly continues the trained stage-one checkpoint, selectively adapts
MiniROADA's GRU/forecast heads with a lower learning rate, and leaves original
feature extractors, input projection and Omni frozen. It exports immutable
stage-one/original references and automatic threshold-free raw endpoint AP.
The user requested this exploratory continuation while semantic annotations
are audited; P0 remains unfinished. Four additional epochs means eight total
adaptation epochs, requiring the fusion-only continuation control for a
budget-matched unfreezing comparison. See the
[`stage-two runbook`](docs/easycom_egospeak_omni_finetune.md).
### Measured oracle-information screen
- A seed-0, four-epoch Session-12 development screen supplied transcript-derived