Record EgoSpeak three-level evaluation

This commit is contained in:
Xin Wang
2026-09-16 03:31:10 +08:00
parent e4b429545c
commit 4b4624f6b8
8 changed files with 186 additions and 2 deletions

View File

@@ -57,3 +57,13 @@ disjoint Sessions 4--12 calibration reviews and out-of-fold predictions.
Before manuscript reporting, freeze the 2.0-second ENTRY cap, 0.6-second YIELD
cap, positive anchor-selection policy, and multiple-competitor handling using
training-side data only.
## Recorded Sessions 1--3 baseline
The first threshold-free run gives ENTRY AP 52.487% (163 positive, 335 hard
negative; 32.731% prevalence) and INT/YIELD AP 20.135% (28 positive, 109 hard
negative; 20.438% prevalence). It excludes 81 ENTRY and 5 INT cases as invalid
or post-outcome. These are provisional LLM-assisted labels, not human-reviewed
confirmatory results. Dense, raw-boundary, and opportunity metrics and their
Figure 7 interpretation are frozen together in the
[`2026-09-16 result record`](../results/easycom_egospeak_three_level_eval_2026-09-16/README.md).

View File

@@ -159,6 +159,15 @@ adapter 实验。
- addressed-to-wearer response recall 和 latency;
- wearer 已经讲话时的 yield recall 和 latency。
首个 Sessions 1--3 EgoSpeak MiniROADA A+V 基线已把三层指标分开:dense 0.2 秒
mAP/十-horizon mean mAP 为 `74.124/61.155`,raw wearer onset/offset mean AP 为
`24.491/38.024`;在尚未人工复核的 LLM-assisted matched opportunities 上,ENTRY
AP 为 `52.487`(prevalence `32.731%`),INT/YIELD AP 为 `20.135`
(prevalence `20.438%`)。因此 EgoSpeak Figure 7 式连续 wearer score 只能作为 dense
forecasting 的定性解释,不能代替 boundary 或 semantic opportunity 评估。完整 horizon
曲线和限制见
[`three-level baseline record`](../results/easycom_egospeak_three_level_eval_2026-09-16/README.md)。
### P3:第一优先方法——匿名逐人时序旁路
先做易解释、能在 8×L20 上完成的旁路,而不是直接修改整个 Thinker。