Add Ego4D local AV ablation workflow

This commit is contained in:
Xin Wang
2026-08-28 00:25:54 +08:00
parent 8b2fbd2622
commit b5ce64702a
8 changed files with 731 additions and 41 deletions

View File

@@ -284,6 +284,16 @@ transition prevalence is 11.21718%, while transition AP is approximately
over R1 by only 0.01162 points and transition AP by 0.16660 points. Seed 2 is
still required before freezing this as a complete null ablation.
## Ego4D local-feature ablation family
To test whether the recent-audio / per-person-visual gains transfer from EasyCom,
see [the Ego4D local-feature experiment guide](docs/ego4d_local_baselines.md).
It reuses existing global Omni features and the EgoSpeak manifest, extracts local
A/V directly from raw clips, and runs **G / G+A / G+V / G+A+V** for four epochs,
without a dev set. `run_ego4d_local_baselines.py` preflights all train/test files
and encoder contracts before training; the summary reports matched-seed deltas,
including AV minus audio. No new accuracy claim is implied by adding the code.
## Current Ego4D context-length results
The following single-seed snapshot was recorded on 2026-08-22. Both variants