Add Ego4D local AV ablation workflow
This commit is contained in:
10
README.md
10
README.md
@@ -284,6 +284,16 @@ transition prevalence is 11.21718%, while transition AP is approximately
|
||||
over R1 by only 0.01162 points and transition AP by 0.16660 points. Seed 2 is
|
||||
still required before freezing this as a complete null ablation.
|
||||
|
||||
## Ego4D local-feature ablation family
|
||||
|
||||
To test whether the recent-audio / per-person-visual gains transfer from EasyCom,
|
||||
see [the Ego4D local-feature experiment guide](docs/ego4d_local_baselines.md).
|
||||
It reuses existing global Omni features and the EgoSpeak manifest, extracts local
|
||||
A/V directly from raw clips, and runs **G / G+A / G+V / G+A+V** for four epochs,
|
||||
without a dev set. `run_ego4d_local_baselines.py` preflights all train/test files
|
||||
and encoder contracts before training; the summary reports matched-seed deltas,
|
||||
including AV minus audio. No new accuracy claim is implied by adding the code.
|
||||
|
||||
## Current Ego4D context-length results
|
||||
|
||||
The following single-seed snapshot was recorded on 2026-08-22. Both variants
|
||||
|
||||
Reference in New Issue
Block a user