wx44wx/icassp2027-experiment
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Add EasyCom encoder-only comparison workflow

Browse Source
This commit is contained in:
Xin Wang
2026-08-28 10:44:13 +08:00
parent ee5e735fc2
commit 321238a92f
8 changed files with 488 additions and 49 deletions
Download Patch File Download Diff File Expand all files Collapse all files

15
README.md
View File

@@ -11,6 +11,11 @@ The pooled local-feature B1 experiment (frozen Qwen face crops + recent audio,
native 2048D sidecars, optional trainable projection, four-epoch ablations) is
documented in [docs/local_feature_baseline.md](docs/local_feature_baseline.md).
For **EasyCom encoder-only A / V / AV** with no Thinker states, start with
[the EasyCom comparison commands](docs/easycom_encoder_only.md).
They reuse the verified local sidecars, train on Session 4–12, test on 3/2/1,
and keep four epochs with no dev set.
The main experiment is deliberately simple:
```text
@@ -301,11 +306,13 @@ GPU workers, with per-GPU logs, validated resume, and foreground supervision.
See the guide's L20 commands for the `/data1/yfzx/wangx` paths.
For **encoder-only A / V / AV**, without Thinker states, see
[the encoder-only comparison guide](docs/ego4d_encoder_only.md).
[the Ego4D guide](docs/ego4d_encoder_only.md) or
[the EasyCom-first guide](docs/easycom_encoder_only.md).
`prepare_encoder_only_features.py` packs complete local vectors and validity
bits on CPU; `run_ego4d_encoder_only.py` trains/evaluates four-epoch heads with
no dev set. This native-concatenation baseline is not capacity- or
context-matched to the Thinker baseline.
bits on CPU (pass `--dataset easycom` for EasyCom; default remains Ego4D).
`run_ego4d_encoder_only.py` / `run_easycom_encoder_only.py` train/evaluate
four-epoch heads with no dev set. This native-concatenation baseline is not
capacity- or context-matched to the Thinker baseline.
## Current Ego4D context-length results