46 lines
2.1 KiB
Markdown
46 lines
2.1 KiB
Markdown
# Third-party reference code
|
|
|
|
Audited reference repositories are vendored here so a normal clone of this
|
|
project contains the exact source used by the experiments. The nested
|
|
upstream `.git` directories are deliberately removed; each checkout records
|
|
its immutable source commit in `.upstream-revision`.
|
|
|
|
The track-GRU design was checked against the official EgoSpeak repository at
|
|
revision `b5bee35e796d8f2d6aa7da2bf1b07836270f8bfb`:
|
|
|
|
```bash
|
|
git clone https://github.com/jun297/EgoSpeak.git third_party/EgoSpeak
|
|
git -C third_party/EgoSpeak checkout b5bee35e796d8f2d6aa7da2bf1b07836270f8bfb
|
|
```
|
|
|
|
The project implementation does not import EgoSpeak at runtime. Its source is
|
|
retained for implementation comparison and license/provenance auditing.
|
|
|
|
The high-rate local AV extractor imports the vendored official MuVAP ASD
|
|
implementation at audited revision `a1ef9c8` and its published `asd-cpc`
|
|
weights. The MuVAP-only Stage-3 reconstruction additionally uses the published
|
|
25 Hz `vap-role-cpc` release. To refresh this vendored copy intentionally,
|
|
clone and audit the new revision outside the project first, then update the
|
|
source, weights and `.upstream-revision` together:
|
|
|
|
```bash
|
|
git clone https://github.com/Haotian-Qi/MuVAP.git third_party/MuVAP
|
|
git -C third_party/MuVAP checkout a1ef9c8
|
|
python third_party/MuVAP/tools/fetch_frontends.py cpc
|
|
huggingface-cli download Haotian-Qi/MuVAP \
|
|
--include 'asd-cpc/*' 'vap-role-cpc/*' \
|
|
--local-dir third_party/MuVAP/weights
|
|
```
|
|
|
|
The published `asd-cpc`/`vap-role-cpc` releases and CPC frontend are retained
|
|
in this directory. The extractors hash each consumed release into every
|
|
feature contract.
|
|
It imports this exact checkout directly, so an editable install is not
|
|
required. In an established Qwen container, avoid letting MuVAP's package
|
|
metadata replace the working PyTorch/Transformers stack. The additional import
|
|
requirements are `torchaudio`, `einops`, and `PyYAML`; verify/install only the
|
|
missing packages.
|
|
|
|
See [`docs/easycom_highrate_person_av.md`](../docs/easycom_highrate_person_av.md)
|
|
for the causality contract and experiment commands.
|