Delegate wearer boundary semantics to review

This commit is contained in:
Xin Wang
2026-09-15 02:12:18 +08:00
parent 71dfd8808a
commit 3a127a3f9f
12 changed files with 596 additions and 404 deletions

View File

@@ -233,14 +233,16 @@ participant timeline is retained to derive committed interaction events for
behavioral evaluation.
\textbf{Behavioral event annotation.}
We use floor-level wearer transitions as high-recall anchors for positive-event
annotation. Each wearer onset is examined retrospectively for a preceding
non-wearer floor release as contextual metadata and labeled as a wearer-entry
whenever the subsequent wearer speech constitutes a genuine floor take,
including re-entry while another speaker is active. Similarly, each wearer offset
is examined for a new competing non-wearer onset during the current wearer turn
and labeled as INT-yield only when the competing speaker genuinely takes over
the floor. We use permissive temporal retrieval and let an LLM jointly inspect
We use every observed wearer activity transition as a high-recall semantic
candidate. For each wearer onset, nearby preceding non-wearer releases, the
intervening silence gap, and concurrent activity are retained as contextual
facts; the onset is labeled as wearer entry only when the subsequent wearer
speech constitutes a genuine floor take, including re-entry while another
speaker is active. For each wearer offset, nearby non-wearer onsets and offsets,
pre-existing and newly active speakers, overlap durations, and subsequent
speakers are retained without a timing-based takeover gate; the offset is
labeled as INT-yield only when a non-wearer genuinely takes over and the wearer
relinquishes the floor. We let an LLM jointly inspect
participant-resolved timing and transcripts to provide a semantic pre-label,
followed by mandatory human adjudication. Separately, we mine regions with no
wearer response that nevertheless constitute false-positive opportunities:
@@ -272,7 +274,9 @@ HN: other backchannel & \todo{--} & \todo{--} \\
HN: non-takeover overlap & \todo{--} & \todo{--} \\
HN: wearer holds floor & \todo{--} & \todo{--} \\
\hline
Excluded / fallback & \todo{--} & \todo{--} \\
Excluded: valid but out of scope & \todo{--} & \todo{--} \\
Excluded: insufficient evidence & \todo{--} & \todo{--} \\
Excluded: data quality & \todo{--} & \todo{--} \\
\textbf{Scoring-eligible total} & \todo{--} & \todo{--} \\
\hline
\end{tabular}
@@ -557,42 +561,38 @@ because, by definition, many contain no wearer transition.
\subsection{Positive-event mining}
\textbf{Floor-level transitions.}
Short wearer-silence gaps are conditionally merged before positive mining. In
the current audit configuration, a raw onset after at most 0.8~s of silence is
treated as a within-turn resumption unless the gap contains sustained competing
non-wearer activity. Short feedback-like activity does not by itself split the
wearer episode. This grouping changes only the behavioral-event layer, not the
source intervals or dense targets.
\textbf{Wearer activity transitions.}
We preserve every raw wearer $0\!\rightarrow\!1$ and $1\!\rightarrow\!0$
boundary as a semantic review candidate. Candidate construction does not merge
short silence gaps, infer within-turn resumption, or decide whether overlapping
speech constitutes takeover. It only records participant-resolved temporal and
transcript facts. The source intervals and dense targets remain unchanged.
\textbf{Wearer entry.}
Every floor-level wearer onset at $t_b$ is proposed as a wearer-entry candidate.
We additionally search backward for plausible non-wearer floor releases. A
release at $t_r$ is retained as a contextual option
only when the interval from $t_r$ to $t_b$ contains neither intervening wearer
speech nor a competing non-wearer onset. Each wearer onset contributes at most
one review item: $t_b$ is its immutable \emph{behavior anchor}, and the item
stores every admissible \emph{opportunity-anchor} option and response delay.
Silence duration alone does not reject an option. A preceding release is not
required for a positive entry: the wearer may enter after a release, from
silence, or while another speaker remains active. When a release clearly
prompts the entry, the LLM or human may select one supplied option; neither may
invent or move a trigger timestamp. The release relation is metadata for
response-oriented analyses, not part of the positive entry label.
Every raw wearer onset at $t_b$ is proposed as one wearer-entry review item.
We search backward within the retrieval window for non-wearer offsets and store
each one with its response delay and factual indicators of intervening wearer
speech, intervening other onsets, and concurrent activity. These are possible
context anchors rather than deterministically admissible causes. The LLM and
human reviewer decide whether the boundary is a genuine new entry, a
within-turn resumption, a wearer backchannel, or an excluded non-event. A
preceding release is not required for a positive entry: the wearer may enter
after a release, from silence, or while another speaker remains active. When a
release clearly prompts the entry, the LLM or human may select one supplied
option; neither may invent or move a timestamp.
\textbf{INT-yield.}
Starting from an episode-ending wearer offset $t_y$, we search backward inside
the current wearer episode for a new competing non-wearer onset $t_o$. With
$t_w$ denoting the wearer-episode start, an INT candidate must satisfy
\begin{equation}
t_w < t_o < t_y < t_o^{\mathrm{off}}.
\label{eq:int_candidate}
\end{equation}
The current audit allows a one-frame (50-ms) tolerance only at the offset
boundary. Pre-existing other activity, post-completion onsets, offsets inside a
merged wearer episode, and completion-to-silence remain controls. Timing only
retrieves a possible interruption; the LLM and human annotator decide whether
the competitor genuinely takes over and the wearer yields.
Every raw wearer offset $t_y$ is proposed as an INT-yield review item. The
generator records the current wearer activity-run start, all nearby non-wearer
onsets and offsets, activity immediately before and after $t_y$, whether an
other speaker is pre-existing or begins during wearer speech, strict and
50-ms-tolerant boundary crossing, overlap duration, the next speech onset,
transcripts, and target-of-speech metadata. Relations such as
$t_w<t_o<t_y<t_o^{\mathrm{off}}$ are descriptive evidence only: they neither
admit nor reject a candidate and do not establish takeover. The LLM and human
annotator answer whether the wearer stopped because a non-wearer genuinely took
over the floor. Natural completion, post-completion activity, and within-turn
pauses are therefore resolved semantically rather than pre-filtered.
\subsection{False-positive opportunity mining}
@@ -624,9 +624,11 @@ relabel it, or exclude an
unscorable region. Only human-confirmed \textsc{Wearer-Entry},
\textsc{INT-Yield}, and hard-negative opportunities enter evaluation;
\textsc{Exclude} candidates do not. Thus \textsc{Exclude} is the sole
non-scoring outcome for out-of-scope non-events (e.g., natural wearer completion
that merely coincides with feedback), insufficient evidence, unresolvable data
quality, or pre-label disagreement.
non-scoring verdict, but every exclusion retains a closed-vocabulary reason and
derived aggregation group. We report valid-but-out-of-scope behavior (e.g.,
natural wearer completion coincident with feedback), insufficient semantic
evidence, and data-quality failures separately; model-pass disagreement belongs
to insufficient evidence and is never counted as corrupt data.
Annotation-only transcripts, identities, target-of-speech metadata, LLM output,
and future observations are never supplied to the evaluated forecasting model.