Analyzing the Effect of Entrainment on Dialogue Acts
Paper · 2016 · Masahiro Mizukami, Koichiro Yoshino, Graham Neubig et al.
Summary
Speakers in a conversation tend to converge on each other's behaviour. This convergence is called entrainment. It is well studied for word choice, but little is known about whether it also shapes the structure of a dialogue. The authors ask three questions. Do partners align in the dialogue acts they choose? Does lexical alignment depend on the dialogue act of an utterance? Does alignment grow as a conversation goes on? Working on the Switchboard Corpus, they build on the Nenkova et al. word-distribution score with two changes. First, the raw score is replaced by a rank-based Entrainment Score Ratio, which counts how often the real partner beats every non-partner speaker. Second, per-speaker unigram distributions are Dirichlet-smoothed against a corpus-wide background model, which reduces sparsity effects. The findings are:
- Dialogue-act entrainment exists.
- Lexical entrainment is strongest in low-content acts such as greetings, closings, backchannels and agreement.
- Entrainment rises slightly from the first half of a dialogue to the second, but not significantly.
These results suggest that dialogue systems should adapt to users at the act level and should do so progressively.
Key points
- Data: Switchboard Corpus with dialogue-act labels. The per-act analysis covers N = 2310 target speakers.
- Baseline check on the 25MFC word class gives a score of -0.211 for partners and -0.248 for non-partners. This reproduces the earlier finding that real partners align more.
- Word classes from prior work are 25MFC, 25MFD, ACW (affirmative cue words) and FP (filled pauses). 25MFC is the main class used.
- Conventional-closing shows the strongest lexical entrainment, with Cohen's d 1.50 and Ratio 0.703. Effects are counted as notable at d > 0.5 or Ratio > 0.55. Acts such as Apology, Action-directive and several question types show almost no gain.
- The smoothing weight α is fitted by maximizing likelihood under a Dirichlet process prior with Newton's method.
- The partner versus non-partner difference is already significant in the earlier half of dialogues. A "Cross" condition tests whether one speaker's earlier words reappear later in the partner's speech.
Interesting ideas
- I1. Compare each real pair against many shuffled non-partner pairs and report the win rate, not the raw similarity; this makes measures over sets of very different sizes comparable.
- I2. Smooth small per-slice distributions (per speaker, act and dialogue part) toward a global background model with a fitted Dirichlet weight, so that sparse slices do not look artificially dissimilar.
- I3. Condition lexical measurements on the dialogue act of an utterance, since formulaic acts behave very differently from content-bearing ones.
- I4. The authors admit that their measure cannot separate fixed adjacency responses (coordination) from true entrainment, which flags a confound to design against.
- I5. Split each dialogue into earlier and later halves and add a cross condition to detect delayed influence of one speaker on the other.
For Mova
How these ideas could serve Mova, our small open language model — its files, stages and tests:
- I1 (learn): use partner-vs-random win rates as a negative control when testing whether two parsers' agreement or a frame match exceeds chance.
- I2 (tokens): smooth per-genre or per-author lemma and tag statistics toward corpus-wide counts before comparing texts.
- I3 (frames): tag greeting, closing and backchannel speech acts in prag as formulaic, so that they are not over-interpreted as carrying content or implicature.
- I4 (frames): model conventional responses such as hi→hello or bye→bye as explicit adjacency-pair rules in prag, kept apart from learned stylistic alignment.
- I5 (world): track when a character's wording or state first appears and then recurs in another character's speech, giving the event-order model evidence of influence.
📚 Shelves 6 Computer Science · 9,086 works Artificial Intelligence · 8,889 works Arts and Humanities · 9,296 works Language and Linguistics · 9,206 works Psychology · 798 works Social Psychology · 129 works
🧭 Topics 2 Dialogue systems · 401 works Speech act theory · 160 works
Cite
Cite as Masahiro Mizukami, Koichiro Yoshino, Graham Neubig, David Traum and Satoshi Nakamura. 2016. Analyzing the Effect of Entrainment on Dialogue Acts. Proceedings of the 17th Annual Meeting of the Special Interest Group on Discourse and Dialogue.
@inproceedings{mizukami2016analyzing,
title = {{Analyzing the Effect of Entrainment on Dialogue Acts}},
author = {Masahiro Mizukami, Koichiro Yoshino, Graham Neubig, David Traum and Satoshi Nakamura},
booktitle = {Proceedings of the 17th Annual Meeting of the Special Interest Group on Discourse and Dialogue},
year = {2016},
doi = {10.18653/v1/w16-3640},
url = {https://doi.org/10.18653/v1/w16-3640}
}References
- Table 5: The entrainment score for combinations of part Partner Non-Partner Rate En(25MFC|Earlier) -0.106** -0.126 0.658 En(25MFC|Cross) -0.106** -0.127 0.666 En(25MFC|Later) -0.104** -0.126 0.674 * p < 0.10, ** p < 0.05* Štefan Beňuš, Agustı́n Gravano, Rivka Levitan, Sarah Ita Levitan, Laura Willson, and Julia Hirschberg. 2014. Entrainment, dominance and alliance in supreme court hearings. Knowledge-Based Systems, 71:3–14. find
- Susan E Brennan and Herbert H Clark. 1996. Conceptual pacts and lexical choice in conversation. Journal of Experimental Psychology: Learning, Memory, and Cognition, 22(6):1482. *Table 6: The p-values for partner’s entrainment score between each part p-value En(25MFC|Earlier) En(25MFC|Later) 0.222 En(25MFC|Earlier) En(25MFC|Cross) 0.238 En(25MFC|Cross) 0.00425 En(25MFC|Later)* Nick Campbell and Stefan Scherer. 2010. Comparing measures of synchrony and alignment in dialogue speech timing with respect to turn-taking activity. In INTERSPEECH, pages 2546–2549. ↗
- Jacob Cohen. 1988. Statistical power analysis for the behavioral sciences. 2nd edn. hillsdale, new jersey: L. earlier and later parts of the conversation, the difference is slight. find
- Rachel Coulston, Sharon Oviatt, and Courtney Darves. 2002. Amplitude convergence in children’s conversational speech with animated personas. In Proc. ICSLP, volume 4, pages 2689–2692. find
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/papers/mizukami-2016-analyzing-effect-entrainment-dialogue-acts/