MeetingToM: Evaluating Multimodal LLMs on Theory-of-Mind Reasoning in Multi-Party Meetings

TL;DR - MeetingToM is a benchmark for evaluating theory-of-mind reasoning by multimodal LLMs in naturalistic multi-party meetings. It matters because current models struggle to combine verbal and nonverbal cues to infer hidden attitudes and distinguish genuine agreement from socially pressured pseudo-consensus.

• Evaluates mental-state prediction, addressee understanding, and group consensus reasoning.
• Targets latent social dynamics rather than only overt, externally verifiable signals.
• Introduces pseudo-consensus as a meeting-specific challenge involving apparent agreement despite private dissent.
• Analyses of representative models reveal persistent weaknesses in nonverbal cue integration and hidden-attitude inference.