Can MLLMs Read the Room? A Multimodal Benchmark for Assessing Deception in Multi-Party Social Interactions

arXiv — cs.CVFriday, November 21, 2025 at 5:00:00 AM
  • A recent study highlights the limitations of Multimodal Large Language Models (MLLMs) in detecting deception during complex social interactions, introducing a new benchmark called MIDA to evaluate their performance.
  • This development underscores the challenges faced by advanced AI models, particularly in understanding nuanced human communication, which is essential for applications in social robotics and virtual assistants.
  • The findings reflect ongoing concerns about the reliability of MLLMs, as they often fail to integrate multimodal cues effectively, a challenge echoed in various studies addressing hallucinations and misinformation in AI
— via World Pulse Now AI Editorial System

Was this article worth reading? Share it

Recommended apps based on your readingExplore all apps
Continue Readings
Where Does Vision Meet Language? Understanding and Refining Visual Fusion in MLLMs via Contrastive Attention
PositiveArtificial Intelligence
A recent study has explored the integration of visual and textual information in Multimodal Large Language Models (MLLMs), revealing that visual-text fusion occurs at specific layers within these models rather than uniformly across the network. The research highlights a late-stage
Incentivizing Cardiologist-Like Reasoning in MLLMs for Interpretable Echocardiographic Diagnosis
PositiveArtificial Intelligence
A novel approach has been proposed to enhance echocardiographic diagnosis through the integration of a Cardiac Reasoning Template (CRT) and CardiacMind, aimed at improving the reasoning capabilities of multimodal large language models (MLLMs). This method addresses the challenges faced by existing models in capturing the relationship between quantitative measurements and clinical manifestations in cardiac screening.
ClimateIQA: A New Dataset and Benchmark to Advance Vision-Language Models in Meteorology Anomalies Analysis
PositiveArtificial Intelligence
A new dataset named ClimateIQA has been introduced to enhance the capabilities of Vision-Language Models (VLMs) in analyzing meteorological anomalies. This dataset, which includes 26,280 high-quality images, aims to address the challenges faced by existing models like GPT-4o and Qwen-VL in interpreting complex meteorological heatmaps characterized by irregular shapes and color variations.
LLaVAction: evaluating and training multi-modal large language models for action understanding
PositiveArtificial Intelligence
The research titled 'LLaVAction' focuses on evaluating and training multi-modal large language models (MLLMs) for action understanding, reformulating the EPIC-KITCHENS-100 dataset into a benchmark for MLLMs. The study reveals that leading MLLMs struggle with recognizing correct actions when faced with difficult distractors, highlighting a gap in their fine-grained action understanding capabilities.
DriveRX: A Vision-Language Reasoning Model for Cross-Task Autonomous Driving
PositiveArtificial Intelligence
DriveRX has been introduced as a vision-language reasoning model aimed at enhancing cross-task autonomous driving by addressing the limitations of traditional end-to-end models, which struggle with complex scenarios due to a lack of structured reasoning. This model is part of a broader framework called AutoDriveRL, which optimizes four core tasks through a unified training approach.
Ground What You See: Hallucination-Resistant MLLMs via Caption Feedback, Diversity-Aware Sampling, and Conflict Regularization
PositiveArtificial Intelligence
A recent study has introduced a framework aimed at mitigating hallucination issues in Multimodal Large Language Models (MLLMs) during Reinforcement Learning (RL) optimization. The research identifies key factors contributing to hallucinations, including over-reliance on visual reasoning and insufficient exploration diversity. The proposed framework incorporates modules for caption feedback, diversity-aware sampling, and conflict regularization to enhance model reliability.
KidVis: Do Multimodal Large Language Models Possess the Visual Perceptual Capabilities of a 6-Year-Old?
NeutralArtificial Intelligence
A new benchmark called KidVis has been introduced to evaluate the visual perceptual capabilities of Multimodal Large Language Models (MLLMs), specifically assessing their performance against that of 6-7 year old children across six atomic visual capabilities. The results reveal a significant performance gap, with human children scoring an average of 95.32 compared to GPT-5's score of 67.33.
UR-Bench: A Benchmark for Multi-Hop Reasoning over Ultra-High-Resolution Images
NeutralArtificial Intelligence
The introduction of the Ultra-high-resolution Reasoning Benchmark (UR-Bench) aims to evaluate the reasoning capabilities of multimodal large language models (MLLMs) specifically on ultra-high-resolution images, which have been largely unexplored in existing visual question answering benchmarks. This benchmark features two main categories, Humanistic Scenes and Natural Scenes, with images ranging from hundreds of megapixels to gigapixels, accompanied by structured questions.

Ready to build your own newsroom?

Subscribe to unlock a personalised feed, podcasts, newsletters, and notifications tailored to the topics you actually care about