DEFT-LLM: Disentangled Expert Feature Tuning for Micro-Expression Recognition
PositiveArtificial Intelligence
Micro expression recognition (MER) is essential for understanding genuine emotions. The application of a multimodal large language model (MLLM) to MER allows for spatio-temporal analysis of facial movements, but challenges remain. These include the entanglement of static appearance and dynamic motion cues, and a semantic gap between textual labels and actual facial muscle movements. To tackle these issues, DEFT-LLM is proposed, which utilizes multi-expert disentanglement to achieve motion semantic alignment, alongside the introduction of Uni-MER, a dataset designed to align text with facial motion.
— via World Pulse Now AI Editorial System
