arXiv:2511.19117v1 Announce Type: new 
Abstract: The miniaturization of thermal sensors for mobile platforms inherently limits their spatial resolution and textural fidelity, leading to blurry and less informative images. Existing thermal super-resolution (SR) methods can be grouped into single-image and RGB-guided approaches: the former struggles to recover fine structures from limited information, while the latter relies on accurate and laborious cross-camera calibration, which hinders practical deployment and robustness. Here, we propose 3M-TI, a calibration-free Multi-camera cross-Modality diffusion framework for Mobile Thermal Imaging. At its core, 3M-TI integrates a cross-modal self-attention module (CSM) into the diffusion UNet, replacing the original self-attention layers to adaptively align thermal and RGB features throughout the denoising process, without requiring explicit camera calibration. This design enables the diffusion network to leverage its generative prior to enhance spatial resolution, structural fidelity, and texture detail in the super-resolved thermal images. Extensive evaluations on real-world mobile thermal cameras and public benchmarks validate our superior performance, achieving state-of-the-art results in both visual quality and quantitative metrics. More importantly, the thermal images enhanced by 3M-TI lead to substantial gains in critical downstream tasks like object detection and segmentation, underscoring its practical value for robust mobile thermal perception systems. More materials: https://github.com/work-submit/3MTI.

إن إدخال 3M-TI، وهو إطار عمل متعدد الكاميرات بدون معايرة، يمثل تقدمًا كبيرًا في تكنولوجيا التصوير الحراري المحمول. تتضمن هذه الطريقة المبتكرة دمج وحدة انتباه متعددة الأبعاد في UNet الخاص بالانتشار، مما يسمح بمحاذاة الميزات الحرارية وRGB دون الحاجة إلى معايرة معقدة، مما يحسن جودة الصورة وتفاصيلها.

La introducción de 3M-TI, un marco de difusión multi-cámara sin calibración, marca un avance significativo en la tecnología de imágenes térmicas móviles. Este enfoque innovador integra un módulo de atención cruzada en el UNet de difusión, permitiendo la alineación de características térmicas y RGB sin necesidad de calibración compleja de cámaras, mejorando así la calidad y el detalle de las imágenes.

L'introduction de 3M-TI, un cadre de diffusion multi-caméras sans calibration, marque une avancée significative dans la technologie d'imagerie thermique mobile. Cette approche innovante intègre un module d'attention croisée dans le diffusion UNet, permettant l'alignement des caractéristiques thermiques et RGB sans nécessiter de calibration complexe des caméras, améliorant ainsi la qualité et le détail des images.

The introduction of 3M-TI, a calibration-free Multi-camera cross-Modality diffusion framework, marks a significant advancement in mobile thermal imaging technology. This innovative approach integrates a cross-modal self-attention module into the diffusion UNet, enabling the alignment of thermal and RGB features without the need for complex camera calibration, thus enhancing image quality and detail.

3M-TI: High-Quality Mobile Thermal Imaging via Calibration-free Multi-Camera Cross-Modal Diffusion

Was this article worth reading? Share it

LangWatch

OpenL Translator

Chroma