A Tri-Modal Dataset and a Baseline System for Tracking Unmanned Aerial Vehicles

arXiv — cs.CVTuesday, November 25, 2025 at 5:00:00 AM
  • A new dataset named MM-UAV has been introduced, designed for tracking unmanned aerial vehicles (UAVs) using a multi-modal approach that includes RGB, infrared, and event signals. This dataset features over 30 challenging scenarios with 1,321 synchronized sequences and more than 2.8 million annotated frames, addressing the limitations of single-modality tracking in difficult conditions.
  • The release of MM-UAV is significant as it provides researchers and developers with a robust benchmark for improving UAV tracking systems, enhancing security technologies that rely on visual multi-object tracking in complex environments.
  • This development reflects a growing trend in leveraging multi-sensor data for various applications, including agriculture and environmental monitoring, as UAVs become increasingly vital in collecting data across diverse fields. The integration of different modalities not only improves tracking accuracy but also opens avenues for advancements in related areas such as object detection and scene understanding.
— via World Pulse Now AI Editorial System

Was this article worth reading? Share it

Recommended apps based on your readingExplore all apps
Continue Readings
MambaRefine-YOLO: A Dual-Modality Small Object Detector for UAV Imagery
PositiveArtificial Intelligence
MambaRefine-YOLO has been introduced as a dual-modality small object detector specifically designed for Unmanned Aerial Vehicle (UAV) imagery, addressing the challenges of low resolution and background clutter in small object detection. The model incorporates a Dual-Gated Complementary Mamba fusion module (DGC-MFM) and a Hierarchical Feature Aggregation Neck (HFAN), achieving a state-of-the-art mean Average Precision (mAP) of 83.2% on the DroneVehicle dataset.
A Theory-Inspired Framework for Few-Shot Cross-Modal Sketch Person Re-Identification
PositiveArtificial Intelligence
A new framework called KTCAA has been introduced for few-shot cross-modal sketch person re-identification, aiming to bridge the gap between hand-drawn sketches and RGB surveillance images. This framework addresses challenges related to domain discrepancy and perturbation invariance, proposing innovative components like Alignment Augmentation and Knowledge Transfer Catalyst to enhance model robustness and alignment capabilities.
One4D: Unified 4D Generation and Reconstruction via Decoupled LoRA Control
PositiveArtificial Intelligence
One4D has been introduced as a unified framework for 4D generation and reconstruction, capable of producing dynamic 4D content through synchronized RGB frames and pointmaps. This framework utilizes a Unified Masked Conditioning mechanism to handle varying sparsities of conditioning frames, allowing for seamless transitions between 4D generation from a single image and reconstruction from full videos or sparse frames.
Enhancing UAV Search under Occlusion using Next Best View Planning
PositiveArtificial Intelligence
Recent advancements in unmanned aerial vehicle (UAV) technology have led to the development of an optimized planning strategy for search and rescue missions in occluded environments, such as dense forests. This strategy focuses on enhancing the effectiveness of UAVs by optimizing camera positioning and perspective to capture clearer ground views during critical missions following natural disasters.
Roadside Monocular 3D Detection Prompted by 2D Detection
PositiveArtificial Intelligence
The introduction of the Promptable 3D Detector (Pro3D) marks a significant advancement in roadside monocular 3D detection, which involves identifying objects in RGB frames and predicting their 3D attributes, such as bird's-eye-view locations. This innovation leverages 2D detections as prompts to enhance the accuracy and efficiency of 3D detection processes.
SPAGS: Sparse-View Articulated Object Reconstruction from Single State via Planar Gaussian Splatting
PositiveArtificial Intelligence
A new framework for articulated object reconstruction has been proposed, utilizing planar Gaussian Splatting to reconstruct 3D objects from sparse-view RGB images captured from a single state. This method introduces a Gaussian information field to optimize viewpoint selection and employs a coarse-to-fine optimization strategy for depth estimation and part segmentation.
Meta Policy Switching for Secure UAV Deconfliction in Adversarial Airspace
PositiveArtificial Intelligence
A new framework for autonomous UAV navigation has been proposed, focusing on meta-policy switching to enhance resilience against adversarial attacks that manipulate sensor inputs. This approach utilizes a discounted Thompson sampling mechanism to dynamically select robust policies, addressing the limitations of traditional reinforcement learning methods in adversarial airspace.