DensifyBeforehand: LiDAR-assisted Content-aware Densification for Efficient and Quality 3D Gaussian Splatting

A new method for real-time LiDAR point cloud densification has been introduced, addressing the challenges of capturing dynamic 3D scenes and processing them with minimal latency. This approach utilizes high-resolution color images and a convolutional neural network to generate dense depth maps at full HD resolution in real time, significantly outperforming previous methods.

A novel multimodal framework, MMLGNet, has been introduced to align heterogeneous remote sensing modalities, such as Hyperspectral Imaging and LiDAR, with natural language semantics using vision-language models like CLIP. This framework employs modality-specific encoders and bi-directional contrastive learning to enhance the understanding of complex Earth observation data.

A new framework named MSSF has been introduced, combining 4D millimeter-wave radar and camera technologies to enhance 3D object detection in autonomous driving. This approach addresses the limitations of existing radar-camera fusion methods, which have struggled with sparse and noisy point clouds, by implementing a multi-stage sampling technique that improves interaction with image semantic information.