DirectFisheye-GS: Enabling Native Fisheye Input in Gaussian Splatting with Cross-View Joint Optimization

A new framework called DirectFisheye-GS has been introduced, enabling native fisheye image input in 3D Gaussian Splatting (3DGS) for enhanced 3D scene reconstruction. This advancement addresses issues related to undistorting fisheye images, which previously led to information loss and detail dilution.

The integration of fisheye camera models into 3DGS is significant for virtual and augmented reality (VR/AR) applications, as it allows for high-quality reconstructions from fewer inputs, potentially improving efficiency and rendering fidelity in these technologies.