MrNeRF (@janusch_patas)
2024-11-08 | โค๏ธ 159 | ๐ 20
SharedNeRF: Leveraging Photorealistic and View-dependent Rendering for Real-time and Remote Collaboration
Abstract (excerpt): When collaborators are remote, coordinating the sharing of views of their physical environment becomes challenging.
Video-conferencing tools often do not provide the desired viewpoints for a remote viewer. While RGB-D cameras offer 3D views, they lack the necessary fidelity.
We introduce SharedNeRF, designed to enhance synchronous remote collaboration by leveraging the photorealistic and view-dependent nature of Neural Radiance Field (NeRF). The system complements the higher visual quality of the NeRF rendering with the instantaneity of a point cloud and combines them through carefully accommodating the dynamic elements within the shared space, such as hand gestures and moving objects.
The system employs a head-mounted camera for data collection, creating a volumetric task space on the fly and updating it as the task space changes.
๋ฏธ๋์ด
