Zhengyi “Zen” Luo (@zhengyiluo)

2024-08-21 | ❤️ 160 | 🔁 37


All code, data, and models are now released for SimXR.

https://github.com/ZhengyiLuo/SimXR https://x.com/zhengyiluo/status/1826361376362656072/video/1

미디어

video


인용 트윗

Zhengyi “Zen” Luo (@zhengyiluo)

CVPR2024 Highlight🌟 SimXR: Real-Time Simulated Avatar from Head-Mounted Sensors

Controlling simulated humanoids and estimate full-body pose using SLAM images and headset pose in real time.

🌐: https://t.co/C1wCBYUBKm 📜: https://t.co/eAIJKaNe5v 🧑🏻‍💻: https://t.co/JiLd6DEjaK

Input: four SLAM views from Quest 2 headset and 6DoF headset pose. Output: full-body humanoid control signals.

Leveraging the laws of physics as a strong prior for egocentric pose estimation.

원본 트윗

🎬 영상

Tags

domain-vision-3d domain-ai-ml domain-dev-tools