Jia-Bin Huang (@jbhuang0604)

2025-05-13 | โค๏ธ 165 | ๐Ÿ” 29


Exploration is key for robots to generalize, especially in open-ended environments with vague goals and sparse rewards.

BUT, how do we go beyond random poking? Wouldnโ€™t it be great to have a robot that explores an environment just like a kid?

Introducing Imagine, Verify, Execute (IVE)!

IVE leverages Vision-Language models to โ€ข extract semantic scene graphs, โ€ข imagine novel scenes, โ€ข predict their physical plausibility, and โ€ข generate executable sequences.

IVE is a memory-guided agentic exploration framework that operates fully automatically, enabling more diverse and meaningful exploration.

๋ฏธ๋””์–ด

video


Auto-generated - needs manual review

Tags

domain-robotics domain-ai-ml domain-dev-tools domain-visionos