Rose Hendrix

srraen@ilolh.eoga

I am a Senior Research Engineer at the Allen Institute for Artificial Intelligence (AI2) on the Perceptual Reasoning and Interaction (PRIOR) team, where I work on embodied AI in unstructured human environments. Prior to that, I earned my PhD in Mechanical Engineering at the University of Washington, where I was advised by Santosh Devasia and Joseph Garbini.

GitHub  /  Google Scholar  /  Twitter

profile photo

Research

I'm interested in how to bring robotics into unstructured human environments. Here is my relevant recent work - please see my Google Scholar for a complete history. * denotes equal contribution.

project image

SPOC: Imitating Shortest Paths in Simulation Enables Effective Navigation and Manipulation in the Real World


Rose Hendrix*, Kiana Ehsani*, Tanmay Gupta*, Jordi Salvador*, Luca Weihs*, Kuo-Hao Zeng*, Kunal Pratap Singh, Yejin Kim, Winson Han, Alvaro Herrasti, Ranjay Krishna, Dustin Schwenk, Eli VanderBilt, Aniruddha Kembhavi
CVPR, 2024
arxiv / code / website /

We train a supervised model to imitate shortest path trajectories collected from simulation and show that it generalizes to perform effective navigation and manipulation when deployed on real world agents.

project image

Phone2Proc: Bringing Robust Robots Into Our Chaotic World


Rose Hendrix*, Matt Deitke*, Luca Weihs, Ali Farhadi, Kiana Ehsani, Aniruddha Kembhavi
CVPR, 2023
arxiv / code / website /

From a 10-minute iPhone scan of any environment, we condition procedural scene generation on that scan to generate training environments. Training a robot to perform ObjectNav in these scenes dramatically improves sim-to-real performance from 35% to 71% and results in an agent that is remarkably robust to human movement, lighting variations, added clutter, and rearranged objects.





Original design and source code from Jon Barron, modified by Leonid Keselman, and email scrambler by Jeff Donohue.