[Meetings] Join us on Monday, July 15! RSS’24 Workshop on Semantics for Robotics: From Environment Understanding and Reasoning to Safe Interaction
SiQi Zhou
Dear Colleagues,
- Venue Location: Lecture Hall D, Aula Conference Centre, TU Delft
- YouTube Stream: http://tiny.cc/rss24-sfr-youtube
Workshop Overview
For robots to safely interact with people and the real world, they need the capability to not only perceive but also understand their surroundings in a semantically meaningful way (i.e., understanding implications or pertinent properties associated with the objects in the scene). Advanced perception methods coupled with learning algorithms have made significant progress in enabling semantic understanding. Recent breakthroughs in foundation models have further exposed opportunities for robots to contextually reason about their operating environments. Semantics is ingrained in every aspect of robotics, from perception to action; reliably exploiting semantic information in embodied systems requires tightly coupled perception, learning, and control algorithm design (e.g., a robot in a warehouse must recognize objects on the floor and reason whether it is safe to run over them). By organizing this workshop, we hope to foster discussions on innovative approaches that harness semantic understanding for the design and deployment of intelligent embodied systems. We aim to facilitate an interdisciplinary exchange between researchers in robot learning, perception, mapping, and control to identify the opportunities and pressing challenges when incorporating semantics into robotic applications.
08:45 – 09:00: Opening Remarks
09:00 – 09:20: Dr. Oier Mees, “Low-Level Embodied Intelligence with Foundation Models”
09:20 – 09:40: Prof. Angela Dai, “From Quantity to Quality for 3D Perception”
09:40 – 10:00: Dr. Masha Itkina, “Towards Uncertainty-Aware Embodied Behavior Generalization”
10:00 – 10:30: Coffee Break and Poster Session
10:30 – 10:50: Dr. Manuel Keppler, “Bridging the Divide: Unified Control for Rigid and Elastic Robots”
10:50 – 11:10: Dr. Federico Tombari, “Open-set Semantics for Environment Understanding”
11:10 – 11:30: Prof. Michael Milford, “What Can Understanding do for Navigating and Localizing Robots?”
11:30 – 12:30: Morning Session Panel Discussion
Afternoon Session
14:00 – 14:30: Spotlight Talks
14:30 – 14:50: Prof. Luca Carlone, “Metric-Semantic World Models”
14:50 – 15:10: Prof. Marco Pavone, “Leveraging Foundation Models to Develop Safer AV Stacks”
15:10 – 15:30: Prof. Koushil Sreenath, “Generative Self-Supervised Learning for Legged Locomotion”
15:30 – 16:00: Coffee Break and Poster Session
16:00 – 16:20: Prof. Andrea Bajcsy, “Towards Human–AI Safety: Unifying Generative AI and Control Systems Safety”
16:20 – 16:55: Afternoon Session Panel Discussion
16:55 – 17:00: Concluding Remarks
17:00 – 18:00: Social Gathering