[Meetings] [Call for Papers] RSS 2024 Workshop on Semantic Reasoning and Goal Understanding in Robotics (SemRob)

143 views
Skip to first unread message

Jonathan Francis

unread,
Apr 10, 2024, 8:25:00 AMApr 10
to robotics-...@lists.kit.edu, rl-...@googlegroups.com, ai-ro...@googlegroups.com, u...@engr.orst.edu, ml-...@googlegroups.com, semrob....@gmail.com

(Apologies for cross-posting; please distribute among interested parties)

——————


Call for Papers: RSS 2024 Workshop on Semantic Reasoning and Goal Understanding in Robotics (SemRob)


Workshop website: https://semrob.github.io/

Contact email: semrob....@gmail.com


Paper Submission Deadline: 3 June 2024, 23:59 AOE

Workshop Date: 19 July 2024

Workshop Location: Delft, Netherlands (RSS 2024)


——————


We are delighted to invite you to submit your papers to the 1st Workshop on Semantic Reasoning and Goal Understanding in Robotics (SemRob), which will be held at the 20th Robotics Science and Systems conference (RSS 2024), in Delft, Netherlands, on 19 July 2024. 


This workshop intends to sponsor discussion of new hybrid methodologies—those that combine representations from robotics foundation models with modeling mechanisms that may prove useful for semantic reasoning and abstract goal understanding, including neural memory mechanisms, cognitive architectures, neuro-symbolic representations (e.g., knowledge/scene graph embeddings), meta-cognitive reasoning structures (e.g., chain-of-thought reasoning), robot skill primitives and their composition, 3D world representations (e.g., NeRFs), etc.


We aim to bring together robotics researchers, engineers, and practitioners from different communities to enable avenues for interdisciplinary research on methods that could facilitate the deployment of semantics-aware and generalizable embodied agents in unstructured and dynamic real world environments. We draw our organizers, speakers, panelists, and TPC from the following (sub-)communities: Robot Learning, Embodied AI, Planning + Controls, Cognitive Robotics, Neuro-Symbolism, Natural Language Processing, Computer Vision, and Multimodal Machine Learning. We likewise intend to attract an audience from these diverse sub-communities to contribute to compelling discussions.


Topics of Interest


In addition to the RSS 2024 subject areas, we especially invite paper submissions on various topics, including (but not limited to):


  • Learning semantically-rich and generalizable robot state representations 

  • Learning general goal representations, e.g., in instruction-following 

  • Reasoning mechanisms for generalization in open-vocabulary contexts

  • Leveraging foundation models for robotics tasks; efforts to create robotics-specific foundation models

  • Foundation model agent frameworks, e.g., for chain-of-thought reasoning, self-guidance, reasoning about failures, policy-refinement, etc.

  • Multimodal tokens and prompt mechanisms with foundational models for robotics tasks

  • Grounding foundation models with other modalities (e.g., haptics, audio, IMU signals, joint torques, etc.)

  • Combining foundation models with AI reasoning structures (e.g., neuro-symbolic structures, memory, cognitive architectures, etc.), for robotics tasks

  • Data-efficient concept learning for robotics, e.g., few-shot demonstrations, interactive perception, co-simulation, etc.


Submission Guidelines


RSS SemRob 2024 suggests a 4+N or 8+N paper length format — i.e., 4 or 8 pages of main content with unlimited additional pages for references, appendices, etc. However, like RSS 2024, we impose no strict page length requirements on submissions; we trust that authors will recognize that respecting reviewers’ time is helpful to the evaluation of their work. 


Submissions are handled through CMT: https://cmt3.research.microsoft.com/SEMROB2024


We will use the official LaTeX or Word templates, provided by RSS 2024.


Important Dates


  • Paper submission deadline: 3 June 2024, 23:59 AOE

  • Paper review deadline: 17 June 2024, 23:59 AOE

  • Author notifications: 24 June 2024

  • Camera-ready submission deadline: 1 July 2024, 23:59 AOE


Best Paper Award: One best paper will be selected from the submissions and awarded; the winner will be announced at the workshop!


Invited Speakers


  • Niko Sünderhauf; Queensland University of Technology

  • Coline Devin; Google DeepMind

  • Animesh Garg; University of Toronto + NVIDIA

  • Alessandra Sciutti; Istituto Italiano di Tecnologia

  • Joyce Chai; University of Michigan

  • Jesse Thomason; University of Southern California

  • Dongheui Lee; Technische Universität Wien

  • Yonatan Bisk; Carnegie Mellon University + Meta AI


Organizing Committee


  • Jonathan Francis; Bosch Center for Artificial Intelligence + Carnegie Mellon University

  • Andrew Melnik; University of Bielefeld

  • Krishan Rana; Queensland University of Technology

  • Saumya Saxena; Carnegie Mellon University

  • Hyemin Ahn; Ulsan National Institute of Science and Technology

  • Qiang Li; Shenzhen Technology University

  • Jean Oh; Carnegie Mellon University


Contact Addresses



Mailing List


Feel free to join our mailing list, to stay updated on all workshop information: https://mailchi.mp/07f8ab4c1c65/semrob-workshop

Jonathan Francis

unread,
Apr 10, 2024, 9:28:48 AMApr 10
to robotics-...@lists.kit.edu, rl-...@googlegroups.com, ai-ro...@googlegroups.com, u...@engr.orst.edu, ml-...@googlegroups.com, semrob....@gmail.com

Jonathan Francis

unread,
Apr 17, 2024, 11:16:32 PMApr 17
to robotics-...@lists.kit.edu, rl-...@googlegroups.com, ai-ro...@googlegroups.com, u...@engr.orst.edu, ml-...@googlegroups.com, semrob....@gmail.com

Jonathan Francis

unread,
Apr 22, 2024, 9:34:43 AMApr 22
to robotics-...@lists.kit.edu, rl-...@googlegroups.com, ai-ro...@googlegroups.com, u...@engr.orst.edu, ml-...@googlegroups.com, semrob....@gmail.com

Ludovico Montalcini

unread,
Apr 22, 2024, 11:37:30 AMApr 22
to robotics-...@lists.kit.edu, rl-...@googlegroups.com, ai-ro...@googlegroups.com, u...@engr.orst.edu, comp-neuro@neuroinformatics.be <comp-neuro@neuroinformatics.be>,, connectionists@cs.cmu.edu <connectionists@cs.cmu.edu>,, ml-news@googlegroups.com <ml-news@googlegroups.com>,, systems-neuroscience@googlegroups.com <systems-neuroscience@googlegroups.com>,, maths-neuronet@lists.nottingham.ac.uk, semrob....@gmail.com
* Apologies for multiple copies. Please forward to anybody who might be interested, thanks *

                       * Last 60 seats left, hurry up and register! *

#ACDL2024, An Interdisciplinary Course: From Deep Learning to Generative AI

ACDL 2024  is a full-immersion 5-day course in Tuscany on cutting-edge advances in AI, Deep Learning, LLMs, Data Sc. & Generative AI with lectures delivered by world-renowned experts. 

If
 you want to learn
 NLP, Generative AI
 Transformers, Diffusion Models,
 Large language models,
 Vision - Large-scale vision models,
 Vision and language,
 Beyond vision and language,
 Multimodal Foundation Models  
 and much more
then
 take part in ACDL 2024! ;-)

Riva del Sole Resort & SPA - Tuscany, Italy, June 10-14
https://acdl2024.icas.events  
ac...@icas.cc

EARLY REGISTRATION: by April 23 (AoE)
https://acdl2024.icas.events/registration/
Oral Presentation Submission Deadline: by April 23 (AoE)

LECTURERS:
Each Lecturer will hold up to four lectures on one or more research topics.
https://acdl2024.icas.events/lecturers/

* Joseph Sifakis, Verimag Laboratory, Grenoble, France  *Turing Award*
Lectures “Artificial Intelligence: Where We Are, Where We Are Going?”

* Gabriel Barth-Maron, DeepMind, London, UK
4 Lessons on "Multimodal Foundation Models"

* Sergiy Butenko, Texas A&M University, USA
“Cluster-detection Methods in Network-based Data Analysis”
“Continuous Approaches to Cluster-Detection Problems in Networks ”

* Sven Giesselbach, Fraunhofer Institute - IAIS, Germany
5 Lessons on "Introduction on Foundation Models"

* Ramin Hasani, MIT, USA
4 Lessons on "Continuous Neural Networks / Liquid Neural Networks"

* Nora Kassner, DeepMind, London, UK
"Large Language Models: Life after Pre-training"
"Large Language Models: Evaluation"
"Large Language Models: Reasoning and Factuality"
"Large Language Models: Retrieval augmentation and Tool-use"

* Petros Koumoutsakos, Harvard University, USA
“Machine Learning for Modeling and Control of Complex Systems” 1/2
“Machine Learning for Modeling and Control of Complex Systems” 2/2
“Solving forward and inverse problems with and without neural networks”
“Bayesian Uncertainty Quantification”

* Maria Liakata, The Alan Turing Institute, UK
4 Lessons on "Longitudinal Language Processing with User Generated Content"

* Panos Pardalos, University of Florida, USA
Lectures 1-2 TBA
Topics: Data Science, Application to Neuroscience

* Jakub M. Tomczak, Eindhoven University of Technology, The Netherlands
4 Lessons on “Deep Generative Modelling”

* Rianne van den Berg, Microsoft Research Amsterdam, The Netherlands
3 Lessons on "Diffusion Models"

* Pascal Van Hentenryck, Georgia Institute of Technology, USA
3 Lessons on "Fusing Machine Learning and Optimization for Engineering"

* Max Welling, University of Amsterdam, The Netherlands
3 Lessons on "Generalized Belief Propagation Algorithms for Tensor Network Contractions"

PAST LECTURERS: https://acdl2024.icas.events/past-lecturers/

ACDL 2024 VENUE: https://acdl2024.icas.events/venue/
Riva del Sole Resort & SPA
Località Riva del Sole‚ Castiglione della Pescaia (Grosseto)
CAP 58043‚ Tuscany‚ Italy
p: +39-0564-928111
e: booking...@rivadelsole.it
w: https://www.rivadelsole.it/en/

PAST EDITIONS: https://acdl2024.icas.events/past-editions/

REGISTRATION:  https://acdl2024.icas.events/registration/

CERTIFICATE & 8 ECTS:
PhD students, Postdocs, Industry Practitioners, Junior and Senior Academics, and will be typical profiles of the ACDL attendants. The Course will involve a total of 36-40 hours of lectures, according to the academic system the final achievement will be equivalent to 8 ECTS points for the PhD Students (and some strongly motivated master student) attending the Course. At the end of the course, a formal certificate will be delivered indicating the 8 ECTS points.

TO PARTICIPATE IN ACDL 2024, all attendants must

(1/2) register for the course (by April 23, 2024) and
(2/2) book accommodation at the course venue, Riva del Sole Resort & SPA‚ (by April 23, 2024); all attendants must stay at the Riva del Sole Resort & SPA.

Once accommodation has been booked at Riva del Sole Resort & SPA‚ the participant must send this information (including the Booking Number) to the ACDL organizing committee (ac...@icas.cc).

ACDL is a residential course, so all lecturers and participants must reside in the same Hotel (Riva del Sole Resort & SPA). No exceptions are made.
 
For privacy reasons, the Hotel cannot match people. If you have someone to share the apartment with, please send to the Hotel (booking...@rivadelsole.it) the name, surname and email address. Otherwise the solution is to book an apartment in single use.

Anyone interested in participating in ACDL 2024 should register as soon as possible.

See you in Riva del Sole in June!
         Giuseppe Nicosia & Panos Pardalos - ACDL 2024 Directors.
         ACDL 2024 Scientific & Organizing Committees.  

https://acdl2024.icas.events  
ac...@icas.cc

Jonathan Francis

unread,
May 1, 2024, 2:26:43 PMMay 1
to robotics-...@lists.kit.edu, rl-...@googlegroups.com, ai-ro...@googlegroups.com, u...@engr.orst.edu, ml-...@googlegroups.com, semrob....@gmail.com

Jonathan Francis

unread,
May 8, 2024, 12:01:32 PMMay 8
to robotics-...@lists.kit.edu, rl-...@googlegroups.com, ai-ro...@googlegroups.com, u...@engr.orst.edu, ml-...@googlegroups.com, semrob....@gmail.com

Jonathan Francis

unread,
May 14, 2024, 12:28:54 AMMay 14
to robotics-...@lists.kit.edu, rl-...@googlegroups.com, ai-ro...@googlegroups.com, u...@engr.orst.edu, ml-...@googlegroups.com, semrob....@gmail.com

Jonathan Francis

unread,
May 21, 2024, 12:06:20 PMMay 21
to robotics-...@lists.kit.edu, rl-...@googlegroups.com, ai-ro...@googlegroups.com, u...@engr.orst.edu, ml-...@googlegroups.com, semrob....@gmail.com

Jonathan Francis

unread,
May 28, 2024, 12:19:18 PMMay 28
to robotics-...@lists.kit.edu, rl-...@googlegroups.com, ai-ro...@googlegroups.com, u...@engr.orst.edu, ml-...@googlegroups.com, semrob....@gmail.com
Reply all
Reply to author
Forward
0 new messages