WORKSHOP ROMADO
(RObotic MAnipulation of Deformable Objects)

Workshop at IROS 2020
(IEEE/RSJ International Conference on Intelligent Robots and Systems)

IROS 2020 will not be held in-person due to the COVID-19 pandemic. Instead, the contents of the conference will be provided on the IROS On-Demand platform. This platform will be used to present the contents of this workshop.

ROMADO workshop goes live!
Please register to the live panel discussion session on Thursday, November 19, 2020
(15:00 to 16:00, Paris time)


Visit IROS On-Demand Sign-Up to register for free access to all the contents

The conference is held on-demand from October 25 to December 25, 2020

IROS On-Demand 
YouTube channel

Novel solutions for the robotic manipulation of deformable objects can enable new real-world tasks in areas of strategic interest. These include the manufacturing industry, agriculture, or medicine. However, deformable objects are complex to model and require the manipulation system to have high adaptability and the ability to operate under uncertainty. These are important challenges and, although exciting progress has been made in the field over the past years, there remain many open technical questions. In particular, the workshop targets the following topics of interest:

1) Planning and control for grasping and manipulation of deformable objects.

Grasping and manipulation of deformable objects present great challenges because non-rigidity increases the uncertainty and the complexity of modelling. Current research efforts are based on prior identification of the object’s deformation properties or use a sensor-based definition of the task with online adaptation. However, the performance of existing approaches is still limited by the challenges mentioned above. Another major issue is the scarcity of general, as opposed to ad-hoc, frameworks for deformable object grasping and manipulation.

2) Multi-modal perception for manipulation of deformable objects.

Multi-modal sensing approaches are inspired by the human perception based on exploiting both touch and vision senses. They are almost a necessity when a robot has to perform complex manipulation tasks such as controlling the shape of a deformable object or ensuring a stable grasp. Both vision and tactile sensors become more challenging to use effectively when the object to be sensed is deformable. New trends are focused on combining or fusing these two sensing modalities, as well as the proprioceptive identification from the robot.

3) Machine learning for manipulation of deformable objects.

Deep learning from vision and touch data can be used for recognizing physical features and surface reconstruction of manipulated objects to determine how the robot should grasp the object or to predict its movements. Also, deep reinforcement learning can be used, e.g., to control a robotic hand to continuously update the grasp strategy with a wide variety of objects. Machine learning is undoubtedly a very promising tool in the highly uncertain and complex scenarios of deformable object manipulation.

4) Multi-robot and human-robot interactions in the manipulation of deformable objects.

The use of multiple robots (as opposed to a single one) allows transporting large deformable objects or controlling their shape in a more refined way. Perception, planning and control for such complex tasks should exploit both (i) multi-robot coordination and optimization frameworks and (ii) the deformation properties of the object. The integration of the two aspects in a synergistic manner remains an underexplored topic. Moreover in prominent cases of practical interest a robot has to manipulate a deformable object while interacting with humans. This also calls for novel approaches to take deformability into account in the definition and control of the interaction.

Topics of interest

The topics of interest include, but are not limited to:

  • Grasping for deformable objects
  • Dexterous manipulation for deformable objects
  • Manipulation planning for deformable objects
  • Shape control of deformable objects
  • Visual sensing for manipulation of deformable objects
  • Tactile sensing for manipulation of deformable objects
  • Multimodal perception for manipulation of deformable objects
  • Machine learning for manipulation of deformable objects
  • Multi-robot manipulation of deformable objects
  • Human-robot manipulation of deformable objects

Call for contributions

Important Dates

14 August, 4 September, 2020: Paper submissions
31 August, 18 September, 2020: Acceptance notification
14 September, 25 September, 2020: Camera ready
29 October, Workshop On-Demand

Instructions for Authors

We solicit contributions of two types:
– Short papers (2-4 pages): Concise descriptions of preliminary results and ongoing work.
– Regular papers (4-8 pages): More detailed descriptions of ongoing work or of more mature developments.

Papers should be in PDF format and prepared using the standard IROS template. They will be reviewed and their acceptance will be decided on the basis of their scientific merit and relevance to the workshop’s topics of interest. The accepted papers will be made available on the workshop’s website. The accepted papers will be presented as posters at the workshop, with the possibility of oral presentation for selected papers.

Papers should be submitted by email to romadoworkshop@gmail.com. Please identify clearly the type of submission (“Short” or “Regular”) in the subject of the email. An acknowledgement of receipt will be sent shortly after submission.

We will consider the publication of an independently peer-reviewed journal special issue after the workshop. Authors of papers presented at the workshop would be invited to submit extended versions to the special issue.

Invited speakers

David Navarro-Alarcón, The Hong Kong Polytechnic University
“On feedback features for shape control of deformable objects”

Danica Kragic and Ioanna Mitsioni, KTH Royal Institute of Technology
“Deformable object interaction and contact-rich tasks”

Berk Calli, Worcester Polytechnic Institute
“Controlled within-hand sliding”

Raúl Suárez, Universitat Politècnica de Catalunya
“Grasp synthesis of articulated objects with n links”

Kaspar Althoefer, Queen Mary University of London
“Integrating soft robots with the sense of touch”

Véronique Perdereau, Sorbonne Université
“Multimodal planning and control for dexterous manipulation of challenging objects”

Javier Alonso-Mora, Delft University of Technology
“Multi-robot motion planning and coordination for object transport in dynamic environments”

Zhanat Kappassov, Nazarbayev University
“From human haptic illusions on soft objects to robotic object recognition and slip detection”

Contributed papers

Paper 1:Dual-armed manipulation planning for tethered tools
by Daniel Sánchez, Weiwei Wan and Kensuke Harada

Paper 2:Prediction of tactile perception from vision on deformable objects”
by Brayan S. Zapata-Impata and Pablo Gil

Paper 3:Shape control of elastoplastic deformable linear objects through reinforcement learning
by Rita Laezza and Yiannis Karayiannidis

Paper 4:Interaction identification through tactile sensing during cloth manipulation using a 3-axis touch sensor
by Idril Geer, Marc Maceira, Julia Borras, Carme Torras and Guillem Alenya

Paper 5:Toward a general framework for 3D deformable object grasping and manipulation
by Félix Nadon, Angel J. Valencia, Narmadha Sambandam, Stephen Rowlands, James Dickens and Pierre Payeur

Paper 6: “Experimental multi-camera setup for perception of dynamic objects
by Rafael Herguedas, Gonzalo Lopez-Nicolas and Carlos Sagues

Paper 7:Real-time state estimation of deformable objects with dynamical simulation
by Shiyu Jin, Changhao Wang, Xinghao Zhu, Te Tang and Masayoshi Tomizuka

Workshop organizers

Miguel Aranda (SIGMA Clermont, Institut Pascal)
Juan Antonio Corrales (SIGMA Clermont, Institut Pascal)
Pablo Gil (Universidad de Alicante)
Gonzalo López-Nicolás (Universidad de Zaragoza)
Helder Araujo (Universidade de Coimbra)
Youcef Mezouar (SIGMA Clermont, Institut Pascal)

This workshop received support from the IEEE RAS Technical Committee on Robotic Hands, Grasping, and Manipulation and from the IEEE RAS Technical Committee on Multi-Robot Systems.

Contact

For any question regarding the workshop send an email to romadoworkshop@gmail.com

Sponsoring

Project COMMANDIA (SOE2/P1/F0638) is partially supported by Interreg Sudoe Programme and European Regional Development Fund (ERDF).