Supervisor: Prof. Ville Kyrki (email@example.com)
Keywords: cloth manipulation, real2sim transfer, high-fidelity simulators.
Deformable objects such as cloths have many degrees of freedom, which creates additional challenges while manipulating them. Utilization of a simulated environment in learning the policies for cloth manipulation is usually the preferred option. “High fidelity” simulations of clothes are pivotal components, especially if the policy is targeted to be transferred to a real-world application.
This thesis will focus on proposing principled ways to increase the fidelity of cloth simulations using real-world observations from different types/sizes of cloths. Observations can include RGB-D measurements as well as absolute positions and velocities retrieved from a motion capture system. The thesis will comparatively investigate the available simulation environments in terms of adjustable parameters and work on the best suitable one for Real2Sim transfer.
- Review of relevant literature,
- Comparisons of different cloth simulators in terms of adjustable parameters,
- Principled ways of tuning cloth parameters with real-world observations,
- Evaluations of the proposed method with different types + sizes of cloths,
- Manipulation in real robot using policies learned in simulation.
Pre-requisites: Python(high/medium), ROS (medium)
Tools: Franka Panda Robot, OptiTrack Motion Capture System, Microsoft Kinect or Microsoft Azure Kinect
Simulators: (up-to-change) MuJoCo, PyBullet, SoftGym
Start: Available immediately
- Hahn, D., Banzet, P., Bern, J. M., & Coros, S. (2019). Real2sim: Visco-elastic parameter estimation from dynamic motion. ACM Transactions on Graphics (TOG), 38(6), 1-13.
- Coltraro, F., Amorós, J., Alberich-Carramiñana, M., & Torras, C. (2021). An Inextensible Model for Robotic Simulations of Textiles. arXiv preprint arXiv:2103.09586.
- Hietala, J., Blanco-Mulero, D., Alcan, G., & Kyrki, V. (2021). Closing the Sim2Real Gap in Dynamic Cloth Manipulation. arXiv preprint arXiv:2109.04771.