Riccardo is pursuing his PhD in University of Turin, Italy, and will stay with us for 6 months for an Erasmus Trainee project.
This thesis will focus on how to apply Reinforcement Learning methods for solving deformable object manipulation tasks.
The goal of this project is to build the open-sourced quadruped robot called Real-Ant. To start with, the 3D models and the codes for the microcontroller as well as serial port communication are available for the robot. So the first task will be to print the components, assemble the robot and test the available codes on the robot. Then in the second stage, we will modify the robot to make it more robust so that it can tolerate mild shocks and can be run for an extended period of time without the need of tightening the screws or replacing the components. For example, we can think of adding soft legs, cushions etc. to protect the belly and the actuators. In addition, we can also simplify the design so that it can be repaired quickly if required.
The goal of this Master thesis is to develop simulation tools necessary to evaluate co-adaptation techniques, and to develop new approaches for learning the behaviour and design of robots using deep learning and deep reinforcement learning.
In this thesis, an extensive investigation of constrained DDP methods will be performed and the major selected ones will be implemented in simulation environment for trajectory optimizations of different robots such as a simple point robot, 2D car-like robot, 3D quadrotor robot and cart-pole system. In this context, the methods will be compared in terms of convergence speed, computational complexity, sensitivity to initializations and parameter selections.