Emergent swimming strategies of a smart three-bead swimmer

Low-Reynolds-number microswimmers have recently attracted much interest for their ubiquity in biology and their applications in biotechnology and medicine. However, a key obstacle for the design and deployment of artificial microswimmers lies in their autonomy: to successfully perform tasks in any real-world scenario, these swimmers need to be able to interact with and adapt to their environment without external control. Here, we train a simple two-dimensional model microswimmer (consisting of three-bead) to learn autonomous swimming strategies via Reinforcement Learning, focusing on neuroevolution techniques to derive controller architectures with minimal complexity. We identify five different, characteristic swimming gaits: three of these gaits lead to directed locomotion with varying grades of efficiency and two gaits result in a rotational, inefficient movement. Remarkably, all of these gaits can be achieved by very simple neural networks (with less than ten nodes and weights), showing that low-Reynolds-number swimming can be achieved efficiently and robustly while requiring only minimal computational power. These results are of particular interest to the experimental design of artificial microswimmers and may have implications for modeling biological microorganisms such as Chlamydomonas reinhardtii.