Abstract
Mobile robotic systems serve as versatile platforms for diverse indoor applications, ranging from warehousing and manufacturing to test benches dedicated to evaluating automated driving (AD) functions. In AD systems, the path following (PF) layer is responsible for defining steering commands to follow the reference path. Recently explored approaches involve artificial intelligence-based methods, such as Deep Reinforcement Learning (DRL). Despite their promising performance, these controllers still suffer from time-consuming training phases and may experience performance degradation when deviating from training conditions. To address these challenges, this paper proposes novel DRL controllers addressing the simulation-to-reality gap in unknown scenarios by: (i) training via an expert demonstrator which also speed up the learning phase; and (ii) a weight adaptation strategy for the resulting neural network (NN) to strengthen controller robustness and enhance PF performance. In addition, an experimentally validated vehicle model is used for training the proposed DRL algorithm and as a model for a federated extended Kalman filter (FEKF) system employed for sensor fusion in vehicle localisation. The proposed DRL-based PF controllers are experimentally evaluated through key performance indicators across multiple maneuvers not considered during training, and it is shown that they outperform benchmarking model-based controllers from the literature.