A Distributed Approach to Autonomous Intersection Management via Multi-Agent Reinforcement Learning

Autonomous intersection management (AIM) poses significant challenges due to the intricate nature of real-world traffic scenarios and the need for a highly expensive centralised server in charge of simultaneously controlling all the vehicles. This study addresses such issues by proposing a novel distributed approach to AIM utilizing multi-agent reinforcement learning (MARL). We show that by leveraging the 3D surround view technology for advanced assistance systems, autonomous vehicles can accurately navigate intersection scenarios without needing any centralised controller. The contributions of this paper thus include a MARL-based algorithm for the autonomous management of a 4-way intersection and also the introduction of a new strategy called prioritised scenario replay for improved training efficacy. We validate our approach as an innovative alternative to conventional centralised AIM techniques, ensuring the full reproducibility of our results. Specifically, experiments conducted in virtual environments using the SMARTS platform highlight its superiority over benchmarks across various metrics.

A Fairness-Oriented Reinforcement Learning Approach for the Operation and Control of Shared Micromobility Services

As Machine Learning systems become increasingly popular across diverse application domains, including those with direct human implications, the imperative of equity and algorithmic fairness has risen to prominence in the Artificial Intelligence community. On the other hand, in the context of Shared Micromobility Systems, the exploration of fairness-oriented approaches remains limited. Addressing this gap, we introduce a pioneering investigation into the balance between performance optimization and algorithmic fairness in the operation and control of Shared Micromobility Services. Our study leverages the Q-Learning algorithm in Reinforcement Learning, benefiting from its convergence guarantees to ensure the robustness of our proposed approach. Notably, our methodology stands out for its ability to achieve equitable outcomes, as measured by the Gini index, across different station categories--central, peripheral, and remote. Through strategic rebalancing of vehicle distribution, our approach aims to maximize operator performance while simultaneously upholding fairness principles for users. In addition to theoretical insights, we substantiate our findings with a case study or simulation based on synthetic data, validating the efficacy of our approach. This paper underscores the critical importance of fairness considerations in shaping control strategies for Shared Micromobility Services, offering a pragmatic framework for enhancing equity in urban transportation systems.

Visual Sensor Network Stimulation Model Identification via Gaussian Mixture Model and Deep Embedded Features

Visual sensor networks constitute a fundamental class of distributed sensing systems, with unique complexity and performance research subjects. One of these novel challenges is represented by the identification of the network stimulation model (SM), which emerges when a set of detectable events trigger different subsets of the cameras. In this direction, the formulation of the related SM identification problem is proposed, along with a proper network observations generation method. Consequently, an approach based on deep embedded features and soft clustering is leveraged to solve the presented identification problem. In detail, the Gaussian Mixture Modeling is employed to provide a suitable description for data distribution and an autoencoder is used to reduce undesired effects due to the so-called curse of dimensionality. Hence, it is shown that a SM can be learnt by solving Maximum A-Posteriori estimation on the encoded features belonging to a space with lower dimensionality. Lastly, numerical results are reported to validate the devised estimation algorithm.