Latency vs precision: Stability preserving perception scheduling

In robotic systems, perception latency is a term that refers to the computing time measured from the data acquisition to the moment in which perception output is ready to be used to compute control commands. There is a compromise between perception latency, precision for the overall robotic system, and computational resource usage referred to here as the latency-precision trade-off. In this work, we analyze a robot model given by a linear system, a zero-order hold controller, and measurements taken by several perception mode possibilities with different noise levels. We show that the analysis of this system is reduced to studying an equivalent switching system. Our goal is to schedule perception modes such that stability is attained while optimizing a cost function that models the latency-precision trade-off. Our solution framework comprises three main tools: the construction of perception scheduling policy candidates, admissibility verification for policy candidates, and optimal strategies based on admissible policies.

PLATE: A perception-latency aware estimator,

Target tracking is a popular problem with many potential applications. There has been a lot of effort on improving the quality of the detection of targets using cameras through different techniques. In general, with higher computational effort applied, i.e., a longer perception-latency, a better detection accuracy is obtained. However, it is not always useful to apply the longest perception-latency allowed, particularly when the environment doesn't require to and when the computational resources are shared between other tasks. In this work, we propose a new Perception-LATency aware Estimator (PLATE), which uses different perception configurations in different moments of time in order to optimize a certain performance measure. This measure takes into account a perception-latency and accuracy trade-off aiming for a good compromise between quality and resource usage. Compared to other heuristic frame-skipping techniques, PLATE comes with a formal complexity and optimality analysis. The advantages of PLATE are verified by several experiments including an evaluation over a standard benchmark with real data and using state of the art deep learning object detection methods for the perception stage.

A Hybrid Method for Online Trajectory Planning of Mobile Robots in Cluttered Environments

This paper presents a method for online trajectory planning in known environments. The proposed algorithm is a fusion of sampling-based techniques and model-based optimization via quadratic programming. The former is used to efficiently generate an obstacle-free path while the latter takes into account the robot dynamical constraints to generate a time-dependent trajectory. The main contribution of this work lies on the formulation of a convex optimization problem over the generated obstacle-free path that is guaranteed to be feasible. Thus, in contrast with previously proposed methods, iterative formulations are not required. The proposed method has been compared with state-of-the-art approaches showing a significant improvement in success rate and computation time. To illustrate the effectiveness of this approach for online planning, the proposed method was applied to the fluid autonomous navigation of a quadcopter in multiple environments consisting of up to two hundred obstacles. The scenarios hereinafter presented are some of the most densely cluttered experiments for online planning and navigation reported to date. See video at https://youtu.be/DJ1IZRL5t1Q

Autonomous Navigation of MAVs in Unknown Cluttered Environments

This paper presents an autonomous navigation framework for reaching a goal in unknown 3D cluttered environments. The framework consists of three main components. First, a computationally efficient method for mapping the environment from the disparity measurements obtained from a depth sensor. Second, a stochastic method to generate a path to a given goal, taking into account field of view constraints on the space that is assumed to be safe for navigation. Third, a fast method for the online generation of motion plans, taking into account the robot's dynamic constraints, model and environmental uncertainty and disturbances. To highlight the contribution with respect to the available literature, we provide a qualitative and quantitative comparison with state of the art methods for reaching a goal and for exploration in unknown environments, showing the superior performance of our approach. To illustrate the effectiveness of the proposed framework, we present experiments in multiple indoors and outdoors environments running the algorithm fully on board and in real-time, using a robotic platform based on the Intel Ready to Fly drone kit, which represents the implementation in the most frugal platform for navigation in unknown cluttered environments demonstrated to date. See video at https://youtu.be/Wq0e7vF6nZM