RAPID: Retrofitting IEEE 802.11ay Access Points for Indoor Human Detection and Sensing

In this work we present RAPID, a Joint Communication & Radar (JCR) system based on next generation IEEE 802.11ay WiFi networks in the 60 GHz band, which retrofits existing communication hardware to perform zero-cost monitoring of human movement and activities in indoor spaces. Most of the available approaches for human sensing at millimeter-waves employ special-purpose radar devices, which are utilized to retrieve and analyze the small-scale Doppler effect (micro-Doppler) caused by human motion. This is key to achieve fine-grained sensing applications such as simultaneous activity recognition and person identification. We show that IEEE 802.11ay Access Points (APs) can be retrofitted to perform radar-like extraction of micro-Doppler effects of multiple human subjects. While radar systems entail the deployment of additional hardware, our framework performs activity recognition and person identification using IEEE 802.11ay wireless networks with no modifications to the transmitted packet structure specified by the standard. We leverage the in-packet beam training capability of IEEE 802.11ay to accurately localize and track multiple individuals using the estimated Channel Impulse Response (CIR), while the beam tracking mechanism embedded in data packets allows to extract the desired micro-Doppler ({\mu}D) signatures of the subjects. We implement our system on an IEEE 802.11ay-compatible full-duplex FPGA platform with phased antenna arrays, which can estimate the CIR from the reflections of transmitted packets. Using two access points, we achieve reliable positioning and tracking of multiple subjects, and an accuracy of 93% and 90% for activity recognition and person identification, respectively.