One of the bottlenecks of modern communication is to enable sensing and communication simultaneously with causing scheduling conflicts, and how sensing may be leveraged to help directional communication accuracy. To this end, we propose and implement a novel peer-to-peer mmWave communication system to achieve joint beamforming and sensing. A radar and IMU assisted tracking and beamforming algorithm is designed and tested and the results show robust tracking capacity with an overall higher throughtput obtained. The results demonstrated promising future extensions where with refinements the design and implementation can be deployed in a more scalable manner.