Privacy-Preserving Quantized Federated Learning with Diverse Precision

Federated learning (FL) has emerged as a promising paradigm for distributed machine learning, enabling collaborative training of a global model across multiple local devices without requiring them to share raw data. Despite its advancements, FL is limited by factors such as: (i) privacy risks arising from the unprotected transmission of local model updates to the fusion center (FC) and (ii) decreased learning utility caused by heterogeneity in model quantization resolution across participating devices. Prior work typically addresses only one of these challenges because maintaining learning utility under both privacy risks and quantization heterogeneity is a non-trivial task. In this paper, our aim is therefore to improve the learning utility of a privacy-preserving FL that allows clusters of devices with different quantization resolutions to participate in each FL round. Specifically, we introduce a novel stochastic quantizer (SQ) that is designed to simultaneously achieve differential privacy (DP) and minimum quantization error. Notably, the proposed SQ guarantees bounded distortion, unlike other DP approaches. To address quantization heterogeneity, we introduce a cluster size optimization technique combined with a linear fusion approach to enhance model aggregation accuracy. Numerical simulations validate the benefits of our approach in terms of privacy protection and learning utility compared to the conventional LaplaceSQ-FL algorithm.

No Analog Combiner TTD-based Hybrid Precoding for Multi-User Sub-THz Communications

We address the design and optimization of real-world-suitable hybrid precoders for multi-user wideband sub-terahertz (sub-THz) communications. We note that the conventional fully connected true-time delay (TTD)-based architecture is impractical because there is no room for the required large number of analog signal combiners in the circuit board. Additionally, analog signal combiners incur significant signal power loss. These limitations are often overlooked in sub-THz research. To overcome these issues, we study a non-overlapping subarray architecture that eliminates the need for analog combiners. We extend the conventional single-user assumption by formulating an optimization problem to maximize the minimum data rate for simultaneously served users. This complex optimization problem is divided into two sub-problems. The first sub-problem aims to ensure a fair subarray allocation for all users and is solved via a continuous domain relaxation technique. The second sub-problem deals with practical TTD device constraints on range and resolution to maximize the subarray gain and is resolved by shifting to the phase domain. Our simulation results highlight significant performance gain for our real-world-ready TTD-based hybrid precoders.

On The Stability of Approximate Message Passing with Independent Measurement Ensembles

Approximate message passing (AMP) is a scalable, iterative approach to signal recovery. For structured random measurement ensembles, including independent and identically distributed (i.i.d.) Gaussian and rotationally-invariant matrices, the performance of AMP can be characterized by a scalar recursion called state evolution (SE). The pseudo-Lipschitz (polynomial) smoothness is conventionally assumed. In this work, we extend the SE for AMP to a new class of measurement matrices with independent (not necessarily identically distributed) entries. We also extend it to a general class of functions, called controlled functions which are not constrained by the polynomial smoothness; unlike the pseudo-Lipschitz function that has polynomial smoothness, the controlled function grows exponentially. The lack of structure in the assumed measurement ensembles is addressed by leveraging Lindeberg-Feller. The lack of smoothness of the assumed controlled function is addressed by a proposed conditioning technique leveraging the empirical statistics of the AMP instances. The resultants grant the use of the SE to a broader class of measurement ensembles and a new class of functions.

True-Time Delay-Based Hybrid Precoding Under Time Delay Constraints in Wideband THz Massive MIMO Systems

The beam squint effect that arises in the wideband Terahertz (THz) massive multiple-input multiple-output (MIMO) communication produces a serious array gain loss. True-time delay (TTD)-based hybrid precoding has been considered to compensate for the beam squint effect. By fixing the phase shifter (PS) precoder, a common strategy has been designing TTD precoder under the assumption of unbounded time delay values. In this paper, we present a new approach to the problem of beam squint compensation, based on the joint optimization of the TTD and PS precoders under per TTD device time delay constraints. We first derive a lower bound of the achievable rate and show that in the large system limit the ideal analog precoder that completely compensates for the beam squint is equivalent to the one that maximizes the achievable rate lower bound. Unlike the prior approaches, our approach does not require the unbounded time delay assumption; the range of time delay values that a TTD can produce is strictly limited in our approach. Instead of focusing on the design of TTD values only, we jointly optimize both the TTD and PS values to effectively cope with the practical time delay constraints. Taking the advantage of the proposed joint TTD and PS precoder optimization approach, we quantify the minimum number of TTDs required to produce a predefined array gain performance. The simulation results illustrate the substantially improved performance with the array gain performance guarantee of the proposed joint optimization method.

Joint Delay and Phase Precoding Under True-Time Delay Constraint for THz Massive MIMO

A new approach is presented to the problem of compensating the beam squint effect arising in wideband terahertz (THz) hybrid massive multiple-input multiple-output (MIMO) systems, based on the joint optimization of the phase shifter (PS) and true-time delay (TTD) values under per-TTD device time delay constraints. Unlike the prior approaches, the new approach does not require the unbounded time delay assumption; the range of time delay values that a TTD device can produce is strictly limited in our approach. Instead of focusing on the design of TTD values, we jointly optimize both the TTD and PS values to effectively cope with the practical time delay constraint. Simulation results that illustrate the performance benefits of the new method for the beam squint compensation are presented. Through simulations and analysis, we show that our approach is a generalization of the prior TTD-based precoding approaches.