FedLED: Label-Free Equipment Fault Diagnosis with Vertical Federated Transfer Learning

Intelligent equipment fault diagnosis based on Federated Transfer Learning (FTL) attracts considerable attention from both academia and industry. It allows real-world industrial agents with limited samples to construct a fault diagnosis model without jeopardizing their raw data privacy. Existing approaches, however, can neither address the intense sample heterogeneity caused by different working conditions of practical agents, nor the extreme fault label scarcity, even zero, of newly deployed equipment. To address these issues, we present FedLED, the first unsupervised vertical FTL equipment fault diagnosis method, where knowledge of the unlabeled target domain is further exploited for effective unsupervised model transfer. Results of extensive experiments using data of real equipment monitoring demonstrate that FedLED obviously outperforms SOTA approaches in terms of both diagnosis accuracy (up to 4.13 times) and generality. We expect our work to inspire further study on label-free equipment fault diagnosis systematically enhanced by target domain knowledge.

Full State Estimation of Soft Robots From Tip Velocities: A Cosserat-Theoretic Boundary Observer

Soft robotics is a rapidly growing research area in robotics. Sensing of robotic systems is important for designing feedback controllers which usually provide robustness to modeling uncertainties. Sensing of soft robots, however, is considered a challenging task because theoretically, soft robots have infinite degrees of freedom while existing sensors only provide a limited number of measurements. One solution to this challenge is to design an observer/filter to estimate the unknown states from the sensor measurements. In this work, we design a boundary observer for soft robots based on the well-known Cosserat rod theory which models soft robots by nonlinear partial differential equations (PDEs). This boundary observer is able to estimate all the continuous robot states (poses, strains, and velocities) using the PDE model, inputs, and only tip velocity measurements (which explains the name "boundary" observer). The key idea is to inject sequential tip velocity measurements into the observer in a way that dissipates the energy of state estimation errors through the boundary. This boundary observer only requires sensing the tip velocity, can be implemented by simply changing a boundary condition in any numerical solvers of Cosserat rod models, and is proven to be locally input-to-state stable. Simulation studies are included and suggest that the domain of attraction is large and the observer is robust to measurement noise.

Task Space Tracking of Soft Manipulators: Inner-Outer Loop Control Based on Cosserat-Rod Models

Soft robots are robotic systems made of deformable materials and exhibit unique flexibility that can be exploited for complex environments and tasks. However, their control problem has been considered a challenging subject because they are of infinite degrees of freedom and highly under-actuated. Existing studies have mainly relied on simplified and approximated finite-dimensional models. In this work, we exploit infinite-dimensional nonlinear control for soft robots. We adopt the Cosserat-rod theory and employ nonlinear partial differential equations (PDEs) to model the kinematics and dynamics of soft manipulators, including their translational motions (for shear and elongation) and rotational motions (for bending and torsion). The objective is to achieve position tracking of the whole manipulator in a planar task space by controlling the moments (generated by actuators). The control design is inspired by the energy decay property of damped wave equations and has an inner-outer loop structure. In the outer loop, we design desired rotational motions that rotate the translational component into a direction that asymptotically dissipates the energy associated with position tracking errors. In the inner loop, we design inputs for the rotational components to track their desired motions, again by dissipating the rotational energy. We prove that the closed-loop system is exponentially stable and evaluate its performance through simulations.

Latent Dirichlet Allocation Model Training with Differential Privacy

Latent Dirichlet Allocation (LDA) is a popular topic modeling technique for hidden semantic discovery of text data and serves as a fundamental tool for text analysis in various applications. However, the LDA model as well as the training process of LDA may expose the text information in the training data, thus bringing significant privacy concerns. To address the privacy issue in LDA, we systematically investigate the privacy protection of the main-stream LDA training algorithm based on Collapsed Gibbs Sampling (CGS) and propose several differentially private LDA algorithms for typical training scenarios. In particular, we present the first theoretical analysis on the inherent differential privacy guarantee of CGS based LDA training and further propose a centralized privacy-preserving algorithm (HDP-LDA) that can prevent data inference from the intermediate statistics in the CGS training. Also, we propose a locally private LDA training algorithm (LP-LDA) on crowdsourced data to provide local differential privacy for individual data contributors. Furthermore, we extend LP-LDA to an online version as OLP-LDA to achieve LDA training on locally private mini-batches in a streaming setting. Extensive analysis and experiment results validate both the effectiveness and efficiency of our proposed privacy-preserving LDA training algorithms.

OL4EL: Online Learning for Edge-cloud Collaborative Learning on Heterogeneous Edges with Resource Constraints

Distributed machine learning (ML) at network edge is a promising paradigm that can preserve both network bandwidth and privacy of data providers. However, heterogeneous and limited computation and communication resources on edge servers (or edges) pose great challenges on distributed ML and formulate a new paradigm of Edge Learning (i.e. edge-cloud collaborative machine learning). In this article, we propose a novel framework of 'learning to learn' for effective Edge Learning (EL) on heterogeneous edges with resource constraints. We first model the dynamic determination of collaboration strategy (i.e. the allocation of local iterations at edge servers and global aggregations on the Cloud during collaborative learning process) as an online optimization problem to achieve the tradeoff between the performance of EL and the resource consumption of edge servers. Then, we propose an Online Learning for EL (OL4EL) framework based on the budget-limited multi-armed bandit model. OL4EL supports both synchronous and asynchronous learning patterns, and can be used for both supervised and unsupervised learning tasks. To evaluate the performance of OL4EL, we conducted both real-world testbed experiments and extensive simulations based on docker containers, where both Support Vector Machine and K-means were considered as use cases. Experimental results demonstrate that OL4EL significantly outperforms state-of-the-art EL and other collaborative ML approaches in terms of the trade-off between learning performance and resource consumption.

Leak Event Identification in Water Systems Using High Order CRF

Today, detection of anomalous events in civil infrastructures (e.g. water pipe breaks and leaks) is time consuming and often takes hours or days. Pipe breakage as one of the most frequent types of failure of water networks often causes community disruptions ranging from temporary interruptions in services to extended loss of business and relocation of residents. In this project, we design and implement a two-phase approach for leak event identification, which leverages dynamic data from multiple information sources including IoT sensing data (pressure values and/or flow rates), geophysical data (water systems), and human inputs (tweets posted on Twitter). In the approach, a high order Conditional Random Field (CRF) is constructed that enforces predictions based on IoT observations consistent with human inputs to improve the performance of event identifications. Considering the physical water network as a graph, a CRF model is built and learned by the Structured Support Vector Machine (SSVM) using node features such as water pressure and flow rate. After that, we built the high order CRF system by enforcing twitter leakage detection information. An optimal inference algorithm is proposed for the adapted high order CRF model. Experimental results show the effectiveness of our system.