Rapid Automated Mapping of Clouds on Titan With Instance Segmentation

Despite widespread adoption of deep learning models to address a variety of computer vision tasks, planetary science has yet to see extensive utilization of such tools to address its unique problems. On Titan, the largest moon of Saturn, tracking seasonal trends and weather patterns of clouds provides crucial insights into one of the most complex climates in the Solar System, yet much of the available image data are still analyzed in a conventional way. In this work, we apply a Mask R-CNN trained via transfer learning to perform instance segmentation of clouds in Titan images acquired by the Cassini spacecraft - a previously unexplored approach to a big data problem in planetary science. We demonstrate that an automated technique can provide quantitative measures for clouds, such as areas and centroids, that may otherwise be prohibitively time-intensive to produce by human mapping. Furthermore, despite Titan specific challenges, our approach yields accuracy comparable to contemporary cloud identification studies on Earth and other worlds. We compare the efficiencies of human-driven versus algorithmic approaches, showing that transfer learning provides speed-ups that may open new horizons for data investigation for Titan. Moreover, we suggest that such approaches have broad potential for application to similar problems in planetary science where they are currently under-utilized. Future planned missions to the planets and remote sensing initiatives for the Earth promise to provide a deluge of image data in the coming years that will benefit strongly from leveraging machine learning approaches to perform the analysis.

Feature Extraction and Classification from Planetary Science Datasets enabled by Machine Learning

In this paper we present two examples of recent investigations that we have undertaken, applying Machine Learning (ML) neural networks (NN) to image datasets from outer planet missions to achieve feature recognition. Our first investigation was to recognize ice blocks (also known as rafts, plates, polygons) in the chaos regions of fractured ice on Europa. We used a transfer learning approach, adding and training new layers to an industry-standard Mask R-CNN (Region-based Convolutional Neural Network) to recognize labeled blocks in a training dataset. Subsequently, the updated model was tested against a new dataset, achieving 68% precision. In a different application, we applied the Mask R-CNN to recognize clouds on Titan, again through updated training followed by testing against new data, with a precision of 95% over 369 images. We evaluate the relative successes of our techniques and suggest how training and recognition could be further improved. The new approaches we have used for planetary datasets can further be applied to similar recognition tasks on other planets, including Earth. For imagery of outer planets in particular, the technique holds the possibility of greatly reducing the volume of returned data, via onboard identification of the most interesting image subsets, or by returning only differential data (images where changes have occurred) greatly enhancing the information content of the final data stream.

sEMG Gesture Recognition with a Simple Model of Attention

Myoelectric control is one of the leading brain-machine-interfaces in the field of robotic prosthetics. We present our research in real-time surface electromyography (sEMG) signal classification, where our simple and novel attention-based approach now leads the industry, universally beating more complex, state-of-the-art models. Our model achieved an accuracy of 87\% (class-balanced accuracy: 69\%) using sEMG data and 91\% (balanced accuracy: 74\%) using both sEMG and accelerometer (IMU) data on NinaPro DB5, as well as 73\% overall on NinaPro DB4, an improvement on both highly sophisticated deep learning and signal processing approaches. Notably, the representation of the data learned by the attention mechanism alone is powerful enough to yield an accuracy of 79\% on DB5. NinaPro DB5 is a standard benchmark for sEMG gesture recognition and consists of 53 unique gestures, including finger gestures, wrist gestures, and functional grasping gestures. Our proposed methodology's model simplicity represents a compelling alternative to the convolutional neural network (CNN) approaches utilized in recent research.