Experimental Validation of Ultrasound Beamforming with End-to-End Deep Learning for Single Plane Wave Imaging

Ultrafast ultrasound imaging insonifies a medium with one or a combination of a few plane waves at different beam-steered angles instead of many focused waves. It can achieve much higher frame rates, but often at the cost of reduced image quality. Deep learning approaches have been proposed to mitigate this disadvantage, in particular for single plane wave imaging. Predominantly, image-to-image post-processing networks or fully learned data-to-image neural networks are used. Both construct their mapping purely data-driven and require expressive networks and large amounts of training data to perform well. In contrast, we consider data-to-image networks which incorporate a conventional image formation techniques as differentiable layers in the network architecture. This allows for end-to-end training with small amounts of training data. In this work, using f-k migration as an image formation layer is evaluated in-depth with experimental data. We acquired a data collection designed for benchmarking data-driven plane wave imaging approaches using a realistic breast mimicking phantom and an ultrasound calibration phantom. The evaluation considers global and local image similarity measures and contrast, resolution and lesion detectability analysis. The results show that the proposed network architecture is capable of improving the image quality of single plane wave images on all evaluation metrics. Furthermore, these image quality improvements can be achieved with surprisingly little amounts of training data.

Simultaneous Coherent and Displacement Compounding for 2D Noninvasive Carotid Strain Imaging: a Proof of Principle Study

Arteriosclerosis results from lipid buildup in artery walls, leading to plaque formation, and is a leading cause of death. Plaque rupture can cause blood clots that might lead to a stroke. Distinguishing plaque types is a challenge, but ultrasound elastography can help by assessing plaque composition based on strain values. Since the artery has a circular structure, an accurate axial and lateral displacement strategy is needed to derive the radial and circumferential strains. A high precision lateral displacement is challenging due to the lack of phase information in the lateral direction of the beamformed RF data. Previously, our group has developed a compounding technique in which the lateral displacement is estimated using tri-angulation of the axial displacement estimated from transmitting and beamforming ultrasound beams at +-20 degree. However, its applicability to in vivo is challenging due to the imaging noise and the low contrast of the arterial wall, caused by a single plane wave transmission. In this paper, we combine our displacement compounding with coherent compounding. Instead of transmitting a single plane wave, multiple plane waves are transmitted at certain angles with respect to the angle of the beamforming grids, and then the backscattered wavefronts are beamformed and coherently compounded on the center of the transmit beams (-20, +20 and 0 degree). ...

Single Plane-Wave Imaging using Physics-Based Deep Learning

In plane-wave imaging, multiple unfocused ultrasound waves are transmitted into a medium of interest from different angles and an image is formed from the recorded reflections. The number of plane waves used leads to a trade-off between frame-rate and image quality, with single-plane-wave (SPW) imaging being the fastest possible modality with the worst image quality. Recently, deep learning methods have been proposed to improve ultrasound imaging. One approach is to use image-to-image networks that work on the formed image and another is to directly learn a mapping from data to an image. Both approaches utilize purely data-driven models and require deep, expressive network architectures, combined with large numbers of training samples to obtain good results. Here, we propose a data-to-image architecture that incorporates a wave-physics-based image formation algorithm in-between deep convolutional neural networks. To achieve this, we implement the Fourier (FK) migration method as network layers and train the whole network end-to-end. We compare our proposed data-to-image network with an image-to-image network in simulated data experiments, mimicking a medical ultrasound application. Experiments show that it is possible to obtain high-quality SPW images, almost similar to an image formed using 75 plane waves over an angular range of $\pm$16$^\circ$. This illustrates the great potential of combining deep neural networks with physics-based image formation algorithms for SPW imaging.