Kernel Ridgeless Regression is Inconsistent in Low Dimensions

We show that kernel interpolation for a large class of shift-invariant kernels is inconsistent in fixed dimension, even with bandwidth adaptive to the training set.