Trajectory Reconstruction (TR) is vital for accurately mapping movement patterns and validating analyses, especially in fields like robotics, biomechanics, and environmental tracking, where data might be missing or affected by outliers. Improving Trajectory estimation by employing Gaussian smoothing techniques in the presence of non-Gaussian noise is the subject of this work. We consider the case where data is collected from independent sensors. A variational Bayesian (VB) based Unscented Raunch-Tung-Striebel smoothing (URTSS) scheme is proposed which adopts a vectorized weighing mechanism for the measurement covariance matrix to selectively remove contaminated measurements at each time step. To improve our outlier mitigation, we model our outlier characteristics as a Gamma distribution and dynamically learn the parameters of this distribution from data. We verify the performance of our proposed smoother by a range of simulations and experimental data. We also propose a robustness criterion for smoothers based on the Kullback-Leibler (KL) divergence and show that our proposed method complies with this criterion.