We present the implementation of nuclear velocity perturbation theory (NVPT), using a pioneering combination of atom-centered (velocity-dependent) Gaussian basis functions and plane waves in the CP2K package. The atomic polar tensors (APTs) and atomic axial tensors (AATs) are evaluated in the velocity representation using efficient density functional perturbation theory. The presence of nonlocal pseudopotentials, the representation of potentials on numerical integration grids, and effects arising from the basis functions being centered on the atoms have been considered in the implementation. The Magnetic Field Perturbation Theory (MFPT) using gauge-including atomic orbitals is implemented in the same code and compared to the NVPT. Our implementation is the first to compare both approaches (MFPT and NVPT) in the same code. The implementation has been verified via sum rules and by investigating the gauge origin dependence of the AATs for a set of small molecules, oxirane, and fluoro-oxirane. We also present vibrational circular dichroism spectra that are related to the APTs and AATs, applying both theories.