High precision mass and g-factor measurements in Penning traps have enabled groundbreaking tests of fundamental physics. The most advanced setups use multi-trap methods, which employ transport of particles between specialized trap zones. Present developments focused on the implementation of sympathetic laser cooling will enable significantly shorter duty cycles and better accuracies in many of these scenarios. To take full advantage of these increased capabilities, we implement fast adiabatic transport concepts developed in the context of trapped-ion quantum information processing in a cryogenic Penning trap system. We show adiabatic transport of a single 9Be+ ion initially cooled to 2 mK over a 2.2-cm distance within 15 ms and with less than 10 mK energy gain at a peak velocity of 3 m/s. These results represent an important step towards the implementation of quantum logic spectroscopy in the (anti-)proton system. Applying these developments to other multi-trap systems has the potential to considerably increase the data-sampling rate in these experiments.