We consider higher-order QCD corrections to Higgs boson production through gluon-gluon fusion in the large top quark mass limit in hadron collisions. We extend the transverse-momentum (qT ) subtraction method to next-to-next-to-next-to-leading order (N3LO) and combine it with the NNLO Higgs-plus-jet calculation to numerically compute differential infrared-safe observables at N3LO for Higgs boson production in gluon fusion. To cancel the infrared divergences, we exploit the universal behaviour of the associated qT distributions in the small-qT region. We document all the necessary ingredients of the transverse-momentum subtraction method up to N3LO. The missing third-order collinear functions, which contribute only at qT = 0, are approximated using a prescription which uses the known result for the total Higgs boson cross section at this order. As a first application of the third-order qT subtraction method, we present the N3LO rapidity distribution of the Higgs boson at the LHC.