Along a long-term ecosystem development gradient, soil nutrient contents and mineralogical properties change, therefore probably altering soil microbial communities. However, knowledge about the dynamics of soil microbial communities during long-term ecosystem development including progressive and retrogressive stages is limited, especially in mineral soils. Therefore, microbial abundances (quantitative PCR) and community composition (pyrosequencing) as well as their controlling soil properties were investigated in soil depth profiles along the 120,000 years old Franz Josef chronosequence (New Zealand). Additionally, in a microcosm incubation experiment the effects of particular soil properties, i.e., soil age, soil organic matter fraction (mineral-associated vs. particulate), O2 status, and carbon and phosphorus additions, on microbial abundances (quantitative PCR) and community patterns (T-RFLP) were analyzed. The archaeal to bacterial abundance ratio not only increased with soil depth but also with soil age along the chronosequence, coinciding with mineralogical changes and increasing phosphorus limitation. Results of the incubation experiment indicated that archaeal abundances were less impacted by the tested soil parameters compared to Bacteria suggesting that Archaea may better cope with mineral-induced substrate restrictions in subsoils and older soils. Instead, archaeal communities showed a soil age-related compositional shift with the Bathyarchaeota, that were frequently detected in nutrient-poor, low-energy environments, being dominant at the oldest site. However, bacterial communities remained stable with ongoing soil development. In contrast to the abundances, the archaeal compositional shift was associated with the mineralogical gradient. Our study revealed, that archaeal and bacterial communities in whole soil profiles are differently affected by long-term soil development with archaeal communities probably being better adapted to subsoil conditions, especially in nutrient-depleted old soils.