The specific surface of snow dictates key physical properties and continuously evolves in natural snowpacks. This is referred to as metamorphism. This work develops a rigorous physical model for this evolution, which is able to reproduce X-ray tomography measurements without using unphysical tuning parameters. Our results emphasize that snow crystal growth at the micrometer scale ultimately controls the pace of metamorphism.