Satellite altimeters only sample surface heights at scattered points. We developed a method to turn these measurements into maps of glacier height change while also estimating how reliable the results are. Applying this approach to glaciers in Svalbard and Antarctica shows strong ice loss and clearly captures short-lived events such as glacier surges. Our results improve the ability to monitor glacier change in difficult terrain and help better assess future contributions to sea level rise.