We use simple, physics-based models to compare how marine-terminating glaciers respond to changes at their marine margin vs. inland surface melt. Initial glacier retreat is more rapid for ocean changes than for inland changes, but in both cases, glaciers will continue responding for millennia. We analyze several implications of these differing pathways of change. In particular, natural ocean variability must be better understood to correctly identify the anthropogenic role in glacier retreat.