When the sea ice opens in winter in so-called “polynyas”, the entire climate system is affected from deep water ventilation to cloud formation, along with the ecosystem. In observations, winter Arctic polynyas have been increasing along with climate change. We here show that we cannot predict their future using global climate models as they do not represent winter Arctic polynyas correctly: they open over too large areas but too rarely, and for the wrong reason.