Articles | Volume 18, issue 5
https://doi.org/10.5194/tc-18-2381-2024
© Author(s) 2024. This work is distributed under the Creative Commons Attribution 4.0 License.
Multivariate state and parameter estimation with data assimilation applied to sea-ice models using a Maxwell elasto-brittle rheology
Download
- Final revised paper (published on 14 May 2024)
- Preprint (discussion started on 16 Oct 2023)
Interactive discussion
Status: closed
Comment types: AC – author | RC – referee | CC – community | EC – editor | CEC – chief editor
| : Report abuse
-
RC1: 'Comment on egusphere-2023-1809', Anonymous Referee #1, 14 Nov 2023
- AC1: 'Reply on RC1', Yumeng Chen, 30 Jan 2024
-
RC2: 'Comment on egusphere-2023-1809', Anonymous Referee #2, 07 Dec 2023
- AC2: 'Reply on RC2', Yumeng Chen, 30 Jan 2024
Peer review completion
AR – Author's response | RR – Referee report | ED – Editor decision | EF – Editorial file upload
ED: Reconsider after major revisions (further review by editor and referees) (26 Feb 2024) by Yevgeny Aksenov
AR by Yumeng Chen on behalf of the Authors (26 Feb 2024)
Author's response
Author's tracked changes
Manuscript
ED: Referee Nomination & Report Request started (27 Feb 2024) by Yevgeny Aksenov
RR by Anonymous Referee #1 (14 Mar 2024)
ED: Publish subject to technical corrections (21 Mar 2024) by Yevgeny Aksenov
AR by Yumeng Chen on behalf of the Authors (01 Apr 2024)
Author's response
Manuscript
The authors estimate two parameters in a sea-ice model by means of state-space augmentation with an EnKF. The application is clear and useful. However, I have several concerns about the experiment setup. I recommend publishing the manuscript, after the authors have considered my comments below.
General comments:
I am concerned about how the authors chose to use their computational resources. I am not asking that the authors execute all the simulations I suggest below, but perhaps they can explain their choices a bit better.
1. Have the authors done a sensitivity ensemble free run in which each member has different parameter values drawn from the assumed distribution, but share the same initial and boundary conditions? From this, one can determine for which values of the parameter the model variables are most sensitive, as well as establish which obs are important for the estimation of the respective parameters, thereby reducing the number of experiments with all the different combinations of obs. See also specific comment 4.
2. The authors aim to improve long term forecasts by estimating the model parameters. Yet, no long term forecast was computed. On which timescales does the benefit of the parameter estimation persist? And how is the spread/skill ratio for those forecasts?
3. How does the parameter estimation do compared to perfect model experiments? Because of the different techniques for inflation, one cannot compare. It therefore feels like two separate papers: one for state estimation only, and one for parameter estimation, without a clear connection. Have the authors considered running a perfect model experiment with the same inflation technique as for the parameter estimation experiments? I also wonder about the effect the different inflation techniques have.
4. I fail to understand the added value of repeating all experiments with all the different combinations of obs for all four cases. For example, it is clear a priori that SIV is important for C_a. Why run 3 experiments without SIV? To confirm the importance of SIV one should be enough (or none even). I think the computational resources could be better spent on verifying the significance of the results, since the results look somewhat noisy. For example, how does the parameter estimation do with a different realisation of the truth? Ideally one would estimate as best as possible a distribution for the parameter. In this case a Gaussian distribution N(mu_c,5 x 10 ^-4) for C_a and N(mu_a,1.5) for alpha. Then draw randomly from that distribution to get the true parameter and draw from the same distribution to get the initial ensemble. Repeat this many times for statistical significance. I understand that this may be too expensive, so, as an alternative, one could pick at least a few values for the truth. For example, +sigma, +2 sigma, -sigma and -2sigma. Or other values based on sensitivity studies (see the first general comment). Basically, how wrong does the model have to be to get improvement from the parameter estimation.
5. Based on the inset of Figure 3a, the discussion on violation of SIC bounds when SIT is observed, and the paragraph starting on page 17, line 391: Instead of running the SIC+SIT30+SIV experiments, have the authors considered to not allow SIT measurements to affect SIC (and maybe damage)? Basically setting the covariances between SIT and SIC (and damage) to zero only for SIT measurements.
Specific comments:
1. page 4, line 99: Why the additional constraint?
2. page 7, line 187: What does DA-only mean in this context?
3. Section 5.1: I suggest moving this section to section 4.3.2, as it is meant as tuning for the experimental setup. Naturally, it is up to the authors.
4. Table 5. How much does the mean change? Based on the low increase in spread for alpha, I am surprised the estimation works so well. I am guessing that the mean of certain variables changes significantly when changing the parameters? See also general comment 1.
5. For Figures 4, 7, 12 and 14, I suggest using a colour bar that goes as far in red as blue. I understand that the red would be barely visible, but I think that is a good thing, because it would reflect that the deterioration of the fields is significantly less than the improvements.
6. page 17, line 387: I think the statement needs to be reversed: improvement in SIC and SIT (SIT) when SIV (SIC) is assimilated. Also, I am confused about the statement about the comparison between Figure 3 and 4. The two figures seem to be consistent for the chosen localisation radius except when assimilating SIT only. In figure 4 it seems to have a neutral effect on SIC, in contrast to the inset of Figure 3a.
7. Table 7: I personally lack intuition about what the actual values mean in Table 7. Perhaps small histograms of correlation values or small scatter plots would be useful here.
8. Figure 8: The colours of the free run and the forecast are too similar.
9. page 27, line 574: Isn't the reason the estimation works well when alpha is estimated only after 10 days, simply because C_a is already significantly more accurate and therefore the parameter estimation problem converges to another (better) local minimum? In other words, the problem resembles the case 3 scenario.