the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Evaluation of snow extent time series derived from Advanced Very High Resolution Radiometer global area coverage data (1982–2018) in the Hindu Kush Himalayas
Kathrin Naegeli
Valentina Premier
Carlo Marin
Dujuan Ma
Jingping Wang
Stefan Wunderle
Download
- Final revised paper (published on 07 Sep 2021)
- Preprint (discussion started on 15 Mar 2021)
Interactive discussion
Status: closed
-
RC1: 'Comment on tc-2021-46', Anonymous Referee #1, 09 Apr 2021
General Comments:
Interesting concept to build a long-term snow cover data product from AVHHR GAC. There are many challenges to creating and validating an AVHRR GAC snow cover dataset over the Hindu Kush Himalaya (HKH) region for the period 1982-2013. Description of, and explanation of how the AVHRR GAC snow cover dataset was created are insufficient. There are significant problems regarding how the snow cover dataset was created, and with how the satellite validation datasets were processed and analyzed. A map of the snow cover dataset is not presented. A AVHHR GAC snow map must be shown in support of evaluation/analysis. The quality/accuracy of the snow cover dataset cannot be evaluated. The conclusions are not substantiated by the analysis presented. The manuscript is not suitable for publication.
Specific Comments:
Line 44: The GCOS does recommend area covered by snow cover as an essential climate variable daily at 1 km or higher resolution. The GAC resolution is much lower than recommended. The lower resolution needs to be discussed relevant to GCOS observation requirements.
Discussion is also lacking on explaining the relevance of coarse GAC resolution product in the HKH region, especially when higher resolution snow cover data sources are available.
Section 2.2: I do not understand how you created a AVHRR GAC snow extent. I read the FCDR product user guide. I downloaded and looked at the FCDR data products. There is no snow cover extent dataset in any of the products. There is no AVHRR channel reflectance data in those products that could be used to calculate NDSI.
The fractional snow method of Salomonson and Appel (2006) is based on a using Landsat TM data at 30 m to estimate the fractional amount of snow in a MODIS 500 m pixels. That relationship is not directly applicable to GAC data at 1x5 km2 resolution. Please explain why you applied this regression to GAC data to estimate FSC.
NDSI cannot be calculated from AVHHR data until 1998 when with NOAA-15 Channel 3A at 1.6 um was added to AVHRR. Before then there was no shortwave infrared channel covering 1.6 um. It is not possible to calculate NDSI from AVHRR data prior to 1998. But your dataset record is 1982-2013. How can it possibly be consistent across major design changes in the AVHRR?
The calculation of NDSI from AVHRR GAC is not explicitly given. Without explanation of how NDSI was calculated the entirety of the validation discuss and results is doubtful.
Section 2.3.2: The estimate of FSC for TM/ETM data is flawed. Salomonson and Appel (2006) did not derive the FSC regression to estimate TM/ETM FSC, they derived a FSC estimate for MODIS data based on the higher spatial resolution TM/ETM data. That regression is not appropriate to estimate FSC in TM/ETM data.
No AVHRR GAC snow map is shown! No snow maps are shown! The research describes building an AVHRR GAC snow cover map, but none is shown. Visual evidence of the snow maps must be presented.
Line 145: It is unclear how the 30 m FSC data was used to identify FSC in a GAC pixel. Were many 30 m FSC pixels mapped into a GAC pixel then was some spatial averaging or binning of observations done to estimate FSC in a GAC pixel? A clear explanation of sampling and estimate of FSC in GAC pixel is needed.
Line 248: How were MOD10A1 data resampled and reprojected to a GAC pixel? Many MOD10A1 pixels can be covered by a GAC pixel. What method was used to resample? Was there any averaging or compositing observations to GAC pixel done?
Because of the great amount of uncertainty regarding how the AVHHR GAC snow cover dataset was created and uncertainty of processing the validation datasets, only a cursory review of the methods and results was done.
The conclusion that this AVHRR GAC dataset has consistent performance across the whole suite of AVHRR sensors is not substantiated.
Citation: https://doi.org/10.5194/tc-2021-46-RC1 -
AC1: 'Reply on RC1', Xiaodan Wu, 28 Jul 2021
Re: The manuscript has been revised from the following aspects:
First, the AVHRR GAC snow dataset have been updated with the final released version. Because the final AVHRR GAC snow data published and accessible for everyone is different from what we have previously employed in the paper. Our team have improved the retrieval algorithm, because there was a need to retrieve also snow on ground with an identical procedure as for viewable snow. The final AVHRR GAC data dataset (openly accessible here https://catalogue.ceda.ac.uk/uuid/5484dc1392bc43c1ace73ba38a22ac56) in the whole time series was based on the algorithm SCAMOD (Metsämäki et al. 2015). Consequently, many results and conclusions have been reworked.
Second, we expand the description of the generation of AVHRR GAC snow cover product in Section 2.2 and include the snow cover maps for illustration.
Third, we have made more in-depth analysis of the performance of AVHRR GAC snow. In particular, the study area has been divided into eight groups according to their elevations (0-200, 200-500, 500-1500, 1500-2500, 2500-3500, 3500-4500, 4500-5500, >5500) in order to take the topography into consideration. Furthermore, the effect of landcover type, slope, aspect, and topographical variability were analyzed for different elevation regions in Section 4.2.3 (Pixel-based comparison and potential influential factors on accuracy).
Fourth, the structure of the manuscript has been improved. The accuracy of MODIS based on in situ sites was discussed along with AVHRR in Section 4.1. Furthermore, the comparison between AVHRR GAC and MODIS snow regarding the accuracy and temporal stability is also presented in this section. The comparison between AVHRR GAC snow and MODS snow regarding their absolute values as well as the comparison between AVHRR GAC snow and Landsat snow were presented in Section 4.2 (Comparison based on medium to high resolution data).
Last but not the least, based on the new results and analyses, more comprehensive conclusions were presented in Section 5.
For the specific comments for each reviewer, we have made detailed reply as following:
Specific Comments:
Line 44: The GCOS does recommend area covered by snow cover as an essential climate variable daily at 1 km or higher resolution. The GAC resolution is much lower than recommended. The lower resolution needs to be discussed relevant to GCOS observation requirements.
Re: On the one hand, GCOS definitely is in need of long, meaning climate-relevant time scales of >30 years, thus this is only covered by AVHRR. On the other hand, although the GAC resolution is lower than recommended, this snow dataset is unique over such a long time scale at daily resolution available. In order to clarify this point, we have added the sentences as “……the ESA Climate Change Initiative (CCI) has emphasized the necessity of generating consistent, high quality long-term datasets over the last 30 years as a timely contribution to the ECV databases. In this demand, a global time series of daily fractional snow cover product has been generated from AVHRR GAC data (Naegeli et al., 2021). This snow dataset is unique as it spans 4 decades and thus provides information about an ECV at climate-relevant time scales."in the Introduction.
Discussion is also lacking on explaining the relevance of coarse GAC resolution product in the HKH region, especially when higher resolution snow cover data sources are available.
Re: We would like to point out the AVHRR GAC snow is a global product for all land areas, excluding Antarctica and Greenland ice sheets. It provides daily products for the period 1982-2019. This dataset is unique as it spans 4 decades and thus provides information about an ECV at climate-relevant time scales. In fact, this is the best spatial resolution over such a long-time scale at daily resolution available. It is important to note that the evaluation of AVHRR GAC snow over HKH is just a typical representation of its performance over mountainous area.
The HKH was selected as the study area partly because of its particular sensitiveness to climate change and thus reliable daily snow cover data across this area are in great demand, and partly because this area is featured by rich diversity of climates, hydrology, ecology, biology, and topography. Then it provides a favorable condition to explore the influential factors (e.g., elevations, landcover type, slope, aspect, and topographical variability) on the accuracy of snow mapping.
In order to clarify this point, we have emphasized the relevance of HKH and AVHRR GAC snow in Introduction as “The Hindu Kush Himalaya (HKH), which is often called as the freshwater tower of Asia, comprises the highest concentration of snow outside the polar regions. The snow cover of this area plays a crucial role in the water supply of several major Asian rivers (Immerzeel et al, 2009). On the other hand, the HKH area is of special interest due to large area, rich diversity of climates, hydrology, ecology, and biology (Wester et al., 2019). Variations in snow cover affect the precipitation, near-ground air temperature, and summer monsoon in Eurasia and across the Northern Hemisphere (Hao et al., 2018). Given the fact that HKH is particularly sensitive to climate change and thus shows strong interannual variability, reliable daily snow cover data over a long time series across this area are in great demand."
Section 2.2: I do not understand how you created a AVHRR GAC snow extent. I read the FCDR product user guide. I downloaded and looked at the FCDR data products. There is no snow cover extent dataset in any of the products. There is no AVHRR channel reflectance data in those products that could be used to calculate NDSI.
Re: In the revised manuscript, we have extended the description of AVHRR GAC snow as “The AVHRR GAC snow cover extent time series version 1 derived in the frame of the ESA CCI+ Snow project is the most recent long-term global snow cover product available (Naegeli et al., 2021). It covers the period 1982-2019 at a daily temporal and 0.05° spatial resolution. The product is based on the Fundamental Climate Data Record (FCDR) consisting of daily composites of AVHRR GAC data (https://doi.org/10.5676/DWD/ESA_Cloud_cci/AVHRR-PM/V003) produced in the ESA Cloud CCI project (Stengel et al., 2020). The data were pre-processed with an improved geocoding and an inter-channel and inter-sensor calibration using PyGAC (Devasthale et al., 2017). Snow cover extent retrieval method was developed and improved based on the ESA GlobSnow approach described by Metsämäki et al. (2015) and complemented with a pre-classification module. Alongside the daily reflectance and brightness temperature information, an excellent cloud mask including pixel-based uncertainty information is provided (Stengel et al., 2017, 2020). All cloud free pixels are then used for the snow extent mapping, using spectral bands centred at about 630 nm and 1.61 µm (channel 3a or the reflective part of channel 3b), and an emissive band centred at about 10.8 µm. The water bodies, permanent ice bodies and missing values are flagged. SCAmod retrieves both the snow cover on top of the canopy as well as on ground below the canopy by taking the canopy density into account. Here, we focus on the latter variable as this is most suitable for the comparison with in situ stations.
To reduce the effect of cloud coverage, a temporal filter of ±3 days of each individual snow cover observation was applied after Foppa and Seiz (2012). The AVHRR GAC FCDR snow cover product comprises only one longer data gap of 92 days between November 1994 and January 1995 resulting in a 99 % data coverage over the entire study period of 38 years. In this study, we will focus on the evaluation of raw daily retrieval of AVHRR GAC snow extent (denoted by “AVHRR_Raw”) since additional uncertainty will be introduced with the gap-filling process.” in Section 2.2.
The fractional snow method of Salomonson and Appel (2006) is based on a using Landsat TM data at 30 m to estimate the fractional amount of snow in a MODIS 500 m pixels. That relationship is not directly applicable to GAC data at 1x5 km2resolution. Please explain why you applied this regression to GAC data to estimate FSC.
Re: As we explained before, the final AVHRR GAC snow adopted by the revised manuscript is different from what we have previously employed. Our team have improved the retrieval algorithm, because there was a need to retrieve also snow on ground with an identical procedure as for viewable snow. The final algorithm was developed and improved based on the ESA GlobSnow approach described by Metsämäki et al. (2015) and complemented with a pre-classification module. The detailed description of this method can be seen in Section 2.2 (AVHRR GAC snow extent retrieval) in the revised manuscript.
NDSI cannot be calculated from AVHHR data until 1998 when with NOAA-15 Channel 3A at 1.6 um was added to AVHRR. Before then there was no shortwave infrared channel covering 1.6 um. It is not possible to calculate NDSI from AVHRR data prior to 1998. But your dataset record is 1982-2013. How can it possibly be consistent across major design changes in the AVHRR?
Re: The old retrieval algorithm of snow cover extent considers the high reflectance of snow in the visible spectra and the low reflectance in the short-wave infrared (). In order to construct the long-term AVHRR snow extent dataset, the reflectance values stem either from channel 3a centred around 1.61 μm or from the reflective part of channel 3b centred around 3.75 μm (Roger et al., 1993). We derived the reflective part of channel 3b (ref3b) using the method proposed by Baum (1999):
(2)
Where is the measured radiance (mW m-2 sr-1 cm) for channel 3b, is the 11 μm brightness temperature, is the integrated solar spectral irradiance (mW m-2 cm) weighted by the spectral response function for channel 3b, and is the cosine of the solar zenith angle. To account for changing solar zenith (sunz) angles the Top of Atmosphere (TOA) reflectance was corrected by a division of the cosine(sunz).
Reference:
Baum, B. A. (1999). A grouped threshold approach for scene identification in avhrr imagery. Journal of Atmospheric & Oceanic Technology, 16(6).
Roger, J. C. & Vermote, E. F. (1993). A method to retrieve the reflectivity signature at 3.75 μm from AVHRR data. Remote Sens. Environ. 64, 103–114.
The calculation of NDSI from AVHRR GAC is not explicitly given. Without explanation of how NDSI was calculated the entirety of the validation discuss and results is doubtful.
Re: The Normalised Difference Snow Index (NDSI) were determined by the high reflectance in the visible spectra and the low reflectance in the short-wave infrared:
(1)
In the case of here used AVHRR GAC data, is represented by channel 1 centred around 0.63 μm. The reflectance values stem either from channel 3a centred around 1.61 μm or from the reflective part of channel 3b centred around 3.75 μm (Roger et al., 1993). We derived the reflective part of channel 3b (ref3b) using the method proposed by Baum (1999):
(2)
where is the measured radiance (mW m-2 sr-1 cm) for channel 3b, is the 11 μm brightness temperature, is the integrated solar spectral irradiance (mW m-2 cm) weighted by the spectral response function for channel 3b, and is the cosine of the solar zenith angle. To account for changing solar zenith (sunz) angles the Top of Atmosphere (TOA) reflectance was corrected by a division of the cosine(sunz).
Section 2.3.2: The estimate of FSC for TM/ETM data is flawed. Salomonson and Appel (2006) did not derive the FSC regression to estimate TM/ETM FSC, they derived a FSC estimate for MODIS data based on the higher spatial resolution TM/ETM data. That regression is not appropriate to estimate FSC in TM/ETM data.
Re: Although the method by Salomonson and Appel (2006) is originally designed for MODIS FSC products with a mean absolute error of less than 10% (Salomonson and Appel, 2004), we assumed that such an accuracy can be achieved with higher resolution data in this paper. This treatment follows the recommendations of (Metsamaki et al., 2015), which applied fractional snow method by Salomonson and Appel (2006) to Landsat data for the evaluation of coarse-pixel snow extent products.
In order to clarify this point, we have added the sentences as “Following the recommendation of Metsamaki et al. (2015), the fractional snow method by Salomonson and Appel (2006) was employed to generate reference FSC from Landsat TM/ETM imagery. This method is originally designed for MODIS FSC products, with a mean absolute error of less than 10% (Salomonson and Appel, 2004). In this paper, we assumed that such an accuracy can be achieved with higher resolution data.” in Section 2.3.2 in the revised manuscript.
Reference:
Metsamaki, S., Pulliainen, J., Luojus, &K., et al.: Introduction to globsnow snow extent products with considerations for accuracy assessment, Remote Sens. Environ., 156, pp. 96-108, 2015.
No AVHRR GAC snow map is shown! No snow maps are shown! The research describes building an AVHRR GAC snow cover map, but none is shown. Visual evidence of the snow maps must be presented.
Re: We have included the snow cover maps for illustration in Section 2.2 in the revised manuscript.
Figure 2. AVHRR GAC raw (top row) and gap-filled (bottom row) snow cover for entire HKH in March 1984 (left) and March 2010 (right).
Line 145: It is unclear how the 30 m FSC data was used to identify FSC in a GAC pixel. Were many 30 m FSC pixels mapped into a GAC pixel then was some spatial averaging or binning of observations done to estimate FSC in a GAC pixel? A clear explanation of sampling and estimate of FSC in GAC pixel is needed.
Re: We would like to thank the reviewer for providing such a valuable comment. The resampling method was area-weighted average of contributing pixels. This point has been clarified in Section 2.3.2 as “These high-resolution data were then projected to a geographic projection and aggregated to AVHRR GAC pixel scale using the area-weighted average of contributing pixels to ‘simulate’ the reference FSC estimates at the AVHRR GAC pixel scale.” in the revised manuscript.
Line 248: How were MOD10A1 data resampled and reprojected to a GAC pixel? Many MOD10A1 pixels can be covered by a GAC pixel. What method was used to resample? Was there any averaging or compositing observations to GAC pixel done?
Re: The resampling method was area-weighted average of contributing pixels. In order to clarify this point, we have added one sentence as “In order to avoid spatial scale mismatch between AVHRR and MODIS pixel, MOD10A1 was reprojected to a geographic projection and aggregated to AVHRR GAC pixel scale using the area-weighted average of contributing pixels.” in Section 2.3.3 in the revised manuscript.
Because of the great amount of uncertainty regarding how the AVHHR GAC snow cover dataset was created and uncertainty of processing the validation datasets, only a cursory review of the methods and results was done.
Re: In the revised manuscript, we have extended the description of AVHHR GAC snow cover retrieval in Section 2.2. Additionally, the processing the validation datasets have been enhanced in Section 2.3.2 (Landsat TM/ETM data and processing) and Section 2.3.3 (MODIS snow cover product).
The conclusion that this AVHRR GAC dataset has consistent performance across the whole suite of AVHRR sensors is not substantiated.
Re: Since the AVHRR GAC snow dataset have been updated with the final released version. many results and conclusions have been reworked. Furthermore, the performance of AVHRR GAC snow in different months were analyzed in detail.
Based on the new results, it was found that the sensor-to-sensor consistency was found to differ slightly and unsystematically in ACC and Bias throughout the time series. While the consistent slight increasing trend on HSS is noteworthy. Particularly, the performance of AVHRR GAC snow is the worst on January and the best on October regarding the magnitude of ACC and HSS. But when temporal stability of accuracy was considered, it performs the best on November and the worst on January and December regarding the ACC. While that of HSS is the worst on December. The results of Bias provide different perspectives for the performance of AVHRR GAC snow. It generally overestimates snow on February, March, October, and November. By contrast, unbiased estimation is likely to occur on December and January.
-
AC2: 'Reply on RC1', Xiaodan Wu, 28 Jul 2021
Re: The manuscript has been revised from the following aspects:
First, the AVHRR GAC snow dataset have been updated with the final released version. Because the final AVHRR GAC snow data published and accessible for everyone is different from what we have previously employed in the paper. Our team have improved the retrieval algorithm, because there was a need to retrieve also snow on ground with an identical procedure as for viewable snow. The final AVHRR GAC data dataset (openly accessible here https://catalogue.ceda.ac.uk/uuid/5484dc1392bc43c1ace73ba38a22ac56) in the whole time series was based on the algorithm SCAMOD (Metsämäki et al. 2015). Consequently, many results and conclusions have been reworked.
Second, we expand the description of the generation of AVHRR GAC snow cover product in Section 2.2 and include the snow cover maps for illustration.
Third, we have made more in-depth analysis of the performance of AVHRR GAC snow. In particular, the study area has been divided into eight groups according to their elevations (0-200, 200-500, 500-1500, 1500-2500, 2500-3500, 3500-4500, 4500-5500, >5500) in order to take the topography into consideration. Furthermore, the effect of landcover type, slope, aspect, and topographical variability were analyzed for different elevation regions inSection 4.2.3 (Pixel-based comparison and potential influential factors on accuracy).
Fourth, the structure of the manuscript has been improved. The accuracy of MODIS based on in situ sites was discussed along with AVHRR in Section 4.1. Furthermore, the comparison between AVHRR GAC and MODIS snow regarding the accuracy and temporal stability is also presented in this section. The comparison between AVHRR GAC snow and MODS snow regarding their absolute values as well as the comparison between AVHRR GAC snow and Landsat snow were presented in Section 4.2 (Comparison based on medium to high resolution data).
Last but not the least, based on the new results and analyses, more comprehensive conclusions were presented in Section 5.
For the specific comments for each reviewer, we have made detailed reply as following:
Specific Comments:
Line 44: The GCOS does recommend area covered by snow cover as an essential climate variable daily at 1 km or higher resolution. The GAC resolution is much lower than recommended. The lower resolution needs to be discussed relevant to GCOS observation requirements.
Re: On the one hand, GCOS definitely is in need of long, meaning climate-relevant time scales of >30 years, thus this is only covered by AVHRR. On the other hand, although the GAC resolution is lower than recommended, this snow dataset is unique over such a long time scale at daily resolution available. In order to clarify this point, we have added the sentences as “……the ESA Climate Change Initiative (CCI) has emphasized the necessity of generating consistent, high quality long-term datasets over the last 30 years as a timely contribution to the ECV databases. In this demand, a global time series of daily fractional snow cover product has been generated from AVHRR GAC data (Naegeli et al., 2021). This snow dataset is unique as it spans 4 decades and thus provides information about an ECV at climate-relevant time scales."in the Introduction.
Discussion is also lacking on explaining the relevance of coarse GAC resolution product in the HKH region, especially when higher resolution snow cover data sources are available.
Re: We would like to point out the AVHRR GAC snow is a global product for all land areas, excluding Antarctica and Greenland ice sheets. It provides daily products for the period 1982-2019. This dataset is unique as it spans 4 decades and thus provides information about an ECV at climate-relevant time scales. In fact, this is the best spatial resolution over such a long-time scale at daily resolution available. It is important to note that the evaluation of AVHRR GAC snow over HKH is just a typical representation of its performance over mountainous area.
The HKH was selected as the study area partly because of its particular sensitiveness to climate change and thus reliable daily snow cover data across this area are in great demand, and partly because this area is featured by rich diversity of climates, hydrology, ecology, biology, and topography. Then it provides a favorable condition to explore the influential factors (e.g., elevations, landcover type, slope, aspect, and topographical variability) on the accuracy of snow mapping.
In order to clarify this point, we have emphasized the relevance of HKH and AVHRR GAC snow in Introduction as “The Hindu Kush Himalaya (HKH), which is often called as the freshwater tower of Asia, comprises the highest concentration of snow outside the polar regions. The snow cover of this area plays a crucial role in the water supply of several major Asian rivers (Immerzeel et al, 2009). On the other hand, the HKH area is of special interest due to large area, rich diversity of climates, hydrology, ecology, and biology (Wester et al., 2019). Variations in snow cover affect the precipitation, near-ground air temperature, and summer monsoon in Eurasia and across the Northern Hemisphere (Hao et al., 2018). Given the fact that HKH is particularly sensitive to climate change and thus shows strong interannual variability, reliable daily snow cover data over a long time series across this area are in great demand."
Section 2.2: I do not understand how you created a AVHRR GAC snow extent. I read the FCDR product user guide. I downloaded and looked at the FCDR data products. There is no snow cover extent dataset in any of the products. There is no AVHRR channel reflectance data in those products that could be used to calculate NDSI.
Re: In the revised manuscript, we have extended the description of AVHRR GAC snow as “The AVHRR GAC snow cover extent time series version 1 derived in the frame of the ESA CCI+ Snow project is the most recent long-term global snow cover product available (Naegeli et al., 2021). It covers the period 1982-2019 at a daily temporal and 0.05° spatial resolution. The product is based on the Fundamental Climate Data Record (FCDR) consisting of daily composites of AVHRR GAC data (https://doi.org/10.5676/DWD/ESA_Cloud_cci/AVHRR-PM/V003) produced in the ESA Cloud CCI project (Stengel et al., 2020). The data were pre-processed with an improved geocoding and an inter-channel and inter-sensor calibration using PyGAC (Devasthale et al., 2017). Snow cover extent retrieval method was developed and improved based on the ESA GlobSnow approach described by Metsämäki et al. (2015) and complemented with a pre-classification module. Alongside the daily reflectance and brightness temperature information, an excellent cloud mask including pixel-based uncertainty information is provided (Stengel et al., 2017, 2020). All cloud free pixels are then used for the snow extent mapping, using spectral bands centred at about 630 nm and 1.61 µm (channel 3a or the reflective part of channel 3b), and an emissive band centred at about 10.8 µm. The water bodies, permanent ice bodies and missing values are flagged. SCAmod retrieves both the snow cover on top of the canopy as well as on ground below the canopy by taking the canopy density into account. Here, we focus on the latter variable as this is most suitable for the comparison with in situ stations.
To reduce the effect of cloud coverage, a temporal filter of ±3 days of each individual snow cover observation was applied after Foppa and Seiz (2012). The AVHRR GAC FCDR snow cover product comprises only one longer data gap of 92 days between November 1994 and January 1995 resulting in a 99 % data coverage over the entire study period of 38 years. In this study, we will focus on the evaluation of raw daily retrieval of AVHRR GAC snow extent (denoted by “AVHRR_Raw”) since additional uncertainty will be introduced with the gap-filling process.” in Section 2.2.
The fractional snow method of Salomonson and Appel (2006) is based on a using Landsat TM data at 30 m to estimate the fractional amount of snow in a MODIS 500 m pixels. That relationship is not directly applicable to GAC data at 1x5 km2resolution. Please explain why you applied this regression to GAC data to estimate FSC.
Re: As we explained before, the final AVHRR GAC snow adopted by the revised manuscript is different from what we have previously employed. Our team have improved the retrieval algorithm, because there was a need to retrieve also snow on ground with an identical procedure as for viewable snow. The final algorithm was developed and improved based on the ESA GlobSnow approach described by Metsämäki et al. (2015) and complemented with a pre-classification module. The detailed description of this method can be seen in Section 2.2 (AVHRR GAC snow extent retrieval) in the revised manuscript.
NDSI cannot be calculated from AVHHR data until 1998 when with NOAA-15 Channel 3A at 1.6 um was added to AVHRR. Before then there was no shortwave infrared channel covering 1.6 um. It is not possible to calculate NDSI from AVHRR data prior to 1998. But your dataset record is 1982-2013. How can it possibly be consistent across major design changes in the AVHRR?
Re: The old retrieval algorithm of snow cover extent considers the high reflectance of snow in the visible spectra and the low reflectance in the short-wave infrared (). In order to construct the long-term AVHRR snow extent dataset, the reflectance values stem either from channel 3a centred around 1.61 μm or from the reflective part of channel 3b centred around 3.75 μm (Roger et al., 1993). We derived the reflective part of channel 3b (ref3b)using the method proposed by Baum (1999):
(2)
Where is the measured radiance (mW m-2 sr-1 cm) for channel 3b, is the 11 μm brightness temperature, is the integrated solar spectral irradiance (mW m-2 cm) weighted by the spectral response function for channel 3b, and is the cosine of the solar zenith angle. To account for changing solar zenith (sunz) angles the Top of Atmosphere (TOA) reflectance was corrected by a division of the cosine(sunz).
Reference:
Baum, B. A. (1999). A grouped threshold approach for scene identification in avhrr imagery. Journal of Atmospheric & Oceanic Technology, 16(6).
Roger, J. C. & Vermote, E. F. (1993). A method to retrieve the reflectivity signature at 3.75 μm from AVHRR data. Remote Sens. Environ. 64, 103–114.
The calculation of NDSI from AVHRR GAC is not explicitly given. Without explanation of how NDSI was calculated the entirety of the validation discuss and results is doubtful.
Re: The Normalised Difference Snow Index (NDSI) were determined by the high reflectance in the visible spectra and the low reflectance in the short-wave infrared:
(1)
In the case of here used AVHRR GAC data, is represented by channel 1 centred around 0.63 μm. The reflectance values stem either from channel 3a centred around 1.61 μm or from the reflective part of channel 3b centred around 3.75 μm (Roger et al., 1993). We derived the reflective part of channel 3b (ref3b) using the method proposed by Baum (1999):
(2)
where is the measured radiance (mW m-2 sr-1 cm) for channel 3b, is the 11 μm brightness temperature, is the integrated solar spectral irradiance (mW m-2 cm) weighted by the spectral response function for channel 3b, and is the cosine of the solar zenith angle. To account for changing solar zenith (sunz) angles the Top of Atmosphere (TOA) reflectance was corrected by a division of the cosine(sunz).
Section 2.3.2: The estimate of FSC for TM/ETM data is flawed. Salomonson and Appel (2006) did not derive the FSC regression to estimate TM/ETM FSC, they derived a FSC estimate for MODIS data based on the higher spatial resolution TM/ETM data. That regression is not appropriate to estimate FSC in TM/ETM data.
Re: Although the method by Salomonson and Appel (2006) is originally designed for MODIS FSC products with a mean absolute error of less than 10% (Salomonson and Appel, 2004), we assumed that such an accuracy can be achieved with higher resolution data in this paper. This treatment follows the recommendations of (Metsamaki et al., 2015), which applied fractional snow method by Salomonson and Appel (2006) to Landsat data for the evaluation of coarse-pixel snow extent products.
In order to clarify this point, we have added the sentences as “Following the recommendation of Metsamaki et al. (2015), the fractional snow method by Salomonson and Appel (2006) was employed to generate reference FSC from Landsat TM/ETM imagery. This method is originally designed for MODIS FSC products, with a mean absolute error of less than 10% (Salomonson and Appel, 2004). In this paper, we assumed that such an accuracy can be achieved with higher resolution data.” in Section 2.3.2 in the revised manuscript.
Reference:
Metsamaki, S., Pulliainen, J., Luojus, &K., et al.: Introduction to globsnow snow extent products with considerations for accuracy assessment, Remote Sens. Environ., 156, pp. 96-108, 2015.
No AVHRR GAC snow map is shown! No snow maps are shown! The research describes building an AVHRR GAC snow cover map, but none is shown. Visual evidence of the snow maps must be presented.
Re: We have included the snow cover maps for illustration in Section 2.2 in the revised manuscript.
Figure 2. AVHRR GAC raw (top row) and gap-filled (bottom row) snow cover for entire HKH in March 1984 (left) and March 2010 (right).
Line 145: It is unclear how the 30 m FSC data was used to identify FSC in a GAC pixel. Were many 30 m FSC pixels mapped into a GAC pixel then was some spatial averaging or binning of observations done to estimate FSC in a GAC pixel? A clear explanation of sampling and estimate of FSC in GAC pixel is needed.
Re: We would like to thank the reviewer for providing such a valuable comment. The resampling method was area-weighted average of contributing pixels. This point has been clarified in Section 2.3.2 as “These high-resolution data were then projected to a geographic projection and aggregated to AVHRR GAC pixel scale using the area-weighted average of contributing pixels to ‘simulate’ the reference FSC estimates at the AVHRR GAC pixel scale.” in the revised manuscript.
Line 248: How were MOD10A1 data resampled and reprojected to a GAC pixel? Many MOD10A1 pixels can be covered by a GAC pixel. What method was used to resample? Was there any averaging or compositing observations to GAC pixel done?
Re: The resampling method was area-weighted average of contributing pixels. In order to clarify this point, we have added one sentence as “In order to avoid spatial scale mismatch between AVHRR and MODIS pixel, MOD10A1 was reprojected to a geographic projection and aggregated to AVHRR GAC pixel scale using the area-weighted average of contributing pixels.” in Section 2.3.3 in the revised manuscript.
Because of the great amount of uncertainty regarding how the AVHHR GAC snow cover dataset was created and uncertainty of processing the validation datasets, only a cursory review of the methods and results was done.
Re: In the revised manuscript, we have extended the description of AVHHR GAC snow cover retrieval in Section 2.2. Additionally, the processing the validation datasets have been enhanced in Section 2.3.2 (Landsat TM/ETM data and processing) and Section 2.3.3 (MODIS snow cover product).
The conclusion that this AVHRR GAC dataset has consistent performance across the whole suite of AVHRR sensors is not substantiated.
Re: Since the AVHRR GAC snow dataset have been updated with the final released version. many results and conclusions have been reworked. Furthermore, the performance of AVHRR GAC snow in different months were analyzed in detail.
Based on the new results, it was found that the sensor-to-sensor consistency was found to differ slightly and unsystematically in ACC and Bias throughout the time series. While the consistent slight increasing trend on HSS is noteworthy. Particularly, the performance of AVHRR GAC snow is the worst on January and the best on October regarding the magnitude of ACC and HSS. But when temporal stability of accuracy was considered, it performs the best on November and the worst on January and December regarding the ACC. While that of HSS is the worst on December. The results of Bias provide different perspectives for the performance of AVHRR GAC snow. It generally overestimates snow on February, March, October, and November. By contrast, unbiased estimation is likely to occur on December and January.
Please find the supplement for the detailed response.
-
AC1: 'Reply on RC1', Xiaodan Wu, 28 Jul 2021
-
RC2: 'Comment on tc-2021-46', Anonymous Referee #2, 13 Apr 2021
- General comments
Extensive work has been done regarding a matter of the greatest importance. Being able to have an extensive temporal and spatial serie of snow cover over the Himalayan Hindukush region is a great challenge. But if most of the study shows interesting results, some key components are not considered enough, not discussed enough throughout the paper. What we see are good results hiding probable bad ones, the spatial weight of a “friendlier” topography to AVHRR GAC 4 km compensating on the large scale for the variability of the small and abrupt Himalayan range over the study area. Specifically, sections 2.2, 3.3, 4.2 and 4.3 raised questions, and a conclusion (section 5) that lacks the raised problem. There is a need to go more in depth in the results and discussion of this highly mountainous area, because what is presented does not show confidence into the use of the product over the Himalaya, and by extent over any high mountain range. Even though the rest of the results shows interesting work. This paper is not ready for publication.
- Specific comments
Section 2.2
There is a lack of basic informations about the product used, we should have more to get a better hold of it. Channels used to build the product, spatial resolution, … Even though your work was not to build it, it would be of importance to have some basic informations about it. You describe MODIS and Landsat products more in depth than the product you actually want to validate.
I understand the advantage of using AVHRR GAC because of the temporal resolution and time serie, but I am not convinced the 4km spatial resolution to be an adequate choice for those regions with very high topographic variability. Studies generally tend to discard AVHRR for the specific purpose you try to use it for (snow cover in mountainous regions), so you really need more justification to convince of the interest of such a low resolution product compared to the high topographic variability within a pixel. (an exemple here : Sharma, V. et al (2014). Topographic controls on spatio-temporal snow cover distribution in Northwest Himalaya. International journal of remote sensing, 35(9), 3036-3056.)
You use The fractional snow retrieval method by Salomonson and Appel (2006), at a different spatial resolution that the modis 500m product spatial resolution it was developed for. Both for AVHRR GAC at 4 km, and Landsat at 30 m. Were there any issues changing the scale of the spatial resolution for the application of this methodology ? would be interesting to discuss this matter
You don’t discuss much topography… 0m to 8000m in the areas you use, gonna have a huge impact on SD , especially as viewed by satellites
Section 3.3
By resampling and projecting modis FSC 500m to AVHRR GAC 4km pixels in order to compare their absolute values, you clearly loose a lot of information in the highly variable topographic areas. But you don’t discuss / show a comparative analysis of MODIS at 500m versus MODIS at 4 km to assess the accuracy of the resampleded product. Might be of importance especially in the more mountainous areas.
Section 4.2
What your results are showing, essentially, is that using AVHRR in high mountainous areas with strong variations of slope, elevation, … within a pixel, just doesn’t work. RMSE values are over the roof (fig. 12), which is also quite explicit in fig. 10. You get overall good results for most of the study area, but not for the Himalayan range, and therefore cannot write that the results are good there as well.
You need a more specific analysis to show that your results are good enough, putting both of the Himalayan part of the tile and the further Tibetan highland part under the same “mountainous area” category doesn’t make sense as their geographical caracteristics aren’t alike.
Section 5
Conclusion reflects the study, showing overall convincing results over the study area but lacking in depth work regarding the Himalayan range and the errors that go with. Work is in my opinion not complete if you want to include highly variable topographic areas in the spectrum of your validation.
- Technical corrections
Beware of the over use of logical connections at the beginning of your sentences. Makes the manuscript sometimes hard to read.
Section 4.3
Difficult to follow the discussion in a reader point of view, having to scroll back and forth to get to the plots. Would have been easier to read if the MODIS comparison was discussed along with the AVHRR, as a comparison to MODIS is one of the key point of your study to validate the AVHRR product
Citation: https://doi.org/10.5194/tc-2021-46-RC2 -
AC3: 'Reply on RC2', Xiaodan Wu, 28 Jul 2021
General comments
Extensive work has been done regarding a matter of the greatest importance. Being able to have an extensive temporal and spatial serie of snow cover over the Himalayan Hindukush region is a great challenge. But if most of the study shows interesting results, some key components are not considered enough, not discussed enough throughout the paper. What we see are good results hiding probable bad ones, the spatial weight of a “friendlier” topography to AVHRR GAC 4 km compensating on the large scale for the variability of the small and abrupt Himalayan range over the study area. Specifically, sections 2.2, 3.3, 4.2 and 4.3 raised questions, and a conclusion (section 5) that lacks the raised problem. There is a need to go more in depth in the results and discussion of this highly mountainous area, because what is presented does not show confidence into the use of the product over the Himalaya, and by extent over any high mountain range. Even though the rest of the results shows interesting work. This paper is not ready for publication.
Re: Several improvements have been made in the revised manuscript:
First, the AVHRR GAC snow dataset have been updated with the final released version. Because the final AVHRR GAC snow data published and accessible for everyone is different from what we have previously employed in the paper. Our team have improved the retrieval algorithm, because there was a need to retrieve also snow on ground with an identical procedure as for viewable snow. The final AVHRR GAC data dataset (openly accessible here https://catalogue.ceda.ac.uk/uuid/5484dc1392bc43c1ace73ba38a22ac56) in the whole time series was based on the algorithm SCAMOD (Metsämäki et al. 2015). Consequently, many results and conclusions have been reworked.
Second, we have made more in-depth analysis of the performance of AVHRR GAC snow. In particular, the study area has been divided into eight groups according to their elevations (0-200, 200-500, 500-1500, 1500-2500, 2500-3500, 3500-4500, 4500-5500, >5500) in order to take the topography into consideration. Furthermore, the effect of landcover type, slope, aspect, and topographical variability were analyzed for different elevation regions.
Third, the structure of the manuscript has been improved. The accuracy of MODIS based on in situ sites was discussed along with AVHRR in Section 4.1. And the comparison to MODIS regarding the accuracy and temporal stability is also presented in this section.
Last but not the least, we would like to point out that different reference data sources (i.e., in situ, Landsat, MODIS snow) were employed in this paper in order to assess the performance of AVHRR GAC snow from different perspectives (absolute accuracy, sensor-to-sensor consistency, spatial distribution of accuracy, as well as the influential factors on accuracy). It is true that the spatial weight of Landsat and MODIS snow to AVHRR GAC pixel scale may compensate for the variability of the small and abrupt Himalayan range. Nevertheless, from the perspective of validation of AVHRR GAC snow, the spatial aggregation of Landsat and MODIS snow is necessary, because there is significant spatial scale mismatch between AVHRR GAC and Landsat as well as MODIS. The evaluation of AVHRR GAC snow is an urgent need since this dataset is unique as it spans 4 decades and thus provides information about an ECV at climate-relevant time scales.
- Specific comments
Section 2.2
There is a lack of basic informations about the product used, we should have more to get a better hold of it. Channels used to build the product, spatial resolution, … Even though your work was not to build it, it would be of importance to have some basic informations about it. You describe MODIS and Landsat products more in depth than the product you actually want to validate.
Re: In the revised manuscript, we gave a detailed description of AVHRR GAC snow as “The AVHRR GAC snow cover extent time series version 1 derived in the frame of the ESA CCI+ Snow project is the most recent long-term global snow cover product available (Naegeli et al., 2021). It covers the period 1982-2019 at a daily temporal and 0.05° spatial resolution. The product is based on the Fundamental Climate Data Record (FCDR) consisting of daily composites of AVHRR GAC data (https://doi.org/10.5676/DWD/ESA_Cloud_cci/AVHRR-PM/V003) produced in the ESA Cloud CCI project (Stengel et al., 2020). The data were pre-processed with an improved geocoding and an inter-channel and inter-sensor calibration using PyGAC (Devasthale et al., 2017). Snow cover extent retrieval method was developed and improved based on the ESA GlobSnow approach described by Metsämäki et al. (2015) and complemented with a pre-classification module. Alongside the daily reflectance and brightness temperature information, an excellent cloud mask including pixel-based uncertainty information is provided (Stengel et al., 2017, 2020). All cloud free pixels are then used for the snow extent mapping, using spectral bands centred at about 630 nm and 1.61 µm (channel 3a or the reflective part of channel 3b), and an emissive band centred at about 10.8 µm. The water bodies, permanent ice bodies and missing values are flagged. SCAmod retrieves both the snow cover on top of the canopy as well as on ground below the canopy by taking the canopy density into account. Here, we focus on the latter variable as this is most suitable for the comparison with in situ stations.
To reduce the effect of cloud coverage, a temporal filter of ±3 days of each individual snow cover observation was applied after Foppa and Seiz (2012). The AVHRR GAC FCDR snow cover product comprises only one longer data gap of 92 days between November 1994 and January 1995 resulting in a 99 % data coverage over the entire study period of 38 years. In this study, we will focus on the evaluation of raw daily retrieval of AVHRR GAC snow extent (denoted by “AVHRR_Raw”) since additional uncertainty will be introduced with the gap-filling process.” in Section 2.2.
I understand the advantage of using AVHRR GAC because of the temporal resolution and time serie, but I am not convinced the 4km spatial resolution to be an adequate choice for those regions with very high topographic variability. Studies generally tend to discard AVHRR for the specific purpose you try to use it for (snow cover in mountainous regions), so you really need more justification to convince of the interest of such a low resolution product compared to the high topographic variability within a pixel. (an exemple here : Sharma, V. et al (2014). Topographic controls on spatio-temporal snow cover distribution in Northwest Himalaya.International journal of remote sensing, 35(9), 3036-3056.)
Re: We would like to point out the AVHRR GAC snow is a global product for all land areas, excluding Antarctica and Greenland ice sheets. It provides daily products for the period 1982-2019, which is very important for climate-relevant studies. In fact, this is the best spatial resolution over such a long-time scale at daily resolution available. It is important to note that the validation over HKH is a typical representation of its performance over mountainous area.
The HKH was selected as the study area partly because of its particular sensitiveness to climate change and thus reliable daily snow cover data across this area are in great demand, and partly because this area is featured by rich diversity of climates, hydrology, ecology, biology, and topography. Then it provides a favorable condition to explore the influential factors (e.g., elevations, landcover type, slope, aspect, and topographical variability) on the accuracy.
You use The fractional snow retrieval method by Salomonson and Appel (2006), at a different spatial resolution that the modis 500m product spatial resolution it was developed for. Both for AVHRR GAC at 4 km, and Landsat at 30 m. Were there any issues changing the scale of the spatial resolution for the application of this methodology ? would be interesting to discuss this matter
Re: It is important to note that the final AVHRR GAC snow adopted by the revised manuscript is different from what we have previously employed. Our team have improved the retrieval algorithm, because there was a need to retrieve also snow on ground with an identical procedure as for viewable snow. The final algorithm was developed and improved based on the ESA GlobSnow approach described by Metsämäki et al. (2015) and complemented with a pre-classification module.
Although the method by Salomonson and Appel (2006) is originally designed for MODIS FSC products with a mean absolute error of less than 10% (Salomonson and Appel, 2004). We assumed that such an accuracy can be achieved with higher resolution data in this paper. This treatment follows the recommendations of (Metsamaki et al., 2015), which applied fractional snow method by Salomonson and Appel (2006) to Landsat data for the evaluation of coarse-pixel snow extent products.
In order to clarify this point, we have added the sentences as “Following the recommendation of Metsamaki et al. (2015), the fractional snow method by Salomonson and Appel (2006) was employed to generate reference FSC from Landsat TM/ETM imagery. This method is originally designed for MODIS FSC products, with a mean absolute error of less than 10% (Salomonson and Appel, 2004). In this paper, we assumed that such an accuracy can be achieved with higher resolution data.” in Section 2.3.2 in the revised manuscript.
You don’t discuss much topography… 0m to 8000m in the areas you use, gonna have a huge impact on SD , especially as viewed by satellites
Re: In the revised manuscript, we have discussed the topography in depth by dividing the in situ sites into five groups according to their elevations. The detailed analysis was added in Section 4.1.4 as “It is generally thought that coarse-pixel satellite snow products perform better in higher elevations due to the continuous and thick snow cover (Yang et al., 2011). Nevertheless, the ACC over HKH shows different phenomena. The two satellite snow products consistently show larger ACC over slightly lower elevations than those over higher elevations. Nevertheless, an exception can be found in the elevation region of [3500 m, 4500 m], where the ACC of the two dataset is the lowest over the whole HKH. Furthermore, the ACC over these elevation regions is the most divergent, demonstrating that the accuracy of snow product within this range is more likely to be affected by other factors. It is noteworthy that MODIS snow product slightly outperforms AVHRR snow dataset over different elevation regions. This is reasonable since the spatial scale mismatch between in situ and satellite-based observations is greater for the AVHRR snow datasets than for the MODIS snow dataset.”.
Figure 8. Boxplots of ACC from the direct comparison with in situ site observations over different elevation regions (a) and land cover types (b) for AVHRR raw and MODIS snow data.
Section 3.3
By resampling and projecting modis FSC 500m to AVHRR GAC 4km pixels in order to compare their absolute values, you clearly loose a lot of information in the highly variable topographic areas. But you don’t discuss / show a comparative analysis of MODIS at 500m versus MODIS at 4 km to assess the accuracy of the resampleded product. Might be of importance especially in the more mountainous areas.
Re: We admit that resampling and projecting modis FSC 500m to AVHRR GAC 4km will loss lot of information in the highly variable topographic areas. Nevertheless, as we have explained before, the spatial aggregation of MODIS snow to AVHRR GAC snow pixel is necessary in validation, because there is significant spatial scale mismatch between them.
As suggested by the reviewer, we have made a comparative analysis of MODIS at 500m versus MODIS at 4 km to assess the accuracy of the resampled product using several clear-sky Landsat TM data over the study area. The evaluation results were summarized in the following table. It can be found that compared to the 500 m MODIS snow, the 4 km MODIS snow consistently shows a higher accuracy at different times of the year.
Table. Summary of accuracies of 500m MODIS and the aggregated MODIS at 4 km pixel scale with Landsat5 TM snow over “P140-R40” through scene-by-scene comparison.
500 m MODIS snow
4 km MODIS snow
RMSE(%)
mBias(%)
R(%)
RMSE(%)
mBias(%)
R(%)
2010.01.19
13.88
-3.52
0.54
9.38
-3.23
0.74
2010.02.04
15.26
-4.17
0.50
10.74
-3.96
0.69
2010.12.05
16.00
-4.44
0.48
10.45
-4.13
0.69
2010.12.21
16.51
-5.01
0.45
11.68
-4.85
0.63
Section 4.2
What your results are showing, essentially, is that using AVHRR in high mountainous areas with strong variations of slope, elevation, … within a pixel, just doesn’t work. RMSE values are over the roof (fig. 12), which is also quite explicit in fig. 10. You get overall good results for most of the study area, but not for the Himalayan range, and therefore cannot write that the results are good there as well.
Re: This part has been rephrased in the revised manuscript.
You need a more specific analysis to show that your results are good enough, putting both of the Himalayan part of the tile and the further Tibetan highland part under the same “mountainous area” category doesn’t make sense as their geographical caracteristics aren’t alike.
Re: In order to take the topography into consideration, the study area have been divided into eight groups according to their elevations (0-200, 200-500, 500-1500, 1500-2500, 2500-3500, 3500-4500, 4500-5500, >5500) (Fig. 10). Furthermore, the effect of landcover type, slope, aspect, and topographical variability were analyzed for different elevation regions (Fig. 10).
Figure 11. The variation of RMSE in dependence of a) elevation, b) land cover, c) slope, d) aspect and e) topographical variability. The different colors refer to the 8 different elevation classes. The plots show combined results of “P140-R40” and “P140-R41”.
Figure 11. continued.
In order to make an in-depth analysis of the performance of AVHRR GAC snow over different conditions, we have added a new section (4.2.3 Pixel-based comparison and potential influential factors on accuracy) in the revised manuscript as follows:
“4.2.3 Pixel-based comparison and potential influential factors on accuracy
Both the land cover types and topography are highly heterogeneous over the HKH. Here, the sub-region “P140-R40/R41” was chosen to investigate the influential factors (i.e., elevations, landcover type, slope, aspect, and topographical variability) on the accuracy of AVHRR GAC snow dataset (Fig. 10). …… This finding is inconsistent with Yang et al. (2011) who consider that coarse-pixel satellite snow products generally perform better in higher elevations due to the continuous and thick snow cover. The larger RMSEs in the highest elevations are partly caused by the large values of FSC themselves, partly caused by the roughness, topographic effects, and shadows, and partly caused by the cloud effects given that the probability of cloud rises with rising altitude in mountain areas.
Given the considerable effect of elevation on the accuracy of AVHRR GAC snow, the regions ‘P140-R40/41’ are divided into eight groups according to their elevations (Fig. 10(b)). From Fig. 10(b), it can be seen that the RMSE is rising with elevation in each individual land cover type.….. The accuracy of grasslands shows a different response to elevations, which is the worst over regions [2500 m, 3500 m]. Its accuracy is comparable to other land cover types over relatively low elevations (<1500 m) and outperforms barren over high elevations (> 3500 m).
The effect of slope on the accuracy of AVHRR GAC snow datasets is clearly shown in Fig. 10(c). ..….. In fact, the effect of slope on snow mapping accuracy is understandable since the topographic effects tend to be significant in a steep mountain area.
Regarding the effect of aspect (Fig. 10(d)), there is not a clear trend of RMSEs with aspect over the regions less than 5000 m.……Thus, snow cover in south facing slopes is more likely to be shallowness and patchiness, reducing the accuracy of AVHRR GAC snow datasets.
From Fig. 10(e), it can be found that there is only small topographical variability over the regions with low elevations (<500).…….. This is due to the fact that the topographical variability is just one of the factors influencing the accuracy of AVHRR GAC snow.
From the results above, we can conclude that the accuracy of AVHRR GAC snow is closely related to elevations, slopes, and topographical variability. And the negative influence of these factors on snow mapping accuracy is more significant over regions with high elevations. The effect of aspect can be ignored over the regions less than 5500 m. But for the areas higher than 5500 m, the accuracy first increases and then decreases gradually from the north facing slope to the south facing slope and vice versa. The effect of landcover type on snow mapping accuracy is related to elevations. ”
Section 5
Conclusion reflects the study, showing overall convincing results over the study area but lacking in depth work regarding the Himalayan range and the errors that go with. Work is in my opinion not complete if you want to include highly variable topographic areas in the spectrum of your validation.
Re: As we explained before, more in-depth analyses was made regarding the effect of topography in the revied manuscript. We have added the analyses and discussion about the influence of landcover type, slope, aspect, and topographical variability over different elevation regions (0-200, 200-500, 500-1500, 1500-2500, 2500-3500, 3500-4500, 4500-5500, >5500) in Section 4.2.3.
Furthermore, more comprehensive conclusions were presented in Section 5 based on the new analyses as “And the negative influence of these factors on snow mapping accuracy is more significant over regions with high elevations. The RMSE over different elevation regions generally shows an increasing trend with slope. The effect of aspect can be ignored over the regions less than 5500 m. But over the areas higher than 5500 m, the accuracy first increases and then decreases gradually from north facing slope to south facing slope and vice versa. The effect of landcover type on snow mapping accuracy is related to elevations. Its accuracy is generally good in croplands since it is distributed only within the region of [<1500 m]. The accuracy of barren is generally not good because it is merely distributed within the range of [>3500 m]. Forests and savannas basically show comparable overall accuracy. The accuracy of grasslands shows different responses to elevations, which is the worst over regions [2500 m, 3500 m]. Its accuracy is comparable to other land cover types over relatively low elevations (<1500 m) and outperforms barren over high elevations (> 3500 m).”.
- Technical corrections
Beware of the over use of logical connections at the beginning of your sentences. Makes the manuscript sometimes hard to read.
Re: Regarding the writing issues, this paper has been polished by a native English speaker. Furthermore, we have also made a very thorough check of the new manuscript.
Section 4.3
Difficult to follow the discussion in a reader point of view, having to scroll back and forth to get to the plots. Would have been easier to read if the MODIS comparison was discussed along with the AVHRR, as a comparison to MODIS is one of the key point of your study to validate the AVHRR product.
Re: As suggested by the reviewer, we have adjusted the structure of the manuscript as follows:
First, the accuracy of MODIS based on in situ sites was discussed along with AVHRR in Section 4.1. Furthermore, the comparison between AVHRR GAC and MODIS snow regarding the accuracy and temporal stability is also presented in this section.
Second, the comparison between AVHRR GAC snow and MODS snow regarding their absolute values as well as the comparison between AVHRR GAC snow and Landsat snow were presented in Section 4.2 (Comparison based on medium to high resolution data). The former is in Section 4.2.1 (Quantitative comparison to MOD10A1). While the latter was displayed in Section 4.2.2 (Spatial consistency of snow cover extent).
Third, we have added a new section (4.2.3 Pixel-based comparison and potential influential factors on accuracy) to analyze and discuss the influence of landcover type, slope, aspect, and topographical variability over different elevation regions.
Please find the supplement for the detailed response.
-
AC3: 'Reply on RC2', Xiaodan Wu, 28 Jul 2021
-
RC3: 'Comment on tc-2021-46', Anonymous Referee #3, 13 Jun 2021
I spent a long time reading the first sections of the manuscript when I realized that this article should not have passed the Editor's initial screening. There are 16 figures but in fact most of the figures are multi-panel figures and I counted 72 individual graphs, some of them with multiple lines or symbols. That is too much information to analyze as a reviewer. The result section is a long description of these figures. I think that the authors should profoundly revise their manuscript to present a more concise assessment by cutting down some text and figures, and rework the design of the key figures.
Beyond that issues I still think that the study is useful and important. I am not able to provide a more detailed review because that would cost me a couple of extra hours of work. However, there is an important point that cast doubt on a significant part of the study :
About the Landsat data processing: "the 30 m FSC were resampled (nearest neighbor method) and projected to a geographic projection of 0.05°to identify FSC within a given AVHRR GAC pixel."
If this is actually done as written it means that a *single* Landsat pixel of 30 m resolution was assigned to the 0.05° pixel (about 5 km resolution), i.e. the pixel that is the neares to the center of the AVHRR pixel. The source code was not provided so I could not check. The Landsat pixels should be resampled to AVHRR resolution using the area-weighted average of contributing pixels.
Citation: https://doi.org/10.5194/tc-2021-46-RC3 -
AC4: 'Reply on RC3', Xiaodan Wu, 28 Jul 2021
Thank you for providing us valuable suggestions and they do help improve the paper. According to the reviewers’ comments, we revised the paper carefully and tried to give satisfactory answers to the reviewers’ questions. The corresponding modifications are highlighted with red font in the revised paper.
The summaries of the revision for this paper are as follows:
First, the AVHRR GAC snow dataset have been updated with the final released version, which is based on based on the algorithm SCAMOD (Metsämäki et al. 2015). Furthermore, we extend the description of AVHRR GAC snow retrieval in the revised manuscript.
Second, more in-depth analysis was made regarding the performance of AVHRR GAC snow over different elevation regions (0-200, 200-500, 500-1500, 1500-2500, 2500-3500, 3500-4500, 4500-5500, >5500). Furthermore, the effect of landcover type, slope, aspect, and topographical variability were analyzed for different elevation regions.
Third, the structure of the manuscript has been improved. The accuracy of MODIS based on in situ sites was discussed along with AVHRR in Section 4.1. Furthermore, the comparison between AVHRR GAC and MODIS snow regarding the accuracy and temporal stability is also presented in this section. The comparison between AVHRR GAC snow and MODS snow regarding their absolute values as well as the comparison between AVHRR GAC snow and Landsat snow were presented in Section 4.2 (Comparison based on medium to high resolution data).
Fourth, based on the new results and analyses, more comprehensive conclusions were presented.
Fifth, some details, including figures and grammar, were improved.
For the specific comments for each reviewer, we have made detailed reply as following.
Reviewer3:
I spent a long time reading the first sections of the manuscript when I realized that this article should not have passed the Editor's initial screening. There are 16 figures but in fact most of the figures are multi-panel figures and I counted 72 individual graphs, some of them with multiple lines or symbols. That is too much information to analyze as a reviewer. The result section is a long description of these figures. I think that the authors should profoundly revise their manuscript to present a more concise assessment by cutting down some text and figures, and rework the design of the key figures.
Re: We completely agree with the reviewer, and we also admit that study is overloaded by figures and description of these. In the revised manuscript, the figures have been reworked substantially and a selection based on the main focus of the paper has been made. Since there is no need to show “gac raw” and “gac gap-filled” all the time, we put emphasis on the analysis of AVHRR GAC raw snow in the revised manuscript.
Furthermore, we would like to point out that the final AVHRR GAC snow data published and accessible for everyone is different from what we have previously employed in the paper. Our team have improved the retrieval algorithm, because there was a need to retrieve also snow on ground with an identical procedure as for viewable snow. The final AVHRR GAC data dataset (openly accessible here https://catalogue.ceda.ac.uk/uuid/5484dc1392bc43c1ace73ba38a22ac56) in the whole time series was based on the algorithm SCAMOD (Metsämäki et al. 2015). Therefore, AVHRR GAC snow dataset have been updated with the final released version. Consequently, many results and conclusions have been reworked. In the revised manuscript, only case2 were adopted.
Since only the AVHRR GAC raw snow and the case 2 was focused, many figures (2, 11, 13, 14) have been either omitted or combined. There are in all 10 figures and 5 tables in the revised manuscript.
Beyond that issues I still think that the study is useful and important. I am not able to provide a more detailed review because that would cost me a couple of extra hours of work. However, there is an important point that cast doubt on a significant part of the study : About the Landsat data processing: "the 30 m FSC were resampled (nearest neighbor method) and projected to a geographic projection of 0.05°to identify FSC within a given AVHRR GAC pixel." If this is actually done as written it means that a *single* Landsat pixel of 30 m resolution was assigned to the 0.05° pixel (about 5 km resolution), i.e. the pixel that is the neares to the center of the AVHRR pixel. The source code was not provided so I could not check. The Landsat pixels should be resampled to AVHRR resolution using the area-weighted average of contributing pixels.
Re: We would like to thank the reviewer for providing such a valuable comment. And we have changed the resampling method to area-weighted average of contributing pixels in the revised manuscript. This has been clarified in Section 2.3.2 as “These high-resolution data were then projected to a geographic projection and aggregated to AVHRR GAC pixel scale using the area-weighted average of contributing pixels to ‘simulate’ the reference FSC estimates at the AVHRR GAC pixel scale.” in the revised manuscript.
Please find the supplement for the detailed response.
-
AC4: 'Reply on RC3', Xiaodan Wu, 28 Jul 2021