Hybrid Ensemble Spectral Clustering(HESC): A Heterogeneous Ensemble Clustering Approach for Multi-dimensional Climate Data
Explore the source record for details and available documents.
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
Changepoint detection is a vital tool in the application of climate data analysis. Numerous types of climate observation data are most properly represented by functional time series, implying a need for accurate changepoint detection methods applicable to functional time series data. Such data taken at a global scale often contain both spatial heterogeneity and dependence as well as phase (time) misalignment. In this report, we present methods which can detect spatially-dependent changepoints while allowing different estimates of change time and change strength depending on location. Additionally, we provide extensions to this spatially-predicted model which controls for phase variability among observations. Our methods provide the ability to detect a single change, or control for epidemic changes (where a “return-to-normal” change is more likely to be detected than the initial change). We showcase results analyzing the June 1991 eruption of Mt. Pinatubo, where our methods demonstrate the ability to accurately detect both single and epidemic changepoints even in the presence of strong seasonal variability. We find that our spatially-predicted model improves the detection of relevant changepoints versus methods which do not take spatial information into account, and we find that controlling for phase variability helps to control the false discovery rate during the detection process.
A long-term, consistent, and reproducible satellite-based passive microwave sea ice concentration climate data record (CDR) is available for climate studies, monitoring, and model validation with an initial operation capability (IOC). The daily and monthly sea ice concentration data are on the National Snow and Ice Data Center (NSIDC) polar stereographic grid with nominal 25 km × 25 km grid cells in both the Southern and Northern Hemisphere polar regions from 9 July 1987 to 31 December 2007. The data files are available in the NetCDF data format at http://nsidc.org/data/g02202.html and archived by the National Climatic Data Center (NCDC) of the National Oceanic and Atmospheric Administration (NOAA) under the satellite climate data record program (http://www.ncdc.noaa.gov/cdr/operationalcdrs.html). The description and basic characteristics of the NOAA/NSIDC passive microwave sea ice concentration CDR are presented here. The CDR provides similar spatial and temporal variability as the heritage products to the user communities with the additional documentation, traceability, and reproducibility that meet current standards and guidelines for climate data records. The data set, along with detailed data processing steps and error source information, can be found at http://dx.doi.org/10.7265/N5B56GN3.
The development and use of NASA's Pilot Climate Data System (PCDS) are discussed. The PCDS is used as a focal point for managing and providing access to a large collection of actively used data for the Earth, ocean and atmospheric sciences. The PCDS provides uniform data catalogs, inventories, and access methods for selected NASA and non-NASA data sets. Scientific users can preview the data sets using graphical and statistical methods. The system has evolved from its original purpose as a climate data base management system in response to a national climate program, into an extensive package of capabilities to support many types of data sets from both spaceborne and surface based measurements with flexible data selection and analysis functions.
Enhanced melting of the Greenland Ice Sheet has been documented in recent literature along with surface-temperature increases measured using infrared satellite data since 1981. Using a recently-developed climate-quality data record, 11- and 12-year trends in the clear-sky ice-surface temperature (IST) of the Greenland Ice Sheet have been studied using the Moderate-Resolution Imaging Spectroradiometer (MODIS) IST product. Daily and monthly MODIS ISTs of the Greenland Ice Sheet beginning on 1 March 2000 and continuing through 31 December 2010 are now available at 6.25-km spatial resolution on a polar stereographic grid as described in Hall et al. (submitted). This record will be elevated in status to a climate-data record (CDR) when more years of data become available either from the MODIS on the Terra or Aqua satellites, or from the Visible Infrared Imager Radiometer Suite (VIIRS) to be launched in October 2011. Maps showing the maximum extent of melt for the entire ice sheet and for the six major drainage basins have been developed from the MODIS IST dataset. Twelve-year trends of the duration of the melt season on the ice sheet vary in different drainage basins with some basins melting progressively earlier over the course of the study period. Some (but not all) of the basins also show a progressively-longer duration of melt. IST 12-year trends are compared with in-situ data, and climate data from the Modern Era Retrospective-Analysis for Research and Applications (MERRA) Reanalysis.
The Super-Resolution for Renewable Energy Resource Data with Climate Change Impacts (Sup3rCC) data is a collection of 4km hourly wind, solar, temperature, humidity, and pressure fields for the contiguous United States under various climate change scenarios. Sup3rCC is downscaled Global Climate Model (GCM) data. The downscaling process was performed using a generative machine learning approach called sup3r: Super-Resolution for Renewable Energy Resource Data (linked below as "Sup3r GitHub Repo"). The data includes both historical and future weather years, although the historical years represent the historical climate, not the actual historical weather that we experienced. You cannot use Sup3rCC data to study historical weather events, although other sup3r datasets may be intended for this. The Sup3rCC data is intended to help researchers study the impact of climate change on energy systems with high levels of wind and solar capacity. Please note that all climate change data is only a representation of the possible future climate and contains significant uncertainty. Analysis of multiple climate change scenarios and multiple climate models can help quantify this uncertainty.
We have developed a climate-quality data record of the clear-sky surface temperature of the Greenland Ice Sheet using the Moderate-Resolution Imaging Spectroradiometer (MODIS) Terra ice-surface temperature (1ST) algorithm. A climate-data record (CDR) is a time series of measurements of sufficient length, consistency, and continuity to determine climate variability and change. We present daily and monthly Terra MODIS ISTs of the Greenland Ice Sheet beginning on 1 March 2000 and continuing through 31 December 2010 at 6.25-km spatial resolution on a polar stereographic grid within +/-3 hours of 17:00Z or 2:00 PM Local Solar Time. Preliminary validation of the ISTs at Summit Camp, Greenland, during the 2008-09 winter, shows that there is a cold bias using the MODIS IST which underestimates the measured surface temperature by approximately 3 C when temperatures range from approximately -50 C to approximately -35 C. The ultimate goal is to develop a CDR that starts in 1981 with the Advanced Very High Resolution (AVHRR) Polar Pathfinder (APP) dataset and continues with MODIS data from 2000 to the present. Differences in the APP and MODIS cloud masks have so far precluded the current IST records from spanning both the APP and MODIS IST time series in a seamless manner though this will be revisited when the APP dataset has been reprocessed. The Greenland IST climate-quality data record is suitable for continuation using future Visible Infrared Imager Radiometer Suite (VIIRS) data and will be elevated in status to a CDR when at least 9 more years of climate-quality data become available either from MODIS Terra or Aqua, or from the VIIRS. The complete MODIS IST data record will be available online in the summer of 2011.
The application of hyper spectral radiometric data to climate research requires very high absolute radiometric accuracy and stability. We use cloud-free tropical ocean data from the Atmospheric InfraRed Sounder (AIR) Calibration Data Subset (ADCS) to show that the radiometric precision and stability required climate applications has been achieved. The sea surface skin temperatures derived from the AIRS 2616cm-1 super window channel are stable relative to the RTG.SST at the better than 8 mK/year level, and the spectral calibration is stable at the 1 ppm/year level. The excellent stability and accuracy are the result of the implementation of AIRS as a grating array spectrometer, which is cooled and stabilized within 10 mK at 155 K. Analysis of daily measurements of the temperature gradient between the surface and 7 km altitude show that the AIRS Calibration Data Subset has applications which extend its original intent for calibration support to climate research. The Atmospheric Infrared Sounder (AIRS) on the EOS Aqua satellite was launched into polar orbit in May 2002. AIRS covers the spectral region from 640 to 2700 cm-1 with 2378 independent channels and represents the first of a new generation of hyper spectral resolution sounders in support of global sounding data for weather forecasting and climate research.
We have developed a climate-quality data record of the clear-sky surface temperature of the Greenland Ice Sheet using the Moderate-Resolution Imaging Spectroradiometer (MODIS) ice-surface temperature (1ST) algorithm. A climate-data record (CDR) is a time series of measurements of sufficient length, consistency, and continuity to determine climate variability and change. We present daily and monthly MODIS ISTs of the Greenland Ice Sheet beginning on 1 March 2000 and continuing through 31 December 2010 at 6.25-km spatial resolution on a polar stereographic grid. This record will be elevated in status to a CDR when at least nine more years of data become available either from MODIS Terra or Aqua, or from the Visible Infrared Imager Radiometer Suite (VIIRS) to be launched in October 2011. Our ultimate goal is to develop a CDR that starts in 1981 with the Advanced Very High Resolution (AVHRR) Polar Pathfinder (APP) dataset and continues with MODIS data from 2000 to the present, and into the VIIRS era. Differences in the APP and MODIS cloud masks have so far precluded the current 1ST records from spanning both the APP and MODIS time series in a seamless manner though this will be revisited when the APP dataset has been reprocessed. The complete MODIS 1ST daily and monthly data record is available online.
A broad community of climate adaptation practitioners, stakeholders and policymakers rely on historical reconstructions and future projections of local to regional climate. To be of value to these users, climate data must be credible, salient, and authoritative (Cash et al. 2002). Namely, data must be consistent with our physical understanding of the global Earth system, must be relevant for informing the decision-making process, and must be backed by expert judgment. As more and more data products have become available, multiple challenges have emerged around the production, evaluation, selection, and use of these data products. Consequently, to ensure crucial decisions leverage the best possible historical and future physical climate data, there is a pressing need to develop a coordinated national climate data strategy that is inclusive of all relevant communities of practice.
The impacts of present and potential future climate change will be one of the most important scientific and societal challenges in the 21st century. Given observed changes in temperature, sea ice, and sea level, improving our understanding of the climate system is an international priority. This system is characterized by complex phenomena that are imperfectly observed and even more imperfectly simulated. But with an ever-growing supply of climate data from satellites and environmental sensors, the magnitude of data and climate model output is beginning to overwhelm the relatively simple tools currently used to analyze them. A computational approach will therefore be indispensable for these analysis challenges. This chapter introduces the fledgling research discipline climate informatics: collaborations between climate scientists and machine learning researchers in order to bridge this gap between data and understanding. We hope that the study of climate informatics will accelerate discovery in answering pressing questions in climate science.
The past two decades have witnessed natural disasters and extreme weather events that affect millions of people. At the same time, the data volume from high-resolution climate models, satellite, in-situ and ground-based measurements have substantially increased to petabyte scales. These new and readily accessible datasets create the previously missing pipeline required for scientific machine learning (ML) and therefore new opportunities for improved understanding and prediction capability of climate extreme events. This project developed a deep latent variable model framework to discover physically meaningful hidden structures from high-dimensional, spatiotemporal climate extreme data.
Practitioners of climate change prediction base many of their future climate scenarios on General Circulation Models (GCM's), each model with differing assumptions and parameter requirements. For representing the atmosphere, GCM's typically contain equations for calculating motion of particles, thermodynamics and radiation, and continuity of water vapor. Hydrology and heat balance are usually included for continents, and sea ice and heat balance are included for oceans. The current issue of this journal contains a paper by Van Blarcum et al. (1995) that predicts runoff from nine high-latitude rivers under a doubled CO2 atmosphere. The paper is important since river flow is an indicator variable for climate change. The authors show that precipitation will increase under the imposed perturbations and that owing to higher temperatures earlier in the year that cause the snow pack to melt sooner, runoff will also increase. They base their simulations on output from a GCM coupled with an interesting water routing scheme they have devised. Climate change models have been linked to other models to predict deforestation.
Australia’s changing climate is already impacting the agriculture sector and will continue to do so in the future. To help respond to these impacts, the Climate Services for Agriculture (CSA) platform presents readily accessible climate data, including future climate projections, relevant to specific agricultural commodities. This wine industry example aims to demonstrate the functionality and utility of the CSA for national use across a broad range of commodities. Methods and Results. The platform includes commodity-relevant climate indices designed in consultation with experts to ensure that they are as salient to producers as possible; the wine-grape specific indices include measures of growing season temperature, rainfall, extreme heat, and frost. Here, we describe the research behind the wine-grape specific indices and present sample outputs from the CSA platform for a site within a selected winegrowing region. We note the CSA platform has been developed through an extensive and continuing user engagement initiative, ensuring it meets the needs of the agriculture community as they grapple with how to make decisions based on longer term climate projections. Conclusions. Provision of past, seasonal outlook, and future climate information for Australia and for a range of important agricultural commodities can help improve on-farm planning and decision-making to respond to climate risks. The wine industry provides a leading example of how to use these data for decision-making, noting ongoing adjustments will be needed. Significance of the Study. The CSA platform brings together historical climate data, seasonal climate outlooks, and future climate projections to assist agricultural producers to better manage climate variability and climate change. It aims to nationalise this information for all major agricultural commodities in Australia. We use wine production as a demonstration case here.
The Clouds and the Earth’s Radiant Energy System (CERES) project provides observations of Earth’s radiation budget using measurements from CERES instruments on board the Terra, Aqua, Suomi National Polar-orbiting Partnership (S-NPP), and NOAA-20 satellites. The CERES top-of-atmosphere (TOA) fluxes are produced by converting radiance measurements using empirical angular distribution models, which are functions of cloud properties that are retrieved from imagers flying with the CERES instruments. As the objective is to create a long-term climate data record, not only calibration consistency of the six CERES instruments needs to be maintained for the entire time period, it is also important to maintain the consistency of other input data sets used to produce this climate data record. In this paper, we address aspects that could potentially affect the CERES TOA flux data quality. Discontinuities in imager calibration can affect cloud retrieval which can lead to erroneous flux trends. When imposing an artificial 0.6 per decade decreasing trend to cloud optical depth, which is similar to the trend difference between CERES Edition 2 and Edition 4 cloud retrievals, the decadal SW flux trend changed from −0.3 5 ± 0.18 Wm −2 to 0.61 ± 0.18 Wm −2 . This indicates that a 13% change in cloud optical depth results in about 1% change in the SW flux. Furthermore, different CERES instruments provide valid fluxes at different viewing zenith angle ranges, and including fluxes derived at the most oblique angels unique to S-NPP (>66 ∘ ) can lead to differences of 0.8 Wm −2 and 0.3 Wm −2 in global monthly mean instantaneous SW flux and LW flux. To ensure continuity, the viewing zenith angle ranges common to all CERES instruments (<66 ∘ ) are used to produce the long-term Earth’s radiation budget climate data record. The consistency of cloud properties retrieved from different imagers also needs to be maintained to ensure the TOA flux consistency.
Public health professionals are increasingly concerned about the potential impact that climate variability and change can have on infectious disease. The International Research Institute for Climate and Society (IRI) is developing new products to increase the public health community's capacity to understand, use and demand the appropriate climate data and climate information to mitigate the public health impacts of climate on infectious disease, in particular meningitis and malaria. In this paper, we present the new and improved products that have been developed for: (i) estimating dust aerosol for forecasting risks of meningitis and (ii) for monitoring temperature and rainfall and integrating them into a vectorial capacity model for forecasting risks of malaria epidemics. We also present how the products have been integrated into a knowledge system (IRI Data Library Map Room, SERVIR) to support the use of climate and environmental information in climate-sensitive health decision-making.
The range of results from climate models and scenarios is important to the understanding of uncertainty in power planning analysis. A U.S. Department of Energy-funded analytic project called Power Planning for Alignment of Climate and Energy Systems is developing data and analytic methods to reflect the effects of climate change on key variables for power system planning, as part of the Grid Modernization Lab Consortium. This project will select and prepare global climate model results for use in power system planning models. A related report (Evaluation of Global Climate Models for Use in Energy Analysis) assesses the performance of various global climate models from the Coupled Model Intercomparison Project Phase 6 data archive for their historical skill with respect to energy system performance and for their future projections under multiple climate change scenarios. Building from that report, we describe the selection of a climate scenario (Shared Socioeconomic Pathway [SSP] 2-4.5) and five climate models: TaiESM1, EC-Earth3-CC, GFDL-CM4, EC-Earth3-Veg, and MPI-ESM1-2-HR. We describe the model selection criteria, which were based on the quality of the match between model results under historical conditions and on the representation of the range of future values for several variables. These results will be downscaled via an open-source generative machine learning method called Super-Resolution for Renewable Energy Resource Data with Climate Change Impacts.
With ever changing landscapes and environmental conditions due to human induced climate change, adaptability is imperative for the long-term success of facilities and Federal agency missions. To mitigate the effects of climate change, indicators such as above-ground biomass change must be identified to establish a comprehensive monitoring effort. Researching the varying effects of climate change on ecosystems can provide a scientific framework that will help produce informative, strategic and tactical policies for environmental adaptation. As a proactive approach to climate change mitigation, NASA tasked the Climate Change Adaptation Science Investigators Workgroup (CASI) to provide climate change expertise and data to Center facility managers and planners in order to ensure sustainability based on predictive models and current research. Generation of historical datasets that will be used in an agency-wide effort to establish strategies for climate change mitigation and adaptation at NASA facilities is part of the CASI strategy. Using time series of historical remotely sensed data is well-established means of measuring change over time. CASI investigators have acquired multispectral and hyperspectral optical and LiDAR remotely sensed datasets from NASA Earth Observation Satellites (including the International Space Station), airborne sensors, and astronaut photography using hand held digital cameras to create a historical dataset for the Johnson Space Center, as well as the Houston and Galveston area. The raster imagery within each dataset has been georectified, and the multispectral and hyperspectral imagery has been atmospherically corrected. Using ArcGIS for Server, the CASI-Regional Remote Sensing data has been published as an image service, and can be visualized through a basic web mapping application. Future work will include a customized web mapping application created using a JavaScript Application Programming Interface (API), and inclusion of the CASI data for the NASA Johnson Space Center into a NASA-Wide GIS Institutional Portal.