Search NASA⌕ Search

SEARCH · Search NASA

Results for “climate data analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Why High Performance Visual Data Analytics is both Relevant and Difficult

Data visualization, as well as data analysis and data analytics, are all an integral part of the scientific process. Collectively, these technologies provide the means to gain insight into data of ever-increasing size and complexity. Over the past two decades, a substantial amount of visualization, analysis, and analytics R&D has focused on the challenges posed by increasing data size and complexity, as well as on the increasing complexity of a rapidly changing computational platform landscape. While some of this research focuses on solely on technologies, such as indexing and searching or novel analysis or visualization algorithms, other R&D projects focus on applying technological advances to specific application problems. Some of the most interesting and productive results occur when these two activities R&D and application are conducted in a collaborative fashion, where application needs drive R&D, and R&D results are immediately applicable to real world problems.

97 MATHEMATICS AND COMPUTING↗

Elastic Changepoint Detection for Globally-indexed Functional Time Series Data with Climate Applications

Changepoint detection is a vital tool in the application of climate data analysis. Numerous types of climate observation data are most properly represented by functional time series, implying a need for accurate changepoint detection methods applicable to functional time series data. Such data taken at a global scale often contain both spatial heterogeneity and dependence as well as phase (time) misalignment. In this report, we present methods which can detect spatially-dependent changepoints while allowing different estimates of change time and change strength depending on location. Additionally, we provide extensions to this spatially-predicted model which controls for phase variability among observations. Our methods provide the ability to detect a single change, or control for epidemic changes (where a “return-to-normal” change is more likely to be detected than the initial change). We showcase results analyzing the June 1991 eruption of Mt. Pinatubo, where our methods demonstrate the ability to accurately detect both single and epidemic changepoints even in the presence of strong seasonal variability. We find that our spatially-predicted model improves the detection of relevant changepoints versus methods which do not take spatial information into account, and we find that controlling for phase variability helps to control the false discovery rate during the detection process.

54 ENVIRONMENTAL SCIENCES↗

Ultrascale Visualization of Climate Data

Fueled by exponential increases in the computational and storage capabilities of high-performance computing platforms, climate simulations are evolving toward higher numerical fidelity, complexity, volume, and dimensionality. These technological breakthroughs are coming at a time of exponential growth in climate data, with estimates of hundreds of exabytes by 2020. To meet the challenges and exploit the opportunities that such explosive growth affords, a consortium of four national laboratories, two universities, a government agency, and two private companies formed to explore the next wave in climate science. Working in close collaboration with domain experts, the Ultrascale Visualization Climate Data Analysis Tools (UV-CDAT) project aims to provide high-level solutions to a variety of climate data analysis and visualization problems.

analysis tools↗

Hadoop for High-Performance Climate Analytics: Use Cases and Lessons Learned

Scientific data services are a critical aspect of the NASA Center for Climate Simulations mission (NCCS). Hadoop, via MapReduce, provides an approach to high-performance analytics that is proving to be useful to data intensive problems in climate research. It offers an analysis paradigm that uses clusters of computers and combines distributed storage of large data sets with parallel computation. The NCCS is particularly interested in the potential of Hadoop to speed up basic operations common to a wide range of analyses. In order to evaluate this potential, we prototyped a series of canonical MapReduce operations over a test suite of observational and climate simulation datasets. The initial focus was on averaging operations over arbitrary spatial and temporal extents within Modern Era Retrospective- Analysis for Research and Applications (MERRA) data. After preliminary results suggested that this approach improves efficiencies within data intensive analytic workflows, we invested in building a cyber infrastructure resource for developing a new generation of climate data analysis capabilities using Hadoop. This resource is focused on reducing the time spent in the preparation of reanalysis data used in data-model inter-comparison, a long sought goal of the climate community. This paper summarizes the related use cases and lessons learned.

analytics↗

NASA Center for Climate Simulation (NCCS) Presentation

The NASA Center for Climate Simulation (NCCS) offers integrated supercomputing, visualization, and data interaction technologies to enhance NASA's weather and climate prediction capabilities. It serves hundreds of users at NASA Goddard Space Flight Center, as well as other NASA centers, laboratories, and universities across the US. Over the past year, NCCS has continued expanding its data-centric computing environment to meet the increasingly data-intensive challenges of climate science. We doubled our Discover supercomputer's peak performance to more than 800 teraflops by adding 7,680 Intel Xeon Sandy Bridge processor-cores and most recently 240 Intel Xeon Phi Many Integrated Core (MIG) co-processors. A supercomputing-class analysis system named Dali gives users rapid access to their data on Discover and high-performance software including the Ultra-scale Visualization Climate Data Analysis Tools (UV-CDAT), with interfaces from user desktops and a 17- by 6-foot visualization wall. NCCS also is exploring highly efficient climate data services and management with a new MapReduce/Hadoop cluster while augmenting its data distribution to the science community. Using NCCS resources, NASA completed its modeling contributions to the Intergovernmental Panel on Climate Change (IPCG) Fifth Assessment Report this summer as part of the ongoing Coupled Modellntercomparison Project Phase 5 (CMIP5). Ensembles of simulations run on Discover reached back to the year 1000 to test model accuracy and projected climate change through the year 2300 based on four different scenarios of greenhouse gases, aerosols, and land use. The data resulting from several thousand IPCC/CMIP5 simulations, as well as a variety of other simulation, reanalysis, and observationdatasets, are available to scientists and decision makers through an enhanced NCCS Earth System Grid Federation Gateway. Worldwide downloads have totaled over 110 terabytes of data.

Webster, William P.↗

Accelerated Climate Modeling For Energy

This is the final report on the work of the New York University team to the DOE Accelerated Climate Modeling For Energy (ACME) project. NYU was one of the original developers of the UV-CDAT tool for climate data analysis, which is being used in ACME. NYU primarily focused on the analysis package graphical user interface, workflow and provenance functionality. The most significant activities in the last year of the grant were the development of the new plotting system in UVCMetrics package and the package EzLinePlot for 1D plots which are described in detail.

54 ENVIRONMENTAL SCIENCES↗

Analyzing and visualizing next generation climate data (Final Report)

The project "Analyzing and visualizing next generation climate data" adds block-structured (mosaic) grid support, parallel processing, and 2D/3D curvilinear interpolation to the open-source UV-CDAT climate data analysis tool. Block structured grid support complies to the Gridspec extension submitted to the Climate and Forecast metadata conventions. It contains two parts: aggregation of data spread over multiple mosaic tiles (M-SPEC) and aggregation of temporal data stored in different files (F-SPEC). Together, M-SPEC and F-SPEC allow users to interact with data stored in multiple files as if the data were in a single file. For computational expensive tasks, a flexible, multi-dimensional, multi-type distributed array class allows users to process data in parallel using remote memory access. Both nodal and cell based interpolation is supported; users can choose between different interpolation libraries including ESMF and LibCF depending on the their particular needs.

54 ENVIRONMENTAL SCIENCES↗

Web-based Visual Analytics for Extreme Scale Climate Science

In this paper, we introduce a Web-based visual analytics framework for democratizing advanced visualization and analysis capabilities pertinent to large-scale earth system simulations. We address significant limitations of present climate data analysis tools such as tightly coupled dependencies, ineffi- cient data movements, complex user interfaces, and static visualizations. Our Web-based visual analytics framework removes critical barriers to the widespread accessibility and adoption of advanced scientific techniques. Using distributed connections to back-end diagnostics, we minimize data movements and leverage HPC platforms. We also mitigate system dependency issues by employing a RESTful interface. Our framework embraces the visual analytics paradigm via new visual navigation techniques for hierarchical parameter spaces, multi-scale representations, and interactive spatio-temporal data mining methods that retain details. Although generalizable to other science domains, the current work focuses on improving exploratory analysis of large-scale Community Land Model (CLM) and Community Atmosphere Model (CAM) simulations.

climate science↗

American Meteorological Society (AMS) - The Modern Era Retrospective-Analysis for Research and Applications (MERRA) Data and Accessibility

The AM Short Course on The Modern Era Retrospective-analysis for Research and Applications (MERRA) data and accessibility will be held on January 11, 2009 preceding the 89th Annual Meeting in Phoenix, Arizona. Preliminary programs, registration, hotel, and general information will be posted on the AMS Web site in mid-September 2008. Retrospective-analyses (or reanalyses) have been established as an important tool in weather and climate research over the last decade. As computer power increases, the data assimilation and modeling systems improve and become more advanced, the input data quality increases and so reanalyses become more reliable. In 2008, NASA Global Modeling and Assimilation Office began producing a new reanalysis called the Modem Era Retrospective-analysis for Research and Applications (MERRA). The initial data from the reanalysis has been made available to the community and should be complete through 30 years (1979-present) by Fall of 2009. MERRA has taken advantage of the advancement of computing resources to provide users more data than previously available. The native spatial resolution is nominally 1/2 degrees and the surface two dimensional data are one hourly frequency. In addition to the meteorological analysis data, complete mass, energy and momentum budget data and also stratospheric data are provided. The eventual data holdings will exceed 150Tb. In order to facilitate user accessibility to the data, it will be stored in online hard drives (not tape storage) and available through several portals. Subsetting tools will also be available to allow users to tailor their data requests. The goals of this short course are to provide hands on users of reanalyses instruction on MERRA systems and also interactive experience with the online data and access tools. The course is intended for students and research scientists who will be actively interested in accessing and applying MERRA data in their weather, climate or applications work. The course has three parts. There will be an overview of the MERRA system, the validation of the system and the native data format. Second, Instructors will provide examples of weather and climate data analysis using various software packages (primarily GrADS) as well as the online access tools for subsetting and download, as well as visualization (e.g. Giovanni and Google Earth). This will also include examples on changing the data format to fit user's preferences and also to regrid the data for comparisons to other reanalyses and observational data. Lastly, there will he time set aside for participants to have hands on access to the data and software while interacting with the instructors and other developers. The course convener is Dr. Michael Bosilovich, NASA GSFC Global Modeling and Assimilation Office (GMAO). He will be joined by several GMAO, Goddard Earth Science Data and information Services Center (GES DISC) and Software Integration and Visualization Office (SIVO) staff.

daSilva, Arlindo↗

clif

SAND2022-12903 O clif contains code to perform climate fingerprinting. It includes capabilities for principal component analysis of climate data, Fourier analysis, a collection of pre-processing scripts, and time series statistical tools. It uses a templated object-oriented programming approach to integrate all classes with the operator in Scikit Learn. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Nichol, Jeffrey↗

Guidelines for the air-sea interaction special study: An element of the NASA climate research program, JPL/SIO workshop report

A program in the area of air sea interactions is introduced. A space capability is discussed for global observations of climate parameters which will contribute to the understanding of the processes which influence climate and its predictability. The following recommendations are some of the suggestions made for air sea interaction studies: (1) a major effort needs to be devoted to the preparation of space based climatic data sets; (2) NASA should create a group or center for climatic data analysis due to the substantial long term effort that is needed in research and development; (3) funding for the analyses of existing data sets should be augmented and continued beyond the termination of present programs; (4) NASA should fund studies in universities, research institutions and governments' centers; and (5) the planning for an air sea interaction mission should be an early task.

Source record↗

Interactive Correlation Analysis and Visualization of Climate Data

The relationship between our ability to analyze and extract insights from visualization of climate model output and the capability of the available resources to make those visualizations has reached a crisis point. The large volume of data currently produced by climate models is overwhelming the current, decades-old visualization workflow. The traditional methods for visualizing climate output also have not kept pace with changes in the types of grids used, the number of variables involved, and the number of different simulations performed with a climate model or the feature-richness of high-resolution simulations. This project has developed new and faster methods for visualization in order to get the most knowledge out of the new generation of high-resolution climate models. While traditional climate images will continue to be useful, there is need for new approaches to visualization and analysis of climate data if we are to gain all the insights available in ultra-large data sets produced by high-resolution model output and ensemble integrations of climate models such as those produced for the Coupled Model Intercomparison Project. Towards that end, we have developed new visualization techniques for performing correlation analysis. We have also introduced highly scalable, parallel rendering methods for visualizing large-scale 3D data. This project was done jointly with climate scientists and visualization researchers at Argonne National Laboratory and NCAR.

54 ENVIRONMENTAL SCIENCES↗

Changes in Characteristics of Future Climate Across the U.S.: Time Series Analysis of Climate Model Data by NASA POWER

NASA’s Prediction of Worldwide Energy Resource (POWER) project facilitates the use of NASA Earth Science data holdings within the energy, agricultural, and building heating/cooling design industries. POWER packages solar and meteorological data at various temporal levels from several NASA projects in a user friendly GIS-enabled web services system (https://power.larc.nasa.gov). Data users can access these data either through an intuitive data viewer, image services fully integrable with GIS analysis, connections in the cloud through an Amazon Web Services S3 Bucket, or fully customizable access through an API. Data provided by POWER has been used to remotely monitor solar array fields and integrated in a sizing tool for off-grid solar and storage systems. POWER data has also been coupled with key building decision tools to support design and retrofitting of building energy systems for energy efficiency and reduction of greenhouse gases. POWER is now developing capabilities to provide time series of the projected future evolution of surface quantities important to future energy production and use, such as heating/cooling degree days, temperature, wind speed, and downwelling solar flux. We present here a range of possible future changes in these quantities at locations throughout the continental United States. We show how both average and extreme values of the quantities will evolve from present-day to future climate conditions. We plan to provide these projections for users in the energy and sustainable energy communities.

Bradley M. Hegyi↗

Efficient Extraction of Regional Subsets from Massive Climate Datasets using Parallel IO

The size of datasets produced by current climate models is increasing rapidly to the scale of petabytes. To handle data at this scale parallel analysis tools are required, however the majority of climate analysis software remains at the scale of workstations. Further, many climate analysis tools adequately process regularly gridded data but lack sufficient features when handling unstructured grids. This paper presents a data-parallel subsetter capable of correctly handling unstructured grids while scaling to over 2000 cores. The approach is based on the partitioned global address space (PGAS) parallel programming model and one-sided communication. The paper demonstrates that IO remains the single greatest bottleneck for this domain of applications and that parallel analysis of climate data succeeds in practice.

54 ENVIRONMENTAL SCIENCES↗