Search NASA⌕ Search

SEARCH · Search NASA

Results for “data set”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

ARM Cloud Retrieval Ensemble Data Set (ACRED)

This document describes a new Atmospheric Radiation Measurement (ARM) data set, the ARM Cloud Retrieval Ensemble Data Set (ACRED), which is created by assembling nine existing ground-based cloud retrievals of ARM measurements from different cloud retrieval algorithms. The current version of ACRED includes an hourly average of nine ground-based retrievals with vertical resolution of 45 m for 512 layers. The techniques used for the nine cloud retrievals are briefly described in this document. This document also outlines the ACRED data availability, variables, and the nine retrieval products. Technical details about the generation of ACRED, such as the methods used for time average and vertical re-grid, are also provided.

54 ENVIRONMENTAL SCIENCES↗

GES DISC Greenhouse Gas Data Sets and Associated Services

NASA Goddard Earth Sciences (GES) Data and Information Services Center (DISC) archives and distributes rich collections of data on atmospheric greenhouse gases from multiple missions. Hosted data include those from the Atmospheric Infrared Sounder (AIRS) mission (which has observed CO2, CH4, ozone, and water vapor since 2002); legacy water vapor and ozone retrievals from TIROS Operational Vertical Sounder (TOVS); and Upper Atmosphere Research Satellite (UARS) going back to the early 1980s. GES DISC also archives and supports data from seven projects of the Making Earth System Data Records for Use in Research Environments (MEaSUREs) program that have ozone and water vapor records. Greenhouse gases data from the A-Train satellite constellation is also available: (1) Aura-Ozone Monitoring Instrument (OMI) and Microwave Limb Sounder (MLS) ozone, nitrous oxide, and water vapor since 2004; (2) Greenhouse Gases Observing Satellite (GOSAT) CO2 observations since 2009 from the Atmospheric CO2 Observations from Space (ACOS) task; and (3) Orbiting Carbon Observatory-2 (OCO-2) CO2 data since 2014. The most recent related data set that the GES DISC archives is methane flux for North America, as part of NASAs Carbon Monitoring System (CMS) project. This dataset contains estimates of methane emission in North America based on an inversion of the GEOS-Chem chemical transport model constrained by GOSAT observations (Turner et al., 2015). Along with data stewardship, an important focus area of the GES DISC is to enhance the usability of its data and broaden its user base. Users have unrestricted access to a new user-friendly search interface, which includes many services such as variable subsetting, format conversion, quality screening, and quick browse. The majority of the GES DISC data sets are also accessible through Open-source Project for a Network Data Access Protocol (OPeNDAP) and Web Coverage Service (WCS). The latter two services provide more options for specialized subsetting, format conversion, and image viewing. Additional data exploration, data preview, and preliminary analysis capabilities are available via NASA Giovanni, which obviates the need forusers to download the data (Acker and Leptoukh, 2007). Giovanni provides a bridge between the data and science and has been very successful in extending GES DISC data to educational users and to users with limited resources.

data ordering↗

The Magnitude and Variability of Global and Regional Precipitation Based on the 22-Year GPCP (Global Precipitation Climatology Project) and Three-Year TRMM (Tropical Rainfall Measuring Mission) Data Sets

This paper gives an overview of the analysis of global precipitation over the last few decades and the impact of the new TRMM precipitation observations. The 20+ year, monthly, globally complete precipitation analysis of the World Climate Research Program's (WCRP/GEWEX) Global Precipitation Climatology Project (GPCP) is used to study global and regional variations and trends and is compared to the much shorter TRMM (Tropical Rainfall Measuring Mission) tropical data set. The GPCP data set shows no significant trend in precipitation over the twenty years, unlike the positive trend in global surface temperatures over the past century. The global trend analysis must be interpreted carefully, however, because the inhomogeneity of the data set makes detecting a small signal very difficult, especially over this relatively short period. Identifying regional trends in precipitation may be more practical. From 1979 to 1999 the northern mid-latitudes appear to be drying, the southern mid-latitudes have gotten wetter, and there is a mixed signal in the tropics. The relation between this field of trends and the relation to the frequency of El Nino events during this time period is explored. Monthly anomalies of precipitation are related to ENSO variations with clear signals extending into middle and high latitudes of both hemispheres. The El Nino and La Nina mean anomalies are near mirror images of each other and when combined produce an ENSO signal with significant spatial continuity over large distances. These El Nino minus La Nina composites of normalized precipitation show the usual positive, or wet, anomaly over the central and eastern Pacific Ocean with the negative, or dry, anomaly over the maritime continent along with an additional negative anomaly over Brazil and the Atlantic Ocean extending into Africa and a positive anomaly over the Horn of Africa and the western Indian Ocean. A number of the features are shown to extend into high latitudes. Positive anomalies extend in the Southern Hemisphere (S.H.) from the Pacific southeastward across Chile and Argentina into the south Atlantic Ocean. In the Northern Hemisphere (N.H.) the counterpart feature extends across the southern US and Atlantic Ocean into Europe. Further to the west a negative anomaly extends southeastward again from the Maritime Continent across the South Pacific and through the Drake Passage. The N.H. counterpart crosses the North Pacific and southern Canada. In the Southern Hemisphere an anomaly feature is shown to spiral into the Antarctica land mass. The extremes of ENSO-related anomalies are also examined and indicate that globally, during both El Nino and La Nina, more extremes of precipitation ( both wet and dry) occur than during the "neutral" regime, with the El Nino regime showing larger magnitudes. The distribution is different for the globe as a whole and when the area is restricted to just land. The recent (1998-present) TRMM observations are compared with the similar period of GPCP analyses with very good agreement in terms of pattern and generally good agreement with regard to magnitude. However, there still are differences among the individual TRMM products using passive and active microwave techniques and these need to be resolved before longer-term products such as the GPCP analyses can be validated.

Adler, Robert F.↗

Variations and Trends in Global and Regional Precipitation Based on the 22-Year GPCP (Global Precipitation Climatology Project) and Three-Year TRMM (Tropical Rainfall Measuring Mission) Data Sets

This paper gives an overview of the analysis of global precipitation over the last few decades and the impact of the new TRMM precipitation observations. The 20+ year, monthly, globally complete precipitation analysis of the World Climate Research Program's (WCRP/GEWEX) Global Precipitation Climatology Project (GPCP) is used to study global and regional variations and trends and is compared to the much shorter TRMM(Tropical Rainfall Measuring Mission) tropical data set. The GPCP data set shows no significant trend in global precipitation over the twenty years, unlike the positive trend in global surface temperatures over the past century. The global trend analysis must be interpreted carefully, however, because the inhomogeneity of the data set makes detecting a small signal very difficult, especially over this relatively short period. The relation of global (and tropical) total precipitation and ENSO events is quantified with no significant signal when land and ocean are combined. Identifying regional trends in precipitation may be more practical. From 1979 to 2000 the tropics have pattern of regional rainfall trends that has an ENSO-like pattern with features of both the El Nino and La Nina. This feature is related to a possible trend in the frequency of ENSO events (either El Nino or La Nina) over the past 20 years. Monthly anomalies of precipitation are related to ENSO variations with clear signals extending into middle and high latitudes of both hemispheres. The El Nino and La Nina mean anomalies are near mirror images of each other and when combined produce an ENSO signal with significant spatial continuity over large distances. A number of the features are shown to extend into high latitudes. Positive anomalies extend in the Southern Hemisphere (S.H.) from the Pacific southeastward across Chile and Argentina into the south Atlantic Ocean. In the Northern Hemisphere (N.H.) the counterpart feature extends across the southern U.S. and Atlantic Ocean into Europe. Further to the west a negative anomaly extends southeastward again from the Maritime Continent across the South Pacific and through the Drake Passage. In the Southern Hemisphere an anomaly feature is shown to spiral into the Antarctica land mass. The extremes of ENSO-related anomalies are also examined and indicate that globally, during both El Nino and La Nina, more extremes of precipitation (both wet and dry) occur than during the "neutral" regime, with the El Nino regime showing larger magnitudes. The distribution is different for the globe as a whole and when the area is restricted to just land. The recent (1998-present) TRMM observations are compared with the similar period of GPCP analyses with very good agreement in terms of pattern and generally good agreement with regard to magnitude. However, there still are differences among the individual TRMM products using passive and active microwave techniques and these need to be resolved before longer-term products such as the GPCP analyses can be validated.

Adler, Robert F.↗

Atmospheric Carbon and Transport – America (ACT-America) Data Sets: Description, Management, and Delivery

The ACT-America project is a NASA Earth Venture Suborbital-2 mission designed to study the transport and fluxes of greenhouse gases. The open and freely available ACT-America data sets provide airborne in situ measurements of atmospheric carbon dioxide, methane, trace gases, aerosols, clouds, and meteorological properties, airborne remote sensing measurements of aerosol backscatter, atmospheric boundary layer height and columnar content of atmospheric carbon dioxide, tower-based measurements, and modeled atmospheric mole fractions and regional carbon fluxes of greenhouse gases over the Central and Eastern United States. In this study, we conducted 121 research flights during five campaigns in four seasons during 2016–2019 over three regions of the US (Mid-Atlantic, Midwest and South) using two NASA research aircraft (B-200 and C-130). We performed three flight patterns (fair weather, frontal crossings, and OCO-2 underflights) and collected more than 1,140 h of airborne measurements via level-leg flights in the atmospheric boundary layer, lower, and upper free troposphere and vertical profiles spanning these altitudes. We also merged various airborne in situ measurements onto a common standard sampling interval, which brings coherence to the data, creates geolocated data products, and makes it much easier for the users to perform holistic analysis of the ACT-America data products. Here, we report on detailed information of data sets collected, the workflow for data sets including storage and processing of the quality controlled and quality assured harmonized observations, and their archival and formatting for users. Finally, we provide some important information on the dissemination of data products including metadata and highlights of applications of ACT-America data sets.

54 ENVIRONMENTAL SCIENCES↗

Ozone highs and associated flow features in the first half of the twentieth century in different data sets

In order to better understand weather extremes, their relation to the large-scale climate variability, and their possible changes over time, observation-based atmospheric data sets are required that reach back in time as far as possible and that provide information on the 3-dimensional structure of the atmosphere. A number of new such data sets have been published in recent years, including historical observations, reanalyses, and reconstructions, some of which reach back into the nineteenth century. However, their usefulness for studying weather extremes remains to be shown. Here we compare some of these historical data sets in the first half of the twentieth century, focusing on one specific type of extreme, namely “ozone highs". Using historical total ozone observations as a starting point, we assess dynamical links between total ozone, the flow near the tropopause, and tropospheric circulation in the “Twentieth Century Reanalysis" (20CR), historical radiosonde and aircraft observations, and hand drawn historical maps. Selected cases are presented for two regions (Europe and China). Ozone highs over Europe in the 1920s to 1950s were qualitatively well reproduced in 20CR and could mostly be interpreted in the context of cut-off lows. Some of these coincided with a blocking high over the North Atlantic or with vigorous cold-air outbreaks. One of these cases is analysed in more detail. Ozone highs over China in the 1930s may have been related to changes in the jet stream and the subtropical tropopause, but they were not always well reproduced in 20CR. The results demonstrate that, in many of the cases, the available data allow a dynamical interpretation. This confirms the potential of the available data and techniques to extend the length of atmospheric data sets suitable for studying extremes.

54 ENVIRONMENTAL SCIENCES↗

Parallel analysis tools and new visualization techniques for ultra-large climate data set

ParVis was a project funded under LAB 10-05: “Earth System Modeling: Advanced Scientific Visualization of Ultra-Large Climate Data Sets”. Argonne was the lead lab with partners at PNNL, SNL, NCAR and UC-Davis. This report covers progress from January 1st, 2013 through Dec 1st, 2014. Two previous reports covered the period from Summer, 2010, through September 2011 and October 2011 through December 2012, respectively. While the project was originally planned to end on April 30, 2013, personnel and priority changes allowed many of the institutions to continue work through FY14 using existing funds. A primary focus of ParVis was introducing parallelism to climate model analysis to greatly reduce the time-to-visualization for ultra-large climate data sets. Work in the first two years was conducted on two tracks with different time horizons: one track to provide immediate help to climate scientists already struggling to apply their analysis to existing large data sets and another focused on building a new data-parallel library and tool for climate analysis and visualization that will give the field a platform for performing analysis and visualization on ultra-large datasets for the foreseeable future. In the final 2 years of the project, we focused mostly on the new data-parallel library and associated tools for climate analysis and visualization.

54 ENVIRONMENTAL SCIENCES↗

Compression of regions in the global advanced very high resolution radiometer 1-km data set

The global advanced very high resolution radiometer (AVHRR) 1-km data set is a 10-band image produced at USGS' EROS Data Center for the study of the world's land surfaces. The image contains masked regions for non-land areas which are identical in each band but vary between data sets. They comprise over 75 percent of this 9.7 gigabyte image. The mask is compressed once and stored separately from the land data which is compressed for each of the 10 bands. The mask is stored in a hierarchical format for multi-resolution decompression of geographic subwindows of the image. The land for each band is compressed by modifying a method that ignores fill values. This multi-spectral region compression efficiently compresses the region data and precludes fill values from interfering with land compression statistics. Results show that the masked regions in a one-byte test image (6.5 Gigabytes) compress to 0.2 percent of the 557,756,146 bytes they occupy in the original image, resulting in a compression ratio of 89.9 percent for the entire image.

Kess, Barbara L.↗

Integrated Data Collection Analysis (IDCA) Program — RDX Standard Data Sets

The Integrated Data Collection Analysis (IDCA) program is conducting a proficiency study for Small- Scale Safety and Thermal (SSST) testing of homemade explosives (HMEs). Described here are the results for impact, friction, electrostatic discharge, and differential scanning calorimetry analysis of the RDX Type II Class 5 standard, for a third and fourth time in the Proficiency Test and averaged with the analysis results from the first and second time. The results, from averaging all four sets (1, 2, 3 and 4) of data suggest a material to have slightly more impact sensitivity, more BAM friction sensitivity, less ABL friction sensitivity, similar ESD sensitivity, and same DSC sensitivity, compared to the results from Set 1, which was used previously as the values for the RDX standard in IDCA Analysis Reports.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Production of long-term global water vapor and liquid water data set using ultra-fast methods to assimilate multi-satellite and radiosonde observations

In recent years climate research scientists have recognized the need for increased time and space resolution precipitable and liquid water data sets. This project is designed to meet those needs. Specifically, NASA is funding STC-METSAT to develop a total integrated column and layered precipitable water data set. This is complemented by a total column liquid water data set. These data are global in extent, 1 deg x 1 deg in resolution, with daily grids produced. Precipitable water is measured by a combination of in situ radiosonde observations and satellite derived infrared and microwave retrievals from four satellites. This project combines these data into a coherent merged product for use in global climate research. This report is the Year 2 Annual Report from this NASA-sponsored project and includes progress-to-date on the assigned tasks.

Vonderhaar, Thomas H.↗

Problems in merging Earth sensing satellite data sets

Satellite remote sensing systems provide a tremendous source of data flow to the Earth science community. These systems provide scientists with data of types and on a scale previously unattainable. Looking forward to the capabilities of Space Station and the Earth Observing System (EOS), the full realization of the potential of satellite remote sensing will be handicapped by inadequate information systems. There is a growing emphasis in Earth science research to ask questions which are multidisciplinary in nature and global in scale. Many of these research projects emphasize the interactions of the land surface, the atmosphere, and the oceans through various physical mechanisms. Conducting this research requires large and complex data sets and teams of multidisciplinary scientists, often working at remote locations. A review of the problems of merging these large volumes of data into spatially referenced and manageable data sets is presented.

Smith, Paul H.↗

Development of a MODIS-Derived Surface Albedo Data Set: An Improved Model Input for Processing the NSRDB

A significant source of bias in the transposition of global horizontal irradiance to plane-of-array (POA) irradiance arises from inaccurate estimations of surface albedo. The current physics-based model used to produce the National Solar Radiation Database (NSRDB) relies on model estimations of surface albedo from a reanalysis climatalogy produced at relatively coarse spatial resolution compared to that of the NSRDB. As an input to spectral decomposition and transposition models, more accurate surface albedo data from remotely sensed imagery at finer spatial resolutions would improve accuracy in the final product. The National Renewable Energy Laboratory (NREL) developed an improved white-sky (bi-hemispherical reflectance) broadband (0.3-5.0 ..mu..m) surface albedo data set for processing the NSRDB from two existing data sets: a gap-filled albedo product and a daily snow cover product. The Moderate Resolution Imaging Spectroradiometer (MODIS) sensors onboard the Terra and Aqua satellites have provided high-quality measurements of surface albedo at 30 arc-second spatial resolution and 8-day temporal resolution since 2001. The high spatial and temporal resolutions and the temporal coverage of the MODIS sensor will allow for improved modeling of POA irradiance in the NSRDB. However, cloud and snow cover interfere with MODIS observations of ground surface albedo, and thus they require post-processing. The MODIS production team applied a gap-filling methodology to interpolate observations obscured by clouds or ephemeral snow. This approach filled pixels with ephemeral snow cover because the 8-day temporal resolution is too coarse to accurately capture the variability of snow cover and its impact on albedo estimates. However, for this project, accurate representation of daily snow cover change is important in producing the NSRDB. Therefore, NREL also used the Integrated Multisensor Snow and Ice Mapping System data set, which provides daily snow cover observations of the Northern Hemisphere for the temporal extent of the NSRDB (1998-2015). We provide a review of validation studies conducted on these two products and describe the methodology developed by NREL to remap the data products to the NSRDB grid and integrate them into a seamless daily data set.

14 SOLAR ENERGY↗

A Public Data Set of Auto-Generated Geotagged PV Site Equipment, Generated via Deep Learning

In this research, we present a data set over 100 photovoltaic (PV) sites in TX, which have been automatically geotagged via a fully autonomous deep learning (DL) pipeline. Specifically, locations of inverters, tracker/fixed tilt rows, batteries, and substations are labeled algorithmically. To ensure high data quality, all systems have been reviewed manually and any deep learning errors have been corrected. This public data set, as well as the open-sourced pipeline used to generate it, is valuable for site planning, modelling, and insurance purposes. Given time and resources, we hope to extend the data set to additional states/regions in the US.

14 SOLAR ENERGY↗

A compressed marine data set for geomagnetic field modeling

Some 13 million scalar magnetic field data points that have been collected from the world's ocean areas reside in the collection of the National Geophysical Data Center. In order to derive a suitable data set for modeling the geomagnetic field of the earth, each ship track is divided into 220 km segments. The distribution of the reduced data in position, time and local time is discussed. The along-track filtering process described has proved to be an effective method of condensing large numbers of shipborne magnetic data into a manageable and meaningful data set for field modeling. This process also provides the benefits of smoothing short-wavelength crystal anomalies, discarding data recorded during magnetically noisy periods, and assigning reasonable error estimates to be utilized in the least squares modeling.

Langel, R. A.↗

Sensitivity of Regional WRF‐Chem Air Quality and Weather Simulations to Biomass‐Burning Emission Data Sets: A Case Study of the Impact of Canadian Wildfire on the US°

This study focuses on the period from June 26 to 29, 2023, when record‐breaking Canadian wildfires severely impacted air quality in the Midwest United States. Using the Weather Research and Forecasting Model with Chemistry (WRF‐Chem) and four biomass‐burning data sets (Fire Inventory from NCAR version 1, Fire Inventory from NCAR version 2.5, Quick Fire Emissions Data set [QFED], and Regional ABI‐VIIRS Emission), we analyzed aerosol transport from Canada to the US and assessed the model's accuracy in predicting PM 2.5 , O 3 , CO and aerosol weather feedback. Model simulations were compared with ground‐based and remote sensing observations as well as field measurements from the Community Research on Climate and Urban Science (CROCUS) project. Our findings show that the movement of a low‐pressure system from the Great Lakes to the Atlantic, combined with the high‐pressure system over the Atlantic, caused the transport of aerosols from Canadian wildfires to the US. Results show WRF‐Chem significantly underestimated key atmospheric components: aerosol optical depth (AOD) by over 50%, PM 2.5 by 65%–90% and peak O 3 concentrations by 50%–55% across four biomass burning data sets. Additionally, CO and NO 2 concentrations were underpredicted. The substantial underestimation of PM 2.5 led to an overestimation of temperature by up to 3.6 °C primarily due to excessive downward shortwave radiation, which resulted from the underestimation of direct aerosol effects and an increase in sensible heat flux. Among the biomass‐burning data sets, QFED produced the most accurate AOD and PM 2.5 predictions due to improved wildfire emission estimates, leading to a 1.0 to 1.5 °C reduction in temperature overestimation during the daytime. These findings underscore the need for improving wildfire emission estimates for trace gases and aerosols to enhance air quality and weather feedback predictions.

WRF-chem model↗

Moving Large Data Sets Over High-Performance Long Distance Networks

In this project we look at the performance characteristics of three tools used to move large data sets over dedicated long distance networking infrastructure. Although performance studies of wide area networks have been a frequent topic of interest, performance analyses have tended to focus on network latency characteristics and peak throughput using network traffic generators. In this study we instead perform an end-to-end long distance networking analysis that includes reading large data sets from a source file system and committing large data sets to a destination file system. An evaluation of end-to-end data movement is also an evaluation of the system configurations employed and the tools used to move the data. For this paper, we have built several storage platforms and connected them with a high performance long distance network configuration. We use these systems to analyze the capabilities of three data movement tools: BBcp, GridFTP, and XDD. Our studies demonstrate that existing data movement tools do not provide efficient performance levels or exercise the storage devices in their highest performance modes. We describe the device information required to achieve high levels of I/O performance and discuss how this data is applicable in use cases beyond data movement performance.

99 GENERAL AND MISCELLANEOUS↗

Data catalog series for space science and applications flight missions. Volume 1B: Descriptions of data sets from planetary and heliocentric spacecraft and investigations

The main purpose of the data catalog series is to provide descriptive references to data generated by space science flight missions. The data sets described include all of the actual holdings of the Space Science Data Center (NSSDC), all data sets for which direct contact information is available, and some data collections held and serviced by foreign investigators, NASA and other U.S. government agencies. This volume contains narrative descriptions of planetary and heliocentric spacecraft and associated experiments. The following spacecraft series are included: Mariner, Pioneer, Pioneer Venus, Venera, Viking, Voyager, and Helios. Separate indexes to the planetary and interplanetary missions are also provided.

Horowitz, Richard↗

A GROUP FINDING ALGORITHM FOR MULTIDIMENSIONAL DATA SETS

We describe a density-based hierarchical group finding algorithm capable of identifying structures and substructures of any shape and density in multidimensional data sets where each dimension can be a numeric attribute with arbitrary measurement scale. This has applications in a wide variety of fields from finding structures in galaxy redshift surveys, to identifying halos and subhalos in N-body simulations and group finding in Local Group chemodynamical data sets. In general, clustering schemes require an a priori definition of a metric (a non-negative function that gives the distance between two points in a space) and the quality of clustering depends upon this choice. The general practice is to use a constant global metric which is optimal only if the clusters in the data are self-similar. For complex data configurations even the most finely tuned constant global metric turns out to be suboptimal. Moreover, the correct choice of metric also becomes increasingly important as the number of dimensions increase. To address these problems, we present an entropy-based binary space partitioning algorithm which uses a locally adaptive metric for each data point. The metric is employed to calculate the density at each point and a list of its nearest neighbors, and this information is then used to form a hierarchy of groups. Finally, the ratio of maximum to minimum density of points in a group is used to estimate the significance of the groups. Setting a threshold on this significance can effectively screen out groups arising due to Poisson noise and helps organize the groups into meaningful clusters. For a data set of N points, the algorithm requires only O(N) space and O(N(log N){sup 3}) time which makes it ideally suitable for analyzing large data sets. As an example, we apply the algorithm to identify structures in a simulated stellar halo using the full six-dimensional phase space coordinates.

79 ASTRONOMY AND ASTROPHYSICS↗