Search NASA⌕ Search

SEARCH · Search NASA

Results for “data set”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Developing Synthetic Distribution Models Using Open-Source Data Sets

The deployment of distributed generation resources at scale with the distribution side of the power system network over the last two decades has spurred a lot of research interest in distribution networks. Given, the sensitive nature of power system data sets, utilities are still reluctant to open-source distribution networks. Although some open-source data sets are available, they may not cover the region of interest. In this paper, we introduce the Synthetic dIstribution Network Generator (SING), new software that allows users to develop synthetic distribution models, using open-source data sets, in any region of interest within the continental US.

data set↗

A reduced version of the NMC DERF 2 data set

The National Meterological Center (NMC) Dynamical Extended Range Forecast (DERF 2) data represents a major computational effort to better ascertain the potential for extended range forecasts and to develop a strategy for performing operational extended range forecasts using dynamical models. A major stumbling block for using this data has been the sheer volume of data that must be processed to perform even simple calculations. The product of the data reduction described is a manageable data set that fits comfortably on five magnetic tapes or on one compact disc. The document outlines the data reduction process of the second phase of DERF data. It contains the description of the fields and the resolution of both the original and final fields. In order to assist the users of this data set, maps of selected fields, using both the original truncation at rhomboidal 30 and the truncation of the final data at triangular 20, are displayed.

Schubert, Siegfried↗

Use cases of lossy compression for floating-point data in scientific data sets

Architectural and technological trends of systems used for scientific computing call for a significant reduction of scientific data sets that are composed mainly of floating-point data. Here, this article surveys and presents experimental results of currently identified use cases of generic lossy compression to address the different limitations of scientific computing systems. The article shows from a collection of experiments run on parallel systems of a leadership facility that lossy data compression not only can reduce the footprint of scientific data sets on storage but also can reduce I/O and checkpoint/restart times, accelerate computation, and even allow significantly larger problems to be run than without lossy compression. In conclusion, these results suggest that lossy compression will become an important technology in many aspects of high performance scientific computing. Because the constraints for each use case are different and often conflicting, this collection of results also indicates the need for more specialization of the compression pipelines.

97 MATHEMATICS AND COMPUTING↗

A unified development of several techniques for the representation of random vectors and data sets

Linear vector space theory is used to develop a general representation of a set of data vectors or random vectors by linear combinations of orthonormal vectors such that the mean squared error of the representation is minimized. The orthonormal vectors are shown to be the eigenvectors of an operator. The general representation is applied to several specific problems involving the use of the Karhunen-Loeve expansion, principal component analysis, and empirical orthogonal functions; and the common properties of these representations are developed.

Bundick, W. T.↗

Device and Method for Gathering Ensemble Data Sets

An ensemble detector uses calibrated noise references to produce ensemble sets of data from which properties of non-stationary processes may be extracted. The ensemble detector comprising: a receiver; a switching device coupled to the receiver, the switching device configured to selectively connect each of a plurality of reference noise signals to the receiver; and a gain modulation circuit coupled to the receiver and configured to vary a gain of the receiver based on a forcing signal; whereby the switching device selectively connects each of the plurality of reference noise signals to the receiver to produce an output signal derived from the plurality of reference noise signals and the forcing signal.

Racette, Paul E.↗

Cluster Analysis-Based Approaches for Geospatiotemporal Data Mining of Massive Data Sets for Identification of Forest Threats

We investigate methods for geospatiotemporal data mining of multi-year land surface phenology data (250 m2 Normalized Difference Vegetation Index (NDVI) values derived from the Moderate Resolution Imaging Spectrometer (MODIS) in this study) for the conterminous United States (CONUS) as part of an early warning system for detecting threats to forest ecosystems. The approaches explored here are based on k-means cluster analysis of this massive data set, which provides a basis for defining the bounds of the expected or normal phenological patterns that indicate healthy vegetation at a given geographic location. We briefly describe the computational approaches we have used to make cluster analysis of such massive data sets feasible, describe approaches we have explored for distinguishing between normal and abnormal phenology, and present some examples in which we have applied these approaches to identify various forest disturbances in the CONUS.

54 ENVIRONMENTAL SCIENCES↗

Arctic and Antarctic Sea Ice Concentrations from Multichannel Passive-Microwave Satellite Data Sets: October 1978-September 1995 User's Guide

Satellite multichannel passive-microwave sensors have provided global radiance measurements with which to map, monitor, and study the Arctic and Antarctic polar sea ice covers. The data span over 18 years (as of April 1997), starting with the launch of the Scanning Multichannel Microwave Radiometer (SMMR) on NASA's SeaSat A and Nimbus 7 in 1978 and continuing with the Defense Meteorological Satellite Program (DMSP) Special Sensor Microwave/Imager (SSMI) series beginning in 1987. It is anticipated that the DMSP SSMI series will continue into the 21st century. The SSMI series will be augmented by new, improved sensors to be flown on Japanese and U.S. space platforms. This User's Guide provides a description of a new sea ice concentration data set generated from observations made by three of these multichannel sensors. The data set includes gridded daily ice concentrations (every-other-day for the SMMR data) for both the north and south polar regions from October 26, 1978 through September 30, 1995, with the one exception of a 6-week data gap from December 3, 1987 through January 12, 1988. The data have been placed on two CD-ROMs that include a ReadMeCD file giving the technical details on the file format, file headers, north and south polar grids, ancillary data sets, and directory structure of the CD-ROM. The CD-ROMS will be distributed by the National Snow and Ice Data Center in Boulder, CO.

Sea ice concentration↗

Carbonate clumped isotope analysis (Δ 47 ) of 21 carbonate standards determined via gas‐source isotope‐ratio mass spectrometry on four instrumental configurations using carbonate‐based standardization and multiyear data sets

Rationale Clumped isotope geochemistry examines the pairing or clumping of heavy isotopes in molecules and provides information about the thermodynamic and kinetic controls on their formation. The first clumped isotope measurements of carbonate minerals were first published 15 years ago, and since then, interlaboratory offsets have been observed, and laboratory and community practices for measurement, data analysis, and instrumentation have evolved. Here we briefly review historical and recent developments for measurements, share Tripati Lab practices for four different instrument configurations, test a recently published proposal for carbonate‐based standardization on multiple instruments using multi‐year data sets, and report values for 21 different carbonate standards that allow for recalculations of previously published data sets. Methods We examine data from 4628 standard measurements on Thermo MAT 253 and Nu Perspective IS mass spectrometers, using a common acid bath (90°C) and small‐sample (70°C) individual reaction vessels. Each configuration was investigated by treating some standards as anchors (working standards) and the remainder as unknowns (consistency standards). Results We show that different acid digestion systems and mass spectrometer models yield indistinguishable results when instrument drift is well characterized. For linearity correction, mixed gas‐and‐carbonate standardization or carbonate‐only standardization yields similar results. No difference is observed in the use of three or eight working standards for the construction of transfer functions. Conclusions We show that all configurations yield similar results if instrument drift is robustly characterized and validate a recent proposal for carbonate‐based standardization using large multiyear data sets. Δ 47 values are reported for 21 carbonate standards on both the absolute reference frame (ARF; also refered to as the Carbon Dioxide Equilibrated Scale or CDES) and the new InterCarb‐Carbon Dioxide Equilibrium Scale (I‐CDES) reference frame, facilitating intercomparison of data from a diversity of labs and instrument configurations and restandardization of a broad range of sample sets between 2006, when the first carbonate measurements were published, and the present.

58 GEOSCIENCES↗

CFD Data Sets on the WWW for Education and Testing

The Numerical Aerodynamic Simulation (NAS) Systems Division at NASA Ames Research Center has begun the development of a Computational Fluid Dynamics (CFD) data set archive on the World Wide Web (WWW) at URL http://www.nas.nasa.gov/NAS/DataSets/. Data sets are integrated with related information such as research papers, metadata, visualizations, etc. In this paper, four classes of users are identified and discussed: students, visualization developers, CFD practitioners, and management. Bandwidth and security issues are briefly reviewed and the status of the archive as of May 1995 is examined. Routine network distribution of data sets is likely to have profound implications for the conduct of science. The exact nature of these changes is subject to speculation, but the ability for anyone to examine the data, in addition to the investigator's analysis, may well play an important role in the future.

Globus, Al↗

Atmosphere, Ocean, Land, and Solar Irradiance Data Sets

The report present the atmosphere, ocean color, land and solar irradiation data sets. The data presented: total ozone, aerosol, cloud optical and physical parameters, temperature and humidity profiles, radiances, rain fall, drop size distribution.

Johnson, James↗

iVirus: facilitating new insights in viral ecology with software and community data sets imbedded in a cyberinfrastructure

Microbes affect nutrient and energy transformations throughout the world’s ecosystems, yet they do so under viral constraints. In complex communities, viral metagenome (virome) sequencing is transforming our ability to quantify viral diversity and impacts. Although some bottlenecks, for example, few reference genomes and nonquantitative viromics, have been overcome, the void of centralized data sets and specialized tools now prevents viromics from being broadly applied to answer fundamental ecological questions. Here we present iVirus, a community resource that leverages the CyVerse cyberinfrastructure to provide access to viromic tools and data sets. The iVirus Data Commons contains both raw and processed data from 1866 samples and 73 projects derived from global ocean expeditions, as well as existing and legacy public repositories. Through the CyVerse Discovery Environment, users can interrogate these data sets using existing analytical tools (software applications known as ‘Apps’) for assembly, open reading frame prediction and annotation, as well as several new Apps specifically developed for analyzing viromes. Because Apps are web based and powered by CyVerse supercomputing resources, they enable scalable analyses for a broad user base. Finally, a use-case scenario documents how to apply these advances toward new data. This growing iVirus resource should help researchers utilize viromics as yet another tool to elucidate viral roles in nature.

59 BASIC BIOLOGICAL SCIENCES↗

A strategy for compression and analysis of massive geophysical data sets

This paper describes a method for summaraizing data in a way that approximately preserves high-resolution data structure while reducing data volume and maintaining global integrity of very large, remote sensing data sets. The method is under development for one of Terra's instruments, the Multi-angle Imaging SpectroRadiometer (MISR).

geophysical data sets compression↗

Two Types of Transpolar Arc Development, Event Studies with Data Set of ASTRID-2, DMSP, FAST, and SuperDARN

Aurorae which appear in the polar cap are called transpolar arcs, polar cap arcs, sun-aligned arcs, or occasionally Theta-aurora because of its spatial distribution resembling Greek character 'Theta.' Morphology, IMF (Interplanetary Magnetic Field) relationship, and ionospheric convection patterns were studied in quest of mechanisms of transpolar arcs. Four events were analyzed: 1999/Jan/22/19:00 - 23/01:30 (1 event: a) 1999/Jan/24/06:00 - 10:00 (1 event: b) 1999/Feb/1 1/20:00 - 12/02:00 (2 events: c, d), with data set of ExB drift velocity data obtained by electric field measurements of ASTRID-2 and FAST, DMSP ion driftmeter data, and line-of-sight velocity data of SuperDARN. POLAR-UVI image data were used for spatial and temporal variations of transpolar arcs and ACE data set were used for investigation of IMF relationship. IMF-Bz was strongly positive (Bz from +8nT to +20 nT) during periods of all four transpolar arcs. In events (a),(b),(c), transpolar arcs appeared immediately after the direction of IMF turned northward, though IMF was fluctuating in event (b). A sudden increase of IMF-By, from +3nT to +18nT, was observed in event (d). Two different types of transpolar arc development were observed in POLAR-UVI: one which begins as a split from dawn or dusk sector of auroral oval and shifts poleward in event (a),(c),(d), and another which is initially a patch of auroral oval disturbed by substorm but develops as a transpolar arc, forming a growing finger-like shape from midnight sector (event b). Sunward flow, associated with positive IMF-Bz, were observed within newly-created polar caps in event (a),(c),(d). Not clear ionospheric convection pattern was seen across the polar cap arc in event (b) die to limitation of data set. In event (c), O+ with energy more than 1 keV were observed by FAST within a transpolar arc, suggesting that their origin be from plasma sheet. Transpolar arcs are thought to be projection of plasma sheet bifurcation into lobe regime. There can be several ways of development of transpolar arcs and two different patterns were observed through this work.

Narita, Yasuhito↗

Curated Modeled Fault Data Set

The curated fault model simulation data set consists of tagged and fully-described time series representing simulated faults for the AFDD test building (ORNLs Flexible Research Platform (FRP)), including baseline performance, faulty performance, and corresponding energy impact. A total of 26 fault models are considered for 99 simulation scenarios with various fault intensity levels. Additional Contacts: Principal investigator: Matt Leach Matt.Leach@nrel.gov Simulation performer: Janghyun Kim Janghyun.Kim@nrel.gov

AFDD↗

Atlas of wide-field-of-view outgoing longwave radiation derived from Nimbus 7 Earth radiation budget data set, November 1985 to October 1987

An atlas of monthly outgoing longwave radiation global contour maps and associated spherical harmonic coefficients is presented. The atlas contains 23 months of data from November 1985 to October 1987 . The data were derived from the second Earth Radiation Budget (ERB) package, which was flown on the Nimbus 7 Sun-synchronous satellite in 1987. This data set is a companion set and extension to similar atlases that documented 10 years of outgoing longwave radiation results from Nimbus 6 and Nimbus 7 satellites. This atlas and the companion atlases give a data set covering a 12-year time period and will be very useful in studying different aspects of our changing climate. The data set also provides a 3-year overlap with the current Earth Radiation Budget Experiment (ERBE).

Bess, T. Dale↗

Estimating Uncertainties in the SBUV Version 8.6 Merged Profile Ozone Data Set

The combined record of total and profile ozone measurements from the solar backscatter ultraviolet (SBUV) and SBUV/2 series of instruments, known as the SBUV Merged Ozone Data (MOD) product, constitutes the longest satellite-based ozone time series from a single instrument type and as such plays a key role in ozone trend analyses. Following the approach documented in Frith et al. (2014) to analyze the merging uncertainties in the MOD total ozone record, we use Monte Carlo simulations to estimate the potential for uncertainties in the calibration and drift of individual instruments in the profile ozone merged data set. We focus our discussion on the trends and associated merging uncertainty since 2001 in an effort to verify the start of ozone recovery as predicted by chemistry climate models. We find that merging uncertainty dominates the overall estimated uncertainty when considering only the 15 years of data since 2001. We derive trends versus pressure level for the MOD data set that are positive in the upper stratosphere as expected for ozone recovery. These trends appear to be significant when only statistical uncertainties are included but become not significant at the 2o level when instrument uncertainties are accounted for. However, when we use the entire data set from 1979 through 2015 and fit to the EESC (equivalent effective stratospheric chlorine) we find statistically significant fits throughout the upper stratosphere at all latitudes. This implies that the ozone profile data remain consistent with our expectation that chlorine is the dominant ozone forcing term.

Ozone profile↗

Open data sets for assessing photovoltaic system reliability

Photovoltaic (PV) systems have become a cornerstone of renewable energy strategies, particularly due to the significant reduction in solar power costs over the past decade. However, the long-term reliability of PV installations presents a persistent challenge, requiring the development of advanced monitoring and predictive maintenance strategies. A wide range of data types is used to evaluate the health of PV systems, including environmental conditions, electrical performance, and inspection imagery. These data enable methodologies such as machine learning (ML) models for lifetime prediction and computer vision techniques for defect detection. However, the acquisition of high-quality and comprehensive data is difficult, particularly in terms of long-term consistency and data variety. Publicly available data sets serve as valuable resources for addressing these challenges, but they often suffer from fragmentation and are difficult to access. This paper presents a comprehensive review of existing open-source data sets related to PV degradation, analyzing their features, functionalities, and potential applications. We categorize these data sets based on the specific aspects of PV system information they cover, such as environmental conditions, operational monitoring, image inspection and module materials, and propose relevant tools and ML models for processing them. In addition, we propose practices for future data collection and usage, while also discussing potential directions in data-driven research. Our aim is to enhance data utilization and publication among researchers and industry professionals, promoting a deeper understanding of the role of data in enhancing the performance and durability of PV systems.

14 SOLAR ENERGY↗

Updates in Developing a Prototype Science Pipeline and Full-Volume, Global Hyperspectral Synthetic Data Sets for NASA’s Earth System Observatory’s Upcoming Surface, Biology and Geology Mission

The Surface Biology and Geology (SBG) mission recently passed mission confirmation review and has entered phase A – design and development. SBG will acquire high resolution solar-reflected spectroscopy and thermal infrared observations at a data rate of ~2.5 TB/day and generate products at ~40 TB/day. Given that the per-day volume is greater than NASA’s total extant airborne hyperspectral data collection, collecting, processing, disseminating, and exploiting the SBG data present new challenges. To meet these challenges, we have developed a prototype science pipeline and a full-volume global hyperspectral synthetic data set to help prepare for SBG’s flight (see poster GC42D-0730). Our science pipeline is based on the science processing technology developed for NASA’s Kepler and TESS planet-hunting missions. The pipeline infrastructure, Ziggy, provides a scalable architecture for robust, repeatable, and replicable science and application products that can be run on a range of systems from a laptop to the cloud or a supercomputer. Ziggy is compliant with NASA Procedural Requirement (NPR) 7150.2C, is at a technical readiness level (TRL) of 7 and has been released to github.com/nasa/ziggy. We integrated Ziggy with EO-1/Hyperion workflows to build a prototype pipeline and ingested the 17-year mission archive that provides globally sampled visible through shortwave infrared spectra that are representative of SBG data types and volumes. We fully implemented the first stage and processed the entire 55 TB Hyperion data set from the raw data (Level 0) to top-of-the-atmosphere radiance (Level 1R). We are currently evaluating the ISOFIT atmospheric correction module to convert the L1R data to surface reflectance (Level 2) before reprocessing the full data set to L2. Crosschecks are being performed with RadCalNet as well as with coincident observations by AVIRIS. We are also investigating modern methods for georectifying the Hyperion scenes. Finally, we describe an analysis of the cost to conduct forward processing and reprocessing campaigns for SBG on HECC with dedicated compute and storage resources using the resurrected Hyperion pipeline as a proxy for full-volume SBG data. The analysis demonstrates that SBG L0 data can be processed to L2 on HECC with full reprocessing campaigns every two years for ~$2.6M over a 7-year lifespan. Moreover, 69% of the system capacity would be available for other activities, possibly enabling future open-source science activities, including algorithm development, L3+ processing, .etc.

ESD↗