Search NASA⌕ Search

SEARCH · Search NASA

Results for “data versions”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Exploring versioned distributed arrays for resilience in scientific applications: Global view resilience

Exascale studies project reliability challenges for future HPC systems. We present the Global View Resilience (GVR) system, a library for portable resilience. GVR begins with a subset of the Global Arrays interface, and adds new capabilities to create versions, name versions, and compute on version data. Applications can focus versioning where and when it is most productive, and customize for each application structure independently. This control is portable, and its embedding in application source makes it natural to express and easy to maintain. The ability to name multiple versions and “partially materialize” them efficiently makes ambitious forward-recovery based on “data slices” across versions or data structures both easy to express and efficient. Using several large applications (OpenMC, preconditioned conjugate gradient (PCG) solver, ddcMD, and Chombo), we evaluate the programming effort to add resilience. The required changes are small (< 2% lines of code (LOC)), localized and machine-independent, and perhaps most important, require no software architecture changes. We also measure the overhead of adding GVR versioning and show that overheads < 2% are generally achieved. This overhead suggests that GVR can be implemented in large-scale codes and support portable error recovery with modest investment and runtime impact. Our results are drawn from both IBM BG/Q and Cray XC30 experiments, demonstrating portability. We also present two case studies of flexible error recovery, illustrating how GVR can be used for multi-version rollback recovery, and several different forward-recovery schemes. GVR’s multi-version enables applications to survive latent errors (silent data corruption) with significant detection latency, and forward recovery can make that recovery extremely efficient. Lastly, our results suggest that GVR is scalable, portable, and efficient. GVR interfaces are flexible, supporting a variety of recovery schemes, and altogether GVR embodies a gentle-slope path to tolerate growing error rates in future extreme-scale systems.

97 MATHEMATICS AND COMPUTING↗

The Global Ocean Data Analysis Project version 2 (GLODAPv2) – an internally consistent data product for the world ocean

Version 2 of the Global Ocean Data Analysis Project (GLODAPv2) data product is composed of data from 724 scientific cruises covering the global ocean. It includes data assembled during the previous efforts GLODAPv1.1 (Global Ocean Data Analysis Project version 1.1) in 2004, CARINA (CARbon IN the Atlantic) in 2009/2010, and PACIFICA (PACIFic ocean Interior CArbon) in 2013, as well as data from an additional 168 cruises. Data for 12 core variables (salinity, oxygen, nitrate, silicate, phosphate, dissolved inorganic carbon, total alkalinity, pH, CFC-11, CFC-12, CFC-113, and CCl 4 ) have been subjected to extensive quality control, including systematic evaluation of bias. The data are available in two formats: (i) as submitted but updated to WOCE exchange format and (ii) as a merged and internally consistent data product. In the latter, adjustments have been applied to remove significant biases, respecting occurrences of any known or likely time trends or variations. Adjustments applied by previous efforts were re-evaluated. Hence, GLODAPv2 is not a simple merging of previous products with some new data added but a unique, internally consistent data product. In conclusion, this compiled and adjusted data product is believed to be consistent to better than 0.005 in salinity, 1 % in oxygen, 2 % in nitrate, 2 % in silicate, 2 % in phosphate, 4 µmol kg -1 in dissolved inorganic carbon, 6 µmol kg -1 in total alkalinity, 0.005 in pH, and 5 % for the halogenated transient tracers.

54 ENVIRONMENTAL SCIENCES↗

SoDaH: the SOils DAta Harmonization database, an open-source synthesis of soil data from research networks, version 1.0

Data collected from research networks present opportunities to test theories and develop models about factors responsible for the long-term persistence and vulnerability of soil organic matter (SOM). Synthesizing datasets collected by different research networks presents opportunities to expand the ecological gradients and scientific breadth of information available for inquiry. Synthesizing these data is challenging, especially considering the legacy of soil data that have already been collected and an expansion of new network science initiatives. To facilitate this effort, here we present the SOils DAta Harmonization database (SoDaH; https://lter.github.io/som-website, last access: 22 December 2020), a flexible database designed to harmonize diverse SOM datasets from multiple research networks. SoDaH is built on several network science efforts in the United States, but the tools built for SoDaH aim to provide an open-access resource to facilitate synthesis of soil carbon data. Moreover, SoDaH allows for individual locations to contribute results from experimental manipulations, repeated measurements from long-term studies, and local- to regional-scale gradients across ecosystems or landscapes. Finally, we also provide data visualization and analysis tools that can be used to query and analyze the aggregated database. The SoDaH v1.0 dataset is archived and available at https://doi.org/10.6073/pasta/9733f6b6d2ffd12bf126dc36a763e0b4 (Wieder et al., 2020).

54 ENVIRONMENTAL SCIENCES↗

An open-source data storage and visualization platform for collaborative qubit control

Developing collaborative research platforms for quantum bit control is crucial for driving innovation in the field, as they enable the exchange of ideas, data, and implementation to achieve more impactful outcomes. Furthermore, considering the high costs associated with quantum experimental setups, collaborative environments are vital for maximizing resource utilization efficiently. However, the lack of dedicated data management platforms presents a significant obstacle to progress, highlighting the necessity for essential assistive tools tailored for this purpose. Current qubit control systems are unable to handle complicated management of extensive calibration data and do not support effectively visualizing intricate quantum experiment outcomes. In this paper, we introduce Qubit Control Storage and Visualization ( QubiCSV ), a platform specifically designed to meet the demands of quantum computing research, focusing on the storage and analysis of calibration and characterization data in qubit control systems. As an open-source tool, QubiCSV facilitates efficient data management of quantum computing, providing data versioning capabilities for data storage and allowing researchers and programmers to interact with qubits in real time. The insightful visualization are developed to interpret complex quantum experiments and optimize qubit performance. QubiCSV not only streamlines the handling of qubit control system data but also improves the user experience with intuitive visualization features, making it a valuable asset for researchers in the quantum computing domain.

97 MATHEMATICS AND COMPUTING↗

MODIS Airborne simulator (MAS) Final Report for CLASIC

The MAS was flown aboard the NASA ER-2 for the CLASIC field experiment, and for all data collected, provided calibrated and geolocated (Level-1B) radiance data for it’s 50 spectral bands (ranging in wavelength for 0.47 to 14.3 µm). From the Level-1B data, as directed in the Statement of Work, higher order (Level-2) data products were derived. The Level-2 products include: a) cloud optical thickness, b) cloud effective radius, c) cloud top height (temperature), d) cloud fraction, e) cloud phase products. Preliminary Level-1B and Level-2 products were provided during the field experiment (typically within one or two days of data collection). Final version data products were made available in December 2008 following considerable calibration analysis. Data collection, data processing (to Level-2), and discussion of the calibration work are summarized below.

54 ENVIRONMENTAL SCIENCES↗

MAPSTER: Automated Geospatial Data Sharing – Version 1.4.0

The US Department of Energy’s (DOE) Oak Ridge National Laboratory (ORNL) developed MAPSTER which is a geospatial data management tool that aggregates, organizes, and shares data from dispersed sources such as unmanned aerial systems (UAS). Built specifically for use in environments where communications may be limited, MAPSTER utilizes two key technologies to effectively manage data in the field and enable easy data sharing with authorized partners: Observer and Checkpoint. Observer is a lightweight software package on an edge device, such as a laptop, that automatically detects newly processed UAS data and sends to a central server called Checkpoint. Checkpoint is a centralized server at ORNL that receives and manages data from all Observer instances. Even in a very low bandwidth environment, Observer can still send information about the UAS data product almost instantly as it generates its own metadata package on the size of KB (kilobytes). MAPSTER is not only for UAS data but for any geospatial data collected at the austere edge and dispersed sources.

97 MATHEMATICS AND COMPUTING↗

Physics-Based Constraints in the Forward Modeling Analysis of Time-Correlated Image Data (Long Version)

The forward-model approach has been shown to produce accurate model reconstructions of scientific measurements for single-time image data. Here we extend the approach to a series of images that are correlated in time using the physics-based constraints that are often available with scientific imaging. The constraints are implemented through a representational bias in the model and, owing to the smooth nature of the physics evolution in the specified model, provide an effective temporal regularization. Unlike more general temporal regularization techniques, this restricts the space of solutions to those that are physically realizable. We explore the performance of this approach on a simple radiographic imaging problem of a simulated object evolving in time. We demonstrate that the constrained simultaneous analysis of the image sequence outperforms the independent forward modeling analysis over a range of degrees of freedom in the physics constraints, including when the physics model is under-constrained. Further, this approach outperforms the independent analysis over a large range of signal-to-noise ratios.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

The CMIP6 Data Request (DREQ, version 01.00.31)

The data request of the Coupled Model Intercomparison Project Phase 6 (CMIP6) defines all the quantities from CMIP6 simulations that should be archived. This includes both quantities of general interest needed from most of the CMIP6-endorsed model intercomparison projects (MIPs) and quantities that are more specialized and only of interest to a single endorsed MIP.The complexity of the data request has increased from the early days of model intercomparisons, as has the data volume.In contrast with CMIP5, CMIP6 requires distinct sets of highly tailored variables to be saved from each of the more than 200 experiments.This places new demands on the data request information base and leads to a new requirement for development of software that facilitates automated interrogation of the request and retrieval of its technical specifications.The building blocks and structure of the CMIP6 Data Request (DREQ), which have been constructed to meet these challenges, are described in this paper.

54 ENVIRONMENTAL SCIENCES↗

FTICR-MS Data from Multi-continent River Water and Sediment and from Coastal River Fresh and Saline Sediment Associated with: “Dissolved Organic Matter Functional Trait Relationships are Conserved Across Rivers”

This data package is associated with the publication “Dissolved Organic Matter Functional Trait Relationships are Conserved Across Rivers” submitted to PNAS (Stegen et al., 2023). The study aims to understand large-scale spatial structure of the dissolved organic matter (DOM) thermodynamic traits and inter-trait relationships by investigating (1) river water and sediments collected along 97 rivers spanning 3 continents and (2) coastal sediment collected from fresh and saline locations in Pacific and Gulf/Atlantic rivers. Sediment extracts and water samples were analyzed using ultrahigh resolution Fourier transform ion cyclotron resonance mass spectrometry (FTICR-MS). This dataset is comprised of three folders (1) Coastal, (2) WHONDR_S19S, and (3) Data_Dictionaries. Coastal contains (1) a subfolder with processed FTICR-MS data as csv files and sample collection metadata, (2) a subfolder with R scripts used to process the data and create associated figures, (3) a subfolder with the raw, unprocessed FTICR-MS data as .xml files, and (4) a readme file with more information about the dataset and instructions for using Formularity (https://omics.pnl.gov/software/formularity). WHONDRS_S19S contains (1) a csv file with processed FTICR data, (2) a csv with sample collection metadata, (3) a csv with sample geospatial data, (4) a csv with simulated lambda model outputs, (5) a subfolder with R scripts used to process the data and create associated figures, and (6) a readme file with more information regarding WHONDRS raw FTICR data and processing scripts. Data_Dictionaries contains data dictionaries for each csv file in the data package. The 97 global river corridors were part of a WHONDRS (https://whondrs.pnnl.gov) study. The raw, unprocessed FTICR-MS data with additional data can be found at doi:10.15485/1729719 for sediments and doi:10.15485/1603775 for water. This data package contains the processed data used in the associated manuscript. The coastal data has not been previously published, and this data package contains both the raw and processed data. Version 3 of this data package published February 2023 includes updates to the title of the manuscript, additional data and data dictionary and updated scripts linked to new analysis.

54 ENVIRONMENTAL SCIENCES↗

Small Hydropower Research and Development Technology Project (Final Scientific/Technical Report, Non-Limited Data Rights Version)

The objective of this work was to investigate, develop, and validate the next generation of small hydroturbine generator designs that maximize the energy transfer from flowing water to electrical power generation. What resulted from this effort was the design of a new technology hydroturbine that Near Space Systems (NSS) has named the Star*Stream© Hydroturbine. Using a design that eliminates nearly all of the shortfalls of conventional hydroturbines, the Star*Stream© Hydroturbine employs a new mechanical-to-electrical energy transfer hydro design that operates without lubrication of any kind, and does not introduce foreign chemicals or particulate matter from oil or drive shaft seal degradation into the hydro ecology. In its unique configuration, the Star*Stream© Hydroturbine is nearly environmentally inert, without the negative aspects caused by interrupting the ecological continuity, i.e., disruptions to sedimentation, water quality, habitat changes, human displacement, fish migration, etc., - while it ensures dramatically reduced timeframes to project completion. While a remarkable reduction in LCOE resulting from application of the Star*Stream© Hydroturbine technology has been the core achievement of the this effort, there have been numerous technological breakthroughs from the development effort.

13 HYDRO ENERGY↗

csphothybv3: A hybrid sky radiance scan scenario version 3 data

This hybrid scan starts at the position of the Sun and first follows the great circle that is orthogonal to the Principal Plane until it reaches a viewing zenith angle of 75 degrees and then follows the almucantar keep that viewing zenith angle constant. The scan is then repeated in the opposite azimuth direction. This mode was designed to optimize the range of scattering angles and significantly improves the retrieval of inversion parameters especially at low solar zenith angles.

54 ENVIRONMENTAL SCIENCES↗

Assessing data change in scientific datasets

Summary Scientific datasets are growing rapidly and becoming critical to next‐generation scientific discoveries. The validity of scientific results relies on the quality of data used and data are often subject to change, for example, due to observation additions, quality assessments, or processing software updates. The effects of data change are not well understood and difficult to predict. Datasets are often repeatedly updated and recomputing derived data products quickly becomes time consuming and resource intensive and may in some cases not even be necessary, thus delaying scientific advance. Despite its importance, there is a lack of systematic approaches for best comparing data versions to quantify the changes, and ad‐hoc or manual processes are commonly used. In this article, we propose a novel hierarchical approach for analyzing data changes, including real‐time (online) and offline analyses. We employ a variety of fast‐to‐compute numerical analyses, graphical data change representations, and more resource‐intensive recomputations of a subset of the data product. We illustrate the application of our approach using three scientific diverse use cases, namely, satellite, cosmological, and x‐ray data. The results show that a variety of data change metrics should be employed to enable a comprehensive representation and qualitative evaluation of data changes.

97 MATHEMATICS AND COMPUTING↗

The NJOY Nuclear Data Processing System, Version 2016

The NJOY Nuclear Data Processing System, version 2016, is a comprehensive computer code package for producing pointwise and multigroup cross sections and related quantities from evaluated nuclear data in the ENDF-4 through ENDF-6 legacy card-image formats. NJOY works with evaluated files for incident neutrons, photons, and charged particles, producing libraries for a wide variety of particle transport and reactor analysis codes.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Development of nuclear data processing code FRENDY version 2

Nuclear data processing is an important interface between an evaluated nuclear data library and neutronics calculation codes. JAEA has been developed the new nuclear data processing code FRENDY from 2013. FRENDY version 1 generates the ACE files used for the continuous-energy Monte Carlo codes including PHITS, Solomon, Serpent,and MCNP and it was released as the open-source software under the 2-clause BSD license in 2019.After we released FRENDY version 1, many functions, e.g., the multi-group neutron cross-section library generation, the statistical uncertainty quantification of the probability tables for unresolved resonance cross-section, the 'perturbation' of the ACE file for uncertainty quantification, and the modification of the ENDF-6 formatted nuclear data file, have been developed. We released FRENDY version 2 including these functions. The present paper gives an overview of FRENDY and presents features of new functions implemented in FRENDY version 2. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗