Search NASA⌕ Search

SEARCH · Search NASA

Results for “data usability”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Usable Data Abstractions for Next-Generation Scientific Workflows

Data- and computationally-intensive scientific research, such as numerical simulations and inversions or the training of large neural networks in machine learning applications, that are well suited for HPC environments also often require expert insight and evaluation throughout the computation which can be greatly facilitated with the use of interactive computing tools, such as those in the Jupyter ecosystem. HPC workflows and interactive workflows are typically treated as orthogonal, however, the next generation of research will require both. The first challenge we face in this project is thus designing the right level of abstractions to allow interactive capabilities in the JupyterLab environment to allow the working scientist to flexibly explore and query their data at multiple levels, with a minimal amount of customization required of the underlying optimized codes. In addition to these questions regarding the high-level representation of data for interactive use in HPC, we tackled two additional issues that are part of the entire lifecycle of research and that become particularly acute in HPC contexts: how to improve the experience of interfacing with the HPC system's scheduling environment for a scientist focused on exploratory questions, and how can that scientist then best share the results of their work with others in a self-contained, reproducible manner.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Researcher Views on Water Data Accessibility, Usability, and Dissemination

Ultimately, the challenges that researchers face with finding, accessing, using, and disseminating water data affect their ability to do mission critical research for DOE and other sponsors. We interviewed PNNL researchers who support DOE’s Water Power Technologies Office and summarize their views on issues pertaining to data access, use, and dissemination. We also take a closer look at approaches to disseminating data to help inform WPTO and lab researcher decisions about incorporating data dissemination into future projects.

13 HYDRO ENERGY↗
DOE OSTI2023

Optimizing metaproteomics database construction: lessons from a study of the vaginal microbiome

Metaproteomics, a method for untargeted, high-throughput identification of proteins in complex samples, provides functional information about microbial communities and can tie functions to specific taxa. Metaproteomics often generates less data than other omics techniques, but analytical workflows can be improved to increase usable data in metaproteomic outputs. Identification of peptides in the metaproteomic analysis is performed by comparing mass spectra of sample peptides to a reference database of protein sequences. Although these protein databases are an integral part of the metaproteomic analysis, few studies have explored how database composition impacts peptide identification. Here, we used cervicovaginal lavage (CVL) samples from a study of bacterial vaginosis (BV) to compare the performance of databases built using six different strategies. We evaluated broad versus sample-matched databases, as well as databases populated with proteins translated from metagenomic sequencing of the same samples versus sequences from public repositories. Smaller sample-matched databases performed significantly better, driven by the statistical constraints on large databases. Additionally, large databases attributed up to 34% of significant bacterial hits to taxa absent from the sample, as determined orthogonally by 16S rRNA gene sequencing. We also tested a set of hybrid databases which included bacterial proteins from NCBI RefSeq and translated bacterial genes from the samples. These hybrid databases had the best overall performance, identifying 1,068 unique human and 1,418 unique bacterial proteins, ~30% more than a database populated with proteins from typical vaginal bacteria and fungi. Our findings can help guide the optimal identification of proteins while maintaining statistical power for reaching biological conclusions.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Battery data integrity and usability: Navigating datasets and equipment limitations for efficient and accurate research into battery aging

A tremendous commitment of resources is needed to acquire, understand and apply battery data in terms of performance and aging behavior. There are many state of performance (SOP) and state of health (SOH) metrics that are useful to guide alignment of batteries to end-use, yet how these metrics are measured or extracted can make the difference between usable, valuable datasets versus data that lacks the necessary integrity to meet baseline confidence levels for SOP/SOH quantification. This work will speak to 1) types of data that support SOP and SOH evaluations on mechanistic terms, 2) measurement conditions needed to assure high data integrity, 3) equipment limitations that can compromise data high fidelity, and 4) the impact of cell polarization on data quality. A common goal in battery research and field use is to work from a data platform that supports economical paths of data capture while minimizing down-time for battery diagnostics. An ideal situation would be to utilize data obtained during normal daily use (“pulses or cycles of convenience”) without stopping the daily duty cycles to perform dedicated SOP/SOH diagnostic routines. However, difficulties arise in trying to make use of daily duty cycle data (denoted as cycle-by-cycle, CBC) that underscores the need for standardization of conditions: temperature and duty cycles can vary over the course of a day and throughout a week, month and year; polarization can develop within an immediate cycle and throughout successive cycles as a hysteresis. If CBC data is envisioned as a data source to determine performance and aging trends, it should be recognized that polarization is a frequent consequence of CBC and thus makes it difficult to separate reversible and irreversible components to metrics such as capacity loss and resistance increase over aging. Since CBC conditions can have a major impact on data usability, we will devote part of this paper to CBC data conditioning and management. Differential analyses will also be discussed as a means to detect changing trends in data quality. Our target cell chemistries will be lithium-ion types NMC/graphite and LMO/LTO.

25 ENERGY STORAGE↗
DOE OSTI2022

Guidelines for Publicly Archiving Terrestrial Model Data to Enhance Usability, Intercomparison, and Synthesis

Scientific communities are increasingly publishing data to evaluate, accredit, and build on published research. However, guidelines for curating data for publication are sparse for model-related research, limiting the usability of archived simulation data. In particular, there are no established guidelines for archiving data related to terrestrial models that simulate land processes and their coupled interactions with climate. Terrestrial modelers have a unique set of challenges when publishing data due to the diversity of scientific domains, research questions, and the types and scales of simulations. Researchers in the U.S. Department of Energy’s (DOE) projects use a variety of multiscale models to advance robust predictions of terrestrial and subsurface ecosystem processes. Here, we synthesize archiving needs for data associated with different DOE models, and provide guidelines for publishing terrestrial model data components following FAIR (Findable, Accessible, Interoperable, Reusable) principles. The guidelines recommend archiving model inputs and testing data used in final simulation runs along with associated codes, workflow scripts, and metadata in public repositories. Researchers should consider archiving model outputs if they are within the storage limits of the repository. We also provide considerations for how to bundle files into different data publications with citable digital object identifiers. Finally, we identify repository features and tools that would enable storage and reuse of model data. Given the diversity of DOE terrestrial models, these guidelines are transferable to other model types and will enable efficient reuse of simulation data for purposes such as model intercomparisons, initialization, benchmarking, synthesis, and comparisons with field observations.

58 GEOSCIENCES↗
DOE OSTI2021

Investigating User Experiences with Data Abstractions on High Performance Computing Systems

Scientific exploration generates expanding volumes of data that commonly require High Performance Computing (HPC) systems to facilitate research. HPC systems are complex ecosystems of hardware and software that frequently are not user friendly. The Usable Data Abstractions (UDA) project set out to build usable software for scientific workflows in HPC environments by undertaking multiple rounds of qualitative user research. Qualitative research investigates how individuals accomplish their work and our interview-based study surfaced a variety of insights about the experiences of working in and with HPC ecosystems. This report examines multiple facets to the experiences of scientists and developers using and supporting HPC systems. We discuss how stakeholders grasp the design and configuration of these systems, the impacts of abstraction layers on their ability to successfully do work, and the varied perceptions of time that shape this work. Examining the adoption of the Cori HPC at NERSC we explore the anticipations and lived experiences of users interacting with this system’s novel storage feature, the Burst Buffer. We present lessons learned from across these insights to illustrate just some of the challenges HPC facilities and their stakeholders need to account for when procuring and supporting these essential scientific resources to ensure their usability and utility to a variety of scientific practices.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

ARM Aerosol Measurement Science Group 2019 Strategic Planning Workshop Report

This report summarizes the results of a U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility workshop held in November 2019 to advance a science-based strategy for ARM’s aerosol measurement program. This was the second such workshop since the Aerosol Measurement Science Group (AMSG) was chartered in 2015 to enhance coordination of ARM observations of aerosols and atmospheric trace gases with the needs of ARM users. The results presented here reflect the AMSG’s focus in recent years on science-based strategies that will contribute to the increased use of ARM data to fulfill its mission of improving process representations and predictability in climate models. Sessions held during the workshop range from interfacing with models through aerosol sampling strategies to calibration protocols and data products. The strategies set forth here were also developed to be directly relevant to ARM’s updated Decadal Vision. The AMSG workshops have been designed to recommend actions that will enable ARM to evolve and continue to meet its mission. To that end, the AMSG will develop an actionable plan from the recommendations outlined here. Some are well defined and can reasonably be accomplished in the short term. Others are less definite or of a larger scope that calls for a longer-term implementation. Further discussion will be required to develop and prioritize actionable items related to such areas. Task teams comprising the appropriate expertise and perspective from the AMSG and other members of the community will be formed to achieve this outcome. Some particular topics are recognized as high priority, so plans are underway to develop task teams and to hold follow-on discussions to address them. Four areas currently being considered for short, focused discussion are 1) aerosol measurements on the North Slope of Alaska, 2) improving data usability for modeling, 3) strategies for advancing remote sensing, vertical profiling, and distributed measurements of aerosols, and 4) aerosol sampling strategies at existing ARM sites to provide intensive modes of operation to promote data usage for process and modeling studies.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

ARM Aerosol Measurement Science Group 2019 Strategic Planning Workshop Report

This report summarizes the results of a U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility workshop held in November 2019 to advance a science-based strategy for ARM’s aerosol measurement program. This was the second such workshop since the Aerosol Measurement Science Group (AMSG) was chartered in 2015 to enhance coordination of ARM observations of aerosols and atmospheric trace gases with the needs of ARM users. The results presented here reflect the AMSG’s focus in recent years on science-based strategies that will contribute to the increased use of ARM data to fulfill its mission of improving process representations and predictability in climate models. Sessions held during the workshop range from interfacing with models through aerosol sampling strategies to calibration protocols and data products. The AMSG workshops have been designed to recommend actions that will enable ARM to evolve and continue to meet its mission. To that end, the AMSG will develop an actionable plan from the recommendations outlined here. Some are well defined and can reasonably be accomplished in the short term. Others are less definite or of a larger scope that calls for a longer-term implementation. Further discussion will be required to develop and prioritize actionable items related to such areas. Task teams comprising the appropriate expertise and perspective from the AMSG and other members of the community will be formed to achieve this outcome. Some particular topics are recognized as high priority, so plans are underway to develop task teams and to hold follow-on discussions to address them. Four areas currently being considered for short, focused discussion are 1) aerosol measurements on the North Slope of Alaska, 2) improving data usability for modeling, 3) strategies for advancing remote sensing, vertical profiling, and distributed measurements of aerosols, and 4) aerosol sampling strategies at existing ARM sites to provide intensive modes of operation to promote data usage for process and modeling studies.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

A Survey of Open-Source Tools for Transmission and Distribution Systems Research

This work presents a review of open-source electric power transmission and distribution systems analysis tools suitable for use by industry professionals and academic researchers. Due to the high complexity of the electric grid, there exist numerous tools and extensive research pertaining to nearly every aspect of the design, operation, and control of transmission and distribution networks. In addition to the commercial tools, a wide range of free, open-source tools, models, and data usable by the scientific community for related research have been developed by different organizations, including both international and US universities and national laboratories. However, due to the absence of a catalog of available tools, models and data, researchers often lack a knowledge of existing capabilities and may develop duplicative software and tools. Increasing awareness of these available resources seeks to accelerate their broader use, leading to more efficient and standardized grid analysis. This review paper (which is part of a larger survey effort that studied over 400 tools in the transmission, distribution, buildings, and electric vehicles space) outlines selected open-source resources that have been developed in power transmission and distribution systems research. It is anticipated that this work can serve as a guide for industry and academic researchers alike, ensuring that research efforts are well-channeled.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

AlgoSCR: an algorithm for solar contamination removal from radio interferometric data

Hydrogen intensity mapping is a new field in astronomy that promises to make three-dimensional maps of the matter distribution of the Universe using the redshifted 21cm line of neutral hydrogen gas (HI). Several ongoing and upcoming radio interferometers, such as Tianlai, CHIME, HERA, HIRAX, etc., are using this technique. These instruments are designed to map large swaths of the sky by drift scanning over periods of many months. One of the challenges of the observations is that the daytime data are contaminated by strong radio signals from the Sun. In the case of Tianlai, this results in almost half of the measured data being unusable. We try to address this issue by developing an algorithm for solar contamination removal (AlgoSCR) from the radio data. The algorithm is based on an eigenvalue analysis of the visibility matrix and hence is applicable only to interferometers. We apply AlgoSCR to simulated visibilities, as well as real daytime data from the Tianlai dish array. The algorithm can reduce strong solar contamination by about 95 per cent without seriously affecting other weaker sky signals and thus makes the data usable for certain applications.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

SALT3-NIR: Taking the Open-source Type Ia Supernova Model to Longer Wavelengths for Next-generation Cosmological Measurements

Abstract A large fraction of Type Ia supernova (SN Ia) observations over the next decade will be in the near-infrared (NIR), at wavelengths beyond the reach of the current standard light-curve model for SN Ia cosmology, SALT3 (∼2800–8700 Å central filter wavelength). To harness this new SN Ia sample and reduce future light-curve standardization systematic uncertainties, we train SALT3 at NIR wavelengths (SALT3-NIR) up to 2 μ m with the open-source model-training software SALTshaker , which can easily accommodate future observations. Using simulated data, we show that the training process constrains the NIR model to ∼2%–3% across the phase range (−20 to 50 days). We find that Hubble residual (HR) scatter is smaller using the NIR alone or optical+NIR compared to optical alone, by up to ∼30% depending on filter choice (95% confidence). There is significant correlation between NIR light-curve stretch measurements and luminosity, with stretch and color corrections often improving HR scatter by up to ∼20%. For SN Ia observations expected from the Roman Space Telescope, SALT3-NIR increases the amount of usable data in the SALT framework by ∼20% at redshift z ≲ 0.4 and by ∼50% at z ≲ 0.15. The SALT3-NIR model is part of the open-source SNCosmo and SNANA SN Ia cosmology packages.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Genome Extraction from Shotgun Metagenome Sequence Data

Uncultivated Bacteria and Archaea comprise the vast majority of species on Earth, but obtaining their genomes directly from the environment, using shotgun sequencing, has only recently become possible. To realize the hope of capturing Earth’s microbial genetic complement, technologies that accelerate recovery of high-quality genomes are necessary. We present a series of analysis steps and data products for the extraction of high quality metagenome-assembled genomes (MAGs) from microbiomes using the U.S. Department of Energy Systems Biology Knowledgebase (KBase) platform (http://www.kbase.us/). In KBase, the process is end-to-end, allowing a user to go from the initial sequencing reads all the way through to MAG genomes, which can then be analyzed with other KBase capabilities such as phylogenetic placement, functional assignment, metabolic modeling, pangenome functional profiling, RNA-Seq, and others. While portions of such capabilities are individually available from other resources, the combination of the intuitive usability, data interoperability, and integration of tools in a freely available compute resource makes KBase a uniquely powerful platform for obtaining MAGs from microbiomes. While this workflow offers tools for each of the key steps in the genome extraction process, it also provides a scaffold that can be easily extended, with additional MAG recovery and analysis tools, via the KBase SDK (Software Development Kit).

Chivian, Dylan↗
DOE OSTI2021

Moab Desert Crust - Sample 4E

Uncultivated Bacteria and Archaea comprise the vast majority of species on Earth, but obtaining their genomes directly from the environment, using shotgun sequencing, has only recently become possible. To realize the hope of capturing Earth’s microbial genetic complement, technologies that accelerate recovery of high-quality genomes are necessary. We present a series of analysis steps and data products for the extraction of high quality metagenome-assembled genomes (MAGs) from microbiomes using the U.S. Department of Energy Systems Biology Knowledgebase (KBase) platform (http://www.kbase.us/). In KBase, the process is end-to-end, allowing a user to go from the initial sequencing reads all the way through to MAG genomes, which can then be analyzed with other KBase capabilities such as phylogenetic placement, functional assignment, metabolic modeling, pangenome functional profiling, RNA-Seq, and others. While portions of such capabilities are individually available from other resources, the combination of the intuitive usability, data interoperability, and integration of tools in a freely available compute resource makes KBase a uniquely powerful platform for obtaining MAGs from microbiomes. While this workflow offers tools for each of the key steps in the genome extraction process, it also provides a scaffold that can be easily extended, with additional MAG recovery and analysis tools, via the KBase SDK (Software Development Kit).

Chivian, Dylan↗
DOE OSTI2022

Metagenome-assembled genome extraction and analysis from microbiomes using KBase

Uncultivated Bacteria and Archaea account for the vast majority of species on Earth, but obtaining their genomes directly from the environment, using shotgun sequencing, has only become possible recently. In order to realize the hope of capturing Earth’s microbial genetic complement and to facilitate the investigation of the functional roles of specific lineages in a given ecosystem, technologies that accelerate the recovery of high-quality genomes are necessary. We present a series of analysis steps and data products for the extraction of high-quality metagenome-assembled genomes (MAGs) from microbiomes using the U.S. Department of Energy Systems Biology Knowledgebase (KBase) platform (http://www.kbase.us/). Overall, these steps take about a day to obtain extracted genomes when starting from smaller environmental shotgun read libraries, or up to about a week from larger libraries. In KBase, the process is end-to-end, allowing a user to go from the initial sequencing reads all the way through to MAGs, which can then be analyzed with other KBase capabilities such as phylogenetic placement, functional assignment, metabolic modeling, pangenome functional profiling, RNA-Seq and others. While portions of such capabilities are available individually from other resources, the combination of the intuitive usability, data interoperability and integration of tools in a freely available computational resource makes KBase a powerful platform for obtaining MAGs from microbiomes. While this workflow offers tools for each of the key steps in the genome extraction process, it also provides a scaffold that can be easily extended with additional MAG recovery and analysis tools, via the KBase software development kit (SDK).

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Dry in-pile fracture test (DRIFT) for separate-effects validation of ceramic fuel fracture models

Fracture is an important component of nuclear fuel behavior, and significant efforts have been invested into developing fuel performance models that are capable of accurately representing fracture. Usable data on the process of fracture propagation in nuclear fuel under realistic service conditions are very limited. To address this need, a series of separate-effects experiments were developed and performed at Idaho National Laboratory's Transient Reactor Test (TREAT) facility. These experiments employ a heat sink to radially remove heat from the fuel in a manner that approximates the effect of coolant in an operating light-water reactor (LWR). The test holder for these experiments is known as the Dry In-pile Fracture Test (DRIFT). A series of experiments employing DRIFT and TREAT were performed to provide data on the extent and nature of fracture in fresh fuel at various points during a ramp to full power. Novel aspects of these experiments include the way they employ a heat sink to replicate steady-state LWR conditions, as well as the use of fiber optic sensors for in-reactor thermal instrumentation. Details on the development of this experiment, experimental conditions, and resulting data (including in situ thermal measurements and post-irradiation imaging of fracture) are provided in this work. LWR-equivalent powers ranging from 10 to 25 kW/m were tested using this apparatus. Cracking was visible at all power levels, with increasing cracking extent as the power level increased, although there was little difference in the cracking between the two highest-power tests, which had LWR-equivalent powers of 20 and 25 kW/m.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

Bragg Spot Finder (BSF): a new machine-learning-aided approach to deal with spot finding for rapidly filtering diffraction pattern images

Macromolecular crystallography contributes significantly to understanding diseases and, more importantly, how to treat them by providing atomic resolution 3D structures of proteins. This is achieved by collecting X-ray diffraction images of protein crystals from important biological pathways. Spotfinders are used to detect the presence of crystals with usable data, and the spots from such crystals are the primary data used to solve the relevant structures. Having fast and accurate spot finding is essential, but recent advances in synchrotron beamlines used to generate X-ray diffraction images have brought us to the limits of what the best existing spotfinders can do. This bottleneck must be removed so spotfinder software can keep pace with the X-ray beamline hardware improvements and be able to see the weak or diffuse spots required to solve the most challenging problems encountered when working with diffraction images. In this paper, we first present Bragg Spot Detection (BSD), a large benchmark Bragg spot image dataset that contains 304 images with more than 66 000 spots. We then discuss the open source extensible U-Net-based spotfinder Bragg Spot Finder (BSF), with image pre-processing, a U-Net segmentation backbone, and post-processing that includes artifact removal and watershed segmentation. Finally, we perform experiments on the BSD benchmark and obtain results that are (in terms of accuracy) comparable to or better than those obtained with two popular spotfinder software packages ( Dozor and DIALS ), demonstrating that this is an appropriate framework to support future extensions and improvements.

36 MATERIALS SCIENCE↗
DOE OSTI2021

FEST: Facility Energy Saving and Securing Technology Using Multi-Source Data: (Milestone 2 Report)

This project aims to demonstrate three technologies developed in-house at LLNL and University of Michigan-Dearborn (UMD), at a military site, including i) Grid Data Crossing (called GriD-Xing) for increasing smart meter data usability, ii) Facility Energy Optimization (called Facility E-GO) for improving facility energy efficiency in both operation and planning perspectives, and iii) Co-simulation tool (called Co-Sim) for enhancing smart meter and energy facility networks resilience and security. In this report, Millstone 2 - Integration A: Integrate GriD-Xing and facility optimization tools is documented.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

On a Simplified Approach to Achieve Parallel Performance and Portability Across CPU and GPU Architectures

This paper presents software advances to easily exploit computer architectures consisting of a multi-core CPU and CPU+GPU to accelerate diverse types of high-performance computing (HPC) applications using a single code implementation. The paper describes and demonstrates the performance of the open-source C++ matrix and array (MATAR) library that uniquely offers: (1) a straightforward syntax for programming productivity, (2) usable data structures for data-oriented programming (DOP) for performance, and (3) a simple interface to the open-source C++ Kokkos library for portability and memory management across CPUs and GPUs. The portability across architectures with a single code implementation is achieved by automatically switching between diverse fine-grained parallelism backends (e.g., CUDA, HIP, OpenMP, pthreads, etc.) at compile time. The MATAR library solves many longstanding challenges associated with easily writing software that can run in parallel on any computer architecture. This work benefits projects seeking to write new C++ codes while also addressing the challenges of quickly making existing Fortran codes performant and portable over modern computer architectures with minimal syntactical changes from Fortran to C++. We demonstrate the feasibility of readily writing new C++ codes and modernizing existing codes with MATAR to be performant, parallel, and portable across diverse computer architectures.

97 MATHEMATICS AND COMPUTING↗