Search NASA⌕ Search

SEARCH · Search NASA

Results for “Coverage Metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

The Inspectability Metric: A Formalized System Of Measurement Enabling The Design For Inspection Framework

Nondestructive evaluation (NDE) engineers are often confronted with structural design choices that present challenges to meeting inspection requirements. These challenges, at best, increase the resources needed to design an inspection solution and, at worst, require resource intensive redesign of the structure. If the inspectability of the structure can be determined early in the design cycle, these challenging inspection scenarios can be avoided. The emergence of additive manufacturing has further compounded this problem by enabling the creation of highly optimized structures with no regard to inspection constraints. Design for inspection (DFI) offers a framework to integrate nondestructive evaluation (NDE) into the design process to alleviate the mechanisms that produce uninspectable designs. DFI is the concept of including inspectability in a multi-objective optimization framework so that it can be considered in parallel to other metrics such as mass and manufacturability. This allows rapid evaluation of the trade-off between design metrics to find solutions that meet the inspection needs of a particular material system, structural concept, or vehicle program. To enable DFI, there must be a system by which the inspectability of a structure can be measured. This system must be agile to produce results quickly, it must be versatile to work with the type of incomplete information one would encounter early in the design process (such as lack of inspection requirements), and it must be delivered in a form that is easily understood by designers. To meet this need, this presentation introduces the novel inspectability metric as a system to measure inspectability. The inspectability metric is a standardized, automation friendly procedure that uses simulations to determine inspectability. Along with guidelines to properly process designs and integrate with existing workflows, the inspectability metric provides a suite of simulation tests to interrogate the ability to find defects and the sensitivity to variability. The testing rubric is designed to maximize the coverage of the parameter space while minimizing the number of simulations needed. The inspectability metric has been in development in collaboration with industry partners to ensure compatibility with modern simulation tools and aerospace design workflows. In this study, we will demonstrate how the inspectability metric is able to determine the inspectability of multiple types of structures, including aerospace composites and additively manufactured parts. We will then show how the inspectability score can be plugged into existing design optimization tasks, such as structural sizing algorithms or design for manufacturing (DFM) frameworks.

Design for inspection↗

Development and Initial Validation of HFBP-EM Short-Form Surveys

The Human Factors and Behavioral Performance Exploration Measures (HFBP-EM) suite includes self-report surveys designed to assess Behavioral Medicine (BMed) and Team risks for future exploration class missions. Survey data was collected during the Human Exploration Research Analog (HERA) Campaign 4 (C4), HERA Campaign 5 (C5), and during SIRIUS19 missions in the Russian Ground Based Experiment Complex, NEK. Crew time in spaceflight analogs and in spaceflight is typically limited. Extensive self-report surveys can be a significant burden to participants and are not operationally acceptable for spaceflight. The purpose of this project was to comprehensively assess the reliability and validity of the standard-length HFBP-EM surveys, identify acceptable short forms to administer during HERA C6, examine initial validation evidence for the proposed short form measures, and identify key measurement gaps in HFBP-EM coverage. In this presentation, we will report reliability and validity metrics of standard form data, describe the proposed new short forms, and present initial psychometric analyses supporting the use of these short forms.

S T Bell↗

The Utility of Auroral Image-based Activities Metrics

Auroral activity indices such as Hemispheric Power and Auroral Boundary are currently key data products used for space weather predictions and nowcasting. However, these products are necessarily based on limited observations which must be extrapolated to provide global coverage. The advent of routine space-based auroral imaging in the last decade offers the seeming advantage of more detailed measures of auroral activity. Examples of image-derived products include energy deposition maps, oval location, cap size, and morphological classification. However, activity metrics derived from auroral images have shortcomings, as well. For example, limited fields-of-view and orbital motion prevent full coverage of the auroral regions. This paper will examine the utility of activity metrics derived h m auroral images for operational purposes. The eight-year collection of Polar UVI images databased in the UVI Online Search Tool (OST) will be used to illustrate the advantages and shortcomings of auroral activity metrics. The potential role of other currently-active imaging missions will also be examined and correlative studies to date using auroral imaging will be summarized.

Germany, G.↗

High-Resolution South American Wind Resource Data Downscaled with Generative Machine Learning Conditioned on Near-Surface Observations

High-resolution historical wind data was developed for the entirety of South America using the innovative Super-Resolution for Renewable Resource Data (sup3r) machine learning framework. The publicly available Sup3rWind South America dataset represents a significant advancement in wind resource data generation, leveraging generative machine learning conditioned on near-surface observations from the Meteorological Assimilation Data Ingest System (MADIS) to efficiently and accurately downscale coarse reanalysis data from the European Centre for Medium-Range Weather Forecasts (ERA5). This approach produces fine-scale, spatially and temporally coherent wind and meteorological fields hundreds of times more computationally efficient than traditional numerical weather modeling methods, enabling access to high-fidelity wind information across both continental and offshore regions. Sup3rWind South America builds on the earlier Sup3rWind Ukraine dataset through improvements in model architecture and outputs conditioned on near-surface observation inputs. As with the Ukraine data release, this dataset includes wind speed, wind direction, temperature, relative humidity, and pressure at a horizontal resolution of ~2 km, representing a 15x spatial enhancement relative to the 31 km ERA5 grid. Wind speed and direction are provided at 5-minute resolution, a 12x temporal refinement compared to the hourly ERA5 data, while temperature, relative humidity, and pressure remain at hourly resolution. The data covers all years from 2005 to 2024. Before downscaling, ERA5 inputs were bias-corrected using long-term monthly means and a limited number of quality-controlled observations to align large-scale statistics with regional conditions. The resulting dataset is the first publicly available high-resolution timeseries wind record that provides full spatial coverage of South America. Model validation demonstrates strong agreement with observations across several statistical metrics, consistent with other state-of-the-art high-resolution wind resource datasets. The potential applications of Sup3rWind South America span renewable energy resource assessment, energy system modeling, and grid resilience analysis. The 20-year record and high spatial and temporal resolution support accurate estimation of long-term energy yield and the economic feasibility of potential wind development sites. Continuous coverage across both continental and offshore regions enables comprehensive site prospecting within exclusive economic zones. The 2 km, 5-minute resolution data provide the spatial and temporal variability required for power system simulation, operational planning, and regional risk assessments.

17 WIND ENERGY↗

Spatial Coverage Planning and Optimization for Planetary Exploration

We are developing onboard planning and scheduling technology to enable in situ robotic explorers, such as rovers and aerobots, to more effectively assist scientists in planetary exploration. In our current work, we are focusing on situations in which the robot is exploring large geographical features such as craters, channels or regional boundaries. In to develop valid and high quality plans, the robot must take into account a range of scientific and engineering constraints and preferences. We have developed a system that incorporates multiobjective optimization and planning allowing the robot to generate high quality mission operations plans that respect resource limitations and mission constraints while attempting to maximize science and engineering objectives. An important scientific objective for the exploration of geological features is selecting observations that spatially cover an area of interest. We have developed a metric to enable an in situ explorer to reason about and track the spatial coverage quality of a plan. We describe this technique and show how it is combined in the overall multiobjective optimization and planning algorithm.

autonomy↗

Benchmark Testing on the IBM-Q Network

The goal of this project is to evaluate a proposed set of candidate benchmarks being developed by the Standards and Performance Metrics Technical Advisory Group (TAG) of the Quantum Economic Development Consortium (QED-C), of which LANL is a member. The QED-C Standards and Performance Metrics TAG has developed implementations of several benchmark codes with the hope and expectation that these codes will be helpful to QED-C members interested in investigating various quantum computer platforms. The benchmark set will be run on LANL’s access to the IBM-Q system with the intent to evaluate the set for scalability, correct execution, and coverage of the application space. The goal is for the QED-C Standards and Performance Metrics TAC to be able to produce a coherent, consistent, scalable set of benchmarks that will run on multiple quantum computing platforms and will be available to members of QED-C, including LANL.

97 MATHEMATICS AND COMPUTING↗

Analysis of limited coverage effects on areal density measurements in inertial confinement fusion implosions

Accurate diagnosis of areal density ($\textit{ρR}$) is critical for the inference of performance metrics in inertial confinement fusion implosions. One potential source of error in this diagnosis is the existence of low mode perturbations in the imploding target, which lead to asymmetries in the inference of the $\textit{ρR}$ from different lines of sight. Here, the error accrued as a result of limited coverage of the sphere due to a finite number of detectors is quantified, and the development of a forward scatter measurement from the OMEGA neutron time-of-flight detectors is motivated. In this work, a method by which the 1D-equivalent 4 π-averaged $\langleρR\rangle$ can be reconstructed, if accurate mode information can be diagnosed by other means, is validated.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Developments to the Distributed Holdup Monitoring System in Fiscal Year 2025

Permanently installed holdup monitoring would provide a myriad of benefits to nuclear facilities, ranging among decreased facility burden, increased safety bases, and increased accuracy of relevant material controls and accountancy metrics. However, the cost per detection system must be affordable to provide reliable coverage. For this project, the target unit price per system has been $\$$1,000. Recent work has focused on pushing costs lower through developing a plastic scintillator and silicon photomultiplier (SiPM)–based front end, which are components that are not commercially available in conjunction with each other. Other work has included further system development and use of a low-cost SiPM. Finally, a limited deployment at a processing facility was achieved. Results from this deployment and the development process are discussed in detail.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Structural aspects of Imbrium sculpture, part G

Apollo 16 metric photographs taken at low to high sun angles provided the first stereographic coverage of the distinctive landforms collectively referred to as Imbrium sculpture. The sculpture consists of a series of nearly linear ridges and troughs extending radially outward for more than 1000 km from the rim of the Imbrium Basin. The origin of the ridges and troughs, whether by deposition and impact scoring by fluidized clouds of ejecta from the Imbrium Basin or by faulting and volcanism during and subsequent to basin formation, is controversial. Evidence indicative of the mode of origin of Imbrium sculpture is summarized as follows. Evidence of volcano-tectonic mode of origin is favored by: (1) wide variation in relative age of parts of the sculpture; (2) furrows without rims; (3) absence of ballistic shielding; (4) asymmetry of sculpture; (5) absence of randomly oriented clusters; and (6) association with other features of structural origin. An origin by ejecta scoring and deposition is favored by the gradational ejecta with a Fra Mauro-type texture. Features that are ambiguous as to mode or origin are furrows made of coalesced crater chains and prominent rims on furrows.

Scott, D. H.↗

Investigation of Non-Equilibrium Radiation for Earth Entry

This paper presents measurements and simulations of non-equilibrium shock layer radiation relevant to high-speed Earth entry data obtained in the NASA Ames Research Center's Electric Arc Shock Tube (EAST) facility. The experiments were aimed at measuring the spatially and spectrally resolved radiance at relevant entry conditions for both an approximate Earth atmosphere (79 N2 : 21 O2) as well as a more accurate composition featuring the trace species Ar and CO2 (78.08 N2 : 20.95 O2 : 0.04 CO2 : 0.93 Ar). The experiments were configured to target a wide range of conditions, of which shots from 8 to 11.5 km/s at 0.2 Torr (26.7 Pa) are examined in this paper. The non-equilibrium component was chosen to be the focus of this study as it can account for a significant percentage of the emitted radiation for Earth entry, and more importantly, non-equilibrium has traditionally been assigned a large uncertainty for vehicle design. The main goals of this study are to present the shock tube data in the form of a non-equilibrium metric, evaluate the level of agreement between the experiment and simulations, identify key discrepancies and to promote discussion about various aspects of modeling non-equilibrium radiating flows. Radiance profiles integrated over discreet wavelength regions, ranging from the VUV through to the NIR, were compared in order to maximize both the spectral coverage and the number of experiments that could be used in the analysis. A previously defined non-equilibrium metric has been used to allow comparisons with several shots and reveal trends in the data. Overall, LAURAHARA is shown to under-predict EAST by as much as 50 and over-predict by as much as 20 depending on the shock speed. DPLRNEQAIR is shown to under-predict EAST by as much as 40 and over-predict by as much as 12 depending on the shock speed. In terms of an upper bound estimate for the absolute error in wall-directed heat flux, at the lower speeds investigated in this paper, 8 to 9 km/s, even though there are some large relative differences, the absolute error in radiance will be less then 1 Wcm2. At the highest shock speed of 11 km/s, the error will be less than 20 W/ sq cm.

Radiation↗

Software stewardship and advancement of a high-performance computing scientific application: QMCPACK

Here, we provide an overview of the software engineering efforts and their impact in QMCPACK, a production-level ab-initio Quantum Monte Carlo open-source code targeting high-performance computing (HPC) systems. Aspects included are: (i) strategic expansion of continuous integration (CI) targeting CPUs, using GitHub Actions own runners, and NVIDIA and AMD GPUs used in pre-exascale systems, (ii) incremental reduction of memory leaks using sanitizers, (iii) incorporation of Docker containers for CI and reproducibility, and (iv) refactoring efforts to improve maintainability, testing coverage, and memory lifetime management. We quantify the value of these improvements by providing metrics to illustrate the shift towards a predictive, rather than reactive, maintenance approach. Our goal, in documenting the impact of these efforts on QMCPACK, is to contribute to the body of knowledge on the importance of research software engineering (RSE) for the stewardship and advancement of community HPC codes to enable scientific discovery at scale.

97 MATHEMATICS AND COMPUTING↗

Reference-free structural variant detection in microbiomes via long-read co-assembly graphs

Motivation: The study of bacterial genome dynamics is vital for understanding the mechanisms underlying microbial adaptation, growth, and their impact on host phenotype. Structural variants (SVs), genomic alterations of 50 base pairs or more, play a pivotal role in driving evolutionary processes and maintaining genomic heterogeneity within bacterial populations. While SV detection in isolate genomes is relatively straightforward, metagenomes present broader challenges due to the absence of clear reference genomes and the presence of mixed strains. In response, our proposed method rhea, forgoes reference genomes and metagenome-assembled genomes (MAGs) by encompassing all metagenomic samples in a series (time or other metric) into a single co-assembly graph. The log fold change in graph coverage between successive samples is then calculated to call SVs that are thriving or declining. Results: We show rhea to outperform existing methods for SV and horizontal gene transfer (HGT) detection in two simulated mock metagenomes, particularly as the simulated reads diverge from reference genomes and an increase in strain diversity is incorporated. We additionally demonstrate use cases for rhea on series metagenomic data of environmental and fermented food microbiomes to detect specific sequence alterations between successive time and temperature samples, suggesting host advantage. Our approach leverages previous work in assembly graph structural and coverage patterns to provide versatility in studying SVs across diverse and poorly characterized microbial communities for more comprehensive insights into microbial gene flux.

59 BASIC BIOLOGICAL SCIENCES↗

Collected software engineering papers, volume 3

Topics addressed include: software technology evaluation programs; collection of valid software engineering data; test processes using structural coverage; prototype expert system for software engineering management; use of an environment characteristic software metric set; software modulation; software development by analysis of change; and independent verification and validation.

Source record↗

Software engineering to sustain a high-performance computing scientific application: QMCPACK

We provide an overview of the software engineering efforts and their impact in QMCPACK, a production-level ab-initio Quantum MonteCarlo open-source code targeting high-performance computing (HPC) systems. Aspects included are: (i) strategic expansion ofcontinuous integration (CI) targeting CPU, using GitHub Actions runners, and graphics processing units (GPU) in pre-exascalesystems, using self-hosted hardware; (ii) incremental reduction of memory leaks using sanitizers, (iii) incorporation of Dockercontainers for CI and reproducibility, and (iv) refactoring efforts to improve maintainability, testing coverage, and memory lifetime management. We quantify the value of these improvements by providing metrics to illustrate the shift towards a predictive, rather than reactive, sustainable maintenance approach. Our goal, in documenting the impact of these efforts on QMCPACK, is to contribute to the body of knowledge on the importance of research software engineering (RSE) for the sustainability of community HPC codes and scientific discovery at scale.

Godoy, William↗

Design for Inspection: A Formalized Approach to Evaluating the Inspectability of Aerospace Structures Early in the Design Process

NDE engineers are often confronted with structural design choices that present challenges to meeting inspection requirements. These challenges at best increase the resources needed to design an inspection solution and, at worst, require resource intensive redesign of the structure. If the inspectability of structure can be determined early in the design cycle, these challenging inspection scenarios can be avoided. Therefore, there exists a need for a resource friendly formalized approach to gauge the inspectability of a structure. This paper proposes the use of a novel inspectability metric to meet this need. The inspectability metric is a standardized, automation friendly procedure that uses simulations to determine inspectability. It provides a suite of simulation tests to interrogate the ability to find defects and the sensitivity to variability. The testing rubric is designed to maximize the coverage of the parameter space while minimizing the number of simulations needed. In this preliminary study, we will demonstrate how the inspectability metric is able to determine the inspectability of a structure as a function of changes in the structure’s design.

Peter Juarez↗

Investigation of Non-Equilibrium Radiation for Earth Entry

For Earth re-entry at velocities between 8 and 11.5 km/s, the accuracy of NASA's computational uid dynamic and radiative simulations of non-equilibrium shock layer radiation is assessed through comparisons with measurements. These measurements were obtained in the NASA Ames Research Center's Electric Arc Shock Tube (EAST) facility. The experiments were aimed at measuring the spatially and spectrally resolved radiance at relevant entry conditions for both an approximate Earth atmosphere (79% N2 : 21% O2 by mole) as well as a more accurate composition featuring the trace species Ar and CO2 (78.08% N2 : 20.95% O2 : 0.04% CO2 : 0.93% Ar by mole). The experiments were configured to target a wide range of conditions, of which shots from 8 to 11.5 km/s at 0.2 Torr (26.7 Pa) are examined in this paper. The non-equilibrium component was chosen to be the focus of this study as it can account for a significant percentage of the emitted radiation for Earth re-entry, and more importantly, non-equilibrium has traditionally been assigned a large uncertainty for vehicle design. The main goals of this study are to present the shock tube data in the form of a non-equilibrium metric, evaluate the level of agreement between the experiment and simulations, identify key discrepancies and to examine critical aspects of modeling non-equilibrium radiating flows. Radiance pro les integrated over discreet wavelength regions, ranging from the Vacuum Ultra Violet (VUV) through to the Near Infra-Red (NIR), were compared in order to maximize both the spectral coverage and the number of experiments that could be used in the analysis. A previously defined non-equilibrium metric has been used to allow comparisons with several shots and reveal trends in the data. Overall, LAURA/HARA is shown to under-predict EAST by as much as 40% and over-predict by as much as 12% depending on the shock speed. DPLR/NEQAIR is shown to under-predict EAST by as much as 50% and over-predict by as much as 20% depending on the shock speed. The one standard deviation scatter in the EAST results was calculated to be 31%. An estimate for the upper bound of the absolute error in wall-directed heat flux was calculated. Below 9 km/s, where the relative difference is large, the absolute error in radiative heat flux due to non-equilibrium models is estimated to be less then 1 W/sq cm. At the highest shock speed of 11 km/s, the error in non-equilibrium is estimated to be less than 20 W/sq cm.

Shock Tube↗

Flux Seasonality Metrics Database: A companion dataset for FLUXNET annual product

This dataset include standardized phenological transition dates, and derived season lengths of active, dormant and transition seasons of ecosystem carbon and energy fluxes, as reported in FLUXNET. Such metrics are unique in that they characterize the seasonal dynamics of these fluxes in their own terms rather than in reference to traditional phenology indicators that mostly relate to vegetation structural characteristics. The Flux Seasonality Metrics Database (FSMD) generated 17 standardized seasonality metrics for 4 different fluxes including gross primary productivity (GPP), ecosystem respiration (RE), latent heat (LE) and sensible heat (H) reported in FLUXNET2015 Dataset for about 200 sites and 1500 site-years of data globally. Each metric is reported as an estimate and a confidence interval, which is a function of data coverage and flux variability. We anticipate that the FSMD will facilitate new model validation exercises, and stimulate new research in global change and Earth science disciplines where land-atmosphere exchange dynamics play a central role.

54 ENVIRONMENTAL SCIENCES↗

The Impacts of Microphysics and Planetary Boundary Layer Physics on Model Simulations of U. S. Deep South Summer Convection

Inspection of output from various configurations of high-resolution, explicit convection forecast models such as the Weather Research and Forecasting (WRF) model indicates significant sensitivity to the choices of model physics parameterizations employed. Some of the largest apparent sensitivities are related to the specifications of the cloud microphysics and planetary boundary layer physics packages. In addition, these sensitivities appear to be especially pronounced for the weakly-sheared, multicell modes of deep convection characteristic of the Deep South of the United States during the boreal summer. Possible ocean-land sensitivities also argue for further examination of the impacts of using unique ocean-land surface initialization datasets provided by the NASA Short-term Prediction Research and Transition (SPoRT Center to select NOAA/NWS weather forecast offices. To obtain better quantitative understanding of these sensitivities and also to determine the utility of the ocean-land initialization data, we have executed matrices of regional WRF forecasts for selected convective events near Mobile, AL (MOB), and Houston, TX (HGX). The matrices consist of identically initialized WRF 24-h forecasts using any of eight microphysics choices and any of three planetary boundary layer choices. The resulting 24 simulations performed for each event within either the MOB or HGX regions are then compared to identify the sensitivities of various convective storm metrics to the physics choices. Particular emphasis is placed on sensitivities of precipitation timing, intensity, and coverage, as well as amount and coverage of lightning activity diagnosed from storm kinematics and graupel in the mixed phase layer. The results confirm impressions gleaned from study of the behavior of variously configured WRF runs contained in the ensembles produced each spring at the Center for the Analysis and Prediction of Storms, but with the benefit of more straightforward control of the physics package choices. The design of the experiments thus allows for more direct interpretation of the sensitivities to each possible physics combination. The results should assist forecasters in their efforts to anticipate and correct for possible biases in simulated WRF convection patterns, and help the modeling community refine their model parameterizations.

McCaul, E. W., Jr.↗