Search NASA⌕ Search

SEARCH · Search NASA

Results for “Coverage Metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Demonstration of Optimal Benchmark Selection Website and Validation of the q c Coverage Metric Using HEU-SOL-THERM-013-003 Experiment

In the work documented in this interim report, the experiment selection toolkit web site was demonstrated and q C coverage metric methodology was validated for IEU-MET-FAST-002-001, MIX-COMP-THERM 004-004, and HEU-SOL-THERM-013-003 experiments. 𝑞 𝐶 is an information-theoretic measure based on mutual information that quantifies the ability of candidate benchmark experiments to reduce the bias and uncertainty of a target criticality safety application. The metric and an accompanying open-source Python toolkit with a web-based interface were tested against a benchmark set of 425 experiments drawn from the International Criticality Safety Benchmark Evaluation Project Handbook. The interface is hosted at https://edim.covdef.com. It accepts sensitivity data files produced by the TSUNAMI-IP module of the SCALE code system and supports both (i) deterministic analysis using the ENDF/B-VII.0 covariance library and (ii) stochastic analysis based on user-supplied keff samples. Demonstrations on representative applications across a range of material composition, spectrum, and form show that q C -guided benchmark selection achieves greater uncertainty reduction with fewer experiments and yields more stable posterior bias and uncertainty estimates than traditional similarity coefficient ( c k )–based selection, while also capturing valuable low-ck experiments that one-to-one metrics overlook.

Abdel-khalik, Hany S. [Indiana Univ.-Purdue Univ. ↗

Exploring Sustainability in Scientific Software through Code Quality & Test Coverage Metrics

Context: Scientific open-source software (SciOSS) plays a foundational role in research and engineering, yet its long-term sustainability has often been overlooked and remains a significant concern. Objective: This study investigates the long-term sustainability of SciOSS through code and test quality metrics. Method: We analyze CASS Software Portfolio projects, classifying them by sustainability and comparing their code structure, test coverage, and links between code quality and testing across the dataset. Results: Sustainable projects show higher, more consistent test coverage and clearer code-test correlations, while unsustainable ones show weaker patterns. Overall, test coverage is low in scientific software, and high complexity and coupling reduce testability. Conclusion: In this study, we present a practical, data-driven approach for assessing sustainability in scientific software, offering a foundation for evaluating long-term software health and supporting future efforts in quality assurance and sustainability monitoring.

Md mushfiqur rahman, Sheikh [University of Tenness↗

Little prairie under the panel: testing native pollinator habitat seed mix establishment at three utility-scale solar sites in Minnesota

Abstract As more land is being utilized for large-scale solar energy projects, there are increasing discussions from stakeholders on how to utilize land under solar panels to promote biodiversity. One path is to plant habitat beneficial to pollinators and other insects, but there have been few long-term studies that examine how different vegetation and seed mixes establish underneath solar panels. This study addresses a scientific gap to determine whether native pollinator seed mixes successfully establish over time under solar arrays using a systematic assessment of eight seed mixes planted at three utility-scale solar sites in Minnesota. We assess establishment with a percent native coverage metric, which is an assessment of native species observations compared to total observations during percent cover analyses in our vegetative test plots. The percent native coverage metric allows for a measurement of how the seed mix established and how the seed mix persists over time. The percent native coverage under and in between the solar photovoltaic (PV) arrays rose from 10% after one year of planting to 58% after three years across all sites, while the native coverage of the full sun control area rose from 9.6% to 70% under the same period, showing that native prairie and pollinator plants successfully established under the array, although to a lesser extent than in full sun conditions. Percent native coverage under the PV arrays rose 5- to 8-fold for each of the three sites from over the course of the study, while the coverage of weeds decreased for all three sites over the same period. Percent native coverage varied by seed mix over the project years, but every seed mix experienced a higher percent native coverage year after year under the PV arrays. Our results did not indicate a difference in establishment across placement within the array; the center, west, and east portions of the areas in between panels had similar establishment rates at two out of three sites, indicating that the same seed mix can be applied throughout the array. Out of 101 plant species seeded, we observed the establishment of 68 species in our vegetative test plots, and we detailed the top 20 observed species to inform future seed mix development. Based on these findings, native pollinator vegetation can establish over time at solar arrays, and it can be suitable for creating habitat at utility-scale solar sites.

14 SOLAR ENERGY↗

Quantification of heterogeneity in human CD8 + T cell responses to vaccine antigens: an HLA-guided perspective

Vaccines have historically played a pivotal role in controlling epidemics. Effective vaccines for viruses causing significant human disease, e.g., Ebola, Lassa fever, or Crimean Congo hemorrhagic fever virus, would be invaluable to public health strategies and counter-measure development missions. Here, we propose coverage metrics to quantify vaccine-induced CD8 + T cell-mediated immune protection, as well as metrics to characterize immuno-dominant epitopes, in light of human genetic heterogeneity and viral evolution. Proof-of-principle of our approach and methods are demonstrated for Ebola virus, SARS-CoV-2, and Burkholderia pseudomallei (vaccine) proteins.

60 APPLIED LIFE SCIENCES↗

Finding gaps in the national electric vehicle charging station coverage of the United States

Abstract The United States federal government has invested $7.5 billion into charging infrastructure, including the National Electric Vehicle Infrastructure Program, to build fast charging stations along designated highways for long-distance car travel. We develop a consecutive coverage metric to compute the percent of United States roads (traffic-weighted) that are consecutively accessible within 500 miles of each county. We answer (1) what the state of consecutive coverage is in each county and (2) what the increase in coverage is when designated highways receive fast chargers. In 2023, 10% of counties had at least 75% minimum viable coverage. We find that if all designated highways receive fast-charging stations, 94% of United States counties will reach at least 75% fast charger coverage. However, the remaining counties are rural. This demonstrates that federal funding for fast chargers will help connect most—but not all—counties to the national network of continuously accessible charging stations.

24 POWER TRANSMISSION AND DISTRIBUTION↗

BinaRena: a dedicated interactive platform for human-guided exploration and binning of metagenomes

Background: Exploring metagenomic contigs and “binning” them into metagenome-assembled genomes (MAGs) are essential for the delineation of functional and evolutionary guilds within microbial communities. Despite the advances in automated binning algorithms, their capabilities in recovering MAGs with accuracy and biological relevance are so far limited. Researchers often find that human involvement is necessary to achieve representative binning results. This manual process however is expertise demanding and labor intensive, and it deserves to be supported by software infrastructure. Results: We present BinaRena, a comprehensive and versatile graphic interface dedicated to aiding human operators to explore metagenome assemblies via customizable visualization and to associate contigs with bins. Contigs are rendered as an interactive scatter plot based on various data types, including sequence metrics, coverage profiles, taxonomic assignments, and functional annotations. Various contig-level operations are permitted, such as selection, masking, highlighting, focusing, and searching. Binning plans can be conveniently edited, inspected, and compared visually or using metrics including silhouette coefficient and adjusted Rand index. Completeness and contamination of user-selected contigs can be calculated in real time. In demonstration of BinaRena’s usability, we show that it facilitated biological pattern discovery, hypothesis generation, and bin refinement in a complex tropical peatland metagenome. It enabled isolation of pathogenic genomes within closely related populations from the gut microbiota of diarrheal human subjects. It significantly improved overall binning quality after curating results of automated binners using a simulated marine dataset. Conclusions: BinaRena is an installation-free, dependency-free, client-end web application that operates directly in any modern web browser, facilitating ease of deployment and accessibility for researchers of all skill levels. The program is hosted at https://github.com/qiyunlab/binarena, together with documentation, tutorials, example data, and a live demo. It effectively supports human researchers in intuitive interpretation and fine tuning of metagenomic data.

59 BASIC BIOLOGICAL SCIENCES↗

Test Points for Online Monitoring of Quantum Circuits

Noisy Intermediate-Scale Quantum (NISQ) computers consisting of tens of inherently noisy quantum bits (qubits) suffer from reliability problems. Qubits and their gates are susceptible to various types of errors. Due to limited numbers of qubits and high error rates, quantum error correction cannot be applied. Physical constraints of quantum hardware including the error rates are used to guide the design and the layout of quantum circuits. The error rates determine the selection of qubits and their operations. The resulting circuit is executed on the quantum computer. This study explores the risk of unexpected changes in the error rates of NISQ computers post-calibration. We show that unexpected changes in error rates can alter the output state of a quantum circuit. To detect these changes, we propose the insertion of test points into the quantum circuit to enable online monitoring of the physical qubit behavior. We utilize classical, superposition, and uncompute test points. Furthermore, we use a gate error coverage metric to assess the quality of the tests. We verify the effectiveness of the proposed scheme on different IBM quantum computers (IBM Q), in addition to a noisy simulation that shows the scalability of the proposed approach.

97 MATHEMATICS AND COMPUTING↗

An entropy-based debiasing approach to quantifying experimental coverage for novel applications of interest in the nuclear community

This manuscript proposes a novel information-theoretic approach to the quantification of experimental relevance, i.e., coverage, to achieve optimal data assimilation results for nuclear engineering applications. Specifically, this work posits the need for a new metric, called coverage (q C ) of an application’s quantity of interest, i.e., eigenvalue or power peaking for an advanced reactor concept, defined herein as the theoretically maximum achievable reduction in the quantity’s uncertainty given measurements from a pool of experiments in a manner that is independent of the data assimilation procedure employed. Currently, reduction in a quantity’s uncertainty is strongly biased by the underlying assumptions of the assimilation procedure to account for the under-determined nature of such problems and the similarity criterion employed to identify relevant experiments. To address this challenge, this work has developed a coverage metric, q C , based on mutual information, which establishes a new conceptual framework for assessing coverage, one that is independent of the model parameters and responses degree of variations in both the experimental and application domains, i.e., linear vs non-linear, and their prior uncertainty distributions, i.e., Gaussian vs. non-Gaussian. The q C is an entropic measure capable of addressing coverage for general nonlinear problems with non-Gaussian uncertainties and inclusive of the measurement uncertainties from multiple experiments. Numerical experiments from manufactured analytical problems as well as a set of benchmarks from the ICSBEP handbook are employed to demonstrate its theoretical and practical performance as compared to the c k -based experiment selection methodology, commonly employed in the neutronic community. The manuscript then employs other well-known adaptations to existing data assimilation methodologies for nonlinear and non-Gaussian problems capable of achieving the coverage posited by q C .

Bayesian data assimilation↗

Selective Dynamical Imaging of Interferometric Data

Recent developments in very long baseline interferometry (VLBI) have made it possible for the Event Horizon Telescope (EHT) to resolve the innermost accretion flows of the largest supermassive black holes on the sky. The sparse nature of the EHT’s (u, v)-coverage presents a challenge when attempting to resolve highly time-variable sources. We demonstrate that the changing (u, v)-coverage of the EHT can contain regions of time over the course of a single observation that facilitate dynamical imaging. These optimal time regions typically have projected baseline distributions that are approximately angularly isotropic and radially homogeneous. We derive a metric of coverage quality based on baseline isotropy and density that is capable of ranking array configurations by their ability to produce accurate dynamical reconstructions. We compare this metric to existing metrics in the literature and investigate their utility by performing dynamical reconstructions on synthetic data from simulated EHT observations of sources with simple orbital variability. We then use these results to make recommendations for imaging the 2017 EHT Sgr A* data set.

79 ASTRONOMY AND ASTROPHYSICS↗

Updates to the Regional Seismic Travel Time (RSTT) Model: 2. Path-dependent Travel-time Uncertainty

Abstract The regional seismic travel time (RSTT) model and software were developed to improve travel-time prediction accuracy by accounting for three-dimensional crust and upper mantle structure. Travel-time uncertainty estimates are used in the process of associating seismic phases to events and to accurately calculate location uncertainty bounds (i.e. event location error ellipses). We improve on the current distance-dependent uncertainty parameterization for RSTT using a random effects model to estimate slowness (inverse velocity) uncertainty as a mean squared error for each model parameter. The random effects model separates the error between observed slowness and model predicted slowness into bias and random components. The path-specific travel-time uncertainty is calculated by integrating these mean squared errors along a seismic-phase ray path. We demonstrate that event location error ellipses computed for a 90% coverage ellipse metric (used by the Comprehensive Nuclear-Test-Ban Treaty Organization International Data Centre (IDC)), and using the path-specific travel-time uncertainty approach, are more representative (median 82.5% ellipse percentage) of true location error than error ellipses computed using distance-dependent travel-time uncertainties (median 70.1%). We also demonstrate measurable improvement in location uncertainties using the RSTT method compared to the current station correction approach used at the IDC (median 74.3% coverage ellipse).

58 GEOSCIENCES↗

Resilience Metrics for Solar Photovoltaics

This workshop presentation proposes the development of solar photovoltaic (PV) system resilience metrics and a methodology and framework for evaluation of PV resilience metrics. PV resilience metrics are needed to establish a consistent basis for reporting, evaluation, and data collection by industry, evaluate performance of PV systems that have been subject to natural hazards, correlating resilience to system attributes, and predicting resilience for any PV system. PV resilience metrics can guide improved system design, standards, and insurance coverage. Establishing consistent metrics can foster data collection on impacts of natural hazards on PV systems.

14 SOLAR ENERGY↗

Outdoor annual algae productivity improvements at the pre-pilot scale through crop rotation and pond operational management strategies

The Development of Integrated Screening, Cultivar Optimization, and Verification Research (DISCOVR) collaborative consortium operated pre-pilot scale outdoor ponds to deliver much-needed multi-year, long-term and consistent, algae cultivation data relevant to understanding the current state of technology in terms of expected seasonal algae biomass productivity. Over the course of four years from 2018 to 2021, twelve identical 4.2 m 2 mini-ponds were run in triplicate sets to test strains and operational strategies demonstrated in small-, indoor photobioreactors, in pursuit of increasing overall algae areal productivity and projected farm yield. Fourteen different cultivars derived from a strain screening pipeline were tested. Through deliberate seasonal crop rotation and improvements in operational strategies, annual biomass productivity increased from 11.6 to 17.6 g m -2 day -1 , a > 50% increase over the 2018 baseline. Both brackish and marine strains were included and four out of the fourteen strains consistently yielded high productivity across multiple years; brackish strains Monoraphidium minutum (26BAM) and Scenedesmus obliquus (UTEX393), and marine strains Tetraselmis striata (LANL1001) and Picochlorum celeri (TG2). These freely available datasets, which represent nearly complete annual daily coverage of cultivation metrics including weather, pond temperature and pH, nutrients, and productivity, are unique in the public domain and seek to fill agronomic and operational knowledge gaps to help in the eventual commercialization of algal biofuels and bioproducts.

09 BIOMASS FUELS↗

Sea ice breakup and freeze-up indicators for users of the Arctic coastal environment

Abstract. The timing of sea ice retreat and advance in Arctic coastal waters varies substantially from year to year. Various activities, ranging from marine transport to the use of sea ice as a platform for industrial activity or winter travel, are affected by variations in the timing of breakup and freeze-up, resulting in a need for indicators to document the regional and temporal variations in coastal areas. The primary objective of this study is to use locally based metrics to construct indicators of breakup and freeze-up in the Arctic and subarctic coastal environment. The indicators developed here are based on daily sea ice concentrations derived from satellite passive-microwave measurements. The “day of year” indicators are designed to optimize value for users while building on past studies characterizing breakup and freeze-up dates in the open pack ice. Relative to indicators for broader adjacent seas, the coastal indicators generally show later breakup at sites known to have landfast ice. The coastal indicators also show earlier freeze-up at some sites in comparison with freeze-up for broader offshore regions, likely tied to earlier freezing of shallow-water regions and areas affected by freshwater input from nearby streams and rivers. A factor analysis performed to synthesize the local indicator variations shows that the local breakup and freeze-up indicators have greater spatial variability than corresponding metrics based on regional ice coverage. However, the trends towards earlier breakup and later freeze-up are unmistakable over the post-1979 period in the synthesized metrics of coastal breakup and freeze-up and the corresponding regional ice coverage. The findings imply that locally defined indicators can serve as key links between pan-Arctic or global indicators such as sea ice extent or volume and local uses of sea ice, with the potential to inform community-scale adaptation and response.

54 ENVIRONMENTAL SCIENCES↗

Two-phase flow numerical analysis of electrode geometry for alkaline water electrolyzers

Hydrogen is a promising component of a future energy-secure and efficient economy, but its competitiveness depends on reducing production costs. One strategy is to operate alkaline water electrolyzers at higher current densities to increase output. However, this intensifies performance losses due to gas bubble accumulation, which blocks transport pathways and deactivates electrochemically active surfaces. Enhancing bubble evacuation through electrode design is therefore essential. Previous studies have explored various approaches — such as modifying surface morphology, applying sonication or pressure modulation, and introducing surfactants — but these efforts have addressed a limited range of conditions due to the complexity of two-phase flow and electrode geometries. Experiments have also largely been focused on either cell level improvements, which lack the information necessary to isolate each contributing factor, or on modified geometries that are not relevant to practical cell operation. From a modeling perspective, conventional Eulerian multiphase models do not track the complex gas–liquid interfacial dynamics and often neglect surface tension and contact angle effects, reducing their predictive accuracy. To provide insights on the effects of different electrode geometries on the performance of alklaine water electrolyzers this work employs an immersed boundary volume-of-fluid method to simulate bubble behavior in 3D porous electrodes. Multiple base electrode geometries, typically used in practice, with varying porosity are evaluated under a constant surface gas generation rate. Simulation data is analyzed to quantify electrode gas coverage, bubble size dynamics and other relevant metrics. Results show that porosity strongly influences bubble accumulation on electrode surfaces, with higher porosity reducing gas coverage, and its not strictly dependent on the electrode geometry. However, the electrode’s base geometry significantly affects gas accumulation at the separator gap, independent of porosity. A foam electrode geometry resulted in the lowest gas coverage of all electrodes with a median volumetric gas coverage of 11%, but at the cost of a 70% reduction in active area compared with the largest surface area electrode, while gyroid electrodes showed the best trade-off between gas coverage, particularly at the separator surface, and electrochemically active area. In conclusion, the results highlight the need for holistic electrode design strategies.

Alkaline↗

High-Resolution South American Wind Resource Data Downscaled with Generative Machine Learning Conditioned on Near-Surface Observations

High-resolution historical wind data was developed for the entirety of South America using the innovative Super-Resolution for Renewable Resource Data (sup3r) machine learning framework. The publicly available Sup3rWind South America dataset represents a significant advancement in wind resource data generation, leveraging generative machine learning conditioned on near-surface observations from the Meteorological Assimilation Data Ingest System (MADIS) to efficiently and accurately downscale coarse reanalysis data from the European Centre for Medium-Range Weather Forecasts (ERA5). This approach produces fine-scale, spatially and temporally coherent wind and meteorological fields hundreds of times more computationally efficient than traditional numerical weather modeling methods, enabling access to high-fidelity wind information across both continental and offshore regions. Sup3rWind South America builds on the earlier Sup3rWind Ukraine dataset through improvements in model architecture and outputs conditioned on near-surface observation inputs. As with the Ukraine data release, this dataset includes wind speed, wind direction, temperature, relative humidity, and pressure at a horizontal resolution of ~2 km, representing a 15x spatial enhancement relative to the 31 km ERA5 grid. Wind speed and direction are provided at 5-minute resolution, a 12x temporal refinement compared to the hourly ERA5 data, while temperature, relative humidity, and pressure remain at hourly resolution. The data covers all years from 2005 to 2024. Before downscaling, ERA5 inputs were bias-corrected using long-term monthly means and a limited number of quality-controlled observations to align large-scale statistics with regional conditions. The resulting dataset is the first publicly available high-resolution timeseries wind record that provides full spatial coverage of South America. Model validation demonstrates strong agreement with observations across several statistical metrics, consistent with other state-of-the-art high-resolution wind resource datasets. The potential applications of Sup3rWind South America span renewable energy resource assessment, energy system modeling, and grid resilience analysis. The 20-year record and high spatial and temporal resolution support accurate estimation of long-term energy yield and the economic feasibility of potential wind development sites. Continuous coverage across both continental and offshore regions enables comprehensive site prospecting within exclusive economic zones. The 2 km, 5-minute resolution data provide the spatial and temporal variability required for power system simulation, operational planning, and regional risk assessments.

17 WIND ENERGY↗

Benchmark Testing on the IBM-Q Network

The goal of this project is to evaluate a proposed set of candidate benchmarks being developed by the Standards and Performance Metrics Technical Advisory Group (TAG) of the Quantum Economic Development Consortium (QED-C), of which LANL is a member. The QED-C Standards and Performance Metrics TAG has developed implementations of several benchmark codes with the hope and expectation that these codes will be helpful to QED-C members interested in investigating various quantum computer platforms. The benchmark set will be run on LANL’s access to the IBM-Q system with the intent to evaluate the set for scalability, correct execution, and coverage of the application space. The goal is for the QED-C Standards and Performance Metrics TAC to be able to produce a coherent, consistent, scalable set of benchmarks that will run on multiple quantum computing platforms and will be available to members of QED-C, including LANL.

97 MATHEMATICS AND COMPUTING↗

Analysis of limited coverage effects on areal density measurements in inertial confinement fusion implosions

Accurate diagnosis of areal density ($\textit{ρR}$) is critical for the inference of performance metrics in inertial confinement fusion implosions. One potential source of error in this diagnosis is the existence of low mode perturbations in the imploding target, which lead to asymmetries in the inference of the $\textit{ρR}$ from different lines of sight. Here, the error accrued as a result of limited coverage of the sphere due to a finite number of detectors is quantified, and the development of a forward scatter measurement from the OMEGA neutron time-of-flight detectors is motivated. In this work, a method by which the 1D-equivalent 4 π-averaged $\langleρR\rangle$ can be reconstructed, if accurate mode information can be diagnosed by other means, is validated.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Developments to the Distributed Holdup Monitoring System in Fiscal Year 2025

Permanently installed holdup monitoring would provide a myriad of benefits to nuclear facilities, ranging among decreased facility burden, increased safety bases, and increased accuracy of relevant material controls and accountancy metrics. However, the cost per detection system must be affordable to provide reliable coverage. For this project, the target unit price per system has been $\$$1,000. Recent work has focused on pushing costs lower through developing a plastic scintillator and silicon photomultiplier (SiPM)–based front end, which are components that are not commercially available in conjunction with each other. Other work has included further system development and use of a low-cost SiPM. Finally, a limited deployment at a processing facility was achieved. Results from this deployment and the development process are discussed in detail.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗