Search NASA⌕ Search

SEARCH · Search NASA

Results for “protocol validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Anion exchange membrane test protocol validation

This study presents the validation of protocols for measuring ion exchange capacity (IEC) and alkaline stability of anion exchange membranes (AEMs) for low-temperature water electrolysis. While protocols are often tested within individual laboratories, their results across multiple laboratories with varying equipment, environmental conditions, and personnel qualification remain unverified. The validation involved Los Alamos National Laboratory (LANL), National Renewable Energy Laboratory (NREL), and University of Oregon (UO) using the same commercially available AEM to assess reproducibility and reliability of the protocols under diverse conditions. For the IEC protocol, results across laboratories were consistent within ±10% of the NMR-determined reference value. The alkaline stability protocol could pose greater challenges due to factors such as variations in sample collection timing, preservation methods, and analytical techniques, but consistent test results for percentage IEC loss were demonstrated across institutions. These results highlight the reliability and applicability of the protocols, emphasizing the importance of validation to ensure consistency in diverse research environments.

08 HYDROGEN↗
DOE OSTI2026

Collaborative Approach to Identify Degradation Mechanisms and Validate Aging Protocols for a Diverse Set of DAC Materials (TCF Base Technology-Specific Final Report)

This work supports the mission of the U.S. Department of Energy to promote American energy leadership, technological innovation, and economic growth through the development of technologies for cost effective carbon capture. While capture technologies can provide carbon dioxide for enhanced oil recovery, many capture materials suffer from oxidative, hydrolytic and/or thermal degradation which leads to capacity loss and unwanted emissions such as ammonia. Short lifetimes increase operational costs and cost studies suffer from uncertainty because the true lifetimes of many capture materials are unknown. In this study, a suite of capture materials were studied to quantify their degradation, provide insight into the mechanisms that lead to their uptake loss and provide validated accelerated aging protocols for industry.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Atomistic Simulation of Glasses and Amorphous Materials: Challenges and Opportunities for the Next Decade

Atomistic simulations have become indispensable tools for understanding glass structure, dynamics, and properties, yet persistent challenges limit their predictive power. This perspective examines three interconnected issues, namely glass formation procedures, interatomic potential development, and machine learning applications, which emerged from the 5th International Workshop on Challenges of Atomistic Simulations of Glasses and Amorphous Materials. We identify convergent community priorities for (i) standardized validation protocols, (ii) curated benchmark datasets with complete metadata, and (iii) open repositories for glasses. A systematic was forward is provided by a hierarchical validation framework for assessing the structural fidelity, property prediction, and behavioral realism of simulation techniques. Looking ahead, transformative advances are promised by the fusion of classical techniques with machine learning based approaches, for instance, by integrating swap Monte Carlo with machine-learning (ML) potentials, leveraging foundation models through transfer learning, and finetuning ML potentials with experimental data. Progress depends on the community committing to validated models, reproducible protocols, and sustained data sharing.

Krishnan, N. M. Anoop↗
DOE OSTI2026

A systematic analytical framework for multi-source municipal solid waste characterization for energy recovery

Advancing municipal solid waste (MSW) management from disposal-oriented practices toward circular, value-driven systems requires standardized methodologies capable of identifying material composition and resource recoverable potential at the point of generation. Despite extensive research, MSW characterization remains fragmented due to inconsistences in sampling methodologies, waste sorting categories, and temporal coverage across previous studies which limit cross-site comparability, reproducibility, and constrain the reliable evaluation of potential resource recovery pathways. This lack of consistency has hindered the development of a unified framework for MSW characterization and resource assessment. This study introduces a standardized, field-validated protocol for MSW sampling and composition analysis that ensures consistent, traceable data across diverse waste sources. The protocol integrates randomized spatial sampling, systematic material sorting, and controlled subsampling for multi-site and multi-season field campaigns. Validation included MSW collection from residential, grocery, restaurant, and school MSW streams across five U.S. states, including Maryland, Idaho, Virginia, Ohio, and Mississippi, to demonstrate the protocol’s ability to identify source-based composition patterns relevant to resource recovery applications. Grocery and restaurant streams were dominated by food waste and high-moisture organics, while school waste contained higher paper content and residential waste showed greater heterogeneity. Aggregation into energy-relevant fractions highlighted practical recovery pathways via anaerobic digestion or gasification, supporting data-driven planning, policy, and circular economy strategies for sustainable waste management across waste sources.

09 BIOMASS FUELS↗
DOE OSTI2026

PRIME: An evaluation framework for protein representation inference and generalization in viral mutation space

Background Protein language models (PLMs) have revolutionized protein fitness prediction, yet their application to rapidly evolving viral pathogens is often confounded by extreme sequence homology. This homology leads to “data leakage” in standard random validation splits, yielding inflated performance metrics that fail to translate into real-world biosurveillance utility. Results We present Protein Representation Inference for Mutation Evaluation (PRIME), a framework that integrates domain-specific fine-tuning with a rigorous position-stratified validation protocol to evaluate viral threats. Using a dataset of 347,432 SARS-CoV-2 receptor binding domain (RBD) sequences, we demonstrate that while random training data split yields deceptive R 2 values (> 0.90), they fail to generalize to novel mutational sites. By benchmarking models up to 650 M parameters, we show that domain-specific fine-tuning of the ESM-C 600 M model with correctly stratified data provides an initial demonstration of predictive signal for binding affinity and expression at unseen mutational sites of binding affinity and expression on unseen sites (R 2 ~0.23), a significant advancement over base foundation models which exhibit no predictive power (R 2 <0). PRIME’s embedding-based clustering identified 3.03% of bat coronavirus sequences as candidates for further experimental prioritization based on their functional similarity to human-infective strains in embedding space, offering a perspective complementary to traditional phylogenetic methods. Conclusion PRIME establishes a new benchmark for the application of PLMs in pathogen surveillance. Our findings demonstrate that state-of-the-art models and fine-tuning, when paired with stratified validation, provide biologically meaningful insights into pathogen evolution and zoonotic risk.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

PRAQTICE

PRAQTICE (Python Repository for Advanced QCVV Tutorials and Interesting Characterization Experiments) is a software package containing advanced demonstrations of the implementation of quantum characterization, verification and validation protocols.

Ostrove, Corey [Sandia National Lab. (SNL-NM), Alb↗
DOE OSTI2025

Performance Evaluation of LPBF Manufactured 316H Components

This work represents the continuation of a benchmark study that includes modeling, fabrication and characterization as demonstration to support industry’s adoption of advanced manufacturing processes in a variety of structures. This comprehensive study investigated the feasibility of using additive manufacturing (AM) technologies, specifically Laser Powder Direct Energy Deposition (LP-DED) and Laser Powder Bed Fusion (LPBF), to produce complex nuclear microreactor components using 316H stainless steel. The research focused on manufacturing an expanded elbow pipe component with transitioning sections, which are traditionally difficult and costly to produce through conventional manufacturing methods. The overall study’s primary objectives are therefore demonstrating AM viability for nuclear applications, optimizing process parameters, developing comprehensive material characterization protocols, validating computational modeling approaches, and establishing manufacturing guidelines for complex geometries. Although the initial work included the phased approach of cubical, upscaled cylindrical components, it is to enable to obtain more knowledge for the printing of the expanded elbow structure. The project achieved significant progress in process development by successfully optimizing LP-DED parameters to achieve 99.16-99.97% relative density in 316H stainless steel components. Through systematic evaluation of sixteen cube samples with varied laser powers (400-700W) and scan speeds (600-900 mm/min), optimal processing windows were identified at 500-550W with 600-700 mm/min or 650-700W with 650-900 mm/min scan speeds. The DED manufactured 316H demonstrated mechanical properties comparable or superior to wrought materials, with Young's modulus ranging from 153-208 GPa and controlled microstructural characteristics including greater than 95% face-centered cubic (FCC) phases and engineered cellular structures with sizes between 3.23-6.17 µm.

36 MATERIALS SCIENCE↗
DOE OSTI2026

A Centralized AI Lakehouse Framework for Brain Tumor MRI Classification and Segmentation, University KPI Forecasting, and Water Potability Prediction

In many university and healthcare projects, models are built for very different data types such as tables, institutional time series, and medical images, but they are deployed as separate applications. In this work, that separation made testing and maintenance difficult because each module had its own pipeline and runtime requirements. This paper presents an integrated AI lakehouse-style implementation that runs three model pipelines inside one containerized backend. For medical imaging, we used MRI datasets from IEEE DataPort: a four-class classification set with 7012 images (5708 train/1304 test) and a segmentation set with 3063 image–mask pairs. The classification model (ResNet50 transfer learning) is evaluated using a proper train–validation–test protocol across multiple splits (80/10/10, 70/10/20, 60/10/30, and 10/30/60), achieving a test accuracy of 99.00% under the standard 80/10/10 split. Additionally, a patient-level evaluation is conducted using an external glioma dataset to provide a more realistic assessment without data leakage. The segmentation model (DeepLabV3-ResNet50) achieved 83.09% validation mIoU and 88.79% Dice score. For university KPI forecasting, we used annual IPEDS and NSF HERD data from 2010 to 2023 for three universities (BSU, EOU, and UAB). To examine the effect of preprocessing on forecasting performance, two case studies are conducted. In the first case, linear interpolation is applied to generate semester-level data. In the second case, the original annual data is used directly without interpolation. Random Forest regression and ARIMA models are evaluated using MAE, RMSE, MAPE, and R 2 . The results showed that interpolation improved apparent forecasting performance due to smoothing, while evaluation on the original annual data provided a more realistic assessment of model behavior. To further validate the framework on a larger dataset, an additional case study is conducted using a student dropout dataset. For water potability, we trained and compared multiple tabular classifiers on a large dataset (1,048,575 samples). A Random Forest model (100 trees, max depth 10) achieved 85.86% test accuracy and high recall for unsafe samples (0.8447). All modules are served via FastAPI and deployed together using Docker, with workflow automation routing requests to the correct endpoint. System-level benchmarking indicates that the backend maintains stable throughput and latency under concurrent requests.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Reliable p K a Prediction through Efficient Incorporation of Anharmonicity within the Nuclear–Electronic Orbital Framework

Accurate pK a prediction is critical for understanding chemical reactivity and molecular properties across a wide range of applications. Computational approaches usually invoke a harmonic treatment of the vibrational modes for zero-point energies, as well as thermal and entropic contributions. Herein, we present a general protocol for relative pK a prediction that incorporates the significant anharmonic effects using nuclear–electronic orbital (NEO) theory. This protocol is validated against experimental data for a range of molecules in acetonitrile, including protonated nitrogen bases, nitrophenols, anilines, and diamines, as well as cobalt electrocatalysts. For simple acids, the NEO approach offers only a slight improvement over conventional density functional theory with the standard harmonic vibrational treatment, whereas for hydrogen-bonded acids, the NEO approach offers more significantly improved performance at a comparable computational cost. This accessible methodology provides a practical route for accurate pKa prediction in challenging systems and is extendable to related thermodynamic properties such as hydricities and proton-coupled redox potentials.

Density functional theory↗
DOE OSTI2025

Screening Metal Halide Perovskite Solar Modules for Premature Field Failures

Developing metal halide perovskite (MHP) photovoltaic (PV) devices into reliable large-area solar modules could accelerate global solar energy deployment. Many MHP devices are susceptible to degradation under light and elevated temperature (LT). Published research on LT testing is limited at the module level, and LT testing has not yet been developed for qualification testing of commercial PV products. This report assesses whether results of LT testing at moderately elevated temperatures correlate with those of field-tested modules from the same batch. Six batches of samples from four manufacturers are assessed. It is shown that modules with a robust package that can maintain over 80% of their peak efficiency during LT testing at 55 °C for 100 h are more likely to retain over 80% of their peak efficiency during outdoor operation for 10 weeks. This finding is a step towards developing a validated test protocol that could be incorporated into a qualification standard for the commercialization of MHP PV technologies.

14 SOLAR ENERGY↗
DOE OSTI2025

Toward equitable environmental exposure modeling through convergence of data, open, and citizen sciences: an example of air pollution exposure modeling amidst increasing wildfire smoke

Exposure modeling is critical in environmental epidemiology and human health but may face challenges (e.g., skewed data, unequal error, context-insensitive validation, and computational demands). Modeling decisions reflect the intended use of the models and the values that modelers prioritize. We aimed to provide a conceptual framework and machine learning (ML) modeling protocols that address these issues. With 500m-gridded hourly PM 2.5 and O 3 levels in Illinois before, during, and after the 2023 Canadian wildfire season as a motivating example, we conducted modeling experiments to evaluate modeling methods, guided by three domains we propose based on theories of science: 1) Data Diversity, leveraging open and citizen science data to enhance inclusivity, parsimony, and representativeness; 2) Equitable Accuracy, ensuring fairly distributed uncertainties across subpopulations; and 3) Sustainable Modeling, balancing accuracy with reducing computational demands to promote accessibility for under-resourced researchers. Here, we found that ML with publicly available data can achieve high accuracy. Depending on methods, performance may vary substantially, even with identical input data. Large but skewed data may reduce performance. Misuse of cross-validation protocols can underestimate prediction error; although we observed R 2 s of ∼98 %, the modeled estimates varied significantly, indicating the need for careful model validation. By using new modeling protocols including representativeness-considered training and validation data and a new loss function, we achieved high agreement between estimates and ground-based measurements (e.g., R 2 = ∼90 % for PM 2.5 ; ∼80 % for O 3 ), equally distributed errors across sociodemographic strata and urban–rural divides, and reduction in computation time—from several weeks or months to a few days.

Exposure assessment↗
DOE OSTI2025

Environmental DNA as a tool for hydropower impact assessments: current status, special considerations, and future integration

Globally there is an urgent need to find sustainable solutions to balance energy production with the protection of vulnerable species and conservation of biodiversity. This is particularly critical for freshwater ecosystems, habitats, and species that may be impacted by hydropower development and operations needed to meet energy grid demands. Reliable and accurate environmental impact assessments (EIAs) that identify the biological, physical, or social impacts of hydropower are key to ensure biodiversity, ecosystem, and societal sustainability. The analysis of environmental DNA (eDNA) has the potential to transform hydropower EIAs, management and mitigation planning, and decision-making procedures. Further, the incorporation of eDNA surveys into EIAs during both hydropower planning and continued operations may streamline regulatory processes by improving our understanding of potentially impacted biota and habitats and evaluating environmental impacts mitigation. Here, we: (i) highlight current understanding and use of eDNA in freshwater environments; (ii) examine critical considerations for eDNA integration into hydropower EIAs and biological monitoring; (iii) identify knowledge gaps in eDNA analysis and applications unique to hydropower-regulated systems; and (iv) discuss future opportunities to bolster the incorporation of eDNA into hydropower research including regulatory acceptance and public engagement. While we acknowledge that there are several factors that may complicate the broad adoption of eDNA as a tool for assessing the impacts of hydropower, we anticipate that growing confidence in eDNA through hydropower-specific protocols, calibrations, and validations will overcome these inherent uncertainties.

aquatic biodiversity↗
DOE OSTI2025

Assessment of Heavy-Duty Fueling Methods and Components-Modeling and Analysis

The goal of the Assessment of Heavy-Duty Fueling Methods and Components project was to comprehensively assess heavy-duty (HD) fuel cell electric vehicle fueling protocols and their effects on techno-economic assessments (TEA) and total cost of ownership (TCO). The project leveraged and built upon ongoing international HD fueling protocols and fueling component development activities to deliver component performance assessments, modeling tools and methods evaluations, TEA of industry-selected protocol structures, and experimental validations of the strategies at the station scale. The effects of the protocols on the fueling times, station costs, and TCO were explored. Fueling time, which was influenced by temperature and protocol selection, had a large impact on the station cost due to component sizing and satisfying hourly demand. As the fleet size increased, the station cost was shown to exponentially decrease by achieving economies of scale. Technology year and fuel economy were the largest contributors to the TCO; however, the choice of fueling protocol had a minor impact on the TCO.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2026

Heterogeneous Multi-Domain Dataset Synthesis to Facilitate Privacy and Risk Assessments in Smart City IoT

The emergence of the Smart Cities paradigm and the rapid expansion and integration of Internet of Things (IoT) technologies within this context have created unprecedented opportunities for high-resolution behavioral analytics, urban optimization, and context-aware services. However, this same proliferation intensifies privacy risks, particularly those arising from cross-modal data linkage across heterogeneous sensing platforms. To address these challenges, this paper introduces a comprehensive, statistically grounded framework for generating synthetic, multimodal IoT datasets tailored to Smart City research. The framework produces behaviorally plausible synthetic data suitable for preliminary privacy risk assessment and as a benchmark for future re-identification studies, as well as for evaluating algorithms in mobility modeling, urban informatics, and privacy-enhancing technologies. As part of our approach, we formalize probabilistic methods for synthesizing three heterogeneous and operationally relevant data streams—cellular mobility traces, payment terminal transaction logs, and Smart Retail nutrition records—capturing the behaviors of a large number of synthetically generated urban residents over a 12-week period. The framework integrates spatially explicit merchant selection using K-Dimensional (KD)-tree nearest-neighbor algorithms, temporally correlated anchor-based mobility simulation reflective of daily urban rhythms, and dietary-constraint filtering to preserve ecological validity in consumption patterns. In total, the system generates approximately 116 million mobility pings, 5.4 million transactions, and 1.9 million itemized purchases, yielding a reproducible benchmark for evaluating multimodal analytics, privacy-preserving computation, and secure IoT data-sharing protocols. To show the validity of this dataset, the underlying distributions of these residents were successfully validated against reported distributions in published research. We present preliminary uniqueness and cross-modal linkage indicators; comprehensive re-identification benchmarking against specific attack algorithms is planned as future work. This framework can be easily adapted to various scenarios of interest in Smart Cities and other IoT applications. By aligning methodological rigor with the operational needs of Smart City ecosystems, this work fills critical gaps in synthetic data generation for privacy-sensitive domains, including intelligent transportation systems, urban health informatics, and next-generation digital commerce infrastructures.

IoT↗
DOE OSTI2026

Assessment of Heavy-Duty Fueling Methods and Components

Chevron, NLR, ANL, and NextEnergy partnered in the development of a comprehensive assessment of heavy-duty (HD) fuel cell electric vehicle fueling protocols. The project leveraged and built upon existing international heavy-duty (HD) fueling protocols and fueling component development activities to deliver component performance assessments, modeling tools and methods evaluations, techno-economic assessments of industry-selected protocol structures and experimental validations of the strategies performed at NLR's HD hydrogen fueling station.

08 HYDROGEN↗
DOE OSTI2025

Practical Introduction to Benchmarking and Characterization of Quantum Computers

Rapid progress in quantum technology has transformed quantum computing and quantum information science from theoretical possibilities into tangible engineering challenges. Breakthroughs in quantum algorithms, quantum simulations, and quantum error correction are bringing useful quantum computation closer to fruition. These remarkable achievements have been facilitated by advances in quantum characterization, verification, and validation (QCVV). QCVV methods and protocols enable scientists and engineers to scrutinize, understand, and enhance the performance of quantum information-processing devices. In this tutorial, we review the fundamental principles underpinning QCVV, and introduce a diverse array of QCVV tools used by quantum researchers. We define and explain QCVV’s core models and concepts—quantum states, measurements, and processes—and illustrate how these building blocks are leveraged to examine a target system or operation. We survey and introduce protocols ranging from simple qubit characterization to advanced benchmarking methods. Along the way, we provide illustrated examples and detailed descriptions of the protocols, highlight the advantages and disadvantages of each, and discuss their potential scalability to future large-scale quantum computers. This tutorial serves as a guidebook for researchers unfamiliar with the benchmarking and characterization of quantum computers, and also as a detailed reference for experienced practitioners.

open quantum systems & decoherence↗