Search NASA⌕ Search

SEARCH · Search NASA

Results for “Proposal Evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

A Proposed Evaluation Framework for New and Emerging Low Embodied-Carbon Concrete Technologies

New opportunities for carbon reductions in buildings create a strong need for a common framework and method for those who design, build and influence construction to evaluate lifecycle carbon reductions from design decisions and technology choices. These opportunities include a wide range of low-embodied-carbon concrete materials being rapidly developed and introduced to the market. How to evaluate these newer materials and technologies has become critical for both public- and private-sector actors seeking to decarbonize building constructions by leveraging the Infrastructure Investment and Jobs Act (IIJA) and Inflation Reduction Act (IRA) funds. We propose an evaluation framework to assess the lifecycle carbon reductions from adoption of these technologies, including a subset of key “must have” (1) technical criteria (embodied carbon level, technology development stage); (2) market criteria (market size, scalability); and (3) financial criteria (cost of technology implementation compared to businessas-usual) from a range of options. We discuss how to use the framework and illustrate it using a “heatmap,” rating score and short case study of a promising technology. We also propose a plan to implement this framework that includes (1) standardized measurement and validation methods for verifying emission reductions from these technologies, and (2) avenues to implement real world demonstrations. We conclude with recommendations for next steps on framework refinement and commercialization strategy development.

Singh, Reshma↗
DOE OSTI2026

UL 1741SC Conformance Development, Evaluation, and Proposal [Slides]

V2G AC is a type of grid interconnection by mobile battery that transforms an EV into a DER with the potential to stabilize the grid and lower costs for electricity. UL 1741SC is a critical new standard to enable grid interconnection of V2G AC-capable vehicles, by defining requirements for V2G AC-intended EVSEs as a gatekeeper between the grid and the EV to support grid safety, such as through redundant voltage trip (namely oversight). EVSE manufacturers need a clear set of conformance test cases and criteria by which to evaluate their equipment and confirm the compliance with UL 1741SC, so that the EVSEs performs as intended for the grid safety. Hence, NLR identified necessary conformance tests and performed the tests identified to understand the maturity.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2026

Evaluating multistation phase picking algorithm phase neural operator (PhaseNO) on local seismic networks

Reliable automatic phase picking is important for many seismic applications. With the development of machine learning approaches, many algorithms are proposed, evaluated and applied to different areas. Many of these algorithms are single station based, while recent proposed methods start to combine surrounding stations into consideration in the problem of phase picking. Among these algorithms, the phase neural operator (PhaseNO) shows promising results on regional data sets comparing to existing algorithms. But there are many use cases for the local seismic networks in our community, therefore in this paper we evaluate the performance of PhaseNO on four different local data sets and compare the results to PhaseNet and EQTransformer. We used both individual phase picking metrics as well as association metrics to illustrate the performance of PhaseNO. By manually reviewing the newly detected events, we find that the PhaseNO model outperforms the single station-based approaches in the local-scale use cases due to its consideration of coherent signals from multiple stations. We also explored PhaseNO’s behaviours when only using one station, as well as gradually increasing the number of stations in the seismic network to better understand its behaviour. Overall, using the off-the-shelf machine learning based phase pickers, PhaseNO demonstrated its good performance on local-scale seismic networks.

58 GEOSCIENCES↗
DOE OSTI2024

Evaluating Machine Learning-Based MRI Reconstruction Using Digital Image Quality Phantoms

Quantitative and objective evaluation tools are essential for assessing the performance of machine learning (ML)-based magnetic resonance imaging (MRI) reconstruction methods. However, the commonly used fidelity metrics, such as mean squared error (MSE), structural similarity (SSIM), and peak signal-to-noise ratio (PSNR), often fail to capture fundamental and clinically relevant MR image quality aspects. To address this, we propose evaluation of ML-based MRI reconstruction using digital image quality phantoms and automated evaluation methods. Our phantoms are based upon the American College of Radiology (ACR) large physical phantom but created in k-space to simulate their MR images, and they can vary in object size, signal-to-noise ratio, resolution, and image contrast. Our evaluation pipeline incorporates evaluation metrics of geometric accuracy, intensity uniformity, percentage ghosting, sharpness, signal-to-noise ratio, resolution, and low-contrast detectability. We demonstrate the utility of our proposed pipeline by assessing an example ML-based reconstruction model across various training and testing scenarios. The performance results indicate that training data acquired with a lower undersampling factor and coils of larger anatomical coverage yield a better performing model. The comprehensive and standardized pipeline introduced in this study can help to facilitate a better understanding of the performance and guide future development and advancement of ML-based reconstruction algorithms.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

A Resolved Resonance Evaluation for 51 V with Resonance Parameter Covariance

In this presentation the 51 V evaluation in response to NCSP need is completed. Issues in connection to RR representation are addressed. Uncertainty and covariance information derived with the evaluation. Evaluation proposed and accepted for inclusion in ENDF/B-VIII.1 library.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Thermal Integration of Advanced Nuclear Reactors with a Reference Refinery, Methanol Synthesis, and a Wood Pulp Plant (Rev.1)

The present report is intended to provide process flow diagrams (PFDs) and energy and mass balance data sheets for a U.S. industrial sector subset with which nuclear heat and power could be integrated—a subset that includes the oil refining, methanol and pulp and paper industries. Coupling options for integrating nuclear energy into these industries are quantitatively outlined for reference systems, and future work will extend this analysis in greater detail. Opportunities for integrating small modular nuclear reactors (SMNRs) were investigated for each of the industrial process configurations. Aspen HYSYS and Cycle-Tempo models for a high-temperature gas-cooled reactor were developed to evaluate the proposed integration. This introductory evaluation provides a general description and assessment of the operating principles, reactor coolant core outlet temperature, and reactor size to be integrated with industry. The industrial processes of oil refining and the production of methanol, pulp and paper were simulated by using Aspen HYSYS, Aspen Plus, and the PRELIM (Petroleum Refinery Life Cycle Inventory Model) tool to develop process details. Cycle-Tempo models then extend the process modeling results to obtain net energy demands (e.g., heat, steam, and electricity) when accounting for process steam and waste heat recovery. This information is intended to foster the analysis of integrating an SMNR to decarbonize industrial facilities. The SMNR would provide reliable, competitive, and sustainable clean energy while reducing carbon emissions and other environmental impacts, such as water withdrawals, consumption, and contamination. The refining industry, exhibited in Figure ES1, is a leading consumer of fossil -fuel-based heat, power, and hydrogen in the U.S. industrial sector, generating over 164 million metric tons (MMT) of CO 2 emissions in 2023. The overall mass and energy pertaining to a generalized complex refinery in the United States is reflected in Figure ES1, along with energy metrics regarding integration with a nuclear power plant (NPP). Data sheets were developed to indicate the energy requirements for the overall refinery and each refinery process. The data sheet for the overall refinery is shown in Table ES2.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

Dynamically Learning Incentives for Load Control

As electrical generation becomes more distributed and volatile, and loads become more uncertain, controllability of distributed energy resources (DERs), regardless of their ownership status, will be necessary for grid reliability. Grid operators lack direct control over end-users' grid interactions, such as energy usage, but incentives can influence behavior -- for example, an end-user that receives a grid-driven incentive may adjust their consumption or expose relevant control variables in response. A key challenge in studying such incentives is the lack of data about human behavior, which usually motivates strong assumptions, such as distributional assumptions on compliance or rational utility-maximization. In this paper, we propose a general incentive mechanism in the form of a constrained optimization problem -- our approach is distinguished from prior work by modeling human behavior (e.g., reactions to an incentive) as an arbitrary unknown function. We propose feedback-based optimization algorithms to solve this problem that each leverage different amounts of information and/or measurements. We show that each converges to an asymptotically stable incentive with (near)-optimality guarantees given mild assumptions on the problem. Finally, we evaluate our proposed techniques in voltage regulation simulations on standard test beds. We test a variety of settings, including those that break assumptions required for theoretical convergence (e.g., convexity, smoothness) to capture realistic settings. In this evaluation, our proposed algorithms are able to find near-optimal incentives even when the reaction to an incentive is modeled by a theoretically difficult (yet realistic) function.

demand response↗
DOE OSTI2025

Initial Design Curves for Alloy 709 for an Improved Creep-fatigue Design Method

Creep-fatigue (CF) interaction damage is the primary damage mode for high-temperature structural components subjected to cyclic loading. Over the past several decades, researchers within the American Society of Mechanical Engineers (ASME) Boiler and Pressure Vessel Code (BPVC), Section III, Division 5, have focused on developing elevated temperature code rules to ensure conservative structural designs that mitigate CF failure in high-temperature reactors. The existing CF evaluation methodologies in the Code are based on the creep and fatigue damage diagram approach, which is complex and often excessively conservative. The alternative CF evaluation approach proposed here is intended to significantly simplify the evaluation procedure while reducing conservatism in high-temperature component design analysis. This alternative CF evaluation method integrates the elastic–perfectly plastic (EPP) analysis approach with the simplified model test (SMT) CF design concept, leveraging the advantages of both methods. This report presents the preliminary analysis and the approach for developing CF design curves for Alloy 709, utilizing fatigue and CF data generated for the 100,000-hr Code Case to support its qualification to ASME Section III, Division 5 for Class A construction of high temperature reactors. This study is to support the incorporation of Alloy 709 in this alternative CF evaluation method. Recommendations for the remaining work needed to complete the effort are also provided.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Preventive Power Outage Estimation Based on a Novel Scenario Clustering Strategy

The increasing occurrence of extreme weather events is challenging power grid operation. For extreme weather events, the system operator is responsible for estimating the power outages and scheduling the restoration resources. This paper proposes an outage evaluation framework to identify the possible unserved load profiles, vulnerable areas, and mobile energy adequacy. The outputs of an outage prediction model tool are used to generate numerous faulted line scenarios. Next, each scenario's nodal unserved load profile is obtained by solving a three-phase restoration model that considers repair crews and mobile energy resources (MERs). Then, a novel scenario clustering strategy is developed to cluster the unserved load profiles into multiple representative profiles which the system operator can focus on. Finally, case studies on a distribution system evaluate the damage caused by an extreme weather event and verify the effectiveness of the proposed scenario clustering strategy.

MATHEMATICS AND COMPUTING,POWER TRANSMISSION AND D↗
DOE OSTI2025

A Data-Agnostic, Continuous Machine Learning Framework for Application in High Energy Physics and Beyond: Phase 1 Final Scientific/Technical Report

This Phase 1 effort has focused on the development of continual learning frameworks for use in machine learning, specifically in the applied context of High Energy Physics (HEP). Machine learning (ML) is a transformative technology by which computers, typically through the use of neural networks, are able to perform tasks with proficiency that rivals or surpasses that of human users. Model Degradation & Catastrophic Forgetting are two undesired phenomena which can occur in ML where the performance of a model degrades when either deployed on novel data streams, or trained on novel data which are sufficiently different than the data the models were initially trained on. A natural example where these sorts of effects can be observed is in the performance of detectors in harsh environments, where the detector signature may change over the lifetime of the detector as it ages and deteriorates — precisely what occurs in the experiments conducted in HEP. Real world HEP data is therefore an excellent test-ground and use-case for Continual Learning paradigms, which are techniques used in ML to counteract these problems. Ensemble learning is one such technique, where multiple smaller models are trained on subsets of the overall data and are ensembled together during inference. The intuition behind this technique is that, although there are shifts in the distributions which govern the incoming data streams, these shifts are not expected to be homogeneous or global. If a sufficient diversity in solutions within the various sub-models has been achieved, then at least one sub-model is expected to retain its performance within the overall ensemble. One further strength of this approach is that the architectures of the various models do not need to be identical, and in fact even different modalities of data can naturally be combined in this way. This work focused on applying ensemble learning techniques to derive results using two main datasets, anomaly detection in HEP data & time-series forecasting in semiconductor manufacturing data. Semiconductor manufacturing involves data with surprising similarity to that of HEP (e.g. wafer maps look very similar to digi-occupancy maps) and Cerium Lab’s prominence within the semiconductor industry makes semiconductor manufacturing a natural opportunity for commercialization of this work. Our efforts have led to two strong results. The first is that we evaluated the proposed ensembling techniques using previously proposed machine learning architectures for use in anomaly detection, namely AutoEncoder based models and their derivatives. We also developed new architectures which have not been evaluated in this context before. In fact, this work marks the first use of Vision Transformers for anomaly detection in HEP. Second, we demonstrated that ensemble learning significantly improves model performance in scenarios prone to degradation, validating its effectiveness across both HEP and semiconductor datasets. These results further support ensemble learning as a powerful strategy for mitigating catastrophic forgetting and maintaining robust performance in evolving data environments.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

EVALUATION OF HRA METHODOLOGIES FOR APPLICATION IN SDP WORK

This study critically evaluates human reliability analysis (HRA) methodologies applicable to regulatory probabilistic safety assessment (PSA) model, with a particular focus on their role in supporting the significance determination process (SDP) in nuclear safety assessment. Firstly, three widely utilized HRA methods – IDHEAS-ECA, SPAR-H, and ASEP/THERP – were qualitatively and quantitatively assessed. Qualitative assessments were conducted using attributes from the NEA/CSNI/R(2015)1 report, while quantitative evaluations employed regression and correlation analyses to compare predicted human error probabilities (HEPs) against empirical data. Results reveal distinct strengths, for example, IDHEAS-ECA’s robust predictive accuracy and K-HRA’s alignment with operational practices. In addition, dependency analysis and recovery analysis were critically evaluated. For dependency analysis, the methods’ handling of inter-task dependencies and their impact on HEPs were examined, while recovery analysis highlighted strategies for mitigating failure events. Furthermore, strategies were proposed to evaluate performance-shaping factors under conditions of reduced human performance, such as stress, fatigue, or cognitive overload, addressing specific challenges faced in SDP evaluations. Human errors from KINS’s operational performance information system event reports were evaluated as a case study. This study identifies gaps and provides actionable insights to ensure their validity and applicability in SDP HRA applications. This paper is a part of research conducted by KINS, and it should be noted that this result does not represent the regulatory position of KINS.

99 - GENERAL AND MISCELLANEOUS↗
DOE OSTI2025

Cooperative On-Ramp Merging with Time-Varying Vehicle-to-Vehicle Communication Delay Compensation via a Model-Free Approach

Cooperative merging strategies enabled by vehicle-to-vehicle (V2V) communication have shown promise in addressing congestion, fuel inefficiency, and collision risks. However, their performance can be severely degraded by time-varying and uncertain communication delays-an issue often overlooked in existing research, which primarily focuses on merging sequence determination and trajectory planning. Furthermore, practical considerations such as heterogeneous vehicle dynamics, varying road conditions, and real-time implementation complexities are frequently neglected. This paper presents a model-free, online planning framework for cooperative on-ramp merging of connected and automated vehicles (CAVs), explicitly accounting for time-varying V2V communication delays. Without relying on detailed vehicle dynamics, the proposed method introduces a data-driven delay compensation scheme. A co-simulation platform integrating high-fidelity vehicle dynamics, traffic simulation (SUMO), and V2V communication within MATLAB/Simulink is developed to evaluate the proposed method. Simulation results demonstrate that unaddressed V2V communication delays significantly impair merging performance. In contrast, the proposed framework enhances intervehicle distance tracking and maintains low CO2 emissions and fuel consumption, under communication delay across different communication frequencies. In conclusion, its lightweight design also facilitates real-time implementation, making it well-suited for deployment in practical CAV systems.

Accounting↗
DOE OSTI2024

LSAFE: a Lightweight Static Analysis Framework for binary Executables

Static analysis is a widely used technique for analyzing various aspects of programs. However, as programs become more complex, static analysis tools require larger resources, such as CPU time and memory, to perform the same tasks. Moreover, the source code of programs may not always be accessible, requiring static analysis to be performed on the binary executable code directly. To overcome these challenges, we propose a lightweight static analysis framework called LSAFE, which constructs control flow graphs (CFGs) and data dependency graphs (DDGs) of target programs with optimized performance in terms of CPU and memory usage. We evaluated the proposed framework using both Spec benchmark programs and real-world industrial applications, and found that it outperformed Angr, an existing state-of-the-art static analysis tool. Additionally, we demonstrate a case study that utilizes the CFG generated by LSAFE to detect memory leaks.

Qu, Guangzhi↗
DOE OSTI2024

Deep Reinforcement Learning for Microgrid Cost Optimization Considering Load Flexibility

This paper proposes a novel Soft-Actor-Critic (SAC) based Deep Reinforcement Learning (DRL) method for optimizing the cost of microgrid operation by leveraging load flexibility. The proposed SAC-DRL method is designed to coordinate the control of distributed energy resources (DERs) and flexible load, addressing practical energy billing formation by power distribution utilities. Key contributions include an innovative reward function to mitigate sparse reward challenges and a mixed control strategy for discrete and continuous variables, ensuring radial network topology and minimizing power loss. We evaluate the proposed method on the model of a real microgrid located in Southern California, U.S.. The SAC-DRL model is tested to demonstrate its efficacy in reducing grid dependence, optimizing resource use, and minimizing costs. The results highlight the potential of DRL in modern energy systems, offering a sustainable and economically efficient solution for energy management in microgrids.

deep reinforcement learning↗
DOE OSTI2024

SRBench++: Principled Benchmarking of Symbolic Regression With Domain-Expert Interpretation

Symbolic regression searches for analytic expressions that accurately describe studied phenomena. The main promise of this approach is that it may return an interpretable model that can be insightful to users, while maintaining high accuracy. The current standard for benchmarking these algorithms is SRBench, which evaluates methods on hundreds of datasets that are a mix of real-world and simulated processes spanning multiple domains. At present, the ability of SRBench to evaluate interpretability is limited to measuring the size of expressions on real-world data, and the exactness of model forms on synthetic data. In practice, model size is only one of many factors used by subject experts to determine how interpretable a model truly is. Furthermore, SRBench does not characterize algorithm performance on specific, challenging sub-tasks of regression such as feature selection and evasion of local minima. In this work, we propose and evaluate an approach to benchmarking SR algorithms that addresses these limitations of SRBench by 1) incorporating expert evaluations of interpretability on a domain-specific task, and 2) evaluating algorithms over distinct properties of data science tasks. We evaluate 12 modern symbolic regression algorithms on these benchmarks and present an in-depth analysis of the results, discuss current challenges of symbolic regression algorithms and highlight possible improvements for the benchmark itself.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Implementation and Evaluation of Emission‐Driven Land‐Atmosphere Coupled Simulation in E3SMv2.1

Emissions-driven (prognostic CO 2 ) simulations are essential for representing two-way carbon-climate feedback in Earth System Models. We present an emissions-driven land–atmosphere coupled biogeochemistry (BGC) configuration (BGCLNDATM_progCO2) in version 2.1 of the Energy Exascale Earth System Model (E3SMv2.1). This is the first E3SM configuration that performs land-atmosphere emission-hindcasts. Here, we document its implementation, evaluate the model's performance against observations and other models, and propose a structured evaluation protocol for such emissions-driven simulations. We conducted transient historical simulations (1850–2014) with BGCLNDATM_progCO2 and compare them to reference simulations—a land-atmosphere coupled simulation without BGC and a standalone land simulation with BGC, both using prescribed CO 2 concentrations—and to observations. BGCLNDATM_progCO2 overestimates atmospheric CO 2 concentrations by 11–23 ppm yet stays within the 40-ppm spread CMIP6 emission-driven models and retains physical climate properties comparable to the reference runs. The CO 2 biases are partly attributed to underrepresented oceanic CO 2 uptake and inadequate representations of some terrestrial processes. In general, introducing prognostic CO 2 did not change physical climate metrics at the global scale but had larger regional effects, particularly over land where spatially heterogeneous CO 2 and prognostic leaf area index influenced surface energy balance. Finally, we propose a general evaluation protocol including spin-up assessment, atmospheric CO 2 benchmarking, physical climate evaluation, and land biogeochemical analysis to support scientific rigor and facilitate inter-model comparisons. The new configuration lays the groundwork for future enhancements, including improved terrestrial biogeochemical processes, integrated marine biogeochemistry, and additional human–Earth system interactions. These developments advance E3SM toward fully coupled emissions-driven simulations, enabling more accurate carbon–climate feedback projections and informing mitigation policy by providing physically consistent carbon-budget metrics for mitigation scenarios.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Bayesian Optimized Deep Ensemble for Uncertainty Quantification of Deep Neural Networks: a System Safety Case Study on Sodium Fast Reactor Thermal Stratification Modeling

Deep neural networks (DNNs) are increasingly important to scientific computing and engineering system simulations. Accurate uncertainty quantification (UQ) for DNNs is critical in safety-sensitive engineering domains. Traditional Deep Ensemble (DE) methods, while easy to implement, frequently suffer from poorly calibrated uncertainty estimates and limited predictive accuracy due to reliance on fixed architectures with varied weight initializations. To address these issues, we introduce a workflow that combines Bayesian Optimization (BO) and DE. The workflow is modular, scalable, and integrates parallel BO initialized with Sobol sequences to individually optimize the hyperparameters of each ensemble member. This method enhances ensemble diversity, improves predictive accuracy, and provides reliable uncertainty estimates. We evaluate the proposed BODE approach in a sodium fast reactor thermal stratification modeling case study, where we used a densely connected convolutional neural network to predict turbulent viscosity during the reactor transient with consideration of data noise. We benchmark its performance against several optimization approaches, including baseline deep ensemble, evolutionary algorithm-optimized ensemble, ensemble formed via random search combined with greedy selection, and a BO ensemble using random initialization. Here, our results demonstrate superior performance of the developed BODE approach. In noise-free scenarios, BODE notably reduces incorrect aleatoric uncertainty and significantly enhances predictive accuracy. Under conditions of 5% and 10% Gaussian noise, BODE adaptively quantifies uncertainty proportional to data noise, achieving up to an 80% reduction in root mean square error compared to baseline methods and producing well-calibrated prediction intervals.

Bayesian optimization↗
DOE OSTI2025

Off-Equilibrium Reactivity of Boron-Enriched Metal Diboride Surfaces in Electroreduction Conditions

Boron-based materials, featuring B-dependent reactivity and diverse phases, are emerging as promising catalyst systems. However, the catalytic mechanism on many borides remains poorly understood due to complex surface reconstructions under reaction conditions. Here, we investigate the MoB 2 surface in conditions of hydrogen evolution reaction in acidic media, using grand canonical global optimization, grand canonical density functional theory, ab initio molecular dynamics, free energy surface sampling, and an analytical model for electrochemical barrier evaluation. We propose a boron-enrichment strategy to tune the surface reactivity of the hexagonal face of MoB 2 . We reveal the dynamic nature of the B-enriched surface under H coverage and kinetic trapping of the system in the metastable regime with an extensive examination of the deactivation pathways. The metastable center B site on B-enriched surfaces, featuring buckled-up configuration and a usual relaxation effect, is found to be highly active toward HER via the Volmer–Heyrovsky mechanism. In conclusion, this work demonstrates how off-equilibrium behaviors can arise from the interplay between adsorbate coverage and surface reconstruction on a seemingly simple surface, and we present a theoretical framework and computational workflows to address these behaviors, along with other realistic complexities, in kinetics simulations.

Adsorption↗