Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

MoE-Inference-Bench: Performance Evaluation of Mixture of Expert Large Language and Vision Models

Mixture of Experts (MoE) models have enabled the scaling of Large Language Models (LLMs) and Vision Language Models (VLMs) by achieving massive parameter counts while maintaining computational efficiency. However, MoEs introduce several inference-time challenges, including load imbalance across experts and the additional routing computational overhead. To address these challenges and fully harness the benefits of MoE, a systematic evaluation of hardware acceleration techniques is essential. We present MoE-Inference-Bench, a comprehensive study to evaluate MoE performance across diverse scenarios. We analyze the impact of batch size, sequence length, and critical MoE hyperparameters such as FFN dimensions and number of experts on throughput. We evaluate several optimization techniques on Nvidia H100 GPUs, including pruning, Fused MoE operations, speculative decoding, quantization, and various parallelization strategies. Our evaluation includes MoEs from the Mixtral, DeepSeek, OLMoE and Qwen families. The results reveal performance differences across configurations and provide insights for the efficient deployment of MoEs.

Chitty-Venkata, Krishna Teja↗
DOE OSTI2025

Ship Motion Testing Needs Evaluation

The American Bureau of Shipping performed an evaluation of national maritime nuclear testing capabilities and determined there currently is an inability to test maritime nuclear power plants in a ship motion environment. A Ship Motion Test Facility (SMTF) is proposed to fill this gap. To inform design of this facility, this report documents an evaluation performed by a panel of technical experts that identifies key physical phenomena associated with maritime nuclear power plant operation that are important to safety and reliability and have a low state of knowledge. This evaluation concluded that all of the major test needs to understand a nuclear plant's behavior in a ship motion environment are for thermal-hydraulics related phenomena. Based on this finding, the evaluation panel concluded that the SMTF would not be required to use nuclear fuel to provide a heat source for the fluids. This would significantly decrease the cost, timeline, and complexity for this test facility to enable the advancement of maritime nuclear technology.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

Evaluations for Nuclear Criticality Safety Program 12 C, 139 La, minor actinides, 235 U [Slides]

For light nuclei, preliminary work extends the evaluation from 6.5 MeV to ~ 10 MeV. For 139 La, the team delivered full evaluation in fast region to ORNL, including covariances. For sup>235 U, RPI data simulations, the team performed simulations and showed some improvement for neutrons below 5 MeV. Some of the changes needed for more improvement might not be supported by the current format. Some of the changes above 12 MeV to account for the angular distribution of preequilibrium neutrons require a change in the PFNS evaluation procedure.

235U re-evaluation↗
DOE OSTI2024

A new 181 Ta neutron resolved resonance region evaluation

A new 181 Ta neutron resolved resonance region evaluation has been performed from the thermal energy range up to approximately 2.5 keV. The R-matrix SAMMY code was used with the Reich–Moore approximation to evaluate resonance parameters from several experimental data sets. A Monte Carlo approach was used for resonance spin assignments and generating 59 small fictitious resonance levels which were shown to improve the cumulative level, Porter-Thomas, and Wigner distributions as compared to theoretical predictions. Covariance information was also generated for the entire resolved resonance region. Finally, the positive impact of the new evaluation was validated through benchmark calculations which were sensitive to the 181 Ta cross section and showed improvement in the reactivity bias for several benchmark cases.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

Design and evaluation of alphabetic and numeric input methods for virtual reality

In today’s virtual reality (VR), users have various ways to influence their VR experience, including alphanumeric input. While typing characters and numbers is straightforward on desktop computers, it presents challenges and opportunities in head-mounted display VR due to specific interaction methods and a lack of real-world visual stimuli. Addressing these open questions, our work implements and evaluates ten approaches to alphabetic and numeric inputs in VR. Here, we describe the design motivation behind these input methods and evaluate them in a user study with 40 participants divided into groups for alphabetic and numeric keyboards. This comparison investigates each method’s performance and user interactions. Our findings suggest that different input methods significantly impact words per minute and error rates, and that certain keyboard designs may receive better subjective evaluations despite poorer objective performance.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Model Data Archive for Manuscript Titled "Evaluation of a Coupled Surface–Subsurface Hydrologic Model Using Dense Water‑Level Sensors in a Mixed Urban–Rural Watershed"

This archive provides scripts, input files, and datasets used for the implementation and evaluation of a fully coupled surface–subsurface hydrologic model in the Neches River Basin, southeast Texas. The study uses the Advanced Terrestrial Simulator (ATS) to simulate coupled surface–subsurface hydrologic processes over a mixed urban–rural watershed and evaluates model performance using a dense network of 136 in situ water-level sensors, nine U.S. Geological Survey (USGS) stream gauges, and SSEBop-derived evapotranspiration estimates during the period October 2014–June 2024. The workflow is implemented primarily in Python 3 using the Watershed Workflow package. The Jupyter notebooks can be executed using open-source software such as Anaconda JupyterLab or Visual Studio Code. Other data files include TXT, CSV, XML, SHP, TIF, NetCDF, HDF5, and ExodusII files, which can be processed using the provided Python scripts. ATS input files are provided in XML format and can be edited using any commonly used text editor. This archive contains: *Scripts and input files used to generate the ATS model setup, including watershed discretization, mesh generation, parameter mapping, and model configuration. *Jupyter notebooks used for preprocessing observational data, evaluating streamflow, water levels, and evapotranspiration, computing performance metrics, and generating the figures presented in the manuscript. *ATS simulation outputs and processed observational datasets, including OneRain and DD6 water-level sensors, USGS streamflow observations, GIS data, and supporting spatial datasets used throughout the study.

Dense water-level sensor network↗
DOE OSTI2024

A Resolved Resonance Evaluation for 51 V with Resonance Parameter Covariance

In this presentation the 51 V evaluation in response to NCSP need is completed. Issues in connection to RR representation are addressed. Uncertainty and covariance information derived with the evaluation. Evaluation proposed and accepted for inclusion in ENDF/B-VIII.1 library.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Analytical and Performance-Based Evaluation Alternatives to Full-Scope, High-Fidelity Testbeds

One consequence the design and operational differences of advanced reactors is that integrated system validation (ISV) using full-scope, high-fidelity testbed might not be cost-justified or practical. The absence of traditional ISV may pose an issue for the conduct of safety evaluations since it may leave regulators without the information derived from this performance-based testing. The purpose of this research is to identify analytical and performance-based test and evaluation methods that are alternatives to full-scope, high-fidelity testbeds that have traditionally been used for ISV. We developed a method to test validation based on a multi-stage validation (MSV) framework. MSV is an approach to meeting validation objectives through incremental, successive validation activities beginning in the early stages of the design process and continuing through the later stages. MSV doesn't rely solely on late stage validation, rather it accommodates the use of a broad spectrum of analytical and performance-based information and a diversity of testbeds. In addition, MSV embraces the use of information from other types of evaluations and analyses.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2026

EXERGETIC: De-Risking Next-Generation Resilient Geothermal Hybrids via At-Scale Evaluation Using Virtual Emulation Digital Twin Environment for Efficient Operation

The DOE-GTO-funded project, award number 5.1.2.12, entitled "EXERGETIC - De-risking Next Generation Resilient Geothermal Hybrids via at-Scale Evaluation Using a Virtual Emulation Digital Twin Environment for Efficient Operation," advances the solution to these challenges by developing and validating a geothermal co-emulation environment implemented at the National Laboratory of the Rockies (NLR)'s Advanced Research on Integrated Energy Systems (ARIES) platform. This framework enables the de-risking of next-generation geothermal and geothermal hybrid systems through high-fidelity modeling, real-time digital emulation, advanced control strategies, and techno-economic assessment. The project focused on geothermal hybrid configurations that integrate geothermal power plants with concentrated solar power and underground thermal energy storage, enabling enhanced efficiency, flexibility, and grid support capabilities. The main goal of this project was the development of a geothermal digital co-emulation environment to demonstrate the technical and economic value of geothermal hybrid systems and their contribution to grid stability and flexibility. The EXERGETIC framework combined physics-based models, controls, and real assets at ARIES, including digital real-time simulators (DRTS), a 20-MW-scale controllable grid interface (CGI), and a 2-MW conventional generator. Detailed transient models were developed for the key subsystems of a hybrid geothermal plant, including parabolic trough solar collectors, reservoir thermal energy storage (RTES), and a binary Organic Rankine Cycle (ORC) power plant. The ORC model explicitly captured thermal inertia and off-design operation and integrated control strategies to dynamically respond to electric load profiles. The models were validated against published experimental and numerical studies, demonstrating strong agreement and confirming the accuracy and robustness of the modeling approach. The resulting digital twin represents geothermal-solar-storage systems at multiple scales (1 MW to 100 MW) and enables realistic emulation of grid-connected operation. The control architecture allows the geothermal resource to provide stable baseload generation, while solar and stored thermal energy supply flexible, dispatchable support during periods of high demand or variable grid conditions. A key contribution of the EXERGETIC project is the demonstration that geothermal hybrid systems can be designed to be active grid assets rather than passive baseload generators. Using the ARIES platform, the digital twin was evaluated under multiple grid scenarios, including load following, voltage support at the distribution level, and frequency response at the transmission level. Results show that hybrid geothermal systems can respond effectively to dynamic grid conditions, providing inertia-like behavior, primary frequency support, and voltage regulation through coordinated control. In addition to the performance and grid services capability analysis of geothermal and hybrid geothermal systems, the EXERGETIC project also focused on scalability and techno-economic analysis of geothermal hybrid plants. In particular, for the scalability analysis, machine-learning (ML)-based surrogate models were trained using data generated from the geothermal digital twin under different grid-connected scenarios and plant capacities. These ML models demonstrated strong interpolation and extrapolation capabilities across plant sizes, accurately reproducing both steady-state and transient responses with very low errors. Regarding the techno-economic analysis, plant performance results were integrated with cost models for hybrid geothermal systems, and the levelized cost of electricity (LCOE) was used as the main economic metric to evaluate system performance across a range of system capacities, solar shares, solar multiples, and storage durations. Results indicate that economies of scale significantly reduce geothermal LCOE as plant capacity increases, with large-scale systems (25-100 MW) achieving substantially lower costs than small plants. Hybridization with solar thermal energy and storage further improves economic performance by increasing capacity utilization and enabling flexible dispatch. In addition, thermal storage plays a critical role in reducing LCOE by maximizing geothermal, solar, and stored energy resources. In summary, the results from this project demonstrate that geothermal hybrid systems represent a promising alternative for increasing the energy conversion efficiency of geothermal technologies, contributing to the preservation of geothermal resources, and supporting the transition of geothermal plants from traditional baseload resources into flexible, resilient, and cost-competitive energy conversion technologies.

15 GEOTHERMAL ENERGY↗
DOE OSTI2026

Evaluation Toolkit for Technical Assistance Programs

Across the United States, every home, business, industry, and government depends on abundant, reliable, and affordable electricity. Energy stakeholders have many options to improve how energy is generated, distributed, and used, but choosing the right path can be complex and challenging. To support more informed decision-making about local electricity systems, the U.S. Department of Energy (DOE) and its national laboratories provide customized technical assistance (TA) through several different programs. These TA programs are designed to support a wide range of stakeholders with a variety of needs. Technical assistance may include brief consultations with subject-matter experts, in-depth technical modeling and analysis, stakeholder engagement, and peer-to-peer exchange. Delivering effective TA is an iterative process that requires evaluation and adaptation. A comprehensive and robust evaluation framework provides the structure needed to ensure that TA programs and practitioners remain effective, responsive to industry trends, and aligned with local needs. This toolkit provides a framework—including a clear, structured process—that TA program staff can adapt to their program's goals to evaluate success.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
NASA NTRS2006

Chemical Kinetics and Photochemical Data for Use in Atmospheric Studies Evaluation Number 15

This is the fifteenth in a series of evaluated sets of rate constants and photochemical cross sections compiled by the NASA Panel for Data Evaluation. The data are used primarily to model stratospheric and upper tropospheric processes, with particular emphasis on the ozone layer and its possible perturbation by anthropogenic and natural phenomena. Copies of this evaluation are available in electronic form and may be printed from the following Internet URL: http://jpldataeval.jpl.nasa.gov/.

data evaluation↗
NASA NTRS2016

Regime-Based Evaluation of Cloudiness in CMIP5 Models

The concept of Cloud Regimes (CRs) is used to develop a framework for evaluating the cloudiness of 12 fifth Coupled Model Intercomparison Project (CMIP5) models. Reference CRs come from existing global International Satellite Cloud Climatology Project (ISCCP) weather states. The evaluation is made possible by the implementation in several CMIP5 models of the ISCCP simulator generating for each gridcell daily joint histograms of cloud optical thickness and cloud top pressure. Model performance is assessed with several metrics such as CR global cloud fraction (CF), CR relative frequency of occurrence (RFO), their product (long-term average total cloud amount [TCA]), cross-correlations of CR RFO maps, and a metric of resemblance between model and ISCCP CRs. In terms of CR global RFO, arguably the most fundamental metric, the models perform unsatisfactorily overall, except for CRs representing thick storm clouds. Because model CR CF is internally constrained by our method, RFO discrepancies yield also substantial TCA errors. Our findings support previous studies showing that CMIP5 models underestimate cloudiness. The multi-model mean performs well in matching observed RFO maps for many CRs, but is not the best for this or other metrics. When overall performance across all CRs is assessed, some models, despite their shortcomings, apparently outperform Moderate Resolution Imaging Spectroradiometer (MODIS) cloud observations evaluated against ISCCP as if they were another model output. Lastly, cloud simulation performance is contrasted with each model's equilibrium climate sensitivity (ECS) in order to gain insight on whether good cloud simulation pairs with particular values of this parameter.

cloud climatology↗
NASA NTRS2019

Evaluation of Matthews-WLR-CH4: A New Wetland, Lake, and Reservoir Methane Emissions Data Set

Methane (CH4) is emitted from a variety of sources, both natural and anthropogenic, and is the second most important greenhouse gas contributing to climate change. Natural wetlands are the largest single contributor to annual global CH4 emissions and other inland water sources, such as lakes and reservoirs, produce CH4 but have received less attention. These emission sources are among the most uncertain components of the global CH4 cycle. These uncertainties stem from numerous issues, including the vast variability in these ecosystems and the sensitivity of CH4 emissions to interannual climate variations. Existing CH4 emission models display large differences in wetland spatial extent and include simplified, or lack all together, wetland-type classifications. Furthermore, CH4 emissions from lakes and reservoirs are typically combined with wetlands, or ignored, on a regional and global scale. Our NASA Interdisciplinary Research in Earth Science (IDS) study is focused on developing a suite of data sets on wetlands, lakes, and reservoirs (WLR) including global distributions of types, CH4-centric classifications, and daily CH4 emission rates (hereafter Matthews-WLR-CH4). This project is unique in that it comprises source-independent emission data for WLR, the first spatially-explicit data set of lake and reservoir CH4 emissions, and wetland emissions comprising numerous different wetland-type classifications.The focus of this study is to perform the initial evaluation of the wetland and lake CH4 emissions data from Matthews-WLR-CH4. This evaluation will focus on the domain of North America and include: 1) estimates of the contribution of wetland and lake sources to total CH4 emissions and atmospheric mixing ratios, 2) comparisons of wetland fraction and CH4 emissions to a suite of existing models (e.g., Wetland and Wetland CH4 Inter-comparison of Models Project (WETCHIMP), Global Carbon Project (GCP)), and 3) an accuracy assessment with in situ airborne and tower-based atmospheric CH4 observations when the Matthews-WLR-CH4 emissions are implemented in forward and inverse CarbonTracker-Lagrange (CT-L) CH4 model simulations. Here we will present the new Matthews-WLR-CH4 wetland and lake CH4 emissions data, the initial evaluation of these products, and the path forward for our project.

Reservoir↗
NASA NTRS2020

Evaluation Issues for a Flight Deck Interface; CAST SE-210 Output 2: Report 4 of 6

This report is part of a series of reports that addresses flight deck design and evaluation, written as a response to loss of control accidents. In particular, this activity is directed at failures in airplane state awareness, in which the pilot loses awareness of the airplane’s energy state or attitude and enters an upset condition. Another report in this series of reports speaks directly to flight deck evaluation methods and metrics for the types of attention and awareness issues that were revealed from the airplane state awareness events. In this report, we describe a wide range of flight deck evaluation issues tied to flight crew performance. The objectives are to establish a framework for thinking about how the flight deck interface should support the performance of the flight crew, and to aid the Federal Aviation Administration (FAA) in identifying relevant human performance issues during the evaluation/certification process. Issues are broken out into sections that cover physical ergonomics, design for usability, data integration and display content, attention and task management, flight crew problem solving, and flight crew teaming. For each issue, we recommend specific ways that the flight deck interface should support the flight crew. For each, we also identify existing 14 CFR Part 25 rules and guidance that are relevant to the issue. This allows the FAA to determine what current regulatory materials can support them in raising the issue with the applicant.

commercial aviation↗
NASA NTRSDate not supplied

Shadow Evaluation of the ATD-2 Phase 3Trajectory Option Set Reroute Capability in the North Texas Metroplex

This paper presents results of NASA’s Airspace Technology Demonstration 2 Phase 3 Trajectory Option Set reroute capability designed to resolve a demand capacity imbalance along the terminal airspace boundary. We focus on Candidate flights generated during the Stormy 2020 Shadow Evaluation which was the result of using the system to passively collect predictions for each flight at the OUT event. Benefit metrics associated with the predictions are defined for the individual rerouted flight and also the system-wide savings. Candidate flights are grouped into three distinct use cases and the benefit mechanism is explained for each use case along with illustrative data. Analysis of the different use cases shed light on the underlying causes of the reroute opportunities. Lessons learned from the Stormy 2020 Shadow Evaluation including the importance of reroutes during recovery from Severe Weather Avoidance Programs and also reroutes in the absence of terminal airspace constraints will be incorporated into the Phase 3 Field Evaluation in 2021 to maximize reroute opportunities.

Airspace Technology Demonstration 2↗
NASA NTRS2022

ATD-2 Field Evaluation of Pre-Departure Trajectory Option Set Reroutes in North Texas Metroplex

The NASA Airspace Technology Demonstration-2 Phase 3 capabilities extend Integrated Arrival, Departure and Surface scheduling to a Metroplex environment where multiple airports are interacting and sharing resources along the terminal boundary. The Phase 3 coordinated scheduling provides pre-departure reroute recommendations to flight operators which reduce delay caused by terminal restrictions. This paper reports results of the Phase 3 Stormy 2021 Field Evaluation conducted between November 2020 and September 2021 in the North Texas Metroplex. During the field evaluation NASA partnered with the FAA, American Airlines, Southwest Airlines, and Envoy Airlines to evaluate Phase 3 capabilities in an operational environment. The benefits results are provided as delay savings metrics measured in time and converted to fuel and emissions savings using detailed fuel flow models provided by flight operators.

ATD-2 Field Evaluation, Trajectory Option Set, Pre↗
NASA NTRSDate not supplied

ATD-2 Field Evaluation of Pre-Departure Trajectory Option Set Reroutes in North Texas Metroplex

The NASA Airspace Technology Demonstration-2 Phase 3 capabilities extend Integrated Arrival, Departure and Surface scheduling to a Metroplex environment where multiple airports are interacting and sharing resources along the terminal boundary. The Phase 3 coordinated scheduling provides pre-departure reroute recommendations to flight operators which reduce delay caused by terminal restrictions. This paper reports results of the Phase 3 Stormy 2021 Field Evaluation conducted between November 2020 and September 2021 in the North Texas Metroplex. During the field evaluation NASA partnered with the FAA, American Airlines, Southwest Airlines, and Envoy Airlines to evaluate Phase 3 capabilities in an operational environment. The benefits results are provided as delay savings metrics measured in time and converted to fuel and emissions savings using detailed fuel flow models provided by flight operators.

ATD-2↗