Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Controller Hardware-in-the-Loop Evaluation of a Microgrid Controller for a Microgrid System with Multiple Grid-Forming Inverters: Preprint

This paper presents the laboratory evaluation of a commercial Microgrid Management System (MGMS) implemented in the real-world Bronzeville Microgrid which features a futuristic scenario with high renewable energy integration and the use of multiple Grid-Forming (GFM) inverters. The primary objective of the performance evaluation for the MGMS is to assess the MGMS's capability to dispatch GFM units, including a GFM PV unit and two GFM battery units, to maintain the system stability and ensure economic operation, thus guaranteeing the microgrid's resilience during prolonged outages and dynamic events. The laboratory controller hardware-in-the-loop provides realistic testing environment through detailed electromagnetic transient modeling of the microgrid system, hardware MGMS, and standard communication protocols (DNP3). The CHIL evaluation shows how the MGMS effectively manages the GFM inverters, highlighting its performance in maintaining stability, reliability, and survivability in a microgrid environment with a high penetration of renewable energy sources.

controller hardware-in-the-loop↗
DOE OSTI2024

A Proposed Evaluation Framework for New and Emerging Low Embodied-Carbon Concrete Technologies

New opportunities for carbon reductions in buildings create a strong need for a common framework and method for those who design, build and influence construction to evaluate lifecycle carbon reductions from design decisions and technology choices. These opportunities include a wide range of low-embodied-carbon concrete materials being rapidly developed and introduced to the market. How to evaluate these newer materials and technologies has become critical for both public- and private-sector actors seeking to decarbonize building constructions by leveraging the Infrastructure Investment and Jobs Act (IIJA) and Inflation Reduction Act (IRA) funds. We propose an evaluation framework to assess the lifecycle carbon reductions from adoption of these technologies, including a subset of key “must have” (1) technical criteria (embodied carbon level, technology development stage); (2) market criteria (market size, scalability); and (3) financial criteria (cost of technology implementation compared to businessas-usual) from a range of options. We discuss how to use the framework and illustrate it using a “heatmap,” rating score and short case study of a promising technology. We also propose a plan to implement this framework that includes (1) standardized measurement and validation methods for verifying emission reductions from these technologies, and (2) avenues to implement real world demonstrations. We conclude with recommendations for next steps on framework refinement and commercialization strategy development.

Singh, Reshma↗
DOE OSTI2024

Controller-Hardware-in-the-Loop Evaluation of a Microgrid Controller for a Microgrid System With Multiple Grid-Forming Inverters

This paper presents the laboratory evaluation of a commercial Microgrid Management System (MGMS) implemented in the real-world Bronzeville Microgrid which features a futuristic scenario with high renewable energy integration and the use of multiple Grid-Forming (GFM) inverters. The primary objective of the performance evaluation for the MGMS is to assess the MGMS's capability to dispatch GFM units, including a GFM PV unit and two GFM battery units, to maintain the system stability and ensure economic operation, thus guaranteeing the microgrid's resilience during prolonged outages and dynamic events. The laboratory controller hardware-in-the-loop provides realistic testing environment through detailed electromagnetic transient modeling of the microgrid system, hardware MGMS, and standard communication protocols (DNP3). This CHIL evaluation shows how the MGMS effectively manages the GFM inverters, highlighting its performance in maintaining stability, reliability, and survivability in a microgrid environment with a high penetration of renewable energy sources.

controller hardware-in-the-loop↗
DOE OSTI2025

An Evaluation of Representation Learning Methods in Particle Physics Foundation Models

We present a systematic evaluation of representation learning objectives for particle physics within a unified framework. Our study employs a shared transformer-based particle-cloud encoder with standardized preprocessing, matched sampling, and a consistent evaluation protocol on a jet classification dataset. We compare contrastive (supervised and self-supervised), masked particle modeling, and generative reconstruction objectives under a common training regimen. In addition, we introduce targeted supervised architectural modifications that achieve state-of-the-art performance on benchmark evaluations. This controlled comparison isolates the contributions of the learning objective, highlights their respective strengths and limitations, and provides reproducible baselines. We position this work as a reference point for the future development of foundation models in particle physics, enabling more transparent and robust progress across the community.

Chen, Michael [Caltech]↗
DOE OSTI2025

Evaluating Hydropower Plants for Wildfire Resilient Microgrids

The increasing occurrence and severity of wildfires in recent years is severely impacting critical infrastructures, including the power grid, compromising the quality of life and provision of essential services, including electricity. The western parts of the United States, more specifically Washington, Oregon, and California, which are prone to large wildfires, are also rich in hydropower resources. Hydropower resources located close to communities vulnerable to wildfire can be utilized to develop wildfire-resilient microgrids to support critical needs of those communities. Therefore, this paper develops a framework to characterize hydropower plants and evaluate their feasibility to operate in microgrids during wildfire-related outages. In the proposed framework, hydropower plants are characterized using various plant and site attributes and evaluated in terms of capability and performance indicative metrics. A case study is carried out evaluating the Hills Creek hydropower plant located in a wildfire-prone region of Oregon for wildfire-resilient microgrid. The results of steady-state and dynamic simulations show that the hydropower plant is capable of providing the essential microgrid services and powering nearby communities during extended wildfire-related outages.

29 - ENERGY PLANNING, POLICY AND ECONOMY↗
DOE OSTI2024

Laboratory Evaluation of Commercial Utility Microgrid Controller Test Results

The functional requirements of many microgrid controllers (MGCs) are expanding and evolving to meet growing utility and community needs. At a high level, the utility microgrid controller serves resilience and reliability use cases by coordinating transitions between grid-connected and islanded states and by managing the system during island operations. This includes control scenarios that require the microgrid controller to use flexible microgrid boundaries, maintain energy balance, coordinate with peer systems, and manage grid-forming (GFM) and grid-following (GFL) distributed energy resources (DER). In order to evaluate these functional enhancements, microgrid controller test plans must also be developed to ensure that the implemented controllers provide adequate performance. This report provides MGC test plans for both island operation and transition functions. The functions covered in this report include feeder level energy management, island constraint management, secondary voltage and frequency control, black start, and synchronized reconnection. This second edition update also includes results from applying the tests to a commercial utility microgrid controller. These results evaluate the performance and reliability of the controller under various operational scenarios. It identifies specific areas where the controller excels and highlights gaps that need to be addressed for future enhancements. The application of these test plans on real-world system behavior provides insights on commercial equipment readiness for field deployment. These test cases can be applied to utility-managed microgrid controllers that exclusively manage utility-owned equipment; the tests also apply to third-party managed microgrid controllers that coordinate with utility- and customer-owned equipment. The report can also be used by technology developers and project developers in industry to evaluate control strategies and performance characteristics for community microgrid controllers.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Evaluation of Bio-Intermediates and Other Biofuels for use in Marine Engines

This paper presents an overview of the DOE Marine Biofuel Feasibility Study to evaluate the potential of biofuels for ocean-going vessels. These vessels operate on low-cost residual fuel oils (also known as heavy fuel oils or HFO), which require significant heating and purification onboard vessels. The industry is looking at economical alternative fuels that can enhance performance from combustion/emissions, rheology, and other perspectives. Four U.S. national laboratories are collaborating to evaluate a variety of biofuels, including bio-intermediates (pyrolysis and hydrothermal liquefaction oils), biodiesel (fatty acid methyl esters or FAME), bio-residuals (FAME byproducts) for their suitability as fuels for marine diesel engines. Bio-intermediates in particular are of interest because large marine engines that operate on HFO can tolerate lowerquality, more viscous fuels and may be able to utilize these fuels with less upgrading than other applications, presenting economic advantages. The test fuels of interest are examined to determine the minimum level of upgrading required for blend compatibility with market HFOs containing high levels of asphaltenes as well as their impact on the viscosity, polymerization tendency, and combustion properties (particularly cetane number) of the fuel blends in preparation for future evaluation in engine studies.

Kaul, Brian [ORNL] (ORCID:0000000184813620)↗
DOE OSTI2026

Hydrogen Recombiner Catalyst Evaluations for Waste Storage

Radiolysis of water in nuclear waste storage generates hydrogen gas that can accumulate within sludge style waste and be rapidly released during agitation events, creating a significant flammability hazard. Engineering controls are therefore required to limit hydrogen concentrations during both quiescent storage and transient disturbances. Catalytic recombination of hydrogen in waste storage offgas is a proven mitigation strategy, maintaining hydrogen levels below flammability limits and managing sudden concentration spikes. Conventional recombiners rely on platinum and/or palladium catalysts, with development efforts focused on extending service life, increasing active surface area, and ensuring safe deployment in radioactive environments. Savannah River National Laboratory (SRNL) is evaluating a newly developed hydrogen recombiner catalyst from Canadian Nuclear Laboratories as a cost-effective and durable alternative for nuclear waste applications. Testing was conducted in SRNL’s Shielded Cells facility, which enables reduced-scale experimental modeling under radiation fields and near-use-case conditions relevant to radioactive waste storage. Catalyst performance was evaluated using a custom offgas characterization system designed for near-zero flow conditions. The experimental apparatus consisted of a gas-tight 2.7 L PTFE vessel equipped with temperature monitoring, gas flow controls, and a variable-speed mixer to simulate sludge agitation. Offgas composition was monitored using a dedicated gas chromatograph with argon carrier gas and a krypton internal standard. Measurements were obtained for an empty vessel, the vessel containing a well characterized radioactive tank waste sample, and the same configuration with the candidate catalyst installed. Results demonstrate that the new catalyst effectively reduced hydrogen concentrations in the offgas within the constraints of the experimental design. In addition to confirming catalytic activity, the testing provided valuable insights into experimental optimization and considerations for future performance evaluations. These findings support the potential scalability of the technology and highlight its applicability to broader nuclear waste management operations, offering improved safety and reduced operational costs through enhanced catalyst durability and lower replacement frequency.

Tener, Zachary P. [Savannah River National Laborat↗
DOE OSTI2025

EVALUATION OF OPERATION TEMPERATURES UNDER NATURAL CONVECTION HELIUM FLOW IN A CONFINED CAVITY

The Spallation Neutron Source (SNS) is a high-power accelerator-based pulsed neutron source led by Oak Ridge National Laboratory (ORNL) to achieve high fluxes of neutrons for scientific experiments. Active and passive cooling of the systems and parts forming the SNS have been considered to warrant the safe operation of the facility. The diverse cooling systems make use of conjugated heat transfer mechanisms to provide a stable operation temperature for all components in the machine. Thermal power deposited into stainless-steel piping lines due to particle radiation may reach values of up to 1.2 W/cc in the regions located closer to the center of the lower IRP. These energy deposition levels, in not actively cooled components, such as the transfer-line-outer-vacuum-layer may increase the temperature of the component beyond design requirement limitations. The evaluation of the operation temperatures for the former components relies in the assumption that a low-pressure helium atmosphere provides enough heat removal capacity based on natural convection phenomena. In this work, the evaluation of steady state temperatures in components such as the CMS transfer lines has been evaluated using computational fluid dynamics (CFD), analytical correlations and experimental measurements. The companion experiments were conducted in a closed helium system at pressures varying from 1.1 to 1.5 bar. A copper rod was affixed horizontally between viewing windows and heated at constant power, and measurements were made of both the rod temperature and ambient temperature via a system fiberoptic distributed temperature sensors and RTDs. It was found that the measured heat transfer coefficients agree well with the predictions of Churchill and Chu correlations across the range of cases considered. Additionally, the ambient helium volume above the rod was imaged via background oriented schlieren (BOS), and these data was used to determine the line-averaged density gradients in this region. These gradients were compared to simulation data to validate the predictions of natural convection simulations.

Dominguez-Ontiveros, Elvis [ORNL] (ORCID:000000018↗
DOE OSTI2025

Training Evaluation: A Case Study of Measuring Impact and ROI

The purpose of this case study was to evaluate the Compliance Officer/Coordinator (CO/CC) training program using Phillips’ approach to training evaluation. INL Learning Performance Consultants (LPCs) applied the ROI Methodology to measure the effectiveness of the CO/CC training program. INL CO/CCs participated in focus groups to provide feedback on their learning, enablers and barriers to applying what they learned, and opportunities to improve the CO/CC learning experience. With collaboration from the CO/CC training program owner, the LPCs demonstrated the business impact and return on investment (ROI) of the CO/CC training program. Included are training program recommendations and lessons learned using the ROI Methodology.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2025

Evaluation of normalization strategies for mass spectrometry-based multi-omics datasets

Introduction Data normalization is crucial for multi-omics integration, reducing systematic errors and maximizing the likelihood of discovering true biological variation. Most studies assess normalization for a single omics type or use datasets from separate experiments. Few address time-course data, where normalization might bias temporal differentiation. In this study, we compared common normalization methods and a machine learning approach, Systematical Error Removal using Random Forest (SERRF), using multi-omics datasets generated from the same experiment—even from the same cell lysate. Objectives To develop a straightforward process to assess normalization effects and identify the most robust methods across multi-omics datasets. Methods We analyzed metabolomics, lipidomics, and proteomics datasets from primary human cardiomyocytes and motor neurons exposed to acetylcholine-active compounds over time. Normalization effectiveness was evaluated based on improvement in QC features consistency and observing the change in treatment and time-related variance. Results Probabilistic Quotient Normalization (PQN) and Locally Estimated Scatterplot Smoothing (LOESS) QC were identified as optimal for metabolomics and lipidomics, while PQN, Median, and LOESS normalization excelled for proteomics. These methods consistently enhanced QC feature consistency in metabolomics and lipidomics, and preserved time-related variance or treatment-related variance in proteomics, demonstrating their effectiveness and robustness. SERRF normalization, applied only to metabolomics in this study, outperformed other methods in some datasets but inadvertently masked treatment-related variance in others. Conclusion Our evaluation identified PQN and LoessQC as the top methods for metabolomics and lipidomics, and PQN, Median, and Loess normalization for proteomics, in multi-omics integration in a temporal study.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2026

Systematic Evaluation of Atmospheric Forcing, Surface Datasets, and Mesh Effects on Kilometer-Scale Land Surface and River Modeling

Earth system models are advancing toward kilometer-scale resolution to capture local climate impacts and extremes. High-resolution land and river modeling depends on multiple factors, including mesh, surface datasets, and atmospheric forcing, but their relative effects at kilometer scales remain unquantified. We evaluated five Energy Exascale Earth System Model land and river configurations over the Mid-Atlantic region using two mesh (1/8° structured versus variable-resolution unstructured mesh), two surface datasets (default versus newly developed), and three atmospheric forcings (NLDAS2, MSWX, GSWP). Evaluation against satellite, reanalysis, and in situ benchmarks across water, energy, and carbon cycles quantifies how these factors affect model performance. Forcing selection produces the largest bias reductions (12-99% across variables), followed by surface datasets (7-75%) and mesh (up to 21%). Forcing effects vary by variable, with MSWX reducing biases for snow water equivalent, evapotranspiration, albedo, temperature, and gross primary productivity, GSWP for snow cover and runoff, and NLDAS for soil moisture and streamflow. The use of newly developed surface datasets improves gross primary productivity (58% bias reduction) and evapotranspiration but increase soil moisture and albedo biases due to current modeling limitations. Variable-resolution unstructured mesh improves the simulation of small-basin streamflow through better capturing drainage networks, though mesh minimally affects other land variables. These findings provide important guidance for high-resolution modeling development and actionable science.

Land and River modeling↗
DOE OSTI2025

Comprehensive defect evaluation of advanced nuclear fuels using high-resolution acoustic signals and optimized sensor separation

Graphite pebble composite structures based on TRistructural-ISOtropic (TRISO) particles are being developed as core nuclear fuels in advanced power reactors, promising safe operation at increased temperatures. Ensuring the structural integrity of these nuclear fuels requires comprehensive and accurate non-destructive evaluation (NDE) techniques to characterize defects and damage in the pebbles. However, traditional acoustic evaluation methods face limitations in defect characterization due to the highly attenuative, and geometrically and compositionally complex nature of these structures. This study proposes an improved acoustic NDE technique for accurate detection and classification of anticipated relevant defects and damage in graphite pebbles using high-resolution acoustic signals and optimized transmit-receive sensor networks. The proposed approach utilizes a triangular three-sensor network as the base unit, comprising three transmit-receive sensors. The sensor separation distance, as well as acoustic excitation center frequency, pulse-width, and bandwidth are optimized to enhance spatial resolution and improve signal-to-noise ratio, enabling effective characterization of the smallest size and widest range of defects in pebbles. Furthermore, the use of the triangular sensor configuration instead of a more conventional transmit-receive sensor pair expands the inspection region from a one-dimensional linear path to a two-dimensional area, increasing spatial coverage. To mitigate challenges associated with processing of complex acoustic signals arising from high-frequency, high-bandwidth excitation in these structures, a machine-learning-based signal processing algorithm is integrated with the sensor network. In the machine-learning-based algorithm, multi-domain features are extracted from the acoustic signals to capture intricate signal characteristics, significantly improving defect identification and classification compared to traditional approaches. The proposed acoustic NDE technique offers considerable promise for practical and reliable defect/damage diagnostics of advanced nuclear pebble fuels.

42 ENGINEERING↗
DOE OSTI2026

Integrating three plan evaluation approaches for coordinated heat resilience in cities across the Arizona urban corridor

Increasing heat poses a growing threat to cities worldwide due to both climate change and the urban heat island effect. While heat planning and governance are still emergent, research suggests that silos and conflicts within cities' networks of plans often impede heat resilience. Integrated heat resilience planning, therefore, requires a systematic and comprehensive analysis of the silos and conflicts relevant to heat resilience within networks of plans. This study is the first to combine three complementary plan evaluation methods to assess how cities' networks of plans address heat resilience. We applied 1) plan cross-referencing, 2) Plan Quality Evaluation for Heat Resilience, and 3) Plan Integration for Resilience Scorecard™ (PIRS™) for Heat to 19 plans from seven Arizona cities. We find similarities and differences in how these cities' networks of plans address heat hazards. The plans have consistently high-quality participation and coordination principles but lack details on vulnerability and climate change uncertainty, suggesting a need to move beyond immediate heat risks. We also identify opportunities to diversify policy mechanisms, spatially target high heat risk areas, and enhance the connection between planning efforts. These results validate that plan elements are interlinked and the importance of integrative plan development processes to improve heat resilience.

Extreme heat↗
DOE OSTI2026

Evaluation of daily gridded climate products using in situ FLUXNET data and tree growth modeling

Gridded climate data products have facilitated research in climate and ecology by providing meteorological data continuously across large spatial scales. However, the sensitivity of scientific outcomes to dataset choice remains poorly understood, and evaluation using station-based records can favor datasets built heavily on weather stations. Here, we evaluate seven high-resolution daily gridded datasets covering the contiguous United States using independent meteorology from the FLUXNET2015 dataset, with a focus on the implications of dataset choice for process-based tree growth modeling. We find that gridded products tend to capture temperature accurately while consistently overestimating the magnitude and frequency of precipitation and its extremes. Moreover, datasets vary in how they define a ‘day,’ which significantly affects temporal alignment with FLUXNET2015 observations. Despite differences among the datasets, the interannual variability in tree ring simulations is insensitive to dataset choice, likely because daily-scale biases are averaged out through accumulated growth across several months. However, inaccuracies in temperature and precipitation can significantly bias modeled xylem cell production, with systematically higher annual precipitation in the gridded datasets leading to greater xylem production compared to simulations using in situ data. Our results suggest that model applications, especially those that integrate to time scales longer than one day, are likely insensitive to climate dataset choice, but applications that are sensitive to daily climate variations or to absolute climate values need to carefully consider biases in gridded climate products.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Performance Evaluation of Multi-Vendor Grid-Forming Inverters for Grid-Connected Operation Through Hardware Experimentation: Preprint

Existing real-world projects of GFM inverters that operate in parallel to power grids typically are sized between dozens and a few hundreds Megawatt (MW) scale according to a recent NERC GFM inverter white paper. These large systems are often difficult to evaluate prior to deployments because of their large size. The performance of smaller GFM inverters (dozens to a few hundreds MW) that operate parallel with power grids (distribution systems) is even less understood. There is an opportunity to better understand these systems through hardware testing under controlled laboratory conditions. Therefore, this paper presents the functional performance evaluation tests of multiple (three) commercial GFM inverters when they operate in parallel with the grid through hardware experiments. The goal of these tests is to explore the GFM inverters' functionalities and dynamic response when in parallel with power grids to eventually develop universal specifications for GFM inverters. Both steady state (changing the inverter's frequency and voltage droop) and transient (adding step change in grid's frequency/voltage) tests are performed for each GFM inverter with the same testing circuit and testing protocol. The experimental results indicate the bench-marked performance that: 1) the GFM inverters can be dispatched through frequency and voltage droop intercepts to output the target power when paralleled to the grid; 2) the GFM inverters automatically respond to system frequency and voltage events to output the needed power, however, the GFM inverters all show stability issues when absorbing reactive power from the grid.

grid-forming inverters↗
DOE OSTI2024

Performance evaluation of the USGS velocity model for the San Francisco Bay Area

In this study, we evaluated the performance of the United States Geological Survey velocity model developed for the San Francisco Bay Area (SFBA), version 21.1. The evaluation was performed through high-resolution three-dimensional physics-based ground motion simulations of seven small-magnitude earthquakes (ranging from magnitude 3.8 to 4.4) that occurred on the eastern side of the San Francisco Bay. The simulations were performed in the frequency range from 0 to 5 Hz with a minimum shear-wave velocity of 250 m/s, which allowed the capture of wave propagation effects of the near-surface soft materials that characterize local basins. Based on the direct comparison of Fourier amplitude spectra between recorded and simulated ground motions for more than 250 stations, we found that the velocity model generally performs well in the frequency range of 0.2–5 Hz. The median value of the Fourier amplitude residuals was found to be near zero for all seven earthquakes. The slight over-prediction of 0.2 log-natural units at frequencies above 3 Hz in our simulations was attributed to the potentially inaccurate representation of the source radiation pattern by a double-couple point source model, and simple representation of shallow small-scale underground structural complexity in the velocity model. Maps of spectral amplitude differences between the simulated and recorded data were used to identify areas responsible for systematic ground motion over-predictions or under-predictions. For example, while some sub-domains over soft sediments show over-prediction patterns, the block east of the Hayward fault is prone to exhibit patterns of under-prediction. These maps can be used to guide future refinements of the SFBA velocity model. Since our simulation methodology allows for the decoupling of the source and wave propagation effects, the ground motion data generated by our simulations can also be used to quantify the epistemic uncertainty due to the velocity model, in empirically based ground motion estimates for the SFBA.

58 GEOSCIENCES↗
DOE OSTI2024

An Evaluation Framework for State Energy Offices' Energy Efficiency and Clean Energy Workforce Programs

Historic levels of funding for energy efficiency and clean energy projects from the Bipartisan Infrastructure Law and Inflation Reduction Act will be flowing through State Energy Offices (SEOs) in the coming years, including funds specifically for supporting workforce development efforts. This report offers a workforce evaluation framework that they can use to track and measure the progress, performance, and effectiveness of energy efficiency and clean energy workforce programs that they fund and/or implement. This evaluation step is essential to ensuring that SEOs' workforce efforts remain relevant to the evolving needs of the energy efficiency and clean energy sector and advance a workforce that is inclusive and diverse thus maximizing the success of their programs.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗