Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation of test systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

SVM-Based Synchronized Fault Detection for 100% Renewable Microgrids

Traditional protection schemes face significant challenges when applied to microgrids with high penetrations of renewables with inverter-based resources (IBRs). The proliferation of advanced sensing and communication technologies has generated copious data, offering an opportunity to overcome these limitations using data-driven machine learning approaches. This work proposes a novel approach based on a support vector machine (SVM) for detecting faults within a 100% renewable microgrid. The approach encompasses a systematic offline training stage for the development of a linear SVM-based fault detection algorithm. This process covers offline data collection from the microgrid under study, the extraction of features such as positive- and negative-sequence components and the total harmonic distortion of the voltage and current measurements of the relays, and the design of the linear SVM-based classifier. During the online implementation, however, different classifiers can exhibit asynchronicity in detecting the fault inception at different subcycle-to-cycle period-level delays. To circumvent this asynchronicity issue, a separate algorithm is developed for each relay to estimate the fault inception time as close to the real fault time. The performance of the proposed SVM-based synchronized fault detection method is evaluated using online time-domain simulation studies on a microgrid test system. The results corroborate the reliability of the fault detection scheme when tested under various fault cases (fault types, locations, and impedances) and non-fault cases during both grid-tied and islanded operation modes.

100% microgrid↗

Feature Based Qualification (FBQ) of Wire Arc Additively Manufactured (WAAM) 17-4PH Martensitic Stainless Steels

The Department of Defense (DOD) programs of records desire to reduce the time and cost of the development and delivery loop in metal additive manufacturing (AM), including establishing forwarded AM capabilities. The success of these efforts relies on a robust and qualified process. To achieve this, the United States Army Combat Capabilities Development Command Ground Vehicle Systems Center Materials Engineering (GVME) needs to be able to quickly evaluate, test, and develop feedstocks, processes, and parts. This report is directed towards demonstrating the need for a framework for metal AM processes, defining and exploring geometries for metal AM process qualification, testing resultant deposition, and delivering actionable data.

36 MATERIALS SCIENCE↗

SVM-Based Synchronized Fault Detection for 100% Renewable Microgrids: Preprint

Traditional protection schemes face significant challenges when applied to microgrids with high penetrations of renewables with inverter-based resources (IBRs). The proliferation of advanced sensing and communication technologies has generated copious data, offering an opportunity to overcome these limitations using data-driven machine learning approaches. This work proposes a novel approach based on a support vector machine (SVM) for detecting faults within a 100% renewable microgrid. The approach encompasses a systematic offline training stage for the development of a linear SVM-based fault detection algorithm. This process covers offline data collection from the microgrid under study, the extraction of features such as positive- and negative-sequence components and the total harmonic distortion of the voltage and current measurements of the relays, and the design of the linear SVM-based classifier. During the online implementation, however, different classifiers can exhibit asynchronicity in detecting the fault inception at different subcycle-to-cycle period-level delays. To circumvent this asynchronicity issue, a separate algorithm is developed for each relay to estimate the fault inception time as close to the real fault time. The performance of the proposed SVM-based synchronized fault detection method is evaluated using online time-domain simulation studies on a microgrid test system. The results corroborate the reliability of the fault detection scheme when tested under various fault cases (fault types, locations, and impedances) and non-fault cases during both grid-tied and islanded operation modes.

100% microgrid↗

Interregional Transmission Operational Coordination (IRTOC)

This report presents a modeling and evaluation framework developed through the Inter-Regional Transmission Operational Coordination (IRTOC) project to study market-to-market (M2M) congestion management across day-ahead and real-time markets. The framework extends the Sienna platform through Sienna Decomposition, a multi-stage evaluation architecture that enables flexible representation of multiple regions and systematic assessment of alternative market coordination designs. Additional modeling capabilities include reserve deliverability constraints, High-Voltage Direct Current (HVDC) optimization for Alternating Current (AC) congestion management, and several real-time distributed coordination algorithms. Case studies using the RTS-GMLC test system and a large-scale Eastern Interconnection model demonstrate that the framework can evaluate alternative coordination structures and quantify their economic and operational impacts. The proposed framework provides a scalable platform for analyzing inter-regional coordination strategies in large-scale electricity markets.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

The Tribomechadynamics Research Challenge: Confronting blind predictions for the linear and nonlinear dynamics of a thin-walled jointed structure with measurement results

The present article summarizes the submissions to the Tribomechadynamics Research Challenge announced in 2021. The task was a blind prediction of the vibration behavior of a system comprising a thin plate clamped on two sides via bolted joints. Both geometric and frictional contact nonlinearities are expected to be relevant. Provided were the CAD models and technical drawings of all parts as well as assembly instructions. The main objective was to predict the frequency and damping ratio of the lowest-frequency mode as function of the amplitude. Many different prediction approaches were pursued, ranging from well-known methods to very recently developed ones. After the submission deadline, the system has been fabricated and tested. The aim of this article is to evaluate the current state of the art in modeling and vibration prediction, and to provide directions for future methodological advancements.

42 ENGINEERING↗

Implementation of WBG devices in circuits - Electric Drive Technologies Project (Final Technical Report)

The objective of the project is to ensure that SiC devices are reliable and rugged as required in automotive applications for operational life of 300,000 hrs and create new device designs to address various weaknesses in currently available commercial devices. OSU has worked closely with SUNY Polytechnic. OSU has carried out the reliability and ruggedness evaluations of commercial devices as well as those fabricated by SUNY Polytechnic, discussed the results with SUNY Poly, and collaborated with the PI at SUNY Poly to improve the designs with respect to reliability/ruggedness. OSU work focused on reliability/ruggedness evaluation of SiC devices by individually testing them and then evaluate them in a 10 kW, 3 phase inverter system built with a specific purpose of stressing devices using realistic drive cycles such as a 10-minute hill climb. It should be noted that the primary purpose of the 10 kW inverter is to provide a platform for stressing the SiC devices under accelerated but realistic drive conditions.

33 ADVANCED PROPULSION SYSTEMS↗

Integration of a thermoelectric subcooler with an air‑source heat pump to enhance heating capacity and dehumidification

This study presents an innovative configuration of a thermoelectric subcooler (TES) integrated with an air-source heat pump (ASHP). The TES is installed in the liquid line, where it absorbs heat from the refrigerant. On its hot side, it discharges heat to the return air in heating mode or to the supply air in cooling mode, enabling year-round operation. The ASHP–TES system was evaluated under various conditions to reduce supplemental heating needs and improve dehumidification. Experimental heating tests revealed that activating the TES increased the heating capacity by 12%–20%. However, this occurred with a 7.6%–10% reduction in heating coefficient of performance (COP). In cooling mode, TES operation significantly improved moisture removal. The TES reduced the sensible heat ratio (SHR) and enhanced dehumidification, removing 20%–50% more moisture than a conventional system when meeting the same sensible load. The TES can be turned off to use the refrigerant subcooler for reheat supply air or turned on to substantially boost dehumidification. When meeting the same latent load, the ASHP–TES system achieved up to 33% energy savings compared with a conventional ASHP using resistance heating. Relative to a conventional ASHP paired with a whole-house dehumidifier, the ASHP–TES system provided up to 20% energy savings. These findings underscore the potential of TES integration to improve latent load control and enhance overall energy efficiency in hybrid ASHP systems, especially in cold and humid climates.

Hu, Yifeng [ORNL] (ORCID:0000000242875185)↗

Solar Energy Technical Publications Catalog: Solar Thermal Technology

The research and development described in these documents was conducted within the U.S . Department of Energy's (DOE) Solar Thermal Technology Program. The goal of this program is to advance the engineering and scientific understanding of solar thermal technology and to establish the technology base from which private industry can develop solar thermal power production options for introduction into the competitive energy market. Solar thermal technology concentrates the solar flux using tracking mirrors or lenses onto a receiver where the solar energy is absorbed as heat and converted into electricity or incorporated into products as process heat. The two primary solar thermal technologies, central receivers and distributed receivers, employ various point and line-focus optics to concentrate sunlight. Current central receiver systems use fields of heliostats (two-axis tracking mirrors) to focus the sun's radiant energy onto a single, tower- mounted receiver. Point focus concentrators up to 17 meters in diameter track the sun in two axes and use parabolic dish mirrors or Fresnel lenses to focus radiant energy onto a receiver. Troughs and bowls are line-focus tracking reflectors that concentrate sunlight onto receiver tubes along their focal lines. Concentrating collector modules can be used alone or in a multimodule system. The concentrated radiant energy absorbed by the solar thermal receiver is transported to the conversion process by a circulating work fluid. Receiver temperatures range from l00 degrees C in low-temperature troughs to over 1500 degrees C in dish and central receiver systems. The Solar Thermal Technology Program is directing efforts to advance and improve each system concept through solar thermal materials, components, and subsystems research and development and by testing and evaluation. These efforts are carried out with the technical direction of DOE and its network of field laboratories that works with private industry. Together they have established a comprehensive, goal-directed program to improve performance and provide technically proven options for eventual incorporation into the nation's energy supply. To successfully contribute to an adequate energy supply at reasonable cost, solar thermal energy must be economically competitive with a variety of other energy sources. The Solar Thermal Technology Program has developed components and system-level performance targets as quantitative program goals. These targets are used in planning research and development activities, measuring progress, assessing alternative technology options, and developing optimal components. These targets are pursued vigorously to ensure a successful program. This catalog represents part of an effort to provide information on publications about solar thermal research and development activities conducted by DOE's laboratories. Publications listed include technical and research reports and special publications. The following national laboratories are represented in this edition: Sandia National Laboratories, Solar Energy Research Institute, Jet Propulsion Laboratory. This catalog is a product of the DOE Solar Technical Information Program, which is dedicated to providing information to scientific and industrial users in ways most convenient and useful to them. This catalog focuses on solar thermal technologies, and its purpose is to keep the scientific and industrial communities informed of the latest developments in federally sponsored research in this technology.

140000* -- Solar Energy↗

Improving thermodynamic nudging in the E3SM Atmosphere Model version 2 (EAMv2): strategy and hindcast skills on weather systems

Nudging techniques are commonly employed to constrain atmospheric simulations toward observed states, facilitating model evaluation and sensitivity studies. However, if applied improperly – particularly to thermodynamic variables such as temperature and humidity – nudging can distort physical processes and introduce spurious biases, undermining the credibility of the simulations. This study presents an improved nudging implementation that applies vertically modulated tendencies to reduce adverse impacts on model physics. The framework is tested in version 2 of the Energy Exascale Earth System Model (EAMv2) using a suite of hindcast simulations nudged toward ERA5 reanalysis. We systematically evaluate the individual and combined effects of nudging wind, temperature, and humidity fields on the model's ability to represent large-scale atmospheric states and high-impact weather systems. Results show that the revised strategy – particularly when nudging temperature and humidity at selected levels – enhances hindcast skill by improving agreement with ERA5 without degrading the hydrological cycle or precipitation processes. Additional improvements in surface temperature, outgoing longwave radiation, and precipitation biases are achieved through targeted nudging of land-surface variables. The proposed approach strengthens the representation of large-scale conditions relevant to tropical cyclones, atmospheric rivers, and extratropical cyclones in the low-resolution EAMv2. These findings demonstrate that carefully designed thermodynamic nudging, especially of temperature and humidity, improves the realism of constrained simulations and broadens the utility of nudged EAMv2 for atmospheric modeling, machine learning, and high-impact weather research.

Atmospheric river↗

Lab Evaluation of Downward Capacity of Radiant Ceiling Panel Systems

This project investigated the cooling delivery effectiveness of radiant ceiling panels as a function of attic insulation level using multiple laboratory testing and analytical methodologies. Delivery effectiveness is the heating or cooling energy delivered to a conditioned space divided by the total heating or cooling energy added or removed by the space conditioning system. The lower the losses of the heating or cooling delivery method, the higher the delivery effectiveness. For ducted systems, delivery effectiveness is reduced by both air leakage and thermal losses (especially if the ducts are installed in attics), while the delivery effectiveness of a radiant system supplied by hot and cold water is only reduced by thermal losses, which can be mitigated by sufficient insulation above, or at the "back" of the panel. Being installed at or below the ceiling plane, sufficient back insulation should be provided by default in the form of the attic insulation above the radiant ceiling panels. Site-built radiant ceiling panels were evaluated at Frontier Energy’s Building Science Research Laboratory (BSRL) in a uniquely designed environmental test chamber with independently controllable indoor and attic spaces and a height-adjustable ceiling.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Scan2Sim: Software to Convert Network Scans to Emulations

Within operational technology (OT) systems design, the construction of testing environments for simulation is often a tedious, manual process that slows down safety and security evaluations. This document details the design and functionality of Scan2Sim, a program designed to construct high-fidelity topological schematics for OT systems without significant manual human input. Scan2Sim may take as input a detailed network scan of a system, and produces an instruction set to re-create the original scanned network within a virtualized simulation network. This construction is achieved via heuristic methods of machine template selection, which allows for a fast, performant approach to automated environment construction. The current tool is designed to produce topology schematics compatible with the Minimega, a tool designed by Sandia National Laboratories for repeatable experimentation management.

97 MATHEMATICS AND COMPUTING↗

Long-Range Biometric Identification in Real World Scenarios: A Comprehensive Evaluation Framework Based on Missions

The considerable body of data available for evaluating biometric recognition systems in Research and Development (R&D) environments has contributed to the increasingly common problem of target performance mismatch. Biometric algorithms are frequently tested against data that may not reflect the real world applications they target. From a Testing and Evaluation (T&E) standpoint, this domain mismatch causes difficulty assessing when improvements in State-of-the-Art (SOTA) research actually translate to improved applied outcomes. This problem can be addressed with thoughtful preparation of data and experimental methods to reflect specific use-cases and scenarios.To that end, this paper evaluates research solutions for identifying individuals at ranges and altitudes, which could support various application areas such as counterterrorism, protection of critical infrastructure facilities, military force protection, and border security. We address challenges including image quality issues and reliance on face recognition as the sole biometric modality. By fusing face and body features, we propose developing robust biometric systems for effective long-range identification from both the ground and steep pitch angles. Preliminary results show promising progress in whole-body recognition. This paper presents these early findings and discusses potential future directions for advancing long-range biometric identification systems based on mission-driven metrics.

Aykac, Deniz↗

Predicting the von Neumann entanglement entropy using a graph neural network

Calculating the von Neumann entanglement entropy from experimental data is challenging due to its dependence on the complete wavefunction, forcing reliance on approximations such as classical mutual information (MI). We propose a machine learning approach using a graph neural network to predict the von Neumann entropy directly from experimentally accessible bitstrings. We test this approach on a Rydberg ladder system and achieve a mean absolute error of $3.6\,\times 10^{-3}$ when evaluating within the training range on a dataset with entropy values ranging from 0 to 1.9. The model achieves a mean absolute percentage error of 1.44% and outperforms MI-based bounds. When tested beyond the training range, the model maintains reasonable accuracy. Furthermore, we demonstrate that fine-tuning the model with small datasets significantly improves performance on data outside the original training range.

graph neural networks↗

Study of the Protection Improvements for a Weak Grid Area With High Inverter-Based Resources (IBRs)

This project designs enhanced protection scheme for the real-world weak grid area with a high penetration of IBRs. As the existing protection schemes are originally designed for traditional synchronous machines, we first evaluate if the protection scheme will continue to operate reliably in systems with high levels of IBRs. Hardware relays are tested using a controller-hardware-in-the-loop setup. PSCAD electromagnetic transient simulation with IBR original equipment manufacturer black-box models is used to perform fault studies and generate COMTRADE data, which are replayed by a real-time digital simulator (RTDS) to feed input to the hardware relays. Three scenarios are analyzed: normal operation, an N-1 contingency, and an IBR-only scenario. The evaluation results reveal the following: 1) the protection scheme remains reliable under normal conditions and N-1 contingencies and 2) in IBR-only scenarios, differential protection (87L) continues to operate reliably, whereas local protection elements, such as distance and directional elements, fail because of the lack of regulated negative sequence current contributed by IBRs. Enhanced protection is designed to address the challenge of lack of negative sequence current from IBRs, including increased restraining factors a2 and k2 to block 32Q or using V instead QV ORDER for ground faults, enhanced mho distance element with voltage and phase angle supervision for L-L faults. The efficacy of enhanced protection logic is validated and proven to work reliably. Additionally, IEEE Std. 2800-2022 negative sequence current compliant GFL and GFM IBRs from another vendor are tested and proven to work reliably without need for enhanced logic. Therefore, this work provides valuable decision-making for utilities facing protection system challenges due to IBRs, either designing enhanced protection scheme or requesting their IBRs being IEEE Std. 2800-2022 compliant to produce regulated negative sequence current for protection relay to make correct decision.

24 POWER TRANSMISSION AND DISTRIBUTION↗

2023 Reftek Colt Seismometer Exploratory Evaluation

Sandia National Laboratories has tested and evaluated three Colt broadband seismometers designed and manufactured by Reftek. The purpose of this seismometer evaluation is to measure performance characteristics in areas such as power consumption, sensitivity, frequency response, full scale, self-noise, dynamic range, calibration system response, and passband. The Colt model of sensors are being evaluated to explore the potential for a future seismometer Type Approval process in the International Monitoring System (IMS) of the Comprehensive Nuclear-Test-Ban Treaty (CTBT).

47 OTHER INSTRUMENTATION↗

dCache CI/CD migration to Kubernetes

For over two decades, the dCache project has provided open-source to satisfy ever-more demanding storage requirements. More than 80 sites worldwide rely on dCache to provide services for LHC experiments, Belle-II, Eu- XFEL, and others. This can be achieved only with a well-established process from a whiteboard, where ideas are created through development, packaging, and testing. The project’s build and test infrastructure is based on Jenkins CI and a set of virtual machines. This infrastructure is maintained by dCache developers. With the introduction of the DESY-central Gitlab server, the developers have started migrating from VM-based testing to container-based deployments in the onsite Kubernetes cluster. As a result, we have packaged dCache containers and Helm charts that can be used by other sites to reproduce our test and build steps quickly or to evaluate new releases on their pre-production systems and, eventually, become a standard model of dCache deployment at the sites. This paper describes the challenges we have faced, the techniques we used to solve them, and the issues that still need to be addressed.

Mkrtchyan, Tigran [DESY]↗

On the Impact of High-Order Harmonic Generation in Electrical Distribution Systems

The modern power grid has seen a rise in the integration of non-linear loads, presenting a significant concern for operators. These loads introduce unwanted harmonics, leading to potential issues such as overheating and improper functioning of circuit breakers. In pursuing a more sustainable grid, the adoption of electric vehicles (EVs) and photovoltaic (PV) systems in residential networks has increased. Understanding and examining the effects of high-order harmonic frequencies beyond $1.5$ kHz is crucial to understanding their impact on the operation and planning of electrical distribution systems under varying nonlinear loading conditions. This study investigates a diverse set of critical power electronic loads within a household modeled using PSCAD/EMTdc, analyzing their unique harmonic spectra. This information is utilized to run the time-series harmonic analysis program in OpenDSS on a modified IEEE 34 bus test system model. The impact of high-order harmonics is quantified using metrics that evaluate total harmonic distortion (THD), transformer harmonic-driven eddy current loss component, and propagation of harmonics from the source to the substation transformer.

Peerzada, Aaqib A. [BATTELLE (PACIFIC NW LAB)]↗

Scalable DAQ system operating the CHIPS-5 neutrino detector

The CHIPS R&D project focuses on development of low-cost water Cherenkov neutrino detectors through novel design strategies and resourceful engineering. This work presents an end-to-end DAQ solution intended for a recent 5 kt CHIPS prototype, which is largely based on affordable mass-produced components. Much like the detector itself, the presented instrumentation is composed of modular arrays that can be scaled up and easily serviced. A single such array can carry up to 30 photomultiplier tubes (PMTs) accompanied by electronics that generate high voltage in-situ and deliver time resolution of up to 0.69 ns. In addition, the technology is compatible with the White Rabbit timing system, which can synchronize its elements to within 100 ps. While deployment issues did not permit the presented DAQ system to operate beyond initial evaluation, the presented hardware and software successfully passed numerous commissioning tests that demonstrated their viability for use in a large-scale neutrino detector, instrumented with thousands of PMTs.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗