Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation of test systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

2023 Reftek Colt Seismometer Exploratory Evaluation

Sandia National Laboratories has tested and evaluated three Colt broadband seismometers designed and manufactured by Reftek. The purpose of this seismometer evaluation is to measure performance characteristics in areas such as power consumption, sensitivity, frequency response, full scale, self-noise, dynamic range, calibration system response, and passband. The Colt model of sensors are being evaluated to explore the potential for a future seismometer Type Approval process in the International Monitoring System (IMS) of the Comprehensive Nuclear-Test-Ban Treaty (CTBT).

47 OTHER INSTRUMENTATION↗

dCache CI/CD migration to Kubernetes

For over two decades, the dCache project has provided open-source to satisfy ever-more demanding storage requirements. More than 80 sites worldwide rely on dCache to provide services for LHC experiments, Belle-II, Eu- XFEL, and others. This can be achieved only with a well-established process from a whiteboard, where ideas are created through development, packaging, and testing. The project’s build and test infrastructure is based on Jenkins CI and a set of virtual machines. This infrastructure is maintained by dCache developers. With the introduction of the DESY-central Gitlab server, the developers have started migrating from VM-based testing to container-based deployments in the onsite Kubernetes cluster. As a result, we have packaged dCache containers and Helm charts that can be used by other sites to reproduce our test and build steps quickly or to evaluate new releases on their pre-production systems and, eventually, become a standard model of dCache deployment at the sites. This paper describes the challenges we have faced, the techniques we used to solve them, and the issues that still need to be addressed.

Mkrtchyan, Tigran [DESY]↗

On the Impact of High-Order Harmonic Generation in Electrical Distribution Systems

The modern power grid has seen a rise in the integration of non-linear loads, presenting a significant concern for operators. These loads introduce unwanted harmonics, leading to potential issues such as overheating and improper functioning of circuit breakers. In pursuing a more sustainable grid, the adoption of electric vehicles (EVs) and photovoltaic (PV) systems in residential networks has increased. Understanding and examining the effects of high-order harmonic frequencies beyond $1.5$ kHz is crucial to understanding their impact on the operation and planning of electrical distribution systems under varying nonlinear loading conditions. This study investigates a diverse set of critical power electronic loads within a household modeled using PSCAD/EMTdc, analyzing their unique harmonic spectra. This information is utilized to run the time-series harmonic analysis program in OpenDSS on a modified IEEE 34 bus test system model. The impact of high-order harmonics is quantified using metrics that evaluate total harmonic distortion (THD), transformer harmonic-driven eddy current loss component, and propagation of harmonics from the source to the substation transformer.

Peerzada, Aaqib A. [BATTELLE (PACIFIC NW LAB)]↗

Scalable DAQ system operating the CHIPS-5 neutrino detector

The CHIPS R&D project focuses on development of low-cost water Cherenkov neutrino detectors through novel design strategies and resourceful engineering. This work presents an end-to-end DAQ solution intended for a recent 5 kt CHIPS prototype, which is largely based on affordable mass-produced components. Much like the detector itself, the presented instrumentation is composed of modular arrays that can be scaled up and easily serviced. A single such array can carry up to 30 photomultiplier tubes (PMTs) accompanied by electronics that generate high voltage in-situ and deliver time resolution of up to 0.69 ns. In addition, the technology is compatible with the White Rabbit timing system, which can synchronize its elements to within 100 ps. While deployment issues did not permit the presented DAQ system to operate beyond initial evaluation, the presented hardware and software successfully passed numerous commissioning tests that demonstrated their viability for use in a large-scale neutrino detector, instrumented with thousands of PMTs.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Evaluation of the Turbine Integrated Mortality Reduction (TIMR SM ) Technology as a Smart Curtailment Approach (Final Summary Report)

Wind energy is a crucial technology for achieving net-zero emissions by 2050. However, the growth and deployment of wind energy in North America have led to the deaths of many bat species due to operating wind turbines. Hundreds of thousands of bats are estimated to die at wind turbines annually in North America. Operational minimization, which includes feathering turbine blades and curtailment, has been documented to reduce bat fatality effectively. Curtailment refers to altering turbine operation based on wind speed, time of year, temperature, sensors, and activity models. However, when turbines are curtailed, they do not generate power, resulting in energy loss and revenue for wind energy facilities. The Electric Power Research Institute (EPRI) funded the development of Turbine Integrated Mortality Reduction (TIM SM ) Technology, which curtails turbine operation when bats are detected. The initial TIMR system research showed promising results, with an 85% reduction in overall bat fatalities and a 91% reduction for the little brown bat. However, these results were based on a single site during one fall season, and it was unclear if similar results could be replicated at other wind energy facilities. This research aimed to validate the TIMR system results from the prior field study at a second site in the U.S., estimate the power production and reduction in bat mortality at turbines with installed TIMR systems relative to blanket curtailment and fully operational turbines, test the TIMR system in two calendar years and during the summer and fall periods, and evaluate the operational and commercial characteristics of the TIMR system for potential wind industry adoption. The study was conducted at a 500.9-MW wind energy facility in southeast Adair County, Iowa. Three experimental treatments were involved in this randomized block design study: TIMR, Curtailment at 5.0 m/s, and Normal Operation. In 2021, three treatments were used at 18 turbines, expanding to four treatments across 36 turbines in 2022. The TIMR system worked as designed throughout the entire study; however, because of unexpected wind turbine operational challenges in 2021, there was not sufficient sample size to evaluate the treatment differences. In 2022, there were significant differences in fatality levels between treatment types and normal operating turbines. Curtailment at 5.0 m/s reduced fatalities by 30.8% compared to normal operations, and TIMR decreased fatalities by 48.6% compared to normal operations. Two different methods were used to evaluate the differences in energy loss for each treatment. The TIMR system resulted in 1.3% to 1.6 % annual energy loss in 2021 and 1.0% to 1.2 % in 2022. The Curtailment at 5.0 m/s resulted in 0.6% to 0.8 % annual energy loss in 2021 and 0.5% to 0.6 % in 2022. The project achieved all the stated objectives and demonstrated that TIMR is an effective technology that balances bat fatality reduction with energy generation. The results will support the deployment of TIMR and other acoustic sensor-based technologies. The research provides valuable insights into the impact of different treatments on fatality rates and energy outputs, contributing to the ongoing efforts to mitigate the environmental impact of wind energy.

17 WIND ENERGY↗

2023 Reftek Wrangler Digitizer Type Approval Evaluation

Sandia National Laboratories has tested and evaluated the Reftek Wrangler digitizer. The Wrangler digitizers are intended to record sensor output for seismic and infrasound monitoring applications. The purpose of this digitizer evaluation is to measure the performance characteristics in such areas as power consumption, input impedance, sensitivity, full scale, self-noise, dynamic range, system noise, response, passband, and timing. The Wrangler digitizers are being evaluated for potential use in the International Monitoring System (IMS) and On-site Inspection (OSI) components of Comprehensive Nuclear-Test-Ban Treaty (CTBT).

58 GEOSCIENCES↗

Controller Hardware-in-the-Loop Evaluation of a Microgrid Controller for a Microgrid System with Multiple Grid-Forming Inverters

This paper presents the laboratory evaluation of a commercial Microgrid Management System (MGMS) implemented in the real-world Bronzeville Microgrid which features a futuristic scenario with high renewable energy integration and the use of multiple Grid-Forming (GFM) inverters. The primary objective of the performance evaluation for the MGMS is to assess the MGMS's capability to dispatch GFM units, including a GFM PV unit and two GFM battery units, to maintain the system stability and ensure economic operation, thus guaranteeing the microgrid's resilience during prolonged outages and dynamic events. The laboratory controller hardware-in-the-loop provides realistic testing environment through detailed electromagnetic transient modeling of the microgrid system, hardware MGMS, and standard communication protocols (DNP3). The CHIL evaluation shows how the MGMS effectively manages the GFM inverters, highlighting its performance in maintaining stability, reliability, and survivability in a microgrid environment with a high penetration of renewable energy sources.

controller hardware-in-the-loop↗

Controller Hardware-in-the-Loop Evaluation of a Microgrid Controller for a Microgrid System with Multiple Grid-Forming Inverters: Preprint

This paper presents the laboratory evaluation of a commercial Microgrid Management System (MGMS) implemented in the real-world Bronzeville Microgrid which features a futuristic scenario with high renewable energy integration and the use of multiple Grid-Forming (GFM) inverters. The primary objective of the performance evaluation for the MGMS is to assess the MGMS's capability to dispatch GFM units, including a GFM PV unit and two GFM battery units, to maintain the system stability and ensure economic operation, thus guaranteeing the microgrid's resilience during prolonged outages and dynamic events. The laboratory controller hardware-in-the-loop provides realistic testing environment through detailed electromagnetic transient modeling of the microgrid system, hardware MGMS, and standard communication protocols (DNP3). The CHIL evaluation shows how the MGMS effectively manages the GFM inverters, highlighting its performance in maintaining stability, reliability, and survivability in a microgrid environment with a high penetration of renewable energy sources.

controller hardware-in-the-loop↗

Controller-Hardware-in-the-Loop Evaluation of a Microgrid Controller for a Microgrid System With Multiple Grid-Forming Inverters

This paper presents the laboratory evaluation of a commercial Microgrid Management System (MGMS) implemented in the real-world Bronzeville Microgrid which features a futuristic scenario with high renewable energy integration and the use of multiple Grid-Forming (GFM) inverters. The primary objective of the performance evaluation for the MGMS is to assess the MGMS's capability to dispatch GFM units, including a GFM PV unit and two GFM battery units, to maintain the system stability and ensure economic operation, thus guaranteeing the microgrid's resilience during prolonged outages and dynamic events. The laboratory controller hardware-in-the-loop provides realistic testing environment through detailed electromagnetic transient modeling of the microgrid system, hardware MGMS, and standard communication protocols (DNP3). This CHIL evaluation shows how the MGMS effectively manages the GFM inverters, highlighting its performance in maintaining stability, reliability, and survivability in a microgrid environment with a high penetration of renewable energy sources.

controller hardware-in-the-loop↗

Secure Time Synchronization in Power Grids and Network HIL Synchrophasor Testing

Reliable and secure time synchronization underpins the monitoring and control functions of modern power grids. As GPS-based timing infrastructures grow more susceptible to spoofing and jamming, their vulnerabilities pose escalating risks to grid stability. This work investigates a secure, resilient timing framework that can serve as an alternative or redundant source for power grids, with a particular focus on synchrophasorbased applications. A candidate timing system architecture is evaluated to guarantee trustworthy time dissemination, even in degraded conditions. A network hardware-in-the-loop testing of two synchrophasors validates the concepts, demonstrating enhanced timing integrity, improved detection of timing anomalies, and sustained observability during adverse timing events.

Wu, Ori [ORNL] (ORCID:0000000326723410)↗

OptiBench: An Optimization Benchmark Tool for Renewable Energy Problems

We propose a benchmark framework and visualization tool, OptiBench, for analyzing the performance of state-of-the-art optimization solvers across a variety of optimization problems in renewable energy research. Our framework is designed from the ground up in the Julia programming language and enables analysis at scale on high performance computing (HPC) systems. Our visualization tool allows effortless evaluation of optimization solver performance, robustness, and accuracy through intuitive plots, e.g., performance profiles, heat maps, and distribution plots. We have tested three benchmark suites relevant to the modeling of renewable energy systems, viz., CUTEst, PGLib-OPF, and WaterTAP water treatment optimization problems. We illustrate benchmarking of CUTEst using OptiBench on the National Renewable Energy Laboratory's (NREL) HPC Kestrel. Our findings indicate that MA57 HSL linear solver demonstrated the best overall performance for an experimental IPOPT implementation. Our work is ongoing and we intend to add support for more optimization solvers and benchmark test suites in the future.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

OptiBench: An Optimization Benchmark Tool for Renewable Energy Problems

We propose a benchmark framework and visualization tool, OptiBench, for analyzing the performance of state-of-the-art optimization solvers across a variety of optimization problems in renewable energy research. Our framework is designed from the ground up in the Julia programming language and enables analysis at scale on high performance computing (HPC) systems. Our visualization tool allows effortless evaluation of optimization solver performance, robustness, and accuracy through intuitive plots, e.g., performance profiles, heat maps, and distribution plots. We have tested three benchmark suites relevant to the modeling of renewable energy systems, viz., CUTEst, PGLib-OPF, and WaterTAP water treatment optimization problems. We illustrate benchmarking of CUTEst using OptiBench on the National Laboratory of the Rockies's (NLR) HPC Kestrel. Our findings indicate that MA57 HSL linear solver demonstrated the best overall performance for an experimental IPOPT implementation. Our work is ongoing and we intend to add support for more optimization solvers and benchmark test suites in the future.

97 MATHEMATICS AND COMPUTING↗

Testing the parametric model for self-interacting dark matter using matched halos in cosmological simulations

Here, we systemically evaluate the performance of the self-interacting dark matter (SIDM) halo model proposed in Ref.Yang et al. (2023) with matched halos from high-resolution cosmological CDM and SIDM simulations. The model incorporates SIDM effects along mass evolution histories of CDM halos and it is applicable to both isolated halos and subhalos. We focus on the accuracy of the model in predicting halo density profiles at z = 0 and the evolution of maximum circular velocity. We find the model predictions agree with the simulations within 10%–50% for most of the simulated (sub)halos, 50%–100% for extreme cases. This indicates that the model effectively captures the gravothermal evolution of the halos with very strong, velocity-dependent self-interactions. For an example application, we apply the model to study the impact of various SIDM scenarios on strong lensing perturber systems, demonstrating its utility in predicting SIDM effects for small-scale structure analyses. Our findings confirm that the model is an effective tool for mapping CDM halos into their SIDM counterparts.

Yang, Daneng [Chinese Academy of Sciences, Nanjing↗

LAMP Technical Readiness Evaluation Report

An internal preliminary evaluation of Critical Technology Elements (CTEs) for the LANSCE Modernization Project (LAMP) was completed in 2023. This included determining corresponding Technical Readiness Levels (TRLs) for all subsystems using the criteria of DOE G 413.3-4A, Technical Readiness Assessment Guide. This revised report includes a summary of the recent design modifications required to meet the project Key Performance Requirements (KPPs), some of which may reduce technical risk to the project. These recent design modifications include: • Further optimization of the low-energy and medium-energy beam transport regions (LEBT and MEBT, respectively), including relocation of various functional elements (ie choppers, kickers, and bunchers). • An additional H - ion source to separate ion-source function based on beam delivery requirements. • A high-repetition-rate pulsed kicker magnet to select/merge the two H ion beams into a common low-energy beam transport. • Modification and further optimization to a more conventional RFQ design. Performance of the RFQ has been optimized to deliver the required three types of beams while meeting the project KPPs. • The addition of a second chopper in the medium-energy beam transport (MEBT) line to reduce the required pulser voltages. The scope of the evaluation was limited to the project Work Breakdown Structure (WBS) elements as defined for the RFQ Injector and Drift Tube Linac (DTL) systems only. Integration of Instrumentation and Controls (I&C) and Safety Systems was not considered, although specific technologies as related to the RFQ and DTL systems were included. Other elements of the project such as Shielding, System Design, Technical Management, and additional facility integration needed to enable off-line testing and pre-installation commissioning were also not evaluated. Each technical subsystem element was evaluated for technical readiness, however, not all were found to meet the criteria for a CTE. Three subsystem elements were determined to meet the CTE criteria. Their associated TRLs are summarized in the table below. These subsystem elements of the project have the lowest technical readiness due to either being new, novel or modified, requiring additional R&D before being capable of meeting the project Key Performance Parameters (KPPs) and subsystem requirements, or present technology exists but has not yet been demonstrated in a relevant environment. All other subsystems were determined to have a TRL of 8, indicating that actual operating systems exist having similar performance requirements as needed for LAMP. Details of the technical readiness evaluation for each subsystem is given in the following sections of this report.

43 PARTICLE ACCELERATORS↗

Durability of ABC Team Wall Assemblies

This study evaluates the long-term hygrothermal durability of four advanced retrofit wall systems using a field test facility located in Hollywood, South Carolina, representative of a mixed-humid coastal climate (Zone 3). The research focuses on assessing the thermal and moisture performance of a baseline wall assembly retrofitted with (1) Tremco/Dryvit prefabricated panel systems (Revitalite and Fedderlite), (2) Reinforced Fiberglass Plastic (RFP) panels developed by Oak Ridge National Laboratory (ORNL), and (3) Vacuum Insulated Panels (VIP) integrated with EPS by Home Innovation Research Labs (HIRL) and ORNL. A baseline wall representing a typical uninsulated wood-frame construction was used for comparison.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Analyzing the Impact of Future Weather Data on Energy Consumption in Weatherization Assistant

This study supports the mission of the U.S. Department of Energy’s Weatherization Assistance Program (WAP), which aims to increase the energy efficiency of dwellings and reduce their total residential expenditures. Specifically, we examine how projected future climate conditions may affect residential building energy performance by integrating future weather data into the National Energy Audit Tool (NEAT). Since WAP evaluates the cost-effectiveness of retrofit measures over lifespans of up to 30 years, accounting for evolving climate conditions is increasingly important. To reflect future household energy demands, this study replaces historically based Typical Meteorological Year (TMY3) weather inputs with Future Typical Meteorological Year (fTMY) datasets derived from global climate model (GCM) projections. A simulation-based framework was established to enable NEAT analysis under future weather conditions. This workflow involves converting EPW-format weather files into JSON inputs compatible with NEAT and generating degree-hour metrics needed for load calculations. The fTMY dataset used in this study was developed by Oak Ridge National Laboratory through downscaling of six GCMs under different emission scenarios and covers the period from 2020 to 2100. In contrast, the TMY3 dataset is based on historical weather data from 1961 to 1990. Simulations were conducted for benchmark single-family prototype buildings across ASHRAE climate zones 1–7, which cover all regions of the U.S. except the subarctic Zone 8 in northern Alaska, evaluating both heating and cooling loads under TMY3 and fTMY conditions. Four foundation types were tested, while heating systems were standardized, as NEAT does not differentiate thermal energy load by HVAC system type in its load calculations. Results show that fTMY weather input consistently yield lower heating loads and higher cooling loads across most locations, aligning with expected climate warming trends. Notably, colder regions such as zones 6A, 6B, and 7 experience marked reductions in heating load, while warmer and transitional zones, such as 2A (Lufkin, TX) and 3C (San Francisco, CA), have substantial increases in cooling loads. Although this study does not directly assess the performance of retrofit measures under future climate conditions, it provides a critical foundation for doing so. By quantifying shifts in baseline (i.e., pre-retrofit case) energy loads between historical and future weather files, the study highlights the importance of integrating climate-responsive data into audit tools. These findings will inform future efforts to evaluate the long-term effectiveness and cost-effectiveness of weatherization measures under changing climate conditions.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Developing an Energy-Conscious Traffic Signal Control System for Optimized Fuel Consumption in Connected Vehicle Environments

The project titled “Developing an Energy-Conscious Traffic Signal Control System for Optimized Fuel Consumption in Connected Vehicle Environments” addresses energy-related challenges associated with adaptive traffic control systems by integrating connected vehicles (CV) and connected infrastructure (CI). The system developed in this project, a CV-based adaptive traffic control system, aims to improve fuel consumption in mixed traffic environments by capitalizing on emerging CV and CI communication technologies, as well as leveraging recent advances in Artificial Intelligence (AI), optimization, and edge computing. The system was tested at the MLK Smart Corridor, an urban testbed managed by the University of Tennessee at Chattanooga (UTC) and the City of Chattanooga. The system was validated through extensive simulations, both Software-in-the-Loop (SILS) and Hardware-in-the-Loop (HILS), and was further implemented and tested in real-world conditions at several intersections along the corridor. The Fuel Consumption Performance Index (FC-PI) and the Ecological Performance Index (Eco-PI) were developed as the key components for evaluating the system’s impact on fuel consumption and emissions. These metrics provided a comprehensive means of understanding the impact of traffic signal control optimization in mixed traffic environments. The report presents an in-depth analysis of the Eco-PI, FC-PI, adaptive traffic control system integration, and the testing and field implementation of the system. The results demonstrate significant reductions in fuel consumption and emissions, showcasing the system’s capability to contribute to more sustainable urban traffic management. The report also documents the challenges encountered and recommendations for scaling and further improving the system.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Distributed Magnetic Field and Temperature Monitoring for Superconducting Radio Frequency Cavities

The overall objective of the proposed Phase I program was to design, construct and demonstrate a fiber optic sensing system capable of providing temperature and magnetic field measurements with an enhanced spatial resolution that can be implemented over a large surface area (cryomodules) to survey superconducting radio frequency cavities and magnets. A magnetic field sensor capable of detecting fluxes on the order of 1 μT is required to detect the distribution of trapped flux on the cavity surface. A unique distributed magnetic field sensor was successfully designed and constructed to demonstrate the detection of magnetic fluxes less than 500 nT. The sensor leveraged the ultra-high sensitivity of Sentek’s picoDAS to measure the magnetostriction induced vibrations in a commercially available Metglas 2605 SC ribbon that was in physical contact with sensing fiber. Static magnetic fields were detected by applying an alternating current a copper wire proximate to the Metglas 2605SC ribbon to create an AC bias magnetic field. In an alternative approach, an AC bias magnetic field was applied to a special magnetic field sensing fiber with Metglas 2605SC cladding successfully detect a magnetic field flux of a 3 μT. Exhaustive testing was performed to characterize the dependency of sensor response on the direction of the applied magnetic field. Although the special sensing fiber based magnetic field sensor did not exhibit an observable dependence on the direction of the magnetic field, the Metglas 2605SC ribbon sensor exhibited a clear directional dependence. A wide variety of polymer materials were evaluated to enhance the temperature response of an FBG based sensor at cryogenic temperatures. The processing and performance challenges provided the motivation to develop a new simple cryogenic temperature sensor that uses a commercially available fiber optic splice protector. The EVA hot melt tube that becomes adhered to the optical fiber and the polyolefin outer tube that shrinks upon heating in the fusion splicer heater provide the high thermal expansion coefficient necessary to impart a significant strain on the FBG when exposed to cryogenic temperatures. The temperature sensitivity (Δ𝜆𝐵𝑟𝑎𝑔𝑔~ 62 𝑝𝑝𝑚/℃) of the FBG-based sensor was on par with the best reported to date. The simple design, use of readily available cost-effective materials, and well-established processing techniques lends this approach to the creation of hundreds to thousands of temperature sensors on one single optical fiber length. The inherently small form factor also allows for co-location with the distributed magnetic field sensor. In preparation for field testing of the prototype sensing system at the Jefferson Labs in potential Phase II program, several different cable designs were evaluated to package the sensors. The preliminary successful demonstration of fully functional sensing cables provides the foundation for subsequent development efforts to advance the Technology Readiness Level of the technology. The technical feasibility of the proposed approach was successfully demonstrated in this Phase I effort.

43 PARTICLE ACCELERATORS↗