Final Technical Report, Comport: Rigorous Testing Methods to Safeguard Software Porting
Final report for Comport grant.
Rubio Gonzalez, Cindy [University of California, D↗
SEARCH · Search NASA
Results for “Software Testing”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Real-Time Testbed for Smart Grid Recloser Controller
The growing need for a low voltage recloser has become apparent due to the rise in requirements for a smart grid. This includes more detailed management of power flow forward (towards load) and backward (towards generation), source synchronization in real time, more indepth fault responses, and the use of green energy. The SEL-651R-2 relay is a device that can manage these needs, especially in fault response and synchronization, and is commonly used in systems called microgrids. Microgrids are distribution level systems that are able to operate separated from the main grid, are typically installed much closer to the load(s), and are fed by distributed energy resources (DERs), such as wind, solar or diesel generators. The SEL-651R-2 is normally used in the field with presets operative settings, but the Western Michigan University (WMU) Center for Interdisciplinary Research on Secure, Efficient and Sustainable Energy Technology (WMU InterEnergy Center) wished to test this device in its range of capabilities for microgrid application. A Hardware-In-the-Loop (HIL) testbed was implemented and used through the Real Time Digital Simulator (RTDS) using the RSCAD software to test the SEL-651R-2's use cases and functions. The testbed includes a microgrid with interconnection to a larger main grid, and the relay is meant to control the recloser at the point of common coupling (PCC) between the main grid and microgrid. The testbed shows how basic protections, reclosing, and synchronization checks function when handling faults that affect both the microgrid and the main grid.
24 POWER TRANSMISSION AND DISTRIBUTION↗
Hiperclust
This software leverages transfer learning to analyze atom probe tomography (APT) data. It is trained on synthetic data and then applies this knowledge to predict the optimal number of clusters for a given APT dataset. Initially, the software used preliminary clustering to estimate the general structure of the data. Based on this, it provides suggestions for key parameters like minimum cluster size and minimum number of points. These parameters are critical for algorithms like HDBSCAN, ensuring accurate cluster formation without the need for trial-and-error testing. The software runs on High-Performance computing (HPC) systems, enabling fast, scalable analysis of large APT datasets, ultimately saving time and improving the reliability of clustering outcomes.
Tang, Yalei [Idaho National Laboratory (INL), Idah↗
Detector Interface for Streaming, Control, and Open-source integration (DISCO) v1.0.0
This suite consists of a multi-package ecosystem featuring detector emulators, EPICS areaDetector drivers, and remote server frameworks designed for the Advanced Light Source (ALS). Engineered for high-bandwidth devices—including VFCCD, Timepix3, Timepix4, and related pixel detectors—the software simulates hardware, wraps vendor SDKs into remote-callable servers, and integrates with open-source control systems. Key Capabilities: Distributed SDK Architecture: Server packages wrap hardware-specific SDKs, allowing areaDetector drivers to execute remote framework calls. This isolates proprietary libraries from the EPICS IOC, enhancing stability and enabling distributed computing across beamline networks. Device Support: Custom drivers for VFCCD, the Timepix family, and similar sensors optimize the data path from hardware control to high-speed transport. Full-Stack Emulation: Sophisticated emulator packages allow end-to-end pipeline testing and software development without requiring physical hardware or beam time. Integrated Workflows: Supports high-bandwidth streaming for real-time analysis and robust, metadata-rich file-based workflows (e.g., HDF5/NeXus). By standardizing interfaces across heterogeneous hardware, this suite reduces technical debt. It provides the ALS with a scalable, open-source solution to manage massive data rates within a unified control environment.
Mahl, Johannes [Lawrence Berkeley National Laborat↗
From text to test: AI-generated control software for materials science instruments
AI-crafted control software for automating scientific instruments can democratize and further accelerate materials research.
36 MATERIALS SCIENCE↗
Comparison of steady-state analytical wake models implemented in wind farm analysis software
A common set of mathematical wind turbine wake models are implemented in a few, well-adopted computational tools for wind farm wake modelling. Although the referenced mathematical formulations are common, implementation details may lead to differences in results. This study presents a systematic comparison of the implementation of mathematical wake models in open source, Python-based wind turbine wake modelling software, and a set of the models are directly compared. Despite aligning only the mathematical model parameters and retaining the default computational model parameters, good agreement is found across most of the model implementations, and additional agreement is expected upon further parameters alignment.
17 WIND ENERGY↗
Design-to-Deployment Continuum Platform for Microscopes and Computing Ecosystems
Science ecosystems with networked computing systems and physical instruments are increasingly being deployed with a goal to achieve the productivity promised by AI-supported remote automation. In support of these efforts, the virtual infrastructure twins (VITs) have been successfully utilized to develop the orchestration codes for these ecosystems without requiring physical access to expensive instruments, such as electron microscopes. Currently, the utility of such a VIT is severely limited by the computing capacity and capability of the computing system used as its host. Furthermore, codes developed on the VIT typically need to be transferred and refactored for production use, particularly, on high-performance systems with accelerators. In response, we develop a design-to-deployment continuum platform wherein a VIT runs natively on the ecosystem's own computing system, and thereby facilitates the continual in-situ testing and transition of codes for production use. Here, we describe the development and testing of software for remote microscope steering and GPU-based image reconstruction using this platform on a multi-GPU computing system networked to Nion microscopes. We demonstrate a continual transition of steering and reconstruction codes developed under VIT platform to production ecosystem deployment.
Al-Najjar, Anees [Oak Ridge National Laboratory (O↗
Geomagnetically Induced Current Field Test on Large Grid-Connected Power Transformers: Analysis, Model Development, and Simulations
Geomagnetic-induced current (GIC) flow in power grids can cause undesirable effects such as transformer overheating, harmonics, higher reactive power demand, etc. Many simulation models have been developed to study these effects, but real-world verification on modern transformer designs is rare. Here, this paper presents the first long-duration GIC field test in the U.S. performed on high-voltage, grid-connected transformers featuring winding clamps and tie rods instead of conventional tie bars. Field measurements were taken to evaluate GIC effects. These measurements also aided in developing and validating thermal and electromagnetic transient (EMT) models of the transformers. During the test, significant current and voltage distortions were observed along with considerable transformer reactive power losses. Analysis of the field measurements showed that the transformers’ hottest spot was at the inner windings, and their k-factors were close to factory test and software default values. Thermal simulations indicated that the transformers would not violate their thermal limits even for a GIC waveform that peaks at about 200 A/phase. EMT simulations revealed that increased transformer loading may reduce GIC-induced reactive power demand and harmonics in certain scenarios. The study also highlighted potential inaccuracies in using the k-factor method to calculate transformer reactive power losses.
EMTDC↗
Project PARETO - DOE’s Produced Water Optimization Initiative: Produced Water Sharing and Trading Portals
This presentation highlights developments in Project PARETO’s ongoing produced water exchange tools and makes audience members aware of planned pilot studies in the near future. It is geared towards requesting volunteers to partake in noncommittal pilots to test the software tools and provide feedback to aid in continued development.
Tominac, Philip↗
Building a Simplistic Automatic Extruder: Instrument Development Opportunities for the Laboratory
This work presents an automatic extruder as a research experience for undergraduate students. The system offers a user-friendly approach to preparing vesicles, such as liposomes or polymersomes, with a defined size and polydispersity properties crucial for research in biology and macromolecules. It comprises two syringe pumps connected by a membrane filter. The setup is controlled by software. Compared to manual extrusion, this automated system provides advantages, such as precisely controlled variables. The project describes a tool to enhance undergraduate learning in science and engineering laboratories. Building an automatic extruder serves as a simplified model of a complex industrial process. It offers a clear advantage: automating a well-understood manual extrusion process. To make this project accessible, it is broken down into three manageable tasks: software development, hardware assembly, and testing procedures. This breakdown describes the software created, the hardware components used, and the testing procedures conducted for this project. All project data, including software code, testing data, and procedures, are freely available online. This allows undergraduate students to not only begin their own projects but also contribute to this educational instrument’s ongoing development.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Ristra Project FY23 L2 Milestone Report, Rev.1: MRT #8541: Multiphysics Scaling on EAS-3
The findings of this report were used to close out the ATDM milestone MRT# 8541, which was designed to demonstrate readiness of ATDM multiphysics codes for mission-relevant work on ATS-4, El Capitan. To this end, the closure criteria were to run a 3D shaped charge problem at scale up to 50% of the El Capitan early-access system, RZVernal (AMD Trento CPUs and AMD MI-250X GPUs), demonstrate scalability, and document challenges with the software stack and environment. LANL’s approach to this milestone was to test our modular software capability by developing an entirely new code, Moya, built upon our FleCSI framework. The physics capability and the GPU infrastructure needed for the shaped charge problem on GPUs was added to Moya, and the required calculations were performed at scale. Moya showed good scaling without any fine-tuning of GPU kernels; there is still significant room for performance enhancements, especially for the Legion backend. Tied up in this L2 milestone was a closeout of KPP-3s for the ECP ST Projects at LANL; this material will be covered in a separate document.
97 MATHEMATICS AND COMPUTING↗
Promoting regulatory acceptance of combined ion and neutron irradiation testing of nuclear reactor materials: Modeling and software considerations
As the needs for the nuclear energy industry continue to evolve in the 21st century, timely adoption of new technological solutions acceptable to regulatory agencies is critical. Quantitative prediction of radiation damage in materials and its impact on mechanical properties is a key component of licensing and regulatory decisions regarding nuclear power plants. Accelerated testing methodologies such as combined ion and neutron irradiation data sets are crucial for the development and deployment of new materials and new manufacturing methods (e.g., additive manufacturing). However, regulatory acceptance of accelerated testing methodologies is necessary for their adoption. Further, the present work discusses the fundamental basis for comparing ion- and neutron-induced material microstructures, the theory behind interpreting radiation damage across length and time scales and radiation types, and the codes, standards, and quality assurance concerns surrounding different modeling methods and software. In particular, recommendations are given as to the path forward that will enable national laboratories, academia, and industry to develop the modeling and software basis for regulatory acceptance of the combined use of ion and neutron irradiation for material performance evaluation.
11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
Progress Towards NQA-1 for Cardinal in FY25
Cardinal is a wrapping of the GPU-oriented spectral element Computational Fluid Dynamics (CFD) code NekRS and the Monte Carlo particle transport code OpenMC within the Multiphysics Object-Oriented Simulation Environment (MOOSE). Cardinal provides high-resolution thermal-hydraulics and/or radiation transport feedback to MOOSE multiphysics simulations. Multiphysics feedback is implemented in a geometry-agnostic manner which eliminates the need for rigid one-to-one mappings. A generic data transfer implementation also allows NekRS and OpenMC to couple to any MOOSE application, enabling a broad set of multiphysics capabilities. Cardinal simulations can also leverage combinations of MPI, OpenMP, and GPU resources. Cardinal continuous development and improvement efforts have led to the software being considered as a high-fidelity design and licensing tool for key areas of nuclear reactor relevant physics, including neutron transport, fluid flow, heat transfer, and mechanical processes. The fast development and expansion of the software from a pure R&D framework towards its application in the nuclear industry and regulation require a focus on developing, enhancing,and maintaining Cardinal’s software quality through strict adherence to a Software Quality Assurance (SQA) framework and SQA program. To facilitate compliance with SQA standards, the Cardinal SQA Program was initiated during Fiscal Year 2023 (FY23). During the development of the Cardinal SQA Program, multiple gaps have been identified. These gaps are primarily related to model verification and code pedigree as they relate to the use of Cardinal as an analysis tool. These gaps were captured in a report published in 2023. A second report highlighted the progress made during Fiscal Year 2024 (FY24) and described Argonne’s effort to document and integrate software verification within Cardinal’s software development process. This report documents the progress made towards NQA-1 for Cardinal in the Fiscal Year 2025 (FY25). All cases in the expanded Continuous Integration (CI) suite of NekRS are included in this report which test the solvers and modules available in NekRS exhaustively. The NekRS tests are integrated with the Cardinal CI suite and made available in publicly accessible Github documentation. Following the CI practice permits integrating of source code changes frequently and ensuring that the integrated codebase clears the verification testing for the software. Also in this report is a brief overview of the development of the Cardinal Software Quality Assurance Plan (SQAP) that was done in FY25, though it should be noted that the rest of the documentation for the SQA program needs to be developed in a future step of this task.
22 GENERAL STUDIES OF NUCLEAR REACTORS↗
Analysis and Grading of the Test Performance of PS Modules for the CMS Phase-2 Outer Tracker Upgrade
The Outer Tracker of the CMS experiment provides information about the trajectory of charged particles produced in proton-proton collisions at the LHC. During the High Luminosity LHC upgrade, scheduled for the late 2020s, the Outer Tracker will be replaced with new modules capable of transmitting data to the L1 Trigger. These modules are being assembled at several facilities around the world, including Fermilab, necessitating coordinated standards of module quality. Here I discuss the development of POTATO (Phase-2 Outer Tracker Analyzer of Test Outputs), a C++ software which provides a standardized procedure for analyzing and grading test results of the Outer Tracker modules. The particular focus of this poster is on the analysis and grading of the PS (pixel-strip) modules in POTATO.
Riggall, Caroline↗
Analysis and Grading of the Test Performance of PS Modules for the CMS Phase-II Outer Tracker Upgrade
The Outer Tracker detector of the Compact Muon Solenoid (CMS) experiment provides information about the trajectory of charged particles produced in proton-proton collisions at the Large Hadron Collider (LHC). During the High Luminosity LHC upgrade, scheduled for the late 2020s, the Outer Tracker will be replaced with new modules capable of transmitting data to the L1 Trigger. These modules are being assembled at several facilities around the world, including Fermilab, necessitating coordinated standards of module quality. Here I discuss the development of POTATO (Phase-II Outer Tracker Analyzer of Test Outputs), a C++ software which provides a standardized procedure for analyzing and grading test results of the Outer Tracker modules. The particular focus of this paper is on the analysis and grading of the PS (pixel-strip) modules in POTATO.
43 PARTICLE ACCELERATORS↗
Packaging HEP Heterogeneous Mini-apps for Portable Benchmarking and Facility Evaluation on Modern HPCs
High Energy Physics (HEP) experiments are making increasing use of GPUs and GPU dominated High Performance Computer facilities. Both the software and hardware of these systems are rapidly evolving, creating challenges for experiments to make informed decisions as to where they wish to devote resources. In its first phase, the High Energy Physics Center for Computational Excellence (HEP-CCE) produced portable versions of a number of heterogeneous HEP mini-apps, such as p2r, FastCaloSim, Patatrack and the WireCell Toolkit, that exercise a broad range of GPU characteristics, enabling cross platform and facility benchmarking and evaluation. However, these miniapps still require a significant amount of manual intervention to deploy on a new facility. We present our work in developing turn-key deployments of these mini-apps, where by means of containerization and automated configuration and build techniques such as Spack, we are able to quickly test new hardware, software, environments and entire facilities with minimal user intervention, and then track performance metrics over time.
73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
Packaging HEP Heterogeneous Mini-apps for Portable Benchmarking and Facility Evaluation on Modern HPCs
High Energy Physics (HEP) experiments are making increasing use of GPUs and GPU dominated High Performance Computer facilities. Both the software and hardware of these systems are rapidly evolving, creating challenges for experiments to make informed decisions as to where they wish to devote resources. In its first phase, the High Energy Physics Center for Computational Excellence (HEP-CCE) produced portable versions of a number of heterogeneous HEP mini-apps, such as \ptor, FastCaloSim, Patatrack and the WireCell Toolkit, that exercise a broad range of GPU characteristics, enabling cross platform and facility benchmarking and evaluation. However, these mini-apps still require a significant amount of manual intervention to deploy on a new facility. We present our work in developing turn-key deployments of these mini-apps, where by means of containerization and automated configuration and build techniques such as Spack, we are able to quickly test new hardware, software, environments and entire facilities with minimal user intervention, and then track performance metrics over time.
Atif, Mohammad [Brookhaven] (ORCID:000000026889770↗
Real time heat load calculation software based on EPICS for Fermilab PIP-II CM tests
Fermilab has a project to improve the proton beam energy which is called PIP-II (the 2nd Proton Improvement Plan). There is a superconducting linear accelerator, LINAC, to improve the proton beam power and the LINAC consists of 5 types of cryomodules (CM), 1 HWR CM, 2 SSR1 CM, 4 SSR2 CM, LB650 CM, and HB650 CM. The prototypes of these cryomodules are being tested at Fermilab’s CryoModule Test Facility (CMTF). Heat load measurements are an important part of the prototype CM testing. The CMTF cryogenic control system was developed based on the ACNET (Accelerator Control NETwork) for CM testing for other projects, but the PIP-II cryogenic control system will be implemented using the Experimental Physics and Industrial Control System (EPICS). As part of the prototype CM testing campaign an EPICS based control system has been implemented at CMTF. This EPICS cryogenic control system includes real time heat load calculation software utilizing the Fortran implementation of Hepak. This paper details the real time heat load calculation software developed for the prototype CM testing including the first results from the HB 650 CM.
Yoon, S. [Fermilab]↗