Search NASASearch

SEARCH · Search NASA

Results for “Automated Testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

ATLAS-MAP: An Automated Test Station for Gated Electronic Transport Measurements

The diversification of electronic materials in devices provides a strong incentive for methods to rapidly correlate device performance with fabrication decisions. In this work, we present a low-cost automated test station for gated electronic transport measurements of field-effect transistors. Utilizing open-source PyMeasure libraries for transparent instrument control, the “ATLAS-MAP” system serves as a customizable interface between sourcemeters and samples under test and is programmed to conduct transfer curve and van der Pauw methods with static and sweeping gate voltages. Zinc oxide transistors of variable thickness (5, 10, and 20 nm) and channel size (50 μm to 3 mm, of equal length and width) were fabricated to validate the design. Standardization of testing procedures and raw data formatting enabled automated data analysis. A detailed list of parts and code files for the system are provided.

36 MATERIALS SCIENCE

Maximizing Efficiency and Quality: Leveraging Automated Testing for Laboratory Commissioning

The traditional commissioning process uses sampling to select equipment for functional acceptance testing when large quantities of equipment are present. Although this approach is generally effective in identifying wide-spread issues, it has several shortcomings: it fails to evaluate equipment not included in the sample, provides only a one-time validation of equipment operation, and the standard documentation is a simple checklist of pass/fail questions. During the construction and commissioning process of the new Research and Innovation Laboratory (RAIL) in Golden, CO, the National Renewable Energy Laboratory team engaged Group14 Engineering to implement a Connected Commissioning process using fault detection and diagnostic software for automated functional acceptance testing. This presentation highlights the advantages offered by automated functional testing in this critical laboratory setting: (1) sampling 100% of BAS-connected equipment during functional testing, (2) testing results backed by data beyond the traditional pass/fail checklist, and (3) an automated test process that can be regularly executed by the building management team for ongoing commissioning throughout the life of the building. The presentation will also cover technical challenges associated with Connected Commissioning and the important conversations with key stakeholders that need to occur well before functional acceptance testing in order to successfully implement the automated testing processes.

automated testing

Hardware-in-Loop Modules for Testing Automated Ventilator Controllers

Automated ventilator controllers have the potential to simplify oxygen and carbon dioxide management for trauma. In the pre-hospital or military medicine environment, trauma care can be required for prolonged periods by personnel with limited ventilator management training. As such, there is a need for closed-loop control systems that can adapt ventilator management to a complex, ever-changing medical environment. Here, we present a novel hardware-in-loop test platform for the independent troubleshooting and evaluation of oxygen and carbon dioxide automated ventilator management capabilities. The oxygen management system provides an analogue blood oxygen signal that is responsive to the fraction of inspired oxygen and the peak inspiratory pressure ventilator settings. A tested oxygenation controller successfully reached the target oxygen saturation within 5 min. The carbon dioxide removal system integrates with commercial ventilator technology and mimics carbon dioxide generation, lung compliance, and airway resistance while providing an end-tidal carbon dioxide level that is responsive to changes in the tidal volume and respiratory rate settings. A test mechanical ventilator controller was able to regulate EtCO2 regardless of the starting value within 10 min. This highlights the system’s functionality and provides proof-of-concept demonstrations for how the hardware-in-loop test platforms can be used for evaluating closed-loop controller technologies.

Berard, David (ORCID:0000000322863846)

Automating Testing of DUNE Electronics via a Finite State Machine

The Deep Underground Neutrino Experiment (DUNE) is a flagship international collaboration designed to study neutrinos tiny, nearly massless particles that may hold answers to fundamental questions about the Universe. Fermilab s Robotic Test Stand (RTS) plays a critical role in ensuring the quality of approximately 50,000 Application-Specific Integrated Circuit (ASIC) chips that will be used in DUNE s massive liquid argon detectors. These electronics will be inside the cryostat; therefore, they will need to have a high yield of working chips and low noise. To improve the automation and reliability of the RTS, this project focused on designing and implementing a Python-based finite state machine (FSM) to manage chip handling workflows. The FSM was developed as a modular software framework to coordinate robotic arm movements, manage chip tray positions, and monitor system states during testing. Key features include robust error handling routines, a pause/resume system for safe mid-cycle interruptions, and a simulation mode for iterative testing without hardware dependencies. The system was designed to prepare for seamless integration with RTS hardware components such as the robotic arm and vision system. This integration will streamline collaboration and enable efficient deployment of updates across the six total institutions performing testing. The outcomes of this internship contribute to Fermilab s mission to advance high-energy physics and support the DOE s national goals by directly improving the testing of equipment to be used in DUNE. The project also provided valuable experience in software design and contributing to the success of DUNE.

Kang, Caleb [William Rainey Harper Coll.]

Automating Testing of DUNE Electronics via a Finite State Machine

The Deep Underground Neutrino Experiment (DUNE) is a flagship international collaboration designed to study neutrinos—tiny, nearly massless particles that may hold answers to fundamental questions about the Universe. Fermilab’s Robotic Test Stand (RTS) plays a critical role in ensuring the quality of approximately 50,000 Application-Specific Integrated Circuit (ASIC) chips that will be used in DUNE’s massive liquid argon detectors. These electronics will be inside the cryostat; therefore, they will need to have a high yield of working chips and low noise. To improve the automation and reliability of the RTS, this project focused on designing and implementing a Python-based finite state machine (FSM) to manage chip handling workflows. The FSM was developed as a modular software framework to coordinate robotic arm movements, manage chip tray positions, and monitor system states during testing. Key features include robust error handling routines, a pause/resume system for safe mid-cycle interruptions, and a simulation mode for iterative testing without hardware dependencies. The system was designed to prepare for seamless integration with RTS hardware components such as the robotic arm and vision system. This integration will streamline collaboration and enable efficient deployment of updates across the six institutions performing testing. The outcomes of this internship contribute to Fermilab’s mission to advance high-energy physics and support the DOE’s national goals by directly improving the testing of equipment to be used in DUNE. The project also provided valuable experience in software design and contributing to the success of DUNE.

Kang, Caleb [Fermilab]

A Scalable Test-Bed for Direct Current Current Transformer Automated Functional Testing and Characterization

This article describes a scalable test-bed for automation of measurements of the direct current current transformers (DCCT). Automation of measurement involves functional measurements, fault event based measurements and data validation. The test-bed is designed to measure up to 20 DCCTs at a time with software based measurement repetition checks and validation of the measurements.

43 PARTICLE ACCELERATORS

ON THE EFFECTIVENESS OF LLMS IN UNIT TEST GENERATION FOR STRUCTURED TEXT PROGRAMS

The reliability of industrial automation systems heavily depends on the correctness of Programmable Logic Controller (PLC) programs, which are often written in Structured Text (ST). While Large Language Models (LLMs) have shown promise in automating test generation for mainstream programming languages, their effectiveness for the syntactically strict ST language remains underexplored. This thesis presents a systematic empirical evaluation of three state-of-the-art LLMs—GPT-4o, Gemini 2.5 Pro, and Claude Sonnet 4.5—for generating ST unit tests. We examine three prompting strategies: Natural Language (NL), Code Language (CL), and Chain-of-Thought (CoT), across a curated set of 11 ST function blocks. The quality of the generated tests is assessed using Compilation Success Rate (CSR), Statement Coverage (SC), and Branch Coverage (BC). In the zero-shot setting, Claude Sonnet 4.5 achieves the highest CSR, while Gemini 2.5 Pro consistently delivers the best statement and branch coverage, particularly under CL prompts. By incorporating a one-shot CL prompt, all models exhibit substantial improvements—most notably GPT-4o, whose CSR increases from 45.45% to 90.91%, with substantial gains in both SC and BC. To further contextualize these findings, we compare GPT-4o’s one-shot results with PLCAutoTester, a state-ofthe- art ST unit test generation tool, on an additional benchmark dataset. While LLMgenerated tests approach competitive coverage levels, PLCAutoTester maintains significantly higher and more stable coverage across programs. This study provides the first comprehensive benchmark of modern LLMs for ST unit testing, highlighting their strengths, limitations, and improvements through one-shot prompting, and positioning their performance relative to specialized automated testing tools in industrial automation.

42 ENGINEERING

Excess Density as a Descriptor for Electrolyte Solvent Design

Electrolytes mediate interactions between the cathode and anode and determine performance characteristics of batteries. Mixtures of multiple solvents are often used in electrolytes to achieve desired properties, such as viscosity, dielectric constant, boiling point, and melting point. Conventionally, multi-component electrolyte properties are approximated with linear mixing, but in practice, significant deviations are observed. Excess quantities can provide insights into the molecular behavior of the mixture and could form the basis for designing high-performance electrolytes. Here we investigate the excess density of commonly used Li-ion battery solvents such as cyclic carbonates, linear carbonates, ethers, and nitriles with molecular dynamics simulations. We additionally investigate electrolytes consisting of these solvents and a salt. The results smoothly vary with mole percent and are fit to permutation-invariant Redlich-Kister polynomials. Mixtures of similar solvents, such as cyclic-cyclic carbonate mixtures, tend to have excess properties that are lower in magnitude compared to mixtures of dissimilar substances, such as carbonate-nitrile mixtures. We perform experimental testing using our automated test stand, Clio, to provide validation to the observed simulation trends. We quantify the structure similarity using SOAP fingerprints to create a descriptor for excess density, enabling the design of electrolyte properties. To a first approximation, this will allow us to estimate the deviation of a mixture from ideal behavior based solely upon the structural dissimilarity of the components.

74 ATOMIC AND MOLECULAR PHYSICS

Best practices in software development for robust and reproducible geoscientific models based on insights from the Global Carbon Budget's dynamic vegetation models

Computational models play an increasingly vital role in scientific research by enabling the numerical simulation of complex processes. Such models are also fundamental in geosciences. For instance, they offer critical insights into the impacts of global change on the Earth system today and in the future. Beyond their value as research tools, models are also software products and should therefore adhere to certain established software engineering standards. However, scientists are rarely trained as software developers, which can lead to potential deficiencies in software quality like unreadable, inefficient, or erroneous code. The complexity of models, coupled with their integration into broader workflows, also often makes it challenging to reproduce results, evaluate processes, and build upon them. In this paper, we review the state and current practices of the development processes of the state-of-the-art land surface models used by the Global Carbon Budget. We combine the experience of modelers from the respective research groups with the expertise of software engineers from tech companies to outline key principles and tools for improving software quality in research. We explore four main areas: (1) model testing and validation, (2) scientific, technical, and user documentation, (3) version control, continuous integration, and code review, and (4) the portability and reproducibility of workflows. Our review reveals that while modeling communities are incorporating many best practices, significant room for improvement remains in areas such as automated testing, automated documentation, and reproducibility. Therefore, we here identify and promote essential software engineering practices, including numerous examples of practices from within the community that can serve as guidelines for other models and could help streamline processes across the entire community. We conclude with an open-source example implementation of these principles, demonstrating portable and reproducible data flows, a continuous integration setup, and web-based visualizations. This example may serve as a practical resource for model developers, users, and all scientists engaged in scientific programming.

Gregor, Konstantin [Technical Univ. of Munich (Ger

Persistent Elevated Soot Emissions Induced by Clustered Stochastic Preignition Events

Stochastic Preignition (SPI) is an abnormal combustion phenomenon that can occur in spark-ignition engines particularly under high-load operation. SPI is characterized by uncontrolled initiation of combustion prior to spark discharge, an abnormal combustion process that can lead to severe knock events and significant engine damage. SPI has been associated with fuel properties, lubricant composition, and engine design and operation. Here, in this work, a single-cylinder test engine with a dry-sump oil system was utilized to study the SPI response of E10 and E25 fuels with a range of Reid Vapor Pressure (RVP). An automated test procedure was employed, consisting of ten square-waved load profile segments, with each segment composed of 5 min of low-load operation followed by 25 min of sustained high-load operation. These tests were replicated across multiple days of testing including a lubricant triple flush between tests, and an online Fuel in Oil diagnostic measurement. Exhaust particulate emissions were continuously measured by an AVL microsoot sensor (MSS). Elevated particulate matter emissions were observed to occur concurrently with SPI events as blooms of soot. Particularly after clustered events (i.e., multiple SPI cycles occurring within 10 consecutive engine cycles), high soot emissions were observed to persist over several days of sequential operation despite daily lubricant changes, a complete warm-up procedure, and sustained low-load operation between test segments. This result implies that the particulate emissions trends may be dominated by deposit-based effects, where higher load operation is needed to alter deposition and formation processes. The observed soot blooms were also found to correspond to a reduction in the engine fueling and the fuel engine oil dilution rate despite the engine exhaust remaining at stoichiometric exhaust operation. These observations suggest that post-SPI events, pathways for lubricant migration and consumption into the combustion chamber may occur until these pathways are closed from deposit formation or ring dynamics during extended operation. These observed sooting propensity persisted with all fuels tests, but a linear correlation was observed between the summation of soot and particulate matter index (PMI) value for each fuel as well as SPI events, proving that PMI is a crucial fuel property for reducing SPI.

Splitter, Derek [Oak Ridge National Laboratory (OR

Field-Emission Properties of Vertically Aligned Carbon Nanotube Cathodes of Varying Geometries

This work characterizes the bulk emission properties of carbon nanotube (CNT) forest cathodes fabricated with various geometries. Geometries explored include dense nanotube forests of varying height grown on 5×5 mm silicon (Si) substrates and discrete, patterned CNT pillars fabricated using UV photolithography. Dense forests heights ranged from 526 μ m to 1.41 mm, with packing fraction for dense forest calculated to be 4e10 nanotubes/cm2 based on an average nanotube separation distance of 100 nm for fixed growth dense forests. Patterned sample micro pillar heights ranged from 47 to 393 μ m with pillar widths on tested samples ranging from 250 to 270 μ m . Properties explored include emission current, turn-on field, and emission current performance over time. A parallel plate electron beam diode with a 100- μ m A-K gap and an automated test apparatus were developed to provide a configurable experiment that provides accurate and repeatable measurements for dc, dc sweep, and timed performance testing. Operating voltages for the voltage sweeps spanned from 0 to −350 V. Furthermore, testing has shown evidence of a hysteresis effect on the emission current tied to the applied field history as well as shifting of the turn-on field magnitude throughout the testing period, suggesting a conditioning effect during use. Three separate emission regions in the I–V curves during sweep testing have also been observed. In the geometric study, dense forests and patterned samples were sweep tested up to a peak applied voltage of −250 V, with the taller samples generally performing better. Currents produced in the geometric study from the dense forest emitters ranged from 36.8 to 572.34 μ A , with current densities ranging from 15 to 2.29 mA/cm2. Currents produced from the patterned micropillar emitters ranged from 39.4 to 317.51 μ A , with current densities ranging from 67 to 3 mA/cm2. DC time testing s...

36 MATERIALS SCIENCE

Pyomo: Accidentally outrunning the bear

Pyomo is an open-source optimization modeling software that has undergone significant evolution since its inception in 2008. Pyomo has evolved to enhance flexibility, solver integration, and community engagement. Modern collaborative tools for open-source software have facilitated the development of new Pyomo functionality and improved our development process through automated testing and performance-tracking pipelines. However, Pyomo faces challenges typical of research software, including resource limitations and knowledge retention. The Pyomo team’s commitment to better development practices and community engagement reflects a proactive approach to these issues. We describe Pyomo’s development journey, highlighting both successes and failures, in the hopes that other open-source research software packages may benefit from our experiences.

automation

Descriptor: High Temporal Resolution Meteorological Data at Oak Ridge Reservation (ORR-HiResMet)

Access to continuous, quality assessed meteorological data is critical for understanding the climatology and atmospheric dynamics of a region. Research facilities like Oak Ridge National Laboratory (ORNL) rely on such data to assess site-specific climatology, model potential emissions, establish safety baselines, and prepare for emergency scenarios. To meet these needs, on-site towers at ORNL collect meteorological data at 15-minute and hourly intervals. However, data measurements from meteorological towers are affected by sensor sensitivity, degradation, lightning strikes, power fluctuations, glitching, and sensor failures, all of which can affect data quality. To address these challenges, we conducted a comprehensive quality assessment and processing of five years of meteorological data collected from ORNL at 15-minute intervals, including measurements of temperature, pressure, humidity, wind, and solar radiation. The time series of each variable was pre-processed and gap-filled using established meteorological data collection and cleaning techniques, i.e., the time series were subjected to structural standardization, data integrity testing, automated and manual outlier detection, and gap-filling. The data product and highly generalizable processing workflow developed in Python Jupyter notebooks are publicly accessible online. As a key contribution of this study, the evaluated 5-year data will be used to train atmospheric dispersion models that simulate dispersion dynamics across the complex ridge-and-valley topography of the Oak Ridge Reservation in East Tennessee.

Steckler, Morgan R. [Oak Ridge National Laboratory

MUPPET: An automated OpenMP mutation testing framework for performance optimization

MUPPET is a tool for OpenMP programs that identifies program modifications, called mutations, aimed at improving program performance. Existing performance optimization techniques, including profiling-based and auto-tuning techniques, fail to indicate program modifications at the source level thus preventing their portability across compilers. MUPPET aims to help HPC developers reason about performance defects and missed opportunities to improve performance at the source code level.

Parasyris, Konstantinos

Microreactor Automated Control System Test Bed Digital Architecture for Real-Time, Hardware-in-the-Loop Simulation

This work describes progress made towards the development of a real-time hardware-in-the-loop (HIL) test bed for non-nuclear testing of microreactor control schemes and failure modes. Non-nuclear testing is a crucial step in developing robust control algorithms for managing microreactor dynamics. The creation of an HIL simulation harnesses the realistic dynamics of physical analogue systems while additionally considering the challenges of variable communication delay. This collaborative effort between Oak Ridge National Laboratory and Idaho National Laboratory has resulted in a LabVIEW-based gRPC communication protocol which couples a TRANSFORM Modelica simulation of nuclear components to the ViBRANT physical hardware for realistic feedback and visual representation of control action in real time. A modular python client structure is developed to manage FMU-based Modelica simulation and real-time gRPC communication. HIL testing suggests that the modeled reactor with natural convection molten salt loop coolant configuration responds well to PID control of drum positioning for modulation of reactor core power, however, future efforts will be made to explore the added thermal inertial delay of system level control and downstream demand changes. Development of this platform with a generalized methodology provides a foundation for exploring a variety of reactor configurations and failure modes in rapid order to provide insight into the most effective avenues of study for further research and development.

McConnell, Jono [ORNL] (ORCID:0000000238984741)