Search NASASearch

SEARCH · Search NASA

Results for “Automated Testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Closing the Accuracy Gap in Tandem Photovoltaic Testing: An Accessible and Efficient Spectral Tuning Method Using LED-Based Simulators for Research Laboratories and Industry

Accurate performance calibration of multijunction (MJ) solar cells is critical for advancing this technology toward large-scale terrestrial application, yet existing testing methods developed by photovoltaics calibration laboratories remain prohibitively complex and resource intensive for most research laboratories. Current approaches rely on expensive multisource simulators and/or intricate spectral tuning algorithms, limiting accessibility and hindering standardized comparisons of emerging MJ technologies such as perovskite-based tandems. This paper introduces a streamlined spectral irradiance adjustment method for light-emitting diode (LED)-based solar simulators, which are increasingly adopted in the photovoltaics community due to their versatility and cost-effectiveness. The method we present bins LED channels into groups based on the number of junctions of the MJ photovoltaic device under test (DUT) and their corresponding band gaps and incorporates an automated tuning algorithm that eliminates the need to adjust each channel’s irradiance individually. This tuning algorithm requires the relative spectral responsivities of both the DUT and a broadband reference cell, as well as a calibrated spectroradiometer. Measurement validation across various MJ devices, including III-V and perovskite/silicon tandems, demonstrates excellent agreement within 1% with well-established xenon-tungsten multisource simulators and associated tuning algorithms. By enabling precise spectral tuning with readily available equipment and a simple tuning algorithm, our approach bridges the measurement accuracy gap between research laboratories and accredited testing facilities, fostering more reliable device comparisons and accelerating the translation of MJ technologies into real-world energy systems.

14 SOLAR ENERGY

Automated Label‐Free Assay for Viral Detection and Inhibitor Screening via Biomembrane‐Functionalized Microelectrode Arrays

Most virus infection assays have indirect readout such as virus number following entry (e.g., PCR, cell lysis). While effective, these technologies are labor‐intensive, require specialized environments (e.g., sterile or RNA‐free), and detect later‐stage viral events like lysis or cell death, lacking sensitivity to early fusion events. To address these limitations, we present biologically relevant 2D membrane materials, host‐cell‐derived supported lipid bilayers (hcd‐SLBs), integrated with organic microelectrode arrays (OMEAs) for detection of severe acute respiratory syndrome coronavirus 2 (SARS‐CoV‐2) fusion. By overexpressing angiotensin‐converting enzyme 2 (ACE2) receptors on the native membranes, the platform functions as a viral sensor capable of detecting virus pseudo particles (VPPs) through the late pathway. Additionally, hcd‐SLBs extracted from human lung epithelium expressing native ACE2 detect fusion events through the early pathway. The platform's utility as a drug‐screening tool is demonstrated by testing antibodies targeting either the ACE2 on the host membrane or the viral spike (S) proteins. To enhance the throughput, microfluidics are integrated for automation and OMEAs are incorporated within each channel, miniaturizing the testing units. This system supports high‐throughput data generation, automation, and scalability, providing an efficient platform for viral fusion detection that advances the study of pathogen‐host interactions and accelerates antiviral drug discovery.

Biology

An Advanced Cyber-Physical System Security Testbed for Substation Automation

A Cyber-Physical System (CPS) testbed serves as a powerful platform for testing and validating cyber intrusion detection and mitigation strategies in substations. This study presents the design and development of a CPS testbed that can effectively assess the real-time dynamics of a substation. Cyber attacks exploiting IEC 61850-based SV and GOOSE protocols are demonstrated using the testbed, along with an analysis on attack detection. Realistic timing measurements are obtained, and the time frames for deploying detection and mitigation strategies are evaluated.

24 POWER TRANSMISSION AND DISTRIBUTION

Automation and machine learning drive rapid optimization of isoprenol production in Pseudomonas putida

Advances in genome engineering have improved our ability to perturb microbial metabolic networks, yet bioproduction campaigns often struggle with parsing complex metabolic datasets to efficiently enhance product titers. We address this challenge by coupling laboratory automation with machine learning to systematically optimize the production of isoprenol, a sustainable aviation fuel precursor, in Pseudomonas putida. The simultaneous downregulation through CRISPR interference of combinations of up to four gene targets, guided by machine learning, permitted us to increase isoprenol titer 5-fold in six consecutive design-build-test-learn cycles. Moreover, machine learning enabled us to swiftly explore a vast experimental design space of 800,000 possible combinations by strategically recommending approximately 400 priority constructs. High-throughput proteomics allowed us to validate CRISPRi downregulation and identify biological mechanisms driving production increases. Our work demonstrates that ML-driven automated design-build-test-learn cycles, when combined with rigorous data validation, can rapidly enhance titers without specific biological knowledge, suggesting that it can be applied to any host, product, or pathway.

Carruthers, David N

Abstraction hierarchy to define biofoundry workflows and operations for interoperable synthetic biology research and applications

Lack of standardization in biofoundries limits the scalability and efficiency of synthetic biology research. Here, we propose an abstraction hierarchy that organizes biofoundry activities into four interoperable levels: Project, Service/Capability, Workflow, and Unit Operation, effectively streamlining the Design‑Build‑Test‑Learn (DBTL) cycle. This framework enables more modular, flexible, and automated experimental workflows. It improves communication between researchers and systems, supports reproducibility, and facilitates better integration of software tools and artificial intelligence. Our approach lays the foundation for a globally interoperable biofoundry network, advancing collaborative synthetic biology and accelerating innovation in response to scientific and societal challenges.

Kim, Haseong

Cybersecurity Certification Requirements for Distributed Energy Resources: A Survey of SunSpec Alliance Standards

This survey paper explores the cybersecurity certification requirements defined by the SunSpec Alliance for Distributed Energy Resource (DER) devices, focusing on aspects such as software updates, device communications, authentication mechanisms, device security, logging, and test procedures. The SunSpec cybersecurity standards mandate support for remote and automated software updates, secure communication protocols, stringent authentication practices, and robust logging mechanisms to ensure operational integrity. Furthermore, the paper discusses the implementation of the SAE J3072 standard using the IEEE 2030.5 protocol, emphasizing the secure interactions between electric vehicle supply equipment (EVSE) and plug-in electric vehicles (PEVs) for functionalities like vehicle-to-grid (V2G) capabilities. This research also examines the SunSpec Modbus standard, which enhances the interoperability among DER system components, facilitating compliance with grid interconnection standards. This paper also analyzes the existing SunSpec Device Information Models, which standardize data exchange formats for DER systems across communication interfaces. Finally, this paper concludes with a detailed discussion of the energy storage cybersecurity specification and the blockchain cybersecurity requirements as proposed by SunSpec Alliance.

Tsikteris, Sean (ORCID:0009000524202250)

LLM Benchmarking with LLaMA2: Evaluating Code Development Performance Across Multiple Programming Languages

The rapid evolution of large language models (LLMs) has opened new possibilities for automating various tasks in software development. This paper evaluates the capabilities of the LLaMA 2-70B model in automating these tasks for scientific applications written in commonly used programming languages. Using representative test problems, we assess the model's capacity to generate code, documentation, and unit tests, as well as its ability to translate existing code between commonly used programming languages. Our comprehensive analysis evaluates the compilation, runtime behavior, and correctness of the generated and translated code. Additionally, we assess the quality of automatically generated code, documentation, and unit tests. Here, our results indicate that while LLaMA 2-70B frequently generates syntactically correct and functional code for simpler numerical tasks, it encounters substantial difficulties with more complex, parallelized, or distributed computations, requiring considerable manual corrections. We identify key limitations and suggest areas for future improvements to better leverage AI-driven automation in scientific computing workflows.

97 MATHEMATICS AND COMPUTING

Understanding and modeling current and future coastal wetland methane dynamics (Final Report)

The coastal terrestrial-aquatic interface (TAI) is a highly dynamic component of the Earth system that plays a critical role in biogeochemical cycling. Due to its dynamic nature, the processes that regulate decomposition and methane (CH 4 ) emissions are of greater significance at the TAI than in upland systems. Despite this, we have limited mechanistic understanding of how climate stressors interact to regulate the electron acceptors and donors that determine decomposition pathways within TAIs, including the generation of hot spots and hot moments. Accurately modeling these processes is critical for incorporating the coastal TAI into Earth systems models, such as DOE’s E3SM. With previous DOE support, we adapted an aerobic terrestrial representation of decomposition using PFLOTRAN, a reactive flow and transport model, and added anerobic decomposition pathways, salinity, and oxygen (O 2 ) that fluctuates independently of water table level. However, because this model (PFLOTRAN TAI ) is based on decomposition rates and organic matter carbon to nitrogen ratios from terrestrial systems, its performance in TAI systems is currently limited by the lack of empirical data to properly parameterize variables. In addition, while PFLOTRAN TAI can simulate movement of O 2 into sediments, it is not currently capable of tracking the movement of CH 4 gas through plant tissues due to both current model structure and lack of available data. Our overall objective of the project was the increase our mechanistic understanding of CH 4 dynamics in response to environmental change, such that we can improve the representation of these dynamics in PFLOTRAN. We installed automated flux chambers in a new field-scale active soil warming experiment and set up marsh organs (mesocosms) to test effects of warming, flooding, and salinity. This resulted in a new dataset consisting of chamber-level CH 4 flux measurements across multiple sites, ecological conditions, and timeframes, as well as corresponding measurements on porewater chemistry, soil carbon quality, plant biomass, and redox reaction rates. Using these data, we improved PFLOTRAN TAI to more accurately model CH 4 dynamics and successfully tested our hypotheses. This grant contributed to the professional development of 3 postdocs, 4 undergraduate interns, 4 teacher interns, 17 technicians, and 15 participatory scientists. The automated chamber technology designed for this grant has also been shared with multiple new projects.

54 ENVIRONMENTAL SCIENCES

Testing Capabilities for Superconducting Magnets at Fermilab

This presentation will focus on the current testing capabilities for superconducting magnets at Fermilab, highlighting existing systems, recent upgrades, and future plans. The Vertical Magnet Test Facility (VMTF) remains a cornerstone for testing superconducting magnets in R&D applications, maintaining its established capabilities. Stand 4 continues to support the Hi-Lumi AUP production line of magnets in cryostats and has achieved significant improvements through a redesign of lead connections, resolving issues with liquid helium levels and resistance, culminating in a successful endurance test without interruption. Similarly, Stand 7 underwent commissioning and a lead redesign to reduce heat load, while its core testing capabilities remain unchanged. Looking forward, Stand 3 is undergoing a redesign, with plans to restart and begin commissioning by the end of 2025, introducing new features such as background magnetic field testing and upgraded power supplies. Fermilab is also advancing the High Field Vertical Magnet Test Facility (HFVMTF), designed to support the fusion and magnet R&D program, with commissioning scheduled for 2025 and critical components, including the cryostat and power supplies, being delivered. Enhancing all operations, the newly commissioned IB1 cryoplant now offers automated overnight helium production and efficient transfer to a 10,000-liter dewar, streamlining support across all test stands. This talk will provide a comprehensive overview of testing capabilities, and showcasing how Fermilab is advancing its capabilities to meet the evolving demands of superconducting magnet testing.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS

Exploring Large Language Model Agents in Cybersecurity: A Literature Review with Experiments

The accelerated development and integration of large language model (LLM) agents have led researchers and developers to explore their effectiveness in cybersecurity, specifically with penetration testing (pentesting). Recent research efforts have attempted to use LLM agents to automate the process of pentesting because of the cost and time requirements that are required to perform a manual review. However, not all of the tools perform as expected. This paper reviews some of the newest and most popular autonomous pentesting frameworks, highlighting the capabilities and limitations of each one with the goal of providing the components needed to successfully and effectively build an autonomous pentesting agent in the future.

97 MATHEMATICS AND COMPUTING

If We Build Them, They Will Run: Automated HPC Apps Deployment and Profiling with eBPF in Cloud

The high performance computing (HPC) community is in a period of transition. The rise of AI/ML coupled with a changing landscape of resources deems portability a new metric of performance, and methods to move between on-premises and cloud environments and assess compatibility are paramount. Here we design and test a strategy for bridging the gap between traditional HPC and Kubernetes environments – first containerizing applications, providing automated orchestration to run studies, and packaging the setup with automated means to assess performance using low overhead eXtended Berkeley Packet Filter (eBPF) programs. We first assess different designs for eBPF collection, demonstrating a tradeoff between number of programs deployed on a node and overhead added. We develop 5 low overhead eBPF programs that combine with streaming ML models to assess CPU, futex, TCP, shared memory, and file access across four different builds of an HPC application for CPU and GPU. We use eBPF data to generate insights into the possible underlying etiology of scaling issues. We then assess compatibility of a well-known benchmark, HPCG, across matrices of micro-architectures and optimization levels (217 containers across 24 instance types and over 7500 runs). We provide to the community 30 applications to deploy in our automated setup and perform a scaling study from 4 to a maximum of 256 nodes for both CPU and GPU applications. Finally, we use our gained knowledge about performance to generate compatibility artifacts that are used by a newly developed Kubernetes controller to intelligently select instance type based on optimizing a figure of merit. Along with insights to scaling in this environment with a collection of applications and templates to work from, we provide an overall strategy for approaching HPC application deployment and image selection based on compatibility in cloud.

Computer science

Heat load measurements for the PIP-II pHB650 cryomodule

Phase-3 testing of the pHB650 cryomodule at the PIP-II Injector Test Facility was conducted to evaluate the effectiveness of heat load mitigations performed after earlier phases of testing and to continue pinpointing any sources of unexpectedly high heat loads.. The programme measured HTTS, LTTS, and 2 K isothermal/non-isothermal loads under "standard", "linac", and "simulated dynamic" operating modes, recording data both inside the cryomodule and across the bayonet can circuits. Thermal-acoustic oscillations were eliminated by replacing the original G10 cooldown-valve stem with a stainless-steel stem fitted with wipers. A newly developed Python script automated acquisition of ACNET data, performed real-time heat-load calculations, and generated plots and tables that were posted to the electronic logbook within minutes, vastly reducing manual effort and accelerating feedback between SRF and cryogenics teams. Analysis showed that JT heat-exchanger effectiveness and temperature stratification in the two-phase and relief piping strongly influence the observed loads and helped isolate sources of excess heat. The campaign demonstrates that rigorous pre-test planning, real-time diagnostics, and automated reporting can improve both accuracy and efficiency, providing a template for future PIP-II cryomodule tests and for implementing targeted heat-load mitigations.

Porwisiak, D. [Fermilab; Wroclaw Tech. U.] (ORCID:

Myna: Connecting powder bed fusion build data to simulation tools for digital twin applications

Additive manufacturing (AM), as a digital process, can generate a detailed digital thread linking a part’s design and manufacturing to its operational performance. As AM systems advance, an increasing amount of process data is stored in manufacturing databases. In principle, this data can be utilized by simulation-based digital twin approaches, such as real-time process control and asynchronous post-processing guidance. However, few tools currently exist for systematically integrating digital thread data with computational tools. Here, in this study, we propose a software package, called Myna, for connecting data from powder bed fusion processes to simulation tools. The utility of such a platform is demonstrated using build data from the Oak Ridge National Laboratory Manufacturing Demonstration Facility “Peregrine v2023-10” public dataset to automatically configure and run 54 semi-analytical 3DThesis melt pool simulations, 78 numerical Additive FOAM melt pool simulations, and 3 ExaCA microstructure simulations. The simulated, spatially registered microstructures are then compared directly with electron backscatter diffraction characterization of the corresponding as-built part locations. The resulting simulated microstructure showed variation as a function of process parameters, particularly stripe width; however, the experimental data had little variation between the microstructure texture and grain size resulting from different processing conditions. Analysis of the discrepancies suggest that it is possible a two-phase ferritic-austenitic solidification model is needed to accurately predict grain size and texture for certain stainless steel 316L feedstock compositions under powder bed fusion conditions, providing direction for future research. As illustrated here, due to the number and complexity of the simulations involved in AM process-structure–property predictions, automated methods to connect process data and simulations will remain necessary tools for testing hypotheses and implementing digital twin applications.

Knapp, Gerald L. [Oak Ridge National Laboratory (O

Packaging HEP Heterogeneous Mini-apps for Portable Benchmarking and Facility Evaluation on Modern HPCs

High Energy Physics (HEP) experiments are making increasing use of GPUs and GPU dominated High Performance Computer facilities. Both the software and hardware of these systems are rapidly evolving, creating challenges for experiments to make informed decisions as to where they wish to devote resources. In its first phase, the High Energy Physics Center for Computational Excellence (HEP-CCE) produced portable versions of a number of heterogeneous HEP mini-apps, such as p2r, FastCaloSim, Patatrack and the WireCell Toolkit, that exercise a broad range of GPU characteristics, enabling cross platform and facility benchmarking and evaluation. However, these miniapps still require a significant amount of manual intervention to deploy on a new facility. We present our work in developing turn-key deployments of these mini-apps, where by means of containerization and automated configuration and build techniques such as Spack, we are able to quickly test new hardware, software, environments and entire facilities with minimal user intervention, and then track performance metrics over time.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS

Packaging HEP Heterogeneous Mini-apps for Portable Benchmarking and Facility Evaluation on Modern HPCs

High Energy Physics (HEP) experiments are making increasing use of GPUs and GPU dominated High Performance Computer facilities. Both the software and hardware of these systems are rapidly evolving, creating challenges for experiments to make informed decisions as to where they wish to devote resources. In its first phase, the High Energy Physics Center for Computational Excellence (HEP-CCE) produced portable versions of a number of heterogeneous HEP mini-apps, such as \ptor, FastCaloSim, Patatrack and the WireCell Toolkit, that exercise a broad range of GPU characteristics, enabling cross platform and facility benchmarking and evaluation. However, these mini-apps still require a significant amount of manual intervention to deploy on a new facility. We present our work in developing turn-key deployments of these mini-apps, where by means of containerization and automated configuration and build techniques such as Spack, we are able to quickly test new hardware, software, environments and entire facilities with minimal user intervention, and then track performance metrics over time.

Atif, Mohammad [Brookhaven] (ORCID:000000026889770

Generalizable Web User Interface for Scalable and Streamlined Deployment of Building Energy Management Systems in Small and Medium-Sized Commercial Buildings

Small and medium-sized commercial buildings (SMCBs) comprise 94% of US commercial buildings yet face significant barriers to implementing building energy management systems despite advances in smart device technology. Existing solutions present critical limitations: cloud-based API solutions simplify deployment but create vendor lock-in constraints; commercial integrated software solutions ensure compatibility via standardized protocols but require substantial cost and technical expertise; open-source IoT platforms offer cost-effective vendor independence but provide insufficient standardized protocol support for commercial building automation. This research presents a generalizable web user interface framework that bridges the gap between evolving smart device capabilities and lagging software infrastructure for SMCBs. The proposed system integrates VOLTTRON open-source middleware with an automated configuration converter that transforms unified specifications written in YAML, a human-readable data-serialization format, into system-specific files, streamlining manual setup processes. The vendor-agnostic architecture supports industry-standard protocols (BACnet and Modbus) and semantic building models while providing adaptive web interfaces that dynamically adjust to various building configurations. Demonstrations through simulation-based testing and a field deployment show automatic interface adaptation across heterogeneous HVAC systems and multizone monitoring. The automated configuration converter also substantially reduces labor-intensive setup.

Chung, Jihoon [ORNL] (ORCID:0000000184880815)

Modular Autonomous Experimentation for Biological Applications

The Modular Autonomous Research System (MARS) was created to address a key challenge in scientific discovery: experiments are often slow, require significant manual labor, and generate data that is not easily integrated across different tools. This limits how quickly scientists can explore new materials, processes, and chemical reactions. Our motivation was to design a system that makes research faster, more reliable, and adaptable by combining automation with artificial intelligence. By doing so, we aimed to reduce human error, accelerate discovery, and allow researchers to quickly test many possibilities that would otherwise take months or years. Our approach was to build a flexible platform that connects laboratory robots, measurement instruments, and a central data system, all guided by artificial intelligence. MARS integrates liquid handling robots, robotic arms, and plate readers with an intelligent decision-making system that chooses the most informative experiments to run next. This creates a closed loop where experiments are performed automatically, the data is analyzed in real time, and new conditions are immediately tested. Through this work, we demonstrated that MARS can carry out multiple experiments with little or no human intervention, adapt to different scientific problems, and handle uncertain or noisy measurements in a robust way. The results show that modular and intelligent automation can significantly accelerate the pace of discovery, providing a model for future self-driving laboratories. This approach addresses the growing scientific need for adaptable, data-driven research platforms that can keep up with the complexity and scale of modern science.

59 BASIC BIOLOGICAL SCIENCES