Search NASA⌕ Search

SEARCH · Search NASA

Results for “Automated Functional Testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21

Human Factors Evaluation of Conflict Detection Tool for Terminal Area

A conflict detection and resolution tool, Terminal-area Tactical Separation-Assured Flight Environment (T-TSAFE), is being developed to improve the timeliness and accuracy of alerts and reduce the false alert rate observed with the currently deployed technology. The legacy system in use today, Conflict Alert, relies primarily on a dead reckoning algorithm, whereas T-TSAFE uses intent information to augment dead reckoning. In previous experiments, T-TSAFE was found to reduce the rate of false alerts and increase time between the alert to the controller and a loss of separation over the legacy system. In the present study, T-TSAFE was tested under two meteorological conditions, 1) all aircraft operated under instrument flight regimen, and 2) some aircraft operated under mixed operating conditions. The tool was used to visually alert controllers to predicted Losses of separation throughout the terminal airspace, and show compression errors, on final approach. The performance of T-TSAFE on final approach was compared with Automated Terminal Proximity Alert (ATPA), a tool recently deployed by the FAA. Results show that controllers did not report differences in workload or situational awareness between the T-TSAFE and ATPA cones but did prefer T-TSAFE features over ATPA functionality. T-TSAFE will provide one tool that shows alerts in the data blocks and compression errors via cones on the final approach, implementing all tactical conflict detection and alerting via one tool in TRACON airspace.

Verma, Savita Arora↗

EdgeCortix SAKURA-I Machine-Learning, PCIe Accelerator SEE Heavy Ion Test Report

To enable autonomy in space, machine-learning and computer vision applications become invaluable for sensor processing. However, these algorithms are computationally complex and unfeasible for many embedded central processing units (CPUs) and usually require external coprocessors, such as graphics processing units (GPUs) or accelerators specific to the application, including application specific integrated circuits (ASICs). In power-constrained systems, GPUs tend to consume more power than is acceptable (>40W), so lower-power accelerators have shown promise to provide the performance needed under spacecraft constraints. For radiation engineers, developing methodologies that can properly test CPUs, GPUs, and accelerators, and enable comparisons between them remains a necessary complication to solve as the devices become more complex. The methodology in this test aims to be a start in developing a baseline single-event effect (SEE) test for client-device machine learning accelerators. This category of devices do not host their own operating system. This testing campaign is a continuation of a previous 200 MeV proton test performed in January 2024. This report covers two heavy ion tests of the SAKURA-I card: one in April 2024, and one in June 2024. Additional data was needed after the April test due to ion-range issues experienced at higher linear-energy transfers (LETs). These range issues are described in more detail in Section 8. This experiment characterizes SEEs and data error susceptibility of the EdgeCortix SAKURA-I machine-learning accelerator under heavy ions. The device was monitored for single event upsets (SEUs) and single event functional interrupts (SEFIs) at the Lawrence Berkeley National Laboratory’s 88-inch cyclotron. The SAKURA-I board accelerates machine-learning inference applications on a host computer through a PCIex16 connection. For the purposes of devising an end to end automated analysis workflow for this experiment, the YOLO-V5 and SSD300 objection-detection models, and the ResNet-50, EfficientNet, and MobileNetV2 image classification models were used as a representative suite of analytical machine-learning models.

Seth S Roffe↗

Advanced control sequences and FDD technology. Just shiny objects, or ready for scale?

Innovations in commercial building control sequences (ASHRAE guideline 36) and fault detection and diagnostics (FDD) technology have the potential to transform existing building operational efficiency by realizing whole-building level savings on the order of 15% and higher. However, several technical and market barriers related to up-front estimation of achievable savings, verifying implementation, and ensuring persistence are slowing down their adoption as a core offering through diverse owner-funded initiatives and rate-payer funded programs. This paper describes a suite of solutions to overcome these barriers to program delivery of advanced HVAC controls integrated with FDD energy management and information system (EMIS) technology. First, the Guideline 36 conformance test offers an automated method to confirm correct sequence implementation by the manufacturer, before field deployment. A successful test of a controller was conducted using a new manufacturer-independent hardware-in-the-loop testbed demonstrating the viability and scalability of this approach. Second, the Guideline 36 energy savings calculator uses modeling paired with high-level user inputs to estimate building-specific savings potential, target cost effective implementation and minimize uncertainty. Initial results indicate the baseline control sequences significantly impact energy savings, however, as much as 50% savings may be possible for the worst-case baseline scenario. Third, a functional specification provides minimum recommended EMIS-FDD capabilities, and best practices to integrate the technology into organizational practice and ensure that advanced control sequences provide persistent savings.

Pritoni, Marco↗

SLR 2000

SLR 2000 is a concept for a totally automated subcentimeter SLR system presently being studied at GSFC. If funding permits, a prototype would be installed and tested at the Goddard Geophysical and Astronomical Observatory (GCAO) in FY98 and a small number of automated stations would be fielded by the year 2000. Unlike present systems, the "SLR 2000" system is being designed to: 1) operate autonomously without the need for onsite operators; 2) present no hazards (i.e., optical, electrical, and/or chemical) to personnel in the vicinity or to overflying aircraft; and 3) have a mean time between failures (MTBF) of at least three months. It is assumed that the systems are located at "friendly" sites where some level of security is provided and where certain low level service functions (e.g. commercial power, communications, heat pump service cleaning, etc.) are available or can be contracted for locally on an as-needed basis. The main system consists of two parts - an optical head and electronics rack. The optical head contains the laser transmitter and power supply, transmit/receive switch, optical telescope, tracking angle sensor (intensified CCD camera), detector and power supply, two angular encoders, azimuth and elevation motors, and a protective dome. The optical head mounts directly to the top of a concrete pier which contains the geodetic monument and forms part of the environmental housing for the hardware and servicing personnel. It is equipped with electronic levels for leveling the mount and monitoring its stability.

Degnan, John J.↗

Integrated Systems Health Management for Space Exploration

Integrated Systems Health Management (ISHM) is a system engineering discipline that addresses the design, development, operation, and lifecycle management of components, subsystems, vehicles, and other operational systems with the purpose of maintaining nominal system behavior and function and assuring mission safety and effectiveness under off-nominal conditions. NASA missions are often conducted in extreme, unfamiliar environments of space, using unique experimental spacecraft. In these environments, off-nominal conditions can develop with the potential to rapidly escalate into mission- or life-threatening situations. Further, the high visibility of NASA missions means they are always characterized by extraordinary attention to safety. ISHM is a critical element of risk mitigation, mission safety, and mission assurance for exploration. ISHM enables: In-space maintenance and repair; a) Autonomous (and automated) launch abort and crew escape capability; b) Efficient testing and checkout of ground and flight systems; c) Monitoring and trending of ground and flight system operations and performance; d) Enhanced situational awareness and control for ground personnel and crew; e) Vehicle autonomy (self-sufficiency) in responding to off-nominal conditions during long-duration and distant exploration missions; f) In-space maintenance and repair; and g) Efficient ground processing of reusable systems. ISHM concepts and technologies may be applied to any complex engineered system such as transportation systems, orbital or planetary habitats, observatories, command and control systems, life support systems, safety-critical software, and even the health of flight crews. As an overarching design and operational principle implemented at the system-of-systems level, ISHM holds substantial promise in terms of affordability, safety, reliability, and effectiveness of space exploration missions.

Uckun, Serdar↗

Proposal for hierarchical description of software systems

The programming of digital computers has developed into a new dimension full of diffculties, because the hardware of computers has become so powerful that more complex applications are entrusted to computers. The costs of software development, verification, and maintenance are outpacing those of the hardware and the trend is toward futher increase of sophistication of application of computers and consequently of sophistication of software. To obtain better visibility into software systems and to improve the structure of software systems for better tests, verification, and maintenance, a clear, but rigorous description and documentation of software is needed. The purpose of the report is to extend the present methods in order to obtain a documentation that better reflects the interplay between the various components and functions of a software system at different levels of detail without losing the precision in expression. This is done by the use of block diagrams, sequence diagrams, and cross-reference charts. In the appendices, examples from an actual large sofware system, i.e. the Marshall System for Aerospace Systems Simulation (MARSYAS), are presented. The proposed documentation structure is compatible to automation of updating significant portions of the documentation for better software change control.

Thauboth, H.↗

Bayesian Optimization for Reactor Design Optimization

This study present a test case in which the Bayesian Optimization method is applied to a simulation-based reactor core design optimization problem. The test case aims to showcase the potential of an automated design optimization algorithm for reactor designs by streamlining the reactor core design workflow, given the high computational cost of simulations. The contributions of this work are threefold. First, the existing HTGR model is converted into a simulation-based design optimization test case by developing a pipeline that enables modification of key design parameters and evaluates design performance based on simulation outputs. Second, Bayesian Optimization is implemented and adapted to demonstrate the feasibility of automatic design optimization for nuclear reactor core. Proposed approach leverages Gaussian Process models to characterize the relationship between design variables and performance metrics, while incorporating novel acquisition functions that balance exploration of the design space with exploitation of promising configurations. This implementation lays the foundation for the future developments of reactor design optimization algorithms.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Myna: Connecting powder bed fusion build data to simulation tools for digital twin applications

Additive manufacturing (AM), as a digital process, can generate a detailed digital thread linking a part’s design and manufacturing to its operational performance. As AM systems advance, an increasing amount of process data is stored in manufacturing databases. In principle, this data can be utilized by simulation-based digital twin approaches, such as real-time process control and asynchronous post-processing guidance. However, few tools currently exist for systematically integrating digital thread data with computational tools. Here, in this study, we propose a software package, called Myna, for connecting data from powder bed fusion processes to simulation tools. The utility of such a platform is demonstrated using build data from the Oak Ridge National Laboratory Manufacturing Demonstration Facility “Peregrine v2023-10” public dataset to automatically configure and run 54 semi-analytical 3DThesis melt pool simulations, 78 numerical Additive FOAM melt pool simulations, and 3 ExaCA microstructure simulations. The simulated, spatially registered microstructures are then compared directly with electron backscatter diffraction characterization of the corresponding as-built part locations. The resulting simulated microstructure showed variation as a function of process parameters, particularly stripe width; however, the experimental data had little variation between the microstructure texture and grain size resulting from different processing conditions. Analysis of the discrepancies suggest that it is possible a two-phase ferritic-austenitic solidification model is needed to accurately predict grain size and texture for certain stainless steel 316L feedstock compositions under powder bed fusion conditions, providing direction for future research. As illustrated here, due to the number and complexity of the simulations involved in AM process-structure–property predictions, automated methods to connect process data and simulations will remain necessary tools for testing hypotheses and implementing digital twin applications.

Knapp, Gerald L. [Oak Ridge National Laboratory (O↗

A Comparison of Three-Dimensional Simulations of Traveling-Wave Tube Cold-Test Characteristics Using CST MICROWAVE STUDIO and MAFIA

Previously, it was shown that MAFIA (solutions of Maxwell's equations by the Finite Integration Algorithm), a three-dimensional simulation code, can be used to produce accurate cold-test characteristics including frequency-phase dispersion, interaction impedance, and attenuation for traveling-wave tube (TWT) slow-wave structures. In an effort to improve user-friendliness and simulation time, a model was developed to compute the cold-test parameters using the electromagnetic field simulation software package CST MICROWAVE STUDIO (MWS). Cold-test parameters were calculated for several slow-wave circuits including a ferruled coupled-cavity, a folded waveguide, and a novel finned-ladder circuit using both MWS and MAFIA. Comparisons indicate that MWS provides more accurate cold-test data with significantly reduced simulation times. Both MAFIA and MWS are based on the finite integration (FI) method; however, MWS has several advantages over MAFIA. First, it has a Windows based interface for PC operation, making it very user-friendly, whereas MAFIA is UNIX based. MWS uses a new Perfect Boundary Approximation (PBA), which increases the accuracy of the simulations by avoiding stair step approximations associated with MAFIA's representation of structures. Finally, MWS includes a Visual Basic for Applications (VBA) compatible macro language that enables the simulation process to be automated and allows for the optimization of user-defined goal functions, such as interaction impedance.

Chevalier, C. T.↗

Automating methods for estimating metabolite volatility

The volatility of metabolites can influence their biological roles and inform optimal methods for their detection. Yet, volatility information is not readily available for the large number of described metabolites, limiting the exploration of volatility as a fundamental trait of metabolites. Here, we adapted methods to estimate vapor pressure from the functional group composition of individual molecules (SIMPOL.1) to predict the gas-phase partitioning of compounds in different environments. We implemented these methods in a new open pipeline called volcalc that uses chemoinformatic tools to automate these volatility estimates for all metabolites in an extensive and continuously updated pathway database: the Kyoto Encyclopedia of Genes and Genomes (KEGG) that connects metabolites, organisms, and reactions. We first benchmark the automated pipeline against a manually curated data set and show that the same category of volatility (e.g., nonvolatile, low, moderate, high) is predicted for 93% of compounds. We then demonstrate how volcalc might be used to generate and test hypotheses about the role of volatility in biological systems and organisms. Specifically, we estimate that 3.4 and 26.6% of compounds in KEGG have high volatility depending on the environment (soil vs. clean atmosphere, respectively) and that a core set of volatiles is shared among all domains of life (30%) with the largest proportion of kingdom-specific volatiles identified in bacteria. With volcalc , we lay a foundation for uncovering the role of the volatilome using an approach that is easily integrated with other bioinformatic pipelines and can be continually refined to consider additional dimensions to volatility. The volcalc package is an accessible tool to help design and test hypotheses on volatile metabolites and their unique roles in biological systems.

59 BASIC BIOLOGICAL SCIENCES↗

Simple and Accurate One-Body Energy and Dipole Moment Surfaces for Water and Beyond

Water is often the testing ground for new, advanced force fields. While advanced functional forms for intermolecular interactions have been integral to the development of accurate water models, less attention has been paid to a transferable model for intramolecular valence terms. In this work, we present a one-body energy and dipole moment surface model, named 1B-UCB, that is simple yet accurate and can be feasibly adapted for both standard and advanced potentials. 1B-UCB for water is comparable in accuracy to those with much more complex functional forms, despite having drastically fewer parameters. The parametrization protocol has been implemented as part of the Q-Force automated workflow and requires only a quantum mechanical Hessian calculation as reference data, hence allowing it to be easily extended to a variety of molecular systems beyond water, which we demonstrate on a selection of small molecules with different symmetries.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Models of Human Information Requirements: "When Reasonable Aiding Systems Disagree"

Aircraft flight management and Air Traffic Control (ATC) automation are under development to maximize the economy of flight and to increase the capacity of the terminal area airspace while maintaining levels of flight safety equal to or better than current system performance. These goals are being realized by the introduction of flight management automation aiding and operations support systems on the flight deck and by new developments of ATC aiding systems that seek to optimize scheduling of aircraft while potentially reducing required separation and accounting for weather and wake vortex turbulence. Aiding systems on both the flight deck and the ground operate through algorithmic functions on models of the aircraft and of the airspace. These models may differ from each other as a result of variations in their models of the immediate environment. The resultant flight operations or ATC commands may differ in their response requirements (e.g. different preferred descent speeds or descent initiation points). The human operators in the system must then interact with the automation to reconcile differences and resolve conflicts. We have developed a model of human performance including cognitive functions (decision-making, rule-based reasoning, procedural interruption recovery and forgetting) that supports analysis of the information requirements for resolution of flight aiding and ATC conflicts. The model represents multiple individuals in the flight crew and in ATC. The model is supported in simulation on a Silicon Graphics' workstation using Allegro Lisp. Design guidelines for aviation automation aiding systems have been developed using the model's specification of information and team procedural requirements. Empirical data on flight deck operations from full-mission flight simulation are provided to support the model's predictions. The paper describes the model, its development and implementation, the simulation test of the model predictions, and the empirical validation process. The model and its supporting data provide a generalizable tool that is being expanded to include air/ground compatibility and ATC crew interactions in air traffic management.

Corker, Kevin↗

Hardware-in-Loop Modules for Testing Automated Ventilator Controllers

Automated ventilator controllers have the potential to simplify oxygen and carbon dioxide management for trauma. In the pre-hospital or military medicine environment, trauma care can be required for prolonged periods by personnel with limited ventilator management training. As such, there is a need for closed-loop control systems that can adapt ventilator management to a complex, ever-changing medical environment. Here, we present a novel hardware-in-loop test platform for the independent troubleshooting and evaluation of oxygen and carbon dioxide automated ventilator management capabilities. The oxygen management system provides an analogue blood oxygen signal that is responsive to the fraction of inspired oxygen and the peak inspiratory pressure ventilator settings. A tested oxygenation controller successfully reached the target oxygen saturation within 5 min. The carbon dioxide removal system integrates with commercial ventilator technology and mimics carbon dioxide generation, lung compliance, and airway resistance while providing an end-tidal carbon dioxide level that is responsive to changes in the tidal volume and respiratory rate settings. A test mechanical ventilator controller was able to regulate EtCO2 regardless of the starting value within 10 min. This highlights the system’s functionality and provides proof-of-concept demonstrations for how the hardware-in-loop test platforms can be used for evaluating closed-loop controller technologies.

Berard, David (ORCID:0000000322863846)↗

An Architecture to Enable Autonomous Control of Spacecraft

Autonomy is required for manned spacecraft missions distant enough that light-time communication delays make ground-based mission control infeasible. Presently, ground controllers develop a complete schedule of power modes for all spacecraft components based on a large number of factors. The proposed architecture is an early attempt to formalize and automate this process using on-vehicle computation resources. In order to demonstrate this architecture, an autonomous electrical power system controller and vehicle Mission Manager are constructed. These two components are designed to work together in order to plan upcoming load use as well as respond to unanticipated deviations from the plan. The communication protocol was developed using "paper" simulations prior to formally encoding the messages and developing software to implement the required functionality. These software routines exchange data via TCP/IP sockets with the Mission Manager operating at NASA Ames Research Center and the autonomous power controller running at NASA Glenn Research Center. The interconnected systems are tested and shown to be effective at planning the operation of a simulated quasi-steady state spacecraft power system and responding to unexpected disturbances.

space power systems↗

Operations automation using the Link Monitor and Control Operator Assistant

The Link Monitor and Control Operator Assistant (LMC OA) is a knowledge-based prototype system which uses AI techniques to provide semiautomated monitor and control functions to support operations of the Deep Space Network (DSN) 70-m antenna at the Goldstone Deep Space Communications Complex (DSCC). The manual and time-consuming process of configuring the 70-m antenna and its associated communications and processing equipment, known as precalibration, is an overhead activity; the time spent in precalibration is time which cannot be spent supporting actual mission operations. Therefore, the major goal of the LMC OA task is to demonstrate techniques that reduce precalibration time, decrease operations overhead, and increase the availability of this valuable and oversubscribed NASA resource. The LMC OA prototype was tested in a parallel, experimental mode at the Goldstone DSCC performing semiautomated precalibration using the actual operational equipment. This test demonstrated that a reduction of 40 percent in precalibration time can be achieved with the LMC OA prototype.

Lee, Lorrine F.↗

Scalable Thin Light-Emitting Diode (LED) Light Sheet Platform

The goal of the Scalable Thin Light-Emitting Diode (LED) Light Sheet Platform project is to derisk the manufacturing scalability for a high chip count heterogeneous smart lighting platform, with the potential to enable significant energy savings through dynamic directional light control and custom. Specifically, the project derisks the scalability of a disruptive new computer controlled microassembly fabrication process SRI International is developing, to address fundamental cost barriers to mass production of high chip count systems. This is key for enabling mass adoption and thus maximum societal energy savings impact. The LED light sheet technology is a smart illumination platform that can be applied to lighting, signage, and display. It has features and a form factor similar to bendable or conformal OLED light sheets but uses more efficient LEDs with a remote phosphor layer that is very close to the LED to deliver a luminous efficacy that exceeds 125 lumen/Watt and enable > 50% Lighting Application Efficiency (LAE) energy savings. During Budget Period 1 (BP1), all of the BP1 milestones were successfully completed: (M2.0.1) Design demonstrator details that will meet the final project goals, (M6.1.1) Show lighting output model can predict illuminance, spatial, spectral distribution for specific light-sheet designs and use case, (M3.2.1) Automated loading supports 200 chip arrays, and (M3.3.1) Finish first interconnect process run for 200 chip array. The BP1 Go/No-Go Decision Point (G/NG 1) 200 chip demonstrator sample was in the process of final assembly and test at the end of BP1 on December 31, 2023. The objective was successfully achieved on January 16, 2024, when a wired 200-chip sample underwent confirmation testing that demonstrated a 93.75% first pass electrical yield that successfully exceeded the 75% first-pass electrical yield BP1 G/NG requirement. In addition, all 93.75% of the sample devices lit up, further demonstrating the ability to assemble and transfer small LED chips without damaging their functionality.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Joint U.S./Japan Conference on Adaptive Structures, 1st, Maui, HI, Nov. 13-15, 1990, Proceedings

The present volume of adaptive structures discusses the development of control laws for an orbiting tethered antenna/reflector system test scale model, the sizing of active piezoelectric struts for vibration suppression on a space-based interferometer, the control design of a space station mobile transporter with multiple constraints, and optimum configuration control of an intelligent truss structure. Attention is given to the formulation of full state feedback for infinite order structural systems, robustness issues in the design of smart structures, passive piezoelectric vibration damping, shape control experiments with a functional model for large optical reflectors, and a mathematical basis for the design optimization of adaptive trusses in precision control. Topics addressed include approaches to the optimal adaptive geometries of intelligent truss structures, the design of an automated manufacturing system for tubular smart structures, the Sandia structural control experiments, and the zero-gravity dynamics of space structures in parabolic aircraft flight.

Wada, Ben K.↗

Robotic end-effector for rewaterproofing shuttle tiles

This paper summarizes work by Rockwell International's Space Systems Division's Robotics Group at Downey, California. The work is part of a NASA-led team effort to automate Space Shuttle rewaterproofing in the Orbiter Processing Facility at the Kennedy Space Center and the ferry facility at the Ames-Dryden Flight Research Facility. Rockwell's effort focuses on the rewaterproofing end-effector, whose function is to inject hazardous dimethylethyloxysilane into thousands of ceramic tiles on the underside of the orbiter after each flight. The paper has five sections. First, it presents background on the present manual process. Second, end-effector requirements are presented, including safety and interface control. Third, a design is presented for the five end-effector systems: positioning, delivery, containment, data management, and command and control. Fourth, end-effector testing and integrating to the total system are described. Lastly, future applications for this technology are discussed.

Manouchehri, Davoud↗