Search NASA⌕ Search

SEARCH · Search NASA

Results for “Test Framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,261 records · Page 70

A quality assurance framework for the fully automated and objective evaluation of image quality in cone-beam computed tomography

Purpose: Thousands of cone-beam computed tomography (CBCT) scanners for vascular, maxillofacial, neurological, and body imaging are in clinical use today, but there is no consensus on uniform acceptance and constancy testing for image quality (IQ) and dose yet. The authors developed a quality assurance (QA) framework for fully automated and time-efficient performance evaluation of these systems. In addition, the dependence of objective Fourier-based IQ metrics on direction and position in 3D volumes was investigated for CBCT. Methods: The authors designed a dedicated QA phantom 10 cm in length consisting of five compartments, each with a diameter of 10 cm, and an optional extension ring 16 cm in diameter. A homogeneous section of water-equivalent material allows measuring CT value accuracy, image noise and uniformity, and multidimensional global and local noise power spectra (NPS). For the quantitative determination of 3D high-contrast spatial resolution, the modulation transfer function (MTF) of centrally and peripherally positioned aluminum spheres was computed from edge profiles. Additional in-plane and axial resolution patterns were used to assess resolution qualitatively. The characterization of low-contrast detectability as well as CT value linearity and artifact behavior was tested by utilizing sections with soft-tissue-equivalent and metallic inserts. For an automated QA procedure, a phantom detection algorithm was implemented. All tests used in the dedicated QA program were initially verified in simulation studies and experimentally confirmed on a clinical dental CBCT system. Results: The automated IQ evaluation of volume data sets of the dental CBCT system was achieved with the proposed phantom requiring only one scan for the determination of all desired parameters. Typically, less than 5 min were needed for phantom set-up, scanning, and data analysis. Quantitative evaluation of system performance over time by comparison to previous examinations was also verified. The maximum percentage interscan variation of repeated measurements was less than 4% and 1.7% on average for all investigated quality criteria. The NPS-based image noise differed by less than 5% from the conventional standard deviation approach and spatially selective 10% MTF values were well comparable to subjective results obtained with 3D resolution pattern. Determining only transverse spatial resolution and global noise behavior in the central field of measurement turned out to be insufficient. Conclusions: The proposed framework transfers QA routines employed in conventional CT in an advanced version to CBCT for fully automated and time-efficient evaluation of technical equipment. With the modular phantom design, a routine as well as an expert version for assessing IQ is provided. The QA program can be used for arbitrary CT units to evaluate 3D imaging characteristics automatically.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

An Automated, Disruption-Tolerant Device Authentication and Key Management Framework for Critical Systems

Key management is critical to secure operation. Distributed control systems, such as Supervisory Control and Data Acquisition (SCADA) systems, have unique operational requirements that make conventional key management solutions less effective and burdensome. In this paper a novel Kerberos based framework for automated, disruption-tolerant key management for control system environments is presented. Experimental tests and their results are presented to quantify expected performance overhead of this approach. In addition, Zeek sensor analytics are presented to monitor the health and security of the key management framework operation.

Edgar, Thomas W.↗

Evaluation of automated stability testing in machining through closed-loop control and Bayesian machine learning

Here, this paper describes a system for automated identification of the optimal stable cutting parameters in milling through Bayesian machine learning and closed-loop control. The closed-loop control system consists of a process monitoring architecture, an analysis framework, and a feedback mechanism. The analysis framework consists of a Bayesian machine learning algorithm that learns a stability map given test results. The learned stability map is used to select parameters for stability testing using an expected improvement in the material removal rate criterion. The test parameters are communicated to the machine controller to complete the test cut through a feedback mechanism. The test cuts were monitored using an audio signal; the stability of the test cut was determined by analyzing the frequency content of the audio signal. The test result was fed back to the Bayesian learning algorithm to complete the loop. Experimental results demonstrate that the system can identify the optimal stable parameters without information about the cutting force model or the structural dynamics. The system provides a low-cost method for optimal stable parameter identification in an industrial environment.

Chatter↗

Applicability of a Framework for Estimating Performance and Associated Uncertainty for Modified Aircraft Configurations

As improvements are made to the accuracy and reliability of modeling and simulation techniques, certification by analysis becomes a more attractive alternative compared to traditional aircraft flight testing. Certification by analysis is especially cost-effective when one considers modifications to a previously certified aircraft. However, it is important that the models and methods used are applicable and accurate throughout the intended use domain. A framework for estimating the performance and associated uncertainty was introduced in an earlier paper. The factors and limitations of this framework for estimating the performance and associated model form uncertainty are explored to determine the range of applicability of the framework, particularly with respect to model form, process and sensor noise, and quality of available flight test data. This paper focuses on the general limitations and applicability of the framework and not the applicability of the individual methods to a range of modified configurations, which requires a large number of modified configurations and is an area for future work. The effects of these factors on the performance and uncertainty results are demonstrated using NASA’s Generic Transport Model aircraft.

uncertainty quantification↗

Data-driven deconvolution for large eddy simulations of Kraichnan turbulence

In this article, we demonstrate the use of artificial neural networks as optimal maps which are utilized for convolution and deconvolution of coarse-grained fields to account for sub-grid scale turbulence effects. Here, we demonstrate that an effective eddy-viscosity is predicted by our purely data-driven large eddy simulation framework without explicit utilization of phenomenological arguments. In addition, our data-driven framework precludes the knowledge of true sub-grid stress information during the training phase due to its focus on estimating an effective filter and its inverse so that grid-resolved variables may be related to direct numerical simulation data statistically. The proposed predictive framework is also combined with a statistical truncation mechanism for ensuring numerical realizability in an explicit formulation. Through this, we seek to unite structural and functional modeling strategies for modeling non-linear partial differential equations using reduced degrees of freedom. Both a priori and a posteriori results are shown for a two-dimensional decaying turbulence case in addition to a detailed description of validation and testing. A hyperparameter sensitivity study also shows that the proposed dual network framework simplifies learning complexity and is viable with exceedingly simple network architectures. Our findings indicate that the proposed framework approximates a robust and stable sub-grid closure which compares favorably to the Smagorinsky and Leith hypotheses for capturing the theoretical k -3 scaling in Kraichnan turbulence.

42 ENGINEERING↗

New developments and verification of fusion blanket simulation capabilities in the MOOSE framework

Multiphysics modeling capabilities have a crucial role to play in the accelerated deployment of fusion energy. To that end, we developed new multiphysics fusion blanket simulation capabilities in the Multiphysics Object-Oriented Simulation Environment (MOOSE). Firstly, we expanded on the existing capabilities of the previously published work, by coupling 3D tritium transport modeling capabilities using the Tritium Migration Analysis Program, version 8 (TMAP8) to an existing tool including thermal hydraulics, fully three-dimensional (3D) heat transfer, and loosely coupled neutronics analysis. Secondly, we performed a thorough verification of the new capabilities and increased testing code coverage to meet MOOSE’s software quality standards. The MOOSE framework follows a strict software quality assurance plan to be Nuclear Quality Assurance, Level 1 compliant. The new multiphysics fusion blanket simulation capabilities are now held to the same standard. Thirdly, to demonstrate MOOSE’s new fusion blanket modeling capabilities, we performed a fully integrated, multiphysics simulation of a 3D solid ceramic breeder blanket design. This proof-of-concept simulation provides the temperature and tritium distribution across the blanket. In conclusion, the combined efforts towards software quality and the development of multiphysics coupling capabilities provide an effective and reliable framework for modeling solid ceramic fusion blankets using MOOSE.

modeling and simulation↗

express: Extensible, high-level workflows for swifter ab initio materials modeling

In this work, we introduce an open-source Julia project, express, an extensible, lightweight, high-throughput, high-level workflow framework that aims to automate ab initio calculations for the materials science community. express is shipped with well-tested workflow templates, including structure optimization, equation of state (EOS) fitting, phonon spectrum (lattice dynamics) calculation, and thermodynamic property calculation in the framework of the quasi-harmonic approximation (QHA). It is designed to be highly modularized so that its components can be reused across various occasions, and customized workflows can be built on top of that. Users can also track the status of workflows in real-time, and rerun failed jobs thanks to the data lineage feature express provides. Finally, two working examples, i.e., all workflows applied to lime and akimotoite, are also presented in the code and this paper.

36 MATERIALS SCIENCE↗

Graphic simualtion test bed for robotics applications in a workstation environment

Graphical simulation is a cost-effective solution for developing and testing robots and their control systems. The availability of various high-performance workstations makes these systems feasible. Simulation offers preliminary testing of systems before their actual realizations, and it provides a framework for developing new control and planning algorithms. On the other hand, these simulation systems have to have the capability of incorporating various knowledge-based system components, e.g., task planners, representation formalisms, etc. They also should have an appropriate user interface, which makes possible the creation and control of simulation models. ROBOSIM was developed jointly by MSFC and Vanderbilt University, first in a VAX environment. Recently, the system has been ported to an HP-9000 workstation equipped with an SRX graphics accelerator. The user interface of the system now contains a menu- and icon-based facility, as well as the original ROBOSIM language. The system is also coupled to a symbolic computing system based on Common Lisp, where knowledge-based functionalities are implemented. The knowledge-based layer uses various representation and reasoning facilities for programming and testing the control systems of robots.

Springfield, J.↗

On-Track Measurement of Road Load Changes in Two Close-Following Vehicles: Methods and Results

As emerging automated vehicle technology is making advances in safety and reliability, engineers are also exploring improvements in energy efficiency with this new paradigm. Powertrain efficiency receives due attention, but also impactful is finding ways to reduce driving losses in coordinated-driving scenarios. Efforts focused on simulation to quantify road load improvements require a sufficient amount of background validation work to support them. This study uses a practical approach to directly quantify road load changes by testing the coordinated driving of two vehicles on a test track at various speeds (64, 88, 113 km/h) and vehicle time gaps (0.3 to 1.3 s). Axle torque sensors were used to directly measure the load required to maintain steady-state speeds while following a lead vehicle at various gap distances. Through trial and error, test methods were developed that appear to provide satisfactory results, considering the challenges of track testing under real-world conditions (wind, weather, temperature changes, etc.). We found that total road load was reduced by about 10-12% at an optimum gap time of 0.25 to 0.4 s. Challenges that were encountered included less repeatability of load measurements at short gap distances and powertrain mode switching (from a hybrid vehicle) that rendered the 88-km/h results less useful. This study will provide the framework for further investigations on coordinated-driving road load using track testing methods.

Duoba, Michael↗

Reducing Communication Overhead in Federated Learning for Network Anomaly Detection with Adaptive Client Selection

Communication overhead in federated learning (FL) poses a significant challenge for network anomaly detection systems, where the myriad of client configurations and network conditions can severely impact system efficiency and detection accuracy. While existing approaches attempt to address this through individual optimization techniques, they often fail to maintain the delicate balance between reduced overhead and detection performance. This paper presents an adaptive FL framework that dynamically combines batch size optimization, client selection, and asynchronous updates to achieve efficient anomaly detection. Through extensive profiling and experimental analysis on two distinct datasets-UNSW-NBIS for general network traffic and ROAD for automotive networks-our framework reduces communication overhead by 97.6%; (from 700.0s to 16.8s) compared to synchronous baseline approaches while maintaining comparable detection accuracy (95.10%; vs. 95.12%;). Statistical validation using Mann-Whitney U test confirms significant improvements (p < 0.05) over existing FL approaches across both datasets, demonstrating the framework's adaptability to different network security contexts. Detailed profiling analysis reveals the efficiency gains through dramatic reductions in GPU operations and memory transfers while maintaining robust detection performance under varying client conditions.

Marfo, William [University of Texas at El Paso]↗

Separation of Carbon Monoxide and Carbon Dioxide for Mars ISRU-Concepts

Solid oxide electrolyzers, such as electrolysis cells utilizing yttria-stabilized zirconia, can produce oxygen from Mars atmospheric carbon dioxide and reject carbon monoxide and unreacted carbon dioxide in a separate stream. The oxygen-production process has been shown to be far more efficient if the high-pressure, unreacted carbon dioxide can be separated and recycled back into the feed stream. Additionally, the mass of the adsorption compressor can be reduced. Also, the carbon monoxide by-product is a valuable fuel for space exploration and habitation, with applications from fuel cells to production of hydrocarbons and plastics. In our research, we will design, construct, and test an innovative, robust, low mass, low power separation device that can recover carbon dioxide and carbon monoxide for Mars ISRU. Such fundamental process technology, involving gas-solid phase separation in a reduced gravitational environment, will help to enable Human Exploration and Development of Space. The separation device will be scaled to operate with a CO2 sorption compressor and a zirconia electrolysis device built at the NASA Ames Research Center and the University of Arizona, respectively. In our research, we will design, construct, and test an innovative, robust, low mass, low power separation device that can recover carbon dioxide and carbon monoxide for Mars ISRU, Such fundamental process technology, involving gas-solid phase separation in a reduced gravitational environment, will help to enable Human Exploration and Development of Space. The separation device will be scaled to operate with a CO2 sorption compressor and a zirconia electrolysis device built at the NASA Ames Research Center and the University of Arizona, The separation device will be scaled to operate with a CO2 sorption compressor and a zirconia electrolysis device built at the NASA Ames Research Center and the University of Arizona, Research needs for the design shown are as follows: (1) The best adsorbent for the process must be determined. (2) Adsorption isotherms must be measured, both for pure components and mixtures. (3) Mathematical modeling must be performed to provide a solid framework for design. (4) The separation system must be constructed and tested. (5) System integration must be studied.

LeVan, M. Douglas↗

Ultrastable Zirconium-Based Cationic Metal–Organic Frameworks for Perrhenate Removal from Wastewater

The effective removal of radioactive 99 TcO 4 – anion from nuclear wastewater remains a very difficult unsolved problem. Functional adsorbent materials with high stability, anion-exchange capacity, excellent selectivity, and recyclability are much needed to solve this problem. In this work, we designed two stable cationic metal–organic frameworks (MOFs)—Zr-tcbp-Me and Zr-tcpp-Me—for possible use as adsorbent materials to remove 99 TcO 4 – . Both compounds were synthesized by solvothermal reactions of the tetracarboxylate ligand with zirconium salt, followed by postsynthetic modification (N-methylation). Here, the crystallinity of both zirconium-based MOFs can be well retained under harsh conditions, and they exhibit high adsorption capacity and selectivity toward ReO 4 – anion, a nonradioactive analogue of 99 TcO 4 – . Zr-tcbp-Me and Zr-tcpp-Me demonstrate the highest framework stability toward acidity among all previously reported cationic MOFs that have been tested for perrhenate removal from wastewater.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Flight Test Design and Implementation for Airspace Independent Surveillance Through a Distributed Ground Based Sensor Network

The paper presents a system architecture for distributed sensing, networking and computing, its hardware implementation, and execution of initial flight experiments to validate theoretical findings. It induces development of distributed sensing requirements, framework, and architecture, development of distributed ground node hardware prototypes, integration of all nodes and testing of baseline functionalities, integration of in-house developed perception, migration and tracking software packages, establishing flight scenario and flyable path for a selected UAS, flying the air vehicle along the path, recording sensors measurements, pre-processing them and transferring the resulting data to an optimal computing center. It also addresses the challenges related to pre-flight hardware calibration, clock synchronization, sensor registration and establishing a communication network. Sensors data processing results demonstrate the functionality of the presented distributed architecture and satisfactory performance of the applied technologies.

Target tracking↗

SISO Space Reference FOM - Tools and Testing

The Simulation Interoperability Standards Organization (SISO) Space Reference Federation Object Model (SpaceFOM) version 1.0 is nearing completion. Earlier papers have described the use of the High Level Architecture (HLA) in Space simulation as well as technical aspects of the SpaceFOM. This paper takes a look at different SpaceFOM tools and how they were used during the development and testing of the standard.The first organizations to develop SpaceFOM-compliant federates for SpaceFOM development and testing were NASA's Johnson Space Center (JSC), the University of Calabria (UNICAL), and Pitch Technologies.JSC is one of NASA's lead centers for human space flight. Much of the core distributed simulation technology development, specifically associated with the SpaceFOM, is done by the NASA Exploration Systems Simulations (NExSyS) team. One of NASA's principal simulation development tools is the Trick Simulation Environment. NASA's NExSyS team has been modifying and using Trick and TrickHLA to help develop and test the SpaceFOM.The System Modeling And Simulation Hub Laboratory (SMASH-Lab) at UNICAL has developed the Simulation Exploration Experience (SEE) HLA Starter kit, that has been used by most SEE teams involved in the distributed simulation of a Moon base. It is particularly useful for the development of federates that are compatible with the SpaceFOM. The HLA Starter Kit is a Java based tool that provides a well-structured framework to simplify the formulation, generation, and execution of SpaceFOM-compliant federates.Pitch Technologies, a company specializing in distributed simulation, is utilizing a number of their existing HLA tools to support development and testing of the SpaceFOM. In addition to the existing tools, Pitch has developed a few SpaceFOM specific federates: Space Master for managing the initialization, execution and pacing of any SpaceFOM federation; EarthEnvironment, a simple Root Reference Publisher; and Space Monitor, a graphical tool for monitoring reference frames and physical entities.Early testing of the SpaceFOM was carried out in the SEE university outreach program, initiated in SISO. Students were given a subset of the FOM, that was later extended. Sample federates were developed and frameworks were developed or adapted to the early FOM versions.As drafts of the standard matured, testing was performed using federates from government, industry, and academia. By mixing federates developed by different teams the standard could be tested with respect to functional correctness, robustness and clarity.These frameworks and federates have been useful when testing and verifying the design of the standard. In addition to this, they have since formed a starting point for developing SpaceFOM-compliant federations in several projects, for example for NASA, ESA as well as SEE.

Möller, Björn↗

Subgrid modelling for two-dimensional turbulence using neural networks

Here in this investigation, a data-driven turbulence closure framework is introduced and deployed for the subgrid modelling of Kraichnan turbulence. The novelty of the proposed method lies in the fact that snapshots from high-fidelity numerical data are used to inform artificial neural networks for predicting the turbulence source term through localized grid-resolved information. In particular, our proposed methodology successfully establishes a map between inputs given by stencils of the vorticity and the streamfunction along with information from two well-known eddy-viscosity kernels. Through this we predict the subgrid vorticity forcing in a temporally and spatially dynamic fashion. Our study is both a priori and a posteriori in nature. In the former, we present an extensive hyper-parameter optimization analysis in addition to learning quantification through probability-density-function-based validation of subgrid predictions. In the latter, we analyse the performance of our framework for flow evolution in a classical decaying two-dimensional turbulence test case in the presence of errors related to temporal and spatial discretization. Statistical assessments in the form of angle-averaged kinetic energy spectra demonstrate the promise of the proposed methodology for subgrid quantity inference. In addition, it is also observed that some measure of a posteriori error must be considered during optimal model selection for greater accuracy. The results in this article thus represent a promising development in the formalization of a framework for generation of heuristic-free turbulence closures from data.

42 ENGINEERING↗

DEVELOPMENT OF ENSEMBLE-BASED PROBABILISTIC FLOOD MAPS FOR PROBABLE MAXIMUM FLOOD

The magnitude and frequency of hydro-meteorological extremes are expected to increase in a changing environment that threaten the security of US energy-water assets. This includes probable maximum precipitation (PMP) and probable maximum flood (PMF) which are used as hydraulic design standards for critical infrastructures such as major hydropower reservoirs and nuclear power plants. To assess the potential flood hazards due to PMP/PMF, an integrated high resolution process-based hydro-meteorologic modeling framework was utilized to develop ensemble-based probabilistic flood maps based on best-available historic observations and future climate projections. A graphical process unit accelerated 2-dimensional hydrodynamic model was used to simulate the surface inundation areas corresponding to a total of PMF hydrographs. These ensemble-based PMF maps were compared with flood maps obtained from the conventional deterministic PMP/PMF approach, revealing added information of conditional probability of flooding. Further, a relative sensitivity test was conducted to explore the effects of various factors in the framework such as meteorological forcings, antecedent hydrologic conditions, reservoir storage, and flood model input resolution and parameters. The proposed framework better illustrates the uncertainties associated with model inputs, parameterization and hydro-meteorological factors allowing more informed decision-making for future emergency preparation.

13 HYDRO ENERGY↗

Flight Test Design and Implementation for Independent Surveillance of an Airspace Through a Distributed Ground Sensing Network

The paper presents a system architecture for distributed sensing, networking and computing, its hardware implementation, and execution of initial flight experiments to validate theoretical findings. It induces development of distributed sensing requirements, framework, and architecture, development of distributed ground node hardware prototypes, integration of all nodes and testing of baseline functionalities, integration of in-house developed perception, migration and tracking software packages, establishing flight scenario and flyable path for a selected UAS, flying the air vehicle along the path, recording sensors measurements, pre-processing them and transferring the resulting data to an optimal computing center. It also addresses the challenges related to pre-flight hardware calibration, clock synchronization, sensor registration and establishing a communication network. Sensors data processing results demonstrate the functionality of the presented distributed architecture and satisfactory performance of the applied technologies.

Distributed sensing↗