Search NASA⌕ Search

SEARCH · Search NASA

Results for “Test Framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,063 records · Page 59

Weak Form Scientific Machine Learning: Test Function Construction for System Identification

Weak form Scientific Machine Learning (WSciML) is a recently developed framework for data-driven modeling and scientific discovery. It leverages the weak form of equation error residuals to provide enhanced noise robustness in system identification via convolving model equations with test functions, reformulating the problem to avoid direct differentiation of data. The performance, however, relies on wisely choosing a set of compactly supported test functions. In this work, we mathematically motivate a novel data-driven method for constructing Single-scale-Local reference functions for creating the set of test functions. Our approach numerically approximates the integration error introduced by the quadrature and identifies the support size for which the error is minimal, without requiring access to the model parameter values. Through numerical experiments across various models, noise levels, and temporal resolutions, we demonstrate that the selected supports consistently align with regions of minimal parameter estimation error. We also compare the proposed method against the strategy for constructing Multi-scale-Global (and orthogonal) test functions introduced in our prior work, demonstrating the improved computational efficiency.

FOS: Computer and information sciences↗

A ROS-based Simulator for Testing the Enhanced Autonomous Navigation of the Mars 2020 Rover

In order to achieve the ambitious objectives of the Mars 2020 (M2020) mission, in particular the ability to autonomously traverse more challenging terrains more efficiently, new surface mobility software was developed for Enhanced Navigation (ENav). That decision was made early in the project, before most of the new surface flight software (FSW) existed, which created a need for a separate framework where the new navigation algorithms could be quickly prototyped and tested, before more realistic FSW-based testbeds became available. The JPL robotics team chose the Robot Operating System [1] (ROS) as the environment in which to test the new ENav algorithms. This made it possible to write the algorithms in the C language required by the FSW, so they could be directly ported over to the flight module later on, while leveraging all the C++ libraries and tools provided by ROS for simulation and testing. The ENav algorithms were developed as a separate C library, and stubs were used to replace any FSW-specific code, such as Event Reporting (EVRs) and data products (DPs). A ROS simulator was developed to generate a rich set of varied 3D terrains representative of the candidate Mars landing sites and simulate the physics of the rover motion, the point cloud perceived by the rover’s stereo vision system, and the new thinking-while-driving (TWD) navigation logic which directs the rover to drive autonomously to user-specified waypoints. To simulate the rover motion and perception, a ROS node was developed that uses a software library called HyperDrive Sim (HDSim), which is a wrapper for the Rover Sequencing and Visualization Program [2] (RSVP). That library provides roverterrain settling, realistic slip modelling, and camera rendering capability based on the rover’s NavCam machine vision models. To simulate the navigation logic, a ROS node was created that initializes and runs the ENav algorithms in a way that mimics the FSW execution, while also providing the capability to load and replay data products, including re-running the recorded inputs through the ENav algorithms for testing. An engineering Graphical User Interface (GUI) was also developed to visualize various elements, such as the rover pose during the drive, the simulated and perceived terrain, the selected local and global paths to the goal, the evaluated candidate paths and the reasons why they were rejected, the keep-in and keep-out zones (KIOZs), etc. Finally, an advanced Monte Carlo (MC) framework that can run many simulations in parallel on the Cloud and automatically generate reports that capture the key ENav performance metrics was developed to evaluate the system in a statisticallymeaningful way. This paper provides an overview of the ROSbased simulator used for testing the M2020 ENav algorithms.

Toupet, Olivier↗

NuQKD: A Modular Quantum Key Distribution Simulation Framework for Engineering Applications

Abstract An experimental Quantum Key Distribution (QKD) implementation requires advanced costly hardware, unavailable in most research environments, making protocol testing and performance evaluation complicated. This has been a major motivation for the development of QKD simulation frameworks, to allow researchers to obtain insight before proceeding into practical implementations. Several simulators have been introduced over the recent years. However, only four are publicly available, only one of which models equipment imperfections. Currently, no open‐source simulator includes all following capabilities: channel attenuation modelling, equipment imperfections and effects on key rates, estimation of elapsed time during classical and quantum‐ channel processes, use of truly random binary sequences for qubits and measurement bases, shared ‐bit fraction customization. In this paper, we present NuQKD, an open‐ source modular, intuitive simulator, featuring all the above capabilities. NuQKD establishes communication between two computer terminals, accepts custom user inputs (iterations, raw key size, attacker interception rate etc.) and evaluates the sifted key, Quantum Bit Error Rate (QBER), elapsed communication time, and more. NuQKD capabilities include optical fiber and free ‐space simulation, modeling of equipment/channel imperfections, bitstrings from True Random Number Generators, decoy‐state protocol support, and automated evaluation of performance metrics. We expect NuQKD to enable convenient and accurate representation of actual experimental conditions.

Gkouliaras, Konstantinos↗

Multi-Agency Annual Southeastern Beach Mouse Habitat Occupancy Monitoring

The southeastern beach mouse (Peromyscus polionotus niveiventris, hereafter SEBM), a federally threatened species was identified by Merritt Island National Wildlife Refuge (MINWR) as one of the top five priorities for management. The Kennedy Space Center (KSC) Environmental Management Branch was asked to provide support in the form of population monitoring for SEBM on KSC and the surrounding properties. When we began the project, the SEBM was known to occupy sites ranging from Volusia through Brevard and Indian River Counties, but the exact distribution within the Federal lands encompassing the Cape Canaveral Barrier Island Complex (CCBIC) was not well known. The broad range of habitat conditions encompassing the species’ historical range and the diversity of sites historically known to contain SEBM required a landscape-scale approach for both monitoring the population and for investigating species habitat relationships. We designed a monitoring plan for the SEBM with the goal of estimating the habitat occupancy of beach mice annually each winter/spring throughout the entire area of suitable coastal habitat (approximately 72 km linear distance along the beach). Methods were tested in a 2008 pilot study, and during 2010-2018 we monitored the proportion of coastal habitat occupied by the SEBM on the CCBIC. Monitoring was focused on using dynamic habitat occupancy surveys with data collected with rapid assessment techniques (i.e., track tubes or live-traps) to detect SEBM occurrence at sampling stations. An important component of the study design was the use of repeated samples that provided the information needed to estimate detectability. Measuring detectability was required to account for the fact that surveys could fail to detect animals at sites at which they were actually present (Mackenzie et al., 2002). This monitoring framework is very flexible, allowing numerous hypothesis to be tested about how various factors influence beach mouse occupancy using habitat, geographic, and environmental covariates. Our survey has been the longest survey conducted for any of the seven extant beach mouse subspecies and has encompassed nearly the entire remaining range of the SEBM. Although occupancy surveys of other beach mouse subspecies via track tubes have been conducted on the Gulf coast of Florida by Florida Fish and Wildlife Conservation Commission (FWC), United States Fish and Wildlife Service (USFWS), and various universities, we expanded previous methods to fit unique aspects of the SEBM, and thus our study was very different from any of the previous studies. To achieve this specificity, we employed an adaptive approach throughout the study, with all activities aimed at providing managers with information related to environmental compliance and natural resource management on KSC and the surrounding Federal lands.

Eric Douglas Stolen↗

Fan Noise Predictions of the NASA Source Diagnostic Test Using Unsteady Simulations with LAVA Part I: Near-Field Aerodynamics and Turbulence

A sliding mesh technique within the Launch, Ascent, and Vehicle Aerodynamics (LAVA) computational framework is validated using the experimental dataset collected as part of the NASA Source Diagnostic Test (SDT) campaign. Two modeling approaches are explored: the unsteady Reynolds-Averaged Navier Stokes (URANS) with Spalart-Allmaras (SA) turbulence model closure, and a hybrid Reynolds-Averaged Navier Stokes/Large Eddy Simulation (RANS/LES) paradigm employing a Zonal Detached Eddy Simulation (ZDES) closure with enhanced shielding protection. Fan stage performance metrics, aerodynamic quantities and turbulent flow structures are analyzed in this work. Initial studies focusing on grid and time-step sensitivity are presented. Sensitivity to different variants of the SA turbulence model is analyzed, supporting the use of the baseline SA model in the production runs. Two conditions are analyzed in detail using URANS and hybrid RANS/LES (HRLES). Mean flow quantities are well-captured by both methods in the low-speed (approach) regime. While URANS misses all the upstream-propagating noise in the inlet due to the rotor-locked tones being evanescent in nature at subsonic fan tip speeds, HRLES captures this broadband component in its pressure field. At the high-speed (sideline) condition, URANS shows better agreement with the SDT data than HRLES in the interstage flow-field. In this regime, URANS captures the tonal content propagating through the inlet, since the tones are now cut-on. Both methods are suitable to capture fan stage performance metrics and mean flow quantities, but only HRLES is able to resolve the fine turbulent structures responsible for broadband noise. The results support the use of the sliding mesh technique implemented in this work for future turbomachinery applications within the LAVA solver framework.

AATT↗

Fan Noise Predictions of the NASA Source Diagnostic Test Using Unsteady Simulations with LAVA Part I: Near-Field Aerodynamics and Turbulence

A sliding mesh technique within the Launch, Ascent, and Vehicle Aerodynamics (LAVA) computational framework is validated using the experimental dataset collected as part of the NASA Source Diagnostic Test (SDT) campaign. Two modeling approaches are explored: the unsteady Reynolds-Averaged Navier Stokes (URANS) with Spalart-Allmaras (SA) turbulence model closure, and a hybrid Reynolds-Averaged Navier Stokes/Large Eddy Simulation (RANS/LES) paradigm employing a Zonal Detached Eddy Simulation (ZDES) closure with enhanced shielding protection. Fan stage performance metrics, aerodynamic quantities and turbulent flow structures are analyzed in this work. Initial studies focusing on grid and time-step sensitivity are presented. Sensitivity to different variants of the SA turbulence model is analyzed, supporting the use of the baseline SA model in the production runs. Two conditions are analyzed in detail using URANS and hybrid RANS/LES (HRLES). Mean flow quantities are well-captured by both methods in the low-speed (approach) regime. While URANS misses all the upstream-propagating noise in the inlet due to the rotor-locked tones being evanescent in nature at subsonic fan tip speeds, HRLES captures this broadband component in its pressure field. At the high-speed (sideline) condition, URANS shows better agreement with the SDT data than HRLES in the interstage flow-field. In this regime, URANS captures the tonal content propagating through the inlet, since the tones are now cut-on. Both methods are suitable to capture fan stage performance metrics and mean flow quantities, but only HRLES is able to resolve the fine turbulent structures responsible for broadband noise. The results support the use of the sliding mesh technique implemented in this work for future turbomachinery applications within the LAVA solver framework.

AATT↗

Application of Machine Learning to Rotorcraft Health Monitoring

Machine learning is a powerful tool for data exploration and model building with large data sets. This project aimed to use machine learning techniques to explore the inherent structure of data from rotorcraft gear tests, relationships between features and damage states, and to build a system for predicting gear health for future rotorcraft transmission applications. Classical machine learning techniques are difficult, if not irresponsible to apply to time series data because many make the assumption of independence between samples. To overcome this, Hidden Markov Models were used to create a binary classifier for identifying scuffing transitions and Recurrent Neural Networks were used to leverage long distance relationships in predicting discrete damage states. When combined in a workflow, where the binary classifier acted as a filter for the fatigue monitor, the system was able to demonstrate accuracy in damage state prediction and scuffing identification. The time dependent nature of the data restricted data exploration to collecting and analyzing data from the model selection process. The limited amount of available data was unable to give useful information, and the division of training and testing sets tended to heavily influence the scores of the models across combinations of features and hyper-parameters. This work built a framework for tracking scuffing and fatigue on streaming data and demonstrates that machine learning has much to offer rotorcraft health monitoring by using Bayesian learning and deep learning methods to capture the time dependent nature of the data. Suggested future work is to implement the framework developed in this project using a larger variety of data sets to test the generalization capabilities of the models and allow for data exploration.

machine learning↗

F Prime: An Open-Source Framework for Small-Scale Flight Software Systems

Developing flight software for small-scale missions such as CubeSats and SmallSats is challenging. These missions typically have ambitious goals, modest budgets, and tight schedules. To meet these challenges, a good flight software framework is essential. Frameworks can provide an architecture, infrastructure, tools, and reusable software components, all of which can help developers deliver their code on time and on budget. In this paper we present F Prime, a free, open-source flight software framework developed at JPL and tailored to small-scale systems such as CubeSats, SmallSats, and instruments. F Prime comprises several elements: (1) an architecture that decomposes flight software into discrete components with well-defined interfaces; (2) a C++ framework that provides core capabilities such as message queues and threads; (3) tools for specifying components and connections and automatically generating code; (4) a growing collection of ready-to-use components; and (5) tools for testing flight software at the unit and integration levels.We describe the F Prime framework and tools and present our experience using them. We describe several enhancements to the framework currently underway in the areas of software design, software verification, and ground data systems for testing.

Levison, Jeffrey W.↗

Upwind methods for the Baer–Nunziato equations and higher-order reconstruction using artificial viscosity

This article is devoted to the numerical discretisation of the hyperbolic two-phase flow model of Baer and Nunziato. A special attention is paid on the discretisation of intercell flux functions in the framework of Finite Volume and Discontinuous Galerkin approaches, where care has to be taken to efficiently approximate the non-conservative products inherent to the model equations. Various upwind approximate Riemann solvers have been tested on a bench of discontinuous test cases. New discretisation schemes are proposed in a Discontinuous Galerkin framework following the criterion of Abgrall and the path-conservative formalism. A stabilisation technique based on artificial viscosity is applied to the high-order Discontinuous Galerkin method and compared against classical TVD-MUSCL Finite Volume flux reconstruction.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

TRUST Contact Thermal Conductance (TRUST-CTC) Report: FY2022

The objective of the Delivery Environments (DE) Testbeds to Reduce Uncertainties in Simulations and Tests (TRUST) work package is to quantify and help increase confidence in specific areas of computational and experimental capabilities that are applicable to current and future delivery environments. More complete quantification of confidence in experimental and computational capabilities and the sufficient increase of confidence in those capabilities is critical to improving weapons engineering design, qualification, and assessment efforts that are critical to the current and future stockpile. Staff development will include cross-discipline training to provide engineers with experience in both numerical simulations and experimental methods. This work will use and provide feedback on analysis tools and experimental results databases for efficient and responsive engineering which are currently under development: engineering common model framework (ECMF), engineering quantification of margins and uncertainties (EQMU), test information management system (TIMS), and [WAVES] Analysis for Verified Engineering Simulation (WAVES).

42 ENGINEERING↗

TRUST Contact Thermal Conductance (TRUST-CTC) Report: FY23

The objective of the Delivery Environments (DE) Testbeds to Reduce Uncertainties in Simulations and Tests (TRUST) work package is to quantify and help increase confidence in specific areas of computational and experimental capabilities that are applicable to current and future delivery environments. More complete quantification of confidence in experimental and computational capabilities and the sufficient increase of confidence in those capabilities is critical to improving weapons engineering design, qualification, and assessment efforts that are critical to the current and future stockpile. Staff development will include cross-discipline training to provide engineers with experience in both numerical simulations and experimental methods. This work will use and provide feedback on analysis tools and experimental results databases for efficient and responsive engineering which are currently under development: engineering common model framework (ECMF), engineering quantification of margins and uncertainties (EQMU), test information management system (TIMS), and [WAVES] Analysis for Verified Engineering Simulation (WAVES).

42 ENGINEERING↗

A Novel Framework for Optimizing Ramping Capability of Hybrid Energy Storage Systems

Hybrid Energy Storage System has been widely applied in aerospace, electric vehicle, and microgrid applications. The advantages are that they include complimentary technologies with both high power and energy capabilities. HESS have the potential to be useful to the bulk power systems, for example to increase the value of energy produced by variable generation resource through enabling participation in ancillary service markets. Actualizing the benefits of HESSs requires optimizing the combined ramping capability of aggregated HESS resources. To provide quality ancillary service, source of HESSs locating at multiple sites of variable generation resource must be optimally sized and cohesively controlled. Optimizing aggregated resources can be formulated as an optimization problem. Successfully solving this problem not only requires using effective solution methods but also depends on accurately and rapidly setting the necessary parameters in the problem formula. This article proposes a novel framework with double-layer structure to solve the optimization problem of aggregating ramping capability. Program developed on the upper layer focuses on solving the optimization of aggregating ramping capability among multiple HESSs and is compatible with most existing optimization algorithms. Program on lower layer of the framework targets at optimizing the local control of a single HESS based on a thorough analytics of HESS operation strategy presented in this article. Result of local optimization is also provided to upper layer program for updating the parameters in formula of optimization problem. Real time hardware-in-the-loop test is conducted to verify the performance of the optimization framework developed. The work presented is expected to provide guidance for implementing this framework in practical operation.

Luo, Yushen↗

Safer and optimized vulnerability scanning for operational technology through integrated and automated passive monitoring and active scanning

Vulnerability scanning of embedded sensors and controllers have a history of causing disruption and malfunction within operation technology environments. Traditional information technology vulnerability scanning generally consists of blunt exercising all or a large population of test conditions to understand how equipment responds. Often the large number and varied conditions of the tests are too much for embedded systems to handle. This paper presents a methodology and framework for integrating passive monitoring and active scanning techniques to optimize the type and amount of necessary active communication tests while achieving acceptable levels of device and vulnerability discovery. Bayesian probability and networks are leveraged for inference to drive the automation of the scanning actions to achieve confidence in discovery. Through inference, selecting the optimal active scans with the least risk and highest confidence impact is possible, thereby eliminating unnecessary scans with uncertain effects. Results of experimenting with real power systems and the following probabilities are provided.

Key Management, ICS, SCADA, Authentication↗

GSI 191 Closure Issue for EDF PWR Fleet: The Fuel Assembly Test Results

EDF has re started recirculation studies within the international GSI 191 framework by 2002, when EDF decided to join the NEI sump strainers task force. All the EDF PWR fleet have been upgraded, with major strainer modifications, according to the NEI 04-07 guideline. The so-called chemical effects have been carefully studied by EDF and demonstration have been released that there are no chemical effects on EDF fleet, owing to the nature of our debris. The study of strainer downstream effects started by 2009, with decoupling Downstream Sump Debris Source Term (DST) and by the end of 2016, all the equipment have been successfully qualified. At a previous ANS meeting,it was said that core fuel tests were scheduled. They have started at the beginning of 2014 and they have been closed by mid 2016 for AREVA Fuel type at ERLANGEN facility (Germany). The present presentation is aimed at describing the test facility, the test specifications and the main results. (authors)

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Bayesian inference of fiber orientation and polymer properties in short fiber-reinforced polymer composites

Herein we present a Bayesian methodology to infer the elastic modulus of the constituent polymer and the fiber orientation state in a short-fiber reinforced polymer composite (SFRP). The properties are inversely determined using only a few experimental tests. Developing composite manufacturing digital twins for SFRP composite processes, including injection molding and extrusion deposition additive manufacturing (EDAM) requires extensive experimental material characterization. In particular, characterizing the composite mechanical properties is time consuming and therefore, micromechanics models are used to fully identify the elasticity tensor. Hence, the objective of this paper is to infer the fiber orientation and the effective polymer modulus and therefore, identify the elasticity tensor of the composite with minimal experimental tests. To that end, we develop a hierarchical Bayesian model coupled with a micromechanics model to infer the fiber orientation and the polymer elastic modulus simultaneously which we then use to estimate the composite elasticity tensor. We motivate and demonstrate the methodology for the EDAM process but the development is such that it is applicable to other SFRP composites processed via other methods. Our results demonstrate that the approach provides a reliable framework for the inference, with as few as three tensile tests, while accounting for epistemic and aleatory uncertainty. Posterior predictive checks show that the model is able to recreate the experimental data well. The ability of the Bayesian approach to calibrate the material properties and its associated uncertainties, make it a promising tool for enabling a probabilistic predictive framework for composites manufacturing digital twins.

36 MATERIALS SCIENCE↗

The International Framework for Maintaining Equivalence and Traceability in Radionuclide Metrology

Confidence that a testing or calibration laboratory consistently obtains reliable results is of major importance to users of laboratory services and participation in proficiency testing schemes provides laboratories with an objective means of assessing and demonstrating the level of confidence that can be ascribed to the reliability of the data they are producing. That level of confidence, in turn, depends on the quality of the proficiency tests and, in particular, on the accuracy of the property values associated with the test samples. In the ideal situation, the relevant property value, such as the activity of a particular radionuclide in a test matrix, will be directly traceable to the SI via comparisons with a national or international metrology institute (NMI). This, in turn, begs the question of, how reliable are the results from that NMI.Demonstration of that reliability at the highest metrological levels is achieved through inter-laboratory comparisons that are conducted between national and international metrological institutes. These are coordinated primarily by the Bureau International des Poids et Mesures (BIPM) via Key Comparisons or by comparisons within Regional Metrological Organisations (RMOs), with the results from those RMO exercises being linked to the BIPM Key Comparison results. Such programmes have been in place for many years but they have grown in importance and frequency over the past decade. Tabulation of these comparison data has been regularized recently and made available to the user communities via the BIPM Key Comparison Database (KCDB).In the field of ionizing radiation, the radionuclide metrology discipline exhibits a number of special features. For example, these include the number of potential radionuclides in a user sample; the variety of physical and chemical formats that may be presented; the statistical and temporal effects of radioactive decay; the variations in primary standardization techniques; and the restricted applicability of those primary standardization techniques to the full range of potential radionuclides and activities. Each of these, singly or in combination, ensure that there can never be a fully comprehensive set of Key Comparisons which will cover the requirements of the user community and, in turn, compromise the ability to provide a full range of proficiency tests for testing and calibration laboratories.These problems are discussed, in the context of radioactivity measurements, together with the structure and range of Key Comparisons and associated databases at the highest international level that are currently in place to underpin the proficiency tests that are necessary for the user communities in this field of application.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Assignment of Freight Traffic in a Large-scale Intermodal Network under Uncertainty

This paper presents a methodology for freight traffic assignment in a large-scale road-rail intermodal network under uncertainty. Network uncertainties caused by natural disasters have dramatically increased in recent years. Several of these disasters (e.g., Hurricane Sandy, Mississippi River Flooding, and Hurricane Harvey) severely disrupted the U.S. freight transportation network, and consequently, the supply chain. To account for these network uncertainties, a stochastic freight traffic assignment model is formulated. An algorithmic framework, involving the sample average approximation and gradient projection algorithm, is proposed to solve this challenging problem. The developed methodology is tested on the U.S. intermodal network with freight flow data from the Freight Analysis Framework. The experiments consider three types of natural disasters that have different risks and impacts on transportation networks: earthquakes, hurricanes, and floods. It is found that for all disaster scenarios, freight ton-miles are higher compared to the base case without uncertainty. The increase in freight ton-miles is the highest under the flooding scenario; this is because there are more states in the flood-risk areas, and they are scattered throughout the U.S.

42 ENGINEERING↗