Search NASA⌕ Search

SEARCH · Search NASA

Results for “test frameworks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
NASA NTRS2023

Python Based Plume Dynamics Estimation Tool (PyPDET) Rapid Plume Strike Analysis for RPOD Maneuvers in Deep Space Operations

I worked as a NASA Intern during the Summer 2023 term in the DS-00 division under the supervision of my mentor, Dr. Jonathan Pitt. Our goal was to build on our previous work from 2022 to develop a plume strike estimation tool using a prescribed physics methodology and model plume impingement effects while considering the dynamics of a rendezvous, operations, proximity, and docking (RPOD) maneuver. This tool supports previously configured CFD-DSMC calculations by allowing for rapid analysis of initial designs using a low-fidelity source flow model. Engineers can then use the high-fidelity CFD-DSMC tool to consolidate results as they work towards finalizing a design. This year’s project was focused on developing a software application that other engineers would be using in their analysis. Thus, the user’s experience was considered in the development of this application. Proper documentation, testability, and modularity of the codebase was our priority. For example, the project included auto documentation procedures to start building towards a User Manual, while also including dedicated demonstration cases for more explicit communication of functionality. Also, this project included a framework for testing the source code for future developments. Additionally, care was taken to develop the code using an Object-Oriented Programming approach. Thus, allowing for a modular extensibility of functionality in anticipation of future developments. The core work of this project was developing an algorithm that would transform the visiting vehicle and associated thruster data according to the kinematics described in the jet firing history. It would then calculate the estimated plume strikes on two of the target vehicles and write data accordingly into a VTK file. Summer work is to conclude by developing and presenting a PowerPoint slide deck at the intern exit briefing on August 11 th , 2023. Once the model for simple plume strike calculations is developed and tested there are several avenues to explore to continue development of this tool. These are also discussed in this report.

Plume Impingement↗
NASA NTRS2023

Land Surfaces at the Tipping-Point for Water and Energy Balance Coupling

The surface water and energy balances can be coupled or uncoupled depending on whether the evaporation regime is water-limited or energy-limited. As the landscape loses soil moisture during drydowns, a transition between the regimes may occur, which signifies a nonlinear change in water-energy-carbon coupling. Regions that switch often between these two regimes, that is, are dominated by neither regime, are particularly vulnerable to climate variability and change. To robustly identify these tipping points, we identify drydown events based on global soil moisture data sets from remote sensing. The event identification does not rely on precipitation information and is robust with respect to measurement noise. Then, the soil moisture thresholds delineating the evaporation regime transitions are determined by Sequential Monte Carlo Sampling and a two-stage parametrization strategy. Based on the estimated soil moisture thresholds across the globe, we estimate observation-based water availability indices which quantify the nonlinear controls of soil moisture on evaporation. This framework is tested and applied globally using Soil Moisture Active Passive soil moisture retrievals. Combined with a new tippling-point metric that describes the frequency of evaporation regime transitions, we identify regions that switch often between different evaporation regimes at the global scale. Given unit shifts in soil moisture, these regions will experience the most change in how their surface water and energy are coupled.

Jianzhi Dong↗
NASA NTRS2012

Accounting for Proof Test Data in a Reliability Based Design Optimization Framework

This paper investigates the use of proof (or acceptance) test data during the reliability based design optimization of structural components. It is assumed that every component will be proof tested and that the component will only enter into service if it passes the proof test. The goal is to reduce the component weight, while maintaining high reliability, by exploiting the proof test results during the design process. The proposed procedure results in the simultaneous design of the structural component and the proof test itself and provides the designer with direct control over the probability of failing the proof test. The procedure is illustrated using two analytical example problems and the results indicate that significant weight savings are possible when exploiting the proof test results during the design process.

Ventor, Gerharad↗
NASA NTRS2024

A Distributed Simulation Framework Applied to Artemis Analysis, Studies, Integration, and Test

The National Aeronautics and Space Administration (NASA) established the Artemis Program, a series of missions to return humans to the Moon and explore further than before. To execute the Artemis missions, NASA is collaborating with commercial and international partners to create the necessary infrastructure and logistics plan that will establish a long term presence on the Moon ahead of exploring Mars. NASA and its partners are developing a collection of space and surface systems to support crewed missions to the lunar surface that will provide the mobility, habitation, logistics, and exploration support necessary for Artemis mission successes which includes robust scientific investigations. This paper details the design, capabilities, and uses of the Artemis Distributed Simulation (ADS) being developed by the NASA Exploration Systems Simulations (NExSyS) Team to support Artemis architecture studies. ADS utilizes international interoperability standards to connect a collection of independent vehicle and service simulations; these include but are not limited to elements such as rovers, landers, and habitation elements along with services like communications, environment, visualization, and data logging. ADS’s distributed nature allows for the complex aggregation of constituent Artemis elements; this includes efficient scenario modification with the addition or removal of individual simulations representing Artemis elements or services. This capability provides support for the rapid performance of various Artemis mission trade studies exploring alternate configurations. Currently, ADS uses NASA developed simulations for development and testing; however, through the use of international simulation interoperability standards, ADS provides an integration framework to incorporate dissimilar authoritative vendor simulations as Artemis systems mature and vendor simulations become available. Vendor simulations will be able to join ADS and interact with other Artemis elements and vehicles while limiting the exposure of proprietary data. This paper describes the expansion of an existing distributed simulation infrastructure to accommodate a collaborative and dynamic framework for the Artemis Program. This work includes updated federation designs, integration into existing NASA facilities, advancements in visualizations, and advancements in human driven inputs. This paper will also outline recently completed and ongoing support and collaboration with NASA studies and testing, namely results from energetics and Human-In-The-Loop (HITL) studies. The paper concludes with a plan for future developments and facility integration to enable enhanced studies in preparation for a return of humans to the lunar surface.

Artemis↗
NASA NTRS1990

A test manager's perspective of a test concept for a heavy lift vehicle

The developmment of a test concept is a significant part of the advanced planning activities accomplished for the Initial Operational Test and Evaluation (IOT&E) of new systems. A test concept is generally viewed as a description, including rationale, of the test structure, evaluation methodology and management approach required to plan and conduct the IOT&E of a program such as a new heavy lift launch vehicle system. The test concept as presented in this paper is made up of an operations area, a test area, an evaluation area, and a management area. The description presented here is written from the perspective of one test manager, and represents his views of a possible framework of a test concept using examples for a potential IOT&E of a heavy lift launch vehicle.

Pargeon, John I., Jr.↗
NASA NTRS2008

Computational Analyses of Pressurization in Cryogenic Tanks

A) Advanced Gas/Liquid Framework with Real Fluids Property Routines: I. A multi-fluid formulation in the preconditioned CRUNCH CFD(Registered TradeMark) code developed where a mixture of liquid and gases can be specified: a) Various options for Equation of state specification available (from simplified ideal fluid mixtures, to real fluid EOS such as SRK or BWR models). b) Vaporization of liquids driven by pressure value relative to vapor pressure and combustion of vapors allowed. c) Extensive validation has been undertaken. II. Currently working on developing primary break-up models and surface tension effects for more rigorous phase-change modeling and interfacial dynamics B) Framework Applied to Run-time Tanks at Ground Test Facilities C) Framework Used For J-2 Upper Stage Tank Modeling: 1) NASA MSFC tank pressurization: a) Hydrogen and oxygen tank pre-press, repress and draining being modeled at NASA MSFC. 2) NASA AMES tank safety effort a) liquid hydrogen and oxygen are separated by a baffle in the J-2 tank. We are modeling pressure rise and possible combustion if a hole develops in the baffle and liquid hydrogen leaks into the oxygen tank. Tank pressure rise rates simulated and risk of combustion evaluated.

Ahuja, Vineet↗
NASA NTRS2014

LAVA Simulations for the AIAA Sonic Boom Prediction Workshop

Computational simulations using the Launch Ascent and Vehicle Aerodynamics (LAVA) framework are presented for the First AIAA Sonic Boom Prediction Workshop test cases. The framework is utilized with both structured overset and unstructured meshing approaches. The three workshop test cases include an axisymmetric body, a Delta Wing-Body model, and a complete low-boom supersonic transport concept. Solution sensitivity to mesh type and sizing, and several numerical convective flux discretization choices are presented and discussed. Favorable comparison between the computational simulations and experimental data of nearand mid-field pressure signatures were obtained.

Simulations↗
NASA NTRS2010

Mauna Kea, Hawaii as an Analogue Site for Future Planetary Resource Exploration: Results from the 2010 ILSO-ISRU Field-Testing Campaign

Within the framework of the International Lunar Surface Operation - In-Situ Resource Utilization Analogue Test held on January 27 - February 11, 2010 on the Mauna Kea volcano in Hawaii, a number of scientific instrument teams collaborated to characterize the field site and test instrument capabilities outside laboratory environments. In this paper, we provide a geological setting for this new field-test site, a description of the instruments that were tested during the 2010 ILSO-ISRU field campaign, and a short discussion for each instrument about the validity and use of the results obtained during the test. These results will form a catalogue that may serve as reference for future test campaigns. In this paper we provide a description and regional geological setting for a new field analogue test site for lunar resource exploration, and discuss results obtained from the 2010 ILSO-ISRU field campaign as a reference for future field-testing at this site. The following instruments were tested: a multispectral microscopic imager, MMI, a Mossbauer spectrometer, an evolved gas analyzer, VAPoR, and an oxygen and volatile extractor called RESOLVE. Preliminary results show that the sediments change from dry, organic-poor, poorly-sorted volcaniclastic sand on the surface, containing basalt, iron oxides and clays, to more water- and organic-rich, fine grained, well-sorted volcaniclastic sand, primarily consisting of iron oxides and depleted of basalt and clays. Furthermore, drilling experiments showed a very close correlation between drilling on the Moon and drilling at the test site. The ILSO-ISRU test site was an ideal location for testing strategies for in situ resource exploration at the lunar or martian surface.

ten Kate, I. L.↗
NASA NTRSDate not supplied

Testing a Run-Time Assurance Framework Coupled with Integrated Risk Mitigation Capabilities for Autonomous Urban UAS Flights

The In-Time Aviation Safety Management System (IASMS) Concept of Operations (ConOps) envisions new capabilities to monitor, assess, and mitigate flight safety risks. Systems will be tailored to mission type, vehicle/equipage type, operational environment, and safety risk tolerance. Within an IASMS framework, several capabilities may be implemented spanning three operational phases (pre-flight, in-flight, and post-flight/off-line); and consisting of lower level functions and information services which may reside onboard the aircraft, on third-party server(s), and/or on ground/operator station(s). Each capability will be designed to produce and disseminate safety-relevant information; perform detection, diagnosis, and prediction of unsafe situations; and/or execute mitigation actions when hazardous events warrant such changes. This paper focuses on recent testing of airborne capabilities that demonstrate inflight aspects of the overarching concept for autonomous unmanned aircraft systems (UAS) operations in urban environments. A flight test architecture is described that applies run-time assurance principles (e.g., executes independent of the unassured autopilot), real-time risk assessment, and a technique to execute contingencies if necessary either automatically or via pilot intervention. Several tests using small UAS were conducted to verify the assured in-flight risk mitigation capability. The paper draws significantly from a larger NASA technical report and recent prior conference papers, providing additional details. Data is analyzed for two representative flights to illustrate the performance for various sequential and simultaneous hazards used during testing. During each automated flight, several hazards are encountered at various points along the flight path. At each point, the hazard is mitigated by the system, with the vehicle then continuing to subsequent points. The paper concludes with lessons-learned regarding relevant aspects of the overarching IASMS concept and how it may be updated and further advanced in the future.

population activity↗
NASA NTRS2020

Adaptive Stress Testing: Finding Likely Failure Events with Reinforcement Learning

Finding the most likely path to a set of failure states is important to the analysis of safety-critical systems that operate over a sequence of time steps, such as aircraft collision avoidance systems and autonomous cars. In many applications such as autonomous driving, failures cannot be completely eliminated due to the complex stochastic environment in which the system operates.As a result, safety validation is not only concerned about whether a failure can occur, but also discovering which failures are most likely to occur. This article presents adaptive stress testing (AST), a framework for finding the most likely path to a failure event in simulation. We consider a general black box setting for partially observable and continuous-valued systems operating in an environment with stochastic disturbances. We formulate the problem as a Markov decision process and use reinforcement learning to optimize it. The approach is simulation-based and does not require internal knowledge of the system, making it suitable for black-box testing of large systems. We present different formulations depending on whether the state is fully observable or partially observable. In the latter case, we present a modified Monte Carlo tree search algorithm that only requires access to the pseudorandom number generator of the simulator to overcome partial observability. We also present an extension of the framework, called differential adaptive stress testing (DAST), that can find failures that occur in one system but not in another. This type of differential analysis is useful in applications such as regression testing, where we are concerned with finding areas of relative weakness compared to a baseline. We demonstrate the effectiveness of the approach on an aircraft collision avoidance application, where a prototype aircraft collision avoidance system is stress tested to find the most likely scenarios of near mid-air collision.

Verification and Validation↗
NASA NTRS1976

Development of a fluidic rudder

Wind tunnel tests were performed to examine the concept of aircraft controls without moving parts, and aircraft stabilization by means of scoop-fed slots. Results of wind tunnel tests, in the framework of a NASA program, to determine the force-control characteristics of a symmetrical airfoil with scoop-fed slots are discussed. Further tests showed that a fluidic amplifier could be built into the airfoil and operate with ram air. A fluidic rudder was then developed, consisting of cascaded fluidic amplifiers necessary to couple low-level fluidic sensors with slot flow control of the aerodynamic force on the vertical tail.

Belsterling, C. A.↗
NASA NTRS2012

Complex Decision-Making Applications for the NASA Space Launch System

The Space Shuttle program is ending and elements of the Constellation Program are either being cancelled or transitioned to new NASA exploration endeavors. NASA is working diligently to select an optimum configuration for the Space Launch System (SLS), a heavy lift vehicle that will provide the foundation for future beyond LEO large ]scale missions for the next several decades. Thus, multiple questions must be addressed: Which heavy lift vehicle will best allow the agency to achieve mission objectives in the most affordable and reliable manner? Which heavy lift vehicle will allow for a sufficiently flexible exploration campaign of the solar system? Which heavy lift vehicle configuration will allow for minimizing risk in design, test, build and operations? Which heavy lift vehicle configuration will be sustainable in changing political environments? Seeking to address these questions drove the development of an SLS decisionmaking framework. From Fall 2010 until Spring 2011, this framework was formulated, tested, fully documented, and applied to multiple SLS vehicle concepts at NASA from previous exploration architecture studies. This was a multistep process that involved performing FOM-based assessments, creating Pass/Fail gates based on draft threshold requirements, performing a margin-based assessment with supporting statistical analyses, and performing sensitivity analysis on each. This paper discusses the various methods of this process that allowed for competing concepts to be compared across a variety of launch vehicle metrics. The end result was the identification of SLS launch vehicle candidates that could successfully meet the threshold requirements in support of the SLS Mission Concept Review (MCR) milestone.

Lyles, Garry↗
NASA NTRSDate not supplied

An Evaluation of Extended Reality Technologies for Use in Verification Testing at NASA 2024 HRP IWS Abstract

BACKGROUND At NASA, verification testing is the formal process of ensuring that a product conforms to requirements set by a project or program. Some verification methods, such as Demonstrations and Test, require either the end product or a mockup of the product with sufficient fidelity to stand-in for the product during the test. Traditionally, these mockups have been physical (e.g., foam-core and wood) but there is growing interest in exploring new methods for testing with these mockups. These methods include virtual reality (VR), mixed reality, and augmented reality which are collectively referred to as eXtended Reality (XR) technologies. VR has already been adopted and used by many in the aerospace industry as a tool for use in early design phases (e.g., developmental testing) and may have the most potential for use in verification tests. Benefits of using VR mockups offer cost effectiveness, ease of iteration, simulation of hazardous conditions (e.g., an egress through a hatch with smoke obscuring vision), and the ability to simulate microgravity conditions, which are challenging to do with physical mockups. However, the validity of test results obtained from VR mockup demonstrations or testing, compared to the current gold standard of physical mockups, remains uncertain. It is unlikely that there is one clean answer as there are many different types of verification outcomes and each XR technology must be evaluated on its own merits. This is not an issue during developmental testing as the design is still in flux and the total success of the design is not dependent upon the results of a developmental test. Verification tests, however, only happen once, assuming no change to the design, and the results are used to certify the product. Therefore, establishing the validity of XR mockup-based verification outcomes is essential before considering them for any use in verification tests. OBJECTIVE AND METHOD To address this concern, the Human Research Program has funded a project to explore and qualify how XR technologies might be used in verification demonstration and testing at NASA. Currently, we are conducting a review of the literature on the utilization of XR mockups for design activities, prototyping, and user testing. We are employing the Strengths, Weaknesses, Opportunities, and Threats (SWOT) analysis method to identify the pros, cons, and barriers to adoption of XR technologies for verification testing at NASA. Additionally, we are developing a framework to guide the deployment of XR mockups for verification tests. Building upon available evidence from the literature and subject-matter expert feedback, our goal for the framework is to provide guidelines for which forms of XR mockups are suitable for a given verification test, when only physical mockups should be employed and to highlight areas for which more evidence is needed. To further refine our framework and to contribute to the body of evidence, we are planning a lab-based experiment comparing a VR mockup to a physical twin for a set of select verification outcomes. ANTICIPATED RESULTS In this presentation, we will present the work we conducted to evaluate XR technologies for use in verification tests at NASA. We will summarize and report our findings from the SWOT analysis and our lab-based study, and we will present the current state of the XR Technologies for Verification Testing framework. We will conclude by summarizing remaining work and future directions for the project. Technologies for Verification Testing framework. We will conclude by summarizing remaining work and future directions for the project.

Extended Reality↗
NASA NTRS2012

Complex Decision-Making Applications for the NASA Space Launch System

The Space Shuttle program is ending and elements of the Constellation Program are either being cancelled or transitioned to new NASA exploration endeavors. The National Aeronautics and Space Administration (NASA) has worked diligently to select an optimum configuration for the Space Launch System (SLS), a heavy lift vehicle that will provide the foundation for future beyond low earth orbit (LEO) large-scale missions for the next several decades. Thus, multiple questions must be addressed: Which heavy lift vehicle will best allow the agency to achieve mission objectives in the most affordable and reliable manner? Which heavy lift vehicle will allow for a sufficiently flexible exploration campaign of the solar system? Which heavy lift vehicle configuration will allow for minimizing risk in design, test, build and operations? Which heavy lift vehicle configuration will be sustainable in changing political environments? Seeking to address these questions drove the development of an SLS decision-making framework. From Fall 2010 until Spring 2011, this framework was formulated, tested, fully documented, and applied to multiple SLS vehicle concepts at NASA from previous exploration architecture studies. This was a multistep process that involved performing figure of merit (FOM)-based assessments, creating Pass/Fail gates based on draft threshold requirements, performing a margin-based assessment with supporting statistical analyses, and performing sensitivity analysis on each. This paper discusses the various methods of this process that allowed for competing concepts to be compared across a variety of launch vehicle metrics. The end result was the identification of SLS launch vehicle candidates that could successfully meet the threshold requirements in support of the SLS Mission Concept Review (MCR) milestone.

Lyles, Garry↗
NASA NTRS2016

Validation of High-Fidelity CFD/CAA Framework for Launch Vehicle Acoustic Environment Simulation against Scale Model Test Data

A hybrid Computational Fluid Dynamics and Computational Aero-Acoustics (CFD/CAA) modeling framework has been developed for launch vehicle liftoff acoustic environment predictions. The framework couples the existing highly-scalable NASA production CFD code, Loci/CHEM, with a high-order accurate discontinuous Galerkin solver developed in the same production framework, Loci/THRUST, to accurately resolve and propagate acoustic physics across the entire launch environment. Time-accurate, Hybrid RANS/LES CFD modeling is applied for predicting the acoustic generation physics at the plume source, and a high-order accurate unstructured discontinuous Galerkin (DG) method is employed to propagate acoustic waves away from the source across large distances using high-order accurate schemes. The DG solver is capable of solving 2nd, 3rd, and 4th order Euler solutions for non-linear, conservative acoustic field propagation. Initial application testing and validation has been carried out against high resolution acoustic data from the Ares Scale Model Acoustic Test (ASMAT) series to evaluate the capabilities and production readiness of the CFD/CAA system to resolve the observed spectrum of acoustic frequency content. This paper presents results from this validation and outlines efforts to mature and improve the computational simulation framework.

Liever, Peter A.↗
NASA NTRS2016

Validation of High-Fidelity CFD/CAA Framework for Launch Vehicle Acoustic Environment Simulation against Scale Model Test Data

A hybrid Computational Fluid Dynamics and Computational Aero-Acoustics (CFD/CAA) modeling framework has been developed for launch vehicle liftoff acoustic environment predictions. The framework couples the existing highly-scalable NASA production CFD code, Loci/CHEM, with a high-order accurate Discontinuous Galerkin solver developed in the same production framework, Loci/THRUST, to accurately resolve and propagate acoustic physics across the entire launch environment. Time-accurate, Hybrid RANS/LES CFD modeling is applied for predicting the acoustic generation physics at the plume source, and a high-order accurate unstructured mesh Discontinuous Galerkin (DG) method is employed to propagate acoustic waves away from the source across large distances using high-order accurate schemes. The DG solver is capable of solving 2nd, 3rd, and 4th order Euler solutions for non-linear, conservative acoustic field propagation. Initial application testing and validation has been carried out against high resolution acoustic data from the Ares Scale Model Acoustic Test (ASMAT) series to evaluate the capabilities and production readiness of the CFD/CAA system to resolve the observed spectrum of acoustic frequency content. This paper presents results from this validation and outlines efforts to mature and improve the computational simulation framework.

Liever, Peter A.↗