Search NASA⌕ Search

SEARCH · Search NASA

Results for “simulation evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13
All sourcesNASA NTRSDOE OSTI
NASA NTRS1995

Moving base simulation of an integrated flight and propulsion control system for an ejector-augmentor STOVL aircraft in hover

A piloted motion simulator evaluation, using the NASA Ames Vertical Motion Simulator, was conducted in support of a NASA Lewis Contractual study of the integration of flight and propulsion systems of a STOVL aircraft. Objectives of the study were to validate the Design Methods for Integrated Control Systems (DMICS) concept, to evaluate the handling qualities, and to assess control power usage. The E-7D ejector-augmentor STOVL fighter design served as the basis for the simulation. Handling-qualities ratings were obtained during precision hover and shipboard landing tasks. Handling-qualities ratings for these tasks ranged from satisfactory to adequate. Further improvement of the design process to fully validate the DMICS concept appears to be warranted.

Mcneill, Walter, E.↗
NASA NTRS2015

Appendix A: NAS-Wide Encounter Rate Evaluation Using Historical Radar Data and the Airspace Concept Evaluation System (ACES)

Regulations that establish operational and performance requirements for unmanned aircraft systems (UAS) are being developed by a consortium of government, industry and academic institutions. Those requirements will apply to detect-and-avoid (DAA) systems and other equipment necessary to integrate UAS with the National Airspace System (NAS) and are determined according to their contribution to the overall level of safety required to operate in the airspace. Several key gaps must be addressed in order to link equipment requirements to an airspace level of safety. Foremost among these is the calculation of the relative effectiveness of a particular system to mitigate violations of a separation standard with other aircraft, which is known as the systems risk ratio. The risk ratio is calculated as the probability of mid-air collision with a DAA system divided by the probability of mid-air collision without a DAA system. The risk ratio of a DAA system, in combination with the risk ratios of other collision avoidance mitigations, will determine the overall safety of the airspace measured in terms of the number of mid-air collisions per flight hour. Defining the required risk ratio that the DAA system needs to ensure the safety of the airspace requires an evaluation of the current airspace and a simulated evaluation that incorporates UAS aerodynamic performance and the mission characteristics of future UAS operations that are projected to be conducted in areas that interact with current operations. These evaluations will produce the frequency of encounters that currently exist in the airspace and those that could be generated with the introduction of UAS. Together, the frequency of encounters, an evaluation of unmitigated risk of collision, and a desired level of safety of the airspace will yield a required risk ratio of the DAA system. This study will focus on evaluating the encounter rates between aircraft based on historical radar data and encounter rates that could occur based on simulated UAS missions.

Unmanned Aircraft Systems↗
DOE OSTI2019

Predicting ocean waves along the US east coast during energetic winter storms: sensitivity to whitecapping parameterizations

The performance of two methods for quantifying whitecapping dissipation incorporated in the Simulating Waves Nearshore (SWAN) wave model is evaluated for waves generated along and off the US east coast under energetic winter storms with a predominantly westerly wind. Parameterizing the whitecapping effect can be done using the Komen-type schemes, which are based on mean spectral parameters, or the saturation-based (SB) approach of van der Westhuysen (2007), which is based on local wave parameters and the saturation level concept of the wave spectrum (we use “Komen” and “Westhuysen” to denote these two approaches). Observations of wave parameters and frequency spectra at four National Data Buoy Center (NDBC) buoys are used to evaluate simulation results. Model–data comparisons show that when using the default parameters in SWAN, both Komen and Westhuysen methods underestimate wave height. Simulations of mean wave period using the Komen method agree with observations, but those using the Westhuysen method are substantially lower. Examination of source terms shows that the Westhuysen method underestimates the total energy transferred into the wave action equations, especially in the lower frequency bands that contain higher spectral energy. Several causes for this underestimation are identified. The primary reason is the difference between the wave growth conditions along the east coast during winter storms and the conditions used for the original whitecapping formula calibration. In addition, some deficiencies in simulation results are caused along the coast by the “slanting fetch” effect that adds low-frequency components to the 2-D wave spectra. These components cannot be simulated partly or entirely by available source terms (wind input, whitecapping, and quadruplet) in models and their interaction. Further, the effect of boundary layer instability that is not considered in the Komen and Westhuysen whitecapping wind input formulas may cause additional underestimation.

Allahdadi, Mohammad Nabi↗
NASA NTRS1983

Evaluation of control and display configurations for helicopter shipboard operations

A simulation evaluation of several approach and landing flight-control configurations and of two out-of-the-cockpit display devices (a head-up display and a helmet-mounted display) was performed for the task of landing a helicopter on a destroyer in adverse weather. The results indicated that the ship airwake turbulence was the most significant environmental variable affecting hover performance. In addition, to achieve adequate landing performance, attitude-command control compensation was required for the pilot regardless of the display used. For improved performance with reduced pilot effort, a velocity-command, position-hold control system was desired.

Paulk, C. H., Jr.↗
DOE OSTI2016

Can nudging be used to quantify model sensitivities in precipitation and cloud forcing?

Efficient simulation strategies are crucial for the development and evaluation of high resolution climate models. This paper evaluates simulations with constrained meteorology for the quantification of parametric sensitivities in the Community Atmosphere Model version 5 (CAM5). Two parameters are perturbed as illustrating examples: the convection relaxation time scale (TAU), and the threshold relative humidity for the formation of low-level stratiform clouds (rhminl). Results suggest that the fidelity and computational efficiency of the constrained simulations depend strongly on 3 factors: the detailed implementation of nudging, the mechanism through which the perturbed parameter affects precipitation and cloud, and the magnitude of the parameter perturbation. In the case of a strong perturbation in convection, temperature and/or wind nudging with a 6-hour relaxation time scale leads to non-negligible side effects due to the distorted interactions between resolved dynamics and parameterized convection, while a 1-year free running simulation can satisfactorily capture the annual mean precipitation sensitivity in terms of both global average and geographical distribution. In the case of a relatively weak perturbation the large-scale condensation scheme, results from 1-year free-running simulations are strongly affected by noise associated with internal variability, while nudging winds effectively reduces the noise, and reasonably reproduces the response of precipitation and cloud forcing to parameter perturbation. These results indicate that caution is needed when using nudged simulations to assess precipitation and cloud forcing sensitivities to parameter changes in general circulation models. We also demonstrate that ensembles of short simulations are useful for understanding the evolution of model sensitivities.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1980

Preliminary evaluation of time and distance spacing cues using a cockpit displayed target

A simulator evaluation was conducted to compare time and distance selfspacing cues wherein a pilot establishes and maintains separation from a cockpit displayed target. Langley's terminal configured vehicle simulator which represents an advanced aircraft employing cathode ray tubes for primary flight displays and highly augmented flight control modes was used. Three tasks, two in trail rendezvous tasks (target straight and level and target turning) and one merge task were utilized. Three pilots flew each task twice, once with a time predictor cue and once with a distance predictor. Both time and distance spacing methods are operationally acceptable to the pilots. A slight preference was indicated by the pilots for the distance based predictor in performing rendezvous and merging tasks. Analysis of the recorded data showed the spacing performance with both predictors was essentially the same.

Kelly, J. R.↗
NASA NTRSDate not supplied

Comparisons of CFD Simulations of Icing Wind Tunnel Clouds with Experiments Conducted at the NASA Propulsions Systems Laboratory

This paper evaluates simulation predictions against experimental test data of icing clouds that were produced during 2018 ice crystal icing physics tests conducted at the NASA Propulsion Systems Laboratory icing wind tunnel. Aero-thermal and cloud parameters are set and known upstream at the tunnel inlet and spray system, but change as the cloud and air thermodynamically interact as the flowing masses reach the tunnel test section. Utilizing the ANSYS Fluent Discrete Phase Model function, 3D computational fluid dynamics (CFD) simulations were performed, capturing the thermodynamic interactions between the test parameters, and providing predictions of the aero thermal and cloud conditions at the tunnel test section. Simulation predictions were compared with test data that were measured at the tunnel exit plane. Evaluations focused on the cloud concentration (total water content), humidity content, and air temperature. CFD simulation predictions showed areas of agreement and disagreement. Simulations showed that cloud concentration profiles at the test section are strongly related to the initial spray nozzle pattern used at the tunnel inlet. Experimental data suggest that greater dispersion of the cloud occurred as the simulated cloud predicted areas of high and low cloud concentration compared to test data profiles. Simulations, however, captured the magnitude and location of the change in humidity content and the change in air temperature due to the presence of the cloud reasonably well, when compared to test data. This result would suggest that while the ANSYS simulation did not fully predict the spreading of the cloud as measured during experiment, it did capture evaporation and the molecular movements of air and vapor relatively well.

CFD↗
NASA NTRSDate not supplied

Comparisons of CFD Simulations of Icing Wind Tunnel Clouds with Experiments Conducted at the NASA Propulsions Systems Laboratory

This paper evaluates simulation predictions against experimental test data of icing clouds that were produced during 2018 ice crystal icing physics tests conducted at the NASA Propulsion Systems Laboratory icing wind tunnel. Aero-thermal and cloud parameters are set and known upstream at the tunnel inlet and spray system, but change as the cloud and air thermodynamically interact as the flowing masses reach the tunnel test section. Utilizing the ANSYS Fluent Discrete Phase Model function, 3D computational fluid dynamics (CFD) simulations were performed, capturing the thermodynamic interactions between the test parameters, and providing predictions of the aero thermal and cloud conditions at the tunnel test section. Simulation predictions were compared with test data that were measured at the tunnel exit plane. Evaluations focused on the cloud concentration (total water content), humidity content, and air temperature. CFD simulation predictions showed areas of agreement and disagreement. Simulations showed that cloud concentration profiles at the test section are strongly related to the initial spray nozzle pattern used at the tunnel inlet. Experimental data suggest that greater dispersion of the cloud occurred as the simulated cloud predicted areas of high and low cloud concentration compared to test data profiles. Simulations, however, captured the magnitude and location of the change in humidity content and the change in air temperature due to the presence of the cloud reasonably well, when compared to test data. This result would suggest that while the ANSYS simulation did not fully predict the spreading of the cloud as measured during experiment, it did capture evaporation and the molecular movements of air and vapor relatively well.

CFD↗
NASA NTRS2007

Coupled Stochastic Time-Inverted Lagrangian Transport/Weather Forecast and Research/Vegetation Photosynthesis and Respiration Model: Simulations of Tower-Based and Airborne CO2 Measurements - Part II

This paper evaluates simulations of atmospheric CO2 measured in 2004 at continental surface and airborne receptors, intended to test the capability to use data with high temporal and spatial resolution for analyses of carbon sources and sinks at regional and continental scales. The simulations were performed using the Stochastic Time-Inverted Lagrangian Transport (STILT) model driven by the Weather Forecast and Research (WRF) model, and linked to surface fluxes from the satellite-driven Vegetation Photosynthesis and Respiration Model (VPRM). The simulations provide detailed representations of hourly CO2 tower data and reproduce the shapes of airborne vertical profiles with high fidelity. WRF meteorology gives superior model performance compared with standard meteorological products, and the impact of including WRF convective mass fluxes in the STILT trajectory calculations is significant in individual cases. Important biases in the simulation are associated with the nighttime CO2 build-up and subsequent morning transition to convective conditions, and with errors in the advected lateral boundary condition. Comparison of STILT simulations driven by the WRF model against those driven by the Brazilian variant of the Regional Atmospheric Modeling System (BRAMS) shows that model-to-model differences are smaller than between an individual transport model and observations, pointing to systematic errors in the simulated transport. Future developments in the WRF model s data assimilation capabilities, basic research into the fundamental aspects of trajectory calculations, and intercomparison studies involving other transport models, are possible venues for reducing these errors. Overall, the STILT/WRF/VPRM offers a powerful tool for continental and regional scale carbon flux estimates.

Eluszkiewicz, Janusz↗
NASA NTRS2013

Analysis of Traffic Conflicts in a Mixed-Airspace Evaluation of Airborne Separation Assurance

A pair of human-in-the-loop simulation evaluations of a distributed air/ground separation assurance system have been conducted to investigate the function allocation between humans and automation systems as well as ground-based and airborne agents in the Next Generation Air Transportation System and beyond. This paper focuses on an analysis of certain critical conflicts observed between self-separating aircraft and ground-managed traffic in the same airspace. The principal cause of each conflict is identified and potential mitigations are discussed, such as: the sharing of trajectory intent information between the ground and the air; more cautious trajectory planning by the self-separating aircraft; and more equitable rules-of-the-road between the self-separating aircraft and ground-managed aircraft. This analysis will inform the ongoing design of an airborne separation assurance automation tool.

Lewis, Timothy A.↗
NASA NTRS1991

Design and evaluation of an air traffic control Final Approach Spacing Tool

This paper describes the design and simulator evaluation of an automation tool for assisting terminal radar approach controllers in sequencing and spacing traffic onto the final approach course. The automation tool, referred to as the Final Approach Spacing Tool (FAST), displays speed and heading advisories for arriving aircraft as well as sequencing information on the controller's radar display. The main functional elements of FAST are a scheduler that schedules and sequences the traffic, a four-dimensional trajectory synthesizer that generates the advisories, and a graphical interface that displays the information to the controller. FAST has been implemented on a high-performance workstation. It can be operated as a stand-alone in the terminal radar approach control facility or as an element of a system integrated with automation tools in the air route traffic control center. FAST was evaluated by experienced air traffic controllers in a real-time air traffic control simulation. simulation results summarized in the paper show that the automation tools significantly reduced controller work load and demonstrated a potential for an increase in landing rate.

Davis, Thomas J.↗
NASA NTRS1970

Post Flight Dynamic Analysis Simulation

Digital six-degrees-of-freedom, open loop Saturn 5 first stage flight evaluation simulation program obtains post flight simulation of the launch vehicle using actual flight data as input. Results are compared with measured data. For preflight analysis, the program uses predicted flight data as input.

Gregory, B. R.↗
DOE OSTI2024

Portable, heterogeneous ensemble workflows at scale using libEnsemble

libEnsemble is a Python-based toolkit for running dynamic ensembles, developed as part of the DOE Exascale Computing Project. The toolkit utilizes a unique generator–simulator–allocator paradigm, where generators produce input for simulators, simulators evaluate those inputs, and allocators decide whether and when a simulator or generator should be called. The generator steers the ensemble based on simulation results. Generators may, for example, apply methods for numerical optimization, machine learning, or statistical calibration. libEnsemble communicates between a manager and workers. Flexibility is provided through multiple manager–worker communication substrates each of which has different benefits. These include Python’s multiprocessing, mpi4py, and TCP. Multisite ensembles are supported using Balsam or Globus Compute. We overview the unique characteristics of libEnsemble as well as current and potential interoperability with other packages in the workflow ecosystem. We highlight libEnsemble’s dynamic resource features: libEnsemble can detect system resources, such as available nodes, cores, and GPUs, and assign these in a portable way. These features allow users to specify the number of processors and GPUs required for each simulation; and resources will be automatically assigned on a wide range of systems, including Frontier, Aurora, and Perlmutter. Such ensembles can include multiple simulation types, some using GPUs and others using only CPUs, sharing nodes for maximum efficiency. We also describe the benefits of libEnsemble’s generator–simulator coupling, which easily exposes to the user the ability to cancel, and portably kill, running simulations based on models that are updated with intermediate simulation output. We demonstrate libEnsemble’s capabilities, scalability, and scientific impact via a Gaussian process surrogate training problem for the longitudinal density profile at the exit of a plasma accelerator stage. In conclusion, the study uses gpCAM for the surrogate model and employs either Wake-T or WarpX simulations, highlighting efficient use of resources that can easily extend to exascale.

Dynamic ensembles↗
NASA NTRS1995

Design, analysis, and control of a large transport aircraft utilizing selective engine thrust as a backup system for the primary flight control

A study has been conducted to determine the capability to control a very large transport airplane with engine thrust. This study consisted of the design of an 800-passenger airplane with a range of 5000 nautical miles design and evaluation of a flight control system, and design and piloted simulation evaluation of a thrust-only backup flight control system. Location of the four wing-mounted engines was varied to optimize the propulsive control capability, and the time constant of the engine response was studied. The goal was to provide level 1 flying qualities. The engine location and engine time constant did not have a large effect on the control capability. The airplane design did meet level 1 flying qualities based on frequencies, damping ratios, and time constants in the longitudinal and lateral-directional modes. Project pilots consistently rated the flying qualities as either level 1 or level 2 based on Cooper-Harper ratings. However, because of the limited control forces and moments, the airplane design fell short of meeting the time required to achieve a 30 deg bank and the time required to respond a control input.

Gerren, Donna S.↗
NASA NTRS2001

Techniques for Improving Pilot Recovery from System Failures

This project examined the application of intelligent cockpit systems to aid air transport pilots at the tasks of reacting to in-flight system failures and of planning and then following a safe four dimensional trajectory to the runway threshold during emergencies. Two studies were conducted. The first examined pilot performance with a prototype awareness/alerting system in reacting to on-board system failures. In a full-motion, high-fidelity simulator, Army helicopter pilots were asked to fly a mission during which, without warning or briefing, 14 different failures were triggered at random times. Results suggest that the amount of information pilots require from such diagnostic systems is strongly dependent on their training; for failures they are commonly trained to react to with a procedural response, they needed only an indication of which failure to follow, while for 'un-trained' failures, they benefited from more intelligent and informative systems. Pilots were also found to over-rely on the system in conditions were it provided false or mis-leading information. In the second study, a proof-of-concept system was designed suitable for helping pilots replan their flights in emergency situations for quick, safe trajectory generation. This system is described in this report, including: the use of embedded fast-time simulation to predict the trajectory defined by a series of discrete actions; the models of aircraft and pilot dynamics required by the system; and the pilot interface. Then, results of a flight simulator evaluation with airline pilots are detailed. In 6 of 72 simulator runs, pilots were not able to establish a stable flight path on localizer and glideslope, suggesting a need for cockpit aids. However, results also suggest that, to be operationally feasible, such an aid must be capable of suggesting safe trajectories to the pilot; an aid that only verified plans entered by the pilot was found to have significantly detrimental effects on performance and pilot workload. Results also highlight that the trajectories suggested by the aid must capture the context of the emergency; for example, in some emergencies pilots were willing to violate flight envelope limits to reduce time in flight - in other emergencies the opposite was found.

Pritchett, Amy R.↗
NASA NTRS2007

2007 Lunar Regolith Simulant Workshop Overview

The National Aeronautics and Space Administration (NASA) vision has as a cornerstone, the establishment of an Outpost on the Moon. This Lunar Outpost will eventually provide the necessary planning, technology development, and training for a manned mission to Mars in the future. As part of the overall activity, NASA is conducting Earth-based research and advancing technologies to a Technology Readiness Level (TRL) 6 maturity under the Exploration Technology Development Program that will be incorporated into the Constellation Project as well as other projects. All aspects of the Lunar environment, including the Lunar regolith and its properties, are important in understanding the long-term impacts to hardware, scientific instruments, and humans prior to returning to the Moon and living on the Moon. With the goal of reducing risk to humans and hardware and increasing mission success on the Lunar surface, it is vital that terrestrial investigations including both development and verification testing have access to Lunar-like environments. The Marshall Space Flight Center (MSFC) is supporting this endeavor by developing, characterizing, and producing Lunar simulants in addition to analyzing existing simulants for appropriate applications. A Lunar Regolith Simulant Workshop was conducted by MSFC in Huntsville, Alabama, in October 2007. The purpose of the Workshop was to bring together simulant developers, simulant users, and program and project managers from ETDP and Constellation with the goals of understanding users' simulant needs and their applications. A status of current simulant developments such as the JSC-1A (Mare Type Simulant) and the NASA/U.S. Geological Survey Lunar Highlands-Type Pilot Simulant (NU-LHT-1M) was provided. The method for evaluating simulants, performed via Figures of Merit (FoMs) algorithms, was presented and a demonstration was provided. The four FoM properties currently being assessed are: size, shape, density, and composition. Some of the Workshop findings include: simulant developers must understand simulant users' needs and applications; higher fidelity simulants are needed and needed in larger quantities now; simulants must be characterized to allow "apples-to-apples" comparison of test results; simulant users should confer with simulant experts to assist them in the selection of simulants; safety precautions should be taken in the handling and use of simulants; shipping, storing, and preparation of simulants have important implications; and most importantly, close communications among the simulant community must be maintained and will be continued via telecoms, meetings, and an annual Lunar Regolith Simulant Workshop.

McLemore, Carole A.↗