SEARCH · Search NASA

Results for “simulation evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

All sources NASA NTRS DOE OSTI

NASA NTRS1984

A system for the simulation and evaluation of satellite communication networks

With the emergence of a new era in satellite communications, brought about by NASA's thrust into the Ka band with multibeam and onboard processing technologies, new and innovative techniques for evaluating these concepts and systems are required. To this end, NASA, in conjunction with its extensive program for advanced communications technology development, has undertaken to develop a concept for the simulation and evaluation of a complete communications network. Incorporated in this network will be proof-of-concept models of the latest technologies proposed for future satellite communications systems. These include low noise receivers, matrix switches, baseband processors, and solid state and tube type high power amplifiers. To accomplish this, numerous supporting technologies must be added to those aforementioned proof-of-concept models. These include controllers for synchronization, order wire, resource allocation, gain compensation, signal leveling, power augmentation, and rain fade and range delay simulation. Taken together, these will be assembled to comprise a system capable of addressing numerous design and performance questions. The simulation and evaluation system, as planned, will be modular in design and implementation, capable of modification and updating to track and evaluate a continuum of emerging concepts and technologies. Previously announced in STAR as N84-13400

Bagwell, J. W.↗

NASA NTRS1975

Path selection system simulation and evaluation for a Martian roving vehicle

A comprehensive digital computer simulation program has been developed for evaluating the path-selection system performance of an autonomous roving vehicle being designed for the exploration of Mars. Vehicle performance over realistic three-dimensional terrains in the presence of random motion disturbances and sensor measurement noise is simulated and plotted on a terrain contour map. In addition, a numerical figure-of-merit is computed automatically for each run.

Frederick, D. K.↗

NASA NTRS1965

Solar simulator spectrum evaluation.

Computer method using spectrometer for rapidly measuring spectral distribution of solar simulator and determining effects on thermal balance evaluation of spacecraft

SOLAR SIMULATOR↗

NASA NTRS2008

Simulation Based Evaluation of Integrated Adaptive Control and Flight Planning Technologies

The objective of this work is to leverage NASA resources to enable effective evaluation of resilient aircraft technologies through simulation. This includes examining strengths and weaknesses of adaptive controllers, emergency flight planning algorithms, and flight envelope determination algorithms both individually and as an integrated package.

Campbell, Stefan Forrest↗

NASA NTRS1993

Evaluation of simulation motion fidelity criteria in the vertical and directional axes

An evaluation of existing motion fidelity criteria was conducted on the NASA Ames Vertical Motion Simulator. Experienced test pilots flew single-axis repositioning tasks in both the vertical and the directional axes. Using a first-order approximation of a hovering helicopter, tasks were flown with variations only in the filters that attenuate the commands to the simulator motion system. These filters had second-order high-pass characteristics, and the variations were made in the filter gain and natural frequency. The variations spanned motion response characteristics from nearly full math-model motion to fixed-base. Between configurations, pilots recalibrated their motion response perception by flying the task with full motion. Pilots subjectively rated the motion fidelity of subsequent configurations relative to this full motion case, which was considered the standard for comparison. The results suggested that the existing vertical-axis criterion was accurate for combinations of gain and natural frequency changes. However, if only the gain or the natural frequency was changed, the rated motion fidelity was better than the criterion predicted. In the vertical axis, the objective and subjective results indicated that a larger gain reduction was tolerated than the existing criterion allowed. The limited data collected in the yaw axis revealed that pilots had difficulty in distinguishing among the variations in the pure yaw motion cues.

Schroeder, Jeffery A.↗

NASA NTRS1972

Pitch attitude, flight path, and airspeed control during approach and landing of a powered lift STOL aircraft

Analytical investigations and piloted moving base simulator evaluations were conducted for manual control of pitch attitude, flight path, and airspeed for the approach and landing of a powered lift jet STOL aircraft. Flight path and speed response characteristics were described analytically and were evaluated for the simulation experiments which were carried out on a large motion simulator. The response characteristics were selected and evaluated for a specified path and speed control technique. These charcteristics were: (1) the initial pitch response and steady pitch rate sensitivity for control of attitude with a pitch rate command/ attitude hold system, (2) the initial flight path response, flight path overshoot, and flight path-airspeed coupling in response to a change in thrust, and (3) the sensitivity of airspeed to pitch attitude changes. Results are presented in the form of pilot opinion ratings and commentary, substantiated where appropriate by response time histories and aircraft states at the point of touchdown.

Franklin, J. A.↗

NASA NTRS1972

Flight-path and airspeed control for the STOL approach and landing

Analytical investigations and piloted moving base simulator evaluations were conducted for manual control of flight path and airspeed for the approach and landing of a powered lift jet STOL aircraft. Flight-path and airspeed response characteristics were described analytically and were evaluated for the simulation experiments which were carried out on a large motion simulator. The response characteristics were selected and evaluated for a specified path and speed control technique. These characteristics were the initial flight-path response, flight-path overshoot, flight-path-airspeed coupling in response to a change in thrust, and the sensitivity of airspeed to pitch-attitude changes. Results are presented in the form of pilot opinion ratings and commentary, substantiated where appropriate by response time histories and aircraft states at the point of touchdown.

Franklin, J. A.↗

NASA NTRS2019

Fast-Time Simulation for Evaluating the Impact of Estimated Flight Ready Time Uncertainty on Surface Metering

NASA has been developing and demonstrating new concepts and technologies for Integrated Arrival, Departure, and Surface (IADS) traffic management capabilities under the Airspace Technology Demonstration 2 (ATD-2) project. One of the IADS capabilities in the ATD-2 project is surface metering enabled by a tactical surface scheduler to provide controllers with the pushback advisories for departures at gates. The tactical surface scheduler uses the estimated flight ready times provided by airlines, called Earliest Off-Block Times (EOBTs), as input to calculate the target off-block times for pushback advisories. However, the EOBTs are often inaccurate and deviate from the actual flight ready times, which may reduce the benefits of surface metering. In this paper, a linear regression model is developed to model the EOBT uncertainty distribution over time based on actual EOBT data collected at Charlotte airport. This EOBT model is integrated with a tactical surface scheduler and a fast-time simulation tool. To evaluate the impact of the EOBT accuracy on airport surface operations, fast-time simulations are implemented for selected traffic scenarios under different levels of modelled EOBT accuracy. The simulation results show that the EOBT uncertainty affects several performance metrics related to the surface metering, such as gate hold, taxi time reduction, and target takeoff time predictability, which in turn influences ATD-2's scheduler performance.

tactical surface scheduler↗

NASA NTRS2019

Fast-Time Simulation for Evaluating the Impact of Estimated Flight Ready Time Uncertainty on Surface Metering

tactical surface scheduler↗

DOE OSTI2023

Evaluating EAMv2 Simulated High Latitude Clouds Using ARM Measurements in the Northern and Southern Hemispheres

Here, this study evaluates high latitude stratiform mixed-phase clouds (SMPC) in the atmosphere model of the Energy Exascale Earth System Model version 2 (EAMv2) by utilizing one-year-long ground-based remote sensing measurements from the Atmospheric Radiation and Measurement (ARM) program. A nudging approach is applied to model simulations for a constrained comparison with the ARM observations. Observed and modeled SMPCs are sampled and collocated to address the difference in data resolution, so that we can consistently evaluate their macrophysical properties at the North Slope of Alaska (NSA) site in the Arctic and the McMurdo (AWR) site in the Antarctic. We found that EAMv2 overestimates SMPC frequency of occurrence at both sites. However, the model captures the observed larger cloud frequency of occurrence at the NSA site. For collocated SMPCs, the annual statistics of observed cloud macrophysics are generally reproduced at the NSA site, while at the AWR site, there are larger biases. Compared to the AWR site, the lower cloud top and cloud base and the warmer cloud top temperature observed at NSA are well simulated. On the other hand, simulated cloud phase is substantially biased. The model largely overestimates liquid water path, and the ice water path is underestimated at NSA, but at AWR, the liquid water path is frequently underestimated due to the dominance of snow in Antarctic SMPCs. As a result, the observed hemispheric difference in cloud phase partitioning is misrepresented in EAMv2. This study implies that additional model development is needed for high latitude mixed-phase clouds.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Advanced Modeling and Simulation Methods for Evaluation of Thermal Neutron Scattering Materials

With the rise of interest in thermal neutron scattering data for advanced reactor, criticality safety, and shielding applications, new experimental data are required for evaluation of new materials or for re-evaluation (or validations) of previously evaluated materials. New experimental data are evaluated in a three-step process: (1) computing the phonon characteristics, (2) computing the dynamic structure factor (DSF) from the data, and (3) using the experimental setup to simulate the experimental data. All three steps have challenges, ranging from the need for a sufficiently general material simulation code—a processing code that can compute the corresponding DSF—to having a detailed layout of the instrument/beamline/facility where the data were measured. Whereas phonon characteristics of materials can be computed using various methods (molecular dynamics, density functional theory, etc.), a high-fidelity computation of the DSF and the simulation of the experiment based on the DSF is vital to the accuracy of the evaluation. The latter two steps can be achieved by using the two corresponding code systems developed by instrument scientists at the Spallation Neutron Source (SNS) at Oak Ridge National Laboratory: (1) OCLIMAX, a program that calculates the dynamic structure factor from DFT and MD simulation results, and (2) MCViNE, a Monte Carlo neutron ray-tracing program designed to simulate neutron scattering experiments. Recently, polyethylene and yttrium hydride were measured at the Wide Angular-Range Chopper (ARCS) and SEQUOIA instrument stations of the SNS. These experiments are simulated using the density functional theory code, the Cambridge Serial Total Energy Package (CASTEP), to compute its phonon characteristics (eigenvalues/vectors and PDOS), which is then processed using OCLIMAX to yield the DSF, and finally the data at each instrument station are simulated by the MCViNE for comparison to the measured data for evaluation. For comparison to conventional evaluation methods, the scattering data processed from OCLIMAX are compared against those processed from the LEAPR module of NJOY, and the results from MCViNE simulations are compared against previously used simplified beamline models implemented in the Monte Carlo N-Particle (MCNP) code.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2022

Advanced Modeling and Simulations for Evaluation of Thermal Neutron Scattering Materials [Slides]

In this presentation, researchers detail tradeoffs between two simulation suites for thermal neutron scattering data. OXLIMAX + MCViNE provide a more accurate elastic peak shape and NJOY + MCNP have more accurate spectra between phonon mode peaks (most likely due to multiple neutron scattering). Additionally, some outstanding issues with MCViNE are noted, including multiple neutron scattering and non-uniform (Q,E) grid for data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

NASA NTRS1980

Development of the reentry flight dynamics simulator for evaluation of space shuttle orbiter entry systems

A nonlinear, six degree of freedom, digital computer simulation of a vehicle which has constant mass properties and whose attitudes are controlled by both aerodynamic surfaces and reaction control system thrusters was developed. A rotating, oblate Earth model was used to describe the gravitational forces which affect long duration Earth entry trajectories. The program is executed in a nonreal time mode or connected to a simulation cockpit to conduct piloted and autopilot studies. The program guidance and control software used by the space shuttle orbiter for its descent from approximately 121.9 km to touchdown on the runway.

Rowell, L. F.↗

NASA NTRS1993

Lift-fan aircraft: Lessons learned-the pilot's perspective

This paper is written from an engineering test pilot's point of view. Its purpose is to present lift-fan 'lessons learned' from the perspective of first-hand experience accumulated during the period 1962 through 1988 while flight testing vertical/short take-off and landing (V/STOL) experimental aircraft and evaluating piloted engineering simulations of promising V/STOL concepts. Specifically, the scope of the discussions to follow is primarily based upon a critical review of the writer's personal accounts of 30 hours of XV-5A/B and 2 hours of X-14A flight testing as well as a limited simulator evaluation of the Grumman Design 755 lift-fan aircraft. Opinions of other test pilots who flew these aircraft and the aircraft simulator are also included and supplement the writer's comments. Furthermore, the lessons learned are presented from the perspective of the writer's flying experience: 10,000 hours in 100 fixed- and rotary-wing aircraft including 330 hours in 5 experimental V/STOL research aircraft. The paper is organized to present to the reader a clear picture of lift-fan lessons learned from three distinct points of view in order to facilitate application of the lesson principles to future designs. Lessons learned are first discussed with respect to case histories of specific flight and simulator investigations. These principles are then organized and restated with respect to four selected design criteria categories in Appendix I. Lastly, Appendix Il is a discussion of the design of a hypothetical supersonic short take-off vertical landing (STOVL) fighter/attack aircraft.

Gerdes, Ronald M.↗

DOE OSTI2021

Simulation-based Performance Evaluation of Model Predictive Control for Building Energy Systems

The performance of model predictive control (MPC) can be significantly affected by different choices of controller parameters such as the time intervals for model discretization and control sampling. Due to the lack of a systematic understanding on how these parameters affect control performance, they are usually selected arbitrarily in practice.In this paper, the combined impacts of selected time intervals for model discretization and control sampling on the performance of MPC are comprehensively investigated for the first time through detailed simulations. Specifically, a typical MPC strategy is first designed to improve building operations based on a reduced-order model of building dynamics. Then, the performance of the designed MPC is evaluated against different choices of time intervals for model discretization and control sampling on a simulated office building. The detailed simulation results reveal that the time interval for model discretization has a much greater influence on the performance of MPC than the time interval for control sampling. Although the time interval for control sampling usually receives more attentions in practice, it turns out that the time interval for model discretization affects the prediction performance, cost saving, and computation time simultaneously and more significantly. Therefore, the simulation-based performance evaluation presented here sheds light on the impacts of different time intervals and facilitates their selection for practical applications of MPC to building operations

Huang, Sen↗

DOE OSTI2023

QASMBench: A Low-Level Quantum Benchmark Suite for NISQ Evaluation and Simulation

The rapid development of quantum computing (QC) in the NISQ era urgently demands a low-level benchmark suite and insightful evaluation metrics for characterizing the properties of prototype NISQ devices, the efficiency of QC programming compilers, schedulers and assemblers, and the capability of quantum system simulators in a classical computer. In this work, we fill this gap by proposing a low-level, easy-to-use benchmark suite called QASMBench based on the OpenQASM assembly representation. It consolidates commonly used quantum routines and kernels from a variety of domains including chemistry, simulation, linear algebra, searching, optimization, arithmetic, machine learning, fault tolerance, cryptography, and so on, trading-off between generality and usability. To analyze these kernels in terms of NISQ device execution, in addition to circuit width and depth, we propose four circuit metrics including gate density, retention lifespan, measurement density, and entanglement variance, to extract more insights about the execution efficiency, the susceptibility to NISQ error, and the potential gain from machine-specific optimizations. Applications in QASMBench can be launched and verified on several NISQ platforms, including IBM-Q, Rigetti, IonQ and Quantinuum. For evaluation, we measure the execution fidelity of a subset of QASMBench applications on 12 IBM-Q machines through density matrix state tomography, comprising 25K circuit evaluations. In addition we also compare the fidelity of executions among the IBM-Q machines, the IonQ QPU and the Rigetti Aspen M-1 system.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2026

Evaluation of simulated HPGe detector efficiencies in OpenMC compared to MCNP

In late 2023, the open-source radiation transport code OpenMC introduced a pulse-height tally (PHT) feature, enabling users to track the total energy deposited by individual photons in OpenMC cells. This function represents an important improvement of the OpenMC code because it allows users to simulate the response function of a gamma detector without relying on closed-source alternatives. Despite this, limited work has been published evaluating OpenMC as a radiation transport code for simulating gamma spectroscopy experiments. This study attempts to demonstrate the usefulness of OpenMC in this space by directly comparing its PHT output to MCNP (a trusted industry-standard Monte Carlo code). In the first half of this study, a radiation transport experiment is described in which a detector with a complex internal geometry is exposed to various gamma-emitting isotopes ( 133 Ba, 137 Cs, and 60 Co) over a range of distances. The setup of this experiment was modeled in MCNP with sufficient detail to capture the efficiency characteristics of a high purity germanium (HPGe) detector for the primary gammas of each isotope. After good agreement between the MCNP model and experiment was achieved, an identical model was produced in OpenMC to allow direct comparison between the full energy peak (FEP) values produced in OpenMC and MCNP. The results show strong agreement between OpenMC and MCNP across the full range of tested energies, with each model’s FEP values typically within 2% of each other and most FEP areas within 4% of experimental data. Worse agreement was seen between the Monte Carlo codes and experiment below 300 keV (an expected result). For the 662 keV line of 137 Cs, both codes were found in poor agreement with experiment and each other over the full range of distances tested (possibly indicating an error with the 137 Cs experimental data). Ignoring the anomalous results of the 662 keV line, all other data show good qualitative and quantitative agreement between MCNP and OpenMC. This result demonstrates the accuracy of OpenMC’s PHT feature for spectroscopic applications in which detector efficiency is a primary concern.

07 - ISOTOPES AND RADIATION SOURCES↗

DOE OSTI2017

Using Dynamic Simulation to Evaluate Attemperator Operation in a Natural Gas Combined Cycle With Duct Burners in the Heat Recovery Steam Generator

A generic training simulator of a natural gas combined cycle was modified to match operations at a real plant. The objective was to use the simulator to analyze cycling operations of the plant. Initial operation of the simulator revealed the potential for saturation conditions in the final high pressure superheater as the attemperator tried to control temperature at the superheater outlet during gas turbine loading and unloading. Subsequent plant operational data confirmed simulation results. Multiple simulations were performed during loading and unloading of the gas turbine to determine operational strategies that prevented saturation and increased the approach to saturation temperature. The solutions included changes to the attemperator temperature control setpoints and strategic control of the steam turbine inlet pressure control valve.

20 FOSSIL-FUELED POWER PLANTS↗