Search NASA⌕ Search

SEARCH · Search NASA

Results for “simulation evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Advanced supersonic transport fixed-base simulator evaluations at landing approach

Equations of motion simulating the landing approach case for the supersonic cruise vehicle were programmed and exercised using a fixed base simulation facility. Unaugmented and augmented system comparisons using this facility are provided. Refinements necessary for system performance improvement are made. The unaugmented longitudinal responses to elevator commands are slow and sluggish, requiring augmentation to increase the speed of the response. In the lateral directional case, the Dutch roll is highly underdamped and requires an augmentation system to increase this damping and provide satisfactory flying qualities. The status of this fixed base study is that the longitudinal equations, updated with recent wind tunnel data, were evaluated on the simulator and the system found to be satisfactory. The lateral axis equations are linearized and are not yet updated to large excursion capability; consequently, only limited, preliminary findings on this system are available. The basic results so far indicate augmentation systems are required to provide a satisfactory longitudinal system, and that additional study and evaluation of the lateral directional case are necessary before a more complete assessment can be made.

Feather, J. B.↗

Engineering simulation evaluation of the two-segment noise abatement approach in the Douglas DC-8-61

The development and operational evaluation are discussed of a noise abatement two-segment approach which is safe and operationally acceptable for routine use in air carrier service. An engineering simulation evaluation was conducted; it was found that the entry speed and initial configuration are more important in the DC-8-61 than in the 727 because of the DC-8's aerodynamic cleanliness and drag programming constraints. It was also found that the altitude required for the DC-8 upper and lower transitions is less than the 727 transitions principally due to the pitching moment from the underslung DC-8 engines as compared to the 727 engines which produce no pitching moment with a change in thrust. The 727 approach was a reduced flaps (30 degrees) procedure with a 10-knot airspeed bleed in the lower transition; the DC-8 approach is a full flaps (50 degrees) procedure with constant airspeed established as soon as possible after upper segment transition.

Nylen, W. E.↗

A Real2Sim Digital Twin Pipeline for Photorealistic Robot Simulation: Evaluating VLA Policy Deployment on a Bimanual Mobile Robot

Digital twins that are automatically constructed from robot sensor data offer a promising pathway for scalable Real2Sim and Sim2Real transfer. However, it remains an open question whether photorealistic reconstruction alone is sufficient to support reliable deployment of vision-language-action (VLA) policies. We present a generative-AI-assisted Real2Sim pipeline that generates simulation-ready digital twins from real-world RGB observations with minimal manual intervention. The pipeline uses prompted segmentation to isolate scene components and a generative 3D model to directly produce simulation assets, eliminating the need for traditional multi-view reconstruction or manual 3D modeling.\r\nTo evaluate simulation fidelity, we deploy and compare policies from two VLA models in both the real robot and the reconstructed\r\nsimulation under identical tasks and initial conditions. We compare joint-level action trajectories and analyze how divergence evolves over time in closed-loop execution. Although the reconstructed environments are visually accurate, we observe increasing trajectory divergence during closedloop operation. These results indicate that photorealistic reconstruction alone is insufficient to preserve closed-loop control behavior\r\nin VLA policies, particularly in contact-rich manipulation settings where small perceptual errors compound over time.

97 MATHEMATICS AND COMPUTING↗

Piloted Simulation Evaluation of a Model-Predictive Automatic Recovery System to Prevent Vehicle Loss of Control on Approach

This paper describes a model-predictive automatic recovery system for aircraft on the verge of a loss-of-control situation. The system determines when it must intervene to prevent an imminent accident, resulting from a poor approach. It estimates the altitude loss that would result from a go-around maneuver at the current flight condition. If the loss is projected to violate a minimum altitude threshold, the maneuver is automatically triggered. The system deactivates to allow landing once several criteria are met. Piloted flight simulator evaluation showed the system to provide effective envelope protection during extremely unsafe landing attempts. The results demonstrate how flight and propulsion control can be integrated to recover control of the vehicle automatically and prevent a potential catastrophe.

aircraft engine simulation↗

Initial Piloted Simulation Evaluation of the Reference-H High-Speed Civil Transport Design During Takeoff and Recovery From Limit Flight Conditions

An initial assessment of a proposed High-Speed Civil Transport (HSCT) was conducted in the fall of 1995 at the NASA Langley Research Center. This configuration, known as the Industry Reference-H (Ref.-H), was designed by the Boeing Aircraft Company as part of their work in the High Speed Research program. It included a conventional tail, a cranked-arrow wing, four mixed-flow turbofan engines, and capacity for transporting approximately 300 passengers. The purpose of this assessment was to evaluate and quantify operational aspects of the Reference-H configuration from a pilot's perspective with the additional goal of identifying design strengths as well as any potential configuration deficiencies. This study was aimed at evaluating the Ref.-H configuration at many points of the aircraft's envelope to determine the suitability of the vehicle to accomplish typical mission profiles as well as emergency or envelope-limit conditions. Pilot-provided Cooper-Harper ratings and comments constituted the primary vehicle evaluation metric. The analysis included simulated real-time piloted evaluations, performed in a 6 degree of freedom motion base NASA Langley Visual-Motion Simulator, combined with extensive bath analysis. The assessment was performed using the third major release of the simulation data base (known as Ref.-H cycle 2B).

Glaab, Louis J.↗

Piloted Simulation Evaluation of a Model-Predictive Automatic Recovery System to Prevent Vehicle Loss of Control on Approach

This paper describes a model-predictive automatic recovery system for aircraft on the verge of a loss-of-control situation. The system determines when it must intervene to prevent an imminent accident, resulting from a poor approach. It estimates the altitude loss that would result from a go-around maneuver at the current flight condition. If the loss is projected to violate a minimum altitude threshold, the maneuver is automatically triggered. The system deactivates to allow landing once several criteria are met. Piloted flight simulator evaluation showed the system to provide effective envelope protection during extremely unsafe landing attempts. The results demonstrate how flight and propulsion control can be integrated to recover control of the vehicle automatically and prevent a potential catastrophe.

aircraft engine performance↗

Runway Incursion Prevention System Simulation Evaluation

A Runway Incursion Prevention System (RIPS) was evaluated in a full mission simulation study at the NASA Langley Research center in March 2002. RIPS integrates airborne and ground-based technologies to provide (1) enhanced surface situational awareness to avoid blunders and (2) alerts of runway conflicts in order to prevent runway incidents while also improving operational capability. A series of test runs was conducted in a high fidelity simulator. The purpose of the study was to evaluate the RIPS airborne incursion detection algorithms and associated alerting and airport surface display concepts. Eight commercial airline crews participated as test subjects completing 467 test runs. This paper gives an overview of the RIPS, simulation study, and test results.

Jones, Denise R.↗

Comparison of simulator fidelity model predictions with in-simulator evaluation data

A full factorial in simulator experiment of a single axis, multiloop, compensatory pitch tracking task is described. The experiment was conducted to provide data to validate extensions to an analytic, closed loop model of a real time digital simulation facility. The results of the experiment encompassing various simulation fidelity factors, such as visual delay, digital integration algorithms, computer iteration rates, control loading bandwidths and proprioceptive cues, and g-seat kinesthetic cues, are compared with predictions obtained from the analytic model incorporating an optimal control model of the human pilot. The in-simulator results demonstrate more sensitivity to the g-seat and to the control loader conditions than were predicted by the model. However, the model predictions are generally upheld, although the predicted magnitudes of the states and of the error terms are sometimes off considerably. Of particular concern is the large sensitivity difference for one control loader condition, as well as the model/in-simulator mismatch in the magnitude of the plant states when the other states match.

Parrish, R. V.↗

Simulation evaluation of NIST air-kerma rate calibration standard for electronic brachytherapy: Simulation of NIST air-kerma rate eBT calibration standard

Purpose: Dosimetry for the model S700 50 kV electronic brachytherapy (eBT) source (Xoft, Inc., a subsidiary of iCAD, San Jose, CA) was simulated using Monte Carlo (MC) methods by Rivard et al. [“Calculated and measured brachytherapy dosimetry parameters in water for the Xoft Axxent x-ray source: An electronic brachytherapy source,” Med. Phys. 33, 4020–4032 (2006)] and recently by Hiatt et al. [“A revised dosimetric characterization of the model S700 electronic brachytherapy source containing an anode-centering plastic insert and other components not included in the 2006 model,” Med. Phys. 42, 2764–2776 (2015)] with improved geometric characterization. Additionally, while these studies examined the dose distribution in water, there have not previously been reports of the eBT source calibration methods beyond that recently reported by Seltzer et al. [“New national air-kerma standard for low-energy electronic brachytherapy sources,” J. Res. Natl. Inst. Stand. Technol. 119, 554–574 (2014)]. Therefore, the motivation for the current study was to provide an independent determination of air-kerma rate at 50 cm in air K air (d = 50 cm) using MC methods for the model S700 eBT source. Methods: Using CAD information provided by the vendor and disassembled sources, an MC model was created for the S700 eBT source. Simulations were run using the mcnp6 radiation transport code for the NIST Lamperti air ionization chamber according to specifications by Boutillon et al. [“Comparison of exposure standards in the 10-50 kV x-ray region,” Metrologia 5, 1–11 (1969)], in air without the Lamperti chamber, and in vacuum without the Lamperti chamber. K air (d = 50 cm) was determined using the *F4 tally with NIST values for the mass energy-absorption coefficients for air. Photon spectra were evaluated over 2π azimuthal sampling for polar angles of 0° ≤ θ ≤ 180° every 1°. Volume averaging was averted through tight radial binning. Photon energy spectra were determined over all polar angles in both air and vacuum using the F4 tally with 0.1 keV resolution. A total of 10 11 simulated histories were run for the Lamperti chamber geometry (statistical uncertainty of 0.14%), with 10 10 histories for the in-air and in-vacuum simulations (statistical uncertainty of 0.04%). The total standard uncertainty in the calculated air-kerma rate determination amounted to 6.8%. Results: MC simulations determined the air-kerma rate at 50 cm from the source with the modeled Lamperti chamber to be (1.850 ± 0.126) × 10 -4 Gy/s, which was within the range of K air (d = 50 cm) values (1.67–2.11) × 10 -4 Gy/s measured by NIST. The ratio of the photon spectra in air and in vacuum were in good agreement above 13 keV, and for θ < 150° where the influence of the Kovar sleeve and the Ag epoxy components caused increased scatter in air. Below 13 keV, the ratio of the photon spectra in air to vacuum exhibited a decrease that was attributed to increased attenuation of the photons in air. Across most of the energy range on the source transverse plane, there was good agreement between the authors' simulated spectra and that measured by NIST. Discrepancies were observed above 40 keV where the NIST spectrum had a steeper fall-off towards 50 keV. Conclusions: Through MC simulations of radiation transport, this study provided an independent validation of the measured air-kerma rate at 50 cm in air at NIST for the model S700 eBT source, with mean results in agreement within 3.3%. Lastly, this difference was smaller than the range (i.e., 23%) of the measured values.

61 RADIATION PROTECTION AND DOSIMETRY↗

Moving-base simulation evaluation of thrust margins for vertical landing for the NASA YAV-8B Harrier aircraft

A simulation experiment was conducted on Ames Research Center's Vertical Motion Simulator to evaluate the thrust margin for vertical landing required for the YAV-8B Harrier. Two different levels of ground effect were employed, representing the aircraft with or without lift improvement devices installed. In addition, two different inlet temperature profiles were included to cover a wide range of hot gas ingestion. For each ground effect and hot gas ingestion variant, vertical landings were performed at successively heavier weights, with the pilot assessing the acceptability of the operation in each case. Results are presented as a function of hover weight ratio and a metric of the mean ground effect and ingestion that reflect the increase in thrust margin required to provide acceptable control of sink rate during the descent to touchdown with increasing suck down and hot gas ingestion.

Franklin, James A.↗

Simulator evaluation of display concepts for pilot monitoring and control of space shuttle approach and landing. Phase 2: Manual flight control

A study of the display requirements for final approach management of the space shuttle orbiter vehicle is presented. An experimental display concept, providing a more direct, pictorial representation of the vehicle's movement relative to the selected approach path and aiming points, was developed and assessed as an aid to manual flight path control. Both head-up, windshield projections and head-down, panel mounted presentations of the experimental display were evaluated in a series of simulated orbiter approach sequence. Data obtained indicate that the experimental display would enable orbiter pilots to exercise greater flexibility in implementing alternative final approach control strategies. Touchdown position and airspeed dispersion criteria were satisfied on 91 percent of the approach sequences, representing various profile and wind effect conditions. Flight path control and airspeed management satisfied operationally-relevant criteria for the two-segment, power-off orbiter approach and were consistently more accurate and less variable when the full set of experimental display elements was available to the pilot. Approach control tended to be more precise when the head-up display was used; however, the data also indicate that the head-down display would provide adequate support for the manual control task.

Gartner, W. B.↗

Simulation evaluation of display/FLIR concepts for low-altitude, terrain-following helicopter operations

Trials were run on a six degree of freedom combat helicopter simulator to evaluate head-down displays with integrated FLIR imagery for terrain-following, course-steering, and transition to approach and hover helicopter pilot tasks. Three display formats were tested, providing varying levels of symbology for, e.g., the flight path angle, pitch-attitude data, vertical speed, altitude, etc. The pilots were also furnished flight director guidance, i.e., terrain-following, course steering, airspeed hold, and approach to hover. All the displays permitted the pilots to fly satisfactory mission in the CGI scenarios. The results revealed that the pilots preferred a nonconformal FLIR display superposition.

Swenson, H. N.↗

Simulated Evaluation of Strategic Conflict Management Capabilities for Urban Air Mobility Operations

Urban Air Mobility (UAM) is a new air transportation service concept to carry passengers or cargo in metropolitan areas, leveraged by innovative aircraft and automation technologies. NASA has conducted a series of simulations to evaluate the UAM concept of operations and inform the development of airspace procedures and services for UAM operations. The latest set of simulations called “X5” were conducted to test a Provider of Services for UAM (PSU) prototype that NASA developed for UAM flight planning, strategic conflict management support, and data exchange between UAM operators. In these simulations, two strategic conflict management capabilities, Demand-Capacity Balancing (DCB) and Sequencing and Scheduling (S&S), were further investigated. This paper describes the system architecture designed for the X5 simulation activities, the sequence diagram for strategic conflict management, and the simulation environment in the Dallas/Fort Worth urban area. The simulation results based on several system performance metrics for evaluation show that a sequential application of DCB and S&S effectively works to distribute traffic demand and meet sequencing and spacing criteria by assigning ground delays, compared to the DCB only and S&S only cases.

Simulation↗

Simulated Evaluation of Strategic Conflict Management Capabilities for Urban Air Mobility Operations

Urban Air Mobility (UAM) is a new air transportation service concept to carry passengers or cargo in metropolitan areas, leveraged by innovative aircraft and automation technologies. NASA has conducted a series of simulations to evaluate the UAM concept of operations and inform the development of airspace procedures and services for UAM operations. The latest set of simulations called “X5” were conducted to test a Provider of Services for UAM (PSU) prototype that NASA developed for UAM flight planning, strategic conflict management support, and data exchange between UAM operators. In these simulations, two strategic conflict management capabilities, Demand-Capacity Balancing (DCB) and Sequencing and Scheduling (S&S), were further investigated. This paper describes the system architecture designed for the X5 simulation activities, the sequence diagram for strategic conflict management, and the simulation environment in the Dallas/Fort Worth urban area. The simulation results based on several system performance metrics for evaluation show that a sequential application of DCB and S&S effectively works to distribute traffic demand and meet sequencing and spacing criteria by assigning ground delays, compared to the DCB only and S&S only cases.

Urban Air Mobility, Strategic Conflict Management,↗

A simulator evaluation of the use of spoilers on a light aircraft

A fixed-base flight simulator was used to evaluate wing spoilers for longitudinal flight path control on a modified Cessna Cardinal aircraft. Spoilers which generated the proper pitching moment to maintain aircraft trim C sub L constant could be used as an effective descent rate control. More than 100 simulated ILS approaches were flown by evaluation pilots using both conventional methods and spoiler descent rate control. Three spoiler control schemes were evaluated during the ILS approaches. Using the spoilers for control, instrument approaches could be flown smoothly and precisely with constant airspeed and pitch attitude. While the spoilers could adequately control ILS approaches, a spoiler system with greater authority would be desirable for use in visual approaches.

Brainerd, C. H.↗

Simulation evaluation of a low-altitude helicopter flight guidance system adapted for a helmet-mounted display

A computer aiding concept for low-altitude helicopter flight was developed and evaluated in a real-time piloted simulation. The concept included an optimal control trajectory-generation algorithm based upon dynamic programming and a helmet-mounted display (HMD) presentation of a pathway-in-the-sky, a phantom aircraft, and flight-path vector/predictor guidance symbology. The trajectory-generation algorithm uses knowledge of the global mission requirements, a digital terrain map, aircraft performance capabilities, and advanced navigation information to determine a trajectory between mission way points that seeks valleys to minimize threat exposure. The pilot evaluation was conducted at NASA ARC moving base Vertical Motion Simulator (VMS) by pilots representing NASA, the U.S. Army, the Air Force, and the helicopter industry. The pilots manually tracked the trajectory generated by the algorithm utilizing the HMD symbology. The pilots were able to satisfactorily perform the tracking tasks while maintaining a high degree of awareness of the outside world.

Swenson, Harry N.↗

A simulator evaluation of a rate-enhanced instrument landing system display

A piloted simulation study was conducted to evaluate the effect on instrument landing system tracking performance of integrating localizer error rate information with the raw localizer error display. The resulting display was named the pseudo command tracking indicator (PCTI) because it provides an indication of any changes of heading required to track the localizer. Eight instrument-rated pilots each flew five instrument approaches with the PCTI and five instrument approaches with a conventional course deviation indicator. The results show good overall pilot acceptance of the PCTI and a significant reduction in localizer tracking error.

Hinton, D. A.↗