Search NASA⌕ Search

SEARCH · Search NASA

Results for “simulation evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,243 records · Page 69

Quantifying Pilot Contribution to Flight Safety During an In-Flight Airspeed Failure

Accident statistics cite the flight crew as a causal factor in over 60% of large transport fatal accidents. Yet a well-trained and well-qualified crew is acknowledged as the critical center point of aircraft systems safety and an integral component of the entire commercial aviation system. A human-in-the-loop test was conducted using a Level D certified Boeing 737-800 simulator to evaluate the pilot's contribution to safety-of-flight during routine air carrier flight operations and in response to system failures. To quantify the human's contribution, crew complement was used as an independent variable in a between-subjects design. This paper details the crew's actions and responses while dealing with an in-flight airspeed failure. Accident statistics often cite flight crew error (Baker, 2001) as the primary contributor in accidents and incidents in transport category aircraft. However, the Air Line Pilots Association (2011) suggests "a well-trained and well-qualified pilot is acknowledged as the critical center point of the aircraft systems safety and an integral safety component of the entire commercial aviation system." This is generally acknowledged but cannot be verified because little or no quantitative data exists on how or how many accidents/incidents are averted by crew actions. Anecdotal evidence suggest crews handle failures on a daily basis and Aviation Safety Action Program data generally supports this assertion, even if the data is not released to the public. However without hard evidence, the contribution and means by which pilots achieve safety of flight is difficult to define. Thus, ways to improve the human ability to contribute or overcome deficiencies are ill-defined.

Etherington, Timothy J.↗

Modeling the Distribution and Type of High-Latitude Natural Wetlands for Methane Studies

High latitude (>50N) natural wetlands emit a substantial amount of methane to the atmosphere, and are located in a region of amplified warming. Northern hemisphere high latitudes are characterized by cold climates, extensive permafrost, poor drainage, short growing seasons, and slow decay rates. Under these conditions, organic carbon accumulates in the soil, sequestering CO2 from the atmosphere. Methanogens produce methane from this carbon reservoir, converting stored carbon into a powerful greenhouse gas. Methane emission from wetland ecosystems depends on vegetation type, climate characteristics (e.g, precipitation amount and seasonality, temperature, snow cover, etc.), and geophysical variables (e.g., permafrost, soil type, and landscape slope). To understand how wetland methane dynamics in this critical region will respond to climate change, we have to first understand how wetlands themselves will change and therefore, what the primary controllers of wetland distribution and type are. Understanding these relationships permits data-anchored, physically-based modeling of wetland distribution and type in other climate scenarios, such as paleoclimates or future climates, a necessary first step toward modeling wetland methane emissions in these scenarios. We investigate techniques and datasets for predicting the distribution and type of high latitude (>50N) natural wetlands from a suite of geophysical and climate predictors. Hierarchical clustering is used to derive an empirical methane-centric wetland model. The model is applied in a multistep process first to predict the distribution of wetlands from relevant geophysical parameters, and then, given the predicted wetland distribution, to classify the wetlands into methane-relevant types using an expanded suite of climate and biogeophysical variables. As the optimum set of predictor variables is not known a priori, the model is applied iteratively, and each simulation is evaluated with respect to observed high-latitude wetlands.

Romanski, Joy↗

RUMS - Realtime Visualization and Evaluation of Live, Virtual, Constructive Simulation Data

This paper describes the tools and display capabilities being developed to visualize aircraft flight and trajectory information that is produced during a distributed Live, Virtual, Constructive (LVC) simulation events involving a mix of manned and unmanned aircraft. This paper discusses the design approach and general software architecture of the Remote User Monitor Service (RUMS) application. The simulations and flight tests are conducted over a nationwide network with components communicating via software gateways that translate the messages and provide a location to access and collect data. The data collected is not only archived for post-processing and analysis, but also processed in real-time by RUMS, which allows dynamic viewing of the information via a web browser. This real-time dynamic viewing of the data allows test conductors and researchers to monitor the health of the distributed system and of the data being collected not only in situ where tests are conducted but also at remote locations.

distributed simulation↗

ACES Study of DAA-Mitigated UAS Operations SC-228 Requirements Sub Group

Realization of the expected proliferation of Unmanned Aircraft System (UAS) operations in the National Airspace System (NAS) depends on the development and validation of performance standards for UAS Detect and Avoid (DAA) Systems. The RTCA Special Committee 228 is charged with leading the development of draft Minimum Operational Performance Standards (MOPS) for UAS DAA Systems. NASA, as a participating member of RTCA SC-228 is committed to supporting the development and validation of draft requirements as well as the safety substantiation and end-to-end assessment of DAA system performance. A recent study conducted using NASA's ACES (Airspace Concept Evaluation System) simulation capability begins to address questions surrounding the development of draft MOPS for DAA systems by assessing DAA performance in a NAS-wide context. ACES analyses were conducted to determine the impact of varying elements of UAS pilot performance and uncertainty mitigations on DAA system performance. Simulations were conducted with recorded cooperative and non-cooperative VFR (Visual Flight Rules) traffic to accurately model UAS encounters with other NAS traffic (ATC (Air Traffic Control) being responsible for separation with other IFR (Instrument Flight Rules) aircraft) and with roughly 25, 000 simulated UAS operations The number of Loss of Well Clear (LoWC) events were recorded across the range of independent variables: pilot response time, horizontal LoWC prediction buffer and horizontal LoWC resolution buffer. The number of LoWC events was compared to the unmitigated case (without the benefit of a DAA system) to determine the resultant risk-ratio for each of 8 simulation conditions. The parameter trades presented by the resultant DAA system performance (risk ratio) will be used by SC 228 to inform decisions about future requirements development and validation efforts.

Detect-and-Avoid↗

UAS Integration in the NAS Project: Fast-Time Simulation Studies

NASA is working on the project for Unmanned Aircraft System (UAS) integration into the National Airspace System (NAS) and helping the RTCA's Special Committee 228 (RTCA SC-228) to develop the minimum operational performance standards (MOPS) for detect-and avoid (DAA) systems. The Ames' Separation Assurance-Sense and Avoid Interoperability (SSI) team for the project is supporting this effort through fast-time simulation studies using the Airspace Concept Evaluation System (ACES) simulation platform. This presentation introduces the Ames SSI team's tasks and shows some results from accomplished fast-time simulation studies. It is a part of overall presentations for NASA's efforts for the UAS integration into the NAS project.

fast time simulation↗

Airspace Safety Threshold Study: NAS-Wide Encounter Rate Evaluation Using Historical Radar Data and ACES

Realization of the expected proliferation of Unmanned Aircraft System (UAS) operations in the National Airspace System (NAS) depends on the development and validation of performance standards for UAS Detect and Avoid (DAA) Systems. The RTCA Special Committee 228 (SC-228) is charged with leading the development of draft Minimum Operational Performance Standards (MOPS) for UAS DAA Systems. NASA, as a participating member of RTCA SC-228 is committed to supporting the development and validation of draft requirements as well as the safety substantiation and end-to-end assessment of DAA system performance. With regard to the safety aspect being studied by the SC-228 DAA Safety sub-group, NASA has conducted a study using the ACES (Airspace Concept Evaluation System) simulation capability to determine: 1) the rate at which IFR aircraft encounter other IFR and VFR aircraft, and 2) the rate at which UAS aircraft encounter VFR aircraft as well as the corresponding encounter geometries. Five different separation thresholds were used (two for encounter and one each for well-clear, near mid-air collision, and closest point of approach). The results will be used by the SC-228 DAA Safety sub-group to inform decisions about the safety aspect of UAS DAA systems and future requirements development and validation efforts.

encounter geometry↗

Airspace Safety Threshold Study: Status Update to SC-228 DAA Safety Sub-Group

Realization of the expected proliferation of Unmanned Aircraft System (UAS) operations in the National Airspace System (NAS) depends on the development and validation of performance standards for UAS Detect and Avoid (DAA) Systems. The RTCA Special Committee 228 is charged with leading the development of draft Minimum Operational Performance Standards (MOPS) for UAS DAA Systems. NASA, as a participating member of RTCA SC-228, is committed to supporting the development and validation of draft requirements as well as the safety substantiation and end-to-end assessment of DAA system performance. A recent study conducted using NASA's ACES (Airspace Concept Evaluation System) simulation capability begins to address questions surrounding the development of draft MOPS for DAA systems. ACES analyses were conducted to determine: 1) the rate at which IFR aircraft encounter other IFR and VFR aircraft, and 2) the rate at which UAS aircraft encounter VFR aircraft. Five different separation thresholds were used (two for encounter and one each for well-clear, near mid-air collision, and closest point of approach). The results will be used by SC228 to inform decisions about the safety aspect of UAS DAA systems and future requirements development and validation efforts.

Risk ratio↗

Polar Coding For Forward Error Correction In Space Communications With LDPC Comparisons

With the surging development of optical telecommunicationsfor space applications, the importance of errorcorrection has become more apparent than ever. Specifically,the exploration of forward error correction code (FEC) methodologieswill be instrumental in developing the standards foroptical communications in space. Despite the widespread useof low-density parity-check (LDPC) codes, alternate FEC codessuch as polar codes have shown immense promise in assistingspace communications error correction with their ability tobypass the error floors that plague LDPC codes. Extremelypromising techniques including cyclic redundancy checks (CRC),successive cancellation (SC), and successive cancellation lists(SCL) that assist polar coding in achieving the Shannon limitin a timely manner are evaluated. MATLAB simulations areconducted with AWGN and burst noise to test each technique'sability to handle noise typically encountered in space and eachtechnique's ability to correct unexpected errors. Results ofsimulations for different rates and message lengths are alsoreported to determine each technique's ability to handle largedata volumes and fix errors. Similar simulations are conductedfor LDPC codes with additional tests for convolutional and nointerleavers. Finally, a discussion regarding the future ability ofpolar codes to satisfy current missions in the place of, or inconjunction with, LDPC codes along with the merits of eachFEC technique's ability to process data efficiently and handledata while maintaining adequate performance will be provided.Preliminary recommendations will be made for each technique'seffectiveness for GEO related missions along with discussionsregarding each technique's ability to fit within the CCSDS standards for optical communications.

Polar Coding↗

Evaluating a Regional Climate Model Simulation of Greenland Ice Sheet Snow and Firn Density for Improved Surface Mass Balance Estimates

Modeling vertical profiles of snow and firn density near the surface of the Greenland ice sheet (GrIS) is key to estimating GrIS mass balance, and by extension, global sea level change. To understand sources of error in simulated GrIS density, we compare GrIS density profiles from a leading regional climate model with coincident in situ measurements. We identify key contributors to model density and mass balance biases, including underestimated simulated fresh snow density (which leads to underestimation of density in the top 1 m of snow by ~10%). In areas undergoing frequent melting, positive density biases (of 7% in the top 1 m, and 10% between 1 and 10 m) are likely associated with errors in representing meltwater production, retention and refreezing. The results highlight the importance of accurately capturing fresh snow density and meltwater processes in models used to estimate GrIS mass balance change.

P M Alexander↗

Improving Brightness Temperature Measurements near Coastal Areas for SMAP

The Soil Moisture Active Passive (SMAP) mission is designed to acquire L-band radiometer measurements for the estimation of soil moisture with 0.04 m3/m3 volumetric accuracy in the top 5 cm for vegetation with water content of less than 5 kg/m2. In regions near the coast or near inland bodies of water, the signal measured by the SMAP radiometer contains emissions from land and water, resulting in errors in the soil moisture estimation. In this paper, the effort to extract the brightness temperature (TB) according to the land fraction or water fraction (depending on the center of the footprint location) from the affected SMAP measurements was addressed. A single pixel correction algorithm was applied and its performance was evaluated over simulated data. A data-driven approach for the estimation of land and water TB for data correction was developed. The correction algorithm was then applied to real data and its performance was assessed over the SMAP soil moisture retrievals. We showed that the single pixel algorithm is an effective and computationally efficient algorithm for removing land or water TB contamination from the SMAP data.

Julian Chaubell↗

A Study of the Degradation of Electronic Speed Controllers for Brushless DC Motors

Brushless DC motors are frequently used in electric aircraft and other direct drive applications. As these motors are notactually direct current machines but synchronous alternating current machines; they are electronically commutated by a power inverter. The power inverter for brushless DC motors typically used in small scale UAVs is a semiconductor base delectronic commutator that is external to the motor and is referred to as an electronic speed control (ESC). This paper examines the performance changes of a UAV electric propulsion system resulting from ESC degradation. ESC performance is evaluated in simulation and on a new developed test bed featuring propulsion components from a reference UAV. An increase in the rise fall times of the switched voltages is expected to cause timing issues at high motor speeds. This study paves the way for further development of diagnostic and prognostic methods for inverter circuits which are part of the overall electric UAV system.

Gorospe, George E., Jr.↗

Impact of Advanced Synoptics and Simplified Checklists During Aircraft Systems Failures

Abstract—Natural human capacities are becoming increasingly mismatched to the enormous data volumes, processing capabilities, and decision speeds demanded in today’s aviation environment. Increasingly Autonomous Systems (IAS) are uniquely suited to solve this problem. NASA is conducting research and development of IAS - hardware and software systems, utilizing machine learning algorithms, seamlessly integrated with humans whereby task performance of the combined system is significantly greater than the individual components. IAS offer the potential for significantly improved levels of performance and safety that are superior to either human or automation alone. A human-in-the-loop test was conducted in NASA Langley’s Integration Flight Deck B-737-800 simulator to evaluate advanced synoptic pages with simplified interactive electronic checklists as an IAS for routine air carrier flight operations and in response to aircraft system failures. Twelve U.S. airline crews flew various normal and non-normal procedures and their actions and performance were recorded in response to failures. These data are fundamental to and critical for the design and development of future increasingly autonomous systems that can better support the human in the cockpit. Synoptic pages and electronic checklists significantly improved pilot responses to non-normal scenarios, but implementation of these aids and other intelligent assistants have barriers to implementation (e.g., certification cost) that must overcome.

Etherington, Timothy J.↗

Management by Trajectory: Improving Predictability for Airspace Operations

In the present-day National Airspace System, the air traffic management system attempts to predict the trajectory for each flight based on the flight plan and scheduled or controlled departure time. However, gaps in trajectory data and models, coupled with tactical control actions that are not communicated to automation systems or other stakeholders, lead to trajectory predictions that are less accurate than they could be. This affects traffic flow management performance. Management by Trajectory (MBT) is a NASA concept for air traffic management in which every flight operates in accordance with a 4D trajectory that is negotiated between the airspace user and the FAA to account for the airspace user’s goals while complying with NAS constraints. The primary benefit of MBT is an improvement in system performance due to increased trajectory predictability and stability, which result from managing traffic in all four dimensions (2D route, vertical, and time), ensuring that changes to the flight’s trajectory are incorporated into the assigned trajectory, and utilizing improved time or arrival control standards. Importantly, the performance improvements support increasing efficiency without increasing collision risk. This paper provides an overview of MBT and describes fast-time simulation results evaluating the safety, performance, and efficiency effects of MBT.

Fernandes, Alicia B.↗

Progressive Damage and Failure Analysis of Bonded Composite Joints at High Energy Dynamic Impacts

Both wing and fuselage structures utilize bonded composite joints for structural efficiency in modern commercial and military aircraft. To ensure compliance with certification requirements mechanical fasteners are typically used as a failsafe mechanism for appropriate strength in the event of complete stiffener disbond. However, the use of fasteners decreases the structural efficiency of the structure by adding weight. This establishes the requirement to better exploit the efficiency of bonded structures and fully understand the failure behavior of adhesively bonded composite structures, particularly when subjected to elevated loading rates due to high energy dynamic impacts (HEDI). For this reason, the NASA Advanced Composite Consortium (ACC) HEDI team developed an experimentation and numerical modeling program for high rate loading of composite joints. In the present work, the response of adhesively bonded composite joints subjected to elevated loading rates is studied numerically and validated against experimental results. Due to dynamic considerations of experiments, the idea of wedge insert was extended to use with Split Hopkinson Pressure Bar (SHPB) testing techniques. Mode-I and Mode-II test configurations were simulated to evaluate the capability of two continuum damage material (CDM) models in LS-DYNA, namely MAT162 and MAT261. Three different levels of fidelity were considered to investigate the level of detail required to numerically predict the failure behavior and the results from high fidelity analysis are presented.

MAT261↗

Fire Front Detection and Tracking for Autonomous sUAS in STEReO

The Scalable Traffic Management Emergency Response Operations (STEReO) project aims to incorporate unmanned aerial systems (UAS) into wildfire incident response to safely quicken response times, improve operator awareness, and scale-up aircraft operations.Autonomous UAS can be used to relieve human operators of dull, dirty, and dangerous tasks such as checking for re-ignitions and geo-locating fires. To geo-locate fires, the UAS must be able to detect whether a fire is present and also have the necessary information to stamp a location. Furthermore, the UAS should be able to track the fire front to determine the extent of the fire. This study presents a fire front detection and tracking methodology for an autonomous small UAS (sUAS). The methodology is evaluated in simulation.

Autonomous UAV,Wildfire,Detection,Tracking↗

Impacts of aerosol size-dependent below-cloud scavenging on tropospheric aerosol in the NASA GEOS model

Wet deposition is the major sink for a suite of tropospheric aerosols, and thus largely affects the global distribution and lifetime of aerosols as well as the formation of clouds in the atmosphere. In this study, we implement the aerosol size-dependent below-cloud scavenging (BCS; washout) parameterization of Croft et al. (Atmos. Chem. Phys., 2009; hereafter referred to as C09) in the GOCART bulk aerosol scheme coupled with the NASA Goddard Earth Observing System (GEOS) model, and evaluate the simulated tropospheric aerosols against surface, airborne, and satellite observations. The current below-cloud scavenging in GOCART employs a first-order removal function with a constant scavenging coefficient that is independent of aerosol sizes and precipitation fluxes. The C09 BCS parameterization instead calculates aerosol below-cloud scavenging coefficients based on a size-dependent collision efficiency between aerosol particles and raindrops (or snow crystals). A look-up table of compiled collision efficiencies provides scavenging coefficients for sixty aerosol sizes and nine rain flux rates. We determine instantaneous coefficients according to the C09 BCS look-up table, precipitation fluxes, and a log-normal size distribution of aerosols. The implemented BCS parameterization tends to result in a large diversity of scavenging coefficient values with higher magnitudes, leading to more efficient scavenging. The model-simulated global mean tropospheric Pb-210 aerosol lifetime decreases from 7.4 days to 5.8 days. The separate consideration of rain and snow conditions in the scavenging coefficient lookup table leads to a bi-mode distribution of scavenging coefficients. These changes also cause increased mass fractions of smaller aerosols compared to the current simulation. We examine the impacts of the C09 BCS parameterization on the simulated aerosol vertical profiles, tropospheric lifetimes, and deposition fluxes through comparisons with NASA aircraft measurements (ATom), surface observations of aerosol concentrations (IMPROVE) and wet deposition fluxes (NADP and APQMP), and MODIS aerosol optical depth (AOD) retrievals.

Aerosols↗

Bench top interferometric test bed for LISA

Adaptive optics systems with Shack-Hartmann wavefront sensors require reconstruction of the atmospheric phase error from slope measurements, with every sensor in the array being used in the computation of each actuator command. This fully populated reconstruction matrix can result in a significant computational burden for adaptive optics systems with large numbers of actuators. A method for generating sparse wavefront reconstruction matrices for adaptive optics is proposed. The method exploits the relevance of nearby slope measurements for control of an individual actuator, and relies upon the limited extent of the influence function for a zonal deformable mirror. Relying only on nearby sensor information can significantly reduce the calculation time for wavefront reconstruction. In addition, a hierarchic controller is proposed to recover some of the global wavefront information. The performance of these sparse wavefront reconstruction matrices was evaluated in simulation, and tested on the Palomar Adaptive Optics System. This paper will present some initial results from the simulations and experiments.

LISA↗

Assessment of NO2 Observations During DISCOVER-AQ and KORUS-AQ Field Campaigns

NASA’s Deriving Information on Surface Conditions from Column and Vertically Resolved Observations Relevant to Air Quality (DISCOVER-AQ, conducted in 2011–2014) campaign in the United States and the joint NASA and National Institute of Environmental Research (NIER) Korea–United States Air Quality Study (KORUS-AQ, conducted in 2016) in South Korea were two field study programs that provided comprehensive, integrated data sets of airborne and surface observations of atmospheric constituents, including nitrogen dioxide (NO2), with the goal of improving the interpretation of spaceborne remote sensing data. Various types of NO2 measurements were made, including in situ concentrations and column amounts of NO2 using ground- and aircraft-based instruments, while NO2 column amounts were being derived from the Ozone Monitoring Instrument (OMI) on the Aura satellite. This study takes advantage of these unique datasets by first evaluating in situ data taken from two different instruments on the same aircraft platform, comparing coincidently sampled profile-integrated columns from aircraft spirals with remotely sensed column observations from ground-based Pandora spectrometers, intercomparing column observations from the ground (Pandora), aircraft (in situ vertical spirals), and space (OMI), and evaluating NO2 simulations from coarse Global Modeling Initiative (GMI) and high-resolution regional models. We then use these data to interpret observed discrepancies due to differences in sampling and deficiencies in the data reduction process. Finally, we assess satellite retrieval sensitivity to observed and modeled a priori NO2 profiles. Contemporaneous measurements from two aircraft instruments that likely sample similar air masses generally agree very well but are also found to differ in integrated columns by up to 31.9 %. These show even larger differences with Pandora, reaching up to 53.9 %, potentially due to a combination of strong gradients in NO2 fields that could be missed by aircraft spirals and errors in the Pandora retrievals. OMI NO2 values are about a actor of 2 lower in these highly polluted environments due in part to inaccurate retrieval assumptions (e.g., a priori pro-files) but mostly to OMI’s large footprint (>312 km2).

Nitrogen dioxide↗