Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation methodology”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

Multi-Model Ensemble Wake Vortex Prediction

Several multi-model ensemble methods are investigated for predicting wake vortex transport and decay. This study is a joint effort between National Aeronautics and Space Administration and Deutsches Zentrum fuer Luft- und Raumfahrt to develop a multi-model ensemble capability using their wake models. An overview of different multi-model ensemble methods and their feasibility for wake applications is presented. The methods include Reliability Ensemble Averaging, Bayesian Model Averaging, and Monte Carlo Simulations. The methodologies are evaluated using data from wake vortex field experiments.

Koerner, Stephan↗

Titan Science Return Quantification

Each proposal for a NASA mission concept includes a Science Traceability Matrix (STM), intended to show that what is being proposed would contribute to satisfying one or more of the agency's top-level science goals. But the information traditionally provided cannot be used directly to quantitatively compare anticipated science return. We added numerical elements to NASA's STM and developed a software tool to process the data. We then applied this methodology to evaluate a group of competing concepts for a proposed mission to Saturn's moon, Titan.

Saturn↗

Experimental Evaluation of the Scale Model Method to Simulate Lunar Vehicle Dynamics

As compared to driving on Earth, the presence of lower gravity and uneven terrain on planetary bodies makes high speed driving difficult. In order to maintain ground contact and control vehicles need to be designed with special attention to dynamic response. The challenge of maintaining control on the Moon was evident during high speed operations of the Lunar Roving Vehicle (LRV) on Apollo 16, as at one point all four tires were off the ground; this event has been referred to as the Lunar Grand Prix. Ultimately, computer simulation should be used to examine these phenomena during the vehicle design process; however, experimental techniques are required for the validation and elucidation of key issues. The objectives of this study were to evaluate the methodology for developing a scale model of a lunar vehicle using similitude relationships and to test how vehicle configuration, six or eight wheel pods, and local tire compliance, soft or stiff, affect the vehicles dynamic performance. A wheel pod consists of a drive and steering transmission and wheel. The Lunar Electric Rover (LER), a human driven vehicle with a pressurized cabin, was selected as an example for which a scale model was built. The scaled vehicle was driven over an obstacle and the dynamic response was observed and then scaled to represent the full-size vehicle in lunar gravity. Loss of ground contact, in terms of vehicle travel distance with tires off the ground, was examined. As expected, local tire compliance allowed ground contact to be maintained over a greater distance. However, switching from a six-tire configuration to an eight-tire configuration with reduced suspension stiffness had a negative effect on ground contact. It is hypothesized that this was due to the increased number or frequency of impacts. The development and testing of this scale model provided practical lessons for future low-gravity vehicle development.

Moon↗

Multimodel Ensemble Methods for Prediction of Wake-Vortex Transport and Decay Originating NASA

Several multimodel ensemble methods are selected and further developed to improve the deterministic and probabilistic prediction skills of individual wake-vortex transport and decay models. The different multimodel ensemble methods are introduced, and their suitability for wake applications is demonstrated. The selected methods include direct ensemble averaging, Bayesian model averaging, and Monte Carlo simulation. The different methodologies are evaluated employing data from wake-vortex field measurement campaigns conducted in the United States and Germany.

Korner, Stephan↗

NASA Additive Manufacturing Initiatives for Deep Space Human Exploration

Additive Manufacturing (AM) is being infused into aerospace industries at an accelerated pace. Reasons for this rapid adoption include: (1) Innovation Capability e.g. design features such as topology optimization, integrated fluid passages, and mesh structures; (2) Rapid Development and Optimization - ability to quickly iterate the design, development, and test cycle; (3) Affordability - reductions in part counts, cost, and schedule. NASA's Marshall Space Flight Center (MSFC) has taken a leadership role in application of AM technologies for deep space human exploration, leading the Agency's In Space Manufacturing (ISM) initiative and the application of AM for a broad variety of space propulsion systems. MSFC has championed the development of ISM capabilities since our first reduced-gravity aircraft experiment flew in 1999. Partnering with Made In Space, MSFC placed the first 3D Printer on ISS in 2014 and the second generation printer, the Additive Manufacturing Facility, in 2016. The next ISS technology demonstration will be the Refabricator, a recycler/basic printer scheduled to launch in late Fall 2018. Ground-based development is progressing in common use materials, metals 3D printing, printed electronics, and the new cornerstone of ISM, the FabLab. The latest developments in each area will be described. An overview of NASA's In Space Robotic Manufacturing and Assembly (IRMA) ground-based risk reduction projects will also be presented. MSFC has aggressively incorporated AM capabilities for design and development of space propulsion components. The capabilities have been rapidly matured and extensively exercised to produce and hot-fire test the Additive Manufacturing Demonstrator Engine, an in-space class prototype engine. This experience base has been extended to support Aerojet Rocketdyne in the application of AM to the RS-25, the Space Launch System Core Stage engine, and to small propulsion systems and thrusters for small satellites and cubesats. The latest developments will be described. In responding to a request from NASA's Commercial Crew Program for a consistent methodology for evaluation of AM processes and parts, MSFC began development of a draft standard for AM space flight hardware in late 2014. The draft was broadly disseminated for comments in mid-2015, and subsequently revised into two documents, a standard and a specification for AM space flight hardware, which were formally released by MSFC in October 2017. An overview of the key elements of these documents will be presented.

Clinton, Raymond↗

Fire Front Detection and Tracking for Autonomous sUAS in STEReO

The Scalable Traffic Management Emergency Response Operations (STEReO) project aims to incorporate unmanned aerial systems (UAS) into wildfire incident response to safely quicken response times, improve operator awareness, and scale-up aircraft operations.Autonomous UAS can be used to relieve human operators of dull, dirty, and dangerous tasks such as checking for re-ignitions and geo-locating fires. To geo-locate fires, the UAS must be able to detect whether a fire is present and also have the necessary information to stamp a location. Furthermore, the UAS should be able to track the fire front to determine the extent of the fire. This study presents a fire front detection and tracking methodology for an autonomous small UAS (sUAS). The methodology is evaluated in simulation.

Autonomous UAV,Wildfire,Detection,Tracking↗

Regional Tropical Aboveground Biomass Mapping with L-Band Repeat-Pass Interferometric Radar, Sparse Lidar, and Multiscale Superpixels

We introduce a multiscale superpixel approach that leverages repeat-pass interferometric coherence and sparse AGB estimates from a simulated spaceborne lidar in order to extend the NISAR mission’s applicable range of aboveground biomass (AGB) in tropical forests. Airborne and spaceborne L-band radar and full-waveform airborne lidar data are used to simulate the NISAR and GEDI mission, respectively. In addition to UAVSAR data, we use spaceborneALOS-2/PALSAR-2 imagery with 14-day temporal baseline, which is comparable to NISAR’s 12-daybaseline. Our reference AGB maps are derived from the airborne LVIS data during the AfriSAR campaign for three sites (Mondah, Ogooue, and Lope). Each tropical site has mean AGB of at least 125 Mg/ha in addition to areas with AGB exceeding 700 Mg/ha. Spatially sampling from these LVIS-derived AGB reference maps, we approximate GEDI AGB estimates. To evaluate our methodology, we perform several different analyses. First, we partition each study site into low(≤100 Mg/ha) and high (>100 Mg/ha) AGB areas, in conformity with the NISAR mission requirement to provide AGB estimates for forests between 0 and 100 Mg/ha with a RMSE below 20 Mg/ha. In the low AGB areas, this RMSE requirement is satisfied in Lope and Mondah and it fell short of the requirement in Ogooue by less 3 Mg/ha with UAVSAR and 6 Mg/ha with PALSAR-2. We note that our maps have finer spatial resolution (50 m) than NISAR requires (1 hectare). In the high AGB areas, the normalized RMSE increases to 51% (i.e.,<90 Mg/ha), but with negligible bias for all three sites. Second, we train a single model to estimate AGB across both high and low AGB regimes simultaneously and obtain a normalized RMSE that is<60% (or<100 Mg/ha). Lastly, we show the use of both (a) multiscale superpixels and (b) interferometric coherence significantly improves the accuracy of the AGB estimates. The InSAR coherence improved the RMSE by approximately 8% at Mondah with both sensors, lowering the RMSE from 59 Mg/ha to 47.4 Mg/h with UAVSAR and from 57.1 Mg/ha to 46 Mg/ha. This work illustrates one of the numerous synergistic relationships between the spaceborne lidars, such as GEDI, with L-band SAR, such as PALSAR-2 and NISAR, in order to produce robust regional AGB in high biomass tropical regions.

NISAR↗

Comparison of Prediction Modeling Methodologies for Aeroacoustic Characterization of Hovering sUAS Rotors

This work compared artificial neural network and multivariate orthogonal function modeling methodologies for the prediction and characterization of isolated hovering sUAS rotor aerodynamics and aeroacoustics. Design of Experiments was used to create input feature spaces over 9 input features: the number of rotor blades, rotor size, rotor speed, the amount of blade twist, blade taper ratio, tip chord length, collective pitch, airfoil camber, and airfoil thickness. CAMRAD~II and AARON were executed at the points defined by the input feature space to predict aerodynamic and aeroacoustic quantities. These predicted aerodynamic and aeroacoustic data were then used to generate artificial neural networks and polynomial response surface models. The two prediction model methodologies were evaluated over test data previously unseen by the models, which showed good prediction capabilities for both model types, with slightly lower prediction error for the artificial neural networks. A characterization study was performed, which showed that input features correspondent to the spanwise sectional blade lift and drag were the most significant factors to the aerodynamic thrust and power, respectively. It was also shown that the aeroacoustic quantities were highly dependent on variations in rotor speed and size, which affect the Doppler factor for tonal noise and the spanwise Reynolds number for broadband noise.

Christopher S Thurman↗

An Investigation Into Transecting Satellites in Future Space Traffic Management Scenarios

The number of satellites expected to populate the near-Earth space environment is set to dramatically increase in the coming decade as new large constellations are approved and deployed. Current strategies for placing new batches of these satellites on orbit often involve launching into an initial orbit, and then performing apogee raising maneuvers to reach a target altitude. Similarly, end-of-life planning for these constellation satellites can consist of de-orbit burns that lower perigee to permit disposal via re-entry. Both the raising and de-orbiting maneuvers can result in the individual satellites traveling in high-eccentricity orbits that have the potential to transect other spacecraft trajectories. While individual large constellations may be able to coexist in separate altitude and inclination bands, having thousands of satellites moving between these bands as new satellites are replaced and old ones are removed could pose additional collision risks. Similar concerns have been raised regarding the impact that large numbers of university-class CubeSats might have in terms of their overall collision risk, especially as these satellites typically do not have propulsion systems for active maneuvering. To assess the impact that transecting satellites might have to future space traffic management strategies, this study explored a variety of future realistic scenarios using a high-fidelity simulation tool. The model can simulate the orbit of tens of thousands of resident space objects (RSOs) simultaneously, to include active satellites, debris, rocket bodies, or even future hypothetical scenarios, using a realistic force model that incorporates non-spherical gravity, atmospheric drag, solar radiation pressure, and more. As the model is run forward in time, various statistics and meta-data are gathered on any predicted conjunction event, providing insight into the nature and frequency of potential collisions, e.g., what size are the two satellites, who operates the satellites, are they active or passive objects, etc. Additional customization is available in terms of how probability of collision is computed, and how the probability ellipsoids and screening volumes are determined. The simulation tool also allows for rule-based maneuvers for active satellites, e.g, given an advance conjunction “warning,” one or both of the satellites can maneuver to a safe distance. A wide range of maneuvers can be implemented using impulsive or low-thrust methods, and the latencies can also be varied, e.g., using maneuver lead times of 48 hours, 24 hours, or 12 hours. Validation of the simulation results is performed against current and historical datasets available, to include comparisons to prior conjunction data messages (CDMs), object properties (mass, volume, etc.), and two-line-element records from both public and internal sources. Using the simulation environment, an assessment on the general risks that transecting satellites might pose for hypothetical future space object environments will be presented. This will involve the simulation of approximately 50,000 new large constellation satellites, in addition to the existing catalog of approximately 20,000 known resident space objects (RSOs), over propagation periods of one month to one year. A description of the simulation methodologies, scenarios evaluated, and validation methods will also be presented, as well as a preliminary assessment of the effectiveness of several candidate maneuver strategies that have the potential to reduce collision risk between active satellites.

Brian Gunter↗

Using Videos Derived from Simulations to Support the Analysis of Spatial Awareness in Synthetic Vision Displays

The evaluation of human-centered systems can be performed using a variety of different methodologies. This paper describes a human-centered systems evaluation methodology where participants watch 5-second non-interactive videos of a system in operation before supplying judgments and subjective measures based on the information conveyed in the videos. This methodology was used to evaluate the ability of different textures and fields of view to convey spatial awareness in synthetic vision systems (SVS) displays. It produced significant results for both judgment based and subjective measures. This method is compared to other methods commonly used to evaluate SVS displays based on cost, the amount of experimental time required, experimental flexibility, and the type of data provided.

Boton, Matthew L.↗

Financial options methodology for analyzing investments in new technology

The evaluation of investments in longer term research and development in emerging technologies, because of the nature of such subjects, must address inherent uncertainties. Most notably, future cash flow forecasts include substantial uncertainties. Conventional present value methodology, when applied to emerging technologies severely penalizes cash flow forecasts, and strategic investment opportunities are at risk of being neglected. Use of options evaluation methodology adapted from the financial arena has been introduced as having applicability in such technology evaluations. Indeed, characteristics of superconducting magnetic energy storage technology suggest that it is a candidate for the use of options methodology when investment decisions are being contemplated.

Wenning, B. D.↗

An evaluation of the directed flow graph methodology

The applicability of the Directed Graph Methodology (DGM) to the design and analysis of special purpose image and signal processing hardware was evaluated. A special purpose image processing system was designed and described using DGM. The design, suitable for very large scale integration (VLSI) implements a region labeling technique. Two computer chips were designed, both using metal-nitride-oxide-silicon (MNOS) technology, as well as a functional system utilizing those chips to perform real time region labeling. The system is described in terms of DGM primitives. As it is currently implemented, DGM is inappropriate for describing synchronous, tightly coupled, special purpose systems. The nature of the DGM formalism lends itself more readily to modeling networks of general purpose processors.

Snyder, W. E.↗

Applicability and evaluation of an implicit self-starting unconditionally stable methodology for the dynamics of structures

The applicability and evaluation of a new self-starting, unconditionally stable, implicit methodology of computation for the dynamics of structures is described. The methodology offers different perspectives and architecture for structural dynamics compared with the traditional (widely advocated and commonly used) time integration methods. It is based on velocity representations and architecture and uses finite elements as the principal analysis tool for structural dynamic modeling/analysis. In particular, the dynamics of beam-type flexural models are considered, and comparative results validate and support the proposed use of the self-starting methodology of computation for the dynamics of linear/nonlinear structures. The overall effectiveness and elegance strongly support its use in most existing commercial codes.

Tamma, Kumar K.↗

COTS Ceramic Chip Capacitors: An Evaluation of the Parts and Assurance Methodologies

Commercial-Off-The-Shelf (COTS) multilayer ceramic chip capacitors (MLCCs) are continually evolving to reduce physical size and increase volumetric efficiency. Designers of high reliability aerospace and military systems are attracted to these attributes of COTS MLCCs and would like to take advantage of them while maintaining the high standards for long-term reliable operation they are accustomed io when selecting military qualified established reliability (MIL-ER) MLCCs. However, MIL-ER MLCCs are not available in the full range of small chip sizes with high capacitance as found in today's COTS MLCCs. The objectives for this evaluation were to assess the long-term performance of small case size COTS MLCCs and to identify effective, lower-cost product assurance methodologies. Fifteen (15) lots of COTS X7R dielectric MLCCs from four (4) different manufacturers and two (2) MIL-ER BX dielectric MLCCs from two (2) of the same manufacturers were evaluated. Both 0805 and 0402 chip sizes were included. Several voltage ratings were tested ranging from a high of 50 volts to a low of 6.3 volts. The evaluation consisted of a comprehensive screening and qualification test program based upon MIL-PRF-55681 (i.e., voltage conditioning, thermal shock, moisture resistance, 2000-hour life test, etc.). In addition, several lot characterization tests were performed including Destructive Physical Analysis (DPA), Highly Accelerated Life Test (HALT) and Dielectric Voltage Breakdown Strength. The data analysis included a comparison of the 2000-hour life test results (used as a metric for long-term performance) relative to the screening and characterization test results. Results of this analysis indicate that the long-term life performance of COTS MLCCs is variable -- some lots perform well, some lots perform poorly. DPA and HALT were found to be promising lot characterization tests to identify substandard COTS MLCC lots prior to conducting more expensive screening and qualification tests. The results indicate that lot- specific screening and qualification are still recommended for high reliability applications. One significant and concerning observation is that MIL- type voltage conditioning (100 hours at twice rated voltage, 125 C) was not an effective screen in removing infant mortality parts for the particular lots of COTS MLCCs evaluated.

Brusse, Jay A.↗

Infrared algorithm development for ocean observations

Efforts continue under this contract to develop algorithms for the computation of sea surface temperature (SST) from MODIS infrared retrievals. This effort includes radiative transfer modeling, comparison of in situ and satellite observations, development and evaluation of processing and networking methodologies for algorithm computation and data accession, evaluation of surface validation approaches for IR radiances, and participation in MODIS (project) related activities. Efforts in this contract period have focused on radiative transfer modeling, evaluation of atmospheric correction methodologies, involvement in field studies, production and evaluation of new computer networking strategies, and objective analysis approaches.

Brown, Otis B.↗

Knowledge-Based Aircraft Automation: Managers Guide on the use of Artificial Intelligence for Aircraft Automation and Verification and Validation Approach for a Neural-Based Flight Controller

The ultimate goal of this report was to integrate the powerful tools of artificial intelligence into the traditional process of software development. To maintain the US aerospace competitive advantage, traditional aerospace and software engineers need to more easily incorporate the technology of artificial intelligence into the advanced aerospace systems being designed today. The future goal was to transition artificial intelligence from an emerging technology to a standard technology that is considered early in the life cycle process to develop state-of-the-art aircraft automation systems. This report addressed the future goal in two ways. First, it provided a matrix that identified typical aircraft automation applications conducive to various artificial intelligence methods. The purpose of this matrix was to provide top-level guidance to managers contemplating the possible use of artificial intelligence in the development of aircraft automation. Second, the report provided a methodology to formally evaluate neural networks as part of the traditional process of software development. The matrix was developed by organizing the discipline of artificial intelligence into the following six methods: logical, object representation-based, distributed, uncertainty management, temporal and neurocomputing. Next, a study of existing aircraft automation applications that have been conducive to artificial intelligence implementation resulted in the following five categories: pilot-vehicle interface, system status and diagnosis, situation assessment, automatic flight planning, and aircraft flight control. The resulting matrix provided management guidance to understand artificial intelligence as it applied to aircraft automation. The approach taken to develop a methodology to formally evaluate neural networks as part of the software engineering life cycle was to start with the existing software quality assurance standards and to change these standards to include neural network development. The changes were to include evaluation tools that can be applied to neural networks at each phase of the software engineering life cycle. The result was a formal evaluation approach to increase the product quality of systems that use neural networks for their implementation.

Broderick, Ron↗