Results for “model credibility” — Page 9

NASA NTRS2017

Venus Global Reference Atmospheric Model Status and Planned Updates

The Venus Global Reference Atmospheric Model (Venus-GRAM) was originally developed in 2004 under funding from NASA's In Space Propulsion (ISP) Aerocapture Project to support mission studies at the planet. Many proposals, including NASA New Frontiers and Discovery, as well as other studies have used Venus-GRAM to design missions and assess system robustness. After Venus-GRAM's release in 2005, several missions to Venus have generated a wealth of additional atmospheric data, yet few model updates have been made to Venus-GRAM. This paper serves to address three areas: (1) to present the current status of Venus-GRAM, (2) to identify new sources of data and other upgrades that need to be incorporated to maintain Venus-GRAM credibility and (3) to identify additional Venus-GRAM options and features that could be included to increase its capability. This effort will de-pend on understanding the needs of the user community, obtaining new modeling data and establishing a dedicated funding source to support continual up-grades. This paper is intended to initiate discussion that can result in an upgraded and validated Venus-GRAM being available to future studies and NASA proposals.

Justh, H. L.↗

NASA NTRS2010

Application of Satellite Observations to Manage Natural Disasters in the Lake Victoria Basin

Lake Victoria, the second largest fresh water lake in the Eastern part of Africa is a vital natural resource for the economic well being and prosperity of over 30 million people located in riparian regions of Uganda, Kenya and Tanzania. It covers a large area of about 68,870 km2 and produces a GDP of about US $30 billion per year. The region is also very much prone to natural disasters such as severe floods during heavy precipitation periods in the Eastern part of Africa. In addition to floods, the precipitation also produces large infestations of mosquito larvae due to the standing water in many areas. This further causes multiple vector borne diseases such as Malaria, Rift Valley Fever and more. These problems are of serious concern and require active and aggressive surveillance and management to minimize the loss of human and animal lives and property damage. Satellite imagery and observations along with the in situ measurements provide a great tool to analyze and study this area and inform the policy makers to make calculated policy decisions which are more beneficial to the environment. Recently, NASA and USAID have joined forces with the Regional Center for Mapping of Resources for Development (RCMRD) located in Nairobi, Kenya to utilize multiple NASA sensors such as TRMM, SRTM and MODIS to develop flood potential maps for the Lake Victoria Basin. The idea is to generate a flood forecasts and "nowcasts" that can be sent to the disaster management organizations of Uganda, Kenya, and Tanzania. Post flood event satellite imagery is becoming a common tool to assess the areas inundated by flooding. However, this work is unique undertaking by utilizing land imaging and atmospheric satellites to build credible flood potential maps. At same time, we are also studying the potential occurrence and spread of Rift Valley Fever disease based on the short term climate records and precipitation data. These activities require multi-nation coordination and agreements and multiple operational agencies within each respective country. It also requires credible in situ data such as precipitation, river flow rates and lake levels to further validate the global and regional Hood models and algorithms. This also requires a considerable amount of training and capacity building for the RCMRD experts who will help us validate the model results and eventually transition it for operational use. In a final analysis, Disaster management and humanitarian aid organizations need accurate and timely information for making decisions regarding deployment of relief teams and emergency supplies during major floods. Flood maps based on the use of satellite data have proven extremely valuable to such organizations for identifying the location, extent, and severity of these events. However, despite extraordinary efforts on the part of remote sensing data providers to rapidly deliver such maps, there is typically a delay of several days or even weeks from the on-set of flooding until such maps are available to the disaster management community. This paper summarizes efforts at NASA to address this problem through development of an integrated and automated process of a) flood forecasting b) flood detection, c) satellite data acquisition, d) rapid Hood mapping and distribution, and e) validation of Hood forecasting and detection products.

Habib, Shahid↗

NASA NTRS2003

Rapid Prototyping of an Aircraft Model in an Object-Oriented Simulation

A team was created to participate in the Mars Scout Opportunity. Trade studies determined that an aircraft provided the best opportunity to complete the science objectives of the team. A high fidelity six degree of freedom flight simulation was required to provide credible evidence that the aircraft design fulfilled mission objectives and to support the aircraft design process by providing performance evaluations. The team created the simulation using the Langley Standard Real-Time Simulation in C++ (LaSRS++) application framework. A rapid prototyping approach was necessary because the team had only three months to both develop the aircraft simulation model and evaluate aircraft performance as the design and mission parameters matured. The design of LaSRS++ enabled rapid-prototyping in several ways. First, the framework allowed component models to be designed, implemented, unit-tested, and integrated quickly. Next, the framework provides a highly reusable infrastructure that allowed developers to maximize code reuse while concentrating on aircraft and mission specific features. Finally, the framework reduces risk by providing reusable components that allow developers to build a quality product with a compressed testing cycle that relies heavily on unit testing of new components.

Kenney, P. Sean↗

NASA NTRS2018

Validation of the Nasa Integrated Medical Model: a Space Flight Medical Risk Prediction Tool

The Human Research Program funded the development of the Integrated Medical Model (IMM) to quantify the medical component of overall mission risk. The IMM uses Monte Carlo simulation methodology, incorporating space flight and ground medical data, to estimate the probability of mission medical outcomes and resource utilization. To determine the credibility of IMM output, the IMM project team completed two validation studies that compared IMM predicted output to observed medical events from a selection of Shuttle Transportation System (STS) and International Space Station (ISS) missions. The validation study results showed that the IMM underpredicted the occurrence of ~10% of the modeled medical conditions for the STS missions and overpredicted ~20% of the modeled medical conditions for the ISS missions. These findings imply that the strength of IMM predictions to inform decisions depends on simulated mission specifications including length. This discrepancy could result from medical recording differences between ISS and STS that possibly influence observed incidence rates, IMM combining all "mission type" data as constant occurrence rate or fixed proportion across both mission types, misspecification of symptoms to conditions, and gaps in the literature informing the model. Some of these issues will be alleviated by updating the IMM source data through incorporation of the observed validation data.

medical equipment↗

NASA NTRS2018

Validation of the NASA Integrated Medical Model: a Space Flight Medical Risk Prediction Tool

The Human Research Program funded the development of the Integrated Medical Model (IMM) to quantify the medical component of overall mission risk. The IMM uses Monte Carlo simulation methodology, incorporating space flight and ground medical data, to estimate the probability of mission medical outcomes and resource utilization. To determine the credibility of IMM output, the IMM project team completed two validation studies that compared IMM predicted output to observed medical events from a selection of Shuttle Transportation System (STS) and International Space Station (ISS) missions. The validation study results showed that the IMM underpredicted the occurrence of ~10% of the modeled medical conditions for the STS missions and overpredicted ~20% of the modeled medical conditions for the ISS missions. These findings imply that the strength of IMM predictions to inform decisions depends on simulated mission specifications including length. This discrepancy could result from medical recording differences between ISS and STS that possibly influence observed incidence rates, IMM combining all "mission type" data as constant occurrence rate or fixed proportion across both mission types, misspecification of symptoms to conditions, and gaps in the literature informing the model. Some of these issues will be alleviated by updating the IMM source data through incorporation of the observed validation data.

risk assessment↗

NASA NTRS2012

The Race To Understand A Changing Planet

The Earth's climate is changing rapidly. In some respects, the rate of change is outpacing the predictions of only a few years ago. The challenge to Earth Science is to put forward credible projections of possible future climates so that the public and policy makers can make science-based decisions about energy development strategies. Models, observations and experiments all play strong roles in improving knowledge and increasing confidence in our predictions. The models have progressed from simple, coarse-resolution descriptions of atmospheric dynamics and physics only twenty years ago, to full-up Earth System models (ESMs) that include complete descriptions of the oceans and cryosphere. It has been convincingly argued that such complexity - the construction of realistic "toy" Earth's - is necessary to address the complex processes involved in climate change, including not only the physical atmosphere, oceans and cryosphere, but also the carbon cycle - both its natural and anthropogenic components - and the biosphere. Observations, particularly satellite observations, have more or less kept pace with the demands of the modelers, being able to observe progressively more and different facets of the Earth system, but the global satellite fleet is in need of an overhaul very soon. Lastly, field experiments and process studies confront the models with facts and allow us to develop more sophisticated and accurate satellite data algorithms. The challenges facing our relatively small Earth and planetary science communities are considerable and the stakes are significant. The stakeholders, now numbering 7 billion but soon to be 10 billion, will be relying on our results and capabilitie's to guide them into the future.

Sellers, Piers J.↗

NASA NTRS2017

Towards a New Food System Assessment: AgMIP Coordinated Global and Regional Assessments of Climate Change

Agricultural stakeholders need more credible information on which to base adaptation and mitigation policy decisions. In order to provide this, we must improve the rigor of agricultural modelling. Ensemble approaches can be used to address scale issues and integrated teams can overcome disciplinary silos. The AgMIP Coordinated Global and Regional Assessments of Climate Change and Food Security (CGRA) has the goal to link agricultural systems models using common protocols and scenarios to significantly improve understanding of climate effects on crops, livestock and livelihoods across multiple scales. The AgMIP CGRA assessment brings together experts in climate, crop, livestock, economics, and food security to develop Protocols to guide the process throughout the assessment. Scenarios are designed to consistently combine elements of intertwined storylines of future society including, socioeconomic development, greenhouse gas concentrations, and specific pathways of agricultural sector development. Through these approaches, AgMIP partners around the world are providing an evidence base for their stakeholders as they make decisions and investments.

Ensembles↗

NASA NTRSDate not supplied

Pretest Simulations of a Supersonic Mixing and Combustion Validation Experiment to Assess Sensitivities

The reliance on CFD simulations to develop, design, and optimize scramjet systems (or components) has become commonplace. This reliance inevitably hinges on the ability of the computational analyst to quantify the level of confidence in their computational results. Unfortunately, nearly all the measured data available for this assessment comes from antiquated experimental datasets, or from tests that focused on the extraction of scramjet system (or component) performance. The objective of a CFD validation experiment is to quantify the predictive accuracy of one or more of the CFD physics submodels, implying that other uncertainties related to replicating the facility flow environment (e.g., knowledge of boundary conditions) must be minimized to the extent possible. This inevitably places stringent requirements on the quality and quantity of measurements taken to accurately specify inflow, outflow, and surface conditions for the CFD simulations; in addition to the measurements taken for the validation of physics submodels. This places additional demands on the experimental process above and beyond those for test article performance assessment. A recent high speed code credibility workshop series sponsored by AFRL identified a gap in existing validation data for fundamental assessments of turbulent mixing and combustion CFD closure models at scramjet engine relevant conditions. To address this gap, engineers at AFRL have designed a coaxial jet flame configuration that will be tested at two facilities (Research Cell 19 at the Air Force Research Lab, and at Purdue University). The effort described here documents pretest simulations of this validation experiment with the goal of fleshing out the extent of the facility flowpath that must be included to adequately reproduce the facility test section flow environment. The findings indicate that the flow around the support structure for the fuel injection centerbody upstream of the facility nozzle generates disturbances that persist throughout the nozzle expansion process; corrupting the azimuthal symmetry that was desired in the fuel/air mixing region of the test section. Simulations without this support structure maintained a high degree of azimuthal symmetry up until the fuel injection plane. However, even in this scenario the azimuthal symmetry was not maintained once the centerbody boundary layer transitioned to a wake flow downstream of the fuel injection plane.

CFD↗

NASA NTRSDate not supplied

Pretest Simulations of a Supersonic Mixing and Combustion Validation Experiment to Assess Sensitivities

The reliance on CFD simulations to develop, design, and optimize scramjet systems (or components) has become commonplace. This reliance inevitably hinges on the ability of the computational analyst to quantify the level of confidence in their computational results. Unfortunately, nearly all the measured data available for this assessment comes from antiquated experimental datasets, or from tests that focused on the extraction of scramjet system (or component) performance. The objective of a CFD validation experiment is to quantify the predictive accuracy of one or more of the CFD physics submodels, implying that other uncertainties related to replicating the facility flow environment (e.g., knowledge of boundary conditions) must be minimized to the extent possible. This inevitably places stringent requirements on the quality and quantity of measurements taken to accurately specify inflow, outflow, and surface conditions for the CFD simulations; in addition to the measurements taken for the validation of physics submodels. This places additional demands on the experimental process above and beyond those for test article performance assessment. A recent high speed code credibility workshop series sponsored by AFRL identified a gap in existing validation data for fundamental assessments of turbulent mixing and combustion CFD closure models at scramjet engine relevant conditions. To address this gap, engineers at AFRL have designed a coaxial jet flame configuration that will be tested at two facilities (Research Cell 19 at the Air Force Research Lab, and at Purdue University). The effort described here documents pretest simulations of this validation experiment with the goal of fleshing out the extent of the facility flowpath that must be included to adequately reproduce the facility test section flow environment. The findings indicate that the flow around the support structure for the fuel injection centerbody upstream of the facility nozzle generates disturbances that persist throughout the nozzle expansion process; corrupting the azimuthal symmetry that was desired in the fuel/air mixing region of the test section. Simulations without this support structure maintained a high degree of azimuthal symmetry up until the fuel injection plane. However, even in this scenario the azimuthal symmetry was not maintained once the centerbody boundary layer transitioned to a wake flow downstream of the fuel injection plane.

CFD↗

NASA NTRS1972

Supplementary notes on sea surface temperature anomalies and model-generated meteorological histories

In seasonal computations, the Mintz-Arakawa two-level model is found to be sensitive to a minor alteration in the computational program. Effects of the program change on monthly mean sea level pressure fields are small in the first month, but large in the second and third months, although the meteorological histories generated by both the original and modified programs are equally credible. The inherited effects of a transient (one month) sea surface temperature (SST) anomaly on the computed monthly mean sea level pressure fields over a period of a season are about as large in absolute magnitude as those generated in the model by a persistent (seasonal) SST anomaly. The effects of a transient SST anomaly in the North Pacific Ocean on monthly and seasonal temperature and precipitation in the eastern United States may be large enough to produce a change of one or two class intervals in these predicted weather elements. The model-generated precipitation in the equatorial region is also found to be sensitive to the sea surface temperature field in the North Pacific.

Spar, J.↗

NASA NTRS1984

Why credible propeller noise measurements are possible in the acoustically untreated NASA Lewis 8 ft by 6 ft wind tunnel

An explanation is presented for the lack of acoustic reflections in noise studies of propfan models in the NASA-Lewis 8 x 6 ft wind tunnel, where trials were run at Mach numbers 0.5-0.85. The highly directional propeller noise, i.e., mainly in the plane of rotation, experiences a convective effect due to the high subsonic axial Mach number. Reflected sounds are carried downstream, out of range of the acoustic sensors in the tunnel. Furthermore, reflected noise is less audible, and therefore does not affect measurements near peak values. It is suggested that some data contamination may occur below Mach 0.6, and that measurements be performed on higher harmonics generated by low level reflected noise.

Dittmar, J. H.↗

NASA NTRS2003

Simulating the ARES Aircraft in the Mars Environment

NASA Langley proposed the Aerial Regional-scale Environmental Survey (ARES) of Mars science mission in response to the NASA Office of Space Science 2002 Mars Scout Opportunity. The science-driven mission proposal began with trade studies and determined that a rocket powered aircraft was the best suited platform to complete the ARES science objectives. A high fidelity six degree of freedom flight simulation was required to provide credible evidence that the aircraft design fulfilled mission objectives and to support the aircraft design process by providing performance evaluations. The aircraft was initially modeled using the aero, propulsion, and flight control system components of other aircraft models. As the proposed aircraft design evolved, the borrowed components were replaced with new models. This allowed performance evaluations to be performed as the design was maturing. Basic autopilot features were also developed for the ARES aircraft model. Altitude hold and track hold modes allowed different mission scenarios to be evaluated for both science merit and aircraft performance. Platform stability and data rate requirements were identified for each of the instruments and the aircraft performance was evaluated against those requirements. The results of the simulation evaluations indicate that the ARES design and mission profiles are sound and meet the science objectives.

Kenney, P. Sean↗

NASA NTRS2021

Dynamical and Trace Gas Responses of the Quasi-Biennial Oscillation to Increased CO2

Long-term projections of the Quasi-Biennial Oscillation (QBO) remain uncertain. Using the high-top \Middle Atmosphere" (MA) version of the NASA Goddard Institute for Space Studies (GISS) ModelE (E2.2-AP), we show that increased CO2 reduces the QBO period and weakens its amplitude, consistent with results from recent multimodel studies. The amplitude response is asymmetric, with the easterly phase weakening more than the westerly phase. Results from both coupled atmosphere{ocean and climatologically fixed sea surface temperature simulations link the period response to changes in parameterized convective gravity wave fluxes, whereas the amplitude changes are more closely tied to changes in tropical upwelling. Comparisons of simulations with and without ozone-dynamical feedbacks reveal that ozone feedbacks increase the QBO amplitude and period in pre-industrial control simulations, and reduce the response of the amplitude to increased CO2. The response of stratospheric tracers to projected changes in the QBO is also investigated. Similarity between results using fully interactive (trace gas and aerosol) versus linearized ozone chemical mechanisms suggests that the QBO response to CO2 does not depend on additional chemical feedbacks beyond those associated with ozone, which implies that projected QBO changes may be credibly represented using simpli fied stratospheric ozone schemes.

GISS Model E2.2-AP↗

NASA NTRS2010

Orbit Determination Toolbox

The Orbit Determination Toolbox is an orbit determination (OD) analysis tool based on MATLAB and Java that provides a flexible way to do early mission analysis. The toolbox is primarily intended for advanced mission analysis such as might be performed in concept exploration, proposal, early design phase, or rapid design center environments. The emphasis is on flexibility, but it has enough fidelity to produce credible results. Insight into all flight dynamics source code is provided. MATLAB is the primary user interface and is used for piecing together measurement and dynamic models. The Java Astrodynamics Toolbox is used as an engine for things that might be slow or inefficient in MATLAB, such as high-fidelity trajectory propagation, lunar and planetary ephemeris look-ups, precession, nutation, polar motion calculations, ephemeris file parsing, and the like. The primary analysis functions are sequential filter/smoother and batch least-squares commands that incorporate Monte-Carlo data simulation, linear covariance analysis, measurement processing, and plotting capabilities at the generic level. These functions have a user interface that is based on that of the MATLAB ODE suite. To perform a specific analysis, users write MATLAB functions that implement truth and design system models. The user provides his or her models as inputs to the filter commands. The software provides a capability to publish and subscribe to a software bus that is compliant with the NASA Goddard Mission Services Evolution Center (GMSEC) standards, to exchange data with other flight dynamics tools to simplify the flight dynamics design cycle. Using the publish and subscribe approach allows for analysts in a rapid design center environment to seamlessly incorporate changes in spacecraft and mission design into navigation analysis and vice versa.

Carpenter, James R.↗

NASA NTRS1987

Reliability modeling of fault-tolerant computer based systems

Digital fault-tolerant computer-based systems have become commonplace in military and commercial avionics. These systems hold the promise of increased availability, reliability, and maintainability over conventional analog-based systems through the application of replicated digital computers arranged in fault-tolerant configurations. Three tightly coupled factors of paramount importance, ultimately determining the viability of these systems, are reliability, safety, and profitability. Reliability, the major driver affects virtually every aspect of design, packaging, and field operations, and eventually produces profit for commercial applications or increased national security. However, the utilization of digital computer systems makes the task of producing credible reliability assessment a formidable one for the reliability engineer. The root of the problem lies in the digital computer's unique adaptability to changing requirements, computational power, and ability to test itself efficiently. Addressed here are the nuances of modeling the reliability of systems with large state sizes, in the Markov sense, which result from systems based on replicated redundant hardware and to discuss the modeling of factors which can reduce reliability without concomitant depletion of hardware. Advanced fault-handling models are described and methods of acquiring and measuring parameters for these models are delineated.

Bavuso, Salvatore J.↗

NASA NTRS1999

The Aviation System Analysis Capability Air Carrier Cost-Benefit Model

To meet its objective of assisting the U.S. aviation industry with the technological challenges of the future, NASA must identify research areas that have the greatest potential for improving the operation of the air transportation system. Therefore, NASA is developing the ability to evaluate the potential impact of various advanced technologies. By thoroughly understanding the economic impact of advanced aviation technologies and by evaluating how the new technologies will be used in the integrated aviation system, NASA aims to balance its aeronautical research program and help speed the introduction of high-leverage technologies. To meet these objectives, NASA is building the Aviation System Analysis Capability (ASAC). NASA envisions ASAC primarily as a process for understanding and evaluating the impact of advanced aviation technologies on the U.S. economy. ASAC consists of a diverse collection of models and databases used by analysts and other individuals from the public and private sectors brought together to work on issues of common interest to organizations in the aviation community. ASAC also will be a resource available to the aviation community to analyze; inform; and assist scientists, engineers, analysts, and program managers in their daily work. The ASAC differs from previous NASA modeling efforts in that the economic behavior of buyers and sellers in the air transportation and aviation industries is central to its conception. Commercial air carriers, in particular, are an important stakeholder in this community. Therefore, to fully evaluate the implications of advanced aviation technologies, ASAC requires a flexible financial analysis tool that credibly links the technology of flight with the financial performance of commercial air carriers. By linking technical and financial information, NASA ensures that its technology programs will continue to benefit the user community. In addition, the analysis tool must be capable of being incorporated into the wide-ranging suite of economic and technical models that comprise ASAC. This report describes an Air Carrier Cost-Benefit Model (CBM) that meets these requirements. The ASAC CBM is distinguished from many of the aviation cost-benefit models by its exclusive focus on commercial air carriers. The model considers such benefit categories as time and fuel savings, utilization opportunities, reliability and capacity enhancements, and safety and security improvements. The model distinguishes between benefits that are predictable and those that occur randomly. By making such a distinction, the model captures the ability of air carriers to reoptimize scheduling and crew assignments for predictable benefits. In addition, the model incorporates a life-cycle cost module for new technology, which applies the costs of nonrecurring acquisitions, recurring maintenance and operation, and training to each aircraft equipment type independently.

Gaier, Eric M.↗

NASA NTRS1991

Multisource Data Integration in Remote Sensing

Papers presented at the workshop on Multisource Data Integration in Remote Sensing are compiled. The full text of these papers is included. New instruments and new sensors are discussed that can provide us with a large variety of new views of the real world. This huge amount of data has to be combined and integrated in a (computer-) model of this world. Multiple sources may give complimentary views of the world - consistent observations from different (and independent) data sources support each other and increase their credibility, while contradictions may be caused by noise, errors during processing, or misinterpretations, and can be identified as such. As a consequence, integration results are very reliable and represent a valid source of information for any geographical information system.

Tilton, James C.↗

NASA NTRS2012

A Bayesian Framework for Reliability Analysis of Spacecraft Deployments

Deployable subsystems are essential to mission success of most spacecraft. These subsystems enable critical functions including power, communications and thermal control. The loss of any of these functions will generally result in loss of the mission. These subsystems and their components often consist of unique designs and applications for which various standardized data sources are not applicable for estimating reliability and for assessing risks. In this study, a two stage sequential Bayesian framework for reliability estimation of spacecraft deployment was developed for this purpose. This process was then applied to the James Webb Space Telescope (JWST) Sunshield subsystem, a unique design intended for thermal control of the Optical Telescope Element. Initially, detailed studies of NASA deployment history, "heritage information", were conducted, extending over 45 years of spacecraft launches. This information was then coupled to a non-informative prior and a binomial likelihood function to create a posterior distribution for deployments of various subsystems uSing Monte Carlo Markov Chain sampling. Select distributions were then coupled to a subsequent analysis, using test data and anomaly occurrences on successive ground test deployments of scale model test articles of JWST hardware, to update the NASA heritage data. This allowed for a realistic prediction for the reliability of the complex Sunshield deployment, with credibility limits, within this two stage Bayesian framework.

Evans, John W.↗