Search NASA⌕ Search

SEARCH · Search NASA

Results for “model credibility”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Integrated Modeling and Simulation Verification, Validation, and Accreditation Strategy for Exploration Systems Mission Directorate

Models and simulations (M&S) are critical resources in the exploration of space. They support program management, systems engineering, integration, analysis, test, and operations and provide critical information and data supporting key analyses and decisions (technical, cost and schedule). Consequently, there is a clear need to establish a solid understanding of M&S strengths and weaknesses, and the bounds within which they can credibly support decision-making. Their usage requires the implementation of a rigorous approach to verification, validation and accreditation (W&A) and establishment of formal process and practices associated with their application. To ensure decision-making is suitably supported by information (data, models, test beds) from activities (studies, exercises) from M&S applications that are understood and characterized, ESMD is establishing formal, tailored W&A processes and practices. In addition, to ensure the successful application of M&S within ESMD, a formal process for the certification of analysts that use M&S is being implemented. This presentation will highlight NASA's Exploration Systems Mission Directorate (ESMD) management approach for M&S W&A to ensure decision-makers receive timely information on the model's fidelity, credibility, and quality.

Hale, Joseph P.↗

An Uncertainty Structure Matrix for Models and Simulations

Software that is used for aerospace flight control and to display information to pilots and crew is expected to be correct and credible at all times. This type of software is typically developed under strict management processes, which are intended to reduce defects in the software product. However, modeling and simulation (M&S) software may exhibit varying degrees of correctness and credibility, depending on a large and complex set of factors. These factors include its intended use, the known physics and numerical approximations within the M&S, and the referent data set against which the M&S correctness is compared. The correctness and credibility of an M&S effort is closely correlated to the uncertainty management (UM) practices that are applied to the M&S effort. This paper describes an uncertainty structure matrix for M&S, which provides a set of objective descriptions for the possible states of UM practices within a given M&S effort. The columns in the uncertainty structure matrix contain UM elements or practices that are common across most M&S efforts, and the rows describe the potential levels of achievement in each of the elements. A practitioner can quickly look at the matrix to determine where an M&S effort falls based on a common set of UM practices that are described in absolute terms that can be applied to virtually any M&S effort. The matrix can also be used to plan those steps and resources that would be needed to improve the UM practices for a given M&S effort.

Green, Lawrence L.↗

Mission Scenario Development Workbench

The Mission Scenario Development Workbench (MSDW) is a multidisciplinary performance analysis software tool for planning and optimizing space missions. It provides a number of new capabilities that are particularly useful for planning the surface activities on other planets. MSDW enables rapid planning of a space mission and supports flight system and scientific-instrumentation trades. It also provides an estimate of the ability of flight, ground, and science systems to meet high-level mission goals and provides means of evaluating expected mission performance at an early stage of planning in the project life cycle. In MSDW, activity plans and equipment-list spreadsheets are integrated with validated parameterized simulation models of spacecraft systems. In contrast to traditional approaches involving worst-case estimates with large margins, the approach embodied in MSDW affords more flexibility and more credible results early in the lifecycle through the use of validated, variable- fidelity models of spacecraft systems. MSDW is expected to help maximize the scientific return on investment for space missions by understanding early the performance required to have a successful mission while reducing the risk of costly design changes made at late stages in the project life cycle.

Kordon, Mark↗

Computation of confined coflow jets with three turbulence models

A numerical study of confined jets in a cylindrical duct is carried out to examine the performance of two recently proposed turbulence models: an RNG-based K-epsilon model and a realizable Reynolds stress algebraic equation model. The former is of the same form as the standard K-epsilon model but has different model coefficients. The latter uses an explicit quadratic stress-strain relationship to model the turbulent stresses and is capable of ensuring the positivity of each turbulent normal stress. The flow considered involves recirculation with unfixed separation and reattachment points and severe adverse pressure gradients, thereby providing a valuable test of the predictive capability of the models for complex flows. Calculations are performed with a finite-volume procedure. Numerical credibility of the solutions is ensured by using second-order accurate differencing schemes and sufficiently fine grids. Calculations with the standard K-epsilon model are also made for comparison. Detailed comparisons with experiments show that the realizable Reynolds stress algebraic equation model consistently works better than does the standard K-epsilon model in capturing the essential flow features, while the RNG-based K-epsilon model does not seem to give improvements over the standard K-epsilon model under the flow conditions considered.

Zhu, J.↗

The Effects of Solar Variability on Earth's Climate: A Workshop Report

Solar irradiance, the flux of the Sun s output directed toward Earth, is Earth s main energy source.1 The Sun itself varies on several timescales over billions of years its luminosity increases as it evolves on the main sequence toward becoming a red giant; about every 11 years its sunspot activity cycles; and within just minutes flares can erupt and release massive amounts of energy. Most of the fluctuations from tens to thousands of years are associated with changes in the solar magnetic field. The focus of the National Research Council's September 2011 workshop on solar variability and Earth's climate, and of this summary report, is mainly magnetically driven variability and its possible connection with Earth's climate variations in the past 10,000 years. Even small variations in the amount or distribution of energy received at Earth can have a major influence on Earth's climate when they persist for decades. However, no satellite measurements have indicated that solar output and variability have contributed in a significant way to the increase in global mean temperature in the last 50 years. Locally, however, correlations between solar activity and variations in average weather may stand out beyond the global trend; such has been argued to be the case for the El Nino-Southern Oscillation, even in the present day. A key area of inquiry deals with establishing a unified record of the solar output and solar-modified particles that extends from the present to the prescientific past. The workshop focused attention on the need for a better understanding of the links between indices of solar activity such as cosmogenic isotopes and solar irradiance. A number of presentations focused on the timescale of the solar cycle and of the satellite record, and on the problem of extending this record back in time. Highlights included a report of progress on pyroheliometer calibration, leading to greater confidence in the time history and future stability of total solar irradiance (TSI), and surprising results on changes in spectral irradiance over the last solar cycle, which elicited spirited discussion. New perspectives on connections between features of the quiet and active areas of the photosphere and variations in TSI were also presented, emphasizing the importance of developing better understanding in order to extrapolate back in time using activity indices. Workshop participants reviews highlighted difficulties as well as causes for optimism in current understanding of the cosmogenic isotope record and the use of observed variability in Sun-like stars in reconstructing variations in TSI occurring on lower frequencies than the sunspot cycle. The workshop succeeded in bringing together informed, focused presentations on major drivers of the Sun-climate connection. The importance of the solar cycle as a unique quasi-periodic probe of climate responses on a timescale between the seasonal and Milankovitch cycles was recognized in several presentations. The signal need only be detectable, not dominant, for it to play this role of a useful probe. Some workshop participants also found encouraging progress in the top-down perspective, according to which solar variability affects surface climate by first perturbing the stratosphere, which then forces the troposphere and surface. This work is now informing and being informed by research on tropospheric responses to the Antarctic ozone hole and volcanic aerosols. In contrast to the top-down perspective is the bottom-up view that the interaction of solar energy with the ocean and surface leads to changes in dynamics and temperature. During the discussion of how dynamical air-sea coupling in the tropical Pacific and solar variability interact from a bottom-up perspective, several participants remarked on the wealth of open research questions in the dynamics of the climatic response to TSI and spectral variability. The discussion of the paleoclimate record emphasized that the link between solar varbility and Earth s climate is multifaceted and that some components are understood better than others. According to two presenters on paleoclimate, there is a need to study the idiosyncrasies of each key proxy record. Yet they also emphasized that there may be an emerging pattern of paleoclimate change coincident with periods of solar activity and inactivity, but only on long timescales of multiple decades to millennia. Several speakers discussed the effects of particle events and cosmic-ray variability. These are all areas of exciting fundamental research; however, they have not yet led to conclusive evidence for significant related climate effects. The key problem of attribution of climate variability on the timescales of the Little Ice Age and the Maunder Minimum were directly addressed in several presentations. Several workshop participants remarked that the combination of solar, paleoclimatic, and climate modeling research has the potential to dramatically improve the credibility of these attribution studies.

Source record↗

Analysis of film cooling in rocket nozzles

Computational Fluid Dynamics (CFD) programs are customarily used to compute details of a flow field, such as velocity fields or species concentrations. Generally they are not used to determine the resulting conditions at a solid boundary such as wall shear stress or heat flux. However, determination of this information should be within the capability of a CFD code, as the code supposedly contains appropriate models for these wall conditions. Before such predictions from CFD analyses can be accepted, the credibility of the CFD codes upon which they are based must be established. This report details the progress made in constructing a CFD model to predict the heat transfer to the wall in a film cooled rocket nozzle. Specifically, the objective of this work is to use the NASA code FDNS to predict the heat transfer which will occur during the upcoming hot-firing of the Pratt & Whitney 40K subscale nozzle (1Q93). Toward this end, an M = 3 wall jet is considered, and the resulting heat transfer to the wall is computed. The values are compared against experimental data available in Reference 1. Also, FDNS's ability to compute heat flux in a reacting flow will be determined by comparing the code's predictions against calorimeter data from the hot firing of a 40K combustor. The process of modeling the flow of combusting gases through the Pratt & Whitney 40K subscale combustor and nozzle is outlined. What follows in this report is a brief description of the FDNS code, with special emphasis on how it handles solid wall boundary conditions. The test cases and some FDNS solution are presented next, along with comparison to experimental data. The process of modeling the flow through a chamber and a nozzle using the FDNS code will also be outlined.

Woodbury, Keith A.↗

Modeling and Simulation at NASA

This slide presentation is composed of two topics. The first reviews the use of modeling and simulation (M&S) particularly as it relates to the Constellation program and discrete event simulation (DES). DES is defined as a process and system analysis, through time-based and resource constrained probabilistic simulation models, that provide insight into operation system performance. The DES shows that the cycles for a launch from manufacturing and assembly to launch and recovery is about 45 days and that approximately 4 launches per year are practicable. The second topic reviews a NASA Standard for Modeling and Simulation. The Columbia Accident Investigation Board made some recommendations related to models and simulations. Some of the ideas inherent in the new standard are the documentation of M&S activities, an assessment of the credibility, and reporting to decision makers, which should include the analysis of the results, a statement as to the uncertainty in the results,and the credibility of the results. There is also discussion about verification and validation (V&V) of models. There is also discussion about the different types of models and simulation.

Steele, Martin J.↗

Taking Climate Model Evaluation to the Next Level

Earth system models are complex and represent a large number of processes, resulting in a persistent spread across climate projections for a given future scenario. Owing to different model performances against observations and the lack of independence among models, there is now evidence that giving equal weight to each available model projection is suboptimal. This Perspective discusses newly developed tools that facilitate a more rapid and comprehensive evaluation of model simulations with observations, process-based emergent constraints that are a promising way to focus evaluation on the observations most relevant to climate projections, and advanced methods for model weighting. These approaches are needed to distil the most credible information on regional climate changes, impacts, and risks for stakeholders and policy-makers.

Eyring, Veronika↗

Credible Software and Simulation Uncertainty

The utility of software primarily depends on its reliability and performance; whereas, its significance depends solely on its credibility for intended use. The credibility of simulations confirms the credibility of software. The level of veracity and the level of validity of simulations determine the degree of credibility of simulations. The process of assessing this credibility in fields such as computational mechanics (CM) differs from that followed by the Defense Modeling and Simulation Office in operations research. Verification and validation (V&V) of CM simulations is not the same as V&V of CM software. Uncertainty is the measure of simulation credibility. Designers who use software are concerned with management of simulation uncertainty. Terminology and concepts are presented with a few examples from computational fluid dynamics.

Mehta, Unmeel B.↗

A method motion simulator design based on modeling characteristics of the human operator

A design criteria is obtained to compare two simulators and evaluate their equivalence or credibility. In the subsequent analysis the comparison of two simulators can be considered as the same problem as the comparison of a real world situation and a simulation's representation of this real world situation. The design criteria developed involves modeling of the human operator and defining simple parameters to describe his behavior in the simulator and in the real world situation. In the process of obtaining human operator parameters to define characteristics to evaluate simulators, measures are also obtained on these human operator characteristics which can be used to describe the human as an information processor and controller. First, a study is conducted on the simulator design problem in such a manner that this modeling approach can be used to develop a criteria for the comparison of two simulators.

Repperger, D. W.↗

Sleep Disruption Medical Intervention Forecasting (SDMIF) Module for the Integrated Medical Model

The NASA Integrated Medical Model (IMM) assesses the risk, including likelihood and impact of occurrence, of all credible in-flight medical conditions. Fatigue due to sleep disruption is a condition that could lead to operational errors, potentially resulting in loss of mission or crew. Pharmacological consumables are mitigation strategies used to manage the risks associated with sleep deficits. The likelihood of medical intervention due to sleep disruption was estimated with a well validated sleep model and a Monte Carlo computer simulation in an effort to optimize the quantity of consumables. METHODS: The key components of the model are the mission parameter program, the calculation of sleep intensity and the diagnosis and decision module. The mission parameter program was used to create simulated daily sleep/wake schedules for an ISS increment. The hypothetical schedules included critical events such as dockings and extravehicular activities and included actual sleep time and sleep quality. The schedules were used as inputs to the Sleep, Activity, Fatigue and Task Effectiveness (SAFTE) Model (IBR Inc., Baltimore MD), which calculated sleep intensity. Sleep data from an ISS study was used to relate calculated sleep intensity to the probability of sleep medication use, using a generalized linear model for binomial regression. A human yes/no decision process using a binomial random number was also factored into sleep medication use probability. RESULTS: These probability calculations were repeated 5000 times resulting in an estimate of the most likely amount of sleep aids used during an ISS mission and a 95% confidence interval. CONCLUSIONS: These results were transferred to the parent IMM for further weighting and integration with other medical conditions, to help inform operational decisions. This model is a potential planning tool for ensuring adequate sleep during sleep disrupted periods of a mission.

Lewandowski, Beth↗

Executive Summary: Special Section on Credible Computational Fluid Dynamics Simulations

This summary presents the motivation for the Special Section on the credibility of computational fluid dynamics (CFD) simulations, its objective, its background and context, its content, and its major conclusions. Verification and validation (V&V) are the processes for establishing the credibility of CFD simulations. Validation assesses whether correct things are performed and verification assesses whether they are performed correctly. Various aspects of V&V are discussed. Progress is made in verification of simulation models. Considerable effort is still needed for developing a systematic validation method that can assess the credibility of simulated reality.

Mehta, Unmeel B.↗

Analysis of gamma-ray burst spectra with cyclotron lines

Motivated by the recent developments in the cyclotron resonance upscattering of soft photons or CUSP model of Gamma Ray Burst (GBR) continuum spectra, we revisit a select database of GRBs with credible cyclotron absorption features. We measure the break energy of the continuum, the slope below the break and deduce the soft photon energy or the electron beam Lorentz factor cutoff. We study the correlation (or lack of) between various parameters in the context of the CUSP model. One surprise result is that there appears to be marginal correlation between the break energy and the spectral index below the break.

Kargatis, Vincent↗

Atmospheric effects of stratospheric aircraft - A status report from NASA's High-Speed Research Program

Studies have indicated that, with sufficient technology development, future high-speed civil transport aircraft could be economically competitive with long-haul subsonic aircraft. However, uncertainty about atmospheric pollution, along with community noise and sonic boom, continues to be a major concern which is being addressed in the planned six-year High-Speed Research Program begun in 1990. Building on NASA's research in atmospheric science and emissions reduction, current analytical predictions indicate that an operating range may exist at altitudes below 20 km (i.e., corresponding to a cruise Mach number of approximately 2.4) where the goal level of 5 gm equivalent NO2 emissions/kg fuel will deplete less than one percent of column ozone. Because it will not be possible to directly measure the impact of an aircraft fleet on the atmosphere, the only means of assessment will be prediction. The process of establishing credibility for the predicted effects will likely be complex and involve continued model development and testing against climatological patterns. In particular, laboratory simulation of heterogeneous chemistry and other effects, and direct measurements of well understood tracers in the troposphere and stratosphere are being used to improve the current models.

Wesoky, Howard L.↗

The Atmospheric Effects of Stratospheric Aircraft: a First Program Report

Studies have indicated that, with sufficient technology development, high speed civil transport aircraft could be economically competitive with long haul subsonic aircraft. However, uncertainty about atmospheric pollution, along with community noise and sonic boom, continues to be a major concern; and this is addressed in the planned 6 yr HSRP begun in 1990. Building on NASA's research in atmospheric science and emissions reduction, the AESA studies particularly emphasizing stratospheric ozone effects. Because it will not be possible to directly measure the impact of an HSCT aircraft fleet on the atmosphere, the only means of assessment will be prediction. The process of establishing credibility for the predicted effects will likely be complex and involve continued model development and testing against climatological patterns. Lab simulation of heterogeneous chemistry and other effects will continue to be used to improve the current models.

Prather, Michael J.↗

Population Properties of Compact Objects from the Second LIGO-Virgo Gravitational-Wave Transient Catalog

We report on the population of 47 compact binary mergers detected with a false-alarm rate of <1yr^(−1) in the second LIGO–Virgo Gravitational-Wave Transient Catalog. We observe several characteristics of the merging binary black hole (BBH) population not discernible until now. First, the primary mass spectrum contains structure beyond a power law with a sharp high-mass cutoff; it is more consistent with a broken power law with a break at 39.7^(+20.3)(-9.1)M or a power law with a Gaussian feature peaking at 33.1^(+4.0)(-5.6)M (90% credible interval). While the primary mass distribution must extend to ~65M or beyond, only 2.9^(+3.5)(-1.7)M% of systems have primary masses greater than 45M. Second, we find that a fraction of BBH systems have component spins misaligned with the orbital angular momentum, giving rise to precession of the orbital plane. Moreover, 12% to 44% of BBH systems have spins tilted by more than 90°, giving rise to a negative effective inspiral spin parameter, χeff. Under the assumption that such systems can only be formed by dynamical interactions, we infer that between 25% and 93% of BBHs with nonvanishing |χeff| > 0.01 are dynamically assembled. Third, we estimate merger rates, finding RBBH = 23.9^(+14.3)(-8.6) Gpc^(-3) yr^(-1) for BBHs and RBNS = 320^(+490)(-240) Gpc^(-3) yr^(-1) for binary neutron stars. We find that the BBH rate likely increases with redshift (85% credibility) but not faster than the star formation rate (86% credibility). Additionally, we examine recent exceptional events in the context of our population models, finding that the asymmetric masses of GW190412 and the high component masses of GW190521 are consistent with our models, but the low secondary mass of GW190814 makes it an outlier.

R Abbott↗

Use of Remote Sensing and Dust Modelling to Evaluate Ecosystem Phenology and Pollen Dispersal

The impact of pollen release and downwind concentrations can be evaluated utilizing remote sensing. Previous NASA studies have addressed airborne dust prediction systems PHAiRS (Public Health Applications in Remote Sensing) which have determined that pollen forecasts and simulations are possible. By adapting the deterministic dust model (as an in-line system with the National Weather Service operational forecast model) used in PHAiRS to simulate downwind dispersal of pollen, initializing the model with pollen source regions from MODIS, assessing the results a rapid prototype concept can be produced. We will present the results of our effort to develop a deterministic model for predicting and simulating pollen emission and downwind concentration to study details or phenology and meteorology and their dependencies, and the promise of a credible real time forecast system to support public health and agricultural science and service. Previous studies have been done with PHAiRS research, the use of NASA data, the dust model and the PHAiRS potential to improve public health and environmental services long into the future.

Luvall, Jeffrey C.↗

Global Aspects of Heliosphere-Geosphere Coupling

The magnetosphere serves both to hold off the solar wind and to couple it selectively to the Earth through the auroral zones. It has long been understood that the plasmasphere consists of geogenic plasmas that expand out of the sunlit low latitude ionosphere, but it was initially assumed that the hot low density plasma beyond the plasmasphere is largely of solar wind origin with a minor admixture of ionospheric plasmas, discovered via mass spectrometric observations in the early 70's. Since then, elaborate simulation models have been developed that have taken us from an era of cartoon physics to a new era of quantitative global comparisons between observations and theory. In most current global circulation models of the magnetosphere, the ionospheric load on the system is taken to lie exclusively in the thin F layer of the ionosphere. This layer is coupled with solar wind and magnetospheric plasmas via Maxwell stresses communicated by field aligned current systems, and with the thermosphere via ion-neutral charge exchange and Coulomb collisions. However, recent observations have shown us that ionospheric plasmas flow sporadically in various forms into the plasmasphere and up into the high latitude circulation cells of the outer magnetosphere, as driven by the solar wind and its variable intensity and magnetic field. Under some conditions, ionospheric material is observed to be the principal component of plasmas at the dayside magnetopause and in the plasma sheet and ring current regions. Given a global model of magnetospheric circulation, it is relatively straightforward to investigate the behaviors of ionospheric plasmas in response to solar wind drivers, and we report the results of such efforts here. We find that ionospheric plasmas dominate the plasma pressure in the magnetosphere in some regions, particularly when the solar wind is especially intense and-or southward directed. This result violates the assumption that the ionospheric load is confined to the F layer, and shows that the ionosphere is often an important dynamic element of the solar wind-ionosphere system throughout the magnetosphere, especially during larger geospace storms. This means that future global circulation models must account for ionospheric plasma inertia, heat capacity, and pressure, to be quantitatively credible.

Moore, Thomas E.↗