Search NASA⌕ Search

SEARCH · Search NASA

Results for “Simulation Credibility”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
NASA NTRS2017

Verification Testing: Meet User Needs Figure of Merit

Verification is the process through which Modeling and Simulation(M&S) software goes to ensure that it has been rigorously tested and debugged for its intended use. Validation confirms that said software accurately models and represents the real world system. Credibility gives an assessment of the development and testing effort that the software has gone through as well as how accurate and reliable test results are. Together, these three components form Verification, Validation, and Credibility(VV&C), the process by which all NASA modeling software is to be tested to ensure that it is ready for implementation. NASA created this process following the CAIB (Columbia Accident Investigation Board) report seeking to understand the reasons the Columbia space shuttle failed during reentry. The reports conclusion was that the accident was fully avoidable, however, among other issues, the necessary data to make an informed decision was not there and the result was complete loss of the shuttle and crew. In an effort to mitigate this problem, NASA put out their Standard for Models and Simulations, currently in version NASA-STD-7009A, in which they detailed their recommendations, requirements and rationale for the different components of VV&C. They did this with the intention that it would allow for people receiving MS software to clearly understand and have data from the past development effort. This in turn would allow the people who had not worked with the MS software before to move forward with greater confidence and efficiency in their work. This particular project looks to perform Verification on several MATLAB (Registered Trademark)(The MathWorks, Inc.) scripts that will be later implemented in a website interface. It seeks to take note and define the limits of operation, the units and significance, and the expected datatype and format of the inputs and outputs of each of the scripts. This is intended to prevent the code from attempting to make incorrect or impossible calculations. Additionally, this project will look at the coding generally and note inconsistencies, redundancies, and other aspects that may become problematic or slow down the codes run time. Certain scripts lacking in documentation also will be commented and cataloged.

validation↗
NASA NTRS2013

Evaluation of GEOS-5 Sulfur Dioxide Simulations During the Frostburg, MD 2010 Field Campaign.

Sulfur dioxide (SO2) is a major atmospheric pollutant with a strong anthropogenic component mostly produced by the combustion of fossil fuel and other industrial activities. As a precursor of sulfate aerosols that affect climate, air quality, and human health, this gas needs to be monitored on a global scale. Global climate and chemistry models including aerosol processes along with their radiative effects are important tools for climate and air quality research. Validation of these models against in-situ and satellite measurements is essential to ascertain the credibility of these models and to guide model improvements. In this study the Goddard Chemistry, Aerosol, Radiation, and Transport (GOCART) module running on-line inside the Goddard Earth Observing System version 5 (GEOS-5) model is used to simulate aerosol and SO2 concentrations. Data taken in November 2010 over Frostburg, Maryland during an SO2 field campaign involving ground instrumentation and aircraft are used to evaluate GEOS-5 simulated SO2 concentrations. Preliminary data analysis indicated the model overestimated surface SO2 concentration, which motivated the examination of mixing processes in the model and the specification of SO2 anthropogenic emission rates. As a result of this analysis, a revision of anthropogenic emission inventories in GEOS-5 was implemented, and the vertical placement of SO2 sources was updated. Results show that these revisions improve the model agreement with observations locally and in regions outside the area of this field campaign. In particular, we use the ground-based measurements collected by the United States Environmental Protection Agency (US EPA) for the year 2010 to evaluate the revised model simulations over North America.

Air Quality Campaign↗
NASA NTRS2003

Magnetotactic bacteria on Earth and on Mars

Continued interest in the possibility of evidence for life in the ALH84001 Martian meteorite has focused on the magnetite crystals. This review is structured around three related questions: is the magnetite in ALH84001 of biological or non-biological origin, or a mixture of both? does magnetite on Earth provide insight to the plausibility of biogenic magnetite on Mars? could magnetotaxis have developed on Mars? There are credible arguments for both the biological and non-biological origin of the magnetite in ALH84001, and we suggest that more studies of ALH84001, extensive laboratory simulations of non-biological magnetite formation, as well as further studies of magnetotactic bacteria on Earth will be required to further address this question. Magnetite grains produced by bacteria could provide one of the few inorganic traces of past bacterial life on Mars that could be recovered from surface soils and sediments. If there was biogenic magnetite on Mars in sufficient abundance to leave fossil remains in the volcanic rocks of ALH84001, then it is likely that better-preserved magnetite will be found in sedimentary deposits on Mars. Deposits in ancient lakebeds could contain well-preserved chains of magnetite clearly indicating a biogenic origin.

Review, Tutorial↗
NASA NTRS1992

Simulator evaluation of displays for a revised takeoff performance monitoring system

Cockpit displays for a Takeoff Performance Monitoring System (TOPMS) to provide pilots with graphic and alphanumeric information pertinent to their decision to continue or abort a takeoff are evaluated. Revised head-down and newly developed head-up displays were implemented on electronic screens in the real-time Transport Systems Research Vehicle (TSRV) Simulator for the Boeing 737 airplane at the Langley Research Center and evaluated by 17 NASA, U.S. Air Force, airline, and industry pilots. Both types of displays were in color, but they were not dependent upon it. The TOPMS head-down display is composed of a runway graphic overlaid with symbolic status and advisory information related to both the expected takeoff point and the predicted stop point (in the event an abort becomes necessary). In addition, an overall Situation Advisory Flag indicates a preferred course of action based on analysis of the various elements of airplane performance and system status. A simpler head-up display conveys most of this same information and relates it to the visual scene. The evaluation pilots found the displays to be credible, easy to monitor, and appropriate for the task. In particular, the pilots said the head-up display was monitored with very little effort and did not obstruct or distract them from monitoring the simulated out-the-window runway scene. This report augments NASA TP-2908, 1989.

Middleton, David B.↗
NASA NTRS2006

Mission Scenario Development Workbench

The Mission Scenario Development Workbench (MSDW) is a multidisciplinary performance analysis software tool for planning and optimizing space missions. It provides a number of new capabilities that are particularly useful for planning the surface activities on other planets. MSDW enables rapid planning of a space mission and supports flight system and scientific-instrumentation trades. It also provides an estimate of the ability of flight, ground, and science systems to meet high-level mission goals and provides means of evaluating expected mission performance at an early stage of planning in the project life cycle. In MSDW, activity plans and equipment-list spreadsheets are integrated with validated parameterized simulation models of spacecraft systems. In contrast to traditional approaches involving worst-case estimates with large margins, the approach embodied in MSDW affords more flexibility and more credible results early in the lifecycle through the use of validated, variable- fidelity models of spacecraft systems. MSDW is expected to help maximize the scientific return on investment for space missions by understanding early the performance required to have a successful mission while reducing the risk of costly design changes made at late stages in the project life cycle.

Kordon, Mark↗
NASA NTRS1984

Flight test of a synthetic aperture radar antenna using STEP

To establish confidence in its overall performance, credible information on the synthetic aperture radar antenna's mechanical properties in orbit must be obtained. However, the antenna's size, design, and operating environment make it difficult to simulate operating conditions under 1-g Earth conditions. The Space Technology Experiments Platform (STEP) offers a timely opportunity to mechanically qualify and characterize the antenna design in a representative environment. The proposed experimental configuration would employ a half-system of the full-scale RADARSAT antenna which would be mounted on the STEP platform in the orbiter cargo bay such that it could be deployed and retracted in orbit (as shown in this figure). The antenna would be subjected to typical environmental exposures while an array of targets and sensors on the antenna support structure and reflecting surface are observed and monitored. In particular, the typical environments would include deployment and retraction, dynamic response to vehicle thruster or base exciter inputs, and thermal soak and transient effects upon entering or exiting Earth eclipse. The proposed experiment would also provide generic information on the properties of large space structures in space and on techniques to obtain the desired information.

Zimcik, D. G.↗
NASA NTRS2019

Gateway Modeling and Simulation Plan

This plan institutes direction across the Gateway Program and the Element Projects to ensure that Cross Program M&S are produced in a manner that (1) generate the artifacts required for NASA-STD-7009 compliance, (2) ensures interoperability of M&S exchanged and integrated across the program and, (3) drives integrated development efforts to provide cross-domain integrated simulation of the Gateway elements, space environment, and operational scenarios. This direction is flowed down via contractual enforcement to prime contractors and includes both the GMS requirements specified in this plan and the NASASTD- 7009 derived requirements necessary for compliance. Grounding principles for management of Gateway Models and Simulations (M&S) are derived from the Columbia Accident Investigation Board (CAIB) report and the Diaz team report, “A Renewed Commitment to Excellence.” As an outcome of these reports, and in response to Action 4 of the Diaz team report, the NASA Standard for Models and Simulations, NASA-STD-7009 was developed. The standard establishes M&S requirements for development and use activities to ensure proper capture and communication of M&S pedigree and credibility information to Gateway program decision makers. Through the course of the Gateway program life cycle M&S will be heavily relied upon to conduct analysis, test products, support operations activities, enable informed decision making and ultimately to certify the Gateway with an acceptable level of risk to crew and mission. To reduce risk associated with M&S influenced decisions, this plan applies the NASA-STD-7009 requirements to produce the artifacts that support credibility assessments and ensure the information is communicated to program management.

NASA-STD-7009↗
NASA NTRS2004

An Overview of Recent Developments in Computational Aeroelasticity

The motivation for Computational Aeroelasticity (CA) and the elements of one type of the analysis or simulation process are briefly reviewed. The need for streamlining and improving the overall process to reduce elapsed time and improve overall accuracy is discussed. Further effort is needed to establish the credibility of the methodology, obtain experience, and to incorporate the experience base to simplify the method for future use. Experience with the application of a variety of Computational Aeroelasticity programs is summarized for the transonic flutter of two wings, the AGARD 445.6 wing and a typical business jet wing. There is a compelling need for a broad range of additional flutter test cases for further comparisons. Some existing data sets that may offer CA challenges are presented.

Bennett, Robert M.↗
NASA NTRS1993

Interdisciplinary technology

The 'computational test-cell' will enable the incorporation of new methodologies, such as concurrent engineering and probabilistic methods, into the propulsion design process. This will provide the capability to conduct credible, interdisciplinary analyses of new propulsion concepts and designs. Probabilistic methods can be used as the basis for reliability-based design. Recently methods have been devised that provide the capability of simulating the performance of propulsion systems at several levels of resolution. These methods make it possible to quantify uncertainty and to establish confidence bounds for the calculated values. The introduction of reliability-based design methodology along with probabilistic analyses will provide a tool to reduce the design space for new systems and to reduce our dependence on hardware testing for proof-of-concept and system integration demonstrations. The resulting simulations will reduce the need for testing and identify potential operational problems early in the design process. This capability will make it possible to compute the expected performance, stability, reliability, and life of propulsion components, subsystems, and systems at design and off-design conditions, to bring life cycle cost trade-offs early into the design process and to determine optimum designs to satisfy specified mission requirements.

Nichols, Lester D.↗
NASA NTRS2017

Oblate-Earth Effects on the Calculation of Ec During Spacecraft Reentry

The bulge in the Earth at its equator has been shown to lead to a clustering of natural decays biased to occur towards the equator and away from the orbit's extreme latitudes. Such clustering must be considered when predicting the Expectation of Casualty (Ec) during a natural decay because of the clustering of the human population in the same lower latitudes. This study expands upon prior work, and formalizes the correction that must be made to the calculation of the average exposed population density as a result of this effect. Although a generic equation can be derived from this work to approximate the effects of gravitational and atmospheric perturbations on a final decay, such an equation averages certain important subtleties in achieving a best fit over all conditions. The authors recommend that direct simulation be used to calculate the true Ec for any specific entry as a more accurate method. A generic equation is provided, represented as a function of ballistic number and inclination of the entering spacecraft over the credible range of ballistic numbers.

Bacon, John B.↗
NASA NTRS2019

Taking Climate Model Evaluation to the Next Level

Earth system models are complex and represent a large number of processes, resulting in a persistent spread across climate projections for a given future scenario. Owing to different model performances against observations and the lack of independence among models, there is now evidence that giving equal weight to each available model projection is suboptimal. This Perspective discusses newly developed tools that facilitate a more rapid and comprehensive evaluation of model simulations with observations, process-based emergent constraints that are a promising way to focus evaluation on the observations most relevant to climate projections, and advanced methods for model weighting. These approaches are needed to distil the most credible information on regional climate changes, impacts, and risks for stakeholders and policy-makers.

Eyring, Veronika↗
NASA NTRS1995

Nonlinear Propagating Features in the Stratosphere of Jupiter Generated by the Impact of SL-9

Among the more intriguing features observed by HST after the impacts of the fragments of Shoemaker-Levy 9 were rings, encircling several of the impact sites, that expanded radially at constant velocities of order 450-500 m/s. One credible suggestion has been that the rings are stratospheric manifestations of linear gravity waves seated in the troposphere (Ingersoll and Kanamori, 1995). In this scenario the waves are made visible by a condensible material of unknown composition. Based on simulations of the comet impact by Zahnle and Mac Low (1995), we suggest an alternative hypothesis, namely that the rings are nonlinear stratospheric gravity waves which break and entrain impact debris material in the breaking wave front. The computations produce just such a feature, with the nonlinear breaking wave front in the stratosphere propagating radially away from the impact site with the correct speed. The computed ring of material is located in an altitude region where the static stability profile has a local maximum and therefore forms a waveguide. Because entrained impact debris forms the ring feature in the model, a condensate of some unknown composition is not required in order to view the wave front. However, there is one severe problem with the computed nonlinear wave: in contrast to a linear wave, it slows down. The computed feature stops within 1000 seconds, while the observed feature lasted at least 10,000 seconds. Since the nonlinear breaking wave front is a natural product of our impact simulations, we are now investigating the conditions that will enable the breaking wave front to propagate further, in accord with the observations. The results of these computations will be presented.

Young, R. E.↗
NASA NTRS1988

Antarctic springtime ozone depletion computed from temperature observations

An observationally based, mechanistic dynamical model is used to simulate the decline of total ozone during September and October for the years 1979 through 1986. Vertical velocities derived from observed stratospheric temperature changes and computed radiative heating rates are used to advect an ozone mixing ratio profile during the Antarctic spring period. An early August 1982 Syowa balloonsonde ozone profile is used to initialize the computations. The model reasonably simulates the September and October changes in total ozone, considering the uncertainties in the observed data and the radiative heating. The simulated decline is found to be very sensitive to the choice of initial ozone profile and to small changes in the radiative heating. The results of this study suggest that the dynamical hypothesis of the Antarctic ozone depletion is both quantitatively credible and consistent with the observed temperature changes.

Rosenfield, Joan E.↗
NASA NTRS1999

Model Experiments and Model Descriptions

The Second Workshop on Stratospheric Models and Measurements Workshop (M&M II) is the continuation of the effort previously started in the first Workshop (M&M I, Prather and Remsberg [1993]) held in 1992. As originally stated, the aim of M&M is to provide a foundation for establishing the credibility of stratospheric models used in environmental assessments of the ozone response to chlorofluorocarbons, aircraft emissions, and other climate-chemistry interactions. To accomplish this, a set of measurements of the present day atmosphere was selected. The intent was that successful simulations of the set of measurements should become the prerequisite for the acceptance of these models as having a reliable prediction for future ozone behavior. This section is divided into two: model experiment and model descriptions. In the model experiment, participant were given the charge to design a number of experiments that would use observations to test whether models are using the correct mechanisms to simulate the distributions of ozone and other trace gases in the atmosphere. The purpose is closely tied to the needs to reduce the uncertainties in the model predicted responses of stratospheric ozone to perturbations. The specifications for the experiments were sent out to the modeling community in June 1997. Twenty eight modeling groups responded to the requests for input. The first part of this section discusses the different modeling group, along with the experiments performed. Part two of this section, gives brief descriptions of each model as provided by the individual modeling groups.

Jackman, Charles H.↗
NASA NTRS2007

Development and Application of a Portable Health Algorithms Test System

This paper describes the development and initial demonstration of a Portable Health Algorithms Test (PHALT) System that is being developed by researchers at the NASA Glenn Research Center (GRC). The PHALT System was conceived as a means of evolving the maturity and credibility of algorithms developed to assess the health of aerospace systems. Comprising an integrated hardware-software environment, the PHALT System allows systems health management algorithms to be developed in a graphical programming environment; to be tested and refined using system simulation or test data playback; and finally, to be evaluated in a real-time hardware-in-the-loop mode with a live test article. In this paper, PHALT System development is described through the presentation of a functional architecture, followed by the selection and integration of hardware and software. Also described is an initial real-time hardware-in-the-loop demonstration that used sensor data qualification algorithms to diagnose and isolate simulated sensor failures in a prototype Power Distribution Unit test-bed. Success of the initial demonstration is highlighted by the correct detection of all sensor failures and the absence of any real-time constraint violations.

Melcher, Kevin J.↗
NASA NTRS2010

Portable Health Algorithms Test System

A document discusses the Portable Health Algorithms Test (PHALT) System, which has been designed as a means for evolving the maturity and credibility of algorithms developed to assess the health of aerospace systems. Comprising an integrated hardware-software environment, the PHALT system allows systems health management algorithms to be developed in a graphical programming environment, to be tested and refined using system simulation or test data playback, and to be evaluated in a real-time hardware-in-the-loop mode with a live test article. The integrated hardware and software development environment provides a seamless transition from algorithm development to real-time implementation. The portability of the hardware makes it quick and easy to transport between test facilities. This hard ware/software architecture is flexible enough to support a variety of diagnostic applications and test hardware, and the GUI-based rapid prototyping capability is sufficient to support development execution, and testing of custom diagnostic algorithms. The PHALT operating system supports execution of diagnostic algorithms under real-time constraints. PHALT can perform real-time capture and playback of test rig data with the ability to augment/ modify the data stream (e.g. inject simulated faults). It performs algorithm testing using a variety of data input sources, including real-time data acquisition, test data playback, and system simulations, and also provides system feedback to evaluate closed-loop diagnostic response and mitigation control.

Melcher, Kevin J.↗
NASA NTRS1989

Interaction of external conditions with the internal flowfield in liquid rocket engines - A computational study

Computational studies have been conducted to examine the capability of a CFD code by simulating the steady state thrust chamber internal flow. The SSME served as the sample case, and significant parameter profiles are presented and discussed. Performance predictions from TDK, the recommended JANNAF reference computer program, are compared with those from PHOENICS to establish the credibility of its results. The investigation of an overexpanded nozzle flow is particularly addressed since it plays an important role in the area ratio selection of future rocket engines. Experience gained during this uncompleted flow separation study and future steps are outlined.

Trinh, H. P.↗
NASA NTRS2000

An Approach to Experimental Design for the Computer Analysis of Complex Phenomenon

The ability to make credible system assessments, predictions and design decisions related to engineered systems and other complex phenomenon is key to a successful program for many large-scale investigations in government and industry. Recently, many of these large-scale analyses have turned to computational simulation to provide much of the required information. Addressing specific goals in the computer analysis of these complex phenomenon is often accomplished through the use of performance measures that are based on system response models. The response models are constructed using computer-generated responses together with physical test results where possible. They are often based on probabilistically defined inputs and generally require estimation of a set of response modeling parameters. As a consequence, the performance measures are themselves distributed quantities reflecting these variabilities and uncertainties. Uncertainty in the values of the performance measures leads to uncertainties in predicted performance and can cloud the decisions required of the analysis. A specific goal of this research has been to develop methodology that will reduce this uncertainty in an analysis environment where limited resources and system complexity together restrict the number of simulations that can be performed. An approach has been developed that is based on evaluation of the potential information provided for each "intelligently selected" candidate set of computer runs. Each candidate is evaluated by partitioning the performance measure uncertainty into two components - one component that could be explained through the additional computational simulation runs and a second that would remain uncertain. The portion explained is estimated using a probabilistic evaluation of likely results for the additional computational analyses based on what is currently known about the system. The set of runs indicating the largest potential reduction in uncertainty is then selected and the computational simulations are performed. Examples are provided to demonstrate this approach on small scale problems. These examples give encouraging results. Directions for further research are indicated.

Rutherford, Brian↗