Search NASA⌕ Search

SEARCH · Search NASA

Results for “Code Validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,387 records · Page 77

Integrated Medical Model Verification, Validation, and Credibility

The Integrated Medical Model (IMM) was designed to forecast relative changes for a specified set of crew health and mission success risk metrics by using a probabilistic (stochastic process) model based on historical data, cohort data, and subject matter expert opinion. A probabilistic approach is taken since exact (deterministic) results would not appropriately reflect the uncertainty in the IMM inputs. Once the IMM was conceptualized, a plan was needed to rigorously assess input information, framework and code, and output results of the IMM, and ensure that end user requests and requirements were considered during all stages of model development and implementation. METHODS: In 2008, the IMM team developed a comprehensive verification and validation (VV) plan, which specified internal and external review criteria encompassing 1) verification of data and IMM structure to ensure proper implementation of the IMM, 2) several validation techniques to confirm that the simulation capability of the IMM appropriately represents occurrences and consequences of medical conditions during space missions, and 3) credibility processes to develop user confidence in the information derived from the IMM. When the NASA-STD-7009 (7009) was published, the IMM team updated their verification, validation, and credibility (VVC) project plan to meet 7009 requirements and include 7009 tools in reporting VVC status of the IMM. RESULTS: IMM VVC updates are compiled recurrently and include 7009 Compliance and Credibility matrices, IMM VV Plan status, and a synopsis of any changes or updates to the IMM during the reporting period. Reporting tools have evolved over the lifetime of the IMM project to better communicate VVC status. This has included refining original 7009 methodology with augmentation from the NASA-STD-7009 Guidance Document. End user requests and requirements are being satisfied as evidenced by ISS Program acceptance of IMM risk forecasts, transition to an operational model and simulation tool, and completion of service requests from a broad end user consortium including Operations, Science and Technology Planning, and Exploration Planning. CONCLUSIONS: The VVC approach established by the IMM project of combining the IMM VV Plan with 7009 requirements is comprehensive and includes the involvement of end users at every stage in IMM evolution. Methods and techniques used to quantify the VVC status of the IMM have not only received approval from the local NASA community but have also garnered recognition by other federal agencies seeking to develop similar guidelines in the medical modeling community.

Validation↗

Development and Validation of Two-Phase CFD Models for Key Elements of Propellant Tank CFM Operations in 1G and Microgravity – An Overview

This paper presents an overview of the state-of-the-art two-phase CFD models that have been developed for various propellant tank storage and transfer operations in 1g, partial gravity and microgravity. The models are developed in the framework of the industry standard ANSYS/Fluent CFD code, the capabilities of which have been significantly enhanced and customized through incorporation of unique submodels via User Defined Functions (UDF)s to satisfy the requirements of its intended variable gravity Cryogenic Fluid Management (CFM) applications. These models/submodels have been validated against experimental data that cross spatial scales, fluid types, and gravity levels in order to properly anchor the models’ physical and numerical fidelity. The CFM application/processes that have been modeled include tank self-pressurization, tank autogenous pressurization, tank pressure control using both subcooled jet mixing and droplet spray injection mechanisms, tank chilldown/filling, tank drainage, tank slosh for both volatile and non-volatile fluids. The strength and shortcomings of the two-phase models for each application is highlighted and discussed briefly.

Propellant Storage & Pressure Control↗

Additional extensions to the NASCAP computer code, volume 2

Particular attention is given to comparison of the actural response of the SCATHA (Spacecraft Charging AT High Altitudes) P78-2 satellite with theoretical (NASCAP) predictions. Extensive comparisons for a variety of environmental conditions confirm the validity of the NASCAP model. A summary of the capabilities and range of validity of NASCAP is presented, with extensive reference to previously published applications. It is shown that NASCAP is capable of providing quantitatively accurate results when the object and environment are adequately represented and fall within the range of conditions for which NASCAP was intended. Three dimensional electric field affects play an important role in determining the potential of dielectric surfaces and electrically isolated conducting surfaces, particularly in the presence of artificially imposed high voltages. A theory for such phenomena is presented and applied to the active control experiments carried out in SCATHA, as well as other space and laboratory experiments. Finally, some preliminary work toward modeling large spacecraft in polar Earth orbit is presented. An initial physical model is presented including charge emission. A simple code based upon the model is described along with code test results.

Stannard, P. R.↗

Impulsive phase of solar flares. 1: Characteristics of high energy electrons

The variation along a magnetic field line of the energy and pitch angle distribution of high energy electrons injected into a cold hydrogen plasma containing either an open or closed magnetic field structure was investigated. The problem is formulated as a time independent Fokker-Planck Equation for the electron number distribution as a function of the electron energy, electron pitch angle, and the structure of the global magnetic field. Simple analytic solution valid in the small pitch angle regime and for slowly varying magnetic field is presented. For the more general situation a numerical code for solving the Fokker-Planck Equation was used and it was found that the analytic expression agrees well with the numerical results to values of the pitch angle much larger than expected. For most practical applications, one many confidently use the analytic expression instead of having to resort to lengthy numerical computations. These results are useful in the study of the nonthermal models of the impulsive phase of solar flares.

Leach, J.↗

Computational fluid dynamics overview

The hierarchy of codes; boundary layers and turbulence models; uniqueness and artificial viscosity; efficiency of solution algorithms; data display and analysis; and cost of experimental validation are briefly examined.

Bobbitt, Percy J.↗

Software reliability studies

The longterm goal of this research is to identify or create a model for use in analyzing the reliability of flight control software. The immediate tasks addressed are the creation of data useful to the study of software reliability and production of results pertinent to software reliability through the analysis of existing reliability models and data. The completed data creation portion of this research consists of a Generic Checkout System (GCS) design document created in cooperation with NASA and Research Triangle Institute (RTI) experimenters. This will lead to design and code reviews with the resulting product being one of the versions used in the Terminal Descent Experiment being conducted by the Systems Validations Methods Branch (SVMB) of NASA/Langley. An appended paper details an investigation of the Jelinski-Moranda and Geometric models for software reliability. The models were given data from a process that they have correctly simulated and asked to make predictions about the reliability of that process. It was found that either model will usually fail to make good predictions. These problems were attributed to randomness in the data and replication of data was recommended.

Wilson, Larry W.↗

Fault injection experiments using FIAT

The results of several experiments conducted using the fault-injection-based automated testing (FIAT) system are presented. FIAT is capable of emulating a variety of distributed system architectures, and it provides the capabilities to monitor system behavior and inject faults for the purpose of experimental characterization and validation of a system's dependability. The experiments consist of exhaustively injecting three separate fault types into various locations, encompassing both the code and data portions of memory images, of two distinct applications executed with several different data values and sizes. Fault types are variations of memory bit faults. The results show that there are a limited number of system-level fault manifestations. These manifestations follow a normal distribution for each fault type. Error detection latencies are found to be normally distributed. The methodology can be used to predict the system-level fault responses during the system design stage.

Barton, James H.↗

Analytical modelling of no-vent fill process

An analytical model called FILL is presented which represents the first step in attaining the capability for no-vent fill of cryogens in space. The model's analytical structure is described, including the equations used to calculate transient thermodynamic behavior in different regions of the tank. The code predictions are compared with data from recent no-vent fill ground tests using Freon-114. The results are used to validate the FILL model to evaluate the viability of universal submerged jet theory in predicting system-level condensation effects.

Vaughan, David A.↗

Wing-section optimization for supersonic viscous flows

The recent interest in High Speed Civil Transport (HSCT) has resulted in renewed research studies of optimized supersonic cruise transport configurations. Incorporation of flow viscosity effects in the design process of such a supersonic wing is currently under investigation. This may lead to more accurate problem formulations and, in turn, greater aerodynamic efficiency than can be obtained by the traditional, inviscid, linear theories. In this context, for a design code to be a candidate for a complex optimization problem, such as three-dimensional viscous supersonic wing design, it should be validated using simpler building-block shapes. To optimize the shape of a supersonic wing, an automated method that also includes higher fidelity to the flow physics is desirable. With this impetus, an aerodynamic optimization methodology incorporating Navier-Stokes equations and sensitivity analysis had been previously developed. Prior to embarking upon the wing design task, the present investigation concentrated on testing the flexibility of the methodology, and the identification of adequate problem formulations, by defining two-dimensional, cost-effective test cases. Starting with two distinctly different initial airfoils, two independent shape optimizations resulted in shapes with very similar features. Secondly, the normal section to the subsonic portion of the leading edge, which had a high normal angle-of-attack, was considered. The optimization resulted in a shape with twist and camber, which eliminated the adverse pressure gradient, hence, exploiting the leading-edge thrust. The wing section shapes obtained in all the test cases had the features predicted by previous studies. Therefore, it was concluded that the flowfield analyses and the sensitivity coefficients were computed and fed to the present gradient-based optimizer correctly. Also, as a result of the present two-dimensional study, suggestions were made for problem formulations which should contribute to an effective wing shape optimization.

Item, Cem C.↗

Visualization of Capsule Reentry Vehicle Heat Shield Ablation Using Naphthalene PLIF

The Orion Multi-Purpose Crew Vehicle (MPCV) will use an ablative heat shield and improved understanding of the ablation process would be beneficial for design purposes. Given that ablation is a multi-physics process involving heat and mass transfer, codes aiming to predict heat shield ablation are in need of experimental data pertaining to the turbulent transport of ablation products for validation. At The University of Texas at Austin, a technique is being developed that uses planar laser-induced fluorescence (PLIF) of a low-temperature sublimating ablator (naphthalene) to visualize the transport of ablation products in a supersonic flow. Since ablation at reentry temperatures can be difficult to recreate in a laboratory setting it is desirable to create a limited physics problem and simulate the ablation process at relatively low temperature conditions using naphthalene. A scaled Orion MPCV model with a solid naphthalene heat shield has been tested in a Mach 5 wind tunnel at various angles of attack in the current work. PLIF imaging reveals the distribution of the ablation products as they are transported into the heat-shield boundary layer and over the capsule shoulders into the separated shear layer and backshell recirculation region. Visualizations of the capsule shear layer using both naphthalene PLIF and Schlieren imaging compared favorably. High concentrations of naphthalene in the capsule separated flow region, intermittent turbulent structures on the heat shield surface, and interesting details of the capsule shear layer structure were observed using the naphthalene PLIF technique. The capsule shear layer was also shown to generally appear to be more turbulent at lower angles of attack. Furthermore, the PLIF signal increased steadily over the course of a run indicating that during a wind tunnel run the model heated up and the rate of naphthalene ablation increased. The shear layer showed increasing signs of turbulence over the course of a wind tunnel run as well, likely because of the combination of increased surface roughness and surface blowing rate. PLIF imaging also detected regions with a relatively low concentration of naphthalene in the capsule backshell recirculation region that are most likely the result of cross-flow-induced vortices on the capsule afterbody.

Combs, Christopher S.↗

Study of Geometric Porosity on Static Stability and Drag Using Computational Fluid Dynamics for Rigid Parachute Shapes

This paper explores use of computational fluid dynamics to study the e↵ect of geometric porosity on static stability and drag for NASA's Multi-Purpose Crew Vehicle main parachute. Both of these aerodynamic characteristics are of interest to in parachute design, and computational methods promise designers the ability to perform detailed parametric studies and other design iterations with a level of control previously unobtainable using ground or flight testing. The approach presented here uses a canopy structural analysis code to define the inflated parachute shapes on which structured computational grids are generated. These grids are used by the computational fluid dynamics code OVERFLOW and are modeled as rigid, impermeable bodies for this analysis. Comparisons to Apollo drop test data is shown as preliminary validation of the technique. Results include several parametric sweeps through design variables in order to better understand the trade between static stability and drag. Finally, designs that maximize static stability with a minimal loss in drag are suggested for further study in subscale ground and flight testing.

Greathouse, James S.↗

The Integrated Medical Model: Outcomes from Independent Review

In 2016, the Integrated Medical Model (IMM) v4.0 underwent an extensive external review in preparation for transition to an operational status. In order to insure impartiality of the review process, the Exploration Medical Capabilities Element of NASA's Human Research Program convened the review through the Systems Review Office at NASA Goddard Space Flight Center (GSFC). The review board convened by GSFC consisted of persons from both NASA and academia with expertise in the fields of statistics, epidemiology, modeling, software development, aerospace medicine, and project management (see Figure 1). The board reviewed software and code standards, as well as evidence pedigree associated with both the input and outcomes information. The board also assesses the models verification, validation, sensitivity to parameters and ability to answer operational questions. This talk will discuss the processes for designing the review, how the review progressed and the findings from the board, as well as summarize the IMM project responses to those findings. Overall, the board found that the IMM is scientifically sound, represents a necessary, comprehensive approach to identifying medical and environmental risks facing astronauts in long duration missions and is an excellent tool for communication between engineers and physicians. The board also found IMM and its customer(s) should convene an additional review of the IMM data sources and to develop a sustainable approach to augment, peer review, and maintain the information utilized in the IMM. The board found this is critically important because medical knowledge continues to evolve. Delivery of IMM v4.0 to the Crew Health and Safety (CHS) Program will occur in the 2017. Once delivered for operational decision support, IMM v4.0 will provide CHS with additional quantitative capability in to assess astronaut medical risks and required medical capabilities to help drive down overall mission risks.

medical equipment↗

Evaluation of HZETRN on the Martian Surface: Sensitivity Tests and Model Results

The Mars Science Laboratory Radiation Assessment Detector (MSLRAD) is providing continuous measurements of dose, dose equivalent, and particle flux on the surface of Mars. These measurements have been highly useful in validating environmental and radiation transport models that will be heavily relied upon for future deep space missions. In this work, the HZETRN code is utilized to estimate radiation quantities of interest on the Martian surface. A description of the modeling approach used with HZETRN is given along with the various input models and parameters used to define the galactic cosmic ray (GCR) environment and Martian geometry. Sensitivity tests are performed to gauge the impact of varying several input factors on quantities being compared to MSLRAD data. Results from these tests provide context for inter-code comparisons presented in a companion paper within this issue. It is found that details of the regolith and atmospheric composition have a minimal impact on surface flux, dose, and dose equivalent. Details of the density variation within the atmosphere and uncertainties associated with specifying the vertical atmospheric thickness are also found to have minimal impact. Two widely used GCR models are used as input into HZETRN and it is found that the associated surface quantities are within several percent of each other.

Tony C Slaba↗

Development of an Effective Finite-rate Oxidation Model for NuSil-coated Charred Carbon Preform Ablators

Recently, a detailed effective finite-rate surface chemistry model was developed for the oxidation of FiberForm [1] using the molecular beam experimental data of Poovathingal et al., [2]. FiberForm is the major building block of the thermal protection system (TPS) material Phenolic Impregnated Carbon Ablator (PICA), commonly used by NASA. The surface chemistry model consists of detailed surface reaction mechanisms such as adsorption, desorption, and several types of Langmuir-Hinshelwood (LH) reactions to characterize the oxygen-carbon interactions at the surface. This model provides excellent agreement with the experimental data for oxidation product compositions and corresponding translational energy distributions. Further, an effective oxidation model was constructed that captures the equivalent interaction of oxygen inside the microstructure (including multiple surface collisions) via a modified reactivity for a smooth wall boundary condition. This enables the use of this model directly into Computational Fluid Dynamics (CFD) codes and Material Response (MR) codes to accurately simulate the gas–surface interactions within FiberForm without using the detailed micro-structure. However, this effective model is valid only for the virgin FiberForm. As the TPS material undergoes ablation, the preform carbon burns and turns into char. In addition, PICA is also coated with a protective silicon coating called NuSil for the purpose of mitigating the spread of phenolic dust, and limit contamination during clean room operations. Fig. 1 shows a X-ray microtomography image of a charred NuSil-coated PICA. The NuSil layer introduces species containing silicon into the product mixture. Further, the reactivity of the carbon within the char layer is different from the virgin FiberForm as shown in Fig. 2. Recently a new set of molecular beam experiments were performed on this NuSil-coated TPS material [3] with the same type of oxygen beam used in the previous experiments. Using the latest experimental data, the previously developed effective model will be extended to account for the charred carbon as well as the NuSil coating. Finally, this new effective model with three phases – preform carbon, char, and NuSil; will be compared and validated against the experimental product compositions.

K Swaminathan Gopalan↗

Development and Validation of Two-Phase CFD Models for Key Elements of Propellant Tank CFM Operations in 1G and Microgravity –An Overview

This paper presents an overview of the state-of-the-art two-phase CFD models that have been developed for various propellant tank storage and transfer operations in 1g, partial gravity, and microgravity. The models are developed in the framework of the industry standard ANSYS/Fluent CFD code, the capabilities of which have been significantly enhanced and customized through the incorporation of unique submodels via User Defined Functions (UDF)s to satisfy the requirements of its intended variable gravity Cryogenic Fluid Management (CFM) applications. These models/submodels have been validated against experimental data that cross spatial scales, fluid types, and gravity levels in order to properly anchor the models’ physical and numerical fidelity. The CFM application/processes that have been modeled include tank self-pressurization, tank autogenous pressurization, tank pressure control using both subcooled jet mixing and droplet spray injection mechanisms, tank chilldown/filling, tank drainage, tank slosh for both volatile and non-volatile fluids. The strength and shortcomings of the two-phase models for each application are highlighted and discussed briefly.

Computational Fluid Dynamics↗

Proceedings of the Third International Workshop on Proof-Carrying Code and Software Certification

This NASA conference publication contains the proceedings of the Third International Workshop on Proof-Carrying Code and Software Certification, held as part of LICS in Los Angeles, CA, USA, on August 15, 2009. Software certification demonstrates the reliability, safety, or security of software systems in such a way that it can be checked by an independent authority with minimal trust in the techniques and tools used in the certification process itself. It can build on existing validation and verification (V&V) techniques but introduces the notion of explicit software certificates, Vvilich contain all the information necessary for an independent assessment of the demonstrated properties. One such example is proof-carrying code (PCC) which is an important and distinctive approach to enhancing trust in programs. It provides a practical framework for independent assurance of program behavior; especially where source code is not available, or the code author and user are unknown to each other. The workshop wiII address theoretical foundations of logic-based software certification as well as practical examples and work on alternative application domains. Here "certificate" is construed broadly, to include not just mathematical derivations and proofs but also safety and assurance cases, or any fonnal evidence that supports the semantic analysis of programs: that is, evidence about an intrinsic property of code and its behaviour that can be independently checked by any user, intermediary, or third party. These guarantees mean that software certificates raise trust in the code itself, distinct from and complementary to any existing trust in the creator of the code, the process used to produce it, or its distributor. In addition to the contributed talks, the workshop featured two invited talks, by Kelly Hayhurst and Andrew Appel. The PCC 2009 website can be found at http://ti.arc.nasa.gov /event/pcc 091.

Ewen, Denney, W.↗

CFD Integrated Transition Modeling for High-Speed Flows via Coupled OVERFLOW-LASTRAC Analysis

This work details ongoing efforts at the NASA Langley Research Center to develop and validate a general-use CFD tool that includes built-in predictions of boundary-layer transition in high-speed flows. Existing tools for the coupling of the NASA OVERFLOW structured overset RANS solver and LASTRAC stability analysis code have been extended to capture boundary-layer transition in high-speed flows driven by either Mack’s first-mode or secondmode instabilities and/or crossflow instabilities. The efficacy of this coupled approach has been demonstrated by examining a variety of supersonic and hypersonic test cases for which experimental validation data is available. The intermittency prescription parameters inherited from prior low-speed applications are found to be suitable for some, but not all high-speed flow scenarios. The method is found to be robust for straight cone configurations and improvements necessary to accurately capture transition on geometries with spatially complex amplification factor envelopes with intermediate regions of slow N-factor variation are examined. The automated, coupled analysis is demonstrated for a 3d supersonic test case and found to perform well within the limits of the linear stability analysis on which it relies. Finally, a preliminary investigation of the method’s robustness to non-ideal CFD meshes is conducted.

High-speed flow↗

A Flexible Statechart-to-model-checker Translator

Many current-day software design tools offer some variant of statechart notation for system specification. We, like others, have built an automatic translator from (a subset of) statecharts to a model checker, for use to validate behavioral requirements.

statecharts↗