Search NASA⌕ Search

SEARCH · Search NASA

Results for “validation studies”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Geologic Sequestration of CO2 in Deep, Unmineable Coalbeds: An Integrated Researdh and Commercial-Scale Field Demonstration Project

The Coal-Seq consortium is a government-industry collaborative consortium with the objective of advancing industry's understanding of complex coalbed methane and gas shale reservoir behavior in the presence of multi-component gases via laboratory experiments, theoretical model development and field validation studies. This will allow primary recovery, enhanced recovery and CO{sub 2} sequestration operations to be commercially enhanced and/or economically deployed. The project was initially launched in 2000 as a U.S. Department of Energy sponsored investigation into CO{sub 2} sequestration in deep, unmineable coalseams. The initial project accomplished a number of important objectives, which mainly revolved around performing baseline experimental studies, documenting and analyzing existing field projects, and establishing a global network for technology exchange. The results from that Phase have been documented in a series of reports which are publicly available. An important outcome of the initial phase was that serious limitations were uncovered in our knowledge of reservoir behavior when CO{sub 2} is injected into coal. To address these limitations, the project was extended in 2005 as a government-industry collaborative consortium. Selected accomplishments from this phase have included the identification and/or development of new models for multi-component sorption and diffusion, laboratory studies of coal geomechanical and permeability behavior with CO{sub 2} injection, additional field validation studies, and continued global technology exchange. Further continuation of the consortium is currently being considered. Some of the topics that have been identified for investigation include further model development/refinement related to multicomponent equations-of-state, sorption and diffusion behavior, geomechanical and permeability studies, technical and economic feasibility studies for major international coal basins, the extension of the work to gas shale reservoirs, and continued global technology exchange.

01 COAL, LIGNITE, AND PEAT↗

Quantitative modeling of the accuracy in registering preoperative patient-specific anatomic models into left atrial cardiac ablation procedures

Purpose: In cardiac ablation therapy, accurate anatomic guidance is necessary to create effective tissue lesions for elimination of left atrial fibrillation. While fluoroscopy, ultrasound, and electroanatomic maps are important guidance tools, they lack information regarding detailed patient anatomy which can be obtained from high resolution imaging techniques. For this reason, there has been significant effort in incorporating detailed, patient-specific models generated from preoperative imaging datasets into the procedure. Both clinical and animal studies have investigated registration and targeting accuracy when using preoperative models; however, the effect of various error sources on registration accuracy has not been quantitatively evaluated. Methods: Data from phantom, canine, and patient studies are used to model and evaluate registration accuracy. In the phantom studies, data are collected using a magnetically tracked catheter on a static phantom model. Monte Carlo simulation studies were run to evaluate both baseline errors as well as the effect of different sources of error that would be present in a dynamicin vivo setting. Error is simulated by varying the variance parameters on the landmark fiducial, physical target, and surface point locations in the phantom simulation studies. In vivo validation studies were undertaken in six canines in which metal clips were placed in the left atrium to serve as ground truth points. A small clinical evaluation was completed in three patients. Landmark-based and combined landmark and surface-based registration algorithms were evaluated in all studies. In the phantom and canine studies, both target registration error and point-to-surface error are used to assess accuracy. In the patient studies, no ground truth is available and registration accuracy is quantified using point-to-surface error only. Results: The phantom simulation studies demonstrated that combined landmark and surface-based registration improved landmark-only registration provided the noise in the surface points is not excessively high. Increased variability on the landmark fiducials resulted in increased registration errors; however, refinement of the initial landmark registration by the surface-based algorithm can compensate for small initial misalignments. The surface-based registration algorithm is quite robust to noise on the surface points and continues to improve landmark registration even at high levels of noise on the surface points. Both the canine and patient studies also demonstrate that combined landmark and surface registration has lower errors than landmark registration alone. Conclusions: In this work, we describe a model for evaluating the impact of noise variability on the input parameters of a registration algorithm in the context of cardiac ablation therapy. The model can be used to predict both registration error as well as assess which inputs have the largest effect on registration accuracy.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Risk management and expert system development methodology

A risk-based expert-system development methodology has been developed to provide guidance to managers and technical personnel and to serve as a standard for developing expert systems. Expert-system development differs from conventional software development in that the information needed to prepare system requirements for expert systems is not known at the outset of a project and is obtained by knowledge engineering methods. The paper describes the expert-system life cycle, development methodology, and the approach taken in this methodology to manage and reduce the risks in expert system development. Also examined are the risks of using and of not using a methodology, the studies undertaken to validate the provisions of the expert system development methodology, and the results of these validation studies.

Hull, Larry↗

A comparative study and validation of upwind and central-difference Navier-Stokes codes for high-speed flows

A comparative study was made using 4 different computer codes for solving the compressible Navier-Stokes equations. Three different test problems were used, each of which has features typical of high speed internal flow problems of practical importance in the design and analysis of propulsion systems for advanced hypersonic vehicles. These problems are the supersonic flow between two walls, one of which contains a 10 deg compression ramp, the flow through a hypersonic inlet, and the flow in a 3-D corner formed by the intersection of two symmetric wedges. Three of the computer codes use similar recently developed implicit upwind differencing technology, while the fourth uses a well established explicit method. The computed results were compared with experimental data where available.

Rudy, David H.↗

In-Trail Procedure Air Traffic Control Procedures Validation Simulation Study

In August 2007, Airservices Australia (Airservices) and the United States National Aeronautics and Space Administration (NASA) conducted a validation experiment of the air traffic control (ATC) procedures associated with the Automatic Dependant Surveillance-Broadcast (ADS-B) In-Trail Procedure (ITP). ITP is an Airborne Traffic Situation Awareness (ATSA) application designed for near-term use in procedural airspace in which ADS-B data are used to facilitate climb and descent maneuvers. NASA and Airservices conducted the experiment in Airservices simulator in Melbourne, Australia. Twelve current operational air traffic controllers participated in the experiment, which identified aspects of the ITP that could be improved (mainly in the communication and controller approval process). Results showed that controllers viewed the ITP as valid and acceptable. This paper describes the experiment design and results.

Chartrand, Ryan C.↗

Total experimental uncertainty in hydrodynamic testing of a semisubmersible wind turbine, considering numerical propagation of systematic uncertainty

Quantifying the uncertainty in experimental results is a vital step in properly validating numerical simulation tools for designing floating wind turbines; without a good understanding of the experimental uncertainties, it is impossible to confirm if numerical simulation tools can capture the physics with acceptable accuracy. Recent validation studies suggest that the wave-induced, low-frequency surge and pitch motions of semisubmersible-type floating wind turbines are consistently underpredicted by numerical simulations, but it has not been possible to state whether or not this underprediction is within the level of experimental error. Here, previously assessed systematic uncertainty components in hydrodynamic tests of the OC5-DeepCwind semisubmersible are propagated to response metrics of interest using numerical simulation tools, and combined with the system's random uncertainty to obtain the total experimental uncertainty. The uncertainty in the low-frequency response metrics is found to be most sensitive to the system properties (e.g., mooring stiffness and center of gravity), and also the wave elevation. The results of the present study suggest that the underprediction of the low-frequency response behavior observed in previous validation studies is larger than the experimental uncertainty.

17 WIND ENERGY↗

OVERFLOW Validation for Predicting Plume Impingement of Underexpanded Axisymmetric Jets onto Angled Flat Plates

This report documents how OVERFLOW, a computational fluid dynamics code, predicts plume impingement of underexpanded axisymmetric jets onto both perpendicular and inclined flat plates. The effects of the plume impinging on a range of plate inclinations varying from 90deg to 30deg are investigated and compared to the experimental results in Reference 1 and 2. The flow fields are extremely complex due to the interaction between the shock waves from the free jet and those deflected by the plate. Additionally, complex mixing effects create very intricate structures in the flow. The experimental data is very limited, so these validation studies will focus only on cold plume impingement on flat and inclined plates. This validation study will help quantify the error in the OVERFLOW simulation when applied to stage separation scenarios.

Lee, Henry C.↗

Numerical studies and metric development for validation of magnetohydrodynamic models on the HIT-SI experiment

We present application of three scalar metrics derived from the Biorthogonal Decomposition (BD) technique to evaluate the level of agreement between macroscopic plasma dynamics in different data sets. BD decomposes large data sets, as produced by distributed diagnostic arrays, into principal mode structures without assumptions on spatial or temporal structure. These metrics have been applied to validation of the Hall-MHD model using experimental data from the Helicity Injected Torus with Steady Inductive helicity injection experiment. Each metric provides a measure of correlation between mode structures extracted from experimental data and simulations for an array of 192 surface-mounted magnetic probes. Numerical validation studies have been performed using the NIMROD code, where the injectors are modeled as boundary conditions on the flux conserver, and the PSI-TET code, where the entire plasma volume is treated. Initial results from a comprehensive validation study of high performance operation with different injector frequencies are presented, illustrating application of the BD method. Using a simplified (constant, uniform density and temperature) Hall-MHD model, simulation results agree with experimental observation for two of the three defined metrics when the injectors are driven with a frequency of 14.5 kHz.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Unmanned Aircraft Systems Detect and Avoid System: End-to-End Verification and Validation Simulation Study of Minimum Operations Performance Standards for Integrating Unmanned Aircraft into the National Airspace System

As Unmanned Aircraft Systems (UAS) make their way to mainstream aviation operations within the National Airspace System (NAS), research efforts are underway to develop a safe and effective environment for their integration into the NAS. Detect and Avoid (DAA) systems are required to account for the lack of "eyes in the sky" due to having no human on-board the aircraft. The technique, results, and lessons learned from a detailed End-to-End Verification and Validation (E2-V2) simulation study of a DAA system representative of RTCA SC-228's proposed Phase I DAA Minimum Operational Performance Standards (MOPS), based on specific test vectors and encounter cases, will be presented in this paper.

Ghatas, Rania W.↗

The Effects of Severity of Losses of Well Clear on Minimum Operations Performance Standards End-To-End Verification and Validation Simulation Study for Integrating Unmanned Aircraft Systems into the National Airspace System Using Detect and Avoid Systems

As Unmanned Aircraft Systems (UAS) make their way to mainstream aviation operations within the National Airspace System (NAS), research efforts are underway to develop a safe and effective environment for their integration into the NAS. Detect and Avoid (DAA) systems are required to account for the lack of “eyes in the sky” due to having no human on-board the aircraft. The technique, results, and lessons learned from a detailed End-to-End Verification and Validation (E2-V2) simulation study of a DAA system representative of RTCA Special Committee(SC)-228’s proposed Phase I DAA Minimum Operational Performance Standards (MOPS), based on specific test vectors and encounter cases, will be presented in this paper.

Ghatas, Rania W.↗

Study of Whisper Statistics for Criticality Safety Code Validation

Whisper is computational software designed to assist with validation studies with the Monte Carlo particle transport package MCNP. Historical approaches rely on expert based judgment to select benchmarks while Whisper uses sensitivity/uncertainty (S/U) methods to select relevant benchmarks to a particular application model. Whisper will also derive a calculational margin and margin of subcriticality (MOS) that may be used to generate an upper subcritical limit (USL) for a particular application model. Whisper finds benchmark experiments whose isotope sensitivity profiles align best with the MCNP model in question, and assign a correlation coefficient ('ck' in Whisper parlance) to each selected benchmark as a measure of how closely those profiles agree. When ck values are high, there is less uncertainty between model and benchmarks and a higher USL is possible, relative to cases when ck values are low. The default Whisper settings recommends a 100,000 particles per cycle run for 500 active cycles, resulting in 50 M active neutron histories per application run. This is computationally intensive and may not be necessary to produce accurate results. A Whisper statistical study was done varying the neutron histories per cycle from 10,000 to the default 100,000. A lower number of neutron histories will allow Whisper to be used on low memory systems such as laptops. The intent of this paper is to present the changes in the Whisper results as the number of neutrons histories run is varied.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Study of Radiative Heat Transfer and Flow Physics from Medium-scale Methanol Pool Fire Simulations [Slides]

Analysis of methanol pool fire conducted as part of validation study for SIERRA/Fuego. Radiation model was effectively calibrated by modifying radiation model parameters for methanol. Computing integrated buoyancy flux, entrainment rate, and turbulent kinetic energy allowed for evaluation of less typical quantities in this validation study. Quantities were compared with experimental data or correlations and generally showed agreement. TKE needed fine mesh to be computed accurately. Predicted flame height less sensitive to variations in mixture fraction than temperature. Mixture fraction is a preferable threshold variable for this application.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Internal Standard Triggered-Parallel Reaction Monitoring Mass Spectrometry Enables Multiplexed Quantification of Candidate Biomarkers in Plasma

Despite advances in proteomic technologies, clinical translation of plasma biomarkers remains low, partly due to a major bottleneck between the discovery of candidate biomarkers and costly clinical validation studies. Due to a dearth of multiplexable assays, generally only a few candidate biomarkers are tested, and the validation success rate is accordingly low. Previously, mass spectrometry-based approaches have been used to fill this gap but feature poor quantitative performance and were generally limited to hundreds of proteins. Here, we demonstrate the capability of an internal standard triggered-parallel reaction monitoring (IS-PRM) assay to greatly expand the numbers of candidates that can be tested with improved quantitative performance. The assay couples immunodepletion and fractionation with IS-PRM and was developed and implemented in human plasma to quantify 5176 peptides representing 1314 breast cancer biomarker candidates. Characterization of the IS-PRM assay demonstrated the precision (median % CV of 7.7%), linearity (median R 2 > 0.999 over 4 orders of magnitude), and sensitivity (median LLOQ < 1 fmol, approximately) to enable rank-ordering of candidate biomarkers for validation studies. Using three plasma pools from breast cancer patients and three control pools, 893 proteins were quantified, of which 162 candidate biomarkers were verified in at least one of the cancer pools and 22 were verified in all three cancer pools. The assay greatly expands capabilities for quantification of large numbers of proteins and is well suited for prioritization of viable candidate biomarkers.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

siRNA high throughput screening identifies regulators of chloropicrin and hydrogen fluoride injury in human corneal epithelial cell models

Corneal injuries induced by various toxicants result in similar clinical presentations such as corneal opacity and neovascularization. Many studies suggest that several weeks post-exposure a convergence of the molecular mechanisms drives these progressive pathologies. However, chemical agents vary in toxicological properties, and early molecular responses are anticipated to be somewhat dissimilar for different toxicants. In this report we chose 3120 targets from the Dharmacon Human Druggable genome to screen for chloropicrin (CP) and hydrogen fluoride (HF) corneal injury as we hypothesized that targets identified in vitro may be effective as therapeutic targets in future studies. Human immortalized corneal epithelial cells (SV40-HCEC) were used for screening. Cell viability and IL-8 were analyzed to down-select hits into validation studies, where multiplex cytokine analysis and high content analysis were performed to understand toxicant effect and target function. Some endpoints were also evaluated in a second human immortalized corneal epithelial cell line, TCEpi. Over 20 targets entered validation studies for CP and HF; of these, only three targets were shared: NR3C1, RELA, and KMT5A. These findings suggest that early molecular responses to different toxicants may be somewhat distinctive and present dissimilar targets for possible early intervention.

60 APPLIED LIFE SCIENCES↗

Investigating Similarity Differences for Light-Water-Moderated and Polyethylene-Moderated Systems

Oak Ridge National Laboratory has performed validation studies in support of Pacific Northwest Laboratory’s analysis of the Sum-of-Fractions method. Work in a companion paper examines the validation methods and results for various mixtures of fissile isotopes in various concentrations moderated and reflected by light-water and polyethylene. Those results indicate a greater coverage of critical experiments for validating light water moderated and reflected systems vs. those with polyethylene. The work presented here details the analysis of differences between light-water and polyethylene systems developed from the different concentration mixtures utilized in the Sum-of-Fractions validation study. Differences in actinide contributions are detailed, explaining the differences in ck for the various systems. The available tools and analysis techniques in TSUNAMI are described to illustrate how these types of differences can be understood by practitioners.

07 ISOTOPE AND RADIATION SOURCES↗

Validation of the Nasa Integrated Medical Model: a Space Flight Medical Risk Prediction Tool

The Human Research Program funded the development of the Integrated Medical Model (IMM) to quantify the medical component of overall mission risk. The IMM uses Monte Carlo simulation methodology, incorporating space flight and ground medical data, to estimate the probability of mission medical outcomes and resource utilization. To determine the credibility of IMM output, the IMM project team completed two validation studies that compared IMM predicted output to observed medical events from a selection of Shuttle Transportation System (STS) and International Space Station (ISS) missions. The validation study results showed that the IMM underpredicted the occurrence of ~10% of the modeled medical conditions for the STS missions and overpredicted ~20% of the modeled medical conditions for the ISS missions. These findings imply that the strength of IMM predictions to inform decisions depends on simulated mission specifications including length. This discrepancy could result from medical recording differences between ISS and STS that possibly influence observed incidence rates, IMM combining all "mission type" data as constant occurrence rate or fixed proportion across both mission types, misspecification of symptoms to conditions, and gaps in the literature informing the model. Some of these issues will be alleviated by updating the IMM source data through incorporation of the observed validation data.

medical equipment↗

Validation of the NASA Integrated Medical Model: a Space Flight Medical Risk Prediction Tool

The Human Research Program funded the development of the Integrated Medical Model (IMM) to quantify the medical component of overall mission risk. The IMM uses Monte Carlo simulation methodology, incorporating space flight and ground medical data, to estimate the probability of mission medical outcomes and resource utilization. To determine the credibility of IMM output, the IMM project team completed two validation studies that compared IMM predicted output to observed medical events from a selection of Shuttle Transportation System (STS) and International Space Station (ISS) missions. The validation study results showed that the IMM underpredicted the occurrence of ~10% of the modeled medical conditions for the STS missions and overpredicted ~20% of the modeled medical conditions for the ISS missions. These findings imply that the strength of IMM predictions to inform decisions depends on simulated mission specifications including length. This discrepancy could result from medical recording differences between ISS and STS that possibly influence observed incidence rates, IMM combining all "mission type" data as constant occurrence rate or fixed proportion across both mission types, misspecification of symptoms to conditions, and gaps in the literature informing the model. Some of these issues will be alleviated by updating the IMM source data through incorporation of the observed validation data.

risk assessment↗

Evaluation of micromilling/conventional isotope ratio mass spectrometry and secondary ion mass spectrometry of δ 18 O values in fish otoliths for sclerochronology

Stable oxygen isotope ratios (δ 18 O values) measured in fish otoliths can provide valuable detailed information on fish life history, fish age determination, and ocean thermography. Traditionally, otoliths are sampled by micromilling followed by isotope ratio mass spectrometry (IRMS), but direct analysis by secondary ion mass spectrometry (SIMS) is becoming more common. However, these two methods have not been compared to determine which, if either, is better for fish age validation studies. Hence, the goals were to: (1) determine if the δ 18 O signatures from the two different methods are similar, (2) determine which method is better for fish age validation studies, and (3) examine biogeographic and migration history. Both analytical techniques, micromilling/IRMS and SIMS, were used to measure δ 18 O values in six Pacific cod (Gadus macrocephalus) otoliths. A series of measurements was made from the center of each otolith to its edge to develop a life-history δ 18 O signature for each fish. The sampling resolution of SIMS analyses was 2–3 times greater than that obtained by micromilling/IRMS. We found an offset between SIMS and micromilling/IRMS δ 18 O values, about 0.5‰ on average, with SIMS yielding lower values. However, the δ 18 O patterns from both methods (i.e., the number of δ 18 O maxima) correspond to the estimated age determined by otolith growth-zone counts, validating fish age determination methods. Both techniques resolved δ 18 O life-history signatures and showed patterns consistent with seasonal variation in temperatures and changes due to fish migration. When otoliths are large, micromilling/IRMS can provide adequate resolution for fish age validation. Finally, SIMS is the better option if greater sampling resolution is required, such as when otoliths are small or specimens are longer lived and have compact growth zones.

54 ENVIRONMENTAL SCIENCES↗