Search NASA⌕ Search

SEARCH · Search NASA

Results for “Validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 757 records · Page 42

Plasma Levels of IL-8 and TGF-β1 Predict Radiation-Induced Lung Toxicity in Non-Small Cell Lung Cancer: A Validation Study

Purpose and Objectives: We previously reported that the combination of mean lung dose (MLD) and inflammatory cytokines interleukin-8 (IL-8) and transforming growth factor-β1 (TGF-β1) may provide a more accurate model for radiation-induced lung toxicity (RILT) prediction in 58 patients with non-small cell lung cancer (NSCLC). This study is to validate the previous findings with new patients and to explore new models with more cytokines. Methods and Materials: One hundred forty-two patients with stage I-III NSCLC treated with definitive radiation therapy (RT) from prospective studies were included. Sixty-five new patients were used to validate previous findings, and all 142 patients were used to explore new models. Thirty inflammatory cytokines were measured in plasma samples before RT and 2 weeks and 4 weeks during RT (pre, 2w, 4w). Grade ≥2 RILT was defined as grade 2, and higher radiation pneumonitis or symptomatic pulmonary fibrosis was the primary endpoint. Logistic regression was performed to evaluate the risk factors of RILT. The area under the curve (AUC) for the receiver operating characteristic curves was used for model assessment. Results: Sixteen of 65 patients (24.6%) experienced RILT2. Lower pre IL-8 and higher TGF-β1 2w/pre ratio were associated with higher risk of RILT2. The AUC increased to 0.73 by combining MLD, pre IL-8, and TGF-β1 2w/pre ratio compared with 0.61 by MLD alone to predict RILT. In all 142 patients, 29 patients (20.4%) experienced grade ≥2 RILT. Among the 30 cytokines measured, only IL-8 and TGF-β1 were significantly associated with the risk of RILT2. MLD, pre IL-8 level, and TGF-β1 2w/pre ratio were included in the final predictive model. The AUC increased to 0.76 by combining MLD, pre IL-8, and TGF-β1 2w/pre ratio compared with 0.62 by MLD alone. Conclusions: We validated that a combination of mean lung dose, pre IL-8 level, and TGF-β1 2w/pre ratio provided a more accurate model to predict the risk of RILT2 compared with MLD alone.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

First-In-Human Validation of CT-Based Proton Range Prediction Using Prompt Gamma Imaging in Prostate Cancer Treatments

Uncertainty in computed tomography (CT)-based range prediction substantially impairs the accuracy of proton therapy. Direct determination of the stopping-power ratio (SPR) from dual-energy CT (DECT) has been proposed (DirectSPR), and initial validation studies in phantoms and biological tissues have proven a high accuracy. However, a thorough validation of range prediction in patients has not yet been achieved by any means. Here, we present the first systematic validation of CT-based proton range prediction in patients using prompt gamma imaging (PGI).

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Systematic validation of non-equilibrium thermochemical models using Bayesian inference

The validation process proposed by Babuška et al. [1] is applied to thermochemical models describing post-shock flow conditions. In this validation approach, experimental data is involved only in the calibration of the models, and the decision process is based on quantities of interest (QoIs) predicted on scenarios that are not necessarily amenable experimentally. Moreover, uncertainties present in the experimental data, as well as those resulting from an incomplete physical model description, are propagated to the QoIs. We investigate four commonly used thermochemical models: a one-temperature model (which assumes thermal equilibrium among all inner modes), and two-temperature models developed by Macheret et al. [2], Marrone and Treanor [3], and Park [4]. Up to 16 uncertain parameters are estimated using Bayesian updating based on the latest absolute volumetric radiance data collected at the Electric Arc Shock Tube (EAST) installed inside the NASA Ames Research Center. Following the solution of the inverse problems, the forward problems are solved in order to predict the radiative heat flux, QoI, and examine the validity of these models. Our results show that all four models are invalid, but for different reasons: the one-temperature model simply fails to reproduce the data while the two-temperature models exhibit unacceptably large uncertainties in the QoI predictions.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Development and validation of a quantitative proton NMR method for the analysis of pregnenolone

Pregnenolone (PREG) is an endogenous steroid frequently sold as an over-the-counter dietary supplement touted to promote neurological and immunological health. While the PREG dietary supplement is added to the diet for health benefits, there are no FDA approved PREG drugs. However, compounded PREG drug products are available to U.S. patients. The FDA works with state regulatory authorities on the oversight of compounding activities, including developing 503A and 503B lists of bulk substances that compounders are permitted to use. PREG is one of the substances publicly nominated to be included on the 503B list. Compounded hormone therapies such as those using PREG are of interest given the lack of standardization in compounded drug products which may increase the possibility of underdosing, overdosing, or contamination. However, no USP monograph currently exists to evaluate the quality of PREG drug substance or product. To address knowledge gaps and assist in quality control, a simple and rapid quantitative proton nuclear magnetic resonance spectroscopy (qNMR) method for the identification and assay of PREG in different types of PREG products was developed and validated. PREG samples were characterized using 1D 1 H and 2D 1 H– 13 C HSQC NMR spectra. The qNMR assay method (taking approximately 10 min per NMR spectrum) was validated for precision, accuracy, specificity, robustness and linearity per ICH Q2(R1) guidance. The method was validated in a range from 0.032 to 3.2 mg/mL. As a proof of concept, seven PREG bulk substance samples, three tablet and two capsule PREG dietary supplements were assessed by the qNMR analytical procedure. NMR data from all tested samples met the expected criteria for identification and assay. The results demonstrate the potential of qNMR for the quality assessment of different types of PREG samples.

60 APPLIED LIFE SCIENCES↗

Validation of electron backscattering in the MCNP6.3 code

A new electron backscattering validation suite has been developed for the MCNP® code. The calculations in this suite cover both condensed history and single-event transport methods, seven different elemental materials ranging from beryllium to uranium, and incident electron energies from 200 eV to 14.1 MeV. In general, the accuracy of the MCNP code for electron backscattering calculations is energy-dependent. For incident electron energies below 2 keV, the condensed history method is not applied while the single-event method shows poor agreement with experimental measurements due to poor accuracy of the underlying atomic data. For incident energies between 2 keV and 256 keV, the single-event method typically shows better agreement with experiments, while for incident energies above 256 keV the condensed history method gives better accuracy. Additionally, agreement with experimental data is generally worse for low- Z materials such as beryllium and carbon, which may reflect deficiencies in the data or physics underlying electron transport through light elements in the MCNP code. The new electron backscattering validation suite, along with the previously introduced electron stopping power and Lockwood energy deposition validation suites, provide MCNP users with a quantified understanding of the uncertainties in electron transport calculations. Future improvements to electron transport in the MCNP code are necessary for low energies (≤ 2 keV) and for low- Z materials.

36 MATERIALS SCIENCE↗

Undesirable Flow Behavior in a Proposed Validation Data Set

The next generation nuclear plant (NGNP), whose development is supported by the U. S. Department of Energy, will be a very high temperature reactor (VHTR). The VHTR is a single-phase helium-cooled reactor that will provide helium at up to 1000 C. The prospect of a coolant at these temperatures circulating in the reactor vessel demands that careful analysis be performed to ensure that excessively hot spots are not created and that sufficient mixing of the coolant is obtained. Computational fluid dynamics (CFD) coupled with heat transfer will be used to perform the desired analyses. However, primarily because of the imperfect nature of modeling turbulent flow, any CFD calculations used to perform nuclear reactor safety analysis must be validated against experimental data. Experimental data have been taken in a scaled section of the lower plenum of a prismatic VHTR at the matched index of refraction (MIR) facility at the Idaho National Laboratory. These data were taken with the intent that they be examined for use as validation data. A series of investigations have been conducted to assess the MIR data. Issues that have already been examined include the extent of the required computational domain, the outlet boundary condition, the inlet data and the effect of the turbulence model. One of the jets that flow into the model impacts on a wedge, which represents a portion of a hexagonal graphite block that lines the inner wall of the lower plenum. The nature of the flow below this particular jet is such that a randomly varying recirculation zone is created. This recirculation zone is seen to change in size, causing a relatively long-time scale of motion or disturbance of the flow in the model. It is concluded that such a feature is undesirable in a validation data set, firstly because of its apparent random nature and, secondly, because to obtain an appropriate long-time average would be impractical because of the compute time required. It is predicted computationally that by eliminating the first of the four inlet jets into the scaled model, the resulting recirculation zone is rendered stable.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Experimental validation of a high fidelity Monte Carlo neutron transport model of the MIT graphite exponential pile

High-fidelity modeling and simulation were performed for the MIT graphite exponential pile (MGEP) using Monte Carlo neutron transport codes OpenMC and MCNP, and the results were validated by experimental data. The MGEP is being used as the test bed for the design of an autonomous control system for the pile's neutron flux distribution. The main contribution of this work is to generate the training data sets of neutron flux distributions with different locations of control rods that perturb the neutron flux profiles. First, code -to-code cross verification between OpenMC and MCNP was performed to ensure consistency of the numerical modeling within statistical uncertainties. To validate the accuracy of this high-fidelity model, a series of neutron flux measurements were conducted using a Helium-3 (He-3) neutron detector on a mobile platform that is placed inside the pile. Second, the neutron flux profiles were measured in four vertical layers of interest, and compared to the corresponding simulation results. The comparison results shows that the root mean square error is less than 2.5% in the two upper layers, and less than 4.5% in all four measured layers. Here the results validated the accuracy of the modeling and simulation. Finally, the relative change of the neutron flux profiles from moving control rods was analyzed, which identified the layer that has the best sensitivity regarding the control rods movements. Thus, this work identified and provided training data sets of both simulated and experimental neutron flux profiles in the most sensitive layer, paving the path forward to the real-time experimental demonstration of the autonomous control system.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Validation of an in vitro contractility assay using canine ventricular myocytes

Measurement of cardiac contractility is a logical part of pre-clinical safety assessment in a drug discovery project, particularly if a risk has been identified or is suspected based on the primary- or non-target pharmacology. However, there are limited validated assays available that can be used to screen several compounds in order to identify and eliminate inotropic liability from a chemical series. We have therefore sought to develop an in vitro model with sufficient throughput for this purpose. Dog ventricular myocytes were isolated using a collagenase perfusion technique and placed in a perfused recording chamber on the stage of a microscope at ∼ 36 °C. Myocytes were stimulated to contract at a pacing frequency of 1 Hz and a digital, cell geometry measurement system (IonOptix™) was used to measure sarcomere shortening in single myocytes. After perfusion with vehicle (0.1% DMSO), concentration–effect curves were constructed for each compound in 4–30 myocytes taken from 1 or 2 dog hearts. The validation test-set was 22 negative and 8 positive inotropes, and 21 inactive compounds, as defined by their effect in dog, cynolomolgous monkey or humans. By comparing the outcome of the assay to the known in vivo contractility effects, the assay sensitivity was 81%, specificity was 75%, and accuracy was 78%. With a throughput of 6–8 compounds/week from 1 cell isolation, this assay may be of value to drug discovery projects to screen for direct contractility effects and, if a hazard is identified, help identify inactive compounds. -- Highlights: ► Cardiac contractility is an important physiological function of the heart. ► Assessment of contractility is a logical part of pre-clinical drug safety testing. ► There are limited validated assays that predict effects of compounds on contractility. ► Using dog myocytes, we have developed an in vitro cardiac contractility assay. ► The assay predicted the in vivo contractility with a good level of accuracy.

60 APPLIED LIFE SCIENCES↗

Verification and validation for magnetic fusion

Dramatic progress in the scope and power of plasma simulations over the past decade has extended our understanding of these complex phenomena. However, as codes embody imperfect models for physical reality, a necessary step toward developing a predictive capability is demonstrating agreement, without bias, between simulations and experimental results. While comparisons between computer calculations and experimental data are common, there is a compelling need to make these comparisons more systematic and more quantitative. Tests of models are divided into two phases, usually called verification and validation. Verification is an essentially mathematical demonstration that a chosen physical model, rendered as a set of equations, has been accurately solved by a computer code. Validation is a physical process which attempts to ascertain the extent to which the model used by a code correctly represents reality within some domain of applicability, to some specified level of accuracy. This paper will cover principles and practices for verification and validation including lessons learned from related fields.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Methodology for turbulence code validation: Quantification of simulation-experiment agreement and application to the TORPEX experiment

A methodology for plasma turbulence code validation is discussed, focusing on quantitative assessment of the agreement between experiments and simulations. The present work extends the analysis carried out in a previous paper [P. Ricci et al., Phys. Plasmas 16, 055703 (2009)] where the validation observables were introduced. Here, it is discussed how to quantify the agreement between experiments and simulations with respect to each observable, how to define a metric to evaluate this agreement globally, and - finally - how to assess the quality of a validation procedure. The methodology is then applied to the simulation of the basic plasma physics experiment TORPEX [A. Fasoli et al., Phys. Plasmas 13, 055902 (2006)], considering both two-dimensional and three-dimensional simulation models.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Advances in validating gyrokinetic turbulence models against L- and H-mode plasmas

Robust validation of predictive turbulent transport models requires quantitative comparisons to experimental measurements at multiple levels, over a range of physically relevant conditions. Toward this end, a series of carefully designed validation experiments has been performed on the DIII-D tokamak [J. L. Luxon, Nucl. Fusion 42, 614 (2002)] to obtain comprehensive multifield, multipoint, multiwavenumber fluctuation measurements and their scalings with key dimensionless parameters. The results of two representative validation studies are presented: an elongation scaling study performed in beam heated L-mode discharges and an electron heating power scan performed in quiescent H-mode (QH-mode) discharges. A 50% increase in the elongation {kappa} is observed to lead to a {approx}50% increase in energy confinement time {tau}{sub e} and accompanying decrease in fluctuation levels, qualitatively consistent with a priori theoretical predictions and nonlinear GYRO [J. Candy and R. E. Waltz, J. Comput. Phys. 186, 545 (2003)] simulations. However, these simulations exhibit clear quantitative differences from experiment in the predicted magnitudes and trends with radius of turbulent fluxes and fluctuation levels which cannot be fully accounted for by uncertainties due to transport stiffness. In the QH-mode study, local nonlinear GYRO simulations that neglect fast ion effects show a similar proportional response to the applied electron cyclotron heating as the experiment, but overpredict the magnitudes of transport and fluctuation levels by a factor of 10 or more. Possible sources of this overprediction, namely nonlocal effects and self-consistent fast beam ions, are identified and discussed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Electromagnetic scattering problems -Numerical issues and new experimental approaches of validation

Electromagnetic scattering problems, thus the question how radiated energy spreads when impinging on an object, are an essential part of wave propagation. Though the Maxwell’s differential equations as starting point, are actually quite simple,the integral formulation of an object’s boundary conditions, respectively the solution for unknown induced currents can only be solved numerically in most cases.As a timely topic of practical importance the scattering of rotating wind turbines is discussed, the numerical description of which is still based on rigorous approximations with yet unspecified accuracy. In this context the issue of validating numerical solutions is addressed, both with reference simulations but in particular with the experimental approach of scaled measurements. For the latter the idea of an incremental validation is proposed allowing a step by step validation of required new mathematical models in scattering theory.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

SCALE 6.2.4 Validation for Light Water Reactor Decay Heat Analysis

Energy release from the decay of radionuclides in nuclear fuel after its discharge from reactor is a critical parameter for design, safety, and licensing analyses of used nuclear fuel storage, transportation, and repository systems. Well-validated computational tools and nuclear data are essential for decay heat prediction. This paper summarizes the validation of the SCALE nuclear analysis code system version 6.2.4, used with ENDF/B-VII.1 libraries, for decay heat analysis of light water reactor used fuel. The experimental data used for validation include full-assembly decay heat measurements that cover assembly burnups of 5 to 51 GWd/tonne U, cooling times after discharge in the 2- to 27-year range, and initial fuel enrichments up to 4 wt% 235U. The comparison between calculated (C) and experimental (E) decay heat showed very good agreement, with an average C/E over all considered measurements of 1.006 (σ = 0.016) for pressurized water reactor and 0.984 (σ = 0.077) for boiling water reactor assembly measurements. The effect of using assembly-average versus axially varying modeling data on the calculated decay heat, important to thermal analyses for used fuel transportation and storage systems, is discussed.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Benchmark of the Chlorine Worth Study Experiments in Support of Chlorine Nuclear Data Validation for Nuclear Criticality Safety

The Chlorine Worth Study (CWS) was a critical experiment to address an urgent need for thermal chlorine nuclear data validation in plutonium systems. This urgent need is tied directly to plutonium recycle and recovery operations in the plutonium facility at Los Alamos National Laboratory, where exceptionally conservative criticality safety limits are used because no credit is taken for the neutron capture by chlorine. The experiment used weapons-grade plutonium metal plates clad in stainless steel, known as the PANN (plutonium aluminum no nickel) ZPPR (zero power physics reactor) plates. The plutonium was reflected and moderated by high-density polyethylene and included combinations of polyvinyl chloride (PVC) and chlorinated polyvinyl chloride (CPVC) as absorbers. The experiment and benchmark included three configurations mimicking 30 g 239 Pu/L plutonium, 300 g 239 Pu/L plutonium, and 600 g 239 Pu/L plutonium in an aqueous chloride solution. Uncertainties in the benchmark included five broad categories: (1) criticality measurement, (2) mass and density, (3) dimensions, (4) material compositions, and (5) positioning. The largest contribution to the overall uncertainties for all three cases came from the material compositions, in particular the PVC and CPVC absorber compositions. A detailed model was created to be a near match (that is within expectations of transport code users) and a simplified model was created to minimize offset dimensions and expedite modeling for code validation. Sample calculations were completed in MCNP6.3 with ENDF/B-VIII.0 and ENDF/B-VII.1 nuclear data. For the detailed and simplified models, the average difference between the computed and experimental k eff was 951 pcm. CWS will serve as the key validation experiment for nuclear criticality safety in support of aqueous chloride operations. The sensitivity to the chlorine capture cross section is orders of magnitude greater than other existing benchmarks. The current limits, as defined by nuclear criticality safety, are 520 g Pu per batch, i.e. the minimum critical mass of the Pu solution infinitely reflected by water [Criticality Handbook: Volume II, (1969)]. This extremely conservative critical mass limit does not credit any neutron capture by chlorine (in particular neutron capture by 35 Cl) and greatly impedes the throughput required for current and future operations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Validation of Kepler's multiple planet candidates. II. Refined statistical framework and descriptions of systems of special interest

We extend the statistical analysis performed by Lissauer et al. in 2012, which demonstrates that the overwhelming majority of Kepler candidate multiple transiting systems (multis) represents true transiting planets, and we develop therefrom a procedure to validate large numbers of planet candidates in multis as bona fide exoplanets. We show that this statistical framework correctly estimates the abundance of false positives already identified around Kepler targets with multiple sets of transit-like signatures based on their abundance around targets with single sets of transit-like signatures. We estimate the number of multis that represent split systems of one or more planets orbiting each component of a binary star system. We use the high reliability rate for multis to validate more than one dozen particularly interesting multi-planet systems herein. Hundreds of additional multi-planet systems are validated in a companion paper by Rowe et al. We note that few very short period (P < 1.6 days) planets orbit within multiple transiting planet systems and discuss possible reasons for their absence. There also appears to be a shortage of planets with periods exceeding a few months in multis.

79 ASTRONOMY AND ASTROPHYSICS↗

Summary report of the 4th IAEA Technical Meeting on Fusion Data Processing, Validation and Analysis (FDPVA)

The objective of the Fourth Technical Meeting on Fusion Data Processing, Validation and Analysis was to provide a platform during which a set of topics relevant to fusion data processing, validation and analysis are discussed with the view of extrapolating needs to next step fusion devices such as ITER. The validation and analysis of experimental data obtained from diagnostics used to characterize fusion plasmas are crucial for a knowledge-based understanding of the physical processes governing the dynamics of these plasmas. This paper presents the recent progress and achievements in the domain of plasma diagnostics and synthetic diagnostics data analysis (including image processing, regression analysis, inverse problems, deep learning, machine learning, big data and physics-based models for control) reported at the meeting. The progress in these areas highlight trends observed in current major fusion confinement devices. A special focus is dedicated on data analysis requirements for ITER and DEMO with a particular attention paid to artificial intelligence for automatization and improving reliability of control processes.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Validation of FAST.Farm Against Large-Eddy Simulations

FAST.Farm is a new midfidelity, multiphysics engineering tool for modeling the power performance and structural loads of wind turbines within a wind farm, including wake and array effects. Previous calibration of the tuneable model parameters of FAST.Farm has shown that its prediction of wake dynamics for a single wind turbine across different atmospheric stability conditions and nacelle-yaw errors matches well with high-fidelity large-eddy simulation at a small fraction of the computational expense. This paper presents a validation of FAST.Farm against large-eddy simulation for a series of cases - independent from those used to support the calibration - considering single-turbine and small wind-farm scenarios, which are both subject to variations in inflow and control. The validation has demonstrated that FAST.Farm reasonably accurately predicts: (1) thrust and power for individual turbines both in isolation and down the row of the small wind farm, (2) wake meandering behavior across different atmospheric conditions, and (3) averaged wake-deficit advection, evolution, and merging effects. As a result, the validation also highlights potential physics that could be improved in FAST.Farm in the future.

17 WIND ENERGY↗

Application of SALSSA Framework to the Validation of Smoothed Particle Hydrodynamics Simulations of Low Reynolds Number Flows

The Support Architecture for Large-Scale Subsurface Analysis (SALSSA) provides an extensible framework, sophisticated graphical user interface (GUI), and underlying data management system that simplifies the process of running subsurface models, tracking provenance information, and analyzing the model results. The SALSSA software framework is currently being applied to validating the Smoothed Particle Hydrodynamics (SPH) model. SPH is a three-dimensional model of flow and transport in porous media at the pore scale. Fluid flow in porous media at velocities common in natural porous media occur at low Reynolds numbers and therefore it is important to verify that the SPH model is producing accurate flow solutions in this regime. Validating SPH requires performing a series of simulations and comparing these simulation flow solutions to analytical results or numerical results using other methods. This validation study is being facilitated by the SALLSA framework, which provides capabilities to setup, execute, analyze, and administer these SPH simulations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗