Search NASA⌕ Search

SEARCH · Search NASA

Results for “Computational Method Validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

Study of Whisper Statistics for Criticality Safety Code Validation

Whisper is computational software designed to assist with validation studies with the Monte Carlo particle transport package MCNP. Historical approaches rely on expert based judgment to select benchmarks while Whisper uses sensitivity/uncertainty (S/U) methods to select relevant benchmarks to a particular application model. Whisper will also derive a calculational margin and margin of subcriticality (MOS) that may be used to generate an upper subcritical limit (USL) for a particular application model. Whisper finds benchmark experiments whose isotope sensitivity profiles align best with the MCNP model in question, and assign a correlation coefficient ('ck' in Whisper parlance) to each selected benchmark as a measure of how closely those profiles agree. When ck values are high, there is less uncertainty between model and benchmarks and a higher USL is possible, relative to cases when ck values are low. The default Whisper settings recommends a 100,000 particles per cycle run for 500 active cycles, resulting in 50 M active neutron histories per application run. This is computationally intensive and may not be necessary to produce accurate results. A Whisper statistical study was done varying the neutron histories per cycle from 10,000 to the default 100,000. A lower number of neutron histories will allow Whisper to be used on low memory systems such as laptops. The intent of this paper is to present the changes in the Whisper results as the number of neutrons histories run is varied.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Correction for FDG PET dose extravasations: Monte Carlo validation and quantitative evaluation of patient studies

Purpose: Current procedure guidelines for whole body [18F]fluoro-2-deoxy-D-glucose (FDG)-positron emission tomography (PET) state that studies with visible dose extravasations should be rejected for quantification protocols. Our work is focused on the development and validation of methods for estimating extravasated doses in order to correct standard uptake value (SUV) values for this effect in clinical routine. Methods: One thousand three hundred sixty-seven consecutive whole body FDG-PET studies were visually inspected looking for extravasation cases. Two methods for estimating the extravasated dose were proposed and validated in different scenarios using Monte Carlo simulations. All visible extravasations were retrospectively evaluated using a manual ROI based method. In addition, the 50 patients with higher extravasated doses were also evaluated using a threshold-based method. Results: Simulation studies showed that the proposed methods for estimating extravasated doses allow us to compensate the impact of extravasations on SUV values with an error below 5%. The quantitative evaluation of patient studies revealed that paravenous injection is a relatively frequent effect (18%) with a small fraction of patients presenting considerable extravasations ranging from 1% to a maximum of 22% of the injected dose. A criterion based on the extravasated volume and maximum concentration was established in order to identify this fraction of patients that might be corrected for paravenous injection effect. Conclusions: The authors propose the use of a manual ROI based method for estimating the effectively administered FDG dose and then correct SUV quantification in those patients fulfilling the proposed criterion.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Processing Aleatory and Epistemic Uncertainties in Experimental Data From Sparse Replicate Tests of Stochastic Systems for Real-Space Model Validation

This paper presents a practical methodology for propagating and processing uncertainties associated with random measurement and estimation errors (that vary from test-to-test) and systematic measurement and estimation errors (uncertain but similar from test-to-test) in inputs and outputs of replicate tests to characterize response variability of stochastically varying test units. Also treated are test condition control variability from test-to-test and sampling uncertainty due to limited numbers of replicate tests. These aleatory variabilities and epistemic uncertainties result in uncertainty on computed statistics of output response quantities. The methodology was developed in the context of processing experimental data for “real-space” (RS) model validation comparisons against model-predicted statistics and uncertainty thereof. The methodology is flexible and sufficient for many types of experimental and data uncertainty, offering the most extensive data uncertainty quantification (UQ) treatment of any model validation method the authors are aware of. It handles both interval and probabilistic uncertainty descriptions and can be performed with relatively little computational cost through use of simple and effective dimension- and order-adaptive polynomial response surfaces in a Monte Carlo (MC) uncertainty propagation approach. A key feature of the progressively upgraded response surfaces is that they enable estimation of propagation error contributed by the surrogate model. Sensitivity analysis of the relative contributions of the various uncertainty sources to the total uncertainty of statistical estimates is also presented. Finally, the methodologies are demonstrated on real experimental validation data involving all the mentioned sources and types of error and uncertainty in five replicate tests of pressure vessels heated and pressurized to failure. Simple spreadsheet procedures are used for all processing operations.

97 MATHEMATICS AND COMPUTING↗

Systems and methods for enhanced power system model validation

A system for enhanced power system model validation is provided. The system includes a computing device including at least one processor in communication with at least one memory device. The at least one processor is programmed to store a plurality of models for a plurality of devices and a plurality of input files associated with the plurality of models, receive, from a user, a selection of model of the plurality of models to simulate, retrieve one or more input files of the plurality of input files, perform a model validity check on the selected model, if the selected model passed the model validity check, perform a model calibration on the selected model, and if the selected model passed the model calibration, perform a post evaluation on the selected model.

Wang, Honggang↗

Creation of the VADER Code in SCALE [Slides]

This presentation details the creation of Validation Analysis Data Evaluation Resource (VADER) code in SCALE. This lecture highlights the USLSTATS program written in JAVA and its history. Additionally, it covers the integration of VADER with SCALE along with features and background information.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Augmented Lagrangian formulation of orbital-free density functional theory

We present an Augmented Lagrangian formulation and its real-space implementation for non-periodic Orbital-Free Density Functional Theory (OF-DFT) calculations. In particular, we rewrite the constrained minimization problem of OF-DFT as a sequence of minimization problems without any constraint, thereby making it amenable to powerful unconstrained optimization algorithms. Further, we develop a parallel implementation of this approach for the Thomas–Fermi–von Weizsacker (TFW) kinetic energy functional in the framework of higher-order finite-differences and the conjugate gradient method. With this implementation, we establish that the Augmented Lagrangian approach is highly competitive compared to the penalty and Lagrange multiplier methods. Additionally, we show that higher-order finite-differences represent a computationally efficient discretization for performing OF-DFT simulations. Overall, we demonstrate that the proposed formulation and implementation are both efficient and robust by studying selected examples, including systems consisting of thousands of atoms. We validate the accuracy of the computed energies and forces by comparing them with those obtained by existing plane-wave methods.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

What Is the Best Way to Contour Lung Tumors on PET Scans? Multiobserver Validation of a Gradient-Based Method Using a NSCLC Digital PET Phantom

Purpose: To evaluate the accuracy and consistency of a gradient-based positron emission tomography (PET) segmentation method, GRADIENT, compared with manual (MANUAL) and constant threshold (THRESHOLD) methods. Methods and Materials: Contouring accuracy was evaluated with sphere phantoms and clinically realistic Monte Carlo PET phantoms of the thorax. The sphere phantoms were 10-37 mm in diameter and were acquired at five institutions emulating clinical conditions. One institution also acquired a sphere phantom with multiple source-to-background ratios of 2:1, 5:1, 10:1, 20:1, and 70:1. One observer segmented (contoured) each sphere with GRADIENT and THRESHOLD from 25% to 50% at 5% increments. Subsequently, seven physicians segmented 31 lesions (7-264 mL) from 25 digital thorax phantoms using GRADIENT, THRESHOLD, and MANUAL. Results: For spheres <20 mm in diameter, GRADIENT was the most accurate with a mean absolute % error in diameter of 8.15% (10.2% SD) compared with 49.2% (51.1% SD) for 45% THRESHOLD (p < 0.005). For larger spheres, the methods were statistically equivalent. For varying source-to-background ratios, GRADIENT was the most accurate for spheres >20 mm (p < 0.065) and <20 mm (p < 0.015). For digital thorax phantoms, GRADIENT was the most accurate (p < 0.01), with a mean absolute % error in volume of 10.99% (11.9% SD), followed by 25% THRESHOLD at 17.5% (29.4% SD), and MANUAL at 19.5% (17.2% SD). GRADIENT had the least systematic bias, with a mean % error in volume of -0.05% (16.2% SD) compared with 25% THRESHOLD at -2.1% (34.2% SD) and MANUAL at -16.3% (20.2% SD; p value <0.01). Interobserver variability was reduced using GRADIENT compared with both 25% THRESHOLD and MANUAL (p value <0.01, Levene's test). Conclusion: GRADIENT was the most accurate and consistent technique for target volume contouring. GRADIENT was also the most robust for varying imaging conditions. GRADIENT has the potential to play an important role for tumor delineation in radiation therapy planning and response assessment.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Clinical Validation of Atlas-Based Auto-Segmentation of Multiple Target Volumes and Normal Tissue (Swallowing/Mastication) Structures in the Head and Neck

Purpose: To validate and clinically evaluate autocontouring using atlas-based autosegmentation (ABAS) of computed tomography images. Methods and Materials: The data from 10 head-and-neck patients were selected as input for ABAS, and neck levels I-V and 20 organs at risk were manually contoured according to published guidelines. The total contouring times were recorded. Two different ABAS strategies, multiple and single subject, were evaluated, and the similarity of the autocontours with the atlas contours was assessed using Dice coefficients and the mean distances, using the leave-one-out method. For 12 clinically treated patients, 5 experienced observers edited the autosegmented contours. The editing times were recorded. The Dice coefficients and mean distances were calculated among the clinically used contours, autocontours, and edited autocontours. Finally, an expert panel scored all autocontours and the edited autocontours regarding their adequacy relative to the published atlas. Results: The time to autosegment all the structures using ABAS was 7 min/patient. No significant differences were observed in the autosegmentation accuracy for stage N0 and N+ patients. The multisubject atlas performed best, with a Dice coefficient and mean distance of 0.74 and 2 mm, 0.67 and 3 mm, 0.71 and 2 mm, 0.50 and 2 mm, and 0.78 and 2 mm for the salivary glands, neck levels, chewing muscles, swallowing muscles, and spinal cord-brainstem, respectively. The mean Dice coefficient and mean distance of the autocontours vs. the clinical contours was 0.8 and 2.4 mm for the neck levels and salivary glands, respectively. For the autocontours vs. the edited autocontours, the mean Dice coefficient and mean distance was 0.9 and 1.6 mm, respectively. The expert panel scored 100% of the autocontours as a 'minor deviation, editable' or better. The expert panel scored 88% of the edited contours as good compared with 83% of the clinical contours. The total editing time was 66 min. Conclusion: Multiple-subject ABAS of computed tomography images proved to be a useful novel tool in the rapid delineation of target and normal tissues. Although editing of the autocontours is inevitable, a substantial time reduction was achieved using editing, instead of manual contouring (180 vs. 66 min).

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Validation testing of the Canberra mobile Feed Roll Assay system - 15404

Japanese farmers grow various grasses as feed for cattle. These are rolled up and sealed for future use. Canberra has created a special truck to monitor these Feed Rolls, called 'Feed Roll Assay System [FRAS]'. On the bed of the truck is the shield containing a large NaI detector. The detector is 3x5x16'' in size, the same size as used in the Canberra FastScan Whole Body Counter. The detector is also LED-stabilized, to keep the gain constant under the wide range of temperature variations expected for this outdoor measurement instrument. The Canberra Osprey digital MCA is connected to the detector. The detector and the MCA are housed in a water proof box, which is surrounded on the bottom and all sides by a 15 cm thick steel shield. A portion of the shield at the top is open where the detector can view the Feed Rolls placed there. A single ethernet cable goes to a laptop PC which provides power to the MCA and detector, and also transmits the signal to the PC. The system was calibrated using MCNP for a variety of different densities, and Feed Roll sizes. The Japanese version of the Canberra Genie software is used to analyze the spectra and compute the Bq/kg concentration of the Feed Roll. The shielding is sufficient so that at a 5 uSv/hr background dose rate, no Cs-137 or Cs-134 peaks were detected in a 1 hour count. Measurements were performed in 0.2 uSv/hr dose rate, using uncontaminated Feed Rolls at various counting times. The MDA for Cs-137 was 11.9 Bq/kg at 30 seconds, 8.2 Bq/kg for 60 seconds, and 1.1 Bq/kg at 3600 seconds count time. The relative measurement uncertainty of the FRAS measurements was 9.4 to 13%, as compared to assays of samples extracted [30-45%] and in-situ Ge measurements [6.0 - 7.1%]. The FRAS measurement results have considerably better precision than measurements of samples extracted from the Feed Rolls, and are much faster than the in-situ Ge measurements and have just about the same uncertainty. (authors)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Shock compression response of cold-rolled Ni/Al multilayer composites

Uniaxial strain, plate-on-plate impact experiments were performed on cold-rolled Ni/Al multilayer composites and the resulting Hugoniot was determined through time-resolved measurements combined with impedance matching. The experimental Hugoniot agreed with that previously predicted by two dimensional (2D) meso-scale calculations. Additional 2D meso-scale simulations were performed using the same computational method as the prior study to reproduce the experimentally measured free surface velocities and stress profiles. Finally, these simulations accurately replicated the experimental profiles, providing additional validation for the previous computational work.

36 MATERIALS SCIENCE↗

Corrigendum to “The Schwarz alternating method in solid mechanics” [Comput. Methods Appl. Mech. Engrg. 319 (2017) 19–51]

This corrigendum clarifies the conditions under which the proof of convergence of Theorem 1 from the original article is valid. We erroneously stated as one of the conditions for the Schwarz alternating method to converge that the energy functional be strictly convex for the solid mechanics problem. Finally, we have relaxed that assumption and changed the corresponding parts of the text. None of the results or other parts of the original article are affected.

36 MATERIALS SCIENCE↗

Analysis of Rig Parameter Data Using Drilling Process Modeling Constraints, Volume 5: Utah FORGE Well 16B(78)-32

Drill rig parameter measurements are routinely used during deep well construction to monitor and guide drilling conditions for improved performance and reduced costs. While insightful into the drilling process, these measurements are of reduced value without a standard to aid in data evaluation and decision making. In the main body of this work (Volume 1), a method is demonstrated whereby rock reduction model constraints are used to interpret drilling response parameters; the method could be applied in real-time to improve decision-making in the field and to further discern technology performance during post-drilling evaluations. Drilling parameters are evaluated using laboratory-validated rock reduction models for predicting the phenomenological response of drag bits (Detournay and Defourny, 1992) in computational algorithms. The method presented has applicability to development of advanced analytics on future geothermal wells using real-time electronic data recording for improved performance and reduced drilling costs. A drilling cost model is also used to show the tradeoff between rate of penetration and bit life and the influence on interval drilling costs. Details of the bit specifications and performance are cataloged in an independent volume, documented under separate cover, for each of the four wells, and include Volume 2: Utah FORGE 16A(78)-32; Volume 3: Utah FORGE 56-32; Volume 4: Utah FORGE 78B-32 and Volume 5: Utah FORGE 16B(78)-32.

15 GEOTHERMAL ENERGY↗

Analysis of Rig Parameter Data Using Drilling Process Modeling Constraints, Volume 4: Utah FORGE Well 78B-32

Drill rig parameter measurements are routinely used during deep well construction to monitor and guide drilling conditions for improved performance and reduced costs. While insightful into the drilling process, these measurements are of reduced value without a standard to aid in data evaluation and decision making. In the main body of this work (Volume 1), a method is demonstrated whereby rock reduction model constraints are used to interpret drilling response parameters; the method could be applied in real-time to improve decision-making in the field and to further discern technology performance during post-drilling evaluations. Drilling parameters are evaluated using laboratory-validated rock reduction models for predicting the phenomenological response of drag bits (Detournay and Defourny, 1992) in computational algorithms. The method presented has applicability to development of advanced analytics on future geothermal wells using real-time electronic data recording for improved performance and reduced drilling costs. A drilling cost model is also used to show the tradeoff between rate of penetration and bit life and the influence on interval drilling costs. Details of the bit specifications and performance are cataloged in an independent volume, documented under separate cover, for each of the four wells, and include Volume 2: Utah FORGE 16A(78)-32; Volume 3: Utah FORGE 56-32; Volume 4: Utah FORGE 78B-32 and Volume 5: Utah FORGE 16B(78)-32.

15 GEOTHERMAL ENERGY↗

Analysis of Rig Parameter Data Using Drilling Process Modeling Constraints, Volume 3: Utah FORGE Well 56-32

Drill rig parameter measurements are routinely used during deep well construction to monitor and guide drilling conditions for improved performance and reduced costs. While insightful into the drilling process, these measurements are of reduced value without a standard to aid in data evaluation and decision making. In the main body of this work (Volume 1), a method is demonstrated whereby rock reduction model constraints are used to interpret drilling response parameters; the method could be applied in real-time to improve decision-making in the field and to further discern technology performance during post-drilling evaluations. Drilling parameters are evaluated using laboratory-validated rock reduction models for predicting the phenomenological response of drag bits (Detournay and Defourny, 1992) in computational algorithms. The method presented has applicability to development of advanced analytics on future geothermal wells using real-time electronic data recording for improved performance and reduced drilling costs. A drilling cost model is also used to show the tradeoff between rate of penetration and bit life and the influence on interval drilling costs. Details of the bit specifications and performance are cataloged in an independent volume, documented under separate cover, for each of the four wells, and include Volume 2: Utah FORGE 16A(78)-32; Volume 3: Utah FORGE 56-32; Volume 4: Utah FORGE 78B-32 and Volume 5: Utah FORGE 16B(78)-32.

15 GEOTHERMAL ENERGY↗

Analysis of Rig Parameter Data Using Drilling Process Modeling Constraints, Volume 1: Summary of Utah FORGE Wells 16A(78)-32, 56-32, 78B-32 and 16B(78)-32

Drill rig parameter measurements are routinely used during deep well construction to monitor and guide drilling conditions for improved performance and reduced costs. While insightful into the drilling process, these measurements are of reduced value without a standard to aid in data evaluation and decision making. In the main body of this work (Volume 1), a method is demonstrated whereby rock reduction model constraints are used to interpret drilling response parameters; the method could be applied in real-time to improve decision-making in the field and to further discern technology performance during post-drilling evaluations. Drilling parameters are evaluated using laboratory-validated rock reduction models for predicting the phenomenological response of drag bits (Detournay and Defourny, 1992) in computational algorithms. The method presented has applicability to development of advanced analytics on future geothermal wells using real-time electronic data recording for improved performance and reduced drilling costs. A drilling cost model is also used to show the tradeoff between rate of penetration and bit life and the influence on interval drilling costs. Details of the bit specifications and performance are cataloged in an independent volume, documented under separate cover, for each of the four wells, and include Volume 2: Utah FORGE 16A(78)-32; Volume 3: Utah FORGE 56-32; Volume 4: Utah FORGE 78B-32 and Volume 5: Utah FORGE 16B(78)-32.

15 GEOTHERMAL ENERGY↗

Numerical implementation, verification and validation of two-phase flow four-equation drift flux model with Jacobian-free Newton–Krylov method

This study presents a numerical investigation on using the Jacobian-free Newton–Krylov (JFNK) method to solve the two-phase flow four-equation drift flux model with realistic constitutive correlations (‘closure models’). The drift flux model is based on Isshi and his collaborators’ work. Additional constitutive correlations for vertical channel flow, such as two-phase flow pressure drop, flow regime map, wall boiling and interfacial heat transfer models, were taken from the RELAP5-3D Code Manual and included to complete the model. The staggered grid finite volume method and fully implicit backward Euler method was used for the spatial discretization and time integration schemes, respectively. The Jacobian-free Newton–Krylov method shows no difficulty in solving the two-phase flow drift flux model with a discrete flow regime map. In addition to the Jacobian-free approach, the preconditioning matrix is obtained by using the default finite differencing method provided in the PETSc package, and consequently the labor-intensive implementation of complex analytical Jacobian matrix is avoided. Extensive and successful numerical verification and validation have been performed to prove the correct implementation of the models and methods. Code-to-code comparison with RELAP5-3D has further demonstrated the successful implementation of the drift flux model.

42 ENGINEERING↗

Energy Smart Management of Scientific Data

Scientific data centers comprised of high-powered computing equipment and large capacity disk storage systems consume considerable amount of energy. Dynamic power management techniques (DPM) are commonly used for saving energy in disk systems. These involve powering down disks that exhibit long idle periods and placing them in standby mode. A file request from a disk in standby mode will incur both energy and performance penalties as it takes energy (and time) to spin up the disk before it can serve a file. For this reason, DPM has to make decisions as to when to transition the disk into standby mode such that the energy saved is greater than the energy needed to spin it up again and the performance penalty is tolerable. The length of the idle period until the DPM decides to power down a disk is called idlenessthreshold. In this paper, we study both analytically and experimentally dynamic power management techniques that save energy subject to performance constraints on file access costs. Based on observed workloads of scientific applications and disk characteristics, we provide a methodology for determining file assignment to disks and computing idleness thresholds that result in significant improvements to the energy saved by existing DPMsolutions while meeting response time constraints. We validate our methods with simulations that use traces taken from scientific applications.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

HYDRODYNAMIC ANALYSIS OF MACROALGAE LOCAL MODEL USING COMPUTATIONAL FLUID DYNAMICS

In this article, a local scale, fully nonlinear coupled fluid-structural interaction (FSI) sugar kelp model has been developed using a computational fluid dynamics (CFD) method. In this model, to be consistent with available experimental data, the sugar kelp is approximated as elongated rectangles with smoothed isosceles triangles at the ends and a single kelp model with one end fixed in a channel with constant current model is developed. Several different current speeds are simulated, and the resulting drag forces and calculated drag coefficients are validated by comparison with experimental data from the literature. In a previous study, a global scale model was developed using a computational structural dynamics (CSD) method to simulate macroalgae farming system and guide the system configuration design. In the global scale model, the hydrodynamic forces are calculated using Morison’s equation and the kinematics and dynamics of the sugar kelp are simplified and the group of kelps attached to the long line is modeled as a slender structure with the same length and an effective diameter such that the volumes are consistent with the real physical system. This simplified model matches the weight and buoyancy but adjusting the hydrodynamic properties when the general hydrodynamic coefficients are employed. Therefore, optimal hydrodynamic coefficients used in global scale model were determined to obtain the hydrodynamic force more accurately. The validated local scale model is then be applied to determine the hydrodynamic coefficients of the simplified sugar kelp model for global dynamic analysis.

hydrodynamic modeling, macroalgae, CFD model↗