Search NASA⌕ Search

SEARCH · Search NASA

Results for “Verification.”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

The Redmapper galaxy cluster catalog from DES science verification data

We describe updates to the redMaPPer algorithm, a photometric red-sequence cluster finder specifically designed for large photometric surveys. The updated algorithm is applied to 150 deg{sup 2} of Science Verification (SV) data from the Dark Energy Survey (DES), and to the Sloan Digital Sky Survey (SDSS) DR8 photometric data set. The DES SV catalog is locally volume limited and contains 786 clusters with richness λ>20 (roughly equivalent to M{sub 500c}≳10{sup 14} h{sub 70}{sup −1} M{sub ⊙}) and 0.2<z<0.9. The DR8 catalog consists of 26,311 clusters with 0.08<z<0.6, with a sharply increasing richness threshold as a function of redshift for z≳0.35. The photometric redshift performance of both catalogs is shown to be excellent, with photometric redshift uncertainties controlled at the σ{sub z}/(1+z)∼0.01 level for z≲0.7, rising to ∼0.02 at z∼0.9 in DES SV. We make use of Chandra and XMM X-ray and South Pole Telescope Sunyaev–Zeldovich data to show that the centering performance and mass–richness scatter are consistent with expectations based on prior runs of redMaPPer on SDSS data. We also show how the redMaPPer photo-z and richness estimates are relatively insensitive to imperfect star/galaxy separation and small-scale star masks.

79 ASTRONOMY AND ASTROPHYSICS↗

Open-source MFIX-DEM software for gas–solids flows: Part I—Verification studies

With rapid advancements in computer hardware, it is now possible to perform large simulations of granular flows using the Discrete Element Method (DEM). As a result, solids are increasingly treated in a discrete Lagrangian fashion in the gas–solids flow community. In this paper, the open-source MFIX-DEM software is described that can be used for simulating the gas–solids flow using an Eulerian reference frame for the continuum fluid and a Lagrangian discrete framework (Discrete Element Method) for the particles. This method is referred to as the continuum discrete method (CDM) to clearly make a distinction between the ambiguity of using a Lagrangian or Eulerian reference for either continuum or discrete formulations. This freely available CDM code for gas–solids flows can accelerate the research in computational gas–solids flows and establish a baseline that can lead to better closures for the continuum modeling (or traditionally referred to as two fluid model) of gas–solids flows. In this paper, a series of verification cases is employed which tests the different aspects of the code in a systematic fashion by exploring specific physics in gas–solids flows before exercising the fully coupled solution on simple canonical problems. It is critical to have an extensively verified code as the physics is complex with highly-nonlinear coupling, and it is difficult to ascertain the accuracy of the results without rigorous verification. These series of verification tests set the stage not only for rigorous validation studies (performed in part II of this paper) but also serve as a procedure for testing any new developments that couple continuum and discrete formulations for gas–solids flows.

Computational fluid dynamics↗

Mass and galaxy distributions of four massive galaxy clusters from Dark Energy Survey Science Verification data

We measure the weak lensing masses and galaxy distributions of four massive galaxy clusters observed during the Science Verification phase of the Dark Energy Survey (DES). This pathfinder study is meant to (1) validate the Dark Energy Camera (DECam) imager for the task of measuring weak lensing shapes, and (2) utilize DECam's large field of view to map out the clusters and their environments over 90 arcmin. We conduct a series of rigorous tests on astrometry, photometry, image quality, point spread function (PSF) modelling, and shear measurement accuracy to single out flaws in the data and also to identify the optimal data processing steps and parameters. We find Science Verification data from DECam to be suitable for the lensing analysis described in this paper. The PSF is generally well behaved, but the modelling is rendered difficult by a flux-dependent PSF width and ellipticity. We employ photometric redshifts to distinguish between foreground and background galaxies, and a red-sequence cluster finder to provide cluster richness estimates and cluster-galaxy distributions. By fitting Navarro-Frenk-White profiles to the clusters in this study, we determine weak lensing masses that are in agreement with previous work. For Abell 3261, we provide the first estimates of redshift, weak lensing mass, and richness. In addition, the cluster-galaxy distributions indicate the presence of filamentary structures attached to 1E 0657-56 and RXC J2248.7-4431, stretching out as far as 1. (approximately 20 Mpc), showcasing the potential of DECam and DES for detailed studies of degree-scale features on the sky.

79 ASTRONOMY AND ASTROPHYSICS↗

Code Verification and Solution Verification framework in pin-resolved neutron transport code MPACT

Program verification in scientific computing encompasses the application of formal and mathematical techniques to a scientific computing code for its credibility, accuracy, and validity. Code Verification identifies bugs and performance issues in the software development stage. Solution Verification assesses the applicability of the code and the accuracy of the solution to problems of interest. Both activities utilize application cases and quantify the error against prescribed acceptance criteria. However, simply executing more application cases does not guarantee stronger or more comprehensive credibility. Here, we establish a verification framework that involves Code Verification and Solution Verification, both of which work together such that the overarching goal of “converge to the correct answer for the intended application” can be reasonably inferred. The application of such a verification framework is demonstrated using the pin-resolved neutron transport code MPACT, where standard unit tests and regression tests are covered, and where the Method of Exact Solutions and the Method of Manufactured Solutions are successfully used. Additionally, the applicability of Method of Manufactured Solutions is extended to the OECD/NEA C5G7 benchmark problems of practical material and geometric configurations. Solution Verification activities are demonstrated on a practical hierarchy of application models of increasing complexity ranging from 2D pin cell problems to 3D assembly problems. The convergence behavior and rate of convergence with respect to each individual variable are studied and provided. This framework can be adapted broadly to other fields involving scientific computing codes.

97 MATHEMATICS AND COMPUTING↗

Dosimetric characterization and output verification for conical brachytherapy surface applicators. Part I. Electronic brachytherapy source

Purpose: Historically, treatment of malignant surface lesions has been achieved with linear accelerator based electron beams or superficial x-ray beams. Recent developments in the field of brachytherapy now allow for the treatment of surface lesions with specialized conical applicators placed directly on the lesion. Applicators are available for use with high dose rate (HDR){sup 192}Ir sources, as well as electronic brachytherapy sources. Part I of this paper will discuss the applicators used with electronic brachytherapy sources; Part II will discuss those used with HDR {sup 192}Ir sources. Although the use of these applicators has gained in popularity, the dosimetric characteristics including depth dose and surface dose distributions have not been independently verified. Additionally, there is no recognized method of output verification for quality assurance procedures with applicators like these. Existing dosimetry protocols available from the AAPM bookend the cross-over characteristics of a traditional brachytherapy source (as described by Task Group 43) being implemented as a low-energy superficial x-ray beam (as described by Task Group 61) as observed with the surface applicators of interest. Methods: This work aims to create a cohesive method of output verification that can be used to determine the dose at the treatment surface as part of a quality assurance/commissioning process for surface applicators used with HDR electronic brachytherapy sources (Part I) and{sup 192}Ir sources (Part II). Air-kerma rate measurements for the electronic brachytherapy sources were completed with an Attix Free-Air Chamber, as well as several models of small-volume ionization chambers to obtain an air-kerma rate at the treatment surface for each applicator. Correction factors were calculated using MCNP5 and EGSnrc Monte Carlo codes in order to determine an applicator-specific absorbed dose to water at the treatment surface from the measured air-kerma rate. Additionally, relative dose measurements of the surface dose distributions and characteristic depth dose curves were completed in-phantom. Results: Theoretical dose distributions and depth dose curves were generated for each applicator and agreed well with the measured values. A method of output verification was created that allows users to determine the applicator-specific dose to water at the treatment surface based on a measured air-kerma rate. Conclusions: The novel output verification methods described in this work will reduce uncertainties in dose delivery for treatments with these kinds of surface applicators, ultimately improving patient care.

61 RADIATION PROTECTION AND DOSIMETRY↗

Dosimetric characterization and output verification for conical brachytherapy surface applicators. Part II. High dose rate {sup 192}Ir sources

Purpose: Historically, treatment of malignant surface lesions has been achieved with linear accelerator based electron beams or superficial x-ray beams. Recent developments in the field of brachytherapy now allow for the treatment of surface lesions with specialized conical applicators placed directly on the lesion. Applicators are available for use with high dose rate (HDR){sup 192}Ir sources, as well as electronic brachytherapy sources. Part I of this paper discussed the applicators used with electronic brachytherapy sources. Part II will discuss those used with HDR {sup 192}Ir sources. Although the use of these applicators has gained in popularity, the dosimetric characteristics have not been independently verified. Additionally, there is no recognized method of output verification for quality assurance procedures with applicators like these. Methods: This work aims to create a cohesive method of output verification that can be used to determine the dose at the treatment surface as part of a quality assurance/commissioning process for surface applicators used with HDR electronic brachytherapy sources (Part I) and{sup 192}Ir sources (Part II). Air-kerma rate measurements for the {sup 192}Ir sources were completed with several models of small-volume ionization chambers to obtain an air-kerma rate at the treatment surface for each applicator. Correction factors were calculated using MCNP5 and EGSnrc Monte Carlo codes in order to determine an applicator-specific absorbed dose to water at the treatment surface from the measured air-kerma rate. Additionally, relative dose measurements of the surface dose distributions and characteristic depth dose curves were completed in-phantom. Results: Theoretical dose distributions and depth dose curves were generated for each applicator and agreed well with the measured values. A method of output verification was created that allows users to determine the applicator-specific dose to water at the treatment surface based on a measured air-kerma rate. Conclusions: The novel output verification methods described in this work will reduce uncertainties in dose delivery for treatments with these kinds of surface applicators, ultimately improving patient care.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

A limited-angle intrafraction verification (LIVE) system for radiation therapy

Purpose: Currently, no 3D or 4D volumetric x-ray imaging techniques are available for intrafraction verification of target position during actual treatment delivery or in-between treatment beams, which is critical for stereotactic radiosurgery (SRS) and stereotactic body radiation therapy (SBRT) treatments. This study aims to develop a limited-angle intrafraction verification (LIVE) system to use prior information, deformation models, and limited angle kV-MV projections to verify target position intrafractionally. Methods: The LIVE system acquires limited-angle kV projections simultaneously during arc treatment delivery or in-between static 3D/IMRT treatment beams as the gantry moves from one beam to the next. Orthogonal limited-angle MV projections are acquired from the beam's eye view (BEV) exit fluence of arc treatment beam or in-between static beams to provide additional anatomical information. MV projections are converted to kV projections using a linear conversion function. Patient prior planning CT at one phase is used as the prior information, and the on-board patient volume is considered as a deformation of the prior images. The deformation field is solved using the data fidelity constraint, a breathing motion model extracted from the planning 4D-CT based on principal component analysis (PCA) and a free-form deformation (FD) model. LIVE was evaluated using a 4D digital extended cardiac torso phantom (XCAT) and a CIRS 008A dynamic thoracic phantom. In the XCAT study, patient breathing pattern and tumor size changes were simulated from CT to treatment position. In the CIRS phantom study, the artificial target in the lung region experienced both size change and position shift from CT to treatment position. Varian Truebeam research mode was used to acquire kV and MV projections simultaneously during the delivery of a dynamic conformal arc plan. The reconstruction accuracy was evaluated by calculating the 3D volume percentage difference (VPD) and the center of mass (COM) difference of the tumor in the true on-board images and reconstructed images. Results: In both simulation and phantom studies, LIVE achieved substantially better reconstruction accuracy than reconstruction using PCA or FD deformation model alone. In the XCAT study, the average VPD and COM differences among different patient scenarios for LIVE system using orthogonal 30° scan angles were 4.3% and 0.3 mm when using kV+BEV MV. Reducing scan angle to 15° increased the average VPD and COM differences to 15.1% and 1.7 mm. In the CIRS phantom study, the VPD and COM differences for the LIVE system using orthogonal 30° scan angles were 6.4% and 1.4 mm. Reducing scan angle to 15° increased the VPD and COM differences to 51.9% and 3.8 mm. Conclusions: The LIVE system has the potential to substantially improve intrafraction target localization accuracy by providing volumetric verification of tumor position simultaneously during arc treatment delivery or in-between static treatment beams. With this improvement, LIVE opens up a new avenue for margin reduction and dose escalation in both fractionated treatments and SRS and SBRT treatments.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Partial defect verification of spent fuel assemblies by PDET: Principle and field testing in Interim Spent fuel Storage Facility (CLAB) in Sweden

Here, the need for the development of a credible method and instrument for partial defect verification of spent fuel has been emphasized over a few decades in the safeguards communities as the diverted spent fuel pins can be the source of nuclear terrorism or devices. The need is increasingly more important and even urgent as many countries have started to transfer spent fuel to so called "difficult-to-access" areas such as dry storage casks, reprocessing or geological repositories. Partial defect verification is required by IAEA before spent fuel is placed into "difficult-to-access" areas. Earlier, Lawrence Livermore National Laboratory (LLNL) has reported the successful development of a new, credible partial defect verification method for pressurized water reactor (PWR) spent fuel assemblies without use of operator data, and further reported the validation experiments using commercial spent fuel assemblies with some missing fuel pins. The method was found to be robust as the method is relatively invariant to the characteristic variations of spent fuel assemblies such as initial fuel enrichment, cooling time, and burn-up. Since then, the PDET system has been designed and prototyped for 17×17 PWR spent fuel assemblies, complete with data acquisition software and acquisition electronics. In this paper, a summary description of the PDET development followed by results of the first successful field testing using the integrated PDET system and actual spent fuel assemblies performed in a commercial spent fuel storage site, known as Central Interim Spent fuel Storage Facility (CLAB) in Sweden will be presented. In addition to partial defect detection initial studies have determined that the tool can be used to verify the operator declared average burnup of the assembly as well as intra-assembly bunrup levels.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Introduction: The 2014 Sandia Verification and Validation Challenge Workshop [The 2014 Sandia Verification and Validation Challenge Workshop]

The 2014 Sandia Verification & Validation Challenge Workshop was held at the 3rd ASME Verification & Validation Symposium in Las Vegas, on May 5-8, 2014. The workshop was built around a challenge problem, formulated as an engineering investigation that required integration of experimental data, modeling and simulation, and verification and validation. The challenge problem served as a common basis for the ASME Journal of Verification, Validation, and Uncertainty Quantification participants to both demonstrate methodology and explore a critical aspect of the field: the role of verification and validation in establishing credibility and supporting decision making. Ten groups presented responses to the challenge problem at the workshop, and the follow-on efforts are documented in this special edition of the ASME Journal of Verification, Validation, and Uncertainty Quantification.

97 MATHEMATICS AND COMPUTING↗

RELAP-7 Software Verification and Validation Plan: Requirements Traceability Matrix (RTM) Update and Code Verification Strategy

This document describes the recent progress of the RELAP-7 Software Verification and Validation Plan (SVVP). The RELAP-7 RTM has been updated by adding the validation requirement items, rearranging the requirement items, and introducing the classifier to better describe the RELAP-7 V&V status at a specified point in time. Also, from the perspective of nuclear system code validation, six items from the list of LWR safety-relevant phenomena were identified as validation data gaps. Lastly, motivated by the needs revealed from the previous RELAP-7 IV&V activities, the independent verification plan for RELAP-7 has been established. The verification method, procedure, and verification test coverage suite discussed in this document will be applied to the future work for the RELAP-7 independent verification.

42 ENGINEERING↗

Deferred Verification: The Role of New Verification Technologies and Approaches

Researchers at UNIDIR have recently proposed a fundamentally new approach to nuclear arms control verification, dubbed "deferred verification." The concept forgoes inspections at sensitive nuclear sites and inspections of nuclear materials or components in classified form. To implement this concept, a state first divides its territory into a closed segment and an open segment. The total fissile material inventory in the closed segment, which includes the weapon complex, is known and declared with very high accuracy. Essentially no inspections take place in the closed segment. Yet, inspectors have access to the open segment, which includes in particular the civilian nuclear sector. The fissile material inventory in the open segment is known with less accuracy, but uncertainties can be reduced over time using methods of nuclear archaeology. Deferred verification relies primarily on established safeguards techniques and avoids many unresolved verification challenges, including for example the need for information barriers for warhead confirmation measurements. At the same time, deferred verification faces some unique challenges. In this work, we explore some of these challenges and offer possible solutions while maintaining the strengths of the concept; to do so, we examine possible noncompliance strategies in which a state would seek to withhold a higher-than-declared inventory.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

CTF Code Verification and Solution Verification

The CTF code is part of the suite of codes developed with DOE funding under the CASL Program to bring the benefits of high-performance computing to issues of importance to the US nuclear power industry. This document primarily focuses on code and solution verification test problems that have been developed to ensure that CTF converges to the correct answer for the intended application. Convergence behavior and numerical errors are quantified for each of the tests. The observed convergence behavior in all available tests is consistent with expectations for the numerical methods employed by CTF, providing evidence that there are no significant code bugs or algorithm deficiencies in the code. The suite of code verification and solution verification tests are mapped to core capabilities of CTF. Gaps were identified in the code verification test suite and they are being addressed. Two new code verification problems were developed to address gaps that were identified.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Robust verification analysis

We introduce a new methodology for inferring the accuracy of computational simulations through the practice of solution verification. We demonstrate this methodology on examples from computational heat transfer, fluid dynamics and radiation transport. Our methodology is suited to both well- and ill-behaved sequences of simulations. Our approach to the analysis of these sequences of simulations incorporates expert judgment into the process directly via a flexible optimization framework, and the application of robust statistics. The expert judgment is systematically applied as constraints to the analysis, and together with the robust statistics guards against over-emphasis on anomalous analysis results. We have named our methodology Robust Verification. Our methodology is based on utilizing multiple constrained optimization problems to solve the verification model in a manner that varies the analysis' underlying assumptions. Constraints applied in the analysis can include expert judgment regarding convergence rates (bounds and expectations) as well as bounding values for physical quantities (e.g., positivity of energy or density). This approach then produces a number of error models, which are then analyzed through robust statistical techniques (median instead of mean statistics). This provides self-contained, data and expert informed error estimation including uncertainties for both the solution itself and order of convergence. Our method produces high quality results for the well-behaved cases relatively consistent with existing practice. The methodology can also produce reliable results for ill-behaved circumstances predicated on appropriate expert judgment. We demonstrate the method and compare the results with standard approaches used for both code and solution verification on well-behaved and ill-behaved simulations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Nonlinear three-dimensional verification of the $\small \mathrm{SPECYL}$ and $\small \mathrm{PIXIE3D}$ magnetohydrodynamics codes for fusion plasmas

With the increasing impact of scientific discovery via advanced computation, there is presently a strong emphasis on ensuring the mathematical correctness of computational simulation tools. Such endeavor, termed verification, is now at the center of most serious code development efforts. In this study, we address a cross-benchmark nonlinear verification study between two three-dimensional magnetohydrodynamics (3D MHD) codes for fluid modeling of fusion plasmas, SPECYL [S. Cappello and D. Biskamp, Nucl. Fusion 36, 571 (1996)] and PIXIE3D [L. Chacón, Phys. Plasmas 15, 056103 (2008)], in their common limit of application: the simple viscoresistive cylindrical approximation. SPECYL is a serial code in cylindrical geometry that features a spectral formulation in space and a semi-implicit temporal advance, and has been used extensively to date for reversed-field pinch studies. PIXIE3D is a massively parallel code in arbitrary curvilinear geometry that features a conservative, solenoidal finite-volume discretization in space, and a fully implicit temporal advance. The present study is, in our view, a first mandatory step in assessing the potential of any numerical 3D MHD code for fluid modeling of fusion plasmas. Finally, excellent agreement is demonstrated over a wide range of parameters for several fusion-relevant cases in both two- and three-dimensional geometries.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Verification of BModes: Rotary Beam and Tower Modal Analysis Code; Preprint

This paper describes verification of BModes, a finite-element code developed to provide coupled modes for the blades and tower of a wind turbine. The blades, which may be rotating or non-rotating, and the towers, whether onshore or offshore, are modeled using specialized 15-dof beam finite elements. Both blade and tower models allow a tip attachment, which is assumed to be rigid body with sixmoments of inertia, and a mass centroid that may be offset from the blade or tower axis. Examples of tip attachments are aerodynamic brakes for blades and nacelle-rotor subassembly for towers. BModes modeling allows for tower supports including tension wires, floating platforms, and monopiles on elastic foundations. Coupled modes (implying coupling of flap, lag, axial, and torsional motions) arerequired for modeling major flexible components in a modal-based, aeroelastic code such as FAST1. These are also required for validation of turbine models using experimental data, modal-based fatigue analysis, controls design, and understanding aeroelastic-stability behavior of turbines. Verification studies began with uniform tower models, with and without tip inertia, and progressed torealistic towers. For the floating turbine, we accounted for the effects of hydrodynamic inertia, hydrostatic restoring, and mooring lines stiffness. For the monopole-supported tower, we accounted for distributed hydrodynamic mass on the submerged part of the tower and for distributed foundation stiffness. Finally, we verified a model of a blade carrying tip mass and rotating at different speeds(verifications of other blade models, rotating or non-rotating, have been reported in another paper.) Verifications were performed by comparing BModes-generated modes with analytical results, if available, or with MSC.ADAMS results. All results in general show excellent agreement.

17 WIND ENERGY↗