Search NASA⌕ Search

SEARCH · Search NASA

Results for “Validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 919 records · Page 51

Experimental validation of universal plasma blob formation mechanism

Anomalous plasma transport in the boundary region of a tokamak plasma is commonly associated with the formation and evolution of coherent density structures known as blobs. Recently, a theory for a universal mechanism of plasma blob formation has been put forward. It is based on a breaking process of a radially elongated streamer due to poloidal and radial velocity shears. The theory is well supported by two-dimensional and three-dimensional numerical simulation results but lacks experimental validation. Here, we report the first ever experimental validation of this universal criterion by testing it against NSTX data on blobs obtained using the gas-puff imaging diagnostic. It is found that the criterion is widely satisfied in most L-mode discharges and may explain the significantly larger number of blob events. We also validate the theoretical criterion against ADITYA Langmuir probe data taken in the scrape-off layer region.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Summary of the 5th IAEA technical meeting on fusion data processing, validation and analysis (FDPVA)

The purpose of the 5th International Atomic Energy Agency technical meeting on fusion data processing, validation and analysis (FDPVA) (Ghent University, Ghent, Belgium, 12–15 June 2023) was to provide a platform during which a set of topics relevant to FDPVA were discussed with the view of meeting the needs of next step fusion devices such as ITER. The validation and analysis of experimental data obtained from diagnostics used to characterize fusion plasmas are crucial for a knowledge-based understanding of the physical processes governing the dynamics of these plasmas. This paper presents the recent progress and achievements in the domain of plasma diagnostics data analysis and synthetic diagnostics reported at the meeting, including concept description of new devices; fusion databases; integrated data analysis; inverse problems; uncertainty propagation, verification and validation; probabilistic methods and machine learning. The relevant results underline trends observed in the current major fusion confinement devices.

fusion databases↗

Validation of an integrated modeling framework for investigating 3D plasma responses in tokamak plasmas

As contemporary experimental tokamaks are pushed toward reactor-relevant operation, they provide essential testbeds for demonstrating and exploring ELM control strategies for deployment in future fusion pilot plants. Accurate predictions of full plasma responses are essential to guide and optimize these demonstrations. This paper introduces and validates an integrated modeling framework over a historical range of DIII-D operational space. The integrated modeling framework uses only scalar plasma parameters and optional reference boundary to self-consistently and flexibly scan through tokamak operational space and estimate the corresponding ELM-suppression relevant plasma response over 3D coil phase space. The framework generates tightly converged equilibria that satisfy a target set of plasma parameters (I p , β N , l i ), with kinetic profiles constrained by an EPED(NN)-computed pedestal and empirical core model. The plasma response of these modeled equilibria is calculated with GPEC. Validated against 55 distinct DIII-D equilibria, the framework consistently reproduces experimentally constrained equilibrium pressure, q, and other representative profiles using the time-varying information from only evolving scalar plasma parameters; plasma response validation is performed for the n=3 perturbation. In particular, the plasma response of a DIII-D discharge scanning q 95 in search of ELM suppression windows is quantitatively reproduced. By accurately reproducing experimental equilibria and plasma responses across wide parameter variation, the framework supports potential for synthetic parameter scans in key operational, stability, and plasma response dimensions to investigate RMP ELM-suppression experiments and inform predictive RMP scenario optimization.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Quantitative Validation of Control Bands Using Bayesian Statistical Analyses

Abstract This study presents a quantitative validation of 15 Similar Exposure Groups (SEGs) that were derived via control bands inherent to the Risk Level Based Management System currently being used at the Lawrence Livermore National Laboratory. For 93% of the SEGs that were evaluated, statistical analyses of personal exposure monitoring data, through Bayesian Decision Analysis (BDA), demonstrated that the controls implemented from the initial control bands assigned to these SEGs were at least as protective as the controls from the control band outcomes derived from the quantitative data. The BDA also demonstrated that for 40% of the SEGs, the controls from the initial control bands were overly protective, thus allowing controls to be downgraded, which resulted in a significant saving of environmental safety and health (ES&H) resources. Therefore, as a means to both confirm existing controls and to identify candidate SEGs for downgrading controls, efforts to continuously improve the accuracy of Control Banding (CB) strategies through the routine quantitative validation of SEGs are strongly encouraged. Targeted collaborative efforts across institutions and even countries for both the development of CB strategies and the validation of discreetly defined SEGs of commonly performed tasks will not only optimize limited ES&H resources but will also assist in providing a simplified process for essential risk communication at the worker level to the benefit of billions of workers around the world.

McCord, Tyler A.↗

Validation of selection function, sample contamination and mass calibration in galaxy cluster samples

ABSTRACT We construct and validate the selection function of the MARD-Y3 galaxy cluster sample. This sample was selected through optical follow-up of the 2nd ROSAT faint source catalogue with Dark Energy Survey year 3 data. The selection function is modelled by combining an empirically constructed X-ray selection function with an incompleteness model for the optical follow-up. We validate the joint selection function by testing the consistency of the constraints on the X-ray flux–mass and richness–mass scaling relation parameters derived from different sources of mass information: (1) cross-calibration using South Pole Telescope Sunyaev-Zel'dovich (SPT-SZ) clusters, (2) calibration using number counts in X-ray, in optical and in both X-ray and optical while marginalizing over cosmological parameters, and (3) other published analyses. We find that the constraints on the scaling relation from the number counts and SPT-SZ cross-calibration agree, indicating that our modelling of the selection function is adequate. Furthermore, we apply a largely cosmology independent method to validate selection functions via the computation of the probability of finding each cluster in the SPT-SZ sample in the MARD-Y3 sample and vice versa. This test reveals no clear evidence for MARD-Y3 contamination, SPT-SZ incompleteness or outlier fraction. Finally, we discuss the prospects of the techniques presented here to limit systematic selection effects in future cluster cosmological studies.

79 ASTRONOMY AND ASTROPHYSICS↗

Validation of the DESI DR2 Ly⁢ 𝛼 BAO analysis using synthetic datasets

The second data release (DR2) of the Dark Energy Spectroscopic Instrument (DESI), containing data from the first three years of observations, doubles the number of Lyman-α (Ly α) forest spectra in DR1 and it provides the largest dataset of its kind. To ensure a robust validation of the baryonic acoustic oscillation (BAO) analysis using Ly α forests, we have made significant updates compared to DR1 to both the mocks and the analysis framework used in the validation. In particular, we present CoLoRe-QL, a new set of Lyα mocks that use a quasilinear input power spectrum to incorporate the nonlinear broadening of the BAO peak. Here, we have also increased the number of realizations used in the validation to 400, compared to the 150 realizations used in DR1. Finally, we present a detailed study of the impact of quasar redshift errors on the BAO measurement, and we compare different strategies to mask damped Lyman-α absorbers in our spectra. The BAO measurement from the Ly α dataset of DESI DR2 is presented in a companion publication.

Casas, L. [Institut de Física d’Altes Energies (IF↗

Multifidelity validation of digital surrogates using variable-density turbulent mixing models

In this study, ensembles of experimental data are presented and utilized to compare and validate two models used in the simulation of variable-density (Atwood = 0.22), compressible turbulent mixing. Though models of this kind (Reynolds averaged NavierStokes and large-eddy simulations) have been validated extensively with more canonical flows in previous studies, here the present approach offers novelty in the complexity of the geometry, the ensemble-based validation, and the uniformity of the computational framework on which the models are tested. Moreover, all experimental and computational tasks were completed by the authors which has led to a tightly coupled experimental configuration with its “digital twin.” The experimental divergent-shock-tube facility and its data acquisition methods are described and replicated in simulation space. A 2D Euler model which neglects the turbulent mixing at the interface is optimized to experimental data using a Gaussian process. This model then serves as the basis for both the 2D RANS and 3D LES studies that make comparisons to the mixing-layer data from the experiment. A relatively simple RANS model is shown to produce good agreement with experimental data only at late flow development times. The LES ensembles generally show good agreement with experimental data but display sensitivity to the characterization of initial conditions. Resolution-dependent behavior is also observed for certain higher-order statistics of interest. Overall, the LES model successfully captures the effects of divergent geometry, compressibility, and combined nonlinear instabilities inherent to the problem. The successful prediction of mixing width and its growth rate highlight the existence of three distinct regimes in the development of the instability, each with similarities to previously studied instabilities.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Systematic study of the validity of the eikonal model including uncertainties

Nuclear reactions at intermediate beam energies are often interpreted using the eikonal model. In the analysis of complex reaction probes, where few-body reaction methods are needed, the eikonal method may be used as an efficient way for describing the fragment-target reaction process. In this work, we perform a systematic study to test the validity of the eikonal approximation for nucleon-nucleus reactions. We also quantify uncertainties due to the nucleon optical potential on reaction observables. We inspect the validity of the eikonal model and its semiclassical correction by comparing it to exact solutions (obtained from solving the optical-model equation with a finite-differences method) for a wide range of reactions. We also study the effect of relativistic corrections, both kinematic and dynamic, by effectively incorporating the relativistic effects at intermediate energies. The uncertainties from a Bayesian global optical potential (KDUQ) are propagated to the observables of interest. Our study includes neutron and proton reactions on 27 Al , 40 Ca , 90 Zr , and 208 Pb , for a wide range of energies 𝐸 lab = 0–400 MeV. We calculate neutron-total cross sections (elastic and reactions) as well as proton-absorption cross sections as a function of beam energy, using the eikonal model, the eikonal model with a semiclassical correction, and the exact solution. Here, we also compute angular distributions for the methods above. Our results show that for the proton-absorption cross section, the eikonal model can be used down to around 60 MeV and the semiclassical correction extends its use to 30 MeV. However, the validity of the eikonal model for the neutron-total cross section only goes down to ≈120 MeV, a range extended to ≈ 50 MeV when using the semiclassical correction. We find the semiclassical correction to the eikonal model to be less effective in describing the angular distributions. The 1⁢𝜎 uncertainty intervals on the observables we studied is less than 5% for most of the energies considered, but increases rapidly for higher energies, namely energies outside the range of KDUQ (𝐸 lab > 200MeV).

Cluster models↗

OPEN-CODE, REAL-TIME EMULATION TESTBED OF GRID-CONNECTED TYPE-3 WIND TURBINE SYSTEM WITH HARDWARE VALIDATION

This paper presents the design and development of an open-code Type-3 wind turbine virtual-testbed for real-time simulations. The proposed testbed includes the bare code for all the models required to emulate a Type-3 wind turbine system: the Doubly-Fed Induction Generator (DFIG) dynamic model, single-mass drive train, wind turbine system, and average model of the back to back power. This testbed can be executed in PC-layer for offline simulations or can be executed in real-time on the National Instruments (NI)-CompactRIO (cRIO) platform. The discrete-time models are implemented on the Field Programmable Gate Array (FPGA), using LabVIEW, and validated against a physical hardware setup. The emulated stator and rotor currents and DC-link voltage are compared against physical measurements creating a validated platform independent from third-party models and suitable for applications in real-time. The proposed testbed is intended to be available to researchers, wind turbine manufacturers, and utility companies to perform tests using a validated platform to verify proposed control designs of DFIG wind turbines.

Ferrari Maglia, Max↗

Experimental Validation of a 40kW, 480V Point-to-Point DC Interlinks for Controller-Agnostic, Interoperable Networked Microgrids

This paper presents the experimental validation of point-to-point dc-interlinks for interconnecting two solar-based, laboratory-scale AC microgrids. DC interlinks provide a solution to numerous technical and operational challenges encountered in networked microgrids, including precise power flow control, stable and fast synchronization, enhanced stability, and improved voltage and frequency regulation. By decoupling microgrids through power converters, dc-interlinks enable power exchange among microgrids that can be owned by different entities (such as communities, utilities, or universities) and managed by diverse microgrid controller vendors. This characteristic makes this dc-interlinks a promising solution for networking real-world microgrids. The presented point-to-point dc interlink utilizes two four-quadrant converters: a 40kW 3-phase ac/dc regulating the dc-link voltage to 800V, and a 3-phase dc/ac controlling power flow. These converters, connected via a 20-foot dc cable, interconnect two ac microgrids operating at 480V, each featuring energy storage, photovoltaic generation, and load emulation. Experimental validation employs commercially available off-the-shelf (COTS) converters and real-world data from solar-powered microgrids in Adjuntas, Puerto Rico. To the authors’ knowledge, this work provides the first at-scale experimental validation of dc-interlinks for networked ac microgrids using COTS inverters, demonstrating their practicality and effectiveness in addressing real-world operational challenges.

Ferrari Maglia, Max [ORNL]↗

Data-Driven Residential Load Modeling and Validation in GridLAB-D

Accurately characterizing the impacts of high penetrations of distributed energy resources (DER) on the electric distribution system has driven modeling methods from traditional static snap shots, often representing a critical point in time (e.g., summer peak load), to quasi-static time series (QSTS) simulations capturing all the effects of variable DER, associated controls and hence, impacts on the distribution system over a given time period. Unfortunately, the high time resolution DER source and load data required for model inputs is often scarce or non-existent. This paper presents work performed within the GridLAB-D model environment to synthesize, calibrate, and validate 1-second residential load models based on measured transformer loads and physics-based models suitable for QSTS electric distribution system modeling. The modeling and validation approach taken was to create a typical GridLAB-D model home that, when replicated to represent multiple diverse houses on a single transformer, creates a statistically similar load to a measured load for a given weather input. The model homes are constructed to represent the range of actual homes on an instrumented transformer: square footage, thermal integrity, heating and cooling system definition as well as realistic occupancy schedules. House model calibration and validation was performed using the distribution transformer load data and corresponding weather. The modeled loads were found to be similar to the measured loads for four evaluation metrics: 1) daily average energy, 2) daily average and standard deviation of power, 3) power spectral density, and 4) load shape.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Towards Validation of Advanced Accelerated Stress Testing Protocols through Failure Analysis and Materials Characterization

As the lifetime of photovoltaic modules increases toward the goal of 50 years, accelerated stress testing is critical to assessing the viability of newer, improved, and often cheaper materials in the field. However, the validation of accelerated testing to reproduce field failure has remained elusive. The recent developments of more advanced stress testing protocols utilizing sequential and combined stressors have provided another opportunity for validation. Using a suite of mechanical, chemical, and structural characterization methods we report the development of our approach using a known bad backsheet “AAA.” We then apply this approach to PVDF-based backsheets to further confirm the generalizability of this approach. The outcome of this work is two-fold: (1) validation of advanced accelerated testing protocols which will enable the prediction of field failures in new materials, and (2) deeper insights into the degradation mechanisms observed through the extensive characterization allowing for improved materials engineering and development.

accelerated aging↗

Nanosecond Transient Validation of Surge Arrester Models to Predict Electromagnetic Pulse Response

The impact of high-altitude electromagnetic pulse events on the electric grid is not fully understood, and validated modeling of mitigations, such as lightning surge arresters (LSAs) is necessary to predict the propagation of very fast transients on the grid. Experimental validation of high frequency models for surge arresters is an active area of research. Further, this article serves to experimentally validate a previously defined ZnO LSA model using four metal-oxide varistor pucks and nanosecond scale pulses to measure voltage and current responses. The SPICE circuit models of the pucks showed good predictability when compared to the measured arrester response when accounting for a testbed inductance of approximately 100 nH. Additionally, the comparatively high capacitance of low-profile arresters show a favorable response to high-speed transients that indicates the potential for effective electromagnetic pulse mitigation with future materials design.

42 ENGINEERING↗

Validation techniques for fault emulation of SRAM-based FPGAs

A variety of fault emulation systems have been created to study the effect of single-event effects (SEEs) in static random access memory (SRAM) based field-programmable gate arrays (FPGAs). These systems are useful for augmenting radiation-hardness assurance (RHA) methodologies for verifying the effectiveness for mitigation techniques; understanding error signatures and failure modes in FPGAs; and failure rate estimation. For radiation effects researchers, it is important that these systems properly emulate how SEEs manifest in FPGAs. If the fault emulation systems does not mimic the radiation environment, the system will generate erroneous data and incorrect predictions of behavior of the FPGA in a radiation environment. Validation determines whether the emulated faults are reasonable analogs to the radiation-induced faults. In this study we present methods for validating fault emulation systems and provide several examples of validated FPGA fault emulation systems.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Economic analysis of model validation for a challenge problem

It is now commonplace for engineers to build mathematical models of the systems they are designing, building, or testing. And, it is nearly universally accepted that phenomenological models of physical systems must be validated prior to use for prediction in consequential scenarios. Yet, there are certain situations in which testing only or no testing and no modeling may be economically viable alternatives to modeling and its associated testing. This paper develops an economic framework within which benefit–cost can be evaluated for modeling and model validation relative to other options. The development is presented in terms of a challenge problem. As a result, we provide a numerical example that quantifies when modeling, calibration, and validation yield higher benefit–cost than a testing only or no modeling and no testing option.

42 ENGINEERING↗

Processing Aleatory and Epistemic Uncertainties in Experimental Data From Sparse Replicate Tests of Stochastic Systems for Real-Space Model Validation

This paper presents a practical methodology for propagating and processing uncertainties associated with random measurement and estimation errors (that vary from test-to-test) and systematic measurement and estimation errors (uncertain but similar from test-to-test) in inputs and outputs of replicate tests to characterize response variability of stochastically varying test units. Also treated are test condition control variability from test-to-test and sampling uncertainty due to limited numbers of replicate tests. These aleatory variabilities and epistemic uncertainties result in uncertainty on computed statistics of output response quantities. The methodology was developed in the context of processing experimental data for “real-space” (RS) model validation comparisons against model-predicted statistics and uncertainty thereof. The methodology is flexible and sufficient for many types of experimental and data uncertainty, offering the most extensive data uncertainty quantification (UQ) treatment of any model validation method the authors are aware of. It handles both interval and probabilistic uncertainty descriptions and can be performed with relatively little computational cost through use of simple and effective dimension- and order-adaptive polynomial response surfaces in a Monte Carlo (MC) uncertainty propagation approach. A key feature of the progressively upgraded response surfaces is that they enable estimation of propagation error contributed by the surrogate model. Sensitivity analysis of the relative contributions of the various uncertainty sources to the total uncertainty of statistical estimates is also presented. Finally, the methodologies are demonstrated on real experimental validation data involving all the mentioned sources and types of error and uncertainty in five replicate tests of pressure vessels heated and pressurized to failure. Simple spreadsheet procedures are used for all processing operations.

97 MATHEMATICS AND COMPUTING↗

Experimental validation of Monte Carlo (MANTIS) simulated x-ray response of columnar CsI scintillator screens

Purpose: MANTIS is a Monte Carlo code developed for the detailed simulation of columnar CsI scintillator screens in x-ray imaging systems. Validation of this code is needed to provide a reliable and valuable tool for system optimization and accurate reconstructions for a variety of x-ray applications. Whereas previous validation efforts have focused on matching of summary statistics, in this work the authors examine the complete point response function (PRF) of the detector system in addition to relative light output values. Methods: Relative light output values and high-resolution PRFs have been experimentally measured with a custom setup. A corresponding set of simulated light output values and PRFs have also been produced, where detailed knowledge of the experimental setup and CsI:Tl screen structures are accounted for in the simulations. Four different screens were investigated with different thicknesses, column tilt angles, and substrate types. A quantitative comparison between the experimental and simulated PRFs was performed for four different incidence angles (0 deg., 15 deg., 30 deg., and 45 deg.) and two different x-ray spectra (40 and 70 kVp). The figure of merit (FOM) used measures the normalized differences between the simulated and experimental data averaged over a region of interest. Results: Experimental relative light output values ranged from 1.456 to 1.650 and were in approximate agreement for aluminum substrates, but poor agreement for graphite substrates. The FOMs for all screen types, incidence angles, and energies ranged from 0.1929 to 0.4775. To put these FOMs in context, the same FOM was computed for 2D symmetric Gaussians fit to the same experimental data. These FOMs ranged from 0.2068 to 0.8029. Our analysis demonstrates that MANTIS reproduces experimental PRFs with higher accuracy than a symmetric 2D Gaussian fit to the experimental data in the majority of cases. Examination of the spatial distribution of differences between the PRFs shows that the main reason for errors between MANTIS and the experimental data is that MANTIS-generated PRFs are sharper than the experimental PRFs. Conclusions: The experimental validation of MANTIS performed in this study demonstrates that MANTIS is able to reliably predict experimental PRFs, especially for thinner screens, and can reproduce the highly asymmetric shape seen in the experimental data. As a result, optimizations and reconstructions carried out using MANTIS should yield results indicative of actual detector performance. Better characterization of screen properties is necessary to reconcile the simulated light output values with experimental data.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Monte Carlo modeling and simulations of the High Definition (HD120) micro MLC and validation against measurements for a 6 MV beam

Purpose: The most recent Varian micro multileaf collimator (MLC), the High Definition (HD120) MLC, was modeled using the BEAMNRC Monte Carlo code. This model was incorporated into a Varian medical linear accelerator, for a 6 MV beam, in static and dynamic mode. The model was validated by comparing simulated profiles with measurements. Methods: The Varian Trilogy (2300C/D) accelerator model was accurately implemented using the state-of-the-art Monte Carlo simulation program BEAMNRC and validated against off-axis and depth dose profiles measured using ionization chambers, by adjusting the energy and the full width at half maximum (FWHM) of the initial electron beam. The HD120 MLC was modeled by developing a new BEAMNRC component module (CM), designated HDMLC, adapting the available DYNVMLC CM and incorporating the specific characteristics of this new micro MLC. The leaf dimensions were provided by the manufacturer. The geometry was visualized by tracing particles through the CM and recording their position when a leaf boundary is crossed. The leaf material density and abutting air gap between leaves were adjusted in order to obtain a good agreement between the simulated leakage profiles and EBT2 film measurements performed in a solid water phantom. To validate the HDMLC implementation, additional MLC static patterns were also simulated and compared to additional measurements. Furthermore, the ability to simulate dynamic MLC fields was implemented in the HDMLC CM. The simulation results of these fields were compared with EBT2 film measurements performed in a solid water phantom. Results: Overall, the discrepancies, with and without MLC, between the opened field simulations and the measurements using ionization chambers in a water phantom, for the off-axis profiles are below 2% and in depth-dose profiles are below 2% after the maximum dose depth and below 4% in the build-up region. On the conditions of these simulations, this tungsten-based MLC has a density of 18.7 g cm{sup -3} and an overall leakage of about 1.1 {+-} 0.03%. The discrepancies between the film measured and simulated closed and blocked fields are below 2% and 8%, respectively. Other measurements were performed for alternated leaf patterns and the agreement is satisfactory (to within 4%). The dynamic mode for this MLC was implemented and the discrepancies between film measurements and simulations are within 4%. Conclusions: The Varian Trilogy (2300 C/D) linear accelerator including the HD120 MLC was successfully modeled and simulated using the Monte Carlo BEAMNRC code by developing an independent CM, the HDMLC CM, either in static and dynamic modes.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗