SEARCH · Search NASA

Results for “Metrics and Validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

All sources NASA NTRS DOE OSTI

NASA NTRS2011

Validating LES for Jet Aeroacoustics

Engineers charged with making jet aircraft quieter have long dreamed of being able to see exactly how turbulent eddies produce sound and this dream is now coming true with the advent of large eddy simulation (LES). Two obvious challenges remain: validating the LES codes at the resolution required to see the fluid-acoustic coupling, and the interpretation of the massive datasets that are produced. This paper addresses the former, the use of advanced experimental techniques such as particle image velocimetry (PIV) and Raman and Rayleigh scattering, to validate the computer codes and procedures used to create LES solutions. This paper argues that the issue of accuracy of the experimental measurements be addressed by cross-facility and cross-disciplinary examination of modern datasets along with increased reporting of internal quality checks in PIV analysis. Further, it argues that the appropriate validation metrics for aeroacoustic applications are increasingly complicated statistics that have been shown in aeroacoustic theory to be critical to flow-generated sound, such as two-point space-time velocity correlations. A brief review of data sources available is presented along with examples illustrating cross-facility and internal quality checks required of the data before it should be accepted for validation of LES.

Bridges, James↗

NASA NTRS2023

Atmospheric Correction Inter-comparison eXercise, ACIX-II Land: An Assessment of Amospheric Correction Processors for Landsat 8 and Sentinel-2 Over Land

The correction of the atmospheric effects on optical satellite images is essential for quantitative and multi-temporal remote sensing applications. In order to study the performance of the state-of-the-art methods in an integrated way, a voluntary and open-access benchmark Atmospheric Correction Inter-comparison eXercise (ACIX) was initiated in 2016 in the frame of Committee on Earth Observation Satellites (CEOS) Working Group on Calibration & Validation (WGCV). The first exercise was extended in a second edition wherein twelve atmospheric correction (AC) processors, a substantially larger testing dataset and additional validation metrics were involved. The sites for the inter-comparison analysis were defined by investigating the full catalogue of the Aerosol Robotic Network (AERONET) sites for coincident measurements with satellites' overpass. Although there were more than one hundred sites for Copernicus Sentinel-2 and Landsat 8 acquisitions, the analysis presented in this paper concerns only the common matchups amongst all processors, reducing the number to 79 and 62 sites respectively. Aerosol Optical Depth (AOD) and Water Vapour (WV) retrievals were consequently validated based on the available AERONET observations. The processors mostly succeeded in retrieving AOD for relatively light to medium aerosol loading (AOD < 0.2) with uncertainties <0.08, while the overall uncertainty values were typically 0.23 ± 0.15. Better performances were observed for WV retrievals with >90% of the results falling within the suggested empirical specifications and with the Root Mean Square Error (RMSE) being mostly <0.25 g/cm2. Regarding Surface Reflectance (SR) validation two main approaches were followed. For the first one, a simulated SR reference dataset was computed over all of the test sites by using the 6SV (Second Simulation of the Satellite Signal in the Solar Spectrum vector code) full radiative transfer modelling (RTM) and AERONET measurements for the required aerosol variables and water vapour content. The performance assessment demonstrated that the retrievals were not biased for most of the bands. The uncertainties ranged from approximately 0.003 to 0.01 (excluding B01) for the best performing processors in both sensors' analyses. For the second one, measurements from the radiometric calibration network RadCalNet over La Crau (France) and Gobabeb (Namibia) were involved in the validation. The performance of the processors was in general consistent across all bands for both sensors and with low standard deviations (<0.04) between on-site and estimated surface reflectance. Overall, our study provides a good insight of AC algorithms' performance to developers and users, pointing out similarities and differences for AOD, WV and SR retrievals. Such validation though still lacks of ground-based measurements of known uncertainty to better assess and characterize the uncertainties in SR retrievals.

Atmospheric correction↗

DOE OSTI2022

Pronghorn Porous Media Model Validation with Pressure Drop Measurements

The verification and validation (V&V) of Pronghorn is imperative to assert its accuracy when predicting the fluid velocity, temperature, and pressure in high temperature gas-cooled reactors. Pronghorn is a coarse-mesh, intermediate-fidelity, and multidimensional thermal-hydraulics (TH) code developed by the Idaho National Laboratory (INL). New pebble bed experiments are used to observe the details of the fluid motion and pressure drop in the porous bed under the reactor normal operation. This paper focuses on the validation of the Pronghorn compressible and incompressible Navier-Stokes equations using the pressure drop measurements performed at the engineering-scale pebble bed facility at the Texas A&M university (TAMU). Various pressure drop correlations and porosity functions are implemented in both Pronghorn and STAR-CCM+ to compare the pressure drop due to the combined viscous and inertial resistances in the porous bed. The correlations accounting for the near-wall effect are also utilized to observe if the pressure drop estimates can be improved. Pronghorn porous media models predict the pressure drop well relative to the STAR-CCM+ simulation results and 1D correlations, and both the finite element method (FEM) and finite volume method (FVM) perform accurately. Pronghorn models are also validated with the experimental measurements given the different Reynolds number ranges and specific aspect ratios. The likelihood of the statistical significance between the pressure drop measurements and specific correlations or simulations is low provided that the overlap of their confidence intervals is more than the half of a single arm. Several validation metrics are reasonable in regard to the similar studies from other literature. The precise average pebble bed porosity estimation has much impact on the pressure drop, and the Foumeny and Montillet (dense packing) models carry out the accurate pressure drop prediction by considering the near-wall effect.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2024

Utilizing digitized occurrence records of Midwestern feral Cannabis sativa to develop ecological niche models

Hemp (Cannabis sativa L.) has historically played a vital role in agriculture across the globe. Feral and wild populations have served as genetic resources for breeding, conservation, and adaptation to changing environmental conditions. However, feral populations of Cannabis, specifically in the Midwestern United States, remain poorly understood. This study aims to characterize the abiotic tolerances of these populations, estimate suitable areas, identify regions at risk of abiotic suitability change, and highlight the utility of ecological niche models (ENMs) in germplasm conservation. The Maxent algorithm was used to construct a series of ENMs. Validation metrics and MOP (Mobility-oriented Parity) analysis were used to assess extrapolation risk and model performance. We also projected the final projected under current and future climate scenarios (2021–2040 and 2061–2080) to assess how abiotic suitability changes with time. Climate change scenarios indicated an expansion of suitable habitat, with priority areas for germplasm collection in Indiana, Illinois, Kansas, Missouri, and Nebraska. This study demonstrates the application of ENMs for characterizing feral Cannabis populations and highlights their value in germplasm conservation and breeding efforts. Populations of feral C. sativa in the Midwest are of high interest, and future research should focus on utilizing tools to aid the collection of materials for the characterization of genetic diversity and adaptation to a changing climate.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2026

Effect of soot concentration on radiative transport in a 2 m JP-8 pool fire

Hubbard et al. (2024) investigated conjugate heat transfer in a 7.9 m JP-8 pool fire, utilizing both heavily sooting and non-sooting fuel models. Their findings indicated that all models produced pool radiative heat fluxes within the measurement uncertainty for large-scale outdoor experiments. This study aims to further investigate the influence of soot concentration on radiative transport. To this end, Large Eddy Simulations (LES) of a 2 m diameter JP-8 pool fire were conducted, employing four turbulent combustion chemistry models: the Eddy Dissipation Concept (EDC) and three variants of flamelet model. Additionally, three variations of the one-equation subgrid scale turbulence kinetic energy model, and multiple mesh resolutions were utilized. The primary validation metrics were pool radiative heat flux and plume radiative fraction, with simulation data compared to experimental results published by Blanchat et al. (2010). The EDC model produced high soot concentrations near the pool surface, resulting in a significant shielding effect. In contrast, the flamelet combustion model has different kinetic limiters for soot production, leading to soot formation higher in the flame, where it can be more readily oxidized. Flamelet models incorporating both acetylene and benzene contributions to soot growth demonstrated better agreement with experimental data. To assess the sensitivity of pool radiative heat flux to soot mass concentration, we used a one-dimensional approximation over a wide range of soot concentrations and compared it to three-dimensional solutions obtained using Discrete Ordinates. Furthermore, this analysis illustrates the impacts of soot shielding and Turbulence Radiation Interactions (TRI), with TRI emission enhancement factors predicted to be in the range of 3–5 near the edges of the plume.

Computational fluid dynamics↗

DOE OSTI2020

Quantitative assessment of eddy viscosity rans models for turbulent mixed convection in a differentially heated plane channel

Turbulent mixed convection between two vertical, infinite parallel plates at different temperatures is studied using various two-equation turbulence models. The numerical simulations are performed at a turbulent Reynolds number of Re τ = 150 and a Grashof number of Gr = 9.6 × 10 5 . Comparisons are made against the highly trusted DNS results. Consistent with the DNS approach, the current simulations are performed using constant properties and the Boussinesq approximation to predict the influence of buoyancy. Previous studies have provided assessments of two-equation turbulence models for various scenarios, but often rely on a qualitative “eye” test in order to determine the most appropriate model to predict a given flow. This study aims to provide a new form of quantitative assessment that accounts for both the physics captured by the turbulence model as well as the magnitude of the system response quantities (SRQ) using a modified symmetric mean absolute percent error (SMAPE) method. This method is designed to be approachable to researchers at any level and can be applied to system response quantities from multiple research fields. Uncertainty quantification is also performed to determine the discretization error for each turbulence model. Recommendations are made as to which turbulence models best capture the physics – hydrodynamically and thermally – using both local and global validation metrics. Lastly, a sensitivity analysis is performed on the damping functions used in the most accurate models. This underpins the potential of model developments and adjustments most worth pursuing for buoyant flows. Finally, this framework provides a more physics-based comparative analysis of the selected turbulence models.

42 ENGINEERING↗

DOE OSTI2021

Evolution of standardization and dissemination of cryo-EM structures and data jointly by the community, PDB, and EMDB

Cryogenic electron microscopy (cryo-EM) methods began to be used in the mid-1970s to study thin and periodic arrays of proteins. Following a half-century of development in cryo-specimen preparation, instrumentation, data collection, data processing and modeling software, cryo-EM has become a routine method for solving structures from large biological assemblies to small biomolecules at near to true atomic resolution. This review explores the critical roles played by the Protein Data Bank (PDB) and Electron Microscopy Data Bank (EMDB) in partnership with the community to develop the necessary infrastructure to archive cryo-EM maps and associated models. Public access to cryo-EM structure data has in turn facilitated better understanding of structure-function relationships and advancement of image processing and modeling tool development. The partnership between the global cryo-EM community and PDB and EMDB leadership has synergistically shaped the standards for metadata, one-stop deposition of maps and models, and validation metrics to assess the quality of cryo-EM structures. The advent of cryo-electron tomography (cryo-ET) for in situ molecular cell structures at a broad resolution range and their correlations with other imaging data introduces new data archival challenges in terms of data size and complexity in the years to come.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2020

Molecular Structure of Sphingomyelin in Fluid Phase Bilayers Determined by the Joint Analysis of Small-Angle Neutron and X-ray Scattering Data

In this work, we have determined the fluid bilayer structure of palmitoyl sphingomyelin (PSM) and stearoyl sphingomyelin (SSM) by simultaneously analyzing small-angle neutron and X-ray scattering data. Using a newly developed scattering density profile (SDP) model for sphingomyelin lipids, we report structural parameters including the area per lipid, total bilayer thickness, and hydrocarbon thickness, in addition to lipid volumes determined by densitometry. Unconstrained all-atom simulations of PSM bilayers at 55 °C using the C36 CHARMM force field produced a lipid area of 56 Å 2 , a value that is 10% lower than the one determined experimentally by SDP analysis (61.9 Å2). Furthermore, scattering form factors calculated from the unconstrained simulations were in poor agreement with experimental form factors, even though segmental order parameter (S CD ) profiles calculated from the simulations were in relatively good agreement with S CD profiles obtained from NMR experiments. Conversely, constrained area simulations at 61.9 Å 2 resulted in good agreement between the simulation and experimental scattering form factors, but not with S CD profiles from NMR. We discuss possible reasons for the discrepancies between these two types of data that are frequently used as validation metrics for molecular dynamics force fields.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2022

La-Based Perovskite Oxide Catalysts for Alkaline Oxygen Reduction: The Importance of Electrochemical Stability

Alkaline fuel cells represent a promising energy conversion technology since they enable the use of precious metal-free electrocatalysts for the oxygen reduction reaction. Among these, La-based perovskite oxides, with great compositional and structural tunability, are especially attractive. However, we believe that the current literature lacks a thorough understanding of their inherent (in)stability issues. Here, in this study, we report on nine La-based perovskite oxide electrocatalysts for the oxygen reduction reaction, including LaMO 3 (M = Mn, Co, Ni) and LaCo x M 1–x O 3 (M = Mn, Ni; x = 0.9, 0.5, 0.1). While some exhibited initial promising activity, they all degraded significantly, even after brief electrochemical testing. Through comprehensive structural characterization of LaCo 0.9 Mn 0.1 O 3 , particularly scanning transmission electron microscopy, we found evidence to support a degradation mechanism in which the B-site cation species irreversibly leach from the perovskite under testing conditions. A sample cycled 10 000 times from +0.4 to +1.2 V vs reversible hydrogen electrode (RHE) showed an amorphous La oxide shell 1–2 nm thick. Bulk analyses showed that B-site leaching also occurs for samples soaked in 1 M KOH or pure EtOH. The mechanistic insights provided here should help inform the future design of La-based perovskite oxide electrocatalysts for alkaline fuel cells and stress the importance of stability metrics validating claims of promising electrocatalytic activity.

Seok, Jeesoo↗

DOE OSTI2023

Isotope effects on energy transport in the core of ASDEX-Upgrade tokamak plasmas: Turbulence measurements and model validation

Design and operation of future tokamak fusion reactors using a deuterium–tritium 50:50 mix requires a solid understanding of how energy confinement properties change with ion mass. This study looks at how turbulence and energy transport change in L-mode plasmas in the ASDEX Upgrade tokamak when changing ion species between hydrogen and deuterium. For this purpose, both experimental turbulence measurements and modeling are employed. Local measurements of ion-scale (with wavevector of fluctuations perpendicular to the B-field k⊥< 2 cm−1, k⊥ρs< 0.2, where ρs is the ion sound Larmor radius using the deuterium ion mass) electron temperature fluctuations have been performed in the outer core (normalized toroidal flux ρTor=0.65−0.8) using a multi-channel correlation electron cyclotron emission diagnostic. Lower root mean square perpendicular fluctuation amplitudes and radial correlation lengths have been measured in hydrogen vs deuterium. Measurements of the cross-phase angle between a normal-incidence reflectometer and an ECE signal were made to infer the cross-phase angle between density and temperature fluctuations. The magnitude of the cross-phase angle was found larger (more out-of-phase) in hydrogen than in deuterium. TRANSP power balance simulations show a larger ion heat flux in hydrogen where the electron-ion heat exchange term is found to play an important role. These experimental observations were used as the basis of a validation study of both quasilinear gyrofluid trapped gyro-Landau fluid-SAT2 and nonlinear gyrokinetic GENE codes. Linear solvers indicate that, at long wavelengths (k⊥ρs<1), energy transport in the deuterium discharge is dominated by a mixed ion-temperature-gradient (ITG) and trapped-electron mode turbulence while in hydrogen transport is exclusively and more strongly driven by ITG turbulence. The Ricci validation metric has been used to quantify the agreement between experiments and simulations taking into account both experimental and simulation uncertainties as well as four different observables across different levels of the primacy hierarchy.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2022

MRI-Based Radiotherapy Planning to Reduce Rectal Dose in Excess of Tolerance

Background and Purpose. Chronic rectal toxicity significantly decreases the quality of life for men who receive radiotherapy for prostate cancer. The most significant predictor of rectal toxicity is rectal dose-volume exceeding tolerance. To minimize the volume of rectum in the high dose field, it is essential to accurately define the prostate-rectum interface. This can be challenging to do by computed tomography (CT) imaging alone. The current study was undertaken to formally demonstrate in a clinical trial setting that image-guided intensity-modulated radiation therapy (IG-IMRT) planning using magnetic resonance imaging (MRI) can reduce the volume of rectum exceeding 70 Gy, a validated metric that predicts the risk of late rectal toxicity. Materials and Methods. This prospective single-arm study enrolled 15 men treated with IG-IMRT for localized prostate cancer. All participants received a dedicated 3 Tesla MRI examination of the prostate in addition to a pelvic CT examination for treatment planning. Two volumetric modulated arc therapy (VMAT) plans with a prescription dose of 79.2 Gy were designed using identical constraints based on CT- and MRI-defined consensus volumes. The volume of rectum exposed to 70 Gy or more was compared using the Wilcoxon paired signed rank test. Results. For CT-based treatment plans, the median volume of rectum receiving 70 Gy or more was 9.3 cubic centimeters (cc) (IQR 7.0 to 10.2) compared with 4.9 cc (IQR 4.1 to 7.8) for MRI-based plans. This resulted in a median volume reduction of 2.1 cc (IQR 0.5 to 5.3, P < .001). Conclusions. Using MRI to plan prostate IG-IMRT to a dose of 79.2 Gy reduces the volume of rectum receiving radiation dose in excess of tolerance (70 Gy or more) and should be considered in men who are at high risk for late rectal toxicity and are not good candidates for other rectal sparing techniques such as hydrogel spacer. This trial is registered with NCT02470910.

Schmidt, Daniel R.↗

DOE OSTI2022

Design and execution of a verification, validation, and uncertainty quantification plan for a numerical model of left ventricular flow after LVAD implantation

Left ventricular assist devices (LVADs) are implantable pumps that act as a life support therapy for patients with severe heart failure. Despite improving the survival rate, LVAD therapy can carry major complications. Particularly, the flow distortion introduced by the LVAD in the left ventricle (LV) may induce thrombus formation. While previous works have used numerical models to study the impact of multiple variables in the intra-LV stagnation regions, a comprehensive validation analysis has never been executed. The main goal of this work is to present a model of the LV-LVAD system and to design and follow a verification, validation and uncertainty quantification (VVUQ) plan based on the ASME V&V40 and V&V20 standards to ensure credible predictions. The experiment used to validate the simulation is the SDSU cardiac simulator, a bench mock-up of the cardiovascular system that allows mimicking multiple operation conditions for the heart-LVAD system. The numerical model is based on Alya, the BSC’s in-house platform for numerical modelling. Alya solves the Navier-Stokes equation with an Arbitrary Lagrangian-Eulerian (ALE) formulation in a deformable ventricle and includes pressure-driven valves, a 0D Windkessel model for the arterial output and a LVAD boundary condition modeled through a dynamic pressure-flow performance curve. The designed VVUQ plan involves: (a) a risk analysis and the associated credibility goals; (b) a verification stage to ensure correctness in the numerical solution procedure; (c) a sensitivity analysis to quantify the impact of the inputs on the four quantities of interest (QoIs) (average aortic root flow $Q^{avg}_{Ao}$, maximum aortic root flow $Q^{max}_{Ao}$, average LVAD flow $Q^{avg}_{VAD}$, and maximum LVAD flow $Q^{max}_{VAD}$; (d) an uncertainty quantification using six validation experiments that include extreme operating conditions. Numerical code verification tests ensured correctness of the solution procedure and numerical calculation verification showed a grid convergence index (GCI)95% <3.3%. The total Sobol indices obtained during the sensitivity analysis demonstrated that the ejection fraction, the heart rate, and the pump performance curve coefficients are the most impactful inputs for the analysed QoIs. The Minkowski norm is used as validation metric for the uncertainty quantification. It shows that the midpoint cases have more accurate results when compared to the extreme cases. The total computational cost of the simulations was above 100 [core-years] executed in around three weeks time span in Marenostrum IV supercomputer. This work details a novel numerical model for the LV-LVAD system, that is supported by the design and execution of a VVUQ plan created following recognised international standards. We present a methodology demonstrating that stringent VVUQ according to ASME standards is feasible but computationally expensive.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2022

Validation Analysis of Medium-Scale Methanol Pool Fire Simulated in SIERRA/Fuego [Slides]

Analysis of methanol pool fire conducted as part of validation study for SIERRA/Fuego. Results showed trends & errors consistent with related studies. Area validation metric provides way to quantify model form uncertainty. AVM shows that more work could be done to understand how model form uncertainty varies with mesh resolution. There is a possible atypical use of MAVM on time-series data. AVM shows mismatch between predicted flame height and experimental value less sensitive to variations in mixture fraction than temperature. Mismatch about experimental value also more symmetric for mixture fraction. Our analysis showed that mixture fraction is preferable for this application.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2026

Longitudinal Phase Space Tomography for the Booster Synchrotron

Efforts in the study of the longitudinal behavior of charged particles in the Fermilab Booster can be catalyzed with an image of the two-dimensional phase space distribution. In the past, tomography has been extensively employed in the reconstruction of the phase space in accelerators such as the Recycler at Fermilab and the Proton Synchrotron Booster at CERN. However, such a capability had yet to realize for the Fermilab Booster synchrotron. In this work, the first successful tomographic phase space reconstruction of a low-energy Booster bunch is presented along with validation metrics. A numerical turn-by-turn model of the longitudinal particle dynamics in the Booster has been implemented, which utilizes a fast, map-based particle transport algorithm. Using a sinogram generated from the Wall Current Monitor, the iterative reconstruction algorithm recovers a discretized image of the original phase space distribution at variable resolution. The reconstruction result shows low root-mean-square error and a rapid convergence toward the solution, providing strong evidence of accuracy. Future and ongoing work includes modeling high-energy bunches above transition and using tomography to infer certain machine parameters such as synchronous phase, peak gap voltage, and synchronous energy in addition to the phase space distribution.

Ebeid, Safi [Unlisted]↗

DOE OSTI2026

Longitudinal Phase Space Tomography for the Booster Synchrotron (Abstract Only)

Ebeid, Safi [Unlisted, US]↗

NASA NTRS1987

Methodology requirements for intelligent systems architecture

The methodology required for the development of the 'intelligent system architecture' of distributed computer systems which integrate standard data processing capabilities with symbolic processing to provide powerful and highly autonomous adaptive processing capabilities must encompass three elements: (1) a design knowledge capture system, (2) computer-aided engineering, and (3) verification and validation metrics and tests. Emphasis must be put on the earliest possible definition of system requirements and the realistic definition of allowable system uncertainties. Methodologies must also address human factor issues.

Grant, Terry↗

NASA NTRS2011

Validating LES for Jet Aeroacoustics

Engineers charged with making jet aircraft quieter have long dreamed of being able to see exactly how turbulent eddies produce sound and this dream is now coming true with the advent of large eddy simulation (LES). Two obvious challenges remain: validating the LES codes at the resolution required to see the fluid-acoustic coupling, and the interpretation of the massive datasets that result in having dreams come true. This paper primarily addresses the former, the use of advanced experimental techniques such as particle image velocimetry (PIV) and Raman and Rayleigh scattering, to validate the computer codes and procedures used to create LES solutions. It also addresses the latter problem in discussing what are relevant measures critical for aeroacoustics that should be used in validating LES codes. These new diagnostic techniques deliver measurements and flow statistics of increasing sophistication and capability, but what of their accuracy? And what are the measures to be used in validation? This paper argues that the issue of accuracy be addressed by cross-facility and cross-disciplinary examination of modern datasets along with increased reporting of internal quality checks in PIV analysis. Further, it is argued that the appropriate validation metrics for aeroacoustic applications are increasingly complicated statistics that have been shown in aeroacoustic theory to be critical to flow-generated sound.

Bridges, James↗

NASA NTRS2014

GCR Environmental Models III: GCR Model Validation and Propagated Uncertainties in Effective Dose

This is the last of three papers focused on quantifying the uncertainty associated with galactic cosmic rays (GCR) models used for space radiation shielding applications. In the first paper, it was found that GCR ions with Z>2 and boundary energy below 500 MeV/nucleon induce less than 5% of the total effective dose behind shielding. This is an important finding since GCR model development and validation have been heavily biased toward Advanced Composition Explorer/Cosmic Ray Isotope Spectrometer measurements below 500 MeV/nucleon. Weights were also developed that quantify the relative contribution of defined GCR energy and charge groups to effective dose behind shielding. In the second paper, it was shown that these weights could be used to efficiently propagate GCR model uncertainties into effective dose behind shielding. In this work, uncertainties are quantified for a few commonly used GCR models. A validation metric is developed that accounts for measurements uncertainty, and the metric is coupled to the fast uncertainty propagation method. For this work, the Badhwar-O'Neill (BON) 2010 and 2011 and the Matthia GCR models are compared to an extensive measurement database. It is shown that BON2011 systematically overestimates heavy ion fluxes in the range 0.5-4 GeV/nucleon. The BON2010 and BON2011 also show moderate and large errors in reproducing past solar activity near the 2000 solar maximum and 2010 solar minimum. It is found that all three models induce relative errors in effective dose in the interval [-20%, 20%] at a 68% confidence level. The BON2010 and Matthia models are found to have similar overall uncertainty estimates and are preferred for space radiation shielding applications.

Slaba, Tony C.↗