Search NASA⌕ Search

SEARCH · Search NASA

Results for “data base for model validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44

THE VELOCITY DISTRIBUTION OF NEARBY STARS FROM HIPPARCOS DATA. I. THE SIGNIFICANCE OF THE MOVING GROUPS

We present a three-dimensional reconstruction of the velocity distribution of nearby stars ({approx}<100 pc) using a maximum likelihood density estimation technique applied to the two-dimensional tangential velocities of stars. The underlying distribution is modeled as a mixture of Gaussian components. The algorithm reconstructs the error-deconvolved distribution function, even when the individual stars have unique error and missing-data properties. We apply this technique to the tangential velocity measurements from a kinematically unbiased sample of 11,865 main-sequence stars observed by the Hipparcos satellite. We explore various methods for validating the complexity of the resulting velocity distribution function, including criteria based on Bayesian model selection and how accurately our reconstruction predicts the radial velocities of a sample of stars from the Geneva-Copenhagen Survey (GCS). Using this very conservative external validation test based on the GCS, we find that there is little evidence for structure in the distribution function beyond the moving groups established prior to the Hipparcos mission. This is in sharp contrast with internal tests performed here and in previous analyses, which point consistently to maximal structure in the velocity distribution. We quantify the information content of the radial velocity measurements and find that the mean amount of new information gained from a radial velocity measurement of a single star is significant. This argues for complementary radial velocity surveys to upcoming astrometric surveys.

99 GENERAL AND MISCELLANEOUS↗

Influence of sky radiance measurement errors on inversion-retrieved aerosol properties

Remote sensing of the atmospheric aerosol is a well-established technique that is currently used for routine monitoring of this atmospheric component, both from ground-based and satellite. The AERONET program, initiated in the 90's, is the most extended network and the data provided are currently used by a wide community of users for aerosol characterization, satellite and model validation and synergetic use with other instrumentation (lidar, in-situ, etc.). Aerosol properties are derived within the network from measurements made by ground-based Sun-sky scanning radiometers. Sky radiances are acquired in two geometries: almucantar and principal plane. Discrepancies in the products obtained following both geometries have been observed and the main aim of this work is to determine if they could be justified by measurement errors. Three systematic errors have been analyzed in order to quantify the effects on the inversion-derived aerosol properties: calibration, pointing accuracy and finite field of view. Simulations have shown that typical uncertainty in the analyzed quantities (5% in calibration, 0.2 Degree-Sign in pointing and 1.2 Degree-Sign field of view) yields to errors in the retrieved parameters that vary depending on the aerosol type and geometry. While calibration and pointing errors have relevant impact on the products, the finite field of view does not produce notable differences.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Conditional distribution estimation of building characteristics with diffusion models for urban energy modeling

Understanding current energy consumption behavior in communities is critical for informing future energy use decisions and enabling efficient energy management. Urban energy models, which are used to simulate these energy use patterns, require large datasets with detailed building characteristics for accurate outcomes. However, such detailed characteristics at the individual building level are often unknown and costly to acquire, or unavailable. Through this work, we propose using a generative modeling approach to generate realistic building attributes to fill in the data gaps and finally provide complete characteristics as inputs to energy models. Our model learns complex, building-level patterns from training on a large-scale residential building stock model containing 2.2 million buildings. We employ a tabular diffusion-based framework that is designed to handle heterogeneous (discrete and continuous) features in tabular building data, such as occupancy, floor area, heating, cooling, and other equipment details. We develop a capability for conditional diffusion, enabling the imputation of missing building characteristics conditioned on known attributes. We conduct a comprehensive validation of our conditional diffusion model, firstly by comparing the generated conditional distributions against the underlying data distribution, and secondly, by performing a case study for a Baltimore residential region, showing the practical utility of our approach. Our work is one of the first to demonstrate the potential of generative modeling to accelerate building energy modeling workflows.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

5-minute Wind Power Data based on WFIP2 WRF Simulation

The second Wind Forecast Improvement Project (WFIP2) was a public-private partnership funded by the U.S. Department of Energy and NOAA, aimed at enhancing the forecast skill of numerical weather prediction models for turbine-height winds in regions with complex terrain. An 18-month Weather Research and Forecasting (WRF) model simulation was conducted over the Pacific Northwest, with model outputs validated against observational data collected during WFIP2. Simulated wind speeds were used to estimate wind power generation using reV (the Renewable Energy Potential Model developed by NREL) at ten wind project sites. Two sets of results were produced: one using wind speeds extracted from the model grid cell at the project centroid, and another using wind speeds from the actual turbine locations. For each dataset, power output was calculated using both actual turbine-specific power curves and nine generic power curves to convert wind speed into power.

17 WIND ENERGY↗

$\nu_μ$ Disappearance in MicroBooNE using the Deep Learning 1$\mu$1$p$ Selection

We test a 3+1 model with the MicroBooNE data using a 1µ1p selection developed using Deep-Learning-based reconstruction. In order to test this model we apply a muon neutrino disappearance effect to the selection, and search across a grid of oscillation model parameters using a Feldman Cousins technique. We determine MicroBooNE’s sensitivity across this model parameter space, and perform several validation studies to test this study’s robustness. Finally, we examine the allowed and excluded regions per MicroBooNE’s data at 90% confidence, using a data set corresponding to 6.67 × 10 20 protons on target. The null model remains allowed, and several of the high-disappearance models are excluded.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

$\nu_μ$ Disappearance in MicroBooNE using the Deep Learning 1$\mu$1$p$ Selection

We test a 3+1 model with the MicroBooNE data using a 1µ1p selection developed using Deep-Learning-based reconstruction. In order to test this model we apply a muon neutrino disappearance effect to the selection, and search across a grid of oscillation model parameters using a Feldman Cousins technique. We determine MicroBooNE’s sensitivity across this model parameter space, and perform several validation studies to test this study’s robustness. Finally, we examine the allowed and excluded regions per MicroBooNE’s data at 90% confidence, using a data set corresponding to 6.67 × 10 20 protons on target. The null model remains allowed, and several of the high-disappearance models are excluded.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Flux in a 1D-Reactor Cell by Response Matrix

Legacy computational reactor physics software tools and protocols currently used in support of the Advanced Test Reactor (ATR) core fuel management and safety assurance, and to some extent, experiment management, are inconsistent with the state of modern nuclear engineering practice. Thus, they are difficult, if not impossible, to verify and validate (V and V) according to modern standards. Furthermore, the legacy staff knowledge required for effective application of their application and protocols from the 1960's and 1970's is rapidly being lost due to staff turnover and retirements. In late 2009, the Idaho National Laboratory (INL) initiated a focused effort, the ATR Core Modeling Update Project, to address this situation through the introduction of modern high-fidelity transport theory based computational software and models to replace the legacy methods, with appropriate (V and V) protocols according to applicable national standards. The new computational tools include: - The 2-dimensional HELIOS deterministic transport code for integrated ATR core fuel and experiment management and Core Safety Analysis Package (CSAP) physics data generation. The MCNP5 3-dimensional stochastic simulation (Monte Carlo) code for verification and validation applications and for specialized ATR core analysis along with its longstanding traditional role in experiment support - The 2-dimensional deterministic NEWT transport code and the 3-dimensional KENO6 stochastic simulation code, with their SCALE-based support infrastructure for use in V and V applications and as supporting modules for sensitivity-uncertainty analysis via the TSUNAMI system. The ATTILA 3-dimensional discrete-ordinates transport code for specialized experiment support and possibly additional applications. Regardless of application, every neutron transport code, new or legacy, requires verification. The aim of this presentation is to provide a neutron transport benchmark for a simple 1D-reactor cell in plane geometry. The benchmark finds use as a standard of comparison for the codes listed above intended for the ATR upgrade. The method developed here is in contrast to the finite Fourier transform solution found in Ref. 1, which is limited to isotropic scattering and particularly difficult to numerically implement unless the total cross section is constant over the cell.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

IMPROVED COMPUTATIONAL NEUTRONICS METHODS AND VALIDATION PROTOCOLS FOR THE ADVANCED TEST REACTOR

The Idaho National Laboratory (INL) is in the process of modernizing the various reactor physics modeling and simulation tools used to support operation and safety assurance of the Advanced Test Reactor (ATR). Key accomplishments so far have encompassed both computational as well as experimental work. A new suite of stochastic and deterministic transport theory based reactor physics codes and their supporting nuclear data libraries (HELIOS, KENO6/SCALE, NEWT/SCALE, ATTILA, and an extended implementation of MCNP5) has been installed at the INL. Corresponding models of the ATR and ATRC are now operational with all five codes, demonstrating the basic feasibility of the new code packages for their intended purpose. Of particular importance, a set of as-run core depletion HELIOS calculations for all ATR cycles since August 2009 was successfully completed during 2011. This demonstration supported a decision late in the year to proceed with the phased incorporation of the HELIOS methodology into the ATR fuel cycle management process beginning in 2012. On the experimental side of the project, new hardware was fabricated, measurement protocols were finalized, and the first four of six planned physics code validation experiments based on neutron activation spectrometry were conducted at the ATRC facility. Data analysis for the first three experiments, focused on characterization of the neutron spectrum in one of the ATR flux traps, has been completed. The six experiments will ultimately form the basis for a flexible, easily-repeatable ATR physics code validation protocol that is consistent with applicable ASTM standards.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Study of Data-Driven Mesh-Model Optimization in System Thermal-Hydraulic Simulation

Quantification of nuclear power plant safety risk requires a systematic and yet practical approach to identification of accident scenarios, assessment of their likelihood and consequences. Instrumental to this goal is risk-informed safety margin characterization (RISMC) framework, whose realization requires computationally robust and affordable methods for sufficiently accurate simulation of complex multi-dimensional physical phenomena, such as turbulent and multi-phase flow. The CFD-like correlation-based codes with 3D simulation capability (e.g., GOTHIC) ensure computational efficiency using coarse mesh size and the sub-grid phenomena in the boundary layer that can be captured by adequate constitutive correlations. However, the error sources and user effects on the selection of mesh size and models lead to unpredictable simulation error, while rich High-Fidelity (HF) data from experiments and numerical simulation using validated code or DNS are not fully explored. It would be useful to have a “smart” data-driven multi-scale framework in which the low-resolution models can be “taught” to emulate high-resolution models. The objective of this work is to develop and evaluate a physical-based data-driven mesh-model optimization approach (Optimized Mesh/Model Information System, OMIS) to estimate the simulation error and give advice on the optimized selection of coarse mesh size and Low-Fidelity (LF) models for System Thermal Hydraulic (STH) simulation to achieve accuracy comparable to that of HF models. This approach takes advantages of computational efficiency of coarse-mesh simulation and application of Machine Learning (ML) algorithms.

97 MATHEMATICS AND COMPUTING↗

HDSense: An efficient method for ranking observable sensitivity

Identifying which observables most effectively constrain model parameters can be computationally prohibitive when considering full likelihoods of many correlated observables. This is especially important for, e.g., hadronization models, where high precision is required to interpret the results of collider experiments. We introduce the High-Dimensional Sensitivity (HDSense) score, a computationally efficient metric for ranking observable sets using only one-dimensional histograms. Derived by profiling over unknown correlations in the Fisher information framework, the score balances total information content against redundancy between observables. We apply HDSense to rank a set observables in terms of their constraining power with respect to five parameters of the Lund string model of hadronization implemented in Pythia using simulated leptonic collider events at the $Z$ pole. Validation against machine-learning--based full-likelihood approximations demonstrates that HDSense successfully identifies near-optimal observable subsets. The framework naturally handles data from multiple experiments with different acceptances and incorporates detector effects. While demonstrated on hadronization models, the methodology applies broadly to generic parameter estimation problems where correlations are unknown or difficult to model.

Assi, Benoît [Cincinnati U.] (ORCID:00000003092433↗

Scalable deep learning for watershed model calibration

Watershed models such as the Soil and Water Assessment Tool (SWAT) consist of high-dimensional physical and empirical parameters. These parameters often need to be estimated/calibrated through inverse modeling to produce reliable predictions on hydrological fluxes and states. Existing parameter estimation methods can be time consuming, inefficient, and computationally expensive for high-dimensional problems. In this paper, we present an accurate and robust method to calibrate the SWAT model (i.e., 20 parameters) using scalable deep learning (DL). We developed inverse models based on convolutional neural networks (CNN) to assimilate observed streamflow data and estimate the SWAT model parameters. Scalable hyperparameter tuning is performed using high-performance computing resources to identify the top 50 optimal neural network architectures. We used ensemble SWAT simulations to train, validate, and test the CNN models. We estimated the parameters of the SWAT model using observed streamflow data and assessed the impact of measurement errors on SWAT model calibration. We tested and validated the proposed scalable DL methodology on the American River Watershed, located in the Pacific Northwest-based Yakima River basin. Our results show that the CNN-based calibration is better than two popular parameter estimation methods (i.e., the generalized likelihood uncertainty estimation [GLUE] and the dynamically dimensioned search [DDS], which is a global optimization algorithm). For the set of parameters that are sensitive to the observations, our proposed method yields narrower ranges than the GLUE method but broader ranges than values produced using the DDS method within the sampling range even under high relative observational errors. The SWAT model calibration performance using the CNNs, GLUE, and DDS methods are compared using R 2 and a set of efficiency metrics, including Nash-Sutcliffe, logarithmic Nash-Sutcliffe, Kling-Gupta, modified Kling-Gupta, and non-parametric Kling-Gupta scores, computed on the observed and simulated watershed responses. The best CNN-based calibrated set has scores of 0.71, 0.75, 0.85, 0.85, 0.86, and 0.91. The best DDS-based calibrated set has scores of 0.62, 0.69, 0.8, 0.77, 0.79, and 0.82. The best GLUE-based calibrated set has scores of 0.56, 0.58, 0.71, 0.7, 0.71, and 0.8. The scores above show that the CNN-based calibration leads to more accurate low and high streamflow predictions than the GLUE and DDS sets. Our research demonstrates that the proposed method has high potential to improve our current practice in calibrating large-scale integrated hydrologic models.

54 ENVIRONMENTAL SCIENCES↗

Validation of a Hot Water Distribution Model Using Laboratory and Field Data

Characterizing the performance of hot water distribution systems is a critical step in developing best practice guidelines for the design and installation of high performance hot water systems. Developing and validating simulation models is critical to this effort, as well as collecting accurate input data to drive the models. In this project, the ARBI team validated the newly developed TRNSYS Type 604 pipe model against both detailed laboratory and field distribution system performance data. Validation efforts indicate that the model performs very well in handling different pipe materials, insulation cases, and varying hot water load conditions. Limitations of the model include the complexity of setting up the input file and long simulation run times. In addition to completing validation activities, this project looked at recent field hot water studies to better understand use patterns and potential behavioral changes as homeowners convert from conventional storage water heaters to gas tankless units. Based on these datasets, we conclude that the current Energy Factor test procedure overestimates typical use and underestimates the number of hot water draws. This has implications for both equipment and distribution system performance. Gas tankless water heaters were found to impact how people use hot water, but the data does not necessarily suggest an increase in usage. Further study in hot water usage and patterns is needed to better define these characteristics in different climates and home vintages.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

PyOECP: A flexible open-source software library for estimating and modeling the complex permittivity based on the open-ended coaxial probe (OECP) technique

Here, we present PyOECP, a Python-based flexible open-source software for estimating and modeling the complex permittivity obtained from the open-ended coaxial probe (OECP) technique. The transformation of the measured reflection coefficient to complex permittivity is performed based on three different methods. The software library contains the dielectric spectra of common reference liquids, which can be used to transform the reflection coefficient into the dielectric spectra. Several Python routines that are commonly employed (e.g., SciPy and NumPy) in the field of science and engineering are required only so that the users can alter the software structure depending on their needs. The modeling algorithm exploits the Markov Chain Monte Carlo method for the data regression. The discrete relaxation models can be built by a proper combination of well-known relaxation models. In addition to these models, electrode polarization, a typical measurement artifact for interpreting dielectric spectra, can be incorporated into the modeling algorithm. A continuous relaxation model, which solves the Fredholm integral equation of the first kind (a mathematically ill-posed problem), is also included. This open-source software enables users to freely adjust the physical parameters to obtain physical insight into their materials under test and will be consistently updated for more accurate measurement and interpretation of dielectric spectra in an automated manner. This work describes the theoretical and mathematical background of the software, lays out the workflow, and validates the software functionality based on both synthetic and empirical data included in the software.

97 MATHEMATICS AND COMPUTING↗

SCC Aerosol Transport Model Summary Report

The purpose of the present work is to introduce a generic and reliable numerical model for prediction of aerosol transport, deposition, and plugging in leak paths similar to stress corrosion cracks while accounting for potential plugging formation. The model is dynamic (changing leak path geometry due to plugging) and it relies on the numerical solution of the aerosol transport equation in one dimension using finite differences. An extensive validation exercise (particle diameters: 0.01-10 μm and pressure difference up to 12 kPa) was conducted based on comparisons with experimental and theoretical data. The developed model is fairly general since it is based on a generic mechanistic description of the aerosol flow and particle deposition in the leak path, without requiring experimental fittings other than using the leak rate parameters commonly available in practical applications. Despite the approximate agreement of the model with the experimental data, the obtained predictions can be qualified as realistic. This is a major achievement of the model, which has been based on generic aerosol mechanics with no reference or adjustment to experimental data.

42 ENGINEERING↗

Quantification of Residual Water in Spent Fuel Dry Storage Canisters Using Mass Spectrometry

The purpose of this report is to document updates on the apparatus to simulate commercial vacuum drying procedures at the Nuclear Energy Work Complex at Sandia National Laboratories. Validation of the extent of water removal in a dry spent nuclear fuel storage system based on drying procedures used at nuclear power plants is needed to close existing technical gaps. Operational conditions leading to incomplete drying may have potential impacts on the fuel, cladding, and other components in the system during subsequent storage and disposal, such as fuel degradation; cladding corrosion, embrittlement, or breaching; and the creation of a flammable environment via radiolysis of water. A general lack of data suitable for model validation of commercial nuclear canister drying processes necessitates well-designed investigations of drying process efficacy and water retention. Scaled tests that incorporate relevant physics and well-controlled boundary conditions are essential to provide insight and guidance to the simulation of prototypic systems undergoing drying processes. This report documents details on the quantification of residual water in the Advanced Drying Cycle Simulator (ADCS), an apparatus built to simulate commercial drying procedures and quantify the amount of residual water remaining in a pressurized water reactor (PWR) fuel assembly after drying. The ADCS was constructed with a prototypic 17×17 PWR fuel skeleton and waterproof heater rods to simulate decay heat. The ADCS is outfitted with thermocouples to measure the thermal response of the ADCS to simulated decay heats and internal helium fill pressures relevant to commercial drying procedures. The ADCS is also instrumented with pressure transducers to measure the pressures and vacuum levels observed during simulated commercial drying. The most unique instrumentation used for quantifying residual water in the ADCS is a Hiden Analytical HPR-30 mass spectrometer (MS), which measures gas compositions of the ADCS internal free volume, based on partial pressures calculated from relative proportions of gas molecules detected by the MS. This report details the methodology used to implement MS measurements in quantifying residual water in the ADCS. This methodology includes the calibration of the HPR-30 MS to a Buck Research Instruments CR-4 chilled mirror hygrometer, which itself is calibrated to a NIST-traceable standard. Data collected by both the MS and the chilled mirror hygrometer from water/helium mixtures ranging from 150 to 500,000 ppmv water in helium were used to generate calibration curves, establishing a source of verification of MS measured water contents. Details regarding water content measurement uncertainties are included in this report, defining the accuracy and verifiability of the HPR-30 MS in measuring residual water content in simulated dry storage canister environments.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Reduction of density-modification bias by β correction

A cross-validation-based method for bias reduction in ‘classical’ iterative density modification of experimental X-ray crystallography maps provides significantly more accurate phase-quality estimates and leads to improved automated model building. Density modification often suffers from an overestimation of phase quality, as seen by escalated figures of merit. A new cross-validation-based method to address this estimation bias by applying a bias-correction parameter ‘β’ to maximum-likelihood phase-combination functions is proposed. In tests on over 100 single-wavelength anomalous diffraction data sets, the method is shown to produce much more reliable figures of merit and improved electron-density maps. Furthermore, significantly better results are obtained in automated model building iterated with phased refinement using the more accurate phase probability parameters from density modification.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Aerosol and Cloud Experiments in Eastern North Atlantic (ACE-ENA) Science Plan

With their extensive coverage, low clouds greatly impact global climate. Presently, low clouds are poorly represented in global climate models (GCMs), and the response of low clouds to changes in atmospheric greenhouse gases and aerosols remains the major source of uncertainty in climate simulations. The poor representations of low clouds in GCMs are in part due to inadequate observations of their microphysical and macrophysical structures, radiative effects, and the associated aerosol distribution and budget in regions where the aerosol impact is the greatest. The Eastern North Atlantic (ENA) is a region of persistent but diverse subtropical marine boundary-layer (MBL) clouds, whose albedo and precipitation are highly susceptible to perturbations in aerosol properties. Boundary-layer aerosol in the ENA region is influenced by a variety of sources, leading to strong variations in cloud condensation nuclei (CCN) concentration and aerosol optical properties. Recently a permanent ENA site was established by the U.S. Department of Energy (DOE)’s Atmospheric Radiation Measurement (ARM) Climate Research Facility on Graciosa Island in the Azores, providing invaluable information on MBL aerosol and low clouds. At the same time, the vertical structures and horizontal variabilities of aerosol, trace gases, cloud, drizzle, and atmospheric thermodynamics are critically needed for understanding and quantifying the budget of MBL aerosol, the radiative properties, precipitation efficiency, and lifecycle of MBL clouds, and the cloud response to aerosol perturbations. Much of this data can be obtained only through aircraft-based measurements. In addition, the interconnected aerosol and cloud processes are best investigated by a study involving simultaneous in situ aerosol, cloud, and thermodynamics measurements. Furthermore, in situ measurements are also necessary for validating and improving ground-based retrieval algorithms at the ENA site. This project is motivated by the need for comprehensive in situ characterizations of boundary-layer structure, and associated vertical distributions and horizontal variabilities of low clouds and aerosol over the Azores. ARM Aerial Facility (AAF) Gulfstream-1 (G-1) aircraft will be deployed at the ENA site during two intensive operational periods (IOPs) of early summer (June to July) of 2017 and winter (January to February) of 2018, respectively. Deployments during both seasons allow for examination of key aerosol and cloud processes under a variety of representative meteorological and cloud conditions. The science themes for the deployments include: 1) Budget of MBL CCN and its seasonal variation; 2) Effects of aerosol on cloud and precipitation; 3) Cloud microphysical and macrophysical structures, and entrainment mixing; 4) Advancing retrievals of turbulence, cloud, and drizzle; and 5) Model evaluation and processes studies. A key advantage of the deployments is the strong synergy between the measurements onboard the G-1 and the routine measurements at the ENA site, including state-of-the-art profiling and scanning radars. The 3D cloud structures provided by the scanning radars will put the detailed in situ measurements into mesoscale and cloud lifecycle contexts. On the other hand, high quality in situ measurements will enable validation and improvements of ground-based retrieval algorithms at the ENA site, leading to high-quality and statistically robust data sets from the routine measurements. The deployments, combined with the routine measurements at the ENA site, will have a long lasting impact on the research and modeling of low clouds and aerosols in the remote marine environment.

54 ENVIRONMENTAL SCIENCES↗