Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

Model and Validation of Single-Axis Tracking with Bifacial PV

Single-axis tracking is a cost-effective deployment strategy for large-scale ground-mount photovoltaic systems in regions with high direct-normal irradiance. Bifacial modules in 1-axis-tracking systems boost energy yield by 4%-15% depending on module type and ground albedo, with a global average of 9%. This benefit is in addition to the 15%-25% energy gain already afforded by single-axis tracking relative to fixed-tilt deployments. Here, we compare model results against field performance data for two side-by-side bifacial/monofacial tracked systems - one in Albuquerque, NM, USA, and one in eastern Oregon. The Albuquerque system shows monthly rear irradiance gain of 10%-14.9%, and the Oregon bifacial system has an average performance ratio 9.4% higher than the monofacial system. Both results match bifacial irradiance model results within uncertainty. Simulations show that smart tracking algorithms can offer more than 1% improvement on annual energy yield by adjusting tilt angle under cloudy conditions. Finally, ray-tracing simulations investigated edge brightening, suggesting a 15%-25% increase in rear irradiance at the ends of tracker rows, but up to 20% loss from center-mounted torque tubes, creating multiple shadows.

14 SOLAR ENERGY↗

Estimation of inflow uncertainties in laminar hypersonic double-cone experiments

We propose herein a probabilistic framework for assessing the consistency of an experimental dataset, i.e., whether the stated experimental conditions are consistent with the measurements provided. In case the dataset is inconsistent, our framework allows one to hypothesize and test sources of inconsistencies. This is crucial in model validation efforts. The framework relies on Bayesian inference to estimate experimental settings deemed uncertain, from measurements deemed accurate. The quality of the inferred variables is gauged by its ability to reproduce held-out experimental measurements. We test the correctness of the framework on three double-cone experiments conducted in the CUBRC Inc.'s LENS-I shock tunnel, which have also been numerically simulated successfully. Thereafter, we use the framework to investigate two double-cone experiments (executed in the LENS-XX shock tunnel) which have encountered difficulties when used in model validation exercises. We detect an inconsistency with one of the LENS-XX experiments. In addition, we hypothesize two causes for our inability to simulate LEXS-XX experiments accurately and test them using our framework. We find that there is no single cause that explains all the discrepancies between model predictions and experimental data, but different causes explain different discrepancies, to larger or smaller extent. We end by proposing that uncertainty quantification methods be used more widely to understand experiments and characterize facilities, and we cite three different methods to do so, the third of which we present in this paper.

Thermophysics↗

Multiple Environmental Influences on the Lightning of Cold-Based Continental Cumulonimbus Clouds. Part I: Description and Validation of Model

In this two-part paper, influences from environmental factors on lightning in a convective storm are assessed with a model. In Part I, an electrical component is described and applied in the Aerosol–Cloud model (AC). AC treats many types of secondary (e.g., breakup in ice–ice collisions, raindrop-freezing fragmentation, rime splintering) and primary (heterogeneous, homogeneous freezing) ice initiation. AC represents lightning flashes with a statistical treatment of branching from a fractal law constrained by video imagery. The storm simulated is from the Severe Thunderstorm Electrification and Precipitation Study (STEPS; 19/20 June 2000). The simulation was validated microphysically [e.g., ice/droplet concentrations and mean sizes, liquid water content (LWC), reflectivity, surface precipitation] and dynamically (e.g., ascent) in our 2017 paper. Predicted ice concentrations (~10 L -1 ) agreed—to within a factor of about 2—with aircraft data at flight levels (-10° to -15°C). Here, electrical statistics of the same simulation are compared with observations. Flash rates (to within a factor of 2), triggering altitudes and polarity of flashes, and electric fields, all agree with the coincident STEPS observations. The “normal” tripole of charge structure observed during an electrical balloon sounding is reproduced by AC. It is related to reversal of polarity of noninductive charging in ice–ice collisions seen in laboratory experiments when temperature or LWC are varied. Positively charged graupel and negatively charged snow at most midlevels, charged away from the fastest updrafts, is predicted to cause the normal tripole. Total charge separated in the simulated storm is dominated by collisions involving secondary ice from fragmentation in graupel–snow collisions.

54 ENVIRONMENTAL SCIENCES↗

Model and Validation of Single-Axis Tracking with Bifacial Photovoltaics: Preprint

Single-axis tracking is a cost effective deployment strategy for large-scale ground-mount photovoltaic (PV) systems in regions with high direct-normal irradiance (DNI). Bifacial modules in 1-axis tracking systems boost energy yield by 4% - 15% depending on module type and ground albedo, with a global average of 9%. This benefit is in addition to the 15%-25% energy gain already afforded by single-axis tracking relative to fixed-tilt deployments. Here we compare model results against field performance data for two side-by-side bifacial / monofacial tracked systems - one in Albuquerque NM, and one in eastern Oregon. The Albuquerque system shows monthly rear irradiance gain of 10-14.9%, and the Oregon bifacial system has an average performance ratio 9.4% higher than the monofacial system. Both results match bifacial irradiance model results within uncertainty. Simulations show that smart tracking algorithms can offer more than 1% improvement on annual energy yield by adjusting tilt angle under cloudy conditions. Finally, ray-tracing simulations investigated edge brightening, suggesting 15%-25% increase in rear irradiance at the ends of tracker rows, but up to 20% loss from center-mounted torque tubes, creating multiple shadows.

14 SOLAR ENERGY↗

Using Measured Plane-of-Array Data Directly in Photovoltaic Modeling: Methodology and Validation

Measured plane-of-array (POA) irradiance may provide a lower-cost alternative to standard irradiance component data for photovoltaic (PV) system performance modeling without loss of accuracy. Previous work has shown that transposition models typically used by PV models to calculate POA irradiance from horizontal data introduce error into the POA irradiance estimates, and that measured POA data can correlate better to measured performance data. However, popular PV modeling tools historically have not directly used input POA data. This paper introduces a new capability in NREL's System Advisor Model (SAM) to directly use POA data in PV modeling, and compares SAM results from both POA irradiance and irradiance components inputs against measured performance data for eight operating PV systems.

14 SOLAR ENERGY↗

Process Modeling and Validation for Metal Big Area Additive Manufacturing

Metal Big Area Additive Manufacturing (mBAAM) is a new additive manufacturing (AM) technology based on the metal arc welding. A continuously fed metal wire is melted by an electric arc that forms between the wire and the substrate, and deposited in the form of a bead of molten metal along the predetermined path. Objects are manufactured one layer at a time starting from the base plate. The final properties of the manufactured object are dependent on its geometry and the metal deposition path, in addition to depending on the basic welding process parameters. Computational modeling can be used to accelerate the development of the mBAAM technology as well as a design and optimization tool for the actual manufacturing process. We have developed a finite element method simulation framework for mBAAM using the new features of software ABAQUS. The computational simulation of material deposition with heat transfer is performed first, followed by the structural analysis based on the temperature history for predicting the final deformation and stress state. In this formulation, we assume that two physics phenomena are coupled in only one direction, i.e. the temperatures are driving the deformation and internal stresses, but their feedback on the temperatures is negligible. The experiment instrumentation (measurement types, sensor types, sensor locations, sensor placements, measurement intervals) and the measurements are presented. The temperatures and distortions from the simulations show good correlation with experimental measurements. Ongoing modeling work is also briefly discussed.

Simunovic, Srdjan↗

An instrument for in situ time-resolved X-ray imaging and diffraction of laser powder bed fusion additive manufacturing processes

In situ X-ray-based measurements of the laser powder bed fusion (LPBF) additive manufacturing process produce unique data for model validation and improved process understanding. Synchrotron X-ray imaging and diffraction provide high resolution, bulk sensitive information with sufficient sampling rates to probe melt pool dynamics as well as phase and microstructure evolution. Here, we describe a laboratory-scale LPBF test bed designed to accommodate diffraction and imaging experiments at a synchrotron X-ray source during LPBF operation. We also present experimental results using Ti-6Al-4V, a widely used aerospace alloy, as a model system. Both imaging and diffraction experiments were carried out at the Stanford Synchrotron Radiation Lightsource. Melt pool dynamics were imaged at frame rates up to 4 kHz with a ~1.1 μm effective pixel size and revealed the formation of keyhole pores along the melt track due to vapor recoil forces. Diffraction experiments at sampling rates of 1 kHz captured phase evolution and lattice contraction during the rapid cooling present in LPBF within a ~50 × 100 μm area. In conclusion, we also discuss the utility of these measurements for model validation and process improvement.

36 MATERIALS SCIENCE↗

Coupling Microstructural Evolution Simulations to Material Property Degradation Predictions for Plasma-Facing Materials

Reliable material performance is required for plasma-facing material (PFM) candidates. Previous research has shown that plasma and neutron radiation exposure induces microstructural changes in PFMs; changes in thermal and electrical conductivities and in material hardening and embrittlement were also observed after neutron irradiation. These material property changes will negatively impact the performance of the PFMs in a fusion reactor. Despite the well-known connection between material microstructure, properties, and performance, there is a need for validated modeling capabilities connecting PFM property degradation with microstructural evolution under fusion-relevant conditions. We are developing a simulation capability to couple plasma-induced microstructural evolution to material property degradation. Our approach relies on deliberate mapping between individual simulation models and experimental characterization for validation. The open-source Multiphysics Object-Oriented Simulation Environment (MOOSE) software was used for this simulation capability development. A MOOSE phase-field model was coupled with the cluster dynamics code, Xolotl, to predict microstructural evolution. Microstructure characterization techniques, including scanning electron microscopy (SEM), transmission electron microscopy (TEM), and laser scanning confocal microscopy (LSCM) are used to validate these microstructural evolution simulations. Calculation of thermal and electrical conductivities with first principles simulations was performed for bulk material and for grain boundaries; these results are used within MOOSE models to calculate effective thermal and electrical conductivities as a function of grain characteristics. Thermoreflectance and four-probe techniques were employed to measure the thermal and electrical conductivities, respectively. A MOOSE crystal plasticity model was adapted to predict microstructure-sensitive deformation behavior, and X-ray diffraction (XRD) was used to collect bulk dislocation density data for validation. After individual simulation validation, these models are coupled to predict material property changes resulting from plasma exposure. We focused here on an experimental design to emphasize the separate effects of moderate thermal loads and plasma exposure using tungsten. Annealing of tungsten was performed under a protective environment for temperatures ranging from 500 C to 1500 C. The plasma exposure was completed in the Tritium Plasma Experiment at Idaho National Laboratory under a deuterium flux of 1e22 D/m^2-s. This incremental approach is employed to build confidence in the modeling capability: separate-effects tests ensure that the models capture key mechanisms from single environmental conditions before predicting PFM property degradation under combined loads. We will show our early results from coupling these simulation models to predict PFM property changes from microstructural evolution. Comparisons of the simulation results with preliminary validation data will be discussed.

36 - MATERIALS SCIENCE↗

Connect microstructure evolution to property degradation with validated simulation

Reliable material performance is required for plasma-facing material (PFM) candidates. Previous research has shown that plasma and neutron radiation exposure induces microstructural changes in PFMs; changes in thermal and electrical conductivities and in material hardening and embrittlement were also observed after neutron irradiation. These material property changes will negatively impact the performance of the PFMs in a fusion reactor. Despite the well-known connection between material microstructure, properties, and performance, there is a need for validated modeling capabilities connecting PFM property degradation with microstructural evolution under fusion-relevant conditions. We are developing a simulation capability to couple plasma-induced microstructural evolution to material property degradation. Our approach relies on deliberate mapping between individual simulation models and experimental characterization for validation. The open-source Multiphysics Object-Oriented Simulation Environment (MOOSE) software was used for this simulation capability development. A MOOSE phase-field model was coupled with the cluster dynamics code, Xolotl, to predict microstructural evolution. Microstructure characterization techniques, including scanning electron microscopy (SEM), transmission electron microscopy (TEM), and laser scanning confocal microscopy (LSCM) are used to validate these microstructural evolution simulations. Calculation of thermal and electrical conductivities with first principles simulations was performed for bulk material and for grain boundaries; these results are used within MOOSE models to calculate effective thermal and electrical conductivities as a function of grain characteristics. Thermoreflectance and four-probe techniques were employed to measure the thermal and electrical conductivities, respectively. A MOOSE crystal plasticity model was adapted to predict microstructure-sensitive deformation behavior, and X-ray diffraction (XRD) was used to collect bulk dislocation density data for validation. After individual simulation validation, these models are coupled to predict material property changes resulting from plasma exposure. We focused here on an experimental design to emphasize the separate effects of moderate thermal loads and plasma exposure using tungsten. Annealing of tungsten was performed under a protective environment for temperatures ranging from 500$^o$C to 1500$^o$C. The plasma exposure was completed in the Tritium Plasma Experiment at Idaho National Laboratory under a deuterium flux of 1e22 $\frac{D}{m^2s}$. This incremental approach is employed to build confidence in the modeling capability: separate-effects tests ensure that the models capture key mechanisms from single environmental conditions before predicting PFM property degradation under combined loads. We will show our early results from coupling these simulation models to predict PFM property changes from microstructural evolution. Comparisons of the simulation results with preliminary validation data will be discussed.

36 - MATERIALS SCIENCE↗

Modeling and Validation of Irradiation Damage in Ni-based Alloys for Long-Term LWR Applications

Grizzly is a multiphysics simulation code under development at Idaho National Laboratory to simulate aging mechanisms and their effects on the integrity of critical LWR components, including Ni-Cr alloy components. Predictions of the LWR component integrity rely on the ductile-to-brittle transition temperature (DBTT) curve to determine the toughness of the alloy after a period of exposure to in-service reactor conditions. The macroscopic DBTT curve is governed by the microstructure evolution of the alloy, thus, a capability to predict the microstructure evolution in response to thermal ageing is being implemented into Grizzly. Within this report section, the implementation of the Avrami equation to estimate the phase fraction of the aged long range ordered precipitates is discussed. The initial evaluation of current crystal plasticity models within Grizzly to model these Ni-Cr alloys is also presented.

36 MATERIALS SCIENCE↗

Representative Phenomena of Cyclic Turbulent Combustion in High-Pressure Fuel Sprays

Abstract Cyclic variations in conventional diesel combustion engines can lead to large differences in engine out emissions even at steady operation. This study uses an optically accessible constant-pressure flow chamber to acquire fuel injections in quick succession to analyze mixing, auto-ignition, and combustion of diesel-surrogate n-heptane using multiple high-speed optical diagnostics. Prior studies have utilized fewer injections and/or they rely on analysis of ensemble average behavior. These approaches do not yield information on injection-to-injection variation or provide confidence in utilizing individual injection measurements for high-fidelity computational fluid dynamics(CFD) model validation. In this study, a large set of 500 injections is used to obtain global parameters including liquid length, vapor penetration length, ignition delay time, and lift-off length. Results for multiple injections are presented to illustrate large injection to injection variations. Potential sources for these variations are analyzed to conclude localized, small scale turbulence and rate of injection variations as the likely sources. Then, a statistical method based on z-scores is proposed and implemented to identify instantaneous injections that best represent the bulk data-set of jet boundaries measured independently by three different diagnostics. This synthesis of statistics-guided screening of data set and ensemble-average analysis offers higher confidence for CFD model validation relying upon both a representative single and average injection results.

42 ENGINEERING↗

Metal Big Area Additive Manufacturing: Process Modeling and Validation

Metal Big Area Additive Manufacturing (mBAAM) is a new additive manufacturing (AM) technology for printing large-scale 3D objects. mBAAM is based on the gas metal arc welding process and uses a continuous feed of welding wire to manufacture an object. An electric arc forms between the wire and the substrate, which melts the wire and deposits a bead of molten metal along the predetermined path. In general, the welding process parameters and local conditions determine the shape of the deposited bead. The sequence of the bead deposition and the corresponding thermal history of the manufactured object determine the long range effects, such as thermal-induced distortions and residual stresses. Therefore, the resulting performance or final properties of the manufactured object are dependent on its geometry and the deposition path, in addition to depending on the basic welding process parameters. Physical testing is critical for gaining the necessary knowledge for quality prints, but traversing the process parameter space in order to develop an optimized build strategy for each new design is impractical by pure experimental means. Computational modeling and optimization may accelerate development of a build process strategy and saves time and resources. Because computational modeling provides these opportunities, we have developed a physics-based Finite Element Method (FEM) simulation framework and numerical models to support the mBAAM process s development and design. In this paper, we performed a sequentially coupled heat transfer and stress analysis for predicting the final deformation of a small rectangular structure printed using the mild steel welding wire. Using the new simulation technologies, material was progressively added into the FEM simulation as the arc weld traversed the build path. In the sequentially coupled heat transfer and stress analysis, the heat transfer was performed to calculate the temperature evolution, which was used in a stress analysis to evaluate the residual stresses and distortions. In this formulation, we assume that physics is directionally coupled, i.e. the effect of stress of the component on the temperatures is negligible. The experiment instrumentation (measurement types, sensor types, sensor locations, sensor placements, measurement intervals) and the measurements are presented. The temperatures and distortions from the simulations show good correlation with experimental measurements. Ongoing modeling work is also briefly discussed.

Additive Manufacturing↗

Multi-decade high-resolution regional hindcasts for wave energy resource characterization in U.S. coastal waters

Long-term, high-resolution, regional wave hindcast datasets were generated using unstructured-grid Simulating WAves Nearshore (SWAN) models for the U.S. coastal waters to support nearshore wave energy development in the U.S. including those bordering U.S. territorial islands. The model domains resolved the entire U.S. exclusive economic zones, with a spatial resolution of approximately 200 m nearshore. The regional SWAN models were driven by the global WAVEWATCH III® model outputs and run for a 42-year period from 1979 to 2020. Extensive model validations were performed using buoy observations and altimeter data. Regional resource characterization was performed based on hindcast data points at 2 km from shore and along the 100 m isobath. Aggregations of wave resource parameters were produced, and spatial and seasonal variations were analyzed for all the regions. Wave resource metrics recommended by international standards, including a 3-hour time series of six resource parameters, hourly frequency- and directionally resolved wave spectra at selected “virtual buoy” locations, and average-annual values of omni-directional wave power, significant wave height, and energy period are publicly disseminated through an Amazon Web Service and a Marine Energy Atlas web application tool to facilitate wave energy research and a wide range of coastal ocean applications.

16 TIDAL AND WAVE POWER↗

End-Use Load Profiles for the U.S. Building Stock: Methodology and Results of Model Calibration, Validation, and Uncertainty Quantification

The United States is embarking on an ambitious transition to a 100% clean energy economy by 2050, which will require improving the flexibility of electric grids. One way to achieve grid flexibility is to shed or shift demand to align with changing grid needs. To facilitate this, it is critical to understand how and when energy is used. High- quality end-use load profiles (EULPs) provide this information, and can help cities, states, and utilities understand the time-sensitive value of energy efficiency, demand response, and distributed energy resources. Publicly available EULPs have traditionally had limited application because of age and incomplete geographic representation (Frick, Eckman, and Goldman 2017; Frick 2019). To help fill this gap, the U.S. Department of Energy (DOE) funded a three-year project - End-Use Load Profiles for the U.S. Building Stock - that culminated in the release of a publicly available dataset1 of simulated EULPs representing residential and commercial buildings across the contiguous United States. The motivation for this work is further detailed in a November 2019 report: Market Needs, Use Cases, and Data Gaps (Mims Frick et al. 2019). This Methodology and Results report provides detailed descriptions of how the dataset was developed, intended for an audience of dataset and model users interested in the technical details. These details include descriptions of all of the model improvements made for calibration and the final comparisons to empirical data sources. A companion report, End-Use Load Profiles for the U.S. Building Stock: Applications and Opportunities, will be published subsequently and will describe example applications and considerations for using the dataset, intended for an audience of general dataset users.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Inclusive cross section measurements in final states with and without protons for charged-current ν μ -Ar scattering in MicroBooNE

A detailed understanding of inclusive muon neutrino charged-current interactions on argon is crucial to the study of neutrino oscillations in current and future experiments using liquid argon time projection chambers. To that end, we report a comprehensive set of differential cross section measurements for this channel that simultaneously probe the leptonic and hadronic systems by dividing the channel into final states with and without protons. Measurements of the proton kinematics and proton multiplicity of the final state are also presented. For these measurements, we utilize data collected with the MicroBooNE detector from 6.4 × 10 20 protons on target from the Fermilab booster neutrino beam at a mean neutrino energy of approximately 0.8 GeV. We present in detail the cross section extraction procedure, including the unfolding, and model validation that uses data to model comparisons and the conditional constraint formalism to detect mismodeling that may introduce biases to extracted cross sections that are larger than their uncertainties. The validation exposes insufficiencies in the overall model, motivating the inclusion of an additional data-driven reweighting systematic to ensure the accuracy of the unfolding. The extracted results are compared to a number of event generators and their performance is discussed with a focus on the regions of phase space that indicate the greatest need for modeling improvements. Published by the American Physical Society 2024

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Application of machine learning to evaluating and remediating models for energy and environmental engineering

Machine learning (ML) algorithms have been increasingly successful in their applications to solve energy and environmental engineering problems. ML algorithms have the advantage of being able to solve highly nonlinear issues effectively. Furthermore, considering the limited sample size of data collected in energy and environmental engineering, obtaining a ML model with reasonable accuracy is simple. Unfortunately, the vast majority of the current applications of ML algorithms lack effective screening of dominant factors and comprehensive model validation, which weakens the predictive ability of the models. The present study takes the minimum miscible pressure (MMP) of CO 2 - oil systems as an example. It establishes a systematic and robust predictive model to address this issue. Based on 147 sets of slim tube tests, the predictive models of the MMPs are investigated by application of eight ML algorithms. The paper concludes that most of the published ML models in the field of energy and environmental engineering prediction are not reliable. Furthermore, it addresses the main reasons for the poor performance of some predictive models built by ML and provides guidelines on how to make such models robust. Further, to the best of our knowledge, this is the first study to point out the defects of current ML modeling methods and propose countermeasures for their application in energy and environmental engineering problems.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗