SEARCH · Search NASA
Results for “Validation Studies”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Nonsteady Load Responses of Wind Turbines to Atmospheric and Mountain-Generated Turbulence Eddies, With Impacts on the Main Bearing: A Validation Study
Previous computational and field experiments identify three characteristic time scales in the aerodynamic responses of utility-scale wind turbine loads to atmospheric boundary layer (ABL) turbulence: a 30-90 second time scale for the passage of high/low speed "streaks" through the rotor plane, the blade and rotor rotation time scales (approximately 1 to 5 seconds), and a sub-second time scale created by blade rotation through gradients within eddy coherent structure. In the current study we compare aerodynamic load responses from daytime ABL turbulence quantified with large-eddy simulation and a actuator line model of the NREL 5 MW wind turbine with analysis of field data from the NREL/GE 1.5 MW wind turbine 5 kilometers east of the Rocky Mountain Front Range in Colorado. In addition, we contrast the responses to the passage of the mountain-generated eddies embedded within the westerly winds with the ABL eddies embedded within northerly/southerly winds. These analyses are in context with the nonsteady forcing of the main bearing by the aerodynamic generation of nontorque bending moments on the main shaft. Potentially relevant to main bearing failure mechanisms, both computational and field data show that the magnitudes of turbulence-generated nontorque bending moments, that we show generate nonsteady force on the main bearing, are of order, and often larger than, torque (which underlies power). However, the temporal variations in these two responses are uncorrelated, implying that the aerodynamic mechanisms that drive power and main bearing response are fundamentally different. We find this to be the case in the field with both mountain-generated eddies (westerly winds) and ABL-generated eddies (northerly/southerly winds). Whereas the time and length scales are comparable, the mountain eddies were somewhat more energetic than the northerly/southerly ABL eddies. Interestingly, however, the fluctuations in nontorque bending moment that force the main bearing were found to be stronger when forced by the ABL eddies than the mountain eddies. The field studies validate the key results from the computational study and show even stronger response in the nontorque bending moment than in the computer simulations. In all cases, the torque and nontorque bending moments are temporally uncorrelated, torque and power are driven by time variations in rotor-averaged horizontal wind velocity and nontorque bending moments are driven by time changes in the degree of nonuniformity in the distribution of velocity over the rotor plane. Thus the results generalize the mechanisms underlying nonsteady aerodynamic forcing to classes of turbulence eddy types with strength of order or stronger than ABL eddies with transverse scale of order the wind turbine rotor. These include atmospheric turbulence eddies, topography-generated turbulence eddies and, by extension, impacts of turbine-wake-scale turbulence eddies on downstream wind turbine rotors.
Validation study of sodium pool fire modeling efforts in $\mathrm{MELCOR}$ and $\mathrm{SPHINCS}$ codes
Discharge of sodium coolant into containment from a sodium-cooled fast reactor vessel can occur in the event of a pipe leak or break. In this situation, some of the liquid sodium droplets discharged from the coolant system will react with oxygen in the air before reaching the containment. This phase of the event is normally termed the sodium spray fire phase. Unreacted sodium droplets pool on the containment floor where continued reaction with containment atmospheric oxygen occurs. This phase of the event is normally termed the sodium pool fire phase. Both phases of these sodium-oxygen reactions (or fires) are important to model because of the heat addition and aerosol generation that occur. Any fission products trapped in the sodium coolant may also be released during this progression of events, which if released from containment could pose a health risk to workers and the public. The paper describes progress of an international collaborative research in the area of the sodium fire modeling in the sodium-cooled fast reactors between the United States and Japan under the framework of the Civil Nuclear Energy Research and Development Working Group. In this collaboration between Sandia National Laboratories and Japan Atomic Energy Agency, the validation basis for and modeling capabilities of sodium spray and pool fires in MELCOR of Sandia National Laboratories and SPHINCS of Japan Atomic Energy Agency are being enhanced. Here this study documents MELCOR and SPHINCS sodium pool fire model validation exercises against the JAEA’s sodium pool fire experiments, F7-1 and F7-2. The proposed enhancement of the sodium pool fire models in MELCOR through addition of thermal hydraulic and sodium spreading models that enable a better representation of experimental results is also described.
Modeling heat transport processes in enhanced geothermal systems: Validation study from EGS Collab Experiment 1
Heat recovery from enhanced geothermal systems (EGS) is a complex process involving heat transport in both fracture networks and rock formations. A comprehensive understanding of and the ability to model the underlying heat transport mechanisms is important for the success of EGS but remains challenging in practice due to the generally insufficient characterization of EGS reservoirs. In the present study, we analyze an extensively monitored intermediate-scale EGS field experiment performed in a well-characterized testbed. The high-resolution, high-quality measurements from the field experiment enable the development of a high-fidelity model incorporating a well-constrained fracture network. Based on the field experiment, we investigate the complex heat transport processes in an EGS-relevant environment and validate the capability of a numerical approach in simulating these inherently coupled heat transport processes. A series of numerical simulations were performed to study the effects of different heat transport mechanisms, including thermal convection with fracture flow, thermal conduction in rock formations, and the Joule-Thomson effect. The agreement of thermal responses between field measurements and simulation results indicates that our numerical approach can appropriately model the heat transport processes pertaining to heat recovery from EGS reservoirs.
High-Fidelity Numerical Wave Tank Verification & Validation Study: Wave Generation Through Paddle Motion: Preprint
This paper presents a numerical benchmark study of wave propagation due to a paddle motion using different high-fidelity numerical models, which are capable of replicating the nearly actual physical wave tank testing. A full time series of the measured wave generation paddle motion which was used to generate wave propagation in the physical wave tank will be utilized in each of the models contributed by IEA OES Task 10's participants, which includes both computational fluid dynamics (CFD) and smooth hydrodynamic particle (SPH). The high-fidelity simulations of the physical wave testcase will allow for the evaluation of the initial transient effects from wave ramp-up and its evolution in the wave tank over time for two representative regular waves with varying levels of nonlinearity. A couple of interesting metrics like the predicted wave surface elevation at select wave probes, wave period, and phase-shift in time will be assessed to evaluate the relative accuracy of numerical models versus experimental data within specified time intervals. These models will serve as a guide for modelers in the wave energy community and provide a base case to allow further and more detailed numerical modeling of the fixed Kramer Sphere Cases under wave excitation force wave tank testing.
A Verification and Validation Study of the Cyclops I PBX 9502 Experiment: A validation of the SURFplus High Explosive Model [Slides]
SURF is an acronym for Scaled-Unified-Reactive-Front, invented by R. Menikoff and S. Shaw. What follows is a brief synopsis of this model as used for the validation study discussed here. For more details see the xrage user manual and the references cited there.
SCEC/USGS Community Stress-Drop Validation Study: How Spectral Fitting Approaches Influence Measured Source Parameters
Spectral source parameters used to estimate an earthquake’s stress drop (Δσ) can vary significantly across measurement approaches. The Statewide California Earthquake Center/U.S. Geological Survey Community Stress‐Drop Validation Study was initiated to compare source parameter estimates, focusing initially on a dataset from the 2019 Ridgecrest earthquake sequence. As part of that validation effort, here we focus on one potential source of uncertainty: whether spectral fitting approaches alone, applied to a common set of spectra from the 2019 Ridgecrest sequence result in different source parameter estimates. By using a common set of benchmark spectra analyzed across a consistent frequency band of 1–40 Hz, we eliminate many sources of variability. A subgroup of validation study participants volunteered to estimate the low‐frequency displacement (Ω 0 ) and corner frequency (ƒ c ) by fitting a smooth function to benchmark displacement spectra. Participants used linear‐ or log‐sampled spectra, assumed a Brune or Boatwright spectral model, and applied different misfit criteria. We compare 17 approaches used to estimate Ω 0 , ƒ c , and Δσ for 54 earthquake spectra. Our results reveal that 35% of events have Δσ estimates within a factor of two, whereas others exhibit variations exceeding an order of magnitude. The variability in and can largely be attributed to whether a spectrum is consistent with the smooth function of an idealized simple crack model. The trade‐off between Ω 0 and ƒ c may be more pronounced when using linearly sampled spectra, as higher frequency spectral bumps control the fits. As expected, methods that assumed a Boatwright model tended to have lower Ω 0 and somewhat higher ƒ c compared to those assuming a Brune model, although resulting Δσ estimates are similar. Finally, when compared to the overall validation study results, the fitting approach alone may account for between 5% and 90% (25% on average) of the total variability in spectral Δσ.
The Importance of Addressing Disagreements Between Nominal and Effective Treatments During Bat Mortality Minimization Validation Studies
As the wind energy industry grows, so too does our need for effective and low-cost bat mortality minimization solutions. Despite knowledge gaps in our understanding of what drives bats to collide with spinning turbines, minimization solutions have shown success during validation studies. Curtailment has been consistently effective, reducing bat mortality from 33%-79%, depending on the curtailment scenario and species present. Several validation studies have demonstrated deterrent solutions, specifically ultrasonic deterrents, to be effective, but overall, more variable compared to curtailment solutions. Further, a study combining curtailment with ultrasonic deterrents produced encouraging results, finding that adding ultrasonic deterrents to turbines that were designated to curtail, significantly reduced mortality rates compared to curtailment only turbines. Despite positive results, the strength of inference achieved with validation studies is limited by methodological constraints associated with appropriately assigning fatalities to treatments. Because of the temporal separation between when a bat collides with a turbine and when it is discovered during a ground-based carcass survey, we must assign carcasses to a treatment that ran during the prior night(s). This process may introduce errors at multiple stages. First, for studies that rotate treatments among turbines, mortality surveyors must be confident that carcasses are 'fresh' such that mortalities are correctly assigned to the treatment from the previous night(s). Second, we must reconcile any misalignments between how we assign treatments and how we implement treatments (e.g., turbines assigned with a deterrent treatment may be implemented as another treatment when deterrent devices are not operating as designed). Finally, for curtailment solutions, it is critical to recognize that measured effects are a function of not just the treatment as implemented but the proportion of the night the treatment is realized (e.g., if wind speeds are greater than the curtailment treatment cut-in speed for the entire night, we cannot expect there to me any differences in mortality reduction relative to control turbines). Using a dataset collected between June and October 2017, that rotated 3 treatments (Deterrent Only, 5 m/s Curtail only, and 5 m/s Curtail & Deterrent) and 1 control condition across 16 turbines each night, we explored the importance and implications of accounting for potential errors in assigning fatalities to treatments. We present preliminary results comparing the mortality associated with error-corrected treatments and control conditions highlighting how the measured effect of a treatment (mortality) greatly depends on site specific implementation.
Quick Urban and Industrial Complex (QUIC) CBR Plume Modeling System: Validation-Study Document
This document contains information on QUIC validation studies that have been performed to evaluate the wind, pressure, and concentration solutions produced by QUIC. Tests of QUIC's source term models and specialized transport mechanisms (e.g., buoyancy algorithms, particle settling and deposition, liquid pool growth, droplet and pool evaporation) are also provided. A brief description of the experiment, a few example validation results, and references to journal articles, reports, and/or presentations are given. Both LANL and non-LANL sources are provided.
Validation Study of Experimental Insulating and Air-Sealing Technology for Enclosed Roof Cavities
Validation Study of Experimental Insulating and Air-Sealing Technology for Enclosed Roof Cavities, explores a new minimally invasive system known as Pinhole Insulation ® for retroft insulation of cathedral ceilings, flat roofs, dormer roofs, and other enclosed roof cavities. It also explores the validation of the associated equipment, software, and materials used in this application. The Pinhole Insulation process essentially consists of drilling a ¼” hole in the ceiling surface and then injecting closed cell polyurethane foam such that the foam is deposited on the interior surface of the exterior roof sheathing. In a typical cathedral ceiling with R19 batts, the R value will be improved by at least 60% and the cavity will become completely air sealed. The system is quick, minimally invasive and at least an order of magnitude less expensive than alternatives such as removing the ceiling surface and spraying closed cell foam.
Overview of the SCEC/USGS Community Stress Drop Validation Study Using the 2019 Ridgecrest Earthquake Sequence
We present initial findings from the ongoing Community Stress Drop Validation Study to compare spectral stress-drop estimates for earthquakes in the 2019 Ridgecrest, California, sequence. This study uses a unified dataset to independently estimate earthquake source parameters through various methods. Stress drop, which denotes the change in average shear stress along a fault during earthquake rupture, is a critical parameter in earthquake science, impacting ground motion, rupture simulation, and source physics. Spectral stress drop is commonly derived by fitting the amplitude-spectrum shape, but estimates can vary substantially across studies for individual earthquakes. Sponsored jointly by the U.S. Geological Survey and the Statewide (previously, Southern) California Earthquake Center our community study aims to elucidate sources of variability and uncertainty in earthquake spectral stress-drop estimates through quantitative comparison of submitted results from independent analyses. The dataset includes nearly 13,000 earthquakes ranging from M 1 to 7 during a two-week period of the 2019 Ridgecrest sequence, recorded within a 1° radius. Here, in this article, we report on 56 unique submissions received from 20 different groups, detailing spectral corner frequencies (or source durations), moment magnitudes, and estimated spectral stress drops. Methods employed encompass spectral ratio analysis, spectral decomposition and inversion, finite-fault modeling, ground-motion-based approaches, and combined methods. Initial analysis reveals significant scatter across submitted spectral stress drops spanning over six orders of magnitude. However, we can identify between-method trends and offsets within the data to mitigate this variability. Averaging submissions for a prioritized subset of 56 events shows reduced variability of spectral stress drop, indicating overall consistency in recovered spectral stress-drop values.
Validation Study of the Spacecraft Background Activation using RHESSI Data
This document serves as a brief writeup of the work done to validate CINDER2008 and the Activation Analysis Tools in the Activation in Accelerator Radiation Environments (AARE) distribution that are used to calculate the activation of spacecraft material while in orbit [1{3]. The validation study involves replicating the decay gamma spectrum as observed onboard the RHESSI spacecraft in the high-purity germanium (HPGe) detectors after crossing the South Atlantic Anomaly (SAA) [4]. The tools involved are a suite of Python scripts, the transmutation code CINDER2008 accompanied with a suite of scripts distributed with AARE,MCNPX, and MCNP6.2 [2,5{7]. Figure 1 shows the gamma ray spectrum this study replicates as the spectrum designated \Difference".
Alaska's Rural Building Stock: a Validation Study Using ResStock and Field Data
The availability of accurate national data on demographics, building stock, and energy use is vital for modeling residential buildings and evaluating decarbonization strategies. However, rural and Indigenous populations, including those in rural Alaska, are typically underrepresented in these datasets. These communities face unique challenges due to their remote locations, severe weather conditions, and limited access to resources, resulting in high energy burden. This report examines how rural Alaskan communities are underrepresented in the ResStock housing model and highlights the need for improved data to address their unique housing and energy challenges. Thus, this report examines the representation of rural Alaskan communities within the national housing stock model, ResStock. A validation study was conducted, considering ResStock, Field Data and Aerial and 3D-view data collection (A3DDC) datasets. The validation process started by using the down selecting approach on the ResStock building stock dataset. For the purpose of this study, only the rural Alaska Boroughs and Census areas located in ASHRAE IECC Climate Zone 8 were considered to ensure a more accurate and fair comparison with the field data, which was collected in rural areas located in climate zone 8, specifically within the Nome Census area. While ResStock may accurately represent several characteristics of the building stock for rural Alaska, some differences between modeled, field data, and aerial and 3D-view data collection datasets were identified. The following building characteristics have a high impact on modeled energy consumption and demonstrated large differences: Revisit heating setpoints and consider a substantially higher setpoint distribution, it could potentially address "missing loads" if this is the case. Develop and include Toyo heating in future modeling for ResStock and EnergyPlus. Remove natural gas as a water heater fuel type outside of North Slope County. Foundation type updated to have more crawlspaces rather than basements. Infiltration rates need reexamination for a larger distribution toward higher infiltration rates. Include more vinyl and less brick in exterior wall type and revise wall color for greater proportion of light rather than dark color. Roof material revised from majority shingles to majority metal. Update number of occupants to higher number of occupant count. Building orientation represents a higher proportion of south facing buildings rather than relatively equal. The findings suggest that updating ResStock's probability logic could better represent rural Alaskan buildings. ResStock can be utilized to identify the best upgrades or energy efficiency and energy efficiency improvements, helping community leaders in making more informed decisions.
304L Can Crush Validation Studies
Accurate prediction of ductile behavior of structural alloys up to and including failure is essential in component or system failure assessment, which is necessary for nuclear weapons alteration and life extensions programs of Sandia National Laboratories. Modeling such behavior requires computational capabilities to robustly capture strong nonlinearities (geometric and material), rate- dependent and temperature-dependent properties, and ductile failure mechanisms. This study's objective is to validate numerical simulations of a high-deformation crush of a stainless steel can. The process consists of identifying a suitable can geometry and loading conditions, conducting the laboratory testing, developing a high-quality Sierra/SM simulation, and then drawing comparisons between model and measurement to assess the fitness of the simulation in regards to material model (plasticity), finite element model construction, and failure model. Following previous material model calibration, a J 2 plasticity model with a microstructural BCJ failure model is employed to model the test specimen made of 304L stainless steel. Simulated results are verified and validated through mesh and mass-scaling convergence studies, parameter sensitivity studies, and a comparison to experimental data. The converged mesh and degree of mass-scaling are the mesh discretization with 140,372 elements, and a mass scaling with a target time increment of 1.0e-6 seconds and time step scale factor of 0.5, respectively. Results from the coupled thermal-mechanical explicit dynamic analysis are comparable to the experimental data. Simulated global force vs displacement (F/D) response predicts key points such as yield, ultimate, and kinks of the experimental F/D response. Furthermore, the final deformed shape of the can and field data predicted from the analysis are similar to that of the deformed can, as measured by 3D optical CMM scans and DIC data from the experiment.
Assessment of Multi‐Ion Channel Block in a Phase I Randomized Study Design: Results of the Ci PA Phase I ECG Biomarker Validation Study
Balanced multi‐ion channel‐blocking drugs have low torsade risk because they block inward currents. The Comprehensive In Vitro Proarrhythmia Assay (Ci PA ) initiative proposes to use an in silico cardiomyocyte model to determine the presence of balanced block, and absence of heart rate corrected J‐T peak (J‐T peak c) prolongation would be expected for balanced blockers. This study included three balanced blockers in a 10‐subject‐per‐drug parallel design; lopinavir/ritonavir and verapamil met the primary end point of ΔΔJ‐T peak c upper bound < 10 ms, whereas ranolazine did not (upper bounds of 8.8, 6.1, and 12.0 ms, respectively). Chloroquine, a predominant blocker of the potassium channel encoded by the ether‐à‐go‐go related gene (hERG), prolonged ΔΔ QT c and ΔΔJ‐T peak c by ≥ 10 ms. In a separate crossover design, diltiazem (calcium block) did not shorten dofetilide‐induced Δ QT c prolongation, but shortened ΔJ‐T peak c and prolonged ΔT peak ‐T end . Absence of J‐T peak c prolongation seems consistent with balanced block; however, small sample size (10 subjects) may be insufficient to characterize concentration‐response in some cases.
Californium-252 production at the High Flux Isotope Reactor - I: Validation study using campaign data
This paper presents a series of 252 Cf production validation and code-to-code comparison studies performed based on data from the production campaigns at the High Flux Isotope Reactor (HFIR). These studies support efforts to convert HFIR from using highly enriched uranium (HEU) fuel to low-enriched uranium (LEU) fuel. HFIR must maintain its world-class performance and missions following this conversion, and because 252 Cf is a vital neutron-emitting radioisotope used for a variety of high-impact applications (e.g., reactor startup, cancer treatment), the ability to efficiently produce 252 Cf must be preserved. In this work, the HFIRCON, Shift, ORIGEN, and TCOMP codes were deployed, and several sets of data libraries were investigated to better understand the calculation codes and the data biases. As-loaded target composition data, as-run irradiation history data, and post-irradiation measurements from recent multi-cycle irradiation campaigns of the HEU core were used to validate and determine methodology biases. Further, the findings demonstrated a good agreement, with results falling within 3 standard deviations of measurements. This paper lays the ground work for the second paper, which evaluates and compares 252 Cf production and safety metrics with the HEU core and a proposed LEU core.
Validation study of RWM stability in DIII-D high- β N plasmas
The n = 1 (n is the toroidal mode number) resistive wall mode (RWM) stability is numerically investigated for two DIII-D high-β N discharges 176440 and 172461, utilizing the MARS-F (Liu et al 2000 Phys. Plasmas 7 3681) and MARS-K (Liu et al 2008 Phys. Plasmas 15 112503) codes. Systematic validation efforts are attempted, for the first time, for discharges with very slow or vanishing toroidal flow for a large fraction of the plasma volume. While gaining physics insights in accessing stable operation regime at β N exceeding the Troyon no-wall limit in these slow-rotation experiments, the predictive capability of fluid and non-perturbative magnetohydrodynamic-kinetic hybrid models for the RWM is further confirmed. The MARS-F fluid model, with a strong but numerically tunable viscosity mimicking ion Landau damping of parallel sound waves, finds complete stabilization of the n = 1 RWM in the considered DIII-D plasmas under the experimental flow conditions. Similarly, either full stabilization (for discharge 176440) or marginal stability (for discharge 172461) of the mode is computed by the MARS-K hybrid model, which is first-principle based without free model parameters. In particular, all drift kinetic resonances, including those of thermal and energetic particles, are found to synergistically act to marginally stabilize the RWM in discharge 172461. These MARS-F/K modeling results explain the experimentally observed stable operational regime in DIII-D, as far as the RWM stability is concerned. Extensive numerical sensitivity studies, with respect to the plasma toroidal flow speed as well as the radial location of the resistive wall, are also carried out to further support the validation study.
Quantitative Exposure Assessment Professional Judgment Validation Study
Professional judgement is a key element of an exposure assessment program. Industrial hygienists frequently rely on it to make judgements about the acceptability of occupational exposures to chemical, biological, and physical agents. Often this must be done with little or no quantitative sampling data. This is especially true in the case of research and development, where activities may be short duration and non-routine. In this situation there are very limited opportunities for sampling, and therefore, professional judgement becomes a major tool industrial hygienists rely upon. One of the limitations of professional judgement is that exposures may be misclassified. That is, an exposure deemed to be unacceptable may in fact be acceptable and unnecessary effort and expense may be incurred as a result. On the other hand, an exposure may be judged acceptable when it is in fact unacceptable, resulting in an overexposure and potential injury or illness. It is therefore crucial that professional judgement be validated. In this study we evaluated 106 acceptable exposure determinations with retrospective quantitative exposure monitoring to validate the performance of Sandia National Laboratory industrial hygienists at performing exposure determinations with professional judgement.