Search NASA⌕ Search

SEARCH · Search NASA

Results for “Code Assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 865 records · Page 48

Assessment of passively actuated in-situ cyclic surveillance test specimens for advanced non-light water reactors

The use of surveillance specimens was identified in a roadmap (Sims, 2010, ASME HTGR Code Development Roadmap, STP-NU-045, American Society of Mechanical Engineers, New York, NY) developed for the U.S. Nuclear Regulatory Commission for non-light water reactors that are intended to have very long design lives on the order of 500,000 hours. Creep rupture, long term strain accumulation, creep-fatigue damage, and their interaction with environmental effects require significant extrapolation from shorter term tests. Surveillance specimens provide a means for confirmation of these extrapolations in-situ. The effects of cyclic service on creep-fatigue damage would be particularly challenging based on conventional mechanical testing. Proposed herein is a passive cyclic testing methodology that lends itself well to in-situ surveillance applications. The concept is based on utilizing the difference in the thermal expansion coefficient of candidate materials to generate cyclic loading based on operational thermal transients. Prototypical specimen designs are proposed and their in-situ response to representative plant operation are evaluated.

Messner, M. C.↗

Uncertainty quantification's role in modeling and simulation planning, and credibility assessment through the predictive capability maturity model

The importance of credible, trustworthy numerical simulations is obvious especially when using the results for making high-consequence decisions. Determining the credibility of such numerical predictions is much more difficult and requires a systematic approach to assessing predictive capability, associated uncertainties and overall confidence in the computational simulation process for the intended use of the model. This process begins with an evaluation of the computational modeling of the identified, important physics of the simulation for its intended use. This is commonly done through a Phenomena Identification Ranking Table (PIRT). Then an assessment of the evidence basis supporting the ability to computationally simulate these physics can be performed using various frameworks such as the Predictive Capability Maturity Model (PCMM). There were several critical activities that follow in the areas of code and solution verification, validation and uncertainty quantification, which will be described in detail in the following sections. Here, we introduce the subject matter for general applications but specifics are given for the failure prediction project. In addition, the first task that must be completed in the verification & validation procedure is to perform a credibility assessment to fully understand the requirements and limitations of the current computational simulation capability for the specific application intended use. The PIRT and PCMM are tools used at Sandia National Laboratories (SNL) to provide a consistent manner to perform such an assessment. Ideally, all stakeholders should be represented and contribute to perform an accurate credibility assessment. PIRTs and PCMMs are both described in brief detail below and the resulting assessments for an example project are given.

97 MATHEMATICS AND COMPUTING↗

Large Eddy Simulation Modeling of Flashback and Flame Stabilization in Hydrogen-Rich Gas Turbines Using a Hierarchical Validation Approach

This project was a combined computational and experimental effort to improve predictive capability for boundary layer flashback of premixed swirl flames relevant to gas-turbine power plants operating with high-hydrogen-content fuels. During the course of this project, significant progress in modeling was made on four major fronts: 1) use of direct numerical simulation of turbulent flames to understand the coupling between the flame and the turbulent boundary layer; 2) improved modeling capability for flame propagation in stratified pre-mixtures; 3) improved portability of computer codes using the OpenFOAM platform to facilitate transfer to industry and other researchers; and 4) application of LES to flashback in swirl combustors, and a detailed assessment of its capabilities and limitations for predictive purposes. A major component of the project was an experimental program that focused on developing a rich experimental database of boundary layer flashback in swirl flames. Both methane and high-hydrogen fuels, including effects of elevated pressure (1 to 5 atm), were explored. For this project, a new model swirl combustor was developed. Kilohertz-rate stereoscopic PIV and chemiluminescence imaging were used to investigate the flame propagation dynamics. In addition to the planar measurements, a technique capable of detecting the instantaneous, time-resolved 3D flame front topography was developed and applied successfully to investigate the flow-flame interaction. The UT measurements and legacy data were used in a hierarchical validation approach where flows with increasingly complex physics were used for validation. First component models were validated with DNS and literature data in simplified configurations, and this was followed by validation with the UT 1-atm flashback cases, and then the UT high-pressure flashback cases. The new models and portable code represent a major improvement over what was available before this project was initiated.

42 ENGINEERING↗

Damage and Failure in a Statistical Crack Model

In this paper I will take a close look at a statistical crack model (SCM) as is used in engineering computer codes to simulate fracture at high strain rates. My general goal is to understand the macroscopic behavior effected by the microphysical processes incorporated into an SCM. More specifically, I will assess the importance of including local interactions between cracks into the growth laws of an SCM. My strategy will be to construct a numerical laboratory that represents a single computational cell containing a realization of a statistical distribution of cracks. The cracks will evolve by the microphysical models of the SCM, leading to quantifiable damage and failure of the computational cell. I will use the numerical data generated by randomly generated ensembles of the fracture process to establish scaling laws that will modify and simplify the implementation of the SCM into large scale engineering codes.

42 ENGINEERING↗

Verification and validation of the Alternative Nonlinear Two-phase Subchannel (ANTS) code

The Alternative Nonlinear Two-phase Subchannel solver (ANTS) code was written to provide a fast-running, steady-state, pin-resolved modeling and simulation tool for analysis of common boiling water reactor (BWR) geometry and common operating conditions. ANTS has been integrated into the Virtual Environment for Reactor Application (VERA) core simulator software, where it can be used to provide a thermal/hydraulic (T/H) subchannel solution that is then used to provide neutronic feedback as well as perform the fuel depletion and temperature solution. Herein, this paper presents the rigorous analysis performed on the ANTS code, which includes both code and solution verification testing, benchmarking with the existing two-phase subchannel capability in VERA, CTF, and validation testing using popular two-phase experiments such as PWR Sub-channel and Bundle Tests (PSBT), BWR Full-size Fine-mesh Bundle Tests (BFBT), Risø, and FRIGG. This assessment was used to qualify ANTS for its intended applications before its use for core-scale, multiphysics BWR simulations. In general, it was found that agreement with experimental data was good; errors were within the range of experimental data uncertainty. Furthermore, code and solution verification confirmed that the governing equations and the most important closure terms were correctly implemented and behaving as expected.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DIC Challenge: Developing Images and Guidelines for Evaluating Accuracy and Resolution of 2D Analyses

With the rapid spread in use of Digital Image Correlation (DIC) globally, it is important there be some standard methods of verifying and validating DIC codes. To this end, the DIC Challenge board was formed and is maintained under the auspices of the Society for Experimental Mechanics (SEM) and the international DIC society (iDICs). The goal of the DIC Board and the 2D–DIC Challenge is to supply a set of well-vetted sample images and a set of analysis guidelines for standardized reporting of 2D–DIC results from these sample images, as well as for comparing the inherent accuracy of different approaches and for providing users with a means of assessing their proper implementation. This document will outline the goals of the challenge, describe the image sets that are available, and give a comparison between 12 commercial and academic 2D–DIC codes using two of the challenge image sets.

97 MATHEMATICS AND COMPUTING↗

Mountain Basin Controls on the Snow-to-Streamflow Signal: An AIC-Weighted Multiple Linear Regression Framework

A regression-based analysis quantifies how basin characteristics modulate the snow-to-streamflow signal. First, we use the ERA5-Land reanalysis gridded product (European Centre for Medium Range Weather Forecasts reanalysis 5 -Land component) for 4,655 hydrologic unit code - 10 (HUC10) mountain basins across the western United States (US) for water years 1987–2024. Linear regressions are performed for peak snow water equivalent (SWE) and annual streamflow for each mountain basin. Models use ordinary least squares in Python’s statsmodels package. After which, an Akaike Information Criterion (AIC)–weighted ensemble multiple linear regression (MLR) framework with 47 watershed traits is used to predict the linear regression coefficient of determination (r-squared) defining the ability of peak SWE to predict annual streamflow across all mountain basin. Predictor sets are constrained to avoid multicollinearity by excluding models with variance inflation factors (VIF) greater than 5. Mountain basin traits included in the MLR include seasonal climate, topography, vegetation type and structure, and bedrock geology. Accepted models are considered if their AIC is within 2.0 of the model with the minimum AIC, or best model. To compare predictor influence across acceptable models, we computed standardized regression coefficients. To evaluate structural redundancy among models, we constructed binary inclusion vectors for each acceptable model, denoting whether a predictor was present (1) or absent (0). Core predictor variables are defined as occurring in at least 67% of the acceptable models. For this regional analysis, only one model was found acceptable, with higher snow-to-streamflow translation (higher r-squared) occurring in colder mountain basins with higher relative winter precipitation, more snow accumulation and a lower fraction of annual precipitation that falls in the spring and summer. The second component of the data package uses previously published, high-resolution output from an integrated hydrological model of the East River watershed using the U.S. Geological Survey Groundwater and Surface water Flow model (GSFLOW, doi:10.15485/1998576). East River MLR expands upon the approach described above to explore the response of five streamflow metrics—annual streamflow, runoff efficiency, 7-day minimum flow, low-flow duration, and non-perennial stream fraction to snow system indicators including peak SWE, snow-covered area, snow disappearance date, and the fraction of basin area characterized by low-to-no snow, as well as seasonal precipitation and temperature, and annual hydrologic variables representing soil moisture, evapotranspiration (ET), the partitioning of incoming precipitation to evapotranspiration (ET/P), groundwater storage, and groundwater inflow to streams. MLR was done on all water years (P0: 1987-2024) and for each period as determined in the split analysis using pooled regression techniques (P1: 1987-2011 and P2: 2012-2024) to evaluate shifting predictor variable emphasis on streamflow generation. Results indicate that since 2012, peak SWE has lost statistical strength in its prediction of annual streamflow and runoff efficiency, and the indirect influence of spring temperature has emerged as critically important. Low-flow metrics remain largely influenced by soil moisture, vegetation water use and groundwater inflows with summer precipitation becoming a direct influence on minimum summer flow. Together, these data and Python-based analysis tools provide a framework for identifying the key watershed characteristics that control how streamflow responds to snow from year to year. The package also helps quantify uncertainty in statistical models and assess how snow–streamflow relationships vary across regions and over time. This dataset contains comma-separated values files (.csv), text files (.txt), python code files (.py), figure files (.png), and shapefiles (.cpg, .dbf, .prj, .sbn, .sbx, .shp, .xml). Further details on file contents and MLR execution can be found in the readme file and the FLMD files. Work was supported by the Watershed Function Science Focus Area at Lawrence Berkeley National Laboratory funded by the US Department of Energy, Office of Science, Biological and Environmental Research under Contract No. DE-AC02-05CH11231.

54 ENVIRONMENTAL SCIENCES↗

BISON analysis of FeCrAl and Zircaloy cladding deformation during simulated BWR cyclic dryout conditions

The BISON fuel performance analysis code has been used to study FeCrAl and Zircaloy cladding performance to better understand cladding deformation behavior in boiling water reactors during conditions caused by anticipated operational occurrences (AOOs) or by anticipated transients without scram (ATWS). BISON models of novel separate effects tests simulating ATWS events predicted mechanical responses to thermal cycling boundary conditions. Here, we assessed FeCrAl and Zircaloy deformation and burst models to determine those best suited for cyclic dryout event analysis. In addition, we compared diametral strain profiles of the post-experiment claddings to simulation results. The capability of the BISON code for modeling BWR AOO or ATWS events is promising.

36 MATERIALS SCIENCE↗

Validation of statistical uncertainties in subcritical benchmark measurements: Part II – Measured data

Part I of this work presented an uncertainty approach which incorporates the singles and doubles counting rates determined by the Hage-Cifarelli formalism of the Feynman Variance-to-Mean method. This moments-based approach utilizes time correlations between prompt neutrons detections to assess the system multiplication. Additionally, it presented a validation which utilized simulated data generated using a 0-D point-kinetics Monte Carlo code. In Part II, this same method and validation approach is applied to measured data of a subcritical benchmark experiment. These measurements were performed with a 4.5 kg sphere of alpha-phase weapons grade plutonium reflected by copper and/or polyethylene. Finally, the results of 17 configurations are shown including detailed validation for four of the configurations.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Impact of numerics on the predictive capabilities of reacting flow LES

Combustors in modern aerospace propulsion systems are highly optimized devices and further enhancements to their performance will require advanced predictive modeling techniques. The LES approach has potential to be such a technique, but demonstration of its true predictive capability remains a challenge. In this paper, a methodical study is performed to assess the impact of numerical error on the predictive capabilities of LES and to distinguish it from error arising from physical modeling. Four codes are employed to simulate the bluff body stabilized flame experiment of Volvo Flygmotor AB. The physical models (governing equations and sub-grid models) are kept identical between the codes so that the physical modeling error is the same. For the same reason, computational grids are also kept identical since the sub-grid models are grid dependent. Results indicate that all codes produce a very similar solution for the non-reacting flow in terms of large scale unsteady vortex shedding behavior, mean profiles and second order turbulence statistics, on a suitably refined grid. This solution is also very close to the experimentally observed behavior of the flow. In contrast, for the reacting case, solutions from the various codes exhibit significant differences when analyzed under the same metrics and with similar or even finer grid resolution than that used for the non-reacting case. These differences are large enough to change the macroscopic behavior of the flow, e.g. some codes predict symmetric vortex shedding while others predict asymmetric shedding and some codes show strong recirculation zones while others show stagnant regions behind the bluff body. It is also shown that none of the solutions truly predicts the experimentally observed flow. Given that the physical sub-grid models and computational grids are the same in all the simulations, the inconsistency between results points to a significant impact of numerical methods and, hence, numerical error. The need for mitigation of this impact is highlighted, along with the need for metrics detailing how LES should be applied to reacting flows. It is suggested that both of these issues should be the focus of future work.

Energy & Fuels↗

Reproducibility in G 0 W 0 calculations for solids

Ab initio many-body perturbation theory within the GW approximation is a Green's function formalism widely used in the calculation of quasiparticle excitation energies of solids. In what has become an increasingly standard approach, Kohn–Sham eigenenergies, generated from a DFT calculation with a strategically-chosen exchange–correlation functional “starting point”, are used to construct G and W, and then perturbatively corrected by the resultant GW self-energy. In practice, there are several ways to construct the GW self-energy, and these can lead to variations in predicted quasiparticle energies. For example, for ZnO and TiO 2 , the GW fundamental gaps reported in the literature can vary by more than 1 eV depending on the GW code used. In this work, we calculate and analyze GW quasiparticle (QP) energies of these and other systems with three different GW codes: BERKELEYGW, ABINIT and YAMBO. Through a systematic analysis of the GW implementation of these three codes, we identify the primary origin of major discrepancies between codes reported in prior literature to be the different implementations the Coulomb divergence in the Fock exchange term and the frequency integration scheme of the GW self-energy. We then eliminate these discrepancies by using common numerical methods and algorithms, demonstrating that the same quasiparticle energies for a given material can be obtained with different codes, within numerical differences ascribable to the technical details of the underling implementations. This work will be important for users and developers in assessing the precision of future GW applications and methods.

36 MATERIALS SCIENCE↗

Thermal model development and validation for rapid filling of high pressure hydrogen tanks

This paper describes the development of thermal models for the filling of high pressure hydrogen tanks with experimental validation. Two models are presented; the first uses a one-dimensional, transient, network flow analysis code developed at Sandia National Labs, and the second uses the commercially available CFD analysis tool Fluent. These models were developed to help assess the safety of Type IV high pressure hydrogen tanks during the filling process. The primary concern for these tanks is due to the increased susceptibility to fatigue failure of the liner caused by the fill process. Thus, a thorough understanding of temperature changes of the hydrogen gas and the heat transfer to the tank walls is essential. The effects of initial pressure, filling time, and fill procedure were investigated to quantify the temperature change and verify the accuracy of the models. In this paper we show that the predictions of mass averaged gas temperature for the one and three-dimensional models compare well with the experiment and both can be used to make predictions for final mass delivery. Furthermore, due to buoyancy and other three-dimensional effects, however, the maximum wall temperature cannot be predicted using one-dimensional tools alone which means that a three-dimensional analysis is required for a safety assessment of the system.

42 ENGINEERING↗

Review of the second charged-particle transport coefficient code comparison workshop

We report the results of the second charged-particle transport coefficient code comparison workshop, which was held in Livermore, California on 24–27 July 2023. This workshop gathered theoretical, computational, and experimental scientists to assess the state of computational and experimental techniques for understanding charged-particle transport coefficients relevant to high-energy-density plasma science. Data for electronic and ionic transport coefficients, namely, the direct current electrical conductivity, electron thermal conductivity, ion shear viscosity, and ion thermal conductivity were computed and compared for multiple plasma conditions. Additional comparisons were carried out for electron–ion properties such as the electron–ion equilibration time and alpha particle stopping power. Overall, 39 participants submitted calculated results from 18 independent approaches, spanning methods from parameterized semi-empirical models to time-dependent density functional theory. In the cases studied here, we find significant differences—several orders of magnitude—between approaches, particularly at lower temperatures, and smaller differences—roughly a factor of five—among first-principles models. We investigate the origins of these differences through comparisons of underlying predictions of ionic and electronic structure. The results of this workshop help to identify plasma conditions where computationally inexpensive approaches are accurate, where computationally expensive models are required, and where experimental measurements will have high impact.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Design and physics basis for the upcoming DIII-D SAS-VW campaign to quantify tungsten leakage and transport in a new slot divertor geometry

A set of experiments are planned to exploit the high SOL collisionality enabled by a tightly baffled slot divertor geometry to suppress tungsten leakage in DIII-D. A toroidal row of graphite tiles from the Small Angle Slot (SAS) divertor is being coated with 10–15 μ m of tungsten. New spectroscopic viewing chords with in-vacuo optics will measure the W gross erosion source from the divertor surface with high spatial and temporal resolution. In parallel, the bottom of the SAS divertor is changed from a flat to a ‘V’ shape. New SOLPS-ITER/DIVIMP simulations conducted with drifts using the planned ‘V’ shape predict a substantial reduction in W sourcing and SOL accumulation in either B × ∇B direction relative to either the old SAS divertor shape or the open, lower divertor. Dedicated studies are planned to carefully characterize the level of W sourcing, leakage, and scrape-off-layer (SOL) accumulation in DIII-D over a wide range of plasma scenarios. Various actuators will be assessed for their efficacy in further reducing high-Z impurity sources and leakage from the slot divertor geometry. Finally, this coupled code-experiment validation effort will be used to stress-test physics models and build confidence in extrapolations to advanced, high-Z divertor geometries for next-step devices.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Evaluation of probabilistic photometric redshift estimation approaches for The Rubin Observatory Legacy Survey of Space and Time (LSST)

Many scientific investigations of photometric galaxy surveys require redshift estimates, whose uncertainty properties are best encapsulated by photometric redshift (photo-z) posterior probability density functions (PDFs). A plethora of photo-z PDF estimation methodologies abound, producing discrepant results with no consensus on a preferred approach. We present the results of a comprehensive experiment comparing twelve photo-z algorithms applied to mock data produced forLarge Synoptic Survey Telescope The Rubin Observatory Legacy Survey of Space and Time (lsst) Dark Energy Science Collaboration (desc). By supplying perfect prior information, in the form of the complete template library and a representative training set as inputs to each code, we demonstrate the impact of the assumptions underlying each technique on the output photo-z PDFs. In the absence of a notion of true, unbiased photo-z PDFs, we evaluate and interpret multiple metrics of the ensemble properties of the derived photo-z PDFs as well as traditional reductions to photo-z point estimates. Additionally, we report systematic biases and overall over/under-breadth of the photo-z PDFs of many popular codes, which may indicate avenues for improvement in the algorithms or implementations. Furthermore, we raise attention to the limitations of established metrics for assessing photo-z PDF accuracy; though we identify the conditional density estimate (CDE) loss as a promising metric of photo-z PDF performance in the case where true redshifts are available but true photo-z PDFs are not, we emphasize the need for science-specific performance metrics.

79 ASTRONOMY AND ASTROPHYSICS↗

Measurements and analysis of dynamic effects in the LARP model quadrupole HQ02b during rapid discharge

This paper presents the analysis of some quench tests addressed to study the dynamic effects in the 1-m-long 120-mm-aperture Nb 3 Sn quadrupole magnet, i.e., HQ02b, designed, fabricated, and tested by the LHC Accelerator Research Program. The magnet has a short sample gradient of 205 T/m at 1.9 K and a peak field of 14.2 T. The test campaign has been performed at CERN in April 2014. In the specific tests, which were dedicated to the measurements of the dynamic inductance of the magnet during the rapid current discharge for a quench, the protection heaters were activated only in some windings, in order to obtain the measure of the resistive and inductive voltages separately. The analysis of the results confirms a very low value of the dynamic inductance at the beginning of the discharge, which later approaches the nominal value. Indications of dynamic inductance variation were already found from the analysis of current decay during quenches in the previous magnets HQ02a and HQ02a2; however, with this dedicated test of HQ02b, a quantitative measurement and assessment has been possible. An analytical model using interfilament coupling current influence for the inductance lowering has been implemented in the quench calculation code QLASA, and the comparison with experimental data is given. In conclusion, the agreement of the model with the experimental results is very good and allows predicting more accurately the critical parameters in quench analysis (MIITs, hot spot temperature) for the MQXF Nb3Sn quadrupoles, which will be installed in the High Luminosity LHC.

43 PARTICLE ACCELERATORS↗

Hanging String Cuts in SPR Caverns: Modeling Investigation and Comparison with Sonar Data

Investigation of leaching for oil sales includes looking closely at cavern geometries. Anomalous cavern "features" have been observed near the foot of some caverns subsequent to partial drawdowns. One potential mitigation approach to reducing further growth of preexisting features is based on the hypothesis that reducing the brine string length via a "string cue' would serve to move the zone associated with additional leaching to a location higher up in the cavern and thus away from the preexisting feature. Cutting of the hanging string is expected to provide a control of leaching depth that could be used to "smooth" existing features and thus reduce geomechanical instability in that region of the cavern. The SANSMIC code has been used to predict cavern geometry changes (i.e., the extent of cavern growth with depth) based on variable input parameters for four caverns: West Hackberry 11 (WH11), West Hackberry 113 (WH113), Big Hill 104 (BH104), Big Hill 114 (BH114). By comparing the initial sonar geometry with resultant geometries calculated by the SANSMIC code, conclusions may be drawn about the potential impact of these variables on future cavern growth. Ultimately, these conclusions can be used to assess possible mitigation strategies such as the potential advantage of cutting versus not cutting a brine string. This work has resulted in a recommendation that a hanging string cut of 80 ft in WH11 would be beneficial to future cavern geometry, while there would be little to no benefit to string cuts in the other three caverns investigated here. The WH11 recommendation was followed in 2019, resulting in an operational string cut. A sonar performed after the string cut showed no adverse leaching in the area of the preexisting flare, as expected from the results of the preliminary SANSMIC runs described in this report. Additional SANSMIC modeling of the actual amount of injected raw water resulted in good agreement with the post-cut sonar.

02 PETROLEUM↗

IC reports (2021)

We requested HPC support to continue research on the seismic waves generated by impacts. We used the following codes: (1) the Hybrid Optimization Software Suite (HOSS), developed at LANL. HOSS is based on a combined Finite and Discrete Element Method (FDEM). New material models are developed for the sedimentary rocks. HOSS has been recently benchmarked to iSale and FLAG codes. SPECFEM3D is an open-source code developed since the last 90s. It won the Gordon Bell award for best performance in 2003, was finalist again in 2008 for a run at 0.16 petaflops on 149,784 cores on the ‘Jaguar’ Cray system at Oak Ridge National Laboratory. It also won the BULL Joseph Fourier supercomputing award in 2010.; SW4 is a 4th-order finite difference code developed at LLNL which is currently actively developed to handle complex 3D models and to be ported on future exascale platforms. We assessed our need to a total of 3.9M CPU-hrs for year 1 and and 3.1 M for year 2.

79 ASTRONOMY AND ASTROPHYSICS↗