Search NASA⌕ Search

SEARCH · Search NASA

Results for “performance verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

MPACT Verification With Magnox Reactor Neutronics Progression Problems

MPACT is a state-of-the-art core simulator designed to perform high-fidelity analysis using whole-core, three-dimensional, pin-resolved neutron transport calculations on modern parallel computing hardware. MPACT was originally developed to model light water reactors, and its capabilities are being extended to simulate gas-cooled, graphite-moderated cores such as Magnox reactors. To verify MPACT’s performance in this new application, the code is being formally benchmarked using representative problems. Progression problems are a series of example models that increase in complexity designed to test a code’s performance. The progression problems include both beginning-of-cycle and depletion calculations. Reference solutions for each progression problem have been generated using Serpent 2, a continuous-energy Monte Carlo reactor physics burnup calculation code.Using the neutron multiplication eigenvalue ke as a metric, MPACT’s performance is assessed on each of the progression problems. Initial results showed that MPACT’s multi-group cross section libraries, originally developed for pressurized water reactor problems, were not sufficient to accurately solve Magnox problems. MPACT’s improved performance on the progression problems is demonstrated using this new optimized cross section library.

Luciano, Nicholas↗
DOE OSTI2022

Design and execution of a verification, validation, and uncertainty quantification plan for a numerical model of left ventricular flow after LVAD implantation

Left ventricular assist devices (LVADs) are implantable pumps that act as a life support therapy for patients with severe heart failure. Despite improving the survival rate, LVAD therapy can carry major complications. Particularly, the flow distortion introduced by the LVAD in the left ventricle (LV) may induce thrombus formation. While previous works have used numerical models to study the impact of multiple variables in the intra-LV stagnation regions, a comprehensive validation analysis has never been executed. The main goal of this work is to present a model of the LV-LVAD system and to design and follow a verification, validation and uncertainty quantification (VVUQ) plan based on the ASME V&V40 and V&V20 standards to ensure credible predictions. The experiment used to validate the simulation is the SDSU cardiac simulator, a bench mock-up of the cardiovascular system that allows mimicking multiple operation conditions for the heart-LVAD system. The numerical model is based on Alya, the BSC’s in-house platform for numerical modelling. Alya solves the Navier-Stokes equation with an Arbitrary Lagrangian-Eulerian (ALE) formulation in a deformable ventricle and includes pressure-driven valves, a 0D Windkessel model for the arterial output and a LVAD boundary condition modeled through a dynamic pressure-flow performance curve. The designed VVUQ plan involves: (a) a risk analysis and the associated credibility goals; (b) a verification stage to ensure correctness in the numerical solution procedure; (c) a sensitivity analysis to quantify the impact of the inputs on the four quantities of interest (QoIs) (average aortic root flow $Q^{avg}_{Ao}$, maximum aortic root flow $Q^{max}_{Ao}$, average LVAD flow $Q^{avg}_{VAD}$, and maximum LVAD flow $Q^{max}_{VAD}$; (d) an uncertainty quantification using six validation experiments that include extreme operating conditions. Numerical code verification tests ensured correctness of the solution procedure and numerical calculation verification showed a grid convergence index (GCI)95% <3.3%. The total Sobol indices obtained during the sensitivity analysis demonstrated that the ejection fraction, the heart rate, and the pump performance curve coefficients are the most impactful inputs for the analysed QoIs. The Minkowski norm is used as validation metric for the uncertainty quantification. It shows that the midpoint cases have more accurate results when compared to the extreme cases. The total computational cost of the simulations was above 100 [core-years] executed in around three weeks time span in Marenostrum IV supercomputer. This work details a novel numerical model for the LV-LVAD system, that is supported by the design and execution of a VVUQ plan created following recognised international standards. We present a methodology demonstrating that stringent VVUQ according to ASME standards is feasible but computationally expensive.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Efforts to enhance reproducibility in a human performance research project

Background: Ensuring the validity of results from funded programs is a critical concern for agencies that sponsor biological research. In recent years, the open science movement has sought to promote reproducibility by encouraging sharing not only of finished manuscripts but also of data and code supporting their findings. While these innovations have lent support to third-party efforts to replicate calculations underlying key results in the scientific literature, fields of inquiry where privacy considerations or other sensitivities preclude the broad distribution of raw data or analysis may require a more targeted approach to promote the quality of research output. Methods: We describe efforts oriented toward this goal that were implemented in one human performance research program, Measuring Biological Aptitude, organized by the Defense Advanced Research Project Agency's Biological Technologies Office. Our team implemented a four-pronged independent verification and validation (IV&V) strategy including 1) a centralized data storage and exchange platform, 2) quality assurance and quality control (QA/QC) of data collection, 3) test and evaluation of performer models, and 4) an archival software and data repository. Results: Our IV&V plan was carried out with assistance from both the funding agency and participating teams of researchers. QA/QC of data acquisition aided in process improvement and the flagging of experimental errors. Holdout validation set tests provided an independent gauge of model performance. Conclusions: In circumstances that do not support a fully open approach to scientific criticism, standing up independent teams to cross-check and validate the results generated by primary investigators can be an important tool to promote reproducibility of results.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Integrated Large-Scale Data Management Platform for Photovoltaic Power Conversion Equipment (PCE) Reliability Data

To meet the demand for accuracy and real-time capability of PV system degradation evaluation, massive volume data is needed to run high-fidelity and high-efficiency simulations and perform advanced data analysis. However, PV farm operators have a series of difficulties with PV inverter data, such as data collection from multiple channels, massive data storage, data management and massive data analysis. To address these challenges, we developed an integrated data management platform capable of data acquisition, processing, storage, query, and performing big data analysis utilizing AI algorithms. The platform can also achieve data correctness verification and provide an effective distributed data management solution to retrieve massive data and establish a connection to distributed computational frameworks.

data management platform↗
DOE OSTI2021

DAKOTA (Design Analysis Kit for Optimization and Terascale) v.6.14

Sandia's Dakota software supports science and engineering transformation through advanced exploration of simulations. Specifically, Dakota manages and analyzes ensembles of simulations to provide broader and deeper perspective for analysts and decision makers. This enables them to: (1) enhance understanding of risk, (2) improve products, and (3) assess simulation credibility. In its simplest mode, Dakota can automate typical parameter variation studies through a generic interface to a computational model. Dakota also delivers advanced parametric analysis techniques enabling design exploration, optimization, model calibration, risk analysis, and quantification of margins and uncertainty with such models. It directly supports verification and validation activities. The algorithms implemented in Dakota aim to address challenges in performing these analyses with complex science and engineering models from desktop to high performance computers. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525 SAND2021-10468 O

Adams, BrianM.↗
DOE OSTI2021

DAKOTA (Design Analysis Kit for Optimization and Terascale) v.6.16

Sandia's Dakota software supports science and engineering transformation through advanced exploration of simulations. Specifically, Dakota manages and analyzes ensembles of simulations to provide broader and deeper perspective for analysts and decision makers. This enables them to: (1) enhance understanding of risk, (2) improve products, and (3) assess simulation credibility. In its simplest mode, Dakota can automate typical parameter variation studies through a generic interface to a computational model. Dakota also delivers advanced parametric analysis techniques enabling design exploration, optimization, model calibration, risk analysis, and quantification of margins and uncertainty with such models. It directly supports verification and validation activities. The algorithms implemented in Dakota aim to address challenges in performing these analyses with complex science and engineering models from desktop to high performance computers. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525 SAND2021-10468 O

Adams, BrianM.↗
DOE OSTI2020

Verification and Validation of the STAT7 Code

This document presents the verification and validation of the STAT7 Version 1.0 code which has been developed to perform the steady-state thermal hydraulic safety calculation of the MIT Research Reactor required upon conversion of the reactor from high enrichment uranium fuel to low enrichment uranium fuel. The key capabilites of the code including the statistical processing, water property generation, and thermal hydraulic solution are verified independently. While the first two capabilites are checked using statistical tests and NIST data tables, each component of the thermal hydraulic solution is verified using simple geometry test problems. The comparison between results obtained by the code and hand calculations on these problems shows that each of these components work correctly. Additionally, a comprehensive comparison between STAT7 Version 1.0 and PLTEMP/ANL Version 4.2 calculations for a five-channel test problem is performed for the validation. The good agreement between the obtained results for all thermal hydraulic parameters belonging to the fuel core region is achieved. An issue in bypass flowrate calculation was detected when both fin-friction and bypass flow claculations are involved. This problem can be corrected in a later version of the code, however, does not affect the application of STAT7 code as it has been used to date where the flow distribution in the core region and bypass channel is specified as an input parameter.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2020

Verification and Validation of the STAT7 Code

This document presents the verification and validation of the STAT7 Version 1.0 code which has been developed to perform the steady-state thermal hydraulic safety calculation of the MIT Research Reactor required upon conversion of the reactor from highly enriched uranium fuel to low- enriched uranium fuel. The key capabilities of the code including the statistical processing, water property generation, and thermal hydraulic solution are verified independently. While the first two capabilities are checked using statistical tests and NIST data tables, each component of the thermal hydraulic solution is verified using simple geometry test problems. The comparison between results obtained by the code and hand calculations on these problems shows that each of these components work correctly. Additionally, a comprehensive comparison between STAT7 Version 1.0 and PLTEMP/ANL Version 4.2 calculations for a five-channel test problem is performed for the validation. The good agreement between the obtained results for all thermal hydraulic parameters belonging to the fuel core region is achieved. An issue in bypass flowrate calculation was detected when both fin-friction and bypass flow calculations are involved. This problem can be corrected in a later version of the code. However, it does not affect the application of STAT7 as it has been used to date where the flow distribution in the core region and bypass channel is specified as an input parameter.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

MOSCATO Development and Integration in Fiscal Year 2022

During FY21, we conducted ongoing development work for the MOSCATO (Molten Salt Chemistry and Transport) solver. The code development work primarily consisted of transitioning capabilities from the original version of the solver, which was written in OpenFOAM, into Nek5000. In doing so, a fast, highly parallelizable solver was created that is capable of complex chemistry and corrosion simulations for engineering-scale molten salt systems. The Nek5000 version of MOSCATO is now fully featured and capable of higher-fidelity simulations than were previously possible. Demonstration cases including a thermal convection loop have been simulated to test these new capabilities. We built upon the work for FY22 and improved the code from several different perspectives. First, we improved the user interface by adding a new component to the official Nek5000 input file (.par). This new part contains documents parameters like, salt properties (density, viscosity, Cp, thermal conductivity), diffusion coefficients, standard potential, etc. Second, we built a conversion script to extract salt properties from the MSTDB-TP salt database and write to MOSCATO input file. Third, we migrated the code to NekRS, which is the GPU branch of Nek5000 and suitable for next generation supercomputers. Verification and Validation (V&V) work was also continued in FY22. Two tasks were performed. The first V&V task involved the validation of the Poisson-Nernst-Planck equation solver and Butler-Volmer electrode kinetics, by comparing with numerical and experimental data about thermoelectric cells. The second task involved the comparisons to corrosion results from a thermal convection loop run during the MSRE era. Satisfactory agreement was obtained from both tasks.

Yuan, Haomin↗
DOE OSTI2023

Verification and Validation of the STAT7 Code

This document presents the verification and validation of the STAT7 Version 1.1 code, which has been developed to perform the steady-state thermal hydraulics (TH) safety calculations required to support conversion of the Massachusetts Institute of Technology Research Reactor from highly enriched uranium fuel to low- enriched uranium fuel. The key capabilities of the code, including statistical processing, water property generation, and TH solution, are verified independently. While the first two capabilities are checked using statistical tests and NIST data tables, each component of the TH solution is verified using simple geometry test problems. The comparison between results obtained by the code and by hand calculations on these problems shows that each of these components works correctly. Additionally, a comprehensive comparison between STAT7 Version 1.1 and PLTEMP/ANL Version 4.3 Revision 162 calculations is performed for the validation. Good agreement is achieved between the results obtained with the two codes for all TH parameters belonging to the fuel core region.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2023

Expanded verification and validation studies of hypersonic aerodynamics with multiple physics-fidelity models

Hypersonic aerothermodynamics is an important domain of modern multiphysics simulation. The Multi-Fidelity Toolkit is a simulation tool being developed at Sandia National Laboratories to predict aerodynamic properties for compressible flows from a range of physics fidelities and computational speeds. These models include the Reynolds-averaged Navier–Stokes (RANS) equations, the Euler equations with momentum-energy integral technique (MEIT), and modified Newtonian aerodynamics with flat-plate boundary layer (MNA+FPBL) equations, and they can be invoked independently or coupled with hierarchical Kriging to interpolate between high-fidelity simulations using lower-fidelity data. However, as with any new simulation capability, verification and validation are necessary to gather credibility evidence. This work describes formal code- and solution-verification activities, as well as model validation with uncertainty considerations. Code verification activities on the MNA+FPBL model build on previous work by focusing on the viscous portion of the model. Viscous quantities of interest are compared against those from an analytical solution for flat-plate, inclined-plate, and cone geometries. The code verification methodology for the MEIT model is also presented. Test setup and results of code verification tests on the laminar and turbulent models within MEIT are shown. Solution-verification activities include grid-refinement studies on simulations that model the HIFiRE-1 wind tunnel experiments. These experiments are used for validation of all model fidelities. A thorough validation comparison with prediction error and uncertainty is also presented. Three additional HIFiRE-1 experimental runs are simulated in this study, and the solution verification and validation work examines the effects of the associated parameter changes on model performance. Finally, a study is presented that compares the computational costs and fidelities from each of the different models.

42 ENGINEERING↗
DOE OSTI2024

Alternative Source Verification for the NB5 Beamline

This report details the calculation and comparison of secondary neutron sources for the purpose of performing NB5 velocity selector shielding calculations without relying on the primary HB4 source and the use of a modified MCNP code to run the full model.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Modeling and Simulation of Fuel Burnup in Pebble Bed Reactors

Modeling and simulation of fuel burnup plays important roles in reactor design, operation, safety, and security as well as nuclear material control and accounting (MC&A) [1]. This task is uniquely challenging for pebble bed reactors (PBR) because the pebbles are continuously added and recycled into the reactor core, and their paths through the core are random. To address this problem, we present two simulation models in this paper. Brookhaven National Laboratory (BNL) developed a simple lattice model of a PBR in Serpent software to generate used pebble isotopic concentrations. The benefit of using Serpent software in this specific application is that it helps streamline the data generation process without having to use too many independent software codes in combination to achieve a simple task. For example, transport, burnup and zero power decay can be implemented in a single pass. Three-dimensional core models were developed using Serpent to simulate the burnup process of 5 subject pebbles starting from fresh till they reach nearly target burnup, with each pebble placed in one of the five artificially designated radial channels to capture the changing neutron spectra along the core radius. Equilibrium isotopic concentrations were assumed in all other pebbles in the core. To provide a verification for the Serpent isotope transmutation and decay results, Oak Ridge National Laboratory (ORNL) performed simple SCALE/ORIGEN calculations using the average neutron spectra calculated by Serpent for each of the 5 pebbles. The 252-group neutron spectra from Serpent were then used by ORIGEN to produce the one-group library for depletion and decay calculations. The isotopic concentrations of a few nuclides of interest and neutron and gamma source terms produced from the ORIGEN calculations were compared with the ones from the Serpent calculations. The model simulated in this work was based on the Pebble Bed Modular Reactor (PBMR)-400 design because many data needed for the simulation such as core power profiles, fuel and reflector temperatures, and equilibrium core composition are publicly available. In this paper, we will compare the results between these two approaches and benchmark the results against a set of well-established simulation results for PBMR-400.

Dim, Odera↗
DOE OSTI2023

Modeling and Simulation of Fuel Burnup in Pebble Bed Reactors

Modeling and simulation of fuel burnup plays important roles in reactor design, operation, safety, and security as well as nuclear material control and accounting (MC&A) [1]. This task is uniquely challenging for pebble bed reactors (PBR) because the pebbles are continuously added and recycled into the reactor core, and their paths through the core are random. To address this problem, we present two simulation models in this paper. Brookhaven National Laboratory (BNL) developed a simple lattice model of a PBR in Serpent software to generate used pebble isotopic concentrations. The benefit of using Serpent software in this specific application is that it helps streamline the data generation process without having to use too many independent software codes in combination to achieve a simple task. For example, transport, burnup and zero power decay can be implemented in a single pass. Three-dimensional core models were developed using Serpent to simulate the burnup process of five subject pebbles starting from fresh till they reach nearly target burnup, with each pebble placed in one of the five artificially designated radial channels to capture the changing neutron spectra along the core radius. Equilibrium isotopic concentrations were assumed in all other pebbles in the core. To provide a verification for the Serpent isotope transmutation and decay results, Oak Ridge National Laboratory (ORNL) performed simple SCALE/ORIGEN calculations using the average neutron spectra calculated by Serpent for each of the five pebbles. The 252-group neutron spectra from Serpent were then used by ORIGEN to produce the one-group library for depletion and decay calculations. The isotopic concentrations of a few nuclides of interest and neutron and gamma source terms produced from the ORIGEN calculations were compared with the ones from the Serpent calculations. The model simulated in this work was based on the Pebble Bed Modular Reactor (PBMR)-400 design because many data needed for the simulation such as core power profiles, fuel and reflector temperatures, and equilibrium core composition are publicly available. In this paper, we will compare the results between these two approaches and benchmark the results against a set of well-established simulation results for PBMR-400.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2023

Integrated Large-Scale Data Management Platform for Photovoltaic Power Conversion Equipment (PCE) Reliability Data: Preprint

To meet the demand for accuracy and real-time capability of PV system degradation evaluation, massive volume data is needed to run high-fidelity and high-efficiency simulations and perform advanced data analysis. However, PV farm operators have a series of difficulties with PV inverter data, such as data collection from multiple channels, massive data storage, data management and massive data analysis. To address these challenges, we developed an integrated data management platform capable of data acquisition, processing, storage, query, and performing big data analysis utilizing AI algorithms. The platform can also achieve data correctness verification and provide an effective distributed data management solution to retrieve massive data and establish a connection to distributed computational frameworks.

data management↗
DOE OSTI2023

Performance assessment of a real water source heat pump within a hardware-in-the-loop (HIL) testing environment

Over the last decade, the global fight against climate change through electrification has led to an increase in research on building heating, ventilation, and air conditioning (HVAC) systems that utilize intelligent control algorithms to provide demand-side grid service while also maintaining the thermal comfort of building occupants. As the pivotal point between building electricity consumption and indoor thermal comfort, high-efficiency electrical vapor-compression heat pumps are at the center of these emerging studies, and various grid-interactive and occupant-comfort control algorithms have been developed for them. The impact of these algorithms on heat pump operation and performance when subjected to different weather conditions, building loads, and grid requests calls for investigation and verification via experimental testing with actual heat pumps integrated with real-time building and grid responses. This study introduces a Water-Source Heat Pump (WSHP) Hardware-in-The-Loop (HIL) Test Facility that is the first of its kind. This testbed utilizes a 2-ton variable speed water-to-air heat pump that is capable of interacting with a virtual environment currently comprised of an EnergyPlus (E+) building simulation, an agent-based occupant behavioral model, and a single U-tube ground-loop heat exchanger (GLHE) model. Detailed descriptions of the testbed’s physical design and operation, virtual environment, as well as their mutual communication is provided. An uncertainty analysis is also performed under manufacturer specified heating and cooling design conditions. This analysis shows that the total load across the WSHP’s demand side heat exchanger, i.e., the sum of its latent and sensible components, can be measured with a relative uncertainty of ± 10.4% and ± 3.6% in cooling and heating mode respectively. The WSHP’s coefficient of performance (COP) can be measured with relative uncertainties of ± 10.4% in cooling mode, and ± 3.7% in heating mode. A preliminary 24-h experimental demonstration is then performed utilizing the DOE prototype small commercial office building model in E+. The simulation takes place in Atlanta, GA on the date of 08/26/15 from 12:00 AM to 11:59 PM using TMY3 weather data. Here, the results from this demonstration show that over the course of this experiment the simulated outputs of zone dry-bulb temperature, zone humidity ratio, and WSHP inlet water temperature can be tracked by testbed emulators up to a root mean squared error (RMSE) of ± 0.27 °C, ± 0.376 g/kg, and ± 0.85 °C respectively. The WSHP’s dynamic behavioral characteristics and performance are also captured, and correspond well with the authors’ previous understanding of heat pump efficiency as a function of evaporator and condenser fluid inlet conditions respectively.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Reported Energy and Cost Savings from the DOE ESPC IDIQ Program: FY2021

The objective of this work was to determine the realization rate of energy and cost savings from the U.S. Department of Energy’s (DOE’s) Energy Savings Performance Contract (ESPC) program based on information reported by the energy services companies (ESCOs) that are carrying out ESPC projects at federal sites. Information was extracted from 201 measurement and verification (M&V) reports covering 193 projects to determine reported, estimated, and guaranteed cost savings and the associated reported and estimated energy savings for the previous contract performance year. This report covers projects that had a performance year ending in fiscal year 2021, between October 1, 2020 and September 30, 2021, and had an M&V report issued. Additionally, the annual cost to perform M&V was extracted from the individual project Task Order (TO) Schedules.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2023

Reported Energy and Cost Savings from the DOE ESPC IDIQ Program: FY 2022

The objective of this work was to determine the realization rate of energy and cost savings from the U.S. Department of Energy’s (DOE’s) Energy Savings Performance Contract (ESPC) program based on information reported by the energy services companies (ESCOs) that are carrying out ESPC projects at federal sites. Information was extracted from 190 measurement and verification (M&V) reports covering 182 projects to determine reported, estimated, and guaranteed cost savings and the associated reported and estimated energy savings for the previous contract performance year. This report covers projects that had a performance year ending in fiscal year 2021, between October 1, 2021 and September 30, 2022, and had an M&V report issued. Additionally, the annual cost to perform M&V was extracted from the individual project Task Order (TO) Schedules.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗