Search NASA⌕ Search

SEARCH · Search NASA

Results for “Validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28

A Complete Reporting of MCNP6 Validation Results for Electron Energy Deposition in Single-Layer Extended Media for Source Energies <= 1-MeV

In this paper, we expand on previous validation work by Dixon and Hughes. That is, we present a more complete suite of validation results with respect to to the well-known Lockwood energy deposition experiment. Lockwood et al. measured energy deposition in materials including beryllium, carbon, aluminum, iron, copper, molybdenum, tantalum, and uranium, for both single- and multi-layer 1-D geometries. Source configurations included mono-energetic, mono-directional electron beams with energies of 0.05-MeV, 0.1-MeV, 0.3- MeV, 0.5-MeV, and 1-MeV, in both normal and off-normal angles of incidence. These experiments are particularly valuable for validating electron transport codes, because they are closely represented by simulating pencil beams incident on 1-D semi-infinite slabs with and without material interfaces. Herein, we include total energy deposition and energy deposition profiles for the single-layer experiments reported by Lockwood et al. (a more complete multi-layer validation will follow in another report).

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Development and Validation of SAM Multi-dimensional Flow Model for Thermal Mixing and Stratification Modeling

Thermal mixing and stratification in large pools or enclosures are very important phenomena that are critical to nuclear reactor safety. Because of the wide ranges of time and length scales associated with such phenomena, accurate modeling and simulation of thermal mixing and stratification remain as the key unresolved, challenging problems for reactor transient analyses. In traditional system analysis codes, simplified zero-dimensional (0-D) models are widely used for their high numerical efficiency, but they generally suffer from very limited prediction accuracies or range of applicability. Like traditional system analysis codes, the current version of the SAM code has implemented such simplified 0-D and one-dimensional mixing models. On the other hand, high-resolution Computational Fluid Dynamics (CFD) tools are often used to model complex thermal mixing and stratification phenomena. They are, however, generally numerically expensive, and they require large amounts of computational resources. It is therefore desirable to implement advanced and efficient thermal mixing and stratification modeling capabilities embedded in a system analysis code. This approach will improve the accuracy of reactor safety analyses when thermal mixing and stratification are involved, and also avoid using the large computational resources needed for high-resolution CFD analysis. Currently, with the support of the U.S. DOE Office of Nuclear Energy’s Nuclear Energy Advanced Modeling and Simulation program, an effort has been launched to develop and implement a multi-dimensional flow model in the system analysis code SAM, and demonstrate its applications to model thermal mixing and stratification phenomena in large enclosures. The main outcomes of this research and development activity are summarized in this report, which presents an attempt to include a built-in advanced multi-dimensional flow model in a system analysis code with the focus on overcoming the simulation challenges of thermal mixing and stratification phenomena. In this report, we start with the introduction of existing SAM code capabilities to simulate thermal mixing and stratification phenomena, which is followed by a short summary of the multi-dimensional model implemented in the SAM code, including both the physical model and the Finite Element Method code implementation. In this study, two options were implemented in the SAM code to model turbulent flows: a relatively simple built-in turbulence model and an interface to accept externally computed turbulent viscosities (e.g., from a high- resolution CFD simulation). Code validation studies on this newly added capability were then carried out to compare SAM simulation results with experimental data from the SUPERCAVNA facility, which was designed to study the complex flow recirculation and thermal stratification phenomena relevant to sodium fast reactor designs. In this study, one transient and two steady-state test cases were used for code validation. Different approaches have been used to model the complex turbulence flow fields in the SUPERCAVNA facility. A highly simplified zero-equation turbulence model was first used, but it was determined that it is too simple to capture the complex turbulence flow fields in these test cases. Subsequently, the code validation continued with the use of turbulent viscosity data from high-resolution STAR-CCM+ CFD simulations to improve the accuracy of the results. Using this approach, the SAM simulation results showed very good agreement with both the SUPERCAVNA experimental data and STAR-CCM+ simulation results. In this report, we demonstrate the development, implementation, and successful validation of a multi-dimensional flow model in the SAM code, which aims to improve the simulation accuracy for complex thermal mixing and stratification phenomena. Lessons have also been learned, including that in cases where the flow fields are not well predicted by the zero-equation model, the iinput of turbulent viscosities from an external source can enhance the overall predictive capabilities needed to accurately capture complex thermal-hydraulic phenomena. Therefore, future research will be needed to further improve the code’s capabilities, such as by developing a more efficient and robust approach to capture the turbulence effects in the SAM code.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Verification and validation of developed short-term forecasting models

Recent advancements in machine learning (ML) and artificial intelligence (AI) technologies provide an opportunity for leveraging data-driven algorithms to predict future nuclear power plant (NPP) operating conditions by using recorded plant process data. Successfully implementing these models can lead to cost-reducing, conditioned-based predictive maintenance through optimized maintenance schedules and a reduction of unnecessary maintenance activities. This report discusses the verification and validation of short-term forecasting processes (i.e., data cleaning, feature selection, model optimization, and forecasting) developed in previous reports. The verification and validation (V&V) process demonstrates the expected precision and accuracy when the ML model encounters new datasets from different systems. Shapley additive explanations were used as the primary means of feature selection across these different data set. Individual models were trained for each data set, then validated through a cross-validation procedure. In this report, two different ML models were tasked to predict variables from three different plant process data sets with varying prediction horizons. The results indicate that support vector regression (SVR) outperformed long short-term memory (LSTM) neural networks in regard to each data set and each prediction horizon in this study, but further tuning and optimization could improve long short-term memory results. However, each forecasting model showed reduced performance as the prediction horizon was extended from 1 hour to 1 day ahead. Research is ongoing to evaluate the optimal input variable space, which is based on a given set of process parameters, to further improve forecasting accuracy.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Validation and Verification for INL Modelica-based TEDS models Via Experimental Results

This report provides an overview on the verification and validation (V&V) of the Thermal Energy Distribution System (TEDS) model developed in the Modelica process modeling ecosystem using experimental data. Model development has led to the creation of a dynamic process model of the experimental TEDS facility housed within the Energy Systems Laboratory (ESL) at Idaho National Laboratory (INL). The model was then used during the preconstruction phase of the experimental effort to inform experimental design (e.g., insulation requirements, bypass line placement, expected performance of components) and to test innovative control schemes prior to the initial operation. The TEDS model developed in Modelica includes the primary components of the TEDS experimental unit: a 200kW Chromalox heater; a single-tank packed-bed thermal energy storage system filled with 0.125-inch alumina (Al2O3) beads; an ethylene-glycol-to-Therminol-66 heat exchanger; system piping; five control valves; and all associated temperature, pressure, and volumetric flow sensors. Using the Institute of Electrical and Electronics Engineers (IEEE) V&V methodologies, considered the gold standard in the engineering field, the model was verified using a combination of static analysis, spatial convergence, and regression tests. Then using dynamic time warping (DTW) initial runs to validate and tune the TEDS model versus the experiment were conducted. This tuning method was accomplished using the INL Risk Analysis Virtual ENvironment (RAVEN) software package. Tuning is required to account for physical phenomena that are less understood within the empirical heat transfer correlations. Through the commencement of this work, a systems-level model of TEDS with associated control systems, sensors, piping diameters, and component capabilities has been created. This model was utilized in the pre-experimental phase to inform system design, insulation thicknesses, and potential control schemes to operate the system effectively and safely. Then, initial experimental startup and operational data were used to demonstrate the validation and tuning methodology. This process demonstrates the classical two-step approach of a model informing experimental design followed by the experiment validation and tuning the model.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

VALID Past, Present, and Future [Slides]

This presentation discusses the Verified, Archived Library of Inputs and Data (VALID) procedure which is managed per computational procedure under the overall SCALE quality assurance plan. The principle behind VALID is that two independent, qualified people prepare and review the model, while a dual, independent check acts as a primary barrier to prevent errors in the library. A final check by VALID QAC of procedural compliance is then performed. The future for VALID includes plans to add more experiments, a review for all ICSBEP cases containing Deuterium, ZEUS intermediate and fast spectrum evaluations, intermediate enrichment experiments, other cases of interest to sponsors, and mixed/intermediate spectrum experiments.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Subcomponent Validation of Composite Joints for the Marine Energy Advanced Materials Project

The Marine Energy Advanced Materials project is an ongoing multi-year, multi-lab project with the main goals of addressing barriers and uncertainties facing marine energy developers in adopting advanced materials for structural applications. NREL's goals of the project were to address subcomponents testing needs for marine energy materials, to improve understanding of design allowables at the full-scale and provide near net-scale static and fatigue data of composite subcomponents using materials applicable to the marine energy industry. In the long term, the test method development and data generated would be used to inform standards development. This report outlines perhaps one of the largest-scale studies conducted with regards to saltwater conditioning of various composite material subcomponents and their subsequent structural validation, specifically directed at the marine renewable energy industry. A variety of fiberglass composite panels with epoxy and vinyl ester epoxy resin systems were manufactured at Montana State University, which were then used to manufacture an array of different types of subcomponent test specimens at the National Renewable Energy Laboratory's Flatirons Campus. These subcomponents were in the form of T-bolt and double-ended-insert specimens, which were intended to represent bonded and mechanical bolted connections for thick composite laminates, metal-metal and composite lap shear specimens to evaluate adhesion of constituent materials, and adhesive beam-shear specimens as part of an effort to better evaluate the characteristics of thick adhesive bondlines. Overall, the materials used were fiberglass reinforced epoxy and vinyl ester matrix composites, epoxy and methacrylate adhesives, and 316 and 2507 stainless steels. Specimens were then conditioned in salt water at various temperatures and for various periods of time at Florida Atlantic University and Pacific Northwest National Laboratory. All specimens were then mechanically characterized and validated using various test methods under static and fatigue loading conditions at NREL's Structural Technology Laboratory. Throughout the conditioning and mechanical validation process, valuable experience was gained, which will help guide future test method development for marine energy materials. In many instances, the results indicated similar observations as to what had been observed during previous coupon scale characterization efforts that provided a vital understanding of the scale up process. However in some instances, unexpected phenomena were observed, such as interactions between the adhesives and 316 steel. Furthermore, some materials exhibited significant degradation due to the saltwater conditioning. Ultimately, this report provides a detailed summary of the specimens that were designed, the subcomponent test methods that were developed, and the results that were generated, which will serve as important guidance for marine renewable energy developers and researchers for future structural designs and validation.

16 TIDAL AND WAVE POWER↗

A Guide to Engaging Underserved Communities in Commercial Energy Efficiency Field Validations

Underserved communities in the United States often experience the negative impacts of climate change and environmental degradation but enjoy few of the benefits of technological and environmental advances. The White House has addressed this inequity through the Justice40 initiative, which requires 40% of the benefits of select federal investments to be directed to underserved communities (The White House, 2022). Clean energy and energy efficiency are two highlighted investment categories, so the U.S. Department of Energy will guide implementation of the Justice40 initiative by, among other things, decreasing energy burdens, increasing parity in clean energy technology access and adoption, and increasing energy resiliency. A strategy for reaching these goals is to evaluate and validate new energy efficiency technologies in commercial buildings in underserved communities, where buildings may be older, smaller, and have deferred maintenance due to historical underinvestment. This paper develops guidance for researchers pursuing field validations with underserved communities. Historical redlining and past negative experiences with government and large institutions may make residents wary of participating in these field validations. Researchers, therefore, may need to spend more time building relationships and matching technologies to buildings. In this paper, we analyzed technical reports to identify common field validation building characteristics and conducted semi-structured expert conversations to identify key stages and major themes of engaging underserved communities. Results indicate there may be flexibility in site selection and there are steps researchers can take to support collaboration with communities. Results also suggest benefits to both the community and energy efficiency research.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Validation and uncertainty quantification of Fuego simulations of calorimeter heating in a wind-driven hydrocarbon pool fire.

The objective of this work is to perform an uncertainty quantification (UQ) and model validation analysis of simulations of tests in the cross-wind test facility (XTF) at Sandia National Laboratories. In these tests, a calorimeter was subjected to a fire and the thermal response was measured via thermocouples. The UQ and validation analysis pertains to the experimental and predicted thermal response of the calorimeter. The calculations were performed using Sierra/Fuego/Syrinx/Calore, an Advanced Simulation and Computing (ASC) code capable of predicting object thermal response to a fire environment. Based on the validation results at eight diversely representative TC locations on the calorimeter the predicted calorimeter temperatures effectively bound the experimental temperatures. This post-validates Sandia's first integrated use of fire modeling with thermal response modeling and associated uncertainty estimates in an abnormal-thermal QMU analysis.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

NEAMS Experimental Support for Code Validation, INL FY2009

The goal is for all modeling and simulation tools to be demonstrated accurate and reliable through a formal Verification and Validation (V&V) process, especially where such tools are to be used to establish safety margins and support regulatory compliance, or to design a system in a manner that reduces the role of expensive mockups and prototypes. Whereas the Verification part of the process does not rely on experiment, the Validation part, on the contrary, necessitates as many relevant and precise experimental data as possible to make sure the models reproduce reality as closely as possible. Hence, this report presents a limited selection of experimental data that could be used to validate the codes devoted mainly to Fast Neutron Reactor calculations in the US. Emphasis has been put on existing data for thermal-hydraulics, fuel and reactor physics. The principles of a new “smart” experiment that could be used to improve our knowledge of neutron cross-sections are presented as well. In short, it consists in irradiating a few milligrams of actinides and analyzing the results with Accelerator Mass Spectroscopy to infer the neutron cross-sections. Finally, the wealth of experimental data relevant to Fast Neutron Reactors in the US should not be taken for granted and efforts should be put on saving these 30-40 years old data and on making sure they are validation-worthy, i.e. that the experimental conditions and uncertainties are well documented.

97 MATHEMATICS AND COMPUTING↗

Representing Small Commercial Building Faults in EnergyPlus, Part II: Model Validation

Automated fault detection and diagnosis (AFDD) tools based on machine-learning algorithms hold promise for lowering cost barriers for AFDD in small commercial buildings; however, access to high-quality training data for such algorithms is often difficult to obtain. To fill the gap in this research area, this study covers the development (Part I) and validation (Part II) of fault models that can be used with the building energy modeling software EnergyPlus® and OpenStudio® to generate a cost-effective training data set for developing AFDD algorithms. Part II (this paper) first presents a methodology of validating fault models with OpenStudio and then presents validation results, which are compared against measurements from a reference building. We discuss the results of our experiments with eight different faults in the reference building (a total of 39 different baseline and faulted scenarios), including our methodology for using fault models along with the reference building model to simulate the same faulted scenarios. Then, we present validation of the fault models by comparing results of simulations and experiments either quantitatively or qualitatively.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Validating Performance Models for Hybrid Power Plant Control Assessment

The need for simple, but accurate performance models of wind turbine generators (WTGs), photovoltaic (PV) plants, and battery energy storage systems (BESS) for various hybrid power plant (HPP) studies motivates the present work. Particularly, the development and verification stage of HPP controls requires reduced-order models to minimize the complexity and computation effort of simulation platforms. In this paper, such models are proposed, and the most essential parts of the models are validated through field measurements. The models target power system integration studies involving active and reactive power, as well as frequency and voltage regulation where detailed models, as proposed in the standards, can be cumbersome. Field measurements of two Vestas WTGs, one 1-MW PV plant, and one 1-MW/1-MWh BESS are used for model validation. The results show that the WTG and PV performance models correctly estimate the power generation variability according to fluctuations in wind speed and solar irradiance. The BESS performance model provides satisfactory results related to grid-forming control performance and estimation of state-of-charge. The presented validation work enables using the proposed performance models for power system studies and HPP control design in all model-based design stages, that is, preliminary analysis, design, verification, and validation with a high level of confidence.

24 POWER TRANSMISSION AND DISTRIBUTION↗

197 candidates and 104 validated planets in K2's first five fields

We present 197 planet candidates discovered using data from the first year of the NASA K2 mission (Campaigns 0–4), along with the results of an intensive program of photometric analyses, stellar spectroscopy, high-resolution imaging, and statistical validation. We distill these candidates into sets of 104 validated planets (57 in multi-planet systems), 30 false positives, and 63 remaining candidates. Our validated systems span a range of properties, with median values of R {sub P} = 2.3 R{sub ⊕}, P = 8.6 days, T{sub eff} = 5300 K, and Kp = 12.7 mag. Stellar spectroscopy provides precise stellar and planetary parameters for most of these systems. We show that K2 has increased by 30% the number of small planets known to orbit moderately bright stars (1–4 R {sub ⊕}, Kp = 9–13 mag). Of particular interest are 76 planets smaller than 2 R {sub ⊕}, 15 orbiting stars brighter than Kp = 11.5 mag, 5 receiving Earth-like irradiation levels, and several multi-planet systems—including 4 planets orbiting the M dwarf K2–72 near mean-motion resonances. By quantifying the likelihood that each candidate is a planet we demonstrate that our candidate sample has an overall false positive rate of 15%–30%, with rates substantially lower for small candidates (<2R{sub ⊕}) and larger for candidates with radii >8R{sub ⊕} and/or with P<3 days. Extrapolation of the current planetary yield suggests that K2 will discover between 500 and 1000 planets in its planned four-year mission, assuming sufficient follow-up resources are available. Efficient observing and analysis, together with an organized and coherent follow-up strategy, are essential for maximizing the efficacy of planet-validation efforts for K2, TESS, and future large-scale surveys.

79 ASTRONOMY AND ASTROPHYSICS↗

Validation of the NLR Pumped Storage Hydropower Cost Model

The National Laboratory of the Rockies (NLR) first released its pumped storage hydropower (PSH) cost model in 2023 as the most detailed bottom-up PSH cost model available to the public. It is available both as a spreadsheet and an interactive web tool, enabling users with a variety of PSH interests to transparently characterize costs of alternative PSH sites and designs. The PSH cost model cannot replace detailed site-level studies and design, but it is important to validate it against other industry PSH cost estimates. The initial model methodology report validated the cost model for a single proposed site, the Eagle Mountain Project in California. This slide deck documents an expanded validation exercise using cost data from six other sites: Goldendale (Washington), Seminoe (Wyoming), Gordon Butte (Montana), Swan Lake (Oregon), White Pine (Oregon), and Lewis Ridge (Kentucky). It compares itemized costs from Federal Energy Regulatory Commission (FERC) applications and other reported costs with NLR PSH cost model outputs after customizing inputs for each site. The validation exercise finds that the NLR model's conservative indirect cost assumptions often drive overall cost overestimation, with direct cost comparisons typically agreeing more closely. All cost model estimates are well within an Association for the Advancement of Cost Engineering (AACE) Class 5 estimation range (-50% to +100%), with five within the AACE Class 4 range (-30% to +50%) and four being within 15%. This result is considered reasonable performance for a parametric model applied at a preliminary design stage.

13 HYDRO ENERGY↗

H2@Scale - Validating an Electrolysis System with High Output Pressure: Cooperative Research and Development Final Report, CRADA Number CRD-18-00741

Electrolysis has been a commercially available product for a while and electrolyzers have been a proven capability to provide additional benefits (e.g. controllable load for grid services) in addition to production of hydrogen. The hydrogen output is typically compressed for storage and dispensing. Compression adds cost and decreases system reliability. Honda’s electrolyzer systems have been developed to include electrochemical compression to leverage the production system itself for at least partial compression. In this project, the team will evaluate Honda’s PEM based electrochemical compression system. The system is capable of compressing hydrogen up to 70 MPa electrochemically. Validation testing is the next step to accelerate this technology into the marketplace, as the validation will provide needed data under a variety of operation conditions and controls. These operating conditions and controls are based on over a decade of NLR research and development with low-temperature electrolysis. The validation testing will include preparing NLR’s site for third party evaluation, benchmark testing of Honda’s stack and system, and simulating operation connected to renewables or in a grid service profile. NLR’s Energy System Integration Lab will be the location for the electrolyzer validation research and integrated into the Hydrogen Infrastructure Test & Research Facility (HITRF). This will build into the existing retail style hydrogen fueling station for a fully integrated experimental setup.

08 HYDROGEN↗

A semi-automatic method for left ventricle volume estimate: an in vivo validation study

This study aims to the validation of the left ventricular (LV) volume estimates obtained by processing volumetric data utilizing a segmentation model based on level set technique. The validation has been performed by comparing real-time volumetric echo data (RT3DE) and magnetic resonance (MRI) data. A validation protocol has been defined. The validation protocol was applied to twenty-four estimates (range 61-467 ml) obtained from normal and pathologic subjects, which underwent both RT3DE and MRI. A statistical analysis was performed on each estimate and on clinical parameters as stroke volume (SV) and ejection fraction (EF). Assuming MRI estimates (x) as a reference, an excellent correlation was found with volume measured by utilizing the segmentation procedure (y) (y=0.89x + 13.78, r=0.98). The mean error on SV was 8 ml and the mean error on EF was 2%. This study demonstrated that the segmentation technique is reliably applicable on human hearts in clinical practice.

NASA Discipline Cardiopulmonary↗

Mars Exploration Rover Mission: Entry, Descent, and Landing System Validation

System validation for a Mars entry, descent, and landing system is not simply a demonstration that the electrical system functions in the associated environments. The function of this system is its interaction with the atmospheric and surface environment. Thus, in addition to traditional test-bed, hardware-in-the-loop, testing, a validation program that confirms the environmental interaction is required. Unfortunately, it is not possible to conduct a meaningful end-to-end test of a Mars landing system on Earth. The validation plan must be constructed from an interconnected combination of simulation, analysis and test. For the Mars Exploration Rover mission, this combination of activities and the logic of how they combined to the system's validation was explicitly stated, reviewed, and tracked as part of the development plan.

system validation↗

Development of Level 2 Calibration and Validation Plans for GOES-R; What is a RIMP?

Calibration and Validation (CalVal) plans for Geostationary Operational Environmental Satellite version R (GOES-R) Level 2 (L2) products were documented via Resource, Implementation, and Management Plans (RIMPs) for all of the official L2 products required from the GOES-R Advanced Baseline Imager (ABI). In 2015 the GOES-R program decided to replace the typical CalVal plans with RIMPs that covered, for a given L2 product, what was required from that product, how it would be validated, and what tools would be used to do so. Similar to Level 1b products, the intent was to cover the full spectrum of planning required for the CalVal of L2 ABI products. Instead of focusing on step-by-step procedures, the RIMPs concentrated on the criteria for each stage of the validation process (Beta, Provisional, and Full Validation) and the many elements required to prove when each stage was reached.

Validation↗

Development of Level 2 Calibration and Validation Plans for GOES-R; What is a RIMP?

Calibration and Validation (CalVal) plans for Geostationary Operational Environmental Satellite version R (GOES-R) Level 2 (L2) products were documented via Resource, Implementation, and Management Plans (RIMPs) for all of the official L2 products required from the GOES-R Advanced Baseline Imager (ABI). In 2015 the GOES-R program decided to replace the typical CalVal plans with RIMPs that covered, for a given L2 product, what was required from that product, how it would be validated, and what tools would be used to do so. Similar to Level 1b products, the intent was to cover the full spectrum of planning required for the CalVal of L2 ABI products. Instead of focusing on step-by-step procedures, the RIMPs concentrated on the criteria for each stage of the validation process (Beta, Provisional, and Full Validation) and the many elements required to prove when each stage was reached.

Validation↗