Search NASA⌕ Search

SEARCH · Search NASA

Results for “database for model validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Calibration and Validation of NRC Fuel Performance Models

Pacific Northwest National Laboratory maintains steady-state and transient fuel performance codes for the U.S Nuclear Regulatory Commission (NRC). The NRC uses these codes in performing confirmatory calculations of licensee fuel performance codes and safety analysis methods during the review and approval of these codes and methods. The NRC also uses these codes to perform calculations to direct regulatory research and to assist in the development of new regulations and regulatory guides. Because of the safety-related uses for these codes, it is critically important that the codes are capable of accurately modeling modern fuel and operations and that the models and code predictions are well validated using data collected from conditions relevant to in-reactor conditions. FRAPCON and FRAPTRAN have an extensive database of separate effects data used to validate individual material property and fuel performance models and an integral effects database used to assess the overall code prediction within the full range of fuel operations. The key code predictions that are of regulatory interest as they relate to various specified acceptable design limits are; fuel and cladding temperature, rod internal pressure, cladding hoop strain, cladding corrosion and hydriding, and fission gas release. To assess the ability of the code to accurately predict these values, the integral assessment database consists of measurements of fuel centerline temperature, fission gas release, void volume, cladding corrosion, and cladding hoop strain. This paper will discuss the activities that are performed to ensure that FRAPCON and FRAPTRAN represent the state of the industry and will describe the separate effect and integral effect databases that are used to validate the models and are continually being expanded to ensure validation over the full range of fuel operations.

Geelhood, Kenneth J.↗

Consistency, Verification, and Validation of Turbulence Models for Reynolds-Averaged Navier-Stokes Applications

In current practice, it is often difficult to draw firm conclusions about turbulence model accuracy when performing multi-code CFD studies ostensibly using the same model because of inconsistencies in model formulation or implementation in different codes. This paper describes an effort to improve the consistency, verification, and validation of turbulence models within the aerospace community through a website database of verification and validation cases. Some of the variants of two widely-used turbulence models are described, and two independent computer codes (one structured and one unstructured) are used in conjunction with two specific versions of these models to demonstrate consistency with grid refinement for several representative problems. Naming conventions, implementation consistency, and thorough grid resolution studies are key factors necessary for success.

Rumsey, Christopher L.↗

Battery inverter experimental data

The increase in power electronic based generation sources require accurate modeling of inverters. Accurate modeling requires experimental data over wider operation range. We used 30 kW off-the-shelf grid following battery inverter in the experiments. We used controllable AC supply and controllable DC supply to emulate AC and DC side characteristics. The experiments were performed at NREL's Energy Systems Integration Facility. Inverter is tested under 100%, 75%, 50%, 25% load conditions. In the first dataset, for each operating condition, controllable AC source voltage is varied from 0.9 to 1.1 per unit (p.u) with a step value of 0.025 p.u while keeping the frequency at 60 Hz. In the second dataset, under similar load conditions (100%, 75%, 50%, 25% ), the frequency of the controllable AC source voltage was varied from 59 Hz to 61 Hz with a step value of 0.2 Hz. Voltage and frequency range is chosen based on inverter protection. Voltages and currents on DC and AC side are included in the dataset.

24 POWER TRANSMISSION AND DISTRIBUTION↗

PV inverter experimental data

The increase in power electronic based generation sources require accurate modeling of inverters. Accurate modeling requires experimental data over wider operation range. We used 20 kW off-the-shelf grid following PV inverter in the experiments. We used controllable AC supply and controllable DC supply to emulate AC and DC side characteristics. The experiments were performed at NREL's Energy Systems Integration Facility. Due to the limitations of the DC supply used, inverter is tested under 75%, 50%, 25% load conditions (This dataset does not contain 100% load condition). In the first dataset, for each operating condition, controllable AC source voltage is varied from 0.88 to 1.09 per unit (p.u) with a step value of 0.025 p.u while keeping the frequency at 60 Hz. In the second dataset, under similar load conditions (75%, 50%, 25% ), the frequency of the controllable AC source voltage was varied from 59.4 Hz to 60.45 Hz with a step value of 0.2 Hz. Voltage and frequency range is chosen based on inverter protection. Voltages and currents on DC and AC side are included in the dataset.

24 POWER TRANSMISSION AND DISTRIBUTION↗

PV Inverter Experimental Dataset Version 2 with 100 Percent Power

The increase in power electronic based generation sources require accurate modeling of inverters. Accurate modeling requires experimental data over wider operation range. We used 20 kW off-the-shelf grid following PV inverter in the experiments. We used controllable AC supply and controllable DC supply to emulate AC and DC side characteristics. The experiments were performed at NREL's Energy Systems Integration Facility. The PV inverter is tested under 100%, 75%, 50%, 25% load conditions. In the first dataset, for each operating condition, controllable AC source voltage is varied from 0.88 to 1.09 per unit (p.u) with a step value of 0.025 p.u while keeping the frequency at 60 Hz. In the second dataset, under similar load conditions (100%, 75%, 50%, 25% ), the frequency of the controllable AC source voltage was varied from 59.4 Hz to 60.45 Hz with a step value of 0.2 Hz. Voltage and frequency range is chosen based on inverter protection. Voltages and currents on DC and AC side are included in the dataset.

14 SOLAR ENERGY↗

Machine learning models for rat multigeneration reproductive toxicity prediction

Reproductive toxicity is one of the prominent endpoints in the risk assessment of environmental and industrial chemicals. Due to the complexity of the reproductive system, traditional reproductive toxicity testing in animals, especially guideline multigeneration reproductive toxicity studies, take a long time and are expensive. Therefore, machine learning, as a promising alternative approach, should be considered when evaluating the reproductive toxicity of chemicals. We curated rat multigeneration reproductive toxicity testing data of 275 chemicals from ToxRefDB (Toxicity Reference Database) and developed predictive models using seven machine learning algorithms (decision tree, decision forest, random forest, k-nearest neighbors, support vector machine, linear discriminant analysis, and logistic regression). A consensus model was built based on the seven individual models. An external validation set was curated from the COSMOS database and the literature. The performances of individual and consensus models were evaluated using 500 iterations of 5-fold cross-validations and the external validation data set. The balanced accuracy of the models ranged from 58% to 65% in the 5-fold cross-validations and 45%–61% in the external validations. Prediction confidence analysis was conducted to provide additional information for more appropriate applications of the developed models. The impact of our findings is in increasing confidence in machine learning models. We demonstrate the importance of using consensus models for harnessing the benefits of multiple machine learning models (i.e., using redundant systems to check validity of outcomes). While we continue to build upon the models to better characterize weak toxicants, there is current utility in saving resources by being able to screen out strong reproductive toxicants before investing in vivo testing. The modeling approach (machine learning models) is offered for assessing the rat multigeneration reproductive toxicity of chemicals. Our results suggest that machine learning may be a promising alternative approach to evaluate the potential reproductive toxicity of chemicals.

consensus model↗

Integrated Analyses of Multiple Worldwide Aerosol Mass Spectrometer Datasets for Improved Understanding of Aerosol Sources and Processes and for Comparison with Global Models

The AMS is the only current instrument that provides real-time, quantitative, and size-resolved data on submicron non-refractory aerosol species with a time resolution of a few minutes or better. The AMS field data are multidimensional and massive, containing extremely rich information on aerosol chemistry, microphysics and dynamics—basic information that is required to evaluate and quantify the radiative climate forcing of atmospheric aerosols. The high time resolution of the AMS data also reveals details of aerosol dynamic variations that are vital to understanding the physico-chemical processes of atmospheric aerosols that govern aerosol properties relevant to the climate. There are two primary objectives of this 3-year project. Our first objective is to perform highly integrated analysis of dozens of AMS datasets acquired from various urban, forested, coastal, marine, mountain peak, and rural/remote locations around the world and synthesize and inter-compare results with a focus on the sources and the physico-chemical processes that govern aerosol properties relevant to aerosol climate forcing. Our second objective is to support our collaboration with global aerosol modelers, in which we will supply the size-resolved aerosol composition and temporal variation data (via a public web interface) and our analysis results for use in model testing and validation and for translation of the rich AMS database into model constraints that can improve climate forcing simulations. Several prominent global aerosol modelers have expressed enthusiastic support for this collaboration. The specific tasks that we propose to accomplish include 1) to develop, validate, and apply multivariate analysis techniques for improved characterization and source apportionment of organic aerosols; 2) to evaluate aerosol source regions and relative contributions based on back-trajectory integration (PSCF method); 3) to summarize and synthesize submicron aerosol information, including composition, concentration, size distribution and (inferred) shape and mixing state in various environments and their regional and seasonal variations within the context of regional and global modeling; and 4) to quantitatively evaluate important processes in various atmospheric environments and during different seasons, focusing on acid-catalyzed SOA formation, new particle growth, and photochemical processes of atmospheric organic aerosols (i.e., SOA production and POA oxidation). We will also examine the correlations and compile the ratios between important pairs of aerosol and gas phase species using region-specific and season-specific correlations and as a function of photochemical age and compare them with the ratios produced by various models. To enable our collaborations with the modelers, we will supply (via a public web interface) AMS data and our analysis results for use in model testing and validation and facilitate the use of the AMS information to constrain calculations of radiative forcing. Model output and AMS measurements and derived parameters will be compared with a focus on regional variability of model/measurement discrepancies and their causes. Finally we will share results, insights and data mining algorithms through peer-reviewed publications, presentations/tutorials at conferences/workshops, and web dissemination of analysis results and in-house developed software packages.

58 GEOSCIENCES↗

Calibration and validation of NRC fuel performance models

FRAPCON and FRAPTRAN are the steady-state and transient fuel performance codes, respectively, that are used by the U.S. Nuclear Regulatory Commission (NRC) in performing confirmatory calculations of licensee fuel performance codes and safety analysis methods during the review and approval of these codes and methods for light-water reactors. The NRC also uses these codes to perform calculations to direct regulatory research and to assist in the development of new regulations and regulatory guides. FRAPCON and FRAPTRAN are well-validated fuel performance codes that are kept in a constant state of maintenance. FRAPCON and FRAPTRAN have an extensive database of separate effects data used to validate individual material property and fuel performance models and an integral effects database used to assess the overall code prediction within the full range of fuel operations. The key code predictions that are of regulatory interest as they relate to various specified acceptable design limits are: fuel and cladding temperature, rod internal pressure, cladding hoop strain, cladding corrosion and hydriding, and fission gas release. To assess the ability of the code to accurately predict these values, the integral assessment database consists of measurements of fuel centerline temperature, fission gas release, void volume, cladding corrosion, and cladding hoop strain. This paper will discuss the activities that are performed to ensure that FRAPCON and FRAPTRAN represent the state of the industry and will describe the separate effect and integral effect databases that are used to validate the models and are continually being expanded to ensure validation over the full range of fuel operations.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Artificial neural network based predictions of cetane number for furanic biofuel additives

The next generation of alternative fuels is being explored through advanced chemical and biological production techniques for the purpose of finding suitable replacements for diesel and gasoline while lowering production costs and increasing process yields. Chemical conversion of biomass to fuels offers a plethora of pathways with a variety of fuel molecules, both novel and traditional, which may be targeted. In the search for new fuels, an initial, intuition-driven evaluation of fuel compounds with desired properties is required. Due to the high cost and significant production time needed to synthesize these materials at a scale sufficient for exhaustive testing, a predictive model would allow chemists to preemptively screen fuel properties of potentially desirable fuel candidates. Current work has shown that predictive models, in this case artificial neural networks (ANN's) analyzing quantitative structure property relationships (QSPR's), can predict the cetane number (CN) of a proposed fuel molecule with relatively small error. A fuel's CN is a measure of its ignition quality, typically defined using prescribed ASTM standards and a cetane testing engine. Alternatively, the analogous derived cetane number (DCN), obtained using an Ignition Quality Tester (IQT), is a direct measurement alternative to the CN that uses an empirical inverse relationship to the ignition delay found in the constant volume combustion chamber apparatus. DCN data points acquired using an IQT were utilized for model validation and expansion of the experimental database used in this study. The present report improves on an existing model by optimizing the model architecture along with the key learning variables of the ANN and by making the model more generalizable to a wider variety of fuel candidate types, specifically the class of furans and furan derivatives, by including specific molecules for the model to incorporate. The new molecules considered include tetrahydrofuran, 2-methylfuran, 2-methyltetrahydrofuran, 5,5'-(furan-2-ylmethylene)bis(2-methylfuran), 5,5'-((tetrahydrofuran-2-yl)methylene)bis(2-methyltetrahydrofuran), tris(5-methylfuran-2-yl)methane, and tris(5-methyltetrahydrofuran-2-yl)methane. Model architecture adjustments improved the overall root-mean-square error (RMSE) of the base database predictions by 5.54%. Additionally, through the targeted database expansion, it is shown that the predicted cetane number of the furan-based molecules improves on average by 49.21% (3.74 CN units) and significantly for a few of the individual molecules. This indicates that a selected subset of representative molecules can be used to extend the model's predictive accuracy to new molecular classes. The approach, bolstered by the improvements presented in this paper, enables chemists to focus on promising molecules by eliminating less favorable candidates in relation to their ignition quality.

09 BIOMASS FUELS↗

Overview of the OECD-NEA Working Party on International Nuclear Data Evaluation Cooperation (WPEC)

The OECD Nuclear Energy Agency (NEA) Working Party on International Nuclear Data Evaluation Cooperation (WPEC) was established in 1989 to facilitate collaboration in nuclear data activities. Over its thirty year history, different Subgroups have been created to address topics in nearly every aspect of nuclear data, including: experimental measurements, evaluation, validation, model development, quality assurance of databases and the development of software tools. WPEC has recently completed activities on fission yield evaluation, the general nuclear database structure (GNDS) to replace the ENDF-6 format, methods to provide feedback to evaluation, studies of specific capture cross sections, new methods in thermal scattering kernel evaluation and the Collaborative International Evaluated Library Organisation (CIELO) Pilot Project. Ongoing activities in GNDS application programming interface (API) development, methods for covariance evaluation and quality assurance in nuclear data validation using the International Criticality Safety Benchmark Evaluation Project (ICSBEP) database are complemented by the work of two Expert Groups that oversee the High-Priority Request List (HPRL) for Nuclear Data and the continuous development of the GNDS. New activities on the use of integral experiments for nuclear data validation and adjustment, as well as the use of the Shielding Integral Benchmark Archive and Database (SINBAD) for validation have begun and will be coordinated alongside future Subgroups. After three decades we will review the status of WPEC, how it integrates other collections and activities organised by the NEA and how it dovetails with the initiatives of the IAEA and other bodies to effectively coordinate international activities in nuclear data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

A Comprehensive Validation Methodology for Sparse Experimental Data

A comprehensive program of verification and validation has been undertaken to assess the applicability of models to space radiation shielding applications and to track progress as models are developed over time. The models are placed under configuration control, and automated validation tests are used so that comparisons can readily be made as models are improved. Though direct comparisons between theoretical results and experimental data are desired for validation purposes, such comparisons are not always possible due to lack of data. In this work, two uncertainty metrics are introduced that are suitable for validating theoretical models against sparse experimental databases. The nuclear physics models, NUCFRG2 and QMSFRG, are compared to an experimental database consisting of over 3600 experimental cross sections to demonstrate the applicability of the metrics. A cumulative uncertainty metric is applied to the question of overall model accuracy, while a metric based on the median uncertainty is used to analyze the models from the perspective of model development by analyzing subsets of the model parameter space.

Norman, Ryan B.↗

Characterization of the physical properties for solid granular materials

Accurate prediction of the behavior of a system is strongly governed by the components within that system. For multiphase systems incorporating solid powder-like particles, there are many different physical properties which need to be known to some level of accuracy for proper design, modeling, or data analysis. In the past, the material properties were determined initially as a secondary part of the study or design. In an attempt to provide results with the least level of uncertainty, a procedure was developed and implemented to provide consistent analysis of several different types of materials. The properties that were characterized included particle sizing and size distributions, shape analysis, density (particle, skeletal and bulk), minimum fluidization velocities, void fractions, particle porosity, and assignment within the Geldart Classification. In the methods used for this experiment, a novel form of the Ergun equation was used to determine the bulk void fractions and particle density. Materials of known properties were initially characterized to validate the accuracy and methodology, prior to testing materials of unknown properties. The procedures used yielded valid and accurate results, with a high level of repeatability. A database of these materials has been developed to assist in model validation efforts and future designs. It is also anticipated that further development of these procedures wil be expanded increasing the properties included in the database.

36 MATERIALS SCIENCE↗

Utilization of GIS technology to support development of flow and contaminant fate and transport models at US DOE sites - 15457

U.S. Department of Energy (DOE) sites have accumulated years of data and millions of spatial and temporal records related to the hydrological cycle, contaminant transport, and parameters of remediation technologies. In addition, numerical models which use field monitoring data to help understand flow and transport produce gigabytes of computed spatial and temporal data for each computation node. There is a need therefore for an advanced spatial data structure that can be used to address the management, processing, and analysis of spatial and temporal numerical modeling data derived from multiple sources. This can be accomplished using a geo-database. The development of an ArcSDE geo-database facilitates the centralized storage, backup, accessibility, organization, and management of model configuration and computed simulation data, putting it into a structured, coherent, and logical computer-supported system. GIS data processing and automation would enable faster and hence more complex analyses of field test data. The Applied Research Center (ARC) at Florida International University (FIU) has provided analysis of flow and transport for several watersheds at DOE's Oak Ridge Reservation (ORR), including East Fork Poplar Creek (EFPC), Upper EFPC in the Y-12 National Security Complex area (Y-12 NSC) and White Oak Creek (WOC). Integrated surface and subsurface flow, fate and transport models were developed to provide analysis of contaminant patterns within each watershed. In addition, digital monitoring data available from the Oak Ridge Environmental Information System (OREIS) related to mercury (Hg) contamination and remediation within these watersheds was used for calibration and verification of the model. Experimental studies were also carried out which provided kinetic and equilibrium data about important parameters related to Hg transport, speciation and methylation/demethylation kinetics within the watershed. Geographic Information Systems (GIS) technology was employed to support the modeling work through storage and geo-processing of spatial and temporal data required by the models and to produce hydrogeological maps for visualization. An ArcGIS geo-database was developed for centralized storage and management of experimental and computed model data and its capabilities were extended over the years using tools such as ModelBuilder combined with Python scripting to automate repetitive tasks, perform statistical analyses and generate maps and reports. The hydrologic geo-database model developed possesses a structure that enables linkage with scalable hydrologic modeling tools/applications to model hydrologic systems, and in this case, enables the testing of the potential impacts of various remediation scenarios on the ORR watersheds. The ArcSDE geo-database can also be used to automate and simplify the process of calling stored GIS and time series data. This geo-database can serve as a tool for contaminant flow and transport analyses which require large amounts of high-quality spatial and temporal data in order to ensure reliability and validity of modeling results. The existing geo-database structure developed for the hydrological modeling at ORR was designed to be replicable for application at other DOE sites. An investigation of downloadable free/open source GIS software along with required security protocols to facilitate online querying of the database was also conducted to determine methods by which project-derived data can be more easily shared with other project stakeholders such as DOE personnel and site contractors. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

UH-60A Airloads Flight Test Program: Data Counter 8513

The data collection portion of the UH-60A Airloads Flight Test Program was conducted between July 1993 and February 1994. At the time, the UH-60A Airloads Program was the most comprehensive and data-rich rotorcraft flight test program that NASA and the U.S. Army had ever attempted. It was part of the Modern Technology Rotors Program, where several different rotors were tested in small- and full-scale wind tunnels combined with flight testing. The UH-60A portion of this program allowed for comparison between other tests performed and served as a scientific quality database for validating current and new computational and simulation models. The UH-60A flight test data was stored in a comprehensive, easily accessed database known as the Tilt Rotor Engineering Database System, or TRENDS. With over 30 years of rotor testing experience, NASA and the Army’s goal of the Airloads Flight Test Program was to collect data for a wide range of operating conditions and provide an extensive amount of data to improve the understanding of rotors and validate and improve prediction codes. This report presents the entire archived data set from Counter 8513 (Run 85, point 13) from the UH-60A Airloads Flight Test Program. There were 1,078 total data set counters acquired and archived during 57 accumulated flight hours and 31 research flights. Over 900 counters were research flight data acquisition data points. Counter 8513 is a low-speed, level-flight test condition.

Kufeld, Robert M.↗

UH-60A Airloads Flight Test Program: Data Counter 9505

The data collection portion of the UH-60A Airloads Flight Test Program (ref. 1) was conducted between July 1993 and February 1994. At the time, the UH-60A Airloads Program was the most comprehensive and data-rich rotorcraft flight test program that NASA and the U.S. Army had ever attempted. It was part of the Modern Technology Rotors Program (ref. 2), where several different rotors were tested in small- and full-scale wind tunnels combined with flight testing. The UH-60A portion of this program allowed for comparison between other tests performed and served as a scientific quality database for validating current and new computational and simulation models. The UH-60A flight test data was stored in a comprehensive, easily accessed database known as the Tilt Rotor Engineering Database System, or TRENDS (ref. 3). With over 30 years of rotor testing experience (ref. 4), NASA and the Army’s goal of the Airloads Flight Test Program was to collect data for a wide range of operating conditions, and to provide an extensive amount of data to improve the understanding of rotors and validate and improve prediction codes. This report presents the entire archived data set from Counter 9505 (Run 95, point 5) from the UH-60A Airloads Flight Test Program. There were 1,078 total data set counters acquired and archived during 57 accumulated flight hours and 31 research flights. Over 900 counters were research flight data acquisition data points. Counter 9505 is a low altitude, moderate airspeed, level-flight test condition. Ground acoustic microphone data was acquired for this counter but the acoustic data is not included in this report.

Kufeld, Robert M.↗

PROTECT: Production and Reuse of Thermally Efficient Ceramic Thermal Protection Systems

PROTECT (Production and Reuse Of Thermally Efficient Ceramic TPS) is a NASA Early Career Initiative focused on developing the next generation of reusable ceramic thermal protection systems (TPS). This project addresses key challenges in TPS design, including temperature capability, thermal stability, and refurbishment time, by integrating novel material development with predictive modeling. Leveraging enhanced capabilities in NASA’s Porous Microstructure Analysis (PuMA) software, PROTECT introduces new modeling tools to predict the thermal and mechanical behavior of fibrous ceramic materials. These tools enable accurate prediction of performance metrics such as thermal conductivity and structural integrity, reducing reliance on costly physical testing. Preliminary advances in these areas will be presented. To support model validation, PROTECT is building a comprehensive database of raw material properties using advanced characterization techniques, including micro computed tomography (CT) scanning in collaboration with the University of Illinois Urbana-Champaign (UIUC). The presentation will detail the sampling workflows and analysis methods used to generate this detailed microstructural data and how it is used to develop improved models in PuMA. This multi-center collaboration, spanning NASA (JSC, ARC, KSC, GRC), Oak Ridge National Laboratory, UIUC, and SpaceX, is developing tailored TPS solutions for LEO, lunar, and Martian missions. By bridging heritage systems with the demands of modern spaceflight, PROTECT contributes to the advancement of reusable TPS technologies for future exploration missions.

Propulsion, Refractory, and Coating Materials↗