Search NASA⌕ Search

SEARCH · Search NASA

Results for “data base for model validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

Viscosities and working region predictions for bismuth aluminoborosilicate glasses

Bismuth aluminoborosilicate glasses were prepared using a standard melt-quench technique, and the viscosity and thermal properties were measured and analyzed. Electron microprobe analysis was used to examine glass homogeneity. Fragility was calculated based on Mauro–Yue–Ellison–Gupta–Allan model fits to the viscosity curves. The system is characterized by an open structure with high fragility (44-59). Based on microanalysis and differential scanning calorimetry results, the addition of network intermediate Al2O3 appears to mitigate both phase separation and crystallization. From thermal property data, mixture models were created to predict the glass transition temperatures and softening temperatures as functions of composition. Based on K-fold validation findings, the first-order mixture model predictions of glass transition and softening appear to approximate actual values better than models with any additional second-order terms.

Gardner, Levi↗

Probing ExoMiner for Effectiveness against False Alarms in Kepler Data

We present a study on the effectiveness of ExoMiner against False Alarms in Kepler data. ExoMiner is a deep learning model that was used to validate around 370 Kepler Objects of Interest. We follow the analysis conducted in Coughlin et al (2017) “DR25 Robovetter Completeness and Effectiveness” for Robovetter, a rule-based model used to vet TCEs for this data release and automatically generate the Q1-Q17 DR 25 KOI Table. The ExoMiner model is trained on observed transit data from Kepler Q1-Q17 DR25 and evaluated on Kepler inverted and scrambled data. The results provide a more comprehensive insight into the capacities and limitations of ExoMiner, especially the vetting of not-transit-like signals and, more generally, the use of deep learning models to model transit photometry data for vetting and validation purposes.

exoplanet↗

The Northwest Geysers EGS Demonstration Project, California. Pre-stimulation Modeling and Interpretation of the Stimulation

The Northwest Geysers Enhanced Geothermal System (EGS) demonstration project aims to create an EGS by directly and systematically injecting cool water at relatively low pressure into a known High Temperature (280–400 °C) Zone (HTZ) located under the conventional (240 °C) geothermal steam reservoir at The Geysers geothermal field in California. Here we report that , the results of coupled thermal, hydraulic, and mechanical (THM) analyses made using a model developed as part of the pre-stimulation phase of the EGS demonstration project is presented. The model simulations were conducted in order to investigate injection strategies and the resulting effects of cold-water injection upon the EGS system; in particular to predict the extent of the stimulation zone for a given injection schedule. The actual injection began on October 6, 2011, and in this paper a comparison of pre-stimulation model predictions with micro-earthquake (MEQ) monitoring data over the first few months of a one-year injection program is presented. The results show that, by using a calibrated THM model based on historic injection and MEQ data at a nearby well, the predicted extent of the stimulation zone (defined as a zone of high MEQ density around the injection well) compares well with observed seismicity. The modeling indicates that the MEQ events are related to shear reactivation of preexisting fractures, which is triggered by the combined effects of injection-induced cooling around the injection well and small changes in steam pressure as far as half a kilometer away from the injection well. Pressure-monitoring data at adjacent wells and satellite-based ground-surface deformation data were also used to validate and further calibrate reservoir-scale hydraulic and mechanical model properties. The pressure signature monitored from the start of the injection was particularly useful for a precise back-calculation of reservoir porosity. Ultimately, the first few months of reservoir pressure and surface deformation data were useful for estimating the reservoir-rock permeability and elastic modulus. Finally, although the extent of the calculated stimulation zone matches the field observations over the first few months of injection, the observed surface deformations and MEQ evolution showed more heterogeneous behavior as a result of more complex geology, including minor faults and fracture zones that are important for consideration in the analysis of energy production and the long-term evolution of the EGS system.

58 GEOSCIENCES↗

HED Hydrodynamics in the Common Modeling Framework

Within the Common Modeling Framework (CMF), the HED Hydrodynamics Project has implemented a common methodology, or "Authority", for modeling high energy density (HED) experiments by extending development of the Eulerian Applications Project code Authority, "EAPA," to include relevant physics models, customization tools and templates, and in situ and post-processing capabilities. Additionally, several models for small-scale HED experiments were successfully added to the CMF and simulations reproduce the results of preexisting, benchmarked input decks. We expect use of the CMF to improve our effectiveness in developing predictive capabilities for experiments ranging from small-scale planar single-interface, single-shock to multi-interface, multi-shock configurations and up through multi-shell inertial confinement fusion (ICF) implosions. Additionally, this will strengthen our ability to design future targeted experiments. Using the CMF infrastructure and Authorities for HED modeling has three key impacts. First, it enables a version-controlled, pedigreed and archived base model for each experiment with tools that allow easy setup, execution and analysis of simulations to assess and/or expose sensitivities to various parameters. Second, having a common base set of inputs and physics definitions helps identify systematic differences between models in the codes and experimental data to support code validation, and build confidence in our predictive capabilities. Finally, designed to work in concert with multiple programs and projects including PEM, IC, OES, V&V and DSW, the CMF supports improved collaboration and integration through shared model definitions, data, simulations and results, enhancing the workflow required to underwrite the knowledge base and capabilities ultimately required for stockpile stewardship

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Day-Ahead Probabilistic Forecasting of Net-Load and Demand Response Potentials with High Penetration of Behind-the-Meter Solar-plus-Storage

The goal of this project is to develop advanced methods for day-ahead net-load forecasting, by leveraging the state-of-the-art machine learning techniques. The developed models produce both point and probabilistic forecasts for a variety of use cases, and are versatile to work with different types of data sets. The innovation lies in the novel design of the architectures, leveraging the most recent advances in machine learning that have not been explored in power systems, accompanied by techniques in the broader artificial intelligence fields such as fuzzy systems. This project has achieved the following accomplishments: (1) preprocessing of over 10 data sets covering varying geographical regions, time horizons, and system levels, which form a robust foundation for training and evaluating forecasting models across a wide range of realistic grid scenarios; (2) development of an interactive web app that enables exploratory analysis of load and generation data, and supports better understanding of data trends, anomalies, and correlations, facilitating model development and stakeholder engagement; (3) implementation of over 10 benchmark models for point and probabilistic forecasting, which include a mix of conventional machine learning methods and state-of-the-art deep learning approaches, providing a comprehensive baseline for performance comparison and validation of the proposed models; (4) development of a fuzzy system based gradient boosting model, tailored for small (less than 3 years) data sets, which achieves a mean absolute percentage error (MAPE) of 4% for point forecasting and a 20% improvement in average pinball loss for probabilistic forecasting; (5) development of a Transformer (a state-of-the-art deep learning architecture) based neural network model, tailored for large (3 years or more) data sets, which achieves a MAPE of 2% for point forecasting and a 20% improvement in average pinball loss for probabilistic forecasting; (6) development of a methodology for quantifying DR potential, and extensions of the previous models for multi-target forecasting of net load and DR potential, which achieve a MAPE of 10% for DR potential.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Autonomous control for Heat-Pipe microreactor using Data-Driven model predictive control

To enable a self-regulating capability for heat pipe (HP) microreactors, an anticipatory control strategy achieved via model predictive control (MPC) could proactively respond to potential disturbances and deviations in operating setpoints. This paper demonstrates data-driven methods for predicting the distribution and transient of temperatures and heat fluxes at selected components and regions in a 37-HP system, based on which the optimal control actions in response to changes in user-defined setpoints can be found. We present the development and validation of linear state-space model, feedfoward, and recurrent neural networks. Here, we compare the performance of MPCs with different modeling approaches in terms of following setpoints for temperatures and averaged output heat fluxes. The accuracies of the three data-driven models are similar, but the control actions initiated by neural-network-based MPC can better adapt to drastic changes in setpoints yet generate the smallest errors.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Data-Driven Wind Farm Optimization Incorporating Effects of Turbulence Intensity

We demonstrate assimilation of field data from a nacelle-mounted lidar and meteorological tower into a medium-fidelity Reynolds-Averaged Navier Stokes wind farm flow model to better predict the effects of atmospheric stability. Increased predictability under a variety of atmospheric conditions can lead to more effective control design and optimization of a wind farm. In particular, atmospheric stability affects wind turbine wake propagation and, therefore, aspects of wind farm control and performance, such as active wind farm control, layout optimization, and power output. Accurately modeling wakes in different stability conditions remains a persistent challenge. This paper presents an optimization framework that leverages high-fidelity field or simulation data to correct a lower-fidelity flow model. Optimal model corrections are found by solving a regularized, high-dimensional, gradient-based optimization problem using adjoint flowfield information. We validate the trained model against large eddy simulation results, and perform separate gradient-based layout optimizations of a simulated utility-scale wind farm to maximize power. Using the data-driven model corrections, we find that atmospheric stability significantly impacts layout optimization and power production: the optimal layout for stable conditions produced 9.1% more power than the optimal layout for unstable conditions, and the optimal layout for neutral conditions underperformed by 8.5% in unstable conditions.

17 WIND ENERGY↗

A framework for assessment of predictive capability maturity and its application in nuclear thermal hydraulics

Here this work presents a formalized and computerized framework for the assessment of decision regarding the adequacy of a simulation tool for a nuclear reactor application. The decision regarding a code’s adequacy for an application is dependent on the assessment of different attributes that govern verification, validation, and uncertainty quantification of the code. In this work, the focus is on code validation. Therefore, the framework is developed and illustrated from the perspective of decision regarding the validation assessment of a code. Code validation assessment is performed based on the validation test results, data applicability, and process quality assurance factors. The process quality assurance factors warrant the trustworthiness of the evidence and help in checking people and process compliance with respect to the standard requirements. The proposed framework is developed using an argument modeling technique called Goal Structuring Notation (GSN). Goal structuring notation facilitates structural knowledge representation, information abstraction, evidence incorporation, and provides a skeletal structure for quantitative maturity assessment. The decision schema for the development of the decision model is based on the Predictive Capability Maturity Model (PCMM) and Analytic Hierarchy Process (AHP) and formalized using Goal structuring notation. Each decision attribute is formulated as a claim, where the degree of validity of the claim (attribute’s assessment) is expressed using different maturity levels. The GSN representation of the decision model is transformed into a confidence network to provide evidence-based quantitative maturity assessment using the Bayesian network. A metric based on the expected utility of maturity levels, called expected distance metric, is proposed to measure the distance between target maturity and achieved maturity on a scale of zero to one. Expected distance metric helps in comparing the assessment of different attributes and identification of major areas of concern in terms of modeling capability, data needs, and quality of assessment process. The practical application of the framework is demonstrated by a case study on validation assessment of a thermal-hydraulic code for a challenge problem called Departure from Nucleate Boiling (DNB).

42 ENGINEERING↗

A Technology Pathway for Airbreathing, Combined-Cycle, Horizontal Space Launch Through SR-71 Based Trajectory Modeling

Access to space is in the early stages of commercialization. Private enterprises, mainly under direct or indirect subsidy by the government, have been making headway into the LEO launch systems infrastructure, of small-weight-class payloads of approximately 1000 lbs. These moderate gains have emboldened the launch industry and they are poised to move into the middle-weight class (roughly 5000 lbs). These commercially successful systems are based on relatively straightforward LOX-RP, two-stage, bi-propellant rocket technology developed by the government 40 years ago, accompanied by many technology improvements. In this paper we examine a known generic LOX-RP system with the focus on the booster stage (1st stage). The booster stage is then compared to modeled Rocket-Based and Turbine-Based Combined Cycle booster stages. The air-breathing propulsion stages are based on/or extrapolated from known performance parameters of ground tested RBCC (the Marquardt Ejector Ramjet) and TBCC (the SR-71/J-58 engine) data. Validated engine models using GECAT and SCCREAM are coupled with trajectory optimization and analysis in POST-II to explore viable launch scenarios using hypothetical aerospaceplane platform obeying the aerodynamic model of the SR-71. Finally, and assessment is made of the requisite research technology advances necessary for successful commercial and government adoption of combined-cycle engine systems for space access.

Kloesel, Kurt J.↗

The Source Physics Experiment (SPE) Science Plan (Version 2.4c)

The Source Physics Experiment (SPE) series is a long-term NNSA research and development effort designed to improve U.S. arms control and nuclear nonproliferation verification and monitoring capabilities. The findings from the SPE will advance the United States’ nuclear explosion monitoring capabilities, particularly with respect to detection, discrimination and determination of yields associated with small nuclear explosions that can be lost amid the noisy seismo-acoustic background from other sources. The data generated from the SPE, a series of well-designed and recorded chemical explosions, will contribute to the development and validation of first-principles explosive source generated seismo-acoustic modeling codes. These codes will then facilitate the update of semi-empirical methods, currently based on historic test site data, such that key explosion observables can be reproduced, thus improving confidence in nuclear test monitoring in new areas and/or under novel emplacement conditions. The overall SPE project is comprised of both the development of the new explosion simulation codes and the chemical explosion test series. The chemical explosion test series will generate the empirical data required to both develop and validate the new simulation codes.

58 GEOSCIENCES↗

The Source Physics Experiment (SPE) Science Plan

The Source Physics Experiment (SPE) series is a long-term NNSA research and development effort designed to improve U.S. arms control and nuclear nonproliferation verification and monitoring capabilities. The findings from the SPE will advance the United States’ nuclear explosion monitoring capabilities, particularly with respect to detection, discrimination and determination of yields associated with small nuclear explosions that can be lost amid the noisy seismo-acoustic background from other sources. The data generated from the SPE, a series of well-designed and recorded chemical explosions, will contribute to the development and validation of first-principles explosive source generated seismo-acoustic modeling codes. These codes will then facilitate the update of semi-empirical methods, currently based on historic test site data, such that key explosion observables can be reproduced, thus improving confidence in nuclear test monitoring in new areas and/or under novel emplacement conditions. The overall SPE project is comprised of both the development of the new explosion simulation codes and the chemical explosion test series. The chemical explosion test series will generate the empirical data required to both develop and validate the new simulation codes.

58 GEOSCIENCES↗

System Level Analysis Software Validation with Argonne's THETA Experimental Facility (Final CRADA Report)

Under this CRADA, the Contractor will be generating and collecting sodium-based experimental data with modern instrumentation. The Contractor will work symbiotically with the Participant to generate SAS4A/SASSYS-1 and SAM computational models of the THETA experimental facility for validation of the system-level analysis codes utilized by Oklo, Inc. This effort will be specifically focused on the design basis event space scoped by Chapter 15 of the NRC’s Standard Review Plan (NUREG-0800) with an emphasis on natural circulation and thermal stratification phenomena in a prototypic sodium-cooled fast reactor (SFR).

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

The role of surface forces in environment-enhanced cracking of brittle solids

Fracture initiation and propagation in brittle materials is promoted in surface-reactive (sorptive) environments, a phenomenon known as subcritical crack growth (SCG). Laboratory measured crack-propagation velocity vs. stress intensity factor relationships typically exhibit highly nonlinear, multi-stage characteristics that are sensitive to environmental factors such as adsorbate concentration and temperature. For practical purposes, empirical relationships (e.g., a power law) have been used to describe this complex phenomenon. However, how the overall SCG behavior emerges from the underlying fundamental processes near the crack tip, such as the interaction of the crack surfaces separated by only a few nanometers and mass transport within the nano-confined space, is still not well understood. This paper develops a mechanistic, surface-force-based fracture theory (SFFT) which integrates surface force models, fluid transport models, and linear elastic fracture mechanics to quantitatively explain the multi-stage characteristics of SCG in brittle solids. A numerical model is developed based on SFFT and solved through an implicit partitioned scheme for efficiency and modularity. The results are validated by Wiederhorn's data on crack propagation in soda-lime glasses at a wide range of relative humidity levels. We show that, for the first time, the entire range of an SCG curve can be captured by a single physics-based model. The predicted SCG curves reveal that the development of repulsive disjoining pressure behind the crack tip can be responsible for the reduced apparent fracture toughness in a sorptive environment. In conclusion, the shape of the SCG curve, and its changes with respect to the environment, is found to critically depend on the assumed transport models.

36 MATERIALS SCIENCE↗

Short-lead seasonal precipitation forecast in northeastern Brazil using an ensemble of artificial neural networks

This study assesses the deterministic and probabilistic forecasting skill of a 1-month-lead ensemble of Artificial Neural Networks (EANN) based on low-frequency climate oscillation indices. The predictand is the February-April (FMA) rainfall in the Brazilian state of Ceará, which is a prominent subject in climate forecasting studies due to its high seasonal predictability. Additionally, the study proposes combining the EANN with dynamical models into a hybrid multi-model ensemble (MME). The forecast verification is carried out through a leave-one-out cross-validation based on 40 years of data. The EANN forecasting skill is compared with traditional statistical models and the dynamical models that compose Ceará’s operational seasonal forecasting system. A spatial comparison showed that the EANN was among the models with the smallest Root Mean Squared Error (RMSE) and Ranked Probability Score (RPS) in most regions. Moreover, the analysis of the area-aggregated reliability showed that the EANN is better calibrated than the individual dynamical models and has better resolution than Multinomial Logistic Regression for above-normal (AN) and below-normal (BN) categories. It is also shown that combining the EANN and dynamical models into a hybrid MME reduces the overconfidence of the extreme categories observed in a dynamically-based MME, improving the reliability of the forecasting system.

54 ENVIRONMENTAL SCIENCES↗

A Monte Carlo Approach to Modeling the Breakup of the Space Launch System EM-1 Core Stage with an Integrated Blast and Fragment Catalogue

The Liquid Propellant Fragment Overpressure Acceleration Model (L-FOAM) is a tool developed by Bangham Engineering Incorporated (BEi) that produces a representative debris cloud from an exploding liquid-propellant launch vehicle. Here it is applied to the Core Stage (CS) of the National Aeronautics and Space Administration (NASA) Space Launch System (SLS launch vehicle). A combination of Probability Density Functions (PDF) based on empirical data from rocket accidents and applicable tests, as well as SLS specific geometry are combined in a MATLAB script to create unique fragment catalogues each time L-FOAM is run-tailored for a Monte Carlo approach for risk analysis. By accelerating the debris catalogue with the BEi blast model for liquid hydrogen / liquid oxygen explosions, the result is a fully integrated code that models the destruction of the CS at a given point in its trajectory and generates hundreds of individual fragment catalogues with initial imparted velocities. The BEi blast model provides the blast size (radius) and strength (overpressure) as probabilities based on empirical data and anchored with analytical work. The coupling of the L-FOAM catalogue with the BEi blast model is validated with a simulation of the Project PYRO S-IV destruct test. When running a Monte Carlo simulation, L-FOAM can accelerate all catalogues with the same blast (mean blast, 2 σ blast, etc.), or vary the blast size and strength based on their respective probabilities. L-FOAM then propagates these fragments until impact with the earth. Results from L-FOAM include a description of each fragment (dimensions, weight, ballistic coefficient, type and initial location on the rocket), imparted velocity from the blast, and impact data depending on user desired application. LFOAM application is for both near-field (fragment impact to escaping crew capsule) and far-field (fragment ground impact footprint) safety considerations. The user is thus able to use statistics from a Monte Carlo set of L-FOAM catalogues to quantify risk for a multitude of potential CS destruct scenarios. Examples include the effect of warning time on the survivability of an escaping crew capsule or the maximum fragment velocities generated by the ignition of leaking propellants in internal cavities.

Richardson, Erin↗

RANS simulations of neutral atmospheric boundary layer flow over complex terrain with comparisons to field measurements

Micro-scale Reynolds-averaged Navier-Stokes (RANS) simulations of the neutral atmospheric boundary layer (ABL) over complex terrain and a comparison of the results with conditionally averaged met-tower data are presented. A robust conditional sampling procedure for the meteorological tower (met-tower) data to identify near-neutral conditions based on a criterion for the turbulence intensity is developed. The conditionally averaged wind data on 14 met-towers are used for the model validation. The ABL flow simulations are conducted over complex terrain which includes a prominent hill using the OpenFOAM-based simulator for on/offshore wind farm applications (SOWFA) with the k-ϵ and the SST k-ω turbulence models. The discretization of the production term in the transport equation for the turbulent kinetic energy (TKE) is modified to greatly reduce the commonly observed nonphysical near surface TKE peak. The driving inflow is generated through an iterative approach using a precursor method to reproduce the measured wind statistics at the reference tower. Both of the RANS models are able to capture the flow behavior windward of the hill. The SST k-ω model predicts more intense flow separation than the k-ϵ model downstream of the steepest sections of the hill. The wind statistics predicted at the location of the met-towers by both of the RANS models are fairly consistent. Overall, the comparisons of the direction, mean, and standard deviation of the wind between the simulations and the tower data show reasonable agreement except for the differences of the mean wind speeds at four met-towers located closer to the main ridge of the hill in a region of strong terrain variations.

17 WIND ENERGY↗

MOOSE-based Tritium Migration Analysis Program, Version 8 (TMAP8) for advanced open-source tritium transport and fuel cycle modeling

Tritium management is critical for the safety, sustainability, and economics of fusion energy systems, and advanced and reliable modeling tools help accelerate the development of tritium technologies. This paper presents the Tritium Migration Analysis Program, Version 8 (TMAP8), an open-source, MOOSE-based application developed to provide state-of-the-art tritium transport and fuel cycle modeling capabilities. TMAP8 aims to expand the capabilities of previous versions (i.e., TMAP4 and TMAP7) by leveraging modern computational techniques, ensuring high software quality assurance standards (key to building trust), and enabling multispecies, multiscale, and multiphysics simulations for integrated tritium transport modeling in complex geometries. This paper outlines TMAP8’s scope and rigorous development practices, emphasizing its transparency, accessibility, modularity, and reliability. We present the current suite of verification and validation cases based on those from TMAP4, demonstrating TMAP8’s accuracy and reliability against analytical solutions and experimental data. Additionally, the paper showcases TMAP8’s integrated fuel cycle modeling capabilities, highlighting its applicability at various scales and levels. The TMAP8 code and documentation are openly available, promoting collaborative development and widespread adoption within the fusion community. Future work will soon expand TMAP8’s verification and validation suite to include those from TMAP7 and other recent experimental studies for validation.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗