Search NASA⌕ Search

SEARCH · Search NASA

Results for “model credibility”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Deterministic Calibration of MFiX-PIC, Part 1: Settling Bed

The Particle-in-cell (PIC) numerical approach for modeling granular solids in fluid flow has gained significant interest in recent years. Valued for its often shorter time-to-solution, the PIC formulation relies on modeling statistical groupings of particles called parcels in cooperation with a solids stress model to affect local solids velocity. This is in contrast to the discrete element model (DEM) where every particle in a system is modelled individually and directly coupled to local solids velocity through Newtonian mechanics. The U.S. Department of Energy (DOE), National Energy Technology Laboratory (NETL) develops and maintains Multiphase Flow with Interphase eXchanges (MFiX), a collection of open-source computational fluid dynamics (CFD) solvers. Included in the MFiX suite are traditional two-fluid model (TFM) and DEM solvers, and a recently added PIC solver (NETL, 2021). In general, PIC methodologies offer an accuracy trade-off in lieu of computational speed; and therefore, it is important to assess the credibility of MFiX-PIC simulations. For this purpose, a systematic verification, validation and uncertainty quantification (VVUQ) effort was initiated at NETL to assess the new PIC solver

42 ENGINEERING↗
DOE OSTI2022

Effects of Chlorine Capture and a Proposed Density Law on the Reactivity of Plutonium Solution Systems

During fissionable material processing, all normal and credible abnormal conditions must remain safely subcritical. Nuclear Criticality Safety (NCS) uses a number of methods to determine subcriticality, one of which is the use of neutron transport codes such as MCNP6. In order to create models for use with MCNP6, both the geometry and materials in fissionable material processes must be known, or assumptions must be made and quantified for the impact to bias. One of the systems with a significant amount of bias due to material modeling assumptions is in the area of aqueous plutonium processing. These solutions are typically plutonium nitrate solutions or plutonium chloride solutions, which are modeled as fictitious plutonium metal-water mixtures because little is known about the actual density of the solution and there is no current predictive capability approved for use at Los Alamos National Laboratory (LANL) for modeling them. This research is currently underway to fill the gap and develop an algorithm for use with MCNP6 to model the density of plutonium chloride solutions. The method is to be validated with experimental data for density, and also validated with critical experiments using MCNP6. Note that the Chlorine Worth Study (CWS) was performed in December 2021 to help bridge the gap in chlorine data for critical experiments, and is currently awaiting International Criticality Safety Benchmark Evaluation Project (ICSBEP) review. This study was performed by LANL at the National Criticality Experiments Research Center (NCERC) at the Nevada National Security Site (NNSS). Additional information regarding this experiment may currently be found in LA-UR- 22-29180. Additionally, the Chemistry-Actinide Analytical Chemistry (C-AAC) at LANL has performed a number of solution density measurements for PuCl 3 -HC 1 -H 2 O, allowing for such data be used to create a semi-empirical density via the Pitzer method. The published dataset for the measurements is documented in LA-UR-22-25454. This method has already been tested successfully for aqueous plutonium nitrate solutions in SCALE. Current solution density measurements exist of plutonium concentrations of 0-~142g/L, all at 2M HC1, at temperatures 20-40°C. Additional data was taken for HC1-corrected density values, which essentially mimics the data for a pure PuCl x -water solution. The calculations in this report aim to support the current research by demonstrating the difference in system reactivity for the current modeling method when compared to the new proposed modeling with a density law implementation, which is being written as a Python tool to be used with MCNP6.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
NASA NTRS2007

Modeling and Optimization for Morphing Wing Concept Generation

This report consists of two major parts: 1) the approach to develop morphing wing weight equations, and 2) the approach to size morphing aircraft. Combined, these techniques allow the morphing aircraft to be sized with estimates of the morphing wing weight that are more credible than estimates currently available; aircraft sizing results prior to this study incorporated morphing wing weight estimates based on general heuristics for fixed-wing flaps (a comparable "morphing" component) but, in general, these results were unsubstantiated. This report will show that the method of morphing wing weight prediction does, in fact, drive the aircraft sizing code to different results and that accurate morphing wing weight estimates are essential to credible aircraft sizing results.

Skillen, Michael D.↗
NASA NTRS1986

An experiment in software reliability

The results of a software reliability experiment conducted in a controlled laboratory setting are reported. The experiment was undertaken to gather data on software failures and is one in a series of experiments being pursued by the Fault Tolerant Systems Branch of NASA Langley Research Center to find a means of credibly performing reliability evaluations of flight control software. The experiment tests a small sample of implementations of radar tracking software having ultra-reliability requirements and uses n-version programming for error detection, and repetitive run modeling for failure and fault rate estimation. The experiment results agree with those of Nagel and Skrivan in that the program error rates suggest an approximate log-linear pattern and the individual faults occurred with significantly different error rates. Additional analysis of the experimental data raises new questions concerning the phenomenon of interacting faults. This phenomenon may provide one explanation for software reliability decay.

Dunham, J. R.↗
DOE OSTI2020

Risk-Informed MultiPphysics BestEestimate Plus Uncertainties (BEPU) Application Development of RELAP5-3D Perturbation Model

The United States nuclear industry is facing a strong challenge to ensure maximum safety while enhancing economic benefit. Safety is a key parameter to all aspects related to light water reactor (LWR) nuclear power plants (NPPs), especially cost savings. Since the goal is to extend the lifetimes of these NPPs, the traditional deterministic safety concept may not guarantee a current economic asset. The Light Water Reactor Sustainability (LWRS) Program has been promoting a wide range of research and development (R&D) in this field to maximize the safety, economics, and performance of these NPPs through improved scientific understanding. One of the best practices to achieve this goal is to identify and optimize safety margins, which can lead to cost reduction. To do this, under the LWRS framework, the Risk-Informed Systems Analysis (RISA) Pathway will focus on the optimization of safety margin and minimization of uncertainties to ensure both safety and economics at the highest level. The RISA Pathway will provide enhanced capabilities for analyzing and characterizing LWR systems performance by developing and demonstrating methods, tools, and data to enable risk-informed margins management (RIMM). The goals of the RISA Pathway are twofold: (1) deploy the risk-informed tools and methods that enable better representation of safety margins and factors that contribute to cost and safety; and (2) conduct advanced risk assessment applications with industry to support margin management strategies that enable more cost-effective plant operation. The tools and methods provided by the RISA Pathway will support effective margin management for both active and passive safety systems, structures, and components (SSC) of an NPP. The tools and methods used in the RISA Pathway should have high confidence and highest technical maturity for and implementation to industry at its current setting. They should also have a capability to support risk-informed decision making for both probabilistic and deterministic elements of safety. The RISA Pathway will, therefore, perform a comprehensive assessment of verification and validation (V&V) status of RISA Toolkit to enhance credibility RISA Toolkit which be used by industry. This report summarizes RELAP5-3D development activities for best estimated and uncertainty (BEPU) capability to support ongoing RISA Pathway pilot projects for risk informed uncertainty quantification applications. Work scope includes (1) development of initial perturbation model for selected closure laws and (2) testing of suitable probability distribution functions (PDF) for the selected correlations. Developed BEPU modules are tested with selected separate effect cases and compared with conventional thermal-hydraulics model.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
NASA NTRS1989

Modeling 2-D jets impinging on Stirling regenerators

The extent to which flow leaving Stirling coolers or heaters in the form of high-velocity jets penetrate the regenerator matrix is visually modeled using a computer program. Two-dimensional laminar jets are shown impinging on regenerator samples of variable permeability ranging from no matrix at all to matrices dense enough to stop the jet dead on. The results lend credibility to a simple tension for flow uniformity as a function of penetration depth.

Gedeon, David↗
NASA NTRS2021

Evolution of Tropical Cyclone Properties Across the Development Cycle of the GISS-E3 Global Climate Model

The next-generation global climate model from the NASA Goddard Institute for Space Studies, GISS-E3, contains many improvements to resolution and physics that allow for improved representation of tropical cyclones (TCs) in the model. This study examines the properties of TCs in two different versions of E3 at different points in its development cycle, run for 20 years at 0.5 degree resolution, and compares these TCs with observations, the previous generation GISS model, E2, and other climate models. E3 shares many TC biases common to global climate models, such as having too few tropical cyclones, but is much improved from E2. E3 produces strong enough TCs that observation-based wind speed thresholds can now be used to detect and track them, and some storms now reach hurricane intensity; neither of these was true of E2. Model development between the first and second versions of E3 further increased the number and intensity of TCs and reduced TC count biases globally and in most regions. One-year sensitivity tests to changes in various microphysical and dynamical tuning parameters are also examined. Increasing the entrainment rate for the more strongly-entraining plume in the convection scheme increases the number of TCs (though also affecting other climate variables, and in some cases increasing biases). Variations in divergence damping did not have a strong effect on simulated TC properties, contrary to expectations based on previous studies. Overall, the improvements in E3 make it more credible for studies of TC activity and its relationship to climate.

Tropical Cyclones↗
NASA NTRSDate not supplied

Advancing Open Science in Atmospheric Research: Integrating Data Usability and Machine Learning

In the dynamic realm of atmospheric sciences, the convergence of data science methodologies and open data marks a transformative era, driving research advancements and nurturing aspiring scientists. This abstract highlights two pivotal projects that epitomize open science principles, aligning seamlessly with the session's objective of interdisciplinary synergy and the cultivation of emerging talent. As a NASA-certified data center, our foremost endeavor focuses on enhancing the visibility and traceability of NASA datasets within atmospheric science research. This initiative not only elevates these datasets' prominence but also establishes a robust framework ensuring their credibility in scholarly discourse. By bridging the gap between data sources and research publications, this project serves as an educational catalyst, nurturing a new generation of scholars in open collaboration and dataset authenticity. Concurrently, our second project pioneers an early warning system for flooding events, utilizing machine learning algorithms to predict flooded fractions. Through multi-source data fusion and predictive modeling, this initiative goes beyond forecasting; it embodies the core of open science by enabling proactive risk mitigation strategies. This project not only advances atmospheric sciences but also fosters an environment where young scholars engage in practical, data-driven solutions. These intertwined projects exemplify the fusion of data science with open data solutions, ensuring both the usability of quality datasets and the cultivation of scientific knowledge among emerging scholars. By spotlighting these impactful use cases, our aim is to foster discussions emphasizing the importance of open collaboration, data integrity, and the nurturing of scientific talent in atmospheric sciences." "In the dynamic realm of atmospheric sciences, the convergence of data science methodologies and open data marks a transformative era, driving research advancements and nurturing aspiring scientists. This abstract highlights two pivotal projects that epitomize open science principles, aligning seamlessly with the session's objective of interdisciplinary synergy and the cultivation of emerging talent. As a NASA-certified data center, our foremost endeavor focuses on enhancing the visibility and traceability of NASA datasets within atmospheric science research. This initiative not only elevates these datasets' prominence but also establishes a robust framework ensuring their credibility in scholarly discourse. By bridging the gap between data sources and research publications, this project serves as an educational catalyst, nurturing a new generation of scholars in open collaboration and dataset authenticity. Concurrently, our second project pioneers an early warning system for flooding events, utilizing machine learning algorithms to predict flooded fractions. Through multi-source data fusion and predictive modeling, this initiative goes beyond forecasting; it embodies the core of open science by enabling proactive risk mitigation strategies. This project not only advances atmospheric sciences but also fosters an environment where young scholars engage in practical, data-driven solutions. These intertwined projects exemplify the fusion of data science with open data solutions, ensuring both the usability of quality datasets and the cultivation of scientific knowledge among emerging scholars. By spotlighting these impactful use cases, our aim is to foster discussions emphasizing the importance of open collaboration, data integrity, and the nurturing of scientific talent in atmospheric sciences.

Jennifer Wei↗
DOE OSTI2024

DAWN: Dashboard for Agricultural Water Use and Nutrient Management—A Predictive Decision Support System to Improve Crop Production in a Changing Climate

Abstract Climate change presents huge challenges to the already-complex decisions faced by U.S. agricultural producers, as seasonal weather patterns increasingly deviate from historical tendencies. Under USDA funding, a transdisciplinary team of researchers, extension experts, educators, and stakeholders is developing a climate decision support Dashboard for Agricultural Water use and Nutrient management (DAWN) to provide Corn Belt farmers with better predictive information. DAWN’s goal is to provide credible, usable information to support decisions by creating infrastructure to make subseasonal-to-seasonal forecasts accessible. DAWN uses an integrated approach to 1) engage stakeholders to coproduce a decision support and information delivery system; 2) build a coupled modeling system to represent and transfer holistic systems knowledge into effective tools; 3) produce reliable forecasts to help stakeholders optimize crop productivity and environmental quality; and 4) integrate research and extension into experiential, transdisciplinary education. This article presents DAWN’s framework for integrating climate–agriculture research, extension, and education to bridge science and service. We also present key challenges to the creation and delivery of decision support, specifically in infrastructure development, coproduction and trust building with stakeholders, product design, effective communication, and moving tools toward use.

Meteorology & Atmospheric Sciences↗
NASA NTRS2018

Comparison of the Integrated Medical Model Predictions to Real World ISS and STS Observations

The Human Research Program funded the development of the integrated medical model (IMM) to quantify the medical component of overall mission risk. The IMM uses Monte Carlo methodology to integrate space flight and ground medical data to assess the probability of mission medical outcomes and resource utilization. To determine the credibility of IMM output the IMM project team completed two validation studies that compare IMM output to observed medical events from a selection of Shuttle Transportation System (STS) and International Space Station (ISS) missions.

validation↗
DOE OSTI2020

MFNets: Multifidelity data-driven networks for Bayesian learning and prediction

This paper presents a multifidelity uncertainty quantification framework called MFNets. We seek to address three existing challenges that arise when experimental and simulation data from different sources are used to enhance statistical estimation and prediction with quantified uncertainty. Specifically, we demonstrate that MFNets can (1) fuse heterogeneous data sources arising from simulations with different parameterizations, e.g simulation models with different uncertain parameters or data sets collected under different environmental conditions; (2) encode known relationships among data sources to reduce data requirements; and (3) improve the robustness of existing multi-fidelity approaches to corrupted data. MFNets construct a network of latent variables (LVs) to facilitate the fusion of data from an ensemble of sources of varying credibility and cost. These LVs are posited as explanatory variables that provide the source of correlation in the observed data. Furthermore, MFNets provide a way to encode prior physical knowledge to enable efficient estimation of statistics and/or construction of surrogates via conditional independence relations on the LVs. We highlight the utility of our framework with a number of theoretical results which assess the quality of the posterior mean as a frequentist estimator and compare it to standard sampling approaches that use single fidelity, multilevel, and control variate Monte Carlo estimators. We also use the proposed framework to derive the Monte Carlo-based control variate estimator entirely from the use of Bayes rule and linear-Gaussian models -- to our knowledge the first such derivation. Finally, we demonstrate the ability to work with different uncertain parameters across different models.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2002

Life Cycle Systems Engineering Approach to NASA's 2nd Generation Reusable Launch Vehicle

The overall goal of the 2nd Generation RLV Program is to substantially reduce technical and business risks associated with developing a new class of reusable launch vehicles. NASA's specific goals are to improve the safety of a 2nd- generation system by 2 orders of magnitude - equivalent to a crew risk of 1 -in- 10,000 missions - and decrease the cost tenfold, to approximately $1,000 per pound of payload launched. Architecture definition is being conducted in parallel with the maturating of key technologies specifically identified to improve safety and reliability, while reducing operational costs. An architecture broadly includes an Earth-to-orbit reusable launch vehicle, on-orbit transfer vehicles and upper stages, mission planning, ground and flight operations, and support infrastructure, both on the ground and in orbit. The systems engineering approach ensures that the technologies developed - such as lightweight structures, long-life rocket engines, reliable crew escape, and robust thermal protection systems - will synergistically integrate into the optimum vehicle. Given a candidate architecture that possesses credible physical processes and realistic technology assumptions, the next set of analyses address the system's functionality across the spread of operational scenarios characterized by the design reference missions. The safety/reliability and cost/economics associated with operating the system will also be modeled and analyzed to answer the questions "How safe is it?" and "How much will it cost to acquire and operate?" The systems engineering review process factors in comprehensive budget estimates, detailed project schedules, and business and performance plans, against the goals of safety, reliability, and cost, in addition to overall technical feasibility. This approach forms the basis for investment decisions in the 2nd Generation RLV Program's risk-reduction activities. Through this process, NASA will continually refine its specialized needs and identify where Defense and commercial requirements overlap those of civil missions.

Thomas, Dale↗
DOE OSTI2023

Automated Credibility Assessments of User Features in Scientific Software

Scientific software (SciSoft) is complex, often containing a mixture of production capabilities co-mingled with features under active research and development. Furthermore, SciSoft is often developed over decades by non-computer scientists who may not have a strong background in or prioritize software architecture design, testing, and quality (e.g., test coverage). These conditions lead to difficulty in understanding which software components or functions implement what user-facing features and therefore those features’ software quality pedigree. This lack of understanding poses challenges in assessing readiness and credibility of user features, and often relies on a SciSoft subject matter expert’s (SME) laborious investigation and assertion. This final report of a one-year Computing and Information Sciences Lab Directed Research and Development project presents a general framework for modeling SciSoft architecture as a direct relationship between user features and the software components/functions that implement them. Our approach leverages automated labeling of the SciSoft’s regression test suite and employs machine learning algorithms to construct the architecture model. We demonstrate this framework on the Solid Mechanics component of the SIERRA multi-physics engineering analysis suite developed at Sandia National Laboratories.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Organic Rankine Cycle Integration and Optimization for High Efficiency CHP Genset Systems (Final Technical Report)

This project successfully advanced the integration of Organic Rankine Cycle (ORC) technology with reciprocating engine–based combined heat and power (CHP) systems to improve electrical efficiency, total CHP efficiency, and grid-responsive operation. Over three budget periods, the work progressed from high-temperature ORC component development and thermodynamic model validation to next-generation system design, working fluid transition, and techno-economic analysis. Key technical accomplishments include development and validation of a thermodynamic model capable of accurately predicting ORC performance across an expanded temperature and pressure envelope; successful identification and validation of low-global-warming-potential (GWP) working fluids—most notably R1233zd(E)—as viable replacements for R245fa; and demonstration of scalable ORC architectures suitable for integration with 1–20 MW class reciprocating engines. These advances enable flexible CHP configurations that can increase electrical output while maintaining high overall utilization of available thermal energy. The project also produced a clean-sheet design for a next-generation ORC system targeting substantially higher power output per unit, supported by detailed component selection, heat exchanger evaluation, and system-level modeling. Techno-economic analyses indicate that ORC-enabled flexible CHP systems can meet or exceed Department of Energy (DOE) efficiency targets while providing value to both facility operators and the electric grid.. Late-stage testing of the largest next-generation ORC prototype identified limitations related to pump net positive suction head (NPSH) requirements and condenser flooding under certain operating conditions. Although these issues constrained full validation of that configuration within the project timeframe, they provided clear and actionable design guidance for future system refinements. Importantly, validated modeling, smaller-scale testing, and working fluid evaluations confirmed the technical viability of the overall approach. In aggregate, this project met its core objectives by establishing validated design tools, de-risking key ORC technologies for CHP applications, and defining a credible pathway toward commercialization of flexible, high-efficiency CHP systems. The results form a strong foundation for continued development and deployment beyond the conclusion of the DOE-funded effort.

20 FOSSIL-FUELED POWER PLANTS↗
DOE OSTI2024

Uncertainty Quantification in CO2 Trapping Mechanisms: A Case Study of PUNQ-S3 Reservoir Model Using Representative Geological Realizations and Unsupervised Machine Learning

Evaluating uncertainty in CO2 injection projections often requires numerous high-resolution geological realizations (GRs) which, although effective, are computationally demanding. This study proposes the use of representative geological realizations (RGRs) as an efficient approach to capture the uncertainty range of the full set while reducing computational costs. A predetermined number of RGRs is selected using an integrated unsupervised machine learning (UML) framework, which includes Euclidean distance measurement, multidimensional scaling (MDS), and a deterministic K-means (DK-means) clustering algorithm. In the context of the intricate 3D aquifer CO2 storage model, PUNQ-S3, these algorithms are utilized. The UML methodology selects five RGRs from a pool of 25 possibilities (20% of the total), taking into account the reservoir quality index (RQI) as a static parameter of the reservoir. To determine the credibility of these RGRs, their simulation results are scrutinized through the application of the Kolmogorov–Smirnov (KS) test, which analyzes the distribution of the output. In this assessment, 40 CO2 injection wells cover the entire reservoir alongside the full set. The end-point simulation results indicate that the CO2 structural, residual, and solubility trapping within the RGRs and full set follow the same distribution. Simulating five RGRs alongside the full set of 25 GRs over 200 years, involving 10 years of CO2 injection, reveals consistently similar trapping distribution patterns, with an average value of Dmax of 0.21 remaining lower than Dcritical (0.66). Using this methodology, computational expenses related to scenario testing and development planning for CO2 storage reservoirs in the presence of geological uncertainties can be substantially reduced.

Mahjour, Seyed Kourosh↗
DOE OSTI2021

Streamflow simulation in data-scarce basins using Bayesian and physics-informed machine learning models

Hydrologic predictions at rural watersheds are important but also challenging due to data shortage. Long short-term memory (LSTM) networks are a promising machine learning approach and have demonstrated good performance in streamflow predictions. However, due to its data-hungry nature, most LSTM applications focus on well-monitored catchments with abundant and high-quality observations. In this work, we investigate predictive capabilities of LSTM in poorly monitored watersheds with short observation records. To address three main challenges of LSTM applications in data-scarce locations, i.e., overfitting, uncertainty quantification (UQ), and out-of-distribution prediction, we evaluate different regularization techniques to prevent overfitting, apply a Bayesian LSTM for UQ, and introduce a physics-informed hybrid LSTM to enhance out-of-distribution prediction. Through case studies in two diverse sets of catchments with and without snow influence, we demonstrate that 1) when hydrologic variability in the prediction period is similar to the calibration period, LSTM models can reasonably predict daily streamflow with Nash–Sutcliffe efficiency above 0.8, even with only 2 years of calibration data; 2) when the hydrologic variability in the prediction and calibration periods is dramatically different, LSTM alone does not predict well, but the hybrid model can improve the out-of-distribution prediction with acceptable generalization accuracy; 3) L2 norm penalty and dropout can mitigate overfitting, and Bayesian and hybrid LSTM have no overfitting; and 4) Bayesian LSTM provides useful uncertainty information to improve prediction understanding and credibility. In conclusion, these insights have vital implications for streamflow simulation in watersheds where data quality and availability are a critical issue.

54 ENVIRONMENTAL SCIENCES↗