Search NASA⌕ Search

SEARCH · Search NASA

Results for “model validations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

Validation on the Europa Clipper Mission in the Formulation Phase

The Europa Clipper mission will perform a detailed investigation of Europa’s environment and habitability by placing a spacecraft into a looping orbit around Jupiter and performing repeated close Europa flybys. The Europa Clipper Project Verification and Validation (V&V) team is responsible for verifying that the Project System is compliant with the science and engineering requirements levied on it and validating that it is capable of meeting the mission objectives. Europa Clipper has developed a V&V framework to ensure that mission capabilities are realized at a reasonable confidence level prior to launch. The V&V team will coordinate the validation activities defined by this framework throughout the project lifecycle as the spacecraft evolves from design to implementation and operations. Validation of space missions is typically grouped into three categories: 1) requirements validation, 2) model validation, and 3) system validation. System validation, along with verification activities, are often the primary focus of V&V programs and these efforts peak in the implementation phase. However, the increasing reliance of exploration missions on models and simulations, and the complexity of the Europa Clipper mission, have dictated attention to requirements and model validation in the formulation phase. This paper discusses the development of the Europa Clipper V&V framework with emphasis on the validation of models and simulations, and of requirements. Approaches include the adaptation of institutional guidelines, such as those in the NASA-STD-7009 document, to create a Project Model V&V Plan and the use of tools such as DOORS NG to plan model validation and derive requirement quality metrics.

Srivastava, Priyanka↗

Hierarchical calibration and validation for modeling bench-scale solvent-based carbon capture. Part 1: Non-reactive physical mass transfer across the wetted wall column

A hierarchical model calibration and validation are proposed here for quantifying the confidence level of mass transfer prediction using a computational fluid dynamics (CFD) model, where the solvent-based carbon dioxide (CO 2 ) capture is simulated and the predicted results are compared to the corresponding bench-scale experimental data. Two unit problems with an increasing level of complexity are proposed to break down the complex physical/chemical processes of solvent-based CO 2 capture into relatively simpler problems to separate the effects of physical transport and chemical reaction. This paper focuses on the calibration and validation of the first unit problem, i.e., the CO 2 mass transfer across a falling ethanolamine (MEA) film in the absence of chemical reaction. This problem is investigated both experimentally and numerically using non-reactive nitrous oxide (N 2 O) as a surrogate for CO 2 . To capture motion of the gas-liquid interface, a volume of fluid method is employed with a one-fluid formulation to compute the mass transfer between the two phases. Parallel bench-scale experiments are designed and conducted to validate and calibrate the CFD models using a general Bayesian calibration approach. Two important transport parameters, Henry's constant and gas diffusivity, are calibrated to produce the posterior distributions, which will be used as input for the second unit problem to address the chemical absorption of CO 2 across the MEA falling film, where both mass transfer and chemical reaction are involved. Finally, mass transfer coefficients predicted by CFD are also compared with those predicted by the traditional/empirical correlations under both steady and wavy falling film conditions.

54 ENVIRONMENTAL SCIENCES↗

Community-wide Validation of Geospace Model Ground Magnetic Field Perturbation Predictions to Support Model Transition to Operations

In this paper we continue the community-wide rigorous modern space weather model validation efforts carried out within GEM, CEDAR and SHINE programs. In this particular effort, in coordination among the Community Coordinated Modeling Center (CCMC), NOAA Space Weather Prediction Center (SWPC), modelers, and science community, we focus on studying the models' capability to reproduce observed ground magnetic field fluctuations, which are closely related to geomagnetically induced current phenomenon. One of the primary motivations of the work is to support NOAA SWPC in their selection of the next numerical model that will be transitioned into operations. Six geomagnetic events and 12 geomagnetic observatories were selected for validation.While modeled and observed magnetic field time series are available for all 12 stations, the primary metrics analysis is based on six stations that were selected to represent the high-latitude and mid-latitude locations. Events-based analysis and the corresponding contingency tables were built for each event and each station. The elements in the contingency table were then used to calculate Probability of Detection (POD), Probability of False Detection (POFD) and Heidke Skill Score (HSS) for rigorous quantification of the models' performance. In this paper the summary results of the metrics analyses are reported in terms of POD, POFD and HSS. More detailed analyses can be carried out using the event by event contingency tables provided as an online appendix. An online interface built at CCMC and described in the supporting information is also available for more detailed time series analyses.

MAGNETIC↗

Importance of Sea Ice for Validating Global Climate Models

Reproduction of current day large-scale physical features and processes is a critical test of global climate model performance. Without this benchmark, prognoses of future climate conditions are at best speculation. A fundamental question relevant to this issue is, which processes and observations are both robust and sensitive enough to be used for model validation and furthermore are they also indicators of the problem at hand? In the case of global climate, one of the problems at hand is to distinguish between anthropogenic and naturally occuring climate responses. The polar regions provide an excellent testing ground to examine this problem because few humans make their livelihood there, such that anthropogenic influences in the polar regions usually spawn from global redistribution of a source originating elsewhere. Concomitantly, polar regions are one of the few places where responses to climate are non-anthropogenic. Thus, if an anthropogenic effect has reached the polar regions (e.g. the case of upper atmospheric ozone sensitivity to CFCs), it has most likely had an impact globally but is more difficult to sort out from local effects in areas where anthropogenic activity is high. Within this context, sea ice has served as both a monitoring platform and sensitivity parameter of polar climate response since the time of Fridtjof Nansen. Sea ice resides in the polar regions at the air-sea interface such that changes in either the global atmospheric or oceanic circulation set up complex non-linear responses in sea ice which are uniquely determined. Sea ice currently covers a maximum of about 7% of the earth's surface but was completely absent during the Jurassic Period and far more extensive during the various ice ages. It is also geophysically very thin (typically <10 m in Arctic, <3 m in Antarctic) compared to the troposphere (roughly 10 km) and deep ocean (roughly 3 to 4 km). Because of these unique conditions, polar researchers regard sea ice as one of the more important features to monitor in terms of heat, mass, and momentum transfer between the air and sea and furthermore, the impact of such responses to global climate.

Geiger, Cathleen A.↗

OVERFLOW Turbulence Modeling Resource Validation Results

Abstract:We exercise the computational fluid dynamics code OVERFLOW on sixteen turbulence model validation cases from the NASALangley Turbulence Model Resource web site. We give some information about the OVERFLOW options used to run these cases, and compare OVERFLOW results with results from other codes and with experiment. The goal is turbulence model validation for OVERFLOW.

computational fluid dynamics↗

Modelling and validation of particle size distributions of supported nanoparticles using the pair distribution function technique

The particle size of supported catalysts is a key characteristic for determining structure–property relationships. It is a challenge to obtain this information accurately and in situ using crystallographic methods owing to the small size of such particles (<5 nm) and the fact that they are supported. In this work, the pair distribution function (PDF) technique was used to obtain the particle size distribution of supported Pt catalysts as they grow under typical synthesis conditions. The PDF of Pt nanoparticles grown on zeolite X was isolated and refined using two models: a monodisperse spherical model (single particle size) and a lognormal size distribution. The results were compared and validated using scanning transmission electron microscopy (STEM) results. Both models describe the same trends in average particle size with temperature, but the results of the number-weighted lognormal size distributions can also accurately describe the mean size and the width of the size distributions obtained from STEM. Since the PDF yields crystallite sizes, these results suggest that the grown Pt nanoparticles are monocrystalline. This work shows that refinement of the PDF of small supported monocrystalline nanoparticles can yield accurate mean particle sizes and distributions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A comprehensive framework for validating simulation models of power system equipment using terminal measurements

Accurate simulation of power-plants is essential to the planning and operation of modern power grids. The current methods used to periodically check power-plant simulation models have many open questions about their limitations and accuracy. The research in this project explored using Monte-Carlo Experimentation (MCE) as a means for answering these important questions.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DIII-D research advancing the physics basis for optimizing the tokamak approach to fusion energy

DIII-D physics research addresses critical challenges for the operation of ITER and the next generation of fusion energy devices. This is done through a focus on innovations to provide solutions for high performance long pulse operation, coupled with fundamental plasma physics understanding and model validation, to drive scenario development by integrating high performance core and boundary plasmas. Substantial increases in off-axis current drive efficiency from an innovative top launch system for EC power, and in pressure broadening for Alfven eigenmode control from a co-/counter-I p steerable off-axis neutral beam, all improve the prospects for optimization of future long pulse/steady state high performance tokamak operation. Fundamental studies into the modes that drive the evolution of the pedestal pressure profile and electron vs ion heat flux validate predictive models of pedestal recovery after ELMs. Understanding the physics mechanisms of ELM control and density pumpout by 3D magnetic perturbation fields leads to confident predictions for ITER and future devices. Validated modeling of high-Z shattered pellet injection for disruption mitigation, runaway electron dissipation, and techniques for disruption prediction and avoidance including machine learning, give confidence in handling disruptivity for future devices. For the non-nuclear phase of ITER, two actuators are identified to lower the L–H threshold power in hydrogen plasmas. With this physics understanding and suite of capabilities, a high poloidal beta optimized-core scenario with an internal transport barrier that projects nearly to Q = 10 in ITER at ~8 MA was coupled to a detached divertor, and a near super H-mode optimized-pedestal scenario with co-I p beam injection was coupled to a radiative divertor. The hybrid core scenario was achieved directly, without the need for anomalous current diffusion, using off-axis current drive actuators. Also, a controller to assess proximity to stability limits and regulate β N in the ITER baseline scenario, based on plasma response to probing 3D fields, was demonstrated. Finally, innovative tokamak operation using a negative triangularity shape showed many attractive features for future pilot plant operation.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Diii-D Research Advancing The Physics Basis For Optimizing The Tokamak Approach To Fusion Energy

DIII-D physics research addresses critical challenges for operation of ITER and the next generation of fusion energy devices. This is done through a focus on innovations to provide solutions for high performance long pulse operation, coupled with fundamental plasma physics understanding and model validation, to drive scenario development by integrating high performance core and boundary plasmas. Substantial increases in off-axis current drive efficiency from an innovative top launch system for EC power, and in pressure broadening for Alfven eigenmode control from a co-/counter-Ip steerable off-axis neutral beam, all improve the prospects for optimization of future long pulse/steady state high performance tokamak operation. Fundamental studies into the modes that drive the evolution of the pedestal pressure profile and electron vs. ion heat flux validate predictive models of pedestal recovery after ELMs. Understanding the physics mechanisms of ELM control and density pumpout by 3D magnetic perturbation fields leads to confident predictions for ITER and future devices. Validated modeling of high-Z shattered pellet injection for disruption mitigation, runaway electron dissipation, and techniques for disruption prediction and avoidance including machine learning, give confidence in handling disruptivity for future devices. With this physics understanding and suite of actuators, a high poloidal beta optimized-core scenario with an internal transport barrier that projects nearly to Q=10 in ITER at 9 MA was coupled to a detached divertor, and a near Super H-mode optimized-pedestal scenario with co-Ip beam injection, was coupled to a radiative divertor. The Hybrid core scenario was achieved directly, without the need for internal flux pumping, using off-axis current drive actuators, and a controller to avoid mode locking and disruptions in the ITER baseline scenario, based on plasma response to probing 3D fields, was demonstrated. Finally innovative tokamak operation using a negative triangularity shape showed many attractive features for future pilot plant operation.

Fenstermacher, M.↗

Interactive Framework to Support Open Model-Data Validation Efforts at the CCMC

Validation of models using observation data has been a central activity at the Community Coordinated Modeling Center (CCMC) over more than a decade. The Comprehensive Assessment of Models and Events using Library Tools (CAMEL) framework is a database-driven implementation of the interactive analysis of model-data comparisons that simultaneously provides a view across a multitude of locations and time periods. CAMEL thus extends the single-location or single-trajectory timeseries data comparison capabilities provided by the CCMC online visualization that formed the backbone of initial validation efforts. We demonstrate CAMEL capabilities for an example application to study Neutral Density in the upper atmosphere among comparisons in the heliosphere, the Earth’s radiation belt, magnetosphere, and ionosphere-thermosphere-mesosphere domains.

Lutz Rastaetter↗

Riverine Plastic Pollution: Sampling and Analysis Methods

Riverine plastic pollution has been found in all major U.S. rivers, but the exact amount of plastic being released to the oceans has not been quantified. Field studies conducted in U.S. rivers have used a range of sampling and analysis techniques and rarely measured the mass of the plastic collected. Measurements of riverine plastic pollution are needed to calibrate and validate models used to estimate the U.S. riverine plastic emissions to the oceans. This report surveys measurement methods used to quantify riverine pollution and current estimates of U.S. riverine plastic pollution from measurements and models. Measurement methods include field sampling and laboratory analysis. Field sampling methods are described for large (macro) and small (micro) plastic particles. Laboratory analysis methods are described for macro and microplastic with an emphasis on the detailed characterization processes of microplastics. Waterborne leachate analysis is also briefly described. Three models are described that estimate plastic pollution based on mismanaged plastic waste in the river catchment basins. The models were validated and calibrated with global data sources. The data sources were predominantly outside of the U.S., where the magnitude and composition of plastic pollution is different than what is found in U.S. rivers. Comprehensive measurements of riverine plastics are needed not only to characterize the riverine plastic pollution, but also parameterize and validate models of plastic fate and transport. This report also describes five key U.S. rivers that span a range of sizes and environmental conditions that could be sampled to obtain data to support characterization and model development of plastic pollution from rivers to oceans. Sampling and analysis protocol recommendations are made to ensure the highest quality of data are collected in the five rivers.

54 ENVIRONMENTAL SCIENCES↗

Offline Power Systems Applications Enabled by Phasor Measurement Units: Technical Assistance to the Power Sectors of Southeast Asia

This report provides a brief overview of several offline (non-real-time) applications facilitated by high-resolution time-synchronized measurements recorded by phasor measurement units (PMUs). The high reporting rate and time-synchronization of PMU records provide a detailed view of power system dynamics, enabling electric utilities to obtain a better understanding of their systems. In this report, the following applications have been reviewed: Power plant model validation, System model validation, Ringdown oscillation analysis, Frequency response analysis, Postmortem analysis of disturbance events Along with a brief technical background of the applications above, applicable North American Electric Reliability Corporation (NERC) standards have been discussed, and examples of implementation in North American organizations have been provided. Implementing several of the discussed applications may need a preliminary stage of data gathering from multiple entities, and several frameworks and process flows have been formulated by organizations around the world for this purpose. However, the data-gathering stage has not been considered in the scope of the present report.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Integrated behavior-based infrastructure command validation

A cybersecurity infrastructure command validation system is provided herein for validating asset commands issued within an infrastructure network. The cybersecurity infrastructure command validation system can be integrated into an infrastructure network to monitor and validate infrastructure asset commands in real-time or while the infrastructure network is active. The cybersecurity infrastructure command validation system can receive or intercept commands issued by asset controllers. The cybersecurity infrastructure command validation system can validate the commands based on a command validation model. The command validation model can represent normal operating behavior of the infrastructure network. The cybersecurity infrastructure command validation system can provide valid commands to the intended infrastructure asset, or can reject invalid commands. The cybersecurity infrastructure command validation system can store validation results for use in updating the command validation model. The cybersecurity infrastructure command validation system can flag or otherwise warn the infrastructure network or administrators of invalid commands.

Akyol, Bora A.↗

ROMAN CGI Testbed WFSC Modeling and Validation

Optical diffraction and wavefront sensing and control (WFSC) models validated against the high-fidelity Roman Space Telescope Coronagraph Instrument (CGI) testbed play a key role in mask design selection and the verification of many requirements that cannot be accomplished until the observatory is in orbit. We have been steadily improving our model fidelity for the as-built CGI testbed system, demonstrating recently good agreement between measurements and model predictions while validating the Hybrid Lyot Coronagraph’s (HLC) performance using the in-orbit high order wavefront sensing and control (HOWFSC) operational scenario. We present modeling and testbed validation results that explain the reason many testbed WFSC iterations were needed for HLC in the past. A new, direct application of model-generated deformable mirror (DM) solutions has since been successfully demonstrated on the testbed with significant speed and performance improvement. The benefit of using such a solution opens up new model-based WFSC approaches for CGI. This can greatly reduce flight risk from potentially insufficient ground solution generation due to schedule or cost constraints or from unexpected post-delivery changes.

Poberezhskiy, Ilya↗

Verification and Validation of Flow Confinement Modeling using OpenFAST Source Panel Method

Blockage or flow confinement effects in scale wind and water turbine testing in experimental facilities, including wind and water tunnels and tow tanks, can significantly alter incident aerodynamic and hydrodynamic loads, turbine performance (thrust, torque, power output), and wake dynamics compared to unconfined conditions. As scale model tests are key sources of OpenFAST model validation measurements, directly modeling flow confinement and its effects in OpenFAST enables improved model validat

Kim, Dongyoung [Sandia National Laboratories (SNL-↗

Validating an Air Traffic Management Concept of Operation Using Statistical Modeling

Validating a concept of operation for a complex, safety-critical system (like the National Airspace System) is challenging because of the high dimensionality of the controllable parameters and the infinite number of states of the system. In this paper, we use statistical modeling techniques to explore the behavior of a conflict detection and resolution algorithm designed for the terminal airspace. These techniques predict the robustness of the system simulation to both nominal and off-nominal behaviors within the overall airspace. They also can be used to evaluate the output of the simulation against recorded airspace data. Additionally, the techniques carry with them a mathematical value of the worth of each prediction-a statistical uncertainty for any robustness estimate. Uncertainty Quantification (UQ) is the process of quantitative characterization and ultimately a reduction of uncertainties in complex systems. UQ is important for understanding the influence of uncertainties on the behavior of a system and therefore is valuable for design, analysis, and verification and validation. In this paper, we apply advanced statistical modeling methodologies and techniques on an advanced air traffic management system, namely the Terminal Tactical Separation Assured Flight Environment (T-TSAFE). We show initial results for a parameter analysis and safety boundary (envelope) detection in the high-dimensional parameter space. For our boundary analysis, we developed a new sequential approach based upon the design of computer experiments, allowing us to incorporate knowledge from domain experts into our modeling and to determine the most likely boundary shapes and its parameters. We carried out the analysis on system parameters and describe an initial approach that will allow us to include time-series inputs, such as the radar track data, into the analysis

Statistical emulation↗

Control Oriented Modeling and Validation of Aeroservoelastic Systems

Lightweight aircraft design emphasizes the reduction of structural weight to maximize aircraft efficiency and agility at the cost of increasing the likelihood of structural dynamic instabilities. To ensure flight safety, extensive flight testing and active structural servo control strategies are required to explore and expand the boundary of the flight envelope. Aeroservoelastic (ASE) models can provide online flight monitoring of dynamic instabilities to reduce flight time testing and increase flight safety. The success of ASE models is determined by the ability to take into account varying flight conditions and the possibility to perform flight monitoring under the presence of active structural servo control strategies. In this continued study, these aspects are addressed by developing specific methodologies and algorithms for control relevant robust identification and model validation of aeroservoelastic structures. The closed-loop model robust identification and model validation are based on a fractional model approach where the model uncertainties are characterized in a closed-loop relevant way.

Crowder, Marianne↗

Validated CFD Model for Multimode Gasoline Compression Ignition Engine

A validated CFD model for the multimode combustion engine developed under the DOE funded project DE-EE0008478 (Co-optimized Mixed-Mode Engine and Fuel Demonstrator for Improved Fuel Economy while Meeting Emissions Requirements). It incorporates advanced physics-based fuel surrogate models for thermophysical properties and reaction kinetics. The combustion modes include spark ignition (SI), low temperature combustion (LTC), and compression ignition (CI). The real fuel model was validated for RON60, RON70, RON80, RON90, and two biofuel blends. The validation cases can be found in https://doi.org/10.2172/1887341.

02 PETROLEUM↗