Search NASA⌕ Search

SEARCH · Search NASA

Results for “Validated Models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

NASA GSFC CCMC Recent Model Validation Activities

The Community Coordinated Modeling Center (CCMC) holds the largest assembly of state-of-the-art physics-based space weather models developed by the international space physics community. In addition to providing the community easy access to these modern space research models to support science research, its another primary goal is to test and validate models for transition from research to operations. In this presentation, we provide an overview of the space science models available at CCMC. Then we will focus on the community-wide model validation efforts led by CCMC in all domains of the Sun-Earth system and the internal validation efforts at CCMC to support space weather servicesjoperations provided its sibling organization - NASA GSFC Space Weather Center (http://swc.gsfc.nasa.gov). We will also discuss our efforts in operational model validation in collaboration with NOAA/SWPC.

Rastaetter, L.↗

Advanced Performance Metrics and their Application to the Sensitivity Analysis for Model Validation and Calibration

High-quality generator dynamic models are critical to reliable and accurate power systems studies and planning. With the availability of PMUs, measurement-based approach for model validation has gained significant prominence. In this approach, the quality of a model is analyzed by visually comparing measured generator response with the model-based simulated response for large system disturbances. This paper proposes a new set of performance metrics to assess the model validation results to facilitate automation of the model validation process. In the proposed methodology, first, the slow governor response and comparatively faster oscillatory response are separated, and then a separate set of performance metrics is calculated for each of these two components. These proposed metrics quantify the mismatch between the actual and model-based response in a comprehensive manner without missing any information enabling automation of the process. Furthermore, in this paper, we are also proposing that the sensitivity analysis for model calibration be performed with respect to the proposed metrics for the systematic identification of key parameters. In this work, results obtained using both simulated and real-world case-studies validate the effectiveness of the proposed performance metrics for model validation and their application to the sensitivity analysis for model calibration.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Systems and methods for enhanced power system model validation

A system for enhanced power system model validation is provided. The system includes a computing device including at least one processor in communication with at least one memory device. The at least one processor is programmed to store a plurality of models for a plurality of devices and a plurality of input files associated with the plurality of models, receive, from a user, a selection of model of the plurality of models to simulate, retrieve one or more input files of the plurality of input files, perform a model validity check on the selected model, if the selected model passed the model validity check, perform a model calibration on the selected model, and if the selected model passed the model calibration, perform a post evaluation on the selected model.

Wang, Honggang↗

A standardized approach to PV system performance model validation.

PV performance models are used to predict how much energy a PV system will produce at a given location and subject to prescribed weather conditions. These models are commonly used by project developers to choose between module technologies and array designs (e.g., fixed tilt vs. tracking) for a given site or to choose between different geographic locations, and are used by the financial community to establish project viability. Available models can differ significantly in their underlying mathematical formulations and assumptions and in the options available to the analyst for setting up a simulation. Some models lack complete documentation and transparency, which can result in confusion on how to properly set up, run, and document a simulation. Furthermore, the quality and associated uncertainty of the available data upon which these models rely (e.g., irradiance, module parameters, etc.) is often quite variable and frequently undefined. For these reasons, many project developers and other industry users of these simulation tools have expressed concerns related to the confidence they place in PV performance model results. To address this problem, we propose a standardized method for the validation of PV system-level performance models and a set of guidelines for setting up these models and reporting results. This paper describes the basic elements for a standardized model validation process adapted especially for PV performance models, suggests a framework to implement the process, and presents an example of its application to a number of available PV performance models.

14 SOLAR ENERGY↗

Virtual Model Validation of Complex Multiscale Systems: Applications to Nonlinear Elastostatics

We propose a virtual statistical validation process as an aid to the design of experiments for the validation of phenomenological models of the behavior of material bodies, with focus on those cases in which knowledge of the fabrication process used to manufacture the body can provide information on the micro-molecular-scale properties underlying macroscale behavior. One example is given by models of elastomeric solids fabricated using polymerization processes. We describe a framework for model validation that involves Bayesian updates of parameters in statistical calibration and validation phases. The process enables the quanti cation of uncertainty in quantities of interest (QoIs) and the determination of model consistency using tools of statistical information theory. We assert that microscale information drawn from molecular models of the fabrication of the body provides a valuable source of prior information on parameters as well as a means for estimating model bias and designing virtual validation experiments to provide information gain over calibration posteriors.

97 MATHEMATICS AND COMPUTING↗

Parameterization of Model Validating Sets for Uncertainty Bound Optimizations

Given measurement data, a nominal model and a linear fractional transformation uncertainty structure with an allowance on unknown but bounded exogenous disturbances, easily computable tests for the existence of a model validating uncertainty set are given. Under mild conditions, these tests are necessary and sufficient for the case of complex, nonrepeated, block-diagonal structure. For the more general case which includes repeated and/or real scalar uncertainties, the tests are only necessary but become sufficient if a collinearity condition is also satisfied. With the satisfaction of these tests, it is shown that a parameterization of all model validating sets of plant models is possible. The new parameterization is used as a basis for a systematic way to construct or perform uncertainty tradeoff with model validating uncertainty sets which have specific linear fractional transformation structure for use in robust control design and analysis. An illustrative example which includes a comparison of candidate model validating sets is given.

Lim, K. B.↗

Parameterization of Model Validating Sets for Uncertainty Bound Optimizations

Given experimental data and a priori assumptions on nominal model and a linear fractional transformation uncertainty structure, feasible conditions for model validation is given. All unknown but bounded exogenous inputs are assumed to occur at the plant outputs. With the satisfaction of the feasible conditions for model validation, it is shown that a parameterization of all model validating sets of plant models is possible. The new parameterization can be used as a basis for the development of a systematic way to construct model validating uncertainty models which have specific linear fractional transformation structure for use in robust control design and analysis. The proposed feasible condition (existence) test and the parameterization is computationally attractive as compared to similar tests currently available.

Lim, K. B.↗

Aeroservoelastic Model Validation and Test Data Analysis of the F/A-18 Active Aeroelastic Wing

Model validation and flight test data analysis require careful consideration of the effects of uncertainty, noise, and nonlinearity. Uncertainty prevails in the data analysis techniques and results in a composite model uncertainty from unmodeled dynamics, assumptions and mechanics of the estimation procedures, noise, and nonlinearity. A fundamental requirement for reliable and robust model development is an attempt to account for each of these sources of error, in particular, for model validation, robust stability prediction, and flight control system development. This paper is concerned with data processing procedures for uncertainty reduction in model validation for stability estimation and nonlinear identification. F/A-18 Active Aeroelastic Wing (AAW) aircraft data is used to demonstrate signal representation effects on uncertain model development, stability estimation, and nonlinear identification. Data is decomposed using adaptive orthonormal best-basis and wavelet-basis signal decompositions for signal denoising into linear and nonlinear identification algorithms. Nonlinear identification from a wavelet-based Volterra kernel procedure is used to extract nonlinear dynamics from aeroelastic responses, and to assist model development and uncertainty reduction for model validation and stability prediction by removing a class of nonlinearity from the uncertainty.

Brenner, Martin J.↗

Data-driven model validation for neutrino-nucleus cross section measurements

Neutrino-nucleus cross section measurements are needed to improve interaction modeling to meet the precision needs of neutrino experiments in efforts to measure oscillation parameters and search for physics beyond the Standard Model. We review the difficulties associated with modeling neutrino-nucleus interactions that lead to a dependence on event generators in oscillation analyses and cross section measurements alike. We then describe data-driven model validation techniques intended to address this model dependence. The method relies on utilizing various goodness-of-fit tests and the correlations between different observables and channels to probe the model for defects in the phase space relevant for the desired analysis. These techniques shed light on relevant mismodeling, allowing it to be detected before it begins to bias the cross section results. We compare more commonly used model validation methods which directly validate the model against alternative ones to these data-driven techniques and show their efficacy with fake data studies. These studies demonstrate that employing data-driven model validation in cross section measurements represents a reliable strategy to produce robust results that will stimulate the desired improvements to interaction modeling.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Data-driven model validation for neutrino-nucleus cross section measurements

Neutrino-nucleus cross section measurements are needed to improve interaction modeling to meet the precision needs of neutrino experiments in efforts to measure oscillation parameters and search for physics beyond the Standard Model. We review the difficulties associated with modeling neutrino-nucleus interactions that lead to a dependence on event generators in oscillation analyses and cross section measurements alike. We then describe data-driven model validation techniques intended to address this model dependence. The method relies on utilizing various goodness-of-fit tests and the correlations between different observables and channels to probe the model for defects in the phase space relevant for the desired analysis. These techniques shed light on relevant mismodeling, allowing it to be detected before it begins to bias the cross section results. We compare more commonly used model validation methods which directly validate the model against alternative ones to these data-driven techniques and show their efficacy with fake data studies. These studies demonstrate that employing data-driven model validation in cross section measurements represents a reliable strategy to produce robust results that will stimulate the desired improvements to interaction modeling.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

EMT Model Validation of a 2 MVA PV Inverter Using Transient and Frequency-Domain Hardware Testing: Preprint

This paper presents results and new insights gained from a hardware test campaign on a 2 MVA PV inverter for validating its vendor-supplied EMT model. The test campaign was conducted using a 7 MVA grid simulator and a 2 MW PV emulator. It considered both time-domain transient tests and frequency-domain impedance scan tests. The paper highlights the inadequacy of transient tests in capturing all critical resonance modes of the inverter, and the effectiveness of the frequency scan testing in addressing this problem. The paper shows the frequency scan testing as an effective tool for EMT model validation of IBR units which can highlight inaccuracies in the EMT models that are easy to overlook when model validation is performed using only the time-domain transient tests such as voltage ride-through and phase jump tests.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Data-Driven Model Validation Across Dimensions

Data-driven model validation across dimensions in mathematical and computational biology assumptions are often made (e.g., symmetry) to reduce the problem from three spatial dimensions (3D) to two (2D). However, some experimental datasets, such as cell counts obtained via flow cytometry, represent the entire 3D biological object. For purpose of model calibration and validation, it is sometimes necessary to compare these biological datasets with model outputs. In this work, we propose a methodology for scaling 2D model outputs to compare with 3D experimental datasets, and we discuss the application of this methodology to two examples: agent-based models of granuloma formation and skeletal muscle tissue. The accuracy of the method is evaluated in artificially generated scenarios.

97 MATHEMATICS AND COMPUTING↗

Understanding Dynamic Model Validation of a Wind Turbine Generator and a Wind Power Plant

Regional reliability organizations require power plants to validate the dynamic models that represent them to ensure that power systems studies are performed to the best representation of the components installed. In the process of validating a wind power plant (WPP), one must be cognizant of the parameter settings of the wind turbine generators (WTGs) and the operational settings of the WPP. Validating the dynamic model of a WPP is required to be performed periodically. This is because the control parameters of the WTGs and the other supporting components within a WPP may be modified to comply with new grid codes or upgrades to the WTG controller with new capabilities developed by the turbine manufacturers or requested by the plant owners or operators. The diversity within a WPP affects the way we represent it in a model. Diversity within a WPP may be found in the way the WTGs are controlled, the wind resource, the layout of the WPP (electrical diversity), and the type of WTGs used. Each group of WTGs constitutes a significant portion of the output power of the WPP, and their unique and salient behaviors should be represented individually. The objective of this paper is to illustrate the process of dynamic model validations of WTGs and WPPs, the available data recorded that must be screened before it is used for the dynamic validations, and the assumptions made in the dynamic models of the WTG and WPP that must be understood. Without understanding the correct process, the validations may lead to the wrong representations of the WTG and WPP modeled.

17 WIND ENERGY↗

An ice sheet model validation framework for the Greenland ice sheet

We propose a new ice sheet model validation framework the Cryospheric Model Comparison Tool (CMCT) that takes advantage of ice sheet altimetry and gravimetry observations collected over the past several decades and is applied here to modeling of the Greenland ice sheet. We use realistic simulations performed with the Community Ice Sheet Model (CISM) along with two idealized, non-dynamic models to demonstrate the framework and its use. Dynamic simulations with CISM are forced from 1991 to 2013 using combinations of reanalysis-based surface mass balance and observations of outlet glacier flux change. We propose and demonstrate qualitative and quanti- tative metrics for use in evaluating the different model simulations against the observations. We find 10 that the altimetry observations used here are largely ambiguous in terms of their ability to distinguish one simulation from another. Based on basin- and whole-ice-sheet scale metrics, the model initial condition as well as output from idealized and dynamic models all provide an equally reasonable representation of the ice sheet surface (mean elevation differences of <1 m). This is likely due to their short period of record, biases inherent to digital elevation models used for model initial conditions, and biases resulting from firn dynamics, which are not explicitly accounted for in the models or observations. On the other hand, we find that the gravimetry observations used here are able to unambiguously distinguish between simulations of varying complexity, and along with the CMCT, can provide a quantitative score for assessing a particular model and/or simulation. The new framework demonstrates that our proposed metrics can distinguish relatively better from relatively worse simulations and that dynamic ice sheet models, when appropriately initialized and forced with the right boundary conditions, demonstrate predictive skill with respect to observed dynamic changes occurring on Greenland over the past few decades. An extensible design will allow for continued use of the CMCT as future altimetry, gravimetry, and other remotely sensed data become available for use in ice sheet model validation.

58 GEOSCIENCES↗

Thermal System Verification and Model Validation for NASA's Cryogenic Passively Cooled James Webb Space Telescope

A thorough and unique thermal verification and model validation plan has been developed for NASA s James Webb Space Telescope. The JWST observatory consists of a large deployed aperture optical telescope passively cooled to below 50 Kelvin along with a suite of several instruments passively and actively cooled to below 37 Kelvin and 7 Kelvin, respectively. Passive cooling to these extremely low temperatures is made feasible by the use of a large deployed high efficiency sunshield and an orbit location at the L2 Lagrange point. Another enabling feature is the scale or size of the observatory that allows for large radiator sizes that are compatible with the expected power dissipation of the instruments and large format Mercury Cadmium Telluride (HgCdTe) detector arrays. This passive cooling concept is simple, reliable, and mission enabling when compared to the alternatives of mechanical coolers and stored cryogens. However, these same large scale observatory features, which make passive cooling viable, also prevent the typical flight configuration fully-deployed thermal balance test that is the keystone to most space missions thermal verification plan. JWST is simply too large in its deployed configuration to be properly thermal balance tested in the facilities that currently exist. This reality, when combined with a mission thermal concept with little to no flight heritage, has necessitated the need for a unique and alternative approach to thermal system verification and model validation. This paper describes the thermal verification and model validation plan that has been developed for JWST. The plan relies on judicious use of cryogenic and thermal design margin, a completely independent thermal modeling cross check utilizing different analysis teams and software packages, and finally, a comprehensive set of thermal tests that occur at different levels of JWST assembly. After a brief description of the JWST mission and thermal architecture, a detailed description of the three aspects of the thermal verification and model validation plan is presented.

Cleveland, Paul E.↗

1D Heat Loss Models Validation Experiment

Contains data from the model validation in the 1D Heat Loss Models to Predict the Aquifer Temperature Profile during Hot/Cold Water Injection Project. The data include two COMSOL models (2D axisymmetric benchmark model and 2D Vinsome model), one python code (1D Vinsome based FEM numerical simulation), one matlab main code (1D Newton analytical solution and all results comparison visualization), and output files generated from the above models.

1D↗

Milestone 1.2.13: Preliminary Measurements of Radiolytic Nitric Acid Formation to Support Predictive Model Validation

Predictive computational models have been developed to support the technical basis for extended dry storage of aluminum-clad spent nuclear fuel (ASNF) in helium-backfilled cannisters. To date, these models have been optimized on a variety of irradiation experiments designed to elucidate the radiation-induced formation of molecular hydrogen gas, a radiolysis product that is potentially problematic for the safe storage of ASNF. However, the yield of nitric acid (HNO3) has not been determined, despite conservative predictions of its formation (300–4000 ppm) in 1% residual air environments irradiated in contact with ASNF. HNO3, another problematic radiolysis product, can lead to enhanced corrosion and potentially compromise storage canister integrity. Thus, to support the validation of predictive computer models, we report the measurement and quantification of HNO3 from the gamma irradiation of aluminum alloy coupons in humid air.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

Distribution-Level Phasor Measurement Units Application to Composite Load Model Validation

The paper presents the results of composite load model validation based on the distribution level micro- phasor measurement units (PMU) measurements. The actual micro-PMU measurements from the distribution feeders are collected by Lawrence Berkley National Laboratory (LBNL). The composite load model parameters are initially generated using the load model data tool developed by Pacific Northwest National Laboratory (PNNL). The generated load models are calibrated to match the performances with the micro-PMU measurements using disturbance records “play-in” capabilities available in a GE PSLF simulation package. A trial-and-error approach based on engineering judgement is proposed in this paper to benchmark the generated load model parameters and is implemented in the prototype of load model validation tool, which would be a supplement to the load model data tool.

Liu, Yuan↗