Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Model Validation for Propulsion - On the TFNS and LES Subgrid Models for a Bluff Body Stabilized Flame

This paper summarizes the reacting results of simulating a bluff body stabilized flame experiment of Volvo Validation Rig using a releasable edition of the National Combustion Code (NCC). The turbulence models selected to investigate the configuration are the sub-grid scaled kinetic energy coupled large eddy simulation (K-LES) and the time-filtered Navier-Stokes (TFNS) simulation. The turbulence chemistry interaction used is linear eddy mixing (LEM).

Flame↗

SRS Composite Analysis Monitoring Plan (FY2019 Model Validation)

Using a projected end-state date of 2065 (SRNS 2015b), the Savannah River Site (SRS) Composite Analysis (CA) modeling for each facility and waste site began on the inventory year assigned to it so that source depletion and radionuclide transport out of the system could be appropriately captured. Some SRS waste sites that have already achieved their end states (i.e. end-state inventories and end-state configuration) are currently contributing to the potential off-site public dose through source release, groundwater transport, discharge to on-site surface streams, and stream transport to the CA point of assessments (POAs). The inventory year assigned to these waste sites is 2002 or before. This means that SRS CA results from 2002 and beyond are a reasonable representation for these waste sites that have already achieved their end states and are currently contributing to the potential off-site public dose. The SRS Annual Environmental Report (AER) monitoring can differentiate and separate liquid pathway data allowing the data representing only waste sites at their end state to be produced. Because the SRS CA has projected reasonable end-state impacts from 2002 and beyond, and the AER monitoring can differentiate and separate operating and end-state contributions to annual liquid pathway release, an opportunity exists to use the AER monitoring data to validate the SRS CA model. The CA model validation program uses a graded and systematic approach for taking corrective action, starting with an SRS established administrative dose limit of 15 mrem/yr, below which no action is required. Based on the location of the 2010 SRS CA POAs, the only potential exposure pathway for the public is through surface water. The completion of the FY2019 CA model validation indicates that the SRS CA projected dose, while generally conservative, provides a reasonable representation of the maximum annual doses. These doses are well below the administrative limit; therefore, no additional action is required.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Supersonic Retro-Propulsion Experimental Design for Computational Fluid Dynamics Model Validation

The development of supersonic retro-propulsion, an enabling technology for heavy payload exploration missions to Mars, is the primary focus for the present paper. A new experimental model, intended to provide computational fluid dynamics model validation data, was recently designed for the Langley Research Center Unitary Plan Wind Tunnel Test Section 2. Pre-test computations were instrumental for sizing and refining the model, over the Mach number range of 2.4 to 4.6, such that tunnel blockage and internal flow separation issues would be minimized. A 5-in diameter 70-deg sphere-cone forebody, which accommodates up to four 4:1 area ratio nozzles, followed by a 10-in long cylindrical aftbody was developed for this study based on the computational results. The model was designed to allow for a large number of surface pressure measurements on the forebody and aftbody. Supplemental data included high-speed Schlieren video and internal pressures and temperatures. The run matrix was developed to allow for the quantification of various sources of experimental uncertainty, such as random errors due to run-to-run variations and bias errors due to flow field or model misalignments. Some preliminary results and observations from the test are presented, although detailed analyses of the data and uncertainties are still on going.

Berry, Scott A.↗

Hydrogen and Ammonia Blending With Natural Gas: Ignition Delay Times and Chemical Kinetic Model Validation at Gas Turbine Relevant Conditions

Abstract Ignition delay times from undiluted mixtures of natural gas (NG)/H2/Air and NG/NH3/Air were measured using a high-pressure shock tube at the University of Central Florida. The combustion temperatures were experimentally tested between 1000–1500 K near a constant pressure of 25 bar. As mentioned, mixtures were kept undiluted to replicate the same chemistry pathways seen in gas turbine combustion chambers. Recorded combustion pressures exceeded 200 bar due to the large energy release, hence why these were performed at the high-pressure shock tube facility. The data is compared to the predictions of the NUIGMech 1.1 mechanism for chemical kinetic model validation and refinement. An exceptional agreement was shown for stoichiometric conditions in all cases but strayed at lean and rich equivalence ratios, especially in the lower temperature regime of H2 addition and all temperature ranges of the baseline NG mixture. Hydrogen addition also decreased ignition delay times by nearly 90%, while NH3 fuel addition made no noticeable difference in ignition time. NG/NH3 exhibited similar chemistry to pure NG under the same conditions, which is shown in a sensitivity analysis. The reaction CH3 + O2 = CH3O + O is identified and suggested as a possible modification target to improve model performance. Increasing the robustness of chemical kinetic models via experimental validation will directly aid in designing next-generation combustion chambers for use in gas turbines, which in turn will greatly lower global emissions and reduce greenhouse effects.

Pierro, Michael↗

Diurnal ocean surface layer model validation

The diurnal ocean surface layer (DOSL) model at the Fleet Numerical Oceanography Center forecasts the 24-hour change in a global sea surface temperatures (SST). Validating the DOSL model is a difficult task due to the huge areas involved and the lack of in situ measurements. Therefore, this report details the use of satellite infrared multichannel SST imagery to provide day and night SSTs that can be directly compared to DOSL products. This water-vapor-corrected imagery has the advantages of high thermal sensitivity (0.12 C), large synoptic coverage (nearly 3000 km across), and high spatial resolution that enables diurnal heating events to be readily located and mapped. Several case studies in the subtropical North Atlantic readily show that DOSL results during extreme heating periods agree very well with satellite-imagery-derived values in terms of the pattern of diurnal warming. The low wind and cloud-free conditions necessary for these events to occur lend themselves well to observation via infrared imagery. Thus, the normally cloud-limited aspects of satellite imagery do not come into play for these particular environmental conditions. The fact that the DOSL model does well in extreme events is beneficial from the standpoint that these cases can be associated with the destruction of the surface acoustic duct. This so-called afternoon effect happens as the afternoon warming of the mixed layer disrupts the sound channel and the propagation of acoustic energy.

Hawkins, Jeffrey D.↗

An Innovative Software Tool Suite for Power Plant Model Validation and Parameter Calibration using PMU Measurements

Maintaining good quality of power plant stability models is of critical importance to ensure the secure and economic operation and planning of today’s power grid with its increasing stochastic and dynamic behavior. According to North American Electric Reliability (NERC) standards, all generators in North America with capacities larger than 10 MVA are required to validate their models every five years. Validation is quite costly and can significantly affect the revenue of generator owners, because the traditional staged testing requires generators to be taken offline. Over the past few years, validating and calibrating parameters using online measurements including phasor measurement units (PMUs) and digital fault recorders (DFRs) has been proven to be a cost-effective approach. In this paper, an innovative open-source tool suite is presented for validating power plant models using PPMV tool, identifying bad parameters with trajectory sensitivity analysis, and finally calibrating parameters using an ensemble Kalman filter (EnKF) based algorithm. The architectural design and the detailed procedures to run the tool suite are presented, with results of test on a realistic hydro power plant using PMU measurements for 12 different events. The calibrated parameters of machine, exciter, governor and PSS models demonstrate much better performance than the original models for all the events and show the robustness of the proposed calibration algorithm.

Li, Yuanyuan↗

UH-60 Black Hawk engineering simulation model validation and proposed modifications

The engineering simulation model of the UH-60A Black Hawk was validated using comparisons of model time histories with flight test data and updated to improve the fidelity of the model. The flight test data, acquired by the Army Aviation Engineering Flight Activity and consisting of 90 time histories of transient responses to step and pulse control inputs and 16 sets of steady flight data, were processed and compared to corresponding model time histories and trim data by Sikorsky. The current UH-60A model was judged to provide an acceptably accurate simulation for use as an analytical tool, certain unsatisfactory areas were identified and potential approaches to produce a more representative simulation were evaluated.

Kaplita, Thaddeus T.↗

Overview of the TJ-II stellarator research programme towards model validation in fusion plasmas

TJ-II stellarator results on modelling and validation of plasma flow asymmetries due to on-surface potential variations, plasma fuelling physics, Alfvén eigenmodes (AEs) control and stability, the interplay between turbulence and neoclassical (NC) mechanisms and liquid metals are reported. Regarding the validation of the neoclassically predicted potential asymmetries, its impact on the radial electric field along the flux surface has been successfully validated against Doppler reflectometry measurements. Research on the physics and modelling of plasma core fuelling with pellets and tracer encapsulated solid pellet injection has shown that, although post-injection particle radial redistributions can be understood qualitatively from NC mechanisms, turbulence and fluctuations are strongly affected during the ablation process. Advanced analysis tools based on transfer entropy have shown that radial electric fields do not only affect the radial turbulence correlation length but are also capable of reducing the propagation of turbulence from the edge into the scrape-off layer. Direct experimental observation of long range correlated structures show that zonal flow structures are ubiquitous in the whole plasma cross-section in the TJ-II stellarator. Alfvénic activity control strategies using ECRH and ECCD as well as the relation between zonal structures and AEs are reported. Finally, the behaviour of liquid metals exposed to hot and cold plasmas in a capillary porous system container was investigated.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

MAPPER – A NOVEL CAPABILITY TO SUPPORT NUCLEAR MODEL VALIDATION AND MAPPING OF BIASES AND UNCERTAINTIES

This paper overviews the initial results of a new project at the Oak Ridge National Laboratory -- supported via an internal seed funding program -- focused on the development of a novel computational capability, called MAPPER, to support model validation. The MAPPER development aims to eliminate the need for empirical criteria, such as similarity indices, often employed to identify applicable experiments for given application conditions. To achieve that, MAPPER employs an information-theoretic-based approach, based on the Kullback-Leibler (KL) divergence principle, to combine responses of available or to-be-built experiments with application responses of interest using a training set of samples generated using randomized execution of the experiments and the application high fidelity analysis models. These samples are condensed using reduced order modeling techniques in the form of a joint probability distribution function (PDF) connecting each application response of interest with a new effective experimental response. The initial focus of the MAPPER capability will be to support the confirmatory analysis required for criticality safety analysis of storage facilities which require k-eff biases to be known for safe operation. This paper reports some of the initial results obtained with MAPPER as applied to a set of critical experiments for which existing similarity-based methods have been shown to provide inaccurate estimates of the biases.

Mertyurek, Ugur↗

Shuttle Spacesuit: Fabric/LCVG Model Validation

A detailed spacesuit computational model is being developed at the Langley Research Center for radiation exposure evaluation studies. The details of the construction of the spacesuit are critical to estimation of exposures and assessing the risk to the astronaut on EVA. Past evaluations of spacesuit shielding properties assumed the basic fabric lay-up (Thermal Micrometeroid Garment, fabric restraints, and pressure envelope) and Liquid Cooling and Ventilation Garment (LCVG) could be homogenized as a single layer overestimating the protective properties over 60 percent of the fabric area. The present spacesuit model represents the inhomogeneous distributions of LCVG materials (mainly the water filled cooling tubes). An experimental test is performed using a 34-MeV proton beam and highresolution detectors to compare with model-predicted transmission factors. Some suggestions are made on possible improved construction methods to improve the spacesuit's protection properties.

Wilson, J. W.↗

Shuttle Spacesuit: Fabric/LCVG Model Validation

A detailed spacesuit computational model is being developed at the Langley Research Center for radiation exposure evaluation studies. The details of the construction of the spacesuit are critical to estimation of exposures and assessing the risk to the astronaut on EVA. Past evaluations of spacesuit shielding properties assumed the basic fabric lay-up (Thermal Micrometeroid Garment, fabric restraints, and pressure envelope) and Liquid Cooling and Ventilation Garment (LCVG) could be homogenized as a single layer overestimating the protective properties over 60 percent of the fabric area. The present spacesuit model represents the inhomogeneous distributions of LCVG materials (mainly the water filled cooling tubes). An experimental test is performed using a 34-MeV proton beam and high- resolution detectors to compare with model-predicted transmission factors. Some suggestions are made on possible improved construction methods to improve the spacesuit's protection properties.

Wilson, J. W.↗

Model Validation for Propulsion - On the TFNS and LES Subgrid Models for a Bluff Body Stabilized Flame

With advances in computational power and availability of distributed computers, the use of even the most complex of turbulent chemical interaction models in combustors and coupled analysis of combustors and turbines is now possible and more and more affordable for realistic geometries. Recent more stringent emission standards have enticed the development of more fuel-efficient and low-emission combustion system for aircraft gas turbine applications. It is known that the NOx emissions tend to increase dramatically with increasing flame temperature. It is well known that the major difficulty, when modeling the turbulence-chemistry interaction, lies in the high non-linearity of the reaction rate expressed in terms of the temperature and species mass fractions. The transport filtered density function (FDF) model and the linear eddy model (LEM), which both use local instantaneous values of the temperature and mass fractions, have been shown to often provide more accurate results of turbulent combustion. In the present, the time-filtered Navier-Stokes (TFNS) approach capable of capturing unsteady flow structures important for turbulent mixing in the combustion chamber and two different subgrid models, LEM-like and EUPDF-like, capable of emulating the major processes occurring in the turbulence-chemistry interaction will be used to perform reacting flow simulations of a selected test case. The selected test case from the Volvo Validation Rig was documented by Sjunnesson.

bluff body↗

Cryogenic Thermal Distortion Model Validation for the JWST ISIM Structure

The James Webb Space Telescope (JWST) Integrated Science Instrument Module (ISIM) Structure is a precision optical metering structure for the JWST science instruments. Optomechanical performance requirements place stringent limits on the allowable thermal distortion of the metering structure. A significant effort was completed to develop capabilities to predict and metrologize cryogenic thermal distortion of the ISIM Structure. This paper focuses on thermal distortion finite element modeling, analysis, and model validation. Extensive thermal distortion analysis was completed during the design phase for the ISIM Structure to demonstrate that thermal distortion requirements were achieved. Comparison of measurements from recently completed cryogenic testing and model predictions demonstrate the adequacy of thermal distortion modeling uncertainty factors adopted during the design phase, and provide bounds on the accuracy of the model predictions. This paper will provide an overview of the test configurations, describe the thermal distortion models of the tests, and provide a comparison of test results and analytical predictions from the models.

Johnston, John D.↗

Ablation and Thermal Response Property Model Validation for Phenolic Impregnated Carbon Ablator

Phenolic Impregnated Carbon Ablator was the heatshield material for the Stardust probe and is also a candidate heatshield material for the Orion Crew Module. As part of the heatshield qualification for Orion, physical and thermal properties were measured for newly manufactured material, included emissivity, heat capacity, thermal conductivity, elemental composition, and thermal decomposition rates. Based on these properties, an ablation and thermal-response model was developed for temperatures up to 3500 K and pressures up to 100 kPa. The model includes orthotropic and pressure-dependent thermal conductivity. In this work, model validation is accomplished by comparison of predictions with data from many arcjet tests conducted over a range of stagnation heat flux and pressure from 107 Watts per square centimeter at 2.3 kPa to 1100 Watts per square centimeter at 84 kPa. Over the entire range of test conditions, model predictions compare well with measured recession, maximum surface temperatures, and in depth temperatures.

Milos, F. S.↗

ACCRUE—An Integral Index for Measuring Experimental Relevance in Support of Neutronic Model Validation

A key challenge for the introduction of any design changes, e.g., advanced fuel concepts, first-of-a-kind nuclear reactor designs, etc., is the cost of the associated experiments, which are required by law to validate the use of computer models for the various stages, starting from conceptual design, to deployment, licensing, operation, and safety. To achieve that, a criterion is needed to decide on whether a given experiment, past or planned, is relevant to the application of interest. This allows the analyst to select the best experiments for the given application leading to the highest measures of confidence for the computer model predictions. The state-of-the-art methods rely on the concept of similarity or representativity, which is a linear Gaussian-based inner-product metric measuring the angle—as weighted by a prior model parameters covariance matrix—between two gradients, one representing the application and the other a single validation experiment. This manuscript emphasizes the concept of experimental relevance which extends the basic similarity index to account for the value accrued from past experiments and the associated experimental uncertainties, both currently missing from the extant similarity methods. Accounting for multiple experiments is key to the overall experimental cost reduction by prescreening for redundant information from multiple equally-relevant experiments as measured by the basic similarity index. Accounting for experimental uncertainties is also important as it allows one to select between two different experimental setups, thus providing for a quantitative basis for sensor selection and optimization. The proposed metric is denoted by ACCRUE, short for Accumulative Correlation Coefficient for Relevance of Uncertainties in Experimental validation. Using a number of criticality experiments for highly enriched fast metal systems and low enriched thermal compound systems with accident tolerant fuel concept, the manuscript will compare the performance of the ACCRUE and basic similarity indices for prioritizing the relevance of a group of experiments to the given application.

97 MATHEMATICS AND COMPUTING↗

Adaptive Protection and Validated Models to Enable Deployment of High Penetrations of Solar PV (PV-MOD)

The availability and validation of various PV models in commercial tools differ, with some models not yet thoroughly validated for advanced inverter functionalities and reliable performance under weak system conditions. Many existing models do not fully incorporate new inverter control functions, which can affect system stability. The increasing deployment of solar PV and other inverter-based resources (IBRs), including distributed energy resources (DERs), is influencing the reliable operation of protection schemes in distribution systems and microgrids. Emerging adaptive protection schemes (APS) offer new opportunities for protecting these systems during varying configurations and DER operating conditions, though their demonstration and validation remain limited. Adaptive protection schemes face similar challenges, as they are typically designed for specific configurations. There is a growing need for tools and methodologies to streamline the deployment of adaptive protection for safe and reliable DER integration. The project main objective was to develop and validate high-fidelity generic models of solar PV facilities for stability, protection, EMT, and QSTS analyses. This objective was achieved, and these models can now be integrated into commercial software tools, enabling utilities, vendors, and developers to study high-penetration PV systems more confidently. The project also demonstrated advanced applications of these models, including the design and deployment of adaptive protection schemes in high-penetration field applications and microgrids, supporting grid safety and reliability. Several milestones were reached by the end of the project. A sophisticated inverter test plan was developed, and inverters representative of the North American marketplace were selected. EPRI and NREL tested various inverters, conforming to IEEE standards. Improvements were made to existing generic models of IBR units, IBR plants, and aggregated feeders for various analyses. The first generic electromagnetic transient (EMT) model for a solar PV plant was developed, conforming to IEEE Std 2800™-2022 and validated against laboratory measurements of a 2.2 MVA large-scale battery energy storage system (BESS) inverter. That model was then used to produce reference responses illustrating examples of validated and verified IBR plant models that pass or fail tests for technical minimum capability and performance as specified in the IEEE standard. The developed, tested, and validated generic models can be used for transmission planning, stability assessments, expansion planning, and evaluating potential future IBR interconnection requirements. They can also support interconnection screens and conformity assessments of IBR plants, including solar PV. The project significantly contributed to the ongoing standardization and model-based representation and verification of IBR responses. The project further addressed challenges of common distribution protection schemes with increasing deployment of DER by developing, validating, and demonstrating adaptive protection schemes (APS) that can improve the reliable and safe integration of DER into distribution systems. New APS were designed using improved DER models for three common distribution systems: a radial feeder, a meshed network, and a microgrid. Modeling and hardware-in-the-loop (HIL) testing of the APS were conducted, successfully showing their effectiveness and selectivity. Proof-of-concept field demonstration was achieved for two APS, i.e., one on a radial feeder and another one in a microgrid. Field demonstration could not be achieved for the APS on a meshed network, primarily due apprehension of one utility partner and also due to limited access to the protective algorithms in the network protectors. Guidelines developed from the lessons learned in the project lay out the general process followed in the design, installation, and commissioning of APS for various distribution systems. Distribution utility partners’ apprehension about field demonstration of the new APS were addressed—with varying success—by taking a stepped risk-management approach of modeling of a wide range of sensitivities first, performing in-depth proof-of-concept testing in the laboratory including HIL next, and finally deliberately implementing and commissioning the actual protection equipment and algorithms into parts of—or in parallel operation to—the three real distribution systems. Future work should include pilot projects that further show the acceptable performance of the developed APS before these schemes be rolled out more widely. Inclusion of both utility and original equipment manufacturers (OEMs) in future projects could increase chances of successful field demonstration. Despite challenges in achieving the field demonstration goal of the project for all three APS, the research significantly contributed to the innovation of adaptive protection solutions for scalable and reliable DER integration into distribution systems. This project significantly enhances the understanding of the impact of using appropriate inverter models on distribution and transmission (T&D) systems. By addressing the limitations of existing generic models, the project introduces high-fidelity models for stability, protection, electromagnetic transient (EMT), and quasi-static time series (QSTS) analyses. These models, integrated into commercial software tools, enable utilities, vendors, and developers to confidently study high-penetration PV systems. The project also demonstrates advanced applications, including adaptive protection schemes (APS) for distribution systems and microgrids, ensuring grid safety and reliability. The technical effectiveness and economic feasibility of the methods are evident through the development and validation of sophisticated inverter test plans and the selection of representative inverters. Testing by EPRI and NREL on retail, commercial, and utility-scale inverters, conforming to IEEE standards, underscores the robustness of the models. Improvements to existing generic models for various analyses further enhance their validity and applicability. The project also identifies gaps in common distribution protection schemes and designed new APS using improved DER models, demonstrating their effectiveness through modeling and hardware-in-the-loop (HIL) testing. The project’s benefits to the public are manifold. By advancing the standardization and model-based representation of IBR response, it supports transmission planning, stability assessments, and future IBR interconnection requirements. The generic models can facilitate better communication between transmission planners and developers, supporting expected IBR plant capability and performance. Additionally, the development of APS for radial feeders, meshed networks, and microgrids supports the integration of distributed energy resources (DERs) into distribution systems, enhancing grid reliability and safety. The project’s emphasis on thorough testing and simplicity in design ensures practical and scalable solutions for DER integration.

14 SOLAR ENERGY↗

Progress on Gust Load Alleviation Wind Tunnel Experiment and Aeroservoelastic Model Validation for a Flexible Wing with Variable Camber Continuous Trailing Edge Flap System

This paper discusses a wind tunnel experiment of active gust load alleviation of a flexible wing which took place at University of Washington (UW) in 2019. The experiment performed under a NASA SBIR contract with Scientific Systems Company, Inc (SSCI). The objective of the experiment is to demonstrate active controls of the Variable Camber Continuous Trailing Edge Flap (VCCTEF) system for gust load alleviation and real-time drag optimization. The wind tunnel model is a 8.2% sub-scale Common Research Model (CRM) wing. The wing structure is designed to provide a substantial degree of flexibility to represent that of a modern high-aspect ratio wing. Eight active control surfaces are employed in the VCCTEF. A new gust generator system was designed and installed by UW under a sub-contract with SSCI. The first test entry started in July 2019 and ended in September 2019. During this test entry, many significant issues were found with the hardware and software. The significant issues with the servos prevented the test objective from being completed. A follow-up second test entry in 2020 is being planned. The wing system is being repaired by SSCI. This paper reports on the progress of this experimental effort and the aeroservoelastic (ASE) model validation which was conducted during the test entry.

Nguyen, Nhan↗