Search NASA⌕ Search

SEARCH · Search NASA

Results for “MODEL VALIDATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47

Updating the Finite Element Model of the Aerostructures Test Wing Using Ground Vibration Test Data

Improved and/or accelerated decision making is a crucial step during flutter certification processes. Unfortunately, most finite element structural dynamics models have uncertainties associated with model validity. Tuning the finite element model using measured data to minimize the model uncertainties is a challenging task in the area of structural dynamics. The model tuning process requires not only satisfactory correlations between analytical and experimental results, but also the retention of the mass and stiffness properties of the structures. Minimizing the difference between analytical and experimental results is a type of optimization problem. By utilizing the multidisciplinary design, analysis, and optimization (MDAO) tool in order to optimize the objective function and constraints; the mass properties, the natural frequencies, and the mode shapes can be matched to the target data to retain the mass matrix orthogonality. This approach has been applied to minimize the model uncertainties for the structural dynamics model of the aerostructures test wing (ATW), which was designed and tested at the National Aeronautics and Space Administration Dryden Flight Research Center (Edwards, California). This study has shown that natural frequencies and corresponding mode shapes from the updated finite element model have excellent agreement with corresponding measured data.

Lung, Shun-Fat↗

Microstructure Modeling of Third Generation Disk Alloys

The objective of this program was to model, validate, and predict the precipitation microstructure evolution, using PrecipiCalc (QuesTek Innovations LLC) software, for 3rd generation Ni-based gas turbine disc superalloys during processing and service, with a set of logical and consistent experiments and characterizations. Furthermore, within this program, the originally research-oriented microstructure simulation tool was to be further improved and implemented to be a useful and user-friendly engineering tool. In this report, the key accomplishments achieved during the third year (2009) of the program are summarized. The activities of this year included: Further development of multistep precipitation simulation framework for gamma prime microstructure evolution during heat treatment; Calibration and validation of gamma prime microstructure modeling with supersolvus heat treated LSHR; Modeling of the microstructure evolution of the minor phases, particularly carbides, during isothermal aging, representing the long term microstructure stability during thermal exposure; and the implementation of software tools. During the research and development efforts to extend the precipitation microstructure modeling and prediction capability in this 3-year program, we identified a hurdle, related to slow gamma prime coarsening rate, with no satisfactory scientific explanation currently available. It is desirable to raise this issue to the Ni-based superalloys research community, with hope that in future there will be a mechanistic understanding and physics-based treatment to overcome the hurdle. In the mean time, an empirical correction factor was developed in this modeling effort to capture the experimental observations.

Jou, Herng-Jeng↗

Composite Overwrapped Pressure Vessels (COPV): Flight Rationale for the Space Shuttle Program

Each Orbiter Vehicle (Space Shuttle Program) contains up to 24 Kevlar49/Epoxy Composite Overwrapped Pressure Vessels (COPV) for storage of pressurized gases. In the wake of the Columbia accident and the ensuing Return To Flight (RTF) activities, Orbiter engineers reexamined COPV flight certification. The original COPV design calculations were updated to include recently declassified Kevlar COPV test data from Lawrence Livermore National Laboratory (LLNL) and to incorporate changes in how the Space Shuttle was operated as opposed to orinigially envisioned. 2005 estimates for the probability of a catastrophic failure over the life of the program (from STS-1 through STS-107) were one-in-five. To address this unacceptable risk, the Orbiter Project Office (OPO) initiated a comprehensive investigation to understand and mitigate this risk. First, the team considered and eventually deemed unfeasible procuring and replacing all existing flight COPVs. OPO replaced the two vessels with the highest risk with existing flight spare units. Second, OPO instituted operational improvements in ground procedures to signficiantly reduce risk, without adversely affecting Shuttle capability. Third, OPO developed a comprehensive model to quantify the likelihood of occurrance. A fully-instrumented burst test (recording a lower burst pressure than expected) on a flight-certified vessel provided critical understanding of the behavior of Orbiter COPVs. A more accurate model was based on a newly-compiled comprehensive database of Kevlar data from LLNL and elsewhere. Considering hardware changes, operational improvements and reliability model refinements, the mean reliability was determined to be 0.998 for the remainder of the Shuttle Program (from 2007, for STS- 118 thru STS-135). Since limited hardware resources precluded full model validation through multiple tests, additional model confidence was sought through the first-ever Accelerated Stress Rupture Test (ASRT) of a flown flight article. A Bayesian statistical approach was developed to interpret possible test results. Since the lifetime observed in the ASRT exceeded initial estimates by one to two orders of magnitude, the Space Shuttle Program deemed there was significant conservatism in the model and accepted continued operation with existing flight hardware. Given the variability in tank-to-tank original prooftest response, a non-destructive evaluation (NDE) technique utilizing Raman Spectroscopy was developed to directly measure COPV residual stress state. Preliminary results showed that patterns of low fiber elastic strains over the outside vessel surface, together with measured permanent volume growth during proof, could be directly correlated to increased fiber stress ratios on the inside fibers adjacent to the liner, and thus reduced reliability.

Kezirian, Michael T.↗

Suppression of Heating of Coronal Loops Rooted in Opposite Polarity Sunspot Umbrae

EUV observations of active region (AR) coronae reveal the presence of loops at different temperatures. To understand the mechanisms that result in hotter or cooler loops, we study a typical bipolar AR, near solar disk center, which has moderate overall magnetic twist and at least one fully developed sunspot of each polarity. From AIA 193 and 94 Å images we identify many clearly discernible coronal loops that connect plage or a sunspot of one polarity to an opposite-­polarity plage region. The AIA 94 Å images show dim regions in the umbrae of the spots. To see which coronal loops are rooted in a dim umbral area, we performed a non-linear force‐free field (NLFFF) modeling using photospheric vector magnetic field measurements obtained with the Heliosesmic Magnetic Imager (HMI) onboard SDO. The NLFFF model, validated by comparison of calculated model field lines with observed loops in AIA 193 and 94 Å, specifies the photospheric roots of the model field lines. Some model coronal magnetic field lines arch from the dim umbral area of the positive-polarity sunspot to the dim umbral area of a negative-polarity sunspot. Because these coronal loops are not visible in any of the coronal EUV and X-ray images of the AR, we conclude they are the coolest loops in the AR. This result suggests that the loops connecting opposite polarity umbrae are the least heated because the field in umbrae is so strong that the convective braiding of the field is strongly suppressed.

sunspots↗

Suppression of Heating of Coronal Loops Rooted in Opposite Polarity Sunspot Umbrae

EUV observations of active region (AR) coronae reveal the presence of loops at different temperatures. To understand the mechanisms that result in hotter or cooler loops, we study a typical bipolar AR, near solar disk center, which has moderate overall magnetic twist and at least one fully developed sunspot of each polarity. From AIA 193 and 94 Å images we identify many clearly discernible coronal loops that connect plage or a sunspot of one polarity to an opposite-­polarity plage region. The AIA 94 Å images show dim regions in the umbrae of the spots. To see which coronal loops are rooted in a dim umbral area, we performed a non-linear force‐free field (NLFFF) modeling using photospheric vector magnetic field measurements obtained with the Heliosesmic Magnetic Imager (HMI) onboard SDO. The NLFFF model, validated by comparison of calculated model field lines with observed loops in AIA 193 and 94 Å, specifies the photospheric roots of the model field lines. Some model coronal magnetic field lines arch from the dim umbral area of the positive-polarity sunspot to the dim umbral area of a negative-polarity sunspot. Because these coronal loops are not visible in any of the coronal EUV and X-ray images of the AR, we conclude they are the coolest loops in the AR. This result suggests that the loops connecting opposite polarity umbrae are the least heated because the field in umbrae is so strong that the convective braiding of the field is strongly suppressed.

sunspot↗

International Space Station Model Correlation Analysis

This paper summarizes the on-orbit structural dynamic data and the related modal analysis, model validation and correlation performed for the International Space Station (ISS) configuration ISS Stage ULF7, 2015 Dedicated Thruster Firing (DTF). The objective of this analysis is to validate and correlate the analytical models used to calculate the ISS internal dynamic loads and compare the 2015 DTF with previous tests. During the ISS configurations under consideration, on-orbit dynamic measurements were collected using the three main ISS instrumentation systems; Internal Wireless Instrumentation System (IWIS), External Wireless Instrumentation System (EWIS) and the Structural Dynamic Measurement System (SDMS). The measurements were recorded during several nominal on-orbit DTF tests on August 18, 2015. Experimental modal analyses were performed on the measured data to extract modal parameters including frequency, damping, and mode shape information. Correlation and comparisons between test and analytical frequencies and mode shapes were performed to assess the accuracy of the analytical models for the configurations under consideration. These mode shapes were also compared to earlier tests. Based on the frequency comparisons, the accuracy of the mathematical models is assessed and model refinement recommendations are given. In particular, results of the first fundamental mode will be discussed, nonlinear results will be shown, and accelerometer placement will be assessed.

Modal Analysis↗

3-D Modeling off the CFR Engine for the Investigation of Knock on Natural Gas

Engine knock and misfire are barriers to pathways leading to high-efficiency Natural Gas (NG) engines. The general tendency to knock is highly dependent on engine operating conditions and the fuel reactivity. The problem is further complicated by low emissions limits and the wide range of chemical reactivity in pipeline quality NG (65< MN<95). In order to realize diesel-like efficiencies, spark-ignited NG engines must be designed to operate at high BMEP near knock limits over a wide range of fuel reactivity. This requires a deep understanding regarding combustion-engine interactions important in flame propagation and end-gas autoignition. The present work highlights a three-dimensional computational fluid dynamics (CFD) model of the Cooperative Fuel Research (CFR) engine to investigate knock behavior with NG. The CFR engine model is used to investigate fuel-engine interactions that lead to knock with NG, including effects of fuel reactivity, engine operating parameters, and exhaust gas recirculation (EGR). Cylinder wall, piston, valves, and port surface temperatures are estimated with a 1-D Three-Pressure Analysis (TPA) model. Model validation was performed by comparing model predictions with experimental data taken with a CFR engine over varying compression ratio, CA50, EGR fraction and BMEP.

Bestel, Diego↗

A Computational Methodology for Simulating Thermal Loss Testing of the Advanced Stirling Convertor

The U.S. Department of Energy (DOE) and Lockheed Martin Space Systems Company (LMSSC) have been developing the Advanced Stirling Radioisotope Generator (ASRG) for use as a power system for space science missions. This generator would use two highefficiency Advanced Stirling Convertors (ASCs), developed by Sunpower Inc. and NASA Glenn Research Center (GRC). The ASCs convert thermal energy from a radioisotope heat source into electricity. As part of ground testing of these ASCs, different operating conditions are used to simulate expected mission conditions. These conditions require achieving a particular operating frequency, hot end and cold end temperatures, and specified electrical power output for a given net heat input. In an effort to improve net heat input predictions, numerous tasks have been performed which provided a more accurate value for net heat input into the ASCs, including the use of multidimensional numerical models. Validation test hardware has also been used to provide a direct comparison of numerical results and validate the multi-dimensional numerical models used to predict convertor net heat input and efficiency. These validation tests were designed to simulate the temperature profile of an operating Stirling convertor and resulted in a measured net heat input of 244.4 W. The methodology was applied to the multi-dimensional numerical model which resulted in a net heat input of 240.3 W. The computational methodology resulted in a value of net heat input that was 1.7 percent less than that measured during laboratory testing. The resulting computational methodology and results are discussed.

Reid, Terry V.↗

Machine-learning interatomic potentials for interfaces in all-solid-state batteries: Perspectives on training data, model selection, and validation

Interfaces play a pivotal role in dictating the performance and reliability of all-solid-state batteries (ASSBs), where complex electro-chemo-mechanical phenomena at grain boundaries (GBs) and interfaces can lead to degradation and failure. Traditional atomistic simulation methods, such as first-principles calculations and classical molecular dynamics, face limitations in modeling these interfaces due to either high computational cost or insufficient transferability to the diverse atomic environments evolving at interfaces. Machine-learning interatomic potentials (MLIPs) have emerged as a transformative approach, enabling large-scale, high-accuracy simulations of disordered and chemically complex systems by leveraging the predictability of machine learning models trained on first-principles data. Recent applications of MLIPs have demonstrated their ability to capture intricate behaviors at ASSB interfaces, including ion transport, interfacial evolution, and degradation mechanisms, with accuracy and efficiency unattainable by conventional methods. This prospective paper presents comprehensive analysis and practical guidance for MLIP development for GBs and interfaces in ASSBs, with a focus on three key pillars: data generation, model selection, and validation. Here, we review the current state of MLIP applications for GBs and interfaces in both general and ASSB-specific materials, highlighting best practices and challenges in constructing diverse and representative datasets, choosing appropriate machine learning architectures, and rigorously validating model performance. We also discuss emerging strategies and opportunities for improved reliability and efficiency of MLIPs to simulate realistic interfaces in ASSBs.

Energy - Storage↗

Multi-configuration Membrane Distillation Model (MCMD)

Many membrane distillation models have been created to simulate the heat and mass exchange process involved but most of the literature only validates models to a couple of cases with minor configuration changes. Tools are needed that allow tradeoffs between many configurations. The multiconfiguration membrane distillation model handles many configurations. This report introduces membrane distillation, provides theory, and presents the work to verify and validate the model against experimental data from Colorado School of Mines and a lower resolution model created at the National Renewable Energy Laboratory. Though more data analysis and testing are needed, an initial look at the model to experimental comparisons indicates that the model correlates to the data well but that design comparisons are likely to be incorrect across a broad range of configurations. More accurate quantification of heat and mass transfer through computational fluid mechanics is suggested.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Offshore Wind Energy Validation Experiment Hierarchy

This paper provides a summary of planning work for experiments that will be necessary to address the long-term model validation needs required to meet offshore wind energy deployment goals. Conceptual experiments are identified and laid out in a validation hierarchy for both wind turbine and wind plant applications. Instrumentation needs that will be required for the offshore validation experiments to be impactful are then listed. The document concludes with a nominal vision for how these experiments can be accomplished.

17 WIND ENERGY↗

Evaluating Class 6 Delivery Truck Fuel Economy and Emissions Using Vehicle System Simulations for Conventional and Hybrid Powertrains and Co-Optima Fuel Blends

The US Department of Energy’s Co-Optimization of Engine and Fuels Initiative (Co-Optima) investigated how unique properties of bio-blendstocks considered within Co-Optima help address emissions challenges with mixing controlled compression ignition (i.e., conventional diesel combustion) and enable advanced compression ignition modes suitable for implementation in a diesel engine. Additionally, the potential synergies of these Co-Optima technologies in hybrid vehicle applications in the medium- and heavy-duty sector was also investigated. In this work, vehicles system were simulated using the Autonomie software tool for quantifying the benefits of Co-Optima engine technologies for medium-duty trucks. A Class 6 delivery truck with a 6.7 L diesel engine was used for simulations over representative real-world and certification drive cycles with four different powertrains to investigate fuel economy, criteria emissions, and performance. Comparisons were made between ultralow-sulfur diesel and a blend of 25% hexyl hexanoate with diesel. Model validation data were informed by 2019 model year Cummins ISB 6.7 L diesel engine maps and transient validation data in a pre-production hybrid configuration and a direct dyno coupled configuration with diesel fuel and a blend of 25% hexyl hexanoate with diesel.

33 ADVANCED PROPULSION SYSTEMS↗

Recent Progress Validating the HADES Model of LLNL's HEAF MicroCT Measurements

This report compares recent HADES calculations of x-ray linear attenuation coefficients to previous MicroCT measurements made at Lawrence Livermore National Laboratory’s High Energy Applications Facility (HEAF). The chief objective is to investigate what impact recent changes in HADES modeling have on validation results. We find that these changes have no obvious effect on the overall accuracy of the model. Detailed comparisons between recent and previous results are presented.

42 ENGINEERING↗

Multimodel validation of single wakes in neutral and stratified atmospheric conditions

Previous research has revealed the need for a validation study that considers several wake quantities and code types so that decisions on the trade-off between accuracy and computational cost can be well informed and appropriate to the intended application. In addition to guiding code choice and setup, rigorous model validation exercises are needed to identify weaknesses and strengths of specific models and guide future improvements. Here, we consider 13 approaches to simulating wakes observed with a nacelle-mounted lidar at the Scaled Wind Technology Facility (SWiFT) under varying atmospheric conditions. We find that some of the main challenges in wind turbine wake modeling are related to simulating the inflow. In the neutral benchmark, model performance tracked as expected with model fidelity, with large-eddy simulations performing the best. In the more challenging stable case, steady-state Reynolds-averaged Navier–Stokes simulations were found to outperform other model alternatives because they provide the ability to more easily prescribe noncanonical inflows and their low cost allows for simulations to be repeated as needed. Dynamic measurements were only available for the unstable benchmark at a single downstream distance. These dynamic analyses revealed that differences in the performance of time-stepping models come largely from differences in wake meandering. This highlights the need for more validation exercises that take into account wake dynamics and are able to identify where these differences come from: mesh setup, inflow, turbulence models, or wake-meandering parameterizations. In addition to model validation findings, we summarize lessons learned and provide recommendations for future benchmark exercises.

17 WIND ENERGY↗

A Formal Approach to Empirical Dynamic Model Optimization and Validation

A framework was developed for the optimization and validation of empirical dynamic models subject to an arbitrary set of validation criteria. The validation requirements imposed upon the model, which may involve several sets of input-output data and arbitrary specifications in time and frequency domains, are used to determine if model predictions are within admissible error limits. The parameters of the empirical model are estimated by finding the parameter realization for which the smallest of the margins of requirement compliance is as large as possible. The uncertainty in the value of this estimate is characterized by studying the set of model parameters yielding predictions that comply with all the requirements. Strategies are presented for bounding this set, studying its dependence on admissible prediction error set by the analyst, and evaluating the sensitivity of the model predictions to parameter variations. This information is instrumental in characterizing uncertainty models used for evaluating the dynamic model at operating conditions differing from those used for its identification and validation. A practical example based on the short period dynamics of the F-16 is used for illustration.

Crespo, Luis G↗

Wave-powered water pump for upwelling in aquaculture: Numerical model and ocean test

Wave-powered upwelling can increase the productivity and survivability of several aquaculture species. This enhancement is due to transporting cold, nutrient-rich ocean water, typically found lower in the water column, to the surface. Macroalgaes, like kelp, exhibit increased growth from these altered conditions. The University of New Hampshire’s (UNH) wave-powered water pump (wave pump) is a point absorber wave energy converter (WEC) that uses ocean waves to create relative motion between a spar buoy and a concentric float which drives an internal pump. A numerical model of the wave pump was developed using WEC-Sim to predict device performance in the ocean. Wave pump performance was evaluated during a five day ocean test near Appledore Island in Maine in March 2023, where volumetric flow rate, relative distance between spar and float, and wave conditions were measured. These data were then used for numerical model validation. The ocean deployment recorded the device’s performance in a variety of sea states, with average significant wave heights up to 0.7 m. The ocean test data were compared to the WEC-Sim numerical model of the device with favorable results. Average values of device stroke period, stroke height, and flow rate agreed between the ocean test and model data to within approximately 16 to 22%. Furthermore, the validated numerical model provides a valuable tool for improving the design and developing a commercial-scale, wave-powered water pump for use in aquaculture.

16 TIDAL AND WAVE POWER↗

Verification as a Foundation for Validation of a Nuclear Fuel Performance Code

Complex multiphysics simulations such as nuclear fuel performance analysis are composed of many submodels used to describe specific phenomena. These phenomena include, as examples, the relationship between stress and strain, heat transfer across a gas gap, and mechanical contact. These submodels work in concert to simulate real-world events, like the behavior of a fuel rod in a reactor. If a simulation tool is able to represent real-world behavior, the tool is said to be validated. While much emphasis is rightly placed on validation, model verification may be undervalued. Verification involves showing that a model performs as intended, that it computes results consistent with its mathematical description. This paper explains the differences between verification and validation and shows how validation should be preceded by verification. Specific verification problems, including several specific to nuclear fuel analysis, are given. Validation results are also presented.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Light Water Reactor Sustainability Program Status of Adaptive Surrogates within the RAVEN framework

The RAVEN code has been under development at the Idaho National Laboratory since 2012. Its main goal is to create a multi-purpose platform for the deploying of all the capabilities needed for Probabilistic Risk Assessment, uncertainty quantification, data mining analysis and optimization studies. RAVEN has demonstrated a good level of maturity in terms of state-of-art and advanced analysis methodologies. Indeed, in the past year the RAVEN code has been released as open-source project and is available to download (raven.inl.gov) free of charge. The main subject of this report is to show the activities that have been recently accomplished with respect the adaptive surrogate modeling: Implementation of the metric system for the assessment of surrogate model validity; Implementation of cross-validation techniques for the global assessment of surrogate models; Implementation of an automatic infrastructure for switching between a high-fidelity model (e.g. physical code) and a surrogate or set of surrogates; Implementation of a scheme for automatic optimization of surrogate model parameters. The aim of this document is to report the status of the development of methods, within the RAVEN framework, to assess the validity of the predictive capabilities of surrogate models. Indeed, after the construction of a surrogate tight to a certain physical model, it is crucial to assess the goodness of its representation, in order to be confident with its prediction. A cross-validation technique has been employed. This report will highlight the implementation details and proof its correct implementation by an application example. The implementation of a way to assess the predictive capabilities of a surrogate allowed the construction of a RAVEN new entity named “HybridModel” that is aimed to switch between an high-fidelity code and its linked surrogate. In addition, leveraging the optimization algorithms that have been implemented in RAVEN last fiscal year, a new scheme has been developed for automatic tuning of the surrogates’ parameters (e.g. penalty factors in support vector machines).

97 MATHEMATICS AND COMPUTING↗