Search NASA⌕ Search

SEARCH · Search NASA

Results for “model validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44

SLS Navigation Model-Based Design Approach

The SLS Program chose to implement a Model-based Design and Model-based Requirements approach for managing component design information and system requirements. This approach differs from previous large-scale design efforts at Marshall Space Flight Center where design documentation alone conveyed information required for vehicle design and analysis and where extensive requirements sets were used to scope and constrain the design. The SLS Navigation Team has been responsible for the Program-controlled Design Math Models (DMMs) which describe and represent the performance of the Inertial Navigation System (INS) and the Rate Gyro Assemblies (RGAs) used by Guidance, Navigation, and Controls (GN&C). The SLS Navigation Team is also responsible for the navigation algorithms. The navigation algorithms are delivered for implementation on the flight hardware as a DMM. For the SLS Block 1-B design, the additional GPS Receiver hardware is managed as a DMM at the vehicle design level. This paper provides a discussion of the processes and methods used to engineer, design, and coordinate engineering trades and performance assessments using SLS practices as applied to the GN&C system, with a particular focus on the Navigation components. These include composing system requirements, requirements verification, model development, model verification and validation, and modeling and analysis approaches. The Model-based Design and Requirements approach does not reduce the effort associated with the design process versus previous processes used at Marshall Space Flight Center. Instead, the approach takes advantage of overlap between the requirements development and management process, and the design and analysis process by efficiently combining the control (i.e. the requirement) and the design mechanisms. The design mechanism is the representation of the component behavior and performance in design and analysis tools. The focus in the early design process shifts from the development and management of design requirements to the development of usable models, model requirements, and model verification and validation efforts. The models themselves are represented in C/C++ code and accompanying data files. Under the idealized process, potential ambiguity in specification is reduced because the model must be implementable versus a requirement which is not necessarily subject to this constraint. Further, the models are shown to emulate the hardware during validation. For models developed by the Navigation Team, a common interface/standalone environment was developed. The common environment allows for easy implementation in design and analysis tools. Mechanisms such as unit test cases ensure implementation as the developer intended. The model verification and validation process provides a very high level of component design insight. The origin and implementation of the SLS variant of Model-based Design is described from the perspective of the SLS Navigation Team. The format of the models and the requirements are described. The Model-based Design approach has many benefits but is not without potential complications. Key lessons learned associated with the implementation of the Model Based Design approach and process from infancy to verification and certification are discussed

Oliver, T. Emerson↗

PV Performance Modeling - Data and Resources

The Photovoltaic (PV) Performance Modeling Collaborative (PVPMC) organized a blind PV performance modeling intercomparison to allow PV modelers to blindly test their models and modeling ability against real system data. Measured weather and irradiance data were provided along with detailed descriptions of PV systems from two locations (Albuquerque, New Mexico, USA and Roskilde, Denmark). Participants were asked to simulate the plane-of-array irradiance, module temperature, and DC power output from six systems and submit their results to Sandia for processing. This dataset includes seven MS-Excel sheets with instructions, notes and all necessary data (weather, irradiance, temperature, power) used for the data analysis of the blind modeling comparison. The hourly data represent six different systems from Albuquerque, NM and Roskilde, Denmark over a period of one year. These data are useful for PV performance model validation studies.

14 SOLAR ENERGY↗

Suited and Unsuited Hybrid III Impact Testing and Finite Element Model Characterization

NASA spacecraft design requirements for occupant protection are a combination of the Brinkley Dynamic Response Criteria and injury assessment reference values (IARV) extracted from anthropomorphic test devices (ATD). For the ATD IARVs, the requirements specify the use of the 5th percentile female Hybrid III and the 95th percentile male Hybrid III. Each of these ATDs is required to be fitted with an articulating pelvis (also known as the aerospace pelvis) and a straight spine. The articulating pelvis is necessary for the ATD to fit into spacecraft seats, while the straight spine is required as injury metrics for vertical accelerations are better defined for this configuration. Sled testing of the Hybrid III 5th Percentile Female Anthropomorphic Test Device (ATD) was performed at Wright-Patterson Air Force Base (WAPFB). Two 5th Percentile ATDs were tested, the Air Force Research Lab (AFRL) and NASA owned Hybrid III ATDs with aerospace pelvises. Testing was also conducted with a NASA-owned 95th Percentile Male Hybrid III with aerospace pelvis at WPAFB. Testing was performed using an Orion seat prototype provided by Johnson Space Center (JSC). A 5-point harness comprised of 2 inch webbing was also provided by JSC. For suited runs, a small and extra-large Advanced Crew Escape System (ACES) suit and helmet were also provided by JSC. Impact vectors were combined frontal/spinal and rear/lateral. Some pure spinal and rear axis testing was also performed for model validation. Peak accelerations ranged between 15 and 20-g. This range was targeted because the ATD responses fell close to the IARV defined in the Human-Systems Integration Requirements (HSIR) document. Rise times varied between 70 and 110 ms to assess differences in ATD responses and model correlation for different impact energies. The purpose of the test series was to evaluate the Hybrid III ATD models in Orion-specific landing orientations both with and without a spacesuit. The results of these tests were used by the NASA Engineering and Safety Center (NESC) to validate the finite element model (FEM) of the Hybrid III 5th Percentile Female ATD. Physical test data was compared to analytical predictions from simulations, and modelling uncertainty factors have been determined for each injury metric. Additionally, the test data has been used to further improve the FEM, particularly in the areas of the ATD preload, harness, and suit and helmet effects.

Lawrence, C.↗

A High-Pressure Shock Tube Study of Hydrogen and Ammonia Addition to Natural Gas for Reduced Carbon Emissions in Power Generation Gas Turbines

Ignition delay times from undiluted mixtures of natural gas (NG)/H2/Air and NG/NH3/Air were measured using a high-pressure shock tube at the University of Central Florida. The combustion temperatures were experimentally tested between 1000-1500 K near a constant pressure of 25 bar. Mixtures were kept undiluted to replicate the same chemistry pathways seen in gas turbine combustion chambers. Recorded combustion pressures exceeded 200 bar due to the large energy release, hence why these were performed at the high-pressure shock tube facility. The data is compared to the predictions of the NUIGMech 1.1 mechanism for chemical kinetic model validation and refinement. An exceptional agreement was shown for stoichiometric conditions in all cases but strayed at lean and rich equivalence ratios, especially in the lower temperature regime of H2 addition and all temperature ranges of the baseline NG mixture. Hydrogen addition also decreased ignition delay times by nearly 90%, while NH3 fuel addition made no noticeable difference in ignition delay time. NG/NH3 exhibited similar chemistry to pure NG under the same conditions, which is shown in a sensitivity analysis, demonstrating hydrogen chemistry to be dominant in NG/H2 mixtures and hydrocarbon chemistry to be dominant in NG/NH3 mixtures. The reaction CH3 + O2 = CH3O + O is identified and suggested as a possible modification target to improve model performance. Increasing the robustness of chemical kinetic models via experimental validation will directly aid in designing next-generation combustion chambers for use in gas turbines, which in turn will greatly lower global emissions and reduce greenhouse effects.

Pierro, Michael↗

An Overview of the EGS Collab Project: Field Validation of Coupled Process Modeling of Fracturing and Fluid Flow at the Sanford Underground Research Facility, Lead, SD

Enhanced Geothermal Systems (EGS) development will require an ability to accurately predict the flow rates and temperatures of the production wells. While simple in concept, complex heterogeneous fracture pathways can lead to channeling, short-circuiting, and premature thermal breakthrough complicating EGS. The EGS Collab project will establish a suite of intermediate-scale (~10-20 m) field test beds coupled with stimulation and interwell flow tests to provide a basis to better understand the fracture geometries and processes that control heat transfer between rock and stimulated fractures. These experiments will provide a means of testing tools, codes, and concepts that could later be employed under geothermal reservoir conditions at FORGE and in EGS. We will perform well-controlled, in situ experiments focused on rock fracture behavior and permeability enhancement. Pre- and post-test modeling of each test will allow for model prediction and validation. Comprehensive instrumentation will be used to collect high-quality, high-resolution geophysical and fracture characterization and fluid flow data. ,These data will be analyzed and compared with models and field observations to further elucidate the basic relationships between stress, induced seismicity, and permeability enhancement. To the maximum extent achievable, we will observe and quantify other key governing parameters that impact permeability, and attempt to understand how these parameters might change throughout the development and operation of an EGS project with the goal of enabling commercial viability of EGS. The Sanford Underground Research Facility (SURF) in South Dakota was selected as the EGS Collab project experimental site based on the evaluation of information from several sites. Our team has designed and constructed the first field experiment planned for this project, which is supported by the US Department of Energy’s Geothermal Technologies Office.

EGS, FORGE, field fracture stimulation and flow ex↗

Effect of Soil Properties and Input Motion on Site Amplification Using Validated Nonlinear Soil Model

Here, three-dimensional (3-D) nonlinear site response analyses are conducted using finite element models of actual soil profiles from ten nuclear power plant (NPP) sites in the United States to investigate the effects of soil properties and input motions on site amplification. The modeling approach developed in this study combines several novel elements, such as 3-D analysis (including vertical motions), nonlinear inelastic behavior of soil (strain-dependent shear modulus reduction and hysteretic damping), formulation of nonreflecting boundary conditions at the base, and generation of realistic outcrop ground motions for specific sites. All these elements of the modeling approach are first validated using actual data from five earthquakes at three downhole array stations recorded in the Kiban-Kyoshin network (KiK-net), Japan. The same approach is then used to develop site models of ten NPP sites in the United States and corresponding ground motions that are spectrally matched to the site hazard spectra. Eight sets of three-component input motions are used in the study and are categorized on the basis of presence or absence of a near-field pulse in the seed ground motions used for spectral matching. It is found that all sites retain a definite site amplification function regardless of the input motion, provided that the seed motion is spectrally matched to the site hazard spectra. The magnitude of site amplification and frequencies at which they occur depend upon soil properties, particularly the shear wave velocity profile and the constitutive relationship (strain-dependent shear modulus reduction and hysteretic damping) of soil. Amplification of spectral acceleration in the vertical direction (up-down motion) is found to be just as much as, if not more than, the amplification in the horizontal direction. Peak shear strain is found to be about 20% larger for near-field motions compared to far-field motions whereas maximum horizontal site amplification for far-field motions is found to be consistently larger than that of near-field motions, even though the differences between the two remain within the scatter resulting from individual ground motions.

99 GENERAL AND MISCELLANEOUS↗

Uncertainty Propagation Analysis of Computational Models in Laser Powder Bed Fusion Additive Manufacturing Using Polynomial Chaos Expansions

Computational models for simulating physical phenomena during laser-based powder bed fusion additive manufacturing (L-PBF AM) processes are critical for enhancing our understanding of these phenomena, enable process optimization, and accelerate qualification and certification of AM materials and parts. It is a well-known fact that such models typically involve multiple sources of uncertainty that originate from different sources such as model parameters uncertainty, or model/code inadequacy, among many others. Uncertainty quantification (UQ) is a broad field that focuses on characterizing such uncertainties in order to maximize the benefit of these models. Although UQ has been a center theme in computational models associated with diverse fields such as computational fluid dynamics and macro-economics, it has not yet been fully exploited with computational models for advanced manufacturing. The current study introduces one among the first efforts to conduct uncertainty propagation (UP) analysis in the context of L-PBF AM. More specifically, we present a generalized polynomial chaos expansions (gPCE) framework to assess the distributions of melt pool dimensions due to uncertainty in input model parameters. We develop the methodology and then employ it to validate model predictions, both through benchmarking them against Monte Carlo (MC) methods and against experimental data acquired from an experimental testbed.

36 MATERIALS SCIENCE↗

Experimental and Modeling Studies of the Combustion Characteristics of Conventional and Alternative Jet Fuels. Final Report

The objectives of this project have been to develop a comprehensive set of fundamental data regarding the combustion behavior of jet fuels and appropriately associated model fuels. Based on the fundamental study results, an auxiliary objective was to identify differentiating characteristics of molecular fuel components that can be used to explain different fuel behavior and that may ultimately be used in the planning and design of optimal fuel-production processes. The fuels studied in this project were Fischer-Tropsch (F-T) fuels and biomass-derived jet fuels that meet certain specifications of currently used jet propulsion applications. Prior to this project, there were no systematic experimental flame data available for such fuels. One of the key goals has been to generate such data, and to use this data in developing and verifying effective kinetic models. The models have then been reduced through automated means to enable multidimensional simulation of the combustion characteristics of such fuels in real combustors. Such reliable kinetic models, validated against fundamental data derived from laminar flames using idealized flow models, are key to the development and design of optimal combustors and fuels. The models provide direct information about the relative contribution of different molecular constituents to the fuel performance and can be used to assess both combustion and emissions characteristics.

Meeks, Ellen↗

On the Reconstruction of Palaeo-Ice Sheets: Recent Advances and Future Challenges

Reconstructing the growth and decay of palaeo-ice sheets is critical to understanding mechanisms of global climate change and associated sea-level fluctuations in the past, present and future. The significance of palaeo-ice sheets is further underlined by the broad range of disciplines concerned with reconstructing their behaviour, many of which have undergone a rapid expansion since the 1980s. In particular, there has been a major increase in the size and qualitative diversity of empirical data used to reconstruct and date ice sheets, and major improvements in our ability to simulate their dynamics in numerical ice sheet models. These developments have made it increasingly necessary to forge interdisciplinary links between sub-disciplines and to link numerical modelling with observations and dating of proxy records. The aim of this paper is to evaluate recent developments in the methods used to reconstruct ice sheets and outline some key challenges that remain, with an emphasis on how future work might integrate terrestrial and marine evidence together with numerical modelling. Our focus is on pan-ice sheet reconstructions of the last deglaciation, but regional case studies are used to illustrate methodological achievements, challenges and opportunities. Whilst various disciplines have made important progress in our understanding of ice-sheet dynamics, it is clear that data-model integration remains under-used, and that uncertainties remain poorly quantified in both empirically-based and numerical ice-sheet reconstructions. The representation of past climate will continue to be the largest source of uncertainty for numerical modelling. As such, palaeo-observations are critical to constrain and validate modelling. State-of-the-art numerical models will continue to improve both in model resolution and in the breadth of inclusion of relevant processes, thereby enabling more accurate and more direct comparison with the increasing range of palaeo-observations. Thus, the capability is developing to use all relevant palaeo-records to more strongly constrain deglacial (and to a lesser extent pre-LGM) ice sheet evolution. In working towards that goal, the accurate representation of uncertainties is required for both constraint data and model outputs. Close cooperation between modelling and data-gathering communities is essential to ensure this capability is realised and continues to progress.

Ice sheet reconstruction↗

Machine Learning based Aircraft Performance Model Estimation for Trajectory Prediction

The accurate prediction of aircraft trajectory by ground-based decision support tools is a critical component of air traffic management in the US National Airspace System (NAS). Accurate predictions of where the aircraft will be in the future or when they will arrive at specific locations (e.g., fixes) is a key enabler for sequencing and efficient arrival management of flights. Traditional physics based aircraft trajectory prediction relies on a simplified point-mass total energy model whose parameters are referred to as Aircraft Performance Model (APM) parameters. Even though the performance coefficients and weight of an aircraft are a vital part of the aircraft performance model’s predictions and accuracy, these coefficients are proprietary in nature and therefore, unavailable to decision-support tools. Current approaches freeze some coefficients to default base of aircraft data (BADA) values and optimize others. However, the APM parameters are highly coupled by the flight dynamics and prioritizing one parameter over others leads to bias and skewed predictions. To alleviate this problem, we provide a combined optimization framework to predict all the critical (thrust, drag and weight) APM parameters. This paper is focused on training Machine Learning (ML) models that map historical flights to optimized APM parameters that provide the best fit (in terms of prediction error). Our dataset obtained from NASA’s Sherlock data warehouse is comprised of thousands of historical flights and includes weather and track data collected from 2019. Using different subsets of relevant features (e.g., aircraft type), we trained several ML models to estimate the aircraft’s take off weight, drag polar coefficients (both parasitic and lift induced), and thrust settings (multiplier applied to the maximum engine thrust). The chosen flights are from three of the most common aircraft types (B738, B737, and A320) arriving at four airports (LAX, DEN, MSP, and DFW). Our ML approach is comprised of two different solutions: 1- using a subset of features that are known prior to the flight departure and do not change during flight (such as engine type, current temperature at departure & destination airports, aircraft type) and 2 - using a subset of temporal features of the flight trajectory (such as cruise altitude, Mach, airspeed, and rate of climb) in addition to the pre-departure features from the first solution. The labels or target variables are the APM parameters that were obtained by an optimized ordinary differential equations (ODE) fitting process (applied to individual flights). The ODE-fitting is very time intensive and is therefore performed offline. Thus, training an ML model to learn the relationship between the flight features and ODE-generated labels enables faster estimation of the APM parameters and is therefore amenable to real-time prediction. Various ML models including linear regression, random forest, XGBoost, and neural network were trained, and the results are compared. After model validation and hyperparameter-tuning, we observed that the Random Forest model outperformed the other three models by the overall mean square error (MSE) of 2% for the first solution and 1.5% for the second solution. Finally, the ML-derived parameters are compared against default BADA APM parameters using NASA’s Autonomy Development toolkit (ADK) simulation software. The simulation results for one of each aircraft type is shown and discussed.

Aida Sharif Rohani↗

Validation of Community Models: 2. Development of a Baseline, Using the Wang-Sheeley-Arge Model

This paper is the second in a series providing independent validation of community models of the outer corona and inner heliosphere. Here I present a comprehensive validation of the Wang-Sheeley-Arge (WSA) model. These results will serve as a baseline against which to compare the next generation of comparable forecasting models. The WSA model is used by a number of agencies to predict Solar wind conditions at Earth up to 4 days into the future. Given its importance to both the research and forecasting communities, it is essential that its performance be measured systematically and independently. I offer just such an independent and systematic validation. I report skill scores for the model's predictions of wind speed and interplanetary magnetic field (IMF) polarity for a large set of Carrington rotations. The model was run in all its routinely used configurations. It ingests synoptic line of sight magnetograms. For this study I generated model results for monthly magnetograms from multiple observatories, spanning the Carrington rotation range from 1650 to 2074. I compare the influence of the different magnetogram sources and performance at quiet and active times. I also consider the ability of the WSA model to forecast both sharp transitions in wind speed from slow to fast wind and reversals in the polarity of the radial component of the IMF. These results will serve as a baseline against which to compare future versions of the model as well as the current and future generation of magnetohydrodynamic models under development for forecasting use.

MacNeice, Peter↗

Validation of implosion modeling through direct-drive shock timing experiments at the National Ignition Facility

Precise modeling of shocks in inertial confinement fusion implosions is critical for obtaining the desired compression in experiments. Shock velocities and post-shock conditions are determined by laser-energy deposition, heat conduction, and equations of state. This paper describes experiments at the National Ignition Facility (NIF) where multiple shocks are launched into a cone-in-shell target made of polystyrene, using laser pulse shapes with two or three pickets and varying on-target intensities. Shocks are diagnosed using the Velocity Interferometric System for Any Reflector diagnostic. Simulated and inferred shock velocities agree well for the range of intensities studied in this work. These results are the first shock-velocity measurements using direct drive on the NIF and provide a good measure of early-time, directly driven laser-energy coupling. Furthermore, the validated models add to the credibility of direct-drive-ignition designs at the megajoule scale.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Dynamic Model of Basic Oxygen Steelmaking Process Based on Multi-zone Reaction Kinetics: Model Derivation and Validation

A multi-zone kinetic model coupled with a dynamic slag generation model was developed for the simulation of hot metal and slag composition during the basic oxygen furnace (BOF) operation. The three reaction zones (i) jet impact zone, (ii) slag–bulk metal zone, (iii) slag–metal–gas emulsion zone were considered for the calculation of overall refining kinetics. In the rate equations, the transient rate parameters were mathematically described as a function of process variables. A micro and macroscopic rate calculation methodology (micro-kinetics and macro-kinetics) were developed to estimate the total refining contributed by the recirculating metal droplets through the slag–metal emulsion zone. The micro-kinetics involves developing the rate equation for individual droplets in the emulsion. The mathematical models for the size distribution of initial droplets, kinetics of simultaneous refining of elements, the residence time in the emulsion, and dynamic interfacial area change were established in the micro-kinetic model. In the macro-kinetics calculation, a droplet generation model was employed and the total amount of refining by emulsion was calculated by summing the refining from the entire population of returning droplets. A dynamic Fe{sub t}O generation model based on oxygen mass balance was developed and coupled with the multi-zone kinetic model. The effect of post-combustion on the evolution of slag and metal composition was investigated. The model was applied to a 200-ton top blowing converter and the simulated value of metal and slag was found to be in good agreement with the measured data. The post-combustion ratio was found to be an important factor in controlling Fe{sub t}O content in the slag and the kinetics of Mn and P in a BOF process.

36 MATERIALS SCIENCE↗

Comparison of Analytical and Numerical Performance Predictions for a Regenerative Heat Exchanger in the International Space Station Node 3 Internal Active Thermal Control System

The complexity of International Space Station (ISS) systems modeling often necessitates the concurrence of various dissimilar, parallel analysis techniques to validate modeling. This was the case with a feasibility and performance study of the ISS Node 3 Regenerative Heat Exchanger (RHX). A thermo-hydraulic network model was created and analyzed in SINDA/FLUINT. A less complex, closed form solution of the system dynamics was created using Excel. The purpose of this paper is to provide a brief description of the modeling processes utilized, the results and benefits of each to the ISS Node 3 RHX study.

Wise, Stephen A.↗

Comparison of Analytical and Numerical Performance Predictions for an International Space Station Node 3 Internal Active Thermal Control System Regenerative Heat Exchanger

The complexity of International Space Station (ISS) systems modeling often necessitates the concurrence of various dissimilar, parallel analysis techniques to validate modeling. This was the case with a feasibility and performance study of the ISS Node 3 Regenerative Heat Exchanger (RHX). A thermo-hydraulic network model was created and analyzed in SINDA/FLUINT. A less complex, closed form solution of the systems dynamics was created using an Excel Spreadsheet. The purpose of this paper is to provide a brief description of the modeling processes utilized, the results and benefits of each to the ISS Node 3 RHX study.

Wise, Stephen A.↗

Structural Test and Analysis of a Hybrid Inflatable Antenna

NASA is developing ultra-lightweight structures technology for communication antennas for space missions. One of the research goals is to evaluate the structural characteristics of inflatable and rigidizable antennas through test and analysis. Being able to test and analyze the structural characteristics of a full scale antenna is important to enable the simulation of various mission scenarios to determine system performance in space. Recent work completed to evaluate a Hybrid Inflatable Antenna concept will be discussed. Tests were completed on a 2-m prototype to optimize its static shape and identify its modal dynamics that are important for analytical model validation. These test results were used to evaluate a preliminary finite element model of the antenna, and this model development and correlation activity is also described in the paper.

Gaspar, James L.↗

Numerical Model Development and Validation for the WECCOMP Control Competition: Preprint

This paper details the development and validation of a numerical model of the Wavestar wave energy converter (WEC) in WEC-Sim. This numerical model was developed in support of the WEC Control Competition (WECCCOMP), an open competition with the objective of maximizing WEC power production through innovative control strategies. WECCCOMP has two stages: numerical implementation of control strategies, and experimental implementation. The work presented in this paper is for support of the stage one numerical implementation, where contestants are provided a WEC-Sim model of the Wavestar device to develop their control algorithms.

16 TIDAL AND WAVE POWER↗