Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model Validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26

Validation of Universal Cryogenic Flow Boiling Correlations in Thermal Desktop for Liquid Hydrogen

Developing accurate models of two-phase cryogenic flow will reduce risk and reduce margins for future NASA vehicles such as the Nuclear Thermal Propulsion (NTP) system. Currently there is a need for more accurate, direct cryogenic data-anchored models for various boiling and two-phase phenomena. The focus of the current work is on modeling steady state cryogenic flow boiling in the transfer line that connects a propellant storage tank to an engine or customer receiver tank. This paper presents Thermal Desktop model validation results against several historical liquid hydrogen (LH2) heated tube experiments that cover a wide range of inlet conditions, mass flux, and heat flux. New universal cryogenic flow boiling correlations were recently developed and anchored to the largest cryogenic flow boiling database assembled in the world to-date. The new universal correlations are patched together and implemented into Thermal Desktop to compare model performance against the built-in flow boiling correlations. Axial wall temperature predictions as a function of preponderant parameters like heat flux, mass flux, inlet pressure, inlet quality, tube diameter, etc. using the two sets of flow boiling correlations are compared against the experimental data. Overall, the Thermal Desktop model with the new universal cryogenic flow boiling correlations demonstrates an improvement in predictive performance over the Thermal Desktop model using built-in correlations for both wall temperature and location of critical heat flux compared to the data for LH2 flow boiling in heated tubes.

Cryogenic Propellant Transfer↗

Validation of Universal Cryogenic Flow Boiling Correlations in Thermal Desktop for Liquid Hydrogen

Developing accurate models of two-phase cryogenic flow will reduce risk and reduce margins for future NASA vehicles such as the Nuclear Thermal Propulsion (NTP) system. Currently there is a need for more accurate, direct cryogenic data-anchored models for various boiling and two-phase phenomena. The focus of the current work is on modeling steady state cryogenic flow boiling in the transfer line that connects a propellant storage tank to an engine or customer receiver tank. This paper presents Thermal Desktop model validation results against several historical liquid hydrogen (LH2) heated tube experiments that cover a wide range of inlet conditions, mass flux, and heat flux. New universal cryogenic flow boiling correlations were recently developed and anchored to the largest cryogenic flow boiling database assembled in the world to-date. The new universal correlations are patched together and implemented into Thermal Desktop to compare model performance against the built-in flow boiling correlations. Axial wall temperature predictions as a function of preponderant parameters like heat flux, mass flux, inlet pressure, inlet quality, tube diameter, etc. using the two sets of flow boiling correlations are compared against the experimental data. Overall, the Thermal Desktop model with the new universal cryogenic flow boiling correlations demonstrates an improvement in predictive performance over the Thermal Desktop model using built-in correlations for both wall temperature and location of critical heat flux compared to the data for LH2 flow boiling in heated tubes.

cryogenic propellant transfer↗

SLS Navigation Model-Based Design Approach

The SLS Program chose to implement a Model-based Design and Model-based Requirements approach for managing component design information and system requirements. This approach differs from previous large-scale design efforts at Marshall Space Flight Center where design documentation alone conveyed information required for vehicle design and analysis and where extensive requirements sets were used to scope and constrain the design. The SLS Navigation Team has been responsible for the Program-controlled Design Math Models (DMMs) which describe and represent the performance of the Inertial Navigation System (INS) and the Rate Gyro Assemblies (RGAs) used by Guidance, Navigation, and Controls (GN&C). The SLS Navigation Team is also responsible for the navigation algorithms. The navigation algorithms are delivered for implementation on the flight hardware as a DMM. For the SLS Block 1-B design, the additional GPS Receiver hardware is managed as a DMM at the vehicle design level. This paper provides a discussion of the processes and methods used to engineer, design, and coordinate engineering trades and performance assessments using SLS practices as applied to the GN&C system, with a particular focus on the Navigation components. These include composing system requirements, requirements verification, model development, model verification and validation, and modeling and analysis approaches. The Model-based Design and Requirements approach does not reduce the effort associated with the design process versus previous processes used at Marshall Space Flight Center. Instead, the approach takes advantage of overlap between the requirements development and management process, and the design and analysis process by efficiently combining the control (i.e. the requirement) and the design mechanisms. The design mechanism is the representation of the component behavior and performance in design and analysis tools. The focus in the early design process shifts from the development and management of design requirements to the development of usable models, model requirements, and model verification and validation efforts. The models themselves are represented in C/C++ code and accompanying data files. Under the idealized process, potential ambiguity in specification is reduced because the model must be implementable versus a requirement which is not necessarily subject to this constraint. Further, the models are shown to emulate the hardware during validation. For models developed by the Navigation Team, a common interface/standalone environment was developed. The common environment allows for easy implementation in design and analysis tools. Mechanisms such as unit test cases ensure implementation as the developer intended. The model verification and validation process provides a very high level of component design insight. The origin and implementation of the SLS variant of Model-based Design is described from the perspective of the SLS Navigation Team. The format of the models and the requirements are described. The Model-based Design approach has many benefits but is not without potential complications. Key lessons learned associated with the implementation of the Model Based Design approach and process from infancy to verification and certification are discussed

Oliver, T. Emerson↗

Suited and Unsuited Hybrid III Impact Testing and Finite Element Model Characterization

NASA spacecraft design requirements for occupant protection are a combination of the Brinkley Dynamic Response Criteria and injury assessment reference values (IARV) extracted from anthropomorphic test devices (ATD). For the ATD IARVs, the requirements specify the use of the 5th percentile female Hybrid III and the 95th percentile male Hybrid III. Each of these ATDs is required to be fitted with an articulating pelvis (also known as the aerospace pelvis) and a straight spine. The articulating pelvis is necessary for the ATD to fit into spacecraft seats, while the straight spine is required as injury metrics for vertical accelerations are better defined for this configuration. Sled testing of the Hybrid III 5th Percentile Female Anthropomorphic Test Device (ATD) was performed at Wright-Patterson Air Force Base (WAPFB). Two 5th Percentile ATDs were tested, the Air Force Research Lab (AFRL) and NASA owned Hybrid III ATDs with aerospace pelvises. Testing was also conducted with a NASA-owned 95th Percentile Male Hybrid III with aerospace pelvis at WPAFB. Testing was performed using an Orion seat prototype provided by Johnson Space Center (JSC). A 5-point harness comprised of 2 inch webbing was also provided by JSC. For suited runs, a small and extra-large Advanced Crew Escape System (ACES) suit and helmet were also provided by JSC. Impact vectors were combined frontal/spinal and rear/lateral. Some pure spinal and rear axis testing was also performed for model validation. Peak accelerations ranged between 15 and 20-g. This range was targeted because the ATD responses fell close to the IARV defined in the Human-Systems Integration Requirements (HSIR) document. Rise times varied between 70 and 110 ms to assess differences in ATD responses and model correlation for different impact energies. The purpose of the test series was to evaluate the Hybrid III ATD models in Orion-specific landing orientations both with and without a spacesuit. The results of these tests were used by the NASA Engineering and Safety Center (NESC) to validate the finite element model (FEM) of the Hybrid III 5th Percentile Female ATD. Physical test data was compared to analytical predictions from simulations, and modelling uncertainty factors have been determined for each injury metric. Additionally, the test data has been used to further improve the FEM, particularly in the areas of the ATD preload, harness, and suit and helmet effects.

Lawrence, C.↗

Experimental and Modeling Studies of the Combustion Characteristics of Conventional and Alternative Jet Fuels. Final Report

The objectives of this project have been to develop a comprehensive set of fundamental data regarding the combustion behavior of jet fuels and appropriately associated model fuels. Based on the fundamental study results, an auxiliary objective was to identify differentiating characteristics of molecular fuel components that can be used to explain different fuel behavior and that may ultimately be used in the planning and design of optimal fuel-production processes. The fuels studied in this project were Fischer-Tropsch (F-T) fuels and biomass-derived jet fuels that meet certain specifications of currently used jet propulsion applications. Prior to this project, there were no systematic experimental flame data available for such fuels. One of the key goals has been to generate such data, and to use this data in developing and verifying effective kinetic models. The models have then been reduced through automated means to enable multidimensional simulation of the combustion characteristics of such fuels in real combustors. Such reliable kinetic models, validated against fundamental data derived from laminar flames using idealized flow models, are key to the development and design of optimal combustors and fuels. The models provide direct information about the relative contribution of different molecular constituents to the fuel performance and can be used to assess both combustion and emissions characteristics.

Meeks, Ellen↗

On the Reconstruction of Palaeo-Ice Sheets: Recent Advances and Future Challenges

Reconstructing the growth and decay of palaeo-ice sheets is critical to understanding mechanisms of global climate change and associated sea-level fluctuations in the past, present and future. The significance of palaeo-ice sheets is further underlined by the broad range of disciplines concerned with reconstructing their behaviour, many of which have undergone a rapid expansion since the 1980s. In particular, there has been a major increase in the size and qualitative diversity of empirical data used to reconstruct and date ice sheets, and major improvements in our ability to simulate their dynamics in numerical ice sheet models. These developments have made it increasingly necessary to forge interdisciplinary links between sub-disciplines and to link numerical modelling with observations and dating of proxy records. The aim of this paper is to evaluate recent developments in the methods used to reconstruct ice sheets and outline some key challenges that remain, with an emphasis on how future work might integrate terrestrial and marine evidence together with numerical modelling. Our focus is on pan-ice sheet reconstructions of the last deglaciation, but regional case studies are used to illustrate methodological achievements, challenges and opportunities. Whilst various disciplines have made important progress in our understanding of ice-sheet dynamics, it is clear that data-model integration remains under-used, and that uncertainties remain poorly quantified in both empirically-based and numerical ice-sheet reconstructions. The representation of past climate will continue to be the largest source of uncertainty for numerical modelling. As such, palaeo-observations are critical to constrain and validate modelling. State-of-the-art numerical models will continue to improve both in model resolution and in the breadth of inclusion of relevant processes, thereby enabling more accurate and more direct comparison with the increasing range of palaeo-observations. Thus, the capability is developing to use all relevant palaeo-records to more strongly constrain deglacial (and to a lesser extent pre-LGM) ice sheet evolution. In working towards that goal, the accurate representation of uncertainties is required for both constraint data and model outputs. Close cooperation between modelling and data-gathering communities is essential to ensure this capability is realised and continues to progress.

Ice sheet reconstruction↗

Machine Learning based Aircraft Performance Model Estimation for Trajectory Prediction

The accurate prediction of aircraft trajectory by ground-based decision support tools is a critical component of air traffic management in the US National Airspace System (NAS). Accurate predictions of where the aircraft will be in the future or when they will arrive at specific locations (e.g., fixes) is a key enabler for sequencing and efficient arrival management of flights. Traditional physics based aircraft trajectory prediction relies on a simplified point-mass total energy model whose parameters are referred to as Aircraft Performance Model (APM) parameters. Even though the performance coefficients and weight of an aircraft are a vital part of the aircraft performance model’s predictions and accuracy, these coefficients are proprietary in nature and therefore, unavailable to decision-support tools. Current approaches freeze some coefficients to default base of aircraft data (BADA) values and optimize others. However, the APM parameters are highly coupled by the flight dynamics and prioritizing one parameter over others leads to bias and skewed predictions. To alleviate this problem, we provide a combined optimization framework to predict all the critical (thrust, drag and weight) APM parameters. This paper is focused on training Machine Learning (ML) models that map historical flights to optimized APM parameters that provide the best fit (in terms of prediction error). Our dataset obtained from NASA’s Sherlock data warehouse is comprised of thousands of historical flights and includes weather and track data collected from 2019. Using different subsets of relevant features (e.g., aircraft type), we trained several ML models to estimate the aircraft’s take off weight, drag polar coefficients (both parasitic and lift induced), and thrust settings (multiplier applied to the maximum engine thrust). The chosen flights are from three of the most common aircraft types (B738, B737, and A320) arriving at four airports (LAX, DEN, MSP, and DFW). Our ML approach is comprised of two different solutions: 1- using a subset of features that are known prior to the flight departure and do not change during flight (such as engine type, current temperature at departure & destination airports, aircraft type) and 2 - using a subset of temporal features of the flight trajectory (such as cruise altitude, Mach, airspeed, and rate of climb) in addition to the pre-departure features from the first solution. The labels or target variables are the APM parameters that were obtained by an optimized ordinary differential equations (ODE) fitting process (applied to individual flights). The ODE-fitting is very time intensive and is therefore performed offline. Thus, training an ML model to learn the relationship between the flight features and ODE-generated labels enables faster estimation of the APM parameters and is therefore amenable to real-time prediction. Various ML models including linear regression, random forest, XGBoost, and neural network were trained, and the results are compared. After model validation and hyperparameter-tuning, we observed that the Random Forest model outperformed the other three models by the overall mean square error (MSE) of 2% for the first solution and 1.5% for the second solution. Finally, the ML-derived parameters are compared against default BADA APM parameters using NASA’s Autonomy Development toolkit (ADK) simulation software. The simulation results for one of each aircraft type is shown and discussed.

Aida Sharif Rohani↗

Validation of Community Models: 2. Development of a Baseline, Using the Wang-Sheeley-Arge Model

This paper is the second in a series providing independent validation of community models of the outer corona and inner heliosphere. Here I present a comprehensive validation of the Wang-Sheeley-Arge (WSA) model. These results will serve as a baseline against which to compare the next generation of comparable forecasting models. The WSA model is used by a number of agencies to predict Solar wind conditions at Earth up to 4 days into the future. Given its importance to both the research and forecasting communities, it is essential that its performance be measured systematically and independently. I offer just such an independent and systematic validation. I report skill scores for the model's predictions of wind speed and interplanetary magnetic field (IMF) polarity for a large set of Carrington rotations. The model was run in all its routinely used configurations. It ingests synoptic line of sight magnetograms. For this study I generated model results for monthly magnetograms from multiple observatories, spanning the Carrington rotation range from 1650 to 2074. I compare the influence of the different magnetogram sources and performance at quiet and active times. I also consider the ability of the WSA model to forecast both sharp transitions in wind speed from slow to fast wind and reversals in the polarity of the radial component of the IMF. These results will serve as a baseline against which to compare future versions of the model as well as the current and future generation of magnetohydrodynamic models under development for forecasting use.

MacNeice, Peter↗

Comparison of Analytical and Numerical Performance Predictions for a Regenerative Heat Exchanger in the International Space Station Node 3 Internal Active Thermal Control System

The complexity of International Space Station (ISS) systems modeling often necessitates the concurrence of various dissimilar, parallel analysis techniques to validate modeling. This was the case with a feasibility and performance study of the ISS Node 3 Regenerative Heat Exchanger (RHX). A thermo-hydraulic network model was created and analyzed in SINDA/FLUINT. A less complex, closed form solution of the system dynamics was created using Excel. The purpose of this paper is to provide a brief description of the modeling processes utilized, the results and benefits of each to the ISS Node 3 RHX study.

Wise, Stephen A.↗

Comparison of Analytical and Numerical Performance Predictions for an International Space Station Node 3 Internal Active Thermal Control System Regenerative Heat Exchanger

The complexity of International Space Station (ISS) systems modeling often necessitates the concurrence of various dissimilar, parallel analysis techniques to validate modeling. This was the case with a feasibility and performance study of the ISS Node 3 Regenerative Heat Exchanger (RHX). A thermo-hydraulic network model was created and analyzed in SINDA/FLUINT. A less complex, closed form solution of the systems dynamics was created using an Excel Spreadsheet. The purpose of this paper is to provide a brief description of the modeling processes utilized, the results and benefits of each to the ISS Node 3 RHX study.

Wise, Stephen A.↗

Structural Test and Analysis of a Hybrid Inflatable Antenna

NASA is developing ultra-lightweight structures technology for communication antennas for space missions. One of the research goals is to evaluate the structural characteristics of inflatable and rigidizable antennas through test and analysis. Being able to test and analyze the structural characteristics of a full scale antenna is important to enable the simulation of various mission scenarios to determine system performance in space. Recent work completed to evaluate a Hybrid Inflatable Antenna concept will be discussed. Tests were completed on a 2-m prototype to optimize its static shape and identify its modal dynamics that are important for analytical model validation. These test results were used to evaluate a preliminary finite element model of the antenna, and this model development and correlation activity is also described in the paper.

Gaspar, James L.↗

“Max-tech FHR”: What is the maximum technically achievable water delivery capacity from a single 120 V plug?

Electrifying water heating will require affordable, direct drop-in replacements for existing gas water heaters that meet consumer expectations for hot water delivery. For many replacement scenarios, affordability requires a replacement option with like-for-like physical product dimensions, and existing consumer expectations presume a large delivery capacity from a small water heater. This work explores the technical potential for hot water delivery capacity for a heat pump water heater (HPWH) powered from a common 120 V plug. Delivery capability in this work is quantified by two metrics: the First Hour Rating (FHR) defined in the Code of Federal Regulations, and a real-world draw profile that resulted in hot water runout during field studies of 120 V HPWHs. The work focuses on the common “tall-and-slim” gas water heater product category, with external product dimensions of 20 inch diameter and 60 inch height. Using a simulation model in DOE/ORNL Heat Pump Design Model, validated by experimental baseline testing of a commercially available 120 V HPWH model, several measures were evaluated to maximize the delivery capacity of a 120 V HPWH. The 120 V HPWH was constrained by 1) external product dimensions of 20 in diameter and 60 inch height, 2) electrical power of 1.5 kW (85% of the available power from a dedicated 120 V, 15 A circuit), and 3) commercially-available components. The measures implemented included a large compressor, a pumped loop with plate heat exchanger to maximize tank stratification, enlarged heat exchangers, and relatively thin insulation to maximize the water storage volume.

Gluesenkamp, Kyle↗

Active Aeroelastic Wing Aerodynamic Model Development and Validation for a Modified F/A-18A

A new aerodynamic model has been developed and validated for a modified F/A-18A used for the Active Aeroelastic Wing (AAW) research program. The goal of the program was to demonstrate the advantages of using the inherent flexibility of an aircraft to enhance its performance. The research aircraft was an F/A-18A with wings modified to reduce stiffness and a new control system to increase control authority. There have been two flight phases. Data gathered from the first flight phase were used to create the new aerodynamic model. A maximum-likelihood output-error parameter estimation technique was used to obtain stability and control derivatives. The derivatives were incorporated into the National Aeronautics and Space Administration F-18 simulation, validated, and used to develop new AAW control laws. The second phase of flights was used to evaluate the handling qualities of the AAW aircraft and the control law design process, and to further test the accuracy of the new model. The flight test envelope covered Mach numbers between 0.85 and 1.30 and dynamic pressures from 600 to 1250 pound-force per square foot. The results presented in this report demonstrate that a thorough parameter identification analysis can be used to improve upon models that were developed using other means. This report describes the parameter estimation technique used, details the validation techniques, discusses differences between previously existing F/A-18 models, and presents results from the second phase of research flights.

Cumming, Stephen B.↗

OmicsMLMentor: A Web Application for Guided Machine Learning Analysis of Omics Data

Expression-based omics technologies (e.g. proteomics, metabolomics, transcriptomics, etc.) increasingly rely on supervised and unsupervised machine learning (ML) models to find key biomolecules distinguishing conditions, identify natural groupings in biological data, or generate predictions for outcomes of interest. Fitting ML models to omics data presents several challenges, including handling missing data, selecting a normalization method, choosing a valid model, and optimizing hyperparameters, all requiring statistical programming skills to address these challenges. Thus, the open-source web application SLOPE was designed to lower the barrier to ML modeling for omics data. SLOPE supports the fitting of 15 ML models (10 supervised and 5 unsupervised) tailored to omics datasets, such as proteomics, metabolomics, lipidomics, and transcriptomics. SLOPE offers several omics-specific features, including methods for handling missingness (imputation, conversion, removal), normalization tests, ranking of models based on the structure of a user’s data and user input, and optimal hyperparameter selections using cross-validation splits. By streamlining ML workflows for omics analysis, SLOPE address critical gaps in existing online web tools, facilitating a broader adoption of these models for omics research. Here, SLOPE is applied to data from a lignin exposure study to highlight the workflow for fitting both supervised and unsupervised models to data.

lipidomics↗

The Double-edged Sword of Data-driven Super-Resolution: Adversarial Super-resolution Models

Data-driven super-resolution (SR) methods are often integrated into imaging pipelines as preprocessing steps to improve downstream tasks such as classification and detection. However, these SR models introduce a previously unexplored attack surface into imaging pipelines. In this paper, we present AdvSR, a framework demonstrating that adversarial behavior can be embedded directly into SR model weights during training, requiring no access to inputs at inference time. Unlike prior attacks that perturb inputs or rely on backdoor triggers, AdvSR operates entirely at the model level. By jointly optimizing for reconstruction quality and targeted adversarial outcomes, AdvSR produces models that appear benign under standard image quality metrics while inducing downstream misclassification. We evaluate AdvSR on three SR architectures (SRCNN, EDSR, SwinIR) paired with a YOLOv11 classifier and demonstrate that AdvSR models can achieve high attack success rates with minimal quality degradation. These findings highlight a new model-level threat for imaging pipelines, with implications for how practitioners source and validate models in safety-critical applications.

Sullivan, Haley [ORNL] (ORCID:0000000274069217)↗

Time series modeling of human operator dynamics in manual control tasks

A time-series technique is presented for identifying the dynamic characteristics of the human operator in manual control tasks from relatively short records of experimental data. Control of system excitation signals used in the identification is not required. The approach is a multi-channel identification technique for modeling multi-input/multi-output situations. The method presented includes statistical tests for validity, is designed for digital computation, and yields estimates for the frequency responses of the human operator. A comprehensive relative power analysis may also be performed for validated models. This method is applied to several sets of experimental data; the results are discussed and shown to compare favorably with previous research findings. New results are also presented for a multi-input task that has not been previously modeled to demonstrate the strengths of the method.

Biezad, D. J.↗

Time Series Modeling of Human Operator Dynamics in Manual Control Tasks

A time-series technique is presented for identifying the dynamic characteristics of the human operator in manual control tasks from relatively short records of experimental data. Control of system excitation signals used in the identification is not required. The approach is a multi-channel identification technique for modeling multi-input/multi-output situations. The method presented includes statistical tests for validity, is designed for digital computation, and yields estimates for the frequency response of the human operator. A comprehensive relative power analysis may also be performed for validated models. This method is applied to several sets of experimental data; the results are discussed and shown to compare favorably with previous research findings. New results are also presented for a multi-input task that was previously modeled to demonstrate the strengths of the method.

Biezad, D. J.↗