Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47

Experimental and Modeling Studies of the Combustion Characteristics of Conventional and Alternative Jet Fuels. Final Report

The objectives of this project have been to develop a comprehensive set of fundamental data regarding the combustion behavior of jet fuels and appropriately associated model fuels. Based on the fundamental study results, an auxiliary objective was to identify differentiating characteristics of molecular fuel components that can be used to explain different fuel behavior and that may ultimately be used in the planning and design of optimal fuel-production processes. The fuels studied in this project were Fischer-Tropsch (F-T) fuels and biomass-derived jet fuels that meet certain specifications of currently used jet propulsion applications. Prior to this project, there were no systematic experimental flame data available for such fuels. One of the key goals has been to generate such data, and to use this data in developing and verifying effective kinetic models. The models have then been reduced through automated means to enable multidimensional simulation of the combustion characteristics of such fuels in real combustors. Such reliable kinetic models, validated against fundamental data derived from laminar flames using idealized flow models, are key to the development and design of optimal combustors and fuels. The models provide direct information about the relative contribution of different molecular constituents to the fuel performance and can be used to assess both combustion and emissions characteristics.

Meeks, Ellen↗

On the Reconstruction of Palaeo-Ice Sheets: Recent Advances and Future Challenges

Reconstructing the growth and decay of palaeo-ice sheets is critical to understanding mechanisms of global climate change and associated sea-level fluctuations in the past, present and future. The significance of palaeo-ice sheets is further underlined by the broad range of disciplines concerned with reconstructing their behaviour, many of which have undergone a rapid expansion since the 1980s. In particular, there has been a major increase in the size and qualitative diversity of empirical data used to reconstruct and date ice sheets, and major improvements in our ability to simulate their dynamics in numerical ice sheet models. These developments have made it increasingly necessary to forge interdisciplinary links between sub-disciplines and to link numerical modelling with observations and dating of proxy records. The aim of this paper is to evaluate recent developments in the methods used to reconstruct ice sheets and outline some key challenges that remain, with an emphasis on how future work might integrate terrestrial and marine evidence together with numerical modelling. Our focus is on pan-ice sheet reconstructions of the last deglaciation, but regional case studies are used to illustrate methodological achievements, challenges and opportunities. Whilst various disciplines have made important progress in our understanding of ice-sheet dynamics, it is clear that data-model integration remains under-used, and that uncertainties remain poorly quantified in both empirically-based and numerical ice-sheet reconstructions. The representation of past climate will continue to be the largest source of uncertainty for numerical modelling. As such, palaeo-observations are critical to constrain and validate modelling. State-of-the-art numerical models will continue to improve both in model resolution and in the breadth of inclusion of relevant processes, thereby enabling more accurate and more direct comparison with the increasing range of palaeo-observations. Thus, the capability is developing to use all relevant palaeo-records to more strongly constrain deglacial (and to a lesser extent pre-LGM) ice sheet evolution. In working towards that goal, the accurate representation of uncertainties is required for both constraint data and model outputs. Close cooperation between modelling and data-gathering communities is essential to ensure this capability is realised and continues to progress.

Ice sheet reconstruction↗

Machine Learning based Aircraft Performance Model Estimation for Trajectory Prediction

The accurate prediction of aircraft trajectory by ground-based decision support tools is a critical component of air traffic management in the US National Airspace System (NAS). Accurate predictions of where the aircraft will be in the future or when they will arrive at specific locations (e.g., fixes) is a key enabler for sequencing and efficient arrival management of flights. Traditional physics based aircraft trajectory prediction relies on a simplified point-mass total energy model whose parameters are referred to as Aircraft Performance Model (APM) parameters. Even though the performance coefficients and weight of an aircraft are a vital part of the aircraft performance model’s predictions and accuracy, these coefficients are proprietary in nature and therefore, unavailable to decision-support tools. Current approaches freeze some coefficients to default base of aircraft data (BADA) values and optimize others. However, the APM parameters are highly coupled by the flight dynamics and prioritizing one parameter over others leads to bias and skewed predictions. To alleviate this problem, we provide a combined optimization framework to predict all the critical (thrust, drag and weight) APM parameters. This paper is focused on training Machine Learning (ML) models that map historical flights to optimized APM parameters that provide the best fit (in terms of prediction error). Our dataset obtained from NASA’s Sherlock data warehouse is comprised of thousands of historical flights and includes weather and track data collected from 2019. Using different subsets of relevant features (e.g., aircraft type), we trained several ML models to estimate the aircraft’s take off weight, drag polar coefficients (both parasitic and lift induced), and thrust settings (multiplier applied to the maximum engine thrust). The chosen flights are from three of the most common aircraft types (B738, B737, and A320) arriving at four airports (LAX, DEN, MSP, and DFW). Our ML approach is comprised of two different solutions: 1- using a subset of features that are known prior to the flight departure and do not change during flight (such as engine type, current temperature at departure & destination airports, aircraft type) and 2 - using a subset of temporal features of the flight trajectory (such as cruise altitude, Mach, airspeed, and rate of climb) in addition to the pre-departure features from the first solution. The labels or target variables are the APM parameters that were obtained by an optimized ordinary differential equations (ODE) fitting process (applied to individual flights). The ODE-fitting is very time intensive and is therefore performed offline. Thus, training an ML model to learn the relationship between the flight features and ODE-generated labels enables faster estimation of the APM parameters and is therefore amenable to real-time prediction. Various ML models including linear regression, random forest, XGBoost, and neural network were trained, and the results are compared. After model validation and hyperparameter-tuning, we observed that the Random Forest model outperformed the other three models by the overall mean square error (MSE) of 2% for the first solution and 1.5% for the second solution. Finally, the ML-derived parameters are compared against default BADA APM parameters using NASA’s Autonomy Development toolkit (ADK) simulation software. The simulation results for one of each aircraft type is shown and discussed.

Aida Sharif Rohani↗

Validation of Community Models: 2. Development of a Baseline, Using the Wang-Sheeley-Arge Model

This paper is the second in a series providing independent validation of community models of the outer corona and inner heliosphere. Here I present a comprehensive validation of the Wang-Sheeley-Arge (WSA) model. These results will serve as a baseline against which to compare the next generation of comparable forecasting models. The WSA model is used by a number of agencies to predict Solar wind conditions at Earth up to 4 days into the future. Given its importance to both the research and forecasting communities, it is essential that its performance be measured systematically and independently. I offer just such an independent and systematic validation. I report skill scores for the model's predictions of wind speed and interplanetary magnetic field (IMF) polarity for a large set of Carrington rotations. The model was run in all its routinely used configurations. It ingests synoptic line of sight magnetograms. For this study I generated model results for monthly magnetograms from multiple observatories, spanning the Carrington rotation range from 1650 to 2074. I compare the influence of the different magnetogram sources and performance at quiet and active times. I also consider the ability of the WSA model to forecast both sharp transitions in wind speed from slow to fast wind and reversals in the polarity of the radial component of the IMF. These results will serve as a baseline against which to compare future versions of the model as well as the current and future generation of magnetohydrodynamic models under development for forecasting use.

MacNeice, Peter↗

Validation of implosion modeling through direct-drive shock timing experiments at the National Ignition Facility

Precise modeling of shocks in inertial confinement fusion implosions is critical for obtaining the desired compression in experiments. Shock velocities and post-shock conditions are determined by laser-energy deposition, heat conduction, and equations of state. This paper describes experiments at the National Ignition Facility (NIF) where multiple shocks are launched into a cone-in-shell target made of polystyrene, using laser pulse shapes with two or three pickets and varying on-target intensities. Shocks are diagnosed using the Velocity Interferometric System for Any Reflector diagnostic. Simulated and inferred shock velocities agree well for the range of intensities studied in this work. These results are the first shock-velocity measurements using direct drive on the NIF and provide a good measure of early-time, directly driven laser-energy coupling. Furthermore, the validated models add to the credibility of direct-drive-ignition designs at the megajoule scale.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Dynamic Model of Basic Oxygen Steelmaking Process Based on Multi-zone Reaction Kinetics: Model Derivation and Validation

A multi-zone kinetic model coupled with a dynamic slag generation model was developed for the simulation of hot metal and slag composition during the basic oxygen furnace (BOF) operation. The three reaction zones (i) jet impact zone, (ii) slag–bulk metal zone, (iii) slag–metal–gas emulsion zone were considered for the calculation of overall refining kinetics. In the rate equations, the transient rate parameters were mathematically described as a function of process variables. A micro and macroscopic rate calculation methodology (micro-kinetics and macro-kinetics) were developed to estimate the total refining contributed by the recirculating metal droplets through the slag–metal emulsion zone. The micro-kinetics involves developing the rate equation for individual droplets in the emulsion. The mathematical models for the size distribution of initial droplets, kinetics of simultaneous refining of elements, the residence time in the emulsion, and dynamic interfacial area change were established in the micro-kinetic model. In the macro-kinetics calculation, a droplet generation model was employed and the total amount of refining by emulsion was calculated by summing the refining from the entire population of returning droplets. A dynamic Fe{sub t}O generation model based on oxygen mass balance was developed and coupled with the multi-zone kinetic model. The effect of post-combustion on the evolution of slag and metal composition was investigated. The model was applied to a 200-ton top blowing converter and the simulated value of metal and slag was found to be in good agreement with the measured data. The post-combustion ratio was found to be an important factor in controlling Fe{sub t}O content in the slag and the kinetics of Mn and P in a BOF process.

36 MATERIALS SCIENCE↗

Comparison of Analytical and Numerical Performance Predictions for a Regenerative Heat Exchanger in the International Space Station Node 3 Internal Active Thermal Control System

The complexity of International Space Station (ISS) systems modeling often necessitates the concurrence of various dissimilar, parallel analysis techniques to validate modeling. This was the case with a feasibility and performance study of the ISS Node 3 Regenerative Heat Exchanger (RHX). A thermo-hydraulic network model was created and analyzed in SINDA/FLUINT. A less complex, closed form solution of the system dynamics was created using Excel. The purpose of this paper is to provide a brief description of the modeling processes utilized, the results and benefits of each to the ISS Node 3 RHX study.

Wise, Stephen A.↗

Comparison of Analytical and Numerical Performance Predictions for an International Space Station Node 3 Internal Active Thermal Control System Regenerative Heat Exchanger

The complexity of International Space Station (ISS) systems modeling often necessitates the concurrence of various dissimilar, parallel analysis techniques to validate modeling. This was the case with a feasibility and performance study of the ISS Node 3 Regenerative Heat Exchanger (RHX). A thermo-hydraulic network model was created and analyzed in SINDA/FLUINT. A less complex, closed form solution of the systems dynamics was created using an Excel Spreadsheet. The purpose of this paper is to provide a brief description of the modeling processes utilized, the results and benefits of each to the ISS Node 3 RHX study.

Wise, Stephen A.↗

Structural Test and Analysis of a Hybrid Inflatable Antenna

NASA is developing ultra-lightweight structures technology for communication antennas for space missions. One of the research goals is to evaluate the structural characteristics of inflatable and rigidizable antennas through test and analysis. Being able to test and analyze the structural characteristics of a full scale antenna is important to enable the simulation of various mission scenarios to determine system performance in space. Recent work completed to evaluate a Hybrid Inflatable Antenna concept will be discussed. Tests were completed on a 2-m prototype to optimize its static shape and identify its modal dynamics that are important for analytical model validation. These test results were used to evaluate a preliminary finite element model of the antenna, and this model development and correlation activity is also described in the paper.

Gaspar, James L.↗

Numerical Model Development and Validation for the WECCOMP Control Competition: Preprint

This paper details the development and validation of a numerical model of the Wavestar wave energy converter (WEC) in WEC-Sim. This numerical model was developed in support of the WEC Control Competition (WECCCOMP), an open competition with the objective of maximizing WEC power production through innovative control strategies. WECCCOMP has two stages: numerical implementation of control strategies, and experimental implementation. The work presented in this paper is for support of the stage one numerical implementation, where contestants are provided a WEC-Sim model of the Wavestar device to develop their control algorithms.

16 TIDAL AND WAVE POWER↗

“Max-tech FHR”: What is the maximum technically achievable water delivery capacity from a single 120 V plug?

Electrifying water heating will require affordable, direct drop-in replacements for existing gas water heaters that meet consumer expectations for hot water delivery. For many replacement scenarios, affordability requires a replacement option with like-for-like physical product dimensions, and existing consumer expectations presume a large delivery capacity from a small water heater. This work explores the technical potential for hot water delivery capacity for a heat pump water heater (HPWH) powered from a common 120 V plug. Delivery capability in this work is quantified by two metrics: the First Hour Rating (FHR) defined in the Code of Federal Regulations, and a real-world draw profile that resulted in hot water runout during field studies of 120 V HPWHs. The work focuses on the common “tall-and-slim” gas water heater product category, with external product dimensions of 20 inch diameter and 60 inch height. Using a simulation model in DOE/ORNL Heat Pump Design Model, validated by experimental baseline testing of a commercially available 120 V HPWH model, several measures were evaluated to maximize the delivery capacity of a 120 V HPWH. The 120 V HPWH was constrained by 1) external product dimensions of 20 in diameter and 60 inch height, 2) electrical power of 1.5 kW (85% of the available power from a dedicated 120 V, 15 A circuit), and 3) commercially-available components. The measures implemented included a large compressor, a pumped loop with plate heat exchanger to maximize tank stratification, enlarged heat exchangers, and relatively thin insulation to maximize the water storage volume.

Gluesenkamp, Kyle↗

Active Aeroelastic Wing Aerodynamic Model Development and Validation for a Modified F/A-18A

A new aerodynamic model has been developed and validated for a modified F/A-18A used for the Active Aeroelastic Wing (AAW) research program. The goal of the program was to demonstrate the advantages of using the inherent flexibility of an aircraft to enhance its performance. The research aircraft was an F/A-18A with wings modified to reduce stiffness and a new control system to increase control authority. There have been two flight phases. Data gathered from the first flight phase were used to create the new aerodynamic model. A maximum-likelihood output-error parameter estimation technique was used to obtain stability and control derivatives. The derivatives were incorporated into the National Aeronautics and Space Administration F-18 simulation, validated, and used to develop new AAW control laws. The second phase of flights was used to evaluate the handling qualities of the AAW aircraft and the control law design process, and to further test the accuracy of the new model. The flight test envelope covered Mach numbers between 0.85 and 1.30 and dynamic pressures from 600 to 1250 pound-force per square foot. The results presented in this report demonstrate that a thorough parameter identification analysis can be used to improve upon models that were developed using other means. This report describes the parameter estimation technique used, details the validation techniques, discusses differences between previously existing F/A-18 models, and presents results from the second phase of research flights.

Cumming, Stephen B.↗

Statistical and Neural Network for Real Sensor-Data-Driven Anomaly Detection in Nuclear Applications

Anomaly detection (AD) in sensor data is critical to ensure uninterrupted functionality of nuclear power plants (NPPs). Consequently, AD model validation through real-world sensor data is important for applications in nuclear facilities. In this paper, we propose an Autoencoder (AE)—a multi-layered neural network, for AD in sensor data from an operational NPP testbed. Since the dataset lacks labels for irregularities, we introduce random noise and label them to effectively train our model. The proposed AE model assigns a higher reconstruction error to the abnormal samples that deviate from those encountered during the training phase and uses the reconstruction loss to detect anomalies in a representative imbalanced dataset. We also introduce an analytical solution—seasonal trend decomposition (STD)—as another AD scheme for identifying irregularities withinthe same time-series dataset. In contrast to the AE model which relies on reconstruction loss, the STD scheme decomposes the entire dataset into its trend, seasonality, and residual components to pinpoint irregularities. Our findings indicate that the proposed AE and STD models individually achieve recall scores of 97% and 92%, respectively. We validate the performance of the two models on both balanced and imbalanced data. We further solidify the results by picking the combined selected anomalies of the two solutions with an "AND" operator for more reliable predictions.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

OmicsMLMentor: A Web Application for Guided Machine Learning Analysis of Omics Data

Expression-based omics technologies (e.g. proteomics, metabolomics, transcriptomics, etc.) increasingly rely on supervised and unsupervised machine learning (ML) models to find key biomolecules distinguishing conditions, identify natural groupings in biological data, or generate predictions for outcomes of interest. Fitting ML models to omics data presents several challenges, including handling missing data, selecting a normalization method, choosing a valid model, and optimizing hyperparameters, all requiring statistical programming skills to address these challenges. Thus, the open-source web application SLOPE was designed to lower the barrier to ML modeling for omics data. SLOPE supports the fitting of 15 ML models (10 supervised and 5 unsupervised) tailored to omics datasets, such as proteomics, metabolomics, lipidomics, and transcriptomics. SLOPE offers several omics-specific features, including methods for handling missingness (imputation, conversion, removal), normalization tests, ranking of models based on the structure of a user’s data and user input, and optimal hyperparameter selections using cross-validation splits. By streamlining ML workflows for omics analysis, SLOPE address critical gaps in existing online web tools, facilitating a broader adoption of these models for omics research. Here, SLOPE is applied to data from a lignin exposure study to highlight the workflow for fitting both supervised and unsupervised models to data.

lipidomics↗

Redshifts of radio sources in the Million Quasars Catalogue from machine learning

ABSTRACT With the aim of using machine learning techniques to obtain photometric redshifts based upon a source’s radio spectrum alone, we have extracted the radio sources from the Million Quasars Catalogue. Of these, 44 119 have a spectroscopic redshift, required for model validation, and for which photometry could be obtained. Using the radio spectral properties as features, we fail to find a model which can reliably predict the redshifts, although there is the suggestion that the models improve with the size of the training sample. Using the near-infrared–optical–ultraviolet bands magnitudes, we obtain reliable predictions based on the 12 503 radio sources which have all of the required photometry. From the 80:20 training–validation split, this gives only 2501 validation sources, although training the sample upon our previous SDSS model gives comparable results for all 12 503 sources. This makes us confident that SkyMapper, which will survey southern sky in the u, v, g, r, i, z bands, can be used to predict the redshifts of radio sources detected with the Square Kilometre Array. By using machine learning to impute the magnitudes missing from much of the sample, we can predict the redshifts for 32 698 sources, an increase from 28 to 74 per cent of the sample, at the cost of increasing the outlier fraction by a factor of 1.4. While the ‘optical’ band data prove successful, at this stage we cannot rule out the possibility of a radio photometric redshift, given sufficient data which may be necessary to overcome the relatively featureless radio spectra.

79 ASTRONOMY AND ASTROPHYSICS↗

Grid Modeling and Hosting Capacity Analysis

An interface with the OpenDSS distribution grid simulator, facilitating users in calibrating and validating models. Additionally, three distinct tools have been developed: PV Hosting Capacity: This tool allows users to determine the additional amount of photovoltaic (PV) generation that can be integrated into the system without breaching operational constraints. EV Hosting Capacity: This tool focuses on identifying the capacity for incorporating extra electric vehicle (EV) load into the system without surpassing operational limitations. Project Impact Analysis Tool: This tool is designed to assess and report all potential grid violations associated with a specific project, providing valuable insights into its impact on the distribution grid.

Poudel, Shiva↗

Tracking vegetation phenology across diverse North American biomes using PhenoCam imagery

Vegetation phenology controls the seasonality of many ecosystem processes, as well as numerous biosphere-atmosphere feedbacks. Phenology is also highly sensitive to climate change and variability. Here we present a series of datasets, together consisting of almost 750 years of observations, characterizing vegetation phenology in diverse ecosystems across North America. Our data are derived from conventional, visible-wavelength, automated digital camera imagery collected through the PhenoCam network. For each archived image, we extracted RGB (red, green, blue) colour channel information, with means and other statistics calculated across a region-of-interest (ROI) delineating a specific vegetation type. From the high-frequency (typically, 30 min) imagery, we derived time series characterizing vegetation colour, including "canopy greenness", processed to 1- and 3-day intervals. For ecosystems with one or more annual cycles of vegetation activity, we provide estimates, with uncertainties, for the start of the "greenness rising" and end of the "greenness falling" stages. Lastly, the database can be used for phenological model validation and development, evaluation of satellite remote sensing data products, benchmarking earth system models, and studies of climate change impacts on terrestrial ecosystems.

54 ENVIRONMENTAL SCIENCES↗