SEARCH · Search NASA

Results for “Model Validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28

All sources NASA NTRS DOE OSTI

NASA NTRS2012

The Connection between Model Performance on the CCMVal Transport Diagnostics and Simulated Sensitivity of Ozone to Chlorine Change

The chemistry climate models that contributed simulations for past and future ozone evolution to the 2010 Scientific Assessment of Ozone Depletion were subject to extensive evaluation by the SPARC (Stratospheric Processes and their Role in Climate) CCMVal (Chemistry-Climate Model Validation) activity. The sensitivity of ozone to changes in composition and climate varies among the models, but the relationship between these variations and the model evaluations of CCMVal is not obvious. We have learned that the transport evaluation can be used to interpret the comparisons between observed and simulated columns of chlorine reservoirs, hydrochloric acid (HCl) and chlorine nitrate (ClONO2); these comparisons were part of the CCMVal evaluation of chemistry. The simulations with best performance on the transport diagnostics most faithfully reproduce the evolution and seasonal variation of the chlorine reservoirs as observed at NDACC (Network for Detection of Atmospheric Composition Change) stations (NyAlesund 78.9N, Kiruna 67.8N, Harestua 60.2N, Jungfraujoch 46.6N, Toronto 43.6N, Kitt Peak 31.9N, Izana 28.3N, Mauna Loa 19.5N, Lauder 45S and Arrival Heights 77.8S). In the simulations, the HCl in the lower stratosphere depends on total inorganic chlorine (Cly) and partitioning between HCl and ClON02. Total inorganic chlorine depends on the fractional release of chlorine from source gases, and ratio of ClON02 to HCl is inversely dependent on methane and varies quadratically with ozone. Simulated HCl from various models may agree with observations even though Cly is in error, partitioning is in error, or both. Simulated ozone sensitivity to chlorine is shown to be greater for models that produce larger values of chlorine nitrate for background chlorine levels, and vice versa. Comparisons with the NDACC data show why the models with 'best' transport have similar sensitivity to chlorine change. The realistic evolution of the simulated HCl and ClONO2 columns suggests realistic levels of Cly in the lower atmosphere. In addition, the wide range values for the sensitivity of ozone to chlorine obtained from the CCMVal simulations is explained by the wide range in lower atmospheric columns of ClONO2 and the concomitant wide range of levels for chlorine monoxide.

Douglass, Anne↗

NASA NTRS2018

Evaluation of Modeling NO2 Concentrations Driven by Satellite-Derived and Bottom-Up Emission Inventories Using In-Situ Measurements Over China

Chemical transport models together with emission inventories are widely used to simulate NO2 concentrations over China, but validation of the simulations with in situ measurements has been extremely limited. Here we use ground measurements obtained from the air quality monitoring network recently developed by the Ministry of Environmental Protection of China to validate modeling surface NO2 concentrations from the CHIMERE regional chemical transport model driven by the satellite-derived DECSO and the bottom-up MIX emission inventories. We applied a correction factor to the observations to account for the interferences of other oxidized nitrogen compounds (NOz), based on the modeled ratio of NO2 to NOz. The model accurately reproduces the spatial variability in NO2 from in situ measurements, with a spatial correlation coefficient of over 0.7 for simulations based on both inventories. A negative and positive bias is found for the simulation with the DECSO (slopeD0.74 and 0.64 for the daily mean and daytime only) and the MIX (slopeD1.3 and 1.1) inventories, respectively, suggesting an underestimation and overestimation of NOx emissions from corresponding inventories. The bias between observed and modeled concentrations is reduced, with the slope dropping from 1.3 to 1.0 when the spatial distribution of NOx emissions in the DECSO inventory is applied as the spatial proxy for the MIX inventory, which suggests an improvement of the distribution of emissions between urban and suburban or rural areas in the DECSO inventory compared to that used in the bottom-up inventory. A rough estimate indicates that the observed concentrations, from sites predominantly placed in the populated urban areas, may be 10-40% higher than the corresponding model grid cell mean. This reduces the estimate of the negative bias of the DECSO-based simulation to the range of -30 to 0% on average and more firmly establishes that the MIX inventory is biased high over major cities. The performance of the model is comparable over seasons, with a slightly worse spatial correlation in summer due to the difficulties in resolving the more active NOx photochemistry and larger concentration gradients in summer by the model. In addition, the model well captures the daytime diurnal cycle but shows more significant disagreement between simulations and measurements during nighttime, which likely produces a positive model bias of about 15% in the daily mean concentrations. This is most likely related to the uncertainty in vertical mixing in the model at night.

NO2 modelling↗

NASA NTRS2021

The First Global 883 GHz Cloud Ice Survey: IceCube Level 1 Data Calibration, Processing and Analysis

Sub-millimeter (sub-mm, 200 - 1000 GHz) wavelengths contribute a unique capability to fill-in the sensitivity gap between operational visible/infrared (VIS/IR) and microwave (MW) remote sensing for atmosphere cloud ice and snow. Being able of penetrating cloud to measure cloud ice mass and microphysical properties in the middle to upper troposphere, this is a critical spectrum range for us to understand the connection between cloud ice and precipitation processes.5As the first space-borne 883 GHz radiometer, IceCube mission was NASA’s latest effort in spaceflight demonstration of a commercial sub-mm radiometer technology. Successfully launched from the International Space Station, IceCube is essentially a free-running radiometer and collected valuable 15-month measurements of atmosphere and cloud ice. This paper describes the detailed procedures for Level 1 data calibration, processing and validation. The scientific quality and values of IceCube data are then discussed, including radiative transfer model validation and evaluation, as well as the unique spatial distribution10and diurnal cycle of cloud ice that are revealed for the first time on a quasi-global scale at this frequency.

IceCube↗

NASA NTRS2021

The First Global 883 GHz Cloud Ice Survey: IceCube Level 1 Data Calibration, Processing and Analysis

Jie Gong↗

NASA NTRS2005

Active Aeroelastic Wing Aerodynamic Model Development and Validation for a Modified F/A-18A Airplane

A new aerodynamic model has been developed and validated for a modified F/A-18A airplane used for the Active Aeroelastic Wing (AAW) research program. The goal of the program was to demonstrate the advantages of using the inherent flexibility of an aircraft to enhance its performance. The research airplane was an F/A-18A with wings modified to reduce stiffness and a new control system to increase control authority. There have been two flight phases. Data gathered from the first flight phase were used to create the new aerodynamic model. A maximum-likelihood output-error parameter estimation technique was used to obtain stability and control derivatives. The derivatives were incorporated into the National Aeronautics and Space Administration F-18 simulation, validated, and used to develop new AAW control laws. The second phase of flights was used to evaluate the handling qualities of the AAW airplane and the control law design process, and to further test the accuracy of the new model. The flight test envelope covered Mach numbers between 0.85 and 1.30 and dynamic pressures from 600 to 1250 pound-force per square foot. The results presented in this report demonstrate that a thorough parameter identification analysis can be used to improve upon models that were developed using other means. This report describes the parameter estimation technique used, details the validation techniques, discusses differences between previously existing F/A-18 models, and presents results from the second phase of research flights.

Cumming, Stephen B.↗

DOE OSTI2026

Model-based economic analysis under uncertainty for PFAS treatment by granular activated carbon and ion exchange technologies

Recent drinking water regulations have imposed the need for per- and polyfluoroalkyl substances (PFAS) remediation. In response, treatment facilities may be required to retrofit existing treatment schemes to treat PFAS below maximum contaminant levels (MCLs). Adsorption technologies such as granular activated carbon (GAC) and ion exchange (IX) have been demonstrated to be effective; however, there are limited techno-economic metrics available which provide guidance on technology selection and design for diverse PFAS-containing source water conditions. Process systems engineering (PSE) tools which can traditionally perform these analyses are hindered by the data availability, model validity, and understanding of treatment phenomena for emerging contaminants. This work employs published data regressions, statistical models, process models, techno-economic analyses, and other process systems tools in a model-based uncertainty framework to consider the limitations of emerging contaminant research. Through this analysis framework, economic results are provided as probabilistic distributions based on the uncertainty of the models and diverse conditions that treatment facilities experience.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2025

Low-Cost Sulfur Thermal Storage for Solar Industrial Process Heat Applications

Industrial process heat (IPH) is one of the largest energy demands in U.S., representing about 10% of all domestic energy consumption. Fuel costs to generate this industrial process heat are generally a top three cost for industry, a major component in American manufacturing competitiveness. Roughly 60% of US IPH demand (about 6,500 TBtu annually) falls in the medium-temperature range of 100–250 °C. While concentrated solar thermal (CST) technologies can provide a cost-effective source of heat in this temperature range, solar intermittency limits their adoption in industries that operate 24/7. Element 16 Technologies, Inc. developed a low-cost sulfur thermal energy storage (TES) technology to bridge this gap by capturing excess solar heat during the day and dispatching it reliably during non-solar hours. The core innovation is the use of sulfur, an abundant, industrial waste byproduct that costs ten times less than molten salt used in commercial TES systems. The overall goal of the project was to advance the design and development of molten sulfur TES to a manufacturing-relevant prototype stage for solar industrial process heat applications, while establishing and validating a realistic pathway to commercial success. Key tasks included corrosion and mechanical durability testing to identify cost-effective materials, design investigations using physics-based simulation tools, techno-economic evaluations of system lifetime costs, and pilot-scale testing for performance verification. Corrosion testing of steel alloys under cyclic molten sulfur conditions showed that austenitic stainless steels in the 300 series performed particularly well, with no structural degradation of welds or joints. Thermal cyclic testing of pilot sulfur TES units up to 1.5 MWh quantified charge/discharge rates, heat losses, round-trip efficiency and validated the system's capability to operate effectively under intermittent charging conditions. A techno-economic model, informed by sulfur TES performance model validated using pilot test data, showed that hybrid solar+sulfur TES+NG boiler systems are economically competitive with incumbent natural gas boilers for multiple locations in the southwest US. In summary, this project established molten sulfur TES as a technically viable pathway to improve economic competitiveness of American manufacturing by lowering the cost of solar industrial process heat.

14 SOLAR ENERGY↗

NASA NTRS2006

Laboratory astrophysics on ASDEX Upgrade: Measurements and analysis of K-shell O, F, and Ne spectra in the 9 - 20 A region

High-resolution measurements of K-shell emission from O, F, and Ne have been performed at the ASDEX Upgrade tokamak in Garching, Germany. Independently measured temperature and density profiles of the plasma provide a unique test bed for model validation. We present comparisons of measured spectra with calculations based on transport and collisional-radiative models and discuss the reliability of commonly used diagnostic line ratios.

Hansen, S. B.↗

DOE OSTI2024

Offshore Wind Energy Validation Experiment Hierarchy

This paper provides a summary of planning work for experiments that will be necessary to address the long-term model validation needs required to meet offshore wind energy deployment goals. Conceptual experiments are identified and laid out in a validation hierarchy for both wind turbine and wind plant applications. Instrumentation needs that will be required for the offshore validation experiments to be impactful are then listed. The document concludes with a nominal vision for how these exp

Maniaci, David Charles↗

NASA NTRS2015

Calibration of Predictor Models Using Multiple Validation Experiments

This paper presents a framework for calibrating computational models using data from several and possibly dissimilar validation experiments. The offset between model predictions and observations, which might be caused by measurement noise, model-form uncertainty, and numerical error, drives the process by which uncertainty in the models parameters is characterized. The resulting description of uncertainty along with the computational model constitute a predictor model. Two types of predictor models are studied: Interval Predictor Models (IPMs) and Random Predictor Models (RPMs). IPMs use sets to characterize uncertainty, whereas RPMs use random vectors. The propagation of a set through a model makes the response an interval valued function of the state, whereas the propagation of a random vector yields a random process. Optimization-based strategies for calculating both types of predictor models are proposed. Whereas the formulations used to calculate IPMs target solutions leading to the interval value function of minimal spread containing all observations, those for RPMs seek to maximize the models' ability to reproduce the distribution of observations. Regarding RPMs, we choose a structure for the random vector (i.e., the assignment of probability to points in the parameter space) solely dependent on the prediction error. As such, the probabilistic description of uncertainty is not a subjective assignment of belief, nor is it expected to asymptotically converge to a fixed value, but instead it casts the model's ability to reproduce the experimental data. This framework enables evaluating the spread and distribution of the predicted response of target applications depending on the same parameters beyond the validation domain.

Crespo, Luis G.↗

DOE OSTI2025

Impact of mixed grain size sediment input on braided river Morphodynamics: Insights from experimental and numerical modeling

The rate of sediment supply has significant impacts on river morphology, making it crucial to understand the geomorphic changes and grain size distribution dynamics in rivers. However, the effects of varying grain size sediment input on morphological changes in braided channels remain poorly understood. This study is the first to investigate the bar development and sediment sorting processes in braided channels with non-uniform sediment inputs using both numerical and experimental approaches. We applied a two-dimensional numerical model, Nays2DH to confirm and generalize experimental results. The model reproduced key experiment results, including 1) stream elevation changes, and 2) grain size distribution. Using this validated model, we explored the morphological changes and sorting process in a braided river with sediment inputs. The numerical experiments demonstrate that sediment input controls the elevation of the stream bed and the grain size distribution. Notably, both the elevation and grain-size distribution become relatively stable in downstream of the channel. Additionally, the simulation results suggest that an increased sediment supply leads to greater channel complexity, with bed surface armoring decreasing.

Nays2DH↗

NASA NTRS1984

A mathematical model of the UH-60 helicopter

This report documents the revisions made to a ten-degree-of-freedom, full-flight envelope, generic helicopter mathematical model to represent the UH-60 helicopter accurately. The major modifications to the model include fuselage aerodynamic force and moment equations specific to the UH-60, a canted tail rotor, a horizontal stabilator with variable incidence, and a pitch bias actuator (PBA). In addition, this report presents a full set of parameters and numerical values which describe the helicopter configuration and physical characteristics. Model validation was accomplished by comparison of trim and stability derivative data generated from the UH-60 math model with data generated from a similar total force and moment math model.

Hilbert, K. B.↗

NASA NTRS1993

The use of polar-orbiting satellite sounding data to estimate rural maximum and minimum temperatures

Atmospheric sounding products from NOAA's polar-orbiting satellites were used to derive and test predictive equations of rural shelter-level maximum and minimum temperatures. Sounding data from both winter and summer months were combined with surface data from over 5300 cooperative weather stations in the continental United States to develop multiple linear regression equations. Separate equations were developed for both maximum and minimum temperature, using the three types of sounding retrievals (clear, partly cloudy, and cloudy). Clear retrieval models outperformed others, and maximum temperatures were more accurately predicted than minimums. Average standard deviations of observed rural shelter temperatures within sounding search areas were of similar magnitude to root-mean-square errors from satellite estimates for most clear and partly cloudy cases, but were significantly less for cloudy retrieval cases. Model validation for surrogate polar and tropical climatic regions showed success in application of the four clear retrieval models (maximum and minimum temperature, for both winter and summer). This indicates the potential adaptability of these models to estimates of rural shelter temperature in areas outside of the United States.

Johnson, Gregory L.↗

NASA NTRS2005

Multi-Agent Modeling and Simulation Approach for Design and Analysis of MER Mission Operations

A space mission operations system is a complex network of human organizations, information and deep-space network systems and spacecraft hardware. As in other organizations, one of the problems in mission operations is managing the relationship of the mission information systems related to how people actually work (practices). Brahms, a multi-agent modeling and simulation tool, was used to model and simulate NASA's Mars Exploration Rover (MER) mission work practice. The objective was to investigate the value of work practice modeling for mission operations design. From spring 2002 until winter 2003, a Brahms modeler participated in mission systems design sessions and operations testing for the MER mission held at Jet Propulsion Laboratory (JPL). He observed how designers interacted with the Brahms tool. This paper discussed mission system designers' reactions to the simulation output during model validation and the presentation of generated work procedures. This project spurred JPL's interest in the Brahms model, but it was never included as part of the formal mission design process. We discuss why this occurred. Subsequently, we used the MER model to develop a future mission operations concept. Team members were reluctant to use the MER model, even though it appeared to be highly relevant to their effort. We describe some of the tool issues we encountered.

Seah, Chin↗

NASA NTRS2009

Multiscale Cloud System Modeling

The central theme of this paper is to describe how cloud system resolving models (CRMs) of grid spacing approximately 1 km have been applied to various important problems in atmospheric science across a wide range of spatial and temporal scales and how these applications relate to other modeling approaches. A long-standing problem concerns the representation of organized precipitating convective cloud systems in weather and climate models. Since CRMs resolve the mesoscale to large scales of motion (i.e., 10 km to global) they explicitly address the cloud system problem. By explicitly representing organized convection, CRMs bypass restrictive assumptions associated with convective parameterization such as the scale gap between cumulus and large-scale motion. Dynamical models provide insight into the physical mechanisms involved with scale interaction and convective organization. Multiscale CRMs simulate convective cloud systems in computational domains up to global and have been applied in place of contemporary convective parameterizations in global models. Multiscale CRMs pose a new challenge for model validation, which is met in an integrated approach involving CRMs, operational prediction systems, observational measurements, and dynamical models in a new international project: the Year of Tropical Convection, which has an emphasis on organized tropical convection and its global effects.

Tao, Wei-Kuo↗

NASA NTRS2014

Simulation for Prediction of Entry Article Demise (SPEAD): An Analysis Tool for Spacecraft Safety Analysis and Ascent/Reentry Risk Assessment

For the purpose of performing safety analysis and risk assessment for a potential off-nominal atmospheric reentry resulting in vehicle breakup, a synthesis of trajectory propagation coupled with thermal analysis and the evaluation of node failure is required to predict the sequence of events, the timeline, and the progressive demise of spacecraft components. To provide this capability, the Simulation for Prediction of Entry Article Demise (SPEAD) analysis tool was developed. The software and methodology have been validated against actual flights, telemetry data, and validated software, and safety/risk analyses were performed for various programs using SPEAD. This report discusses the capabilities, modeling, validation, and application of the SPEAD analysis tool.

Ling, Lisa↗

NASA NTRS2022

Comparisons Between the Distributions of Dust and Combustion Aerosols in MERRA-2, FLEXPART and CALIPSO and Implications for Deposition Freezing Over Wintertime Siberia

Aerosol distributions have a potentially large influence on climate-relevant cloud properties but can be difficult to observe over the Arctic given pervasive cloudiness, long polar nights, data paucity over remote regions, and periodic diamond dust events that satellites can misclassify as aerosol. We compared Arctic 2008–2015 mineral dust and combustion aerosol distributions from the Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observation (CALIPSO) satellite, the Modern-Era Retrospective analysis for Research and Applications, Version 2 (MERRA-2) reanalysis products, and the FLEXible PARTicle (FLEXPART) dispersion model. Based on coincident, seasonal Atmospheric Infrared Sounder (AIRS) Arctic satellite meteorological data, diamond dust may occur up to 60 % of the time in winter, but it hardly ever occurs in summer. In its absence, MERRA-2 and FLEXPART each predict the vertical and horizontal distribution of large-scale patterns in combustion aerosols with relatively high confidence (Kendall tau rank correlation > 0.6), although a sizable amount of variability is still unaccounted for. They do the same for dust, except in conditions conducive to diamond dust formation where CALIPSO is likely misclassifying diamond dust as mineral dust and near the surface (< ∼ 2 km) where FLEXPART may be overpredicting local dust emissions. Comparisons to ground data suggest that MERRA-2 Arctic dust concentrations can be improved by the addition of local dust sources. All three products predicted that wintertime dust and combustion aerosols occur most frequently over the same Siberian regions where diamond dust is most common in the winter. This suggests that dust aerosol impacts on ice phase processes may be particularly high over Siberia, although further wintertime model validation with non-CALIPSO observations is needed. This assessment paves the way for applying the model-based aerosol simulations to a range of regional-scale Arctic aerosol–cloud interaction studies with greater confidence.

MERRA-2↗

NASA NTRS1997

Reuse of a Formal Model for Requirements Validation

This paper reports experience from how a project engaged in the process of requirements analysis for evolutionary builds can reuse the formally specified design model produced for a similar, earlier project in the same domain. Two levels of reuse are described here. First, a formally specified generic design model was generated on one project to systematically capture the design commonality in a set of software monitors on board a spacecraft. These monitors periodically check for faults and invoke recovery software when needed. The paper summarizes the use of the design model to validate the software design of the various monitors on that first project. Secondly, the paper describes how the formal design model created for the first project was reused on a second, subsequent project. The model was reused to validate the evolutionary requirements for the second project's software monitors, which were being developed in a series of builds. Some mismatches due to the very different architectures on the two projects suggested changes to make the model more generic. In addition, several advantages to the reuse of the first project's formal model on the second project are reported.

Lutz, Robyn R.↗