Search NASA⌕ Search

SEARCH · Search NASA

Results for “structural uncertainty quantification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Trajectory Engineering with Modular Patched Conics for Entry Systems and TPS (TEMPEST)

Brief Presenter Biography (35 word limit): Bohdan Wesely is an Aerospace Engineer in the Entry Systems and Technology Division at Ames. He has worked on a variety of projects for NASA including integrated TPS (thermal protection system) flight hardware deliveries and testing services for commercial partners. Introduction: TEMPEST is a new trajectory analysis framework that is designed to fill the gap between dedicated flight mechanics tools and aerothermal and TPS sizing tools. The project started as an SJSU master’s thesis and has since evolved into a general conceptual design tool capable of studying a wide variety of entry problems. Development is ongoing in the Entry Systems and Technology Division at NASA ARC. Why TEMPEST: Space missions involving entry into a planetary atmosphere involve a series of unique requirements across multiple disciplines. Whether it is traditional entry descent and landing (EDL), or aerocapture, the vehicle must navigate to its target landing location or orbit state, and the TPS must protect the payload during entry. The design process typically involves iterative handoffs between various flight mechanics, flow solver, and material response level tools. During the early conceptual phase, a wide variety of feasible trajectories are simulated in a Monte Carlo scenario which broadly satisfy the mission or landing requirements. Next, computational fluid dynamics (CFD), direct simulation Monte Carlo (DSMC), and other flow solver analyses are performed at various key trajectory points to generate an aero-database, heating and TPS design requirements also emerge at this stage. At this point, with updated aerodynamics from the various flow solvers, trajectories can be re-run, this in turn can change the required freestream conditions for the CFD tools, and as a project progresses, these analyses converge, and uncertainty is reduced. However, there is always a “hand-off” occurring between two inherently coupled phenomena. Analysis Description: One of the goals with TEMPEST is to use a variety of first principles estimation methods coupled with an atmosphere model to predict vehicle aerothermodynamics across the entire flight regime while propagating a 3 or 6 degree of freedom (DoF) trajectory. Aerodynamics methods include modified Newtonian, Maxwell and Cercignani- Lampis-Lord (CLL) for continuum, transitional, and free molecular flow regimes. Aerothermodynamics include boundary layer and reference enthalpy methods, and Mutation++ for non-equilibrium chemistry modeling. TEMPEST is also capable of stitching multiple trajectory segments together to study mission scenarios like multi-pass aerocapture and aero-gravity assists. Most of the program is implemented in MATLAB using modern system objects, it relies on several C++ shared libraries for supporting tools like Gmsh, the Global Reference Atmospheric Model (GRAM), and Mutation++. The various first principles aerothermal estimation methods are discretized across either a structured axisymmetric panel mesh or an unstructured tri-mesh generated from an open-source tool such as Gmsh, this allows solutions on the same mesh to be compared across tools such as CB-Aero. CFD Coupling. A physics-aware, gaussian process CFD anchoring scheme is proposed to adjust the various first principles methods as a CFD database is populated. One goal for this anchoring module is to inform the project where CFD should be run. Full knowledge of the entire trajectory, atmosphere, and aerothermodynamics allows for easier identification of high sensitivity areas and uncertainty quantification. While the first principles effects are well known and proven accurate in existing tools such as CB- Aero and Cart3D, a physics aware CFD anchoring scheme increases tool credibility across a project lifecycle. Material Response Modeling. Correct TPS sizing is critical for optimizing mass for science payloads and ensuring mission success. The process typically involves a thermal analysis along the trajectory with surface heating environments as a boundary condition. Several design constraints are maximum bondline temperature and maximum recession with various margining techniques. The material response tool FIAT, developed out of NASA Ames, is currently being integrated into the TEMPEST environment. TPS recession, shape change, mass loss, and mass property alteration are all factors that can perturb an entry trajectory. For missions like Mars 2020, recession was minimal and was safely handled separately as a post process. For missions such as Jupiter Galileo with a high TPS mass fraction or asteroid entries, recession plays a major role. The proposed fully coupled scheme is to use an epoch-based approach where the trajectory integration is halted after a recession threshold, the energy balance and FIAT are solved at each panel, the mesh, aerodynamics, and mass properties are updated, and the trajectory continues. Several computational tradeoffs have been made during the development of TEMPEST to limit the cost of a single trajectory and preserve its utility as a conceptual, rapid iteration tool. Conclusion: Development of TEMPEST is ongoing and the project is still in its infancy. This talk aims to showcase its unique capabilities to support future NASA entry systems missions.

Bohdan O Wesely↗

Reliability Quantification of the Flexure: A Critical Stirling Convertor Component

Uncertainties in the manufacturing, fabrication process, material behavior, loads, and boundary conditions results in the variation of the stresses and strains induced in the flexures and its fatigue life. Past experience and the test data at material coupon levels revealed a significant amount of scatter of the fatigue life. Owing to these facts, the design of the flexure, using conventional approaches based on safety factor or traditional reliability based on similar equipment considerations does not provide a direct measure of reliability. Additionally, it may not be feasible to run actual long term fatigue tests due to cost and time constraints. Therefore it is difficult to ascertain material fatigue strength limit. The objective of the paper is to present a methodology and quantified results of numerical simulation for the reliability of flexures used in the Stirling convertor for their structural performance. The proposed approach is based on application of finite element analysis method in combination with the random fatigue limit model, which includes uncertainties in material fatigue life. Additionally, sensitivity of fatigue life reliability to the design variables is quantified and its use to develop guidelines to improve design, manufacturing, quality control and inspection design process is described.

Shah, Ashwin R.↗

Uncertainty Models for the Hybrid Parametric Variation Method of Uncertainty Quantification; Analysis

There is some level of uncertainty in every finite element model (FEM), which flows to a level of uncertainty in predicted results. The purpose of uncertainty quantification (UQ) is to provide statistical bounds on prediction accuracy based on model uncertainty. This is distinct from model updating, which attempts to modify models to improve their accuracy. UQ does not improve the accuracy of models, but accepts that the models are inherently inaccurate and attempts to quantify the impact of that inaccuracy on predicted results. Previously, an alternate method for UQ, called the Hybrid Parametric Variation (HPV) method, was applied to Space Launch System (SLS) Hurty/Craig-Bampton (HCB) components to predict system-level statistics for launch vehicle attitude control transfer functions and core stage section loads due to buffet. The HPV method combines a parametric variation of the HCB fixed-interface (FI) modal frequencies with a nonparametric variation (NPV) method that randomly varies the HCB mass and stiffness matrices as Wishart random matrix distributions using random matrix theory (RMT). Alternatively, the most common method for modeling uncertainty in the structural dynamics community is a parametric approach, which varies physical parameters in the model. However, there are several disadvantages associated with the parametric method. Determining a reduced set of parameters that have a significant impact on the system response can be time consuming, and the selected parameter probability distributions are rarely reliably known. Therefore, in practice, the parameters are surrogates for the actual errors, and the link to parameter uncertainty is unknown. Another major drawback is that the uncertainty that can be represented is limited to the form of the nominal FEM. It is the experience of the authors that based on numerous aerospace programs, almost all FEM errors are in form rather than parameter values. This hypothesis is supported by the observation of the authors that it is almost never possible to ‘tune’ a FEM to match modal test results by only modifying model parameters. Model-form uncertainty cannot be directly represented by FEM input parameters nor included in a parametric approach. However, model-form uncertainty can be modeled using RMT, where a probability distribution is developed for the matrix ensemble of interest. The major advantage of the NPV method is that it covers errors in model form. The HPV method anchors uncertainty at the HCB component level to component modal test results by matching the HCB and test modes based on mode descriptions or other methods, and then applying differing levels of frequency variation. The specific variations depend on the confidence to which a component FEM has been validated through modal testing. The NPV method is layered on the frequency variation to match modal test self-orthogonality and cross-orthogonality (XO) results. Once the component uncertainty models are identified, they are assembled, and the uncertainty is propagated to the system level using a Monte Carlo (MC) analysis approach that generates statistics for system-level predictions This provides a UQ method that can be traced to test data, which can be updated as additional data and improved correlated models become available. The purpose of this paper is to collect and present all of the theory for HPV that has been previously published in reports and papers and to present examples of its application. Specifically, component uncertainty models based on the dispersion of corresponding mass and stiffness matrices using proposed test/analysis correlation metrics are investigated. The first example is purely academic so that the true answers are known, and the validity of the HPV method and the corresponding uncertainty models can be determined. The purpose of this paper is to collect and present all of the theory for HPV that has been previously published in reports and papers and to present examples of its application. Specifically, component uncertainty models based on the dispersion of corresponding mass and stiffness matrices using proposed test/analysis correlation metrics are investigated. The first example is purely academic so that the true answers are known, and the validity of the HPV method and the corresponding uncertainty models can be determined. The second example is an application to a component that is design specific to the SLS. Based on this work and other assessments, the HPV method provides another tool to the toolset used for complex system UQ analysis. From experience gathered to date using the HPV method, additional design specific applications must be investigated to provide further confidence in the validity of the HPV method of UQ analysis.

Uncertainty quantification↗

Transfer-AE: A novel autoencoder-based impact detection model for structural digital twin

Accurately detecting the location and intensity of impacts is crucial for ensuring structural safety. Currently, AI-based structural impact detection methods are widely used for their excellent detection accuracy. However, their generalization capability is limited by the scenarios present in the training data. Many complex and dangerous impact scenarios are difficult to conduct real-world experiments on to collect sufficient samples. To capture all impact scenarios and fully leverage the advantages of AI-based detection technologies, advanced methods involve combining real-world structural monitoring data with corresponding numerical models to construct digital twins. These methods continuously refine the created numerical models with limited real-world data and provide diverse impact scenarios through numerical model simulations. However, there are inevitable differences between digital models and physical models that are challenging to correct through mechanical means. This discrepancy in data distribution between the two models significantly hinders the application of digital twin technology in impact/event identification tasks. To address this challenge, this study proposes a novel model based on autoencoders, named Transfer-AE. Transfer-AE encodes the common features of digital twins in the latent space to bridge the uncertainty gap at a macro scale between numerical models and physical models and synchronously fits the magnitude and location of the impact load in the decoder. This enables consistent detection results for the same impact event, whether the sample comes from the numerical model or the physical model. Transfer-AE includes two operating modes: Mode 1 has a fixed computational complexity with stable inference speed, but the training cost and difficulty increase with data distribution. Mode 2's computational complexity increases with data distribution, but it has a fixed training cost and speed. In both cases involving the geodesic dome structure simulating a deep space habitat and the IASC-ASCE benchmark structure, Transfer-AE demonstrated the best performance in impact localization and quantification tasks compared to mainstream domain-adaptive transfer models.

Chengjia Han↗

The Impact and Estimation of Uncertainty Correlation for Multi-Angle Polarimetric Remote Sensing of Aerosols and Ocean Color

Multi-angle polarimetric (MAP) measurements contain rich information for characterization of aerosol microphysical and optical properties that can be used to improve atmospheric correction in ocean color remote sensing. Advanced retrieval algorithms have been developed to obtain multiple geophysical parameters in the atmosphere-ocean system, although uncertainty correlation among measurements is generally ignored due to lack of knowledge on its strength and characterization. In this work, we provide a practical framework to evaluate the impact of the angular uncertainty correlation from retrieval results and a method to estimate correlation strength from retrieval fitting residuals. The Fast Multi-Angular Polarimetric Ocean coLor (FastMAPOL) retrieval algorithm, based on neural network forward models, is used to conduct the retrievals and uncertainty quantification. In addition, we also discuss a flexible approach to include a correlated uncertainty model in the retrieval algorithm. The impact of angular correlation on retrieval uncertainties is discussed based on synthetic AirHARP and HARP2 measurements using a Monte Carlo uncertainty estimation method. Correlation properties are estimated using auto-correlation functions based on the fitting residuals from both synthetic AirHARP and HARP2 data and real AirHARP measurement, with the resulting angular correlation parameters found to be larger than 0.9 and 0.8 for reflectance and DoLP, respectively, which correspond to correlation angles of 10° and 5°. Although this study focuses on angular correlation from HARP instruments, the methodology to study and quantify uncertainty correlation is also applicable to other instruments with angular, spectral, or spatial correlations, and can help inform laboratory calibration and characterization of the instrument uncertainty structure.

PACE↗

Quantifying Emergent Fluid Dynamics Using Reynolds-Interpolated Fluid Reduced-order Models

Fluid reduced-order models (ROMs) which capture the flow physics within the problem's physical domain are usually constrained in accuracy to only the parameter points, e.g. Reynolds and Mach numbers, at which reference data was provided. Interpolation-focused quantity-of-interest ROMs are often structured differently and fail to provide flow volume data with the same quality - if at all. In this paper, techniques which reside at the intersection of these two ROM schools - flow physics ROMs which can be interpolated within a parameter space of interest - are explored. Using a combination of existing and novel techniques, emergent physics are identified using a fluid ROM at parameter points which are not provided in the ROM's training data.

uncertainty quantification↗

Quantifying Emergent Fluid Dynamics Using Reynolds-Interpolated Fluid Reduced-order Models

Fluid reduced-order models (ROMs) which capture the flow physics within the problem's physical domain are usually constrained in accuracy to only the parameter points, e.g. Reynolds and Mach numbers, at which reference data was provided. Interpolation-focused quantity-of-interest ROMs are often structured differently and fail to provide flow volume data with the same quality - if at all. In this paper, techniques which reside at the intersection of these two ROM schools - flow physics ROMs which can be interpolated within a parameter space of interest - are explored. Using a combination of existing and novel techniques, emergent physics are identified using a fluid ROM at parameter points which are not provided in the ROM's training data.

uncertainty quantification↗

Use of In Situ and Airborne Multiangle Data to Assess MODIS- and Landsat-based Estimates of Surface Albedo

The quantification of uncertainty of global surface albedo data and products is a critical part of producing complete, physically consistent, and decadal land property data records for studying ecosystem change. A current challenge in validating satellite retrievals of surface albedo is the ability to overcome the spatial scaling errors that can contribute on the order of 20% disagreement between satellite and field-measured values. Here, we present the results from an uncertain ty analysis of MODerate Resolution Imaging Spectroradiometer (MODIS) and Landsat albedo retrievals, based on collocated comparisons with tower and airborne multi-angular measurements collected at the Atmospheric Radiation Measurement Program s (ARM) Cloud and Radiation Testbed (CART) site during the 2007 Cloud and Land Surface Interaction Campaign (CLAS33 IC 07). Using standard error propagation techniques, airborne measurements obtained by NASA s Cloud Absorption Radiometer (CAR) were used to quantify the uncertainties associated with MODIS and Landsat albedos across a broad range of mixed vegetation and structural types. Initial focus was on evaluating inter-sensor consistency through assessments of temporal stability, as well as examining the overall performance of satellite-derived albedos obtained at all diurnal solar zenith angles. In general, the accuracy of the MODIS and Landsat albedos remained under a 10% margin of error in the SW(0.3 - 5.0 m) domain. However, results reveal a high degree of variability in the RMSE (root mean square error) and bias of albedos in both the visible (0.3 - 0.7 m) and near-infrared (0.3 - 5.0 m) broadband channels; where, in some cases, retrieval uncertainties were found to be in excess of 20%. For the period of CLASIC 07, the primary factors that contributed to uncertainties in the satellite-derived albedo values include: (1) the assumption of temporal stability in the retrieval of 500 m MODIS BRDF values over extended periods of cloud-contaminated observations; and (2) the assumption of spatial 45 and structural uniformity at the Landsat (30 m) pixel scale.

Roman, Miguel O.↗

Dynamic remapping decisions in multi-phase parallel computations

The effectiveness of any given mapping of workload to processors in a parallel system is dependent on the stochastic behavior of the workload. Program behavior is often characterized by a sequence of phases, with phase changes occurring unpredictably. During a phase, the behavior is fairly stable, but may become quite different during the next phase. Thus a workload assignment generated for one phase may hinder performance during the next phase. We consider the problem of deciding whether to remap a paralled computation in the face of uncertainty in remapping's utility. Fundamentally, it is necessary to balance the expected remapping performance gain against the delay cost of remapping. This paper treats this problem formally by constructing a probabilistic model of a computation with at most two phases. We use stochastic dynamic programming to show that the remapping decision policy which minimizes the expected running time of the computation has an extremely simple structure: the optimal decision at any step is followed by comparing the probability of remapping gain against a threshold. This theoretical result stresses the importance of detecting a phase change, and assessing the possibility of gain from remapping. We also empirically study the sensitivity of optimal performance to imprecise decision threshold. Under a wide range of model parameter values, we find nearly optimal performance if remapping is chosen simply when the gain probability is high. These results strongly suggest that except in extreme cases, the remapping decision problem is essentially that of dynamically determining whether gain can be achieved by remapping after a phase change; precise quantification of the decision model parameters is not necessary.

Nicol, D. M.↗

The Porous Microstructure Analysis (PuMA) software

The open-source Porous Microstructure Analysis (PuMA) software was implemented to offer an efficient framework for determining material characteristics from 3D microstructures. Its development was inspired by progress in X-ray microtomography, an imaging technology that captures the internal structure of materials in 3D, and even in a 4D temporal context. Over recent years, this method has transformed the domain of materials science due to its capability to non-destructively examine material microstructures while presenting digital data about their geometrical details. It has provided insights into materials relevant to several NASA missions, including heatshields, parachute fabrics, meteorites, and other advanced composites. PuMA, in its current version 3, delivers an array of features, spanning from basic geometric insights of a microstructure to intricate anisotropic thermo-elastic and chemical behavior. Specifically, the software evaluates morphological attributes (specific surface area, volume fractions, mean intercept lengths, orientation) and physical characteristics (conductivity, elasticity, permeability, and tortuosity). Additionally, it can model material degradation processes, such as oxidation and surface chemistry interactions. The software can generate synthetic microstructures, from straightforward geometrical designs to intricate woven and non-woven geometries. Coupling material generation and characterization enable parametric studies and sensitivity analysis to optimize the microstructural performance and inform design decisions and reliability assessment based on uncertainty quantification. A recent addition to PuMA includes the TomoSAM plugin, devised to incorporate the cutting-edge Segment Anything Model (SAM). SAM is a promptable deep learning model that can identify objects and create image masks in a zero-shot manner, based only on a few user clicks. The synergy between these tools aids in the segmentation of complex 3D datasets from tomography or other imaging techniques, which would otherwise require a laborious manual segmentation process.

Tomography↗

The Porous Microstructure Analysis (PuMA) software

The open-source Porous Microstructure Analysis (PuMA) software was created to offer an efficient framework for determining material properties from 3D microstructures. Its development was inspired by progress in X-ray microtomography, an imaging technology that captures the internal structure of materials in 3D, and even in a 4D temporal context. Over recent years, this method has transformed the domain of materials science due to its capability to non-destructively examine material microstructures while presenting digital data about their geometrical details. It has provided insights into materials relevant to several NASA missions, including heatshields, parachute fabrics, meteorites, and other advanced composites. PuMA, in its current version 3, delivers an array of features, spanning from basic geometric insights of a microstructure to intricate anisotropic thermo-elastic and chemical behavior. Specifically, the software evaluates morphological attributes (specific surface area, volume fractions, mean intercept lengths, orientation) and physical characteristics (conductivity, elasticity, permeability, and tortuosity). Additionally, it can model material degradation processes, such as oxidation and surface chemistry interactions. The software can generate synthetic microstructures, from straightforward geometrical designs to intricate woven and non-woven geometries. Coupling material generation and characterization enables parametric studies and sensitivity analysis to optimize the microstructural performance and inform design decisions and reliability assessment based on uncertainty quantification. A recent addition to PuMA includes the TomoSAM plugin, devised to incorporate the cutting-edge Segment Anything Model (SAM) into our image segmentation workflow. SAM is a promptable deep learning model that can identify objects and create image masks in a zero-shot manner, based only on a few user clicks. The synergy between these tools aids in the segmentation of complex 3D datasets from tomography and other imaging techniques, which would otherwise require a laborious manual segmentation process.

Tomography↗

Airborne Lidar-Based Estimates of Tropical Forest Structure in Complex Terrain: Opportunities and Trade-Offs for REDD+

Background: Carbon stocks and fluxes in tropical forests remain large sources of uncertainty in the global carbon budget. Airborne lidar remote sensing is a powerful tool for estimating aboveground biomass, provided that lidar measurements penetrate dense forest vegetation to generate accurate estimates of surface topography and canopy heights. Tropical forest areas with complex topography present a challenge for lidar remote sensing. Results: We compared digital terrain models (DTM) derived from airborne lidar data from a mountainous region of the Atlantic Forest in Brazil to 35 ground control points measured with survey grade GNSS receivers. The terrain model generated from full-density (approx. 20 returns/sq m) data was highly accurate (mean signed error of 0.19 +/-0.97 m), while those derived from reduced-density datasets (8/sq m, 4/sq m, 2/sq m and 1/sq m) were increasingly less accurate. Canopy heights calculated from reduced-density lidar data declined as data density decreased due to the inability to accurately model the terrain surface. For lidar return densities below 4/sq m, the bias in height estimates translated into errors of 80-125 Mg/ha in predicted aboveground biomass. Conclusions: Given the growing emphasis on the use of airborne lidar for forest management, carbon monitoring, and conservation efforts, the results of this study highlight the importance of careful survey planning and consistent sampling for accurate quantification of aboveground biomass stocks and dynamics. Approaches that rely primarily on canopy height to estimate aboveground biomass are sensitive to DTM errors from variability in lidar sampling density.

Airborne lidar↗

Detection and Retrieval of Multi-Layered Cloud Properties Using Satellite Data

Four techniques for detecting multilayered clouds and retrieving the cloud properties using satellite data are explored to help address the need for better quantification of cloud vertical structure. A new technique was developed using multispectral imager data with secondary imager products (infrared brightness temperature differences, BTD). The other methods examined here use atmospheric sounding data (CO2-slicing, CO2), BTD, or microwave data. The CO2 and BTD methods are limited to optically thin cirrus over low clouds, while the MWR methods are limited to ocean areas only. This paper explores the use of the BTD and CO2 methods as applied to Moderate Resolution Imaging Spectroradiometer (MODIS) and Advanced Microwave Scanning Radiometer EOS (AMSR-E) data taken from the Aqua satellite over ocean surfaces. Cloud properties derived from MODIS data for the Clouds and the Earth's Radiant Energy System (CERES) Project are used to classify cloud phase and optical properties. The preliminary results focus on a MODIS image taken off the Uruguayan coast. The combined MW visible infrared (MVI) method is assumed to be the reference for detecting multilayered ice-over-water clouds. The BTD and CO2 techniques accurately match the MVI classifications in only 51 and 41% of the cases, respectively. Much additional study is need to determine the uncertainties in the MVI method and to analyze many more overlapped cloud scenes.

Minnis, Patrick↗

Exploring the Production of NOx by Lightning and Its Impact on Tropospheric Ozone

Our quantitative understanding of free tropospheric (FT) chemistry is quite poor. State-of-the-art regional air quality models (e.g., US EPA's CMAQ) perform very poorly in simulating FT chemistry, with Uniform ozone around 70 ppb throughout the FT in summer, while ozonesonde data show much higher levels of ozone and much spatial-temporal structure. Such models completely neglect lightning-NOx (LNOx) emissions (the most significant source of NOx in the FT), and also contain large uncertainties in the specifications of intercontinental transport, stratosphere-troposphere exchange (STE) and PBLFT exchange (PFTE). Global air chemistry models include LNOx, but in very crude fashion, with the frequency and distribution of lightning being based on modeled cloud parameters (hence large uncertainty), lightning energetics being assumed to be constant for all flashes (literature value, while in reality there is at least a two-orders of magnitude variability from flash-to-flash), and the production of NOx in the surrounding heated air, per Joule of heating, being assumed to be constant also (literature value, while in fact it is a non-linear function of the dissipated heat and local air density, p). This situation is commonly blamed on paucity of pertinent observational data, but for the USA, there is now a wealth of surface- and satellite-based data of lightning available to permit much improved observation-based estimation of LNOx emissions. In the FT, such NOx has a long residence time, and also the ozone production efficiency from NOx there is considerably higher than in the PBL. It is, therefore, of critical importance in FT chemistry. This paper will describe the approach and data products of an ongoing NSSTC project aimed at a much-improved quantification of not only LNOx production on the scale of continental USA based on local and regional lightning observations, but also of intercontinental transport, STE and PFTE, all in upgraded simulations of tropospheric transport and chemistry. In our approach for LNOx, (a) we utilize continuous observed lightning information from the NLDN ground network and from satellite imagers (OTD and LIS) to quantify lightning frequency and distribution at the spatial-temporal scales of models such as CMAQ; (b) we develop new methodologies to quantify flash-specific lightning energy dissipation as heat (epsilon) using data from the research-grade lightning measurement facility at NASA-KSC, and to parameterize epsilon based on regional lightning monitoring data (ground- and satellite-based); and, (c) we develop a new parameterization of NOx production as a function of epsilon and rho. Based on such observation-based information, we are working to develop a gridded, episodic LNOx emissions inventory for the USA for use in models like CMAQ. We are also developing approaches for global(MOZART)- regional(CMAQ) chemistry coupling to improve intercontinental transport and STE. Finally, we are developing new methodologies for assimilation of satellite-observed (GOES) clouds into meteorological modeling (MM5), to improve PFTE and to optimize co-location of cloud convection and observed lightning. We will incorporate these improvements in CMAQ simulations over the USA to better understand FT processes and chemistry, and its impact on ground-level ozone.

Gillani, Noor↗

Technical Evaluation of the NASA Model for Cancer Risk to Astronauts Due to Space Radiation

At the request of NASA, the National Research Council's (NRC's) Committee for Evaluation of Space Radiation Cancer Risk Model1 reviewed a number of changes that NASA proposes to make to its model for estimating the risk of radiation-induced cancer in astronauts. The NASA model in current use was last updated in 2005, and the proposed model would incorporate recent research directed at improving the quantification and understanding of the health risks posed by the space radiation environment. NASA's proposed model is defined by the 2011 NASA report Space Radiation Cancer Risk Projections and Uncertainties--2010 . The committee's evaluation is based primarily on this source, which is referred to hereafter as the 2011 NASA report, with mention of specific sections or tables. The overall process for estimating cancer risks due to low linear energy transfer (LET) radiation exposure has been fully described in reports by a number of organizations. The approaches described in the reports from all of these expert groups are quite similar. NASA's proposed space radiation cancer risk assessment model calculates, as its main output, age- and gender-specific risk of exposure-induced death (REID) for use in the estimation of mission and astronaut-specific cancer risk. The model also calculates the associated uncertainties in REID. The general approach for estimating risk and uncertainty in the proposed model is broadly similar to that used for the current (2005) NASA model and is based on recommendations by the National Council on Radiation Protection and Measurements. However, NASA's proposed model has significant changes with respect to the following: the integration of new findings and methods into its components by taking into account newer epidemiological data and analyses, new radiobiological data indicating that quality factors differ for leukemia and solid cancers, an improved method for specifying quality factors in terms of radiation track structure concepts as opposed to the previous approach based on linear energy transfer, the development of a new solar particle event (SPE) model, and the updates to galactic cosmic ray (GCR) and shielding transport models. The newer epidemiological information includes updates to the cancer incidence rates from the life span study (LSS) of the Japanese atomic bomb survivors, transferred to the U.S. population and converted to cancer mortality rates from U.S. population statistics. In addition, the proposed model provides an alternative analysis applicable to lifetime never-smokers (NSs). Details of the uncertainty analysis in the model have also been updated and revised. NASA's proposed model and associated uncertainties are complex in their formulation and as such require a very clear and precise set of descriptions. The committee found the 2011 NASA report challenging to review largely because of the lack of clarity in the model descriptions and derivation of the various parameters used. The committee requested some clarifications from NASA throughout its review and was able to resolve many, but not all, of the ambiguities in the written description.

Source record↗

NASA Langley's Approach to the Sandia's Structural Dynamics Challenge Problem

The objective of this challenge is to develop a data-based probabilistic model of uncertainty to predict the behavior of subsystems (payloads) by themselves and while coupled to a primary (target) system. Although this type of analysis is routinely performed and representative of issues faced in real-world system design and integration, there are still several key technical challenges that must be addressed when analyzing uncertain interconnected systems. For example, one key technical challenge is related to the fact that there is limited data on target configurations. Moreover, it is typical to have multiple data sets from experiments conducted at the subsystem level, but often samples sizes are not sufficient to compute high confidence statistics. In this challenge problem additional constraints are placed as ground rules for the participants. One such rule is that mathematical models of the subsystem are limited to linear approximations of the nonlinear physics of the problem at hand. Also, participants are constrained to use these models and the multiple data sets to make predictions about the target system response under completely different input conditions. Our approach involved initially the screening of several different methods. Three of the ones considered are presented herein. The first one is based on the transformation of the modal data to an orthogonal space where the mean and covariance of the data are matched by the model. The other two approaches worked solutions in physical space where the uncertain parameter set is made of masses, stiffnesses and damping coefficients; one matches confidence intervals of low order moments of the statistics via optimization while the second one uses a Kernel density estimation approach. The paper will touch on all the approaches, lessons learned, validation 1 metrics and their comparison, data quantity restriction, and assumptions/limitations of each approach. Keywords: Probabilistic modeling, model validation, uncertainty quantification, kernel density

Horta, Lucas G.↗

A Framework for Deep Learning Emulation of Numerical Models With a Case Study in Satellite Remote Sensing

Numerical models based on physics represent the state of the art in Earth system modeling and comprise our best tools for generating insights and predictions. Despite rapid growth in computational power, the perceived need for higher model resolutions overwhelms the latest generation computers, reducing the ability of modelers to generate simulations for understanding parameter sensitivities and characterizing variability and uncertainty. Thus, surrogate models are often developed to capture the essential attributes of the full-blown numerical models. Recent successes of machine learning methods, especially deep learning (DL), across many disciplines offer the possibility that complex nonlinear connectionist representations may be able to capture the underlying complex structures and nonlinear processes in Earth systems. A difficult test for DL-based emulation, which refers to function approximation of numerical models, is to understand whether they can be comparable to traditional forms of surrogate models in terms of computational efficiency while simultaneously reproducing model results in a credible manner. A DL emulation that passes this test may be expected to perform even better than simple models with respect to capturing complex processes and spatiotemporal dependencies. Here, we examine, with a case study in satellite-based remote sensing, the hypothesis that DL approaches can credibly represent the simulations from a surrogate model with comparable computational efficiency. Our results are encouraging in that the DL emulation reproduces the results with acceptable accuracy and often even faster performance. We discuss the broader implications of our results in light of the pace of improvements in high-performance implementations of DL and the growing desire for higher resolution simulations in the Earth sciences.

Bayesian Deep Learning↗

Sampling Functions from Gaussian Processes and Structured Covariance Gaussian Networks

When learning aerodynamic models from data, it is critical to incorporate estimates of model uncertainty. This motivates the design of probabilistic aerodynamic databases which can be sampled to generate physically and statistically plausible aerodynamic models. In this talk we discuss how to sample deterministic functions from two different kinds of probabilistic models and demonstrate their use. First, Gaussian Process Regressors (GPRs) are a widely used probabilistic kernel-based model which can be thought of as Gaussian distributions over functions. GPRs are generally trained by maximizing the marginal likelihood of seeing the training data over the kernel parameter space. Sample functions are easily generated by drawing points from the Gaussian distribution at desired input points. However, when the points are not known ahead of time, the classical sampling approach is not possible since successive function samples will generate different function realizations. We present an approach for sampling consistent function evaluations from a GPR over multiple samples. Second, we describe a neural network architecture which learns a conditional Gaussian distribution by maximizing the marginal likelihood at each point in the input space. We then discuss and compare several options for generating sample functions which match this distribution. Finally, we demonstrate the use of these probabilistic aerodynamic models in an atmospheric reentry simulation.

Gaussian process regression↗