Search NASA⌕ Search

SEARCH · Search NASA

Results for “Physical Algorithm”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Physical Retrieval of Surface Emissivity Spectrum from Hyperspectral Infrared Radiances

Retrieval of temperature, moisture profiles and surface skin temperature from hyperspectral infrared (IR) radiances requires spectral information about the surface emissivity. Using constant or inaccurate surface emissivities typically results in large retrieval errors, particularly over semi-arid or arid areas where the variation in emissivity spectrum is large both spectrally and spatially. In this study, a physically based algorithm has been developed to retrieve a hyperspectral IR emissivity spectrum simultaneously with the temperature and moisture profiles, as well as the surface skin temperature. To make the solution stable and efficient, the hyperspectral emissivity spectrum is represented by eigenvectors, derived from the laboratory measured hyperspectral emissivity database, in the retrieval process. Experience with AIRS (Atmospheric InfraRed Sounder) radiances shows that a simultaneous retrieval of the emissivity spectrum and the sounding improves the surface skin temperature as well as temperature and moisture profiles, particularly in the near surface layer.

Li, Jun↗

1D-VAR Retrieval Using Superchannels

Since modern ultra-spectral remote sensors have thousands of channels, it is difficult to include all of them in a 1D-var retrieval system. We will describe a physical inversion algorithm, which includes all available channels for the atmospheric temperature, moisture, cloud, and surface parameter retrievals. Both the forward model and the inversion algorithm compress the channel radiances into super channels. These super channels are obtained by projecting the radiance spectra onto a set of pre-calculated eigenvectors. The forward model provides both super channel properties and jacobian in EOF space directly. For ultra-spectral sensors such as Infrared Atmospheric Sounding Interferometer (IASI) and the NPOESS Airborne Sounder Testbed Interferometer (NAST), a compression ratio of more than 80 can be achieved, leading to a significant reduction in computations involved in an inversion process. Results will be shown applying the algorithm to real IASI and NAST data.

Liu, Xu↗

Radiative Transfer Modeling and Retrievals for Advanced Hyperspectral Sensors

A novel radiative transfer model and a physical inversion algorithm based on principal component analysis will be presented. Instead of dealing with channel radiances, the new approach fits principal component scores of these quantities. Compared to channel-based radiative transfer models, the new approach compresses radiances into a much smaller dimension making both forward modeling and inversion algorithm more efficient.

Liu, Xu↗

Generating Vegetation Leaf Area Index Earth System Data Record from Multiple Sensors: Implementation, Analysis and Validation - Part 2

The evaluation of a new global monthly leaf area index (LAI) data set for the period July 1981 to December 2006 derived from AVHRR Normalized Difference Vegetation Index (NDVI) data is described. The physically based algorithm is detailed in the first of the two part series. Here, the implementation, production and evaluation of the data set are described. The data set is evaluated both by direct comparisons to ground data and indirectly through inter-comparisons with similar data sets. This indirect validation showed satisfactory agreement with existing LAI products, importantly MODIS, at a range of spatial scales, and significant correlations with key climate variables in areas where temperature and precipitation limit plant growth. The data set successfully reproduced well-documented spatio-temporal trends and inter-annual variations in vegetation activity in the northern latitudes and semi-arid tropics. Comparison with plot scale field measurements over homogeneous vegetation patches indicated a 7% underestimation when all major vegetation types are taken into account. The error in mean values obtained from distributions of AVHRR LAI and high-resolution field LAI maps for different biomes is within 0.5 LAI for six out of the ten selected sites. These validation exercises though limited by the amount of field data, and thus less than comprehensive, indicated satisfactory agreement between the LAI product and field measurements. Overall, the intercomparison with short-term LAI data sets, evaluation of long term trends with known variations in climate variables, and validation with field measurements together build confidence in the utility of this new 26 year LAI record for long term vegetation monitoring and modeling studies.

Ganguly, Sangram↗

Hyperspectral Remote Sensing of Atmosphere and Surface Properties

Atmospheric Infrared Sounder (AIRS), Infrared Atmospheric Sounding Interferometer (IASI), and Cross-track Infrared Sounder (CrIS) are all hyper-spectral satellite sensors with thousands of spectral channels. Top of atmospheric radiance spectra measured by these sensors contain high information content on atmospheric, cloud, and surface properties. Exploring high information content contained in these high spectral resolution spectra is a challenging task due to computation e ort involved in modeling thousands of spectral channels. Usually, only very small fractions (4{10 percent) of the available channels are included in physical retrieval systems or numerical weather forecast (NWP) satellite data assimilations. We will describe a method of simultaneously retrieving atmospheric temperature, moisture, cloud, and surface properties using all available spectral channels without sacrificing computational speed. The essence of the method is to convert channel radiance spectra into super-channels by an Empirical Orthogonal Function (EOF) transformation. Because the EOFs are orthogonal to each other, about 100 super-channels are adequate to capture the information content of the radiance spectra. A Principal Component-based Radiative Transfer Model (PCRTM) developed at NASA Langley Research Center is used to calculate both the super-channel magnitudes and derivatives with respect to atmospheric profiles and other properties. There is no need to perform EOF transformations to convert super channels back to spectral space at each iteration step for a one-dimensional variational retrieval or a NWP data assimilation system. The PCRTM forward model is also capable of calculating radiative contributions due to multiple-layer clouds. The multiple scattering effects of the clouds are efficiently parameterized. A physical retrieval algorithm then performs an inversion of atmospheric, cloud, and surface properties in super channel domain directly therefore both reducing the computational need and preserving the information content of the IASI measurements. The inversion algorithm is based on a non-linear Levenberg-Marquardt method with climatology covariance matrices and a priori information as constraints. One advantage of this approach is that it uses all information content from the hyper-spectral data so that the retrieval is less sensitive to instrument noise and eliminates the need for selecting a sub-set of the channels.

Liu, Xu↗

A Briefing on Metrics and Risks for Autonomous Decision-Making in Aerospace Applications

Significant technology advances will enable future aerospace systems to safely and reliably make decisions autonomously, or without human interaction. The decision-making may result in actions that enable an aircraft or spacecraft in an off-nominal state or with slightly degraded components to achieve mission performance and safety goals while reducing or avoiding damage to the aircraft or spacecraft. Some key technology enablers for autonomous decision-making include: a continuous state awareness through the maturation of the prognostics health management field, novel sensor development, and the considerable gains made in computation power and data processing bandwidth versus system size. Sophisticated algorithms and physics based models coupled with these technological advances allow reliable assessment of a system, subsystem, or components. Decisions that balance mission objectives and constraints with remaining useful life predictions can be made autonomously to maintain safety requirements, optimal performance, and ensure mission objectives. This autonomous approach to decision-making will come with new risks and benefits, some of which will be examined in this paper. To start, an account of previous work to categorize or quantify autonomy in aerospace systems will be presented. In addition, a survey of perceived risks in autonomous decision-making in the context of piloted aircraft and remotely piloted or completely autonomous unmanned autonomous systems (UAS) will be presented based on interviews that were conducted with individuals from industry, academia, and government.

Frost, Susan↗

Development of an OSSE Framework for a Global Atmospheric Data Assimilation System

Observing system simulation experiments (OSSEs) are powerful tools for estimating the usefulness of various configurations of envisioned observing systems and data assimilation techniques. Their utility stems from their being conducted in an entirely simulated context, utilizing simulated observations having simulated errors and drawn from a simulation of the earth's environment. Observations are generated by applying physically based algorithms to the simulated state, such as performed during data assimilation or using other appropriate algorithms. Adding realistic instrument plus representativeness errors, including their biases and correlations, can be critical for obtaining realistic assessments of the impact of a proposed observing system or analysis technique. If estimates of the expected accuracy of proposed observations are realistic, then the OSSE can be also used to learn how best to utilize the new information, accelerating its transition to operations once the real data are available. As with any inferences from simulations, however, it is first imperative that some baseline OSSEs are performed and well validated against corresponding results obtained with a real observing system. This talk provides an overview of, and highlights critical issues related to, the development of an OSSE framework for the tropospheric weather prediction component of the NASA GEOS-5 global atmospheric data assimilation system. The framework includes all existing observations having significant impact on short-term forecast skill. Its validity has been carefully assessed using a range of metrics that can be evaluated in both the OSSE and real contexts, including adjoint-based estimates of observation impact. A preliminary application to the Aeolus Doppler wind lidar mission, scheduled for launch by the European Space Agency in 2014, has also been investigated.

Gelaro, Ronald↗

Optimization of Layer Densities for Spacecraft Multilayered Insulation Systems

Numerous tests of various multilayer insulation systems have indicated that there are optimal densities for these systems. However, the only method of calculating this optimal density was by a complex physics based algorithm developed by McIntosh. In the 1970's much data were collected on the performance of these insulation systems with many different variables analyzed. All formulas generated included number of layers and layer density as geometric variables in solving for the heat flux, none of them was in a differentiable form for a single geometric variable. It was recently discovered that by converting the equations from heat flux to thermal conductivity using Fourier's Law, the equations became functions of layer density, temperatures, and material properties only. The thickness and number of layers of the blanket were merged into a layer density. These equations were then differentiated with respect to layer density. By setting the first derivative equal to zero, and solving for the layer density, the critical layer density was determined. Taking a second derivative showed that the critical layer density is a minimum in the function and thus the optimum density for minimal heat leak, this is confirmed by plotting the original function. This method was checked and validated using test data from the Multipurpose Hydrogen Testbed which was designed using McIntosh's algorithm.

Johnson, W. L.↗

Monte Carlo Bayesian Inference on a Statistical Model of Sub-gridcolumn Moisture Variability Using High-resolution Cloud Observations : Sensitivity Tests and Results - Part II

Part I presented a Monte Carlo Bayesian method for constraining a complex statistical model of GCM sub-gridcolumn moisture variability using high-resolution MODIS cloud data, thereby permitting large-scale model parameter estimation and cloud data assimilation. This part performs some basic testing of this new approach, verifying that it does indeed significantly reduce mean and standard deviation biases with respect to the assimilated MODIS cloud optical depth, brightness temperature and cloud top pressure, and that it also improves the simulated rotational-Ramman scattering cloud optical centroid pressure (OCP) against independent (non-assimilated) retrievals from the OMI instrument. Of particular interest, the Monte Carlo method does show skill in the especially difficult case where the background state is clear but cloudy observations exist. In traditional linearized data assimilation methods, a subsaturated background cannot produce clouds via any infinitesimal equilibrium perturbation, but the Monte Carlo approach allows finite jumps into regions of non-zero cloud probability. In the example provided, the method is able to restore marine stratocumulus near the Californian coast where the background state has a clear swath. This paper also examines a number of algorithmic and physical sensitivities of the new method and provides guidance for its cost-effective implementation. One obvious difficulty for the method, and other cloud data assimilation methods as well, is the lack of information content in the cloud observables on cloud vertical structure, beyond cloud top pressure and optical thickness, thus necessitating strong dependence on the background vertical moisture structure. It is found that a simple flow-dependent correlation modification due to Riishojgaard (1998) provides some help in this respect, by better honoring inversion structures in the background state.

Monte Carlo Bayesian inference↗

An Interplay between Photons, Canopy Structure, and Recollision Probability: A Review of the Spectral Invariants Theory of 3D Canopy Radiative Transfer Processes

Earth observations collected by remote sensors provide unique information to our ever-growing knowledge of the terrestrial biosphere. Yet, retrieving information from remote sensing data requires sophisticated processing and demands a better understanding of the underlying physics. This paper reviews research efforts that lead to the developments of the stochastic radiative transfer equation (RTE) and the spectral invariants theory. The former simplifies the characteristics of canopy structures with a pair-correlation function so that the 3D information can be succinctly packed into a 1D equation. The latter indicates that the interactions between photons and canopy elements converge to certain invariant patterns quantifiable by a few wavelength independent parameters, which satisfy the law of energy conservation. By revealing the connections between plant structural characteristics and photon recollision probability, these developments significantly advance our understanding of the transportation of radiation within vegetation canopies. They enable a novel physically-based algorithm to simulate the “hot-spot” phenomenon of canopy bidirectional reflectance while conserving energy, a challenge known to the classic radiative transfer models. Therefore, these theoretical developments have a far-reaching influence in optical remote sensing of the biosphere.

vegetation remote sensing; stochastic radiative tr↗

Deriving Climate Change Signal from Hyperspectral Sounders Using Spectral Fingerprinting Method

Hyperspectral observations from satellite-based sensors provide high information content for the Earth’s atmospheric temperature, water vapor and trace gas vertical profiles. We have developed a radiometrically consistent spectral fingerprinting method to derive climate change signals from Aqua AIRS/AMSU and S-NPP CrIS/ATMS data. The climate variables include temperature and water vapor profiles, cloud, trace gases, and surface skin temperature. The radiative kernels obtained via a single field of view physical retrieval algorithm under all-sky conditions. A key component to this work is a Principal Component-based Radiative Transfer Model (PCRTM). It is 4 orders of magnitude faster than a line-by-line radiative transfer model while keeping a similar accuracy (0.03 K RMS errors with close to zero bias). The PCRTM includes multiple scattering of clouds and non-thermodynamics equilibrium of CO2 in the RT calculations. Instead of quantifying the radiometric differences between AIRS/AMSU and CrIS/ATMS measurements directly using Simultaneous Nadir Overpass (SNO) or Double Difference Technique (DDT), we use the radiometric consistent fingerprinting scheme to derive two sets of space-time averaged anomalies from the Level 1 data of AIRS/AMSU and CrIS/ATMS. The derived anomalies in geophysical space will form a long-term, stable, and continuous climate data record. We can further infer the causes of any offset or drift by studying the differences between two overlapping data sets. For example, the offset in surface skin temperature anomaly time series will most likely caused by the Blackbody temperature calibration errors of the sounder instruments.

climate↗

A New Machine Learning Based Analysis for Improving Satellite Retrieved Atmospheric Composition Data: OMI SO2 as an Example

Despite recent progress, satellite retrievals of anthropogenic SO2 still suffer from relatively low signal-tonoise ratios. In this study, we demonstrate a new machine learning data analysis method to improve the quality of satellite SO2 products. In the absence of large ground-truth datasets for SO2, we start from SO2 slant column densities (SCDs) retrieved from the Ozone Monitoring Instrument (OMI) using a data-driven, physically based algorithm and calculate the ratio between the SCD and the root mean square (rms) of the fitting residuals for each pixel. To build the training data, we select presumably clean pixels with small SCD / rms ratios (SRRs) and set their target SCDs to zero. For polluted pixels with relatively large SRRs, we set the target to the original retrieved SCDs. We then train neural networks (NNs) to reproduce the target SCDs using predictors including SRRs for individual pixels, solar zenith, viewing zenith and phase angles, scene reflectivity, and O3 column amounts, as well as the monthly mean SRRs. For data analysis, we employ two NNs: (1) one trained daily to produce analyzed SO2 SCDs for polluted pixels each day and (2) the other trained once every month to produce analyzed SCDs for less polluted pixels for the entire month. Test results for 2005 show that our method can significantly reduce noise and artifacts over background regions. Over polluted areas, the monthly mean NN-analyzed and original SCDs generally agree to within ±15 %, indicating that our method can retain SO2 signals in the original retrievals except for large volcanic eruptions. This is further confirmed by running both the NN-analyzed and original SCDs through a topdown emission algorithm to estimate the annual SO2 emissions for ∼ 500 anthropogenic sources, with the two datasets yielding similar results. We also explore two alternative approaches to the NN-based analysis method. In one, we employ a simple linear interpolation model to analyze the original SCD retrievals. In the other, we develop a PCA–NN algorithm that uses OMI measured radiances, transformed and dimension-reduced with a principal component analysis (PCA) technique, as inputs to NNs for SO2 SCD retrievals. While the linear model and the PCA–NN algorithm can reduce retrieval noise, they both underestimate SO2 over polluted areas. Overall, the results presented here demonstrate that our new data analysis method can significantly improve the quality of existing OMI SO2 retrievals. The method can potentially be adapted for other sensors and/or species and enhance the value of satellite data in air quality research and applications.

Can Li↗

A Modeling and Simulation Study for the GeoXO Atmospheric Composition Instrument (ACX): System Level SO2 and O3 Retrieval Performance as a Function of SNR

NOAA’s Geostationary Extended Observations (GeoXO) program is planning to include a hyperspectral UV/visible atmospheric composition instrument in geostationary orbit slated for operations by the early 2030s. Trace gas retrievals provide critical information about our Earth’s system as it relates to both natural and anthropogenic activity. This work focused on the impacts of the signal-to-noise ratio (SNR) on the retrieval uncertainty of SO2 and O3. An end-to-end physics-based imaging system and scene modeling and simulation framework was developed to assess instrument performance considerations in support of the planned GeoXO atmospheric composition instrument (ACX). The framework is composed of three primary components: 1) simulated at-sensor radiance via radiative transfer models of a known atmospheric composition, 2) a noise model driven by previous and planned sensor specifications, and 3) a physical retrieval algorithm. In this analysis, the tropospheric concentrations of SO2 and O3 in the atmospheric column were varied in the boundary layer (0-3 km) and at an elevation of 5 km with a thickness of 1-2 km; the uncertainty in retrieval was studied for various SNR levels for multiple viewing geometries and solar zenith angles. This effort supports the development of the GeoXO ACX instrument by providing a simulated ACX performance assessment of the system-level retrieval performance as a function of SNR, particularly with respect to the wavelength range of interest (approximately 305 – 340 nm) for SO2 and O3 trace gas retrievals.

Monica Cook↗

Rover Slip Validation and Prediction Algorithm

A physical-based simulation has been developed for the Mars Exploration Rover (MER) mission that applies a slope-induced wheel-slippage to the rover location estimator. Using the digital elevation map from the stereo images, the computational method resolves the quasi-dynamic equations of motion that incorporate the actual wheel-terrain speed to estimate the gross velocity of the vehicle. Based on the empirical slippage measured by the Visual Odometry software of the rover, this algorithm computes two factors for the slip model by minimizing the distance of the predicted and actual vehicle location, and then uses the model to predict the next drives. This technique, which has been deployed to operate the MER rovers in the extended mission periods, can accurately predict the rover position and attitude, mitigating the risk and uncertainties in the path planning on high-slope areas.

Yen, Jeng↗

Land Surface Modeling and Data Assimilation to Support Physical Precipitation Retrievals for GPM

Objective: The objective of this proposal is to provide a routine land surface modeling and data assimilation capability for GPM in order to provide global land surface states that are necessary to support physical precipitation retrieval algorithms over land. It is well-known that surface emission, particularly over the range of frequencies to be included in GPM, is sensitive to land surface states, including soil properties, vegetation type and greenness, soil moisture, surface temperature, and snow cover, density, and grain size. Therefore, providing a robust capability to routinely provide these critical land states is essential to support GPM-era physical retrieval algorithms over land.

Peters-Lidard, Christa D.↗

NASA GPM GV Science Requirements

An important scientific objective of the NASA portion of the GPM Mission is to generate quantitatively-based error characterization information along with the rainrate retrievals emanating from the GPM constellation of satellites. These data must serve four main purposes: (1) they must be of sufficient quality, uniformity, and timeliness to govern the observation weighting schemes used in the data assimilation modules of numerical weather prediction models; (2) they must extend over that portion of the globe accessible by the GPM core satellite to which the NASA GV program is focused - (approx.65 degree inclination); (3) they must have sufficient specificity to enable detection of physically-formulated microphysical and meteorological weaknesses in the standard physical level 2 rainrate algorithms to be used in the GPM Precipitation Processing System (PPS), i.e., algorithms which will have evolved from the TRMM standard physical level 2 algorithms; and (4) they must support the use of physical error modeling as a primary validation tool and as the eventual replacement of the conventional GV approach of statistically intercomparing surface rainrates fiom ground and satellite measurements. This approach to ground validation research represents a paradigm shift vis-&-vis the program developed for the TRMM mission, which conducted ground validation largely as a statistical intercomparison process between raingauge-derived or radar-derived rainrates and the TRMM satellite rainrate retrievals -- long after the original satellite retrievals were archived. This approach has been able to quantify averaged rainrate differences between the satellite algorithms and the ground instruments, but has not been able to explain causes of algorithm failures or produce error information directly compatible with the cost functions of data assimilation schemes. These schemes require periodic and near-realtime bias uncertainty (i.e., global space-time distributed conditional accuracy of the retrieved rainrates) and local error covariance structure (i.e., global space-time distributed error correlation information for the local 4-dimensional space-time domain -- or in simpler terms, the matrix form of precision error). This can only be accomplished by establishing a network of high quality-heavily instrumented supersites selectively distributed at a few oceanic, continental, and coastal sites. Economics and pragmatics dictate that the network must be made up of a relatively small number of sites (6-8) created through international cooperation. This presentation will address some of the details of the methodology behind the error characterization approach, some proposed solutions for expanding site-developed error properties to regional scales, a data processing and communications concept that would enable rapid implementation of algorithm improvement by the algorithm developers, and the likely available options for developing the supersite network.

Smith, E.↗

Fidelity of Satellite Soundings

Two pattern recognition procedures to provide improvements to first guess fields for satellite temperature retrievals were developed. The first technique where a radiometer measurement is used to select one or more historical radiosonde temperature profiles as analog estimates of ambient thermal structure. Radiosondes are the vertical scales of the analogs. The vertical resolving power of the satellite radiometer is relevant only to a decision process. The analog selection process is much more effective if implemented in an orthogonalized space of measurement information. The second procedure partitions a priori dependent data into shape coherent pattern libraries using structure information inherent in the data itself. It is shown that the pattern recognition techniques are able to reduce first guess profile errors by nearly 50%. The impact of pattern recognition on temperature retrieval error is assessed by regression and physical iterative retrieval algorithms. The influence of improved first guess fields is markedly different on these two types of algorithm. Pattern recognition was a strong positive impact on the physical iterative method.

Thompson, O.↗

Model-agnostic search for dijet resonances with anomalous jet substructure in proton–proton collisions at $\sqrt{s}$ = 13 TeV

This paper presents a model-agnostic search for narrow resonances in the dijet final state in the mass range 1.8-6 TeV. The signal is assumed to produce jets with substructure atypical of jets initiated by light quarks or gluons, with minimal additional assumptions. Search regions are obtained by utilizing multivariate machine-learning methods to select jets with anomalous substructure. A collection of complementary anomaly detection methods - based on unsupervised, weakly supervised, and semisupervised algorithms - are used in order to maximize the sensitivity to unknown new physics signatures. These algorithms are applied to data corresponding to an integrated luminosity of 138 fb -1 , recorded by the CMS experiment at the LHC, at a center-of-mass energy of 13 TeV. No significant excesses above background expectations are seen. Exclusion limits are derived on the production cross section of benchmark signal models varying in resonance mass, jet mass, and jet substructure. Many of these signatures have not been previously sought, making several of the limits reported on the corresponding benchmark models the first ever. When compared to benchmark inclusive and substructure-based search strategies, the anomaly detection methods are found to significantly enhance the sensitivity to a variety of models.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗