Search NASA⌕ Search

SEARCH · Search NASA

Results for “Ensemble methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Early Estimation of Solar Activity Cycle: Potential Capability and Limits

The variable solar magnetic activity known as the 11-year solar cycle has the longest history of solar observations. These cycles dramatically affect conditions in the heliosphere and the Earth's space environment. Our current understanding of the physical processes that make up global solar dynamics and the dynamo that generates the magnetic fields is sketchy, resulting in unrealistic descriptions in theoretical and numerical models of the solar cycles. The absence of long-term observations of solar interior dynamics and photospheric magnetic fields hinders development of accurate dynamo models and their calibration. In such situations, mathematical data assimilation methods provide an optimal approach for combining the available observational data and their uncertainties with theoretical models in order to estimate the state of the solar dynamo and predict future cycles. In this presentation, we will discuss the implementation and performance of an Ensemble Kalman Filter data assimilation method based on the Parker migratory dynamo model, complemented by the equation of magnetic helicity conservation and longterm sunspot data series. This approach has allowed us to reproduce the general properties of solar cycles and has already demonstrated a good predictive capability for the current cycle, 24. We will discuss further development of this approach, which includes a more sophisticated dynamo model, synoptic magnetogram data, and employs the DART Data Assimilation Research Testbed.

Kitiashvili, Irina N.↗

Using Data Assimilation Methods of Prediction of Solar Activity

The variable solar magnetic activity known as the 11-year solar cycle has the longest history of solar observations. These cycles dramatically affect conditions in the heliosphere and the Earth's space environment. Our current understanding of the physical processes that make up global solar dynamics and the dynamo that generates the magnetic fields is sketchy, resulting in unrealistic descriptions in theoretical and numerical models of the solar cycles. The absence of long-term observations of solar interior dynamics and photospheric magnetic fields hinders development of accurate dynamo models and their calibration. In such situations, mathematical data assimilation methods provide an optimal approach for combining the available observational data and their uncertainties with theoretical models in order to estimate the state of the solar dynamo and predict future cycles. In this presentation, we will discuss the implementation and performance of an Ensemble Kalman Filter data assimilation method based on the Parker migratory dynamo model, complemented by the equation of magnetic helicity conservation and long-term sunspot data series. This approach has allowed us to reproduce the general properties of solar cycles and has already demonstrated a good predictive capability for the current cycle, 24. We will discuss further development of this approach, which includes a more sophisticated dynamo model, synoptic magnetogram data, and employs the DART Data Assimilation Research Testbed.

Prediction↗

Using Data Assimilation Methods for Prediction of Solar Activity

The variability of solar magnetic activity known as the 11-­‐year solar cycles has the longest history of observations. These solar cycles dramatically affect conditions in the heliosphere and the Earth’s space environment. Our current understanding of the physical processes that make up global solar dynamics and the dynamo that generates the magnetic fields is sketchy, resulting in unrealistic descriptions in theoretical and numerical models of the solar cycles. The absence of long-­‐term observations of solar interior dynamics and photospheric magnetic fields hinders development of accurate dynamo models and their calibration. In such situations, mathematical data assimilation methods provide an optimal approach for combining the available observational data and their uncertainties with theoretical models in order to estimate the state of the solar dynamo and predict future cycles. In this presentation, we will discuss the implementation and performance of an Ensemble Kalman Filter data assimilation method based on the Parker migratory dynamo model complemented by the equation of magnetic helicity conservation and long-­‐term sunspot data series. This approach has allowed us to reproduce the general properties of the solar cycles and has already demonstrated a good predictive capability for the current cycle, 24. We will discuss further development of this approach, which includes a more sophisticated dynamo model, synoptic magnetogram data, and employs the DART Data Assimilation Research Testbed.

Solar Activity↗

Estimating the instability of a composite clock

A composite clock created from a local clock ensemble is known by its time offsets from the ensemble clocks. By a geometrical argument, estimate for the instability of the composite clock are calculated from the instabilities of the ensemble clocks, individually and against the composite clock. The method is illustrated by examples using simulated and real ensembles.

timescale↗

Lagged average forecasting, some operational considerations

The Lagged Average Forecast (LAF) method differs from the Monte Carlo Forecast (MCF) method in the definition of the ensemble of initial states which are used to generate the ensemble of forecasts. The LAF initial states are the current analysis and the forecasts made from previous analyses verifying the current time. Thus the LAF ensemble is composed of forecasts which are made by a regular operational system of numerical weather prediction and the LAF method is therefore operationally attractive. The application of the authors' previous ideas and results to an operational model requires the resolution of what might be called the degrees of freedom problem, i.e., how to obtain a homogeneous sample large enough to calculate stable statistics. It is suggested that this problem may be solved by carefully modeling the required statistics in terms of a small set of parameters and then estimating only these few parameters from the data. It is noted that there may be considerable information in each initial ensemble relating to the predictability of each particular case, and that this information may be incorporated in the model of the statistics.

Hoffman, R. N.↗

Backscattering by nonspherical particles - A review of methods and suggested new approaches

Scattering of electromagnetic radiation near the backward direction is more sensitive to particle shape than scattering near the forward direction. Mie theory is therefore of dubious applicability to predicting backscattering by atmospheric particles known to be irregular or to inverting measurements on such particles. An irregular particle is one with an uncertain shape. In the face of uncertainty one must adopt a statistical approach in which scattering properties of ensembles are determined. To obtain ensemble averages, a basis is needed for averaging over a set of electromagnetic microstates. Ensemble averages based on the Rayleigh theory for small ellipsoids and on the T matrix method for spheroids agree better with measurements than Mie theory does. The coupled-dipole method also provides a basis for ensemble averaging. This method also leads to a simple physical interpretation of why backscattering is so sensitive to particle shape and can be used to calculate scattering by one- and two-dimensional analogs to three-dimensional irregular particles.

Bohren, Craig F.↗

Interaction of a cumulus cloud ensemble with the large-scale environment. III - Semi-prognostic test of the Arakawa-Schubert cumulus parameterization

The verification of the Arakawa and Schubert (1974) cumulus parameterization is continued using a semiprognostic approach. Observed data from Phase III of GATE are used to provide estimates of the large-scale forcing of a cumulus ensemble at each observation time. Instantaneous values of the precipitation and the warming and drying due to cumulus convection are calculated using the parameterization. The results show that the calculated precipitation agrees very well with estimates from the observed large-scale moisture budget and from radar observations. The calculated vertical profiles of cumulus warming and drying also are quite similar to the observed. It is shown that the closure assumption adopted in the parameterization (the cloud-work function quasi-equilibrium) results in errors of generally less than 10% in the calculated precipitation. The sensitivity of the parameterization to some assumptions of the cloud ensemble model and the solution method for the cloud-base mass flux is investigated.

Lord, S. J.↗

T-Matrix Modeling of Linear Depolarization by Morphologically Complex Soot and Soot-Containing Aerosols

We use state-of-the-art public-domain Fortran codes based on the T-matrix method to calculate orientation and ensemble averaged scattering matrix elements for a variety of morphologically complex black carbon (BC) and BC-containing aerosol particles, with a special emphasis on the linear depolarization ratio (LDR). We explain theoretically the quasi-Rayleigh LDR peak at side-scattering angles typical of low-density soot fractals and conclude that the measurement of this feature enables one to evaluate the compactness state of BC clusters and trace the evolution of low-density fluffy fractals into densely packed aggregates. We show that small backscattering LDRs measured with groundbased, airborne, and spaceborne lidars for fresh smoke generally agree with the values predicted theoretically for fluffy BC fractals and densely packed near-spheroidal BC aggregates. To reproduce higher lidar LDRs observed for aged smoke, one needs alternative particle models such as shape mixtures of BC spheroids or cylinders.

atmospheric radiation↗

Application of Ensemble Detection and Analysis to Modeling Uncertainty in Non Stationary Process

Characterization of non stationary and nonlinear processes is a challenge in many engineering and scientific disciplines. Climate change modeling and projection, retrieving information from Doppler measurements of hydrometeors, and modeling calibration architectures and algorithms in microwave radiometers are example applications that can benefit from improvements in the modeling and analysis of non stationary processes. Analyses of measured signals have traditionally been limited to a single measurement series. Ensemble Detection is a technique whereby mixing calibrated noise produces an ensemble measurement set. The collection of ensemble data sets enables new methods for analyzing random signals and offers powerful new approaches to studying and analyzing non stationary processes. Derived information contained in the dynamic stochastic moments of a process will enable many novel applications.

Racette, Paul↗

Viral coefficient and hidden mass in the galaxy groups

The purpose is the verification of the virial mass estimations for small galaxy groups. The dynamical evolution of triple and quintuple galaxies was studied by the numerical simulations. The dependence of the virial coefficient k(t) versus time was derived. Initial k(O) = O. The function k(t) has some strong oscillations from 0.02 to 0.99. Generally, these oscillations are quasiperiodical ones. Such a behavior of k(t) is caused by formation in a system of close isolated temporary double subsystems. A strong correlation between the virial coefficient and the least mutual distance in the system is observed. Such wide oscillations may add into the estimation of virial mass of the galaxy groups an uncertainty of more than one order. An additional uncertainty is introduced by the projection effect. This uncertainty for the individual estimations of the masses approach three orders. Thus any individual estimation of the virial mass is impossible for small galaxy groups. Some possibility of statistical estimation (median or average) of the total mass, including a hidden mass, is shown for the homogeneous samples. The authors propose a method for these estimations based on a comparison of the medians of dynamical parameters (a mean size in projection and a dispersion of relative radial velocities) for the simulated and observed ensembles of the galaxy groups. This method has been applied to a sample of 46 probably physical triplets of galaxies. The probable median of the hidden mass in a volume of the triplet is about 4 M, where M is the total mass of visible matter.

Anosova, Joanna P.↗

A Particle Batch Smoother Approach to Snow Water Equivalent Estimation

This paper presents a newly proposed data assimilation method for historical snow water equivalent SWE estimation using remotely sensed fractional snow-covered area fSCA. The newly proposed approach consists of a particle batch smoother (PBS), which is compared to a previously applied Kalman-based ensemble batch smoother (EnBS) approach. The methods were applied over the 27-yr Landsat 5 record at snow pillow and snow course in situ verification sites in the American River basin in the Sierra Nevada (United States). This basin is more densely vegetated and thus more challenging for SWE estimation than the previous applications of the EnBS. Both data assimilation methods provided significant improvement over the prior (modeling only) estimates, with both able to significantly reduce prior SWE biases. The prior RMSE values at the snow pillow and snow course sites were reduced by 68%-82% and 60%-68%, respectively, when applying the data assimilation methods. This result is encouraging for a basin like the American where the moderate to high forest cover will necessarily obscure more of the snow-covered ground surface than in previously examined, less-vegetated basins. The PBS generally outperformed the EnBS: for snow pillows the PBSRMSE was approx.54%of that seen in the EnBS, while for snow courses the PBSRMSE was approx.79%of the EnBS. Sensitivity tests show relative insensitivity for both the PBS and EnBS results to ensemble size and fSCA measurement error, but a higher sensitivity for the EnBS to the mean prior precipitation input, especially in the case where significant prior biases exist.

EnBS↗

Evaluation of a nonlinear method for the enhancement of tonal signal detection

A method is presented for biasing spectral estimates to enhance detection of tonal signals against a background of broadband noise. In this method, a nonlinear average of an ensemble of individual spectral estimates is made where broadband noise energy is biased downward, pure tone energy is unbiased, and a mixture of the two is biased by an amount that depends on the ratio of tonal energy to broadband energy. The method is analyzed to provide estimates of the extent of tonal signal detection enhancement.

Garber, Donald P.↗

Microphysics, Radiation and Surface Processes in the Goddard Cumulus Ensemble (GCE) Model

One of the most promising methods to test the representation of cloud processes used in climate models is to use observations together with Cloud Resolving Models (CRMs). The CRMs use more sophisticated and realistic representations of cloud microphysical processes, and they can reasonably well resolve the time evolution, structure, and life cycles of clouds and cloud systems (size about 2-200 km). The CRMs also allow explicit interaction between out-going longwave (cooling) and in-coming solar (heating) radiation with clouds. Observations can provide the initial conditions and validation for CRM results. The Goddard Cumulus Ensemble (GCE) Model, a CRM, has been developed and improved at NASA/Goddard Space Flight Center over the past two decades. The GCE model has been used to understand the following: 1) water and energy cycles and their roles in the tropical climate system; 2) the vertical redistribution of ozone and trace constituents by individual clouds and well organized convective systems over various spatial scales; 3) the relationship between the vertical distribution of latent heating (phase change of water) and the large-scale (pre-storm) environment; 4) the validity of assumptions used in the representation of cloud processes in climate and global circulation models; and 5) the representation of cloud microphysical processes and their interaction with radiative forcing over tropical and midlatitude regions. Four-dimensional cloud and latent heating fields simulated from the GCE model have been provided to the TRMM Science Data and Information System (TSDIS) to develop and improve algorithms for retrieving rainfall and latent heating rates for TRMM and the NASA Earth Observing System (EOS). More than 90 referred papers using the GCE model have been published in the last two decades. Also, more than 10 national and international universities are currently using the GCE model for research and teaching. In this talk, five specific major GCE improvements: (1) ice microphysics, (2) longwave and shortwave radiative transfer processes, (3) land surface processes, (4) ocean surface fluxes and (5) ocean mixed layer processes are presented. The performance of these new GCE improvements will be examined. Observations are used for model validation.

Tao, Wei-Kuo↗

Database for LDV signal processor performance analysis

A technique for the direct comparison of LDV signal processors is developed, based on the use of a data base of digitized signal bursts obtained from an LDV under various configurations. This data base can be used to evaluate the response of signal processors and processor algorithms to specific signal characteristics and not to generalized simplistic waveforms. Examples from such a data base are presented to illustrate the capabilities of the proposed method. This data base includes signal ensembles obtained with three laser power settings at two transmitted focal lengths.

Baker, Glenn D.↗

Advances in Hyperspectral Image Classification Methods for Vegetation and Agricultural Cropland Studies

Hyperspectral data are becoming more widely available via sensors on airborne and unmanned aerial vehicle (UAV) platforms, as well as proximal platforms. While space-based hyperspectral data continue to be limited in availability, multiple spaceborne Earth-observing missions on traditional platforms are scheduled for launch, and companies are experimenting with small satellites for constellations to observe the Earth, as well as for planetary missions. Land cover mapping via classification is one of the most important applications of hyperspectral remote sensing and will increase in significance as time series of imagery are more readily available. However, while the narrow bands of hyperspectral data provide new opportunities for chemistry-based modeling and mapping, challenges remain. Hyperspectral data are high dimensional, and many bands are highly correlated or irrelevant for a given classification problem. For supervised classification methods, the quantity of training data is typically limited relative to the dimension of the input space. The resulting Hughes phenomenon, often referred to as the curse of dimensionality, increases potential for unstable parameter estimates, overfitting, and poor generalization of classifiers. This is particularly problematic for parametric approaches such as Gaussian maximum likelihood–based classifiers that have been the backbone of pixel-based multispectral classification methods. This issue has motivated investigation of alternatives, including regularization of the class covariance matrices, ensembles of weak classifiers, development of feature selection and extraction methods, adoption of nonparametric classifiers, and exploration of methods to exploit unlabeled samples via semi-supervised and active learning. Data sets are also quite large, motivating computationally efficient algorithms and implementations. This chapter provides an overview of the recent advances in classification methods for mapping vegetation using hyperspectral data. Three data sets that are used in the hyperspectral classification literature (e.g., Botswana Hyperion satellite data and AVIRIS airborne data over both Kennedy Space Center and Indian Pines) are described in Section 3.2 and used to illustrate methods described in the chapter. An additional high-resolution hyperspectral data set acquired by a SpecTIR sensor on an airborne platform over the Indian Pines area is included to exemplify the use of new deep learning approaches, and a multiplatform example of airborne hyperspectral data is provided to demonstrate transfer learning in hyperspectral image classification. Classical approaches for supervised and unsupervised feature selection and extraction are reviewed in Section 3.3. In particular, nonlinearities exhibited in hyperspectral imagery have motivated development of nonlinear feature extraction methods in manifold learning, which are outlined in Section 3.3.1.4. Spatial context is also important in classification of both natural vegetation with complex textural patterns and large agricultural fields with significant local variability within fields. Approaches to exploit spatial features at both the pixel level (e.g., co-occurrence–based texture and extended morphological attribute profiles [EMAPs]) and integration of segmentation approaches (e.g., HSeg) are discussed in this context in Section 3.3.2. Recently, classification methods that leverage nonparametric methods originating in the machine learning community have grown in popularity. An overview of both widely used and newly emerging approaches, including support vector machines (SVMs), Gaussian mixture models, and deep learning based on convolutional neural networks is provided in Section 3.4. Strategies to exploit unlabeled samples, including active learning and metric learning, which combine feature extraction and augmentation of the pool of training samples in an active learning framework, are outlined in Section 3.5. Integration of image segmentation with classification to accommodate spatial coherence typically observed in vegetation is also explored, including as an integrated active learning system. Exploitation of multisensor strategies for augmenting the pool of training samples is investigated via a transfer learning framework in Section 3.5.1.2. Finally, we look to the future, considering opportunities soon to be provided by new paradigms, as hyperspectral sensing is becoming common at multiple scales from ground-based and airborne autonomous vehicles to manned aircraft and space-based platforms.

Pasolli, Edoardo↗

An Ensemble Neural Network Model for Predicting Rare-Earth Oxide and Silicate Heat Capacities at High Temperature

In this work, a neural network model was developed to predict the constant pressure heat capacity for materials in the rare-earth oxide—silica material space. Several model architectures were trained and tested on heat capacity data generated from first-principles density functional theory calculations. Hyperparameter optimization was performed, and the optimal model was selected for heat capacity predictions. The optimal model architecture was found to have a root-mean-squared error of 5.12 ± 3.37 J/mol-K. The optimal model architecture was then used in a bagging ensemble model trained using the leave-one-group-out method to provide error estimates for model predictions. The out-of-bag score for the ensemble model was 0.997. The predicted heat capacities agree well with the DFT and experimental results and were computed orders of magnitude faster than DFT simulations. Machine learning shows the potential to provide a suitable surrogate model for thermochemical property predictions for candidate environmental barrier coating materials but refining of input material features and model architectures could further improve accuracy for these models.

environmental barrier coatings↗

A comparison of measured and calculated optical properties of atmospheric aerosols at infrared wavelengths

Measurements of 10.6-micron lidar backscatter were compared with calculated backscatter based on nearly simultaneous observations of stratospheric and tropospheric aerosol size distributions. It was found that there is better agreement in the troposphere, even though the uncertainties of the calculation are greater for this region due to the variables in both the spatial concentration and the physical makeup of the aerosol. A second comparison study was made to test the consistency of the mean tropospheric extinction values at 1.02 micron (as reported by the SAGE satellite) with the values calculated from an ensemble of 400 measured size distributions thought to be representative of midcontinental tropospheric aerosol. The two methods produce consistent results within the expected degree of uncertainty. The ensemble of 400 'proven' size distributions is then used to calculate a statistical relationship between the 1.02-micron extinction and the 10.6-micron backscatter.

Rosen, James M.↗

A new method for simulating atmospheric turbulence for rotorcraft applications

Simulation of atmospheric turbulence as seen by a rotating blade element involves treatment of cyclostationary processes. Conventional filtering techniques do not lend themselves well to the generation of such turbulence sample functions as are required in rotorcraft flight dynamics simulation codes. A method to generate sample functions containing second order statistics of mean and covariance is presented. Compared to ensemble averaging involving excessive computer time, the novelty is to exploit cycloergodicity and thereby, replace ensemble averaging by averaging over a single path sample function of long duration. The method is validated by comparing its covariance results with the analytical and ensemble averaged results for a widely used 1-D turbulence approximation.

J. Riaz↗