Search NASA⌕ Search

SEARCH · Search NASA

Results for “Linear Covariance Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

The Effects of Noise on Polarimetric SAR Data

Polarimetric SAR data can provide a great deal of information about the scattering behavior of the surface under observation. Polarimetric SAR systems often measure the scattering matrices of the areas under observation in linear polarizations (H and V). From the scattering matrix commonly used forms such as the covariance matrix and the Stokes matrix can be easily derived. Other measures derived from polarimetric SAR data include the standard deviation of texture, correlation coefficients between scattering matrix terms, and the mode and variance of phase differences between scattering matrix terms. The effects of additive system noise on these measurements is not often considered in the literature on this subject.

Polarimetric SAR Data analysis↗

B-plane Evolution Under Highly Non-Keplerian Dynamics

Juno is the second of a series of New Frontiers missions and was launched in 2011. The spacecraft was set en route to Jupiter, and its Jupiter Orbit Insertion occurred on 2016-07-04 after a five-year cruise in deep space. The mission phase just prior to this large maneuver is called approach. As navigation team, we were responsible for precise orbit determination of the Juno spacecraft to ensure a successful orbit insertion. To evaluate the navigation performance we employed the B-plane mapping, where the incoming hyperbolic velocity defines the plane perpendicular to it, and the time to go to hit the plane will directly map into the uncertainties of the target point. The B-plane is a convenient tool when assessing the navigation performance as it is not affected by non-linearities due to the gravitational pull of the targeted body. However, as the Jupiter Orbit Insertion approached we started to realize that the B-plane mapping uncertainties were significantly larger than expected. We found that the B-plane mapping time had tremendous influence on the covariance inflation in the B-plane. Because of the close approach distance during the Jupiter Orbit Insertion and the strong interaction with J2 spherical harmonic coefficient, the Juno dynamics were too far from a Keplerian one assumed for the B-plane mapping. We first discuss the analytical approach of the B-plane mapping uncertainty and perform a numerical analysis to isolate the components of the Juno dynamics that cause the B-plane covariance inflation.

Bordi, John↗

Understanding Climate-Vegetation Interactions in Global Rainforests Through a GP-Tree Analysis

The tropical rainforests are the largest reserves of terrestrial carbon and, therefore, the future of these rainforests is a question that is of immense importance in the geoscience research community. With the recent severe Amazonian droughts in 2005 and 2010 and on-going drought in the Congo region for more than two decades, there is growing concern that these forests could succumb to precipitation reduction, causing extensive carbon release and feedback to the carbon cycle. However, there is no single ecosystem model that quantifies the relationship between vegetation health in these rainforests and climatic factors. Small scale studies have used statistical correlation measure and simple linear regression to model climate-vegetation interactions, but suffer from the lack of comprehensive data representation as well as simplistic assumptions about dependency of the target on the covariates. In this paper we use genetic programming (GP) based symbolic regression for discovering equations that govern the vegetation climate dynamics in the rainforests. Expecting micro-regions within the rainforests to have unique characteristics compared to the overall general characteristics, we use a modified regression-tree based hierarchical partitioning of the space to build individual models for each partition. The discovery of these equations reveal very interesting characteristics about the Amazon and the Congo rainforests. Our method GP-tree shows that the rainforests exhibit tremendous resiliency in the face of extreme climatic events by adapting to changing conditions.

genetic programming↗

Gravity field determination and error assessment techniques

Linear estimation theory, along with a new technique to compute relative data weights, was applied to the determination of the Earth's geopotential field and other geophysical model parameters using a combination of satellite ground-based tracking data, satellite altimetry data, and the surface gravimetry data. The relative data weights for the inhomogeneous data sets are estimated simultaneously with the gravity field and other geophysical and orbit parameters in a least squares approach to produce the University of Texas gravity field models. New techniques to perform calibration of the formal covariance matrix for the geopotential solution were developed to obtain a reliable gravity field error estimate. Different techniques, which include orbit residual analysis, surface gravity anomaly residual analysis, subset gravity solution comparisons and consider covariance analysis, were applied to investigate the reliability of the calibration.

Yuan, D. N.↗

Analysis of the lettuce data from the variable pressure growth chamber at NASA Johnson Space Center: A three-stage nested design model

A model of three-stage nested experimental design was applied to analyze the lettuce data obtained from the variable pressure growth chamber test bed at NASA-Johnson Space Center. From the results of an application of the analysis of variance and covariance on the data set, it was noted that all of the (uncontrollable) factors, Side, Zone, Height and (controllable) PAR (photosynthetically active radiation), had nonhomogeneous effects on the dry weight of the edible biomass of lettuce per pot. Incidentally, the variations accountable to the (uncontrollable) factorial heterogeneities are merely 9 percent and 17 percent of the total variation for both the first and second crop test, respectively. After adjusting for the PAR as a covariate in the no-intercept model, the accountable variations to all the four factors are 94 percent and 92 percent for the first and the second crop test, respectively. With the use of a no-intercept simple linear regression model, the accountable variations to the factor PAR are 92 percent and 90 percent for the first and the second crop test, respectively. Evidently, the (controllable) factor PAR is the dominating one.

Lee, Tze-San↗

Definition of Contravariant Velocity Components

This is an old issue in computational fluid dynamics (CFD). What is the so-called contravariant velocity or contravariant velocity component? In the article, we review the basics of tensor analysis and give the contravariant velocity component a rigorous explanation. For a given coordinate system, there exist two uniquely determined sets of base vector systems - one is the covariant and another is the contravariant base vector system. The two base vector systems are reciprocal. The so-called contravariant velocity component is really the contravariant component of a velocity vector for a time-independent coordinate system, or the contravariant component of a relative velocity between fluid and coordinates, for a time-dependent coordinate system. The contravariant velocity components are not physical quantities of the velocity vector. Their magnitudes, dimensions, and associated directions are controlled by their corresponding covariant base vectors. Several 2-D (two-dimensional) linear examples and 2-D mass-conservation equation are used to illustrate the details of expressing a vector with respect to the covariant and contravariant base vector systems, respectively.

Hung, Ching-Mao↗

Orbit-determination performance of Doppler data for interplanetary cruise trajectories. Part 1: Error analysis methodology

An error covariance analysis methodology is used to investigate different weighting schemes for two-way (coherent) Doppler data in the presence of transmission-media and observing-platform calibration errors. The analysis focuses on orbit-determination performance in the interplanetary cruise phase of deep-space missions. Analytical models for the Doppler observable and for transmission-media and observing-platform calibration errors are presented, drawn primarily from previous work. Previously published analytical models were improved upon by the following: (1) considering the effects of errors in the calibration of radio signal propagation through the troposphere and ionosphere as well as station-location errors; (2) modelling the spacecraft state transition matrix using a more accurate piecewise-linear approximation to represent the evolution of the spacecraft trajectory; and (3) incorporating Doppler data weighting functions that are functions of elevation angle, which reduce the sensitivity of the estimated spacecraft trajectory to troposphere and ionosphere calibration errors. The analysis is motivated by the need to develop suitable weighting functions for two-way Doppler data acquired at 8.4 GHz (X-band) and 32 GHz (Ka-band). This weighting is likely to be different from that in the weighting functions currently in use; the current functions were constructed originally for use with 2.3 GHz (S-band) Doppler data, which are affected much more strongly by the ionosphere than are the higher frequency data.

Ulvestad, J. S.↗

Comparison of On-Orbit Performance of Rate Sensing Gyroscopes

This work presents results from the study of a large volume of spacecraft flight data pertaining to gyroscope performance. We have examined long and short term trends of gyroscope biase of first, an exact solution for the time-dependence of the attitude part of the state error covariance, averaged over the three spacecraft axes, is given. This solution is more complete than the usual cubic polynomial for the variance in that it includes coupling among the three gyroscope axes and includes an important term arising from the initial correlations. Second, several continuous 24-hour spans of gyroscope data are examined to verify the short-term statistical model. This analysis demonstrates that in-flight data can be used to determine the strength of the white noise driving the random walk of the gyroscope bias. This may be useful for postlaunch improvement to the noise model and for diagnosing the health of the gyroscope. Third, the long-term trends in gyroscope biases show a nearly linear systematic variation over time scales of years. This has been found on three different missions. While the random walk model is adequate as a basis for onboard Kalman filters or for state estimation using relatively short time spans, these trends indicate that some applications could benefit by accounting for the secular changes in the biases. One example is a new gyroscope calibration method that is under development that allows for multi-epoch bias solutions.

Sedlak, Joseph↗

Basic research for the geodynamics program

The mathematical models of space very long base interferometry (VLBI) observables suitable for least squares covariance analysis were derived and estimatability problems inherent in the space VLBI system were explored, including a detailed rank defect analysis and sensitivity analysis. An important aim is to carry out a comparative analysis of the mathematical models of the ground-based VLBI and space VLBI observables in order to describe the background in detail. Computer programs were developed in order to check the relations, assess errors, and analyze sensitivity. In order to investigate the estimatability of different geodetic and geodynamic parameters from the space VLBI observables, the mathematical models for time delay and time delay rate observables of space VLBI were analytically derived along with the partial derivatives with respect to the parameters. Rank defect analysis was carried out both by analytical and numerical testing of linear dependencies between the columns of the normal matrix thus formed. Definite conclusions were formed about the rank defects in the system.

Source record↗

Radar sensitivity and antenna scan pattern study for a satellite-based Radar Wind Sounder (RAWS)

Modeling global atmospheric circulations and forecasting the weather would improve greatly if worldwide information on winds aloft were available. Recognition of this led to the inclusion of the LAser Wind Sounder (LAWS) system to measure Doppler shifts from aerosols in the planned for Earth Observation System (EOS). However, gaps will exist in LAWS coverage where heavy clouds are present. The RAdar Wind Sensor (RAWS) is an instrument that could fill these gaps by measuring Doppler shifts from clouds and rain. Previous studies conducted at the University of Kansas show RAWS as a feasible instrument. This thesis pertains to the signal-to-noise ratio (SNR) sensitivity, transmit waveform, and limitations to the antenna scan pattern of the RAWS system. A dop-size distribution model is selected and applied to the radar range equation for the sensitivity analysis. Six frequencies are used in computing the SNR for several cloud types to determine the optimal transmit frequency. the results show the use of two frequencies, one higher (94 GHz) to obtain sensitivity for thinner cloud, and a lower frequency (24 GHz) to obtain sensitivity for thinner cloud, and a lower frequency (24 GHz) for better penetration in rain, provide ample SNR. The waveform design supports covariance estimation processing. This estimator eliminates the Doppler ambiguities compounded by the selection of such high transmit frequencies, while providing an estimate of the mean frequency. the unambiguous range and velocity computation shows them to be within acceptable limits. The design goal for the RAWS system is to limit the wind-speed error to less than 1 ms(exp -1). Due to linear dependence between vectors for a three-vector scan pattern, a reasonable wind-speed error is unattainable. Only the two-vector scan pattern falls within the wind-error limits for azimuth angles between 16 deg to 70 deg. However, this scan only allows two components of the wind to be determined. As a result, a technique is then shown, based on the Z-R-V relationships, that permit the vertical component (i.e., rain) to be computed. Thus the horizontal wind components may be obtained form the covariance estimator and the vertical component from the reflectivity factor. Finally, a new candidate system is introduced which summarizes the parameters taken from previous RAWS studies, or those modified in this thesis.

Stuart, Michael A.↗

NASA CEV On-Orbit GN&C Analysis

The Orion spacecraft orbit GN&C system will be required to perform both ISS servicing missions and Lunar sortie and outpost crew transportation. While certain aspects of these two missions are complementary, the two missions are also distinct in many ways. Common between the missions is a Low Earth Orbit (LEO) rendezvous, one with the ISS And the other with the LSAM/EDS stack prior to trans-lunar insertion. The lunar missions will additionally require Orion to perform orbit maintenance in LLO, perform contingency lunar orbit operations including RPOD with the LSAM, perform the TEI maneuver sequence, and execute the trans-Earth cruise. The NASA-led team developed a reference configuration orbit GN&C system capable of executing all of these activities with the same navigation sensor suite and control effectors while fully meeting the requirements being developed for System Requirements Review in advance of prime contractor selection. This paper will present an overview of the analyses performed to support system trade studies, demonstrate the feasibility of the NASA reference configuration, and validate the Orion system requirements. These analyses include linear covariance techniques, 3-DOF Monte Carlo simulations, 6-DOF Monte Carlo simulations, and analytical evaluations of GN&C systems performed by the NASA-led Orion team to characterize the sensitivities of Orion s various missions and assess the unique challenges of each. The first part of this paper will describe the trade studies that were performed in order to characterize the RPOD system performance for both the ISS and the lunar missions including development of an RPOD operations concept, RPOD trajectories, contingency scenarios, docking mechanism and associated contact conditions, post-contact thrust issues, relative navigation sensors, relative navigation sensor target infrastructure. The paper will also discuss concepts for both manually-piloted and automatically executed scenarios, as well as the remotely-piloted contingency scenario in LLO. The second part of the paper will discuss the analyses performed for lunar and cislunar GN&C performance including the accuracy of the post-insertion lunar orbit, the ability of Orion to hit a particular Earth return entry corridor, attitude control solutions for long-duration surface operations, and autonomous navigation in support of TEI without ground tracking.

DSouza, Chris↗

Parameter identification of material constants in a composite shell structure

One of the basic requirements in engineering analysis is the development of a mathematical model describing the system. Frequently comparisons with test data are used as a measurement of the adequacy of the model. An attempt is typically made to update or improve the model to provide a test verified analysis tool. System identification provides a systematic procedure for accomplishing this task. The terms system identification, parameter estimation, and model correlation all refer to techniques that use test information to update or verify mathematical models. The goal of system identification is to improve the correlation of model predictions with measured test data, and produce accurate, predictive models. For nonmetallic structures the modeling task is often difficult due to uncertainties in the elastic constants. A finite element model of the shell was created, which included uncertain orthotropic elastic constants. A modal survey test was then performed on the shell. The resulting modal data, along with the finite element model of the shell, were used in a Bayes estimation algorithm. This permitted the use of covariance matrices to weight the confidence in the initial parameter values as well as confidence in the measured test data. The estimation procedure also employed the concept of successive linearization to obtain an approximate solution to the original nonlinear estimation problem.

Martinez, David R.↗

Exploring the Elevated Water Vapor Signal Associated With the Free Tropospheric Biomass Burning Plume Over the Southeast Atlantic Ocean

In southern Africa, widespread agricultural fires produce substantial biomass burning (BB) emissions over the region. The seasonal smoke plumes associated with these emissions are then advected westward over the persistent stratocumulus cloud deck in the southeast Atlantic (SEA) Ocean, resulting in aerosol effects which vary with time and location. Much work has focused on the effects of these aerosol plumes, but previous studies have also described an elevated free tropospheric water vapor signal over the SEA. Water vapor influences climate in its own right, and it is especially important to consider atmospheric water vapor when quantifying aerosol–cloud interactions and aerosol radiative effects. Here we present airborne observations made during the NASA ORACLES (ObseRvations of Aerosols above CLouds and their intEractionS) campaign over the SEA Ocean. In observations collected from multiple independent instruments on the NASA P-3 aircraft (from near-surface to 6–7 km), we observe a strongly linear correlation between pollution indicators (carbon monoxide (CO) and aerosol loading) and atmospheric water vapor content, seen at all altitudes above the boundary layer. The focus of the current study is on the especially strong correlation observed during the ORACLES-2016 deployment (out of Walvis Bay, Namibia), but a similar relationship is also observed in the August 2017 and October 2018 ORACLES deployments. Using reanalyses from the European Centre for Medium-Range Weather Forecasts (ECMWF) and Modern-Era Retrospective analysis for Research and Applications, Version 2 (MERRA-2), and specialized WRF-Chem simulations, we trace the plume–vapor relationship to an initial humid, smoky continental source region, where it mixes with clean, dry upper tropospheric air and then is subjected to conditions of strong westward advection, namely the southern African easterly jet (AEJ-S). Our analysis indicates that air masses likely left the continent with the same relationship between water vapor and carbon monoxide as was observed by aircraft. This linear relationship developed over the continent due to daytime convection within a deep continental boundary layer (up to ∼5–6 km) and mixing with higher-altitude air, which resulted in fairly consistent vertical gradients in CO and water vapor, decreasing with altitude and varying in time, but this water vapor does not originate as a product of the BB combustion itself. Due to a combination of conditions and mixing between the smoky, moist continental boundary layer and the dry and fairly clean upper-troposphere air above (∼6 km), the smoky, humid air is transported by strong zonal winds and then advected over the SEA (to the ORACLES flight region) following largely isentropic trajectories. Hybrid Single-Particle Lagrangian Integrated Trajectory model (HYSPLIT) back trajectories support this interpretation. This work thus gives insights into the conditions and processes which cause water vapor to covary with plume strength. Better understanding of this relationship, including how it varies spatially and temporally, is important to accurately quantify direct, semi-direct, and indirect aerosol effects over this region.

Kristina Pistone↗

NASA Langley's Approach to the Sandia's Structural Dynamics Challenge Problem

The objective of this challenge is to develop a data-based probabilistic model of uncertainty to predict the behavior of subsystems (payloads) by themselves and while coupled to a primary (target) system. Although this type of analysis is routinely performed and representative of issues faced in real-world system design and integration, there are still several key technical challenges that must be addressed when analyzing uncertain interconnected systems. For example, one key technical challenge is related to the fact that there is limited data on target configurations. Moreover, it is typical to have multiple data sets from experiments conducted at the subsystem level, but often samples sizes are not sufficient to compute high confidence statistics. In this challenge problem additional constraints are placed as ground rules for the participants. One such rule is that mathematical models of the subsystem are limited to linear approximations of the nonlinear physics of the problem at hand. Also, participants are constrained to use these models and the multiple data sets to make predictions about the target system response under completely different input conditions. Our approach involved initially the screening of several different methods. Three of the ones considered are presented herein. The first one is based on the transformation of the modal data to an orthogonal space where the mean and covariance of the data are matched by the model. The other two approaches worked solutions in physical space where the uncertain parameter set is made of masses, stiffnesses and damping coefficients; one matches confidence intervals of low order moments of the statistics via optimization while the second one uses a Kernel density estimation approach. The paper will touch on all the approaches, lessons learned, validation 1 metrics and their comparison, data quantity restriction, and assumptions/limitations of each approach. Keywords: Probabilistic modeling, model validation, uncertainty quantification, kernel density

Horta, Lucas G.↗

NASA Tech Briefs, September 2013

Topics include: ISS Ammonia Leak Detection Through X-Ray Fluorescence; A System for Measuring the Sway of the Vehicle Assembly Building; Fast, High-Precision Readout Circuit for Detector Arrays; Victim Simulator for Victim Detection Radar; Hydrometeor Size Distribution Measurements by Imaging the Attenuation of a Laser Spot; Quasi-Linear Circuit; High-Speed, High-Resolution Time-to-Digital Conversion; Li-Ion Battery and Supercapacitor Hybrid Design for Long Extravehicular Activities; Ultrasonic Low-Friction Containment Plate for Thermal and Ultrasonic Stir Weld Processes; High-Powered, Ultrasonically Assisted Thermal Stir Welding; Next-Generation MKIII Lightweight HUT/Hatch Assembly; Centrifugal Sieve for Gravity-Level-Independent Size; Segregation of Granular Materials; Ion Exchange Technology Development in Support of the Urine Processor Assembly; Nickel-Graphite Composite Compliant Interface and/or Hot Shoe Material; UltraSail CubeSat Solar Sail Flight Experiment; Mechanism for Deploying a Long, Thin-Film Antenna From a Rover; Counterflow Regolith Heat Exchanger; Acquisition and Retaining Granular Samples via a Rotating Coring Bit; Very-Low-Cost, Rugged Vacuum System; Medicine Delivery Device With Integrated Sterilization and Detection; FRET-Aptamer Assays for Bone Marker Assessment, C-Telopeptide, Creatinine, and Vitamin D; Multimode Directional Coupler for Utilization of Harmonic Frequencies from TWTAs; Dual-Polarization, Multi-Frequency Antenna Array for use with Hurricane Imaging Radiometer; Complementary Barrier Infrared Detector (CBIRD) Contact Methods; Autonomous Control of Space Nuclear Reactors; High-Power, High-Speed Electro-Optic Pockels Cell Modulator; Covariance Analysis Tool (G-CAT) for Computing Ascent, Descent, and Landing Errors; Enigma Version 12; Micrometeoroid and Orbital Debris (MMOD) Shield Ballistic Limit Analysis Program; Spitzer Telemetry Processing System; Planetary Protection Bioburden Analysis Program; Wing Leading Edge RCC Rapid Response Damage Prediction Tool (IMPACT2); ISSM: Ice Sheet System Model; Automated Loads Analysis System (ATLAS); Integrated Main Propulsion System Performance Reconstruction Process/Models. Phoenix Telemetry Processor; Contact Graph Routing Enhancements Developed in ION for DTN; GFEChutes Lo-Fi; Advanced Strategic and Tactical Relay Request Management for the Mars Relay Operations Service; Software for Generating Troposphere Corrections for InSAR Using GPS and Weather Model Data; Ionospheric Specifications for SAR Interferometry (ISSI); Implementation of a Wavefront-Sensing Algorithm; Sally Ride EarthKAM - Automated Image Geo-Referencing Using Google Earth Web Plug-In; Trade Space Specification Tool (TSST) for Rapid Mission Architecture (Version 1.2); Acoustic Emission Analysis Applet (AEAA) Software; Memory-Efficient Onboard Rock Segmentation; Advanced Multimission Operations System (ATMO); Robot Sequencing and Visualization Program (RSVP); Automating Hyperspectral Data for Rapid Response in Volcanic Emergencies; Raster-Based Approach to Solar Pressure Modeling; Space Images for NASA JPL Android Version; Kinect Engineering with Learning (KEWL); Spacecraft 3D Augmented Reality Mobile App; MPST Software: grl_pef_check; Real-Time Multimission Event Notification System for Mars Relay; SIM_EXPLORE: Software for Directed Exploration of Complex Systems; Mobile Timekeeping Application Built on Reverse-Engineered JPL Infrastructure; Advanced Query and Data Mining Capabilities for MaROS; Jettison Engineering Trajectory Tool; MPST Software: grl_suppdoc; PredGuid+A: Orion Entry Guidance Modified for Aerocapture; Planning Coverage Campaigns for Mission Design and Analysis: CLASP for DESDynl; and Space Place Prime.

Source record↗

Implementation and Comparison of Acoustic Travel-Time Measurement Procedures for the Solar Dynamics Observatory-Helioseismic and Magnetic Imager Time-Distance Helioseismology Pipeline

The Helioseismic and Magnetic Imager (HMI) instrument onboard the Solar Dynamics Observatory (SDO) satellite is designed to produce high-resolution Doppler-velocity maps of oscillations at the solar surface with high temporal cadence. To take advantage of these high-quality oscillation data, a time - distance helioseismology pipeline (Zhao et al., Solar Phys. submitted, 2010) has been implemented at the Joint Science Operations Center (JSOC) at Stanford University. The aim of this pipeline is to generate maps of acoustic travel times from oscillations on the solar surface, and to infer subsurface 3D flow velocities and sound-speed perturbations. The wave travel times are measured from cross-covariances of the observed solar oscillation signals. For implementation into the pipeline we have investigated three different travel-time definitions developed in time - distance helioseismology: a Gabor-wavelet fitting (Kosovichev and Duvall, SCORE'96: Solar Convection and Oscillations and Their Relationship, ASSL, Dordrecht, 241, 1997), a minimization relative to a reference cross-covariance function (Gizon and Birch, Astrophys. J. 571, 966, 2002), and a linearized version of the minimization method (Gizon and Birch, Astrophys. J. 614, 472, 2004). Using Doppler-velocity data from the Michelson Doppler Imager (MDI) instrument onboard SOHO, we tested and compared these definitions for the mean and difference traveltime perturbations measured from reciprocal signals. Although all three procedures return similar travel times in a quiet-Sun region, the method of Gizon and Birch (Astrophys. J. 614, 472, 2004) gives travel times that are significantly different from the others in a magnetic (active) region. Thus, for the pipeline implementation we chose the procedures of Kosovichev and Duvall (SCORE'96: Solar Convection and Oscillations and Their Relationship, ASSL, Dordrecht, 241, 1997) and Gizon and Birch (Astrophys. J. 571, 966, 2002). We investigated the relationships among these three travel-time definitions, their sensitivities to fitting parameters, and estimated the random errors that they produce.

HMI↗

Fast Solution in Sparse LDA for Binary Classification

An algorithm that performs sparse linear discriminant analysis (Sparse-LDA) finds near-optimal solutions in far less time than the prior art when specialized to binary classification (of 2 classes). Sparse-LDA is a type of feature- or variable- selection problem with numerous applications in statistics, machine learning, computer vision, computational finance, operations research, and bio-informatics. Because of its combinatorial nature, feature- or variable-selection problems are NP-hard or computationally intractable in cases involving more than 30 variables or features. Therefore, one typically seeks approximate solutions by means of greedy search algorithms. The prior Sparse-LDA algorithm was a greedy algorithm that considered the best variable or feature to add/ delete to/ from its subsets in order to maximally discriminate between multiple classes of data. The present algorithm is designed for the special but prevalent case of 2-class or binary classification (e.g. 1 vs. 0, functioning vs. malfunctioning, or change versus no change). The present algorithm provides near-optimal solutions on large real-world datasets having hundreds or even thousands of variables or features (e.g. selecting the fewest wavelength bands in a hyperspectral sensor to do terrain classification) and does so in typical computation times of minutes as compared to days or weeks as taken by the prior art. Sparse LDA requires solving generalized eigenvalue problems for a large number of variable subsets (represented by the submatrices of the input within-class and between-class covariance matrices). In the general (fullrank) case, the amount of computation scales at least cubically with the number of variables and thus the size of the problems that can be solved is limited accordingly. However, in binary classification, the principal eigenvalues can be found using a special analytic formula, without resorting to costly iterative techniques. The present algorithm exploits this analytic form along with the inherent sequential nature of greedy search itself. Together this enables the use of highly-efficient partitioned-matrix-inverse techniques that result in large speedups of computation in both the forward-selection and backward-elimination stages of greedy algorithms in general.

Moghaddam, Baback↗

Preliminary Results Cycling GEOS-JEDI with GSI-based Background Errors

The first phase of transitioning the NASA GMAO GEOS atmospheric data assimilation capabilities to JEDI involves the replacement of the Grid-point Statistical Interpolation (GSI) with a corresponding JEDI analysis. This includes taking JEDI's Unified Observation Operator (UFO), its underlying dependencies, and the JEDI solver that enables a hybrid 4DEnVar strategy similar to what is used in the current GEOS-GSI system. Variational analysis involves at least two main components associated with the observation and background cost function terms. The first is directly related to the UFO, which is being carefully validated in a joint collaboration between GMAO and NCEP to demonstrate consistency with corresponding observations usage in GSI. The second component is the background term, which in a hybrid system involves the ability to set up both a climatologically-based term and an ensemble-based term. JEDI provides the means to implement both terms through its BUMP component. Use of BUMP would require a complete re-tune of both climatological and ensemble, which is a non-trivial exercise we would prefer to avoid. As an alternative, the work here studies the results of interfacing the GSI-background error capability (GSIBEC) into JEDI through SABER. With this, the exact same background error covariance formulation used in GSI can be employed in JEDI without need for re-tuning. This brief summary covers the work done to interface GSIBEC into JEDI and shows preliminary results where the background error covariances of the control (GEOS-GSI) and experiment (GEOS-JEDI) are identical in corresponding cycling experiments. The cycling exercise is obviously preliminary and so much can be expected from GEOS-JEDI when compared to GEOS-GSI. There is still a number of features that need closer attention and although in some cases in principle ready to cycle have been intentionally either turned off or not fully exercised (e.g., VarBC is applied but not cycled). Other features are still pending implementation, one such example is the implementation of the Tangent Linear Normal Mode Constraint. Still, results are quite encouraging as hopefully the discussion here illustrates.

Ricardo Todling↗