2D signal estimation for sparse distributed target photon counting data
Explore the source record for details and available documents.
Matthew Hayman↗
SEARCH · Search NASA
Results for “Sparse estimation”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Joint Model and Phase Parameter Estimation in Sparse Synthetic Aperture Radar Interferometric Measurements
Explore the source record for details and available documents.
interferometry isolated interferometric geodetic m↗
A Systematic Approach for Real-Time Operator Functional State Assessment
A task overload condition often leads to high stress for an operator, causing performance degradation and possibly disastrous consequences. Just as dangerous, with automated flight systems, an operator may experience a task underload condition (during the en-route flight phase, for example), becoming easily bored and finding it difficult to maintain sustained attention. When an unexpected event occurs, either internal or external to the automated system, the disengaged operator may neglect, misunderstand, or respond slowly/inappropriately to the situation. In this paper, we discuss an approach for Operator Functional State (OFS) monitoring in a typical aviation environment. A systematic ground truth finding procedure has been designed based on subjective evaluations, performance measures, and strong physiological indicators. The derived OFS ground truth is continuous in time compared to a very sparse estimation of OFS based on an expert review or subjective evaluations. It can capture the variations of OFS during a mission to better guide through the training process of the OFS assessment model. Furthermore, an OFS assessment model framework based on advanced machine learning techniques was designed and the systematic approach was then verified and validated with experimental data collected in a high fidelity Boeing 737 simulator. Preliminary results show highly accurate engagement/disengagement detection making it suitable for real-time applications to assess pilot engagement.
Zhang, Guangfan↗
Applicability of Loads Estimation Techniques Using Sparse Acceleration Sensor Data to Spacecraft Structural Health Monitoring
The use of structural health monitoring systems on spacecraft structures can play a crucial role in ensuring the safety, reliability, and longevity of the structure by gathering and analyzing onboard sensor data. Of specific importance is monitoring for excessive loading at critical interfaces as any off-nominal structural excitations experienced by spacecraft structures can cause early unpredicted high structural life consumption or damage. The availability and cost of flight-certified sensors along with the size of spacecraft structures and allowable payload mass drives the need for a method to estimate loads using sparsely-located sensors. Numerous approaches such as physics-based, statistical learning, and physics-enhanced statistical learning algorithms have gained popularity among structural prognostics applications. However, developing noise-robust prediction models to assess loads and structural life predictions from a sparse multi-sensor data acquisition system can be a challenging task. This paper discusses the evaluation of physics-based versus machine-learning algorithms for predicting loads and structural life at mission critical locations on the spacecraft structure using a finite element loads analysis with the application of simulated noise and noise reduction techniques. To estimate the loads from accelerations, the physics-based algorithm leverages a loads transformation matrix from a Craig-Bampton reduced finite element model. A System Equivalent Reduction Expansion Process (SEREP) and a pseudo-inverse approach are considered to expand from the onboard sensor degrees of freedom to the Craig-Bampton model degrees of freedom. The machine learning algorithm provides a data driven solution/mapping of the sensor accelerations to the loads at the mission critical locations using a high dimensionality analysis. Although these strategies produce comparable loads prediction without noise, the limitations of these strategies with incorporating simulated noise and noise reduction techniques with low signal to noise ratio signals are evaluated. The study demonstrates the immense potential of statistical learning algorithms for sparse structural prognostic models and enhancing signal denoising techniques. These findings also highlight the need for noise-resilient prognostic models and low-noise data acquisition systems onboard spacecraft structures.
Spacecraft Structural Health Monitoring↗
Estimating Bare Earth in Sparse Boreal Forests With WorldView Stereo Imagery
Circumboreal forests are currently experiencing rapid climate warming which is altering their structure, productivity, and status as a carbon sink. Very-high resolution (VHR, <2 m) stereo derived digital surface models are available to monitor these forests, but, a similar resolution digital terrain model (DTM) is required to extract information about tree height, which is often used to estimate carbon content. To our knowledge, no openly available VHR DTM currently exists. To address this need, we developed approaches to extract DTMs by filtering VHR stereo point clouds (PCs) in sparse canopies of Alaska. Our evaluation consisted of two stereo processing methods with three PC search radii, at six different tree canopy cover (TCC) intervals. We found VHR DTMs were robust for estimating bare ground at TCC intervals less than 40% with vertical errors <1.6 m using airborne small footprint light detection and ranging (LiDAR) as reference.
Christopher S R Neigh↗
Estimating Bare Earth in Sparse Boreal Forests With WorldView Stereo Imagery
Circumboreal forests are currently experiencing rapid climate warming which is altering their structure, productivity, and status as a carbon sink. Very-high resolution (VHR, <2 m) stereo derived digital surface models are available to monitor these forests, but, a similar resolution digital terrain model (DTM) is required to extract information about tree height, which is often used to estimate carbon content. To our knowledge, no openly available VHR DTM currently exists. To address this need, we developed approaches to extract DTMs by filtering VHR stereo point clouds (PCs) in sparse canopies of Alaska. Our evaluation consisted of two stereo processing methods with three PC search radii, at six different tree canopy cover (TCC) intervals. We found VHR DTMs were robust for estimating bare ground at TCC intervals less than 40% with vertical errors <1.6 m using airborne small footprint light detection and ranging (LiDAR) as reference.
Christopher S. R. Neigh↗
On the use of radiative surface temperature to estimate sensible heat flux over sparse shrubs in Nevada
The accurate partitioning of available energy into sensible and latent heat flux is crucial to the understanding of surface atmosphere interactions. This issue is more complicated in arid and semi arid regions where the relative contribution to surface fluxes from the soil and vegetation may vary significantly throughout the day and throughout the season. A three component model to estimate sensible heat flux over heterogeneous surfaces is presented. The surface was represented with two adjacent compartments. The first compartment is made up of two components, shrubs and shaded soil, the second of open 'illuminated' soil. Data collected at two different sites in Nevada (U.S.) during the Summers of 1991 and 1992 were used to evaluate model performance. The results show that the present model is sufficiently general to yield satisfactory results for both sites.
Chehbouni, A.↗
LAI inversion from optical reflectance using a neural network trained with a multiple scattering model
The inversion of the leaf area index (LAI) canopy parameter from optical spectral reflectance measurements is obtained using a backpropagation artificial neural network trained using input-output pairs generated by a multiple scattering reflectance model. The problem of LAI estimation over sparse canopies (LAI < 1.0) with varying soil reflectance backgrounds is particularly difficult. Standard multiple regression methods applied to canopies within a single homogeneous soil type yield good results but perform unacceptably when applied across soil boundaries, resulting in absolute percentage errors of >1000 percent for low LAI. Minimization methods applied to merit functions constructed from differences between measured reflectances and predicted reflectances using multiple-scattering models are unacceptably sensitive to a good initial guess for the desired parameter. In contrast, the neural network reported generally yields absolute percentage errors of <30 percent when weighting coefficients trained on one soil type were applied to predicted canopy reflectance at a different soil background.
Smith, James A.↗
Validation of Ocean Color Satellite Data Products in Under Sampled Marine Areas
The planktonic marine cyanobacterium, Trichodesmium sp., is broadly distributed throughout the oligotrophic marine tropical and sub-tropical oceans. Trichodesmium, which typically occurs in macroscopic bundles or colonies, is noteworthy for its ability to form large surface aggregations and to fix dinitrogen gas. The latter is important because primary production supported by N2 fixation can result in a net export of carbon from the surface waters to deep ocean and may therefore play a significant role in the global carbon cycle. However, information on the distribution and density of Trichodesmium from shipboard measurements through the oligotrophic oceans is very sparse. Such estimates are required to quantitatively estimate total global rates of N2 fixation. As a result current global rate estimates are highly uncertain. Thus in order to understand the broader biogeochemical importance of Trichodesmium and N2 fixation in the oceans, we need better methods to estimate the global temporal and spatial variability of this organism. One approach that holds great promise is satellite remote sensing. Satellite ocean color sensors are ideal instruments for estimating global phytoplankton biomass, especially that due to episodic blooms, because they provide relatively high frequency synoptic information over large areas. Trichodesmium has a combination of specific ultrastructural and biochemical features that lend themselves to identification of this organism by remote sensing. Specifically, these features are high backscatter due to the presence of gas vesicles, and absorption and fluorescence of phycoerythrin. The resulting optical signature is relatively unique and should be detectable with satellite ocean color sensors such as the Sea-Viewing Wide Field-of-view Sensor (SeaWiFS).
Subramaniam, Ajit↗
High-Order Multivariable Transfer Function Curve Fitting: Algorithms, Space Matrix Methods and Experimental Results
This paper develops a computational approach to multivariable frequency domain curve fitting, based on 2-norm minimization.
matrix; parameter estimation; sparse matrices; mat↗
Regional Tropical Aboveground Biomass Mapping with L-Band Repeat-Pass Interferometric Radar, Sparse Lidar, and Multiscale Superpixels
We introduce a multiscale superpixel approach that leverages repeat-pass interferometric coherence and sparse AGB estimates from a simulated spaceborne lidar in order to extend the NISAR mission’s applicable range of aboveground biomass (AGB) in tropical forests. Airborne and spaceborne L-band radar and full-waveform airborne lidar data are used to simulate the NISAR and GEDI mission, respectively. In addition to UAVSAR data, we use spaceborneALOS-2/PALSAR-2 imagery with 14-day temporal baseline, which is comparable to NISAR’s 12-daybaseline. Our reference AGB maps are derived from the airborne LVIS data during the AfriSAR campaign for three sites (Mondah, Ogooue, and Lope). Each tropical site has mean AGB of at least 125 Mg/ha in addition to areas with AGB exceeding 700 Mg/ha. Spatially sampling from these LVIS-derived AGB reference maps, we approximate GEDI AGB estimates. To evaluate our methodology, we perform several different analyses. First, we partition each study site into low(≤100 Mg/ha) and high (>100 Mg/ha) AGB areas, in conformity with the NISAR mission requirement to provide AGB estimates for forests between 0 and 100 Mg/ha with a RMSE below 20 Mg/ha. In the low AGB areas, this RMSE requirement is satisfied in Lope and Mondah and it fell short of the requirement in Ogooue by less 3 Mg/ha with UAVSAR and 6 Mg/ha with PALSAR-2. We note that our maps have finer spatial resolution (50 m) than NISAR requires (1 hectare). In the high AGB areas, the normalized RMSE increases to 51% (i.e.,<90 Mg/ha), but with negligible bias for all three sites. Second, we train a single model to estimate AGB across both high and low AGB regimes simultaneously and obtain a normalized RMSE that is<60% (or<100 Mg/ha). Lastly, we show the use of both (a) multiscale superpixels and (b) interferometric coherence significantly improves the accuracy of the AGB estimates. The InSAR coherence improved the RMSE by approximately 8% at Mondah with both sensors, lowering the RMSE from 59 Mg/ha to 47.4 Mg/h with UAVSAR and from 57.1 Mg/ha to 46 Mg/ha. This work illustrates one of the numerous synergistic relationships between the spaceborne lidars, such as GEDI, with L-band SAR, such as PALSAR-2 and NISAR, in order to produce robust regional AGB in high biomass tropical regions.
NISAR↗
Coupled Data Assimilation for Integrated Earth System Analysis and Prediction: Goals, Challenges, and Recommendations
The purpose of this report is to identify fundamental issues for coupled data assimilation (CDA), such as gaps in science and limitations in forecasting systems, in order to provide guidance to the World Meteorological Organization (WMO) on how to facilitate more rapid progress internationally. Coupled Earth system modeling provides the opportunity to extend skillful atmospheric forecasts beyond the traditional two-week barrier by extracting skill from low-frequency state components such as the land, ocean, and sea ice. More generally, coupled models are needed to support seamless prediction systems that span timescales from weather, subseasonal to seasonal (S2S), multiyear, and decadal. Therefore, initialization methods are needed for coupled Earth system models, either applied to each individual component (called Weakly Coupled Data Assimilation - WCDA) or applied the coupled Earth system model as a whole (called Strongly Coupled Data Assimilation - SCDA). Using CDA, in which model forecasts and potentially the state estimation are performed jointly, each model domain benefits from observations in other domains either directly using error covariance information known at the time of the analysis (SCDA), or indirectly through flux interactions at the model boundaries (WCDA). Because the non-atmospheric domains are generally under-observed compared to the atmosphere, CDA provides a significant advantage over single-domain analyses. Next, we provide a synopsis of goals, challenges, and recommendations to advance CDA: Goals: (a) Extend predictive skill beyond the current capability of NWP (e.g. as demonstrated by improving forecast skill scores), (b) produce physically consistent initial conditions for coupled numerical prediction systems and reanalyses (including consistent fluxes at the domain interfaces), (c) make best use of existing observations by allowing observations from each domain to influence and improve the full earth system analysis, (d) develop a robust observation-based identification and understanding of mechanisms that determine the variability of weather and climate, (e) identify critical weaknesses in coupled models and the earth observing system, (f) generate full-field estimates of unobserved or sparsely observed variables, (g) improve the estimation of the external forcings causing changes to climate, (h) transition successes from idealized CDA experiments to real-world applications. Challenges: (a) Modeling at the interfaces between interacting components of coupled Earth system models may be inadequate for estimating uncertainty or error covariances between domains, (b) current data assimilation methods may be insufficient to simultaneously analyze domains containing multiple spatiotemporal scales of interest, (c) there is no standardization of observation data or their delivery systems across domains, (d) the size and complexity of many large-scale coupled Earth system models makes it is difficult to accurately represent uncertainty due to model parameters and coupling parameters, (e) model errors lead to local biases that can transfer between the different Earth system components and lead to coupled model biases and long-term model drift, (e) information propagation across model components with different spatiotemporal scales is extremely complicated, and must be improved in current coupled modeling frameworks, (h) there is insufficient knowledge on how to represent evolving errors in non-atmospheric model components (e.g. as sea ice, land and ocean) on the timescales of NWP.
CDA↗
TRMM Field Campaigns: Objectives and Status Report
The Tropical Rainfall Measuring Mission (TRMM) satellite has been sending valuable data since launch in November 1997. Some of the key goals of the joint NASA (US) and NASDA (Japan) mission are: (1) to estimate the four-dimensional diabatic heating in the tropical and subtropical atmosphere, (2) understand the role of latent heating in driving tropical and extratropical circulations, (3) obtain monthly area-averaged estimates of rainfall over the data-sparse oceans, and (4) estimate the relative contribution of convective and stratiform precipitation over different regions during different seasons. The overarching scientific objective is to understand and improve estimates of rainfall and latent heating profiles throughout the global tropics. This requires observations for fundamental understanding of cloud dynamics and microphysics, as well as for validation, testing assumptions and error estimates of cloud-resolving models, forward radiative transfer models, algorithms used to estimate rainfall statistics and vertical structure of precipitation from surface-based radar, and from satellites. Field experiments designed to contribute to this understanding have been conducted in Texas and the South China Sea in spring of 1998, Florida in summer of 1998, and interior Brazil in (boreal) winter 1999. In summer 1999, a major oceanic campaign will be based at Kwajalein Atoll. Some early results will be highlighted, noting some significant contrasts between oceanic and continental convective systems.
Zipser, Edward I.↗
Optimal post-experiment estimation of poorly modeled dynamic systems
Recently, a novel strategy for post-experiment state estimation of discretely-measured dynamic systems has been developed. The method accounts for errors in the system dynamic model equations in a more general and rigorous manner than do filter-smoother algorithms. The dynamic model error terms do not require the usual process noise assumptions of zero-mean, symmetrically distributed random disturbances. Instead, the model error terms require no prior assumptions other than piecewise continuity. The resulting state estimates are more accurate than filters for applications in which the dynamic model error clearly violates the typical process noise assumptions, and the available measurements are sparse and/or noisy. Estimates of the dynamic model error, in addition to the states, are obtained as part of the solution of a two-point boundary value problem, and may be exploited for numerous reasons. In this paper, the basic technique is explained, and several example applications are given. Included among the examples are both state estimation and exploitation of the model error estimates.
Mook, D. Joseph↗
The effects of missing data on global ozone estimates
The effects of missing data and model truncation on estimates of the global mean, zonal distribution, and global distribution of ozone are considered. It is shown that missing data can introduce biased estimates with errors that are not accounted for in the accuracy calculations of empirical modeling techniques. Data-fill techniques are introduced and used for evaluating error bounds and constraining the estimate in areas of sparse and missing data. It is found that the accuracy of the global mean estimate is more dependent on data distribution than model size. Zonal features can be accurately described by 7th order models over regions of adequate data distribution. Data variance accounted for by higher order models appears to represent climatological features of columnar ozone rather than pure error. Data-fill techniques can prevent artificial feature generation in regions of sparse or missing data without degrading high order estimates over dense data regions.
Drewry, J. W.↗
A TRMM-Calibrated Infrared Rainfall Algorithm Over Brazil
An improved version of the Convective/Stratiform Technique (CST) and its application over Brazil are presented. Keeping the major components of traditional CST, we have modified the scheme for classing convective and stratiform rainfall and tested various schemes to eliminate non-raining cirrus clouds. The parameters of the technique are calibrated using Tropical Rainfall Measuring Mission (TRMM) multi-sensor observations, including TMI, PR and Visible Infrared Scanner (VIRS). This technique takes advantage of the high temporal sampling rate of geosynchronous infrared channel and the better instantaneous rain observation of TRMM Microwave Imager (TMI) and PR. Moreover, sparse TMI rain estimates are used to dynamically calibrate the parameters of the technique to improve its performance. The technique is applied to make rainfall estimates on various time scales and to study rainfall statistics such as the distributions of rain intensity and storm duration over a four-month period beginning January 1999. The study period coincides with the TRMM/Large-Scale Biosphere-Atmosphere experiment in Amazonia (LBA) ground validation experiment, and observations from the LBA radar are used to validate the technique. Results show the mean diurnal cycle of precipitation over the LBA area, and are compared to radar data from the Tropical Oceans and Global Atmosphere (TOGA) radar. When the larger geographic region is considered, the analysis of the mean hourly estimates revealed the pronounced effects of rivers, topography and local circulations on the rainfall.
Negri, Andrew J.↗
Wide-Field Infrared Survey Explorer Observations of Young Stellar Objects in the Lynds 1509 Dark Cloud in Auriga
The Wide-Field Infrared Survey Explorer (WISE) has uncovered a striking cluster of young stellar object (YSO) candidates associated with the L1509 dark cloud in Auriga. The WISE observations, at 3.4, 4.6, 12, and 22 microns, show a number of objects with colors consistent with YSOs, and their spectral energy distributions suggest the presence of circumstellar dust emission, including numerous Class I, flat spectrum, and Class II objects. In general, the YSOs in L1509 are much more tightly clustered than YSOs in other dark clouds in the Taurus-Auriga star forming region, with Class I and flat spectrum objects confined to the densest aggregates, and Class II objects more sparsely distributed. We estimate a most probable distance of 485-700 pc, and possibly as far as the previously estimated distance of 2 kpc.
Infrared↗
Probabilistic Machine Learning Estimation of Ocean Mixed Layer Depth from Dense Satellite and Sparse In-Situ Observations
The ocean mixed layer plays an important role in the coupling between the upper ocean and atmosphere across a wide range of time scales. Estimation of the variability of the ocean mixed layer is therefore important for atmosphere-ocean prediction and analysis. The increasing coverage of in situ Argo profile data allows for an increasingly accurate analysis of the mixed layer depth (MLD) variability associated with deviations from the seasonal climatology. However, sampling rates are not sufficient to fully resolve subseasonal (<90 day) MLD variability. Yet, many multivariate observations-based analyses include implicit modeled subseasonal MLD variability. One analysis method is optimal interpolation of in situ data, but the interior analysis can be improved by leveraging surface data with regression or variational approaches. Here, we demonstrate how machine learning methods and satellite sea surface temperature, salinity, and height facilitate MLD estimation in a pilot study of two regions: the mid-latitude southern Indian and the eastern equatorial Pacific Oceans. We construct multiple machine learning architectures to produce weekly 1/2° gridded MLD anomaly fields (relative to a monthly climatology) with uncertainty estimates. We test multiple traditional and probabilistic machine learning techniques to compare both accuracy and probabilistic calibration. We validate our methodology by applying it to ocean model simulations. We find that incorporating sea surface data through a machine learning model improves the performance of spatiotemporal MLD variability estimation compared to optimal interpolation of Argo observations alone. These preliminary results are a promising first step for the application of machine learning to MLD prediction.
Machine Learning↗