SEARCH · Search NASA

Results for “sparse data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38

All sources NASA NTRS DOE OSTI

NASA NTRS2007

The Development of Microshutters for the Near Infrared Spectrograph on the James Webb Space Telescope

One of the James Webb Space Telescope's (JWST) primary science goals is to characterize the epoch of galaxy formation in the universe and observe the first galaxies and clusters of galaxies. This goal requires multi-band imaging and spectroscopic data in the near infrared portion of the spectrum for large numbers of very faint galaxies. Because such objects are sparse on the sky at the JWST resolution, a multi-object spectrograph is necessary to efficiently carry out the required observations. We have developed a fully programmable microshutter array that will be used as the field selector for the Near Infrared Spectrograph (NIRSpec) on JWST. This device allows slits to be opened at the locations of selected galaxies in the field of view while blocking other unwanted light from the sky background and bright sources. In practice, greater than 100 objects within the field of view will be observed simultaneously. In this paper, we describe the microshutter arrays, their development, fabrication, testing, and progress toward delivery of flight qualified devices to the NIRSpec instrument team in 2008.

Silverberg, Robert F.↗

NASA NTRS2007

A Microshutter-Based Field Selector for JWST's Near Infared Spectrograph

Silvergerg, Rorbert F.↗

NASA NTRS2009

Recent Advances in Techniques for Hyperspectral Image Processing

Imaging spectroscopy, also known as hyperspectral imaging, has been transformed in less than 30 years from being a sparse research tool into a commodity product available to a broad user community. Currently, there is a need for standardized data processing techniques able to take into account the special properties of hyperspectral data. In this paper, we provide a seminal view on recent advances in techniques for hyperspectral image processing. Our main focus is on the design of techniques able to deal with the highdimensional nature of the data, and to integrate the spatial and spectral information. Performance of the discussed techniques is evaluated in different analysis scenarios. To satisfy time-critical constraints in specific applications, we also develop efficient parallel implementations of some of the discussed algorithms. Combined, these parts provide an excellent snapshot of the state-of-the-art in those areas, and offer a thoughtful perspective on future potentials and emerging challenges in the design of robust hyperspectral imaging algorithms

Plaza, Antonio↗

NASA NTRS2013

Global Monitoring of Terrestrial Chlorophyll Fluorescence from Moderate-Spectral-Resolution Near-Infrared Satellite Measurements: Methodology, Simulations, and Application to GOME-2

Globally mapped terrestrial chlorophyll fluorescence retrievals are of high interest because they can provide information on the functional status of vegetation including light-use efficiency and global primary productivity that can be used for global carbon cycle modeling and agricultural applications. Previous satellite retrievals of fluorescence have relied solely upon the filling-in of solar Fraunhofer lines that are not significantly affected by atmospheric absorption. Although these measurements provide near-global coverage on a monthly basis, they suffer from relatively low precision and sparse spatial sampling. Here, we describe a new methodology to retrieve global far-red fluorescence information; we use hyperspectral data with a simplified radiative transfer model to disentangle the spectral signatures of three basic components: atmospheric absorption, surface reflectance, and fluorescence radiance. An empirically based principal component analysis approach is employed, primarily using cloudy data over ocean, to model and solve for the atmospheric absorption. Through detailed simulations, we demonstrate the feasibility of the approach and show that moderate-spectral-resolution measurements with a relatively high signal-to-noise ratio can be used to retrieve far-red fluorescence information with good precision and accuracy. The method is then applied to data from the Global Ozone Monitoring Instrument 2 (GOME-2). The GOME-2 fluorescence retrievals display similar spatial structure as compared with those from a simpler technique applied to the Greenhouse gases Observing SATellite (GOSAT). GOME-2 enables global mapping of far-red fluorescence with higher precision over smaller spatial and temporal scales than is possible with GOSAT. Near-global coverage is provided within a few days. We are able to show clearly for the first time physically plausible variations in fluorescence over the course of a single month at a spatial resolution of 0.5 0.5. We also show some significant differences between fluorescence and coincident normalized difference vegetation indices (NDVI) retrievals.

Fluorescence↗

NASA NTRS2013

Global Monitoring of Terrestrial Chlorophyll Fluorescence from Moderate-spectral-resolution Near-infrared Satellite Measurements: Methodology, Simulations, and Application to GOME-2

Globally mapped terrestrial chlorophyll fluorescence retrievals are of high interest because they can provide information on the functional status of vegetation including light-use efficiency and global primary productivity that can be used for global carbon cycle modeling and agricultural applications. Previous satellite retrievals of fluorescence have relied solely upon the filling-in of solar Fraunhofer lines that are not significantly affected by atmospheric absorption. Although these measurements provide near-global coverage on a monthly basis, they suffer from relatively low precision and sparse spatial sampling. Here, we describe a new methodology to retrieve global far-red fluorescence information; we use hyperspectral data with a simplified radiative transfer model to disentangle the spectral signatures of three basic components: atmospheric absorption, surface reflectance, and fluorescence radiance. An empirically based principal component analysis approach is employed, primarily using cloudy data over ocean, to model and solve for the atmospheric absorption. Through detailed simulations, we demonstrate the feasibility of the approach and show that moderate-spectral-resolution measurements with a relatively high signal-to-noise ratio can be used to retrieve far-red fluorescence information with good precision and accuracy. The method is then applied to data from the Global Ozone Monitoring Instrument 2 (GOME-2). The GOME-2 fluorescence retrievals display similar spatial structure as compared with those from a simpler technique applied to the Greenhouse gases Observing SATellite (GOSAT). GOME-2 enables global mapping of far-red fluorescence with higher precision over smaller spatial and temporal scales than is possible with GOSAT. Near-global coverage is provided within a few days. We are able to show clearly for the first time physically plausible variations in fluorescence over the course of a single month at a spatial resolution of 0.5 deg × 0.5 deg. We also show some significant differences between fluorescence and coincident normalized difference vegetation indices (NDVI) retrievals.

remote sensing↗

NASA NTRS1993

A method for the modelling of porous and solid wind tunnel walls in computational fluid dynamics codes

Porous wall wind tunnels have been used for several decades and have proven effective in reducing wall interference effects in both low speed and transonic testing. They allow for testing through Mach 1, reduce blockage effects and reduce shock wave reflections in the test section. Their usefulness in developing computational fluid dynamics (CFD) codes has been limited, however, by the difficulties associated with modelling the effect of a porous wall in CFD codes. Previous approaches to modelling porous wall effects have depended either upon a simplified linear boundary condition, which has proven inadequate, or upon detailed measurements of the normal velocity near the wall, which require extensive wind tunnel time. The current work was initiated in an effort to find a simple, accurate method of modelling a porous wall boundary condition in CFD codes. The development of such a method would allow data from porous wall wind tunnels to be used more readily in validating CFD codes. This would be beneficial when transonic validations are desired, or when large models are used to achieve high Reynolds numbers in testing. A computational and experimental study was undertaken to investigate a new method of modelling solid and porous wall boundary conditions in CFD codes. The method utilized experimental measurements at the walls to develop a flow field solution based on the method of singularities. This flow field solution was then imposed as a pressure boundary condition in a CFD simulation of the internal flow field. The effectiveness of this method in describing the effect of porosity changes on the wall was investigated. Also, the effectiveness of this method when only sparse experimental measurements were available has been investigated. The current work demonstrated this approach for low speed flows and compared the results with experimental data obtained from a heavily instrumented variable porosity test section. The approach developed was simple, computationally inexpensive, and did not require extensive or intrusive measurements of the boundary conditions during the wind tunnel test. It may be applied to both solid and porous wall wind tunnel tests.

Beutner, Thomas John↗

NASA NTRS2023

Assessing the Performance of the South American Land Data Assimilation System Version 2 (SALDAS-2) Energy Balance across Diverse Biomes

Understanding the exchange of energy between the surface and the atmosphere is important in view of the climate scenario. However, it becomes a challenging task due to a sparse network of observations. This study aims to improve the energy balance estimates for the Amazon, Cerrado, and Pampa biomes located in South America using the radiation and precipitation forcing obtained from the Clouds and the Earth’s Radiant Energy System (CERES) and the precipitation CPTEC/MERGE datasets. We employed three surface models—Noah-MP, Community Land Model (CLSM), and Integrated Biosphere Simulator (IBIS)—and conducted modeling experiments, termed South America Land Data Assimilation System (SALDAS-2). The results showed that SALDAS-2 radiation estimates had the smallest errors. Moreover, SALDAS-2 precipitation estimates were better than the Global Land Data Assimilation System (GLDAS) in the Cerrado (MBE = −0.16) and Pampa (MBE = −0.19). Noah-MP presented improvements compared with CLSM and IBIS in 100% of towers located in the Amazon. CLSM tends to overestimate the latent heat flux and underestimate the sensible heat flux in the Amazon. Noah-MP and Ensemble outperformed GLDAS in terms latent and sensible heat fluxes. The potential of SALDAS-2 should be emphasized to provide more accurate estimates of surface energy balance.

modeling↗

DOE OSTI2024

The 3D Lyman- α forest power spectrum from eBOSS DR16

We measure the three-dimensional power spectrum (P3D) of the transmitted flux in the Lyman-α (Ly α) forest using the complete extended Baryon Oscillation Spectroscopic Survey data release 16 (eBOSS DR16). This sample consists of ~205 000 quasar spectra in the redshift range 2 ≤ z ≤ 4 at an effective redshift z = 2.334. We propose a pair-count spectral estimator in configuration space, weighting each pair by exp( i k ∙ r), for wave vector k and pixel pair separation r, effectively measuring the anisotropic power spectrum without the need for fast Fourier transforms. This accounts for the window matrix in a tractable way, avoiding artefacts found in Fourier-transform based power spectrum estimators due to the sparse sampling transverse to the line of sight of Ly α skewers. We extensively test our pipeline on two sets of mocks: (i) idealized Gaussian random fields with a sparse sampling of Ly α skewers, and (ii) log-normal LyaCoLoRe mocks including realistic noise levels, the eBOSS survey geometry and contaminants. On eBOSS DR16 data, the Kaiser formula with a non-linear correction term obtained from hydrodynamic simulations yields a good fit to the power spectrum data in the range $(0.02 ≤ k ≤ 0.35)$ h Mpc -1 at the 1–2σ level with a covariance matrix derived from LyaCoLoRe mocks. We demonstrate a promising new approach for full-shape cosmological analyses of Ly α forest data from cosmological surveys such as eBOSS, the currently observing Dark Energy Spectroscopic Instrument and future surveys such as the Prime Focus Spectrograph, WEAVE-QSO, and 4MOST.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS1990

How well can gravity be recovered using Topex and GPS data?

When Topex is launched in mid-1992 it will carry a high quality GPS receiver which will operate in concert with a worldwide network of precision GPS ground receivers. The data from these receivers can be used to recover new information about the earth's gravity field at longer wavelengths. Software and algorithms have been developed which will allow this gravity field information to be recovered with much greater efficiency than with traditional techniques. The basis for these algorithms is the gravity bin formulation and related filtering techniques that exploit the repeat orbit of Topex and the sparse matrix structure of the problem. This new software has been used to evaluate the expected improvement in the gravity field using multiple ten-day arcs of GPS data from Topex.

Bertiger, Willy↗

DOE OSTI2025

An adaptive and stability-promoting layerwise training approach for sparse deep neural network architecture

This work presents a two-stage adaptive framework for progressively developing deep neural network (DNN) architectures that generalize well for a given training data set. In the first stage, a layerwise training approach is adopted where a new layer is added each time and trained independently by freezing parameters in the previous layers. We impose desirable structures on the DNN by employing manifold regularization, sparsity regularization, and physics-informed terms. We introduce a ε – δ – stability-promoting concept as a desirable property for a learning algorithm and show that employing manifold regularization yields a ε – δ stability-promoting algorithm. Further, we also derive the necessary conditions for the trainability of a newly added layer and investigate the training saturation problem. In the second stage of the algorithm (post-processing), a sequence of shallow networks is employed to extract information from the residual produced in the first stage, thereby improving the prediction accuracy. Numerical investigations on prototype regression and classification problems demonstrate that the proposed approach can outperform fully connected DNNs of the same size. Moreover, by equipping the physics-informed neural network (PINN) with the proposed adaptive architecture strategy to solve partial differential equations, we numerically show that adaptive PINNs not only are superior to standard PINNs but also produce interpretable hidden layers with provable stability. As a result, we also apply our architecture design strategy to solve inverse problems governed by elliptic partial differential equations.

42 ENGINEERING↗

NASA NTRS1995

Spaceborne Applications of P Band Imaging Radars for Measuring Forest Biomass

In three sites of boreal and temperate forests, P band HH, HV, and VV polarization data combined estimate total aboveground dry woody biomass within 12 to 27% of the values derived from allometric equations, depending on forest complexity. Biomass estimates derived from HV-polarization data only are 2 to 14% less accurate. When the radar operates at circular polarization, the errors exceed 100% over flooded forests, wet or damaged trees and sparse open tall forests because double-bounce reflections of the radar signals yield radar signatures similar to that of tall and massive forests. Circular polarizations, which minimize the effect of Faraday rotation in spaceborne applications, are therefore of limited use for measuring forest biomass. In the tropical rain forest of Manu, in Peru, where forest biomass ranges from 4 kg/sq m in young forest succession up to 50 kg/sq m in old, undisturbed floodplain stands, the P band horizontal and vertical polarization data combined separate biomass classes in good agreement with forest inventory estimates. The worldwide need for large scale, updated, biomass estimates, achieved with a uniformly applied method, justifies a more in-depth exploration of multi-polarization long wavelength imaging radar applications for tropical forests inventories.

Rignot, Eric J.↗

NASA NTRS1984

A model of asynchronous iterative algorithms for solving large, sparse, linear systems

Solving large, sparse, linear systems of equations is one of the fundamental problems in large scale scientific and engineering computation. A model of a general class of asynchronous, iterative solution methods for linear systems is developed. In the model, the system is solved by creating several cooperating tasks that each compute a portion of the solution vector. This model is then analyzed to determine the expected intertask data transfer and task computational complexity as functions of the number of tasks. Based on the analysis, recommendations for task partitioning are made. These recommendations are a function of the sparseness of the linear system, its structure (i.e., randomly sparse or banded), and dimension.

Reed, D. A.↗

NASA NTRS1980

Korean coastal water depth/sediment and land cover mapping /1:25,000/ by computer analysis of Landsat imagery

Computer analysis was applied to single data Landsat MSS imagery of a coastal area near Seoul, Korea equivalent to a 1:50,000 topographic map, and featuring large dynamic sediment transport processes. Supervised image processing yielded a test classification map containing five water depth/sediment classes, two shoreline/tidal classes and five coastal land cover classes at a scale of 1:25,000 and with a training set accuracy of 76%; the training sets were selected by direct examination of the digitally displayed imagery. The unsupervised ISOCLAS (Senkus, 1976) clustering analysis was performed to assess the relative value of this approach to image classification in areas of sparse or nonexistent ground control. Results indicate that it is feasible to produce quantitative maps for detailed study of dynamic coastal processes given a Landsat image data base at sufficiently frequent time intervals.

Park, K. Y.↗

DOE OSTI2025

Data-Driven Method for Groundwater-Level Mapping and Monitoring-Well Network Optimization at Hanford

This report summarizes the initial results and outcomes of a physics-informed, data-driven groundwater level (GWL) mapping capability for the Hanford Site. GWL mapping at Hanford is typically conducted annually and requires a significant amount of computational and expert resources, and it does not allow assessment of the informational value of specific monitoring wells. The proposed method produces spatially and temporally resolved fields consistent with sparse, irregularly sampled, and nonuniformly distributed well measurements. Implemented successfully, this capability will allow rapid mapping of groundwater levels and provide an opportunity to optimize monitoring activities (both location and sampling frequency) based on data information value evaluation. The approach integrates a diffusion-based generative model – trained on MODFLOW simulation data from the Plateau-to-River (P2R) model – with score-based data assimilation (SDA), allowing observation-conditioned mapping without retraining for each monitoring-network layout.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS1984

The impact of satellite temperature soundings on the forecasts of a small national meteorological service

The impact of introducing satellite temperature sounding data on a numerical weather prediction model of a national weather service is evaluated. A dry five level, primitive equation model which covers most of the Northern Hemisphere, is used for these experiments. Series of parallel forecast runs out to 48 hours are made with three different sets of initial conditions: (1) NOSAT runs, only conventional surface and upper air observations are used; (2) SAT runs, satellite soundings are added to the conventional data over oceanic regions and North Africa; and (3) ALLSAT runs, the conventional upper air observations are replaced by satellite soundings over the entire model domain. The impact on the forecasts is evaluated by three verification methods: the RMS errors in sea level pressure forecasts, systematic errors in sea level pressure forecasts, and errors in subjective forecasts of significant weather elements for a selected portion of the model domain. For the relatively short range of the present forecasts, the major beneficial impacts on the sea level pressure forecasts are found precisely in those areas where the satellite sounding are inserted and where conventional upper air observations are sparse. The RMS and systematic errors are reduced in these regions. The subjective forecasts of significant weather elements are improved with the use of the satellite data. It is found that the ALLSAT forecasts are of a quality comparable to the SAR forecasts.

Wolfson, N.↗

NASA NTRS1989

A one- and two-layer model for estimating evapotranspiration with remotely sensed surface temperature and ground-based meteorological data over partial canopy cover

Surface-air temperature differences are commonly used in a bulk resistance equation for estimating sensible heat flux (H), which is inserted in the one-dimensional energy balance equation to solve for the latent heat flux (LE) as a residual. Serious discrepancies between estimated and measured LE have been observed for partial-canopy-cover conditions, which are mainly attributed to inappropriate estimates of H. To improve the estimates of H over sparse canopies, one- and two-layer resistance models that account for some of the factors causing poor agreement are developed. The utility of the two models is tested with remotely sensed and micrometeorological data for a furrowed cotton field with 20 percent cover and a dry soil surface. It is found that the one-layer model performs better than the two-layer model when a theoretical bluff-body correction for heat transfer is used instead of an empirical adjustment; otherwise, the two-layer model is better.

Kustas, William P.↗

DOE OSTI2025

A Comparison of Machine Learning Methods of Association Tested on Dense Nodal Arrays

The association of phase picks to form events is one of the fundamental components of seismology. Large and dense sensor networks, such as >1000 geophone arrays (and distributed acoustic sensing), offer unique challenges in association due to the vast numbers of observations and high likelihood of errant picks. In addition, the large number of stations can greatly increase the time it takes to perform the association. For this reason, machine learning (ML) methods might provide a more optimal method of association for such networks. In this work, we examine how well ML methods (e.g., Gaussian mixture model association, PhaseLink, and Graph Earthquake Neural Interpretation Engine) can incorporate dense seismic arrays into regional networks and how well they handle the increasing numbers of stations. Here, we test their capabilities on two dense seismic deployments, one within Rock Valley Nevada (52 nodes and a 9-station sparse local network), and the LArge-n Seismic Survey in Oklahoma dense nodal array (>1800 vertical-component geophones). Processing data from these two different styles of dense seismic deployments allows testing of how the ML algorithms can merge array data with a broader regional network, how they deal with poorly picked phases, and how they handle anthropogenic noise. We compare the ML-associated bulletins to those obtained using the Rapid Earthquake Association and Location algorithm, a more traditional method of association. We find that there are very small differences in results between the methods for small networks (<100 stations) with low pick rates. For large networks (>1000), there are enough errant picks that some of the ML methods start to create false events out of noise. We also find that the ML methods vary in computation time significantly but are all faster than the traditional method tested here.

58 GEOSCIENCES↗

NASA NTRS1978

Treatment of cloudiness in regional scale - Numerical weather prediction models

A numerical weather prediction model is considered in which cloud water and precipitation are explicitly predicted as functions of three space dimensions and time. Approximations in the thermodynamic and continuity equations are discussed in detail, as well as the cumulus parameterization and the cloud microphysics parameterization. An example of a real-data forecast indicates that very accurate quantitative precipitation and cloud cover forecasts are possible using initial observations from only the relatively sparse rawinsonde network in the U.S.

Kreitzberg, C. W.↗