SEARCH · Search NASA

Results for “sparse data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44

All sources NASA NTRS DOE OSTI

NASA NTRS2021

Infrared Imaging using Sparse Microresonator Arrays and Compressed Sensing

In this work, we present an uncooled infrared (IR) thermal imager featuring a sparse array of resonant pixels that can be monolithically integrated with the readout electronics for long-term operation in high-temperature environments. Each of the detector pixels is made of an IR-sensitive GaN microresonator developed to be operated at up to 500 0C. The pixels are employed in sparse array configuration to allow for routing the signal carrying traces and to ease the routing from pixel to circuit, as well as to reduce the power consumption at the expense of moderate post-processing time and increased complexity to recover the image. Three 128 by 128 sparse resonator arrays with the array densities of 10%, 25% and 37.5% are designed, and used in conjunction with the Compressed Sensing (CS) method to reconstruct complex test images from highly incomplete data. Capabilities and performance metrics of the recovery technique are explored.

Rais-Zadeh, Mina↗

NASA NTRS2011

Object-Based Mapping of the Circumpolar Taiga-Tundra Ecotone with MODIS Tree Cover

The circumpolar taiga tundra ecotone was delineated using an image-segmentation-based mapping approach with multi-annual MODIS Vegetation Continuous Fields (VCF) tree cover data. Circumpolar tree canopy cover (TCC) throughout the ecotone was derived by averaging MODIS VCF data from 2000 to 2005 and adjusting the averaged values using linear equations relating MODIS TCC to Quickbird-derived tree cover estimates. The adjustment helped mitigate VCF's overestimation of tree cover in lightly forested regions. An image segmentation procedure was used to group pixels representing similar tree cover into polygonal features (segmentation objects) that form the map of the transition zone. Each polygon represents an area much larger than the 500 m MODIS pixel and characterizes the patterns of sparse forest patches on a regional scale. Those polygons near the boreal/tundra interface with either (1) mean adjusted TCC values from5 to 20%, or (2) mean adjusted TCC values greater than 5% but with a standard deviation less than 5% were used to identify the ecotone. Comparisons of the adjusted average tree cover data were made with (1) two existing tree line definitions aggregated for each 1 degree longitudinal interval in North America and Eurasia, (2) Landsat-derived Canadian proportion of forest cover for Canada, and (3) with canopy cover estimates extracted from airborne profiling lidar data that transected 1238 of the TCC polygons. The adjusted TCC from MODIS VCF shows, on average, less than 12% TCC for all but one regional zone at the intersection with independently delineated tree lines. Adjusted values track closely with Canadian proportion of forest cover data in areas of low tree cover. A comparison of the 1238 TCC polygons with profiling lidar measurements yielded an overall accuracy of 67.7%.

Ranson, K. J.↗

DOE OSTI2026

A score-based diffusion model approach for adaptive learning of stochastic partial differential equation solutions

In this paper, we propose a novel framework for adaptively learning the time-evolving solutions of stochastic partial differential equations (SPDEs) using score-based diffusion models within a recursive Bayesian inference setting. SPDEs play a central role in modeling complex physical systems under uncertainty, but their numerical solutions often suffer from model errors and reduced accuracy due to incomplete physical knowledge and environmental variability. To address these challenges, we encode the governing physics into the score function of a diffusion model using simulation data and incorporate observational information via a likelihood-based correction in a reverse-time stochastic differential equation. This enables adaptive learning through iterative refinement of the solution as new data becomes available. To improve computational efficiency in high-dimensional settings, we introduce the ensemble score filter, a training-free approximation of the score function designed for real-time inference. Numerical experiments on benchmark SPDEs demonstrate the accuracy and robustness of the proposed method under sparse and noisy observations.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS1976

A method and data for video monitor sizing

The paper outlines an approach consisting of using analytical methods and empirical data to determine monitor size constraints based on the human operator's CRT viewing requirements in a context where panel space and volume considerations for the Space Shuttle aft cabin constrain the size of the monitor to be used. Two cases are examined: remote scene imaging and alphanumeric character display. The central parameter used to constrain monitor size is the ratio M/L where M is the monitor dimension and L the viewing distance. The study is restricted largely to 525 line video systems having an SNR of 32 db and bandwidth of 4.5 MHz. Degradation in these parameters would require changes in the empirically determined visual angle constants presented. The data and methods described are considered to apply to cases where operators are required to view via TV target objects which are well differentiated from the background and where the background is relatively sparse. It is also necessary to identify the critical target dimensions and cues.

Kirkpatrick, M., III↗

NASA NTRS1989

Run-time scheduling and execution of loops on message passing machines

Sparse system solvers and general purpose codes for solving partial differential equations are examples of the many types of problems whose irregularity can result in poor performance on distributed memory machines. Often, the data structures used in these problems are very flexible. Crucial details concerning loop dependences are encoded in these structures rather than being explicitly represented in the program. Good methods for parallelizing and partitioning these types of problems require assignment of computations in rather arbitrary ways. Naive implementations of programs on distributed memory machines requiring general loop partitions can be extremely inefficient. Instead, the scheduling mechanism needs to capture the data reference patterns of the loops in order to partition the problem. First, the indices assigned to each processor must be locally numbered. Next, it is necessary to precompute what information is needed by each processor at various points in the computation. The precomputed information is then used to generate an execution template designed to carry out the computation, communication, and partitioning of data, in an optimized manner. The design is presented for a general preprocessor and schedule executer, the structures of which do not vary, even though the details of the computation and of the type of information are problem dependent.

Crowley, Kay↗

NASA NTRS1990

Run-time scheduling and execution of loops on message passing machines

Saltz, Joel↗

NASA NTRS1998

A New Approach to Overcoming Spatial Aliasing in Structural Damage Detection

Aircraft, reusable launch vehicles,unmanned aircraft, and other advanced structures are being built using lightweight composite materials/metals with design safety factors as low as 1.25. These advanced structures operate in uncertain and severe environments and are susceptible to damage such as delamination, fiber/matrix damage, hydrothermal strain in composite materials, and fatigue and cracking in metals. To ensure human safety and load-bearing integrity these structures must be inspected to detect and locate often invisible damage and faults before they become catastrophic. Conventional methods of non-destructive evaluation sometimes miss significant damage and are time consuming and expensive to perform. In contrast, vibrometry or vibration signature techniques are a global method of structural integrity monitoring that potentially can efficiently detect damage on large structures, including damage that is away from sensor locations, and in the interior of structures. However, a barrier problem in damage detection using vibration measurements is the need to measure the vibration response at a large number of points on the structure. Typically, model reduction or expansion procedures such as Guyan reduction or dynamic expansion are attempted to overcome the problem of insufficient measurements or spatial aliasing. These approaches depend on using information from the healthy model, and thus put error into the reduction used to represent the damaged structure. In this paper, a Frequency Response Function technique is used to detect damage to a fixed-free beam. The technique uses measured frequency response functions from the healthy structure as reference data, and then monitors vibration measurements during the life of the structure to detect damage. In an analytical simulation using a finite-element model of a beam, damage was located using only sparse measurements because the technique uses both rotation and translation measurements from the damaged structure.

Schulz, Mark J.↗

DOE OSTI2024

Integration and validation of some modules for modelling of high-speed chemically reactive flows in two-phase gas-droplet mixtures

Three modules are integrated into the built-in OpenFOAM rhoCentralFoam solver towards accurate and efficient modelling of high-speed chemically reactive flows in two-phase gas-droplet mixtures within the OpenFOAM 10.0 framework. The first module is the mixture-averaged diffusion model. The second module is the built-in OpenFOAM Lagrangian solver coupled with optimised droplet drag coefficient and convective heat transfer coefficient sub-models. The last module is a sparse stiff chemistry solver based on dynamic adaptive hybrid integration (AHI-S). The optimised droplet sub-models are first verified in correct implementation for subsequent simulations in this work. Further, they show good accuracy against experimental and analytical data in the modelling of ammonia droplet acceleration and cooling in the flowing and/or low-temperature air. The accuracy and efficiency gains related to the mixture-averaged diffusion model and the AHI-S chemistry solver are examined by simulating 1-D detonation propagation in ammonia droplet-free/laden ammoniaoxygen mixtures. Numerical results of detonation propagation speed, gaseous temperature, density, and species distributions around the induction zone show good agreement with experimental data and analytical solutions. Compared to the built-in OpenFOAM diffusion model, the mixture-averaged diffusion model provides different numerical predictions of pulsating instabilities in detonation propagation. It shows better accuracy in depicting the detonation structure within the droplet-free section attributed to improved multi-component diffusion modelling. Compared to the built-in OpenFOAM solver EulerImplicit (backward Euler), the AHI-S chemistry solver reduces the computational cost by around 50%. It achieves satisfactory accuracy in calculating detonation propagation speed within the droplet-free section with the optimal efficiency when the safety factor, β, equals 0.5.

42 ENGINEERING↗

DOE OSTI2025

Assessing the limitations of commercial sensors and models for supporting marine carbon dioxide removal monitoring: a case study

Several unknowns remain surrounding marine Carbon Dioxide Removal (mCDR) monitoring, reporting, and verification (MRV) practices and capabilities. Current in-situ sensor technology is limited (primarily pH and pCO 2 ), requiring calculations and assumptions to estimate changes in carbonate chemistry parameters, including total alkalinity (TA). Considering that cost, energy consumption, and accuracy of commercial sensors can vary by orders of magnitude, understanding how well existing sensors perform in an mCDR context is important for this emerging community. Likewise, documenting sensor limitations and how relatively simple models can optimize sensor deployments will improve MRV efforts and support protocol development. Here we (1) compare performance a variety of commercially available sensors in a blind mesocosm experiment simulating ocean alkalinity enhancement (OAE), and how sensor performance impacted carbonate chemistry estimates; (2) evaluate if sensors can distinguish the OAE signal from natural variability during a small scale OAE field test in Sequim Bay, WA, USA, and (3) use an idealized ocean biogeochemistry model to explore optimal sensor network design based on (1) and (2). Our mesocosm results indicate that correctly constraining pH uncertainty will be critical for accurate TA estimates with current sensor technology compared to the less impactful variation caused by uncertainty in pCO 2 (pH data that are presented throughout are reported on the total scale (pH T ) unless otherwise noted). Our pilot field test demonstrated that sensors were capable of distinguishing mCDR signatures from natural variability under optimal real-world conditions. Idealized modeling simulations of the field test showed that a range of sparse and dense (3 to 100) sensors sampling areas of detectable increases will underestimate the net change in surface pH by at least 35–55%, at both realistic and highly elevated alkalinity input levels. We also highlight the limitations of current sensing technology for MRV, and the importance of ocean biogeochemistry models as critical tools for predicting when and where mCDR signals will be detectable using available sensors. Overall, our findings suggest that commercially available pCO 2 sensors and some pH sensors will form an important backbone for mCDR MRV tasks, though complete MRV characterization will require these data to be used in combination with other tools.

OAE↗

DOE OSTI2024

Complexity of many-body interactions in transition metals via machine-learned force fields from the TM23 data set

Abstract This work examines challenges associated with the accuracy of machine-learned force fields (MLFFs) for bulk solid and liquid phases ofd-block elements. In exhaustive detail, we contrast the performance of force, energy, and stress predictions across the transition metals for two leading MLFF models: a kernel-based atomic cluster expansion method implemented using sparse Gaussian processes (FLARE), and an equivariant message-passing neural network (NequIP). Early transition metals present higher relative errors and are more difficult to learn relative to late platinum- and coinage-group elements, and this trend persists across model architectures. Trends in complexity of interatomic interactions for different metals are revealed via comparison of the performance of representations with different many-body order and angular resolution. Using arguments based on perturbation theory on the occupied and unoccupieddstates near the Fermi level, we determine that the large, sharpddensity of states both above and below the Fermi level in early transition metals leads to a more complex, harder-to-learn potential energy surface for these metals. Increasing the fictitious electronic temperature (smearing) modifies the angular sensitivity of forces and makes the early transition metal forces easier to learn. This work illustrates challenges in capturing intricate properties of metallic bonding with current leading MLFFs and provides a reference data set for transition metals, aimed at benchmarking the accuracy and improving the development of emerging machine-learned approximations.

Chemistry↗

NASA NTRS1995

Imaging spectrometer measurement of water vapor in the 400 to 2500 nm spectral region

The Airborne Visible-Infrared Imaging Spectrometer (AVIRIS) measures the total upwelling spectral radiance from 400 to 2500 nm sampled at 10 nm intervals. The instrument acquires spectral data at an altitude of 20 km above sea level, as images of 11 by up to 100 km at 17x17 meter spatial sampling. We have developed a nonlinear spectral fitting algorithm coupled with a radiative transfer code to derive the total path water vapor from the spectrum, measured for each spatial element in an AVIRIS image. The algorithm compensates for variation in the surface spectral reflectance and atmospheric aerosols. It uses water vapor absorption bands centered at 940 nm, 1040 nm, and 1380 nm. We analyze data sets with water vapor abundances ranging from 1 to 40 perceptible millimeters. In one data set, the total path water vapor varies from 7 to 21 mm over a distance of less than 10 km. We have analyzed a time series of five images acquired at 12 minute intervals; these show spatially heterogeneous changes of advocated water vapor of 25 percent over 1 hour. The algorithm determines water vapor for images with a range of ground covers, including bare rock and soil, sparse to dense vegetation, snow and ice, open water, and clouds. The precision of the water vapor determination approaches one percent. However, the precision is sensitive to the absolute abundance and the absorption strength of the atmospheric water vapor band analyzed. We have evaluated the accuracy of the algorithm by comparing several surface-based determinations of water vapor at the time of the AVIRIS data acquisition. The agreement between the AVIRIS measured water vapor and the in situ surface radiometer and surface interferometer measured water vapor is 5 to 10 percent.

Green, Robert O.↗

NASA NTRS2012

Can Asian Dust Trigger Phytoplankton Blooms in the Oligotrophic Northern South China Sea?

Satellite data estimate a high dust deposition flux (approximately 18 g m(exp-2 a(exp-1) into the northern South China Sea (SCS). However, observational evidence concerning any biological response to dust fertilization is sparse. In this study, we combined long-term aerosol and chlorophyll-a (Chl-a) measurements from satellite sensors (MODIS and SeaWiFS) with a 16-year record of dust events from surface PM10 observations to investigate dust transport, flux, and the changes in Chl-a concentration over the northern SCS. Our result revealed that readily identifiable strong dust events over this region, although relatively rare (6 cases since 1994) and accounting for only a small proportion of the total dust deposition (approximately 0.28 g m(exp-2 a(exp-1), do occur and could significantly enhance phytoplankton blooms. Following such events, the Chl-a concentration increased up to 4-fold, and generally doubled the springtime background value (0.15 mg m(exp-3). We suggest these heavy dust events contain readily bioavailable iron and enhance the phytoplankton growth in the oligotrophic northern SCS.

northern South China sea↗

NASA NTRSDate not supplied

Compressive Sensing Based Data Acquisition Architecture for Transient Stellar Events in Crowded Star Fields

Compressive sensing is a mathematical technique for simultaneous data acquisition and compression. In this work, we show a CS based architecture for acquiring and reconstructing transient stellar events. This architecture recon-structs a differenced image itself, eliminating the need for any sparse domain transforms, otherwise required for traditional CS reconstruction. The resulting reconstructed differenced image is of critical importance as the information required for generating a time-series photometric light curve is obtained only from a differenced image. Hence, reconstructing a crowded star spatial image, followed by differencing is wasteful. This architecture eliminates the need to 1.) transform an image to a sparse domain, 2.) Reconstruct a dense field, and then apply differencing on the image to obtain the image of critical value. We study the case of microlensing to depict a star source experiencing magnification in time. Our results show that this architecture is able to reconstruct star source magnitudes with magnification factors greater than 1 for clean images with error less than 2% using only 10% of the Nyquist rate samples.

Asmita Korde-patel↗

NASA NTRS2021

Assessing Disaggregated SMAP Soil Moisture Products in the United States

A soil moisture (SM) disaggregation algorithm based on thermal inertia (TI) theory was implemented to downscale the Soil Moisture Active Passive (SMAP) Enhanced product(SPL2SMPE) from 9 km to 1 km over the continental United States. The algorithm applies land surface temperature and normalized difference vegetation index from Moderate Resolution Imaging Spectroradiometer (MODIS) at higher spatial resolution to estimate relative soil wetness within a coarse SMAP grid -this MODIS-derived relative wetness is then used to produce the downscaled SMAP SM. Results from the algorithm were evaluated in terms of their spatiotemporal coverage and accuracy using in situ measurements from SMAP Core Validation Sites (CVS), the US Department of Agriculture Soil Climate Analysis Network (USDA-SCAN), and the National Oceanic and Atmospheric Administration Climate Reference Network(NOAA-CRN). Results were also compared with the baselineSPL2SMPE and the SMAP/Sentinel-1 (SPL2SMAPS) 1kmproduct. Overall, the unbiased root mean square error (ubRMSE)of the disaggregated SM at the CVS using the TI approach is approximately 0.04 m3=m3, which is the SMAP mission requirement for the baseline products. The TI approach out performs the SMAP/Sentinel SL2SMAPS 1km product by approximately0.02 m3=m3. Over the agriculture/crop areas from SCAN and CRN sparse network stations, the TI approach exhibits better ubRMSE compared to SPL2SMPE andSPL2SMAPS byabout0.01 and 0.02 m3=m3, indicating its advantage in these areas. However, a drawback of this approach is that there are data gaps due to cloud cover as optical sensors cannot have a clear view of the land surface.

Soil moisture↗

NASA NTRS2014

The Unusual Multiwavelength Properties of the Gamma-Ray Source PMN J1603-4904

Context. We investigate the nature and classification of PMNJ1603-4904, a bright radio source close to the Galactic plane, which is associated with one of the brightest hard-spectrum gamma-ray sources detected by Fermi/LAT. It has previously been classified as a low peaked BL Lac object based on its broadband emission and the absence of optical emission lines. Optical measurements, however, suffer strongly from extinction and the absence of pronounced short-time gamma-ray variability over years of monitoring is unusual for a blazar. Aims. In this paper, we are combining new and archival multi-wavelength data of PMNJ1603-4904 in order to reconsider the classification and nature of this unusual gamma-ray source. Methods. For the first time, we study the radio morphology of PMNJ1603-4904 at 8.4GHz and 22.3GHz, and its spectral properties on milliarcsecond scales, based on VLBI observations from the TANAMI program. We combine the resulting images with multi-wavelength data in the radio, IR, optical/UV, X-ray, and gamma-ray regimes. Results. PMNJ1603-4904 shows a symmetric brightness distribution at 8.4 GHz on milliarcsecond scales, with the brightest, and most compact component in the center of the emission region. The morphology is reminiscent of a compact symmetric object (CSO). Such objects, thought to be young radio galaxies, have been predicted to produce gamma-ray emission but have not been detected as a class by the Fermi gamma-ray telescope so far. Sparse (u, v)-coverage at 22.3GHz prevents an unambiguous modeling of the source morphology at this higher frequency. Moreover, infrared measurements reveal an excess in the spectral energy distribution (SED), which can be modeled with a blackbody with a temperature of about 1600 K, and which is usually not present in blazar SEDs. Conclusions. The TANAMI VLBI data and the shape of the broadband SED challenge the current blazar classification of one of the brightest gamma-ray sources in the sky. PMNJ1603-4904 seems to be either a highly peculiar BL Lac object or a misaligned jet source. In the latter case, the intriguing VLBI structure opens room for a possible classification of PMNJ1603-4904 as a gamma-ray bright CSO.

Multiwavelength↗

NASA NTRS2018

GES DISC Long-Term Data Analysis Services Using AIRS and CMS Methane Data as an Example

NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) archives and distributes rich collections of data on atmospheric greenhouse gases from multiple satellite missions and model results. Among those greenhouse gases, atmospheric methane is a powerful greenhouse gas contributing ~0.5 (W/m^2) to total radiative forcing, and its concentration has increased by about 150% since 1750. Observations or estimates of methane emissions typically have sparse spatial and temporal coverage. The lack of comprehensive spatial and temporal coverage of methane source and sink observations has made analyzing atmospheric methane trends challenging. In this study the GES DISC aims to provide the community with the resources to better understand changes in atmospheric methane concentrations and the underlying causes. We will utilize methane datasets from Atmospheric Infrared Sounder (AIRS) retrieved methane concentration and three Carbon Monitoring System (CMS) methane emission datasets (in regions of North America, Canada, and Mexico) to compare AIRS methane growth with corresponding CMS regional methane emissions. Comparisons of AIRS methane growth rates and CMS methane emissions suggests wetland emissions may impact methane growth rate trends over North America. As the record for CMS methane data is extended, both datasets can be used in conjunction to better understand impacts on atmospheric methane trends. GES DISCs new anomaly tool can also be used on select datasets to further quantify trends in atmospheric greenhouse gases.

long-term data analysis↗

DOE OSTI2024

Neural Networks to Find the Optimal Forcing for Offsetting the Anthropogenic Climate Change Effects

Abstract Of great relevance to climate engineering is the systematic relationship between the radiative forcing to the climate system and the response of the system, a relationship often represented by the linear response function (LRF) of the system. However, estimating the LRF often becomes an ill-posed inverse problem due to high-dimensionality and nonunique relationships between the forcing and response. Recent advances in machine learning make it possible to address the ill-posed inverse problem through regularization and sparse system fitting. Here, we develop a convolutional neural network (CNN) for regularized inversion. The CNN is trained using the surface temperature responses from a set of Green’s function perturbation experiments as imagery input data together with data sample densification. The resulting CNN model can infer the forcing pattern responsible for the temperature response from out-of-sample forcing scenarios. This promising proof of concept suggests a possible strategy for estimating the optimal forcing to negate certain undesirable effects of climate change. The limited success of this effort underscores the challenges of solving an inverse problem for a climate system with inherent nonlinearity. Significance Statement Predicting the climate response for a given climate forcing is a direct problem, while inferring the forcing for a given desired climate response is often an inverse, ill-posed, problem, posing a new challenge to the climate community. This study makes the first attempt to infer the radiative forcing for a given target pattern of global surface temperature response using a deep learning approach. The resulting deeply trained convolutional neural network inversion model shows promise in capturing the forcing pattern corresponding to a given surface temperature response, with a significant implication on the design of an optimal solar radiation management strategy for curbing global warming. This study also highlights the technical challenges that future research should prioritize in seeking feasible solutions to the inverse climate problem.

Ren, Huiying↗

NASA NTRS2017

Full-Coverage High-Resolution Daily PM(sub 2.5) Estimation using MAIAC AOD in the Yangtze River Delta of China

Satellite aerosol optical depth (AOD) has been used to assess population exposure to fine particulate matter (PM (sub 2.5)). The emerging high-resolution satellite aerosol product, Multi-Angle Implementation of Atmospheric Correction(MAIAC), provides a valuable opportunity to characterize local-scale PM(sub 2.5) at 1-km resolution. However, non-random missing AOD due to cloud snow cover or high surface reflectance makes this task challenging. Previous studies filled the data gap by spatially interpolating neighboring PM(sub 2.5) measurements or predictions. This strategy ignored the effect of cloud cover on aerosol loadings and has been shown to exhibit poor performance when monitoring stations are sparse or when there is seasonal large-scale missngness. Using the Yangtze River Delta of China as an example, we present a Multiple Imputation (MI) method that combines the MAIAC high-resolution satellite retrievals with chemical transport model (CTM) simulations to fill missing AOD. A two-stage statistical model driven by gap-filled AOD, meteorology and land use information was then fitted to estimate daily ground PM(sub 2.5) concentrations in 2013 and 2014 at 1 km resolution with complete coverage in space and time. The daily MI models have an average R(exp 2) of 0.77, with an inter-quartile range of 0.71 to 0.82 across days. The overall Ml model 10-fold cross-validation R(exp 2) (root mean square error) were 0.81 (25 gm(exp 3)) and 0.73 (18 gm(exp 3)) for year 2013 and 2014, respectively. Predictions with only observational AOD or only imputed AOD showed similar accuracy.Comparing with previous gap-filling methods, our MI method presented in this study performed bette rwith higher coverage, higher accuracy, and the ability to fill missing PM(sub 2.5) predictions without ground PM(sub 2.5) measurements. This method can provide reliable PM(sub 2.5)predictions with complete coverage that can reduce biasin exposure assessment in air pollution and health studies.

PM2.5↗