Search NASA⌕ Search

SEARCH · Search NASA

Results for “sparse data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26

Opening doors to physical sample tracking and attribution in Earth and environmental sciences

Physical samples and their associated data and metadata underpin scientific discoveries across disciplines and can enable new science when appropriately archived. However, there are significant gaps in current practices and infrastructure that prevent accurate provenance tracking, reproducibility, and attribution. For most samples, descriptive metadata are often sparse, inaccessible, or absent. Samples and associated data and metadata may also be scattered across numerous physical collections, data repositories, laboratories, data files, and papers with no clear linkage or provenance tracking as new information is generated over time. The Earth Science Information Partners (ESIP) Physical Samples Curation Cluster has therefore developed guidance for scientific authors on ‘Publishing Open Research Using Physical Samples.’ This involved synthesizing existing practices, gathering community feedback, and assessing real-world examples. We identified improvements needed to enable authors to efficiently cite and link Earth science samples and related data, and track their use. Our goal is to help improve discoverability, interoperability, and reuse of physical samples, and associated data and metadata. Though primarily focused on the needs of Earth and environmental sciences, these guidelines are broadly applicable.

58 GEOSCIENCES↗

Regularizing INR with Diffusion Prior for Self-Supervised 3D Reconstruction OF Neutron Computed Tomography Data

Recently, generative diffusion priors have made huge strides as inverse problem solvers, including the ability to be adapted for inference on out-of-distribution data. Concurrently, implicit neural representations (INRs) have emerged as fast and lightweight inverse imaging solvers that are amenable to hybrid approaches that combine learned priors with traditional inverse problem formulations. In this paper, we present a diffusive computed tomography (CT) inversion framework for regularizing INRs called Diffusive INR (DINR), designed to enable high-quality reconstruction from sparse-view neutron CT. Pretrained purely on synthetic data, DINR is evaluated on simulated and experimentally obtained observations of concrete microstructures, where traditional reconstruction methods suffer substantial degradation when the number of views is reduced. Our approach delivers superior performance, reduces reconstruction artifacts, and achieves gains in PSNR and SSIM, enabling accurate micro-structural characterization even under extreme data limitations compared to state-of-the-art sparse-view reconstruction techniques.

Hossain, Maliha [ORNL]↗

Domain-decomposition nonlinear manifold reduced order model

This software combines nonlinear-manifold reduced order models (NM-ROMs) with domain decomposition (DD) techniques. NM-ROMs, which utilize a shallow, sparse autoencoder trained with full order model (FOM) snapshot data, approximate the FOM state on a nonlinear manifold. These models offer advantages over linear-subspace ROMs (LS-ROMs) particularly in scenarios with slowly decaying Kolmogorov n-width. However, the training of NM-ROMs involves a number of parameters that scale with the size of the FOM, and storing high-dimensional FOM snapshots can significantly increase the cost of ROM training for extreme-scale problems. To mitigate these costs, the software employs DD to partition the FOM into smaller subdomains, computes NM-ROMs for each, and then integrates these to form a global NM-ROM. This strategy offers multiple benefits: it enables parallel training of subdomain NM-ROMs, reduces the number of parameters needed, decreases the dimensional requirements of subdomain FOM training data, and allows for customization to the unique characteristics of each FOM subdomain. The use of a shallow, sparse autoencoder architecture in each subdomain NM-ROM facilitates the application of hyper-reduction (HR), simplifying the nonlinear complexities and enhancing computational speed. This software marks the inaugural application of NM-ROM combined with HR to a DD problem. It features an algebraic DD reformulation of the FOM, training of NM-ROMs with HR for each subdomain, and employs a sequential quadratic programming (SQP) solver for the evaluation of the coupled global NMROM. The effectiveness of the DD NM-ROM with HR is numerically demonstrated on the 2D steady-state Burgers' equation, showing an order of magnitude improvement in accuracy over the DD LS-ROM with HR.

Diaz, AlejandroN↗

Seafloor Seismic Noise Patterns Across the Pacific Basin

Seismic hazard monitoring and global tomography efforts are improved by recording signals at a variety of distances and azimuths to maximize subsurface sampling. Although seismic networks provide good to excellent coverage on land, seafloor stations are still sparse. Inclusion of ocean-based data would greatly improve the global coverage of seismic networks, but the use of seafloor seismic data to complement land-based detection and characterization of events is complicated by the generally much higher ambient noise level in the ocean compared to that observed on land. This noise is driven primarily by sea surface waves and tides, but how seismic noise levels vary with location in the oceans is not well described. Here, in this work, we analyze the relationship between ocean surface wave height and seismic noise in the 0.4–4 Hz frequency band at ocean-bottom seismometer deployments across the Pacific basin. We find that a noise-to-responsiveness ratio (NRR)—the median noise level at a station divided by its sea surface wave height responsiveness—correlates negatively with detection success for large teleseismic earthquakes. Stations that are close to land, with relatively shallow ocean and low wind speed, often have lower NRR than open-ocean stations, but the connection between geographic location and earthquake detection success is imperfect.

58 GEOSCIENCES↗

FM4NPP: A Scaling Foundation Model for Nuclear and Particle Physics

Large language models have revolutionized artificial intelligence by enabling large, generalizable models trained through self-supervision. This paradigm has inspired the development of scientific foundation models (FMs). However, applying this capability to experimental particle physics is challenging due to the sparse, spatially distributed nature of detector data, which differs dramatically from natural language. This work addresses if an FM for particle physics can scale and generalize across diverse tasks. We introduce a new dataset with more than 11 million particle collision events and a suite of downstream tasks and labeled data for evaluation. We propose a novel self-supervised training method for detector data and demonstrate its neural scalability with models that feature up to 188 million parameters. With frozen weights and task-specific adapters, this FM consistently outperforms baseline models across all downstream tasks. The performance also exhibits robust data-efficient adaptation. Further analysis reveals that the representations extracted by the FM are task-agnostic but can be specialized via a single linear mapping for different downstream tasks.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Canopy reflectance modeling in a tropical wooded grassland

Geometric/optical canopy reflectance modeling and spatial/spectral pattern recognition are used to study the form and structure of savanna in West Africa. An invertible plant canopy reflectance model is tested for its ability to estimate the amount of woody vegetation cover in areas of sparsely wooded grassland from remotely sensed data. Dry woodlands and wooded grasslands, commonly referred to as savannas, are important ecologically and economically in Africa, and cover approximately forty percent of the continent by some estimates. The Sahelian and Sudanian savanna make up the important and sensitive transition zone between the tropical forests and the arid Saharan region. The depletion of woody cover, used for fodder and fuel in these regions, has become a very severe problem for the people living there. LANDSAT Thematic Mapper (TM) data is used to stratify woodland and wooded grassland into areas of relatively homogeneous canopy cover, and then by applying an invertible forest canopy reflectance model to estimate directly the height and spacing of the trees in the stands. Since height and spacing are proportional to biomass in some cases, a successful application of the segmentation/modeling techniques will allow direct estimation of woody biomass, as well as cover density, over significant areas of these valuable and sensitive ecosystems. Sahelian savanna sites in the Gourma area of Mali being used by the NASA/GIMMS project (Global Inventory Modeling and Monitoring System, at Goddard Space Flight Center), in conjunction with CIPEA/Mali (Centre International pour l'Elevage en Afrique) will be used for testing the canopy model. The model will also be tested in a Sudanian zone crop/woodland area in the Region of Segou, Mali.

Simonett, D.↗

A summary of the computational fluid dynamics analysis of the hypersonic flights of Pegasus

A computational fluid dynamics (CFD) analysis of the hypersonic flights of the NASA's Pegasus launch vehicle was carried out using the PARC code. The flight data included heat transfer rates and sparse pressure coefficients primarily in the fillet region of the vehicle. Since the CFD simulations did not account for ablation at the vehicle surface, the test heat transfer results were obtained for the low Mach number simulations; as the Mach number was increased, the ablative effects at the vehicle surface became more apparent and contributed to the error.

Fricker, Darren↗

An Assessment of Our Ability to Model the Upper Troposphere and Lower Stratosphere in Interactive Climate Models

The physics of the upper troposphere is dominated by the different phases of water, while the lower stratosphere is governed by the presence of ozone. The tropopause may be regarded as the layer which separates the regions where stratospheric and tropospheric processes dominate the physics, but it is clearly not a smooth transition level. Modelling this region in comprehensive climate models is complicated, partly because of the constraints inherent in numerical methods (such as the finite resolution used in models) and partly because of our incomplete knowledge of the physical and chemical interactions which occur (such as the phase transitions of water and the composition of aerosols). However, studies of stratospheric impacts on climate change clearly require the tropopause region to be modelled with a high degree of accuracy. This paper will examine how well we can currently model the structure and dynamics of the tropopause region; this includes some comparisons of the simulated atmospheric composition with observational estimates of these species, some studies of discrepancies between forecasts and observations in the Data Assimilation System of the Data Assimilation office, and inferences for sparsely observed quantities. The analysis will focus on meteorological quantities, physical forcing mechanisms, and the transport and interactions of trace species.

Pawson, Steven↗

How Accurate is Land/Ocean Moisture Transport Variability in Reanalyses?

Quantifying the global hydrological cycle and its variability across various time scales remains a challenge to the climate community. Direct measurements of evaporation (E), evapotranspiration (ET), and precipitation (P) are not feasible on a global scale, nor is the transport of water vapor over the global oceans and sparsely populated land areas. Expanding satellite data streams have enabled development of various water (and energy) flux products, complementing reanalyses and facilitating observationally constrained modeling. But the evolution of the global observing system has produced additional complications--improvements in satellite sensor resolution and accuracy have resulted in "epochs" of observational quasi-uniformity that can adversely affect reanalysis trends. In this work we focus on vertically integrated moisture flux convergence (VMFC) variations within the period 1979 - present integrated over global land. We show that VMFC in recent reanalyses (e.g. ERA-I, NASA MERRA, NOAA CFSR and JRA55) suffers from observing system changes, though differently in each product. Land Surface Models (LSMs) forced with observations-based precipitation, radiation and near-surface meteorology share closely the interannual P-ET variations of the reanalyses associated with ENSO events. (VMFC over land and P-ET estimates are equivalent quantities since atmospheric storage changes are small on these scales.) But the long-term LSM trend over the period since 1979 is approximately one-fourth that of the reanalyses. Additional reduced observation reanalyses assimilating only surface pressure and /or specifying seasurface temperature also have a much smaller trend in P-ET like the LSMs. We explore the regional manifestation of the reanalysis P-ET / VMFC problems, particularly over land. Both principal component analysis and a simple time series changepoint analysis highlight problems associated with data poor regions such as Equatorial Africa and, for one reanalysis, the Equatorial Andes region. Onset of the availability of passive microwave Special Sensor Microwave Imager (SSMI) moisture data in July 1987 and the transition from the Microwave Sounder Unit (MSU) to an advanced version (AMSU) have significant impacts on VMFC variability. Simple accounting for these errors of leading importance results in modified reanalysis VMFC estimates that agree much better with the LSM results. Regional details of the modified reanalysis VMFC and LSM P-ET are related to changes in Pacific Decadal Variability as manifest in SST changes after the late 1990s.

Robertson, F. R.↗

Central Valley Water Resources: Improving California Groundwater Assessments using GRACE and InSAR Datasets for Water Resource Management

California’s Central Valley is one of the most productive agricultural areas in the world, producing approximately $20 billion in crops annually. The recent California droughts of 2007-2010 and 2011-2017 resulted in increased groundwater pumping in the Central Valley to adequately irrigate farmland. Overdrafting of the Central Valley aquifer results in groundwater depletion, land subsidence, and permanent loss of groundwater storage. In 2014, depletion of groundwater led the state of California to enact the Sustainable Groundwater Management Act (SGMA), requiring critically overdrafted, high, and medium priority sub-basins to reach sustainable levels of groundwater pumping and recharge by 2042. SGMA allows local Groundwater Sustainability Agencies the authority to create Groundwater Sustainability Plans at the sub-basin level. To assist California’s Department of Water Resources, this project quantified groundwater change and land subsidence in Central Valley sub-basins with sparse or unreliable well and GPS data. This was done using NASA’s Gravity Recovery and Climate Experiment (GRACE), GRACE Follow-On (GRACE-FO), and interferograms derived from Sentinel-1 C-band Synthetic Aperture Radar (C-SAR) and Advanced Land Observing Satellite 2 (ALOS-2) Phased Array L-band Synthetic Aperture Radar 2 (PALSAR-2). Time series of the GRACE and InSAR data were compared with well and GPS data in data-dense sub-basins to determine the feasibility of these datasets for groundwater storage and subsidence monitoring. We found thatGRACE and InSAR data are effective tools for determining groundwater change and land subsidence and can be used on their own to monitor sub-basins in the absence of well and GPS data.

Water Resources↗

A Hybrid Finite Element Method for Axisymmetric Waveguide fed Horns

A new method for finding radiation patterns and the reflection coefficients associated with an axisymmetric waveguide fed horn is presented. The approach is based on a hybrid finite element method (FEM) wherein the electromagnetic fields in the FEM region are coupled to the fields outside by two surface integral equations. Because of the local nature of the FEM, this formalism allows for the presence of inhomogeneities to be included in the problem domain. The matrix equation which results from the application of this method is shown to be complex-symmetric. It is, furthermore, diagonally dominant and sparse. Comparisons of calculated and measured data for two different horns show good agreement.

Hybrid↗

Simulated ASTER data for Geologic Studies

The Advanced Spaceborne Thermal Emission and Reflectance Radiometer (ASTER) is a high spatial resolution imaging instrument, due to be launched on NASA's Earth Observing System AM-1 satellite platform in 1998. ASTER acquires data in 14 bands, spanning the wavelength region from the visible, near infrared, short wavelength infrared, and thermal infrared, with spatial resolution varying from 15 m to 90 m, depending on wavelength region. In order to evaluate our ability to use ASTER data for geological mapping, we used aircraft data over Cuprite, Nevada to create a simulated 14-band ASTER data set. The study site has sparse vegetation, and exposes a wide range of unaltered and hydrothermally altered volcanic rocks. The wide range of wavelengths covered by ASTER allowed us to recognize or separate iron oxide minerals, clay-bearing minerals, sulfate minerals, ammonia minerals, siliceous rocks, and carbonates. Combined with laboratory spectral measurements, we were able to identify these constituents. Based on both sets of information, we produced an alteration map showing the distribution of argillized rocks, opalized rocks with alunite, silicified rocks, and areas dominated by kaolinite and buddingtonite. The map was as accurate as published maps made by traditional field methods. ASTER promises to be a major improvement over existing satellite systems for geologic mapping.

Advanced↗

Deep Learning-based Parameterization of Complex 3D CO2 Saturation Data in Large-scale Geological Carbon Storage

In deep learning (DL), dimension reduction plays a pivotal role in improving training efficiency and minimizing overfitting, especially when working with complex datasets like three-dimensional (3D) saturation data. In the context of geological carbon storage (GCS), 3D saturation data introduces unique challenges due to its sparse nature and sharp transitions at plume boundaries, known as shock fronts. To tackle these challenges, we developed a novel DL framework that combines dimension reduction with advanced 3D reconstruction techniques. Our approach utilizes latent variables derived from 2D average saturation fields to efficiently capture the essential features of high-dimensional data while reducing the number of variables. This enhances both the robustness and accuracy of DL models, making the framework more practical for real-world applications. By offering a tailored solution for modeling complex 3D saturation dynamics, this framework holds significant potential for environmental monitoring, energy storage, and other geological applications.

Wang, Hongsheng [University of Texas at Austin]↗

Toward memory-efficient melt pool monitoring: a classification framework using event-based imaging and sparse sensing technique

Vision sensors like CMOS and CCD cameras are often used for in-process monitoring of melt pools in laser-based additive and welding processes, but they require transferring large amounts of data and computational processing resources. Event-based neuromorphic imagery, on the other hand, detects only the change in pixel intensity, thus potentially reducing the data amount and latency. With an event imager, this study develops a framework for melt pool condition classification, including image construction, time scale selection, optimal pixel selection, and sparse classification, to achieve a highly memory-efficient scheme. These are based on sparse sensing techniques with singular value decomposition (SVD) and QR pivoting, the two fundamental matrix transformations for linear dimensionality reduction. The framework is then validated by classifying a controlled experiment by exciting various mode shapes of liquid gallium pools of varying depths (3, 6, and 8 mm). At 200 pixels, the classifier can reach overall accuracy of 75%, while at 2000 pixels (0.013% of the total possible pixels), the accuracy is nearly 90% (89.86%). At the same number of pixels, random selection can only achieve 46% and 67%, respectively. The memory savings of the sparsely sampled event data compared to a conventional imager is about 500 times. In addition to performance, implementation and limitations of the framework are also discussed.

42 ENGINEERING↗

deadtrees.earth — An open-access and interactive database for centimeter-scale aerial imagery to uncover global tree mortality dynamics

Excessive tree mortality is a global concern and remains poorly understood as it is a complex phenomenon. We lack global and temporally continuous coverage on tree mortality data. Ground-based observations on tree mortality, e.g., derived from national inventories, are very sparse, and may not be standardized or spatially explicit. Earth observation data, combined with supervised machine learning, offer a promising approach to map overstory tree mortality in a consistent manner over space and time. However, global-scale machine learning requires broad training data covering a wide range of environmental settings and forest types. Low altitude observation platforms (e.g., drones or airplanes) provide a cost-effective source of training data by capturing high-resolution orthophotos of overstory tree mortality events at centimeter-scale resolution. Here, we introduce deadtrees.earth, an open-access platform hosting more than two thousand centimeter-resolution orthophotos, covering more than 1,000,000 ha, of which more than 58,000 ha are manually annotated with live/dead tree classifications. This community-sourced and rigorously curated dataset can serve as a comprehensive reference dataset to uncover tree mortality patterns from local to global scales using space-based Earth observation data and machine learning models. This will provide the basis to attribute tree mortality patterns to environmental changes or project tree mortality dynamics to the future. The open nature of deadtrees.earth, together with its curation of high-quality, spatially representative, and ecologically diverse data will continuously increase our capacity to uncover and understand tree mortality dynamics.

Citizen science↗

Somali current studied from SEASAT altimetry

Mesoscale variability has been obtained for the world ocean from satellite altimetry by using the repetitive tracks data of SEASAT. No significant results were obtained for the Somali current area for two main reasons: the repetitive tracks are too sparse to cover the expected eddy pattern and these data were obtained in late September and early October when the current is strongly decaying. The non-repetitive period of SEASAT offers the possibility to study a dozen of tracks parallel to the eddy axis or crossing it. These are used here to deduce the dynamic topography of the Somali current. Data error reduction and tide and orbit corrections are addressed. A local geoid was built using a collocation inverse method to combine surface gravity data and altimetry: the repetitive tracks show no variability (which confirms that the current is quasi-inexistent at that time) and can be used as data for the local geoid. This should provide a measure of the absolute dynamic topography of the Somali current.

Perigaud, C.↗

Microwave Satellite Data for Hydrologic Modeling in Ungauged Basins

An innovative flood-prediction framework is developed using Tropical Rainfall Measuring Mission precipitation forcing and a proxy for river discharge from the Advanced Microwave Scanning Radiometer for Earth Observing System (AMSR-E) onboard the National Aeronautics and Space Administration's Aqua satellite. The AMSR-E-detected water surface signal was correlated with in situ measurements of streamflow in the Okavango Basin in Southern Africa as indicated by a Pearson correlation coefficient of 0.90. A distributed hydrologic model, with structural data sets derived from remote-sensing data, was calibrated to yield simulations matching the flood frequencies from the AMSR-E-detected water surface signal. Model performance during a validation period yielded a Nash-Sutcliffe efficiency of 0.84. We concluded that remote-sensing data from microwave sensors could be used to supplement stream gauges in large sparsely gauged or ungauged basins to calibrate hydrologic models. Given the global availability of all required data sets, this approach can be potentially expanded to improve flood monitoring and prediction in sparsely gauged basins throughout the world

Distributed hydrologic modeling↗

Investigation of advanced fault insertion and simulator methods

The cooperative agreement partly supported research leading to the open-literature publication cited. Additional efforts under the agreement included research into fault modeling of semiconductor devices. Results of this research are presented in this report which is summarized in the following paragraphs. As a result of the cited research, it appears that semiconductor failure mechanism data is abundant but of little use in developing pin-level device models. Failure mode data on the other hand does exist but is too sparse to be of any statistical use in developing fault models. What is significant in the failure mode data is that, unlike classical logic, MSI and LSI devices do exhibit more than 'stuck-at' and open/short failure modes. Specifically they are dominated by parametric failures and functional anomalies that can include intermittent faults and multiple-pin failures. The report discusses methods of developing composite pin-level models based on extrapolation of semiconductor device failure mechanisms, failure modes, results of temperature stress testing and functional modeling. Limitations of this model particularly with regard to determination of fault detection coverage and latency time measurement are discussed. Indicated research directions are presented.

Dunn, W. R.↗