Search NASA⌕ Search

SEARCH · Search NASA

Results for “sparse data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Monitoring Phenology as Indicator for Timing of Nutrient Inputs in Northern Gulf Watersheds

Nutrient over-enrichment defined by the U.S. Environmental Protection Agency as the anthropogenic addition of nutrients, in addition to any natural processes, causing adverse effects or impairments to the beneficial uses of a water body has been identified as one of the most significant environmental problems facing sensitive estuaries and coastal waters. Understanding the timing of nutrient inputs into those waters through remote sensing observables helps define monitoring and mitigation strategies. Remotely sensed data products can trace both forcings and effects of the nutrient system from landscape to estuary. This project is focused on extracting nutrient information from the landscape. The timing of nutrients entering coastal waters from the land boundary is greatly influenced by hydrologic processes, but can also be affected by the timing of nutrient additions across the landscape through natural or anthropogenic means. Non-point source nutrient additions to watersheds are often associated with specific seasonal cycles, such as decomposition of organic materials in fall and winter or addition of fertilizers to crop lands in the spring. These seasonal cycles or phenology may in turn be observed through the use of satellite sensors. Characterization of the phenology of various land cover types may be of particular interest in Gulf of Mexico estuarine systems with relatively short pathways between intensively managed systems and the land/estuarine boundary. The objective of this study is to demonstrate the capability of monitoring phenology of specific classes of land, such as agriculture and managed timberlands, at a refined watershed level. The extraction of phenological information from the Moderate Resolution Imaging Spectroradiometer (MODIS) data record is accomplished using analytical tools developed for NASA at Stennis Space Center: the Time Series Product Tool and the Phenological Parameters Estimation Tool. MODIS reflectance data (product MOD09) were used to compute the Normalized Difference Vegetation Index, which is sensitive to changes in vegetation canopies. The project team is working directly with the Mississippi Department of Environmental Quality to understand end-user requirements for this type of information product. Initial focus areas are identification of time frames for pre-plant fertilizer applications (prior to start of season), side-dress fertilizer applications (during rapid green-up), and periods of plant decomposition (during and after senescence). Prototypical maps of phenological stages related to these time frames have been generated for watersheds in the northern Gulf of Mexico. Where feasible, these maps have been compared to existing in situ nutrient monitoring data, but the in situ data is temporally sparse (monthly frequency or less), which makes interpretation challenging. Future work will include integrating effects of rainfall and seeking couplings with estuarine remote sensing.

Ross, Kenton W.↗

The Role of Lightning in Controlling Interannual Variability of Tropical Tropospheric Ozone and OH and its Implications for Climate

Nitrogen oxides (NO(x) = NO + NO2) produced by lightning make a major contribution to the production of the dominant tropospheric oxidants (OH and ozone). These oxidants control the lifetime of many trace gases including long-lived greenhouse gases, and control the source-receptor relationship of inter-hemispheric pollutant transport. Lightning is affected by meteorological variability, and therefore represents a potentially important tropospheric chemistry-climate feedback. Understanding how interannual variability (IAV) in lightning affects IAV in ozone and OH in the recent past is important if we are to predict how oxidant levels may change in a future warmer climate. However, lightning parameterizations for chemical transport models (CTMs) show low skill in reproducing even climatological distributions of flash rates from the Lightning Imaging Sensor (LIS) and the Optical Transient Detector (OTD) satellite instruments. We present an optimized regional scaling algorithm for CTMs that enables sufficient sampling of spatiotemporally sparse satellite lightning data from LIS to constrain the spatial, seasonal, and interannual variability of tropical lightning. We construct a monthly time series of lightning flash rates for 1998-2010 and 35degS-35degN, and find a correlation of IAV in total tropical lightning with El Nino. We use the IAV-constraint to drive a 9-year hindcast (1998-2006) of the GEOS-Chem 3D chemical transport model, and find the increased IAV in LNO(x) drives increased IAV in ozone and OH, improving the model fs ability to simulate both. Although lightning contributes more than any other emission source to IAV in ozone, we find ozone more sensitive to meteorology, particularly convective transport. However, we find IAV in OH to be highly sensitive to lightning NO(x), and the constraint improves the ability of the model to capture the temporal behavior of OH anomalies inferred from observations of methyl chloroform and other gases. The sensitivity of OH is explained using photochemical reaction rates which show a "magnification" effect of the initial lightning NO perturbation on OH primary production, HO(x) recycling, and OH loss frequencies. This influence on OH may represent a negative feedback, if lightning increases in a warming world..

Murray, Lee T.↗

Evaluating an Automated Approach for Monitoring Forest Disturbances in the Pacific Northwest from Logging, Fire and Insect Outbreaks with Landsat Time Series Data

Forests are the largest aboveground sink for atmospheric carbon (C), and understanding how they change through time is critical to reduce our C-cycle uncertainties. We investigated a strong decline in Normalized Difference Vegetation Index (NDVI) from 1982 to 1991 in Pacific Northwest forests, observed with the National Ocean and Atmospheric Administration's (NOAA) series of Advanced Very High Resolution Radiometers (AVHRRs). To understand the causal factors of this decline, we evaluated an automated classification method developed for Landsat time series stacks (LTSS) to map forest change. This method included: (1) multiple disturbance index thresholds; and (2) a spectral trajectory-based image analysis with multiple confidence thresholds. We produced 48 maps and verified their accuracy with air photos, monitoring trends in burn severity data and insect aerial detection survey data. Area-based accuracy estimates for change in forest cover resulted in producer's and user's accuracies of 0.21 +/- 0.06 to 0.38 +/- 0.05 for insect disturbance, 0.23 +/- 0.07 to 1 +/- 0 for burned area and 0.74 +/- 0.03 to 0.76 +/- 0.03 for logging. We believe that accuracy was low for insect disturbance because air photo reference data were temporally sparse, hence missing some outbreaks, and the annual anniversary time step is not dense enough to track defoliation and progressive stand mortality. Producer's and user's accuracy for burned area was low due to the temporally abrupt nature of fire and harvest with a similar response of spectral indices between the disturbance index and normalized burn ratio. We conclude that the spectral trajectory approach also captures multi-year stress that could be caused by climate, acid deposition, pathogens, partial harvest, thinning, etc. Our study focused on understanding the transferability of previously successful methods to new ecosystems and found that this automated method does not perform with the same accuracy in Pacific Northwest forests. Using a robust accuracy assessment, we demonstrate the difficulty of transferring change attribution methods to other ecosystems, which has implications for the development of automated detection/attribution approaches. Widespread disturbance was found within AVHRR-negative anomalies, but identifying causal factors in LTSS with adequate mapping accuracy for fire and insects proved to be elusive. Our results provide a background framework for future studies to improve methods for the accuracy assessment of automated LTSS classifications.

Landsat↗

A Case for Nebula Scale Mixing Between Non-Carbonaceous and Carbonaceous Chondrite Reservoirs: Testing the Grand Tack Model with Chromium Isotopic Composition of Almahata Sitta Stone 91A

There is an increasing number of Cr-O-Ti isotope studies that show solar system materials are divided into two main populations, one carbonaceous chondrite (CC)-like and the other is non-carbonaceous (NC)-like, with minimal mixing attributed to a gap opened in the protoplanetary disk due to Jupiter's formation. The Grand Tack model suggests there should be large-scale mixing between S- and C-type asteroids, an idea supported by our recent work on chondrule (Delta)17O-ε54Cr isotope systematics. The Almahata Sitta (AhS) meteorite provides a unique opportunity to test the Grand Tack model. The meteorite fell to Earth in October 2008 and has been linked to the asteroid 2008 TC3 which was discovered just prior to the fall of the AhS stones. The AhS meteorite is composed of up to 700 individual pieces with approx.140 of those pieces having some geochemical and/or petrologic studies. Almahata Sitta is an anomalous polymict ureilite with other meteorite components, including enstatite, ordinary, and carbonaceous chondrites with an approximate abundance of 70% ureilites and 30% chondrites. This observation has lead to the suggestion that TC3 2008 was a loosely aggregated rubble pile-like asteroid with the non-ureilite sample clasts within the rubble-pile. Due to the loosely-aggregated nature of AhS, the object disintegrated during atmospheric entry resulting in the weakly held clasts falling predominantly as individual stones in the AhS collection area. However, recent work has identified one sample of AhS, sample 91A, which may represent two different lithologies coexisting within a single stone. The predominate lithology type in 91A appears to be that of a C2 chondrite based on mineralogy but also contains olivine, pyroxene, and albite that have ureilite-like compositions. Previous Cr isotope investigations into AhS stones are sparse and what data is available show nearly uniform isotopic composition similar to that of typical ureilites with negative ε54Cr values.

Sanborn, M. E.↗

Characterizing 15 Years of Saharan-like, Dry, Well-Mixed Air Layers in North Africa

The Saharan Air Layer (SAL) is a dry, well-mixed layer (WML) of warm and sometimes dusty air of nearly constant water vapor mixing ratio generated by the intense surface heating and strong, dry convection in the Sahara Desert, which has notable downstream impacts on the surface energy balance, organized convective system development, seasonal precipitation, and air quality. Characterizing both WMLs and SALs from the existing rawinsonde network has proven challenging because of its sparseness and inconsistent data reporting. Spurred on by this challenge, we previously created a detection methodology and supporting software to automate the identification and characterization of WMLs from multiple data sources including rawinsondes, remote sensing platforms, and model products. We applied our algorithm to each dataset at both its native and at a common (most coarse data product) vertical resolution to detect WMLs and their characteristics (temperature, mixing ratio, AOD, etc.) at each of the 53 rawinsonde launch sites in north Africa.

Nicholls, Stephen D.↗

Semi-Weekly Monitoring of the Performance and Attitude of Kepler Using a Sparse Set of Targets

The Kepler spacecraft is in a heliocentric Earth-trailing orbit, continuously observing ~160,000 select stars over ~115 square degrees of sky using its photometer containing 42 highly sensitive CCDs. The science data from these stars, consisting of ~6 million pixels at 29.4-minute intervals, is downlinked only every ~30 days. Additional low-rate Xband communications contacts are conducted with the spacecraft twice a week to downlink a small subset of the science data. This paper describes how we assess and monitor the performance of the photometer and the pointing stability of the spacecraft using such a sparse data set.

Attitude reconstruction↗

Thermal Band Atmospheric Correction Using Atmospheric Profiles Derived from Global Positioning System Radio Occultation and the Atmospheric Infrared Sounder

This Rapid Prototyping Capability study explores the potential to use atmospheric profiles derived from GPS (Global Positioning System) radio occultation measurements and by AIRS (Atmospheric Infrared Sounder) onboard the Aqua satellite to improve surface temperature retrieval from remotely sensed thermal imagery. This study demonstrates an example of a cross-cutting decision support technology whereby NASA data or models are shown to improve a wide number of observation systems or models. The ability to use one data source to improve others will be critical to the GEOSS (Global Earth Observation System of Systems) where a large number of potentially useful systems will require auxiliary datasets as input for decision support. Atmospheric correction of thermal imagery decouples TOA radiance and separates surface emission from atmospheric emission and absorption. Surface temperature can then be estimated from the surface emission with knowledge of its emissivity. Traditionally, radiosonde sounders or atmospheric models based on radiosonde sounders, such as the NOAA (National Oceanic & Atmospheric Administration) ARL (Air Resources Laboratory) READY (Real-time Environmental Application and Display sYstem), provide the atmospheric profiles required to perform atmospheric correction. Unfortunately, these types of data are too spatially sparse and too infrequently taken. The advent of high accuracy, global coverage, atmospheric data using GPS radio occultation and AIRS may provide a new avenue for filling data input gaps. In this study, AIRS and GPS radio occultation derived atmospheric profiles from the German Aerospace Center CHAMP (CHAllenging Minisatellite Payload), the Argentinean Commission on Space Activities SAC-C (Satellite de Aplicaciones Cientificas-C), and the pair of NASA GRACE (Gravity Recovery and Climate Experiment) satellites are used as input data in atmospheric radiative transport modeling based on the MODTRAN (MODerate resolution atmospheric TRANsmittance) radiative transport software to separate out the atmospheric component of measured top of atmosphere radiance. Simulated water bodies across a variety of MODTRAN model atmospheres including desert, mid-latitude, tropical and sub-artic conditions provide test bed conditions. Atmospherically corrected radiance and surface temperature results were compared to those obtained using traditional radiosonde balloon data and models. In general, differences between the different techniques were less than 2 percent indicating the potential value satellite derived atmospheric profiles have to atmospherically correct thermal imagery.

Pagnutti, Mary↗

SPAR: Structural-performance analysis and redesign

System of processor programs performs stress, buckling, and vibrational analysis of large linear finite element systems in excess of 50,000 degrees of freedom, while minimizing processing cost, execution time, central memory storage, and secondary data storage requirements. Programs use sparse matrix solution techniques and other computational and data management procedures.

Whetstone, W. D.↗

TPSAS-NF1676L-17943-DND

SAGE II used the solar occultation technique to measure atmospheric ozone for 21 years between 1984 and 2005 and has continued to play a key role in numerous international assessments. Traditionally, the determination of trends in ozone using SAGE II data has been done via time series analysis of monthly mean data within specific latitude bands. However, given the sparse sampling of SAGE II data, this will introduce temporal and/or spatial biases, particularly in the period after late 2000 when the instrument operated at half-duty cycle. Herein we present a new method for performing time series analysis of unevenly sampled data (in particular SAGE II); namely, we utilize the daily mean data and perform a simultaneous temporal and spatial analysis, making use of a Fourier series to constrain latitudinal variation. This methodology is applied to both the previous (v6.2) and current (v7.0) versions of the SAGE II data. Results are discussed that show the improvements to the data between versions 6.2 and 7.0 that make time series analysis produce reduced residuals as well as the preliminary results of the time series itself, which reveal some of the limitations in currently used proxies for the regression.

Robert P Damadeo↗

Identification of turbulence structures above a forest canopy using a wavelet transform

The wavelet transform is used to identify scales of large coherent structures present in atmospheric turbulence above the subarctic forest at Schefferville. Individual coherent structures contributing to much of the exchange between the forest and the atmosphere are depicted in terms of both scale and location using contour diagrams of wavelet transform coefficients. Three typical case studies of turbulence and flux observations were selected to examine the physical characteristics of these flux-filled events and their evolution with distance away from the forest canopy. A wavelet transform spectral technique is applied to vertical velocity, temperature, and turbulent heat flux data observed over the sparse coniferous forest to extract the relative importance of each scale present in those data series. The scale of turbulence structures in relation with their characteristic spacing is discussed.

Turner, B. J.↗

SPARSKIT: A basic tool kit for sparse matrix computations

Presented here are the main features of a tool package for manipulating and working with sparse matrices. One of the goals of the package is to provide basic tools to facilitate the exchange of software and data between researchers in sparse matrix computations. The starting point is the Harwell/Boeing collection of matrices for which the authors provide a number of tools. Among other things, the package provides programs for converting data structures, printing simple statistics on a matrix, plotting a matrix profile, and performing linear algebra operations with sparse matrices.

Saad, Youcef↗

Artificial Intelligence Medical Support for Long-Duration Space Missions

We envision an artificial intelligence (AI) based system that will provide support and recommendations to the crew medical officer (CMO) and ground flight surgeon during long-duration space missions. Such a system would be pretrained on the knowledgebase of clinical knowledge on Earth, minimizing the amount of Earth data that needs to be transferred into space. Then during deployment, the system would be constantly refined through active learning from diverse streams of data from sensors in the spacecraft, data collected daily from individual astronauts, and human-in-the-loop feedback from the crew. The model could be interrogated for predictions and recommendations on personalized crew health based on the overall status of the spacecraft, medicinal stores, and status of other crew members. Adaptation techniques would be used to incorporate spaceflight data that have very different distributions from the training data due to the extreme environment. Edge computing and the most advanced neuromorphic processing would enable computation in scenarios with low power and bandwidth, while dimensionality reduction would be employed to ensure that the input data streams from spaceflight are as small as possible. In order to realize this long-term vision, several hardware and software aspects need to be developed and assembled. First, models pretrained on Earth biomedical data would need to be evaluated for predictive accuracy, and the best one selected. That model would need to be adapted to learn from diverse, sparse, and inconsistently measured data streams, as well as human-in-the-loop feedback. A data integration, standardization, and dimensionality reduction methodology would need to be developed to handle all data types and feed them into the model. Once the software and data infrastructure is developed, it would need to be integrated with small footprint compute processors and tested in high-radiation, high-vibration, unregulated temperature situations. As a short-term goal, we recommend to focus on the development of the data and model software structure. Several large language models (LLM) already exist that have been trained on Earth biomedical and clinical knowledgebases, including BioMedLLM, Med-PaLM, SPOKE LLM, and Foresight. These models need to be evaluated for accuracy and the best one chosen for a proof-of-concept structure, while maintaining awareness of the accelerating AI field and incorporating any newly improved model architectures as needed. Then, we recommend to develop a database of synthetic data types to mimic the diverse data streams that are expected in a long-duration space mission. This should include environmental and microbial data from the spacecraft, non-invasive data from wearables and point-of-care devices employed by astronauts, and more invasive molecular and physiological monitoring of clinical and biomarker data from astronauts. The data standardization methodology should be developed, and these data streams used to refine the clinical LLM. Several scenarios should be developed that could plausibly come up in a long-duration space mission, and changes or aberrations introduced to the data at specific times to mimic these scenarios. Then, question and answer tasks should be designed to interrogate the model for predictions and recommendations, with acceptable answers already identified.

Artificial Intelligence↗

Extracting Periodic Signals From Irregularly Sampled Data

Successive approximations formed in Fourier space. Algorithm extracts periodic signals from sparse, irregularly sampled sets of measurement data. Pertains to data processed via fast Fourier transforms (FFTs). Data represents signal components with initially unknown frequencies spanning large spectral range and includes frequencies not integer multiples of minimum FFT frequency.

Wilcox, Jaroslava Z.↗

Fusion of Surface Ceilometer Data and Satellite Cloud Retrievals in 2D Mesh Interpolating Model with Clustering

For accurate cloud ceiling information, a data fusion approach is proposed that utilizes satellite data to extend surface station information to much wider areas. Cloud base height (CBH) retrieved from satellite observations provides for much larger spatial coverage and higher resolution. The direct comparison of GOES-16 CBH with surface station ceiling yields a local bias that has to be corrected for in the initial GOES-16 cloud base information. This sparsely sampled bias correction presents an irregular 2D mesh of control points, which is then interpolated by constructing a continuous smooth field using polyharmonic splines. The influence of remote stations is restricted by grouping the control points into clusters depending on an effective distance. This cluster-based approach allows for constructing separate spline surfaces corresponding to physically different clouds. The obtained continuous bias correction function is then applied to the entire GOES-16 pixel level CBH except for areas far away from surface stations in data sparse regions such as offshore. The described method is currently being tested using daytime-only observations over the central and eastern United States. Overall, this approach has potential to provide more accurate, high spatial resolution cloud ceiling information for the aviation community.

Khlopenkov, Konstantin↗

Spatial Statistical Data Fusion for Remote Sensing Applications

Data fusion is the process of combining information from heterogeneous sources into a single composite picture of the relevant process, such that the composite picture is generally more accurate and complete than that derived from any single source alone. Data collection is often incomplete, sparse, and yields incompatible information. Fusion techniques can make optimal use of such data. When investment in data collection is high, fusion gives the best return. Our study uses data from two satellites: (1) Multiangle Imaging SpectroRadiometer (MISR), (2) Moderate Resolution Imaging Spectroradiometer (MODIS).

fusion techniques↗

The infrared variability of the eruptive variable HM Sagittae

Recent near infrared observations have been obtained of the peculiar eruptive variable HM Sagittae which show a general decrease in the flux levels between 1 and 5 microns during 1977-1978. The existing data are yet too sparse to ascertain the nature of the variability; however, both the IR and visual observations confirm the close resemblance of HM Sge to V1016 Cyg. A model of a binary symbiotic system containing a late type variable may be consistent with the current data.

Slovak, M. H.↗

Evaluation Analysis of NASA SMAP L3 and L4 and SPoRT-LIS Soil Moisture Data in the United States

Soil moisture has a critical role in the development, frequency and persistence of climatic and hydrologic extremes such as drought, heat wave and flooding events. In situ soil moisture data are uneven and sparse in time and space. This highlights the need to utilize other soil moisture sources to fill this spatiotemporal gap. The goal of this study is to validate one satellite-based and two model-based soil moisture datasets with in situ data across the United States. Soil moisture information from the Soil Moisture Active Passive (SMAP) enhanced level 3 (L3) (SMAP L3) and modeled level 4 (L4) (SMAP L4) data at 9-km resolution and Short-term Prediction Research and Transition-Land Information System (SPoRT-LIS) modeled at 3-km resolution were selected for evaluation. SPoRT-LIS is a near real-time, high resolution operational land analysis data. Ground-based data were obtained from the North American Soil Moisture Database (NASMD) for 362 stations. Seven statistical indicators including anomaly, Spearman, and Pearson correlation coefficients, the systematic error (Bias), root mean square error (RMSE), unbiased root mean square error (ubRMSE), and normalized standard deviation (SDV) were used to evaluate the satellite- and model-derived soil moisture data. In addition, the triple collocation (TC) error model was used to measure the error among SMAP L4, SPoRT-LIS and ground-based data. This study assesses which satellite or modeled dataset is most appropriate for specific times and locations to use as a surrogate for in situ observations. Temporal and spatial analysis demonstrated that, overall, SMAP L4 performed better than SMAP L3 and SPoRT-LIS. Strong agreement was observed between SMAP L4 and in situ observations (ρ = 0.53, Bias = −0.006) in all seasons and most regions with various land covers, especially in winter and in the central regions of the United States. For croplands, SMAP L4 presented the best agreement with in situ data, analyzing all period (ρ = 0.60) and non-winter period (ρ = 0.61) separately.

Tavakol, Ameneh↗

A geometry package for generation of input data for a three-dimensional potential-flow program

The preparation of geometric data for input to three-dimensional potential flow programs was automated and simplified by a geometry package incorporated into the NASA Langley version of the 3-D lifting potential flow program. Input to the computer program for the geometry package consists of a very sparse set of coordinate data, often with an order of magnitude of fewer points than required for the actual potential flow calculations. Isolated components, such as wings, fuselages, etc. are paneled automatically, using one of several possible element distribution algorithms. Curves of intersection between components are calculated, using a hybrid curve-fit/surface-fit approach. Intersecting components are repaneled so that adjacent elements on either side of the intersection curves line up in a satisfactory manner for the potential-flow calculations. Many cases may be run completely (from input, through the geometry package, and through the flow calculations) without interruption. Use of the package significantly reduces the time and expense involved in making three-dimensional potential flow calculations.

Halsey, N. D.↗