SEARCH · Search NASA

Results for “sparse data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

All sources NASA NTRS DOE OSTI

NASA NTRS2006

Flight Operations Analysis Tool

Flight Operations Analysis Tool (FLOAT) is a computer program that partly automates the process of assessing the benefits of planning spacecraft missions to incorporate various combinations of launch vehicles and payloads. Designed primarily for use by an experienced systems engineer, FLOAT makes it possible to perform a preliminary analysis of trade-offs and costs of a proposed mission in days, whereas previously, such an analysis typically lasted months. FLOAT surveys a variety of prior missions by querying data from authoritative NASA sources pertaining to 20 to 30 mission and interface parameters that define space missions. FLOAT provides automated, flexible means for comparing the parameters to determine compatibility or the lack thereof among payloads, spacecraft, and launch vehicles, and for displaying the results of such comparisons. Sparseness, typical of the data available for analysis, does not confound this software. FLOAT effects an iterative process that identifies modifications of parameters that could render compatible an otherwise incompatible mission set.

Easter, Robert↗

NASA NTRS2022

MLtool: Universal Supervised Machine Learning Tool to Model Tabulated Data

Machine Learning (ML) is a subfield of Artificial Intelligence that gives computers the ability to learn from past data without being explicitly programmed. The predictive capabilities of ML models have already been used to facilitate several scientific breakthroughs. However, the practical application of ML is often limited due to the gaps in technical knowledge of its users. The common issue faced by many scientific researchers is the inability to choose the appropriate ML pipelines that are needed to treat real-world data, which is often sparse and noisy. To solve this problem, we have developed an automated Machine Learning tool (MLtool) that includes a set of ML algorithms and approaches to aid scientific researchers. The current version of MLtool is implemented as an object-oriented Python code that is easily extensible. It includes 44 different regression algorithms used to model data. MLtool helps users select the best model for their data, based on the scoring metrics used. Besides regression algorithms, MLtool also includes a suite of pre- and post-processing techniques such as missing value imputation, categorical variable encoding, input feature normalization, uncertainty quantification, exploratory data analysis (EDA), etc. MLtool was tested on several publicly available multi-dimensional data sets and was found capable of making accurate predictions.

Machine learning↗

NASA NTRS2022

MLtool Python Code

Machine Learning↗

NASA NTRS1994

Spherical disharmonics in the Earth sciences and the spatial solution: Ridges, hotspots, slabs, geochemistry and tomography correlations

There is increasing use of statistical correlations between geophysical fields and between geochemical and geophysical fields in attempts to understand how the Earth works. Typically, such correlations have been based on spherical harmonic expansions. The expression of functions on the sphere as spherical harmonic series has many pitfalls, especially if the data are nonuniformly and/or sparsely sampled. Many of the difficulties involved in the use of spherical harmonic expansion techniques can be avoided through the use of spatial domain correlations, but this introduces other complications, such as the choice of a sampling lattice. Additionally, many geophysical and geochemical fields fail to satisfy the assumptions of standard statistical significance tests. This is especially problematic when the data values to be correlated with a geophysical field were collected at sample locations which themselves correlate with that field. This paper examines many correlations which have been claimed in the past between geochemistry and mantle tomography and between hotspot, ridge, and slab locations and tomography using both spherical harmonic coefficient correlations and spatial domain correlations. No conclusively significant correlations are found between isotopic geochemistry and mantle tomography. The Crough and Jurdy (short) hotspot location list shows statistically significant correlation with lowermost mantle tomography for degree 2 of the spherical harmonic expansion, but there are no statistically significant correlations in the spatial case. The Vogt (long) hotspot location list does not correlate with tomography anywhere in the mantle using either technique. Both hotspot lists show a strong correlation between hotspot locations and geoid highs when spatially correlated, but no correlations are revealed by spherical harmonic techniques. Ridge locations do not show any statistically significant correlations with tomography, slab locations, or the geoid; the strongest correlation is with lowermost mantle tomography, which is probably spurious. The most striking correlations are between mantle tomography and post-Pangean subducted slabs. The integrated locations of slabs correlate strongly with fast areas near the transition zone and the core-mantle boundary and with slow regions from 1022-1248 km depth. This seems to be consistent with the 'avalanching' downwellings which have been indicated by models of the mantle which include an endothermic phase transition at the 670-km discontinuity, although this is not a unique interpretation. Taken as a whole, these results suggest that slabs and associated cold downwellings are the dominant feature of mantle convection. Hotspot locations are no better correlated with lower mantle tomography than are ridge locations.

Ray, Terrill W.↗

NASA NTRS1986

Canopy reflectance modeling in a tropical wooded grassland

Geometric/optical canopy reflectance modeling and spatial/spectral pattern recognition is used to study the form and structure of savanna in West Africa. An invertible plant canopy reflectance model is tested for its ability to estimate the amount of woody vegetation from remotely sensed data in areas of sparsely wooded grassland. Dry woodlands and wooded grasslands, commonly referred to as savannas, are important ecologically and economically in Africa, and cover approximately forty percent of the continent by some estimates. The Sahel and Sudan savannas make up the important and sensitive transition zone between the tropical forests and the arid Sahara region. The depletion of woody cover, used for fodder and fuel in these regions, has become a very severe problem for the people living there. LANDSAT Thematic Mapper (TM) data is used to stratify woodland and wooded grassland into areas of relatively homogeneous canopy cover, and then an invertible forest canopy reflectance model is applied to estimate directly the height and spacing of the trees in the stands. Because height and spacing are proportional to biomass in some cases, a successful application of the segmentation/modeling techniques will allow direct estimation of tree biomass, as well as cover density, over significant areas of these valuable and sensitive ecosystems. The model being tested in sites in two different bioclimatic zones in Mali, West Africa, will be used for testing the canopy model. Sudanian zone crop/woodland test sites were located in the Region of Segou, Mali.

Simonett, David↗

NASA NTRSDate not supplied

Phenomena Portal: Large- Scale Visual Exploration of Atmospheric Phenomena

The Earth science community is experiencing a high influx of remote sensing data due to recent advancements in sensor technology. This enables the community to extend their research on a larger scale than ever before. Unfortunately, traditional data processing techniques do not scale well to these new, high volume data sources. State-of-the-art machine learning (ML) pipelines have been proven to overcome these burdens in various other fields but are underexploited within the physical sciences community. Moreover, ML is reliant on labeled data, which is currently sparsely available, owing to the fact that ML adoption is still in the early stages within the Earth and atmospheric science communities. To address these issues, we developed the Phenomena Portal, a visual exploration tool that uses ML to detect various atmospheric phenomena on a global scale. This allows the Earth and atmospheric science communities to view trends of occurrences of phenomena, identify potential relationships between them, and analyze spatiotemporal patterns over time. These detections can also serve as initial labeled data for ML research pertaining to the respective phenomena. The tool also incorporates feedback from subject matter experts to further improve the model detection accuracy, thereby facilitating human-in-the-loop. This presentation will provide an overview of the ML model development and cloud deployment. We also discuss the capabilities of the user interface for displaying the detections.

Muthukumaran Ramasubramanian↗

NASA NTRS1993

Driving a car with custom-designed fuzzy inferencing VLSI chips and boards

Vehicle control in a-priori unknown, unpredictable, and dynamic environments requires many calculational and reasoning schemes to operate on the basis of very imprecise, incomplete, or unreliable data. For such systems, in which all the uncertainties can not be engineered away, approximate reasoning may provide an alternative to the complexity and computational requirements of conventional uncertainty analysis and propagation techniques. Two types of computer boards including custom-designed VLSI chips were developed to add a fuzzy inferencing capability to real-time control systems. All inferencing rules on a chip are processed in parallel, allowing execution of the entire rule base in about 30 microseconds, and therefore, making control of 'reflex-type' of motions envisionable. The use of these boards and the approach using superposition of elemental sensor-based behaviors for the development of qualitative reasoning schemes emulating human-like navigation in a-priori unknown environments are first discussed. Then how the human-like navigation scheme implemented on one of the qualitative inferencing boards was installed on a test-bed platform to investigate two control modes for driving a car in a-priori unknown environments on the basis of sparse and imprecise sensor data is described. In the first mode, the car navigates fully autonomously, while in the second mode, the system acts as a driver's aid providing the driver with linguistic (fuzzy) commands to turn left or right and speed up or slow down depending on the obstacles perceived by the sensors. Experiments with both modes of control are described in which the system uses only three acoustic range (sonar) sensor channels to perceive the environment. Simulation results as well as indoors and outdoors experiments are presented and discussed to illustrate the feasibility and robustness of autonomous navigation and/or safety enhancing driver's aid using the new fuzzy inferencing hardware system and some human-like reasoning schemes which may include as little as six elemental behaviors embodied in fourteen qualitative rules.

Pin, Francois G.↗

NASA NTRSDate not supplied

OCO-2 Satellite-imposed Constraints on Terrestrial Biospheric CO2 Flux over South Asia

The spatiotemporal variability of terrestrial biospheric carbon dioxide (CO2) flux over South Asia is poorly understood. The inverse model “top-down” CO2 flux estimates which rely on atmospheric CO2 observational data are impeded by sparse in situ measurements over this region. The Orbiting Carbon Observatory 2 (OCO-2) provides much needed global retrievals of column-average CO2 dry-air mole fraction (XCO2) with the finest spatial and temporal resolution and highest sensitivity to surface fluxes available to-date. This study conducted global inverse model simulations as part of the second OCO-2 Multi-model Intercomparison Project assimilating version 9 of the OCO-2 XCO2 retrievals in land nadir (LN) and land glint (LG) observing modes and global in situ (IS) measurements. The four-dimensional variational assimilation system with the GEOS-Chem global chemical transport model was used to estimate CO2 fluxes from 2015 to 2018. We then assessed the spatiotemporal variability of optimized CO2 Net ecosystem Exchange (NEE) fluxes aggregated over the South Asia region. The most robust result found by assimilating OCO-2 observations was the constraints imposed on the seasonal cycle of terrestrial biospheric fluxes over South Asia. The seasonality of South Asian NEE estimated by assimilating OCO-2 or global IS data showed a larger seasonal cycle compared to the current understanding of NEE in this region (represented by the prior NEE used in the model). The satellite-in situ joint inversion (IS + LN + LG) led to land flux seasonal amplitude (absolute magnitude of the difference between peak and trough of monthly mean values over a year) of 4.0 PgC yr-1, compared to the prior model (1.5 PgC yr-1). Moreover, OCO-2 data imposed a phase shift in the seasonal cycle, resulting in a large CO2 source in April and a large uptake in September. Most of the features in the seasonal cycle imposed by OCO-2 data are in agreement with previous “top-down” studies assimilating regional aircraft observations. Nevertheless, we recommend a closer examination of the novel features highlighted by the OCO-2 column data over South Asia in future studies by conducting regional inverse modelling with denser in situ and vertically-resolved regional observations along with satellite data.

OCO-2↗

NASA NTRS1999

Parallel Grid Manipulations in Earth Science Calculations

The National Aeronautics and Space Administration (NASA) Data Assimilation Office (DAO) at the Goddard Space Flight Center is moving its data assimilation system to massively parallel computing platforms. This parallel implementation of GEOS DAS will be used in the DAO's normal activities, which include reanalysis of data, and operational support for flight missions. Key components of GEOS DAS, including the gridpoint-based general circulation model and a data analysis system, are currently being parallelized. The parallelization of GEOS DAS is also one of the HPCC Grand Challenge Projects. The GEOS-DAS software employs several distinct grids. Some examples are: an observation grid- an unstructured grid of points at which observed or measured physical quantities from instruments or satellites are associated- a highly-structured latitude-longitude grid of points spanning the earth at given latitude-longitude coordinates at which prognostic quantities are determined, and a computational lat-lon grid in which the pole has been moved to a different location to avoid computational instabilities. Each of these grids has a different structure and number of constituent points. In spite of that, there are numerous interactions between the grids, e.g., values on one grid must be interpolated to another, or, in other cases, grids need to be redistributed on the underlying parallel platform. The DAO has designed a parallel integrated library for grid manipulations (PILGRIM) to support the needed grid interactions with maximum efficiency. It offers a flexible interface to generate new grids, define transformations between grids and apply them. Basic communication is currently MPI, however the interfaces defined here could conceivably be implemented with other message-passing libraries, e.g., Cray SHMEM, or with shared-memory constructs. The library is written in Fortran 90. First performance results indicate that even difficult problems, such as above-mentioned pole rotation- a sparse interpolation with little data locality between the physical lat-lon grid and a pole rotated computational grid- can be solved efficiently and at the GFlop/s rates needed to solve tomorrow's high resolution earth science models. In the subsequent presentation we will discuss the design and implementation of PILGRIM as well as a number of the problems it is required to solve. Some conclusions will be drawn about the potential performance of the overall earth science models on the supercomputer platforms foreseen for these problems.

Sawyer, W.↗

NASA NTRS2014

Arctic Sea Ice in Transformation: A Review of Recent Observed Changes and Impacts on Biology and Human Activity

Sea ice in the Arctic is one of the most rapidly changing components of the global climate system. Over the past few decades, summer areal extent has declined over 30, and all months show statistically significant declining trends. New satellite missions and techniques have greatly expanded information on sea ice thickness, but many uncertainties remain in the satellite data and long-term records are sparse. However, thickness observations and other satellite-derived data indicate a 40 decline in thickness, due in large part to the loss of thicker, older ice cover. The changes in sea ice are happening faster than models have projected. With continued increasing temperatures, summer ice-free conditions are likely sometime in the coming decades, though there are substantial uncertainties in the exact timing and high interannual variability will remain as sea ice decreases. The changes in Arctic sea ice are already having an impact on flora and fauna in the Arctic. Some species will face increasing challenges in the future, while new habitat will open up for other species. The changes are also affecting peoples living and working in the Arctic. Native communities are facing challenges to their traditional ways of life, while new opportunities open for shipping, fishing, and natural resource extraction.

Sea Ice↗

NASA NTRS2026

Remote Sensing-Driven Hydrodynamic Modeling in Data-Scarce Regions: Integrating ICESat-2, Sentinel-2, SWOT and Re-analysis Models for Coastal Monitoring

Hydrodynamic models in coastal and estuarine systems are typically constrained by sparse bathymetry, boundary, and validation data, especially in regions where field campaigns are costly or impractical. Here we develop and test a fully satellite-driven framework for hydrodynamic modeling in South Africa’s Langebaan Lagoon without using any local in situ measurements. Bathymetry is derived by training multispectral Sentinel-2 reflectance against ICESat-2 ATL24 photon-derived depths using an XGBoost model optimized with Bayesian search. The final satellite-derived bathymetry reproduces independent ATL24 points with RMSE = 0.45 m and R 2 = 0.97. This bathymetry was used in a depth-averaged Delft3D Flexible Mesh model driven at the open boundary by TPXO tidal harmonics and by ERA5 winds. We validate modeled water surface elevation against 16 SWOT low-rate (250 m, unsmoothed) passes in 2023. SWOT–model comparisons yield an overall RMSE of 0.11 m and R 2 = 0.61, with typical point differences <0.10 m (∼7% of the 1.5 m tidal range), and showed consistent spatial gradients in water level from the offshore boundary, through Saldanha Bay, and into the lagoon. At the offshore boundary, TPXO and SWOT sea surface heights agree closely (R 2 = 0.86). A simple phase adjustment of ∼26,min between TPXO and SWOT lowers the RMSE from 0.18,m to 0.11,m, showing that phase offset accounts for some of the discrepancy, with additional errors likely linked to non-tidal signals. Our results demonstrate that combining passive optical, photon-counting LiDAR, radar interferometry, and global tidal/atmospheric models enables robust, transferrable hydrodynamic modeling in data-scarce coastal systems, offering a cost-effective pathway for monitoring.

ICESat-2↗

NASA NTRS1980

First Scientific Working Group Meeting of Airborne Doppler Lidar Wind Velocity Measurement Program, appendix C

The problem is to operate on two scalar fields to produce a vector field, to produce user products from the vector field, and to establish reliability of results. Data problems encountered include sparse measurements, irregular distribution, varying quality, imperfect orthogonality, aliasing due to sampling volume, and measurements not simultaneous. Desired algorithm characteristics, solution elements, and characteristics of the model are listed. The seven simulation elements, eight algorithm steps and the required user inputs are given.

Lee, R. W.↗

NASA NTRS1984

Some methods of computing platform transmitter terminal location estimates

A position estimation algorithm was developed to track a humpback whale tagged with an ARGOS platform after a transmitter deployment failure and the whale's diving behavior precluded standard methods. The algorithm is especially useful where a transmitter location program exists; it determines the classical keplarian elements from the ARGOS spacecraft position vectors included with the probationary file messages. A minimum of three distinct messages are required. Once the spacecraft orbit is determined, the whale is located using standard least squares regression techniques. Experience suggests that in instances where circumstances inherent in the experiment yield message data unsuitable for the standard ARGOS reduction, (message data may be too sparse, span an insufficient period, or include variable-length messages). System ARGOS can still provide much valuable location information if the user is willing to accept the increased location uncertainties.

Hoisington, C. M.↗

NASA NTRS1985

Gravity Waves

Atmospheric parameters fluctuate on all scales. In the mesoscale these fluctuations are occasionally sinusoidal so that they can be interpreted as gravity waves. Usually, however, the fluctuations are noise like, so that their cause is not immediately evident. Results of mesoscale observations in the 20 to 120 m altitude range that are suitable for incorporation into a model atmosphere are very limited. In the stratosphere and lower mesosphere observations are sparse and very little data has been summarized into appropriate form. There is much more data in the upper mesosphere and lower thermosphere, but again very little of it has been summarized. The available mesoscale spectra of horizontal wind u versus vertical wave number m in the 20 to 120 km altitude range are shown together with a spectrum from the lower atmosphere for comparison. Further information about these spectra is given. In spite of the large range of altitudes and latitudes, the spectra from the lower atmosphere (NASA, 1971 and DEWAN, 1984) are remarkably similar in both shape and amplitude. The mean slopes of -2.38 for the NASA spectrum and -2.7 for the Dewan spectra are supported by the mean slope of -2.75 found by ROSENBERG et al. (1974). The mesospheric spectrum is too short to establish a shape. Its amplitude is about an order of magnitude larger than the NASA spectrum in the same wave number range. The NASA and Dewan spectra suggest that the mesoscale spectra in the lower atmosphere are insensitive to meteorological conditions.

Vanzandt, T. E.↗

NASA NTRS1991

Voyager 2 test of the radar time-delay effect

By analyzing radio range measurements generated during the solar conjunction of the Voyager 2 spacecraft in 1985, the relativistic time-delay effect has been tested accurately with a spacecraft at a distance of 3 x 10 to the 9th km from the earth. Because the range measurements were generated simultaneously at two frequencies on the downlink, it was possible to derive calibrations for the delay resulting from intervening solar plasma. In addition, a record of attitude thruster firings was used to model small accelerations of the spacecraft that could have produced a range error. It was thereby possible to determine the parameterized post-Newtonian parameter gamma to an accuracy of 3 percent with only a sparse amount of range data.

Krisher, Timothy P.↗

NASA NTRS1993

Real-time qualitative reasoning for telerobotic systems

This paper discusses the sensor-based telerobotic driving of a car in a-priori unknown environments using 'human-like' reasoning schemes implemented on custom-designed VLSI fuzzy inferencing boards. These boards use the Fuzzy Set theoretic framework to allow very vast (30 kHz) processing of full sets of information that are expressed in qualitative form using membership functions. The sensor-based and fuzzy inferencing system was incorporated on an outdoor test-bed platform to investigate two control modes for driving a car on the basis of very sparse and imprecise range data. In the first mode, the car navigates fully autonomously to a goal specified by the operator, while in the second mode, the system acts as a telerobotic driver's aid providing the driver with linguistic (fuzzy) commands to turn left or right, speed up, slow down, stop, or back up depending on the obstacles perceived by the sensors. Indoor and outdoor experiments with both modes of control are described in which the system uses only three acoustic range (sonar) sensor channels to perceive the environment. Sample results are presented that illustrate the feasibility of developing autonomous navigation modules and robust, safety-enhancing driver's aids for telerobotic systems using the new fuzzy inferencing VLSI hardware and 'human-like' reasoning schemes.

Pin, Eancois G.↗

NASA NTRS1995

Linear and nonlinear trending and prediction for AVHRR time series data

The variability of AVHRR calibration coefficient in time was analyzed using algorithms of linear and non-linear time series analysis. Specifically we have used the spline trend modeling, autoregressive process analysis, incremental neural network learning algorithm and redundancy functional testing. The analysis performed on available AVHRR data sets revealed that (1) the calibration data have nonlinear dependencies, (2) the calibration data depend strongly on the target temperature, (3) both calibration coefficients and the temperature time series can be modeled, in the first approximation, as autonomous dynamical systems, (4) the high frequency residuals of the analyzed data sets can be best modeled as an autoregressive process of the 10th degree. We have dealt with a nonlinear identification problem and the problem of noise filtering (data smoothing). The system identification and filtering are significant problems for AVHRR data sets. The algorithms outlined in this study can be used for the future EOS missions. Prediction and smoothing algorithms for time series of calibration data provide a functional characterization of the data. Those algorithms can be particularly useful when calibration data are incomplete or sparse.

Smid, J.↗

NASA NTRS1994

Superhumps in cataclysmic binaries. 3: V795 Herculis

We report photometry of the cataclysmic variable V795 Herculis during 1990-1994. Comparison of recent with previously published data shows that the 2.78-hr periodicity has essentially disappeared; the amplitude has diminished by a factor of at least 10. In its place, there is a low-amplitude signal near the radial-velocity (orbital?) period of 2.60 hr. During 1983-1989, the star did show an obvious 2.78-hr signal. We study the published data on this signal, together with our own data under the (questionable) assumption that the signal still exists with an amplitude too small to survive the rigors of unbiased period detection. The data are really too sparse and too poorly distributed to decide the issue of phase stability. But since the photometric signal is transient and exceeds the likely orbital period by approximately 8%, the photometric waves are likely to be yet another example of 'superhumps', the phenomenon made famous by dwarf novae in superoutburst. At high frequencies, the star shows a quasi-periodic signal with P approximately 1160 s, and possibly also a stable signal with P = 1310.2 s (or 1330.4 s, the one-day alias). The beat period between these signals could be the orbital period, or that of the vanished superhump.

Patterson, Joseph↗