Search NASA⌕ Search

SEARCH · Search NASA

Results for “sparse data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41
All sourcesNASA NTRSDOE OSTI
NASA NTRS1998

Parallel Implicit Algorithms for CFD

The main goal of this project was efficient distributed parallel and workstation cluster implementations of Newton-Krylov-Schwarz (NKS) solvers for implicit Computational Fluid Dynamics (CFD.) "Newton" refers to a quadratically convergent nonlinear iteration using gradient information based on the true residual, "Krylov" to an inner linear iteration that accesses the Jacobian matrix only through highly parallelizable sparse matrix-vector products, and "Schwarz" to a domain decomposition form of preconditioning the inner Krylov iterations with primarily neighbor-only exchange of data between the processors. Prior experience has established that Newton-Krylov methods are competitive solvers in the CFD context and that Krylov-Schwarz methods port well to distributed memory computers. The combination of the techniques into Newton-Krylov-Schwarz was implemented on 2D and 3D unstructured Euler codes on the parallel testbeds that used to be at LaRC and on several other parallel computers operated by other agencies or made available by the vendors. Early implementations were made directly in Massively Parallel Integration (MPI) with parallel solvers we adapted from legacy NASA codes and enhanced for full NKS functionality. Later implementations were made in the framework of the PETSC library from Argonne National Laboratory, which now includes pseudo-transient continuation Newton-Krylov-Schwarz solver capability (as a result of demands we made upon PETSC during our early porting experiences). A secondary project pursued with funding from this contract was parallel implicit solvers in acoustics, specifically in the Helmholtz formulation. A 2D acoustic inverse problem has been solved in parallel within the PETSC framework.

Keyes, David E.↗
NASA NTRS2005

Discovery of a Transition to Global Spin-up in EXO 2030+375

EXO 2030+375, a 42 s transient X-ray pulsar with a Be star companion, has been observed to undergo an outburst at nearly every periastron passage for the last 13.5 years. From 1994 through 2002, the global trend in the pulsar spin frequency was spin-down. Using Rossi X-Ray Timing Explorer (RXTE) data from 2003 September, we have observed a transition to global spin-up in EXO 2030+375. Although the spin-frequency observations are sparse, the relative spin-up between 2002 June and 2003 September observations, along with an overall brightening of the outbursts since mid-2002 observed with the RXTE All-Sky Monitor, accompanied by an increase in density of the Be disk, indicated by infrared magnitudes, suggest that the pattern observed with BATSE of a roughly constant spin frequency, followed by spin-up, followed by spin-down is repeating. If so, this pattern has approximately an 11 yr period, similar to the 15 +/- 3 yr period derived by Wilson et al. for the precession period of a one-armed oscillation in the Be disk. If this pattern is indeed repeating, we predict a transition from spin-up to spin-down in 2005.

Wilson, Colleen A.↗
NASA NTRS2003

The Fizeau Interferometer Testbed

The Fizeau Interferometer Testbed (FIT) is a collaborative effort between NASA's Goddard Space Flight Center, the Naval Research Laboratory, Sigma Space Corporation, and the University of Maryland. The testbed will be used to explore the principles of and the requirements for the full, as well as the pathfinder, Stellar Imager mission concept. It has a long term goal of demonstrating closed-loop control of a sparse array of numerous articulated mirrors to keep optical beams in phase and optimize interferometric synthesis imaging. In this paper we present the optical and data acquisition system design of the testbed, and discuss the wavefront sensing and control algorithms to be used. Currently we have completed the initial design and hardware procurement for the FIT. The assembly and testing of the Testbed will be underway at Goddard's Instrument Development Lab in the coming months.

OPTICS DESIGN↗
NASA NTRS2018

Global Assimilation of Loon Stratospheric Balloon Observations

Project Loon has an overall goal of providing worldwide internet coverage using a network of long-durationsuper-pressure balloons. Since 2013, Loon has launched over 1600 balloons from multiple tropical and middlelatitude locations. These GPS tracked balloon trajectories provide lower stratospheric wind information overthe oceans and remote land areas where traditional radiosonde soundings are sparse, thus providing uniquecoverage of lower stratospheric winds. To fully investigate these Loon winds we: 1) compare the Loon windsto winds produced by a global data assimilation system (DAS: NASA GEOS) and 2) assimilate the Loon windsinto the same comprehensive DAS. Results show that in middle latitudes the Loon winds and DAS winds agreewell, and the Loon wind assimilation has only a minor impact on the forecasts. However, in the Tropics, thereis often a substantial difference between the assimilated winds and the observed Loon winds, of 8 m/s or morein magnitude. In these cases, assimilating the Loon winds significantly improves the meteorological analysesand subsequently the forecasts of the Loon winds. By highlighting cases where the Loon and DAS winds differ,these results can lead to improved understanding of stratospheric winds, especially in the tropics, as well asaiding analyses of the representation of dynamical forcing mechanisms in the GEOS model.

Coy, Lawrence↗
NASA NTRS2019

Predictive Modeling for Differential Diagnosis and Mortality Risk Assessment

The prevalence of electronic health record (EHR) systems has brought prodigious biomedical informatics opportunity. Automated machine learning methods can effectively utilize such data and have become common tools for healthcare predictive modeling. Researches in medical informatics have explored the potential of deep learning and classical models in emergent care scenarios. In particular, predicting differential diagnoses for admissions have proven useful in decreasing unnecessary lab tests and improving inpatient triage decision-making. Moreover, identification of high-risk patients for in-hospital mortality is vitally important to maximize allocation of medical resources.The Medical Information Mart for Intensive Care (MIMIC-III) database, containing de-identified critical care inpatient was used in our study. This data set captures hospital patient laboratory measurements, pharmacologic prescriptions, diagnostic data and procedure event recordings. When considering adult patients and discounting admissions with ICU length of stay less than 24 hours, there were 37,787 unique admissions and 30,414 total patients. We examined the top 25 most prevalent ICD-9 group-level disease specificities in MIMIC-III using a multi-label classification model. In-hospital mortality was modeled as binary classification with 4,155 (13%) adult patients that expired, of which 3,138 (75.5%) were in the ICU setting. The metrics AUC, F1 score, sensitivity and specificity values calculated for each disease label measured prediction performance.The usage of ICD-9 group codes reduced feature dimension from 14,567 to 942 and greatly improved distribution of patient diagnostic categories. Disease temporal patterns were captured by considering the most frequently sampled 6 vital signs and 13 laboratory values. Missing data were imputed at each time-stamp. Time-series raw hourly average values were converted into 5 summary features (mean, standard deviation, number of observations, min & max values). Patient demographic variables such as age, gender, marital status and ethnicity were also factored into the modeling. Choi et al showed that contextual embedding of medical data, diagnostic and procedural codes alone can predict future diagnoses with sensitivity as high as 0.79. We utilized an embedding technique called word2vec which allowed sparse representations of medical history to be transformed into dense word vectors. The mappings captured contextual information by treating each admission as a sentence and learning the most likely neighboring words in a sliding window fashion. Binary and multi-label classification was achieved via collapse models, which do not consider temporal information, as well as recurrent neural networks with regularization, Softmax output layer activation together with categorical cross-entropy as the loss function.

US Army collaboration↗
NASA NTRS2021

Large-scale features of Last Interglacial climate: results from evaluating the lig127k simulations for the Coupled Model Intercomparison Project (CMIP6)–Paleoclimate Modeling Intercomparison Project (PMIP4)

The modeling of paleoclimate, using physically based tools, is increasingly seen as a strong out-of-sample test of the models that are used for the projection of future climate changes. New to the Coupled Model Intercomparison Project (CMIP6) is the Tier 1 Last Interglacial experiment for 127 000 years ago (lig127k), designed to address the climate responses to stronger orbital forcing than the midHolocene experiment, using the same state-of-the-art models as for the future and following a common experimental protocol. Here we present a first analysis of a multi-model ensemble of 17 climate models, all of which have completed the CMIP6 DECK (Diagnostic, Evaluation and Characterization of Klima) experiments. The equilibrium climate sensitivity (ECS) of these models varies from 1.8 to 5.6°C. The seasonal character of the insolation anomalies results in strong summer warming over the Northern Hemisphere continents in the lig127k ensemble as compared to the CMIP6 piControl and much-reduced minimum sea ice in the Arctic. The multi-model results indicate enhanced summer monsoonal precipitation in the Northern Hemisphere and reductions in the Southern Hemisphere. These responses are greater in the lig127k than the CMIP6 midHolocene simulations as expected from the larger insolation anomalies at 127 than 6 ka. New synthesis for surface temperature and precipitation, targeted for 127 ka, have been developed for comparison to the multi-model ensemble. The lig127k model ensemble and data reconstructions are in good agreement for summer temperature anomalies over Canada, Scandinavia, and the North Atlantic and for precipitation over the Northern Hemisphere continents. The model–data comparisons and mismatches point to further study of the sensitivity of the simulations to uncertainties in the boundary conditions and of the uncertainties and sparse coverage in current proxy reconstructions. The CMIP6–Paleoclimate Modeling Intercomparison Project (PMIP4) lig127k simulations, in combination with the proxy record, improve our confidence in future projections of monsoons, surface temperature, and Arctic sea ice, thus providing a key target for model evaluation and optimization.

Last Interglacial climate↗
DOE OSTI2026

A Data-Driven Method for Modeling Creep-Fatigue Stress- Strain Behavior Using Neural ODEs

In this paper, we introduce a data-driven machine learning approach for modeling one-dimensional stress–strain behavior under cyclic loading, utilizing experimental data from the nickel-based Alloy 617. The study employs uniaxial creep–fatigue test data acquired under various loading histories and compares two distinct neural network-based ODE models. The first model, known as the black-box model, comprehensively describes the strain–stress relationship using a Neural ODE equation. To interpret this black-box model, we apply the Sparse Identification of Nonlinear Dynamical Systems (SINDy) technique, transforming the black-box model into an equation-based model using symbolic regression. The second model, the Neural flow rule model, incorporates Hooke’s Law for the linear elastic component, with the nonlinear part characterized by a Neural ODE. Both models are trained with experimental data to accurately reflect the observed stress–strain behavior. We conduct a detailed comparison with the standard Chaboche model, which includes three back stresses. Our results demonstrate that the neural network-based ODE models precisely capture the experimental creep–fatigue mechanical behavior, exceeding the standard Chaboche model’s accuracy. Furthermore, an interpretable model derived from the black-box neural ODE model through symbolic regression achieves accuracy comparable to the Chaboche model, enhancing its interpretability. The results highlight the potential of neural network-based ODE models to depict complex creep–fatigue behavior, eliminating the necessity for experts to define a specific, material-focused model form.

creep-fatigue↗
DOE OSTI2025

Machine learning-assisted identification of potential sources of bias in measurements of prompt-fission neutron spectra

Unrecognized sources of uncertainty (USU) can bias the reported mean and/or covariance of experimental nuclear data. These biases, in turn, can propagate through evaluated nuclear data to application simulations or may poorly inform nuclear theory that is fitted to the experimental data. Such unknown sources of bias must be tied to the inherent physical constituents of the measurements such as the characteristics of a detector response or a background reduction technique. Here, in this article, a sparse Bayesian learning model is used to support experts in their efforts to identify and characterize USU in experimental prompt fission neutron spectra (PFNS) for spontaneous fissioning of 252 Cf by linking observed biases to features of the measurement system. Three different bias components were found. The first acts as a verification case for the algorithm as it identifies a bias coming from a well-known source related to the use of 6 Li in the neutron detection system. The second two cases demonstrate how this method can benefit the evaluation of experimental nuclear data by identifying, quantifying, and relating unknown biases to potential causes.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS1994

Comparison of the seasonal and interannual variability of phytoplankton pigment concentrations in the Peru and California Current systems

Monthly composite images from the global coastal zone color scanner (CZCS) data set are used to provide an initial illustration and comparison of seasonal and interannual variability of phytoplankton pigment concentration along the western coasts of South and North America in the Peru Current system (PCS) and California Current system (CCS). The analysis utilizes the entire time series of available data (November 1978 to June 1986) to form a mean annual cycle and an index of interannual variability for a series of both latitudinal and cross-shelf regions within each current system. Within 100 km of the coast, the strongest seasonal cycles in the CCS are in two regions, one between 34 deg and 45 deg N and the second between 24 deg and 29 deg N, each with maximum concentrations (greater than 3.0 mg m(exp-3)) in May-June. Weaker seasonal variability is present north of 45 deg N and in the Southern California Bight region (32 deg N). Within the PCS, in the same 100-km-wide coastal region, highest (greater than 45 deg S) and lowest (less than 20 deg S) latitude regions have a similar seasonal cycle with maximum concentrations (greater than 1.5 mg m(exp -3)) during the austral spring, summer, and fall, matching that evident throughout the CCS. Between these regions, off northern and central Chile, the seasonal maximum occurs during July-August (austral winter), contrary to the influence of upwelling favorable winds. Within the CCS, the dominant feature of interannual variability in the 8-year time series is a strong negative concentration anomaly in 1983, an El Nino year. The relative value of this negative anomaly is strongest off central California and is followed by an even stronger negative anomaly is strongest off central California and is followed by an even stronger negative anomaly in 1984 off Baja, California. In the PCS, strong negative anomalies during the 1982-1983 El Nino period are evident only off the Peruvian coast and are evident there only in the regions 100 km or more from the coast. Although negative anomalies associated with the El Nino were not present at higher latitudes (more than approximately 20 deg S) in the PCS, the extremely sparse sampling weakens our confidence in the results of the interannual analysis in this region. An upper estimate of the systematic winter bias remaining in the global CZCS data after reprocessing with the multiple scattering algorithm is given in the appendix.

Thomas, A. C.↗
NASA NTRS2011

Olivine and Pyroxene Compositions in Fine-Grained Chondritic Materials

Our analyses of the Wild-2 samples returned by the Stardust Mission have illuminated critical gaps in our understanding of related astromaterials. There is a very large database of olivine and low-calcium pyroxene compositions for coarse-grained components of chondrites, but a sparse database for anhydrous silicate matrix phases. In an accompanying figure, we present comparisons of Wild-2 olivine with the available chondrite matrix olivine major element data. We thus have begun a long-term project measuring minor as well as major element compositions for chondrite matrix and chondritic IDPs, and Wild 2 grains. Finally, we wish to re-investigate the changes to fine-grained olivine and low-Ca pyroxene composition with progressive thermal metamorphism. We have examined the LL3-4 chondrites which because of the Hayabusa Mission have become very interesting.

Zolensky, Michael E.↗
NASA NTRS2023

Assessment of the Impact of Discontinuity in Satellite Instruments and Retrievals on Global PM2.5

Exposure to fine particulate matter (PM2.5) is the leading environmental risk factor for mortality globally. Satellite-derived estimates of surface PM2.5 developed from a combination of satellites, simulations, and ground monitor data are relied upon for health impact studies. The ability to develop satellite-derived PM2.5 estimates requires the continued availability of aerosol optical depth (AOD) sources. This work examines the impact of the addition or loss of satellite AOD data sources on global PM2.5 estimation and the impact of continuing the longterm record with AOD from the Visible Infrared Imaging Radiometer Suite (VIIRS) on the Suomi-National Polar orbiting Partnership (S-NPP) satellite after the loss of the MODIS (MODerate resolution Imaging Spectroradiometer) and MISR (Multi-angle Imaging Spectroradiometer) instruments on board the Terra and Aqua satellites. We find that the addition of VIIRS S-NPP AOD products to geophysical PM2.5 estimates from satellites and simulations causes regional differences that correspond to differences in the VIIRS and MODIS Deep Blue AOD algorithms and sampling. Changes in long-term trends and timeseries due to the addition or loss of AOD data sources are generally within their uncertainties. Statistical fusion with ground monitor data partially corrects for changes due to sampling differences when introducing the VIIRS AOD products, but uncertainty remains over desert regions where ground monitor coverage is sparse. This work provides promise for the sustained development of global satellite-derived PM2.5 estimates, despite discontinuities in instruments and retrieval methods.

Remote sensing↗
NASA NTRS2013

Coarse-Grain Bandwidth Estimation Scheme for Large-Scale Network

A large-scale network that supports a large number of users can have an aggregate data rate of hundreds of Mbps at any time. High-fidelity simulation of a large-scale network might be too complicated and memory-intensive for typical commercial-off-the-shelf (COTS) tools. Unlike a large commercial wide-area-network (WAN) that shares diverse network resources among diverse users and has a complex topology that requires routing mechanism and flow control, the ground communication links of a space network operate under the assumption of a guaranteed dedicated bandwidth allocation between specific sparse endpoints in a star-like topology. This work solved the network design problem of estimating the bandwidths of a ground network architecture option that offer different service classes to meet the latency requirements of different user data types. In this work, a top-down analysis and simulation approach was created to size the bandwidths of a store-and-forward network for a given network topology, a mission traffic scenario, and a set of data types with different latency requirements. These techniques were used to estimate the WAN bandwidths of the ground links for different architecture options of the proposed Integrated Space Communication and Navigation (SCaN) Network. A new analytical approach, called the "leveling scheme," was developed to model the store-and-forward mechanism of the network data flow. The term "leveling" refers to the spreading of data across a longer time horizon without violating the corresponding latency requirement of the data type. Two versions of the leveling scheme were developed: 1. A straightforward version that simply spreads the data of each data type across the time horizon and doesn't take into account the interactions among data types within a pass, or between data types across overlapping passes at a network node, and is inherently sub-optimal. 2. Two-state Markov leveling scheme that takes into account the second order behavior of the store-and-forward mechanism, and the interactions among data types within a pass. The novelty of this approach lies in the modeling of the store-and-forward mechanism of each network node. The term store-and-forward refers to the data traffic regulation technique in which data is sent to an intermediate network node where they are temporarily stored and sent at a later time to the destination node or to another intermediate node. Store-and-forward can be applied to both space-based networks that have intermittent connectivity, and ground-based networks with deterministic connectivity. For groundbased networks, the store-and-forward mechanism is used to regulate the network data flow and link resource utilization such that the user data types can be delivered to their destination nodes without violating their respective latency requirements.

Cheung, Kar-Ming↗
DOE OSTI2026

Data-Driven Modeling and Correction of Vehicle Dynamics

We develop a data-driven framework for learning and correcting nonautonomous vehicle dynamics. Physics-based vehicle models are often simplified for tractability and therefore exhibit inherent model-form uncertainty, motivating the need for data-driven correction. Moreover, nonautonomous dynamics are governed by time-dependent control inputs, which pose challenges in learning predictive models directly from temporal snapshot data. To address these, we reformulate the vehicle dynamics via a local parameterization of the time-dependent inputs, yielding a modified system composed ofa sequence of local parametric dynamical systems. Here, we approximate these parametric systems using two complementary approaches. First, we employ the dimension reduction and interpolation in parameter space (DRIPS) methodology to construct efficient linear surrogate models, equipped with lifted observable spaces and manifold-based operator interpolation. This enables data-efficient learning of vehicle models whose dynamics admit accurate linear representations in the lifted spaces. Second, for more strongly nonlinear systems, we employ flow map learning (FML), a deep neural network (DNN) approach that approximates the parametric evolution map without requiring special treatment of nonlinearities. We further extend FML with a transfer-learning-based model correction procedure, enabling the correction of misspecified prior models using only a sparse set of high-fidelity or experimental measurements, without assuming a prescribed form for the correction term. Through a suite of numerical experiments on unicycle, simplified bicycle, and slip-based bicycle models, we demonstrate that DRIPS offers robust and highly data-efficient learning of nonautonomous vehicle dynamics, while FML provides expressive nonlinear modeling and effective correction of model-form errors under severe data scarcity.

data-driven modeling↗
NASA NTRSDate not supplied

Compressive Sensing Based Data Acquisition Architecture for Transient Stellar Events in Crowded Star Fields

Compressive sensing is a mathematical technique for simultaneous data acquisition and compression. In this work, we show a CS based architecture for acquiring and reconstructing transient stellar events. This architecture recon-structs a differenced image itself, eliminating the need for any sparse domain transforms, otherwise required for traditional CS reconstruction. The resulting reconstructed differenced image is of critical importance as the information required for generating a time-series photometric light curve is obtained only from a differenced image. Hence, reconstructing a crowded star spatial image, followed by differencing is wasteful. This architecture eliminates the need to 1.) transform an image to a sparse domain, 2.) Reconstruct a dense field, and then apply differencing on the image to obtain the image of critical value. We study the case of microlensing to depict a star source experiencing magnification in time. Our results show that this architecture is able to reconstruct star source magnitudes with magnification factors greater than 1 for clean images with error less than 2% using only 10% of the Nyquist rate samples.

Compressive Sensing, Data acquisition, Image diffe↗
NASA NTRS1985

Parallel, iterative solution of sparse linear systems - Models and architectures

Solving large, sparse, linear systems of equations is a fundamental problem in large scale scientific and engineering computation. A model of a general class of asynchronous, iterative solution methods for linear systems is developed. In the model, the system is solved by creating several cooperating tasks that each compute a portion of the solution vector. A data transfer model predicting both the probability that data must be transferred between two tasks and the amount of data to be transferred is presented. This model is used to derive an execution time model for predicting parallel execution time and an optimal number of tasks given the dimension and sparsity of the coefficient matrix and the costs of computation, synchronization, and communication. The suitability of different parallel architectures for solving randomly sparse linear systems is discussed. Based on the complexity of task scheduling, one parallel architecture, based on a broadcast bus, is presented and analyzed.

Reed, D. A.↗
DOE OSTI2025

Survey-wide asteroid discovery with a high-performance computing enabled non-linear digital tracking framework

Modern astronomical surveys detect asteroids by linking together their appearances across multiple images taken over time. This approach faces limitations in detecting faint asteroids and handling the computational complexity of trajectory linking. Here, we present a novel method that adapts “digital tracking” – traditionally used for short-term linear asteroid motion across images – to work with large-scale synoptic surveys such as the Vera Rubin Observatory Legacy Survey of Space and Time (Rubin/LSST). Our approach combines hundreds of sparse observations of individual asteroids across their non-linear orbital paths to enhance detection sensitivity by several magnitudes. To address the computational challenges of processing massive data sets and dense orbital phase spaces, we developed a specialized high-performance computing architecture. We demonstrate the effectiveness of our method through experiments that take advantage of the extensive computational resources at Lawrence Livermore National Laboratory. This work enables the detection of significantly fainter asteroids in existing and future survey data, potentially increasing the observable asteroid population by orders of magnitude across different orbital families, from near-Earth objects (NEOs) to Kuiper belt objects (KBOs).

Asteroid discovery↗
DOE OSTI2024

AmeriFlux FLUXNET-1F CA-HPC Havikpak Creek

This is the AmeriFlux Management Project (AMP) created FLUXNET-1F version of the carbon flux data for the site CA-HPC Havikpak Creek. This is the FLUXNET version of the carbon flux data for the site CA-HPC Havikpak Creek produced by applying the standard ONEFlux (1F) software. Site Description - Southern Arctic boreal woodland (Picea mariana) site with sparse needleleaf vegetation > 2m, continuous permafrost

Sonnentag, Oliver↗
NASA NTRS1990

Two-dimensional shape recognition using sparse distributed memory

Researchers propose a method for recognizing two-dimensional shapes (hand-drawn characters, for example) with an associative memory. The method consists of two stages: first, the image is preprocessed to extract tangents to the contour of the shape; second, the set of tangents is converted to a long bit string for recognition with sparse distributed memory (SDM). SDM provides a simple, massively parallel architecture for an associative memory. Long bit vectors (256 to 1000 bits, for example) serve as both data and addresses to the memory, and patterns are grouped or classified according to similarity in Hamming distance. At the moment, tangents are extracted in a simple manner by progressively blurring the image and then using a Canny-type edge detector (Canny, 1986) to find edges at each stage of blurring. This results in a grid of tangents. While the technique used for obtaining the tangents is at present rather ad hoc, researchers plan to adopt an existing framework for extracting edge orientation information over a variety of resolutions, such as suggested by Watson (1987, 1983), Marr and Hildreth (1980), or Canny (1986).

Kanerva, Pentti↗