Search NASA⌕ Search

SEARCH · Search NASA

Results for “DISTRIBUTED DATA PROCESSING”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 829 records · Page 46

Methods for using a biometric parameter in the identification of persons

Brain waves are used as a biometric parameter to provide for authentication and identification of personnel. The brain waves are sampled using EEG equipment and are processed using phase-space distribution functions to compare digital signature data from enrollment of authorized individuals to data taken from a test subject to determine if the data from the test subject matches the signature data to a degree to support positive identification.

60 APPLIED LIFE SCIENCES↗

Measuring Airflow With Digital Holographic Interferometry

Digital image-processing system assists in analysis of holographic interferometric images of flow about airfoil. Operating semiautomatically, identifies, counts, and labels interference fringes, then processes distances between fringes into distribution of pressure on surface of airfoil. Yields data on pressure faster than manual image-analyses techniques, and data compares favorably with those obtained by manual analysis and by probe measurements of pressure. Uses computer programs evaluating interferograms along straight or curved lines represented by polygon segments. User prompted for such inputs as reference points and fringe number. Digitizes holographic interferograms of flow and processes them into data of pressure or other properties of flow.

Torres, Francisco J.↗

PD2P: PanDA Dynamic Data Placement for ATLAS

The PanDA (Production and Distributed Analysis) system plays a key role in the ATLAS distributed computing infrastructure. PanDA is the ATLAS workload management system for processing all Monte-Carlo (MC) simulation and data reprocessing jobs in addition to user and group analysis jobs. The PanDA Dynamic Data Placement (PD2P) system has been developed to cope with difficulties of data placement for ATLAS. We will describe the design of the new system, its performance during the past year of data taking, dramatic improvements it has brought about in the efficient use of storage and processing resources, and plans for the future.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

An Improved Analysis of Forest Carbon Dynamics using Data Assimilation

There are two broad approaches to quantifying landscape C dynamics - by measuring changes in C stocks over time, or by measuring fluxes of C directly. However, these data may be patchy, and have gaps or biases. An alternative approach to generating C budgets has been to use process-based models, constructed to simulate the key processes involved in C exchange. However, the process of model building is arguably subjective, and parameters may be poorly defined. This paper demonstrates why data assimilation (DA) techniques - which combine stock and flux observations with a dynamic model - improve estimates of, and provide insights into, ecosystem carbon (C) exchanges. We use an ensemble Kalman filter (EnKF) to link a series of measurements with a simple box model of C transformations. Measurements were collected at a young ponderosa pine stand in central Oregon over a 3-year period, and include eddy flux and soil C02 efflux data, litterfall collections, stem surveys, root and soil cores, and leaf area index data. The simple C model is a mass balance model with nine unknown parameters, tracking changes in C storage among five pools; foliar, wood and fine root pools in vegetation, and also fresh litter and soil organic matter (SOM) plus coarse woody debris pools. We nested the EnKF within an optimization routine to generate estimates from the data of the unknown parameters and the five initial conditions for the pools. The efficacy of the DA process can be judged by comparing the probability distributions of estimates produced with the EnKF analysis vs. those produced with reduced data or model alone. Using the model alone, estimated net ecosystem exchange of C (NEE)= -251 f 197g Cm-2 over the 3 years, compared with an estimate of -419 f 29gCm-2 when all observations were assimilated into the model. The uncertainty on daily measurements of NEE via eddy fluxes was estimated at 0.5gCm-2 day-1, but the uncertainty on assimilated estimates averaged 0.47 g Cm-2 day-1, and only exceeded 0.5gC m-2 day-1 on days where neither eddy flux nor soil efflux data were available. In generating C budgets, the assimilation process reduced the uncertainties associated with using data or model alone and the forecasts of NEE were statistically unbiased estimates. The results of the analysis emphasize the importance of time series as constraints. Occasional, rare measurements of stocks have limited use in constraining the estimates of other components of the C cycle. Long time series are particularly crucial for improving the analysis of pools with long time constants, such as SOM, woody biomass, and woody debris. Long-running forest stem surveys, and tree ring data, offer a rich resource that could be assimilated to provide an important constraint on C cycling of slow pools. For extending estimates of NEE across regions, DA can play a further important role, by assimilating remote-sensing data into the analysis of C cycles. We show, via sensitivity analysis, how assimilating an estimate of photosynthesis - which might be provided indirectly by remotely sensed data - improves the analysis of NEE.

Williams, Mathew↗

Combining a land surface model with groundwater model calibration to assess the impacts of groundwater pumping in a mountainous desert basin

The quantification of recharge and trans-valley underflow is needed in arid regions to estimate the impacts of new water withdrawals on the water table. However, for mountainous desert areas, such estimates are highly challenging, due to data scarcity, heterogeneous soils, and long residence times. Conventional assessment employs isolated groundwater models configured with simplified uniform estimates of recharge. Here, we employed a data-constrained surface-subsurface process model to provide an ensemble of spatially distributed recharge and underflow estimates using perturbed parameters. Then, the Model-Independent Parameter Estimation and Uncertainty Quantification (PEST) package was used to calibrate the aquifer hydraulic conductivity field in MODFLOW for this ensemble and reject implausible recharge values. This novel dual-model approach, broadly applicable to mountainous arid regions, was designed to maximally exploit available data sources. It can assimilate groundwater head observations, reject unrealistic parameters, and narrow the range of estimated drawdowns due to pumping. We applied this approach to the Chuckwalla basin in California, USA to determine natural recharge. Simulated recharge concentrates along alluvial fans at the mountain fronts and ephemeral washes where run-off water infiltrates. If an evenly distributed recharge was employed as in conventional studies, it would result in regional biases in estimated drawdown and larger uncertainty bounds. Here, we also note that the speed of groundwater recovery does not guarantee sustainability: heavy pumping induces large hydraulic gradients that initially recover quickly when pumping is halted, but the system may not ultimately recover to pre-pumping levels.

54 ENVIRONMENTAL SCIENCES↗

Prediction of dislocation - grain boundary interactions in FCC aluminum bicrystals using a modified continuum criterion and machine learning methods

Mechanical properties of metals such as strength and toughness are strongly correlated to complex interactions between various defects in the crystalline structure. While elementary interactions between these defects have been investigated using recent micro- and nano-characterization techniques, understanding of the detailed interaction mechanisms has hardly been obtained. To understand defect-driven plasticity at various time and length scales, it is necessary to formulate a general guideline to predict both the interaction type (transmission or reflection) and the dislocation's subsequent slip system after the interaction. Many criteria based on the geometric alignment of the defects have been developed to predict this phenomenon, but these have yet to be found to be accurate when applied to general data sets of grain boundaries (GBs). With this motivation, we conduct a systematic study using molecular dynamics (MD) models of bicrystals to analyze defect interaction process between a prismatic dislocation loop and eleven different grain boundaries of the following character: three tilt, three twist, and five mixed. Based on the MD observations, two new prediction methods are developed: the first is a new data-driven parametric score function based on the classical geometric criteria, and the second is by applying Gaussian process machine learning methods to find the probability distribution of a hidden function. In conclusion, the proposed data-driven prediction methods could pave a new way to predict the unit interaction of dislocations with various GBs, which could show much higher accuracy compared to pre-existing geometric criteria.

36 MATERIALS SCIENCE↗

Cometary atmospheres: Modeling the spatial distribution of observed neutral radicals

Progress on modeling the spatial distributions of cometary radicals is described. The Monte Carlo particle-trajectory model was generalized to include the full time dependencies of initial comet expansion velocities, nucleus vaporization rates, photochemical lifetimes and photon emission rates which enter the problem through the comet's changing heliocentric distance and velocity. The effect of multiple collisions in the transition zone from collisional coupling to true free flow were also included. Currently available observations of the spatial distributions of the neutral radicals, as well as the latest available photochemical data were re-evaluated. Preliminary exploratory model results testing the effects of various processes on observable spatial distributions are also discussed.

Combi, M. R.↗

Satellite and correlative measurements of the stratospheric aerosol. I An optical model for data conversions

A description is presented of an empirically based model of stratospheric aerosol optical properties (size distributions and refractive indices) and their variations. The need for such a model arose in the data validation and archival programs for two satellite sensors, SAM II and SAGE. These programs require the ability to convert measurements of a given aerosol macroproperty (e.g., volume extinction coefficient, volume backscatter coefficient, particle number or mass per unit volume) to best estimates of other aerosol macroproperties, and to assess quantitatively the uncertainties in the conversion process. The described model provides the information on size distributions, refractive indices and their variations necessary for these tasks, and also defines a procedure for combining the model information with empirical data in a way that facilitates automatic data processing. Although the model was developed for use in the satellite validation and archival programs, it also has proven useful in other studies of stratospheric aerosol.

Russell, P. B.↗

Defect-driven anomalous transport in fast-ion conducting solid electrolytes

We report solid-state ionic conduction is a key enabler of electrochemical energy storage and conversion. The mechanistic connections between material processing, defect chemistry, transport dynamics, and practical performance are of considerable importance, but remain incomplete. Here, inspired by studies of fluids and biophysical systems, we re-examine anomalous diffusion in the iconic two-dimensional fast-ion conductors, the β- and β"-aluminas. Using large-scale simulations, we reproduce the frequency dependence of alternating-current ionic conductivity data. We show how the distribution of charge-compensating defects, modulated by processing, drives static and dynamic disorder, which lead to persistent sub-diffusive ion transport at macroscopic timescales. We deconvolute the effects of repulsions between mobile ions, the attraction between the mobile ions and charge-compensating defects, and geometric crowding on ionic conductivity. Our quantitative framework based on these model solid electrolytes connects their atomistic defect chemistry to macroscopic performance with minimal assumptions and enables mechanism-driven 'atoms-to-device' optimization of fast-ion conductors.

25 ENERGY STORAGE↗

Preliminary efforts toward development of data handling and analysis software for unsteady flow measurements: An application for aeroelastic transonic flow configurations

A few years ago the Structural Dynamics Division at LaRC started ambitious experimental research efforts known as the Benchmark Models Program. The primary objective of this program was to provide experimental data that may serve as a calibration source for computational fluid dynamics (CFD) efforts that deal with aeroelastic unsteady flow configurations. It also focuses on the understanding of complex flow phenomenon associated with unsteady flow developments. The overall plan for the program has been described by Bennett, including a presentation of initial test results of flutter of a rigid wing mounted on flexible supports. An example of a test model employed to measure the dynamic response along with corresponding pressure distributions is shown. This model incorporates eighty pressure transducers distributed along two spanwise stations. In addition, the models are equipped with four accelerometers and two strain gages. The data handling system for the Benchmark Model Program is under development. Several interactive computer routines designed for the user interface, dynamic memory allocation, unsteady flow measurements data extraction, and further data processing were developed. To present a few examples of measured data, the unsteady pressure distributions and the wing model dynamic response were plotted.

Finaish, Fathi↗

Exploring OpenSNAPI Use Cases and Evolving Requirements [Slides]

Emerging system architectures are rapidly transforming in order to meet shifting requirements. Motivated by expanding data volumes, energy efficiency concerns, and the omnipresent need to improve performance, architectures are increasingly adopting a data-centric approach. At the core of this concept is the goal of minimizing data motion and instead processing data in-situ to the greatest degree possible. Therefore, data-centric designs, in contrast to conventional CPU-centric models, typically distribute compute capabilities throughout the architecture. As part of this paradigm shift, a novel class of devices known as data processing units (DPUs), alongside CPUs and GPUs, are quickly forming a third pillar of data-centric systems. These devices, which include smart network adapters and switches, seek to offload computation on data at the network edge as well as in-flight within the network fabric. The Open Smart Network API (OpenSNAPI) project seeks to develop a unified API for DPU devices. In our previous talks, we introduced the OpenSNAPI project and detailed our investigations regarding the viability of offloading compute intensive kernels to BlueField DPUs. In contrast, in this talk we detail our efforts to offload application-level file I/O to the DPU. We also discuss plans and early efforts to explore in-network compute capabilities. Finally, we describe our observations with respect to the evolving design of OpenSNAPI.

97 MATHEMATICS AND COMPUTING↗

Using support vector machines for anomalous change detonation

We cast anomalous change detection as a binary classification problem, and use a support vector machine (SVM) to build a detector that does not depend on assumptions about the underlying data distribution. To speed up the computation, our SVM is implemented, in part, on a graphical processing unit. Results on real and simulated anomalous changes are used to compare performance to algorithms which effectively assume a Gaussian distribution. In this paper, we investigate the use of support vector machines (SVMs) with radial basis kernels for finding anomalous changes. Compared to typical applications of SVMs, we are operating in a regime of very low false alarm rate. This means that even for relatively large training sets, the data are quite meager in the regime of operational interest. This drives us to use larger training sets, which in turn places more of a computational burden on the SVM. We initially considered three different approaches to to address the need to work in the very low false alarm rate regime. The first is a standard SVM which is trained at one threshold (where more reliable estimates of false alarm rates are possible) and then re-thresholded for the low false alarm rate regime. The second uses the same thresholding approach, but employs a so-called least squares SVM; here a quadratic (instead of a hinge-based) loss function is employed, and for this model, there are good theoretical arguments in favor of adjusting the threshold in a straightforward manner. The third approach employs a weighted support vector machine, where the weights for the two types of errors (false alarm and missed detection) are automatically adjusted to achieve the desired false alarm rate. We have found in previous experiments (not shown here) that the first two types can in some cases work well, while in other cases they do not. This renders both approaches unreliable for automated change detection. By contrast, the third approach reliably produces good results, but at the cost of larger computational requirements caused by the need to estimate very small false alarm rates. To address these computational requirements, we employ a recently developed in-house solver for SVMs that is significantly faster than freely available standard solvers. But these computational issues are secondary to the larger question: do kernelized solutions provide better performance, in terms of detection rates and false alarm rates, than more traditional methods for change detection that effectively assume Gaussian data distributions? To this end, we will compare ROC curves obtained from the SVM with those from chronochrome, covariance equalization, and hyperbolic anomalous change detection.

97 MATHEMATICS AND COMPUTING↗

The interplay between regeneration and scavenging fluxes drives ocean iron cycling

Despite recent advances in observational data coverage, quantitative constraints on how different physical and biogeochemical processes shape dissolved iron distributions remain elusive, lowering confidence in future projections for iron-limited regions. Here we show that dissolved iron is cycled rapidly in Pacific mode and intermediate water and accumulates at a rate controlled by the strongly opposing fluxes of regeneration and scavenging. Combining new data sets within a watermass framework shows that the multidecadal dissolved iron accumulation is much lower than expected from a meta-analysis of iron regeneration fluxes. This mismatch can only be reconciled by invoking significant rates of iron removal to balance iron regeneration, which imply generation of authigenic particulate iron pools. Consequently, rapid internal cycling of iron, rather than its physical transport, is the main control on observed iron stocks within intermediate waters globally and upper ocean iron limitation will be strongly sensitive to subtle changes to the internal cycling balance.

54 ENVIRONMENTAL SCIENCES↗

Measuring and Modeling Shared Visual Attention

Multi-person teams are sometimes responsible for critical tasks, such as flying an airliner. Here we present a method using gaze tracking data to assess shared visual attention, a term we use to describe the situation where team members are attending to a common set of elements in the environment. Gaze data are quantized with respect to a set of N areas of interest (AOIs); these are then used to construct a time series of N dimensional vectors, with each vector component representing one of the AOIs, all set to 0 except for the component corresponding to the currently fixated AOI, which is set to 1. The resulting sequence of vectors can be averaged in time, with the result that each vector component represents the proportion of time that the corresponding AOI was fixated within the given time interval. We present two methods for comparing sequences of this sort, one based on computing the time-varying correlation of the averaged vectors, and another based on a chi-square test testing the hypothesis that the observed gaze proportions are drawn from identical probability distributions. We have evaluated the method using synthetic data sets, in which the behavior was modeled as a series of "activities," each of which was modeled as a first-order Markov process. By tabulating distributions for pairs of identical and disparate activities, we are able to perform a receiver operating characteristic (ROC) analysis, allowing us to choose appropriate criteria and estimate error rates. We have applied the methods to data from airline crews, collected in a high-fidelity flight simulator (Haslbeck, Gontar & Schubert, 2014). We conclude by considering the problem of automatic (blind) discovery of activities, using methods developed for text analysis.

attention↗

Fracture strength of GaAs solar cells as a function of manufacturing process steps

Fracture of single crystal GaAs substrate during the solar cell processing is an important factor in solar cell yield and cost. Fracture mechanics technique was utilized to evaluate cell cracking characteristics and changes in fracture strength of GaAs solar cells in a present state-of-the-art of manufacturing process for GaAs solar cells from wafer to complete cell of a typical production line. Considerable change in the fracture strength of GaAs solar cells as a function of cell processing was found. The strength data were described by Weibull statistical analysis and can be interpreted with the change of flaw distribution of each of the manufacturing process steps.

Chen, C. P.↗

A scalable approach to solving dense linear algebra problems on hybrid CPU-GPU systems

Aiming to fully exploit the computing power of all CPUs and all graphics processing units (GPUs) on hybrid CPU-GPU systems to solve dense linear algebra problems, in this paper we design a class of heterogeneous tile algorithms to maximize the degree of parallelism, to minimize the communication volume, and to accommodate the heterogeneity between CPUs and GPUs. The new heterogeneous tile algorithms are executed upon our decentralized dynamic scheduling runtime system, which schedules a task graph dynamically and transfers data between compute nodes automatically. The runtime system uses a new distributed task assignment protocol to solve data dependencies between tasks without any coordination between processing units. By overlapping computation and communication through dynamic scheduling, we are able to attain scalable performance for the double-precision Cholesky factorization and QR factorization. Finally, our approach demonstrates a performance comparable to Intel MKL on shared-memory multicore systems and better performance than both vendor (e.g., Intel MKL) and open source libraries (e.g., StarPU) in the following three environments: heterogeneous clusters with GPUs, conventional clusters without GPUs, and shared-memory systems with multiple GPUs.

97 MATHEMATICS AND COMPUTING↗

MODIS Snow and Ice Products from the NSIDC DAAC

The National Snow and Ice Data Center (NSIDC) Distributed Active Archive Center (DAAC) provides data and information on snow and ice processes, especially pertaining to interactions among snow, ice, atmosphere and ocean, in support of research on global change detection and model validation, and provides general data and information services to cryospheric and polar processes research community. The NSIDC DAAC is an integral part of the multi-agency-funded support for snow and ice data management services at NSIDC. The Moderate Resolution Imaging Spectroradiometer (MODIS) will be flown on the first Earth Observation System (EOS) platform (AM-1) in 1998. The MODIS Instrument Science Team is developing geophysical products from data collected by the MODIS instrument, including snow and ice products which will be archived and distributed by NSIDC DAAC. The MODIS snow and ice mapping algorithms will generate global snow, lake ice, and sea ice cover products on a daily basis. These products will augment the existing record of satellite-derived snow cover and sea ice products that began about 30 years ago. The characteristics of these products, their utility, and comparisons to other data set are discussed. Current developments and issues are summarized.

Scharfen, Greg R.↗

Increased signal-to-noise ratios within experimental field trials by regressing spatially distributed soil properties as principal components

Environmental variability poses a major challenge to any field study. Researchers attempt to mitigate this challenge through replication. Thus, the ability to detect experimental signals is determined by the degree of replication and the amount of environmental variation, noise, within the experimental system. A major source of noise in field studies comes from the natural heterogeneity of soil properties which create microtreatments throughout the field. In addition, the variation within different soil properties is often nonrandomly distributed across a field. We explore this challenge through a sorghum field trial dataset with accompanying plant, microbiome, and soil property data. Diverse sorghum genotypes and two watering regimes were applied in a split-plot design. We describe a process of identifying, estimating, and controlling for the effects of spatially distributed soil properties on plant traits and microbial communities using minimal degrees of freedom. Importantly, this process provides a method with which sources of environmental variation in field data can be identified and adjusted, improving our ability to resolve effects of interest and to quantify subtle phenotypes.

60 APPLIED LIFE SCIENCES↗