Search NASA⌕ Search

SEARCH · Search NASA

Results for “DISTRIBUTED DATA PROCESSING”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49

Production Operations Management System (POMS) for Fermilab Experiments

The Production Operations Management System (POMS) software allows production teams and analysis groups across multiple Fermilab experiments to launch, modify and monitor large scale campaigns of related Monte Carlo or data processing jobs, and currently manages the majority of production computing of experiments at Fermilab.POMS provides a web service interface that enables automated job submission on distributed resources according to customers’ requests, as well as subsequent monitoring of those submissions as well as recovery of failed submissions, debugging and record keeping.POMS interfaces with existing HEP data access, processing, movement and monitoring tools at Fermilab, including Jobsub (for job submission), SAM (for data management), and Landscape (for monitoring), and in combination with them handles the creation of intermediate datasets of files for multistage campaigns.POMS visualizes these campaigns with an interactive GUI interface. An important feature of POMS is a one-to-one connection between the GUI campaign visualizer and a text based representation of the complete campaign configuration. An extensible library of template campaign configurations is available. The templates are user modifiable and map cleanly to and from the GUI description of the campaign.This paper will discuss the current usage, history, and some technical details of POMS, as well as planned future extensions, particularly interfacing with Rucio as well as SAM for file movement.

Mengel, Marc↗

Real-Time Analysis and Signal Optimization for Charge Detection Mass Spectrometry

Charge detection mass spectrometry (CDMS) is an important tool for measuring mass distributions for high mass samples and heterogeneous mixtures. In CDMS, single ions are trapped and their m/z and charge are measured simultaneously. As a single particle technique, the average signal must be optimized to maximize the number of single ion trapping events. If the average signal is too small, most of the trapping events will be empty, and if the average signal is too large, most of the trapping events will contain multiple ions. In recent embodiments, the time domain signal from the trapped ion is analyzed by fast Fourier transforms. The analysis time is much longer that the data collection time which precludes real-time optimization of the experimental conditions. In this paper, we describe the implementation of CDMS with real-time analysis. Processing the data in real time allows the average signal intensities to be dynamically optimized to maximize the number of single ion trapping events. Real-time analysis also allows the experimental settings to be optimized in a timely manner to target specific mass regimes to maximize the useful information content of the measurements. .

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Use of Maps, GTE and UARS-MLS Data in Understanding Tropospheric Processes Critical to Model Development

Two of the major problems in using meteorological models to explain observed tropospheric trace constituent distributions and thereby to understand the global budgets of the tracers are to properly define the vertical layered structure in the free atmosphere, and to understand the contribution of advection processes in generating horizontal inhomogeneities at all scales. We proposed to tackle these problems through the examination of an extensive collection of trace constituent data from research and commercial aircraft in conjunction with meteorological data from the European Center for Medium-Range Weather Forecasts. The physical mechanisms responsible for these advection and layering processes were explored and their implications for theories and models assessed. In addition, we calculated examples of how thin layers (not currently resolved by models) affect the radiative heating/cooling rates. We developed an improved algorithm for trace constituent layer detection, and used it to analyze over 100,000 km of ozone and humidity vertical profiles collected by instruments piggybacked on commercial aircraft. We have also performed radiative heating/cooling calculations on some observed layer structures, and have demonstrated that the sharp edges on humidity layers can have strong local effects of self-stabilization (dry layers) or destabilization (wet layers), and have suggested that clear-air turbulence might result from the latter case through convective instability. We also systematically analyzed the mesoscale variabilities, not only of the trace constituents, but also of the aircraft-measured dynamical variables.

Newell, Reginald E.↗

Use of Maps, GTE and UARS-MLS Data in Understanding Tropospheric Processes Critical to Model Development

Two of the major problems in using meteorological models to explain observed tropospheric trace constituent distributions and thereby to understand the global budgets of the tracers are to properly define the vertical layered structure in the free atmosphere, and to understand the contribution of advection processes in generating horizontal inhomogeneities at all scales. We proposed to tackle these problems through the examination of an extensive collection of trace constituent data from research and commercial aircraft in conjunction with meteorological data from the European Center for Medium-Range Weather Forecasts. The physical mechanisms responsible for these advection and layering processes were explored and their implications for theories and models assessed. In addition, we calculated examples of how thin layers (not currently resolved by models) affect the radiative heating/cooling rates. We developed an improved algorithm for trace constituent layer detection, and used it to analyze over 100,000 km of ozone and humidity vertical profiles collected by instruments piggybacked on commercial aircraft. The same method was also used to examine ozone, humidity, carbon monoxide, and methane data from the NASA Pacific Exploratory Missions. The major conclusions from these studies were that tropospheric trace constituent layers are ubiquitous, and that their characteristics are remarkably universal. These results support the notion that ozone layers coming in from the stratosphere play a large role in creating tropospheric layers, whether by themselves or by capping buoyant pollution plumes. This, in turn, has important implications for the transport (especially in the vertical) of trace gases and how it is represented in models.

Newell, Reginald E.↗

The spatial structure of terrain - A process signal in satellite digital images

Pattern recognition procedures applied to Landsat imagery carry an implicit assumption that the digital data are independently distributed. That assumption is incorrect over virtually any terrain. Deviations from independence occur because slopes follow a systematic pattern of variation arising from the slope-forming processes. That pattern can be identified using the stochastic process methodology of Box and Jenkins.Angles of adjacent slopes are autocorrelated and the bidirectional reflectance function transfers these systematic slope changes to the sensor. Imagery becomes autocorrelated through this transfer. Autocorrelation in the imagery can be removed through direct calculation from a digital elevation model or by use of stochastic process methodology. The latter has the advantage that the residuals are white noise; and it is applicable in any area, even where a D.E.M. is unavailable. The stochastic process signal can be used to study terrain processes.

Craig, R. G.↗

A Knowledge Graph Approach to Analyze Systems and Assets Health

Nuclear power plants collect large amounts of equipment reliability data elements that contain information on the statuses of component, assets, and systems. All these data elements precisely record asset and system performance and health throughout the lifecycle of those assets and systems. However, several challenges have proved to be roadblocks to this process. While some of these challenges are technical in nature (i.e., data are often distributed over several physical servers or databases), others are conceptual in nature (i.e., data elements come in different formats, numeric or textual), and measured values have different scales (e.g., vibration spectra and oil temperature). This paper directly focuses on the integration of numeric and textual data elements in order to assist plant system engineers in analyzing equipment reliability data. This task begins with preprocessing the data by extracting knowledge from textual data via natural language processing methods and quantifying system, asset, and component health based on numeric data. We then employed model-based system engineering (MBSE) models of systems and assets to identify their architecture and functional (i.e., cause and effect) relations. Data elements were then associated with a single MBSE graph element, based on their nature. This bonding of MBSE models and data elements constitutes a first-of-its-kind knowledge graph of a nuclear power plants system, with data elements being organized in a structured manner that enables system engineers to identify cause-effect trends in data elements and carry out appropriate actions in response.

97 - MATHEMATICS AND COMPUTING↗

Photon strength functions and nuclear level densities: invaluable input for nucleosynthesis

The pivotal role of nuclear physics in nucleosynthesis processes is being investigated, in particular the intricate influence of photon strength functions (PSFs) and nuclear level densities (NLDs) on shaping the outcomes of the i-, r- and p-processes. Exploring diverse NLD and PSF model combinations uncovers large uncertainties for (p, γ ), (n, γ ) and ( α , γ ) rates across many regions of the nuclear chart. These lead to potentially significant abundance variations of the nucleosynthesis processes and highlight the importance of accurate experimental nuclear data. Theoretical insights and advanced experimental techniques lay the ground work for profound understanding that can be gained of nucleosynthesis mechanisms and the origin of the elements. Recent results further underscore the effect of PSF and NLD data and its contribution to understanding abundance distributions and refining knowledge of the intricate nucleosynthesis processes. This article is part of the theme issue ‘The liminal position of Nuclear Physics: from hadrons to neutron stars’.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

High-Energy X-ray Tomographic Analysis of Precursor Metal Powders (Ti-6Al-4V) Used for Additive Manufacturing

We utilized high-energy x-ray tomography to characterize Ti-6Al-4V metal powders (both as-received and recycled) used in powder-bed additive manufacturing process. The image processing workflow was developed to process and analyze large amount of data objectively by computer program. The distribution of size and shape of the metal particles as well as defect (mainly porosity) inside the particles was analyzed with the statistical representation and resolution in micrometer. The result revealed that circular-shaped porosity with various sizes could be embedded in the powder particles. These porosities could potentially be transferred to the 3D printed part and critically affect the mechanical performance of the component. The present study shows the effectiveness of characterizing metal powders using x-ray imaging techniques where sufficient number of particles can be sampled within tens of minutes with a minimum sample preparation and high accuracy. Clear structural differences in the as-received and recycled powders were delineated that helps in determining the feasibility of using the recycled powders.

36 MATERIALS SCIENCE↗

Oncentra brachytherapy planning system

In modern cancer management, treatment planning has progressed as a contemporary tool with all the advances in computing power in recent years. One of the advanced planning tools uses 3-dimensional (3D) data sets for accurate dose distributions in patient prescription. Among these planning processes, brachytherapy has been a very important part of a successful cancer management program, offering clinical benefits with specific or combined treatments with external beam therapy. In this chapter, we mainly discussed the Elekta Oncentra planning system, which is the main treatment planning tool for high-dose rate (HDR) modality in our facility and in many other facilities in the United States. HDR is a technically advanced form of brachytherapy; a high-intensity radiation source (3.6 mm in length) is delivered with step motor in submillimeter precision under computer guidance directly into the tumor areas while minimizing injury to surrounding normal healthy tissue. Oncentra planning is the key component to generate a deliverable brachytherapy procedure, which is executed on the microSelectron V3 remote afterloader treatment system. Creating a highly conformal plan can be a time-consuming task. The development of Oncentra software (version 4.5.3) offers a variety of useful tools that facilitate many of the clinical challenging tasks for planning, such as contouring and image reconstruction, as well as rapid planning calculations with dose and dose volume histogram analysis. Oncentra Brachy module creates workflow and optimizes the planning accuracy for wide varieties of clinical HDR treatments, such as skin, gynecologic (GYN), breast, prostate, and many other applications. The treatment file can also be transferred to the afterloader control station for speedy delivery. The design concept, calculation algorithms, and optimization modules presented some key characteristics to plan and treat the patients effectively and accurately. The dose distribution and accuracy of several clinical sample cases were discussed to illustrate the effectiveness and clinical efficacy. The American Association of Physicists in Medicine brachytherapy reports of TG-43 and TG-186 were also described and compared in evaluations of fundamental calculation methodologies.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Massively parallel electrical conductivity imaging of the subsurface: Applications to hydrocarbon exploration

Three-dimensional (3D) geophysical imaging is now receiving considerable attention for electrical conductivity mapping of potential offshore oil and gas reservoirs. The imaging technology employs controlled source electromagnetic (CSEM) and magnetotelluric (MT) fields and treats geological media exhibiting transverse anisotropy. Moreover when combined with established seismic methods, direct imaging of reservoir fluids is possible. Because of the size of the 3D conductivity imaging problem, strategies are required exploiting computational parallelism and optimal meshing. The algorithm thus developed has been shown to scale to tens of thousands of processors. In one imaging experiment, 32,768 tasks/processors on the IBM Watson Research Blue Gene/L supercomputer were successfully utilized. Over a 24 hour period we were able to image a large scale field data set that previously required over four months of processing time on distributed clusters based on Intel or AMD processors utilizing 1024 tasks on an InfiniBand fabric. Electrical conductivity imaging using massively parallel computational resources produces results that cannot be obtained otherwise and are consistent with timeframes required for practical exploration problems.

54 ENVIRONMENTAL SCIENCES↗

Next-generation geospatial-temporal information technologies for disaster management

Traditional geographic information systems (GIS) have been disrupted by the emergence of Big Data in the form of geo-coded raster, vector, and time-series Internet-of-Things data. This article discusses the application of new scalable technologies that go far beyond relational databases and file-based storage on spinning disk or tape to incorporate both storage and processing data in the same platform. The roles of the Apache Hadoop Distributed File Systems and NoSQL key-value stores such as the Apache Hbase are discussed, along with indexing schemes that optimally support geospatial-temporal use. Here, we highlight how this new approach can rapidly search multiple GIS data layers to obtain insights in the context of early warning, impact evaluation, response, and recovery to earthquake and wildfire disasters.

97 MATHEMATICS AND COMPUTING↗

Muster: Massively Scalable Clustering

Muster is a framework for scalable cluster analysis. It includes implementations of classic K-Medoids partitioning algorithms, as well as infrastructure for making these algorithms run scalably on very large systems. In particular, Muster contains algorithms such as CAPEK (described in reference 1) that are capable of clustering highly distributed data sets in-place on a hundred thousand or more processes.

Source record↗

A correlation

The paper reports on some correlative features of two sets of space-based atmospheric measurements which are globally distributed with good statistical coverage. One set of data, pertaining to tropospheric processes, is lightning occurrence frequency derived from measurements aboard the DMSP satellite. The second set of data, pertaining to thermospheric processes, is the occurrence frequency of wavelike structures in neutral atmospheric density profiles derived from measurements aboard AE-C and AE-D. A significant correlation was found between the occurrence patterns of dawn lightning, which is indicative of massive long-lived tropospheric convective activity, and the occurrence patterns of wavelike structures in the thermosphere.

Source record↗

Computer Sciences and Data Systems, volume 2

Topics addressed include: data storage; information network architecture; VHSIC technology; fiber optics; laser applications; distributed processing; spaceborne optical disk controller; massively parallel processors; and advanced digital SAR processors.

Source record↗

A test for spatial clustering in the presence of auxiliary information

A technique is proposed to test for the presence of clusters when both spatial and auxiliary information is available. The test is based on randomizing the auxiliary information over the spatial locations. It requires no model assumptions (such as a Poisson process) for the spatial distribution. The procedure may be used to screen data for possible clustering.

Banfield, Jeff↗