Search NASA⌕ Search

SEARCH · Search NASA

Results for “distributed computation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 757 records · Page 42

Completion processing for data communications instructions

Completion processing of data communications instructions in a distributed computing environment with computers coupled for data communications through communications adapters and an active messaging interface (`AMI`), injecting for data communications instructions into slots in an injection FIFO buffer a transfer descriptor, at least some of the instructions specifying callback functions; injecting a completion descriptor for each instruction that specifies a callback function into an injection FIFO buffer slot having a corresponding slot in a pending callback list; listing in the pending callback list callback functions specified by data communications instructions; processing each descriptor in the injection FIFO buffer, setting a bit in a completion bit mask corresponding to the slot in the FIFO where the completion descriptor was injected; and calling by the AMI any callback functions in the pending callback list as indicated by set bits in the completion bit mask.

97 MATHEMATICS AND COMPUTING↗

The Science Training Program for Young Italian Physicists and Engineers at Fermilab

Since 1984 Fermilab has been hosting a two-month summer training program for selected undergraduate and graduate Italian students in physics and engineering. Building on the traditional close collaboration between the Italian National Institute of Nuclear Physics (INFN) and Fermilab, the program is supported by INFN, by the DOE and by the Scuola Superiore di Sant`Anna of Pisa (SSSA), and is run by the Cultural Association of Italians at Fermilab (CAIF). This year the University of Pisa has qualified it as a “University of Pisa Summer School”, and will grant successful students with European Supplementary Credits. Physics students join the Fermilab HEP research groups, while engineers join the Particle Physics, Accelerator, Technical, and Computing Divisions. Some students have also been sent to other U.S. laboratories and universities for special trainings. The programs cover topics of great interest for science and for social applications in general, like advanced computing, distributed data analysis, nanoelectronics, particle detectors for earth and space experiments, high precision mechanics, applied superconductivity. In the years, over 350 students have been trained and are now employed in the most diverse fields in Italy, Europe, and the U.S. In addition, the existing Laurea Program in Fermilab Technical Division was extended to the whole laboratory, with presently two students in Master’s thesis programs on neutrino physics and detectors in the Neutrino Division. And finally, a joint venture with the Italian Scientists and Scholars North-America Foundation (ISSNAF) provided this year 4 professional engineers free of charge for Fermilab. More details on all of the above can be found below.

Barzi, Emanuela↗

Integration Of PanDA Workload Management System With Supercomputers for ATLAS and Data Intensive Science

The Large Hadron Collider (LHC), operating at the international CERN Laboratory in Geneva, Switzerland, is leading Big Data driven scientific explorations. Experiments at the LHC explore the fundamental nature of matter and the basic forces that shape our universe, and were recently credited for the discovery of a Higgs boson. ATLAS, one of the largest collaborations ever assembled in the sciences, is at the forefront of research at the LHC. To address an unprecedented multi-petabyte data processing challenge, the ATLAS experiment is relying on a heterogeneous distributed computational infrastructure. The ATLAS experiment uses PanDA (Production and Data Analysis) Workload Management System for managing the workflow for all data processing on over 150 data centers. Through PanDA, ATLAS physicists see a single computing facility that enables rapid scientific breakthroughs for the experiment, even though the data centers are physically scattered all over the world. While PanDA currently uses more than 250,000 cores with a peak performance of 0.3 petaFLOPS, LHC data taking runs require more resources than Grid computing can possibly provide. To alleviate these challenges, LHC experiments are engaged in an ambitious program to expand the current computing model to include additional resources such as the opportunistic use of supercomputers. We will describe a project aimed at integration of PanDA WMS with supercomputers in United States, Europe and Russia (in particular with Titan supercomputer at Oak Ridge Leadership Computing Facility (OLCF), MIRA supercomputer at Argonne Leadership Computing Facilities (ALCF), Supercomputer at the National Research Center Kurchatov Institute , IT4 in Ostrava and others). Current approach utilizes modified PanDA pilot framework for job submission to the supercomputers batch queues and local data management, with light-weight MPI wrappers to run single threaded workloads in parallel on LCFs multi-core worker nodes. This implementation was tested with a variety of Monte-Carlo workloads on several supercomputing platforms for ALICE and ATLAS experiments and it is in full production for the ATLAS experiment since September 2015. We will present our current accomplishments with running PanDA WMS at supercomputers and demonstrate our ability to use PanDA as a portal independent of the computing facilities infrastructure for High Energy and Nuclear Physics as well as other data-intensive science applications, such as bioinformatics and astro-particle physics.

Data-intensive science↗

Dimensionality Reduction Library v 0.2

Dimensionality Reduction Library is a C++ library for dimensionality reduction. In the context of this library, dimensionality reduction is considered to consist of 1)estimation of the intrinsic dimensionality using sampled data, 2) Finding maps that reduce the diemsionality of data (forward map) or increase the dimensionality of data (reverse map) and 3) mapping arbitray coordiantes to high and low dimensionalities. The library is intended toprovide a consistent interface to multiple dimensionality reduction algorithms with an efficient C++ interface that runs efficiently on multicore architectures. A few routines have been optimized with an option for GPU acceleration or distributed computation. Currently the library offers intrinsic dimensionality estimation using point-PCA reconstruction error and/ residual variance. The following dimensionality reduction methods have been implemented: Principal Component Analysis Multidimensional Scaling Locally Linear Embedding IsoMap Autoencoder Neutral Networks An executable is also supplied that can be built to allow for command-line access to the library routines. A description for an applciation of the library for molecular structure analysis has been published.

BROWN, WILLIAM↗

Mitigating component performance variation

Apparatus and methods may provide for characterizing a plurality of similar components of a distributed computing system based on a maximum safe operation level associated with each component and storing characterization data in a database and allocating non-uniform power to each similar component based at least in part on the characterization data in the database to substantially equalize performance of the components.

97 MATHEMATICS AND COMPUTING↗

Containerization in ATLAS Software Development and Data Production

The ATLAS experiment's software production and distribution on the grid benefits from a semi-automated infrastructure that provides up-to-date information about software usability and availability through the CVMFS dis-tribution service for all relevant systems. The software development process uses a Continuous Integration pipeline involving testing, validation, packag-ing and installation steps. For opportunistic sites that can not access CVMFS, containerized releases are needed. These standalone containers are currently created manually to support Monte-Carlo data production at such sites. In this paper we will describe an automated procedure for the containerization of AT-LAS software releases in the existing software development infrastructure, its motivation, integration and testing in the distributed computing system.

97 MATHEMATICS AND COMPUTING↗

Integration of Rucio in Belle II

The Belle II experiment, which started taking physics data in April 2019, will multiply the volume of data currently stored on its nearly 30 storage elements worldwide by one order of magnitude to reach about 340 PB of data (raw and Monte Carlo simulation data) by the end of operations. To tackle this massive increase and to manage the data even after the end of the data taking, it was decided to move the Distributed Data Management software from a homegrown piece of software to a widely used Data Management solution in HEP and beyond : Rucio. This contribution describes the work done to integrate Rucio with Belle II distributed computing infrastructure as well as the migration strategy that was successfully performed to ensure a smooth transition.

97 MATHEMATICS AND COMPUTING↗

A Modularized Urban Scale Building Energy Modeling Framework Designed with An Open Mind

In recent years, physics-based building energy modeling (BEM) has started being used to evaluate the performance of buildings in the context of connected communities and on an urban scale to study their aggregated energy use, interactions, and impacts on the energy supply infrastructure and environment. The development of urban-scale BEM solutions needs extensive effort. Existing attempts tend to focus on different aspects of BEM on an urban scale, such as collecting as-built building data from different information sources, integrating geometry modeling with geographic information systems (GISs), representing operational and occupancy profiles, automating workflow, processing and visualizing the results, and conducting large-scale simulations. Urban-scale BEM development would benefit from multi-disciplinary research areas and from an open platform to adopt advancements on data sources and tools. For these purposes, this research proposes a modularized bottom-up model creation and simulation framework that is built on the state-of-the-art BEM tools and can accommodate different building stock data. This framework uses a standardized schema to describe building design and operational characteristics, and it can be instantiated from different building survey datasets with heterogeneous structures. The paper demonstrates how thousands of surveyed buildings from the 2012 U.S. Energy Information Administration’s Commercial Buildings Energy Consumption Survey (CBECS) were one-to-one converted to EnergyPlus models through the schema and the model generation process, then simulated with distributed computing, and their results are summarized.

Lei, Xuechen↗

Use of Physics Based Management Optimization for Groundwater Remedy Design - 18671

Numerical modeling coupled with formal mathematical optimization techniques was used to design a groundwater remedy strategy to address a carbon tetrachloride (CCl{sub 4}) plume covering several square miles. The optimization approach, methodology, and project costs are described. The site consists of a large grain elevator in Nebraska. CCl{sub 4} was used as a fumigant and subsequently impacted soils and groundwater. Remedy design focused on the more diffuse plume, which extended approximately 4.5 miles down gradient of the source area. An eleven-layer model was developed and calibrated to observed groundwater conditions. This model was linked with formal optimization techniques to identify the best design capable of meeting client specified requirements and well location limitations. The planned system included requirements on the location of extraction and injection wells, total system flow rate, number of management periods, and specific constraints limiting further plume expansion. A separate trinitrotoluene (TNT) contaminant plume from a third party was located vertically above the leading edge of the CCl{sub 4} plume within the same aquifer. A further constraint imposed was that the design could not affect or cause additional migration of the TNT plume. Optimal system design was determined using HydroGeoLogic's Physics Based Management Optimization (PBMO{sup TM}) system. Over 38,000 candidate solutions consisting of different combinations of pumping and injection wells locations and rates, were evaluated through flow modeling coupled with either particle tracking or fully convective-dispersive transport simulations to determine the optimal design. Planning for installation of the optimal design is underway. Simulations were completed on a distributed computing platform consisting of 3 Quad Core PCs. Flow and particle tracking simulations required less than 2 minutes per simulation. Coupled flow and transport simulation run times were generally between 30-40 minutes per simulation. The total costs for developing the groundwater flow model and completing the subsequent optimal design were approximately $400,000. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Light-Front Holography and Novel Effects in QCD

The correspondence between theories in anti-de Sitter space and conformal field theories in physical space-time leads to an analytic, semiclassical model for strongly-coupled QCD. Light-front holography allows hadronic amplitudes in the AdS fifth dimension to be mapped to frame-independent light-front wavefunctions of hadrons in physical space-time, thus providing a relativistic description of hadrons at the amplitude level. We identify the AdS coordinate z with an invariant light-front coordinate {zeta} which separates the dynamics of quark and gluon binding from the kinematics of constituent spin and internal orbital angular momentum. The result is a single-variable light-front Schroedinger equation for QCD which determines the eigenspectrum and the light-front wavefunctions of hadrons for general spin and orbital angular momentum. The mapping of electromagnetic and gravitational form factors in AdS space to their corresponding expressions in light-front theory confirms this correspondence. Some novel features of QCD are discussed, including the consequences of confinement for quark and gluon condensates and the behavior of the QCD coupling in the infrared. The distinction between static structure functions such as the probability distributions computed from the square of the light-front wavefunctions versus dynamical structure functions which include the effects of rescattering is emphasized. A new method for computing the hadronization of quark and gluon jets at the amplitude level, an event amplitude generator, is outlined.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Dynamic versus Static Hadronic Structure Functions

'Static' structure functions are the probabilistic distributions computed from the square of the light-front wavefunctions of the target hadron. In contrast, the 'dynamic' structure functions measured in deep inelastic lepton-hadron scattering include the effects of rescattering associated with the Wilson line. Initial- and final-state rescattering, neglected in the parton model, can have a profound effect in QCD hard-scattering reactions, producing single-spin asymmetries, diffractive deep inelastic scattering, diffractive hard hadronic reactions, the breakdown of the Lam-Tung relation in Drell-Yan reactions, nuclear shadowing, and non-universal nuclear antishadowing|novel leading-twist physics not incorporated in the light-front wavefunctions of the target computed in isolation. I also review how 'direct' higher-twist processes--where a proton is produced in the hard subprocess itself--can explain the anomalous proton-to-pion ratio seen in high centrality heavy ion collisions.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Analysis of the Current Use, Benefit, and Value of the Open Science Grid

The Open Science Grid usage has ramped up more than 25% in the past twelve months due to both the increase in throughput of the core stakeholders - US LHC, LIGO and Run II - and increase in usage by nonphysics communities. It is important to understand the value collaborative projects, such as the OSG, contribute to the scientific community. This needs to be cognizant of the environment of commercial cloud offerings, the evolving and maturing middleware for grid based distributed computing, and the evolution in science and research dependence on computation. We present a first categorization of OSG value and analysis across several different aspects of the Consortium's goals and activities. And lastly, we presents some of the upcoming challenges of LHC data analysis ramp up and our ongoing contributions to the World Wide LHC Computing Grid.

99 GENERAL AND MISCELLANEOUS↗

Light-Front Holography, AdS/QCD, and Hadronic Phenomena

AdS/QCD, the correspondence between theories in a modified five-dimensional anti-de Sitter space and confining field theories in physical space-time, provides a remarkable semiclassical model for hadron physics. Light-front holography allows hadronic amplitudes in the AdS fifth dimension to be mapped to frame-independent light-front wavefunctions of hadrons in physical space-time, thus providing a relativistic description of hadrons at the amplitude level. We identify the AdS coordinate z with an invariant light-front coordinate {zeta} which separates the dynamics of quark and gluon binding from the kinematics of constituent spin and internal orbital angular momentum. The result is a single-variable light-front Schroedinger equation with a confining potential which determines the eigenspectrum and the light-front wavefunctions of hadrons for general spin and orbital angular momentum. The mapping of electromagnetic and gravitational form factors in AdS space to their corresponding expressions in light-front theory confirms this correspondence. Some novel features of QCD are discussed, including the consequences of confinement for quark and gluon condensates. The distinction between static structure functions, such as the probability distributions computed from the square of the light-front wavefunctions, versus dynamical structure functions which include the effects of rescattering, is emphasized. A new method for computing the hadronization of quark and gluon jets at the amplitude level, an event amplitude generator, is outlined.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DataSpaces: An Interaction and Coordination Framework for Coupled Simulation Workflows

Emerging high-performance distributed computing environments are enabling new end-to-end formulations in science and engineering that involve multiple interacting processes and data-intensive application workflows. For example, current fusion simulation efforts are exploring coupled models and codes that simultaneously simulate separate application processes, such as the core and the edge turbulence, and run on different high performance computing resources. These components need to interact, at runtime, with each other and with services for data monitoring, data analysis and visualization, and data archiving. As a result, they require efficient support for dynamic and flexible couplings and interactions, which remains a challenge. This paper presents Data-Spaces, a flexible interaction and coordination substrate that addresses this challenge. DataSpaces essentially implements a semantically specialized virtual shared space abstraction that can be associatively accessed by all components and services in the application workflow. It enables live data to be extracted from running simulation components, indexes this data online, and then allows it to be monitored, queried and accessed by other components and services via the space using semantically meaningful operators. The underlying data transport is asynchronous, low-overhead and largely memory-to-memory. The design, implementation, and experimental evaluation of DataSpaces using a coupled fusion simulation workflow is presented.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

An Approach to Trust Management Challenges for Critical Infrastructures

Abstract: The diversity of the kinds of interactions between principals in distributed computing systems, especially critical infrastructures, has expanded rapidly in recent years. However, the state of the art in trust management is not yet sufficient to support this diversity of interactions. This paper presents a rationale and design for much richer trust management than is possible today. It presents a set of requirements for more generalized trustmanagement and an analysis of their necessity. A new trust management framework is presented that supports dynamic and composable trust.

97 MATHEMATICS AND COMPUTING↗

Computer program calculates and plots surface area and pore size distribution data

Computer program calculates surface area and pore size distribution of powders, metals, ceramics, and catalysts, and prints and plots the desired data directly. Surface area calculations are based on the gas adsorption technique of Brunauer, Emmett, and Teller, and pore size distribution calculations are based on the gas adsorption technique of Pierce.

Halpert, G.↗

Optimal Sensor Mobility Design for Target Tracking with Distributed Sensing, Communication and Computing Infrastructure

The paper presents an airborne target tracking approach with data fusion from distributed stationary and mobile sensor network transmitted through a wireless/wired communication network and using a distributed computing infrastructure. To obtain high quality measurements, sensor flight platforms' positions and orientations are optimized with respect to the available target's position and velocity estimates, and a formation control strategy is applied to derive desired trajectories for the flight platforms. As sensors move, the communication network topology switching is determined using the worst-case approach to handle uncertainties in the target's and sensors' positions, which alters communication delays for sensors' data transmission to computing centers. An optimal data migration algorithm is periodically applied to determine these communication delays for each sensor and the optimal location with minimum end-to-end latency for the target tracking algorithm execution, which is based on adaptive information fusion from multi-modal mobile and stationary sensors inside an Extended Kalman Filter framework. The approach is validated in a desktop simulation environment using synthetic sensor data generated for a simulated target's flight.

Distributed sensing↗