Search NASA⌕ Search

SEARCH · Search NASA

Results for “DISTRIBUTED DATA PROCESSING”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38

LDCM Grid Prototype (LGP)

The LGP successfully demonstrated that grid technology could be used to create a collaboration among research scientists, their science development machines, and distributed data to create a science production system in a nationally distributed environment. Grid technology provides a low cost and effective method of enabling production of science products by the science community. To demonstrate this, the LGP partnered with NASA GSFC scientists and used their existing science algorithms to generate virtual Landsat-like data products using distributed data resources. LGP created 48 output composite scenes with 4 input scenes each for a total of 192 scienes processed in parallel. The demonstration took 12 hours, which beat the requirement by almost 50 percent, well within the LDCM requirement to process 250 scenes per day. The LGP project also showed the successful use of workflow tools to automate the processing. Investing in this technology has led to funding for a ROSES ACCESS proposal. The proposal intends to enable an expert science user to produce products from a number of similar distributed instrument data sets using the Land Cover Change Community-based Processing and Analysis System (LC-ComPS) Toolbox. The LC-ComPS Toolbox is a collection of science algorithms that enable the generation of data with ground resolution on the order of Landsat-class instruments.

Weinstein, Beth↗

Global distribution and characteristics of coronae and related features on Venus - Implications for origin and relation to mantle processes

The increased coverage and resolution of Magellan images and altimetry data have resulted in significant new identifications of coronae and coronalike features and more detailed information on corona morphology, topography, and distribution. The distribution of coronae and coronalike features in Magellan data are assessed in the light of the proposed hotspot origin of these features. The basic characteristics of coronae are then compared with other possible hotspot features on Venus (e.g., major volcanic shields and domelike highlands) in a first-order assessment of the implications of mantle plume-related features on Venus for interior convective processes.

Stofan, Ellen R.↗

Interconnection Assessment Methodology and Cost Benefit Analysis for High-Penetration PV Deployment in the Arizona Public Service System

In an effort to better understand the impacts of high penetrations of photovoltaic (PV) generators on distribution systems, Arizona Public Service and its partners completed a multi-year project to develop the tools and knowledge base needed to safely and reliably integrate high penetrations of utility- and residential-scale PV. Building upon the APS Community Power Project-Flagstaff Pilot, this project investigates the impact of PV on a representative feeder in northeast Flagstaff. To quantify and catalog the effects of the estimated 1.3 MW of PV that will be installed on the feeder (both smaller units at homes and large, centrally located systems), high-speed weather and electrical data acquisition systems and digital 'smart' meters were designed and installed to facilitate monitoring and to build and validate comprehensive, high-resolution models of the distribution system. These models are being developed to analyze the impacts of PV on distribution circuit protection systems (including coordination and anti-islanding), predict voltage regulation and phase balance issues, and develop volt/VAr control schemes. This paper continues from a paper presented at the 2014 IEEE PVSC conference that described feeder model evaluation and high penetration advanced scenario analysis, specifically feeder reconfiguration. This paper presents results from Phase 5 of the project. Specifically, the paper discusses tool automation; interconnection assessment methodology and cost benefit analysis.

14 SOLAR ENERGY↗

MODIS Data from the GES DISC DAAC: Moderate-Resolution Imaging Spectroradiometer (MODIS)

The Goddard Earth Sciences (GES) Distributed Active Archive Center (DAAC) is responsible for the distribution of the Level 1 data, and the higher levels of all Ocean and Atmosphere products (Land products are distributed through the Land Processes (LP) DAAC DAAC, and the Snow and Ice products are distributed though the National Snow and Ice Data Center (NSIDC) DAAC). Ocean products include sea surface temperature (SST), concentrations of chlorophyll, pigment and coccolithophores, fluorescence, absorptions, and primary productivity. Atmosphere products include aerosols, atmospheric water vapor, clouds and cloud masks, and atmospheric profiles from 20 layers. While most MODIS data products are archived in the Hierarchical Data Format-Earth Observing System (HDF-EOS 2.7) format, the ocean binned products and primary productivity products (Level 4) are in the native HDF4 format. MODIS Level 1 and 2 data are of the Swath type and are packaged in files representing five minutes of Files for Level 3 and 4 are global products at daily, weekly, monthly or yearly resolutions. Apart from the ocean binned and Level 4 products, these are in Grid type, and the maps are in the Cylindrical Equidistant projection with rectangular grid. Terra viewing (scenes of approximately 2000 by 2330 km). MODIS data have several levels of maturity. Most products are released with a provisional level of maturity and only announced as validated after rigorous testing by the MODIS Science Teams. MODIS/Terra Level 1, and all MODIS/Terra 11 micron SST products are announced as validated. At the time of this publication, the MODIS Data Support Team (MDST) is working with the Ocean Science Team toward announcing the validated status of the remainder of MODIS/Terra Ocean products. MODIS/Aqua Level 1 and cloud mask products are released with provisional maturity.

Source record↗

Multiscale-Informed Modeling of High Temperature Component Response with Uncertainty Quantification

This report summarizes a joint effort between Argonne National Laboratory, Idaho National Laboratory, and Los Alamos National Laboratory to develop and deploy constitutive models targeted at predicting the life of Grade 91 alloy components subjected to high temperature environments typical of those that structural components in advanced nuclear reactors would experience. Two distinct, but complementary constitutive modeling approaches have been taken here. The first employs a phenomenological viscoplastic model for which parameters have been calibrated based on experimental data for a wide range of Grade 91 alloy that has undergone a variety of processing. A Bayesian approach was used to derive distributions of uncertain parameters for this model based on this data set. The second approach is a reduced order model suitable for engineering-scale analysis that is based on the results of a large set of mesoscale simulations. Mesoscale models allow for the microstructure and composition of a particular alloy to be directly taken into account in the computation of the viscoplastic response, but are computationally expensive, which makes it impractical to directly call those models for the material constitutive response in an engineering-scale simulation. The reduced-order representation of the response of the underlying model used here allows for an engineering-scale model to take into account the characteristics of the underlying microstructure, while only incurring a reasonable computational expense. Both of these approaches have different strengths, and are applicable for different parts of the design/analysis process. The phenomenological models can be readily parameterized based on a set of experimental data for a given class of materials and used for scoping calculations. Once a specific material is chosen and adequately characterized, the reduced order models can accurately predict the response of that specific alloy, and because the models are based on predictive models of the underlying microstructure, they can be used to more confidently predict the response under conditions in regions where there is limited experimental data. Both of these models have been integrated in the Grizzly code, which is used here to perform proof-of-concept uncertainty quantification analyses of a simple component under prototypical conditions. The built- in stochastic analysis capabilities in the MOOSE framework that Grizzly is built on are used here to run large sets of simulations for this uncertainty quantification analysis. As would be expected, because the reduced order models are developed for a much more tightly defined alloy, they predict tighter distributions of the time to failure than the phenomenological models, which are calibrated to a broader set of data. Also important is that these simulations demonstrate that a reduced order modeling approach can be successfully deployed to propagate uncertainties from the material scale to practical engineering-scale component simulations.

42 ENGINEERING↗

DSP Algorithms for Fission Fragment and Prompt Fission Neutron Spectroscopy

Digital signal processing (DSP) algorithms are in high demand for modern nuclear fission investigation due to importance of increase the accuracy of fissile nuclear data for new generation of nuclear power stations. DSP algorithms for fission fragment (FF) and prompt fission neutron (PFN) spectroscopy are described in the present work. The twin Frisch-grid ionization chamber (GTIC) is used to measure the kinetic energy-, mass- and angular distributions of the FF in the {sup 252}Cf(SF) reaction. Along with the neutron time-of-flight (TOF) measurement the correlation between neutron emission and FF mass and energy is investigated. The TOF is measured between common cathode of the GTIC and the neutron detector (ND) pulses. Waveform digitizers (WFD) having 12 bit amplitude resolution and 100 MHz sampling frequency are used for the detector pulse sampling. DSP algorithms are developed as recursive procedures to perform the signal processing, similar to those available in various nuclear electronics modules, such as constant fraction discriminator (CFD), pulse shape discriminator (PSD), peak-sensitive analogue-to-digital converter (pADC) and pulse shaping amplifier (PSA). To measure the angle between FF and the cathode plane normal to the GTIC a new algorithm is developed having advantage over the traditional analogue pulse processing schemes. Algorithms are tested by comparing the numerical simulation of the data analysis of the {sup 252}Cf(SF) reaction with data available from literature.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Nuclear PDF for neutrino and charged lepton data

Neutrino Deep Inelastic Scattering (DIS) on nuclei is an essential process to constrain the strange quark parton distribution functions (PDF) in the proton. The critical component on the way to using the neutrino DIS data in a proton PDF analysis is understanding the nuclear effects in parton distribution functions. We parametrize these effects by nuclear parton distribution functions (NPDF). Here we compare results from two analysis of NPDF both done at next-to-leading order in QCD. The first uses neutral current charged-lepton (l{sup {+-}A}) Deeply Inelastic Scattering (DIS) and Drell-Yan data for several nuclear targets and the second uses neutrino-nucleon DIS data. We compare the nuclear corrections factors (F{sub 2}{sup Fe}/F{sub 2}{sup D}) for the charged-lepton data with other results from the literature. In particular, we compare and contrast fits based upon the charged-lepton DIS data with those using neutrino-nucleon DIS data.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

UPC++ Programmer’s Guide (v1.0-2019.3.0)

UPC++ is a C++11 library that provides Partitioned Global Address Space (PGAS) programming. It is designed for writing parallel programs that run efficiently and scale well on distributed-memory parallel computers. The PGAS model is single program, multiple-data (SPMD), with each separate constituent process having access to local memory as it would in C++. However, PGAS also provides access to a global address space, which is allocated in shared segments that are distributed over the processes. UPC++ provides numerous methods for accessing and using global memory. In UPC++, all operations that access remote memory are explicit, which encourages programmers to be aware of the cost of communication and data movement. Moreover, all remote-memory access operations are by default asynchronous, to enable programmers to write code that scales well even on hundreds of thousands of cores.

97 MATHEMATICS AND COMPUTING↗

UPC++ v1.0 Programmer’s Guide (Revision 2019.9.0)

UPC++ is a C++11 library that provides Partitioned Global Address Space (PGAS) programming. It is designed for writing parallel programs that run efficiently and scale well on distributed-memory parallel computers. The PGAS model is single program, multiple-data (SPMD), with each separate constituent process having access to local memory as it would in C++. However, PGAS also provides access to a global address space, which is allocated in shared segments that are distributed over the processes. UPC++ provides numerous methods for accessing and using global memory. In UPC++, all operations that access remote memory are explicit, which encourages programmers to be aware of the cost of communication and data movement. Moreover, all remote-memory access operations are by default asynchronous, to enable programmers to write code that scales well even on hundreds of thousands of cores.

97 MATHEMATICS AND COMPUTING↗

UPC++ v1.0 Programmer’s Guide, Revision 2020.10.0

UPC++ is a C++11 library that provides Partitioned Global Address Space (PGAS) programming. It is designed for writing parallel programs that run efficiently and scale well on distributed-memory parallel computers. The PGAS model is single program, multiple-data (SPMD), with each separate constituent process having access to local memory as it would in C++. However, PGAS also provides access to a global address space, which is allocated in shared segments that are distributed over the processes. UPC++ provides numerous methods for accessing and using global memory. In UPC++, all operations that access remote memory are explicit, which encourages programmers to be aware of the cost of communication and data movement. Moreover, all remote-memory access operations are by default asynchronous, to enable programmers to write code that scales well even on hundreds of thousands of cores.

97 MATHEMATICS AND COMPUTING↗

UPC++ Programmer’s Guide, v1.0-2018.9.0

UPC++ is a C++11 library that provides Partitioned Global Address Space (PGAS) programming. It is designed for writing parallel programs that run efficiently and scale well on distributed-memory parallel computers. The PGAS model is single program, multiple-data (SPMD), with each separate constituent process having access to local memory as it would in C++. However, PGAS also provides access to a global address space, which is allocated in shared segments that are distributed over the processes. UPC++ provides numerous methods for accessing and using global memory. In UPC++, all operations that access remote memory are explicit, which encourages programmers to be aware of the cost of communication and data movement. Moreover, all remote-memory access operations are by default asynchronous, to enable programmers to write code that scales well even on hundreds of thousands of cores.

97 MATHEMATICS AND COMPUTING↗

UPC++ v1.0 Programmer’s Guide, Revision 2020.3.0

UPC++ is a C++11 library that provides Partitioned Global Address Space (PGAS) programming. It is designed for writing parallel programs that run efficiently and scale well on distributed-memory parallel computers. The PGAS model is single program, multiple-data (SPMD), with each separate constituent process having access to local memory as it would in C++. However, PGAS also provides access to a global address space, which is allocated in shared segments that are distributed over the processes. UPC++ provides numerous methods for accessing and using global memory. In UPC++, all operations that access remote memory are explicit, which encourages programmers to be aware of the cost of communication and data movement. Moreover, all remote-memory access operations are by default asynchronous, to enable programmers to write code that scales well even on hundreds of thousands of cores.

97 MATHEMATICS AND COMPUTING↗

Global Change Data Center: Mission, Organization, Major Activities, and 2001 Highlights

Rapid efficient access to Earth sciences data is fundamental to the Nation's efforts to understand the effects of global environmental changes and their implications for public policy. It becomes a bigger challenge in the future when data volumes increase further and missions with constellations of satellites start to appear. Demands on data storage, data access, network throughput, processing power, and database and information management are increased by orders of magnitude, while budgets remain constant and even shrink. The Global Change Data Center's (GCDC) mission is to provide systems, data products, and information management services to maximize the availability and utility of NASA's Earth science data. The specific objectives are (1) support Earth science missions be developing and operating systems to generate, archive, and distribute data products and information; (2) develop innovative information systems for processing, archiving, accessing, visualizing, and communicating Earth science data; and (3) develop value-added products and services to promote broader utilization of NASA Earth Sciences Enterprise (ESE) data and information. The ultimate product of GCDC activities is access to data and information to support research, education, and public policy.

Wharton, Stephen W.↗

Fault Detection in Distributed Climate Sensor Networks using Dynamic Bayesian Networks

The Atmospheric Radiation Measurement program operated by U.S. Department of Energy is one of the largest climate research programs dedicated to the collection of long-term continuous measurements of cloud properties and other key components of the earth’s climate system. Given the critical role that collected ARM data plays in the analysis of atmospheric processes and conditions and in the enhancement and evaluation of global climate models, the production and distribution of high-quality data is one of ARM’s primary mission objectives. Fault detection in ARM’s distributed sensor network is one critical ingredient towards maintaining high quality and useful data. We are modeling ARM’s distributed sensor network as a dynamic Bayesian network where key measurements are mapped to Bayesian network variables. We then define the conditional dependencies between variables by discovering highly correlated variable pairs from historical data. The resultant dynamic Bayesian network provides an automated approach to identifying whether certain sensors are malfunctioning or failing in the distributed sensor network. A potential fault or failure is detected when an observed measurement is not consistent with its expected measurement and the observed measurements of other related sensors in the Bayesian network. We present some of our experiences and promising results with the fault detection dynamic Bayesian network.

54 ENVIRONMENTAL SCIENCES↗

HPGMG

HPGMG is a scalable reimplementation of miniGMG (see previous software disclosure) and is a compact geometric multigrid (MG benchmark designed to proxy the performance characteristics of the solves found in adaptive mesh refinement multigrid (AMR MG) applications. It solves the equation a*alpha*u - b div beta grad u = f on a large cubical domain using cell-centered values and either homogenous dirichlet or periodic boundaries. a and b are scalar constants, alpha and beta are space varying constants, f is the right hand side, and u is the solution. The cubical domain is divided into cubical subdomains which are distributed across the supercomputer. Whereas miniGMG enforced a static spatial decomposition across all levels in the MG V-cycle, HPGMG is free to redistribute data at each level including the possibility of moving all data to a single process (memory permitting). Thus, where miniGMG's U-cycle demanded a coarse grid solve across the entire supercomputer (a performance bottleneck), HPGMG can avoid this by combining distributed data and continuing the V-cycle. Technically, HPGMG can still implement a U-cycle or a Krylov bottom solve, but this solve can now be done on a global problem of only 2^3-8^3 cells. Additionally, HPGMG supports the MG F-cycle which avoids the iterative process of the v-cycle with a direct approach that can reach the discretization error in one pass. This provides a substantial performance boosts and opens avenues for exploiting systems that include hierarchical memories or heterogeneous processors. Like miniGMG, the righthand side f in HPGMG is generated from a continuous function for u. Thus, one can solve.

Williams, Samuel↗

Acquisition, Sharing and Processing of Large Datasets for Strain Imaging: an Example of an Indented Ni3Al/Mo Composite

The local effects of stress from a mechanical indentation have been studied on a Ni3 Al single crystal containing submicron inclusions of molybdenum fibers. Polychromatic X ray Microscopy (PXM) was used to measure elastic and plastic deformations near the indents. Analysis of freshly acquired massive sets of PXM data has been carried out over the Science Studio network using parallel processing software FOXMAS. This network and the FOXMAS software have greatly improved the efficiency of the data processing task.. The analysis was successfully applied to study lattice orientation distribution and strain tensor components for both the Ni3 Al and the Mo phases, particularly around 8 indents patterned at the longitudinal section of the alloy.

data processing↗

Multi-Sensor Distributive On-Line Processing, Visualization, and Analysis Infrastructure for an Agricultural Information System at the NASA Goddard Earth Sciences DAAC

The Goddard Space Flight Center Earth Sciences Data and Information Services Center (GES DISC) Distributed Active Center (DAAC) is developing an Agricultural Information System (AIS), evolved from an existing TRMM On-line Visualization and Analysis System precipitation and other satellite data products and services. AIS outputs will be ,integrated into existing operational decision support system for global crop monitoring, such as that of the U.N. World Food Program. The ability to use the raw data stored in the GES DAAC archives is highly dependent on having a detailed understanding of the data's internal structure and physical implementation. To gain this understanding is a time-consuming process and not a productive investment of the user's time. This is an especially difficult challenge when users need to deal with multi-sensor data that usually are of different structures and resolutions. The AIS has taken a major step towards meeting this challenge by incorporating an underlying infrastructure, called the GES-DISC Interactive Online Visualization and Analysis Infrastructure or "Giovanni," that integrates various components to support web interfaces that ,allow users to perform interactive analysis on-line without downloading any data. Several instances of the Giovanni-based interface have been or are being created to serve users of TRMM precipitation, MODIS aerosol, and SeaWiFS ocean color data, as well as agricultural applications users. Giovanni-based interfaces are simple to use but powerful. The user selects geophysical ,parameters, area of interest, and time period; and the system generates an output ,on screen in a matter of seconds.

Teng, William↗