Search NASA⌕ Search

SEARCH · Search NASA

Results for “distributed databases”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Sonar

Sonar contains software for managing a HPC performance-monitoring software stack. This includes streaming data into a distributed Kafka message queue, storing/querying from a distributed Cassandra database, and front-end tools for secure access, visualization, and analytics of facility-wide performance data.

Gimenez, AlfredoA.↗

Device Oriented Project Controller

This proposal is directed at the issue of developing control systems for very large HEP projects. A de-facto standard in accelerator control is the Experimental Physics and Industrial Control System (EPICS), which has been applied successfully to many physics projects. EPICS is a channel based system that requires that each channel of each device be configured and controlled. In Phase I, the feasibility of a device oriented extension to the distributed channel database was demonstrated by prototyping a device aware version of an EPICS I/O controller that functions with the current version of the channel access communication protocol. Extensions have been made to the grammar to define the database. Only a multi-stage position controller with limit switches was developed in the demonstration, but the grammar should support a full range of functional record types. In phase II, a full set of record types will be developed to support all existing record types, a set of process control functions for closed loop control, and support for experimental beam line control. A tool to configure these records will be developed. A communication protocol will be developed or extensions will be made to Channel Access to support introspection of components of a device. Performance bench marks will be made on both communication protocol and the database. After these records and performance tests are under way, a second of the grammar will be undertaken.

43 PARTICLE ACCELERATORS↗

Exascale Co-design for Modeling Materials in Extreme Environments

Computational materials science has provided great insight into the response of materials under extreme conditions that are difficult to probe experimentally. For example, shock-induced plasticity and phase transformation processes in single-crystal and nanocrystalline metals have been widely studied via large-scale molecular dynamics simulations, and many of these predictions are beginning to be tested at advanced 4th generation light sources such as the Advanced Photon Source (APS) and Linac Coherent Light Source (LCLS). I will describe our simulation predictions and their recent verification at LCLS, outstanding challenges in modeling the response of materials to extreme mechanical and radiation environments, and our efforts to tackle these as part of the multi-institutional, multi-disciplinary Exascale Co-design Center for Materials in Extreme Environments (ExMatEx). ExMatEx has initiated an early and deep collaboration between domain (computational materials) scientists, applied mathematicians, computer scientists, and hardware architects, in order to establish the relationships between algorithms, software stacks, and architectures needed to enable exascale-ready materials science application codes within the next decade. We anticipate that we will be able to exploit hierarchical, heterogeneous architectures to achieve more realistic large-scale simulations with adaptive physics refinement, and are using tractable application scale-bridging proxy application testbeds to assess new approaches and requirements. Such current scale-bridging strategies accumulate (or recompute) a distributed response database from fine-scale calculations, in a top-down rather than bottom-up multiscale approach.

36 MATERIALS SCIENCE↗

Gearbox Reliability Collaborative: Gearbox Inspection Metadata

NREL has developed a software application called GearFacts that will be distributed to Database Collaborative participants to capture failure information when gearboxes are rebuilt. This publication names and describes each field used in GearFacts and can be used as a reference to the software's design.

17 WIND ENERGY↗

ORBiT - The Oak Ridge Biosurveillance Toolkit

We describe ORBiT, the Oak Ridge Biosurveillance Toolkit, the objective of which is to provide 1) forecasting and early warning, and 2) an extensible data analytics platform for biosurveillance by enabling the use of traditional and non-traditional datasets, consisting of heterogeneous data types and modalities. ORBiT includes a data collection interface, analytic components, higher-order statistical tools, and a visual front-end with visual analytics. ORBiT is implemented as a distributed analytic platform consisting of a software stack atop of Hadoop and uses Titan, a distributed graph database as a backend for data storage.

59 BASIC BIOLOGICAL SCIENCES↗

Ada software productivity prototypes: A case study

A case study of the impact of Ada on a Command and Control project completed at the Jet Propulsion Laboratory (JPL) is given. The data for this study was collected as part of a general survey of software costs and productivity at JPL and other NASA sites. The task analyzed is a successful example of the use of rapid prototyping as applied to command and control for the U.S. Air Force and provides the U.S. Air Force Military Airlift Command with the ability to track aircraft, air crews and payloads worldwide. The task consists of a replicated database at several globally distributed sites. The local databases at each site can be updated within seconds after changes are entered at any one site. The system must be able to handle up to 400,000 activities per day. There are currently seven sites, each with a local area network of computers and a variety of user displays; the local area networks are tied together into a single wide area network. Using data obtained for eight modules, totaling approximately 500,000 source lines of code, researchers analyze the differences in productivities between subtasks. Factors considered are percentage of Ada used in coding, years of programmer experience, and the use of Ada tools and modern programming practices. The principle findings are the following. Productivity is very sensitive to programmer experience. The use of Ada software tools and the use of modern programming practices are important; without such use Ada is just a large complex language which can cause productivity to decrease. The impact of Ada on development effort phases is consistent with earlier reports at the project level but not at the module level.

Hihn, Jairus M.↗

Regional Educational Laboratory Electronic Network Phase 2 System

The Far West Laboratory in collaboration with the other regional educational laboratories is establishing a regionally coordinated telecommunication network to electronically interconnect each of the ten regional laboratories with educators and education stakeholders from the school to the state level. For the national distributed information database, each lab is working with mid-level networks to establish a common interface for networking throughout the country and include topics of importance to education reform as assessment and technology planning.

Cradler, John↗

Aerospace Engineering Systems and the Advanced Design Technologies Testbed Experience

Continuous improvement of aerospace product development processes is a driving requirement across much of the aerospace community. As up to 90% of the cost of an aerospace product is committed during the first 10% of the development cycle, there is a strong emphasis on capturing, creating, and communicating better information (both requirements and performance) early in the product development process. The community has responded by pursuing the development of computer-based systems designed to enhance the decision-making capabilities of product development individuals and teams. Recently, the historical foci on sharing the geometrical representation and on configuration management are being augmented: 1) Physics-based analysis tools for filling the design space database; 2) Distributed computational resources to reduce response time and cost; 3) Web-based technologies to relieve machine-dependence; and 4) Artificial intelligence technologies to accelerate processes and reduce process variability. The Advanced Design Technologies Testbed (ADTT) activity at NASA Ames Research Center was initiated to study the strengths and weaknesses of the technologies supporting each of these trends, as well as the overall impact of the combination of these trends on a product development event. Lessons learned and recommendations for future activities are reported.

VanDalsem, William R.↗

U.S. Naval Observatory VLBI Analysis Center

This report summarizes the activities of the VLBI Analysis Center at the United States Naval Observatory for the 2012 calendar year. Over the course of the year, Analysis Center personnel continued analysis and timely submission of IVS-R4 databases for distribution to the IVS. During the 2012 calendar year, the USNO VLBI Analysis Center produced two VLBI global solutions designated as usn2012a and usn2012b. Earth orientation parameters (EOP) based on this solution and updated by the latest diurnal (IVS-R1 and IVS-R4) experiments were routinely submitted to the IVS. Sinex files based upon the bi-weekly 24-hour experiments were also submitted to the IVS. During the 2012 calendar year, Analysis Center personnel continued a program to use the Very Long Baseline Array (VLBA) operated by the NRAO for the purpose of measuring UT1-UTC. Routine daily 1-hour duration Intensive observations were initiated using the VLBA antennas at Pie Town, NM and Mauna Kea, HI. High-speed network connections to these two antennas are now routinely used for electronic transfer of VLBI data over the Internet to a USNO point of presence. A total of 270 VLBA Intensive experiments were observed and electronically transferred to and processed at USNO in 2012.

Boboltz, David A.↗

Re-Organizing Earth Observation Data Storage to Support Temporal Analysis of Big Data

The Earth Observing System Data and Information System archives many datasets that are critical to understanding long-term variations in Earth science properties. Thus, some of these are large, multi-decadal datasets. Yet the challenge in long time series analysis comes less from the sheer volume than the data organization, which is typically one (or a small number of) time steps per file. The overhead of opening and inventorying complex, API-driven data formats such as Hierarchical Data Format introduces a small latency at each time step, which nonetheless adds up for datasets with O(10^6) single-timestep files. Several approaches to reorganizing the data can mitigate this overhead by an order of magnitude: pre-aggregating data along the time axis (time-chunking); storing the data in a highly distributed file system; or storing data in distributed columnar databases. Storing a second copy of the data incurs extra costs, so some selection criteria must be employed, which would be driven by expected or actual usage by the end user community, balanced against the extra cost.

data storage↗

Striped Data Analysis Framework

Traditionally, High Energy data analysis is based on the model where data are stored in files and analyzed by running multiple analysis processes, each reading one or more of the data files. This process involves repeated data reduction step, which produces smaller files, which is time consuming and leads to data duplication. We propose an alternative approach to data storage and analysis, based on the Big Data technologies. The idea is to store each element of data once and only once in a distributed scalable database and analyze data by reading only "interesting" pieces of data from the database. To make this approach possible, we developed columnar Striped Data Representation Format as the basis of the framework. Traditional columnar approach allows for efficient analysis of complex data structures. While keeping all the benefits of columnar data representation, striped mechanism goes further by enabling efficient parallelization of computations and flexible dist ribution of data analysis. The framework includes scalable and elastic data storage, compute and user analysis backend components. The framework uses off-the shelf web services and data caching technologies as the compute/data co-location mechanism. Flexible architecture allows the framework run in the cloud using container technologies. The framework offers Python/Jupyter as the user analysis backend platform, but can also run in command line or batch mode. In the article, we will present the results of the FNAL-LDRD-2016-032 FNAL LDRD project, the design, implementation, features and performance characteristics of the Striped Data Analysis Framework.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Estimating a Service-Life Distribution Based on Production Counts and a Failure Database

A manufacturer wanted to compare the service-life distributions of two similar products. These concern product lifetimes after installation (not manufacture). For each product, there were available production counts and an imperfect database providing information on failing units. In the real case, these units were expensive repairable units warrantied against repairs. Failure (of interest here) was relatively rare and driven by a different mode/mechanism than ordinary repair events (not of interest here). Approach: Data models for the service life based on a standard parametric lifetime distribution and a related limited failure population were developed. These models were used to develop expressions for the likelihood of the available data that properly accounts for information missing in the failure database. Results: A Bayesian approach was employed to obtain estimates of model parameters (with associated uncertainty) in order to investigate characteristics of the service-life distribution. Custom software was developed and is included as Supplemental Material to this case study. One part of a responsible approach to the original case was a simulation experiment used to validate the correctness of the software and the behavior of the statistical methodology before using its results in the application, and an example of such an experiment is included here. Because of confidentiality issues that prevent use of the original data, simulated data with characteristics like the manufacturer’s proprietary data are used to illustrate some aspects of our real analyses. Lastly, we also note that, although this case focuses on rare and complete product failure, the statistical methodology provided is directly applicable to more standard warranty data problems involving typically much larger warranty databases where entries are warranty claims (often for repairs) rather than reports of complete failures.

97 MATHEMATICS AND COMPUTING↗

Interpretation of time-of-flight distributions for neutral particles under pulsed laser evaporation using direct Monte Carlo simulation

A theoretical study of the time-of-flight (TOF) distributions under pulsed laser evaporation in vacuum has been performed. A database of TOF distributions has been calculated by the direct simulation Monte Carlo (DSMC) method. It is shown that describing experimental TOF signals through the use of the calculated TOF database combined with a simple analysis of evaporation allows determining the irradiated surface temperature and the rate of evaporation. Analysis of experimental TOF distributions under laser ablation of niobium, copper, and graphite has been performed, with the evaluated surface temperature being well agreed with results of the thermal model calculations. General empirical dependences are proposed, which allow indentifying the regime of the laser induced thermal ablation from the TOF distributions for neutral particles without invoking the DSMC-calculated database.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

The BioMart community portal: an innovative alternative to large, centralized data repositories

The BioMart Community Portal (www.biomart.org) is a community-driven effort to provide a unified interface to biomedical databases that are distributed worldwide. The portal provides access to numerous database projects supported by 30 scientific organizations. It includes over 800 different biological datasets spanning genomics, proteomics, model organisms, cancer data, ontology information and more. All resources available through the portal are independently administered and funded by their host organizations. The BioMart data federation technology provides a unified interface to all the available data. The latest version of the portal comes with many new databases that have been created by our ever-growing community. It also comes with better support and extensibility for data analysis and visualization tools. A new addition to our toolbox, the enrichment analysis tool is now accessible through graphical and web service interface. The BioMart community portal averages over one million requests per day. Building on this level of service and the wealth of information that has become available, the BioMart Community Portal has introduced a new, more scalable and cheaper alternative to the large data stores maintained by specialized organizations.

59 BASIC BIOLOGICAL SCIENCES↗

SMALL-SCALE AND GLOBAL DYNAMOS AND THE AREA AND FLUX DISTRIBUTIONS OF ACTIVE REGIONS, SUNSPOT GROUPS, AND SUNSPOTS: A MULTI-DATABASE STUDY

In this work, we take advantage of 11 different sunspot group, sunspot, and active region databases to characterize the area and flux distributions of photospheric magnetic structures. We find that, when taken separately, different databases are better fitted by different distributions (as has been reported previously in the literature). However, we find that all our databases can be reconciled by the simple application of a proportionality constant, and that, in reality, different databases are sampling different parts of a composite distribution. This composite distribution is made up by linear combination of Weibull and log-normal distributions—where a pure Weibull (log-normal) characterizes the distribution of structures with fluxes below (above) 10{sup 21}Mx (10{sup 22}Mx). Additionally, we demonstrate that the Weibull distribution shows the expected linear behavior of a power-law distribution (when extended to smaller fluxes), making our results compatible with the results of Parnell et al. We propose that this is evidence of two separate mechanisms giving rise to visible structures on the photosphere: one directly connected to the global component of the dynamo (and the generation of bipolar active regions), and the other with the small-scale component of the dynamo (and the fragmentation of magnetic structures due to their interaction with turbulent convection)

79 ASTRONOMY AND ASTROPHYSICS↗

Energy By Design: Science-Based Wind Energy Siting to Avoid Environmental Impact In the Continental United States (Final Technical Report)

The United States has abundant wind resources, such that only about 3% of the resource would need to be developed to achieve the goal of producing 20% of electricity in the United States by 2030. Inappropriately sited wind development may result in conflicts with wildlife that can delay or derail development projects, increase projects costs, and may degrade important conservation values. The most cost-effective approach to reducing such conflicts is through landscape-scale siting early in project development. To support landscape scale siting that avoids sensitive areas for wildlife, we compiled a database on species distributions, wind resource, disturbed areas, and land ownership. This database can be viewed and obtained via http://wind.tnc.org/awwi. Wind project developers can use this web tool to identify potentially sensitive areas and areas that are already disturbed and are therefore likely to be less sensitive to additional impacts from wind development. The United States goal of producing 20% of its electricity from wind energy by the year 2030 would require 241 GW of terrestrial nameplate capacity. We analyzed whether this goal could be met by using lands that are already disturbed, which would minimize impacts to wildlife. Our research shows that over 14 times the DOE goal could be produced on lands that are already disturbed (primarily cropland and oil and gas fields), after taking into account wind resource availability and areas that would be precluded from wind development because of existing urban development or because of development restrictions. This work was published in the peer reviewed science journal PLoS ONE (a free online journal) and can be viewed here: http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0017566. Even projects that are sited appropriately may have some impacts on wildlife habitat that can be offset with offsite compensatory mitigation. We demonstrate one approach to mapping and quantifying mitigation costs, using the state of Kansas as a case study. Our approach considers a range of conservation targets (species and habitat) and calculates mitigation costs based on actual costs of the conservation actions (protection and restoration) that would be needed to fully offset impacts. This work was published in the peer reviewed science journal PLoS ONE (a free online journal) and can be viewed here: http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0026698.

17 WIND ENERGY↗

Update transport - A new technique for update synchronization in replicated database systems

A fully distributed approach to update synchronization is presented where each site completely executes every update. This approach has several features-higher resiliency to different kinds of failures, higher parallelism, improved response to user requests, and low communication overhead. A fully distributed algorithm for concurrency control obtained by rehashing a previously published semidistributed algorithm into the fully distributed model of update execution is presented. A performance model of replicated database systems is presented and used to study the performance of the proposed algorithm and its semidistributed version. The results of the performance study reveal that the proposed approach can substantially improve the performance at the cost of moderate input/output overhead.

Singhal, Mukesh↗

System for Performing Single Query Searches of Heterogeneous and Dispersed Databases

The present invention is a distributed computer system of heterogeneous databases joined in an information grid and configured with an Application Programming Interface hardware which includes a search engine component for performing user-structured queries on multiple heterogeneous databases in real time. This invention reduces overhead associated with the impedance mismatch that commonly occurs in heterogeneous database queries.

Maluf, David A.↗