Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data Distribution Service”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

Design and early experience with promoting user-created data in CMS

The Computing Model of the CMS experiment [1] does not address transfering user-created data between different Grid sites. Due to the limited resources of a single site, distribution of individual user-created datasets between sites is crucial to ensure accessibility. In contrast to official datasets, there are no special requirements for user datasets (e.g. concerning data quality). The StoreResults service provides a mechanism to elevate user-created datasets to central bookkeeping ensuring the data quality is the same as an official dataset. This is a prerequisite for further distribution within the CMS dataset infrastructure.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

UASs in the VOG/Edge/FOG Sensor Web Environment

This paper will describe the evolution of information collection, derivation and delivery mechanisms in sensor webs utilizing Uninhabited Aerial Systems (UAS).We will discuss the movement to "Fog Computing", also known as Edge Computing. Fog Computing facilitates the distribution of common operations and networking between edge devices and cloud computing facilities, optimizing the production of actionable intelligence. Initially, UASs utilized onboard data collection as standard, with minimal data downloaded directly. Information products were derived in conventional computational environments, generally desk top computers, and information products made available to the Science Community in weeks or months. With the increased availability, and increasingly lower costs, of beyond line of sight (BLOS) satellite based communication, transmission rates and data volumes increased, and processing migrated to Cloud based services. Contemporary UASs are moving some of that information product derivation to on vehicle services, and are creating a distributed Cloud/Fog environment. The Author will describe the technological advances that have made this possible, including low power multi-core Central Processing Units (CPU), and, more recently, the availability of high end Graphical Processing Units (GPU) that consume only a few watts. Intelligent system software, leveraging these hardware advances, finally allows for information product generation on-board, rather than simple data collection. Additionally, intelligent flight control systems now support mutual vehicle to vehicle collaboration, allowing UASs to create ad-hoc sensor webs on demand, as required. Also discussed will be the lessons learned by the Authors' development of data systems for NASA's large High Altitude Long Endurance (HALE) UASs like Predator and Global Hawk, and how those lessons are being applied to other UAS development This paper will focus on applications, rather a deep dive into the technology, and will highlight improving data management through these new technologies.

UAS↗

Planetary Boundary Layer Height from AIRS and MERRA-2 Products at NASA GES DISC, and Insights from Data Intercomparison

The Atmospheric Infrared Sounder (AIRS) is the hyperspectral infrared sounder onboard NASA's Aqua satellite, launched in 2002. The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC), in collaboration with NASA Sounder Team at JPL, provides processing, archiving, and distribution services for NASA sounders: the Aqua AIRS mission and the subsequent Suomi-National Polar-orbiting Partnership Cross-track Infrared Sounder (CrIS) mission. The Planetary Boundary Layer (PBL) Height is a new variable added in the AIRS Version 6 support product. It is derived based on gradients of the retrieved atmospheric thermodynamic profile, and gives the pressure at the top of PBL over the ocean. The GES DISC also provides services for the second Modern-Era Retrospective analysis for Research and Applications (MERRA-2) product generated by the Goddard Earth Observing System Model, Version 5 (GEOS-5) data assimilation system. The monthly PBL Height variable has been available in the Giovanni system, which is a Web-based application developed by the GES DISC providing a simple and intuitive way to visualize, analyze, and access vast amounts of Earth science remote sensing data. In this work, we will present the monthly PBL Height data from AIRS and MERRA-2 and the services to support data intercomparison, such as access, plotting, subsetting, re-gridding, and generation of a multi-year monthly mean. We will also show intercomparison results, and evaluate whether (over the ocean) AIRS can observe PBL features similar to the reanalysis product at monthly and longer-term scales.

AIRS↗

A global R&D storage platform implementing distributed Quality of Service [PowerPoint]

The objectives of the program include: Provide facility R&D to match software R&D; Providing a federated system for the optimization of the various storage types (QoS) and reduction of the required manpower to operate storage; and, ''Data lake'': Hiding complexity behind common interfaces and leave it to the distributed lake infrastructure to solve those issues, being: Transpareent change of storage technologies (time, price); and, Data available for low latency access when needed (staging) and safely archived if configured (Long term archive).

43 PARTICLE ACCELERATORS↗

Facility Cybersecurity Framework Best Practices

Federal facilities are increasingly adopting automation and connecting to the Internet creating an energy-internet-of-things environment that converges operational technology (OT) and information technology (IT). Today's buildings increasingly weave together networked sensors and cyber and physical systems that enable data to be collected, aggregated, exchanged, stored and monetized in new ways. Building technological advances have created new energy technology, services, markets and value creation opportunities (e.g. transactive energy, two-way grid communications, machine learning, and increased use of renewable and distributed energy resources). But as larger data sets are being exchanged at faster speeds between an increasing number of OT systems, it becomes more difficult to protect the security of the data lifecycle and the physical equipment it interacts with. These challenges are especially difficult to overcome because the economic and environmental gain (interoperability, big data, social networks and ubiquitous information sharing) are driving these prominent trends in the digital age. Often cybersecurity is an afterthought. The U.S. Department of Energy’s (DOE) Federal Energy Management Program (FEMP) funded the Pacific Northwest National Laboratory (PNNL) to develop various cybersecurity tools, trainings, and reports to aid federal facility managers – and other building owners and operators – in better applying frameworks and lessons learned from the National Institute of Standards and Technology (NIST) Cybersecurity Framework (CSF), risk management framework (RMF), DOE’s cybersecurity capability maturity model (C2M2), and a wide variety of industry best practices and guidance documents (i.e., NIST 800 series, Department of Defense United Facilities Criteria). This set of tools, collectively known as the FEMP Facility-Related Control System Cyber Toolkit (FRCS Cyber Toolkit)2, is focused on cybersecurity concerns from facility-related control systems and other operational technology (OT), such as industrial control systems (ICS). The FRCS Cyber Toolkit can be applied across six of the sixteen critical infrastructure sectors designated by the Department of Homeland Security, including government facilities, healthcare and public health, commercial facilities (e.g., public assembly, offices, lodging), financial services (e.g., banking and insurance), emergency services (e.g., fire and police stations), and information technology. With increasingly converged IT and OT systems, it is crucial to address OT cybersecurity considerations and assess how the seam of these two systems could impact the overall cybersecurity posture of a facility. The objective of this report is to provide an overview of the best possible method to use FRCS Cyber Toolkit (section 2.0) and distilled cybersecurity best practices for the federal facilities to address growing non-linear cyber threats (section 3.0). Recommendations in this document are aggregated from several NIST and other documents (see Appendix A for additional details).

97 MATHEMATICS AND COMPUTING↗

Cloud-Based Orchestration of a Model-Based Power and Data Analysis Toolchain

The proposed Europa Mission concept contains many engineering and scientific instruments that consume varying amounts of power and produce varying amounts of data throughout the mission. System-level power and data usage must be well understood and analyzed to verify design requirements. Numerous cross-disciplinary tools and analysis models are used to simulate the system-level spacecraft power and data behavior. This paper addresses the problem of orchestrating a consistent set of models, tools, and data in a unified analysis toolchain when ownership is distributed among numerous domain experts. An analysis and simulation environment was developed as a way to manage the complexity of the power and data analysis toolchain and to reduce the simulation turnaround time. A system model data repository is used as the trusted store of high-level inputs and results while other remote servers are used for archival of larger data sets and for analysis tool execution. Simulation data passes through numerous domain-specific analysis tools and end-to-end simulation execution is enabled through a web-based tool. The use of a cloud-based service facilitates coordination among distributed developers and enables scalable computation and storage needs, and ensures a consistent execution environment. Configuration management is emphasized to maintain traceability between current and historical simulation runs and their corresponding versions of models, tools and data.

Post, Ethan↗

Confidentiality-preserving machine learning algorithms for soft-failure detection in optical communication networks

Automated fault management is at the forefront of next-generation optical communication networks. The increase in complexity of modern networks has triggered the need for programmable and software-driven architectures to support the operation of agile and self-managed systems. In these scenarios, the European Telecommunications Standards Institute zero-touch network and service management approach is imperative. The need for machine learning algorithms to process the large volume of telemetry data brings safety concerns as distributed cloud-computing solutions become the preferred approach for deploying reliable communication network automation. This paper’s contribution is twofold. First, we propose a simple yet effective method to guarantee the confidentiality of the telemetry data based on feature scrambling. The method allows the operation of third-party computational services without direct access to the full content of the collected data. Additionally, the effectiveness of four unsupervised machine learning algorithms for soft-failure detection is evaluated when applied to the scrambled telemetry data. The methods are based on factor analysis, principal component analysis, nonlinear principal component analysis, and singular value decomposition. Most dimensionality reduction algorithms have the common property that they can maintain similar levels of fault classification performance while hiding the data structure from unauthorized access. Evaluations of the proposed algorithms demonstrate this capability.

97 MATHEMATICS AND COMPUTING↗

CLARA: A Contemporary Approach to Physics Data Processing

In traditional physics data processing (PDP) systems, data location is static and is accessed by analysis applications. In comparison, CLARA (CLAS12 Reconstruction and Analysis framework) is an environment where data processing algorithms filter continuously flowing data. In CLARA's domain of loosely coupled services, data is not stored, but rather flows from one service to another, mutating constantly along the way. Agents, performing event processing, can then subscribe to particular data/events at any stage of the data transformation, and make intricate decisions (e.g. particle ID) by correlating events from multiple, parallel data streams and/or services. This paper presents a PDP application development framework based on service oriented and event driven architectures. This system allows users to design (Java, C++, and Python languages are supported) and deploy data processing services, as well as dynamically compose PDP applications using available services. The PDP service bus provides a layer on top of a distributed pub-sub middleware implementation, which allows complex service composition and integration without writing code. Examples of service creation and deployment, along with the CLAS12 track reconstruction application design will be presented.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Temperature Anomalies from the AIRS Product in Giovanni for the Climate Community

The Atmospheric Infrared Sounder (AIRS) mission began with the launch of Aqua in 2002. Over 15 years of AIRS products have been used by the climate research and application communities. The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC), in collaboration with NASA Sounder Team at JPL, provides processing, archiving, and distribution services for NASA sounders: the present Aqua AIRS mission and the succeeding Suomi National Polar-Orbiting Partnership (SNPP) Cross-track Infrared Sounder (CrIS) mission. We generated a Multi-year Monthly Mean and Anomaly product using 14 years of AIRS standard monthly product. The product includes Air Temperature at the Surface and Surface Skin Temperature, both in Ascending/Daytime and Descending/Nighttime mode. The temperature variables and their anomalies are deployed to Giovanni, a Web-based application developed by the GES DISC. Giovanni provides a simple and intuitive way to visualize, analyze, and access vast amounts of Earth science remote sensing data without having to download the data. It is also a powerful tool that stakeholders can use for decision support in planning and preparing for increased climate variability. In this presentation, we demonstrate the functions in Giovanni with use cases employing AIRS Multi-year Monthly Mean and Anomaly variables.

Giovann↗

An Integrated and Collaborative Approach for NASA Earth Science Data

Earth science research requires coordination and collaboration across multiple disparate science domains. Data systems that support this research are often as disparate as the disciplines that they support. These distinctions can create barriers limiting access to measurements, which could otherwise enable cross-discipline Earth science. NASA's Earth Observing System Data and Information System (EOSDIS) is continuing to bridge the gap between discipline-centric data systems with a coherent and transparent system of systems that offers up to date and engaging science related content, creates an active and immersive science user experience, and encourages the use of EOSDIS earth data and services. The new Earthdata Coherent Web (ECW) project encourages cohesiveness by combining existing websites, data and services into a unified website with a common look and feel, common tools and common processes. It includes cross-linking and cross-referencing across the Earthdata site and NASA's Distributed Active Archive Centers (DAAC), and by leveraging existing EOSDIS Cyber-infrastructure and Web Service technologies to foster re-use and to reduce barriers to discovering Earth science data (http://earthdata.nasa.gov).

Murphy, K.↗

Kepler Science Operations Center Pipeline Framework

The Kepler mission is designed to continuously monitor up to 170,000 stars at a 30 minute cadence for 3.5 years searching for Earth-size planets. The data are processed at the Science Operations Center (SOC) at NASA Ames Research Center. Because of the large volume of data and the memory and CPU-intensive nature of the analysis, significant computing hardware is required. We have developed generic pipeline framework software that is used to distribute and synchronize the processing across a cluster of CPUs and to manage the resulting products. The framework is written in Java and is therefore platform-independent, and scales from a single, standalone workstation (for development and research on small data sets) to a full cluster of homogeneous or heterogeneous hardware with minimal configuration changes. A plug-in architecture provides customized control of the unit of work without the need to modify the framework itself. Distributed transaction services provide for atomic storage of pipeline products for a unit of work across a relational database and the custom Kepler DB. Generic parameter management and data accountability services are provided to record the parameter values, software versions, and other meta-data used for each pipeline execution. A graphical console allows for the configuration, execution, and monitoring of pipelines. An alert and metrics subsystem is used to monitor the health and performance of the pipeline. The framework was developed for the Kepler project based on Kepler requirements, but the framework itself is generic and could be used for a variety of applications where these features are needed.

Klaus, Todd C.↗

The Value of Being a Trustworthy Repository

Today, NASA's Earth Observing System Data and Information System (EOSDIS), a system ofactive archives is attaching the CoreTrustSeal to its websites signifying that it merits theconfidence of its user community. But what value does being a trustworthy repository impart to auser? What does it mean to the owners and operators of repositories? What will it mean in thefuture? EOSDIS was started in the 1990s based on a framework of discipline-oriented, geographicallydistributed centers of expertise, named Distributed Active Archive Centers (DAACs). The functionof EOSDIS is to collect Earth Science data sensor measurements (principally those created andneeded by NASA) and manage the data and many derived digital products. EOSDIS providesmany services, including processing, curating, documenting, disseminating, and enabling datadiscovery as well as efficient use of the data. The EOSDIS has been operational over 25 years andmany lessons have been learned relative to the TRUST principles. During the tenure of EOSDIS,many changes have occurred as we have increased the size of the collection from gigabytes totens of petabytes and the distribution of the data to millions of users. We have had severalstages of system evolution that have improved EOSDIS in order to meet both stakeholder andcustomer expectations. This type of evolution is an on-going process to ensure that ourrepositories remain trustworthy. It is also important that our own community of data managersand system engineers add value in being trustworthy. This paper will discuss approaches to change within a large system of Earth Science data and services, while remaining a trustworthyrepository.

Behnke, Jeanne↗

Berkeley Nuclear Data Cloud (BDC) v2.3

The software was developed to serve and curate arbitrarily large datasets comprising data acquired from various mobile platforms. The software is contained in a number of server and client libraries. The former manage the ingestion, indexing, querying, and serving of the data. The latter libraries are distributed for Linux, Mac OSX, and Windows and enable users to interact with data downloaded from the service either in the form of an HDF5 file or streamed in a BSON data chunk. Using the Berkeley Data Cloud, researchers from varying fields can collaborate, compare results and curate both their raw data and the derived products of their analysis.

Cholia, Shreyas↗

Analysis of FDDI synchronous traffic delays

The Fiber Distributed Data Interface (FDDI) high-speed token-ring protocol provides support for two classes of service: synchronous, to support applications which require deterministic access to the channel, and asynchronous, to support applications which do not have such stringent response-time requirements. The purpose of this paper is to determine how to set ring parameters to support synchronous traffic most efficiently. Both theoretical results and results obtained from a simulation study are presented.

Johnson, Marjory J.↗

A demonstration of centimeter-level monitoring of polar motion with the Global Positioning System

Daily estimates of the Earth's pole position were obtained with the Global Positioning System (GPS) by using measurements obtained during the GPS IERS (International Earth Rotation Service) and Geodynamics (GIG'91) experiment from 22 Jan. to 13 Feb. 1991. Data from a globally distributed network consisting of 21 Rogue GPS receivers were chosen for the analysis. A comparison of the GPS polar motion series with nine 24-hour very long baseline interferometry (VLBI) estimates yielded agreement in the day-to-day pole position of about 1.5 cm for both X and Y polar motion. A similar comparison of GPS and satellite laser ranging (SLR) data showed agreement to about 1.0 cm. These preliminary results indicate that polar motion can be determined by GPS independent of, and at a level comparable to, that which is obtained from either VLBI or SLR. Furthermore, GPS can provide these data with a daily frequency that neither alternative technique can readily achieve. Thus, GPS promises to be a powerful tool for determining high-frequency platform parameter variation, essential for the ultraprecise spacecraft-tracking requirements of the coming years.

Lindqwister, U. J.↗

Land-mobile-satellite fade measurements in Australia

Attenuation measurements were implemented at L-band (1.5 GHz) in southeastern Australia during an 11-day period in October 1988 as part of a continuing examination of the propagation effects due to roadside trees and terrain for mobile-satellite service. Beacon transmissions from the geostationary ETS-V and IPORS satellites were observed. The Australian campaign expanded to another continent our Mobile Satellite Service data base of measurements executed in the eastern and southwestern United States regions. An empirical fade distribution model based on U.S. data predicted the Australian results with errors generally less than 1 dB in the 1-20 percent probability region. Directive antennas are shown to suffer deeper fades under severe shadowing conditions (3 dB excess at 4 percent), the equal-probability isolation between co- and cross-polarized transmissions deteriorated to 10 dB at the 5 dB fade level, and antenna diversity reception may reduce unavailability of the system by a factor of 2-8.

Vogel, Wolfhard J.↗

Data Distribution Satellite

The Data Distribution Satellite (DDS) is described in terms of its role in providing space-data and communication services for the National Research and Education Network. The DDS is envisioned as a processing link in the microwave network that would connect academic, industrial, and government institutions to a high-data-rate service of space data. The general need for science communications is assessed, and it is shown that the data potential exceeds the available spectrum. The DDS could act as a bridge between terrestrial facilities the space network, and other space platforms to provide efficient access to space science data. Government demand for this type of data is high suggesting that the DDS could make use of hopping beams to provide more data at reduced costs.

Stevens, Grady H.↗

Overview of NASA Glenn Aero/Mobile Communication Demonstrations

The Glenn Research Center at Lewis Field (GRC) has been involved with several other NASA field centers on various networking and RF communications demonstrations and experiments since 1998. These collaborative experiments investigated communications technologies new to aviation, such as wideband Ku satcom, L-band narrowband satcom, and IP (Internet Protocol), using commercial off-the-shelf (COTS) components These technologies can be used to distribute weather and hazard data, air traffic management and airline fleet management information, and passenger cabin Internet service.

Brooks, David↗