Search NASA⌕ Search

SEARCH · Search NASA

Results for “and data analytics architecture.”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2019

Software Defined Architectures for Data Analytics

Data analytics applications increasingly are complex workflows composed of phases with very different program behaviors (e.g., graph algorithms and machine learning, algorithms operating on sparse an dense data structures, etc). To reach the levels of efficiency required to process these workflows in real time, upcoming architectures will need to leverage even more workload specialization. If, at one end, we may find even more heterogenous processors composed by a myriad of specialized processing elements, at the other end we may see novel reconfigurable architectures, composed of sets of functional units and memories interconnected with (re)configurable on-chip networks, able to adapt dynamically to adapt the workload characteristics. Field Programmable Gate Arrays are more and more used for accelerating various workloads and, in particular, inferencing in machine learning, providing higher efficiency than other solutions. However, their fine grained nature still leads to issues for the design software and still makes dynamic reconfiguration impractical. Future, more coarse-grained architectures could offer the features to execute diverse workloads at high efficiency while providing better reconfiguration mechanisms for dynamic adaptability. Nevertheless, we argue that the challenges for reconfigurable computing remain in the software. In this position paper, we describe a possible toolchain for reconfigurable architectures targeted at data analytics.

FPGA, Dataflow, Reconfigurable Architectures, Soft↗
DOE OSTI2022

Data Architecture and Analytics Requirements for Artificial Intelligence and Machine Learning Applications to Achieve Condition-Based Maintenance

This report identified some of the important requirements that needs to be taken into consideration as part of the data evolution for the CBM application of a CWS in a NPP. In the data evolution process, the information is converted into insight leading into actions using advancements in AI/ML technologies. A notion of RESET AI: design, development, deployment, and operation principals are introduced to lifecycle of AI technologies. Towards the end of the report, we discussed how this CBM can be realized in a SDE. As path forward, this report lays the foundation for developing a more detailed industry guidance supporting data evolution for other plant applications like operations and plant support. These would be developed as part of ongoing research in the fiscal year 2023.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2014

PMU Data Integrity Evaluation through Analytics on a Virtual Test-Bed

Power systems are rapidly becoming populated by phasor measurement units (PMUs) in ever increasing numbers. PMUs are critical components of today s energy management systems, designed to enable near real-time wide area monitoring and control of the electric power system. They are able to measure highly accurate bus voltage phasors as well as branch current phasors incident to the buses at which PMUs are equipped. Synchrophasor data is used for applications varying from state estimation, islanding control, identifying outages, voltage stability detection and correction, disturbance recording, and others. However, PMU-measured readings may suffer from errors due to meter biases or drifts, incorrect configurations, or even cyber-attacks. Furthermore, the testing of early PMUs showed a large disparity between the reported values from PMUs provided by different manufacturers, particularly when frequency was off-nominal, during dynamic events, and when harmonic/inter-harmonic content was present. Detection and identification of PMU gross measurement errors are thus crucial in maintaining highly accurate phasor readings throughout the system. In this paper, we present our work in conducting analytics to determine the trustworthiness and worth of the PMU readings collected across an electric network system. By implementing the IEEE 118 bus test case on a virtual test bed (VTB) , we are able to emulate PMU readings (bus voltage and branch current phasors in addition to bus frequencies) under normal and abnormal conditions using (virtual) PMU sensors deployed across major substations in the network. We emulate a variety of failures such as bus, line, transformer, generator, and/or load failures. Data analytics on the voltage phase angles and frequencies collected from the PMUs show that specious (or compromised) PMU device(s) can be identified through abnormal behaviour by comparing the trend of its frequency and phase angle reading with the ensemble of all other PMU readings in the network. If the reading trend of a particular PMU deviates from the weighted average of the reading trends of other PMUs at nearby substations, then it is likely that the PMU is malfunctioning. We assign a weight to each PMU denoting how electric-topology-wise close it is from where the PMU under consideration is located. The closer a PMU is, the higher the weight it has. To compute the closeness between two nodes in the power network, we employ a form of the resistance distance metric. It computes the electrical distance by taking into consideration the underlying topology as well as the physical laws that govern the electrical connections or flows between the network components. The detection accuracy of erroneous PMUs should be improved by employing this metric. We present results to validate the proposed approach. We also discuss the effectiveness of using an end-to-end VTB approach that allows us to investigate different types of failures and their responses as seen by the ensemble of PMUs. The collected data on certain types of events may be amenable to certain types of analysis (e.g., alerting for sudden changes can be done on a small window of data) and hence determine the data analytics architectures is required to evaluate the streaming PMU data.

and data analytics architecture.↗
DOE OSTI2019

Big-Data Analytics for Electric Grid and Demand-Side Management

This report describes research to characterize the status of, and trends in, big-data analytics for the electricity grid. The research focused on 1) identifying power-grid big-data sources, types, and characteristics; and 2) characterizing big-data architecture, analytic methods, technology applications, and challenges. The first part of this report describes the main sources and characteristics of big data for the smart grid and comprehensively reviews big-data architecture, technologies, and applications in the power sector. The second part of this report presents case studies of big data applications in the power industry: (1) a smart-meter data and predictive analytics method for demand response (DR), (2) synchrophasor data analytics for the distribution grid, and (3) utility data for peak-demand management. For the predictive analytics case study, smart-meter-data-driven and physical models were developed to predict the potential kilowatt (kW) capacity reduction from DR. The DR estimation framework that was developed works for both small and large-scale customers. The synchrophasor case study demonstrates use of an algorithm applied to time-series data to detect events that appear as significant changes, known as “edges,” in voltage magnitude measurements. The synchrophasor case study also introduces an approach for clustering sets of events to reveal unique features that distinguish them (e.g., distinguishing capacitor bank switching from transformer tap changes). The peak-demand management case study describes the use of the data analytics to enable DR programs to limit forecasted peak demand, resulting in cost savings to the utility. The findings from the research described in this report support identification of opportunities and technologies for big-data and analytics applications for demand-side management in the power sector as well as other approaches to modernizing the electricity grid.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS2019

A Web of Data Analytics Services

Cloud Computing has become the ubiquitous approach to our Big Data challenge. However, one will quickly discover that moving (a.k.a. forklifting) existing on-premise data analytics solutions to the Cloud doesn’t always translate to costing saving and performance boost. The Cloud’s elasticity, its availability, and its wide selection of computing options and selections of costing models making Cloud an attractive environment to tackle our Big Data challenge. The fact is Cloud, on its own, is not the silver bullet to our daunting challenge need for analyze and derive scientific inferences through vast collections of multi-sensor measurements. We would like to have all scientific data in one easy to access environment, but getting the world of scientific data in one analytic system is immensely difficult to achieve. This paper describes the data analytics web architecture NASA is developing by infusing instances of Integrated Data Analytics systems next to the data. The goal is to minimize unnecessary data movement through collection of data access and analytics webservices for researchers to interact with and analyze measurements without have to download data to their local computer. These services are RESTful and provisioned by the data centers with the help from subject matter and science experts. These services encapsulate the physical computing infrastructure, which could local computing cluster, on-premise or public Cloud environment.

Huang, Thomas↗
NASA NTRS2003

The Aeronautical Data Link: Decision Framework for Architecture Analysis

A decision analytic approach that develops optimal data link architecture configuration and behavior to meet multiple conflicting objectives of concurrent and different airspace operations functions has previously been developed. The approach, premised on a formal taxonomic classification that correlates data link performance with operations requirements, information requirements, and implementing technologies, provides a coherent methodology for data link architectural analysis from top-down and bottom-up perspectives. This paper follows the previous research by providing more specific approaches for mapping and transitioning between the lower levels of the decision framework. The goal of the architectural analysis methodology is to assess the impact of specific architecture configurations and behaviors on the efficiency, capacity, and safety of operations. This necessarily involves understanding the various capabilities, system level performance issues and performance and interface concepts related to the conceptual purpose of the architecture and to the underlying data link technologies. Efficient and goal-directed data link architectural network configuration is conditioned on quantifying the risks and uncertainties associated with complex structural interface decisions. Deterministic and stochastic optimal design approaches will be discussed that maximize the effectiveness of architectural designs.

Morris, A. Terry↗
NASA NTRS2019

Cloud Giovanni: Reining in Costs and Improving Performance with Analytical Data Stores Using Scalable Serverless Architecture

Giovanni is the Geospatial Interactive Online Visualization ANd aNalysis Infrastructure developed at NASA GES DISC which provides a simple and intuitive way to visualize, analyze, and access vast amounts of Earth science data. It receives large number of user requests each day for a variety of analysis and visualization services, which leads to the big data challenge of serving gradually increasing large data volumes with diverse statistical algorithms. We hereby propose a multi-dimensional accumulation method which provides fast and cost-efficient cloud analysis for diverse services including both area averaging and time averaging. This method involves the weighted volume integration over multiple variable dimensions (time and space), and is implemented in AWS using Athena providing serverless and highly scalable data analysis. Compared to the standard method, this approach dramatically reduced the computational time by order of magnitude with a minimal AWS cost incurred. For example, for a benchmark of 10-year area averaging over the 1x1 degree daily variable, the computational time was reduced from minutes to seconds, and the Athena cost is only $5 for 100,000 requests.

Zhang, Hailiang↗
DOE OSTI2018

ELINA

Explore the source record for details and available documents.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Integrated Operations for Nuclear: Work Reduction Opportunity Demonstration

Integrated Operations for Nuclear: Work Reduction Opportunity Demonstration The DI BCA document also identifies specific, digitally enabled WRO categories for further study. These were selected as most relevant by Reference Plant personnel from a larger list of WRO areas identified across the nuclear industry as captured INL/RPT-21-64134, “Process for Significant Nuclear Work Function Innovation Based on Integrated Operations Concepts.” This ION WRO demonstration report was developed to provide illustrative, specific, and actionable direction for intertwined PTPG changes associated with digital modernization efforts. The coordinated changes in these areas are intended to maximize safe plant operational and economic performance. This includes enabling WROs associated with detailed configuration, implementation, and use of digital systems and how they are supported over their lifecycle. Illustrating this direction through a minimum set of advanced technology examples establishes a model PTPG framework that can be leveraged across the spectrum of nuclear plant digital modernization efforts going forward. This document addresses many related concepts. To promote an integrated understanding of the topics that make up this work, this document contains an extensive set of internal hyperlinks. This set includes hyperlinks to page numbers in the table of contents, section numbers, items in lists, figures, tables, and references to other documents within the report. When hovering the cursor above hyperlinked text in Adobe, the cursor will change from “ ” to “ .” When the “ ” appears, a left mouse click will take the reader to the referenced location in the document. To return to the original location in the document, the reader need only press and hold the “alt” button on the keyboard and then simultaneously press the “<” directional key on the keyboard.

42 ENGINEERING↗
NASA NTRS2019

NASA Electronic Parts and Packaging (NEPP) Program Status and Technology Investments Overview

The presentation provides an updated, high-level overview of the NEPP Program. The latest organizational chart is presented that shows the names of the Program and Assistant Program Managers. Additionally, the recent work that is on-going with the updating of several NASA NPDs, NPRs and technical standards is reviewed. Internal and external organizational interfaces are described. Finally, the current technology focus areas are described. These areas include passives, wide-band gap power devices, processor units (CPUs and GPUs), 2.5D and 3D device architectures, memories, and data analytics.

NEPAG↗
DOE OSTI2015

Scalable and Power Efficient Data Analytics for Hybrid Exascale Systems

This project developed a generic and optimized set of core data analytics functions. These functions organically consolidate a broad constellation of high performance analytical pipelines. As the architectures of emerging HPC systems become inherently heterogeneous, there is a need to design algorithms for data analysis kernels accelerated on hybrid multi-node, multi-core HPC architectures comprised of a mix of CPUs, GPUs, and SSDs. Furthermore, the power-aware trend drives the advances in our performance-energy tradeoff analysis framework which enables our data analysis kernels algorithms and software to be parameterized so that users can choose the right power-performance optimizations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2016

Towards a Heterogeneous, Polystore-like Data Architecture for the US Department of Veteran Affairs (VA) Enterprise Analytics

The Polystore architecture revisits the federated approach to access and querying of the standalone, independent databases in the uniform and optimized fashion, but this time in the context of heterogeneous data and specialized analyses. In the light of this architectural philosophy, and in the light of the major data architecture development efforts at the US Department of Veterans Administration (VA), we discuss the need for the heterogeneous data store consisting of the large relational data warehouse, an image and text datastore, and a peta-scale genomic repository. The VA's heterogeneous datastore would, to a larger or smaller degree, follow the architectural blueprint proposed by the polystore architecture. To this end, we discuss the current state of the data architecture at VA, architectural alternatives for development of the heterogeneous datastore, the anticipated challenges, and the drawbacks and benefits of adopting the polystore architecture.

Federated Databases↗
DOE OSTI2020

Opportunities for an Integrated Web-Based Workbench for Data Access and Analysis - 20244

Management of environmental issues can require integration of multiple types of data and information, conducting data analysis and interpretation, and providing data visualization for effective communications. These data elements are important for site management to support regulator interactions and provide defensibility for remedial decisions. Databases and information repositories are core elements of managing data; however, efficient data access and analysis also enable effective site management. The U.S. Department of Energy (DOE) Hanford Site is an example of a complex site with a voluminous quantity of environmental data and a need for efficient site management. Different tiers of data and information tools have been developed and deployed to address site needs. These tools are configured for ready access via the web site interfaces and meet the rigorous quality requirements for environmental site management. Evolving efforts are focused on an integrated platform to meet site environmental management needs. In this platform, users can access site information at multiple levels of detail based on their need and permissions, so that data and associated analyses are presented within the context of the site mission and the user's management or technical needs. This concept is not only applicable at individual sites like Hanford but also applicable at other sites within the DOE complex. An integrated web-based architecture that links data visualization, data analytics, and management tools can provide holistic access to large data sets, minimize complexity, and maximize interactivity and technical communication. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2021

Cyber-Physical System Implementation for Manufacturing With Analytics in the Cloud Layer

Effective and efficient modern manufacturing operations require the acceptance and incorporation of the fourth industrial revolution, also known as Industry 4.0. Traditional shop floors are evolving their production into smart factories. To continue this trend, a specific architecture for the cyber-physical system is required, as well as a systematic approach to automate the application of algorithms and transform the acquired data into useful information. This work makes use of an approach that distinguishes three layers that are part of the existing Industry 4.0 paradigm: edge, fog, and cloud. Each of the layers performs computational operations, transforming the data produced in the smart factory into useful information. Trained or untrained methods for data analytics can be incorporated into the architecture. A case study is presented in which a real-time statistical control process algorithm based on control charts was implemented. The algorithm automatically detects changes in the material being processed in a computerized numerical control (CNC) machine. The algorithm implemented in the proposed architecture yielded short response times. The performance was effective since it automatically adapted to the machining of aluminum and then detected when the material was switched to steel. The data were backed up in a database that would allow traceability to the line of g-code that performed the machining.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2016

A Conceptual Architecture for National Biosurveillance: Moving Beyond Situational Awareness to Enable Digital Detection of Emerging Threats

Despite numerous calls for improvement, the U.S. biosurveillance enterprise remains a patchwork of uncoordinated systems that fail to take advantage of the rapid progress in information processing, communication, and analytics made in the past decade. By synthesizing components from the extensive biosurveillance literature, we propose a conceptual framework for a national biosurveillance architecture and provide suggestions for implementation. The framework differs from the current federal biosurveillance development pathway in that it is not focused on systems useful for “situational awareness,” but is instead focused on the long-term goal of having true warning capabilities. Therefore, a guiding design objective is the ability to digitally detect emerging threats that span jurisdictional boundaries, because attempting to solve the most challenging biosurveillance problem first provides the strongest foundation to meet simpler surveillance objectives. Core components of the vision are: (1) a whole-of-government approach to support currently disparate federal surveillance efforts that have a common data need, including those for food safety, vaccine and medical product safety, and infectious disease surveillance; (2) an information architecture that enables secure, national access to electronic health records, yet does not require that data be sent to a centralized location for surveillance analysis; (3) an inference architecture that leverages advances in ‘big data’ analytics and learning inference engines—a significant departure from the statistical process control paradigm that underpins nearly all current syndromic surveillance systems; and, (4) an organizational architecture with a governance model aimed at establishing national biosurveillance as a critical part of the U.S. national infrastructure. Although it will take many years to implement, and a national campaign of education and debate to acquire public buy-in for such a comprehensive system, the potential benefits warrant increased consideration within the U.S. government.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2017

Spherical Region Queries on Multicore Architectures

In this short paper, we report the performance of multiple thread-parallel algorithms for spherical region queries on multicore architectures motivated by a challenging data analytics application in materials science. Performances of two tree-based algorithms and a naive algorithm are compared to identify the length scales at which these approaches perform optimally. The optimal algorithm is then used to scale the driving materials science application, which is shown to deliver over 17X speedup using 32 OpenMP threads on data sets containing many millions of atoms.

Lu, Hao↗
NASA NTRS2016

Information Management Platform for Data Analytics and Aggregation (IMPALA) System Design Document

The System Design document tracks the design activities that are performed to guide the integration, installation, verification, and acceptance testing of the IMPALA Platform. The inputs to the design document are derived from the activities recorded in Tasks 1 through 6 of the Statement of Work (SOW), with the proposed technical solution being the completion of Phase 1-A. With the documentation of the architecture of the IMPALA Platform and the installation steps taken, the SDD will be a living document, capturing the details about capability enhancements and system improvements to the IMPALA Platform to provide users in development of accurate and precise analytical models. The IMPALA Platform infrastructure team, data architecture team, system integration team, security management team, project manager, NASA data scientists and users are the intended audience of this document. The IMPALA Platform is an assembly of commercial-off-the-shelf (COTS) products installed on an Apache-Hadoop platform. User interface details for the COTS products will be sourced from the COTS tools vendor documentation. The SDD is a focused explanation of the inputs, design steps, and projected outcomes of every design activity for the IMPALA Platform through installation and validation.

Carnell, Andrew↗