Search NASA⌕ Search

SEARCH · Search NASA

Results for “Streaming Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Characterizing filamentary magnetic structures in counter-streaming plasmas by Fourier analysis of proton images

Proton imaging is a powerful tool for probing electromagnetic fields in a plasma, providing a path-integrated map of the field topology. However, in cases where the field structure is highly inhomogeneous, inferring spatial properties of the underlying field from proton images can be difficult. This problem is exemplified by recent experiments, which used proton imaging to probe the filamentary magnetic field structures produced by the Weibel instability in collisionless counterstreaming plasmas. In this paper, we perform analytical and numerical analyses of proton images of systems containing many magnetic filaments. We find that, in general, the features observed on proton images do not directly correspond to the spacing between magnetic filaments (the magnetic wavelength) as has previously been assumed and that they instead correspond to the filament size. Furthermore, we demonstrate this result by Fourier analysis of synthetic proton images for many randomized configurations of magnetic filaments. Our results help guide the interpretation of experimental proton images of filamentary magnetic structures in plasmas.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Three-Dimensional Flow Analysis Methodology for Assessing Stream Stability and Channel Migration

Increases in the frequency and magnitude of weather events that deviate significantly from average are being observed both globally and in the U.S. Adaptation strategies need to account for and mitigate increased risks to transportation infrastructure that result from more extreme weather. The present study is a part of a project that covers a sensitivity study of the potential impacts of increases in stream flows due to rain events and floods on an active section of the Maple River near Iowa Highway 175 and Danbury, Iowa, which is shown. This study focuses on the use of advanced three-dimensional (3D) computational fluid dynamics (CFD) techniques to enhance the assessment of increased risks to stream stability of a section of the Maple River that may erode into Iowa Highway 175. The methodology developed and presented can be applied to a wide variety of streams and rivers that may face increased risk of migration due to changes in weather patterns and severity of weather events. The Maple River is a laterally active channel flowing through agricultural land that has migrated several hundred feet in recent decades and is currently within approximately 100 feet of the Highway 175 Right-of-Way. In addition to the near-term threat to the highway from the closest river meander, there is also a concern that other river meanders could develop into longer-term threats, especially if increasing intensity or frequency of rain events increase the rate of meander development and channel migration by changing the long-term hydrology of the Maple River.

54 ENVIRONMENTAL SCIENCES↗

Watermarks in stream processing systems: semantics and comparative analysis of Apache Flink and Google cloud dataflow

Streaming data processing is an exercise in taming disorder: from oftentimes huge torrents of information, we hope to extract powerful and timely analyses. But when dealing with streaming data, the unbounded and temporally disordered nature of real-world streams introduces a critical challenge: how does one reason about the completeness of a stream that never ends? In this paper, we present a comprehensive definition and analysis of watermarks, a key tool for reasoning about temporal completeness in infinite streams.First, we describe what watermarks are and why they are important, highlighting how they address a suite of stream processing needs that are poorly served by eventually-consistent approaches:• Computing a single correct answer, as in notifications.• Reasoning about a lack of data, as in dip detection.• Performing non-incremental processing over temporal subsets of an infinite stream, as in statistical anomaly detection with cubic spline models.• Safely and punctually garbage collecting obsolete inputs and intermediate state.• Surfacing a reliable signal of overall pipeline health.Second, we describe, evaluate, and compare the semantically equivalent, but starkly different, watermark implementations in two modern stream processing engines: Apache Flink and Google Cloud Dataflow.

Akidau, Tyler↗

Acoustic streaming jets: A scaling and dimensional analysis

We present our work on acoustic streaming free jets driven by ultrasonic beams in liquids. These jets are steady flows generated far from walls by progressive acoustic waves. As can be seen on figure 1, our set-up, denominated AStrID for Acoustic Streaming Investigation Device, is made of a water tank in which a 29 mm plane source emits continuous ultrasonic waves at typically 2 MHz. Our approach combines an experimental characterization of both the acoustic pressure field (hydrophone) and the obtained acoustic streaming velocity field (PIV visualization) on one hand, with CFD using an incompressible Navier-Stokes solver on the other hand.

42 ENGINEERING↗

STREAM: A technology planning and capacity expansion model for the industrial sector

The Strategic Technology Roadmapping and Energy, Environmental, and Economic Analysis Model—STREAM—is an optimization-based modeling tool and analysis framework to assist with strategic planning and technology investments of the industrial sector. This open-source framework is written in Julia using the JuMP package, which enables users to model future “pathways” for incumbent and future production technologies, costs, fuels and energy carriers, and energy and non-energy environmental impacts from industries as they transform in pursuit of a robust and competitive manufacturing sector. The model starts with an initial stock of industrial production technologies and assets at a facility level and then determines pathways that minimize cost, subject to an array of possible constraints on demand, market shares, environmental flows, and other exogenously specified operational considerations such as capacity utilization rates or regional energy costs. Key features of the framework include flexibility to model a wide range of industries and industrial technologies/processes at varying levels of granularity, ability to perform parametric sensitivity analyses, and ability to visualize model results using visualization objects.

capacity expansion↗

Interactive Visual Analysis of High Throughput Text Streams

The scale, velocity, and dynamic nature of large scale social media systems like Twitter demand a new set of visual analytics techniques that support near real-time situational awareness. Social media systems are credited with escalating social protest during recent large scale riots. Virtual communities form rapidly in these online systems, and they occasionally foster violence and unrest which is conveyed in the users language. Techniques for analyzing broad trends over these networks or reconstructing conversations within small groups have been demonstrated in recent years, but state-of- the-art tools are inadequate at supporting near real-time analysis of these high throughput streams of unstructured information. In this paper, we present an adaptive system to discover and interactively explore these virtual networks, as well as detect sentiment, highlight change, and discover spatio- temporal patterns.

sentiment analysis↗

Energy deposition model in STREAM with photon transport

Recent efforts have been taken to implement a photon transport module for the neutron transport analysis code STREAM, considering the explicit photon energy distribution in the problem instead of using the locally deposition assumption as employed in previous STREAM versions. The current energy release model in STREAM based on the On-the-fly energy released per fission model is modified accordingly to account for the photon energy deposition computed explicitly by this module. The impacts of the modified energy release model with photon transport in STREAM on the power distribution, fuel temperature and other core parameters during depletion with feedback calculations are studied on several problems from the VERA benchmark suit. Overall, the photon transport provides a better power map for depletion and feedback calculations, especially when strong gamma emitters are present. The fuel temperature, in general, is decreased when the photon transport is employed because fission gammas have been transported out of their birthplace. The new energy deposition model in STREAM with photon transport indicates that gamma energy accounts for about 9.7% of the total energy released in a fresh VERA5 2D core and rises to 10.5% at the End of Cycle. Around 2.5% of the total energy released will be deposited in the coolant in this 2D core. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A Visual Analytics Framework for Reviewing Streaming Performance Data

Understanding and tuning the performance of extreme-scale parallel computing systems demands a streaming approach due to the computational cost of applying offline algorithms to vast amounts of performance log data. Analyzing large streaming data is challenging because the rate of receiving data and limited time to comprehend data make it difficult for the analysts to sufficiently examine the data without missing important changes or patterns. To support streaming data analysis, we introduce a visual analytic framework comprising of three modules: data management, analysis, and interactive visualization. The data management module collects various computing and communication performance metrics from the monitored system using streaming data processing techniques and feeds the data to the other two modules. The analysis module automatically identifies important changes and patterns at the required latency. In particular, we introduce a set of online and progressive analysis methods for not only controlling the computational costs but also helping analysts better follow the critical aspects of the analysis results. Finally, the interactive visualization module provides the analysts with a coherent view of the changes and patterns in the continuously captured performance data. Through a multi-faceted case study on performance analysis of parallel discrete-event simulation, we demonstrate the effectiveness of our framework for identifying bottlenecks and locating outliers.

Human-centered computing↗

Parallel streaming between heterogeneous HPC resources for real-time analysis

Performing analysis or generating visualizations concurrently with high performance simulations can yield great benefits compared to post-processing data. Writing and reading large volumes of data can be reduced or eliminated, thereby producing an I/O cost savings. One such method for concurrent simulation and analysis is in transit - streaming data from the resource running the simulation to a separate resource running the analysis. In transit analysis can be beneficial since computational resources may not have certain resources needed for visualization and analysis (e.g. GPUs) and to reduce the impact of performing analysis tasks to the run time of the simulation. When sending and receiving data in transit, data redistribution mechanisms are needed in order to support heterogeneous data layouts that may be required by the simulation and analysis applications. The work described in this paper compares two mechanisms for on-the-fly data redistribution when streaming data in parallel between two distributed memory applications. Finally, our results show that it is often more advantageous to stream data in the same layout as the sender and redistribute data amongst processes on the receiving end than to stream data in the final layout needed by the receiver.

97 MATHEMATICS AND COMPUTING↗

SELECTING SAGITTARIUS: IDENTIFICATION AND CHEMICAL CHARACTERIZATION OF THE SAGITTARIUS STREAM

Wrapping around the Milky Way, the Sagittarius stream is the dominant substructure in the halo. Our statistical selection method has allowed us to identify 106 highly likely members of the Sagittarius stream. Spectroscopic analysis of metallicity and kinematics of all members provides us with a new mapping of the Sagittarius stream. We find correspondence between the velocity distribution of stream stars and those computed for a triaxial model of the Milky Way dark matter halo. The Sagittarius trailing arm exhibits a metallicity gradient, ranging from −0.59 to −0.97 dex over 142°. This is consistent with the scenario of tidal disruption from a progenitor dwarf galaxy that possessed an internal metallicity gradient. We note high metallicity dispersion in the leading arm, causing a lack of detectable gradient and possibly indicating orbital phase mixing. We additionally report on a potential detection of the Sextans dwarf spheroidal in our data.

79 ASTRONOMY AND ASTROPHYSICS↗

Describing Story Evolution from Dynamic Information Streams

Sources of streaming information, such as news syndicates, publish information continuously. Information portals and news aggregators list the latest information from around the world enabling information consumers to easily identify events in the past 24 hours. The volume and velocity of these streams causes information from prior days’ to quickly vanish despite its utility in providing an informative context for interpreting new information. Few capabilities exist to support an individual attempting to identify or understand trends and changes from streaming information over time. The burden of retaining prior information and integrating with the new is left to the skills, determination, and discipline of each individual. In this paper we present a visual analytics system for linking essential content from information streams over time into dynamic stories that develop and change over multiple days. We describe particular challenges to the analysis of streaming information and explore visual representations for showing story change and evolution over time.

99 GENERAL AND MISCELLANEOUS↗

Streaming Visual Analytics Workshop Report

How can we best enable users to understand complex emerging events and make appropriate assessments from streaming data? This was the central question addressed at a three-day workshop on streaming visual analytics. This workshop was organized by Pacific Northwest National Laboratory for a government sponsor. It brought together forty researchers and subject matter experts from government, industry, and academia. This report summarizes the outcomes from that workshop. It describes elements of the vision for a streaming visual analytic environment and set of important research directions needed to achieve this vision. Streaming data analysis is in many ways the analysis and understanding of change. However, current visual analytics systems usually focus on static data collections, meaning that dynamically changing conditions are not appropriately addressed. The envisioned mixed-initiative streaming visual analytics environment creates a collaboration between the analyst and the system to support the analysis process. It raises the level of discourse from low-level data records to higher-level concepts. The system supports the analyst’s rapid orientation and reorientation as situations change. It provides an environment to support the analyst’s critical thinking. It infers tasks and interests based on the analyst’s interactions. The system works as both an assistant and a devil’s advocate, finding relevant data and alerts as well as considering alternative hypotheses. Finally, the system supports sharing of findings with others. Making such an environment a reality requires research in several areas. The workshop discussions focused on four broad areas: support for critical thinking, visual representation of change, mixed-initiative analysis, and the use of narratives for analysis and communication.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Dynamical modeling of tidal streams

I present a new framework for modeling the dynamics of tidal streams. The framework consists of simple models for the initial action-angle distribution of tidal debris, which can be straightforwardly evolved forward in time. Taking advantage of the essentially one-dimensional nature of tidal streams, the transformation to position-velocity coordinates can be linearized and interpolated near a small number of points along the stream, thus allowing for efficient computations of a stream's properties in observable quantities. I illustrate how to calculate the stream's average location (its 'track') in different coordinate systems, how to quickly estimate the dispersion around its track, and how to draw mock stream data. As a generative model, this framework allows one to compute the full probability distribution function and marginalize over or condition it on certain phase-space dimensions as well as convolve it with observational uncertainties. This will be instrumental in proper data analysis of stream data. In addition to providing a computationally efficient practical tool for modeling the dynamics of tidal streams, the action-angle nature of the framework helps elucidate how the observed width of the stream relates to the velocity dispersion or mass of the progenitor, and how the progenitors of 'orphan' streams could be located. The practical usefulness of the proposed framework crucially depends on the ability to calculate action-angle variables for any orbit in any gravitational potential. A novel method for calculating actions, frequencies, and angles in any static potential using a single orbit integration is described in the Appendix.

79 ASTRONOMY AND ASTROPHYSICS↗

CHARACTERIZING THE CHEMISTRY OF THE MILKY WAY STELLAR HALO: DETAILED CHEMICAL ANALYSIS OF A METAL-POOR STELLAR STREAM ,

We present the results of a detailed abundance analysis of one of the confirmed building blocks of the Milky Way stellar halo, a kinematically coherent metal-poor stellar stream. We have obtained high-resolution and high signal-to-noise spectra of 12 probable stream members using the Magellan Inamori Kyocera Echelle spectrograph on the Magellan-Clay Telescope at Las Campanas Observatory and the 2dCoude spectrograph on the Smith Telescope at McDonald Observatory. We have derived abundances or upper limits for 51 species of 46 elements in each of these stars. The stream members show a range of metallicity (-3.4 < [Fe/H] <-1.5) but are otherwise chemically homogeneous, with the same star-to-star dispersion in [X/Fe] as the rest of the halo. This implies that, in principle, a significant fraction of the Milky Way stellar halo could have formed from accreted systems like the stream. The stream stars show minimal evolution in the alpha or Fe-group elements over the range of metallicity. This stream is enriched with material produced by the main and weak components of the rapid neutron-capture process and shows no evidence for enrichment by the slow neutron-capture process.

79 ASTRONOMY AND ASTROPHYSICS↗

Predicting and Detecting Emerging Cyberattack Patterns Using StreamWorks

The number and sophistication of cyberattacks on industries and governments have dramatically grown in recent years. To counter this movement, new advanced tools and techniques are needed to detect cyberattacks in their early stages such that defensive actions may be taken to avert or mitigate potential damage. From a cybersecurity analysis perspective, detecting cyberattacks may be cast as a problem of identifying patterns in computer network traffic. Logically and intuitively, these patterns may take on the form of a directed graph that conveys how an attack or intrusion propagates through the computers of a network. Such cyberattack graphs could provide cybersecurity analysts with powerful conceptual representations that are natural to express and analyze. We have been researching and developing graph-centric approaches and algorithms for dynamic cyberattack detection. The advanced dynamic graph algorithms we are developing will be packaged into a streaming network analysis framework known as StreamWorks. With StreamWorks, a scientist or analyst may detect and identify precursor events and patterns as they emerge in complex networks. This analysis framework is intended to be used in a dynamic environment where network data is streamed in and is appended to a large-scale dynamic graph. Specific graphical query patterns are decomposed and collected into a graph query library. The individual decomposed subpatterns in the library are continuously and efficiently matched against the dynamic graph as it evolves to identify and detect early, partial subgraph patterns. The scalable emerging subgraph pattern algorithms will match on both structural and semantic network properties.

Chin, George↗

W-SMART Phase-I Pathway Analysis: Case Study - City of Boston, MA

The purpose of this study is to synthesize stakeholder and research learnings to date by exercising PNNL’s Waste - Sustainability Monitoring of Alternative Reuse Options over Time (W-SMART) sustainability protocol for the Greater Boston region. This report serves as a foundation for future discussion and project work to characterize the costs, risks, impacts, tradeoffs, and highest uses for major waste streams. This analysis differs from previous work by 1) incorporating results of a newly completed detailed resource assessment for the Greater Boston area; (2) providing a head-to-head pathway comparison without any policy supports (e.g., carbon or energy credits); and (3) focusing on locally relevant critical waste streams and reuse strategies, by assessing the cost-effectiveness of two complimentary pathways, including (a) expanded incineration of municipal solid waste (MSW) at existing treatment sites to produce baseload electricity, and (b) the conversion of blended municipal wastewater solids (i.e., sludge) and non-residential food waste to produce liquid transportation biofuels at a proposed hydrothermal liquefaction facility in Quincy, MA. The performance of each pathway is also compared to assumed business-as-usual waste management practices as a baseline.

09 BIOMASS FUELS↗

ECOLOGICAL EFFECTS OF METALS IN STREAMS ON A DEFENSE MATERIALS PROCESSING SITE IN SOUTH CAROLINA, USA

The Savannah River Site (SRS) is a 780 km{sup 2} U.S. Department of Energy facility near Aiken SC established in 1950 to produce nuclear materials. SRS streams are 'integrators' that potentially receive water transportable contaminants from all sources within their watersheds necessitating a GIS-based watershed approach to organize contaminant distribution data and accurately characterize the effects of multiple contaminant sources on aquatic organisms. Concentrations of metals in sediments, fish, and water were elevated in streams affected by SRS operations, but contaminant exposure models for Lontra Canadensis and Ceryle alcyon indicated that toxicological reference values were exceeded only by Hg and Al. Macroinvertebrate community structure was unrelated to sediment metal concentrations. This study indicated that (1) modeling studies and field bioassessments provide a complementary basis for addressing the individual and cumulative effects of contaminants, (2) habitat effects must be controlled when assessing contaminant impacts, (3) sensitivity analyses of contaminant exposure models are helpful in apportioning sampling effort, and (4) contaminants released during fifty years of industrial operations have not resulted in demonstrable harm to aquatic organisms in SRS streams.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

GPU Accelerated Event Detection Algorithm

Smart grid external require new algorithmic approaches as well as parallel formulations. One of the critical components is the prediction of changes and detection of anomalies within the power grid. The state-of-the-art algorithms are not suited to handle the demands of streaming data analysis. (i) need for events detection algorithms that can scale with the size of data, (ii) need for algorithms that can not only handle multi dimensional nature of the data, but also model both spatial and temporal dependencies in the data, which, for the most part, are highly nonlinear, (iii) need for algorithms that can operate in an online fashion with streaming data. The GAEDA code is a new online anomaly detection techniques that take into account spatial, temporal, multi-dimensional aspects of the data set. The basic idea behind the proposed approach is to (a) to convert a multi-dimensional sequence into a univariate time series that captures the changes between successive windows extracted from the original sequence using singular value decomposition (SVD), and then (b) to apply known anomaly detection techniques for univariate time series. A key challenge for the proposed approach is to make the algorithm scalable to huge datasets by adopting techniques from perturbation theory, incremental SVD analysis. We used recent advances in tensor decomposition techniques which reduce computational complexity to monitor the change between successive windows and detect anomalies in the same manner as described above. Therefore we propose to develop the parallel solutions on many core systems such as GPUs, because these algorithms involve lot of numerical operations and are highly data-parallelizable.

Source record↗