Search NASA⌕ Search

SEARCH · Search NASA

Results for “Streaming Data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,027 records · Page 57
All sourcesNASA NTRSDOE OSTI
DOE OSTI2017

Deep Packet/Flow Analysis using GPUs

Deep packet inspection (DPI) faces severe performance challenges in high-speed networks (40/100 GE) as it requires a large amount of raw computing power and high I/O throughputs. Recently, researchers have tentatively used GPUs to address the above issues and boost the performance of DPI. Typically, DPI applications involve highly complex operations in both per-packet and per-flow data level, often in real-time. The parallel architecture of GPUs fits exceptionally well for per-packet network traffic processing. However, for stateful network protocols such as TCP, their data stream need to be reconstructed in a per-flow level to deliver a consistent content analysis. Since the flow-centric operations are naturally antiparallel and often require large memory space for buffering out-of-sequence packets, they can be problematic for GPUs, whose memory is normally limited to several gigabytes. In this work, we present a highly efficient GPU-based deep packet/flow analysis framework. The proposed design includes a purely GPU-implemented flow tracking and TCP stream reassembly. Instead of buffering and waiting for TCP packets to become in sequence, our framework process the packets in batch and uses a deterministic finite automaton (DFA) with prefix-/suffix- tree method to detect patterns across out-of-sequence packets that happen to be located in different batches. In conclusion, evaluation shows that our code can reassemble and forward tens of millions of packets per second and conduct a stateful signature-based deep packet inspection at 55 Gbit/s using an NVIDIA K40 GPU.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2018

A Method to Extract Soiling Loss Data from Soiling Stations with Imperfect Cleaning Schedules: Preprint

Typical PV soiling stations determine the natural soiling losses by comparing the output of a naturally soiled PV cell to that of a PV cell maintained in the clean state. Inadequate cleaning frequency or human error provides opportunity for the cleaned cell to soil, directly resulting in error in the reported soiling ratio. This work investigates an algorithm to automatically detect and correct the data stream for errors associated with soiling of the clean cell. The methodology is tested on several soiling stations with irregular cleaning schedules as well as a soiling station where both ideal and imperfect cleaning schedules are in place. The initial results show that the algorithm can reduce error associated with imperfect cleaning but also confirms the benefits of maintaining an optimal cleaning schedule.

14 SOLAR ENERGY↗
DOE OSTI2017

Deep Packet/Flow Analysis using GPUs

aDeep packet inspection (DPI) faces severe performance challenges in high-speed networks (40/100 GE) as it requires a large amount of raw computing power and high I/O throughputs. Recently, researchers have tentatively used GPUs to address the above issues and boost the performance of DPI. Typically, DPI applications involve highly complex operations in both per-packet and per-flow data level, often in real-time. The parallel architecture of GPUs fits exceptionally well for per-packet network traffic processing. However, for stateful network protocols such as TCP, their data stream need to be reconstructed in a per-flow level to deliver a consistent content analysis. Since the flow-centric operations are naturally anti-parallel and often require large memory space for buffering out-of-sequence packets, they can be problematic for GPUs, whose memory is normally limited to several gigabytes. In this work, we present a highly efficient GPU-based deep packet/flow analysi s framework. The proposed design includes a purely GPU-implemented flow tracking and TCP stream reassembly. Instead of buffering and waiting for TCP packets to become in sequence, our framework process the packets in batch and uses a deterministic finite automaton (DFA) with prefix-/suffix- tree method to detect patterns across out-of-sequence packets that happen to be located in different batches. Evaluation shows that our code can reassemble and forward tens of millions of packets per second and conduct a stateful signature-based deep packet inspection at 55 Gbit/s using an NVIDIA K40 GPU.

Gong, Qian↗
DOE OSTI2018

Leveraging Zone Air Temperature Data to Improve Physics-Based Energy Simulation of Existing Buildings

The paper introduces a hybrid modelling approach that enhances the accuracy and usability of physics-based energy simulation for existing buildings. The approach leverages measured zone air temperature data streams -- increasingly available from smart thermostats -- to derive difficult-to-obtain input parameters for internal thermal mass and infiltration airflow rates. It does so using a reformulated inverse heat balance algorithm. We implemented the inverse algorithms in EnergyPlus and used LBNL's Facility for Low Energy eXperiments (FLEXLAB) for demonstration and validation

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2019

Modeling behavior in a network using event logs

A framework is provided for modeling the activity surrounding user credentials and/or machine level activity on a computer network using computer event logs by viewing the logs attributed to each user as a multivariate data stream. The methodology performs well in detecting compromised user credentials at a very low false positive rate. Such a methodology may detect both users of compromised credentials by external actors and otherwise authorized users who have begun engaging in malicious activity.

Turcotte, Melissa J. M.↗
DOE OSTI2020

Municipal Adaptation to Changing Curbside Demands: Findings from Semi-Structured Interviews with Ten U.S. Cities

Emerging mobility services (e.g. ride-hailing, e-commerce, micro-mobility, etc.), are generating novel and rapidly growing demands to use curbside space, with potentially large impacts on mobility, energy consumption, and related outcomes. This presents both opportunities and challenges to municipal agencies responsible for managing this interface between the road network and adjacent land uses, as legacy practices require updating. In this study, we employ a semi-structured interviewing approach to establish how municipalities are adapting to these new pressures on their curbside. We interviewed senior staff responsible for curbside policy of ten large U.S. municipalities, with populations ranging from ~250,000 to ~5,000,000 (and the majority of which are the central city of their metropolitan region). We document a trend of organizational restructuring to more formally include curbside management teams, with the majority of interviewees also reporting increased staffing. Respondents reported that operational failures at their curbside (e.g. demand in excess of capacity) have impacts on safety, capacity, and emergency vehicle mobility, with impacts highly concentrated spatially and temporally (e.g. late evenings in nightlife districts). We document a diversity of data flows between ride-hailing operators (e.g. Uber, Lyft) and municipalities, with some cities reporting obtaining types of data that other cities report not receiving, despite requesting such data. Finally, respondents consistently expressed a desire for new data streams and methodologies to help manage the curbside of the future. It is hoped that establishing the state of practice in this rapidly changing context will be of use to practitioners facing similar pressures as those of our interviewees.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2020

Production of National Nuclear Material Archive Subsamples for High Precision Chemical Analysis

With its historical mission as the focal point for production of uranium components for the NNSA nuclear weapons program, the National Nuclear Materials Archive (NNMA) makes use of Y-12's wide range of uranium materials processing knowledge and onsite materials to identify, collect, and preserve sample materials for nuclear forensics purposes. In 2019, Y-12 took on the responsibility for identifying, subsampling, and shipping a total of 24 NNMA samples to the Lawrence Livermore National Laboratory (LLNL) for further forensics analysis. These were highly enriched uranium metal pieces representative of different weapon systems components produced by Y-12 from approximately 1963 to 1993. The purpose was to provide the NNMA program with higher precision analyses of these materials than what is currently available from historical Y-12 production stream data.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2021

DYFLOW: A flexible framework for orchestrating scientific workflows on supercomputers

Modern scientific workflows are increasing in complexity with growth in computation power, incorporation of non-traditional computation methods, and advances in technologies enabling data streaming to support on-the-fly computation. These workflows have unpredictable runtime behaviors, and a fixed, predetermined resource assignment on supercomputers can be inefficient for overall performance and throughput. Inability to change resource assignments further limits the scientists to avail of science-driven opportunities or respond to failures.We introduce DYFLOW, a flexible framework that orchestrates scientific workflows on supercomputers based on user-designed policies. DYFLOW compartmentalizes orchestration stages into simplified constructs, and end-users can program and reuse them according to their workflow requirements through an easy-to-use interface. These constructs hide the intricacies involved in runtime management from end-users, for instance, procurement of information to understand the workflow state, assessment, and supervision of the runtime changes. DYFLOW is designed to work alongside existing workflow management systems and reuse the available (static) support for workflow management. We have integrated DYFLOW with an existing workflow management tool as a demonstration. With experiments performed on use cases from three types of scientific workflows and two different parallel architectures, we show that DYFLOW achieves the desired orchestration incurring a small cost to carry out the runtime changes.

Singhal, Swati↗
DOE OSTI2021

System, algorithm, and method using short pulse interrogation with neutrons to detect and identify matter

A system, method, and algorithm for detecting and identifying special nuclear material (SNM) (including fissionable material), explosives, or drugs is disclosed. This material detection system relies on active interrogation of material using a short, intense neutron pulse, and characterization of the resulting prompt gamma response in two short time windows, the first concurrent with and the second immediately following the end of the neutron pulse, optionally subject to a total transit delay time of the neutrons from the neutron source to the target and from the target to the gamma detector. A high data rate analysis system implements data stream analysis and statistical correlations of the two short time window gamma responses to rapidly detect or identify SNM, explosives, or drugs. The duration of the neutron pulse is so short that minimal dose results. Various shields help to minimize the background signal falling on the gamma detector to improve sensitivity.

Derzon, Mark S.↗
DOE OSTI2022

Recommendations for Secure Transport: Material Conveyance Physical Protection Technology

Nuclear material is at higher risk of theft and sabotage during transport than during any other phase of the nuclear fuel lifecycle. Nuclear materials are transported in the public domain where adversaries have an upper hand by taking advantage of the time and location of the theft or sabotage attempt. As such, even modest threat profiles for transport of nuclear and radioactive material can require substantial detection and delay measures to support timely response. Conveyance tracking augmented with technology that improves on-the-scene situational awareness at a remote monitoring center has been adopted as a de-facto standard approach for transportation security. At present, the extended tracking and situational awareness capabilities needed for a nuclear material shipment, as is provided by the purpose designed, Transportation – Security, Tracking and Reporting (T-STAR) System, do not exist in a single commercial off-the-shelf (COTS) solution. Typically, the COTS systems that excel in one area are deficient in other areas, presenting challenges to designing well-rounded, robust systems. Still, COTS solutions can offer the basic set of tracking and situational awareness capabilities by indicating last update time, current location, and route taken. By incorporating vehicle and driver performance measures via the vehicle’s controller area network (CAN bus) and video alongside other data streams allows telemetry and other shipment information to be assessed in novel ways.This paper describes the operation, capabilities and features of various conveyance protection systems and approaches, assesses emerging technologies and how they could be used through a unified interface, and enumerates additional ways to provide early detection using vehicle, onboard technologies, effective delay technologies and approaches and simple equipment to improve protection during transport.

Shannon, Michael↗
DOE OSTI2020

Developing a Decision Support Engine to Enable Irrigation Modernization - Poster

Irrigation systems in the United States are some of the oldest continually utilized infrastructure in existence today, with some systems exceeding 100 years in age. They are operated to meet farming demands but are managed through a balance of varying influence: policies limiting water usage, stakeholder interests, and environmental impacts. Irrigation modernization is defined as a set of activities that update and improve existing irrigation systems, including, but not limited to improving water quantity, development of distributed energy resources for surrounding communities, ecosystem services, and improved agricultural yields. Modernizing an existing irrigation system can enable stakeholders to combat changing environmental and population demands but is difficult because the complexity involved in determining the potential benefits and consequences of irrigation modernization is high. We are combining a large amount of various geospatial, tabular, and temporal data with subject matter expertise into a decision support engine that will enable stakeholders to determine the benefits and consequences of irrigation modernization in their irrigation systems. A web-based GIS will allow the user to construct the modifications out of a palette of modernization options, which will be sent to the analytics engine for computations, and back to the web client for a graphical display and comparison of relevant metrics. Our development process involves four phases: 1) identify mechanisms of modernization, 2) identify data requirements, data streams, first principles and applicable algorithms necessary to quantify modernization mechanisms, 3) create ‘modules’ for each modernization mechanism, these modules will form the decision support engine, each capable of performing independently but can also inform other modules when needed, 4) Merge the decision support engine with a user interface, capable of ingesting user inputs and returning insights into the impacts of a modernization project as they relate to economic, environmental, monetary, and energy generation. Once complete, it is our intention that this tool will be fundamental in irrigation modernization projects, providing a strong analytical basis from which stakeholders can quickly make informed decisions regarding project development.

13 HYDRO ENERGY↗
DOE OSTI2023

FPGA Architectures for Distributed ML Systems for Real-time Beam Loss De-blending

The Accelerator Real-time Edge AI for Distributed Systems (READS) project’s goal is to create a Artificial Intelligence (AI) system for real-time beam loss de-blending within the accelerator enclosure, which houses two accelerators: the Main Injector (MI) and the Recycler Ring (RR). In periods of joint operation, when both machines contain high intensity beam, radioactive beam losses from MI and RR overlap on the enclosure’s beam loss monitoring Beam Loss Monitor (BLM) system, making it difficult to attribute those losses to a single machine. Incorrect diagnoses result in unnecessary downtime that incurs both financialand experimental cost. The ML system will automatically disentangle each machine’s contributions to those measured losses, while not disrupting the existing operations-critical functions of the BLM system. This paper will focus on the evolution of the architectures, which provided the high-frequency, low-latency collection of synchronized data streams to make real-time inferences. The ML models, used for learning both local and global machine signatures and producing high quality inferences based on raw BLM loss measurements, will only be discussed at a high-level.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Single Carrier Modulation Resource Allocation for Massive MIMO with Virtual Antennas

Today’s Massive MIMO cellular operation is dominated by orthogonal frequency division multiplexing (OFDM) modulation. One of the advantages of OFDM is the flexibility to carve up the available spectrum into resource blocks (RBs) that can operate adjacent to one another. Massive MIMO adds spatial multiplexing layers on top of the RBs, enabling the simultaneous operation of dozens of UEs. Cyclic prefixed single carrier modulation (CP-SCM) is an alternative to OFDM that also benefits from massive MIMO and is useful as an OFDM alternative in specific scenarios. However, until recently, no resource allocation method has been proposed for CP-SCM. In this paper, we present a CP-SCM resource allocation scheme using virtual antennas in a massive MIMO time domain duplexed scenario. By creating several virtual antennas for each physical antenna, the benefits of massive MIMO are achieved with a smaller physical antenna count. Resources are quantized into data streams, and each user can be assigned a variable number of simultaneous streams. This paper presents a detailed development and analysis of multi-stream processing (MSP) for both uplink detection and downlink precoding. We also introduce heterogeneous MSP, where CP-SCM and OFDM signals can be processed in the same MSP framework.

5G and beyond communications↗
DOE OSTI2024

A Multi-Dimensional Benefit Assessment of Automated Mobility Platforms (AMP) for Large Facilities

Automated Mobility Platform (AMP) is a general term for intelligently managed passenger mobility systems that leverage automation and electrification to improve system performance and sustainability through the integration of real-time data streams with advanced decision-making processes tailored for use in large facilities. Using airports as an example, the rapid growth in air travel demand has led to facility expansions and congested terminals, which directly impacts equity (e.g., increased challenges for passengers with reduced mobility [PRMs]) and sustainability - both of which are important metrics often neglected during the engineering design process. Therefore, to evaluate systems and inform critical decisions more effectively, a holistic evaluation framework is proposed that includes equity, sustainability, and infrastructure perspectives - referred to as a multidimensional benefit assessment. More specifically, the following analysis focuses on: (1) mobility, with emphasis on travel time and accessibility within an airport, contrasting existing systems with the proposed AMP system; (2) equity analysis, specifically to the PRM community, but with an eye to the whole of society; (3) energy consumption and greenhouse gas (GHG) emissions associated with intra-airport mobility, comparing and contrasting modes as well as impacts on overall airport operations efficiency; and (4) fundamental changes in building design enabled by AMPs for larger and more flexible, functional, and energy-efficient structures.

ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2016

RISMC Analysis Framework in Response to Proposed 10 CFR 50.46c Rulemaking

The results obtained from the demonstration calculations indicate that as an automation tool in LOCA analyses, LOTUS has the capability to provide integrated evaluation through seamless interfaces of the data stream in multiple disciplines. With further more development, LOTUS will provide a systematic way to perform uncertainty quantification, sensitivity analysis and risk assessment of the multiple physics involved in the LOCA analysis in response to the proposed 10 CFR 50.46c rulemaking. It can be used to obtain quantitative estimate of design or operational margin loss or gain as well as to assess the impact on LOCA analysis safety metrics associated with various combinations of changes in LOCA analysis inputs. It can also aid plant owners to make decision on evaluating design changes as well as resolving operational issues. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2022

Improved Line Outage Detection in Transmission Systems with Few PMUs

Unlike transmission systems, distribution systems historically lack enough measurements, making their real-time monitoring almost impossible. Recent deployment of diverse types of devices such as phasor measurement units (PMUs), smart meters, solar inverters and weather information sensors opens up new ways of monitoring these systems, with the assistance of customized machine learning (ML) applications. The paper describes a grid-model-informed machine learning (ML) tool which integrates heterogeneous data streams and creates synchronous measurement snapshots to be used by a hybrid robust state estimator (SE) which provides not only accurate state estimates but also real-time feedback for ML model refinement. Improved monitoring performance due to the use of developed computational framework is experimentally observed by simulated scenarios on an electric utility’s distribution system.

Distribution systems, graph learning, machine lear↗
DOE OSTI2025

The Sensor Dilemma in Intelligent Transportation Systems: Evaluating Radar, Lidar and Camera: Preprint

Intelligent transportation systems (ITS) are at the forefront in advancing the way we interact with and perceive the transportation network. This revolution is fueled by the significant advancement in sensor perception technologies such as radar, lidar, and video imaging, which are the most popular modalities for ITS. Real-time perception data from these sensors allow intelligent infrastructure-side decision-making to improve the energy, efficiency, and safety at traffic intersections. As traffic departments across the United States transition from traditional loop detectors and emulators and embrace newer technologies, they are often left with a dilemma in choosing a sensor technology for infrastructure-based perception that is reliable, inexpensive, and easy to set up and that has robust performance in varying weather conditions. However, choosing a sensor that checks all these boxes is not straightforward, as every sensor type has unique benefits and drawbacks. Radar is excellent at detecting long-range vehicles and weather resistance but lacks high resolution. Lidar is expensive and weather-sensitive, while cameras provide rich visual data at a low cost but are constrained by lighting and visibility. This study examines radar, lidar, and camera sensor capabilities to ascertain whether any of these qualifies as the "best" sensor for ITS perception. While no single sensor can meet all the demands of ITS, a hybrid approach combining multiple sensor modalities like radar, lidar, and cameras offers the most robust solution for enhancing the safety and efficiency of ITS. Through this evaluation, we hope to draw attention to the necessity of the National Renewable Energy Laboratory's infrastructure perception and control framework, which presents a multisensor track data fusion engine to assimilate multiple data streams in order to provide robust and reliable perception.

33 ADVANCED PROPULSION SYSTEMS↗