SEARCH · Search NASA

Results for “Streaming Data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,207 records · Page 67

All sources NASA NTRS DOE OSTI

NASA NTRS2002

REACH: Real-Time Data Awareness in Multi-Spacecraft Missions

Missions have been proposed that will use multiple spacecraft to perform scientific or commercial tasks. Indeed, in the commercial world, some spacecraft constellations already exist. Aside from the technical challenges of constructing and flying these missions, there is also the financial challenge presented by the tradition model of the flight operations team (FOT) when it is applied to a constellation mission. Proposed constellation missions range in size from three spacecraft to more than 50. If the current ratio of three-to-five FOT personnel per spacecraft is maintained, the size of the FOT becomes cost prohibitive. The Advanced Architectures and Automation Branch at the Goddard Space Flight Center (GSFC Code 588) saw the potential to reduce the cost of these missions by creating new user interfaces to the ground system health-and-safety data. The goal is to enable a smaller FOT to remain aware and responsive to the increased amount of ground system information in a multi-spacecraft environment. Rather than abandon the tried and true, these interfaces were developed to run alongside existing ground system software to provide additional support to the FOT. These new user interfaces have been combined in a tool called REACH. REACH-the Real-time Evaluation and Analysis of Consolidated Health-is a software product that uses advanced visualization techniques to make spacecraft anomalies easy to spot, no matter how many spacecraft are in the constellation. REACH reads a real-time stream of data from the ground system and displays it to the FOT such that anomalies are easy to pick out and investigate. Data visualization has been used in ground system operations for many years. To provide a unique visualization tool, we developed a unique source of data to visualize: the REACH Health Model Engine. The Health Model Engine is rule-based software that receives real-time telemetry information and outputs "health" information related to the subsystems and spacecraft that the telemetry belong to. The Health Engine can run out-of-the-box or can be tailored with a scripting language. Out of the box, it uses limit violations to determine the health of subsystems and spacecraft; when tailored, it determines health using equations combining the values and limits of any telemetry in the spacecraft. The REACH visualizations then "roll up" the information from the Health Engine into high level, summary displays. These summary visualizations can be "zoomed" into for increasing levels of detail. Currently REACH is installed in the Small Explorer (SMEX) lab at GSFC, and is monitoring three of their five spacecraft. We are scheduled to install REACH in the Mid-sized Explorer (MIDEX) lab, which will allow us to monitor up to six more spacecraft. The process of installing and using our "research" software in an operational environment has provided many insights into which parts of REACH are a step forward and which of our ideas are missteps. Our paper explores both the new concepts in spacecraft health-and-safety visualization, the difficulties of such systems in the operational environment, and the cost and safety issues of multi-spacecraft missions.

Maks, Lori↗

NASA NTRS2002

REACH: Real-Time Data Awareness in Multi-Spacecraft Missions

NASA's Advanced Architectures and Automation Branch at the Goddard Space Flight Center (Code 588) saw the potential to reduce the cost of constellation missions by creating new user interfaces to the ground system health-and-safety data. The goal is to enable a small Flight Operations Team (FOT) to remain aware and responsive to the increased amount of ground system information in a multi-spacecraft environment. Rather than abandon the tried and true, these interfaces were developed to run alongside existing ground system software to provide additional support to the FOT. These new user interfaces have been combined in a tool called REACH. REACH-the Real-time Evaluation and Analysis of Consolidated Health-is a software product that uses advanced visualization techniques to make spacecraft anomalies easy to spot, no matter how many spacecraft are in the constellation. REACH reads numerous real-time streams of data from the ground system(s) and displays synthesized information to the FOT such that anomalies are easy to pick out and investigate.

Maks, Lori↗

DOE OSTI2020

Heterogeneous data-processing optimization with CLARA’s adaptive workflow orchestrator

The hardware landscape used in HEP and NP is changing from homogeneous multi-core systems towards heterogeneous systems with many different computing units, each with their own characteristics. To achieve maximum performance with data processing, the main challenge is to place the right computing on the right hardware. In this paper, we discuss CLAS12 charge particle tracking workflow orchestration that allows us to utilize both CPU and GPU to improve the performance. The tracking application algorithm was decomposed into micro-services that are deployed on CPU and GPU processing units, where the best features of both are intelligently combined to achieve maximum performance. In this heterogeneous environment, CLARA aims to match the requirements of each micro-service to the strength of a CPU or a GPU architecture. A predefined execution of a micro-service on a CPU or a GPU may not be the most optimal solution due to the streaming data-quantum size and the data-quantum transfer latency between CPU and GPU. So, the CLARA workflow orchestrator is designed to dynamically assign micro-service execution to a CPU or a GPU, based on the online benchmark results analyzed for a period of real-time data-processing.

Gyurjyan, Vardan↗

DOE OSTI2016

A Measurement-Based Analysis of the Hydrokinetic Energy in the Gulf Stream

This study uses ocean current measurements made off the East Coast of the United States of America to evaluate the ocean current-based electricity production potential in the Gulf Stream. Drifter data from the World Ocean Circulation Experiment (WOCE) are used to map the energy density from South Florida to North Carolina, showing that the most energy dense areas exist off the east coast of Central Florida. Bottom- and vessel-mounted Acoustic Doppler Current Profiler (ADCP) measurements are used to conduct a more detailed study near 26°N and 27°N, respectively. Furthermore, these results quantify the energy profiles in these regions, suggesting that 54% more energy dense currents are available at 27°N than at 26°N.

16 TIDAL AND WAVE POWER↗

DOE OSTI2016

Metering Plan: Intelligent Operational Strategies Through Enhanced Metering Systems

The Sustainability Program at Pacific Northwest National Laboratory (PNNL) has adopted a “triple-bottom-line” approach of environmental stewardship, social responsibility, and economic prosperity to its operations. Metering at PNNL works in support of all three, specifically to measure and inform building energy use and greenhouse gas emissions and minimize water use. The foundation for metering at PNNL is a core goal set, which consists of four objectives: providing accurate data without interruption, analyzing data while it is still new, providing actionable recommendations to operations management, and ensuring PNNL’s compliance with contract metering requirements. These core objectives guide the decisions that we make during annual planning and as we operate throughout the year. This 2016 edition of the Metering Plan conveys the metering practices for and vision of the Sustainability Program. Changes in this plan from the 2015 edition include updated tables and an enhanced discussion on energy tracking systems used at PNNL. This plan also discusses updated benchmarking strategies using PNNL’s graphics and analytics tool, BuildingOS by Lucid Design Group. This plan presents our progress toward the metering goals shared by all federal agencies and highlights our successful completion of metering requirements. Currently, PNNL is fully compliant with the applicable legislative and Executive Order metering requirements. PNNL’s approach to the installation of new meters will be discussed. Perhaps most importantly, this plan details the analysis techniques utilized at PNNL that rely on the endless streams of data newly available as a result of increased meter deployment over the last several years. Previous Metering Plans have documented specific meter connection schemes as PNNL focused on deploying meters in a first step toward managing energy and water use. This plan serves not only to highlight PNNL’s successful completion of agency metering goals, but also can be used as a guideline for meter installation and data analysis.

24 POWER TRANSMISSION AND DISTRIBUTION↗

NASA NTRS1991

Jet stream winds - Comparisons of analyses with independent aircraft data over Southwest Asia

Cruise-level wind data from commercial aircraft are obtained, and these data are compared with operational jet stream analyses over southwest Asia, an area of limited conventional data. Results from an ensemble of 11 cases during January 1989 and individual cases during December 1988-March 1989 are presented. The key results are: (1) European Centre for Medium-Range Weather Forecasts (ECMWF), National Meteorological Center, and United Kingdom Meteorological Office analyses of the subtropical jet in southwest Asia are 11 percent, 17 percent, and 17 percent weaker, respectively, than aircraft observations; (2) analyzed poleward shears range up to 1 f (0.00007/s) compared with up to 3 f (0.00021/s) in the aircraft observations where f is the local Coriolis parameters; (3) the ECMWF errors are largest at the base of the jet; (4) the mean ECMWF core location is latitudinally correct but has an rms latitude variance of 1.5 deg; (5) isolated erroneous radiosondes produce unmeteorological structures in the analyzed subtropical jet stream; and (6) the increased utilization of automated aircraft reports is likely to produce a spurious secular increase in the apparent strength of the jets. The magnitude and spatial extent of the errors seen are near limits of current GCM resolution (100 km) but should be resolvable. The results imply that studies of GCM systematic jet stream wind errors in weather and climate forecasts must be interpreted with caution in this region.

Tenenbaum, J.↗

DOE OSTI2015

A Comprehensive View of Global Potential for Hydro-generated Electricity

In this study, we assess global hydropower potential using runoff and stream flow data, along with turbine technology performance, cost assumptions, and environmental considerations. The results provide the first comprehensive quantification of global hydropower potential including gross, technical, economic, and exploitable estimates. Total global potential of gross, technical, economic, and exploitable hydropower are estimated to be approximately 128, 39, 32, and 27 petawatt hours per year, respectively. The economic and exploitable potential of hydropower are calculated at less than 9 cents/kWh. We find that hydropower has the potential to supply a significant portion of the world energy needs, although this potential varies substantially by region. Globally, hydropower can potentially supply about 1.5 times the total electricity demand in 2005. Estimated hydropower resources in a number of countries are sufficient to accommodate their demand for electricity in 2005, e.g., Brazil (5.6 times), Russia (4.6 times), and Canada (3.5 times). A sensitivity analysis indicates that hydropower estimates are not highly sensitive to five key parameters: design flow (varying by -2% to +1% at less than 9 cents/kWh), cost and financing options (by -7% to +6%), turbine efficiency (by -10% to +10%), stream flow (by -10% to +10%), and fixed charge rate (by -6% to 5%). This sensitivity analysis emphasizes the reliable role of hydropower for future energy systems, when compared to other renewable energy resources with larger uncertainty in their future potentials.

Zhou, Yuyu↗

DOE OSTI2021

Stream discharge and water quality data for East Fork Poplar Creek beginning 2012

This data note describes 15-min discharge and in situ water quality data at two locations along East Fork Poplar Creek in east Tennessee, USA. Data records include temperature, gauge height, water surface elevation above mean sea level, and volumetric discharge. Water quality measurements include temperature, specific conductance, pH, dissolved oxygen (percent saturation and concentration), turbidity, and less extensive fDOM data at one site. The data records begin in 2012 at one site and 2015 at the second site; monitoring at both sites is ongoing (as of 2021). The goal of this data collection is to improve understanding of watershed functions, hydrologic dynamics, and material flux. The data will contribute to site conceptual and numerical models, exposure and risk evaluation, remediation selection and design, and performance monitoring. The data are publicly available and can be accessed via unique url or DOI.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Rate-capability of the VMM3a front-end in the RD51 Scalable Readout System

The VMM3a is an Application Specific Integrated Circuit (ASIC), specifically developed for the readout of gaseous detectors. Originally developed within the ATLAS New Small Wheel (NSW) upgrade, it has been successfully integrated into the Scalable Readout System (SRS) of the RD51 collaboration. This allows, to use the VMM3a also in small laboratory set-ups and mid-scale experiments, which make use of Micro-Pattern Gaseous Detectors (MPGDs). As part of the integration of the VMM3a into the SRS, the readout and data transfer scheme was optimised to reach a high rate-capability of the entire readout system and profit from the VMM3a's high single-channel rate-capability of 3.6Mhits/s. The optimisation focused mainly on the handling of the data output stream of the VMM3a, but also on the development of a trigger-logic between the front-end cards and the DAQ computer. In this article, two firmware implementations of the non-ATLAS continuous readout mode are presented, as well as the implementation of the trigger-logic. Afterwards, a short overview on X-ray imaging results is presented, to illustrate the high rate-capability from an application point-of-view.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2024

On detrending stream velocity time series for robust tidal flow turbulence characterization

We investigated the impact of detrending techniques on turbulence quantities from tidal stream flow data, focusing on the autocorrelation function, $ρ_{uu}$, and velocity spectrum, $Φ(f)$. Standard detrending methods, including high-pass frequency-based and polynomial-based techniques, are examined, alongside a proposed alternative method, the empirical mode decomposition (EMD). Our results highlight that intervals of flow acceleration and deceleration, typical in tidal and riverine flows, significantly affect the estimation of turbulence quantities using high-pass frequency filtering and polynomial detrending of varying orders. These methods can strongly influence $ρ_{uu}$ and $Φ(f)$, thereby affecting the accurate estimation of derived quantities. We examine two variations of detrending data using EMD; the first removes only the EMD residue, and the second removes both the residue and the largest scale intrinsic mode function (IMF). By comparing the detrended spectra with the modeled von Kármán spectra, we demonstrate that the second variation (i.e., removing the residue and the largest scale IMF) successfully removed the large-scale trend of the data while retaining the energy of other scales.

Detrend↗

DOE OSTI2022

3D velocity map imaging of electrons with TPX3CAM

In this report we demonstrate three-dimensional velocity map imaging of low energy electrons using a TPX3CAM, where the three-dimensional momentum information [$p_x, p_y, p_z$] is encoded in position and timing [x, y, t] of hits on the camera sensor. We make use of the camera sensor for the [x, y] information and a constant fraction discriminator and fast time to digital converter in the camera for the time information. We illustrate the capabilities of our apparatus by presenting above threshold ionization measurements of xenon, which produces well defined structures in the momentum resolved photoelectron yield.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2026

Design and simulation of a muon detector to characterize geological overburden

This study presents the design, construction, and simulation of a mobile muon detector tailored for geological overburden characterization. The detector employs plastic scintillator paddles with silicon photomultipliers (SiPMs) and a QuarkNet data acquisition system, offering a portable solution suitable for remote field deployment. The simulator’s modular aluminum frame allows for adjustable geometry and directional sensitivity, while its battery system supports over a week of autonomous operation. Preliminary experimental tests confirmed that its muon flux measurements were consistent with theoretical expectations. A comprehensive simulation framework using Geant4 and CORSIKA was developed to model detector response and overburden effects. Analytical and Monte Carlo methods were used to assess quadrant resolution and infer muon directionality. This work lays the foundation for future overburden mapping and supports the development of reconstruction algorithms for geological applications.

72 - PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2026

A novel method for thermal noise reduction, enabling measurements of broadband, low-amplitude electron temperature fluctuations using individual radiometer channels

A new analysis method has been developed for measurements of broadband, low-amplitude turbulent electron temperature fluctuations in fusion plasmas using individual radiometer channels of a correlation electron cyclotron emission diagnostic. This method takes advantage of differences in the correlation time of thermal noise compared to the correlation time of plasma fluctuations in fusion reactors. The validation of this single-channel method is demonstrated using comparisons with the standard dual-channel radiometer spectral decorrelation method for measurements of turbulent electron temperature fluctuations in the core and edge of low confinement (L), improved confinement (I), and high confinement (H)-mode plasmas at the ASDEX Upgrade tokamak.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2023

S 5 : Probing the Milky Way and Magellanic Clouds potentials with the 6D map of the Orphan–Chenab stream

We present a 6D map of the Orphan–Chenab (OC) stream by combining the data from Southern Stellar Stream Spectroscopic Survey (S 5 ) and Gaia. We reconstruct the proper motion, radial velocity, distance, on-sky track, and stellar density along the stream with spline models. The stream has a total luminosity of M V = -8.2 and metallicity of [Fe/H] = -1.9, similar to classical Milky Way (MW) satellites like Draco. The stream shows drastic changes in its physical width varying from 200 pc to 1kpc, but a constant line-of-sight velocity dispersion of 5 km s -1 . Despite the large apparent variation in the stellar number density along the stream, the flow rate of stars along the stream is remarkably constant. We model the 6D stream track by a Lagrange-point stripping method with a flexible MW potential in the presence of a moving extended Large Magellanic Cloud (LMC). This allows us to constrain the mass profile of the MW within the distance range 15.6 < r < 55∙5 kpc, with the best measured enclosed mass of (2.85 ± 0.1) X 10 11 M ⊙ within 32.4 kpc. Our stream measurements are highly sensitive to the LMC mass profile with the most precise measurement of its enclosed mass made at 32.8 kpc, 7.02 ± 0.9) X 10 11 M ⊙ . We also detect that the LMC dark matter halo extends to at least 53 kpc. The fitting of the OC stream allows us to constrain the past LMC trajectory and the degree of dynamical friction it experienced. We demonstrate that the stars in the OC stream show large energy and angular momentum spreads caused by LMC perturbation.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2026

Gaia: segmented germanium detector for high-energy X-ray fluorescence and spectroscopic imaging

We present Gaia, a monolithic array of 96 high-purity germanium pixel detectors integrated with a custom low-noise application-specific integrated circuit (ASIC) and a field-programmable gate array (FPGA)-based data acquisition system. The sensor operates at ∼100 K using a commercial closed-cycle cryocooler, with the in-vacuum electronics thermally isolated from the cold finger to ensure thermal stability. The system demonstrates an average energy resolution of 711 eV at 122 keV, measured using a 57 Co source, and 253 eV at 5.89 keV, measured with 55 Fe across all channels. The readout architecture incorporates a high-performance FPGA paired with a dual-core ARM processor, forming a complete embedded Linux-based computing platform. Communication between the processor and FPGA is handled via memory-mapped I/O, and data are streamed over high-speed gigabit Ethernet. A full-scale 384-pixel Gaia detector, based on this 96-element module, is currently under fabrication.

36 MATERIALS SCIENCE↗

DOE OSTI2020

Methods and Experiences for Developing Abstractions for Data-intensive, Scientific Applications

Developing software for scientific applications that require the integration of diverse types of computing, instruments, and data present challenges that are distinct from commercial software. These applications require scale, and the need to integrate various programming and computational models with evolving and heterogeneous infrastructure. Pervasive and effective abstractions for distributed infrastructures are thus critical; however, the process of developing abstractions for scientific applications and infrastructures is not well understood. While theory-based approaches for system development are suited for well-defined, closed environments, they have severe limitations for designing abstractions for scientific systems and applications. The design science research (DSR) method provides the basis for designing practical systems that can handle real-world complexities at all levels. In contrast to theory-centric approaches, DSR emphasizes both practical relevance and knowledge creation by building and rigorously evaluating all artifacts. In this work, we show how DSR provides a well-defined framework for developing abstractions and middleware systems for distributed systems. Specifically, we address the critical problem of distributed resource management on heterogeneous infrastructure over a dynamic range of scales, a challenge that currently limits many scientific applications. We use the pilot-abstraction, a widely used resource management abstraction for high-performance, high throughput, big data, and streaming applications, as a case study for evaluating the DSR activities. For this purpose, we analyze the research process and artifacts produced during the design and evaluation of the pilot-abstraction. We find DSR provides a concise framework for iteratively designing and evaluating systems. Finally, we capture our experiences and formulate different lessons learned.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

ICED: An Integrated CGRA Framework Enabling DFVS-Aware Acceleration

oarse-grained reconfigurable arrays (CGRAs) are a promising solution to enable energy-efficient acceleration of applications from different domains. By leveraging reconfiguration at the functional level, they can adapt to significantly different computational patterns. Existing CGRA mapping approaches extract instruction-level parallelism, exploit loop-pipelining opportunities, guarantee the data dependency, and target high throughput of a given loop. However, the recurrence data-dependency in the DFG and the mismatch between required and available computing/communication resources complicate the mapping, and might lead to significant unbalances in the utilization of the CGRA's tiles. This results in wasted power for tiles with low utilization. Applying dynamic voltage and frequency scaling (DVFS) can potentially solve this challenge and improve energy efficiency by adjusting voltage and frequency of different tiles independently. CGRAs have also been successful in accelerating data-dependent streaming applications. However, in these applications, the execution time of each kernel in the pipeline might dynamically vary depending on the characteristics of the input. This also leads to under-utilization of resources for the dynamically changing kernels that do not limit the application throughput. DVFS can also improve energy efficiency for these applications by dynamically changing the voltage and frequency levels of tiles that host non performance-constraining kernels. This paper proposes ICEDTEA -- an integrated DVFS-aware framework to map applications on CGRAs that support power islands. ICEDTEA proposes a CGRA architecture supporting DVFS islands at varying granularity (from a single tile to a group of tiles) and the related DVFS-aware compilation and mapping toolchain. ICEDTEA is the first work that introduces DVFS support for spatio-temporal CGRAs at power-island levels. The experimental evaluation shows that ICEDTEA improves average utilization by 2.3$\times$ and energy-efficiency by 1.32$\times$ over a conventional CGRA. With streaming applications, ICEDTEA improves energy efficiency by 1.12$\times$ over a state-of-the-art CGRA that introduces partial dynamic reconfiguration to adapt to variations in kernels' throughput.

Tan, Cheng↗

DOE OSTI2019

Development of a Host-Based Intrusion Detection and Control Device for Industrial Field Control Devices

Industrial control systems contain a multitude of devices deployed into the field to observe and control a physical process. Currently, most of these devices lack common host-based cybersecurity features, which can lead them to be seen as vulnerable targets. The Cymbiote device was developed to address this problem by examining multiple streams of data to determine what might indicate a potential threat, and to evaluate and execute appropriate response actions. This paper discusses the evolution of the Cymbiote device in response to evaluation and testing done on real-world hardware. Experimental results are discussed, as are the new developments that have been made to the device in response to the findings. In addition, we describe future research directions for this approach along with the experimental setup changes in response to the requirements for statistical rigor.

Rice, Theora R.↗