SEARCH · Search NASA

Results for “stream networks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

All sources NASA NTRS DOE OSTI

DOE OSTI2022

DRIPS: Dynamic Rebalancing of Pipelined Streaming Applications on CGRAs

Coarse-grained reconfigurable arrays (CGRAs) provide higher flexibility than application-specific integrated circuits (ASICs) and higher efficiency than fine-grained reconfigurable devices such as Field Programmable Gate Arrays (FPGAs). However, CGRAs are generally designed to support offloading of a single kernel. While their design, based on communicating functional units, appears to naturally suit data streaming applications composed of multiple cooperating kernels, current approaches only statically partition the resources across application kernels. However, emerging streaming applications at the edge (scientific instruments, sensor networks, network processing) perform much more than digital signal processing and often are data and input dependent. This leads to extremely variable kernel execution times, severely impacting the throughput of the entire pipeline if resources are only statically allocated. Therefore, in this paper, we propose DRIPS — a coarse-grained, dynamically, and partially reconfigurable array for data-dependent streaming applications. We present a unified compiler framework to facilitate the mapping of a given streaming application onto the DRIPS CGRA architecture. The experimental results show that DRIPS achieves an average throughput improvement of 1.46$\times$ across a set of representative applications over a statically partitioned solution. The additional area overhead to enable dynamic rebalancing consumes 16.34% of the entire area for a 5x5 CGRA prototype.

Tan, Cheng↗

NASA NTRS1984

Junction angles in drainage networks

A theoretical model relating the junction angle of a tributary in a drainage network to its own Shreve magnitude and the Shreve magnitude of the stream into which it flows is developed and verified using published data (including Landsat maps) on U.S. networks with different underlying rock types, relief, and basin lengths. Good agreement is found, and a tendency for the slopes of individual network links to evolve toward graded longitudinal profiles as the network approaches an equilibrium (graded') planimetric pattern is noted. The differences between the network patterns predicted by the model and those observed on Mars are indicated, confirming the results of Pieri (1979, 1980).

Pieri, D. C.↗

DOE OSTI2026

WHONDRS Surface Water Geochemistry and Organic Matter Characterization Data from Streams Distributed across Latin America

This dataset supports a broader study examining global transferability of stream biogeochemistry and was generated in collaboration with the MicroSudAqua (µSudAqua) network (https://microsudaqua.netlify.app/en/). The dataset provides surface water geochemistry (dissolved organic carbon, total dissolved nitrogen, cations) and organic matter characterization (FTICR-MS) from streams in Argentina, Brazil, Chile, and Colombia. Samples were collected across stream orders (1st to 6th order) within five basins. Related data were collected and will be published separately in collaboration with the µSudAqua network. For details on how to navigate data packages generated by this project, see https://data.ess-dive.lbl.gov/portals/PNNLRiverCorridorSFA/About. In addition to this readme, this data package also includes a file-level metadata (FLMD) file that describes each file and a data dictionary (DD) that describes all column/row headers and variable definitions. This dataset is comprised of (1) a folder of field photos; (2) a folder of surface water sample data, (3) a folder of raw Fourier transform ion cyclotron resonance mass spectrometry (FTICR-MS) data; (4) file-level metadata; (5) data dictionary; (6) field metadata; (7) readme; (8) international generic sample number (IGSN) mapping file; and (9) field protocol. The sample data subfolder contains (1) dissolved organic carbon (DOC, measured as non-purgeable organic carbon, NPOC) data and averages; (2) total dissolved nitrogen data and averages; (3) anions and averages; (4) methods codes; (5) FTICR-MS methods; and (15) a subfolder of 9.4 Tesla (9.4T) FTICR-MS data. This folder contains the processed data and three subfolders, one containing the .xml files, one containing the water CoreMS output files, and the other containing instructions and scripts for processing the files in CoreMS (https://github.com/EMSL-Computing/CoreMS). All files are .csv, .pdf, .R, .xml, .d, .html, .Rmd, .py, .cal, .json, .jpg, .jpeg, .png, .mov, or .mp4.

Anions↗

DOE OSTI2022

Large Scale Caching and Streaming of Training Data for Online Deep Learning

The training of deep neural network models on large data remains a difficult problem, despite progress towards scalable techniques. In particular, there is a mismatch between the random but predetermined order in which AI flows select training samples and the streaming I/O patterns for which traditional HPC data storage (e.g., parallel file systems) are designed. In addition, as more data are obtained, it is feasible neither simply to train learning models incrementally, due to catastrophic forgetting (i.e., bias towards new samples), nor to train frequently from scratch, due to prohibitive time and/or resource constraints. In this paper, we study data management techniques that combine caching and streaming with rehearsal support in order to enable efficient access to training samples in both offline training and continual learning. We revisit state-of-art streaming approaches based on data pipelines that transparently handle prefetching, caching, shuffling, and data augmentation, and discuss the challenges and opportunities that arise when combining these methods with data-parallel training techniques. We also report on preliminary experiments that evaluate the I/O overheads involved in accessing the training samples from a parallel file system (PFS) under several concurrency scenarios, highlighting the impact of the PFS on the design of the data pipelines.

data pipelines↗

NASA NTRS1987

Chemical network problems solved on NASA/Goddard's massively parallel processor computer

The single instruction stream, multiple data stream Massively Parallel Processor (MPP) unit consists of 16,384 bit serial arithmetic processors configured as a 128 x 128 array whose speed can exceed that of current supercomputers (Cyber 205). The applicability of the MPP for solving reaction network problems is presented and discussed, including the mapping of the calculation to the architecture, and CPU timing comparisons.

Cho, Seog Y.↗

NASA NTRS2006

Communal Cooperation in Sensor Networks for Situation Management

Situation management is a rapidly evolving science where managed sources are processed as realtime streams of events and fused in a way that maximizes comprehension, thus enabling better decisions for action. Sensor networks provide a new technology that promises ubiquitous input and action throughout an environment, which can substantially improve information available to the process. Here we describe a NASA program that requires improvements in sensor networks and situation management. We present an approach for massively deployed sensor networks that does not rely on centralized control but is founded in lessons learned from the way biological ecosystems are organized. In this approach, fully distributed data aggregation and integration can be performed in a scalable fashion where individual motes operate based on local information, making local decisions that achieve globally-meaningful results. This exemplifies the robust, fault-tolerant infrastructure required for successful situation management systems.

Jones, Kennie H.↗

DOE OSTI2025

Dataset for "Machine Learning Ensembles Can Enhance Hydrologic Predictions and Uncertainty Quantification" Willard et al. (2025).

This data release provides all data and code used in the paper " "Machine Learning Ensembles Can Enhance Hydrologic Predictions and Uncertainty Quantifications" Willard et al. (2025)" to model stream temperature, evaluate, and assess results. The associated manuscript explores the effect of different ensemble construction techniques across different common machine learning (ML) architectures for predictions in unmonitored basins. Modeling was done using long short-term memory (LSTM), gated recurrent unit (GRU), temporal convolution network (TCN), and extreme gradient boosting (XGBoost) models, and stream site coverage spans 1362 locations across the conterminous United States. The ensemble construction techniques investigated include ensemble by random weight initialization, differing hyperparameters, different random subsets of training data, different subselections of input features, different architectures, and Monte Carlo Dropout. The data is organized into these items items:Code repository and data for the paper " "Machine Learning Ensembles Can Enhance Hydrologic Predictions and Uncertainty Quantifications" Willard et al. (2025).Code: stream_temp_ml_regionalization.zip contains the code repositoryData to run the code:- data_dir.zip -- contains all files that should be moved to the "DATA_DIR" variable defined in the "set_env_vars.sh" script in the code repository- metadata_dir.zip -- contains all files that should be moved to the "METADATA_DIR" variable defined in the "set_env_vars.sh" script in the code repositoryData produced by the code and used in the paper:- outputs_dir.zip - contains model output and results (outputs_dir/results), model weights (outputs_dir/models), and all other outputs used for the paper including feature importances.To cite this code, please use the following BibTeX or MLA entries:bibtex:@misc{willard2025streamensembles,author = {Jared Willard and Charuleka Varadharajan},title = {Dataset for "Machine Learning Ensembles Can Enhance Hydrologic Predictions and Uncertainty Quantification"},year = {2024},doi = {10.15485/2527393},publisher = {ESS-DIVE Repository},url = {https://data.ess-dive.lbl.gov/datasets/doi:10.15485/2527393}}MLA: Willard, Jared, et al. Dataset for "Machine Learning Ensembles Can Enhance Hydrologic Predictions and Uncertainty Quantification". 2025. ESS-DIVE Repository, doi:10.15485/2448016.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Supporting Cyber Security of Power Distribution Systems by Detecting Differences Between Real-time Micro-Synchrophasor Measurements and Cyber-Reported SCADA (Final Report)

As modern power grids tend towards greater levels of automation and communication, the challenges of identifying and mitigating vulnerabilities to cyber-attacks are ones that are increasingly demanding attention. Today’s power system has evolved to form the foundational bedrock of modern society, and an attack on this infrastructure could prove disastrous. In this project we were tasked to investigate the use of distribution synchrophasors as an independent isolated sensor network with which we can corroborate, or flag potentially spoofed,Supervisory Control And Data Acquisition (SCADA) data. We adapted an approach to marry the underlying physical properties of power systems with the network communications used by power systems in order to offer insights unattainable by either data stream isolation. While the concept of intrusion detection systems (IDS) is well understood for monitoring network traffic and traditional IT computing systems, the approach discussed in this report is motivated by several key notions: first, current SCADA communications alone presents an incomplete view of the grid. Second, the power grid, and the equipment controlling it, is grounded by laws of physics. Given this, we leverage high-frequency physical grid measurements to understand the physical condition of the grid, and combine this with SCADA. While high-frequency physical grid measurements and SCADA communication over Internet Protocol (IP) networks are fundamentally disparate information sources, when collectively examined through appropriate lenses, they offer a much more nuanced depiction of the grid.

24 POWER TRANSMISSION AND DISTRIBUTION↗

NASA NTRS1972

Applications of remote sensing to stream discharge predictions

A feasibility study has been initiated on the use of remote earth observations for augmenting stream discharge prediction for the design and/or operation of major reservoir systems, pumping systems and irrigation systems. The near-term objectives are the interpolation of sparsely instrumented precipitation surveillance networks and the direct measurement of water loss by evaporation. The first steps of the study covered a survey of existing reservoir systems, stream discharge prediction methods, gage networks and the development of a self-adaptive variation of the Kentucky Watershed model, SNOPSET, that includes snowmelt. As a result of these studies, a special three channel scanner is being built for a small aircraft, which should provide snow, temperature and water vapor maps for the spatial and temporal interpolation of stream gages.

Krause, F. R.↗

NASA NTRS2009

Channel Networks on Large Fans: Refining Analogs for the Ridge-forming Unit, Sinus Meridiani

Stream channels are generally thought of as forming within confined valley settings, separated by interfluves. Sinuous ridges on Mars and Earth are often interpreted as stream channels inverted by subsequent erosion of valley sides. In the case of the ridge-forming unit (RFU), this interpretation fails to explain the (i) close spacing of the ridges, which are (ii) organized in networks, and which (iii) cover large areas (approximately 175,000 km (exp 2)). Channel networks on terrestrial fans develop unconfined by valley slopes. Large fans (100s km long) are low-angle, fluvial features, documented worldwide, with characteristics that address these aspects of the RFU. Ridge patterns Channels on large fans provide an analog for the sinuous and elongated morphology of RFU ridges, but more especially for other patterns such as subparallel, branching and crossing networks. Branches are related to splays (delta-like distributaries are rare), whose channels can rejoin the main channel. Crossing patterns can be caused by even slight sinuosity splay-related side channels often intersect. An avulsion node distant from the fan apex, gives rise to channels with slightly different, and hence intersecting, orientations. Channels on neighboring fans intersect along the common fan margin. 2. Network density Channels are the dominant feature on large terrestrial fans (lakes and dune fields are minor). Inverted landscapes on subsequently eroded fans thus display indurated channels as networks of significantly close-spaced ridges. 3. Channel networks covering large areas Areas of individual large terrestrial fans can reach >200,000 km 2 (105-6 km 2 with nested fans), providing an analog for the wide area distribution of the RFU.

Wilkinson, Justin↗

DOE OSTI2020

1.2 Mfps standalone X-ray detector for Time-Resolved Experiments

We present a standalone and autonomous X-ray detector capable of operation with the speed of up to1.2Mfps. The detector utilizes UFXC32k hybrid pixel detectors for sensing X-rays, Spartan-6 LX45 FPGA placed in commercially available sbRIO 9628 controller for data acquisition and processing including a compression with zero-suppression algorithm. A Linux-RT system working on the 400 MHz Dual-Core CPU is used for FPGA control and data streaming to the higher-level system over 1 Gbps Ethernet connection. 1.2 M frames per second is achieved in so-called burst mode of operation while in zerodead-time mode 70 kfps is possible. Due to efficient data compression in FPGA there’s no need of using high-speed transceivers and Frame-Grabber cards on the data server side and the detector can stream the data infinitely over standard 1 Gbps network connection. Operation modes were tested at Advanced Photon Source Synchrotron at Argonne National Laboratory.

47 OTHER INSTRUMENTATION↗

DOE OSTI2022

Recommendations for Secure Transport: Material Conveyance Physical Protection Technology

Nuclear material is at higher risk of theft and sabotage during transport than during any other phase of the nuclear fuel lifecycle. Nuclear materials are transported in the public domain where adversaries have an upper hand by taking advantage of the time and location of the theft or sabotage attempt. As such, even modest threat profiles for transport of nuclear and radioactive material can require substantial detection and delay measures to support timely response. Conveyance tracking augmented with technology that improves on-the-scene situational awareness at a remote monitoring center has been adopted as a de-facto standard approach for transportation security. At present, the extended tracking and situational awareness capabilities needed for a nuclear material shipment, as is provided by the purpose designed, Transportation – Security, Tracking and Reporting (T-STAR) System, do not exist in a single commercial off-the-shelf (COTS) solution. Typically, the COTS systems that excel in one area are deficient in other areas, presenting challenges to designing well-rounded, robust systems. Still, COTS solutions can offer the basic set of tracking and situational awareness capabilities by indicating last update time, current location, and route taken. By incorporating vehicle and driver performance measures via the vehicle’s controller area network (CAN bus) and video alongside other data streams allows telemetry and other shipment information to be assessed in novel ways.This paper describes the operation, capabilities and features of various conveyance protection systems and approaches, assesses emerging technologies and how they could be used through a unified interface, and enumerates additional ways to provide early detection using vehicle, onboard technologies, effective delay technologies and approaches and simple equipment to improve protection during transport.

Shannon, Michael↗

DOE OSTI2024

MS4 - Municipal Separate Storm Sewer System

Stormwater refers to the rainwater or melted snow that flows over land surfaces - including streets, rooftops, and parking lots - that does not infiltrate into the ground. It is collected by storm drains and conveyed through a network of pipes and channels, eventually discharging into streams, rivers, lakes, or oceans. The storm sewer systems on NREL's South Table Mountain (STM) campus, distinct from the sanitary sewer systems, is known as a Municipal Separate Storm Sewer System (MS4).The Environmental Protection Agency (EPA) issued NREL an MS4 Permit for the STM campus to regulate stormwater operations within the boundaries of the STM campus. The STM campus is the only NREL campus to have an MS4 Permit.

ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2025

Real Time implementation of Artificial Intelligence compression algorithm for High-Speed Streaming Readout signals

The new generation of high-energy physics experiments plans to acquire data in streaming mode. With this approach, it is possible to access the information of the whole detector (organized in time slices) for optimal and lossless triggering of data acquisitions. With this approach, data rates, especially in large detectors, are often very high, and the network is likely to be the bottleneck for the entire Streaming Read Out system. The aim of this work is to study the implementation of a lossy compression algorithm based on Artificial Intelligence: an Autoencoder. With Machine Learning it is possible to achieve a high compression ratio and fast inference time with only a small degradation of the signals, almost negligible for the specific application. This work explores different configurations of the Autoencoder and the implementation on different hardware. Different Autoencoder configurations are explored to find the best trade-off between compression ratio and reconstruction loss, both for signals and energy spectrum. Different hardware implementations are also explored to find the best platform to achieve real-time performance for the specific application.

Rossi, Fabio (ORCID:0009000385713885)↗

DOE OSTI2022

A Self-learning Neural Network Approach for Radio Frequency Interference Detection and Removal in Radio Astronomy

In this work, we present a novel neural network (NN) method for the detection and removal of radio frequency interference (RFI) from the raw digitized signal in the signal processing chain of a typical radio astronomy experiment. The main advantage of our method is that it does not require a training set. Instead, our method relies on the fact that the true signal of interest coming from astronomical sources is thermal and therefore described as a Gaussian random process, which cannot be compressed. We employ a variational encoder/decoder network to find the compressible information in the data stream that can explain the most variance with the fewest degrees of freedom. We demonstrate it on a set of toy problems and stored ring buffers from the Baryon Mapping eXperiment prototype. We find that the RFI subtraction is effective at cleaning simulated time streams: While we find that the power spectra of the RFI-cleaned time streams output by the NN suffer from extra signal consistent with additive noise, we find that it is generally around percent level across the band and sub 10% in contaminated spectral channels even when RFI power is an order of magnitude larger than the signal. We discuss the advantages and limitations of this method and possible implementation in the front end of future radio experiments.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS2004

The International Global Network of Geodetic Fiducial Stations

Scientific need and technological opportunity require that we move toward implementing a global network of geodetic fiducial stations which feature co-located SLR, VLBI, GNSS, and DORIS instrumentation. Earth science of the next decade will require more accurate global change measurements of sea level topography, sea level change, polar ice mass balance, hydrological and atmospheric mass flux. and topographic deformation, real time mm scale navigation and precision time transfer on a global scale. These scientific requirements have been translated into a goal of mm scale annual stability for the terrestrial reference frame, earth orientation parameters, as well as the orbit and clock determinations tbr the GNSS systems. To meet these challenges, the four geodetic observing systems must be more tightly integrated in technology, location, and analysis. NASA strongly supports the objectives of the IGGOS initiative vis NASA's National Geodetic Observatory and INDIGO programs. The Global networks of GNSS, SLR. and VLBI observatories are for the most part poorly suited for these new demands. These important geodetic networks have evolved with little planning yet these systems are providing essential measurements to a wide swath of society. New signal structures in the GPS and the developing Galileo GNSS will soon require replacement of the GNSS receivers. The SLR network is poorly distributed globally, requires labor intensive observations and analysis, and for the most part relies upon antiquated technology. The VLBI observatories utilize large radio telescopes in remote regions that are poorly distributed globally. Co-location of these networks is sparse and co-location errors contribute significantly to the observing error spectrum. Increasing use of the S and X band by commercial and other government services will also contribute to increased observational errors. The time is upon us for an international effort to develop an optimized global geodetic fiducial network of twelve or more integrated automated geodetic observatories that will provide in near real time high density mea.surements of Earth orientation, geodetic positioning, and GNSS system monitoring. The strategic goal for the optimized global fiducial network should be efficient autonomous operation, real time data streaming to analysis centers with an integrated near real time analysis capability for all four observing systems. These goals are achievable in the next decade given the dramatic technological improvements in all geodetic systems. For VLBI, the BKG TIGO might be viewed as a preliminary prototype of technology for fundamental stations. Mark 5, PC-VSI. e-VLBI broadband development efforts are laying the groundwork to reduce the aperture of the VLBI antennas and to allow for precision mm level co-location of observing systems. Operating costs and enhanced accuracy would accrue from the elimination of hydrogen maser clocks using double differencing, GNSS time transfer technology, GHz broadband recording, real time analysis, and mm wavelength VLBI observations. A global geodetic fiducial network will not be realizable without international efforts and the support of the four services.

LaBrecque, John↗

DOE OSTI2023

Drainage network response to Arctic warming

Rapid Arctic warming may increase erosion and stream channel formation, which alters the flux of sediments, carbon, and nutrients in these sensitive ecosystems. Yet, understanding landscape change is hampered by a lack of predictive tools applicable to permafrost settings.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS2023

Sea Ice Drift Tracks From Autonomous Buoys in the MOSAiC Distributed Network

A network of autonomous, ice-tethered buoys was deployed around the Multidisciplinary drifting Observatory for the Study of Arctic Climate (MOSAiC) experiment in late September 2019 for a year-long drift in the Arctic Transpolar Drift Stream. The buoys were deployed as part of the MOSAiC distributed network (DN) which included 12 multi-instrumented ice stations and an additional 116 GPS buoys distributed primarily within a 40 km radius of the MOSAiC Central Observatory. Buoy coverage within the DN was maintained with additional deployments throughout the year-long drift allowing for collection of data over a full sea ice growth and melt cycle. All GPS position data from buoys deployed within the DN have been assembled and processed into the collection of 216 quality-controlled buoy drift tracks presented in this dataset covering the period 26 September 2019 – 23 May 2021. The drift tracks in this collection are ideal for studies of dynamic sea ice motion around the MOSAiC experiment at cascading spatial scales ranging from 100s of meters to 100s of km.

Angela C. Bliss↗