Search NASA⌕ Search

SEARCH · Search NASA

Results for “stream networks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Time Series Foundation Models and Deep Learning Architectures for Earthquake Temporal and Spatial Nowcasting

Advancing the capabilities of earthquake nowcasting, the real-time forecasting of seismic activities, remains crucial for reducing casualties. This multifaceted challenge has recently gained attention within the deep learning domain, facilitated by the availability of extensive earthquake datasets. Despite significant advancements, the existing literature on earthquake nowcasting lacks comprehensive evaluations of pre-trained foundation models and modern deep learning architectures; each focuses on a different aspect of data, such as spatial relationships, temporal patterns, and multi-scale dependencies. This paper addresses the mentioned gap by analyzing different architectures and introducing two innovative approaches called Multi Foundation Quake and GNNCoder. We formulate earthquake nowcasting as a time series forecasting problem for the next 14 days within 0.1-degree spatial bins in Southern California. Earthquake time series are generated using the logarithm energy released by quakes, spanning 1986 to 2024. Our comprehensive evaluations demonstrate that our introduced models outperform other custom architectures by effectively capturing temporal-spatial relationships inherent in seismic data. The performance of existing foundation models varies significantly based on the pre-training datasets, emphasizing the need for careful dataset selection. However, we introduce a novel method, Multi Foundation Quake, that achieves the best overall performance by combining a bespoke pattern with Foundation model results handled as auxiliary streams.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Classification and Localization of Fracture-Hit Events in Low-Frequency Distributed Acoustic Sensing Strain Rate with Convolutional Neural Networks

Summary Distributed acoustic sensing (DAS) has been used in the oil and gas industry as an advanced technology for surveillance and diagnostics. Operators use DAS to monitor hydraulic fracturing activities, examine well stimulation efficacy, and estimate complex fracture system geometries. Particularly, low-frequency DAS can detect geomechanical events such as fracture hits because hydraulic fractures propagate and create strain rate variations in the rock. Analysis of DAS data today is mostly done post-job and subject to interpretation methods. However, the continuous and dense data stream generated live by DAS poses the opportunity for more efficient and accurate real-time data-driven analysis. The objective of this study is to develop a machine learning-based workflow that can identify and locate fracture-hit events in simulated strain rate responses correlated with low-frequency DAS data. In this paper, “fracture hit” refers to a hydraulic fracture originating from a stimulated well intersecting an offset well. We start with building a single fracture propagation model to produce strain rate patterns observed at a hypothetical monitoring well. This model is used to generate two sets of strain rate responses with one set containing fracture-hit events. The labeled synthetic data are then used to train a custom convolutional neural network (CNN) model for identifying the presence of fracture-hit events. The same model is trained again for locating the event with the output layer of the model replaced with linear units. We achieved near-perfect predictions for both event classification and localization. These promising results prove the feasibility of using CNN for real-time event detection from fiber-optic sensing data. Additionally, we use edge detection techniques to recognize fracture-hit event patterns in strain rate images. The fracture-hit location can be identified using recognized pixels in the image. The accuracy of edge detection-based location identification is also plausible, but edge detection is dependent on the assumption of pattern shape and image quality, hence it is less robust compared to CNN models. This comparison further supports the need for CNN applications in image-based real-time fiber-optic sensing event detection.

Engineering↗
DOE OSTI2025

A Data-Agnostic, Continuous Machine Learning Framework for Application in High Energy Physics and Beyond: Phase 1 Final Scientific/Technical Report

This Phase 1 effort has focused on the development of continual learning frameworks for use in machine learning, specifically in the applied context of High Energy Physics (HEP). Machine learning (ML) is a transformative technology by which computers, typically through the use of neural networks, are able to perform tasks with proficiency that rivals or surpasses that of human users. Model Degradation & Catastrophic Forgetting are two undesired phenomena which can occur in ML where the performance of a model degrades when either deployed on novel data streams, or trained on novel data which are sufficiently different than the data the models were initially trained on. A natural example where these sorts of effects can be observed is in the performance of detectors in harsh environments, where the detector signature may change over the lifetime of the detector as it ages and deteriorates — precisely what occurs in the experiments conducted in HEP. Real world HEP data is therefore an excellent test-ground and use-case for Continual Learning paradigms, which are techniques used in ML to counteract these problems. Ensemble learning is one such technique, where multiple smaller models are trained on subsets of the overall data and are ensembled together during inference. The intuition behind this technique is that, although there are shifts in the distributions which govern the incoming data streams, these shifts are not expected to be homogeneous or global. If a sufficient diversity in solutions within the various sub-models has been achieved, then at least one sub-model is expected to retain its performance within the overall ensemble. One further strength of this approach is that the architectures of the various models do not need to be identical, and in fact even different modalities of data can naturally be combined in this way. This work focused on applying ensemble learning techniques to derive results using two main datasets, anomaly detection in HEP data & time-series forecasting in semiconductor manufacturing data. Semiconductor manufacturing involves data with surprising similarity to that of HEP (e.g. wafer maps look very similar to digi-occupancy maps) and Cerium Lab’s prominence within the semiconductor industry makes semiconductor manufacturing a natural opportunity for commercialization of this work. Our efforts have led to two strong results. The first is that we evaluated the proposed ensembling techniques using previously proposed machine learning architectures for use in anomaly detection, namely AutoEncoder based models and their derivatives. We also developed new architectures which have not been evaluated in this context before. In fact, this work marks the first use of Vision Transformers for anomaly detection in HEP. Second, we demonstrated that ensemble learning significantly improves model performance in scenarios prone to degradation, validating its effectiveness across both HEP and semiconductor datasets. These results further support ensemble learning as a powerful strategy for mitigating catastrophic forgetting and maintaining robust performance in evolving data environments.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

Improving an Acoustic Vehicle Detector Using an Iterative Self-Supervision Procedure

In many non-canonical data science scenarios, obtaining, detecting, attributing, and annotating enough high-quality training data is the primary barrier to developing highly effective models. Moreover, in many problems that are not sufficiently defined or constrained, manually developing a training dataset can often overlook interesting phenomena that should be included. To this end, we have developed and demonstrated an iterative self-supervised learning procedure, whereby models are successfully trained and applied to new data to extract new training examples that are added to the corpus of training data. Successive generations of classifiers are then trained on this augmented corpus. Using low-frequency acoustic data collected by a network of infrasound sensors deployed around the High Flux Isotope Reactor and Radiochemical Engineering Development Center at Oak Ridge National Laboratory, we test the viability of our proposed approach to develop a powerful classifier with the goal of identifying vehicles from continuously streamed data and differentiating these from other sources of noise such as tools, people, airplanes, and wind. Using a small collection of exhaustively manually labeled data, we test several implementation details of the procedure and demonstrate its success regardless of the fidelity of the initial model used to seed the iterative procedure. Finally, we demonstrate the method’s ability to update a model to accommodate changes in the data-generating distribution encountered during long-term persistent data collection.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

Online Distribution System State Estimation via Stochastic Gradient Algorithm

Distribution network operation is becoming more challenging because of the growing integration of intermittent and volatile distributed energy resources (DERs). This motivates the development of new distribution system state estimation (DSSE) paradigms that can operate at fast timescale based on real-time data stream of asynchronous measurements enabled by modern information and communications technology. To solve the real-time DSSE with asynchronous measurements effectively and accurately, this paper formulates a weighted least squares DSSE problem and proposes an online stochastic gradient algorithm to solve it. The performance of the proposed scheme is analytically guaranteed and is numerically corroborated with realistic data on IEEE 123-bus feeder.

distribution system state estimation↗
DOE OSTI2026

Network of Modified Portable Optical Particle Spectrometers Instrument Handbook

The U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility’s portable optical particle spectrometer (POPS) network (Figure 1) provides an aerosol size distribution spectrum from 150 nm to 5 μm in 16 logarithmically spaced bins. The data emanating from this network of up to four matching POPS in weatherproof enclosures comprises one-minute averages of the aerosol size and number spectrum and the co-located temperature and relative humidity. The total particle concentration and sample flow rate are also provided. The sample stream is not dried before its measurement. Two size spectra are provided: the default size distribution corresponds to the calibration using polystyrene latex spheres (PSL), while the second size distribution corresponds to the calibration using size-selected dry ammonium sulfate aerosol. The principal scientific application of the data provided by the ARM POPS is to determine the aerosol size distribution across a region in three disparate locations – the size distribution is broadly relevant to studies of pollution and of conditions in the boundary layer. A high particle concentration can be an indicator of unhealthy levels of pollution; the dispersion of particles in the atmosphere is a predictor of long-range visibility; and particles serve as collectors of condensing gases including water vapor, and thus are a factor in the formation and properties of fogs and clouds, and in the initiation of precipitation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

The evolution of dam induced river fragmentation in the United States

It is established that dams decrease river connectivity; however, previous global scale studies of river fragmentation focused on a small subset of the largest dams. In the United States, mid-sized dams, which are too small for global databases, account for 96% of major anthropogenic structures and 48% of reservoir storage. We conduct a national evaluation of the evolution of anthropogenic river bifurcation over time that includes more than 50,000 nationally inventoried dams. Mid-sized dams account for 73% of anthropogenically created stream fragments nationally. They also contribute disproportionately to short fragments (less than 10 km), which is particularly troubling for aquatic habitats. Here we show that dam construction has essentially reversed natural fragmentation patterns in the United States. Prior to human development, smaller river fragments and less connected networks occurred in arid basins while today we show that humid basins are the most fragmented due to human structures.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

A tale of two towers: comparing NEON and AmeriFlux data streams at Bartlett Experimental Forest

Long-term ecological data are essential for detecting impacts of climate change and other global change factors, and for making informed predictions about future change. However, long-term measurements are rarely replicated at the site level, which raises questions about their representativeness. We used a multiscale approach to evaluate the agreement of parallel observations from AmeriFlux and NEON (National Ecological Observatory Network) towers at Bartlett Experimental Forest, New Hampshire, USA. The two towers are separated by a horizontal distance of 93 m. Here, we focused our analysis on standard meteorological variables; fluxes of CO 2 , sensible heat, and latent heat measured by eddy covariance; and phenology derived from PhenoCam imagery. Results suggest excellent agreement between AmeriFlux and NEON in meteorology and phenology, and good agreement in fluxes at the half-hourly scale. However, large disagreements in CO 2 and latent heat fluxes occurred at the annual scale, with implications especially for the forest carbon balance. The AmeriFlux tower measurements indicate a site that is close to carbon-neutral (-8 ± 65 g C m -2 y -1 , mean ± 1 SD), whereas the NEON tower measurements indicate a forest that is a carbon sink (-137 ± 10 g C m -2 y -1 ). Causes of this disagreement may include measurement height (26 m vs. 35 m), which resulted in different flux footprints being measured by the two towers, and differences in the flux measurement systems. Our results suggest the need for caution when attempting to merge long-term flux data from two different measurement platforms, and when using measurements from any one measurement platform to inform decision-making on issues related to carbon accounting or natural climate solutions.

Carbon cycle↗
DOE OSTI2026

Artificial intelligence-driven municipal solid waste sortation and its significance on downstream waste valorization in the United States: Techno-economic and life cycle assessment

Municipal solid waste (MSW) generation is quickly increasing due to population growth, industrialization, and urbanization. Current sorting technologies, e.g., optical sorters have low sortation efficiency and produce contaminated sorted materials unsuitable for downstream valorization. This study evaluates a novel artificial neural network (ANN)-based MSW sortation system through sorting efficiencies, economic performance, and environmental impacts. ANN system can sort up to 8 plastic types and all organic waste (i.e., food, yard, and paper waste) with 99% and 93% recovery efficiency, respectively, compared to optical sortation which could separate only polyvinyl chloride (PVC) plastic ultimately producing mixed plastics (except PVC) and organics streams as products. Nonetheless, their sortation costs are similar, $28.7 for ANN-based sortation and $28 for optical sortation per metric ton (Mt) of MSW at processing capacity of 94,860 metric tons (Mt)/yr of MSW in the United States. Additionally, ANN system produced high purity feedstocks for downstream valorization. A biochar pyrolysis plant modeled to process 3.6 and 14 Mt/h of sorted yard waste outperformed biochar production from mixed organic fraction (MOF), achieving 8% lower production cost and 34% lower global warming impact (1.37 kg CO 2 eq. per kg) compared to biochar derived from mixed organic feedstock (2.08 kg CO 2 eq.).

09 BIOMASS FUELS↗
DOE OSTI2020

A multirate mass transfer model to represent the interaction of multicomponent biogeochemical processes between surface water and hyporheic zones (SWAT-MRMT-R 1.0)

Abstract. Surface water quality along river corridors can be modulated by hyporheic zones (HZs) that are ubiquitous and biogeochemically active. Watershed management practices often ignore the potentially important role of HZs as a natural reactor. To investigate the effect of hydrological exchange and biogeochemical processes on the fate of nutrients in surface water and HZs, a novel model, SWAT-MRMT-R, was developed coupling the Soil and Water Assessment Tool (SWAT) watershed model and the reaction module from a flow and reactive transport code (PFLOTRAN). SWAT-MRMT-R simulates concurrent nonlinear multicomponent biogeochemical reactions in both the channel water and its surrounding HZs, connecting the channel water and HZs through hyporheic exchanges using multirate mass transfer (MRMT) representation. Within the model, HZs are conceptualized as transient storage zones with distinguished exchange rates and residence times. The biogeochemical processes within HZs are different from those in the channel water. Hyporheic exchanges are modeled as multiple first-order mass transfers between the channel water and HZs. As a numerical example, SWAT-MRMT-R is applied to the Hanford Reach of the Columbia River, a large river in the United States, focusing on nitrate dynamics in the channel water. Major nitrate contaminants entering the Hanford Reach include those from the legacy waste, irrigation return flows (irrigation water that is not consumed by crops and runs off as point sources to the stream), and groundwater seepage resulting from irrigated agriculture. A two-step reaction sequence for denitrification and an aerobic respiration reaction is assumed to represent the biogeochemical transformations taking place within the HZs. The spatially variable hyporheic exchange rates and residence times in this example are estimated with the basin-scale Networks with EXchange and Subsurface Storage (NEXSS) model. Our simulation results show that (1), given a residence time distribution, how the exchange fluxes to HZs are approximated when using MRMT can significantly change the amount of nitrate consumption in HZs through denitrification and (2) source locations of nitrate have a different impact on surface water quality due to the spatially variable hyporheic exchanges.

58 GEOSCIENCES↗
DOE OSTI2023

Multi-functionalized basic immobilized amine sorbents for removal of metal contaminants from wastewater

This disclosure provides polyamine sorbent compositions for the separation of metals from aqueous solutions. The polyamine sorbent compositions comprise a silica support, an aminosilane bound to the silica support, an epoxysilane bound to the silica support, and a polyamine where the polyamine is chemically tethered onto a solid silica support through via the epoxysilane. The polyamine may be further stabilized within the bulk sorbent through hydrogen bonding interactions with the aminosilane. The sorbent compositions resist leaching by H 2 O in an aqueous stream containing heavy oxyanion-based (and other) metals and demonstrate stability over a pH range of 2-14. The sorbent compositions are useful for the separation of metals from aqueous solutions. The cationic heavy metals are captured by the co-existing amine groups (—NH 2 , —NH, —N) from the polymeric network while additional metal capture capacity is derived from the introduction of a secondary silane linker.

Gray, McMahan L.↗
DOE OSTI2020

DUNE DAQ R&D integration in ProtoDUNE Single-Phase at CERN

The DAQ system of ProtoDUNE-SP successfully proved its design principles and met the requirements of the beam run of 2018. The technical design of the DAQ system for the DUNE experiment has major differences compared to the prototype due to different requirements placed on the detector, as well as a radically different location of operation. The single-phase prototype at CERN is a major integration facility for R&D aspects of the DUNE DAQ system. The facility allows for the exploration of additional data processing capabilities and optimization of the FELIX system, which is the chosen TPC readout solution for the DUNE single-phase detectors. One of the fundamental differences from the prototype is that the DUNE DAQ relies on self-triggering. Therefore, real-time processing of the data stream for hit and trigger primitive finding is essential for the requirement of continuous readout. The supernova burst trigger requires a large and fast buffering technique, where 3D XPoint persistent memory solutions are evaluated and integrated. In order to maximize resource utilization of the FELIX hosting servers, the elimination of the 100 Gb network communication stack is desired. This implies the design and development of a single-host application layer, which is a fundamental element of the self-triggering chain. This paper discusses the evaluation and integration of these developments for the DUNE DAQ, in the ProtoDUNE environment.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

VDiSC: An Open Source Framework for Distributed Smart City Vision and Biometric Surveillance Networks

Recent global growth in the interest of smart cities has led to trillions of dollars of investment toward research and development. These connected cities have the potential to create a symbiosis of technology and society and revolutionize the cost of living, safety, ecological sustainability, and quality of life of societies on a world-wide scale. Some key components of the smart city construct are connected smart grids, self-driving cars, federated learning systems, smart utilities, large-scale public transit, and proactive surveillance systems. While exciting in prospect, these technologies and their subsequent integration cannot be attempted without addressing the potential societal impacts of such a high degree of automation and data sharing. Additionally, the feasibility of coordinating so many disparate tasks will require a fast, extensible, unifying framework. To that end, we propose the Distributed Smart City framework for Vision, or VDiSC. VDiSC serves as a unified biometric API harness that allows for seamless evaluation, deployment, and simple pipeline creation for heterogeneous biometric software. VDiSC additionally provides a fully declarative capability for defining and coordinating custom machine learning and sensor pipelines, allowing the distribution of processes across otherwise incompatible hardware and networks. VDiSC ultimately provides a way to quickly configure, hot-swap, and expand large coordinated or federated systems online without interruptions for maintenance. Because much of the data collected in a smart city contains Personally Identifying Information (PII), VDiSC also provides built-in tools and layers to ensure secure and encrypted streaming, storage, and access of PII data across distributed systems.

Brogan, Joel↗
DOE OSTI2024

Technical Bulletin 005: NTP Monitoring

The Center for Alternative Synchronization and Timing (CAST) views Precision Time Protocol (PTP) and Network Time Protocol (NTP) as critical elements of the grid, from generation to the grid edge. This tech bulletin discusses the operation of NTP. The document shows not only commercial but also open-source applications. In some cases, the commercial applications may already have existing feature sets to secure and monitor NTP streams. From a security standpoint, using subscription NTP is risky unless the open bidirectional ports on local firewalls and routers are properly monitored and controlled.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

ESnet-JLab FPGA Accelerated Transport (control plane) [EJFAT (udplbd2)] v2.0

The ESnet-JLab FPGA Accelerated Transport system is a solution for streaming high-speed scientific measurement data from Data Acquisition Systems (DAQs) to high-performance computing facilties. It is generally compatible with many science workflows, and makes no assumptions about the specifics of any particular experiment. This program (udplbd version 2) implements the control plane for the system. It is responsible for programming network forwarding rules into the data plane (implemented by the hardware designed named udplb, described separately). It also implements the control loop necessary to match up offered workload with available capacity on high-performance compute nodes.

Howard, Derek [Lawrence Berkeley National Laborato↗
DOE OSTI2021

Intelligent Monitoring Systems and Advanced Well Integrity and Mitigation

Long-term seismic monitoring of carbon capture and storage projects is needed to verify that the injected gas is safely stored in the subsurface until permanence can be assured. Conventional surface seismic monitoring techniques are usually expensive, require highly invasive surface operations, and need significant time investments on the part of personnel for both the field effort and processing the acquired data. For these reasons, permanent reservoir monitoring technologies are preferred, as they can offer a cost-effective solution for long-term monitoring. As part of the monitoring program of the Archer Daniels Midland’s large-scale injection of CO 2 in Decatur, Illinois, USA, a continuous seismic monitoring array was installed using a combination of surface orbital vibrator (SOV) sources and fiber-optic cables for distributed acoustic sensing (DAS) acquisition with the objective to build a continuous monitoring array. The aim of the presented project was to build a monitoring array and platform that integrates real-time seismic data with conventional data streams and provides continuous data analysis using dynamic computational models to deliver a comprehensive real-time assessment of subsurface conditions. It is in this context that the Intelligent Monitoring Systems and Advanced Well Integrity and Mitigation project was proposed with the objective to develop an integrated architecture that utilizes a permanent seismic monitoring network, combines the real-time geophysical and process data with reservoir flow and geomechanical models to create a comprehensive monitoring, visualization, and control system that delivers critical information for process surveillance and optimization.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Experimental and numerical investigation of flame stabilization and pollutant formation in matrix stabilized ammonia-hydrogen combustion

Ammonia (NH 3 ) is a carbon-free fuel that offers an attractive alternative for reducing greenhouse gas emissions. However, the slow flame speed, low heating value, and emissions of nitrogen-containing pollutants present significant issues for practical combustion applications. To address these issues, we investigate the use of matrix stabilized combustion. In this type of burner, combustion is performed within an inert porous ceramic foam, heat is recirculated by solid conduction and radiation, which enhances flame speed and combustion stabilization, thereby permitting combustion over a wide range of equivalence ratio conditions. We present a new porous media burner (PMB) capable of stabilizing NH 3 /air flames at ambient conditions. An extensive experimental characterization of the stability of this burner is conducted with up to 30% by volume of hydrogen (H 2 ) in the fuel stream. A 15:1 turndown ratio is demonstrated, with a high thermal power density of 62 MW m -3 . Concentrations of NO, unburnt NH 3 , and H 2 in the exhaust stream are measured. Two regimes are identified for low NO operation: rich and very lean. For rich conditions, NO emissions decrease with increasing equivalence ratio and decreasing H 2 blending. Unburnt NH 3 emissions follow opposite trends. These measurements are complemented by simulations in which the burner is represented by a coupled solid-gas reactor network. In conclusion, this model captures the burner’s pollutant emissions to good accuracy and is used to analyze the mechanisms of pollutant formation.

42 ENGINEERING↗