SEARCH · Search NASA

Results for “Streaming Data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40

All sources NASA NTRS DOE OSTI

DOE OSTI2022

California wildfire spread derived using VIIRS satellite observations and an object-based tracking system

Changing wildfire regimes in the western US and other fire-prone regions pose considerable risks to human health and ecosystem function. However, our understanding of wildfire behavior is still limited by a lack of data products that systematically quantify fire spread, behavior and impacts. Here we develop a novel object-based system for tracking the progression of individual fires using 375 m Visible Infrared Imaging Radiometer Suite active fire detections. At each half-daily time step, fire pixels are clustered according to their spatial proximity, and are either appended to an existing active fire object or are assigned to a new object. This automatic system allows us to update the attributes of each fire event, delineate the fire perimeter, and identify the active fire front shortly after satellite data acquisition. Using this system, we mapped the history of California fires during 2012–2020. Our approach and data stream may be useful for calibration and evaluation of fire spread models, estimation of near-real-time wildfire emissions, and as means for prescribing initial conditions in fire forecast models.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2018

Optimal strategy for polarization modulation in the LSPE-SWIPE experiment

Context. Cosmic microwave background (CMB) B-mode experiments are required to control systematic effects with an unprecedented level of accuracy. Polarization modulation by a half wave plate (HWP) is a powerful technique able to mitigate a large number of the instrumental systematics. Aims. Our goal is to optimize the polarization modulation strategy of the upcoming LSPE-SWIPE balloon-borne experiment, devoted to the accurate measurement of CMB polarization at large angular scales. Methods. We departed from the nominal LSPE-SWIPE modulation strategy (HWP stepped every 60 s with a telescope scanning at around 12 deg/s) and performed a thorough investigation of a wide range of possible HWP schemes (either in stepped or continuously spinning mode and at different azimuth telescope scan-speeds) in the frequency, map and angular power spectrum domain. In addition, we probed the effect of high-pass and band-pass filters of the data stream and explored the HWP response in the minimal case of one detector for one operation day (critical for the single-detector calibration process). We finally tested the modulation performance against typical HWP-induced systematics. Results. Our analysis shows that some stepped HWP schemes, either slowly rotating or combined with slow telescope modulations, represent poor choices. Moreover, our results point out that the nominal configuration may not be the most convenient choice. While a large class of spinning designs provides comparable results in terms of pixel angle coverage, map-making residuals and BB power spectrum standard deviations with respect to the nominal strategy, we find that some specific configurations (e.g., a rapidly spinning HWP with a slow gondola modulation) allow a more efficient polarization recovery in more general real-case situations. Conclusions. Although our simulations are specific to the LSPE-SWIPE mission, the general outcomes of our analysis can be easily generalized to other CMB polarization experiments.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2020

DUNE DAQ R&D integration in ProtoDUNE Single-Phase at CERN

The DAQ system of ProtoDUNE-SP successfully proved its design principles and met the requirements of the beam run of 2018. The technical design of the DAQ system for the DUNE experiment has major differences compared to the prototype due to different requirements placed on the detector, as well as a radically different location of operation. The single-phase prototype at CERN is a major integration facility for R&D aspects of the DUNE DAQ system. The facility allows for the exploration of additional data processing capabilities and optimization of the FELIX system, which is the chosen TPC readout solution for the DUNE single-phase detectors. One of the fundamental differences from the prototype is that the DUNE DAQ relies on self-triggering. Therefore, real-time processing of the data stream for hit and trigger primitive finding is essential for the requirement of continuous readout. The supernova burst trigger requires a large and fast buffering technique, where 3D XPoint persistent memory solutions are evaluated and integrated. In order to maximize resource utilization of the FELIX hosting servers, the elimination of the 100 Gb network communication stack is desired. This implies the design and development of a single-host application layer, which is a fundamental element of the self-triggering chain. This paper discusses the evaluation and integration of these developments for the DUNE DAQ, in the ProtoDUNE environment.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2021

HOSS!

The Hall-D Online Skim System (HOSS) was developed to simultaneously solve two issues for the high intensity GlueX experiment. One was to parallelize the writing of raw data files to disk in order to improve bandwidth. The other was to distribute the raw data across multiple compute nodes in order to produce calibration skims of the data online. The highly configurable system employs RDMA, RAM disks, and zeroMQ driven by Python to simultaneously store and process the full high intensity GlueX data stream.

Lawrence, David↗

DOE OSTI2023

Electron pulse-dilation diagnostic instruments

During the past decade, a number of diagnostic instruments have been developed that utilize electron pulse-dilation to achieve temporal resolution in the 5–30 ps range. These development efforts were motivated by the need for advanced diagnostics for high-energy density physics experiments around the world. The new instruments include single- and multi-frame gated imagers and non-imaging detectors that record continuous data streams. Electron pulse-dilation provides high-speed detection capability by converting incoming signals into a free electron cloud and manipulating the electron signal with electric and magnetic fields. In this paper we discuss design details and applications of these instruments along with issues and challenges associated with employing the electron pulse-dilation technique. Additionally, methods to characterize instrument performance and improve tolerance to gamma and neutron background radiation are discussed.

47 OTHER INSTRUMENTATION↗

DOE OSTI2024

Demystifying group-4 polyolefin hydrogenolysis catalysis: Gaseous propane hydrogenolysis mechanism over the same catalysts

A kinetic/mechanistic investigation of gaseous propane hydrogenolysis over the single-site heterogeneous polyolefin depolymerization catalysts AlS/ZrNp 2 and AlS/HfNp 2 (AlS = sulfated alumina, Np = neopentyl), is use to probe intrinsic catalyst properties without the complexities introduced by time- and viscosity-dependent polymer medium effects. In a polymer-free automated plug-flow catalytic reactor, propane hydrogenolysis turnover frequencies approach 3,000 h −1 at 150 °C. Both catalysts exhibit approximately linear relationships between rate and [H 2 ] at substoichiometric [H 2 ] with rate law orders of 0.66 ± 0.09 and 0.48 ± 0.07 for Hf and Zr, respectively; at higher [H 2 ], the rates approach zero-order in [H 2 ]. Reaction orders in [C 3 H 8 ] and [catalyst] are essentially zero-order under all conditions, with the former implying rapid, irreversible alkane binding/activation. This rate law, activation parameter, and DFT energy span analysis support a scenario in which [H 2 ] is pivotal in one of two plausible and competing rate-determining transition states—bimolecular metal-alkyl bond hydrogenolysis vs. unimolecular β-alkyl elimination. The Zr and Hf catalyst activation parameters, ΔH ‡ = 16.8 ± 0.2 kcal mol −1 and 18.2 ± 0.6 kcal mol −1 , respectively, track the relative turnover frequencies, while ΔS ‡ = −19.1 ± 0.8 and −16.7 ± 1.4 cal mol −1 K −1 , respectively, imply highly organized transition states. These catalysts maintain activity up to 200 °C, while time-on-stream data indicate multiday activities with an extrapolated turnover number ~92,000 at 150 °C for the Zr catalyst. This methodology is attractive for depolymerization catalyst discovery and process optimization.

03 NATURAL GAS↗

DOE OSTI2024

Utilizing a Virtual Sodium-Cooled Fast Reactor Digital Twin to Aid in Diversion Pathway Analysis for International Safeguards Applications

We report digital twin technology has the potential to improve the effectiveness of international safeguards inspectors by providing a tool which can: first, perform an accurate diversion path analysis, identify their indicators, and required sensors to detect them; and second, monitor facilities in real-time using critical data streams that benefit from this safeguards-by-design approach. Safeguards inspectors are required to visit facilities and verify the nuclear material to ensure no diversion has taken place and detect misuse of the facility; however, this analysis and verification effort is time consuming, and with limited funding it is imperative that time spent at a nuclear facility is focused on key areas. A virtual digital twin of three prototypic sodium fast reactors was developed, where diversion and misuse scenarios were explored to determine how a digital twin could provide inspectors with an understanding of how proliferation may occur and where the most likely areas for proliferation would be. For each of the three reactors, an optimization algorithm was able to find core designs which would be difficult to detect via sensors alone; however, the use of a machine learning adapter provided by the digital twin was able to show general trends in where proliferation as likely to take place.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2023

MHD mode tracking using high-speed cameras and deep learning

Abstract We present a new algorithm to track the amplitude and phase of rotating magnetohydrodynamic (MHD) modes in tokamak plasmas using high speed imaging cameras and deep learning. This algorithm uses a convolutional neural network (CNN) to predict the amplitudes of the n = 1 sine and cosine mode components using solely optical measurements from one or more cameras. The model was trained and tested on an experimental dataset consisting of camera frame images and magnetic-based mode measurements from the High Beta Tokamak - Extended Pulse (HBT-EP) device, and it outperformed other, more conventional, algorithms using identical image inputs. The effect of different input data streams on the accuracy of the model’s predictions is also explored, including using a temporal frame stack or images from two cameras viewing different toroidal regions.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2024

Test of lepton flavor universality in B ± → K ± μ + μ – and B ± → K ± e + e – decays in proton-proton collisions at $\sqrt{s}$ = 13 TeV

A test of lepton flavor universality in B ± → K ± μ + μ – and B ± → K ± e + e – decays, as well as a measurement of differential and integrated branching fractions of a nonresonant B ± → K ± μ + μ – decay are presented. The analysis is made possible by a dedicated data set of proton-proton collisions at $\sqrt{s}$ = 13 TeV recorded in 2018, by the CMS experiment at the LHC, using a special high-rate data stream designed for collecting about 10 billion unbiased b hadron decays. The ratio of the branching fractions B(B ± → K ± μ + μ – ) to B(B ± → K ± e + e – ) is determined from the measured double ratio R(K) of these decays to the respective branching fractions of the B ± → J/ψK ± with J/ψ → μ + μ – and e + e – decays, which allow for significant cancellation of systematic uncertainties. The ratio R(K) is measured in the range 1.1 < q 2 < 6.0 GeV 2 , where q is the invariant mass of the lepton pair, and is found to be R(K) = 0.78$^{+0.47}_{-0.23}$, in agreement with the standard model expectation R(K) ≈ 1. This measurement is limited by the statistical precision of the electron channel. The integrated branching fraction in the same q 2 range, B(B ± → K ± μ + μ – ) = (12.42 ± 0.68) x 10 -8 , is consistent with the present world-average value and has a comparable precision.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2022

A Self-learning Neural Network Approach for Radio Frequency Interference Detection and Removal in Radio Astronomy

In this work, we present a novel neural network (NN) method for the detection and removal of radio frequency interference (RFI) from the raw digitized signal in the signal processing chain of a typical radio astronomy experiment. The main advantage of our method is that it does not require a training set. Instead, our method relies on the fact that the true signal of interest coming from astronomical sources is thermal and therefore described as a Gaussian random process, which cannot be compressed. We employ a variational encoder/decoder network to find the compressible information in the data stream that can explain the most variance with the fewest degrees of freedom. We demonstrate it on a set of toy problems and stored ring buffers from the Baryon Mapping eXperiment prototype. We find that the RFI subtraction is effective at cleaning simulated time streams: While we find that the power spectra of the RFI-cleaned time streams output by the NN suffer from extra signal consistent with additive noise, we find that it is generally around percent level across the band and sub 10% in contaminated spectral channels even when RFI power is an order of magnitude larger than the signal. We discuss the advantages and limitations of this method and possible implementation in the front end of future radio experiments.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2024

The SparkPix-S ASIC for the sparsified readout of 1 MHz frame-rate X-ray cameras at LCLS-II: pixel design and simulation results

Exploiting the “sparse” nature of the information in XPCS (X-ray Photon Correlation Spectroscopy) and XSVS (Speckle Visibility Spectroscopy) experiments, we present the SparkPix-S, a 3-sides buttable Application Specific Integrated Circuit (ASIC) based on a sparsified readout strategy for large-format hybrid detectors. The SparkPix-S architecture, based on the successful ePix family, will be composed as follows: a front-end 2-D matrix of 384×352 square pixels with 50 µm pitch is arranged to match the dimensions of a PIN Si-sensor matrix; charge readout, signal shaping and amplitude discrimination is performed at pixel-level, by means of a low-power (<18 µW) analog processor, which, in case of an event, negotiates access to an analog bus placed every other column; on the chip periphery (balcony), the information on each bus is digitized by an array of successive approximation analog-to-digital converters (SAR-ADCs) running at 10 Msps; on the digital back-end the global logic will generate the output data stream using low-voltage differential signalling (LVDS). A first prototype of the SparkPix-S, with a reduced matrix size of 96×96 pixels, is currently under production on a 130 nm CMOS technology. Simulated performance results show an equivalent noise charge <60 el. r.m.s. at 1 MHz repetition rate, with a maximum input energy of 60 keV and capability to discriminate charge signals with equivalent energy as low as 900 eV.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2021

A New Approach to Evaluate and Reduce Uncertainty of Model-Based Biodiversity Projections for Conservation Policy Formulation

Biodiversity projections with uncertainty estimates under different climate, land-use, and policy scenarios are essential to setting and achieving international targets to mitigate biodiversity loss. Evaluating and improving biodiversity predictions to better inform policy decisions remains a central conservation goal and challenge. A comprehensive strategy to evaluate and reduce uncertainty of model outputs against observed measurements and multiple models would help to produce more robust biodiversity predictions. We propose an approach that integrates biodiversity models and emerging remote sensing and in-situ data streams to evaluate and reduce uncertainty with the goal of improving policy-relevant biodiversity predictions. In this work, we describe a multivariate approach to directly and indirectly evaluate and constrain model uncertainty, demonstrate a proof of concept of this approach, embed the concept within the broader context of model evaluation and scenario analysis for conservation policy, and highlight lessons from other modeling communities.

essential biodiversity variables↗

DOE OSTI2019

Getting more from heterogeneous HIV-1 surveillance data in a high immigration country: estimation of incidence and undiagnosed population size using multiple biomarkers

Most HIV infections originate from individuals who are undiagnosed and unaware of their infection. Estimation of this quantity from surveillance data is hard because there is incomplete knowledge about (i) the time between infection and diagnosis (TI) for the general population, and (ii) the time between immigration and diagnosis for foreign-born persons. We developed a new statistical method for estimating the incidence of HIV-1 and the number of undiagnosed people living with HIV (PLHIV), based on dynamic modelling of heterogeneous HIV-1 surveillance data. The methods consist of a Bayesian non-linear mixed effects model using multiple biomarkers to estimate TI of HIV-1-positive individuals, and a novel incidence estimator which distinguishes between endogenous and exogenous infections by modelling explicitly the probability that a foreign-born person was infected either before or after immigration. The incidence estimator allows for direct calculation of the number of undiagnosed persons. The new methodology is illustrated combining heterogeneous surveillance data from Sweden between 2003 and 2015. A leave-one-out cross-validation study showed that the multiple-biomarker model was more accurate than single biomarkers (mean absolute error 1.01 vs ≥1.95). We estimate that 816 [95% credible interval (CI) 775-865] PLHIV were undiagnosed in 2015, representing a proportion of 10.8% (95% CI 10.3-11.4%) of all PLHIV. Here, the proposed methodology will enhance the utility of standard surveillance data streams and will be useful to monitor progress towards and compliance with the 90–90-90 UNAIDS target.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2019

Development of a Novel AOP for Cyp2F2-Mediated Lung Cancer in Mice

Abstract Traditional methods for carcinogenicity testing rely heavily on the rodent bioassay as the standard for identification of tumorigenic risk. As such, identification of species-specific outcomes and/or metabolism are a frequent argument for regulatory exemption. One example is the association of tumor formation in the mouse lung after exposure to Cyp2F2 ligands. The adverse outcome pathway (AOP) framework offers a theoretical platform to address issues of species specificity that is consistent, transparent, and capable of integrating data from new approach methodologies as well as traditional data streams. A central premise of the AOP concept is that pathway progression from the molecular initiating event (MIE) implies a definable “response-response” (R-R) relationship between each key event (KE) that drives the pathway towards a specific adverse outcome (AO). This article describes an AOP for lung cancer in the mouse from an MIE of Cyp2F2-specific reactive metabolite formation, advancing through KE that include protein and/or nucleic acid adducts, diminished Club Cell 10 kDa (CC10) protein expression, hyperplasia of CC10 deficient Club cells, and culminating in the AO of mixed-cell tumor formation in the distal airways. This tumor formation is independent of route of exposure and our AOP construct is based on overlapping mechanistic events for naphthalene, styrene, ethyl benzene, isoniazid, and fluensulfone in the mouse. This AOP is intended to accelerate the explication of an apparent mouse-specific outcome and serve as a starting point for a quantitative analysis of mouse-human differences in susceptibility to the tumorigenic effects of Cyp2F2 ligands.

Hill, III, Thomas↗

DOE OSTI2025

Modeling the differential rate for signal interactions in coincidence with noise fluctuations or large rate backgrounds

The characteristic energy of a relic dark matter interaction with a detector scales strongly with the putative dark matter mass. Consequently, experimental search sensitivity at the lightest masses will always come from interactions whose size is similar to noise fluctuations and low energy backgrounds in the detector. In this paper, we correctly calculate the net change in measured differential event rate due to low rate signal interactions that overlap in time with noise and backgrounds, accounting for both periods of time when the signal is coincident with noise/backgrounds and for the decreased amount of time in which only noise/backgrounds occur and we show that the introduction of random simulated signal events into the continuous raw data stream (a form of “salting”) provides a correct and practical implementation to estimate this net linear signal sensitivity. Unfortunately this does not apply to the situation with non negligible pileups as we show through explicit examples. Consequently, this exclusion technique should be complemented by less sensitive techniques that can separately exclude large rate, high pileup signal parameter space. An analysis threshold above the Gaussian-like noise component of the measured differential rate spectrum should also likely produce conservative limits. Though previous light mass dark matter searches did not correctly account for decreased background only live time effects in their signal sensitivity, conservative analysis choices likely protected their published limits from being nonconservative.

Li, Xinran↗

DOE OSTI2024

Automated pipeline processing X-ray diffraction data from dynamic compression experiments on the Extreme Conditions Beamline of PETRA III

Presented and discussed here is the implementation of a software solution that provides prompt X-ray diffraction data analysis during fast dynamic compression experiments conducted within the dynamic diamond anvil cell technique. It includes efficient data collection, streaming of data and metadata to a high-performance cluster (HPC), fast azimuthal data integration on the cluster, and tools for controlling the data processing steps and visualizing the data using the DIOPTAS software package. This data processing pipeline is invaluable for a great number of studies. The potential of the pipeline is illustrated with two examples of data collected on ammonia–water mixtures and multiphase mineral assemblies under high pressure. The pipeline is designed to be generic in nature and could be readily adapted to provide rapid feedback for many other X-ray diffraction techniques, e.g. large-volume press studies, in situ stress/strain studies, phase transformation studies, chemical reactions studied with high-resolution diffraction etc.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

Architecture for Quantum-in-the Loop Real-Time Simulations for Designing Resilient Smart Grids

With the power grid growing more complex every day with the inclusion of new sensors and regulatory approvals that enable end-users and small local developers to participate in the grid, it is becoming challenging for conventional smart grid simulation, emulation, and testing technologies to keep up. In this work, we propose that quantum-encoded real-time simulations can be helpful under the new paradigm and operational circumstances to solve optimization problems for power grids. By leveraging the principles of quantum mechanics, the proposed quantum-in-loop (QIL) framework will enable better and faster optimization solutions based on real-world, real-time data streams, facilitating the real-time planning and operations of electrical grids that rely on millions of distributed sensors and controllers. Furthermore, QIL will allow researchers and engineers to assist utilities in designing, developing, and de-risking algorithms to optimize power grid operation and resilience by considering inputs from millions of grid-connected devices. QIL framework is being developed to have a self-limiting triage mechanism, which will help engineers and practitioners identify fundamental physical limits on quantum processors, revealing what quantum algorithms can and cannot do in utility-specific use cases and must continue to count on classical high-performance computing infrastructure.

digital real-time simulation↗

DOE OSTI2025

Automation for Grid Interconnected Laboratory Emulation

As computational capabilities improve, digital twins are becoming vital for evaluating equipment realistically in laboratories. This paper outlines a digital twin architecture for the power grid, employing electromagnetic transient (EMT) simulation alongside real-time simulation of power hardware and hierarchical control systems. EMT simulation occurs on a high-performance computing server for scalability. Additionally, the paper describes a workflow and real-time data streaming software facilitating connectivity among EMT simulation, hierarchical control systems, and power hardware. This software enables automated equipment connectivity in the laboratory for realistic evaluations, aiding in identifying necessary upgrades for both equipment control systems and the power grid.

Marthi, Phani Ratna Vanamali [ORNL] (ORCID:0000000↗