Search NASA⌕ Search

SEARCH · Search NASA

Results for “data streaming”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36

Gila Water Resources II: Using Earth Observations to Identify Wildfire Impacts on Hydrologic Functions and Recovery in the Gila National Forest

Wildfires have the potential to cause devastating and long-lasting impacts on ecological systems. In the Gila National Forest (Gila NF), wildfire events have occurred with increasing frequency and severity over recent years. These disturbances, such as the historic Whitewater Baldy Complex Fire (2012) and Silver Fire (2013), have raised concerns over post-fire flooding, debris flows, and vegetation recovery. Understanding connections between burn events and ecological functions is crucial for developing effective land management practices within the Gila NF that ensure conservation of the watershed. The Gila Water Resources II team worked in partnership with the US Department of Agriculture (USDA) US Forest Service’s (USFS) Gila National Forest and Region 3. This project provided insight into the influence of wildfires on increased flooding events and determined if restoration efforts in the Gila NF are having a beneficial impact on vegetation regeneration. To understand recovery trends and hydrologic impact in the Gila NF between 2000-2019, this project used Landsat 5 Thematic Mapper, Landsat 7 Enhanced Thematic Mapper Plus, Landsat 8 Operational Land Imager, Global Precipitation Measurement Integrated Multi-satellite Retrievals for GPM precipitation, along with ancillary data from USGS stream gauges and data provided by USDA USFS’s Gila National Forest and Region 3. Based on these data, the team identified burn areas that received restorative treatments and compared Normalized Burn Ratio for different land cover types to better inform land management decisions. Additionally, the team analyzed the relationship between precipitation and streamflow from stream gauges to investigate the impact wildfires have on hydrology within the watershed.

Water Resources↗

Surface Water Quality Data from Beaver-Impacted Streams; Trail Creek and East River, Colorado 2025

This data package contains surface water chemistry measurements collected in 2025 to evaluate how beaver damming and low-tech process-based stream restoration influence water quality and metal mobility in mountainous headwater systems of the Upper Colorado River Basin. Sampling was conducted at Trail Creek (Taylor Park watershed, Colorado), a tributary undergoing restoration through installation of low-tech process-based structures (i.e., beaver dam analogs), and at off-channel beaver ponds within the East River floodplain (East River watershed, Colorado). Samples were collected along longitudinal transects spanning upstream control reaches, beaver-influenced ponded reaches, and downstream segments. Additional samples were collected from near-surface pore waters within a beaver dam seepage face. The dataset includes concentrations of major and trace elements measured by inductively coupled plasma–mass spectrometry (ICP-MS) and inductively coupled plasma–optical emission spectrometry (ICP-OES), major anions measured by ion chromatography (IC), and dissolved organic carbon (DOC; reported as non-purgeable organic carbon, NPOC). Samples were size-fractionated at 0.45 micrometers (µm), 0.22 µm, and 0.02 µm to distinguish particulate (>0.45 µm), colloidal (0.22–0.02 µm), and dissolved (<0.02 µm) fractions. The data package consists of comma-separated value (.csv) files containing tabulated chemical concentration data, sample metadata (site identifiers, geographic coordinates, sampling dates, fraction type), and quality control flags. All files are provided in open, non-proprietary formats that can be accessed using standard data analysis software such as Microsoft Excel, R, Python, MATLAB, or other programs capable of reading .csv files. Units, detection limits, and analytical methods are documented in accompanying metadata files. The dataset is designed to support analyses of (1) how beaver impoundment and restoration structures alter elemental partitioning and transport, (2) the role of iron and organic carbon in mediating trace metal mobility, and (3) reach-scale changes in water quality across restoration gradients. This work was supported by the Watershed Function Science Focus Area at Lawrence Berkeley National Laboratory funded by the US Department of Energy, Office of Science, Biological and Environmental Research under Contract No. DE-AC02-05CH11231. Part of this work was performed at SLAC Accelerator Laboratory funded by the US Department of Energy, Office of Science, Biological and Environmental Research under Contract No. DE-AC02-76SF00515.

Anions↗

Optical data processing analysis of stream patterns exhibited on ERTS-1 imagery

The purpose of the investigation described in this paper has been the analysis of large-scale geologic ground patterns in Kansas using ERTS-1 imagery and optical data processing techniques. Optical spatial frequency data provide a repeatable quantitative means of specifying ground pattern characteristics.

Egbert, D.↗

PvaPy streaming framework for real-time data processing

User facility upgrades, new measurement techniques, advances in data analysis algorithms as well as advances in detector capabilities result in an increasing amount of data collected at X-ray beamlines. Some of these data must be analyzed and reconstructed on demand to help execute experiments dynamically and modify them in real time. In turn, this requires a computing framework for real-time processing capable of moving data quickly from the detector to local or remote computing resources, processing data, and returning results to users. In this paper, we discuss the streaming framework built on top of PvaPy, a Python API for the EPICS pvAccess protocol. We describe the framework architecture and capabilities, and discuss scientific use cases and applications that benefit from streaming workflows implemented on top of this framework. We also illustrate the framework's performance in terms of achievable data-processing rates for various detector image sizes.

EPICS pvAccess↗

Challenges in Evaluating Relationships Between Quantitative Data (Carbon Dioxide) and Qualitative Data (Self-Reported Visual Changes)

Understanding the nuances in clinical data is critical in developing a successful data analysis plan. Carbon dioxide (CO2) data are collected on board the International Space Station (ISS) in a continuous stream. Clinical data on ISS are primarily collected via conversations between individual crewmembers and NASA Flight Surgeons during weekly Private Medical Conferences (PMC). Law, et.al, 20141 demonstrated a statistically significant association between weekly average CO2 levels on ISS and self-reported headaches over the reporting period from March 14, 2001 to May 31, 2012. The purpose of this analysis is to describe the evaluation of a possible association between visual changes and CO2 levels on ISS and to discuss challenges in developing an appropriate analysis plan. METHODS & PRELIMINARY RESULTS: A first analysis was conducted following the same study design as the published work on CO2 and self-reported headaches1; substituting self-reported changes in visual acuity in place of self-reported headaches. The analysis demonstrated no statistically significant association between visual impairment characterized by vision symptoms self-reported during PMCs and ISS average CO2 levels over ISS missions. Closer review of the PMC records showed that vision outcomes are not well-documented in terms of clinical severity, timing of onset, or timing of resolution, perhaps due to the incipient nature of vision changes. Vision has been monitored in ISS crewmembers, pre- and post-flight, using standard optometry evaluations. In-flight visual assessments were limited early in the ISS program, primarily consisting of self-perceived changes reported by crewmembers. Recently, on-orbit capabilities have greatly improved. Vision data ranges from self-reported post-flight changes in visual acuity, pre- to postflight changes identified during fundoscopic examination, and in-flight progression measured by advanced on-orbit clinical imaging capabilities at predetermined testing intervals. In contrast, CO2 data are recorded in a continuous stream over time; however, for the initial analysis this data was categorized into weekly averages.

Mendez, C. M.↗

Single-Stream Empirical Jet Noise Models Based on Scale-Model Data

Accurate single-stream jet-noise models for hot jets in flight are necessary for predicting noise of future commercial supersonic aircraft at takeoff. Previous comparisons between flight data and existing models have shown unacceptably large errors in the predictive tools. In the current effort, acoustic data were acquired in the Aero-Acoustic Propulsion Laboratory at the NASA Glenn Research Center for a single-stream hot jet with a range of operating conditions and simulated flight speeds that include those expected at takeoff of commercial supersonic aircraft. Models are presented for the resulting shape functions used to estimate the average spectra derived from the appropriate scaling of the jet-noise data.

Acoustics↗

Integration Development and Testing of Rear Transition Monitor for Beam Current Monitoring System

Addressing baseline effects in accelerator environments is crucial for accurate data acquisition and analysis, since baseline effects can obscure signal clarity and impact the reliability of beam current monitoring systems. There are many potential contributors to baseline noise, such as variations in beam dynamics, electromagnetic interference from nearby equipment, or RF interference. Previous applications of noise reduction systems don t sufficiently filter sources of asynchronous noise, so a new algorithm was implemented. A simulation dataset was created to replicate beam conditions and a Red Pitaya FPGA was used to collect data through the streaming application. A Python script was developed to implement noise reduction algorithms and efforts were made to integrate real-time data streaming with the Redis platform and Acnet Front End infrastructure.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Data Assimilation for Robust UQ Within Agent-Based Simulation on HPC Systems

Agent-based simulation provides a powerful tool for in silico system modeling. However, these simulations do not provide built-in methods for uncertainty quantification (UQ). Within these types of models a typical approach to UQ is to run multiple realizations of the model then compute aggregate statistics. This approach is limited due to the compute time required for a solution. When faced with an emerging biothreat, public health decisions need to be made quickly and solutions for integrating near real-time data with analytic tools are needed. We propose an integrated Bayesian UQ framework for agent-based models based on sequential Monte Carlo sampling. Given streaming or static data about the evolution of an emerging pathogen this Bayesian framework provides a distribution over the parameters governing the spread of a disease through a population. These estimates of the spread of a disease may be provided to public health agencies seeking to abate the spread. By coupling agent-based simulations with Bayesian modeling in a data assimilation, our proposed framework provides a powerful tool for modeling dynamical systems in silico. We propose a method which reduces model error and provides a range of realistic possible outcomes. Moreover, our method addresses two primary limitations of ABMs: the lack of UQ and an inability to assimilate data. Our proposed framework combines the flexibility of an agent-based model with UQ provided by the Bayesian paradigm in a workflow which scales well to HPC systems. We provide algorithmic details and results on a simulated outbreak with both static and streaming data.

Spannaus, Adam [ORNL] (ORCID:0000000225213657)↗

Compensating For Unbalance In Pulse-Code Phase Modulation

Algorithm proposed for use in pulse-code phase-modulation transmitter in which non-return-to-zero (NRZ) or biphase data modulated directly onto radio-frequency residual carrier signal. Devised to compensate somewhat for effect, upon distant receiver, of unbalance in stream of transmitted data. Formulated to compute combinations of modulation index, data rate, and transmitter power compensating for measured unbalance in transmitted data stream.

Nguyen, Tien M.↗

Bayesian estimation of HIV acquisition dates for prevention trials

Accurate timing estimates of when participants acquire HIV in HIV prevention trials are necessary for determining antibody levels at acquisition. The Antibody-Mediated Prevention (AMP) Studies showed that a passively administered broadly neutralizing antibody can prevent the acquisition of HIV from a neutralization-sensitive virus. We developed a pipeline for estimating the date of detectable HIV acquisition (DDA) in AMP Study participants using diagnostic and viral sequence data. Using a Bayesian strategy that combines three streams of data (REN [rev/vpu/env/Δnef] sequence, GP [gag/Δpol] sequence, and diagnostic) where their 95% credible intervals overlap based on pre-specified criteria and decision rules. We evaluated the performance of our AMP pipeline using PacBio viral sequence data from 41 participants across two prospective acute HIV acquisition cohort studies, FRESH and RV217, with twice-weekly sampling. These cohort studies enrolled young women in South Africa and men and women in Kenya and Thailand, respectively, with a high likelihood of HIV acquisition. In evaluating performance, “true DDA” was the center of bounds between last-negative and first-positive RNA diagnostic tests (median time 4 days, range 2–7 days); bias was the mean difference between estimated and true DDA. Using diagnostic data alone yielded timing estimates with a bias of 2.4 days and root mean square error (RMSE) of 7.9 days. These results were improved using sequence + diagnostic data (bias 1.5 days, RMSE 6.9 days), as well as by restricting sequence-based estimation to samples from ≤5 weeks post-DDA (bias 0.2 days, RMSE 7.8 days).

59 BASIC BIOLOGICAL SCIENCES↗

Heat transfer with very high free-stream turbulence. I - Experimental data. II - Analysis of results

Boundary layer heat transfer with very high freestream turbulence is investigated. The problem is studied experimentally by placing a constant-temperature heat transfer surface at various locations in the margin of a turbulent free jet and measuring both the surface heat transfer rate and the turbulence in the freestream. Freestream turbulent fluctuations 20 to 60 percent relative to the mean velocity augment heat transfer 1.8 to 4 times that which would be predicted locally using accepted correlations for turbulent boundary layers at the same Reynolds number. The correlations of Simonich and Bradshaw (1989), Pedisius et al. (1983), and Blair (1983) each fail to describe the present data. For flows over flat surfaces in air with very high freestream turbulence, greater than 0.2, u-prime determines h. A new heat transfer parameter, St-prime, characterizes turbulent boundary layer heat transfer with freestream turbulence on the domain 0-0.65 to within +/- 15 percent for high Reynolds number flows with uniform thermal boundary conditions.

Maciejewski, P. K.↗

Real Time implementation of Artificial Intelligence compression algorithm for High-Speed Streaming Readout signals

The new generation of high-energy physics experiments plans to acquire data in streaming mode. With this approach, it is possible to access the information of the whole detector (organized in time slices) for optimal and lossless triggering of data acquisitions. With this approach, data rates, especially in large detectors, are often very high, and the network is likely to be the bottleneck for the entire Streaming Read Out system. The aim of this work is to study the implementation of a lossy compression algorithm based on Artificial Intelligence: an Autoencoder. With Machine Learning it is possible to achieve a high compression ratio and fast inference time with only a small degradation of the signals, almost negligible for the specific application. This work explores different configurations of the Autoencoder and the implementation on different hardware. Different Autoencoder configurations are explored to find the best trade-off between compression ratio and reconstruction loss, both for signals and energy spectrum. Different hardware implementations are also explored to find the best platform to achieve real-time performance for the specific application.

Rossi, Fabio (ORCID:0009000385713885)↗

Validation of the ERBE scanner scene identification methodology: Analysis with Nimbus-7 ERB data

Maximum Likelihood Estimation (MLE) procedure for scene identification currently being utilized in the ERBE scanner data processing stream is applied to the Nimbus-7 ERB Scanner data for the month of June 1979. The Earth radiation budget parameters derived using MLE method show very good agreement with the values provided using sorting into angular bins (SAB) method. Results of the fields on different spatial scales are presented. A satellite zenith angle study indicates that the MLE procedure considerably improves the scene selection over the method of bispectral thresholds applied in the Nimbus-7 ERB data processing. Agreement with SAB results improved further when the observations were cut off at 75% in satellite zenith. Sampling constraints, however require that the cut-off angle should not be lower than 70%. Quantitative details about the reliability of the scene identification are also presented.

Vermury, S.↗

Single-Stream Empirical Jet-Noise Models Based on Scale-Model Data

Accurate single-stream jet-noise models for hot jets in flight are necessary for predicting noise of future commercial supersonic aircraft at takeoff. Previous comparisons between flight data and existing models have shown unacceptably large errors in the predictive tools. In the current effort, acoustic data were acquired in the Aero-Acoustic Propulsion Laboratory at the NASA Glenn Research Center for a single-stream hot jet with a range of operating conditions and simulated flight speeds that include those expected at takeoff of commercial supersonic aircraft. Models are presented for the resulting shape functions used to estimate the average spectra derived from the appropriate scaling of the jet-noise data.

Acoustics↗

Characterization of robotics parallel algorithms and mapping onto a reconfigurable SIMD machine

The kinematics, dynamics, Jacobian, and their corresponding inverse computations are six essential problems in the control of robot manipulators. Efficient parallel algorithms for these computations are discussed and analyzed. Their characteristics are identified and a scheme on the mapping of these algorithms to a reconfigurable parallel architecture is presented. Based on the characteristics including type of parallelism, degree of parallelism, uniformity of the operations, fundamental operations, data dependencies, and communication requirement, it is shown that most of the algorithms for robotic computations possess highly regular properties and some common structures, especially the linear recursive structure. Moreover, they are well-suited to be implemented on a single-instruction-stream multiple-data-stream (SIMD) computer with reconfigurable interconnection network. The model of a reconfigurable dual network SIMD machine with internal direct feedback is introduced. A systematic procedure internal direct feedback is introduced. A systematic procedure to map these computations to the proposed machine is presented. A new scheduling problem for SIMD machines is investigated and a heuristic algorithm, called neighborhood scheduling, that reorders the processing sequence of subtasks to reduce the communication time is described. Mapping results of a benchmark algorithm are illustrated and discussed.

Lee, C. S. G.↗

System Collects And Displays Demultiplexed Data

Electronic system collects, manipulates, and displays in real time results of manipulation of streams of data transmitted from remote scientific instrumentation. Interface circuit shifts data-and-clock signal from differential logic levels of multiplexer to single-ended logic levels of computer. System accommodates nonstandard data-transmission protocol. Software useful in applications where Macintosh computers used in real-time display and recording of data.

Reschke, Millard F.↗