Search NASA⌕ Search

SEARCH · Search NASA

Results for “process data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

TRACER Radar b1 Data Processing: Corrections, Calibrations, and Processing Report

The U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility deployed the first ARM Mobile Facility (AMF1) to Houston, Texas for the Tracking Aerosol Convection Interactions Experiment (TRACER) field campaign. The TRACER campaign was conducted from October 1, 2021 to September 30, 2022, with an intensive operational period (IOP) from June 1 to September 30, 2022. To investigate the life cycles of convective cells in the polluted and humid urban environment of Houston, ARM deployed cloud and precipitation radars, including the C-band Scanning ARM Precipitation Radar (CSAPR2), the X/Ka-band Scanning ARM Cloud Radar (SACR), and the Ka-band ARM Zenith cloud Radar (KAZR), as shown in Figure 1. This report presents an analysis of radar data quality, hardware calibrations, and radar data corrections.

54 ENVIRONMENTAL SCIENCES↗

Fixed-Site KAZR b1 Data Processing: Corrections, Calibrations, and Processing Report

The U.S. Department of Energy’s (DOE) Atmospheric Radiation Measurement (ARM) User Facility operates three fixed-site observatories: Eastern North Atlantic (ENA), North Slope of Alaska (NSA), and Southern Great Plains (SGP). Each fixed site has a wide variety of atmospheric instrumentation that has been collecting data for at least 10 years (NSA and SGP over 25 years). Each site is unique because it represents a different climate state. The environment at ENA is characterized by marine stratocumulus clouds and one of the key scientific areas of focus is the interaction of these clouds with aerosols. At NSA the focus is on arctic climate and cloud and radiative processes in a high-latitude environment. SGP represents a mid-latitude, mid-continent climate that experiences environmental cycles on diurnal and seasonal time scales. The ARM observatories are all meant to improve understanding of atmospheric processes that can then be better incorporated into weather and climate models. Another common thread between the fixed sites is the focus on cloud processes. Each site is equipped with at least one radar that provides continuous remote-sensing observations of clouds and precipitation. This report details the analysis of a1-level radar data at the fixed sites and the process for generating b1-level data. While b1-level data have been produced for ARM campaigns at the mobile facilities, this is the first analysis led by ARM radar mentors to correct data at the fixed sites. In particular, we focus on calibrations and corrections of the Ka-band ARM Zenith Radars (KAZRs) at ENA, NSA, and SGP. Ongoing and future work will involve corrections applied to other fixed-site radars.

54 ENVIRONMENTAL SCIENCES↗

ExaFEL: extreme-scale real-time data processing for X-ray free electron laser science

ExaFEL is an HPC-capable X-ray Free Electron Laser (XFEL) data analysis software suite for both Serial Femtosecond Crystallography (SFX) and Single Particle Imaging (SPI) developed in collaboration with the Linac Coherent Lightsource (LCLS), Lawrence Berkeley National Laboratory (LBNL) and Los Alamos National Laboratory. ExaFEL supports real-time data analysis via a cross-facility workflow spanning LCLS and HPC centers such as NERSC and OLCF. Our work therefore constitutes initial path-finding for the US Department of Energy's (DOE) Integrated Research Infrastructure (IRI) program. We present the ExaFEL team's 7 years of experience in developing real-time XFEL data analysis software for the DOE's exascale supercomputers. We present our experiences and lessons learned with the Perlmutter and Frontier supercomputers. Furthermore we outline essential data center services (and the implications for institutional policy) required for real-time data analysis. Finally we summarize our software and performance engineering approaches and our experiences with NERSC's Perlmutter and OLCF's Frontier systems. This work is intended to be a practical blueprint for similar efforts in integrating exascale compute resources into other cross-facility workflows.

59 BASIC BIOLOGICAL SCIENCES↗

North Slope of Alaska XSAPR b1 Data Processing Report: May 2025-April 2026

The U.S. Department of Energy’s Atmospheric Radiation Measurement (ARM) User Facility operates an X-band Scanning ARM Precipitation Radar (XSAPR) at the North Slope of Alaska (NSA) atmospheric observatory in Utqiaġvik. This radar provides year-round dual-polarization measurements of snow and ice in an arctic environment. Over the past few years, there has been greater focus on the NSA XSAPR, and recent efforts by ARM staff have resulted in quality-controlled, b-level data (Rocque et al. 2026b). This report outlines the processing of the second set of b-level data released for this radar from May 2025 through April 2026 following similar methods from Rocque et al. (2026b).

54 ENVIRONMENTAL SCIENCES↗

Utah FORGE: Seismic DAS and Geophone Borehole Data Processing and 3D Imaging of Vp/Vs Ratio in the 2024 Stimulated Reservoir

This dataset includes a final report and a 3D velocity model derived from seismic DAS and geophone borehole data collected during the April 2024 stimulation of the reservoir at Utah FORGE. The report details the processing of over 50,000 P- and S-wave travel times used in a tomographic inversion to estimate the Vp/Vs ratio, revealing anomalies adjacent to wells 16A and 16B that may be associated with injected fracturing fluids. Additionally, Wadati analysis of more than 27,000 pairs of differential P- and S-wave travel times supports this interpretation with a high Vp/Vs estimate of 1.86, averaged over the dimensions of the earthquake cluster. The accompanying data file provides a 3D model of P- and S-wave velocities and Vp/Vs ratios, structured with spatial coordinates and velocity values.

15 GEOTHERMAL ENERGY↗

WormBase in 2022—data, processes, and tools for analyzing Caenorhabditis elegans

WormBase (www.wormbase.org) is the central repository for the genetics and genomics of the nematode Caenorhabditis elegans. We provide the research community with data and tools to facilitate the use of C. elegans and related nematodes as model organisms for studying human health, development, and many aspects of fundamental biology. Throughout our 22-year history, we have continued to evolve to reflect progress and innovation in the science and technologies involved in the study of C. elegans. We strive to incorporate new data types and richer data sets, and to provide integrated displays and services that avail the knowledge generated by the published nematode genetics literature. Here, we provide a broad overview of the current state of WormBase in terms of data type, curation workflows, analysis, and tools, including exciting new advances for analysis of single-cell data, text mining and visualization, and the new community collaboration forum. Concurrently, we continue the integration and harmonization of infrastructure, processes, and tools with the Alliance of Genome Resources, of which WormBase is a founding member.

59 BASIC BIOLOGICAL SCIENCES↗

Fixed-Site KAZR b1 Data Processing Report: 2025

The U.S. Department of Energy’s Atmospheric Radiation Measurement (ARM) User Facility has been operating Ka-band ARM Zenith Radars (KAZRs) at each of its permanent observatories for at least the past 10 years. Data collected by the KAZRs is used to explore various cloud processes in different climatological regimes including marine stratocumulus clouds at the Eastern North Atlantic (ENA) site, arctic clouds at the North Slope of Alaska (NSA) site, and mid-latitude continental clouds at the Southern Great Plains (SGP) site.

54 ENVIRONMENTAL SCIENCES↗

EPCAPE Radar b1 Data Processing: Corrections, Calibrations, and Processing Report

The U.S. Department of Energy (DOE)’s Atmospheric Radiation Measurement (ARM) user facility recently deployed its First ARM Mobile Facility (AMF1) to La Jolla, California as part of the Eastern Pacific Cloud Aerosol Precipitation Experiment (EPCAPE) campaign. Some of the goals behind EPCAPE were to characterize the diurnal and seasonal cycles of stratocumulus clouds and to investigate the cloud-aerosol-radiation interactions and feedbacks in the area. The deployment of the AMF1 for a full year from 15 February 2023 to 14 February 2024 aided in addressing these scientific questions. While AMF1 collected data year-round, enhanced measurements were taken during two intensive operational periods (IOPs). The first IOP occurred from April to June and focused on the chemistry of low clouds (EPCAPE_Chem), while the second IOP occurred from July to September and was focused on the radiation of high clouds (EPCAPE_Radiation). Several cloud radars were deployed with AMF1 to collect valuable data on cloud properties that will help users address key science objectives. As in past ARM campaigns, a1-level radar data is extensively analyzed and calibration techniques are performed to generate b1-level data (Matthews et al. 2023, Feng et al. 2024). Radar data at the b1-level are of the highest quality and thus can be used to examine scientific questions. The status of the a1-level data and the a1-to-b1 process for the EPCAPE radars is subsequently detailed in this document.

54 ENVIRONMENTAL SCIENCES↗

AWAKEN Site A1 - NREL Scanning Lidar (Halo XR+ #235) / Processed Data

These data include raw scanning Doppler lidar measurements from the deployment of the NREL HALO XR+ (s/n 235) at the A1 site. The processed measurements include uncalibrated beam azimuth angles, radial velocity, backscatter, signal to noise ratio per each line of sight, and range-gate.

17 WIND ENERGY↗

Arrangements for communicating and processing data in a computing system

Systems and methods for reducing data movement in a computer system. The systems and methods use information or knowledge about the structure of an algorithm, operations to be executed at a receiving processing unit, variables or subsets or groups of variables in a distributed algorithm, or other forms of contextual information, for reducing the number of bits transmitted from at least one transmitting processing unit to at least one receiving processing unit or storage device.

Gonzalez, Juan Guillermo↗

GUC CSU X-Band Precipitation Radar Plan Position Indicator data processed with Corrected Moments in Antenna Coordinates

For the Surface Atmosphere Integrated Field Laboratory (SAIL) campaign, Corrected Moments in Antenna Coordinates (CMAC) is a set of algorithms and code that does corrections to CSU X-Precipitation Radar PPI data. Additionally, CMAC adds calculations of derived snowfall rates to the original data in order to provide precipitation estimates for the campaign.

54 ENVIRONMENTAL SCIENCES↗

Initial operation and data processing on a system for real-time evaluation of Thomson scattering signals on the Large Helical Device

A scalable system for real-time analysis of electron temperature and density based on signals from the Thomson scattering diagnostic, initially developed for and installed on the NSTX-U experiment, was recently adapted for the Large Helical Device and operated for the first time during plasma discharges. During its initial operation run, it routinely recorded and processed signals for four spatial points at the laser repetition rate of 30 Hz, well within the system’s rated capability for 60 Hz. We present examples of data collected from this initial run and describe subsequent adaptations to the analysis code to improve the fidelity of the temperature calculations.

47 OTHER INSTRUMENTATION↗

Initial operation and data processing on a system for real-time evaluation of Thomson scattering signals on the Large Helical Device

A scalable system for real-time analysis of electron temperature and density based on signals from the Thomson scattering diagnostic, initially developed for and installed on the NSTX-U experiment, was recently adapted for the Large Helical Device (LHD) and operated for the first time during plasma discharges. During its initial operation run, it routinely recorded and processed signals for four spatial points at the laser repetition rate of 30 Hz, well within the system's rated capability for 60 Hz. We present examples of data collected from this initial run and describe subsequent adaptations to the analysis code to improve the fidelity of the temperature calculations.

Thomson scattering, real-time, LHD, plasma diagnos↗

The real-time data processing and acquisition system for Project 8 Phase II

In Phase II of the Project 8 neutrino mass experiment, electrons from the decays of tritium or 83m Kr are detected via their ≈26 GHz cyclotron radiation while contained within a circular waveguide. The signal from a given electron is characterized as a brief chirp, lasting ≲10 ms and changing in frequency by ≲1 MHz/ms. To detect these signals, the Project 8 collaboration developed a Data Acquisition (DAQ) system tailored to the signal properties. The DAQ is responsible for simultaneously selecting up to three 100 MHz-wide frequency windows to study, detect, and trigger on likely signals from different electron kinetic energies, and for writing the relevant data to disk. Finally, we describe the Phase II DAQ system in detail and address how the system was used for data-taking operations.

Data acquisition↗

Rock Valley Accelerated Weight Drop Seismic Data Processing and Picking of P-wave and S-wave Arrival Times

Rock Valley, in the southern end of the Nevada National Security Site, hosts a fault system that was responsible for a shallow (< 3 km below surface ) magnitude 3.7 earthquake in May 1993. In order to better understand this system, seismic properties of the shallow subsurface need to be better constrained. In April and May of 2021, accelerated weight drop (AWD) active-source seismic data were recorded in order to measure P- and S-wave travel-times for the area. This report describes the processing and phase picking of the recorded seismic waveforms. In total, we picked 7,982 P-wave arrivals at offsets up to ~2500 m, and 4,369 S-wave arrivals at offsets up to ~2200 m. These travel-time picks can be inverted for shallow P-wave and S-wave velocity structure in future studies.

58 GEOSCIENCES↗

EdgeAI: Machine learning via direct attached accelerator for streaming data processing at high shot rate x-ray free-electron lasers

We present a case for low batch-size inference with the potential for adaptive training of a lean encoder model. We do so in the context of a paradigmatic example of machine learning as applied in data acquisition at high data velocity scientific user facilities such as the Linac Coherent Light Source-II x-ray Free-Electron Laser. We discuss how a low-latency inference model operating at the data acquisition edge can capitalize on the naturally stochastic nature of such sources. We simulate the method of attosecond angular streaking to produce representative results whereby simulated input data reproduce high-resolution ground truth probability distributions. By minimizing the mean-squared error between the decoded output of the latent representation and the ground truth distributions, we ensure that the encoding layers and resulting latent representation maintains full fidelity for any downstream task, be it classification or regression. We present throughput results for data-parallel inference of various batch sizes, some with throughput exceeding 100 k images per second. We also show in situ training below 10 s per epoch for the full encoder–decoder model as would be relevant for streaming and adaptive real-time data production at our nation’s scientific light sources.

97 MATHEMATICS AND COMPUTING↗

JANA2 Framework for Event Based and Triggerless Data Processing

Development of the second generation JANA2 multi-threaded event processing framework is ongoing through an LDRD initiative grant at Jefferson Lab. The framework is designed to take full advantage of all cores on modern many-core compute nodes. JANA2 efficiently handles both traditional hardware triggered event data and streaming data in online triggerless environments. Development is being done in conjunction with the Electron Ion Collider development. Anticipated to be the next large scale Nuclear Physics facility constructed. The core framework is written in modern C++ but includes an integrated Python interface. The status of development and summary of the more interesting features are presented.

Lawrence, David↗