SEARCH · Search NASA

Results for “data processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

All sources NASA NTRS DOE OSTI

DOE OSTI2024

Atomic-Scale Characterization of Dilute Dopants in Topological Insulators via STEM–EDS Using Registration and Cell Averaging Techniques

Magnetic dopants in three-dimensional topological insulators (TIs) offer a promising avenue for realizing the quantum anomalous Hall effect (QAHE) without the necessity for an external magnetic field. Understanding the relationship between site occupancy of magnetic dopant elements and their effect on macroscopic property is crucial for controlling the QAHE. By combining atomic-scale energy-dispersive X-ray spectroscopy (EDS) maps obtained by aberration-corrected scanning transmission electron microscopy (AC-STEM) and novel data processing methodologies, including semi-automatic lattice averaging and frame registration, we have determined the substitutional sites of Mn atoms within the 1.2% Mn-doped Sb 2 Te 3 crystal. More importantly, the methodology developed in this study extends beyond Mn-doped Sb 2 Te 3 to other quantum materials, traditional semiconductors, and even electron irradiation sensitive materials.

36 MATERIALS SCIENCE↗

DOE OSTI2024

Imaging and Segmenting Grains and Subgrains Using Backscattered Electron Techniques

We present two new methods of processing data from backscattered electron signals in a scanning electron microscope to image grains and subgrains. The first combines data from multiple backscattered electron images acquired at different specimen geometries to (1) better reveal grain boundaries in recrystallized microstructures and (2) distinguish between recrystallized and unrecrystallized regions in partially recrystallized microstructures. The second utilizes spherical harmonic transform indexing of electron backscatter diffraction patterns to produce high angular resolution orientation data that enable the characterization of subgrains. Subgrains are produced during high-temperature plastic deformation and have boundary misorientation angles ranging from a few degrees down to a few hundredths of a degree. Here, we also present an algorithm to automatically segment grains from combined backscattered electron image data or grains and subgrains from high angular resolution electron backscatter diffraction data. Together, these new techniques enable rapid measurements of individual grains and subgrains from large populations.

36 MATERIALS SCIENCE↗

DOE OSTI2025

X-Ray Imaging and Spectroscopy Mission

The X-Ray Imaging and Spectroscopy Mission (XRISM) is a joint mission between the Japan Aerospace Exploration Agency (JAXA) and the National Aeronautics and Space Administration (NASA) in collaboration with the European Space Agency (ESA). In addition to the three space agencies, universities and research institutes from Japan, North America, and Europe have joined to contribute to developing satellite and onboard instruments, data-processing software, and the scientific observation program. XRISM is the successor to the ASTRO-H (Hitomi) mission, which ended prematurely in 2016. Its primary science goal is to examine astrophysical problems with precise, high-resolution X-ray spectroscopy. XRISM promises to discover new horizons in X-ray astronomy. It carries a 6 × 6 pixelized X-ray microcalorimeter on the focal plane of an X-ray mirror assembly (Resolve) and a co-aligned X-ray CCD camera (Xtend) that covers the same energy band over a large field of view. XRISM utilizes the Hitomi heritage, but all designs were reviewed. The attitude and orbit control system was improved in hardware and software. The spacecraft was launched from the JAXA Tanegashima Space Center on 2023 September 6 (UTC). During the in-orbit commissioning phase, the onboard components were activated. Although the gate valve protecting the Resolve sensor with a thin beryllium X-ray entrance window was not yet opened, scientific observation started in 2024 February with the planned performance verification observation program. The nominal observation program commenced with the following guest observation program beginning in 2024 September.

Astronomy and AstroPhysics↗

DOE OSTI2024

Detecting damage in composites using volume decomposition analysis of tomographic data

Detection of damage in a single tow ceramic matrix composite specimen has been achieved using orthogonal decomposition of volumetric tomographic datasets collected at four tensile loads. This decomposition approach has been applied at two different length scales: (i) individual fibres and (ii) bulk volumes containing fibres and matrix material. Volumes were first decomposed to feature vectors, orders of magnitude smaller than the original volume they describe, and then comparisons between datasets at different load levels were made in feature vector space. The results show quantitative measurements of damage location, damage morphology and the relative growth of this damage with increased load when compared with a dataset with less or no damage. No prior knowledge of the dataset or training of algorithms is required for damage to be detected, it is only necessary that at least two datasets are available for comparison, e.g. from in situ or repeated scanning measurements. Results are generated on significantly shorter timescales when compared with previous automated approaches to tomography data processing. This approach has the potential to be applied to damage detection in a range of materials through comparisons of volumetric datasets from a range of measurement or computational techniques.

Middleton, Ceri A.↗

DOE OSTI2025

Pulse-by-pulse transient thermal deformation in crystal optics under high-repetition-rate FEL

Time-domain modeling of the thermal deformation of crystal optics can help define acceptable operational ranges across the pulse-energy repetition-rate phase space. In this paper, we have studied the transient thermal deformation of a water-cooled diamond crystal for a cavity-based X-ray free-electron laser (CBXFEL), either an X-ray free-electron laser oscillator (XFELO) or a regenerative amplifier X-ray free-electron laser (RAFEL), by numerical simulations including finite-element analysis and advanced data processing. Pulse-by-pulse transient thermal deformation of a 50 µm-thick diamond crystal has been performed with X-ray pulse repetition rates between 50 kHz and 1 MHz. Results for temperature and thermal deformation have been compared with the results of transient analysis using a continuous wave (CW) power loading. Temperature and thermal deformation results from pulse-by-pulse transient analysis vary with time about the results for the CW case for the same average power. The variation amplitude increases with pulse energy and decreases with repetition rate. When the repetition rate increases to infinity, both temperature and thermal deformation converge to the results for the CW case. Two critical time scales for the operation of crystal optics in a CBXFEL are (1) first-turn time, i.e. the time for the XFEL pulse to complete the first turn around the cavity so that the crystal sees the recirculated XFEL pulse, and (2) period-end time, i.e. the time that the next electron bunch arrives for the amplification, so that the crystal outcouples the amplified FEL power. For the same average power, simulation results show that the crystal thermal deformation seen by the XFEL beam decreases with repetition rate at the first-turn time of a 300 m-long cavity and increases with repetition rate at the period-end time. For the wavefront preservation requirement of the crystal optics, a pulse-energy versus repetition-rate phase space has been established. The upper bounds of the pulse energy at both first-turn and period-end times decreases with repetition rate, especially at the period-end time. The upper bound of the thermal deformation of the crystal at the period-end time for any repetition frequency can be estimated from the CW case. For a water-cooled diamond crystal of dimension 5 mm × 5 mm × 0.05 mm, the time to reach a quasi steady-state is about 50 ms for temperature and 50 µs for thermal deformation.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2024

End-to-end codesign of Hessian-aware quantized neural networks for FPGAs

Here, we develop an end-to-end workflow for the training and implementation of co-designed neural networks (NNs) for efficient field-programmable gate array (FPGA) hardware. Our approach leverages Hessian-aware quantization of NNs, the Quantized Open Neural Network Exchange intermediate representation, and the hls4ml tool flow for transpiling NNs into FPGA firmware. This makes efficient NN implementations in hardware accessible to nonexperts in a single open sourced workflow that can be deployed for real-time machine-learning applications in a wide range of scientific and industrial settings. We demonstrate the workflow in a particle physics application involving trigger decisions that must operate at the 40-MHz collision rate of the CERN Large Hadron Collider (LHC). Given the high collision rate, all data processing must be implemented on FPGA hardware within the strict area and latency requirements. Based on these constraints, we implement an optimized mixed-precision NN classifier for high-momentum particle jets in simulated LHC proton-proton collisions.

47 OTHER INSTRUMENTATION↗

DOE OSTI2025

Streaming Data in HPC Workflows Using ADIOS

The “IO Wall” problem, in which the gap between computation rate and data access rate grows continuously, poses significant problems to scientific workflows which have traditionally relied upon using the filesystem for intermediate storage between workflow stages. One way to avoid this problem in scientific workflows is to stream data directly from producers to consumers and avoiding storage entirely. However, the manner in which this is accomplished is key to both performance and usability. This paper presents the Sustainable Staging Transport, an approach which allows direct streaming between traditional file writers and readers with few application changes. SST is an ADIOS “engine”, accessible via standard ADIOS APIs, and because ADIOS allows engines to be chosen at run-time, many existing file-oriented ADIOS workflows can utilize SST for direct application-to-application communication without any source code changes. This paper describes the design of SST and presents performance results from various applications that use SST, for feeding model training with simulation data with substantially higher bandwidth than the theoretical limits of Frontier’s file system, for strong coupling of separately developed applications for multiphysics multiscale simulation, or for in situ analysis and visualization of data to complete all data processing shortly after the simulation finishes.

Podhorszki, Norbert [ORNL] (ORCID:000000019647542X↗

DOE OSTI2025

Whole Energy Homes

This repository contains analysis workflows, associated python packages, and documentation of the Whole Energy Homes study. A reproducible Snakemake workflow for data processing, feature extraction, and modeling using the weh python package. Built with Copier from the able-workflow-copier template.

Pathak, Maharshi [Northeastern Univ., Boston, MA (↗

DOE OSTI2024

Machine learning tools for epigenetics

The software provides machine learning analysis and visualization to detect patterns in epigenetic data, including conventional machine learning and statistical methods, and open-source packages like pyBigWig (https://github.com/deeptools/pyBigWig) for data processing. The software is written in python, it uses some python libraries.

Kim, Anastasiia↗

DOE OSTI2025

ENnUI : Exemplar Navigator Using Inertial Sensors

SAND2025-04794O ENnUI: Exemplar Navigator Using Inertial Sensors helps users understand and compare different navigation algorithms that rely on inertial sensors. This reference library offers a collection of reference mechanization equations and methods for estimating the position and movement of vehicles over time. Rather than aiming for the highest precision or performance, ENnUI focuses on creating a user-friendly framework that allows users to benchmark their own algorithms against a standard set of tools. It is useful for post-processing data and real-time navigation solutions. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Walker II, Michael [Sandia National Lab. (SNL-CA),↗

DOE OSTI2025

The Satellite Image Simulation Toolkit

The Satellite Image Simulation Toolkit (SatIST) is a python software package designed to generate diverse and realistic satellite imaging scenarios. It serves as a toolkit for simulating data that supports the development and testing of algorithms used in satellite detection, calibration, and characterization. SIST provides a suite of simulation tools that allow users to replicate various satellite observation conditions, including sidereal and target tracking. By enabling the creation of scenarios that mimic real-world satellite operations, SIST facilitates advancements in satellite image data processing and the study of satellite behavior under different observational parameters.

Perloff, AlexxS [Lawrence Livermore National Labor↗

DOE OSTI2025

Moltensaltpropnet

MoltenSaltPropnet is a physics-informed machine learning framework that aims to predict the thermophysical properties of molten fluoride and chloride salt mixtures, which are crucial for the design and safety of Generation IV molten salt reactors. The code processes data from the Molten-Salt Thermal Properties Database (MSTDB-TP) and the Janz compendium, converting critically evaluated correlations into fast, differentiable surrogate models for density, viscosity, thermal conductivity, and heat capacity across 448 distinct salt systems. The implementation consists of several key components: 1. Data Curation: The code parses and cleans the raw data, normalizing elemental mole fractions and extracting relevant regression coefficients for various thermophysical properties. 2. Feature Engineering: It generates fixed-length numerical descriptors that encapsulate the composition and temperature, incorporating polynomial interaction terms and dimensionality-reduction techniques to optimize model performance. 3. Coefficient Learning: Four different machine learning architectures are employed: a deep residual network (ResNet), a Kolmogorov–Arnold network (KAN), a sparsity-inducing neural network (SNN), and classical regression models. Each model learns to predict coefficients that define the temperature-dependent correlations for the thermophysical properties. 4. Property Reconstruction: The predicted coefficients are used to compute temperature-dependent property values, ensuring positivity and monotonic trends through a composite loss function that enforces physical constraints. 5. User Interface: An open-source web application enables users to filter the database, train task-specific models, and visualize the results, allowing for rapid exploration of candidate salt mixtures. MoltenSaltPropnet bridges the gap between limited experimental data and high-fidelity reactor simulations, providing a powerful tool for researchers in the field of molten salt reactors and advanced nuclear energy systems.

Retamales, Mauricio Eduardo Tano [Idaho National L↗

DOE OSTI2025

High-Resolution Sampling of a River Plume Front with Uncrewed Underwater and Aerial Vehicles

Sampling fast-propagating oceanic features is inherently challenging and demands versatile instrumentation and innovative strategies. This paper introduces a novel sampling strategy designed to capture such phenomena, exemplified by a river plume front. Our method revolves around modifying the preprogrammed pathway of an uncrewed underwater vehicle (UUV) to dynamically track and three-dimensionally sample the evolution of the front. To enable the UUV to follow the feature, we adapt the use of a drifting gateway buoy to be positioned and trapped at the front’s convergence zone, allowing underway navigation relative to the buoy. In our demonstration, we showcase the effectiveness of this strategy by successfully conducting over 30 crossings of a river plume front within a 6-h window. The UUV sensors allowed a comprehensive assessment of key front characteristics, including density, velocity, and turbulence. Supplemental drone footage contributed to the overall picture and facilitated the transformation of the dataset into a front-following reference frame. This article provides an in-depth description of the deployment strategy and required postcollection data processing, including frontal crossing detection, the assessment of the frontal orientation from drone footage, and defining the plume bottom boundaries using backscatter intensity contours.

autonomous observations↗

DOE OSTI2024

An FPGA-based hardware accelerator supporting sensitive sequence homology filtering with profile hidden Markov models

Abstract Background Sequence alignment lies at the heart of genome sequence annotation. While the BLAST suite of alignment tools has long held an important role in alignment-based sequence database search, greater sensitivity is achieved through the use of profile hidden Markov models (pHMMs). Here, we describe an FPGA hardware accelerator, called HAVAC, that targets a key bottleneck step (SSV) in the analysis pipeline of the popular pHMM alignment tool, HMMER. Results The HAVAC kernel calculates the SSV matrix at 1739 GCUPS on a $$\sim$$ ∼ $3000 Xilinx Alveo U50 FPGA accelerator card, $$\sim$$ ∼ 227× faster than the optimized SSV implementation in nhmmer . Accounting for PCI-e data transfer data processing, HAVAC is 65× faster than nhmmer’s SSV with one thread and 35× faster than nhmmer with four threads, and uses $$\sim$$ ∼ 31% the energy of a traditional high end Intel CPU. Conclusions HAVAC demonstrates the potential offered by FPGA hardware accelerators to produce dramatic speed gains in sequence annotation and related bioinformatics applications. Because these computations are performed on a co-processor, the host CPU remains free to simultaneously compute other aspects of the analysis pipeline.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2025

Efficient near-field ptychography reconstruction using the Hessian operator

X-ray ptychography is a powerful and robust coherent imaging method providing access to the complex object and probe (illumination). Ptychography reconstruction is typically performed using first-order methods due to their computational efficiency. Higher-order methods, while potentially more accurate, are often prohibitively expensive in terms of computation. In this study, we present a mathematical framework for reconstruction using second-order information derived from an efficient computation of the bilinear Hessian and Hessian operator. The formulation is provided for Gaussian-based models, enabling the simultaneous reconstruction of the object, probe, and object positions. Synthetic data tests, along with experimental near-field ptychography data processing, demonstrate a ten-fold reduction in computation time compared to first-order methods. The derived formulas for computing the Hessians, along with the strategies for incorporating them into optimization schemes, are well-structured and easily adaptable to various ptychography problem formulations.

Carlsson, Marcus [Lund Univ. (Sweden)] (ORCID:0000↗

DOE OSTI2025

COMPASS-FME Terrestrial Ecosystem Manipulation to Probe the Effects of Storm Treatments (TEMPEST) Soil Greenhouse Gas Fluxes 04/2020-06/2024

Both raw and processed data measured using a LI-COR 7810 Greenhouse Gas Analyzer in the TEMPEST experiment, part of COMPASS-FME (https://compass.pnnl.gov/FME/COMPASSFME), at Smithsonian Environmental Research Center. This ecosystem-scale experiment probes the effects of saltwater versus freshwater flooding in a coastal deciduous forest.The data consist of both concentrations and fluxes of carbon dioxide and methane measured using static chambers on the soil surface, approximately every two weeks from early 2020 to mid 2024. Some of the measurement points are controls, and some subject to root-exclusion techniques; all measurements are embedded in the TEMPEST control, freshwater, and saltwater plots (see Hopple et al. 2023). These data were generated to understand changing soil greenhouse gas (CO2 and CH4) production and consumption. File types are comma-separated value (.csv) for data, and markdown (.md) for supplementary information.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

Carbon flux measurements from chambers collected between April to October 2023 at Old Woman Creek, Huron, Ohio

This dataset contains carbon dioxide and methane gas flux measurements collected via chamber sampling at Old Woman Creek National Estuarine Research Reserve in Huron, OH. These data were generated to understand temporal and vegetation patterns associated with wetland carbon cycling. Specifically, this dataset intends to answer how carbon dioxide and methane fluxes change monthly and hourly across sites with vegetation and without vegetation. Data includes chamber measurements that were measured in both sites with vegetation and without vegetation and that were collected hourly (7 AM to 7 PM or 5 AM to 10 PM and monthly (April to October). The file soilrespiration_data23.csv contains these data, and the metadata file (soilrespiration_chammetadata23.csv) and location metadata file (soilrespiration_locationmetadata23.csv) have information on locations where the chambers were placed and sampled in the wetland. Data processing was done on raw methane fluxes (Flux_CH4) to remove the influence of ebullition (Flux_CH4_ebullition) to get a diffusive flux (Flux_CH4_diffusive).

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2026

Warming amplifies the variability of methane emissions from a coastal wetland, 2025, Maryland.

These data accompany the published paper Lewis et al., 202X and are from a brackish coastal wetland in situ soil warming experiment (GENX) equipped with automated flux chambers. Methane (CH4) and carbon dioxide (CO2) fluxes were measured in 12 automated chambers using custom-built automated chambers connected to an LI-7810 CH4/CO2 analyzer. The chambers are 1.5 m tall and contain the dominant vegetation species of the site (Schoenoplectus americanus, Spartina patens, and Distichlis spicata). The chambers are also distributed across a soil warming gradient, ranging from ambient to 6°C above ambient, that was started in February 2022. This dataset contains the following files: (1) CH4 and CO2 fluxes from each chamber for March to November 2025, statistics for each flux, and environmental data (water depth, salinity, air temperature) at the time of the flux measurement; (2) 15-minute soil temperature data for each chamber; (3) Aboveground vegetation biomass (total and by species) and stem counts and dimensions for S. americanus; (4) Elevation for each chamber. All data processing code is available on Github.

Coastal wetland↗