Search NASA⌕ Search

SEARCH · Search NASA

Results for “data transfer”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Toward a persistent event-streaming system for high-performance computing applications

High-performance computing (HPC) applications have traditionally relied on parallel file systems and file transfer services to manage data movement and storage. Alternative approaches have been proposed that use direct communications between application components, trading persistence and fault tolerance for speed. Event-driven architectures, as popularized in enterprise contexts, present a compelling middle ground, avoiding the performance cost and API constraints of parallel file systems while retaining persistence and offering impedance matching between application components. However, adapting streaming frameworks to HPC workloads requires addressing challenges unique to HPC systems. This paper investigates the potential for a streaming framework designed for HPC infrastructures and use cases. We introduce Mofka, a persistent event-streaming framework designed specifically for HPC environments. Mofka combines the capabilities of a traditional streaming service with optimizations tailored to the HPC context, such as support for massively multicore nodes, efficient scaling for large producer-consumer workflows, RDMA-enabled high-performance network communications, specialized network fabrics with multiple links per node, and efficient handling of large scientific data payloads. Built using the Mochi suite of HPC data service components, Mofka provides a lightweight, modular, and high-performance solution for persistent streaming in HPC systems. We present the architecture of Mofka and evaluate its performance against Kafka and Redpanda using benchmarks on diverse platforms, including Argonne's Polaris and Oak Ridge's Frontier supercomputers, showing up to 8× improvement in throughput in some scenarios. We then demonstrate its utility in several real-world applications: a tomographic reconstruction pipeline, a workflow for the discovery of metal-organic frameworks for carbon capture, and the instrumentation of Dask workflows for provenance tracking and performance analysis.

HPC↗
DOE OSTI2026

Methods for safely sharing dual-use genetic data

Background: Some genetic data has dual-use potential. Sharing pathogen data has shown tremendous value. For example therapeutic development and lineage tracking during the COVID pandemic. This data sharing is complicated by the fact that these data have the potential to be used for harm. The genome sequence of a pathogen can be used to enable malicious genetic engineering approaches or to recreate the pathogen from synthetic DNA. Standard data security methods can be applied to genetic data, but when data is shared between institutions, ensuring appropriate security can be difficult. Sensitive data that is shared internationally among a wide array of institutions can be especially difficult to control. Methods for securely storing and sharing genetic data with potential for dual-use are needed to mitigate this potential harm.Results: Here we propose new methods that allow genetic data to be shared in a data format that prevents a nefarious actor from accessing sensitive aspects of the data. Our methods obfuscate raw sequence data by pooling reads from different samples. This approach can ensure that data is secure while stored and during electronic transfer. We demonstrate that by pooling raw sequence data from multiple samples of the same organism, the ability to fully reconstruct any individual sample is prevented. In the pooled data, most genomic information remains, but reads or mutations cannot be directly attributed to any individual sample. To further restrict access to information, regions of a genome can be removed from the reads.Conclusion: Our methods obscure genomic information within raw sequence reads. This method can allow genetic data to be stored and shared while preventing a nefarious actor from being able to perfectly reconstruct an organism. Broad-scale sequence information remains, while fine scale details about specific samples are difficult or impossible to reconstruct. Our software is available at https://github.com/Geneinfosec-Inc/ReadMixer.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Advanced Perovskite Solar Cells and Modules

The “Advanced perovskite Cells and Modules” research project was the final agreement focused on enhancing perovskite solar cell (PSC) technologies funded by the US Department of Energy's Solar Energy Technologies Office. The project was designed to address three crucial areas in PSC development: stability, manufacturability, and efficiency. The project was then structured around three main tasks, each targeting one of these strategic goals. The team of experienced researchers in these materials worked collaboratively to address the targets outlined in the technical work plan. building on existing PSC research while also exploring promising new concepts arising in the field. An overview of each primary task is summarized below: Task 1 Stability: This first task, aims to identify material characteristics and metrics that can help predict the primary degradation mechanisms impacting PSC stability. This involved developing specific device tests based on hypotheses regarding mechanisms impacting stability, including fast failure procedures to speed up PSC development and improvement. Various strategies to enhance stability, like incorporating additives, post-treatments, novel contact materials etc. were developed using this fast feedback approach. The relationships between indoor and outdoor stresses were also validated. Task 2 Manufacturability: This second task, focused on creating a scalable production process for PSCs. Initially the objective is to establish a best-known method for a 182 cm2 minimodule. However, given resource limitations, these metrics were modified to focus on the other goal of outlined in the TWP. Specifically, this task worked to demonstrate the transferability of this best-known method to another research institution. Work scope in this area was expanded to material purity and understanding of reagent/process relationships. Examination of other difficulties in PSC production and potential solutions for large-scale production were also evaluated. Given challenges observed in process transfer, work to develop data infrastructure and recording tools for processing of material and devices was then also prioritized in this task. Task 3 Efficiency: This task was focused on improvements to PCE, while still considering Task 1 and Task 2 goal. The efforts targeted a PCE greater than 22% with a T95 exceeding 1000 hours at 25°C in a nitrogen environment for lab-scale devices (approximately 0.1 cm2 devices) across a range of solar-relevant perovskite compositions, including wide-gap (around 1.7 eV) and low-gap (around 1.3 eV) materials, using standard metal contacts. This work then provides a foundation for MHP-based tandem efforts undertaken in other projects and the All-MHP tandem efforts outlined in this projects TWP. Work in this project emphasized disseminating its findings through peer-reviewed publications (PRP), conference presentations, and industrial collaborations. Significant products were produced in all these areas, over 53 peer reviewed publications, 32 conference presentations and industrial investment based on NLR assistance on precompetitive challenges. The team also developed significant intellectual property and awards for their technical excellence, innovations and leadership. The team also leveraged traditional and social media platforms to engage with stakeholders and the public.

14 SOLAR ENERGY↗
DOE OSTI2026

Predicting roughness effects in additively manufactured coolant channels with helical enhancements

Additive manufacturing (AM) is a promising technique for fabrication of complex geometries such as those expected to be utilized in the blanket, first wall, and divertor. In the case of cooling, metallic AM may be exploited to embed geometric enhancements (ribs, rifling, etc.) to improve cooling performance. However, due to the roughness of these unfinished internal AM surfaces, prediction of thermal hydraulic performance in such channels is difficult. In this work, we consider a methodology for predicting pressure drop and heat transfer in AM channels containing helical enhancements (e.g. helical ribs, twisted tapes) that allows the incorporation of roughness data through conventional pipe flow correlations. This methodology is tested using experimental friction factor and heat transfer coefficient data from high-pressure helium coolant flow measurements in AM stainless steel tubes fabricated by laser powder bed fusion. Both a featureless AM tube and one containing helical ribs were considered alongside a conventionally manufactured smooth tube. The AM surface roughness is obtained by profilometry and used to predict an equivalent sand-grain roughness, with this equivalent roughness confirmed through AM featureless tube measurements. Under the proposed methodology, this roughness information is incorporated into predictions of friction factor and Nusselt number for the rifled tube. Furthermore, these predictions agree well with experimental data across a large range of Reynolds numbers, encouraging the use of this methodology for thermal hydraulic analysis of similar systems and design of future coolant channel geometries.

Additive manufacturing↗
DOE OSTI2026

Scientific Data Compression for Large Scale Computational Fluid Dynamics (CFD) Simulations

This Cooperative Research and Development Agreement (CRADA) between Oak Ridge National Laboratory (ORNL) and General Electric (GE) investigated methods for reducing the size of large computational fluid dynamics (CFD) simulation datasets using scientific data compression techniques. The work focused on adapting the MultiGrid Adaptive Reduction of Data (MGARD) compression framework and integrating it with high-performance I/O and visualization tools used in CFD workflows. MGARD uses hierarchical multilevel decomposition to enable error-controlled compression of floating-point scientific data while preserving quantities of interest. During the project, MGARD compression was integrated with the ADIOS I/O framework and visualization tools such as ParaView to enable efficient storage, transfer, and analysis of simulation data. The collaboration also explored approaches for improving compression performance for CFD data defined on unstructured meshes. Results demonstrate that scientific data compression can significantly reduce storage requirements and improve data management for large-scale CFD simulations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Development and Experimental Validation of a Heat Transfer Model for Spilled Molten Salt Pools

A spill of radionuclide-bearing molten salt is one of the major postulated events that needs to be analyzed for liquid fluorine salt-cooled high-temperature reactor (FHR) or molten salt reactor licensing purposes. In this postulated event, radioactive source term materials (RSTMs) in the molten salt are discharged from the reactor vessel to the reactor building. The release of RSTMs from the spilled salt pool to the gas space in the reactor building is expected to be controlled by the cooling behavior of the spilled salt, including the growth and shrinkage of the solid crust on the surface of the spilled salt pool. This paper presents a simulation model for spilled salt pool heat transfer and validation efforts. The validation data come from two molten salt spill tests that were performed recently: the PELE2 test by the Rapid Experimental Laboratory of Kairos Power LLC (KP) and the Argonne salt cooling test conducted by Argonne National Laboratory. The former was a large-scale test involving kilograms of molten spilled FLiNaK salt, and the latter was a relatively smaller-scale test targeting various processes associated with a salt spill event. Both tests generated valuable data sets that can be used to assess salt cooling and validate evaluation models. This paper provides a new one-dimensional model that can simulate the cooling process of a spilled salt pool as well as the thermal responses of heat structures, such as the stainless steel liner and the concrete below the salt. The model has been implemented as part of KP-SAM code, which is a branch of the systems code SAM specific to KP FHR. In conclusion, the simulation results of the model are compared with the data of the PELE2 and Argonne tests, and reasonable agreements are observed between the model and test data.

heat transfer model↗
DOE OSTI2024

Accelerating data acquisition with FPGA-based edge machine learning: a case study with LCLS-II

New scientific experiments and instruments generate vast amounts of data that need to be transferred for storage or further processing, often overwhelming traditional systems. Edge machine learning (EdgeML) addresses this challenge by integrating machine learning (ML) algorithms with edge computing, enabling real-time data processing directly at the point of data generation. EdgeML is particularly beneficial for environments where immediate decisions are required, or where bandwidth and storage are limited. In this paper, we demonstrate a high-speed configurable ML model in a fully customizable EdgeML system using a field programmable gate array (FPGA). Our demonstration focuses on an angular array of electron spectrometers, referred to as the ‘CookieBox,’ developed for the Linac Coherent Light Source II project. The EdgeML system captures 51.2 Gbps from a 6.4 GS s −1 analog to digital converter and is designed to integrate data pre-processing and ML inside an FPGA. Our implementation achieves an inference latency of 0.2 µs for the ML model, and a total latency of 0.4 µs for the complete EdgeML system, which includes pre-processing, data transmission, digitization, and ML inference. The modular design of the system allows it to be adapted for other instrumentation applications requiring low-latency data processing.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

A Comparison of Three Neodymium Atomic Data Sets for Kilonova Modeling

We examine the impact of input neodymium (Nd) atomic data on the light curves and spectra of kilonovae (KNe), probing the sensitivity of kilonova observables to the atomic physics of this important lanthanide element. We use the SuperNu Monte Carlo radiative transfer code, simulating a simple semianalytic 1D kilonova (KN) with a pure Nd atmosphere, fixing the radiative transfer method while using input atomic data generated by three different codes: the LANL suite of atomic physics codes, HULLAC, and Autostructure. We see that the choice of atomic data significantly shapes the resulting light curves and spectra. Peak bolometric luminosities differ by a ratio of nearly 1.5 between HULLAC/Autostructure and LANL data sets. Moreover, we observe significant near- to mid-IR differences in the structure of the spectra. We specifically attribute these differences to the choice of atomic data for neutral Nd I. Many of the results here have been adapted from a presentation at “Radiative Transfer and Atomic Physics of Kilonovae” in Stockholm, 2023. We additionally present a LANL data set with energies calibrated to available values in the NIST Atomic Spectra Database, and demonstrate that this calibration also significantly affects IR spectral structure at late time. The substantial differences in KN observables that arise from tuning the atomic data of just one lanthanide element highlight the special attention that must be paid to atomic physics uncertainties when modeling KNe, from AT2017gfo to beyond.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Bridging the gap between experiments and simulations using machine learning

The physics of inertial confinement fusion is rich and complex. Simulation codes that are used to design experiments are computationally expensive and lack the predictive capability required for extensive parameter exploration in search of a high-performing design for laser direct drive. In this work we use deep learning to build a fast emulator of experiments. To facilitate the development of the deep-learning model, an autoencoder is used to reduce the dimensionality of the input space. Two deep learning models are developed. One model is trained on a vast array of simulation data and is subsequently calibrated to expensive and limited experimental data using a technique known as “transfer learning.” The other model is trained on a statistical model and is subsequently calibrated using experimental data. A comparative study of the two predictive models is carried out. The models potentially reproduce key experimental observables with high accuracy and unprecedented inference times relative to those achieved with simulation codes. These models facilitate rapid exploration of a high dimensional input parameter space.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Anomaly Detection in Seismic Data with Deep Learning: Application for Instrument Failure Detection and Forecasting

Seismic data quality assessment (QA) is the first and one of the most important steps before conducting any further data analysis. Traditional methods involve checking various metrics, such as spike detection and power spectral density, by setting strict thresholds or comparing data against synthetic benchmarks. However, these approaches often rely on pre-existing knowledge and assumptions about data anomalies, leading to potential misclassification of unusual cases. Here, in this study, we propose a deep autoencoder model, an unsupervised learning approach that evaluates data quality without making assumptions about normal and anomalous data, which can be used to identify deviations in recorded data that may indicate nascent instrument failure. We test the model with the U.S. International Monitoring System (IMS) seismic stations and demonstrate the capability of detecting anomalies on a monthly scale. This could prompt station operators to examine potential problems early, allowing sufficient time for instrument maintenance to prevent data outages. In addition, we use a new manually selected testing dataset to compare our model performance against two supervised machine learning (ML) approaches and a standard QA package, as baseline models. When applied to the dataset containing known data anomalies, performance of the supervised and unsupervised ML approaches is similar, with an accuracy of 88.1% for our model compared to ∼90% for the supervised ML approach and 78.2% for the standard QA package. Our model outperforms the baseline models when applied to new stations, where new types of data anomalies can be station-specific and not included in the training dataset. Finally, we show model transferability by training the model with data from the Global Seismograph Network only and applying it to the IMS network data. The results suggest that our model is generalizable and can be applied to new stations with good accuracy.

Lin, Jiun-Ting [Lawrence Livermore National Labora↗
DOE OSTI2025

Sparse-Data Deep Learning Strategies for Radiographic Non-Destructive Testing

Radiography is an imaging technique used in a variety of applications, such as medical diagnosis, airport security, and nondestructive testing. We present a deep learning system for extracting information from radiographic images. We perform various prediction tasks using our system, including material classification and regression on the dimensions of a given object that is being radiographed. Our system is designed to address the sparse-data issue for radiographic nondestructive testing applications. It uses a radiographic simulation tool for synthetic data augmentation, and it uses transfer learning with a pre-trained convolutional neural network model. Using this system, our preliminary results indicate that the object geometry regression task saw an improvement of 70% in the R-squared value when using a multi-regime model. In addition, we increase the performance of the object material classification tasks by utilizing data from different imaging systems. In particular, using neutron imaging improved the material classification accuracy by 20% when compared to x-ray imaging.

convolutional neural networks↗
DOE OSTI2025

CO2 hydrate crystal thickening, morphology, and Raman spectroscopy in a microfluidic device

Gas hydrates are a solid, crystalline form of water that often form at low temperatures and high pressures. Carbon dioxide (CO2) hydrates may form during carbon dioxide capture and storage (CCS) processes. These solid compounds may form in CO2 pipelines, potentially leading to a full blockage and process shutdown for plug removal. On the other hand, formation of CO2 hydrates may be desired for CO2 capture and separation. In either case, understanding the growth behavior and nature of the hydrates is vital to managing these CCS processes. Using a high-pressure, transparent microfluidic reactor, the crystalline film thickening of CO2 hydrates was observed and measured through visual microscopy and Raman spectroscopy. The impact of subcooling, pressure, and CO2 flow rate was investigated, and only CO2 flow rate was found to have a significant impact on the overall thickness of the film. Visual observations and Raman spectroscopy measurements confirmed that two distinct hydrate layers formed during thickening, one which was more porous than the other. The capillary-like channels in the porous layer indicated a mechanism for mass transfer of water through the hydrate layer. A model was developed based on this observation, and it was fit to the thickening data in order to obtain mass transfer coefficients. Results of this study can be applied to CO2 hydrate formation in pipelines and near porous media used for CO2 capture.

Wadsworth, Lindsey [Colorado School of Mines, Gold↗
DOE OSTI2025

Direct Evidence for Buffer-Enhanced Proton-Coupled Electron Transfer Generation of a High-Valent Metal-Oxo Complex

Here, the oxidation of metal-aquo and -hydroxo complexes to generate the high-valent metal-oxo species used in oxidative catalysis is often kinetically slow due to sluggish proton transfer between ligated −H 2 O/–OH in the proton-coupled electron transfer (PCET) chemistry. In this research, a ruthenium water oxidation catalyst anchored to a conductive tin-doped indium oxide (ITO) thin film, abbreviated ITO|Ru II –OH 2 , was characterized by spectroscopic and electrochemical methods in acetate or phosphate buffers. The deprotonated intermediate, Ru II –OH, was observed spectroscopically in the PCET half-reaction ITO(e – )|Ru III –OH + H + → ITO|Ru II –OH 2 indicating an underlying stepwise ET-PT mechanism. In contrast, at elevated buffer concentrations, this intermediate was absent, and a 2–4 order of magnitude increase in the proton transfer rate constant was observed. Kinetic data for this PCET reaction measured as a function of the driving force provided the reorganization energy λ = 1.05 eV and was assigned to a concerted electron–proton transfer (EPT) mechanism. In addition, the standard heterogeneous rate constants for two PCET equilibria, Ru III –OH + H + + e – ⇌ Ru II –OH 2 and Ru IV = O + H + + e – ⇌ Ru III –OH were enhanced by these same buffers. Collectively, the data show that the added buffers can enhance the kinetics and thermodynamics for PCET reactions relevant to oxidative catalysis.

Catalysts↗
DOE OSTI2025

Multi-objective surrogate-assisted calibration of CPFEM models using macroscopic response and in situ EBSD measurements of grain reorientation trajectories

Crystal plasticity finite element method (CPFEM) models are widely used to simulate the deformation behaviour of polycrystalline materials, but their calibration is often limited by their high computational cost and the non-convexity of the optimisation landscape. Here, this study develops a multi-objective surrogate-assisted calibration workflow that couples a multi-objective genetic algorithm (MOGA) with an adaptively trained deep neural network (DNN) surrogate model to efficiently identify CPFEM parameters from experimental data. The workflow is demonstrated on three crystal plasticity (CP) formulations of increasing complexity — Voce hardening (VH), two-coefficient latent hardening (LH2), and six-coefficient latent hardening (LH6) — using in situ electron backscatter diffraction (EBSD) measurements of Alloy 617 under uniaxial tensile loading. The CPFEM models are calibrated against the experimentally observed stress–strain response and reorientation trajectories of eight grains, then validated against eight additional trajectories and overall texture evolution. Across the CP formulations, the macroscopic response was reproduced reliably, while differences emerged in the robustness and accuracy of the grain-scale predictions. Including grain reorientation trajectories in the multi-objective calibration improved texture evolution predictions and filtered out physically inconsistent parameter sets that can arise from calibrating against only the stress–strain data. The workflow also demonstrates good transferability of calibrated parameters from a low- to a high-fidelity microstructural model. These results provide practical guidance for integrating in situ microstructural data into CPFEM through efficient, repeatable, and physically meaningful multi-objective calibration.

Crystal plasticity finite element method↗
DOE OSTI2026

Binary pseudo-random array standard for extreme ultraviolet lithography tool characterization

Extreme ultraviolet (EUV) imaging tools play a crucial role in EUV lithography. Achieving high accuracy in EUV metrology is essential for advanced semiconductor manufacturing. A thorough characterization of the instrumentation in use is required. Binary pseudo-random arrays (BPRAs) are an established standard for calibrating and characterizing optical instruments in the frequency domain. Here, we expand the BPRA standard to applications in EUV imaging. To extend the technology to the EUV spectral range, a high-resolution BPRA target with the smallest feature size of 40 nm is developed. The EUV BPRA target establishes an in situ and portable calibration and alignment standard for EUV imaging. The target is patterned by means of electron-beam lithography, using a nickel absorber with a thickness of 39 nm. The substrate is a 4″ silicon wafer with a molybdenum/silicon multilayer coating. To demonstrate the efficacy of the target and develop the instrument calibration protocol, the target is imaged on the Sharp Hyper-NA Actinic Reticle Review Project EUV mask microscope. Power spectral density (PSD) data are presented. The characteristics of the imaging system are imprinted on the PSD. The modulation transfer function is extracted from the PSD data. A partially coherent imaging model is used as a reference to the experimental results.

BPRA↗
DOE OSTI2025

Applying Transfer Learning for Street-Scale Nuisance Flood Forecasting in Coastal-Urban Cities

An important challenge with Machine Learning (ML) is its transferability; that is, whether a ML model trained on one set of data can be applied to a second set of data without requiring a full re-training of the model. Transfer Learning (TL) addresses this challenge by transferring knowledge learned in the source domain (the data it was trained on) to the target domain (a second set of data that is statistically different but related, which the model was not trained on). This study investigates the use of TL for street-scale nuisance flood forecasting by exploring whether a ML model trained on data collected for one set of streets can effectively forecast flooding for another set of streets in the same city using TL. The envisioned use case is a city deploying a new flood depth monitoring sensor on a street and using TL to apply a ML model, trained on sensor data from an existing flood depth sensor network, to this new street. Eventually, the new flood depth sensor will have a sufficient dataset for training its own ML model, but TL can be used to fill the gap in time while this new dataset is being generated. This method is explored using a Long Short-Term Memory (LSTM) model trained on data for the flood-prone streets of Norfolk City, Virginia. The data used for training includes environmental time series (rainfall, tide), topographic features (Digital Elevation Model (DEM), Topographic Wetness Index (TWI), Depth To Water (DTW)), and street-scale flood depth time series obtained from a high-fidelity physics-based model, acting as a synthetic street-scale stream depth sensor dataset since actual stream depth sensor data is generally unavailable for most cities. A set of 180 flood-prone streets was used to train a base model, while another set of 180 flood-prone streets was used to re-train that model using different TL strategies. The results show that full-weight re-training proved most effective and minimal re-training of only the output layer was insufficient. The advantage of TL was most pronounced when target data was limited, meaning data collected at the new water depth sensor location included generally less than 18 flood events. As target data increased beyond 18 flood events, the benefit of TL diminished relative to training a ML model directly on the local flood events. These findings can assist cities as they implement street-scale flood sensing systems to create accurate forecasts for new sensing locations that do not yet have sufficient data records to train a local ML model.

Roy, Binata [Univ. of Virginia, Charlottesville, V↗
DOE OSTI2024

Data Generation for Machine Learning Interatomic Potentials and Beyond

The field of data-driven chemistry is undergoing an evolution, driven by innovations in machine learning models for predicting molecular properties and behavior. Recent strides in ML-based interatomic potentials have paved the way for accurate modeling of diverse chemical and structural properties at the atomic level. The key determinant defining MLIP reliability remains the quality of the training data. A paramount challenge lies in constructing training sets that capture specific domains in the vast chemical and structural space. This Review navigates the intricate landscape of essential components and integrity of training data that ensure the extensibility and transferability of the resulting models. We delve into the details of active learning, discussing its various facets and implementations. We outline different types of uncertainty quantification applied to atomistic data acquisition and the correlations between estimated uncertainty and true error. The role of atomistic data samplers in generating diverse and informative structures is highlighted. Furthermore, we discuss data acquisition via modified and surrogate potential energy surfaces as an innovative approach to diversify training data. The Review also provides a list of publicly available data sets that cover essential domains of chemical space.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Optimal binning of correlated measurements

Experimental measurements are commonly represented on a discrete grid, requiring a balance between granularity and statistical noise. Two strategies have traditionally been used to improve such representations: selecting an appropriate bin width to control discretization error and applying kernel-based smoothing to suppress fluctuations. Despite their shared goal, these approaches have largely developed independently, without a unified statistical description of how discretization and correlation jointly determine measurement precision. Here, we extend the discussion of optimal interval averaging to a correlation-aware setting by Gaussian process regression, which explicitly accounts for correlations among neighboring bins. Starting from first principles, we derive the mean-squared error of discretized measurements and obtain closed-form asymptotic expressions for the optimal bin width and correlation length. When recast in reduced variables, the theory reveals distinct universal scaling laws governing the error in the correlation-free and correlation-controlled regimes. Characterized by intrinsically smooth intensity profiles and counting-based statistics, neutron scattering measurements are well suited for demonstrating the enhanced error contraction enabled by inter-bin correlations. We show that such improvement is achievable over the experimentally accessible Q-range and across multiple instruments and material systems. These results show that explicitly accounting for correlations systematically reshapes the limits of precision in discretized, noise-limited measurements. More broadly, the framework provides a transferable statistical foundation for optimizing data representation, inference, and experimental design across the physical and data sciences.

Tung, Chi-Huan [ORNL] (ORCID:0000000221972074)↗