Search NASA⌕ Search

SEARCH · Search NASA

Results for “methods: data analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

A Short-Term Solar Forecasting Platform Using a Physics-Based Smart Persistence Model and Data Imputation Method

Electrical energy plays vital role in our socio-economic activity and therefore ensuring the reliability of the electric grid, from the generation, transmission and distribution level is critical. In order to maintain the power system parameter viz., frequency, voltage, etc., optimally, balancing of generation and consumption is very much essential. However, solar energy is infirm power by nature this is due to cloud cover / other local phenomena. Hence, Photovoltaic (PV) power generation brings a significant challenge to the grid operator due to the variability of the solar energy. The complexity of this challenge in terms of planning and dispatch ability of PV resources, aggravates with the high penetration of solar energy into the electric grid. In this setting, reliable solar radiation forecasting models based on accurate and quality input data become essential. In order to develop a suitable model for predicting solar radiation, quality historical / real time measurement is also needed. Under this study NIWE and NREL jointly developed / tested short-term solar forecasting frameworks using a smart persistence and physics-based smart persistence models for intra-hour forecasting of solar radiation (PSPI) and benchmarked 9 different data imputation techniques in 15 Solar Radiation Resource Assessment (SRRA) stations, located at different parts of India. During any measurement campaign, due to various technical reasons, we may miss few observations. However, the missing observation often reduce the performance of any forecasting model. Therefore, suitable data imputation method would assist us to obtain continuous observation of solar radiation. A station-by-station and method-by-method analysis was carried out to understand the performance of each model. Based on our analysis, among all the data imputation methods, the Kalman data imputation method is better for Indian Weather condition. In addition, Kalman StructTS, Linear, Stine and Arima methods yield slightly inferior accuracy compared to Kalman, but outperform the other methods. The extended solar radiation data are used by solar forecasting models to provide the prediction of solar radiation at 15 SRRA stations. As far as short term forecasting model is concerned, the PSPI model outperforms the Smart Persistence model. However, the forecast error is increases with the forecasting horizon.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2022

MODELING AND PARAMETRIC STUDY OF END-GAS AUTOIGNITION TO ALLOW THE REALIZATION OF ULTRA-LOW EMISSIONS, HIGH-EFFICIENCY HEAVY-DUTY SPARK-IGNITED NATURAL GAS ENGINES

Engine knock and misfire are barriers to pathways leading to high-efficiency Spark-Ignited (SI) Natural Gas (NG) engines. The general tendency to knock is highly dependent on engine operating conditions and the fuel reactivity. The problem is further complicated by the low emission limits and the wide range of chemical reactivity in pipeline-quality natural gas. Depending on the region and the source of the natural gas, its reactivity, described by its Methane Number (MN), which is analogous to the Octane Number for liquid SI fuels, can span from 65 to 95. In order to realize diesel-like efficiencies, SI NG engines must be designed to operate at high Brake Mean Effective Pressures (BMEP), near or beyond knock limits, over a wide range of fuel reactivity. This requires a deep understanding of the combustion-engine interactions pertaining to flame propagation and End-Gas Autoignition (EGAI), i.e., the autoignition of the unburned gas (end gas) ahead of the flame front. However, EGAI, if controlled, provides an opportunity to increase SI NG engine efficiency by increasing the combustion rate and the total fraction of burned fuel, mitigating the effects of the slow flame speeds characteristic of natural gas fuels, which generally reduce BMEP and increase unburned hydrocarbon emissions. For this reason, to realize diesel-like efficiencies and ultra-low emissions on SI NG engines, this work proposes the study of the main parameters influencing the modeling and prediction of NG EGAI to allow for its control. In this work, a novel EGAI detection and onset determination method was developed to reliably quantify EGAI for data analysis and engine control. The new method allowed the prediction of EGAI on SI NG engines without the need to use engine- and operating-condition-dependent thresholds and reduced the error in quantifying the fraction of the total energy released by the EGAI event by up to 40%pts. One- and three-dimensional engine models were then developed to study the engine/fuel interactions that lead to NG EGAI and its performance benefits. These models, although having decent agreement with experimental data, showed the need to account for NOx chemistry when predicting NG EGAI due to a consistently later prediction of the EGAI onset (~1.65 crank-angle degrees) and thus, a new reduced chemical mechanism for real NG fuels was developed containing NOx chemistry. The new reduced mechanism improved the EGAI onset prediction agreement to within ±0.5 crank-angle degrees and decreased simulation time during combustion by nearly 50% when using the further reduced AREIS50NOx chemical mechanism. These models were then used to study the role of NG composition on EGAI, evaluate the engine/fuel interactions leading to NG EGAI, and perform engine optimization while leveraging EGAI to increase thermal efficiency. Piston design optimization combined with a Controlled EGAI (C-EGAI) combustion mode allowed a Heavy-Duty (HD) SI NG engine to operate at diesel-like efficiencies, i.e., Brake Thermal Efficiency (BTE) ≥44%. Experimental and modeling data analysis revealed that earlier and faster heat release increases combustion efficiency by an average of 1%pts, increases work transferred to the piston resulting in a decrease in exhaust losses by 50% depending on the engine operating condition while slightly increasing heat losses. Finally, the simulation results revealed an opportunity to further enhance the BTE (up to 50%) by enabling C-EGAI combustion at leaner conditions, λ=1.4-1.6.

Bestel, Diego Bernardi↗
DOE OSTI2022

Thermal Ratcheting Analysis of TEDS Packed-bed Thermocline Energy Storage Tank - Modeling Methodology and Data Validation

This report investigates numerical modeling methods for thermal ratcheting analysis of packed-bed thermal energy storage (TES) tank and discusses the validation results via comparison with experimental data. The experimental data obtained from various design characteristics of packed-bed thermocline tanks, including the Thermal Energy Distribution System (TEDS) TES tank at Idaho National Laboratory (INL), were used to validate thermal and mechanical models developed in this study to evaluate the thermal ratcheting potential. The thermal model was shown to predict the transient thermal propagation through the packed-bed thermocline tanks generally well. However, a larger discrepancy was observed during the comparison with the data from TEDS, presumably due to the uncertainty of boundary conditions given from the experiment. Based on the comparative study between the thermal model predictions and experimental data of various packed-bed thermocline tanks, potential improvements were suggested for the future TEDS experiments for more precise validation study. For mechanical (thermally induced stress) analysis, two different modeling approaches were tested to evaluate hoop stress applied to the packed-bed TES tank wall, which is a major cause of thermal ratcheting process: (i) infinite rigidity model and (ii) Drucker-Prager (DP) model. The ‘model (i)’ is a conservative method with infinite rigidity assumption of granular filler inside a TES tank, whereas the ‘model (ii)’ is a method that takes into account more realistic processes such as thermal expansion of filler and tank wall as well as inter-particle interactions during the cyclic operation of a packed-bed TES tank. The validity of each modeling method was examined by comparing the numerical simulation with the experimental data obtained from the packed-bed TES tank for Solar One pilot plant. Then, the effects of various model parameters were discussed to evaluate the thermal ratcheting potential of the TEDS TES tank. The preliminary thermal ratcheting analysis implies that the TEDS TES tank will hold its structural integrity during the normal operation cycles.

25 ENERGY STORAGE↗
DOE OSTI2020

Uncertainty about the Uncertainty [Slides]

A golden standard in science is to repeat an experiment a statistically significant number of times, recording data using the same set of detectors and the same data analysis methodology. In such case experimental error includes both the range of true values generated by repetitions of the experiment, and measurement uncertainty caused by the detector. They are independent. It is a huge and too frequently used simplification, to assume that one can measure multiple repetitions of an identical experiment, resulting in identical true experimental value. Repetitions, as similar is it is experimentally achievable result in a range of the true values rather than in a single value. When modern, very sensitive and well calibrated measurement systems are used, this range is not negligible, and sometimes dominates, in comparison to the measurement uncertainty. Range of true values depends on the physics of the experiment, while measurement uncertainty depends on the measurement method (properties of the detector not of the experiment). When data from one–of–a kind experiment are analyzed, only the measurement uncertainty is reported. It gives no information about the range, in which the true values of experiment would spread if the experiment was repeated. A frequently used approximation, that if a physical quantity is measured as a function of time, only measurement of this quantity, produces uncertainty is also in some real experiments fare to strong. Example: In reaction history time measurement uncertainty propagated to alpha dominated under certain conditions over the flux measurement uncertainty propagated to alpha. Reliability of a data point is in general independent from its measurement uncertainty. However, in practice reliable measurement methods frequently have high measurement uncertainty, while low reliability methods are applied to limit measurement uncertainty. Comparison of reliable data with high measurement uncertainty to not so reliable data measured with low uncertainty is discussed – in different scenarios different data analysis methods are applicable.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

Probabilistic neural networks for improved analyses with phenomenological R -matrix

Here we present a method for measurement analyses based on probabilistic deep neural networks that provide several advantages over conventional analyses with phenomenological models. These include predicting physical quantities directly from data, the rapid generation of statistically robust uncertainties, and the ability to bypass some parameters that may induce ambiguities and complications in data analysis. As deep learning methods make predictions through “black boxes,” the uncertainty quantification is typically challenging. We use a probabilistic framework that provides thorough uncertainty quantification and is straightforward to follow in practice. With the network architecture based on the Transformer, we demonstrate the current method for predicting nuclear resonance parameters from scattering data using the phenomenological R-matrix model.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Radio Afterglow Detection and AI-driven Response (RADAR): A Federated Framework for Gravitational-wave Event Follow-up

The landmark detection of both gravitational waves (GWs) and electromagnetic (EM) radiation from the binary neutron star merger GW170817 has spurred efforts to streamline the follow-up of GW alerts in current and future observing runs of ground-based GW detectors. Within this context, the radio band of the EM spectrum presents unique challenges. Sensitive radio facilities capable of detecting the faint radio afterglow seen in GW170817, and with sufficient angular resolution, have small fields of view compared to typical GW localization areas. Additionally, theoretical models predict that the radio emission from binary neutron star mergers can evolve over weeks to years, necessitating long-term monitoring to probe the physics of the various postmerger ejecta components. These constraints, combined with limited radio observing resources, make the development of more coordinated follow-up strategies essential—especially as the next generation of GW detectors promises a dramatic increase in detection rates. Here, we present RADAR, a framework designed to address these challenges by promoting community-driven information sharing, federated data analysis, and system resilience, while integrating AI methods for both GW signal identification and radio data aggregation. We show that it is possible to preserve data rights while sharing models that can help design and/or update follow-up strategies. We demonstrate our approach through a case study of GW170817, and discuss future directions for refinement and broader application.

Gravitational waves↗
DOE OSTI2021

SANS quantification of bound water in water-soluble polymers across multiple concentration regimes

Contrast-variation small-angle neutron scattering (CV-SANS) is a widely used technique for quantifying hydration water in soft matter systems, but it is predominantly applied in the dilute regime or for systems with a well-defined structure factor. Here, CV-SANS was used to quantify the number of hydration water molecules associating with three water-soluble polymers with different critical solution temperatures and types of water–solute interactions in dilute, semidilute, and concentrated solution through the exploration of novel methods of data fitting and analysis. Multiple SANS fitting workflows with varying levels of model assumptions were evaluated and compared to give insight into SANS model selection. These fitting pathways ranged from general, model-free algorithms to more standard form and structure factor fitting. In addition, Monte Carlo bootstrapping was evaluated as a method to estimate parameter uncertainty through simulation of technical replicates. The most robust fitting workflow for dilute solutions was found to be form factor fitting without CV-SANS ( i.e. polymer in 100% D 2 O). For semidilute and concentrated solutions, while the model-free approach can be mathematically defined for CV-SANS data, the addition of a structure factor imposes physical constraints on the optimization problem, suggesting that the optimal fitting pathway should include appropriate form and structure factor models. The measured hydration numbers were consistent with the number of tightly bound water molecules associated with each monomer unit, and the concentration dependence of the hydration number was largely governed by the chemistry-specific interactions between water and polymer. Polymers with weaker water–polymer interactions ( i.e. those with fewer hydration water molecules) were found to have more bound water at higher concentrations than those with stronger water–polymer interactions due to the increase in the number of forced water–polymer contacts in the concentrated system. This SANS-based method to count hydration water molecules can be applied to polymers in any concentration regime, which will lead to improved understanding of water–polymer interactions and their impact on materials design.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Production and discovery of neutron-rich isotopes by fragmentation of 198 Pt

Production cross sections were measured for fragments produced by an 85 MeV/u 198 Pt beam incident on a beryllium target. Event-by-event particle identification of A, Z, and q for the reaction products was performed by employing energy loss, time-of-flight, magnetic rigidity, and total kinetic energy measurements. Over 70 nuclei in the Hf-Pt region were identified, including three isotopes first observed in this work: 191,192 Hf and 189 Lu. Due to the existence of multiple charge states between H-like and C-like ions, a new analysis method was introduced, incorporating Monte Carlo calculations of charge state fractions for a given charge state of the projectile residue just after the reaction. For the first time, charge-state probability distribution functions after the reaction have been deduced from experimental data. Furthermore, this study provides insight into how to produce key nuclides near N = 126 and the ability of a fragmentation residue to retain electrons from the primary beam.

190 ≤ A ≤ 219↗
DOE OSTI2025

Systematic characterization of unknown compounds via dimensionality reduction of time series

Analysis of ambient aerosols provides valuable insight into particle sources and formation chemistry. However, due to the complexity of atmospheric data and the dynamic nature of aerosol composition, a substantial fraction of data often become discarded by conventional analysis methods. Furthermore, a large fraction of chemical species within those data are unidentifiable due to a lack of matching spectral information, resulting in suboptimal characterization of chemical composition. Previous work has demonstrated techniques for cataloging analytes in a chromatographic dataset by deconvolution of mass spectra, but integration of these analytes throughout a large dataset remains time consuming. Here, we present a method to automatically identify an ion for quantitation for single-ion chromatogram based peak fitting and integration, enabling comprehensive integration of analytes with minimal user interaction. The resulting time series are clustered with a machine-learning based dimensionality reduction technique to systematically investigate the underlying characteristics of the categorized analytes and gain new insights into the chemical composition and physicochemical properties of the unidentifiable analytes. We apply these methods to existing atmospheric datasets collected in Manacapuru, Brazil during the GoAmazon2014/5 campaign to identify new analytes and interpret their variability and transformations in the atmosphere. The analysis results generate 408 time series from cataloged analytes of interest, and the clustering of those time series with spherical k-means results in 8 distinct clusters. We find the analytes form clusters based on their distinct physicochemical properties, demonstrating the method’s ability to systematically identify and selectively filter contaminants and instrumental analytes and characterize the unidentifiable analytes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Online data analysis and reduction: An important co-design motif for extreme-scale computers

A growing disparity between supercomputer computation speeds and I/O rates means that it is rapidly becoming infeasible to analyze supercomputer application output only after that output has been written to a file system. Instead, data-generating applications must run concurrently with data reduction and/or analysis operations, with which they exchange information via high-speed methods such as interprocess communications. The resulting parallel computing motif, online data analysis and reduction (ODAR), has important implications for both application and HPC systems design. Here we introduce the ODAR motif and its co-design concerns, describe a co-design process for identifying and addressing those concerns, present tools that assist in the co-design process, and present case studies to illustrate the use of the process and tools in practical settings.

Data Analysis↗
DOE OSTI2022

Disaster risk and artificial intelligence: A framework to characterize conceptual synergies and future opportunities

Artificial intelligence (AI) methods have revolutionized and redefined the landscape of data analysis in business, healthcare, and technology. These methods have innovated the applied mathematics, computer science, and engineering fields and are showing considerable potential for risk science, especially in the disaster risk domain. The disaster risk field has yet to define itself as a necessary application domain for AI implementation by defining how to responsibly balance AI and disaster risk. (1) How is AI being used for disaster risk applications; and how are these applications addressing the principles and assumptions of risk science, (2) What are the benefits of AI being used for risk applications; and what are the benefits of applying risk principles and assumptions for AI-based applications, (3) What are the synergies between AI and risk science applications, and (4) What are the characteristics of effective use of fundamental risk principles and assumptions for AI-based applications? This study develops and disseminates an online survey questionnaire that leverages expertise from risk and AI professionals to identify the most important characteristics related to AI and risk, then presents a framework for gauging how AI and disaster risk can be balanced. This study is the first to develop a classification system for applying risk principles for AI-based applications. This classification contributes to understanding of AI and risk by exploring how AI can be used to manage risk, how AI methods introduce new or additional risk, and whether fundamental risk principles and assumptions are sufficient for AI-based applications.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Archetype-based Redshift Estimation for the Dark Energy Spectroscopic Instrument Survey

We present a computationally efficient galaxy archetype-based redshift estimation and spectral classification method for the Dark Energy Survey Instrument (DESI) survey. The DESI survey currently relies on a redshift fitter and spectral classifier using a linear combination of principal component analysis–derived templates, which is very efficient in processing large volumes of DESI spectra within a short time frame. However, this method occasionally yields unphysical model fits for galaxies and fails to adequately absorb calibration errors that may still be occasionally visible in the reduced spectra. Our proposed approach improves upon this existing method by refitting the spectra with carefully generated physical galaxy archetypes combined with additional terms designed to absorb data reduction defects and provide more physical models to the DESI spectra. We test our method on an extensive data set derived from the survey validation (SV) and Year 1 (Y1) data of DESI. Our findings indicate that the new method delivers marginally better redshift success for SV tiles while reducing catastrophic redshift failure by 10%–30%. At the same time, results from millions of targets from the main survey show that our model has relatively higher redshift success and purity rates (0.5%–0.8% higher) for galaxy targets while having similar success for QSOs. These improvements also demonstrate that the main DESI redshift pipeline is generally robust. Additionally, it reduces the false-positive redshift estimation by 5%–40% for sky fibers. We also discuss the generic nature of our method and how it can be extended to other large spectroscopic surveys, along with possible future improvements.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2025

Cluster spin glass correlations and dynamics in Zn 0.5⁢ Mn 0.5⁢ Te

Here, we present a combined magnetometry, muon spin-relaxation (𝜇⁢SR), and neutron-scattering study of the insulating spin glass Zn 0.5 ⁢Mn 0.5 ⁢Te, for which magnetic Mn 2+ and nonmagnetic Zn 2+ ions are randomly distributed on a face-centered cubic lattice. The magnetometry and 𝜇⁢SR results confirm a spin freezing transition around 𝑇 𝑓 ≈ 23 K, with the spin-fluctuation rate decreasing gradually and somewhat inhomogeneously through the sample volume as the temperature decreases toward 𝑇 𝑓 . Characteristic spin-correlation times well above 𝑇 𝑓 are on the order of 10 −10 s, much slower than typically observed in canonical spin glasses but in line with expectations for a cluster spin glass. Using magnetic pair distribution function (mPDF) analysis and reverse Monte Carlo (RMC) modeling of the magnetic diffuse neutron-scattering data, we show that the spin-glass ground state consists of clusters of spins exhibiting short-range-ordered type-III antiferromagnetic correlations with a locally ordered moment of 3.1⁢(1)⁢𝜇 B between nearest-neighbor spins. The type-III correlations decay exponentially as a function of spin separation distance with a correlation length of approximately 5 Å. The diffuse magnetic scattering and corresponding mPDF show no significant changes across 𝑇 𝑓 , indicating that the dynamically fluctuating short-range spin correlations in the paramagnetic state retain the same basic type-III configuration that characterizes the spin-glass state; the only change apparent from the neutron-scattering data is a gradual reduction of the correlation length and locally ordered moment with increasing temperature. Taken together, these results paint a unique and detailed picture of the local magnetic structure and dynamics in Zn 0.5 ⁢Mn 0.5⁢ Te and provide strong evidence that this material is best described as a cluster spin glass. In addition, this work showcases a statistical method for extracting diffuse scattering signals from neutron powder diffraction data, which we developed to facilitate the mPDF and RMC analysis of the neutron data. This method has the potential to be broadly useful for neutron powder diffraction experiments on a variety of materials with short-range atomic or magnetic order.

magnetism↗
DOE OSTI2023

Towards scanning nanostructure X-ray microscopy

This article demonstrates spatial mapping of the local and nanoscale structure of thin film objects using spatially resolved pair distribution function (PDF) analysis of synchrotron X-ray diffraction data. This is exemplified in a lab-on-chip combinatorial array of sample spots containing catalytically interesting nanoparticles deposited from liquid precursors using an ink-jet liquid-handling system. A software implementation is presented of the whole protocol, including an approach for automated data acquisition and analysis using the atomic PDF method. The protocol software can handle semi-automated data reduction, normalization and modeling, with user-defined recipes generating a comprehensive collection of metadata and analysis results. By slicing the collection using included functions, it is possible to build images of different contrast features chosen by the user, giving insights into different aspects of the local structure.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2022

AlgoSCR: an algorithm for solar contamination removal from radio interferometric data

Hydrogen intensity mapping is a new field in astronomy that promises to make three-dimensional maps of the matter distribution of the Universe using the redshifted 21cm line of neutral hydrogen gas (HI). Several ongoing and upcoming radio interferometers, such as Tianlai, CHIME, HERA, HIRAX, etc., are using this technique. These instruments are designed to map large swaths of the sky by drift scanning over periods of many months. One of the challenges of the observations is that the daytime data are contaminated by strong radio signals from the Sun. In the case of Tianlai, this results in almost half of the measured data being unusable. We try to address this issue by developing an algorithm for solar contamination removal (AlgoSCR) from the radio data. The algorithm is based on an eigenvalue analysis of the visibility matrix and hence is applicable only to interferometers. We apply AlgoSCR to simulated visibilities, as well as real daytime data from the Tianlai dish array. The algorithm can reduce strong solar contamination by about 95 per cent without seriously affecting other weaker sky signals and thus makes the data usable for certain applications.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

Square Kilometre Array Science Data Challenge 1: analysis and results

ABSTRACT As the largest radio telescope in the world, the Square Kilometre Array (SKA) will lead the next generation of radio astronomy. The feats of engineering required to construct the telescope array will be matched only by the techniques developed to exploit the rich scientific value of the data. To drive forward the development of efficient and accurate analysis methods, we are designing a series of data challenges that will provide the scientific community with high-quality data sets for testing and evaluating new techniques. In this paper, we present a description and results from the first such Science Data Challenge 1 (SDC1). Based on SKA MID continuum simulated observations and covering three frequencies (560, 1400, and 9200 MHz) at three depths (8, 100, and 1000 h), SDC1 asked participants to apply source detection, characterization, and classification methods to simulated data. The challenge opened in 2018 November, with nine teams submitting results by the deadline of 2019 April. In this work, we analyse the results for eight of those teams, showcasing the variety of approaches that can be successfully used to find, characterize, and classify sources in a deep, crowded field. The results also demonstrate the importance of building domain knowledge and expertise on this kind of analysis to obtain the best performance. As high-resolution observations begin revealing the true complexity of the sky, one of the outstanding challenges emerging from this analysis is the ability to deal with highly resolved and complex sources as effectively as the unresolved source population.

Bonaldi, A.↗
DOE OSTI2021

Development of a deep learning based automated data analysis for step-filter x-ray spectrometers in support of high-repetition rate short-pulse laser-driven acceleration experiments

We present a deep learning based framework for real-time analysis of a differential filter based x-ray spectrometer that is common on short-pulse laser experiments. The analysis framework was trained with a large repository of synthetic data to retrieve key experimental metrics, such as slope temperature. With traditional analysis methods, these quantities would have to be extracted from data using a time-intensive and manual analysis. Furthermore, this framework was developed for a specific diagnostic, but may be applicable to a wide variety of diagnostics common to laser experiments and thus will be especially crucial to the development of high-repetition rate (HRR) diagnostics for HRR laser systems that are coming online.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

Stability Analysis of Inline ZFP Compression for Floating-Point Data in Iterative Methods

Currently, the dominating constraint in many high performance computing applications is data capacity and bandwidth, in both internode communications and even moreso in intranode data motion. A new approach to address this limitation is to make use of data compression in the form of a compressed data array. Storing data in a compressed data array and converting to standard IEEE-754 types as needed during a computation can reduce the pressure on bandwidth and storage. However, repeated conversions (lossy compression and decompression) introduce additional approximation errors, which need to be shown to not significantly affect the simulation results. Here, we extend recent work that analyzed the error of a single use of compression and decompression of the ZFP compressed data array representation to the case of time-stepping and iterative schemes, where an advancement operator is repeatedly applied in addition to the conversions. We show that the accumulated error for iterative methods involving fixed-point and time evolving iterations is bounded under standard constraints. An upper bound is established on the number of additional iterations required for the convergence of stationary fixed-point iterations. An additional analysis of traditional forward and backward error of stationary iterative methods using ZFP compressed arrays is also presented. The results of several 1D, 2D, and 3D test problems are provided to demonstrate the correctness of the theoretical bounds.

97 MATHEMATICS AND COMPUTING↗