Search NASA⌕ Search

SEARCH · Search NASA

Results for “data reliability”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,549 records · Page 86

Data-Driven Linear Parameter-Varying Modeling and Control of Flexible Loads for Grid Services

Flexible loads have great potential to improve the electric grid's flexibility and stability. To effectively control large ensembles of heterogeneous loads, reliable models thereof are required. This paper presents a data-driven modeling and control approach to manage flexible loads for providing grid services. We leverage a linear parameter-varying autoregressive moving average (LPV-ARMA) model to describe the aggregate load response, where the parameters in the model are used to capture external environmental impacts (e.g., weather). A gain-scheduling feedback controller is then developed to adapt to environmental variations. This data-driven approach can be easily applied to different types of loads in various environmental conditions. In addition to the ensemble controller, distributed load controllers are designed to deliver grid services, while maintaining the quality of service of inherent load tasks. We demonstrate the work on the IEEE 37-node distribution system for real-time power regulation services through control of thermostatically controlled loads.

61 RADIATION PROTECTION AND DOSIMETRY↗

Fresh look at the nuclear transparency using the generalized parton distributions

Color transparency (CT) is a fundamental phenomenon in QCD in which hadrons produced in high-energy exclusive processes traverse nuclear matter with minimal interactions. Nuclear transparency, which quantifies this attenuation suppression, is a quantity with high sensitivity to CT effects and provides critical insights into QCD dynamics in nuclear environments. In this study, we revisit nuclear transparency using the framework of generalized parton distributions (GPDs). By constructing nuclear GPDs (nGPDs) through the incorporation of nuclear parton distribution functions, we calculate the nuclear transparency 𝑇⁡(𝑄 2 ) for the carbon nucleus as a function of momentum transfer 𝑄 2 considering various definitions and compare the results obtained with available experimental data. Our finding highlights the importance of choosing a physically motivated definition of nuclear transparency. Moreover, we emphasize that a more reliable determination of nGPDs requires a dedicated global analysis incorporating nuclear data. Such an approach is essential for improving the theoretical understanding of CT and for achieving consistency with experimental observations in the high-𝑄 2 regime.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Asymmetric neighborhood functions accelerate ordering process of self-organizing maps

A self-organizing map (SOM) algorithm can generate a topographic map from a high-dimensional stimulus space to a low-dimensional array of units. Because a topographic map preserves neighborhood relationships between the stimuli, the SOM can be applied to certain types of information processing such as data visualization. During the learning process, however, topological defects frequently emerge in the map. The presence of defects tends to drastically slow down the formation of a globally ordered topographic map. To remove such topological defects, it has been reported that an asymmetric neighborhood function is effective, but only in the simple case of mapping one-dimensional stimuli to a chain of units. In this paper, we demonstrate that even when high-dimensional stimuli are used, the asymmetric neighborhood function is effective for both artificial and real-world data. Our results suggest that applying the asymmetric neighborhood function to the SOM algorithm improves the reliability of the algorithm. In addition, it enables processing of complicated, high-dimensional data by using this algorithm.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Data-Driven Linear Parameter-Varying Modeling and Control of Flexible Loads for Grid Services: Preprint

Flexible loads have great potential to improve the power grid's flexibility and stability. To effectively control large ensembles of heterogeneous loads, reliable models thereof are required. The paper presents a data-driven modeling and control approach to manage flexible loads for providing grid services. We leverage a linear parameter-varying autoregressive moving average (LPV-ARMA) model to describe the aggregate load response, where the parameters in the model are used to capture external environment impacts (e.g., weather). A gain-scheduling feedback controller is then developed to adapt to environmental variations. This data-driven approach can be easily applied to different types of loads in various environmental conditions. In addition to the ensemble controller, distributed load controllers are designed to deliver grid services, while maintaining the quality of service of inherent load tasks. We demonstrate the work on the IEEE 37-node distribution system for real-time power regulation services through control of thermostatically controlled loads.

control↗

Toward Real Time Data Analysis for Smart Grids

This paper describes the architecture and design of a novel system for supporting large-scale real-time data analysis for future power grid systems. The widespread deployment of renewable generation, smart grid controls, energy storage, plug-in hybrids, and new conducting materials will require fundamental changes in the operational concepts and principal components of the grid. As a result, the whole system becomes highly dynamic and requires constant adjusting based on real time data. Even though millions of sensors such as phase measurement units (PMU) and smart meters are being widely deployed, a data layer that can analyze this amount of data in real time is needed. Unlike the data fabric in other cloud services, the data layer for smart grids has some unique design requirements. First, this layer must provide real time guarantees. Second, this layer must be scalable to allow a large number of applications to access the data from millions of sensors in real time. Third, reliability is critical and this layer must be able to continue to provide service in face of failures. Fourth, this layer must be secure. We address these challenges though a scalable system architecture that integrates the I/O and data processing capability in a devise set of devices. Data process operations can be placed anywhere from sensors, data storage devices, to control centers. We further employ compression to improve performance. We design a lightweight compression customized for power grid data. Our system can reduce end-to-end response time by reduce I/O overhead through compression and overlap compression operations with I/O. The initial prototype of our system was demonstrated with several use cases from PNNL’s FPGI and show that our system can provide real time guarantees to a diverse set of applications.

Data Analytics, Power Grid, Big Data↗

Bayesian methods for parameter estimation in effective field theories

We demonstrate and explicate Bayesian methods for fitting the parameters that encode the impact of short-distance physics on observables in effective field theories (EFTs). We use Bayes' theorem together with the principle of maximum entropy to account for the prior information that these parameters should be natural, i.e., O(1) in appropriate units. Marginalization can then be employed to integrate the resulting probability density function (pdf) over the EFT parameters that are not of specific interest in the fit. We also explore marginalization over the order of the EFT calculation, M, and over the variable, R, that encodes the inherent ambiguity in the notion that these parameters are O(1). This results in a very general formula for the pdf of the EFT parameters of interest given a data set, D. We use this formula and the simpler 'augmented {chi}{sup 2}' in a toy problem for which we generate pseudo-data. These Bayesian methods, when used in combination with the 'naturalness prior', facilitate reliable extractions of EFT parameters in cases where {chi}{sup 2} methods are ambiguous at best. We also examine the problem of extracting the nucleon mass in the chiral limit, M{sub 0}, and the nucleon sigma term, from pseudo-data on the nucleon mass as a function of the pion mass. We find that Bayesian techniques can provide reliable information on M{sub 0}, even if some of the data points used for the extraction lie outside the region of applicability of the EFT.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Combined High Spectral Resolution Lidar and Millimeter Wavelength Radar Measurement of Ice Crystal Precipitation

The goal of this research has been to improve measurements of snowfall using a combination of millimeter-wavelength radar and High Spectral Resolution Lidar (HSRL) Observations. Snowflakes are large compared to the 532nm HSRL wavelength and small compared to the 3.2 and 8.6 mm wavelength radars used in this study. This places the particles in the optical scattering regime of the HSRL, where extinction cross-section is proportional to the projected area of the particles, and in the Rayleigh regime for the radar, where the backscatter cross-section is proportional to the mass-squared of the particles. Forming a ratio of the radar measured cross-section to the HSRL measured cross section eliminates any dependence on the number of scattering particles, yielding a quantity proportional to the average mass-squared of the snowflakes over the average area of the flakes. Using simultaneous radar measurements of particle fall velocities, which are dependent particle mass and cross-sectional area it is possible to derive the average mass of the snow flakes, and with the radar measured fall velocities compute the snowfall rate. Since this retrieval requires the optical extinction cross-section we began by considering errors this quantity. The HSRL is particularly good at measuring the backscatter cross-section. In previous studies of snowfall in the high Arctic were able to estimate the extinction cross-section directly as a fixed ratio to the backscatter cross-section. Measurements acquired in the STORMVEX experiment in Colorado showed that this approach was not valid in mid-latitude snowfalls and that direct measurement of the extinction cross-section is required. Attempts to measure the extinction directly uncovered shortcomings in thermal regulation and mechanical stability of the newly deployed DOE HSRL systems. These problems were largely mitigated by modifications installed in both of the DOE systems. We also investigated other sources of error in the HSRL direct measurement of extinction (see appendix II of this report). We also developed improved algorithms to extract extinction from the HSRL data. These have been installed in the standard HSRL data processing software and are now available to all users of HSRL data. Validation of snowfall measurements has proven difficult due to the unreliability of conventional snowfall measurements coupled with the complexity of considering the vast variety of snowflake geometries. It was difficult to tell how well the algorithm’s approach to accommodating differences in snowflakes was working without good measurements for comparison. As a result, we decided to apply this approach to the somewhat simpler, but scientifically important, problem of drizzle measurement. Here the particle shape is known and the conventional measurement are more reliable. These algorithms where successfully applied to drizzle data acquired during the ARM MAGIC study of marine stratus clouds between California and Hawaii (see Appendix I). This technique is likely to become a powerful tool for studying lifetime of the climatically important marine stratus clouds.

47 OTHER INSTRUMENTATION↗

A data variance technique for automated despiking of magnetotelluric data with a remote reference

The magnetotelluric method employs co-located surface measurements of electric and magnetic fields to infer the local electrical structure of the earth. The frequency-dependent 'apparent resistivity' curves can be inaccurate at long periods if input data are contaminated - even when robust remote reference techniques are employed. Data despiking prior to processing can result in significantly more reliable estimates of long period apparent resistivities. This paper outlines a two-step method of automatic identification and replacement for spike-like contamination of magnetotelluric data; based on the simultaneity of natural electric and magnetic field variations at distant sites. This simultaneity is exploited both to identify windows in time when the array data are compromised, and to generate synthetic data that replace observed transient noise spikes. In the first step, windows in data time series containing spikes are identified via intersite comparison of channel 'activity' - such as the variance of differenced data within each window. In the second step, plausible data for replacement of flagged windows is calculated by Wiener filtering coincident data in clean channels. The Wiener filters - which express the time-domain relationship between various array channels - are computed using an uncontaminated segment of array training data. Examples are shown where the algorithm is applied to artificially contaminated data, and to real field data. In both cases all spikes are successfully identified. In the case of implanted artificial noise, the synthetic replacement time series are very similar to the original recording. In all cases, apparent resistivity and phase curves obtained by processing the despiked data are much improved over curves obtained from raw data.

54 ENVIRONMENTAL SCIENCES↗

Estimation of pipe failure frequencies in the absence of operational experience data: A pilot study

Probabilistic failure metrics such as leak frequency and rupture frequency are commonly used to characterize piping reliability. The methodologies for calculating the failure metrics rely on a complex set of input parameters. Operating experience data and experimental data play an important role in informing the different input parameters. The paper describes results and conclusions of a coordinated research project to benchmark three different reliability models using a four-step procedure: reference case definition of relevance to advanced reactor designs, input parameter calibration, validation of results, and application of different methodologies upon completion of the calibration and validation steps. The reference case is a weld consisting of nickel-base alloy 152/52 and located within a primary pressure boundary of an advanced reactor. This alloy is a class of structural materials known to be highly resistant to stress corrosion cracking. Synergies between the different methods are noted and the importance of a multi-disciplinary approach to input parameter development is underscored. A key conclusion is that the three methods are equally suitable for estimating failure frequencies. In any specific application, a selection of the most practical or effective computational tool can be considered. The comparison of alternative models confirms and helps to gain confidence in the computed failure frequency estimates. The study was part of a coordinated research project organized by the International Atomic Energy Agency.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Global QCD analysis of spin PDFs in the proton with high-𝑥 and lattice constraints

We perform a comprehensive global QCD analysis of spin-dependent parton distribution functions (PDFs), combining all available data on inclusive and semi-inclusive deep-inelastic scattering (DIS), as well as inclusive weak boson and jet production in polarized 𝑝⁢𝑝 collisions, simultaneously extracting spin-averaged PDFs and fragmentation functions. Including recent Jefferson Lab DIS data at high 𝑥, together with subleading power corrections to the leading-twist framework, allows us to verify the stability of the PDFs for 𝑊 2 ≥ 4 GeV 2 and quantify the uncertainties on the spin structure functions more reliably. We explore the use of new lattice QCD data on gluonic pseudo-Ioffe time distributions, which, together with jet production and high-𝑥 DIS data, improve the constraints on the polarized gluon PDF. The expanded kinematic reach afforded by the data into the high-𝑥 region allows us to refine the bounds on higher-twist contributions to the spin structure functions, and test the validity of the Bjorken sum rule.

Perturbative QCD↗

LBNL CRADA (FP00009949) with the American Public Power Association: Electricity Reliability Metrics, Analysis, and Planning (Final Technical Report)

LBNL and APPA (the team) jointly examined the extent to which differences in distribution feeder characteristics are correlated with differences in their reliability performance when exposed to three different types of natural hazards (wildlife, weather, and vegetation). The team employed data-driven approaches to quantify the relationships between various measures of feeder reliability and a suite of feeder characteristics individually and jointly via a statistically-based clustering method.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Electricity Reliability Metrics, Analysis, and Planning (CRADA Final Report)

LBNL and APPA (the team) jointly examined the extent to which differences in distribution feeder characteristics are correlated with differences in their reliability performance when exposed to three different types of natural hazards (wildlife, weather, and vegetation). The team employed data-driven approaches to quantify the relationships between various measures of feeder reliability and a suite of feeder characteristics individually and jointly via a statistically-based clustering method. The team developed suggestions on how comparisons across groupings of feeders and review of the relative contributions of the constituents of SAIFI and SAIDI could be used to help prioritize utility actions to improve reliability. However, they also caution that their suggestions require further evaluation because they are based on only one year of information from a modest number of small utilities.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Machine Learning-Based Anomaly Detection for PMT Data Quality Monitoring in the SBN and DUNE

Maintaining high-quality detector data is essential for achieving the scientific objectives of the Short-Baseline Neutrino (SBN) Program at Fermilab. Current data quality monitoring (DQM) procedures rely primarily on threshold-based metrics and manual inspection of detector monitoring plots, making the detection of subtle or gradually developing anomalies both time-consuming and dependent on expert interpretation. This project developed and evaluated a machine-learning workflow for automatically identifying anomalous photomultiplier tube (PMT) channels in the Short-Baseline Near Detector (SBND) using optical-hit amplitude data. A Python-based analysis program was developed to process ROOT files, extract statistical features describing individual PMT amplitude distributions, and generate feature vectors for anomaly detection. These features were used to train an Isolation Forest model using data representing normal detector operation. The trained model was subsequently applied to independent detector runs to identify channels exhibiting statistically unusual behavior relative to the learned reference response. To support expert interpretation, the workflow generated complementary diagnostic products, including anomaly score distributions, normalized amplitude comparisons, decision-tree visualizations, and principal component analysis (PCA) projections. This project demonstrated the feasibility of integrating unsupervised machine learning into detector data-quality monitoring and developed a complete workflow for automated PMT performance assessment to aid expert-driven review. Beyond its technical contributions, the VFP appointment fostered a research collaboration between Aurora University and Fermilab and provided direct workforce development benefits by training the visiting faculty member in detector-scale machine-learning methods that are now being incorporated into undergraduate coursework and research. The methodology developed here provides a foundation for future applications to ProtoDUNE and other liquid argon time projection chamber (LArTPC) detectors, contributing to ongoing efforts to improve detector reliability, reduce manual monitoring requirements, and enable scalable data quality monitoring for future large-scale neutrino experiments, including the Deep Underground Neutrino Experiment (DUNE).

Colón Santana, Juan A. [Unlisted, US, IL]↗

Recent Experience with the CMS Data Management System

The CMS[1] experiment manages a large-scale data infrastructure, currently handling over 200 PB of disk and 500 PB of tape storage and transferring more than 1 PB of data per day on average between various WLCG[2] sites. Utilizing Rucio[3] for high-level data management, FTS[4] for data transfers, and a variety of storage and network technologies at the sites, CMS confronts inevitable challenges due to the system’s growing scale and evolving nature. Key challenges include managing transfer and storage failures, optimizing data distribution across different storages based on production and analysis needs, implementing necessary technology upgrades and migrations, and efficiently handling user requests. The data management team has established comprehensive monitoring to supervise this system and has successfully addressed many of these challenges. The team’s efforts aim to ensure data availability and protection, minimize failures and manual interventions, maximize transfer throughput and resource utilization, and provide reliable user support. This paper details the operational experience of CMS with its data management system in recent years, focusing on the encountered challenges, the effective strategies employed to overcome them and the ongoing challenges as we prepare for future demands.

Öztürk, Hasan [CERN]↗

Experimental study of the γ p → π 0 η p reaction with the A2 setup at the Mainz Microtron

Here, the data available from the A2 Collaboration at MAMI were analyzed to select the γp → π 0 ηp reaction on an event-by-event basis, which allows for partial-wave analyses of three-body final states to obtain more reliable results, compared to fits to measured distributions. These data provide the world’s best statistical accuracy in the energy range from threshold to E γ = 1.45 GeV, allowing a finer energy binning in the measurement of all observables needed for understanding the reaction dynamics. The results obtained for the measured observables are compared to existing models, and the impact from the new data is checked by the fit with the revised Mainz model.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Measuring System for Use in Radar-System Development

A new system for the analysis and monitoring of radar equipment at the development stage is described. In the verification of radar systems, it is of particular interest to check the reliability of programs that permit the identification of flight test data. In practice, that improves the interpretation of flight data. Practical results are presented.

42 ENGINEERING↗

Physics-Informed and Data-Driven Prediction of Residual Stress in Three-Dimensional Machining

Efficient and reliable prediction of machining-induced residual stress (RS) is a key requirement for truly integrated computational materials engineering (ICME). Currently available process modeling approaches, including empirical, analytical, and numerical methodologies lack predictive power and require substantial calibration and validation data. Moreover, most model-based approaches consider only two-dimensional (2D) (i.e., orthogonal), cutting processes. Meanwhile, industrial processes such as milling, turning, and drilling are inherently three-dimensional (3D). The present work attempts to bridge the gap between 2D and 3D through careful consideration of the process physics, including geometric, kinematic, and size-effect constraints to realize robust prediction of how RS develops in 3D machining. Using a novel in-situ experimental technique and digital image correlation (DIC) to determine equivalent Hertzian contact widths, contact pressures, and friction coefficients, the proposed methodology leverages a discretized conversion algorithm that includes multi-pass shakedown effects. This paper presents a semi-analytical model to predict machining-induced RS in 3D turning operations, which are used representatively for 3D processes more generally. Rather than follow a ‘brute force’ 3D FEM approach or conduct countless experiments to train a purely data-driven machine learning algorithm, the proposed approach builds on previous 2D modeling work. Through careful consideration of the process physics, including complex geometry/kinematic considerations of 3D turning, the authors demonstrated an experimentally calibrated approach, as well as validation based on published RS data. Model predictions and previously published measurement data of RS depth profiles for turning of Inconel 718 were compared for a range of process parameters. Correlation between the proposed 3D model and validation data was found to be within the margin of experimental error for most conditions. The proposed model appears to capture the overall behavior of 3D RS depth profiles with acceptable accuracy, particularly the key metrics of near-surface stress, peak stress magnitude and location, as well as overall stress profile depth. This report presents a physics-informed, data-driven approach for efficient calibration of a 2D model for machining-induced RS through DIC analysis of in-situ characterized subsurface displacement fields.

42 ENGINEERING↗

Practical reliability and uncertainty quantification in complex systems : final report.

The purpose of this project was to investigate the use of Bayesian methods for the estimation of the reliability of complex systems. The goals were to find methods for dealing with continuous data, rather than simple pass/fail data; to avoid assumptions of specific probability distributions, especially Gaussian, or normal, distributions; to compute not only an estimate of the reliability of the system, but also a measure of the confidence in that estimate; to develop procedures to address time-dependent or aging aspects in such systems, and to use these models and results to derive optimal testing strategies. The system is assumed to be a system of systems, i.e., a system with discrete components that are themselves systems. Furthermore, the system is 'engineered' in the sense that each node is designed to do something and that we have a mathematical description of that process. In the time-dependent case, the assumption is that we have a general, nonlinear, time-dependent function describing the process. The major results of the project are described in this report. In summary, we developed a sophisticated mathematical framework based on modern probability theory and Bayesian analysis. This framework encompasses all aspects of epistemic uncertainty and easily incorporates steady-state and time-dependent systems. Based on Markov chain, Monte Carlo methods, we devised a computational strategy for general probability density estimation in the steady-state case. This enabled us to compute a distribution of the reliability from which many questions, including confidence, could be addressed. We then extended this to the time domain and implemented procedures to estimate the reliability over time, including the use of the method to predict the reliability at a future time. Finally, we used certain aspects of Bayesian decision analysis to create a novel method for determining an optimal testing strategy, e.g., we can estimate the 'best' location to take the next test to minimize the risk of making a wrong decision about the fitness of a system. We conclude this report by proposing additional fruitful areas of research.

97 MATHEMATICS AND COMPUTING↗