SEARCH · Search NASA

Results for “data reliability”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 901 records · Page 50

All sources NASA NTRS DOE OSTI

DOE OSTI2023

Measurement of Beam Energy in the Fermilab's Linac taken at the transfer Line

Linac is the first machine in the Accelerator chain at Fermilab where 𝐻− particles are accelerated from 35 keV to 400 MeV and travel to the Booster where they are stripped. of the extra electrons to become protons. The Booster requires stable beam energy at injection. The Linac extraction energy tuning has been performed using two Beam Velocity Monitors (a.k.a Griffin detectors) to maintain stable relative energy between the Booster and the Linac. Our goal is to control the Linac energy parameters using Machine Learning techniques to increase reliability and quality of beam delivered from Linac. The first step is to understand the data from the Linac extraction diagnostics; and develop reliable, accurate methods for energy measurement and control before implementing machine learning. There were two methods of energy measurement implemented, and the results of these are compared. The first method was time of flight measurements using the Phase probes inside B eam Position Monitors (BPM) that provide the beam’s phase of arrival data. The second method used the relation between beam position data from the BPMs and dispersion values from the 400MeV MAD-X model to calculate momentum variation. The results of these two energy measurement methods compare well as the Linac energy is varied.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2020

Fast and Accurate Frequency Response Estimation for Large Power System Disturbances Using Second Derivative of Frequency Data

Accurate Frequency Response Estimation (FRE) is critical to reliability risk management of large power system disturbances. This letter proposes a measurement-driven approach for FRE by calculating the second derivative of frequency from synchrophasor data. Compared with conventional methods, the proposed method has major advantages of low computational burden and high accuracy, which makes it appropriate for real-time FRE in bulk power systems. The effectiveness of this method is validated with actual synchrophasor data on 96 confirmed historical power system disturbances in the U.S. eastern interconnection.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2015

Long Island Smart Energy Corridor

The Long Island Power Authority (LIPA) has teamed with Stony Brook University (Stony Brook or SBU) and Farmingdale State College (Farmingdale or FSC), two branches of the State University of New York (SUNY), to create a “Smart Energy Corridor.” The project, located along the Route 110 business corridor on Long Island, New York, demonstrated the integration of a suite of Smart Grid technologies from substations to end-use loads. The Smart Energy Corridor Project included the following key features: -TECHNOLOGY: Demonstrated a full range of smart energy technologies, including substations and distribution feeder automation, fiber and radio communications backbone, advanced metering infrastructure (AM”), meter data management (MDM) system (which LIPA implemented outside of this project), field tools automation, customer-level energy management including automated energy management systems, and integration with distributed generation and plug-in hybrid electric vehicles. -MARKETING: A rigorous market test that identified customer response to an alternative time-of-use pricing plan and varying levels of information and analytical support. -CYBER SECURITY: Tested cyber security vulnerabilities in Smart Grid hardware, network, and application layers. Developed recommendations for policies, procedures, and technical controls to prevent or foil cyber-attacks and to harden the Smart Grid infrastructure. -RELIABILITY: Leveraged new Smart Grid-enabled data to increase system efficiency and reliability. Developed enhanced load forecasting, phase balancing, and voltage control techniques designed to work hand-in-hand with the Smart Grid technologies. -OUTREACH: Implemented public outreach and educational initiatives that were linked directly to the demonstration of Smart Grid technologies, tools, techniques, and system configurations. This included creation of full-scale operating models demonstrating application of Smart Grid technologies in business and residential settings. Farmingdale State College held three international conferences on energy and sustainability and Smart Grid related technologies and policies. These conferences, in addition to public seminars increased understanding and acceptance of Smart Grid transformation by the general public, business, industry, and municipalities in the Long Island and greater New York region. - JOB CREATION: Provided training for the Smart Grid and clean energy jobs of the future at both Farmingdale and Stony Brook. Stony Brook focused its “Cradle to Fortune 500” suite of economic development resources on the opportunities emerging from the project, helping to create new technologies, new businesses, and new jobs. To achieve these features, LIPA and its sub-recipients, FSC and SBU, each have separate but complementary objectives. At LIPA, the Smart Energy Corridor (1) meant validating Smart Grid technologies; (2) quantifying Smart Grid costs and benefits; and (3) providing insights into how Smart Grid applications can be better implemented, readily adapted, and replicated in individual homes and businesses. LIPA installed 2,550 AMI meters (exceeding the 500 AMI meters in the original plan), created three “smart” substations serving the Corridor, and installed additional distribution automation elements including two-way communications and digital controls over various feeders and capacitor banks. It gathered and analyzed customer behavior information on how they responded to a new “smart” TOU rate and to various levels of information and analytical tools.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2025

Reliable and Efficient Machine Learning (Final Technical Report)

Modern scientific experiments generate massive amounts of data at a pace much faster than humans can manually analyze. While machine learning has revolutionized commercial data analysis (such as recommending movies or recognizing faces), applying these tools to complex scientific discovery is challenging because scientific answers must be precise, interpretable, and adhere to physical laws. The research under this project aims to develop new mathematical tools and computer algorithms specifically designed for scientific applications. Major progress has been made in automatically cleaning and deconstructing messy experimental data, analyzing the visual information of physical phenomena, determining the underlying physical variables, and providing rig orous mathematical analysis of interesting algorithms and concepts widely used in machine learning. This project addressed the critical gap between our ability to generate massive scientific data and our ability to extract interpretable information from it. We established mathematical foundations for Scientific Machine Learning (SciML) aimed at effective data analytics and automated discovery. Our work focused on three core objectives: (1) developing reliable feature extraction methods for dynamic high-dimensional data, (2) establishing mathematical foundations for discovering dynamics via neural networks, and (3) creating rigorous optimization techniques for these models. Key outcomes come from two fronts. On the practical side, they include the development of algorithms that significantly enhance the extraction of signals from field data, as well as the capability to handle situations that exhibit smooth variations or physical stretching due to temperature changes. They also include the creation of an automated framework for discovering fundamental state variables from raw experimental data, demonstrating the ability to identify intrinsic physical dimensions without prior knowledge of the governing laws. On the theoretical front, the research results in theoretical advances in Optimal Transport, a widely used notion in SciML, specifically regarding functions with fixed-size nodal sets, provide sharp bounds relevant to uncertainty quantification. Meanwhile, the outcomes also include the establishment of convergence theories for nonlocal gradient descent methods, enabling robust optimization with noisy data in high-dimensional settings commonly encountered in scientific modeling. The project also helps creating opportunities to train the next generation of researchers, equipping them with the necessary technical skills for today’s workplace and preparing them for future advances.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

The Monarch Initiative in 2024: an analytic platform integrating phenotypes, genes and diseases across species

Abstract Bridging the gap between genetic variations, environmental determinants, and phenotypic outcomes is critical for supporting clinical diagnosis and understanding mechanisms of diseases. It requires integrating open data at a global scale. The Monarch Initiative advances these goals by developing open ontologies, semantic data models, and knowledge graphs for translational research. The Monarch App is an integrated platform combining data about genes, phenotypes, and diseases across species. Monarch's APIs enable access to carefully curated datasets and advanced analysis tools that support the understanding and diagnosis of disease for diverse applications such as variant prioritization, deep phenotyping, and patient profile-matching. We have migrated our system into a scalable, cloud-based infrastructure; simplified Monarch's data ingestion and knowledge graph integration systems; enhanced data mapping and integration standards; and developed a new user interface with novel search and graph navigation features. Furthermore, we advanced Monarch's analytic tools by developing a customized plugin for OpenAI’s ChatGPT to increase the reliability of its responses about phenotypic data, allowing us to interrogate the knowledge in the Monarch graph using state-of-the-art Large Language Models. The resources of the Monarch Initiative can be found at monarchinitiative.org and its corresponding code repository at github.com/monarch-initiative/monarch-app.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2020

Online Event Detection in Synchrophasor Data with Graph Signal Processing

Online detection of anomalies is crucial to enhancing the reliability and resiliency of power systems. We propose a novel data-driven online event detection algorithm with synchrophasor data using graph signal processing. In addition to being extremely scalable, our proposed algorithm can accurately capture and leverage the spatio-temporal correlations of the streaming PMU data. This paper also develops a general technique to decouple spatial and temporal correlations in multiple time series. Finally, we develop a unique framework to construct a weighted adjacency matrix and graph Laplacian for product graph. Case studies with real-world, large-scale synchrophasor data demonstrate the scalability and accuracy of our proposed event detection algorithm. Compared to the state-of-the-art benchmark, the proposed method not only achieves higher detection accuracy but also yields higher computational efficiency.

Event detection↗

DOE OSTI2020

Online Event Detection in Synchrophasor Data with Graph Signal Processing

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2024

Modeling Grid Data Flows for Transmission and Distribution Operations: Review, Design, Next Steps

Operational scenarios of the power grids grow multifold to accommodate the diverse needs of both the utilities and end consumers, and the various other stakeholders in-between. To comprehensively model and apply analytics to support objectives and business functions of grid sectors, a reliable approach to characterize and design data flows is crucial. The flows bridge business functions with communications protocols, stakeholders such as the grid actors, and data interfaces comprising different data objects. Additionally, constraints applied to the flow such as cybersecurity, trust, privacy, and ownership among others intersect these entities, requiring the delineation of their interactions under different scenarios. This paper aims to not only highlight relevant research in the space of grid data flows, but also proposes, for the transmission-distribution sector, a novel modeling approach that marries the aforementioned entities: objectives, business functions, data interfaces, communication protocols, data stakeholders, and flow constraints. It elaborates on the design philosophy and the significance of each entity within the model and applies it to an example function of fault location, isolation and service restoration (FLISR). Finally, the next steps to extend the application of this data flow model for other practical operational scenarios are discussed.

Sundararajan, Aditya [ORNL] (ORCID:000000033577854↗

DOE OSTI2020

PV Reliability Lessons from 100,000 Systems

Despite the importance of reliability to the cost competitiveness of PV, large data sets enabling high-level investigation of the technology’s performance in the field are relatively scarce. Dirk C. Jordan, Chris Deline, Bill Marion and Teresa Barnes of the National Renewable Energy Laboratory, and Mark Bolinger of the Lawrence Berkeley National Laboratory study a unique data set of 100,000 PV systems in the US, drawing out tips for better reliability that have relevance to other parts of the world.

41 EE - Solar Energy Technologies Office (EE-4S)↗

DOE OSTI2019

Impacts of Spatial Heterogeneity and Temporal Non-Stationarity on Intensity-Duration-Frequency Estimates—A Case Study in a Mountainous California-Nevada Watershed

Changes in extreme precipitation events may require revisions of civil engineering standards to prevent water infrastructures from performing below the designated guidelines. Climate change may invalidate the intensity-duration-frequency (IDF) computation that is based on the assumption of data stationarity. Efforts in evaluating non-stationarity in the annual maxima series are inadequate, mostly due to the lack of long data records and convenient methods for detecting trends in the higher moments. In this study, using downscaled high resolution climate simulations of the historical and future periods under different carbon emission scenarios, we tested two solutions to obtain reliable IDFs under non-stationarity: (1) identify quasi-stationary time windows from the time series of interest to compute the IDF curves using data for the corresponding time windows; (2) introduce a parameter representing the trend in the means of the extreme value distributions. Focusing on a mountainous site, the Walker Watershed, the spatial heterogeneity and variability of IDFs or extremes are evaluated, particularly in terms of the terrain and elevation impacts. We compared observations-based IDFs that use the stationarity assumption with the two approaches that consider non-stationarity. The IDFs directly estimated based on the traditional stationarity assumption may underestimate the 100-year 24-h events by 10% to 60% towards the end of the century at most grids, resulting in significant under-designing of the engineering infrastructure at the study site. Strong spatial heterogeneity and variability in the IDF estimates suggest a preference for using high resolution simulation data for the reliable estimation of exceedance probability over data from sparsely distributed weather stations. Discrepancies among the three IDFs analyses due to non-stationarity are comparable to the spatial variability of the IDFs, underscoring a need to use an ensemble of non-stationary approaches to achieve unbiased and comprehensive IDF estimates.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

TASTI-GRID: Overview of the State of Oregon’s Resilience and Reliability [Slides]

This report is intended to help your state identify the most effective investments to improve grid resilience and reliability, based on analysis of outage data, weather events, and the current state of the electric grid. The information presented is derived from the best available data. The discussions and recommendations included provide context and valuable insights into potential high returns on investment (ROI). Specifically, the report offers an overview of electric grid resilience in Oregon, covering outage information, reasons for outages, calculated "resilience scores" across the state, and recommendations for both immediate and long-term investments in grid infrastructure. The document provides a concise overview of the analytical capabilities of the TASTI-GRID team. By utilizing additional data and resources, it synthesizes insights from the platform to present a distinct perspective on investing in grid resilience throughout Oregon. This document is not intended to influence or direct state-level decisions related to investments in grid resilience and reliability. TASTI-GRID should not be used for real-time monitoring, supporting the ESF #12 emergency response functions, or predicting the restoration times for outages.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2025

Floating photovoltaic power plants: A review of energy yield, reliability, and operation and maintenance

Photovoltaic (PV) systems are essential for the transition to sustainable energy, reducing fossil fuel dependence and mitigating climate change. Although PV requires minimal land area — PV can meet the European Union's energy needs using only 0.26% of its land — space for deployment is often scarce in densely populated regions. Floating photovoltaics (FPV) offer an effective solution to land-use challenges by installing PV systems on floating structures in water bodies. FPV is a growing niche within PV with a cumulative installed capacity reaching 7.7 GW globally by 2023. Almost 90% of the installed FPV capacity is in Asia, with close to 50% of in China alone, while the Netherlands and France are the largest markets outside Asia. FPV shows strong potential to support climate targets, but still faces challenges like regulatory barriers, cost competitiveness compared to ground-based PV (GPV), and uncertainties about environmental impacts and system reliability. FPV systems are currently installed mainly on sheltered inland waters, such as quarry lakes, irrigation ponds and reservoirs. FPV technical standards are still being developed. Guidelines have been published by the World Bank, DNV, and Solar Power Europe, and emerging national standards from South Korea, China, and Singapore address design, components, and safety. The International Electrotechnical Commission (IEC) is working on formal standards for floats, mooring systems, and electrical connectors. However, the published best practices lack quantitative guidance for yield modelling and reliability, which this report aims to address. It provides data-driven insights, models, and parameters essential for accurate energy yield, reliability, and maintenance predictions over FPV systems' lifetimes.

14 SOLAR ENERGY↗

DOE OSTI2020

Assessing the Reliability of Relevant Tweets and Validation Using Manual and Automatic Approaches for Flood Risk Communication

While Twitter has been touted as a preeminent source of up-to-date information on hazard events, the reliability of tweets is still a concern. Our previous publication extracted relevant tweets containing information about the 2013 Colorado flood event and its impacts. Using the relevant tweets, this research further examined the reliability (accuracy and trueness) of the tweets by examining the text and image content and comparing them to other publicly available data sources. Both manual identification of text information and automated (Google Cloud Vision, application programming interface (API)) extraction of images were implemented to balance accurate information verification and efficient processing time. The results showed that both the text and images contained useful information about damaged/flooded roads/streets. This information will help emergency response coordination efforts and informed allocation of resources when enough tweets contain geocoordinates or location/venue names. This research will identify reliable crowdsourced risk information to facilitate near real-time emergency response through better use of crowdsourced risk communication platforms.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2019

Machine Learning Applied to Star–Galaxy–QSO Classification and Stellar Effective Temperature Regression

In modern astrophysics, machine learning has increasingly gained popularity with its incredibly powerful ability to make predictions or calculated suggestions for large amounts of data. We describe an application of the supervised machine-learning algorithm, random forests (RF), to the star/galaxy/QSO classification and the stellar effective temperature regression based on the combination of Large Sky Area Multi-Object Fiber Spectroscopic Telescope and Sloan Digital Sky Survey spectroscopic data. This combination enables us to obtain reliable predictions with one of the largest training samples ever used. The training samples are built with a nine-color data set of about three million objects for the classification and a seven-color data set of over one million stars for the regression. The performance of the classification and regression is examined with validation and blind tests on the objects in the RAdial Velocity Extension, 6dFGS, UV-bright Quasar Survey and Apache Point Observatory Galactic Evolution Experiment surveys. We demonstrate that RF is an effective algorithm, with classification accuracies higher than 99% for stars and galaxies, and higher than 94% for QSOs. These accuracies are higher than machine-learning results in former studies. The total standard deviations of the regression are smaller than 200 K, which is similar to those of some spectrum-based methods. The machine-learning algorithm with the broad-band photometry provides us with a more efficient approach for dealing with massive amounts of astrophysical data than do traditional color cuts and spectral energy distribution fits.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2022

Efficient Implementation of Artificial Neural Networks for Sensor Data Analysis Based on a Genetic Algorithm

The reliability of many industrial processes depends on the sensor system. However, these sensors can be affected by noise, perturbations and failures. Hence, sensor monitoring and diagnosis are fundamental to guarantee the quality of an industrial process. Nowadays, artificial neural networks (ANN) are widely used in sensor signal processing and diagnosis. However, those ANNs usually require many artificial neurons, being difficult to implement in software and hardware due to their high computational costs. This paper presents an optimized implementation of artificial neurons in ANNs for sensor data analysis using a Genetic Algorithm (GA). The objective of GA is to find an adequate segmentation to reduce the activation function approximation error. One of the advantages of the proposed approach is that the cost function used in GA considers the effect of factors such as the ANN architecture or the number of bits used in arithmetic operations. The proposed ANN implementation technique aims to get the best possible approximation for a specific ANN architecture, making easier its implementation in software and hardware. Simulation and experimental results using FPGA (Field Programmable Gate Array) prove the advantages of the proposed approach for implementing sensor data analysis systems based on ANNs.

D estefani, André↗

DOE OSTI2024

A customizable data management framework for high-repetition-rate high-energy-density science

The high-energy-density (HED) physics community is moving toward a new paradigm of high-repetition-rate (HRR) operation. To fully leverage the scientific power of HRR HED facilities, all of the components of each subsystem (laser, targetry, and performance diagnostics) must be connected and synchronized in a reliable and robust manner while the data acquired are tagged and archived in real time. To this end, GA has begun developing a generalized NoSQL-database framework, the MongoDB repository for information and archiving. An organizational strategy has been developed that shifts HED data organization from a shot-based to a diagnostic-based approach in order to increase archival and retrieval efficiency that lends itself to optimization applications. This work is a first step in pushing HRR HED science toward data management solutions that emphasize machine actionability and aim to stimulate community engagement to define data standards in HED science.

Instruments & Instrumentation↗

DOE OSTI2026

Large-momentum effective theory’s asymptotic extrapolation vs the inverse problem

Large-momentum effective theory is a physics-guided systematic expansion to calculate light-cone parton distributions, including collinear (PDFs) and transverse-momentum-dependent ones, at any fixed momentum fraction 𝑥 within a range of [𝑥 min , 𝑥 max ]. It theoretically solves the ill-posed inverse problem that afflicts other theoretical approaches to collinear PDFs, such as short-distance factorizations. Recently, Dutrieux et al. raised practical concerns about whether current or even future lattice data will have sufficient precision in the subasymptotic correlation region to support an error-controlled extrapolation—and if not, whether it becomes an inverse problem where the relevant uncertainties cannot be properly quantified. While we agree that not all current lattice data have the desired precision to qualify for an asymptotic extrapolation, some calculations do, and more are expected in the future. We comment on the analysis and results in Dutrieux et al. and argue that a physics-based systematic extrapolation still provides the most reliable error estimates, even when the data quality is not ideal. In contrast, reframing the long-distance asymptotic extrapolation as a data-driven-only inverse problem with ad hoc mathematical conditioning could lead to unnecessarily conservative errors.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2019

Determining $\alpha_s$ from hadronic $\tau$ decay: the pitfalls of truncating the OPE

We discuss sum-rule determinations of \alpha_s α s from non-strange hadronic \tau τ -decay data. We investigate, in particular, the reliability of the assumptions underlying the “truncated OPE strategy,” which specifies a certain treatment of non-perturbative contributions, and which was employed in Refs. . Here, we test this strategy by applying the strategy to the R R -ratio obtained from e^+e^- e + e − data, which extend beyond the \tau τ mass, and demonstrate that the assumptions underlying this strategy are not, in general, valid. We then present a brief overview of new results on the form of duality-violating non-perturbative contributions, which are conspicuously present in the experimentally determined spectral functions. As we show, with the current precision claimed for the extraction of \alpha_s α s , including a representation of duality violations is unavoidable if one wishes to avoid uncontrolled theoretical errors.

Boito, Diogo↗