SEARCH · Search NASA
Results for “data driven operations”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Data Jockey: Automatic Data Management for HPC Multi-Tiered Storage Systems
We present the design and implementation of Data Jockey, a data management system for HPC multi-tiered storage systems. As a centralized data management control plane, Data Jockey automates bulk data movement and placement for scientific workflows and integrates into existing HPC storage infrastructures. Data Jockey simplifies data management by eliminating human effort in programming complex data movements, laying datasets across multiple storage tiers when supporting complex workflows, which in turn increases the usability of multitiered storage systems emerging in modern HPC data centers.Specifically, Data Jockey presents a new data management scheme called “goal driven data management” that can automatically infer low-level bulk data movement plans from declarative high-level goal statements that come from the lifetime of iterative runs of scientific workflows. While doing so, Data Jockey aims to minimize data wait times by taking responsibility for datasets that are unused or to be used, and aggressively utilizing the capacity of the upper, higher performant storage tiers.We evaluated a prototype implementation of Data Jockey under a synthetic workload based on a year’s worth of Oak Ridge Leadership Computing Facility’s (OLCF) operational logs. Our evaluations suggest that Data Jockey leads to higher utilization of the upper storage tiers while minimizing the programming effort of data movement compared to human involved, per-domain adhoc data management scripts.
Using Artificial Intelligence to Improve Reliability and Operational Efficiency of Small-Scale Hydroelectric Distributed Generation
Reliability and resilience are critical concerns for distributed generation (DG) at the rural electric level. The integration of renewable energy sources, such as small-scale hydroelectric distributed generators (hydro DGs), introduces operational challenges, particularly regarding aging infrastructure and grid stability. Artificial Intelligence (AI)-driven Machine Learning (ML) models and applications of Large Language Models (LLMs) offer promising solutions for optimizing DG operations and enhancing resilience. This paper explores AI-based models for improving efficiency, fault resolution, and outage mitigation in small-scale hydro DGs. Furthermore, it highlights the development of a centralized, AI-powered information portal for rural electric cooperatives and municipalities. The research evaluates hydro DG plant models and discusses the applicability of AI-powered question-answering tools for real-time operations, focusing on statistical data, load flow, voltage regulation, and generation power. The findings demonstrate AI’s potential to transform DG management to ensure greater stability and resilience in rural electric grids.
Terry Turbopump Analytical Modeling Efforts in Fiscal Year 2018. Progress Report
This document details the computational fluid dynamic and system-level modeling, including a mechanistic representation of a Terry turbopump. Until this recent effort, data and modeling results show that a Terry turbine, flowing air (or steam) at a certain rate, can develop the same power at two very different speeds, and has large implications with respect to understanding how a boiling water reactor's reactor core isolation cooling system or a pressurized water reactor turbine driven auxiliary feedwater system would respond to a loss of electrical power for Terry turbine speed governing. This work has provided insights in modeling uncertainties and provides confirmation for experimental efforts for the Terry turbopump expanded operating band being conducted at Texas A&M University.
Toward a Seamless Integration of Computing, Experimental, and Observational Science Facilities: A Blueprint to Accelerate Discovery
The Department of Energy, Office of Science operates world-leading facilities for experimental, observational, and computational science. DOE supercomputing facilities will reach performance at the scale of ExaFLOPs in the coming years, enabling new vistas of scale and precision for large scale simulations and data analysis. Experimental scientific facilities are undergoing similar upgrades that will lead to higher data rates and correspondingly larger computational demands, and will increase the need for near-real-time processing and resilient support for more complex workflows. A transformation of science is underway, with workloads at supercomputing facilities increasingly driven by this explosion of data from instruments and experimental facilities, as well as the accelerating use of Artificial Intelligence (AI) as a tool for scientific discovery. A seamless integration of computing, networking, instruments, and experimental facilities is required to support these emerging workloads and open up a new frontier of U.S. leadership in scientific discovery. We propose to accomplish this by providing frictionless access to the ASCR supercomputing facilities. We describe our vision of combining the power of ASCR supercomputers and networking infrastructure into an integrated scalable fabric, available to end user scientists via interfaces that aim to automate and simplify access to high performance computing systems. This will enable unprecedented computational science capabilities for experimental and observational facilities, and will create new opportunities to combine large simulations and modeling with experimental facility data analysis. This blueprint for creating an integrated network of computational and experimental facilities will provide an enriched discovery environment and open doors for new scientific communities to access the DOE’s world-leading computing and networking capabilities.
Rapid Evaluation and Response to Impacts on Critical End-Use Loads Following Natural Hazard-Driven Power Outages: A Modular and Responsive Geospatial Technology
The disparate nature of data for electric power utilities complicates the emergency recovery and response process. The reduced efficiency of response to natural hazards and disasters can extend the time that electrical service is not available for critical end-use loads, and in extreme events, leave the public without power for extended periods. This article presents a methodology for the development of a semantic data model for power systems and the integration of electrical grid topology, population, and electric distribution line reliability indices into a unified, cloud-based, serverless framework that supports power system operations in response to extreme events. An iterative and pragmatic approach to working with large and disparate datasets of different formats and types resulted in improved application runtime and efficiency, which is important to consider in real time decision-making processes during hurricanes and similar catastrophic events. This technology was developed initially for Puerto Rico, following extreme hurricane and earthquake events in 2017 and 2020, but is applicable to utilities around the world. Given the highly abstract and modular design approach, this technology is equally applicable to any geographic region and similar natural hazard events. In addition to a review of the requirements, development, and deployment of this framework, technical aspects related to application performance and response time are highlighted.
A Real-Time Big Data Control-Theoretical Framework for Cyber-Physical-Human Systems [Book Chapter]
It is known that cyber-physical-human systems naturally arise from interdependent infrastructure systems and smart connected communities. Such applications require ubiquitous information sensing and processing, intelligent machine-to-machine communication for a seamless coordination, as well as intelligent interactions between humans and machines. This chapter presents a control-theoretical framework to model heterogeneous physical dynamic systems, information and communication, as well as cooperative controls and/or distributed optimization of such interconnected systems. It is shown that efficient analytical and computational algorithms can be modularly designed and hierarchically implemented to operate and optimize cyber-physical-human systems, first to quantify individually the input–output relationship of nonlinear dynamic behaviors of every physical subsystem, then to coordinate locally both cyber-physical interactions of neighboring agents as well as physical-human interactions, and finally to dynamically model and optimize the overall networked system. The hierarchical structure makes the overall optimization and control problem scalable and solvable. Moreover, the three levels integrate individual designs and optimization, distributed cooperative optimization, and decision-making through real-time, data-driven, model-based learning and control. Specifically, one of the contributions of the chapter is to demonstrate how the combination of dissipativity theory and cooperative control serves as a natural framework and promising tools to analyze, optimize, and control such large-scale system. Application to digital grid is investigated as an illustrative example.
Grid Utility Asset Vulnerability Assessment (GUAVA) Software Tool
Increasing demand and changes in generation portfolios is pushing power grid to operate towards the limit. However, due to lack of analytical tools for understanding various scales of impact on grid, it is becoming more vulnerable to wide scale power outages and blackouts. A vulnerable grid operating at its limit can be easily disrupted by asset failures caused by devastating hurricanes which has been known to damage transmission and distribution lines along its track. In this direction, researchers have focused on determining these assets by conducting Monte Carlo simulations of hurricanes with uncertainties and collected a large set of simulation data. To determine the infrastructure updates necessary for mitigating wide scale impact of hurricanes on the grid, we propose a software tool named “Grid Utility Asset Vulnerability Analysis” (GUAVA) framework. GUAVA presents a novel data-driven probabilistic analytical approach to (1) post-process hurricane failure scenarios, (2) identify/rank assets that are most vulnerable and critical to failing and are associated with highest impact/risk, and (3) to inform system upgrade decisions & prioritization. Based on the observed results and employed data-driven methodology, it is expected GUAVA can be adapted to provide power system planners with a recommendation engine for making informed decisions to improve resilience of grid.
Real-Time, Adaptive Radiological Anomaly Detection and Isotope Identification Using Non-Negative Matrix Factorization
Spectroscopic anomaly detection and isotope identification algorithms are integral components in nuclear nonproliferation applications such as search operations. The task is especially challenging in the case of mobile detector systems because the observed gamma-ray background changes more than for a static detector system, and a pretrained background model can easily find itself out of domain. The result is that algorithms may exceed their intended false alarm rate or sacrifice detection sensitivity to maintain the desired false alarm rate. Non-negative matrix factorization (NMF) is a powerful tool for spectral anomaly detection and identification, but, like many similar algorithms that rely on data-driven background models, in its conventional implementation, it is unable to update in real time to account for environmental changes that affect the background spectroscopic signature. Here, we have developed a novel NMF-based algorithm that periodically updates its background model to accommodate changing environmental conditions. The adaptive NMF algorithm involves fewer assumptions about its environment, making it more generalizable than existing NMF-based methods while maintaining or exceeding detection performance on simulated and real-world datasets.
Measurement of the muon anomalous precession frequency at the Muon g − 2 Experiment at Fermilab
The anomalous magnetic moment of the muon, $a_\mu = \frac{g-2}{2}$ is the fractional deviation of the muon $g$-factor from the value of 2. It emerges as the cumulative effect of the virtual particles participating in the muon interaction with a magnetic field via quantum loop corrections. Its value encodes all the possible interactions between the virtual particles and, for this reason, represents an important test of the Standard Model (SM). In particular, any deviation from the SM theoretical evaluation could be due to new physics contributions. The new Muon $g-2$ (E989) Experiment at Fermilab is currently operating to repeat and improve the previous E821 experiment at Brookhaven National Laboratory (BNL), aiming to reduce the experimental error by a factor of 4 to the final accuracy of 140 parts per billion (ppb). On April 7th, 2021, the E989 collaboration published the first result based on the first year of data taking (Run-1), measuring $a_\mu = 0.001~165~920~40(54)$ with a precision of 460 ppb. The measured value is consistent with the BNL measurement and strengthens the long-standing tension with the data-driven SM prediction to a combined discrepancy of 4.2$\sigma$. On the theory side, however, new efforts involving lattice-QCD techniques are starting to question the current consensus on the theoretical prediction, demanding new improvements on both the experimental and theoretical sides. The E989 collaboration is now finalizing the analysis of Run-2 and Run-3 data and a new publication is expected in the first half of 2023 with a combined statistical uncertainty of 200 ppb. The anomalous magnetic moment $a_\mu$ is measured as the ratio between the muon spin anomalous precession frequency, $\omega_a$, and the average magnetic field experienced by the muons as they circulate in the storage ring. This thesis presents a precession frequency analysis of the Run-1 data and an evaluation of the related systematic uncertainties. A new positron reconstruction developed for the analysis of the subsequent data-taking periods, aiming to reduce some of the major systematic uncertainties of the $\omega_a$ measurement, is presented. The author's involvement in the production of the Run-2/5 data and in the precise calibration of the detectors is discussed. Finally, the complete Run-1 $a_\mu$ result is presented.
Utah FORGE: Neubrex Well 16B(78)-32 DAS Data - April, 2024
This dataset comprises Distributed Acoustic Sensing (DAS) data collected from the Utah FORGE monitoring well 16B(78)-32 (the producer well) during hydraulic fracture stimulation operations conducted in April 2024. The data were acquired continuously over the stimulation period at a temporal sampling rate of 10,000 Hz (10 kS/s) and a spatial resolution of approximately 3.35 feet (1.02109 meters). The measurements were captured using a Neubrex NBX-S4100 Time Gated Digital DAS interrogator unit connected to a single-mode fiber optic cable, which was permanently installed within the casing string. All recorded channels correspond to downhole segments of the fiber optic cable, from a measured depth (MD) of 5,369.35 feet to 10,352.11 feet. The DAS data reflect raw acoustic energy generated by physical processes within and surrounding the well during stimulation activities at wells 16A(78)-32 and 16B(78)-32. These data have potential applications in analyzing cross-well strain, far-field strain rates (including microseismic activity), induced seismicity, and seismic imaging. Metadata embedded in the attributes of the HDF5 files include detailed information on the measured depths of the channels, interrogation parameters, and other acquisition details. The dataset also includes a recording of a seminar held on September 19, 2024, where Neubrex's Chief Operating Officer presented insights into the data collection, analysis, and preliminary findings. The raw data files, stored in HDF5 format, are organized chronologically according to the recording intervals from April 9 to April 24, 2024, with each file corresponding to a 12-second recording interval.
Integration and Optimization of a Waste Heat Driven Organic Rankine Cycle for Power Generation in Wastewater Treatment Plants
The study focuses on achieving energy self-sufficiency in Wastewater Treatment Plants by proposing a comprehensive model for integrating, sizing, and optimizing an Organic Rankine Cycle system. The Organic Rankine Cycle system is designed to utilize waste heat from the gensets at As Samra Wastewater Treatment Plant in Jordan, where it will contribute to the overall electrical energy supply of the plant. Real data from As Samra Wastewater Treatment Plant is used to model and calculate the available waste heat using TRNSYS® software. The Organic Rankine Cycle model is then developed using ASPEN PLUS® software to explore the impact of operational parameters and determine their optimal values for maximizing the plant's energy profile. An economic analysis is conducted to assess the feasibility of the proposed model, considering system components, installation, operation, and maintenance costs. To optimize the Organic Rankine Cycle system, the study employs the Multi-Output Support Vector Regression technique to capture nonlinear relationships between independent variables (fluid type, turbine inlet pressure, turbine inlet temperature, turbine outlet pressure, and mass flow rate) and dependent variables (pump power input, waste heat input, and turbine specific work). The Osprey optimization algorithm is used to address the multi-objective optimization problem, with the proposed Pareto-based Osprey Optimization Algorithm and the Multi-Objective Particle Swarm Optimization technique being employed to evaluate critical performance and economic parameters such as system thermal efficiency, net power output, and the levelized cost of electricity. The results of the optimization strategies indicate that the M-SVR model's prediction accuracy is significantly improved after parameter optimization, with the model returning high R 2 and low Mean Square Error values of 0.991 and 0.00216, respectively. The Pareto-Based Osprey Optimization Algorithm optimizer identifies the best working fluid as Isobutane/Isopentane in a ratio of 66:34, with optimal turbine inlet pressure and temperature of 15 bars and 218 °C, respectively. In conclusion, the Organic Rankine Cycle model at these optimal conditions achieves a cycle efficiency of 19.93% and an Levelized Cost of Electricity value of 0.0353 USD/kWh.
Tests of neutrino interaction models with the MicroBooNE detector
I measure a large set of observables in inclusive charged current muon neutrino scattering on argon with the MicroBooNE liquid argon time projection chamber operating at Fermilab. I evaluate three neutrino interaction models based on the widely used GENIE event generator using these observables. The measurement uses a data set consisting of neutrino interactions with a final state muon candidate fully contained within the MicroBooNE detector. These data were collected in 2016 with the Fermilab Booster Neutrino Beam, which has an average neutrino energy of $800$ MeV, using an exposure corresponding to $5.0\times10^{19}$ protons-on-target. The analysis employs fully automatic event selection and charged particle track reconstruction and uses a data-driven technique to separate neutrino interactions from cosmic ray background events. I find that GENIE models consistently describe the shapes of a large number of kinematic distributions for fixed observed multiplicity, but I show an indication that the observed multiplicity fractions deviate from GENIE expectations.
Magnetic tunnel junction random number generators applied to dynamically tuned probability trees driven by spin orbit torque
Abstract Perpendicular magnetic tunnel junction (pMTJ)-based true-random number generators (RNGs) can consume orders of magnitude less energy per bit than CMOS pseudo-RNGs. Here, we numerically investigate with a macrospin Landau–Lifshitz-Gilbert equation solver the use of pMTJs driven by spin–orbit torque to directly sample numbers from arbitrary probability distributions with the help of a tunable probability tree. The tree operates by dynamically biasing sequences of pMTJ relaxation events, called ‘coinflips’, via an additional applied spin-transfer-torque current. Specifically, using a single, ideal pMTJ device we successfully draw integer samples on the interval [0, 255] from an exponential distribution based on p -value distribution analysis. In order to investigate device-to-device variations, the thermal stability of the pMTJs are varied based on manufactured device data. It is found that while repeatedly using a varied device inhibits ability to recover the probability distribution, the device variations average out when considering the entire set of devices as a ‘bucket’ to agnostically draw random numbers from. Further, it is noted that the device variations most significantly impact the highest level of the probability tree, with diminishing errors at lower levels. The devices are then used to draw both uniformly and exponentially distributed numbers for the Monte Carlo computation of a problem from particle transport, showing excellent data fit with the analytical solution. Finally, the devices are benchmarked against CMOS and memristor RNGs, showing faster bit generation and significantly lower energy use.
Bi-fidelity modeling of uncertain and partially unknown systems using DeepONets
Recent advances in modeling large-scale, complex physical systems have shifted research focuses towards data-driven techniques. However, generating datasets by simulating complex systems can require significant computational resources. Similarly, acquiring experimental datasets can prove difficult. For these systems, often computationally inexpensive, but in general inaccurate models, known as the low-fidelity models, are available. Here in this paper, we propose a bi-fidelity modeling approach for complex physical systems, where we model the discrepancy between the true system's response and a low-fidelity response in the presence of a small training dataset from the true system's response using a deep operator network, a neural network architecture suitable for approximating nonlinear operators. We apply the approach to systems that have parametric uncertainty and are partially unknown. Three numerical examples are used to show the efficacy of the proposed approach to model uncertain and partially unknown physical systems.
Multi-resolution partial differential equations preserved learning framework for spatiotemporal dynamics
Traditional data-driven deep learning models often struggle with high training costs, error accumulation, and poor generalizability in complex physical processes. Physics-informed deep learning (PiDL) addresses these challenges by incorporating physical principles into the model. Most PiDL approaches regularize training by embedding governing equations into the loss function, yet this depends heavily on extensive hyperparameter tuning to weigh each loss term. To this end, we propose to leverage physics prior knowledge by “baking” the discretized governing equations into the neural network architecture via the connection between the partial differential equations (PDE) operators and network structures, resulting in a PDE-preserved neural network (PPNN). This method, embedding discretized PDEs through convolutional residual networks in a multi-resolution setting, largely improves the generalizability and long-term prediction accuracy, outperforming conventional black-box models. The effectiveness and merit of the proposed methods have been demonstrated across various spatiotemporal dynamical systems governed by spatiotemporal PDEs, including reaction-diffusion, Burgers’, and Navier-Stokes equations.
Comparison of $\nu_\mu$-Ar multiplicity distributions observed by MicroBooNE to GENIE model predictions
We measure a large set of observables in inclusive charged current muon neutrino scattering on argon with the MicroBooNE liquid argon time projection chamber operating at Fermilab. We evaluate three neutrino interaction models based on the widely used GENIE event generator using these observables. The measurement uses a data set consisting of neutrino interactions with a final state muon candidate fully contained within the MicroBooNE detector. These data were collected in 2016 with the Fermilab Booster Neutrino Beam, which has an average neutrino energy of $800~\hbox {MeV}$ , using an exposure corresponding to $ 5.0\times 10^{19}$ protons-on-target. The analysis employs fully automatic event selection and charged particle track reconstruction and uses a data-driven technique to separate neutrino interactions from cosmic ray background events. We find that GENIE models consistently describe the shapes of a large number of kinematic distributions for fixed observed multiplicity.
Accounting for hydrological and microbial processes on greenhouse gas budgets from river systems (Final Report)
River systems have a disproportionately large impact on carbon and nitrogen cycling on this planet. For instance, despite their much smaller size in area, it is estimated that global carbon dioxide emission from river systems exceed the emission from lakes and reservoirs, and are on par with the estimated oceanic and land carbon sinks. Closing carbon and nitrogen budgets in river systems requires knowledge of end member greenhouse gas (GHG) products (e.g. carbon dioxide, nitrous oxide, methane), which typically have not been measured in river systems. Moreover, while the production of these gasses is thought to be microbially derived, little is known about microbial activities in sediments of large rivers, despite their potentially high influence on biogeochemical budgets. Typically, when we think of rivers we visualize the channels that carve through the earth, but this only represents a small part of the hydrologic exchange that a river participates in. Rivers are more than conduits; they are dynamically exchanging water and materials with surrounding terrestrial and subsurface environments. In fact, 96% of the carbon dioxide produced within river systems occurs in hyporheic zones, or sediment regions beneath and alongside a river where groundwater and river water mix. In fact, it is widely recognized that microbial processes in hyporheic zones, also known as the river’s liver, strongly influence the fate of carbon, nutrients, and contaminants transported through watersheds. Despite this general knowledge, observational studies linking nitrogen and carbon gas production to microbial activity, and studies of overall gas emissions, are limited across river systems, but especially absent from larger rivers. To identify microbial processes responsible for GHG emissions from large rivers, and to quantify their environmental drivers and dependencies, we selected the Columbia River as a representative field site. This is the largest river west of the North American Continental Divide, and produces a drainage and discharge roughly double of the Nile in Egypt. This river is also an important source for agricultural irrigation and generates more hydroelectric power than any other North American river. Dams manage the release of water in the river, with these changes in river discharge patterns strongly impacting microbial activities in hyporheic zones. Specifically, we target a region down-river from the Priest Rapids Dam (WA) associated with the PNNL SFA, where water discharge from the dam is highly controlled, resulting in 1.5 m fluctuations in river stage daily. This dynamic river stage creates an ideal research opportunity for investigating hydrological perturbations in GHG production, uptake, and emission from large river systems. In this exploratory 1-year project, we conducted data-driven field research to provide observations needed to support predictions about GHG flux from river ecosystems. Using porewater dialysis and surface flux measurements, we observed where and when GHGs were produced and is the emission impacted by river stage. Using meta-omics tools, we determined what microbial processes control production and consumption of GHG in these systems. Finally, we provided key observations to parameterize models that could predict the effect of environmental conditions on GHG emission in the Columbia River near shore environment, at the scale that the modeled processes operate. Closing knowledge gaps in the linkages between river stage, microbial processes, and GHG production and emission, as well as the spatial distribution and ecosystem dependencies of these processes, is necessary to better parameterize land surface models. We provide some of the first, detailed GHG measurements paired microbial activity from large river systems. Our findings have direct relevance to many other large rivers with flows altered by hydroelectric energy, reservoirs, snowmelt, tides, or agriculture.