SEARCH · Search NASA

Results for “frameworks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

All sources NASA NTRS DOE OSTI

DOE OSTI2026

Validation of an integrated modeling framework for investigating 3D plasma responses in tokamak plasmas

As contemporary experimental tokamaks are pushed toward reactor-relevant operation, they provide essential testbeds for demonstrating and exploring ELM control strategies for deployment in future fusion pilot plants. Accurate predictions of full plasma responses are essential to guide and optimize these demonstrations. This paper introduces and validates an integrated modeling framework over a historical range of DIII-D operational space. The integrated modeling framework uses only scalar plasma parameters and optional reference boundary to self-consistently and flexibly scan through tokamak operational space and estimate the corresponding ELM-suppression relevant plasma response over 3D coil phase space. The framework generates tightly converged equilibria that satisfy a target set of plasma parameters (I p , β N , l i ), with kinetic profiles constrained by an EPED(NN)-computed pedestal and empirical core model. The plasma response of these modeled equilibria is calculated with GPEC. Validated against 55 distinct DIII-D equilibria, the framework consistently reproduces experimentally constrained equilibrium pressure, q, and other representative profiles using the time-varying information from only evolving scalar plasma parameters; plasma response validation is performed for the n=3 perturbation. In particular, the plasma response of a DIII-D discharge scanning q 95 in search of ELM suppression windows is quantitatively reproduced. By accurately reproducing experimental equilibria and plasma responses across wide parameter variation, the framework supports potential for synthetic parameter scans in key operational, stability, and plasma response dimensions to investigate RMP ELM-suppression experiments and inform predictive RMP scenario optimization.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2026

Framework for X-ray mirror surface shape fitting

For accurate characterization of grazing-incidence X-ray mirrors, we present a comprehensive framework to fit measured surface shapes (either slope or height) of X-ray mirrors used in synchrotron radiation and free-electron laser facilities. We summarize the closed-form expressions of some typical surface shapes of X-ray mirrors including elliptic cylinders, hyperbolic cylinders, ellipsoids, hyperboloids, and diaboloids. This framework is composed of four layers: definition of standard shapes with closed-form expressions, generation of theoretical surface with pose parameters (six degrees of freedom defining an object's position and orientation relative to a coordinate system), parameter optimization with the ability to select which parameters are fit and which are held constant, and the development of user-friendly fitting function wrappers for particular fitting tasks. A few practical fitting examples are demonstrated to verify the effectiveness of the proposed fitting framework. We discuss the physical meanings of the fitting parameters, and provide several examples using the elliptic cylinder and ellipsoid shapes to highlight some features of the framework. Moreover, we provide the presented framework as open-source codes (MATLAB and Python codes available at https://github.com/nsls2omf/xmf) to the community to encourage academic collaboration and further improvements.

36 MATERIALS SCIENCE↗

DOE OSTI2022

Emulation Framework for Distributed Large-Scale Systems Integration

Recent trends in systems engineering include integration of very large-scale systems, which entails significant challenges when they are geographically dispersed. In these scenarios, intelligent integration of distributed large-scale systems requires significant coordination among hardware elements as well as all software components. The approach of integrated systems (both computing platform and experimental equipment) for end-to-end orchestration is called federation. Virtual frameworks can aid in the testing, assessment, and implementation of a functional system of interconnected resources. We present an emulation framework that replicates the software environments of multi-site federations of computing systems and instruments. Our emulation framework allows systems engineers to reduce developmentcost and avoid disruptions to production infrastructure. Our framework was effectively used to develop and test software modules for various tasks including container orchestration and instrument access. For performance assessment, however, the emulated framework is severely limited in providing accurate network and IO measurements at 10 Gbps and higher data rates. The data transfer performance profiles estimated using these emulated measurements are usually inaccurate for high bandwidth and high latency connections, since emulation does not accurately reflect the critical network transport dynamics.We utilize measurements from a physical testbed with hardware network emulators to obtain data transfer profiles that closely match the expected profiles for the emulated federations. We show the effectiveness of our approach by an illustrative example of integrated (federated) multi-site ultra large-scale systems that are connected via high speed wide area networks.

Imam, Neena↗

DOE OSTI2023

A Predictive Prescription Framework for Stochastic Unit Commitment Using Boosting Ensemble Learning Algorithms

To take unit commitment (UC) decisions under uncertain load, most existing stochastic optimization (SO) frameworks adopt a generic representation of uncertainty. While load levels that materialize on a particular day are influenced by various covariates (such as the day of the week or temperature), SO frameworks typically disregard such side observations, wasting actionable information that could significantly enhance decision quality. Here, this article proposes a contextual SO (CSO) framework for UC under uncertain load, which can effectively exploit covariate observations in conjunction with a class of machine learning (ML) algorithms to improve the out-of-sample performance of UC decisions. It shows how three ML algorithms, adaptive boosting, gradient boosted trees, and extreme gradient boosting, can be used to this end, constituting the first application of these algorithms in any CSO framework. Using real-world data harvested from the New York ISO grid, we measure the out-of-sample performance of the framework in terms of total operation cost, shed load values, locational marginal prices, and total payments by the loads, against several benchmark methods proposed in the literature. The article has an online companion (Yurdakul et al.), wherein we present additional results and lay out further mathematical formulations used in this work.

42 ENGINEERING↗

DOE OSTI2026

A Comprehensive Calibration Framework for the Northwest River Forecast Center

We present a comprehensive framework developed by the Northwest River Forecast Center for calibrating hydrologically diverse basins. The framework includes models for snow, soil moisture, routing, channel loss, and consumptive use. Data inputs include a wide range of open-access datasets for meteorology, land use, topography, and land cover. The framework uses conceptual hydrologic models to handle basins with various hydrologic regimes including rain-driven and snowmelt-dominated basins. We also develop a flexible automatic calibration system that can handle numerous unobservable model parameters in a computationally efficient manner. A single-basin automatic calibration run can typically be completed on a modern laptop in under 10 min. We found that model performance metrics for this new approach match the quality of the NWRFC's previous labor-intensive manual calibrations. The model performance also rivals that of a state-of-the-art deep learning model at a fraction of the computational cost. This framework presents a new standard for the quality of calibrations possible with lumped conceptual hydrologic models, combining careful data curation, an objective calibration framework, and expert local knowledge. In addition, we have made software packages available for the entire suite of National Weather Service River Forecast System models, including SAC-SMA, SNOW-17, and Lag-K. These modern interfaces are intended to increase accessibility and facilitate future research.

Forecasting↗

DOE OSTI2020

From pools to flow: The PROMISE framework for new insights on soil carbon cycling in a changing world

Soils represent the largest terrestrial reservoir of organic carbon, and the balance between soil organic carbon (SOC) formation and loss will drive powerful carbon-climate feedbacks over the coming century. To date, efforts to predict SOC dynamics have rested on pool-based models, which assume classes of SOC with internally homogenous physicochemical properties. However, emerging evidence suggests that soil carbon turnover is not dominantly controlled by the chemistry of carbon inputs, but rather by restrictions on microbial access to organic matter in the spatially heterogeneous soil environment. The dynamic processes that control the physicochemical protection of carbon translate poorly to pool-based SOC models; as a result, we are challenged to mechanistically predict how environmental change will impact movement of carbon between soils and the atmosphere. In this study, we propose a novel conceptual framework to explore controls on belowground carbon cycling: Probabilistic Representation of Organic Matter Interactions within the Soil Environment (PROMISE). In contrast to traditional model frameworks, PROMISE does not attempt to define carbon pools united by common thermodynamic or functional attributes. Rather, the PROMISE concept considers how SOC cycling rates are governed by the stochastic processes that influence the proximity between microbial decomposers and organic matter, with emphasis on their physical location in the soil matrix. We illustrate the applications of this framework with a new biogeochemical simulation model that traces the fate of individual carbon atoms as they interact with their environment, undergoing biochemical transformations and moving through the soil pore space. We also discuss how the PROMISE framework reshapes dialogue around issues related to SOC management in a changing world. We intend the PROMISE framework to spur the development of new hypotheses, analytical tools, and model structures across disciplines that will illuminate mechanistic controls on the flow of carbon between plant, soil, and atmospheric pools.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

A Framework for Optimal Placement of Rooftop Photovoltaic: Maximizing Solar Production and Operational Cost Savings in Residential Communities

Optimizing the placement of photovoltaic (PV) panels on residential buildings has the potential to significantly increase energy efficiency benefits to both homeowners and communities. Strategic PV placement can lower electricity costs by reducing the electricity fed from the grid during on-peak hours, while maintaining PV panel efficiency in terms of the amount of solar radiation received. In this article, we present a framework that identifies the ideal location of PV panels on residential rooftops. Our framework combines energy and environmental simulation, parametric modeling, and optimization to inform PV placement as it relates to and affects the entire community (in terms of both energy use and financial cost), as well as individual buildings. Ensuring that our framework accounts for shading from nearby buildings, different utility rate structures, and different buildings’ energy demand profiles means that existing communities and future housing developments can be optimized for energy savings and PV efficiency. The framework comprises two workflows, each contributing to optimal PV placement with a unique target: (a) maximizing PV panel efficiency (i.e., solar generation) and (b) minimizing operational energy cost considering utility rate structures for operational energy. We apply our framework to a residential community in Fort Collins, Colorado, to demonstrate the optimal PV placement, considering the two workflow targets. Here, we present our results and illustrate the effect of PV location and orientation on solar energy production efficiency and operational energy cost.

14 SOLAR ENERGY↗

DOE OSTI2024

Three-dimensional nanoscale metal, metal oxide, and semiconductor frameworks through DNA-programmable assembly and templating

Controlling the three-dimensional (3D) nanoarchitecture of inorganic materials is imperative for enabling their novel mechanical, optical, and electronic properties. Here, by exploiting DNA-programmable assembly, we establish a general approach for realizing designed 3D ordered inorganic frameworks. Through inorganic templating of DNA frameworks by liquid- and vapor-phase infiltrations, we demonstrate successful nanofabrication of diverse classes of inorganic frameworks from metal, metal oxide and semiconductor materials, as well as their combinations, including zinc, aluminum, copper, molybdenum, tungsten, indium, tin, and platinum, and composites such as aluminum-doped zinc oxide, indium tin oxide, and platinum/aluminum-doped zinc oxide. The open 3D frameworks have features on the order of nanometers with architecture prescribed by the DNA frames and self-assembled lattice. Structural and spectroscopic studies reveal the composition and organization of diverse inorganic frameworks, as well as the optoelectronic properties of selected materials. The work paves the road toward establishing a 3D nanoscale lithography.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

DOE OSTI2023

Mixed-Precision S/DGEMM Using the TF32 and TF64 Frameworks on Low-Precision AI Tensor Cores

Using NVIDIA graphics processing units (GPUs) equipped with Tensor Cores has enabled the significant acceleration of general matrix multiplication (GEMM) for applications in machine learning (ML) and artificial intelligence (AI) and in high-performance computing (HPC) generally. The use of such power-efficient, specialized accelerators can provide a performance increase between 8 × and 20 ×, albeit with a loss in precision. However, a high level of precision is required in many large scientific and HPC applications, and computing in single or double precision is still necessary for many of these applications to maintain accuracy. Fortunately, mixed-precision methods can be employed to maintain a higher level of numerical precision while also taking advantage of the performance increases from computing with lower-precision AI cores. With this in mind, we extend the state of the art by using NVIDIA’s new TF32 framework. This new framework not only burdens some constraints of the previous frameworks, such as costly 32 16-bit castings but also provides an equivalent precision and performance by using a much simpler approach. We also propose a new framework called TF64 that attempts double-precision arithmetic with low-precision Tensor Cores. Although this framework does not exist yet, we validated the correctness of this idea and achieved an equivalent of 64-bit precision on 32-bit hardware.

Valero Lara, Pedro↗

DOE OSTI2023

ARES v1.x - Performance Portable Tool to Simulate Supernovae based on Parthenon Framework

Historically, codes for simulating supernovae (such as Arepo, FLASH or LEAFS) have been at the forefront of scientific high-performance computing to the immense computational resources required for full 3D simulations. However, given the shift towards heterogenous HPC architectures, many current-generation codes are at the risk of losing their competitiveness as they are only designed to run on homogeneous CPU-only systems. There exist several efforts to enable these codes for GPU’s, however, these efforts only consider specific architectures or vendors (e.g., implement only CUDA or HIP), limiting themselves to a small range of exascale computing systems. Frameworks such as Kokkos aim to provide a framework which is agnostic of the targeted architecture, enabling the development of performant and portable code. In the Ares code, we develop a performance portable tool to simulate supernovae based on the Parthenon Framework, which in turn uses Kokkos in the background. Here, the Parthenon Framework provides an interface to the underlying mesh-refinement routines, which form the backbone of our code. In addition, we incorporate the already existing Singularity-EOS toolkit to provide us with various equations of state, primarily the Helmholtz equation of state. We also include the JINA Reaclib as a basis for our nuclear network solver. Finally, we implement a gravity solver to complete the required physics. This setup will provide us with a minimal code base to simulate supernova in a similar style to the tried-and-tested Arepo code, but in a futureproof performance portable framework.

Lim, Hyun↗

DOE OSTI2021

Modeling Framework for Bulk Electric Grid Impacts from HEMP E1 and E3 Effects (Tasks 3.1 Final Report)

This report presents a framework to evaluate the impact of a high-altitude electromagnetic pulse (HEMP) event on a bulk electric power grid. This report limits itself to modeling the impact of EMP E1 and E3 components. The co-simulation of E1 and E3 is presented in detail, and the focus of the paper is on the framework rather than actual results. This approach is highly conservative as E1 and E3 are not maximized with the same event characteristics and may only slightly overlap. The actual results shown in this report are based on a synthetic grid with synthetic data and a limited exemplary EMP model. The framework presented can be leveraged and used to analyze the impact of other threat scenarios, both manmade and natural disasters. This report d escribes a Monte-Carlo based methodology to probabilistically quantify the transient response of the power grid to a HEMP event. The approach uses multiple fundamental steps to characterize the system response to HEMP events, focused on the E1 and E3 components of the event. 1) Obtain component failure data related to HEMP events testing of components and creating component failure models. Use the component failure model to create component failure conditional probability density function (PDF) that is a function of the HEMP induced terminal voltage. 2) Model HEMP scenarios and calculate the E1 coupled voltage profiles seen by all system components. Model the same HEMP scenarios and calculate the transformer reactive power consumption profiles due to E3. 3) Sample each component failure PDF to determine which grid components will fail, due to the E1 voltage spike, for each scenario. 4) Perform dynamic simulations that incorporate the predicted component failures from E1 and reactive power consumption at each transformer affected by E3. These simulations allow for secondary transients to affect the relays/protection remaining in service which can lead to cascading outages. 5) Identify the locations and amount of load lost for each scenario through grid dynamic simulation. This can be an indication of the immediate grid impacts from a HEMP event. In addition, perform more detailed analysis to determine critical nodes and system trends. 6) To help realize the longer-term impacts, a security constrained alternating current optimal power flow (ACOPF) is run to maximize critical load served. This report describes a modeling framework to assess the systemic grid impacts due to a HEMP event. This stochastic simulation framework generates a large amount of data for each Monte Carlo replication, including HEMP location and characteristics, relay and component failures, E3 GIC profiles, cascading dynamics including voltage and frequency over time, and final system state. This data can then be analyzed to identify trends, e.g., unique system behavior modes or critical components whose failure is more likely to cause serious systemic effects. The proposed analysis process is demonstrated on a representative system. In order to draw realistic conclusions of the impact of a HEMP event on the grid, a significant amount of work remains with respect to modeling the impact on various grid components.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2023

Framework for Characterizing the Performance of High-Early Strength, High-Volume Fly Ash (HVFA) Concrete Structures

This presentation will highlight the development of a comprehensive framework to characterize the performance of high-volume fly ash (HVFA) concretes at early ages and discuss the resulting implications for concrete structures built using such materials. Achieving high-early compressive and/or flexural strength is often of particular importance for precast and/or prestressed concrete components – due to early age loading demands resulting from lifting, handling, or application of initial prestress – or other types of concrete structures that can significantly benefit from rapid strength development - such as for bridge deck repairs. The framework first includes a methodology for optimizing the strength of HVFA cementitious binders before subsequently scaling up the technology to evaluation of fresh and hardened HVFA concrete performance. A series of trial mix designs will be presented to demonstrate the effectiveness of the framework to achieve not only the desired high-early strength targets but also satisfactory workability, often in the form of self-consolidating concrete. Mechanical performance was evaluated at several age-dependent milestones and, in conjunction with estimating concrete strength using the maturity method, was ultimately used to facilitate the development of novel strength development history curves. By way of these datasets, concrete mechanical properties were utilized in the design of prototype structural components, such as beams and wall panels, for subjection to larger-scale experimental testing. Implications for other pertinent HVFA concrete performance attributes, such as shrinkage or creep, will also be discussed. The framework also includes a comprehensive methodology for evaluating the environmental life-cycle performance of HVFA concrete structures focused on mitigating any unwarranted environmental consequences resulting from beneficial HVFA reuse in concrete. Strategies for more widespread implementation of HVFA concrete materials into construction practice will also be presented. Lastly, the role of the HVFA concrete framework towards the development of new provisions for building codes and/or design standards, and recommendations for future research needs will also be discussed.

01 COAL, LIGNITE, AND PEAT↗

DOE OSTI2024

Achieving Cyber-Resilience for Power Systems using a Learning, Model-Assisted Blockchain Framework

The secure integration and management of distributed energy resources (DER) and power aggregators in the electric grid requires secure communications and a physics-aware Command and Control (C2) strategy. A Blockchain (BC)-based overlay network was developed to provide a security layer for the existing power grid network that mitigates risks in current and legacy network and C2 protocols. By integrating a Model-Assisted Machine Learning (MAML) framework with a Secure Blockchain Overlay Network (SBON) a defense-in-depth strategy was achieved. In our approach, the MAML framework leveraged a smart contract framework to gather network data and learn the dynamics of DER to develop detection strategies for attacks targeting sensors and actuators used by DER. The MAML framework learned dynamical systems models for individual DERs to detect sensor attacks. For DER we utilized a Digital Twin (DT) to accelerate the learning process for a model resistant to stealthy attacks. The project created DT for PV inverters and BESS. The DTs were coupled with a model-assisted, data-driven learning of DER behavior. Specifically, we evaluated architectures for model-based learning with model-free fine-tuning. Additionally, differential privacy techniques were used to obfuscate data, while still allowing the computation of attack detection results based on obfuscated data. The SBON developed leverages a private permissioned blockchain network orchestrated with the Hyperledger Fabric framework. To connect the cyber world, which orchestrates the blockchain fabric, and the physical world where the power network resides, we developed a system implementation to enable the secure interaction of the physical world and the abstracted blockchain.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Marine Energy Technology Development Risk Management Framework

Over the past decades, the global marine energy industry has suffered a number of serious technological and commercial setbacks. To help reduce the risks of industry failures and advance the development of new technologies, the U.S. Department of Energy (DOE) and the National Renewable Energy Laboratory (NREL) developed a Marine Energy Risk Management Framework in 2015, with this revision published in 2024. This risk management framework shall be utilized on all DOE Water Power Technologies Office (WPTO) projects that require system testing in the open water. By addressing uncertainties, the Marine Energy Risk Management Framework increases the likelihood of successful development of marine energy converter technology. It covers projects of any technology readiness level technology performance level (TPL) and all risk types (e.g. technological risk, regulatory risk, commercial risk) over the development cycle. This risk framework is not a substitute for other risk management procedures that may be required for marine operations, such as installations at sea, hoisting and rigging, safe diver operations, and other safety requirements. This risk framework is intended to meet DOE's risk management expectations for marine energy technology research and development efforts from WPTO. It also provides an overview of other relevant risk management tools and documentation.

16 TIDAL AND WAVE POWER↗

DOE OSTI2025

Life-Cycle Cost Analysis Framework for Water Efficiency Measures

Life-Cycle Cost Analysis Framework for Water Efficiency Measures: Guidance Designed for Federal Agencies (hereafter referred to as “this report”) provides a technical framework for federal agencies to conduct a life-cycle cost analysis (LCCA) for water efficiency projects in accordance with 42 U.S.C. § 8253. This report leverages insights from the 2023 report, PNNL-34006, Water and Wastewater Annual Price Escalation Rates for Selected Cities Across the United States: 2023 Edition (Unger et al. 2023). The primary objective of this report is to provide a framework to assist federal agencies with evaluating the full economic impact of water efficiency projects by assessing both initial investments and long-term operational benefits. An LCCA can provide a comprehensive view of all costs associated with a water efficiency project, including initial investment, ongoing operations and maintenance (O&M), and eventual disposal or replacement, ensuring the most cost-effective solution is selected. The LCCA methodology outlined in this report enables users to compare base case scenarios with potential alternatives using a standardized present value approach. It incorporates key cost components such as energy, water and wastewater, installation, O&M, and equipment replacement. Additionally, the framework introduces relevant evaluation metrics, such as the net savings and the savings-to-investment ratio, to ensure that water efficiency measures are economically justified over the lifespan of the project. To support practical application, this report also describes various water efficiency strategies that may be analyzed using an LCCA, including plumbing retrofits, irrigation upgrades, alternative water use, and cooling system improvements. By applying this framework, federal agencies can ensure compliance with regulatory mandates while maximizing the return on investment and contributing to resilient water management practices. The information provided in this report is aligned with the Federal Energy Management Program (FEMP) life-cycle cost (LCC) methodology, as conveyed in National Institute of Standards and Technology (NIST) Handbook 135 (Kneifel and Webb 2022). This report is intended to provide relatively high-level guidance, acting as a complement to, rather than a substitute for, that resource.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2026

The Levelized Cost of Exergy Framework

Exergy is the amount of energy within a substance or within a transfer of energy that can be used to produce work or some other useful output when interacting with some reference environment. Two different energy systems that produce the same output with the same exergetic efficiency must necessarily have the same amount of exergy input, even if the amount of energy input to the two systems is vastly different. For example, a low-grade heat-driven desalination would require far more energy input than a reverse osmosis (RO) plant producing the same amount of water, but if their exergetic efficiencies were the same, they would require the same amount of exergy input. Thus, comparisons between different energy sources on the basis of energy is not always appropriate. Instead, a comparison on a per unit exergy basis provides more insight on the cost-effectiveness of different energy sources and systems. In this presentation, we describe a framework for analyzing the levelized cost of exergy (LCOEx) for both inputs and outputs of various energy systems. Our framework illustrates how the cost per unit exergy of a system's energy source, as well as the exergetic efficiency of the system, greatly affect the cost of the system output. We use the levelized cost of electricity as a benchmark value for LCOEx, due to electricity's ubiquity as an energy source, and because it is relatively inexpensive on a per unit exergy basis. The LCOEx of various heat sources are then compared to the LCOEx of electricity. Medium- and high-grade industrial heat (> 150 degrees C) produced by natural gas tends to have an LCOEx on par with electricity. This is due to the low cost of natural gas, as well as the high exergy content of heat at higher temperatures. Meanwhile, low-grade heat tends to be an expensive exergy source, owing to the low exergy content of the low-grade heat. We first apply our framework to desalination, where RO has come to dominate, due to the low LCOEx of the energy source (electricity) and relatively high exergetic efficiency of RO compared to thermal desalination systems. We then use this framework to highlight an opportunity for dehumidification systems to experience a similar cost improvement as desalination has. If an electrically-driven, high exergetic efficiency dehumidification system were developed (such as the membrane-based dehumidification systems proposed in literature), it would use a low cost exergy source with a high exergetic efficiency and could potentially lower the cost of dehumidification in the way that RO has done for desalination. Finally, we apply our framework to various fuels (natural gas, hydrogen, gasoline, etc.) and energy systems across different sectors (desalination, dehumidification, vehicles, etc.) to understand the variation in the cost of exergy input and exergetic efficiency of different systems and technologies.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2026

Expandable Log Analyzing Framework

Prior to my internship, I was informed that a previous intern had built a tool to analyse MongoDB logs and look for invalid access attempts, which served as a great reference point for my project. I was initially tasked with expanding on her prototype and filling in the gaps such as integrating it with the main monitoring tool the lab uses. Eventually, the scope grew, expanding to support other databases and a growing collection of tools. I organized the framework around an observer pattern, meaning one point in the program sending updates to the rest of the framework. Every time a log was read and parsed, it was sent to be processed by the tools, using the type of event as a means to determine which tools should get a chance to act on the log. This decouples the tools from the log reader, making future updates and additions much easier. The framework processes MongoDB logs at ~135,000 entries per second and PostgreSQL logs at ~170,500 entries per second, accurately detecting anomalies such as slow queries and connections from unknown addresses. This framework serves to fill gaps in database monitoring tools currently implemented at the lab, such as tracking failed authentication for PostgreSQL and MongoDB which had very minimal or none before this framework. National labs such as Fermilab hold sensitive data and valuable computing resources, making them attractive targets. Monitoring intrusion attempts on databases is made much easier by this comprehensive monitoring suite.

Clark, Dylan [Unlisted, IL]↗

DOE OSTI2026

Expandable Log Analyzing Framework

Clark, Dylan [Unlisted, IL]↗