Search NASASearch

SEARCH · Search NASA

Results for “framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Tailoring a 3D Covalent Organic Framework Toward Facile Functionalization

Three-dimensional covalent organic frameworks (3D COFs) are notably crystalline and stable, but their architectures and monomer structures make them difficult to functionalize. Here, a new strategy is presented to render COF-300 and other imine-linked frameworks amenable to facile functionalization in the last step of synthesis. By reducing the imine linkages to secondary amines and appending them with acetyl halide groups, the linkages are converted to electrophiles that can be readily reacted with nucleophilic guests. This route yields eight new COF-300 derivatives, bearing chloroacetyl, bromoacetyl, azide, cyano, amino, hydroxyl, methoxy, or thiomethyl groups appended to the inter-monomer linkages. The new materials are characterized through solid-state NMR, infrared spectroscopy, and powder X-ray diffraction, among other techniques, finding that the reported linkage transformations proceed to complete conversion while retaining the crystallinity of the materials. Microcrystal electron diffraction (microED) data are used to solve the evacuated structure of the amine-linked framework COF-300-AR for the first time, providing conclusive evidence of this framework's guest-induced phase change, along with the structure of the new framework COF-300-NH 2 . Finally, COF-300-NH 2 is shown to have significantly improved adsorption capacity for CO 2 and perfluoroalkyl substances (PFAS), highlighting the benefits of this synthetic strategy for the generation of customized adsorbents.

COF-300

A conceptual framework for residential energy security in the context of clean energy transitions

Energy security is a crucial aspect of human well-being. As climate change impacts become more evident, countries are constructing equitable, resilient, and sustainable clean energy transition policies to reduce emissions while ensuring energy security. Climate policies globally highlight the importance of national energy security. Furthermore, adequate and affordable access to household energy is also critical to the continued prioritization of climate mitigation. However, past energy security discussions within the broader climate research and policymaking community primarily focused on national-level energy supply as a critical metric of energy security. Less research has explored the potential implications of energy transitions for residential energy security, often focusing on a single dimension of residential energy security. Thus, we conduct a review of journal articles and governmental plans to develop a conceptual framework of residential energy security and facilitate communication among researchers and policymakers. The framework is designed around four foundational pillars, five metrics measuring residential energy security, and seven drivers influencing the metrics. Additionally, we provide policy examples to show how this framework can be applied to inform decision-making. Thus, this paper makes important contributions to the literature by (a) creating a framework to better understand the concept of energy security at the household level for future research and policy-relevant communications, (b) identifying gaps in the current literature, and (c) highlighting instances where aspects of residential energy security are discussed in policies and governmental plans, which help serve as guiding examples for future applications of our framework in the policymaking processes.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI

Protein Coatings Dictate the Dispersibility and Stability of Hydrophobic Zeolitic-Imidazolate Frameworks in Water

Metal–organic frameworks are promising materials for many biomedical technologies due to their ability to store and release large quantities of guest molecules in a predictable and tunable fashion. In biological fluids, proteins readily adsorb to the external surfaces of metal–organic framework particles through a combination of hydrophobic and electrostatic interactions. However, much remains to be understood about the nature of these protein coatings and how they influence the bulk properties of aqueous dispersions of metal–organic frameworks. Here, in this work, we show that a variety of proteins can be used to manipulate the properties of aqueous dispersions of zeolitic-imidazolate framework (ZIF) particles. Specifically, noncovalently associated protein coatings promote the formation of dispersions of hydrophobic ZIFs in water with high colloidal and hydrolytic stability, as long as the density of adsorbed proteins exceeds a critical, protein-dependent threshold. Further, these dispersions feature low viscosity and complete retention of gas carrying capacity. The wide range of properties accessible with protein coatings provides a highly modular approach to design hydrophobic metal–organic frameworks with properties tailored for specific biological applications.

adsorption

PvaPy streaming framework for real-time data processing

User facility upgrades, new measurement techniques, advances in data analysis algorithms as well as advances in detector capabilities result in an increasing amount of data collected at X-ray beamlines. Some of these data must be analyzed and reconstructed on demand to help execute experiments dynamically and modify them in real time. In turn, this requires a computing framework for real-time processing capable of moving data quickly from the detector to local or remote computing resources, processing data, and returning results to users. In this paper, we discuss the streaming framework built on top of PvaPy, a Python API for the EPICS pvAccess protocol. We describe the framework architecture and capabilities, and discuss scientific use cases and applications that benefit from streaming workflows implemented on top of this framework. We also illustrate the framework's performance in terms of achievable data-processing rates for various detector image sizes.

EPICS pvAccess

Inverse design of hypoeutectoid pearlite steel microstructures using a deep learning and genetic algorithm optimization framework

Goal-oriented microstructure design in metallic materials is a challenging task due to complex structure-property relationships. Traditional experimental and computational approaches are time-intensive and economically inefficient, limiting their applicability for large-scale design space exploration. Here, in this work, we propose an end-to-end framework that integrates deep learning models with genetic optimization to design microstructures with targeted mechanical properties. Deep learning models enable accurate forward design, while their integration with genetic optimization enables efficient inverse design within a few hours, compared to days or weeks using conventional finite element simulations. The framework combines experimental characterization and finite element modeling to analyze the influence of microstructural features on the mechanical behavior of hypoeutectoid steels. Data from both experiments and simulations are used to train the deep learning models. To demonstrate its effectiveness, we apply the framework to 0.63% carbon steel with proeutectoid ferrite and pearlite phases, commonly used in industrial applications. In this study, 2D microstructures were used for modeling, selected primarily for computational efficiency and to establish proof of concept. The framework successfully optimizes microstructures for targeted yield strength, ultimate strength, and stress concentration factors while significantly reducing computational time. Beyond hypoeutectoid steels, this scalable framework can be extended to other material systems and integrated with additive manufacturing, offering an efficient approach for accelerating microstructure design for specific engineering applications.

ConvLSTM

Enhanced MPM framework with multipatch isogeometric analysis for geotechnical applications

Achieving stable stress solutions at large strains using the Material Point Method (MPM) is challenging due to the accumulation of errors associated with geometry discretization, cell-crossing noise, and volumetric locking. Several simplified attempts exist in the literature to mitigate these errors, including higher-order frameworks. However, the stability of the MPM solution in such frameworks has been limited to simple geometries and the single-phase formulation (i.e., neglecting pore fluid). Although never explored, multipatch isogeometric analysis offers desirable qualities to simulate complex geometries while mitigating errors in the MPM. The degree of required high-order spatial integration has also never been investigated to infer a minimum limit for the stability of the stress solution in MPM. This paper presents a general-purpose numerical framework for simulating stable stresses in porous media, capturing both near incompressibility and multiphase interactions. First, the numerical framework is presented considering Non-Uniform Rational B-splines (NURBS) to perform isogeometric analysis (IGA) in MPM. Additionally, a volumetric strain smoothing algorithm is used to alleviate errors associated with volumetric locking. Second, the manifestation of cell-crossing errors is assessed via a series of problems with orders ranging from linear to cubic interpolation functions. Third, the use of NURBS is investigated and verified for problems with circular geometries. Finally, multipatch analysis is deployed to simulate plane strain and 3D penetration in soils, considering nearly incompressible elastoplastic (total stress) analysis and fully-coupled hydro-mechanical (effective stress) analysis. The stability of the solution is also analyzed for different constitutive models. From the results, it can be concluded that the framework using cubic interpolation functions with strain smoothing is the most convenient, presenting stable stress solutions for a broad range of multiphase geotechnical applications.

58 GEOSCIENCES

Framework to select robust energy retrofit measures for residential communities

Residential building energy retrofits are essential for enhancing environmental sustainability and reducing energy costs. The selection of retrofit measures is influenced by factors such as building systems, occupant behavior, government policy, weather variability, and climate change, all of which can significantly impact energy performance. Compared to retrofitting individual homes, evaluating and selecting optimal retrofit solutions for an entire community is challenging due to diverse residential compositions and variability present. Therefore, engineering robustness is crucial for ensuring consistent energy performance and resilience across different conditions. In this context, robustness refers to the ability of a retrofit measure to maintain its functionality and remain an optimal choice despite external disturbances or changes in inputs and conditions. This study presents a framework for evaluating the robustness of multiple retrofit measures across various building systems, occupant behaviors, and environmental scenarios at the community level. The framework comprises five key steps: scenario model development, integration of the National Residential Efficiency Measures database, energy performance simulation, cost-benefit aggregation, and retrofit solution selection. Each step enhances the framework’s robustness by incorporating the diversity of building characteristics, occupant behaviors, environmental conditions, retrofit options, and evaluation criteria. The framework’s effectiveness is demonstrated through a case study in southern Michigan in the United States, which includes 63 one-story single-family houses, 121 two-story single-family houses, and 8 townhouses. The study identifies furnace retrofits as the most robust solution for the entire community, consistently achieving source energy reductions of 4.7 %–8.0 % and payback period of 10–20 years across various scenarios. These findings are consistent with previous research, indicating the framework’s potential for broader applications in optimizing community-scale residential energy retrofits.

Shu, Lei

AI-Based Analytics and Energy Modeling Framework for Characterizing Urban Energy Systems

Developing location-specific district energy models is essential for understanding energy patterns and supporting efficient management and planning decisions. However, accurately characterizing these models remains challenging due to gaps in building characteristics and labor-intensive traditional modeling workflows. To address these challenges, we develop an AI-based framework that integrates top-down and bottom-up building energy data to automate urban energy model characterization. The framework trains multimodal deep learning models using heterogeneous ResStockTM datasets to infer missing building characteristics from varying levels of known information and generate simulation-ready inputs for district-scale energy modeling. It also employs a conditioning-based injection approach to generate ”what-if” scenarios, enabling users to explore retrofit, efficiency, and technology-upgrade pathways. Integrated within URBANoptTM, a bottom-up district energy modeling platform for simulating co-located buildings, the framework infers detailed building-level inputs required for bottom-up simulations. Both localized and generalized AI models are developed to learn relationships across categorical, numerical, and time-series data, enabling reconstruction of missing attributes and generation of targeted upgrade scenarios. We demonstrate this methodology on a residential neighborhood in Baltimore, MD, assessing internal consistency against ResStock reference data and URBANopt simulation, and comparing selected attributes against real-world building characteristics. Results show strong overall predictive accuracy in data completion and scenario generation, with localized and generalized models offering complementary trade-offs between precision and scalability. Overall, our automated framework streamlines energy modeling and provides a reliable framework for urban building energy characterization.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI

A unified large language model–based framework for heterogeneous PV image diagnosis

With advances in imaging technologies, modern photovoltaic (PV) systems generate large volumes of heterogeneous image data, including visible, electroluminescence (EL), and infrared (IR) images. Existing PV image analysis models, particularly deep learning approaches, are typically task-specific and lack cross-modality generalization. To address this limitation, this paper proposes an open-source large language model (LLM)–based unified framework for heterogeneous PV image diagnostics. Through task-aware diagnostic prompting, the framework enables analysis of visible, EL, and IR images within a single pipeline, supporting both zero-shot and few-shot inference and binary and multiclass classification. It is compatible with state-of-the-art multimodal LLMs, including ChatGPT, Gemini, Claude, Qwen, and CLIP. The framework is evaluated on PV module condition classification (clean, soiling, snow, hail, and bird droppings) using visible images, cell crack detection using EL images, and hotspot detection using IR images. GPT-5.1 in few-shot mode achieves the best performance, with classification accuracy exceeding 97.3%. Open-source models such as Qwen and CLIP also deliver competitive results on visible images (around 90% accuracy), though their performance is more limited on EL and IR modalities. On the full ELPV dataset, the framework achieves 83.5% zero-shot accuracy, within 2.8% of the supervised CNN baseline, confirming scalability to larger benchmarks. Practical aspects such as reproducibility, response latency, and confidence estimation are systematically analyzed. The framework operates across PV image modalities without modality- or task-specific training, making it well suited as a rapid pre-screening tool to support downstream detailed diagnostics. A benchmark dataset of diverse labeled PV images is also released.

Li, Baojie

A Pathway Analysis Framework for Evaluating the Economic and Environmental Viability of Biomass-Based Plastic Production

Plastic production from fossil feedstocks (e.g., naphtha, coal, and natural gas) is not sustainable and causes known environmental impacts such as global warming. A possible solution is to shift production pathways to use biomass, which is a sustainable feedstock that can sequester atmospheric carbon dioxide. This study presents an optimization-based pathway analysis framework for evaluating the carbon footprints of the production of mainstream plastics from biomass and fossil feedstocks. We use the modeling framework to quickly navigate complex interdependencies that exist between the production pathways of different plastics and to determine pathways of minimum production cost under a range of carbon pricing scenarios. The framework interprets carbon prices as an exogenous taxation scheme or an endogenous negative value perceived by producers. The proposed approach reveals the biomass feedstock quantities needed to displace fossil counterparts and the plastics and technologies that should be prioritized. The framework can also be used for evaluating system-wide trade-offs between production costs and carbon footprints that arise from pathway interdependencies. We also evaluate hidden environmental impacts associated with the large-scale use of biomass as a feedstock, such as land use and water eutrophication that results from a significant increase in fertilizer use. Therefore, it is important to highlight that there are trade-offs between decarbonization and other environmental issues. Here, the proposed framework provides an integrative platform for basic techno-economic and life-cycle data that can be used for analyzing diverse scenarios and determining necessary technology targets (e.g., yields, footprints, and costs) to achieve required levels of decarbonization.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH

Combining Theory and Experiment to Map the Atomic-Level Structure–Energy Pathways of Adsorbate-Mediated Phase Changes in a Cooperatively Flexible Metal–Organic Framework

An important subclass of metal–organic frameworks (MOFs) exhibits cooperative flexibility, wherein individual crystallites undergo global structural phase changes in response to external stimuli. Where cooperative flexibility results in reversible changes between crystalline states of distinct accessible porosity, these frameworks can exhibit rare yet desirable behaviors that cannot be explained by local dynamics alone. Yet, the chemical and structural origins of cooperative flexibility and how frameworks undergo these reversible phase changes at the atomic level remain poorly understood. Deliberate design for specific applications is therefore exceedingly difficult, and there is great impetus to develop a fundamental understanding of this phenomenon. Here, an effective and widely accessible computational approach is developed, which is designed to provide microscopic resolution via direct comparison to experimental data along the desorption-guided pathway. The strategy is applied to explain the desorption-induced phase change in an experimentally well-characterized framework, CdIF-13 (sod-Cd(benzimidazolate)2), where experiment alone was unable to resolve the atomistically detailed phase change landscape. Our findings reveal that the cooperative phase change pathways are adsorbate dependent with thermodynamics of intermediate structural states dictated by a nuanced interplay of ligand orientation, skeletal symmetry, and modes of surface adsorption. The results reveal that this isotropically flexible framework is “chaperoned” through a complex energy landscape by specific adsorbates, revealed by the reported computational approach with atomic-level insight and validated by experimentally determined structures. Thus, this work facilitates both understanding and future design of flexible materials for applications in gas storage, transport, delivery, and separation technologies.

03 NATURAL GAS

Generalized framework for likelihood-based field-level inference of growth rate from velocity and density fields

Measuring the growth rate of large-scale structures ( f ) as a function of redshift has the potential to break degeneracies between modified gravity and dark energy models, when combined with expansion-rate probes. Direct estimates of peculiar velocities of galaxies have attracted interest as a means of estimating fσ 8 . In particular, field-level methods can be used to fit the field nuisance parameter along with cosmological parameters simultaneously. This article aims to provide the community with a unified framework for the theoretical modeling of the likelihood-based field-level inference by performing fast field covariance calculations for velocity and density fields. Our purpose is to lay the foundations for a nonlinear extension of the likelihood-based method at the field level. We have developed a generalized framework, implemented in the dedicated software flip to perform a likelihood-based inference of fσ 8 . We derived a new field covariance model, which includes wide-angle corrections. We also included the models previously described in the literature inside our framework. We compared their performance against ours, and we validated our model by comparing it with the two-point statistics of a recent N-body simulation. The tests we performed have allowed us to validate our software and determine the appropriate wavenumber range to integrate our covariance model and its validity in terms of separation. Our framework allows for a wider wavenumber coverage to be used in our calculations than in previous works, which is particularly interesting for nonlinear model extensions. Finally, our generalized framework allows us to efficiently perform a survey geometry-dependent Fisher forecast of the fσ 8 parameter. We show that the Fisher forecast method we developed gives an error bar that is 30% closer to a full likelihood-based estimation than a standard volume Fisher forecast.

Ravoux, Corentin

Validation of an integrated modeling framework for investigating 3D plasma responses in tokamak plasmas

As contemporary experimental tokamaks are pushed toward reactor-relevant operation, they provide essential testbeds for demonstrating and exploring ELM control strategies for deployment in future fusion pilot plants. Accurate predictions of full plasma responses are essential to guide and optimize these demonstrations. This paper introduces and validates an integrated modeling framework over a historical range of DIII-D operational space. The integrated modeling framework uses only scalar plasma parameters and optional reference boundary to self-consistently and flexibly scan through tokamak operational space and estimate the corresponding ELM-suppression relevant plasma response over 3D coil phase space. The framework generates tightly converged equilibria that satisfy a target set of plasma parameters (I p , β N , l i ), with kinetic profiles constrained by an EPED(NN)-computed pedestal and empirical core model. The plasma response of these modeled equilibria is calculated with GPEC. Validated against 55 distinct DIII-D equilibria, the framework consistently reproduces experimentally constrained equilibrium pressure, q, and other representative profiles using the time-varying information from only evolving scalar plasma parameters; plasma response validation is performed for the n=3 perturbation. In particular, the plasma response of a DIII-D discharge scanning q 95 in search of ELM suppression windows is quantitatively reproduced. By accurately reproducing experimental equilibria and plasma responses across wide parameter variation, the framework supports potential for synthetic parameter scans in key operational, stability, and plasma response dimensions to investigate RMP ELM-suppression experiments and inform predictive RMP scenario optimization.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY

Framework for X-ray mirror surface shape fitting

For accurate characterization of grazing-incidence X-ray mirrors, we present a comprehensive framework to fit measured surface shapes (either slope or height) of X-ray mirrors used in synchrotron radiation and free-electron laser facilities. We summarize the closed-form expressions of some typical surface shapes of X-ray mirrors including elliptic cylinders, hyperbolic cylinders, ellipsoids, hyperboloids, and diaboloids. This framework is composed of four layers: definition of standard shapes with closed-form expressions, generation of theoretical surface with pose parameters (six degrees of freedom defining an object's position and orientation relative to a coordinate system), parameter optimization with the ability to select which parameters are fit and which are held constant, and the development of user-friendly fitting function wrappers for particular fitting tasks. A few practical fitting examples are demonstrated to verify the effectiveness of the proposed fitting framework. We discuss the physical meanings of the fitting parameters, and provide several examples using the elliptic cylinder and ellipsoid shapes to highlight some features of the framework. Moreover, we provide the presented framework as open-source codes (MATLAB and Python codes available at https://github.com/nsls2omf/xmf) to the community to encourage academic collaboration and further improvements.

36 MATERIALS SCIENCE

A Comprehensive Calibration Framework for the Northwest River Forecast Center

We present a comprehensive framework developed by the Northwest River Forecast Center for calibrating hydrologically diverse basins. The framework includes models for snow, soil moisture, routing, channel loss, and consumptive use. Data inputs include a wide range of open-access datasets for meteorology, land use, topography, and land cover. The framework uses conceptual hydrologic models to handle basins with various hydrologic regimes including rain-driven and snowmelt-dominated basins. We also develop a flexible automatic calibration system that can handle numerous unobservable model parameters in a computationally efficient manner. A single-basin automatic calibration run can typically be completed on a modern laptop in under 10 min. We found that model performance metrics for this new approach match the quality of the NWRFC's previous labor-intensive manual calibrations. The model performance also rivals that of a state-of-the-art deep learning model at a fraction of the computational cost. This framework presents a new standard for the quality of calibrations possible with lumped conceptual hydrologic models, combining careful data curation, an objective calibration framework, and expert local knowledge. In addition, we have made software packages available for the entire suite of National Weather Service River Forecast System models, including SAC-SMA, SNOW-17, and Lag-K. These modern interfaces are intended to increase accessibility and facilitate future research.

Forecasting

Life-Cycle Cost Analysis Framework for Water Efficiency Measures

Life-Cycle Cost Analysis Framework for Water Efficiency Measures: Guidance Designed for Federal Agencies (hereafter referred to as “this report”) provides a technical framework for federal agencies to conduct a life-cycle cost analysis (LCCA) for water efficiency projects in accordance with 42 U.S.C. § 8253. This report leverages insights from the 2023 report, PNNL-34006, Water and Wastewater Annual Price Escalation Rates for Selected Cities Across the United States: 2023 Edition (Unger et al. 2023). The primary objective of this report is to provide a framework to assist federal agencies with evaluating the full economic impact of water efficiency projects by assessing both initial investments and long-term operational benefits. An LCCA can provide a comprehensive view of all costs associated with a water efficiency project, including initial investment, ongoing operations and maintenance (O&M), and eventual disposal or replacement, ensuring the most cost-effective solution is selected. The LCCA methodology outlined in this report enables users to compare base case scenarios with potential alternatives using a standardized present value approach. It incorporates key cost components such as energy, water and wastewater, installation, O&M, and equipment replacement. Additionally, the framework introduces relevant evaluation metrics, such as the net savings and the savings-to-investment ratio, to ensure that water efficiency measures are economically justified over the lifespan of the project. To support practical application, this report also describes various water efficiency strategies that may be analyzed using an LCCA, including plumbing retrofits, irrigation upgrades, alternative water use, and cooling system improvements. By applying this framework, federal agencies can ensure compliance with regulatory mandates while maximizing the return on investment and contributing to resilient water management practices. The information provided in this report is aligned with the Federal Energy Management Program (FEMP) life-cycle cost (LCC) methodology, as conveyed in National Institute of Standards and Technology (NIST) Handbook 135 (Kneifel and Webb 2022). This report is intended to provide relatively high-level guidance, acting as a complement to, rather than a substitute for, that resource.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI

The Levelized Cost of Exergy Framework

Exergy is the amount of energy within a substance or within a transfer of energy that can be used to produce work or some other useful output when interacting with some reference environment. Two different energy systems that produce the same output with the same exergetic efficiency must necessarily have the same amount of exergy input, even if the amount of energy input to the two systems is vastly different. For example, a low-grade heat-driven desalination would require far more energy input than a reverse osmosis (RO) plant producing the same amount of water, but if their exergetic efficiencies were the same, they would require the same amount of exergy input. Thus, comparisons between different energy sources on the basis of energy is not always appropriate. Instead, a comparison on a per unit exergy basis provides more insight on the cost-effectiveness of different energy sources and systems. In this presentation, we describe a framework for analyzing the levelized cost of exergy (LCOEx) for both inputs and outputs of various energy systems. Our framework illustrates how the cost per unit exergy of a system's energy source, as well as the exergetic efficiency of the system, greatly affect the cost of the system output. We use the levelized cost of electricity as a benchmark value for LCOEx, due to electricity's ubiquity as an energy source, and because it is relatively inexpensive on a per unit exergy basis. The LCOEx of various heat sources are then compared to the LCOEx of electricity. Medium- and high-grade industrial heat (> 150 degrees C) produced by natural gas tends to have an LCOEx on par with electricity. This is due to the low cost of natural gas, as well as the high exergy content of heat at higher temperatures. Meanwhile, low-grade heat tends to be an expensive exergy source, owing to the low exergy content of the low-grade heat. We first apply our framework to desalination, where RO has come to dominate, due to the low LCOEx of the energy source (electricity) and relatively high exergetic efficiency of RO compared to thermal desalination systems. We then use this framework to highlight an opportunity for dehumidification systems to experience a similar cost improvement as desalination has. If an electrically-driven, high exergetic efficiency dehumidification system were developed (such as the membrane-based dehumidification systems proposed in literature), it would use a low cost exergy source with a high exergetic efficiency and could potentially lower the cost of dehumidification in the way that RO has done for desalination. Finally, we apply our framework to various fuels (natural gas, hydrogen, gasoline, etc.) and energy systems across different sectors (desalination, dehumidification, vehicles, etc.) to understand the variation in the cost of exergy input and exergetic efficiency of different systems and technologies.

29 ENERGY PLANNING, POLICY, AND ECONOMY

Expandable Log Analyzing Framework

Prior to my internship, I was informed that a previous intern had built a tool to analyse MongoDB logs and look for invalid access attempts, which served as a great reference point for my project. I was initially tasked with expanding on her prototype and filling in the gaps such as integrating it with the main monitoring tool the lab uses. Eventually, the scope grew, expanding to support other databases and a growing collection of tools. I organized the framework around an observer pattern, meaning one point in the program sending updates to the rest of the framework. Every time a log was read and parsed, it was sent to be processed by the tools, using the type of event as a means to determine which tools should get a chance to act on the log. This decouples the tools from the log reader, making future updates and additions much easier. The framework processes MongoDB logs at ~135,000 entries per second and PostgreSQL logs at ~170,500 entries per second, accurately detecting anomalies such as slow queries and connections from unknown addresses. This framework serves to fill gaps in database monitoring tools currently implemented at the lab, such as tracking failed authentication for PostgreSQL and MongoDB which had very minimal or none before this framework. National labs such as Fermilab hold sensitive data and valuable computing resources, making them attractive targets. Monitoring intrusion attempts on databases is made much easier by this comprehensive monitoring suite.

Clark, Dylan [Unlisted, IL]