SEARCH · Search NASA

Results for “real and complex analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38

All sources NASA NTRS DOE OSTI

DOE OSTI2025

New technology for an ancient fish: A lamprey life cycle modeling tool with an R Shiny application

Lampreys (Petromyzontiformes) are an ancient group of fishes with complex life histories. We created a life cycle model that includes an R Shiny interactive web application interface to simulate abundance by life stage. This will allow scientists and managers to connect available demographic information in a framework that can be applied to questions regarding lamprey biology and conservation. We used Pacific lamprey ( Entosphenus tridentatus ) as a case study to highlight the utility of this model. We applied a global sensitivity analysis to explore the importance of individual life stage parameters to overall population size, and to better understand the implications of existing gaps in knowledge. We also provided example analyses of selected management scenarios (dam passage, fish translocations, and hatchery additions) influencing Pacific lamprey in fresh water. These applications illustrate how the model can be applied to inform conservation efforts. This tool will provide new capabilities for users to explore their own questions about lamprey biology and conservation. Simulations can hone hypotheses and predictions, which can then be empirically tested in the real world.

Gomes, Dylan G. E. (ORCID:0000000226423728)↗

DOE OSTI2020

DEEP CELLULAR RECURRENT NEURAL ARCHITECTURE FOR EFFICIENT MULTIDIMENSIONAL TIME-SERIES DATA PROCESSING

Efficient processing of time series data is a fundamental yet challenging problem in pattern recognition. Though recent developments in machine learning and deep learning have enabled remarkable improvements in processing large scale datasets in many application domains, most are designed and regulated to handle inputs that are static in time. Many real-world data, such as in biomedical, surveillance and security, financial, manufacturing and engineering applications, are rarely static in time, and demand models able to recognize patterns in both space and time. Current machine learning (ML) and deep learning (DL) models adapted for time series processing tend to grow in complexity and size to accommodate the additional dimensionality of time. Specifically, the biologically inspired learning based models known as artificial neural networks that have shown extraordinary success in pattern recognition, tend to grow prohibitively large and cumbersome in the presence of large scale multi-dimensional time series biomedical data such as EEG. Consequently, this work aims to develop representative ML and DL models for robust and efficient large scale time series processing. First, we design a novel ML pipeline with efficient feature engineering to process a large scale multi-channel scalp EEG dataset for automated detection of epileptic seizures. With the use of a sophisticated yet computationally efficient time-frequency analysis technique known as harmonic wavelet packet transform and an efficient self-similarity computation based on fractal dimension, we achieve state-of-the-art performance for automated seizure detection in EEG data. Subsequently, we investigate the development of a novel efficient deep recurrent learning model for large scale time series processing. For this, we first study the functionality and training of a biologically inspired neural network architecture known as cellular simultaneous recurrent neural network (CSRN). We obtain a generalization of this network for multiple topological image processing tasks and investigate the learning efficacy of the complex cellular architecture using several state-of-the?art training methods. Finally, we develop a novel deep cellular recurrent neural network (CDRNN) architecture based on the biologically inspired distributed processing used in CSRN for processing time series data. The proposed DCRNN leverages the cellular recurrent architecture to promote extensive weight sharing and efficient, individualized, synchronous processing of multi-source time series data. Experiments on a large scale multi-channel scalp EEG, and a machine fault detection dataset show that the proposed DCRNN offers state-of-the-art recognition performance while using substantially fewer trainable recurrent units.

Vidyaratne, Lasitha S.↗

NASA NTRS1990

Improving stability and strength characteristics of framed structures with nonlinear behavior

In this paper an optimal design procedure is introduced to improve the overall performance of nonlinear framed structures. The design methodology presented here is a multiple-objective optimization procedure whose objective functions involve the buckling eigenvalues and eigenvectors of the structure. A constant volume with bounds on the design variables is used in conjunction with an optimality criterion approach. The method provides a general tool for solving complex design problems and generally leads to structures with better limit strength and stability. Many algorithms have been developed to improve the limit strength of structures. In most applications geometrically linear analysis is employed with the consequence that overall strength of the design is overestimated. Directly optimizing the limit load of the structure would require a full nonlinear analysis at each iteration which would be prohibitively expensive. The objective of this paper is to develop an algorithm that can improve the limit-load of geometrically nonlinear framed structures while avoiding the nonlinear analysis. One of the novelties of the new design methodology is its ability to efficiently model and design structures under multiple loading conditions. These loading conditions can be different factored loads or any kind of loads that can be applied to the structure simultaneously or independently. Attention is focused on optimal design of space framed structures. Three-dimensional design problems are more complicated to carry out, but they yield insight into real behavior of the structure and can help avoiding some of the problems that might appear in planar design procedure such as the need for out-of-plane buckling constraint. Although researchers in the field of structural engineering generally agree that optimum design of three-dimension building frames especially in the seismic regions would be beneficial, methods have been slow to emerge. Most of the research in this area has dealt with the optimization of truss and plane frame structures.

Pezeshk, Shahram↗

NASA NTRSDate not supplied

Evaluation of Planetary Boundary Layer Structure from NASA Global Modeling and Assimilation Office’s Next Retrospective Analysis Product MERRA-21C

The Planetary Boundary Layer (PBL) is a complex interface between Earth’s surface and the atmosphere with high spatiotemporal variability in its characteristics, and accurate simulation and observation of the PBL has proven to be a challenge. In this study, we evaluate PBL structures from NASA Global Modeling and Assimilation Office (GMAO)’s next retrospective analysis product: the Goddard Earth Observing System Retrospective Analysis of the early 21st Century (GEOS-R21C), with 25-km horizontal resolution. The GEOS-R21C incorporates a wide range of observing systems and various improvements over previous GMAO reanalysis. We compare the PBL thermodynamic structure as well as PBL Height (PBLH) from GEOS-R21C with various PBL observations. For PBLH, definitions are different depending on each observing system. PBLHs derived from radiosonde observations and Global Navigation Satellite System Radio Occultation (GNSS RO) are based on bulk Richardson number and refractivity gradient, respectively. The results of the evaluation of PBL structure from GMAO’s next retrospective analysis product will be presented. In addition, comparison between near-real-time (NRT) commercial and NASA commercial GNSS RO PBLH will also be discussed.

Eun-Gyeong Yang↗

DOE OSTI2024

U.S. Department of Energy Collegiate Wind Competition 2025: Rules - Phases 2 and 3

The U.S. Department of Energy (DOE) Wind Energy Technologies Office's (WETO) Collegiate Wind Competition (CWC, also referred to as the "competition" in this rules document) invites interdisciplinary teams of undergraduate students from a variety of academic programs to solve complex wind energy challenges. Through the competition, WETO intends to offer students direct industry experience, valuable exposure to wind energy career pathways, and greater knowledge of wind energy's potential to contribute to a clean energy future. The competition will select up to 35 teams to start, making them eligible to compete for a cash prize pool of up to $280,000. Each year, the competition identifies a new challenge and set of activities that address real-world research questions, thus demonstrating skills that students will need to work in the wind or wider renewable energy industries. The Collegiate Wind Competition 2025 challenge requires participants to compete simultaneously in four contests: 1) Turbine Design Contest: Design, build, and present a unique, wind-driven power system. 2) Turbine Testing Contest: Test the wind turbine in a competition wind tunnel at the final event. 3) Project Development Contest: Research wind resource data, transmission infrastructure, and environmental factors to create a site plan and financial analysis for a hypothetical wind farm. 4) Connection Creation Contest: Partner with wind industry professionals, raise awareness of wind energy in your local community, and work with local media to promote your team's accomplishments. The competition does not prescribe a power system market or wind regime. It is expected that each team will participate in all four contests.

Collegiate Wind Competition↗

DOE OSTI2026

Spherical tokamak physics research in preparation for the operation of NSTX-U

The National Spherical Torus Experiment Upgrade (NSTX-U) is preparing to resume operation, representing a crucial step toward realizing compact, cost-effective fusion pilot plants. In advance of this, extensive modeling and data analysis have been conducted to advance the physics basis for low-aspect-ratio, high-performance plasma regimes, focusing on three core objectives: confinement and stability, power and particle handling, and steady-state operation. Significant progress has been made in understanding the electron temperature flattening in high-β plasmas, which is shown to be driven by a complex interplay of magnetohydrodynamic instabilities (e.g. non-resonant infernal modes), fast-ion-driven Alfvén eigenmodes, and electron and ion-scale micro-instabilities, particularly Kinetic Ballooning Modes (KBMs), whose destabilization is strongly dependent on parallel magnetic field fluctuations (δB ∥ ). Furthermore, a new gyrokinetic critical pedestal model was developed, accurately predicting pedestal structure by identifying KBMs as the primary stability limit, offering a critical constraint for future high-confinement scenarios. To address the challenge of high heat flux, novel liquid lithium plasma-facing components were modeled. The analysis confirmed that lithium vapor shielding is a self-regulating mechanism for heat mitigation, while also emphasizing that strong main ion parallel flow is essential to minimize core lithium contamination. Finally, progress toward steady-state operation was anchored by developing the required physics basis and control tools. This includes predictive modeling for reversed magnetic shear sustainment, demonstrating that magnetic island-induced bootstrap current reduction is negligible in STs, and advancing real-time control and disruption avoidance capabilities. The development of high-speed surrogate models (e.g. MMMNet) provides computationally efficient tools vital for non-inductive scenario optimization and integrated, low-disruptivity operations planned for NSTX-U.

NSTX-U↗

DOE OSTI2022

Computational Estimation by Scientific Data Mining with Classical Methods to Automate Learning Strategies of Scientists

Experimental results are often plotted as 2-dimensional graphical plots (aka graphs) in scientific domains depicting dependent versus independent variables to aid visual analysis of processes. Repeatedly performing laboratory experiments consumes significant time and resources, motivating the need for computational estimation. The goals are to estimate the graph obtained in an experiment given its input conditions, and to estimate the conditions that would lead to a desired graph. Existing estimation approaches often do not meet accuracy and efficiency needs of targeted applications. We develop a computational estimation approach called AutoDomainMine that integrates clustering and classification over complex scientific data in a framework so as to automate classical learning methods of scientists. Knowledge discovered thereby from a database of existing experiments serves as the basis for estimation. Challenges include preserving domain semantics in clustering, finding matching strategies in classification, striking a good balance between elaboration and conciseness while displaying estimation results based on needs of targeted users, and deriving objective measures to capture subjective user interests. These and other challenges are addressed in this work. The AutoDomainMine approach is used to build a computational estimation system, rigorously evaluated with real data in Materials Science. Our evaluation confirms that AutoDomainMine provides desired accuracy and efficiency in computational estimation. It is extendable to other science and engineering domains as proved by adaptation of its sub-processes within fields such as Bioinformatics and Nanotechnology.

Computer Science↗

NASA NTRS2010

Serious Games that Improve Performance

Serious games can help people function more effectively in complex settings, facilitate their role as team members, and provide insight into their team's mission. In such games, coordination and cooperation among team members are foundational to the mission's success and provide a preview of what individuals and the team as a whole could choose to do in a real scenario. Serious games often model events requiring life-or-death choices, such as civilian rescue during chemical warfare. How the players communicate and what actions they take can determine the number of lives lost or saved. However, merely playing a game is not enough to realize its most practical value, which is in learning what actions and communication methods are closest to what the mission requires. Teams often play serious games in isolation, so when the game is complete, an analytical stage is needed to extract the strategies used and examine each strategy's success relative to the others chosen. Recognizing the importance of this next stage, Noblis has been developing Game Analysis, software that parses individual game play into meaningful units and generates a strategic analysis. Trainers create a custom game-specific grammar that reflects the objects and range of actions allowable in a particular game, which Game Analysis then uses to parse the data and generate a practical analysis. Trainers have then enough information to represent strategies in tools, such as Gantt and heat map charts. First-responder trainees in North Carolina have already partnered Hot-Zone and Game Analysis with great success.

McGowan, Clement, III↗

NASA NTRS2003

Biological Visualization, Imaging and Simulation(Bio-VIS) at NASA Ames Research Center: Developing New Software and Technology for Astronaut Training and Biology Research in Space

The Bio- Visualization, Imaging and Simulation (BioVIS) Technology Center at NASA's Ames Research Center is dedicated to developing and applying advanced visualization, computation and simulation technologies to support NASA Space Life Sciences research and the objectives of the Fundamental Biology Program. Research ranges from high resolution 3D cell imaging and structure analysis, virtual environment simulation of fine sensory-motor tasks, computational neuroscience and biophysics to biomedical/clinical applications. Computer simulation research focuses on the development of advanced computational tools for astronaut training and education. Virtual Reality (VR) and Virtual Environment (VE) simulation systems have become important training tools in many fields from flight simulation to, more recently, surgical simulation. The type and quality of training provided by these computer-based tools ranges widely, but the value of real-time VE computer simulation as a method of preparing individuals for real-world tasks is well established. Astronauts routinely use VE systems for various training tasks, including Space Shuttle landings, robot arm manipulations and extravehicular activities (space walks). Currently, there are no VE systems to train astronauts for basic and applied research experiments which are an important part of many missions. The Virtual Glovebox (VGX) is a prototype VE system for real-time physically-based simulation of the Life Sciences Glovebox where astronauts will perform many complex tasks supporting research experiments aboard the International Space Station. The VGX consists of a physical display system utilizing duel LCD projectors and circular polarization to produce a desktop-sized 3D virtual workspace. Physically-based modeling tools (Arachi Inc.) provide real-time collision detection, rigid body dynamics, physical properties and force-based controls for objects. The human-computer interface consists of two magnetic tracking devices (Ascention Inc.) attached to instrumented gloves (Immersion Inc.) which co-locate the user's hands with hand/forearm representations in the virtual workspace. Force-feedback is possible in a work volume defined by a Phantom Desktop device (SensAble inc.). Graphics are written in OpenGL. The system runs on a 2.2 GHz Pentium 4 PC. The prototype VGX provides astronauts and support personnel with a real-time physically-based VE system to simulate basic research tasks both on Earth and in the microgravity of Space. The immersive virtual environment of the VGX also makes it a useful tool for virtual engineering applications including CAD development, procedure design and simulation of human-system systems in a desktop-sized work volume.

Smith, Jeffrey↗

DOE OSTI2020

Steering Molecular Dynamics Simulations of Membrane-Associated Proteins with Neutron Reflection Results

Herein, we present a novel method to incorporate structural results from surface-sensitive scattering, such as X-ray or neutron reflectometry, into molecular dynamics simulations. While reflectometry techniques generally provide a means to determine the molecular-scale structures of organized interfacial films, they were recently shown to offer the capability to characterize the structures of protein-membrane complexes supported by a solid substrate. One-dimensional information inherent in the experimental results is used in the form of component volume occupancy (CVO) profiles, which describe the distribution of molecular components within an interfacial architecture, to construct real-space constraints in the form of a biasing potential for the simulation that vanishes when the simulated and experimental profiles agree. This approach improves the correspondence between simulation and experiment, as shown in the re-evaluation of an neutron-reflection-derived structure which was approximated by an independent molecular dynamics simulation in earlier work, and it also leads to faster equilibration of ensemble structures. We further show that time averaging the CVO profile that develops in the simulation while biasing with this approach permits fluctuations about the average that are necessary for conformational exploration of the system. This method is particularly valuable for studies of proteins at interfaces that contain disordered regions since the conformation of such regions is difficult to judge from the analysis of one-dimensional experimental profiles and may take prohibitively long to equilibrate in simulations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2025

Driving Economics and Reducing Risks: The Business Case for Security-by-Design in Nuclear Power

This report provides an analysis of the financial, operational, and strategic advantages of incorporating Security-by-Design (SeBD) early in the lifecycle of nuclear power plant projects. By framing security as a foundational design element rather than a late-stage add-on, owners, vendors, and operators can reduce budget overruns, strengthen regulatory compliance, and increase revenue opportunities. The report details key lifecycle phases, highlighting the strategic imperative for organizations (including project developers, investors, vendors, and regulators) to adopt SeBD. Drawing on industry estimates, real-world case studies, and comparative cost analyses, the findings underscore that even a modest upfront investment in SeBD can yield substantial long-term returns by preventing costly retrofit activities, minimizing regulatory delays, and positioning nuclear vendors for the ability to adapt in the evolving security market. By avoiding excessive retrofit expenses and positioning security as a built-in feature rather than an afterthought, nuclear projects can protect their financial performance, enhance public trust, and secure a competitive edge in an increasingly complex global energy market. The authors advocate for SeBD’s strategic implementation, supported by established quality management methodologies, thereby promoting continuous improvement and defect avoidance. Ultimately, early SeBD integration represents a strategic investment, yielding significant returns by preventing costly retrofits and positioning nuclear projects for enhanced competitiveness and public trust.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

NASA NTRS1994

Multivariate Statistical Analysis Software Technologies for Astrophysical Research Involving Large Data Bases

We developed a package to process and analyze the data from the digital version of the Second Palomar Sky Survey. This system, called SKICAT, incorporates the latest in machine learning and expert systems software technology, in order to classify the detected objects objectively and uniformly, and facilitate handling of the enormous data sets from digital sky surveys and other sources. The system provides a powerful, integrated environment for the manipulation and scientific investigation of catalogs from virtually any source. It serves three principal functions: image catalog construction, catalog management, and catalog analysis. Through use of the GID3* Decision Tree artificial induction software, SKICAT automates the process of classifying objects within CCD and digitized plate images. To exploit these catalogs, the system also provides tools to merge them into a large, complex database which may be easily queried and modified when new data or better methods of calibrating or classifying become available. The most innovative feature of SKICAT is the facility it provides to experiment with and apply the latest in machine learning technology to the tasks of catalog construction and analysis. SKICAT provides a unique environment for implementing these tools for any number of future scientific purposes. Initial scientific verification and performance tests have been made using galaxy counts and measurements of galaxy clustering from small subsets of the survey data, and a search for very high redshift quasars. All of the tests were successful and produced new and interesting scientific results. Attachments to this report give detailed accounts of the technical aspects of the SKICAT system, and of some of the scientific results achieved to date. We also developed a user-friendly package for multivariate statistical analysis of small and moderate-size data sets, called STATPROG. The package was tested extensively on a number of real scientific applications and has produced real, published results.

Djorgovski, S. G.↗

DOE OSTI2025

End-to-End Automated Segmentation Framework for Four-Dimensional Scanning Transmission Electron Microscopy Data

Four-dimensional scanning transmission electron microscopy (4D-STEM) is powerful for rapidly characterizing arrays of nanoparticles produced via high-throughput synthesis. However, such 4D-STEM datasets typically contain thousands of nanoparticles, each characterized by thousands of diffraction patterns spatially distributed across the nanoparticle, necessitating efficient and comprehensive analysis. We propose an end-to-end segmentation framework to automatically segment each nanoparticle into regions with distinct composition/orientation of crystal grains, using only the 4D-STEM data. Bragg disk information is extracted in a physics-informed manner from the diffraction patterns at each spatial location and combined with the real space coordinates to form feature vectors. These feature vectors are then used as inputs to a Gaussian mixture model (GMM) to segment the nanoparticle into distinct regions. We also develop two visualization tools based on the GMM outputs to infer the interface transition and the degree of superposition. Our framework comprehensively integrates machine learning tools and physics knowledge, and provides a basis for substantially compressing enormous 4D-STEM datasets, e.g., by replacing the full 4D-STEM dataset for each nanoparticle with only a single set of Bragg disk features for each distinct crystal grain identified in the nanoparticle. In this article, we demonstrate the power of our framework by presenting results for real, complex datasets.

47 OTHER INSTRUMENTATION↗

DOE OSTI2021

Neutron Radiography and Computed Tomography of Biological Systems at the Oak Ridge National Laboratory's High Flux Isotope Reactor

Neutrons have historically been used for a broad range of biological applications employing techniques such as small-angle neutron scattering, neutron spin echo, diffraction, and inelastic scattering. Unlike neutron scattering techniques that obtain information in reciprocal space, attenuation-based neutron imaging measures a signal in real space that is resolved on the order of tens of micrometers. The principle of neutron imaging follows the Beer-Lambert law and is based on the measurement of the bulk neutron attenuation through a sample. Greater attenuation is exhibited by some light elements (most notably, hydrogen), which are major components of biological samples. Contrast agents such as deuterium, gadolinium, or lithium compounds can be used to enhance contrast in a similar fashion as it is done in medical imaging, including techniques such as optical imaging, magnetic resonance imaging, X-ray, and positron emission tomography. For biological systems, neutron radiography and computed tomography have increasingly been used to investigate the complexity of the underground plant root network, its interaction with soils, and the dynamics of water flux in situ. Moreover, efforts to understand contrast details in animal samples, such as soft tissues and bones, have been explored. This manuscript focuses on the advances in neutron bioimaging such as sample preparation, instrumentation, data acquisition strategy, and data analysis using the High Flux Isotope Reactor CG-1D neutron imaging beamline. The aforementioned capabilities will be illustrated using a selection of examples in plant physiology (herbaceous plant/root/soil system) and biomedical applications (rat femur and mouse lung).

Bilheux, Hassina↗

DOE OSTI2024

U.S. Department of Energy Collegiate Wind Competition 2025 Rules - Phase 1

The U.S. Department of Energy (DOE) Wind Energy Technologies Office's (WETO) Collegiate Wind Competition (CWC, also referred to as the "Competition" in this rules document) invites interdisciplinary teams of undergraduate students from a variety of academic programs to solve complex wind energy challenges. Through the competition, WETO intends to offer students direct industry experience, valuable exposure to wind energy career pathways, and greater knowledge of wind energy's potential to contribute to a clean energy future. The competition will select up to 35 teams to start, making them eligible to compete for a cash prize pool of up to $280,000 . Each year, the competition identifies a new challenge and set of activities that address real-world research questions, thus demonstrating skills that students will need to work in the wind or wider renewable energy industries. The Collegiate Wind Competition 2025 challenge requires participants to compete simultaneously in four contests: 1) Turbine Prototype Contest: Design, build, and present a unique, wind-driven power system based on market research; 2) Turbine Testing Contest: Test the wind turbine in a competition wind tunnel at the final event; 3) Project Development Contest: Research wind resource data, transmission infrastructure, and environmental factors to create a site plan and financial analysis for a hypothetical wind farm; and Connection Creation Contest: Partner with wind industry professionals, raise awareness of wind energy in your local community, and work with local media to promote your team's accomplishments. The competition does not prescribe a power system market or wind regime. It is expected that each team will participate in all four contests.

collegiate wind competition↗

DOE OSTI2021

A Short-Term Solar Forecasting Platform Using a Physics-Based Smart Persistence Model and Data Imputation Method

Electrical energy plays vital role in our socio-economic activity and therefore ensuring the reliability of the electric grid, from the generation, transmission and distribution level is critical. In order to maintain the power system parameter viz., frequency, voltage, etc., optimally, balancing of generation and consumption is very much essential. However, solar energy is infirm power by nature this is due to cloud cover / other local phenomena. Hence, Photovoltaic (PV) power generation brings a significant challenge to the grid operator due to the variability of the solar energy. The complexity of this challenge in terms of planning and dispatch ability of PV resources, aggravates with the high penetration of solar energy into the electric grid. In this setting, reliable solar radiation forecasting models based on accurate and quality input data become essential. In order to develop a suitable model for predicting solar radiation, quality historical / real time measurement is also needed. Under this study NIWE and NREL jointly developed / tested short-term solar forecasting frameworks using a smart persistence and physics-based smart persistence models for intra-hour forecasting of solar radiation (PSPI) and benchmarked 9 different data imputation techniques in 15 Solar Radiation Resource Assessment (SRRA) stations, located at different parts of India. During any measurement campaign, due to various technical reasons, we may miss few observations. However, the missing observation often reduce the performance of any forecasting model. Therefore, suitable data imputation method would assist us to obtain continuous observation of solar radiation. A station-by-station and method-by-method analysis was carried out to understand the performance of each model. Based on our analysis, among all the data imputation methods, the Kalman data imputation method is better for Indian Weather condition. In addition, Kalman StructTS, Linear, Stine and Arima methods yield slightly inferior accuracy compared to Kalman, but outperform the other methods. The extended solar radiation data are used by solar forecasting models to provide the prediction of solar radiation at 15 SRRA stations. As far as short term forecasting model is concerned, the PSPI model outperforms the Smart Persistence model. However, the forecast error is increases with the forecasting horizon.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2024

Retrieval Augmented Generation for Robust Cyber Defense

In cybersecurity, the ability to efficiently analyze and respond to vulnerabilities, weaknesses, attack patterns, and threat tactics is critical for effective defense strategies. With the increasing complexity and volume of cybersecurity data, traditional methods of querying and retrieving information are often inadequate. To address this challenge, we implemented Retrieval-Augmented Generation (RAG) systems—CyRAG and GraphCyRAG—that integrate large language models (LLMs) with both structured data from relational databases and knowledge graphs such as Neo4j. CyRAG is designed to handle structured data, focusing on CVE (Common Vulnerabilities and Exposures) and CWE (Common Weakness Enumeration) entities to generate accurate and context-rich responses. In contrast, GraphCyRAG leverages Neo4j knowledge graphs to retrieve interconnected information from CVE, CWE, CAPEC (Common Attack Pattern Enumeration and Classification), and ATT&CK (Adversarial Tactics, Techniques, and Common Knowledge) datasets. By utilizing Neo4j’s graph-based framework, GraphCyRAG enables deeper traversal of relationships between vulnerabilities and attack patterns, providing cybersecurity analysts with more comprehensive insights into potential attack vectors and mitigation strategies. Our preliminary results demonstrate that integrating knowledge graphs with RAG significantly enhances both the accuracy and depth of threat analysis, allowing for the retrieval of dynamic, real-time data and the generation of contextually aware responses. This approach helps analysts uncover hidden relationships between cyber entities, predict exploit paths, and prioritize mitigation efforts effectively. The integration of RAG with cybersecurity knowledge graphs represents a significant advancement in cybersecurity threat intelligence, enabling more informed decision-making and stronger defense strategies.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Comparative Assessment of U-Net-Based Deep Learning Models for Segmenting Microfractures and Pore Spaces in Digital Rocks

Segmentation of high-resolution X-ray microcomputed tomography (µCT) images is crucial in digital rock physics (DRP), affecting the characterization and analysis of microscale phenomena in the porous media. The complexity of geological structures and nonideal scanning conditions pose significant challenges to conventional image segmentation approaches. Motivated by the recent increasing popularity of deep learning (DL) techniques in image processing, this work undertakes a comparative study of DL models, specifically U-Net and its variants, for segmenting multiple targets with distinguished features in digital rocks, including discrete fracture networks (DFNs), pore spaces, and solid rock. Particularly, DFNs have a smaller volumetric fraction over others, bringing in a substantial challenge of imbalanced segmentation. The primary focus is to evaluate the architecture and feature enhancement strategies of various DL models, including U-Net, attention U-Net, residual U-Net, U-Net++, and residual U-Net++. The models were designed as 2.5D, utilizing a central 2D image and its two adjacent upper and lower 2D images as input to provide a pseudo-3D context. In addition, because the ground truth of segmentation was unknown for real-world digital rocks, we created a benchmark data set following the inverse operations of segmentation. The data synthesis started from the label images (i.e., solid rock, pore spaces, and DFNs), followed by simulating partial volume blurring, adding random background noise, and introducing ring artifacts to mimic real raw X-ray µCT images. The data set, which included various rock types (i.e., sandstone and artificial data), scanning resolution, and magnitudes of noise and artifacts, was divided into training and testing data sets with a 90% and 10% ratio, respectively. Moreover, in addition to the conventional pixel-wise evaluation metrics, the physics-based metric of the lattice-Boltzmann method (LBM) simulated permeability provided more comprehensive assessments. The results demonstrated that the residual connections, nested architectures, and redesigned skip connections contribute to the model performance and give the residual U-Net++ the highest accuracy. The improvements were mainly on the boundaries and small targets, especially the DFNs, which dominate the interconnectivity and therefore affect the permeability greatly. This study also rigorously evaluated the efficiency and generalization of each model, demonstrating that the sophisticated architectures achieved excellent practicability and maintained robust performance on completely unseen data, ensuring their suitability for diverse and challenging DRP applications.

58 GEOSCIENCES↗