Search NASA⌕ Search

SEARCH · Search NASA

Results for “Level set method”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,135 records · Page 63

Hydrogen Activation by Silica Supported Metal Ion Catalysts: Catalytic Properties of Metals and Performance of DFT Functionals

Single-site heterogeneous catalysts (SSHC) have received increasing attention due to their well-defined active sites and potentially high specific activity. Detailed computational studies were carried out on a set of potential SSHC’s, i.e., silica-supported metal ions, to investigate the reactivity of these catalysts with H2 as well as to evaluate the performance of density functional theory (DFT) methods in conjunction with triple-ζ quality basis sets (i.e., cc-pVTZ) on reaction energetics. The ions considered include 4d and 5d metals as well as several post-transition metal ions. A representative cluster model of silica is used to calculate reaction free energies of the metal hydride formation that results from the heterolytic cleavage of H2 on the M–O bond. The hydride formation free energy is previously shown to be strongly correlated with the catalytic activity of such catalysts for alkene hydrogenation. ONIOM calculations (CCSD(T)//MP2) are used to assess the accuracy and reliability of the MP2 results and it is found that MP2 is a suitable level of theory for gauging the performance of DFT functionals. The performance of various DFT functionals is assessed relative to MP2 results and it is found that the wB97xd and PBE0 functionals have the lowest standard deviation (STD) value while the MN12SX and PBE functionals have the lowest mean absolute deviation (MAD) values. The B3LYP functional is shown to have similar MAD and STD values as the top performing functionals. Potential active SSHC’s for exergonic hydrogen activation predicted in this study include mostly late and post transition metal ions, i.e., Au3+, Pd2+, Pt4+, Pd4+, Ir4+, Hg2+, Rh3+, Pb4+, Tl3+, In3+, Ir3+, Os4+, Cd2+, Ru2+, and Ga3+. This study provides important guidance to future computational studies of such catalyst systems.

Plascencia, Cesar↗

Automated Detection and Characterization of Surface Restructuring Events in Bimetallic Catalysts

Surface restructuring in bimetallic systems has recently been shown to play a crucial role in heterogeneous catalysis. In particular, the segregation in binary alloys can be reversed in the presence of strongly bound adsorbates. Mechanistic characterization of such restructuring phenomena at the atomic level remains scarce and challenging because of the large configurational space that must be explored. To this end, we propose an automated method to discover elementary surface restructuring processes in an unbiased fashion using Pd/Ag as an example. Here, we employ high-temperature classical molecular dynamics to rapidly detect restructuring events, isolate them, and optimize using density functional theory. In addition to confirming the known exchange descent mechanism, our systematic approach has revealed three new predominant classes of events at step edges of close-packed surfaces that have not been considered before: (1) vacancy insertion; (2) direct exchange; and (3) interlayer exchange. The discovered events enable us to construct the complete set of mechanistic pathways by which Pd is incorporated into the Ag host in vacuum at the single-atom limit. Finally, these atomistic insights provide a step toward systematic understanding and engineering of surface segregation dynamics in bimetallic catalysts.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Mass generation in an Abelian gauge theory with multiple scalar fields and no tree-level dimensionful couplings

We study the Abelian Higgs model with multiple scalar fields, but without mass terms. Solving the model nonperturbatively order-by-order in the number of scalar fields, we find that radiative corrections generate masses for the scalar and gauge boson, without spontaneous symmetry breaking. The mass scales are set by the Λ -parameter of the electroweak running coupling, thereby naturally avoiding the hierarchy problem. No part of our calculation employs a weak-coupling expansion, and we find that the perturbative vacuum is metastable, and hence must decay to the stable nonperturbative vacuum of the theory, which we identify. Although the field content of our Lagrangian is standard, our results predict the existence of two heavy scalar resonances in addition to the Higgs. We believe that these predicted resonances will ultimately allow experimentalists to discriminate between our method and standard solutions of the Higgs model. Published by the American Physical Society 2024

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Coherency-Constrained Spectral Clustering for Power Network Reduction

This paper presents a methodology for reducing the complexity of large-scale power network models using spectral clustering, aggregation of electrical components, and cost function approximation. Two approaches are explored using unconstrained and constrained spectral clustering to determine areas for effective system reduction. Once the system areas are determined, both loads and generators by type are aggregated, and their new cost function is approximated through polynomial curve-fitting or statistical methods. The performance of reduced networks is evaluated in terms of their ability to follow the true daily cost of the original system over a 24-hour period considering a set of several days. Two test systems are taken as test beds. Application of the methodology to a modified version of the IEEE 39-bus system reduces it from 17 generators to a 4-bus system and 9 generators with about 93% of accuracy. Similarly, the IEEE 118-bus system is reduced from 19 generators to a 3-bus system with three aggregated units achieving over 99% of accuracy. These findings address scalability challenges and enhance accuracy for high and mid-loading level conditions, and by aggregating thermal units with similar cost functions.

42 ENGINEERING↗

Single-Site Metal Organic Complexes on Oxide Supports for Selective Alkane Functionalization

High levels of reaction selectivity for heterogeneous catalysis are generally difficult to achieve with traditional metal nanoparticle catalysts, due to the variety of metal binding sites available. In this project, we have developed a metal-ligand coordination strategy to form transition metal single-sites on high surface area supports as heterogeneous single-site catalysts. Metal centers can be atomically dispersed in the binding pockets of organic ligands on oxide supports. The systems have to be carefully designed so that tendencies for metal cluster formation or binding to surface defect sites are overcome by the attractive coordination environment provided by the organic ligand. This was confirmed by a comprehensive set of characterization methods, including XAS, XPS, XRD, TEM, and CO adsorption. Design and tuning of metal-support and support-ligand interactions were crucial for high structural uniformity. We demonstrate that supported metal-ligand SSCs are effective, recyclable catalysts for alkene hydrosilylation reactions. Compared with commercial homogeneous catalysts, they exhibit improved yield and selectivity, less metal aggregation and side reactions, and stronger tolerance with functionalized substrates. These results give some preliminary indication that coordination with organic ligands can improve activity and selectivity in metal/oxide heterogeneous catalysts.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Underwater Noise Measurements around a Tidal Turbine in a Busy Port Setting

Acoustic emissions from current energy converters remain an environmental concern for regulators because of their potential effects on marine life and uncertainties about their effects stemming from a lack of sufficient observational data. Several recent opportunities to characterize tidal turbine sound emissions have begun to fill knowledge gaps and provide a context for future device deployments. In July 2021, a commercial-off-the-shelf hydrophone was deployed in a free-drifting configuration to measure underwater acoustic emissions and characterize a 25 kW-rated tidal turbine at the University of New Hampshire’s Living Bridge Project in Portsmouth, New Hampshire. Sampling methods and analysis were performed in alignment with the recently published IEC 62600-40 Technical Specification for acoustic characterization of marine energy converters. Results from this study indicate acoustic emissions from the turbine were below ambient sound levels and therefore did not have a significant impact on the underwater noise levels of the project site. As a component of Pacific Northwest National Laboratory’s Triton Field Trials (TFiT) described in this Special Issue, this effort provides a valuable use case for the IEC 62600-40 Technical Specification framework and further recommendations for cost-effective technologies and methods for measuring underwater noise at future current energy converter project sites.

tidal turbine↗

Development of a Trip Energy Estimation Model Using Real-World Global Positioning System Driving Data: Preprint

A data-driven technique for estimation of energy requirements for a proposed vehicle trip has been developed. Based on over 700,000 miles of driving data, the technique has been applied to generate a model that estimates trip energy requirements. The model uses a novel binning approach to categorize driving by road type, traffic conditions, and driving profile. The trip-level energy estimations can easily be aggregated to any higher-level transportation system network desired. The model has been tested and validated on the Austin, Texas, data set used to build this model. Ground-truth energy consumption for the data set was obtained from Future Automotive Systems Technology Simulator (FASTSim) vehicle simulation results. The energy estimation model has demonstrated 12.1 percent normalized total absolute error. The energy estimation from the model can be used to inform control strategies in routing tools, such as change in departure time, alternate routing, and alternate destinations, to reduce energy consumption. The model can also be used to determine more accurate energy consumption of regional or national transportation networks if trip origin and destinations are known. Additionally, this method allows the estimation tool to be tuned to a specific driver or vehicle type.

33 ADVANCED PROPULSION SYSTEMS↗

Unbalanced Nested Random Effects Estimation of Variance Components

To investigate the contributing factors of variance in the measurement of an iodine 127 (127I) sample, we implement a nested random effects analysis of variance (ANOVA). Historically, the reported uncertainty on a measurement of 127I has been obtained by methods of forward uncertainty propagation because there is typically only one replicate of a given sample for which to estimate the uncertainty. When samples are processed there are several types of quality control (QC) standards analyzed along-side the unknown samples with two to five replicates for each. Assuming the variance observed in these replicate QC standards is representative of that of the unknown samples, we use these data in a nested random effects ANOVA to estimate the total uncertainty of a measurement. We demonstrate this approach with two sets of measurements from Idaho National Laboratory and compare the results with the forward uncertainty propagation approach. Variance component estimates for the coarsest level of the nesting structure were most imprecise because replicates were most limited at these levels. We find that the results largely agree between forward propagation and ANOVA, and the greatest contributors of variance are due to instrument variation and chemical processing, with human processing being among the smallest contributors. This analysis provides reassurance that the reported uncertainties using forward propagation are reasonable and the process is well controlled. We propose a future designed experiment to increase replicates at the coarsest level of the hierarchy to improve estimates of these variance components.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Scalable line and plane relaxation in a parallel structured multigrid solver

The efficient solution of sparse, linear systems that arise through the discretization of partial differential equations remains a key challenge for a range of high performance scientific simulations. One approach for reducing data movement and improving performance is by exposing and exploiting structure in a problem through the use of robust structured multilevel solvers. By choosing coarsening that preserves the structure of the problem, these methods maintain efficient structured computation and communication throughout the multigrid hierarchy. However, when coarsening is not permitted to be dependent on the operator, anisotropy must be addressed by the smoother — producing error compatible for coarse-grid correction with structured coarsening. Here, the components required in a scalable parallel structured solver are described with a focus on memory and communication efficiency of robust smoothers. While the implementation of communication and memory reduction techniques in smoothers integrated in a complete 3D solver present a significant engineering challenge, a novel approach is proposed that addresses these challenges systematically through a change to the solver’s execution model. Enabled by user-level threading paired with a set of data and communication abstractions, this approach permits seamless aggregation of communication in plane smoothers — directly reusing code for a 2D distributed multilevel cycle. Results show an effective reduction in communication costs for coarse-grid problems, and result in a speedup of 8.7x in smoothing routines shown in Fig. 12 using this approach. This produces a significant improvement to strong scalability while maintaining favorable weak scaling behavior. Finally, a parallel scaling study using a series of refined meshes is included that demonstrates the effectiveness of this approach in an application of interest.

97 MATHEMATICS AND COMPUTING↗

A Technology Roadmap for Advanced Geothermal Well Construction

Recent analysis has shown that by 2050, geothermal energy can supply up to 90 GW of power to the U.S. electrical grid. Reducing the lifecycle cost of geothermal wells is critical to achieving this level of adoption. While time-related costs of drilling remain an important issue, there is also a need to focus on the costs associated with casing and cementing of geothermal wells. This report provides a roadmap of R&D activities needed to reduce the life cycle cost of casing and cementing while improving life-of-well performance. The purpose of the roadmap is to develop priorities for R&D in the areas of (1) high-performance and cost-effective materials for target geothermal well conditions, (2) well construction methods and techniques to reduce construction costs, and (3) methods and techniques to decrease to decrease long-term operating costs. The roadmap sets targets for the next 10-year period and purposely excludes R&D efforts into improved rock reduction. The roadmap was developed by a joint working group of experts from Oak Ridge National Laboratory, Brookhaven National Laboratory, and Sandia National Laboratories as well as 35 experts from industry and academia. Input from a series of information gathering sessions was used to inform and guide the development of the roadmap.

15 GEOTHERMAL ENERGY↗

A Load Switching Group based Feeder-level Microgrid Energy Management Algorithm for Service Restoration in Power Distribution System

This paper presents a load switching group based energy management system (LSG-EMS) for operating microgrids on a distribution feeder powered by one or multiple grid-forming distributed energy resources. Loads on a distribution feeder are divided into load switching groups that can be remotely switched on and off. The LSG-EMS algorithm, formulated as a mixed-integer linear programming (MILP) problem, has an objective function of maximizing the served loads while minimizing the total number of switching actions. A new set of topology constraints are developed for allowing multiple microgrids to be formed on the feeder and selecting the optimal supply path. Customer comfort is accounted for by maximizing the supply duration in the customer preferred service period and enforcing a minimum service duration. The proposed method is demonstrated on a modified IEEE 33-bus system using actual customer data. Simulation results show that the LSG-EMS successfully coordinates multiple grid-forming sources by selecting an optimal supply topology that maximizes the supply period of both the critical and noncritical loads while minimizing customer service interruptions in the service restoration process.

Hu, Rongxing↗

Disentangling long and short distances in momentum-space TMDs

The extraction of nonperturbative TMD physics is made challenging by prescriptions that shield the Landau pole, which entangle long- and short-distance contributions in momentum space. The use of different prescriptions then makes the comparison of fit results for underlying nonperturbative contributions not meaningful on their own. We propose a model-independent method to restrict momentum-space observables to the perturbative domain. This method is based on a set of integral functionals that act linearly on terms in the conventional position-space operator product expansion (OPE). Artifacts from the truncation of the integral can be systematically pushed to higher powers in Λ QCD /k T . We demonstrate that this method can be used to compute the cumulative integral of TMD PDFs over k T ≤ k$^{cut}_{T}$ in terms of collinear PDFs, accounting for both radiative corrections and evolution effects. This yields a systematic way of correcting the naive picture where the TMD PDF integrates to a collinear PDF, and for unpolarized quark distributions we find that when renormalization scales are chosen near k$^{cut}_{T}$, such corrections are a percent-level effect. We also show that, when supplemented with experimental data and improved perturbative inputs, our integral functionals will enable model-independent limits to be put on the non-perturbative OPE contributions to the Collins-Soper kernel and intrinsic TMD distributions.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

An evaluation of point-insertion sequences for incremental Delaunay tessellations

Currently, incremental algorithms may be seen as the lowest-cost computational methods to generate Delaunay tessellations in several point distributions. In this work, eight point-insertion sequences in incremental algorithms for generating Delaunay tessellations are evaluated. More specifically, four point-insertion sequences in incremental algorithms for generating Delaunay tessellations are proposed: with orders given by the red–black tree with in-order and level-order traversals, spiral ordering, and H-indexing. These four incremental algorithms with such sequences are compared with four incremental algorithms with point-insertion orders given by the following sequences: the Hilbert and Lebesgue curves, cut-longest-edge kd-tree, and random order. Six 2-D and seven 3-D point distributions are tested, with sets ranging from 25,000 to 8,000,000 points. The results of computational and storage costs of these eight algorithms are analyzed. It follows that the incremental algorithm with a point-insertion sequence in the order given by the cut-longest-edge kd-tree shows the lowest computational and storage costs of the sequences tested.

97 MATHEMATICS AND COMPUTING↗

Exosomes and Exosomal MicroRNAs in Prostate Cancer Radiation Therapy

Despite current risk stratification systems using traditional clinicopathologic factors, many localized and locally advanced prostate cancers fail radical treatment (ie, radical prostatectomy, radiation therapy with or without androgen deprivation therapy). Therefore, a pressing need exists for enhanced methods of disease stratification through novel prognostic and predictive tools that can reliably be applied in clinical practice. Exosomes are 50- to 150-nm small vesicles released by cancer cells that reflect the genetic and nongenetic materials of parent cancer cells. Cancer cells can contain distinct sets of microRNA profiles, the expression of which can change owing to stress such as radiation therapy. These alterations or distinctions in contents allow exosomes to be used as prognostic and/or predictive biomarkers and to monitor the treatment response. Additionally, microRNAs have been shown to influence multiple processes in prostate tumorigenesis, including cell proliferation, induction of apoptosis, migration, oncogene inhibition, and radioresistance. Thus, comparative exosomal microRNA profiling at different levels could help portray tumor aggressiveness and response to radiation therapy. Although technical challenges persist in exosome isolation and characterization, recent improvements in microRNA profiling have evolved toward in-depth analyses of the exosomal cargo and its functions. We have reviewed the role of exosomes and exosomal microRNAs in biologic processes of prostate cancer progression and radiation therapy response, with a particular focus on the development of clinical assays for treatment personalization.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Limited-angle effect compensation for respiratory binned cardiac SPECT

Purpose: In cardiac single photon emission computed tomography (SPECT), respiratory-binned study is used to combat the motion blur associated with respiratory motion. However, owing to the variability in respiratory patterns during data acquisition, the acquired data counts can vary significantly both among respiratory bins and among projection angles within individual bins. If not properly accounted for, such variation could lead to artifacts similar to limited-angle effect in image reconstruction. In this work, the authors aim to investigate several reconstruction strategies for compensating the limited-angle effect in respiratory binned data for the purpose of reducing the image artifacts. Methods: The authors first consider a model based correction approach, in which the variation in acquisition time is directly incorporated into the imaging model, such that the data statistics are accurately described among both the projection angles and respiratory bins. Afterward, the authors consider an approximation approach, in which the acquired data are rescaled to accommodate the variation in acquisition time among different projection angles while the imaging model is kept unchanged. In addition, the authors also consider the use of a smoothing prior in reconstruction for suppressing the artifacts associated with limited-angle effect. In our evaluation study, the authors first used Monte Carlo simulated imaging with 4D NCAT phantom wherein the ground truth is known for quantitative comparison. The authors evaluated the accuracy of the reconstructed myocardium using a number of metrics, including regional and overall accuracy of the myocardium, uniformity and spatial resolution of the left ventricle (LV) wall, and detectability of perfusion defect using a channelized Hotelling observer. As a preliminary demonstration, the authors also tested the different approaches on five sets of clinical acquisitions. Results: The quantitative evaluation results show that the three compensation methods could all, but to different extents, reduce the reconstruction artifacts over no compensation. In particular, the model based approach reduced the mean-squared-error of the reconstructed myocardium by as much as 40%. Compared to the approach of data rescaling, the model based approach further improved both the overall and regional accuracy of the myocardium; it also further improved the lesion detectability and the uniformity of the LV wall. When ML reconstruction was used, the model based approach was notably more effective for improving the LV wall; when MAP reconstruction was used, the smoothing prior could reduce the noise level and artifacts with little or no increase in bias, but at the cost of a slight resolution loss of the LV wall. The improvements in image quality by the different compensation methods were also observed in the clinical acquisitions. Conclusions: Compensating for the uneven distribution of acquisition time among both projection angles and respiratory bins can effectively reduce the limited-angle artifacts in respiratory-binned cardiac SPECT reconstruction. Direct incorporation of the time variation into the imaging model together with a smoothing prior in reconstruction can lead to the most improvement in the accuracy of the reconstructed myocardium.

60 APPLIED LIFE SCIENCES↗

Progress Update on Segmentation of Neutron Tomographic Images, 2018

The present report documents the techniques developed to segment fast-neutron tomographic images of objects consisting of assemblies of machined parts with distinct boundaries. This report satisfies the fiscal year 2018 technical deliverable for project OR16-3DTomography-PD3Jb, “3D Tomography and Image Processing Using Fast Neutrons,” to report on the extension of geometric shape-finding algorithms to three dimensions. The project has two overall goals. The first of these goals is to extend associated-particle fast-neutron transmission and, particularly, induced-reaction tomographic imaging algorithms to three dimensions. This aspect of the project is beyond the scope of this report. The second goal is to automatically segment the resultant tomographic images into constituent parts and then extract information about the parts, such as the class of shape and potentially the shape parameters. This report describes progress for the image segmentation part of the project. Imaging techniques have been developed as high-confidence methods for confirming the presence and configuration of special nuclear materials (SNM). This high confidence is achieved at the cost of revealing considerable information that may be undesirable to share with the operator of the equipment. One potential way to make use of the high-confidence of imaging methods without revealing imaging data is to employ automated analysis that can extract meaningful attributes of the SNM without showing imaging data to the operator. An essential step of this automated analysis is the segmentation of the image into its constituent parts. For example, a three-dimensional (3D) fast-neutron tomographic image of an assembly containing uranium could be reconstructed and then segmented into discrete parts. The properties of a constituent part identified as uranium would be of interest and could be extracted. For instance, the volume and density of the part would together determine its mass. Moreover, its shape might be expected to fall into a particular geometric class, such as a cube, cylinder, or sphere, and the parameters of the shape (such as side length, height, or diameter) would be expected to fall in a given range. In such an analysis, automated identification of the boundaries and properties of the uranium part is an essential step. A key goal of the present work is to infer the boundaries of objects in fast-neutron tomographic images via the general method of image segmentation. Development of this capability can be broken into more manageable steps, including 1. operator-guided segmentation of two-dimensional (2D) fast-neutron tomographic images, 2. operator-guided segmentation of 3D fast-neutron tomographic images, 3. development of automated segmentation algorithms, and 4. extraction of shape parameters from constituent volumes in 3D. In the first year, the project team reported progress on the first step. Last year, progress on the second step, the extension into 3D, was reported with application to simulated data. The present report describes additional progress on the second step, and progress toward the third step, automated segmentation algorithms. In particular, a multiphase level set approach for image segmentation in three dimensions has been applied to measured 3D data for the first time. Activities related to the fourth step will also be reported, but it will focus on estimation of 3D volumes rather than shape parameters. In this report, the steps before image segmentation will be described, and the multiphase level sets approach to image segmentation will be briefly reviewed. This will be followed by a discussion of the issues encountered when applying the level set technique to measured 3D transmission images, and then a description of the inclusion of induced-reaction data will be provided. Finally, segmentation results for various measured target assemblies will be presented and the image segmentation portion of this project will be summarized and future directions will be discussed.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

CarbStor: Development, Analysis and Modification of Carbon Storing Model Soil Communities

Soil microbial communities carry out a number of key processes including plant growth promotion, bioremediation and cycling of nutrients. Carbon cycling is among the most important of these nutrients that are metabolized and processed by the soil microbial community. Many of the carbon inputs are converted to alternative organic forms of carbon that can be used by plants or act as biomass for microbial growth. However, inorganic forms of carbon can also be produced by soil microbial communities including calcium carbonate (CaCO 3 ). Production of calcium carbonate is beneficial for the ecosystem in several ways: it can stabilize soils and improve soil health, especially denser soils with high clay content, it can act as a method of bioremediation, it can serve as an alternative carbon source for plants and it can be a way to store carbon in soil in a stable, inorganic manner for the long term. While the chemistry surrounding individual species carrying out this process is well known what is lacking is an understanding of how species interact in a community to drive carbonate production. As all microbial species in soil exist in a community setting gaining this knowledge is critical to our predicting and controlling this microbial phenotype to greatly improve soil health. The CarbStor project is focused on developing, analyzing and modifying defined microbial soil consortia that express phenotypes at both the species and community level to convert carbon into recalcitrant stable sources such as precipitated carbonate or microbial necromass. To take full advantage of the soil community for this process we will need to fill several key knowledge gaps (KG), three of which are the focus of CarbStor. KG1: Whether and to what degree microbial communities can be developed that produce precipitated carbon via microbial metabolism. KG2: What interspecies interactions drive the individual member phenotypes in defined communities that lead to carbon precipitation. KG3: How can these interactions be modified to enhance carbon sequestration beyond what native communities are capable of. We hypothesize that in a carbon sequestering community only a subset of species will express phenotypes related to carbon storage processes. We also hypothesize that these phenotypes are expressed as a result of interactions with other species in the community that are not involved in carbon storage processes and that these interactions can be harnessed to enhance community carbon sequestration.

54 ENVIRONMENTAL SCIENCES↗

Recurrent Neural Network Language Models for Open Vocabulary Event-Level Cyber Anomaly Detection

Automated analysis methods are crucial aids for monitoring and defending a network to protect the sensitive or confidential data it hosts. This work introduces a flexible, powerful, and unsupervised approach to detecting anomalous behavior in computer and network logs; one that largely eliminates domain-dependent feature engineering employed by existing methods. By treating system logs as threads of interleaved ``sentences'' (event log lines) to train online unsupervised neural network language models, our approach provides an adaptive model of normal network behavior. We compare the effectiveness of both standard and bidirectional recurrent neural network language models at detecting malicious activity within network log data. Extending these models, we introduce a tiered recurrent architecture, which provides context by modeling sequences of users' actions over time. Compared to isolation forests and Principal Components Analysis (PCA), two popular anomaly detection algorithms, we observe superior performance on the Los Alamos National Laboratory Cyber Security dataset. For log-line-level predictions, our best performing character-based model provides test set anomaly scores ranking red team events in the 98th percentile on average, and yields 0.97 area under the receiver operator characteristic curve, demonstrating the strong fine-grained anomaly detection performance of this approach on open vocabulary logging sources.

Cyber Analysis, Deep Learning, language analysis, ↗