Search NASA⌕ Search

Engineering topics

Erwin, Samantha

Publications and source records attributed to Erwin, Samantha.

Testing SOAR tools in use

Investigations within Security Operation Centers (SOCs) are tedious as they rely on manual efforts to query diverse data sources, overlay related logs, correlate the data into information, and then document results in a ticketing system. Security Orchestration, Automation, and Response (SOAR) tools are a relatively new technology that promise, with appropriate configuration, to collect, filter, and display needed diverse information; automate many of the common tasks that unnecessarily require SOC analysts’ time; facilitate SOC collaboration; and, in doing so, improve both efficiency and consistency of SOCs. There has been no prior research to test SOAR tools in practice; hence, understanding and evaluation of their effect is nascent and needed. Here, in this paper, we design and administer the first hands-on user study of SOAR tools, involving 24 participants and six commercial SOAR tools. Our contributions include the experimental design, itemizing six characteristics of SOAR tools, and a methodology for testing them. We describe configuration of a cyber range test environment, including network, user, and threat emulation; a full SOC tool suite; and creation of artifacts allowing multiple representative investigation scenarios to permit testing. We present the first research results on SOAR tools. Concisely, our findings are that: per-SOC SOAR configuration is extremely important; SOAR tools increase efficiency and reduce context switching, although with potentially decreased ticketing accuracy/completeness; user preference is slightly negatively correlated with their performance with the tool; internet dependence varies widely among SOAR tools; and balance of automation with assisting decision making is preferred by senior participants. We deliver a public user- and tool-anonymized and -obfuscated version of the data.

97 MATHEMATICS AND COMPUTING↗

Toward the Detection of Polyglot Files

Standardized file types play a key role in the development and use of computer software. However, it is possible to confound standardized file type processing by creating a file that is valid in multiple file types. The resulting polyglot (many languages) file can confuse file type identification, allowing elements of the file to evade analysis. This is especially problematic for malware detection systems that rely on file type identification for feature extraction. Although work has been done to identify file types using more comprehensive methods than file signatures, accurate identification of polyglot files remains an open problem. Since malware detection systems routinely perform file type-specific feature extraction, polyglot files need to be filtered out prior to ingestion by these systems. Otherwise, malicious content could pass through undetected. To address the problem of polyglot detection we assembled a data set using the mitra tool. We then evaluated the performance of the most commonly used file identification tools, including file, polydet, binwalk, and TrID. Our analysis demonstrates that existing file type detection tools fail to provide reliable polyglot detection. We then evaluated the ability of a range of machine and deep learning models to detect polyglot files. The most performant models were MalConv2 and Catboost, which demonstrated the highest recall on our data set with 95.16% and 95.45%, respectively. These models outperformed existing methods and could be incorporated into a malware detector’s file processing pipeline to filter out potentially malicious polyglots before file type-dependent feature extraction takes place.

Koch, Luke↗

Soar Survey Scoring

ORNL conducted an experiment to test COTS (commercial off the shelf) SOAR tools. Vendors interested in entering their tool into the experiment were asked to submit information videos about their tool for phase 1 to down-select which tools should make it through to the testing phase. SOC operators were assigned to watch a subset of the videos such that each video was assigned to the same number of operators. After watching all the videos, operators completed surveys which asked them to grade basic aspects about the tool as best as they could based on the provided video, and asked them to rank the order of their interest in the vendors they were assigned to watch videos on. The problem solved was how do we aggregate the results of the surveys and each of the operator's ranked lists into an overall ranking of all the tools. In addition, it was desirable to be able to work on this code before final results were collected from operators, so code to generate fake data was developed to output in the same output as the survey results.

Bridges, Robert↗

Mathematical model of broadly reactive plasma cell production

Strain-specific plasma cells are capable of producing neutralizing antibodies that are essential for clearance of challenging pathogens. These neutralizing antibodies also function as a main defense against disease establishment in a host. However, when a rapidly mutating pathogen infects a host, successful control of the invasion requires shifting the production of plasma cells from strain-specific to broadly reactive. In this study, we develop a mathematical model of germinal center dynamics and use it to predict the events that lead to improved breadth of the plasma cell response. We examine scenarios that lead to germinal centers that are composed of B-cells that come from a single strain-specific clone, a single broadly reactive clone or both clones. We find that the initial B-cell clonal composition, T-follicular helper cell signaling, increased rounds of productive somatic hypermutation, and B-cell selection strength are among the mechanisms differentiating between strain-specific and broadly reactive plasma cell production during infections. Understanding the contribution of these factors to emergence of breadth may assist in boosting broadly reactive plasma cells production.

59 BASIC BIOLOGICAL SCIENCES↗

The effect of enrofloxacin on enteric Escherichia coli : Fitting a mathematical model to in vivo data

Antimicrobial drugs administered systemically may cause the emergence and dissemination of antimicrobial resistance among enteric bacteria. To develop logical, research-based recommendations for food animal veterinarians, we must understand how to maximize antimicrobial drug efficacy while minimizing risk of antimicrobial resistance. Our objective is to evaluate the effect of two approved dosing regimens of enrofloxacin (a single high dose or three low doses) on Escherichia coli in cattle. We look specifically at bacteria above and below the epidemiological cutoff (ECOFF), above which the bacteria are likely to have an acquired or mutational resistance to enrofloxacin. We developed a differential equation model for the antimicrobial drug concentrations in plasma and colon, and bacteria populations in the feces. The model was fit to animal data of drug concentrations in the plasma and colon obtained using ultrafiltration probes. Fecal E. coli counts and minimum inhibitory concentrations were measured for the week after receiving the antimicrobial drug. We predict that the antimicrobial susceptibility of the bacteria above the ECOFF pre-treatment strongly affects the composition of the bacteria following treatment. Faster removal of the antimicrobial drugs from the colon throughout the study leads to improved clearance of bacteria above the ECOFF in the low dose regimen. If we assume a fitness cost is associated with bacteria above the ECOFF, the increased fitness costs leads to reduction of bacteria above the ECOFF in the low dose study. These results suggest the initial E. coli susceptibility is a strong indicator of how steers respond to antimicrobial drug treatment.

59 BASIC BIOLOGICAL SCIENCES↗