Search NASA⌕ Search

SEARCH · Search NASA

Results for “deep generative models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Discovering Elusive Dynamics Across Frontiers (Final Technical Report)

Profound puzzles, such as the nature of dark matter, the origins of the electroweak scale, the mechanism behind the small neutrino mass, and the strong CP problem, suggested new physics beyond the Standard Model and drove the particle physics program in search of the associated new particles. Despite extensive searches, conventional realizations of new physics have not yet provided conclusive evidence. This raised the serious possibility that new dynamics might be more elusive, perhaps due to a richer gauge and matter structure than previously considered. Notably, the existence of dark matter and advancements in understanding the naturalness problem urged exploration into sectors with complex gauge and matter structures. Through experiments like the LHC, DUNE, and small-scale experiments, the robust US HEP program played a critical role in pursuing these well-motivated but under-explored scenarios for new physics. I explored these physics opportunities in depth, focusing on novel searches and significant improvements in parameter space coverage. The elusive dynamics revealed rich information about the underlying theory and were essential in identifying observable opportunities. Understanding the observable consequences required a deep comprehension of the theory, which I also developed. The proposal included essential components aimed at coherently increasing our knowledge in well-motivated elusive dynamics models. Through research on high-quality axions, composite neutrinos, the Higgs boson as a portal to hidden strong dynamics, and new scalar potentials to generate alternative electroweak phase transitions, I focused on identifying new signatures and parameter regions in plausible elusive dynamics models. The exploration emphasized generic possibilities motivated by broad classes of elusive dynamics models. These signatures were not effectively probed previously due to various challenges such as triggering, background suppression, or experimental design. My research involved close interaction with experimental colleagues to overcome these difficulties, leveraging new theoretical and experimental possibilities. These efforts included identifying new observables such as timing information and substructure in calorimetries, new multiple-hit techniques, new scattering events, and new resonance searches in liquid argon detectors. This work created a positive feedback loop: theory and experimental work inspired each other, revealing new exciting opportunities that supported both programs.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
NASA NTRS2006

NASA Tech Briefs, March 2006

Topics covered include: Medical Signal-Conditioning and Data-Interface System; Instruments for Reading Direct-Marked Data-Matrix Symbols; Processing EOS MLS Level-2 Data; Ground Processing of Data From the Mars Exploration Rovers; Estimating Total Electron Content Using 1,000+ GPS Receivers; NASA Solar Array Demonstrates Commercial Potential; Improved Control of Charging Voltage for Li-Ion Battery; Programmable Pulse-Position-Modulation Encoder; Wavelength-Agile External-Cavity Diode Laser for DWDM; Pattern-Recognition Processor Using Holographic Photopolymer; Submicrosecond Power-Switching Test Circuit; Three-Function Logic Gate Controlled by Analog Voltage; Integrated System for Autonomous Science; Montage Version 3.0; Utilizing AI in Temporal, Spatial, and Resource Scheduling; Satellite Image Mosaic Engine; Architecture for Control of the K9 Rover; HFGMC Enhancement of MAC/GMC; Automated Activation and Deactivation of a System Under Test; Cleaning Carbon Nanotubes by Use of Mild Oxygen Plasmas; Generating Aromatics From CO2 on Mars or Natural Gas on Earth; Attaching Thermocouples by Peening or Crimping; Heat Treatment of Friction-Stir-Welded 7050 Aluminum Plates; Generating Breathable Air Through Dissociation of N2O; High-Performance Scanning Acousto-Ultrasonic System; Correction for Thermal EMFs in Thermocouple Feedthroughs; Using Quasiparticle Poisoning To Detect Photons; Estimating Resolution Lengths of Hybrid Turbulence Models; Education and Training Module in Alertness Management; Cargo-Positioning System for Next-Generation Spacecraft; Micro-Imagers for Spaceborne Cell-Growth Experiments; Holographic Solar Photon Thrusters; Plasma-Based Detector of Outer-Space Dust Particles; and Generation of Data-Rate Profiles of Ka-Band Deep-Space Links.

Source record↗
DOE OSTI2020

Multiple-objective Reinforcement Learning for Inverse Design and Identification

The aim of inverse chemical design is to develop new molecules with given optimized molecular properties or objectives. Recently, generative deep learning (DL) networks are considered as the state-of-the-art in inverse chemical design and have achieved early success in generating molecular structures with desired properties in the pharmaceutical and material chemistry fields. However, satisfying a large number (> 10 objectives) of molecular objectives is a limitation of current generative models. To improve the model’s ability to handle a large number of molecule design objectives, we developed a Reinforcement Learning (RL) based generative framework to optimize chemical molecule generation. Our use of Curriculum Learning (CL) to fine-tune the pre-trained generative network allowed the model to satisfy up to 21 objectives and increase the generative network’s robustness. The experiments show that the proposed multiple-objective RL-based generative model can correctly identify unknown molecules with an 83% to 100% success rate, compared to the baseline approach of 0%. Additionally, this proposed generative model is not limited to just chemistry research challenges; we anticipate that problems that utilize RL with multiple objectives will benefit from this framework.

reinforcement learning, generative model, inverse ↗
DOE OSTI2025

Expanding the physics reach of DUNE in the near and far detectors

The Deep Underground Neutrino Experiment (DUNE) is a next-generation long-baseline neutrino oscillation experiment. Its primary goal is the determination of the neutrino mass hierarchy and the CP-violating phase. The DUNE physics programme also includes the detection of astrophysical neutrinos and the search for beyond the Standard Model (BSM) phenomena. DUNE will consist of a near detector (ND) complex placed at Fermilab, and a modular Liquid Argon Time Projection Chamber (LArTPC) far detector (FD) to be built in the Sanford Underground Research Facility (SURF), approximately 1300 km away from the neutrino production point. This thesis describes three different projects within DUNE. First, a novel strategy to improve the triggering capabilities of the DUNE FD is proposed. It uses matched filters to enhance the production of online hits across all charge collection planes. Next, the possibility of detecting neutrinos coming from dark matter (DM) annihilations in the Sun with the FD is explored. The complementarity of DUNE to this kind of DM searches is shown. Finally, the simulation and reconstruction framework of ND-GAr, the gas argon ND proposed for Phase II of DUNE, is presented. A number of additions to this are described, particularly focused on the development of the particle identification (PID) capabilities of the detector. These are then used to perform the first event selection studies with an end-to-end simulation in ND-GAr, in particular the selection of pion exclusive samples in $\nu_{\mu}$ CC interactions. All three of these projects share the common goal of enhancing the physics programme of DUNE.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

Occlusion-Perturbed Deep Learning for Probabilistic Solar Forecasting via Sky Images

Solar forecasting is shifting to the probabilistic paradigm due to the inherent uncertainty within the solar resource. Input uncertainty quantification is one of the widely used and best-performing ways to model solar uncertainty. However, compared to other sources of inputs, such as numerical weather prediction models, pure sky image-based probabilistic solar forecasting lags behind. In this research, an occlusion-perturbed convolutional neural network, named the PSolarNet, is developed. The PSolarNet provides very short-term deterministic forecasts, forecast scenarios, and probabilistic forecasts of the global horizontal irradiance from sky image sequences. Case studies based on 6 years of open-source data show that the developed PSolarNet is able to generate accurate 10-minute ahead deterministic forecasts with a 5.62% normalized root mean square error, realistic and diverse forecast scenarios with a 0.966 average correlation with the actual time series, and reliable and sharp probabilistic forecasts with a 2.77% normalized continuous ranked probability score.

Bayesian model averaging↗
DOE OSTI2011

Deep-UV generation in an SBO crystal with an irregular domain structure

Random (stochastic) quasi-phase matching is demonstrated for broadband radiation in a one-dimensional irregular strontium tetraborate nonlinear photonic crystal. Harmonic generation tunable in the range 187.5 - 215 nm is achieved. The average power of the generated signal is a quadratic function of pump power and reaches 1 {mu}W. In a steady-state model, taking into account sum frequency generation within the spectrum of the input light causes no broadening of the peaks in the spectrum of the generated signal. (nonlinear optical phenomena)

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2022

Occlusion-Perturbed Deep Learning for Probabilistic Solar Forecasting via Sky Images: Preprint

Solar forecasting is shifting to the probabilistic paradigm due to the inherent uncertainty within the solar resource. Input uncertainty quantification is one of the widely used and best-performing ways to model solar uncertainty. However, compared to other sources of inputs, such as numerical weather prediction models, pure sky image-based probabilistic solar forecasting lags behind. In this research, an occlusion-perturbed convolutional neural network, named the PSolarNet, is developed. The PSolarNet provides very short-term deterministic forecasts, forecast scenarios, and probabilistic forecasts of the global horizontal irradiance from sky image sequences. Case studies based on 6 years of open-source data show that the developed PSolarNet is able to generate accurate 10-minute ahead deterministic forecasts with a 5.62% normalized root mean square error, realistic and diverse forecast scenarios with a 0.966 average correlation with the actual time series, and reliable and sharp probabilistic forecasts with a 2.77% normalized continuous ranked probability score.

Bayesian model averaging↗
DOE OSTI2015

Optimal well placement and brine extraction for pressure management during CO 2 sequestration

Large-scale pressure increases resulting from carbon dioxide (CO 2 ) injection in the subsurface can potentially impact caprock integrity, induce reactivation of critically stressed faults, and drive CO 2 or brine through conductive features into shallow groundwater. Pressure management involving the extraction of native fluids from storage formations can be used to reduce such pressure increases. However, dealing with large volumes of extracted brine can be technically challenging and expensive. Selection of optimal well locations and pumping rates are critical for maximizing CO 2 storage and minimizing brine extraction during geologic CO 2 sequestration (GCS). Robust and efficient computerized algorithms combining reservoir models and optimization methods are needed to make proper decisions on well placement and pumping rates. This work presents a constrained differential evolution (CDE) algorithm for solving global optimization problems involving pressure management of GCS projects. Application of the CDE optimization methodology was demonstrated for a hypothetical CO 2 storage scenario in a deep sandstone reservoir in the Southern San Joaquin Basin in California, USA. Industrial-scale storage of CO 2 would generate significant pressure buildup in this formation, which in turn would raise concerns about induced seismicity due to presence of multiple faults surrounding the injection site. Through the CDE optimization algorithm coupled to a vertically-averaged reservoir simulator, we successfully estimated optimal solutions for brine extraction wells in the reservoir that would limit the local pressure along the faults to a prescribed threshold. Multiple realizations of the reservoir permeability field were created to understand the impact of reservoir heterogeneity on optimization results. Our results indicate that the reservoir slope and heterogeneity have significant impact on optimum extraction rates. Reservoir heterogeneity is also a significant factor for extraction well locations, suggesting that in practice decisions about extraction well placement through optimization should be made at later project stages when data from a few years of CO 2 injection have allowed iterative updating and refining of the reservoir forward models. Although the study focused on optimization of brine extraction, the CDE optimization methodology presented in this paper has also potential to solve other complex optimization problems related to GCS, such as increasing storage efficiency by enhancing injectivity and capillary and dissolution trapping.

58 GEOSCIENCES↗
DOE OSTI2020

Physical and hydrodynamic properties of deep sea mining-generated, abyssal sediment plumes in the Clarion Clipperton Fracture Zone (eastern-central Pacific)

The anthropogenic impact of polymetallic nodule harvesting in the Clarion-Clipperton Fracture Zone is expected to strongly affect the benthic ecosystem. To predict the long-term, industrial-scale impact of nodule mining on the deep-sea environment and to improve the reliability of the sediment plume model, information about the specific characteristics of deep-sea particles is needed. Discharge simulations of mining-related fine-grained (median diameter ≈ 20 µm) sediment plumes at concentrations of 35–500 mg L –1 (dry weight) showed a propensity for rapid flocculation within 10 to 135 min, resulting in the formation of large aggregates up to 1100 µm in diameter. The results indicated that the discharge of elevated plume concentrations (500 mg L –1 ) under an increased shear rate (G ≥ 2.4 s –1 ) would result in improved efficiency of sediment flocculation. Furthermore, particle transport model results suggested that even under typical deep-sea flow conditions (G ≈ 0.1 s –1 ), rapid deposition of particles could be expected, which would restrict heavy sediment blanketing (several centimeters) to a smaller fall-out area near the source, unless subsequent flow events resuspended the sediments. Planning for in situ tests of these model projections is underway.

42 ENGINEERING↗
DOE OSTI2021

Transport and chemistry of isoprene and its oxidation products in deep convective clouds

Deep convective clouds can transport trace gases from the planetary boundary layer into the upper troposphere where subsequent chemistry may impact aerosol particle formation and growth. In this modelling study, we investigate processes that affect isoprene and its oxidation products injected into the upper troposphere by an isolated deep convective cloud in the Amazon. We run a photochemical box model with coupled cloud microphysics along hundreds of individual air parcel trajectories sampled from a cloud-resolving model simulation of a convective event. The box model simulates gas-phase chemical reactions, gas scavenging by liquid and ice hydrometeors, and turbulent dilution inside a deep convective cloud. The results illustrate the potential importance of gas uptake to anvil ice in regulating the intensity of the isoprene oxidation and associated low volatility organic vapour concentrations in the outflow. Isoprene transport and fate also depends on the abundance of lightning-generated nitrogen oxide radicals (NO x = NO + NO 2 ). If gas uptake on ice is efficient and lightning activity is low, around 30% of the boundary layer isoprene will survive to the cloud outflow after approximately one hour of transport, while all the low volatile oxidation products will be scavenged by the cloud hydrometeors. If lightning NO x is abundant and gas uptake by ice is inefficient, then all isoprene will be oxidised during transport or in the immediate outflow region, while several low volatility isoprene oxidation products will have elevated concentrations in the cloud outflow. Reducing uncertainties associated with the uptake of vapours on ice hydrometeors, especially HO 2 and oxygenated organics, is essential to improve predictions of isoprene and its oxidation products in deep convective outflows and their potential contribution to new particle formation and growth.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Characterizing Baselines and Change in Gas Hydrate Systems using EM Methods

The objective of this project was to advance our understanding of gas hydrate systems in nature by characterizing their electrical properties in the field and in the laboratory. In the laboratory measurements, methane hydrate was synthesized from pure water ice and flash frozen seawater, with varying amounts of sand or silt added. Electrical conductivity was determined by impedance spectroscopy, using equivalent circuit modeling to separate the effects of electrodes and to gain insight into conduction mechanisms. Silt and sand increase the conductivity of pure hydrate, inferred to be contaminant NaCl contributing to conduction in hydrate, to a peak conductivity in agreement with peak resistivities observed in well logs through massive hydrate (3,000--10,000 Ωm). The addition of silt and sand lowers the conductivity of hydrate synthesized from seawater, by an amount consistent with Archie's Law. All samples were characterized using cryogenic scanning electron microscopy and energy dispersive spectroscopy, which shows good connectivity of salt and brine phases. Electrical conductivity measurements of pure hydrate and hydrate mixed with silt during pressure-induced dissociation supports previous conclusions that sediment increases dissociation rate. In order to characterize gas hydrate systems in the field, we collected 360 line kilometers of controlled-source electromagnetic data on Walker Ridge 313, Orca Basin (WR100), Mad Dog (GC781), and Green Canyon 955 in the Gulf of Mexico, all areas with known or seismically inferred gas hydrate deposits and which have be drilled or targeted for future drilling. We deep-towed an EM transmitter that generates an alternating electric field which propagates through the seafloor geology. Data were recorded on 6 receivers towed behind the transmitter at distances between 550 and 1550 m. In the presence of conductive geology, the electric fields will be attenuated, and conversely, in resistive geology the fields will be preserved. Our data were inverted using a 2D inversion method that first optimizes the model-data misfit, then finds the smoothest model fitting the data. This ensures that resistivity structures present in the final model are likely necessary. At each of the proposed drilling sites we found increased resistivity, interpreted as increased hydrate concentrations. However, not only were the primary drilling sites not always more resistive than the alternate sites, at WR313 the strongest resistors were not at the locations targeted for drilling.

03 NATURAL GAS↗
DOE OSTI2016

Retrievals of ice cloud microphysical properties of deep convective systems using radar measurements: Convective Cloud Microphysical Retrieval

This study presents new algorithms for retrieving ice cloud microphysical properties (ice water content (IWC) and median mass diameter (Dm)) for the stratiform and thick anvil regions of Deep Convective Systems (DCSs) using Next-Generation Radar (NEXRAD) reflectivity and recently developed empirical relationships from aircraft in situ measurements during the Midlatitude Continental Convective Clouds Experiment (MC3E). A classic DCS case on 20 May 2011 is used to compare the retrieved IWC profiles with other retrieval and cloud-resolving model simulations. The mean values of each retrieved and simulated IWC fall within one standard derivation of the other two. The statistical results from six selected cases during MC3E show that the aircraft in situ derived IWC and Dm are 0.47 ± 0.29 g m-3 and 2.02 ± 1.3 mm, while the mean values of retrievals have a positive bias of 0.16 g m-3 (34%) and a negative bias of 0.39 mm (19%). To validate the newly developed retrieval algorithms from this study, IWC and Dm are performed with other DCS cases during Bow Echo and Mesoscale Convective Vortex Experiment (BAMEX) field campaign using composite gridded NEXRAD reflectivity and compared with in situ IWC and Dm from aircraft. A total of 64 1-min collocated aircraft and radar samples are available for comparisons, and the averages of radar retrieved and aircraft in situ measured IWCs are 1.22 g m-3 and 1.26 g m-3 with a correlation of 0.5, and their averaged Dm values are 2.15 and 1.80 mm. These comparisons have shown that the retrieval algorithms 45 developed during MC3E can retrieve similar ice cloud microphysical properties of DCS to aircraft in situ measurements during BAMEX with median errors of ~40% and ~25% for IWC and Dm retrievals, respectively. This is indicating our retrieval algorithms are suitable for other midlatitude continental DCS ice clouds, especially at stratiform rain and thick anvil regions. In addition, based on the averaged IWC and Dm values during MC3E and BAMEX, the DCS IWC values over midlatitude are significantly different, while their Dm values are close to each other. On the other hand, these DCS IWC and Dm values are 1-2 orders of magnitude larger than those of single-layered cirrus clouds over midlatitudes.

Tian, Jingjing↗
DOE OSTI2022

Artificial intelligence inferred microstructural properties from voltage–capacity curves

Abstract The quantification of microstructural properties to optimize battery design and performance, to maintain product quality, or to track the degradation of LIBs remains expensive and slow when performed through currently used characterization approaches. In this paper, a convolution neural network-based deep learning approach (CNN) is reported to infer electrode microstructural properties from the inexpensive, easy to measure cell voltage versus capacity data. The developed framework combines two CNN models to balance the bias and variance of the overall predictions. As an example application, the method was demonstrated against porous electrode theory-generated voltage versus capacity plots. For the graphite|LiMn $$_2$$ 2 O $$_4$$ 4 chemistry, each voltage curve was parameterized as a function of the cathode microstructure tortuosity and area density, delivering CNN predictions of Bruggeman’s exponent and shape factor with 0.97 $$R^2$$ R 2 score within 2 s each, enabling to distinguish between different types of particle morphologies, anisotropies, and particle alignments. The developed neural network model can readily accelerate the processing-properties-performance and degradation characteristics of the existing and emerging LIB chemistries.

25 ENERGY STORAGE↗
DOE OSTI2018

Understanding the Dynamics of Primary Zn-MnO 2 Alkaline Battery Gassing with Operando Visualization and Pressure Cells

The leading cause for safety vent rupture in alkaline batteries is the intrinsic instability of Zn in the highly alkaline reacting environment. Zn and aqueous KOH react in a parasitic process to generate hydrogen gas, which can rupture the seal and vent the hydrogen along with small amounts of electrolyte, and thus, damage consumer devices. Abusive conditions, particularly deep discharge, are known to accelerate this “gassing” phenomena. In order to understand the fundamental drivers and mechanisms for such gassing behavior, the results from multiphysics modeling, ex-situ microscopy and operando measurements of cell potential, pressure and visualization have been combined. Operando measurements were enabled by the development a new research platform that enables a cross-sectional view of a cylindrical Zn-MnO 2 primary alkaline battery throughout its discharge and recovery. A second version of this cell can actively measure the in-cell pressure during the discharge. It is shown that steep concentration gradients emerge during the cell discharge through a redox electrolyte mechanism, leading to the formation of high surface area Zn deposits that experience rapid corrosion when the cell rests to its open circuit voltage. Such corrosion is paired with the release of hydrogen and high cell pressure – eventually leading to cell rupture.

25 ENERGY STORAGE↗
DOE OSTI2020

DSCOVR/EPIC-derived global hourly and daily downward shortwave and photosynthetically active radiation data at 0.1° × 0.1° resolution

Downward shortwave radiation (SW) and photosynthetically active radiation (PAR) play crucial roles in Earth system dynamics. Spaceborne remote sensing techniques provide a unique means for mapping accurate spatiotemporally continuous SW–PAR, globally. However, any individual polar-orbiting or geostationary satellite cannot satisfy the desired high temporal resolution (sub-daily) and global coverage simultaneously, while integrating and fusing multisource data from complementary satellites/sensors is challenging because of co-registration, intercalibration, near real-time data delivery and the effects of discrepancies in orbital geometry. The Earth Polychromatic Imaging Camera (EPIC) on board the Deep Space Climate Observatory (DSCOVR), launched in February 2015, offers an unprecedented possibility to bridge the gap between high temporal resolution and global coverage and characterize the diurnal cycles of SW–PAR globally. In this study, we adopted a suite of well-validated data-driven machine-learning models to generate the first global land products of SW–PAR, from June 2015 to June 2019, based on DSCOVR/EPIC data. The derived products have high temporal resolution (hourly) and medium spatial resolution (0.1°×0.1°), and they include estimates of the direct and diffuse components of SW–PAR. We used independently widely distributed ground station data from the Baseline Surface Radiation Network (BSRN), the Surface Radiation Budget Network (SURFRAD), NOAA's Global Monitoring Division and the U.S. Department of Energy's Atmospheric System Research (ASR) program to evaluate the performance of our products, and we further analyzed and compared the spatiotemporal characteristics of the derived products with the benchmarking Clouds and the Earth's Radiant Energy System Synoptic (CERES) data. We found both the hourly and daily products to be consistent with ground-based observations (e.g., hourly and daily total SWs have low biases of -3.96 and -0.71 W m -2 and root-mean-square errors (RMSEs) of 103.50 and 35.40 W m -2 , respectively). The developed products capture the complex spatiotemporal patterns well and accurately track substantial diurnal, monthly, and seasonal variations in SW–PAR when compared to CERES data. They provide a reliable and valuable alternative for solar photovoltaic applications worldwide and can be used to improve our understanding of the diurnal and seasonal variabilities of the terrestrial water, carbon and energy fluxes at various spatial scales.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2014

Systematic problems with using dark matter simulations to model stellar halos

The limits of available computing power have forced models for the structure of stellar halos to adopt one or both of the following simplifying assumptions: (1) stellar mass can be 'painted' onto dark matter (DM) particles in progenitor satellites; (2) pure DM simulations that do not form a luminous galaxy can be used. We estimate the magnitude of the systematic errors introduced by these assumptions using a controlled set of stellar halo models where we independently vary whether we look at star particles or painted DM particles, and whether we use a simulation in which a baryonic disk galaxy forms or a matching pure DM simulation that does not form a baryonic disk. We find that the 'painting' simplification reduces the halo concentration and internal structure, predominantly because painted DM particles have different kinematics from star particles even when both are buried deep in the potential well of the satellite. The simplification of using pure DM simulations reduces the concentration further, but increases the internal structure, and results in a more prolate stellar halo. These differences can be a factor of 1.5-7 in concentration (as measured by the half-mass radius) and 2-7 in internal density structure. Given this level of systematic uncertainty, one should be wary of overinterpreting differences between observations and the current generation of stellar halo models based on DM-only simulations when such differences are less than an order of magnitude.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Converting tabular data into images for deep learning with convolutional neural networks

Abstract Convolutional neural networks (CNNs) have been successfully used in many applications where important information about data is embedded in the order of features, such as speech and imaging. However, most tabular data do not assume a spatial relationship between features, and thus are unsuitable for modeling using CNNs. To meet this challenge, we develop a novel algorithm, image generator for tabular data (IGTD), to transform tabular data into images by assigning features to pixel positions so that similar features are close to each other in the image. The algorithm searches for an optimized assignment by minimizing the difference between the ranking of distances between features and the ranking of distances between their assigned pixels in the image. We apply IGTD to transform gene expression profiles of cancer cell lines (CCLs) and molecular descriptors of drugs into their respective image representations. Compared with existing transformation methods, IGTD generates compact image representations with better preservation of feature neighborhood structure. Evaluated on benchmark drug screening datasets, CNNs trained on IGTD image representations of CCLs and drugs exhibit a better performance of predicting anti-cancer drug response than both CNNs trained on alternative image representations and prediction models trained on the original tabular data.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2019

Detailed Statistical Models of Host-Based Data for Detection of Malicious Activity

The cybersecurity research community has focused primarily on the analysis and automation of intrusion detection systems by examining network traffic behaviors. Expanding on this expertise, advanced cyber defense analysis is turning to host-based data to use in research and development to produce the next generation network defense tools. The ability to perform deep packet inspection of network traffic is increasingly harder with most boundary network traffic moving to HTTPS. Additionally, network data alone does not provide a full picture of end-to-end activity. These are some of the reasons that necessitate looking at other data sources such as host data. We outline our investigation into the processing, formatting, and storing of the data along with the preliminary results from our exploratory data analysis. In writing this report, it is our goal to aid in guiding future research by providing foundational understanding for an area of cybersecurity that is rich with a variety of complex, categorical, and sparse data, with a strong human influence component. Including suggestions for guiding potential directions for future research.

97 MATHEMATICS AND COMPUTING↗