Search NASA⌕ Search

Engineering topics

Ren, Simiao

Publications and source records attributed to Ren, Simiao.

Transfer learning for metamaterial design and simulation

Abstract We demonstrate transfer learning as a tool to improve the efficacy of training deep learning models based on residual neural networks (ResNets). Specifically, we examine its use for study of multi-scale electrically large metasurface arrays under open boundary conditions in electromagnetic metamaterials. Our aim is to assess the efficiency of transfer learning across a range of problem domains that vary in their resemblance to the original base problem for which the ResNet model was initially trained. We use a quasi-analytical discrete dipole approximation (DDA) method to simulate electrically large metasurface arrays to obtain ground truth data for training and testing of our deep neural network. Our approach can save significant time for examining novel metasurface designs by harnessing the power of transfer learning, as it effectively mitigates the pervasive data bottleneck issue commonly encountered in deep learning. We demonstrate that for the best case when the transfer task is sufficiently similar to the target task, a new task can be effectively trained using only a few data points yet still achieve a test mean absolute relative error of 3 % with a pre-trained neural network, realizing data reduction by a factor of 1000.

Peng, Rixi↗

Automated Extraction of Energy Systems Information from Remotely Sensed Data: A Review and Analysis

We report high quality energy systems information is a crucial input to energy systems research, modeling, and decision-making. Unfortunately, actionable information about energy systems is often of limited availability, incomplete, or only accessible for a substantial fee or through a non-disclosure agreement. Recently, remotely sensed data (e.g., satellite imagery, aerial photography) have emerged as a potentially rich source of energy systems information. However, the use of these data is frequently challenged by its sheer volume and complexity, precluding manual analysis. Recent breakthroughs in machine learning have enabled automated and rapid extraction of useful information from remotely sensed data, facilitating large-scale acquisition of critical energy system variables. Here we present a systematic review of the literature on this emerging topic, providing an in-depth survey and review of papers published within the past two decades. We first taxonomize the existing literature into ten major areas, spanning the energy value chain. Within each research area, we distill and critically discuss major features that are relevant to energy researchers, including, for example, key challenges regarding the accessibility and reliability of the methods. We then synthesize our findings to identify limitations and trends in the literature as a whole, and discuss opportunities for innovation. These include the opportunity to extend the methods beyond electricity to broader energy systems and wider geographic areas; and the ability to expand the use of these methods in research and decision making as satellite data become cheaper and easier to access. We also find that there are persistent challenges: limited standardization and rigor of performance assessments; limited sharing of code, which would improve replicability; and a limited consideration of the ethics and privacy of data.

97 MATHEMATICS AND COMPUTING↗

Deep inverse photonic design: A tutorial

Deep learning (DL) has been used to design deep neural networks (DNNs) which have recently been applied to solving inverse problems in artificial electromagnetic materials (AEMs). Although inverse problems are often ill-posed, and therefore are difficult to solve, deep inverse models (DIMs) have achieved impressive results often surpassing capabilities possible with other approaches. We overview the process of deep inverse learning applied to AEM problems, including the building of data sets, design of a forward model, and comparison of inverse approaches including limitations. We conclude by detailing some important outstanding issues of deep inverse design of AEMs, and present an outlook of this exciting field.

42 ENGINEERING↗

Inverse deep learning methods and benchmarks for artificial electromagnetic material design

In this work we investigate the use of deep inverse models (DIMs) for designing artificial electromagnetic materials (AEMs) – such as metamaterials, photonic crystals, and plasmonics – to achieve some desired scattering properties (e.g., transmission or reflection spectrum). DIMs are deep neural networks (i.e., deep learning models) that are specially-designed to solve ill-posed inverse problems. There has recently been tremendous growth in the use of DIMs for solving AEM design problems however there has been little comparison of these approaches to examine their absolute and relative performance capabilities. In this work we compare eight state-of-the-art DIMs on three unique AEM design problems, including two models that are novel to the AEM community. Our results indicate that DIMs can rapidly produce accurate designs to achieve a custom desired scattering on all three problems. Although no single model always performs best, the Neural-Adjoint approach achieves the best overall performance across all problem settings. As a final contribution we show that not all AEM design problems are ill-posed, and in such cases a conventional deep neural network can perform better than DIMs. We recommend that a deep neural network is always employed as a simple baseline approach when addressing AEM design problems. Furthermore, we publish python code for our AEM simulators and our DIMs to enable easy replication of our results, and benchmarking of new DIMs by the AEM community.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Deep Learning the Electromagnetic Properties of Metamaterials—A Comprehensive Review

Deep neural networks (DNNs) are empirically derived systems that have transformed traditional research methods, and are driving scientific discovery. Here, artificial electromagnetic materials (AEMs)—including electromagnetic metamaterials, photonic crystals, and plasmonics—are research fields where DNN results valorize the data driven approach; especially in cases where conventional methods have failed. In view of the great potential of deep learning for the future of artificial electromagnetic materials research, the status of the field with a focus on recent advances, key limitations, and future directions is reviewed. Strategies, guidance, evaluation, and limits of using deep networks for both forward and inverse AEM problems are presented.

14 SOLAR ENERGY↗

Neural-adjoint method for the inverse design of all-dielectric metasurfaces

All-dielectric metasurfaces exhibit exotic electromagnetic responses, similar to those obtained with metal-based metamaterials. Research in all-dielectric metasurfaces currently uses relatively simple unit-cell designs, but increased geometrical complexity may yield even greater scattering states. Although machine learning has recently been applied to the design of metasurfaces with impressive results, the much more challenging task of finding a geometry that yields a desired spectra remains largely unsolved. We propose and demonstrate a method capable of finding accurate solutions to ill-posed inverse problems, where the conditions of existence and uniqueness are violated. A specific example of finding the metasurface geometry which yields a radiant exitance matching the external quantum efficiency of gallium antimonide is demonstrated. We also show how the neural-adjoint method can intelligently grow the design search space to include designs that increasingly and accurately approximate the desired scattering response. The neural-adjoint method is not restricted to the case demonstrated and may be applied to plasmonics, photonic crystal, and other artificial electromagnetic materials.

42 ENGINEERING↗