Search NASA⌕ Search

Engineering topics

Zheng, Hanyu

Publications and source records attributed to Zheng, Hanyu.

Multichannel meta-imagers for accelerating machine vision

Rapid developments in machine vision technology have impacted a variety of applications, such as medical devices and autonomous driving systems. These achievements, however, typically necessitate digital neural networks with the downside of heavy computational requirements and consequent high energy consumption. As a result, real-time decision-making is hindered when computational resources are not readily accessible. Here we report a meta-imager designed to work together with a digital back end to offload computationally expensive convolution operations into high-speed, low-power optics. Further, in this architecture, metasurfaces enable both angle and polarization multiplexing to create multiple information channels that perform positively and negatively valued convolution operations in a single shot. We use our meta-imager for object classification, achieving 98.6% accuracy in handwritten digits and 88.8% accuracy in fashion images. Owing to its compactness, high speed and low power consumption, our approach could find a wide range of applications in artificial intelligence and machine vision applications.

47 OTHER INSTRUMENTATION↗

Digital Modeling on Large Kernel Metamaterial Neural Network

Deep neural networks (DNNs) utilized recently are physically deployed with computational units (e.g., CPUs and GPUs). Such a design might lead to a heavy computational burden, significant latency, and intensive power consumption, which are critical limitations in applications such as Internet of Things (IoT), edge computing, and usage of drones. Recent advances in optical computational units (e.g., metamaterial) have shed light on energy-free and light-speed neural networks. However, the digital design of the metamaterial neural network (MNN) is fundamentally limited by its physical limitations, such as precision, noise, and bandwidth during fabrication. Moreover, the unique advantages of MNN’s (e.g., light-speed computation) are not fully explored via standard 3×3 convolution kernels. In this paper, we propose a novel large kernel metamaterial neural network (LMNN) that maximizes the digital capacity of the state-of-the-art (SOTA) MNN with model re-parametrization and network compression, while also considering the optical limitation explicitly. The new digital learning scheme can maximize the learning capacity of MNN while modeling the physical restrictions of meta-optics. With the proposed LMNN, the computation cost of the convolutional front-end can be offloaded to fabricated optical hardware. The experimental results on two publicly available datasets demonstrate that the optimized hybrid design improved classification accuracy while reducing computational latency. In conclusion, the development of the proposed LMNN is a promising step towards the ultimate goal of energy-free and light-speed AI.

97 MATHEMATICS AND COMPUTING↗

Compound Meta-Optics for Complete and Loss-Less Field Control

Optical metasurfaces offer a compact platform for manipulation of the amplitude, phase, and polarization state of light. Independent control over these properties, however, is hindered by the symmetric transmission matrix associated with single-layer metasurfaces. Here, we utilize multilayer birefringent meta-optics to realize high-efficiency, independent control over the amplitude, phase, and polarization state of light. In this work, high-efficiency control is enabled by redistributing the wavefront between cascaded metasurfaces, while end-to-end inverse design is used to realize independent complex-valued functions for orthogonal polarization states. Based on this platform, we demonstrate spatial mode division multiplexing, optical mode conversion, and universal vectorial holograms, all with diffraction efficiencies over 80%. This meta-optic platform expands the design space of flat optics and could lead to advances in optical communications, quantum entanglement, and information encryption.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Meta-optic accelerators for object classifiers

Rapid advances in deep learning have led to paradigm shifts in a number of fields, from medical image analysis to autonomous systems. These advances, however, have resulted in digital neural networks with large computational requirements, resulting in high energy consumption and limitations in real-time decision-making when computation resources are limited. Here, we demonstrate a meta-optic–based neural network accelerator that can off-load computationally expensive convolution operations into high-speed and low-power optics. In this architecture, metasurfaces enable both spatial multiplexing and additional information channels, such as polarization, in object classification. End-to-end design is used to co-optimize the optical and digital systems, resulting in a robust classifier that achieves 93.1% accurate classification of handwriting digits and 93.8% accuracy in classifying both the digit and its polarization state. This approach could enable compact, high-speed, and low-power image and information processing systems for a wide range of applications in machine vision and artificial intelligence.

42 ENGINEERING↗

All-Dielectric Meta-Optics for High-Efficiency Independent Amplitude and Phase Manipulation

Optical metasurfaces, composed of subwavelength scattering elements, demonstrate remarkable control over the transmitted amplitude, phase, and polarization of light. However, manipulating the amplitude upon transmission, without the use of surface waves, requires loss if a single metasurface is used. Herein, high-efficiency independent manipulation of the amplitude and phase of a beam is described using two lossless phase-only metasurfaces separated by a distance. With this configuration, optical components such as combined beam-forming and splitting devices are experimentally demonstrated, as well as those for forming complex-valued, 3D holograms. The compound meta-optic platform provides a promising approach for achieving high-performance holographic displays and compact optical components, while exhibiting a high overall efficiency.

42 ENGINEERING↗

Large-Scale Metasurfaces Based on Grayscale Nanosphere Lithography

Metasurfaces, based on subwavelength structuring, provide a versatile platform for wavefront manipulation in an ultrathin form factor. The manufacturing of metasurfaces, however, generally requires fabrication techniques, such as electron-beam lithography, that are not scalable. One alternative is the use of ultraviolet steppers, but these require significant capital investment and there are challenges in handling the large mask sizes that metasurfaces demand due to the structuring density. In this paper, we propose and demonstrate a novel manufacturing method based on self-assembly of nanospheres in combination with grayscale lithography. This technique enables large-scale metasurfaces with nonperiodic phase profiles while being cost-effective. As a proof of concept, we demonstrate a series of large-scale (1 mm diameter) metalenses demonstrating diffraction-limited focusing as well as holograms. This approach could open new doors to cost-effective and large-scale fabrication of a wide range of metasurface-based optics.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Flat optics for image differentiation

Image processing has become a critical technology in a variety of science and engineering disciplines. Although most image processing is performed digitally, optical analog processing has the advantages of being low-power and high-speed, but it requires a large volume. Here, we demonstrate flat optics for direct image differentiation, allowing us to significantly shrink the required optical system size. We first demonstrate how the differentiator can be combined with traditional imaging systems such as a commercial optical microscope and camera sensor for edge detection with a numerical aperture up to 0.32. We next demonstrate how the entire processing system can be realized as a monolithic compound flat optic by integrating the differentiator with a metalens. The compound nanophotonic system manifests the advantage of thin form factor as well as the ability to implement complex transfer functions, and could open new opportunities in applications such as biological imaging and computer vision.

36 MATERIALS SCIENCE↗

Multifunctional metaoptics based on bilayer metasurfaces

Optical metasurfaces have become versatile platforms for manipulating the phase, amplitude, and polarization of light. A platform for achieving independent control over each of these properties, however, remains elusive due to the limited engineering space available when using a single-layer metasurface. For instance, multiwavelength metasurfaces suffer from performance limitations due to space filling constraints, while control over phase and amplitude can be achieved, but only for a single polarization. Here, we explore bilayer dielectric metasurfaces to expand the design space for metaoptics. The ability to independently control the geometry and function of each layer enables the development of multifunctional metaoptics in which two or more optical properties are independently designed. As a proof of concept, we demonstrate multiwavelength holograms, multiwavelength waveplates, and polarization-insensitive 3D holograms based on phase and amplitude masks. The proposed architecture opens a new avenue for designing complex flat optics with a wide variety of functionalities.

36 MATERIALS SCIENCE↗