Search NASA⌕ Search

Engineering topics

Lee, Kelvin

Publications and source records attributed to Lee, Kelvin.

Super Resolving Unrolled Neural Networks for Remote Sensing

In remote sensing systems, the capabilities of the system are constrained by the complex interactions between size, weight, and power (SWAP) of potential designs. In electro-optical (EO) systems, examples of these critical parameters include the system’s sensitivity and resolution. Those parameters can be increased by ever larger optical apertures and focal planes but at the cost of more SWAP. Multi-image super resolution (MISR) techniques allow resolution to be enhanced via computation rather than more sophisticated optical hardware. These algorithms combine multiple images together into a single, higher resolution image, trading temporal resolution and computation for spatial resolution. Fielded MISR techniques, such as Drizzle, can require several hundred images to create a single super resolved image, implying reduced temporal resolution, increased data acquisition load, and limiting mission applications. Iterative techniques, such as model-based image reconstruction and compressive sensing, have been shown to create super resolved images using fewer images than Drizzle. They do this by posing an optimization problem that balances accuracy between a highly accurate physical model and an image model. In the case of super resolution, the physical model is defined by the relation between low resolution input images and the desired high resolution output image. The image model encodes some assumptions about the super resolved image. These assumptions are meant to suppress reconstruction artifacts that arise due to deterministic physical model error, stochastic measurement noise, and potential undersampling. In practice, the performance of iterative methods are limited by imaging models compatible with optimization. Deep learning-based methods can effectively learn image models of arbitrary complexity, but lack the theoretical explainability and robustness of iterative techniques. Consensus equilibrium (CE) generalizes the iterative techniques beyond optimization, enabling blackbox algorithms such as traditional and neural image denoisers to be used as the image model. CE-based approaches retain much of the explainability and robustness of iterative techniques while allowing the expressiveness of machine learning image models to be used. Additionally, by unrolling iterations of CE with an embedded image denoiser, the image denoiser can be further trained and specialized to the specific application with potentially higher quality reconstructions. Under this project, we demonstrated the feasibility of training an unrolled neural network based upon CE. While we didn’t train one, we showed that the CE process is differentiable and its gradient can be tractably computed. We also explored the usage of a variants of CE akin to generative neural works. Most importantly, we applied the CE framework to a number of problems including non-blind deconvolution, upsampling, single-image super resolution, MISR, event-based sensing, and saturated deconvolution. Our MISR prototype creates high quality reconstructions with an order of magnitude fewer images than previous approaches and, critically, produces these reconstructions fast enough for practical usage.

47 OTHER INSTRUMENTATION↗

Automated Construction of Potential Energy Surfaces Suitable to Describe van der Waals Complexes with Highly Excited Nascent Molecules: The Rotational Spectra of Ar–CS( v ) and Ar–SiS( v )

Some reactions produce extremely hot nascent products which nevertheless can form sufficiently long-lived van der Waals (vdW) complexes—with atoms or molecules from a bath gas—as to be observed via microwave spectroscopy. Theoretical calculations of such unbound resonance states can be much more challenging than ordinary bound-state calculations depending on the approach employed. One encounters not just the floppy, and perhaps multiwelled potential energy surface (PES) characteristic of vdWs complexes, but in addition, one must contend with excitation of the intramolecular modes and its corresponding influence on the PES. Straightforward computation of the (resonance) rovibrational levels of interest, involves the added complication of the unbound nature of the wave function, often treated with techniques such as introducing a complex absorbing potential. Here, we have demonstrated that a simplified approach of making a series of vibrationally effective PESs for the intermolecular coordinates—one for each reaction product vibrational quantum number of interest—can produce vdW levels for the complex with spectroscopic accuracy. This requires constructing a series of appropriately weighted lower-dimensional PESs for which we use our freely available PES-fitting code AUTOSURF. The applications of this study are the Ar–CS and Ar–SiS complexes, which are isovalent to Ar–CO and Ar–SiO, the latter of which we considered in a previously reported study. Using a series of vibrationally effective PESs, rovibrational levels and predicted microwave transition frequencies for both complexes were computed variationally. A series of shifting rotational transition frequencies were also computed as a function of the diatom vibrational quantum number. The predicted transitions were used to guide and inform an experimental effort to make complementary observations. Comparisons are given for the transitions that are within the range of the spectrometer and were successfully recorded. Calculations of the rovibrational level pattern agree to within 0.2% with experimental measurements.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗