Search NASA⌕ Search

SEARCH · Search NASA

Results for “imaging science”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Biomolecular and Characterization Imaging Science Program: 2023 Principal Investigator Meeting Proceedings

The 2023 U.S. Department of Energy (DOE) Biological and Environmental Research (BER) program’s Biomolecular Characterization and Imaging Science (BCIS) Principal Investigator Meeting expanded in scope from previous Bioimaging Science Program (BSP) meetings to include BER Structural Biology and Imaging Resources, which are located largely at DOE Office of Science national laboratories. The BCIS meeting was part of BER’s Biological Systems Science Division (BSSD) annual PI meeting, which was held April 17–19, 2023, and featured parallel meetings of the BCIS and Genomic Science programs (GSP). The meetings were held together to encourage networking and idea exchange across technologies and biological application areas, forging new multidisciplinary collaborations among researchers from adjacent BSSD programmatic areas. Two joint BCIS-GSP sessions were held: “BCIS Technologies for Investigating the Rhizosphere” and “Joint Emerging Topics and Technologies.” The rhizosphere session focused on scientific findings from BCIS and GSP PIs, including national laboratory collaborations. The intent was to identify new opportunities to measure and understand the complex community of microbes, roots, and soils that support plant growth under challenging environmental conditions. The emerging technologies session highlighted forward-looking approaches and tools to tackle challenges within the scope of BSSD research on investigating and modifying genomic and molecular function. A final interactive discussion of the BCIS program was led by plenary session chairs.

59 BASIC BIOLOGICAL SCIENCES↗

Quantitative Scanning Transmission Electron Microscopy for Materials Science: Imaging, Diffraction, Spectroscopy, and Tomography

Scanning transmission electron microscopy (STEM) is one of the most powerful characterization tools in materials science research. Due to instrumentation developments such as highly coherent electron sources, aberration correctors, and direct electron detectors, STEM experiments can examine the structure and properties of materials at length scales of functional devices and materials down to single atoms. STEM encompasses a wide array of flexible operating modes, including imaging, diffraction, spectroscopy, and 3D tomography experiments. This review outlines many common STEM experimental methods with a focus on quantitative data analysis and simulation methods, especially those enabled by open source software. The hope is to introduce both classic and new experimental methods to materials scientists and summarize recent progress in STEM characterization. The review also discusses the strengths and weaknesses of the various STEM methodologies and briefly considers promising future directions for quantitative STEM research.

36 MATERIALS SCIENCE↗

A New Crater Near InSight: Implications for Seismic Impact Detectability on Mars

A new 1.5 m diameter impact crater was discovered on Mars only ~40 km from the InSight lander. Context camera images constrained its formation between 21 February and 6 April 2019; follow-up High Resolution Imaging Science Experiment images resolved the crater. During this time period, three seismic events were identified in InSight data. In this paper, we derive expected seismic signal characteristics and use them to evaluate each of the seismic events. However, none of them can definitively be associated with this source. Atmospheric perturbations are generally expected to be generated during impacts; however, in this case, no signal could be identified as related to the known impact. Using scaling relationships based on the terrestrial and lunar analogs and numerical modeling, we predict the amplitude, peak frequency, and duration of the seismic signal that would have emanated from this impact. The predicted amplitude falls near the lowest levels of the measured seismometer noise for the predicted frequency. Hence, it is not surprising this impact event was not positively identified in the seismic data. Finding this crater was a lucky event as its formation this close to InSight has a probability of only ~0.2, and the odds of capturing it in before and after images are extremely low. We revisit impact-seismic discriminators in light of real experience with a seismometer on the Martian surface. Using measured noise of the instrument, we revise our previous prediction of seismic impact detections downward, from ~a few to tens, to just ~2 per Earth year, still with an order of magnitude uncertainty.

58 GEOSCIENCES↗

Quantum graph learning and algorithms applied in quantum computer sciences and image classification

Graph and network theory play a fundamental role in quantum computer sciences, including quantum information and computation. Random graphs and complex network theory are pivotal in predicting novel quantum phenomena, where entangled links are represented by edges. Quantum algorithms have been developed to enhance solutions for various network problems, giving rise to quantum graph computing and quantum graph learning (QGL). Here, in this review, we explore graph theory and graph learning methods as powerful tools for quantum computers to generate efficient solutions to problems beyond the reach of classical systems. We delve into the development of quantum complex network theory and its applications in quantum computation, materials discovery, and research. We also discuss quantum machine learning (QML) methodologies for effective image classification using qubits, quantum gates, and quantum circuits. Additionally, the paper addresses the challenges of QGL and algorithms, emphasizing the steps needed to develop flexible QGL solvers. This review presents a comprehensive overview of the fields of QGL and QML, highlights recent advancements, and identifies opportunities for future research.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Control Algorithms for Dual-wavefront Sensor Single-conjugate Adaptive Optics

High-contrast imaging systems using active control with adaptive optics (AO) are often limited by non-common path (NCP) aberrations that are seen only at the final science image. AO systems employing focal-plane wavefront sensors (FP-WFSs) are able to simultaneously correct NCP aberrations and measure science images, but they typically require a second stage of control that adds system cost and complexity. We present control algorithms to augment AO systems with FP-WFSs within their existing control setup. We demonstrate inter-arm NCP aberration transfer can be mitigated through temporal filtering, present frequency- and time-domain validation of controller stability and performance, and discuss the optimality of the chosen controllers. This work will enable the development, testing, and installation of FP-WFS technologies for direct imaging of exoplanets.

79 ASTRONOMY AND ASTROPHYSICS↗

Bioimaging Science Program Principal Investigator Meetings Proceedings (2021)

As part of the 2021 Biological Systems Science Division (BSSD) Principal Investigator (PI) Meeting, the Bioimaging Science program (BSP), within BSSD's Biomolecular Characterization and Imaging Science portfolio, held its annual PI meeting virtually February 22–23. BSP's mission is to understand the translation of genomic information into the mechanisms that power living cells, communities of cells, and whole organisms. The goal of BSP is to develop new imaging and measurement technologies to visualize the spatial and temporal relationships of key metabolic processes governing phenotypic expression in plants and microbes. BSP convenes annual PI meetings to bring together its contributing investigators to review progress and current state-of-the-art bioimaging research. Holding the BSP meeting as part of the broader BSSD PI meeting allowed researchers to interact with the extended Genomic Science program community. This convergence provided a platform for networking and exchange of ideas, helping to forge new multidisciplinary collaborations among investigators from the two sister programs. An important highlight of the BSP meeting was the keynote presentation “Enhancing Fluorescence Microscopy with Computation” by Dr. Hari Shroff of the NIH National Institute of Biomedical Imaging and Bioengineering. All the BSP PIs made presentations describing their research focus and progress, and these were followed by roundtable discussions of each project. The meeting’s proceedings provide an outline of the program’s current state and potential future directions and opportunities.

59 BASIC BIOLOGICAL SCIENCES↗

RTN-117: Image Calibration and Instrument Signal Removal for the First Year of the LSST

The NSF-DOE Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST) requires calibration products that provide uniform, stable, and accurate photometric and astrometric performance across the 3.2 gigapixel focal plane and throughout the 10-year survey. This paper details the algorithms and workflows used to produce instrument calibrations and remove instrumental artifacts for Data Preview 2 (DP2)---the first end-to-end processing demonstration using on-sky data with the LSST Camera (LSSTCam). We describe the verification, acceptance, and certification framework used to assess calibration quality and quantify residual systematics. We show baseline metrics on calibrated science images to evaluate the robustness of the calibration and instrument signature removal (ISR) data processing pipelines for DP2. Finally, we summarize the known limitations observed in DP2 production and outline expected algorithmic improvements for the first public LSST data release (Data Release~1, DR1).

79 ASTRONOMY AND ASTROPHYSICS↗

What lies beneath: Vertical temperature heterogeneity in a Mediterranean woodland savanna

As the availability of satellite and airborne thermal infrared remote sensing (TIR-RS) data increases and their spatial, temporal, and spectral resolutions improve, researchers are finding diverse applications for TIR-RS measurements. TIR-RS is now commonly applied in regional- and continental-scale analyses, such as those focused on fire and surface energy balance. However, its application lags in plant physiology and ecology, for which a finer-scale understanding of plant canopy temperatures would be useful to elucidate plant water dynamics, for example. In particular, while methods to disaggregate TIR-RS pixels in horizontal space have advanced, possible vertical stratification of plant canopy temperature and its implications for understanding the correspondence between TIR-RS and finer-scale, field-based thermal measurements (e.g. made with a thermal camera) remain unexplored. Here, we use data from a thermal camera deployed concurrently with the recent ECOSTRESS mission to quantify vertical temperature gradients within tree canopies and temperatures of over- vs. under-story plants in a Mediterranean woodland savanna. We then leverage diverse ancillary data to maximize the geometric comparability of ECOSTRESS and thermal camera measurements, in order to assess the extent to which the two forms of thermal measurements correspond. Specifically, we ask: (1) What are the patterns of intra-canopy and over- vs. under-story vertical temperature in a Mediterranean woodland savanna?, and (2) How can vertically-resolved, but spatially-limited field-based temperature measurements be reconciled with spatially-extensive, but surface-only, temperature measurements of a space-borne remote sensor? Further, we found consistent patterns of vertical thermal heterogeneity both within tree canopies and between ecosystem over- and under-stories. The daytime difference between the top and bottom thirds of blue oak canopies was, on average, 0.48 ° C – and sometimes several times larger. Notably, canopy tops are cooler, likely associated with the under-story grass reaching daytime temperatures often exceeding over-story temperatures by 10° C. Given the consistency of the intra-canopy temperature gradients, we expected the ECOSTRESS sensor would be in better agreement with camera measurements of canopy tops than bulk canopies or canopy bottoms. However, within-canopy gradients were overwhelmed by other sources of disagreement between the measurements, in part associated with upscaling camera measurements across space. Overall, thermal camera and ECOSTRESS measurements were largely in agreement at night (pixel RMSE = 1.1°C), but they were more divergent during times of low (but >0 W/m2) and high incoming solar radiation (daytime pixel RMSE = 3.5°C).

54 ENVIRONMENTAL SCIENCES↗

Synchrotron infrared nano-spectroscopy and -imaging

Infrared (IR) spectroscopy has evolved into a powerful analytical technique to probe molecular and lattice vibrations, low-energy electronic excitations and correlations, and related collective surface plasmon, phonon, or other polaritonic resonances. In combination with scanning probe microscopy, near-field infrared nano-spectroscopy and -imaging techniques have recently emerged as a frontier in imaging science, enabling the study of complex heterogeneous materials with simultaneous nanoscale spatial resolution and chemical and quantum state spectroscopic specificity. Here, we describe synchrotron infrared nano-spectroscopy (SINS), which takes advantage of the low-noise, broadband, high spectral irradiance, and coherence of synchrotron infrared radiation for near-field infrared measurements across the mid- to far-infrared with nanometer spatial resolution. This powerful combination provides a qualitatively new form of broadband spatio-spectral analysis of nanoscale, mesoscale, and surface phenomena that were previously difficult to study with IR techniques, or even any form of micro-spectroscopy in general. We review the development of SINS, describe its technical implementations, and highlight selected examples representative of the rapidly growing range of applications in physics, chemistry, biology, materials science, geology, and atmospheric and space sciences.

47 OTHER INSTRUMENTATION↗

Leveraging Multitime Hamilton–Jacobi PDEs for Certain Scientific Machine Learning Problems

Hamilton-Jacobi partial differential equations (HJ PDEs) have deep connections with a wide range of fields, including optimal control, differential games, and imaging sciences. By considering the time variable to be a higher dimensional quantity, HJ PDEs can be extended to the multi-time case. In this paper, we establish a novel theoretical connection between specific optimization problems arising in machine learning and the multi-time Hopf formula, which corresponds to a representation of the solution to certain multi-time HJ PDEs. Through this connection, we increase the interpretability of the training process of certain machine learning applications by showing that when we solve these learning problems, we also solve a multi-time HJ PDE and, by extension, its corresponding optimal control problem. As a first exploration of this connection, we develop the relation between the regularized linear regression problem and the Linear Quadratic Regulator (LQR). We then leverage our theoretical connection to adapt standard LQR solvers (namely, those based on the Riccati ordinary differential equations) to design new training approaches for machine learning. Lastly, we provide some numerical examples that demonstrate the versatility and possible computational advantages of our Riccati-based approach in the context of continual learning, post-training calibration, transfer learning, and sparse dynamics identification.

97 MATHEMATICS AND COMPUTING↗

Deep nonparametric estimation of operators between infinite dimensional spaces

Learning operators between infinitely dimensional spaces is an important learning task arising in machine learning, imaging science, mathematical modeling and simulations, etc. This paper studies the nonparametric estimation of Lipschitz operators using deep neural networks. Non-asymptotic upper bounds are derived for the generalization error of the empirical risk minimizer over a properly chosen network class. Under the assumption that the target operator exhibits a low dimensional structure, our error bounds decay as the training sample size increases, with an attractive fast rate depending on the intrinsic dimension in our estimation. Our assumptions cover most scenarios in real applications and our results give rise to fast rates by exploiting low dimensional structures of data in operator estimation. We also investigate the influence of network structures (e.g., network width, depth, and sparsity) on the generalization error of the neural network estimator and propose a general suggestion on the choice of network structures to maximize the learning efficiency quantitatively.

97 MATHEMATICS AND COMPUTING↗

Deep Nonparametric Estimation of Operators between Infinite Dimensional Spaces

Learning operators between infinitely dimensional spaces is an important learning task arising in machine learning, imaging science, mathematical modeling and simulations, etc. This paper studies the nonparametric estimation of Lipschitz operators using deep neural networks. Non-asymptotic upper bounds are derived for the generalization error of the empirical risk minimizer over a properly chosen network class. Under the assumption that the target operator exhibits a low dimensional structure, our error bounds decay as the training sample size increases, with an attractive fast rate depending on the intrinsic dimension in our estimation. Our assumptions cover most scenarios in real applications and our results give rise to fast rates by exploiting low dimensional structures of data in operator estimation. We also investigate the influence of network structures (e.g., network width, depth, and sparsity) on the generalization error of the neural network estimator and propose a general suggestion on the choice of network structures to maximize the learning efficiency quantitatively.

97 MATHEMATICS AND COMPUTING↗

Potential of Attosecond Coherent Diffractive Imaging

Attosecond science has been transforming our understanding of electron dynamics in atoms, molecules, and solids. However, to date almost all of the attoscience experiments have been based on spectroscopic measurements because attosecond pulses have intrinsically very broad spectra due to the uncertainty principle and are incompatible with conventional imaging systems. In this paper we report an important advance towards achieving attosecond coherent diffractive imaging. Using simulated attosecond pulses, we simultaneously reconstruct the spectrum, 17 probes, and 17 spectral images of extended objects from a set of ptychographic diffraction patterns. We further confirm the principle and feasibility of this method by successfully performing a ptychographic coherent diffractive imaging experiment using a light-emitting diode with a broad spectrum. We believe this work clears the way to an unexplored domain of attosecond imaging science, which could have a far-reaching impact across different disciplines.

36 MATERIALS SCIENCE↗

Microparticle cloud imaging and tracking for data-driven plasma science

Oceans of image and particle track data encountered in plasma interactions with microparticle clouds motivate development and applications of machine-learning (ML) algorithms. A local-constant-velocity tracker, a Kohonen neural network or self-organizing map, the feature tracking kit, and U-Net are described and compared with each other for microparticle cloud datasets generated from exploding wires, dusty plasmas, and atmospheric plasmas. Particle density and the signal-to-noise ratio have been identified as two important factors that affect the tracking accuracy. Fast Fourier transform is used to reveal how U-Net, a deep convolutional neural network developed for non-plasma applications, achieves the improvements for noisy scenes. Viscous effects are revealed in the ballistic motions of the particles from the exploding wires and atmospheric plasmas. Subdiffusion of microparticles satisfying Δr 2 ∝t k (k=0.84±0.02) is obtained from the dusty plasma datasets. Microparticle cloud imaging and tracking, when enhanced with data and ML models, present new possibilities for plasma physics.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗