Search NASA⌕ Search

SEARCH · Search NASA

Results for “image generator”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Anomaly detection in Hyper Suprime-Cam galaxy images with generative adversarial networks

ABSTRACT The problem of anomaly detection in astronomical surveys is becoming increasingly important as data sets grow in size. We present the results of an unsupervised anomaly detection method using a Wasserstein generative adversarial network (WGAN) on nearly one million optical galaxy images in the Hyper Suprime-Cam (HSC) survey. The WGAN learns to generate realistic HSC-like galaxies that follow the distribution of the data set; anomalous images are defined based on a poor reconstruction by the generator and outlying features learned by the discriminator. We find that the discriminator is more attuned to potentially interesting anomalies compared to the generator, and compared to a simpler autoencoder-based anomaly detection approach, so we use the discriminator-selected images to construct a high-anomaly sample of ∼13 000 objects. We propose a new approach to further characterize these anomalous images: we use a convolutional autoencoder to reduce the dimensionality of the residual differences between the real and WGAN-reconstructed images and perform UMAP clustering on these. We report detected anomalies of interest including galaxy mergers, tidal features, and extreme star-forming galaxies. A follow-up spectroscopic analysis of one of these anomalies is detailed in the Appendix; we find that it is an unusual system most likely to be a metal-poor dwarf galaxy with an extremely blue, higher-metallicity H ii region. We have released a catalogue with the WGAN anomaly scores; the code and catalogue are available at https://github.com/kstoreyf/anomalies-GAN-HSC; and our interactive visualization tool for exploring the clustered data is at https://weirdgalaxi.es.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Feasibility of source-free DAS logging for next-generation borehole imaging

Characterizing and monitoring geologic formations around a borehole are crucial for energy and environmental applications. However, conventional wireline sonic logging usually cannot be used in high-temperature environments nor is the tool feasible for long-term monitoring. We introduce and evaluate the feasibility of a source-free distributed-acoustic-sensing (DAS) logging method based on borehole DAS ambient noise. Our new logging method provides a next-generation borehole imaging tool. The tool is source free because it uses ever-present ambient noises as sources and does not need a borehole sonic source that cannot be easily re-inserted into a borehole after well completion for time-lapse monitoring. The receivers of our source-free DAS logging tool are fiber optic cables cemented behind casing, enabling logging in harsh, high-temperature environments, and eliminating the receiver repeatability issue of conventional wireline sonic logging for time-lapse monitoring. We analyze a borehole DAS ambient noise dataset to obtain root-mean-squares (RMS) amplitudes and use these amplitudes to infer subsurface elastic properties. We find that the ambient noise RMS amplitudes correlate well with anomalies in conventional logging data. The source-free DAS logging tool can advance our ability to characterize and monitor subsurface geologic formations in an efficient and cost-effective manner, particularly in high-temperature environments such as geothermal reservoirs. Further validation of the source-free DAS logging method using other borehole DAS ambient noise data would enable the new logging tool for wider applications.

58 GEOSCIENCES↗
DOE OSTI2020

Unmanned Aerial Vehicle Path Generation for Image Collection to Assist Heliostat Field Optical Characterization

This paper focuses on applications of unmanned aerial vehicles (UAVs) for measuring optical error of heliostats in concentrating solar power (CSP) plants. In CSP, there is a need to measure solar-field optical errors, which is critical for future production improvement as well as for operations and maintenance of a heliostat field. This latter need is particularly challenging because of the large number of heliostats (over 10,000 for a utility-scale power plant) that individually track the sun in the field. To address this issue, a camera-equipped UAV, with an optimized drone flight path developed and uploaded to it, collects images of a precise reflection of the tower on each heliostat to evaluate optical error sources without interrupting plant operation. Generation of the drone path for capturing the reflected images is affected by a number technical and realistic constraints, which include the camera angle used to capture the image, the blocking of the camera view due to surrounding heliostats, the location of the camera in reference to the target heliostat, and the target heliostat position with reference to the tower. The effect of these constraints on calculating the camera position will be discussed in detail in this article. An effective drone-path algorithm is generated to fulfil the need of image collection under various constraints.

concentrated solar power↗
DOE OSTI2024

Ghost imaging second harmonic generation microscopy

A system and methods for ghost imaging second harmonic generation microscopy. Imaging data is collected in parallel, providing faster imagine reconstruction and enabling reconstruction in scattering environments. Ghost imaging, split light beam interacting with a target and a second light beam unimpeded and not required to pass through the same background. A second harmonic generation image is reconstructed from the detected photons.

Wiederrecht, Gary P.↗
DOE OSTI2025

Validation of 3D cryoEM single-particle reconstruction correctness and handedness with Ewald's sphere correction

The correct description of quantum scattering places the observed scattering contributions on the Ewald's sphere and its Friedel mate copy. In electron microscopy, due to the large radius of the Ewald's sphere, these scattering contributions are typically merged during data analysis. We present an approach that separates and factorizes those contributions into real and imaginary components of the image. When an inverted solution is calculated, the map derived from the real component of the image generates an inverted solution, while the map derived from the imaginary component of the image generates an inverted and sign-flipped solution. Therefore, the sign of correlation between reconstructions derived from the real and imaginary components provides the automatic determination of handedness and additional validation for the quality of 3D reconstructions. The factorization and its implementation are robust enough to be routinely used in single-particle reconstructions, even at resolutions below the limit where the curvature of the Ewald's sphere affects the overall signal-to-noise ratio.

Chemistry↗
DOE OSTI2023

NeRVI: Compressive neural representation of visualization images for communicating volume visualization results

We present NeRVI, a new deep-learning approach that compresses a large collection of visualization images generated from time-varying data for communicating volume visualization results. Based on an image-based implicit neural representation, our approach represents tens of thousands of high-resolution rendering images parametrized by different parameters via a hybrid model of multilayer perceptrons and convolutional neural networks. Here, our model predicts images and corresponding masks, and the masks are utilized for loss computation and network training to capture fine structural details and small components. In conjunction with model quantization and weight encoding, NeRVI yields highly compact compressive neural representations while preserving the image fidelity well. We demonstrate the effectiveness of NeRVI with isosurface rendering and direct volume rendering images generated from multiple data sets and compare NeRVI with other state-of-the-art deep learning-based (InSituNet, SIREN, NeRF, and NeRV) methods. Quantitative and qualitative results show that NeRVI provides an alternative solution that augments domain scientists' ability to manage, represent, and communicate scientific visualization output.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

SimLBR: Learning to Detect Fake Images by Learning to Detect Real Images

The rapid advancement of generative models has made the detection of AI-generated images a critical challenge for both research and society. Recent works have shown that most state-of-the-art fake image detection methods overfit to their training data and catastrophically fail when evaluated on curated hard test sets with strong distribution shifts. In this work, we argue that it is more principled to learn a tight decision boundary around the real image distribution and treat the fake category as a sink class. To this end, we propose SimLBR, a simple and efficient framework for fake image detection with Latent Blending Regularization (LBR). Our method significantly improves cross-generator generalization, achieving up to +24.85% accuracy and +69.62% recall on the challenging Chameleon benchmark. SimLBR is also highly efficient, training orders of magnitude faster than existing approaches. Furthermore, we emphasize the need for reliability-oriented evaluation in fake image detection, introducing risk-adjusted metrics and worst-case estimates to better assess model robustness. All the code and models are availabe at: https://github.com/mvrl/SimLBR

Dhakal, Aayush [Washington University, St. Louis]↗
DOE OSTI2023

Imaging systems and related methods including radar imaging with moving arrays or moving targets

Imaging systems, including radio frequency, microwave and millimeter-wave arrangements, and related methods are described. According to one aspect, an imaging system includes an antenna array, a position capture system configured to generate position information indicative of locations of one of the antenna array and the target at the first and second moments in time, and wherein the one of the antenna array and the target move between the first and second moments in time, a transceiver configured to control the antenna array to emit electromagnetic energy towards the target and to generate an output that is indicative of the received electromagnetic energy, a data acquisition system configured to generate radar data, processing circuitry configured to process the position information and the radar data to generate image data regarding the target, and an interface configured to use the image data to generate visual images regarding the target.

Sheen, David M.↗
DOE OSTI2024

Imaging systems and related methods including radar imaging with moving arrays or moving targets

Imaging systems, including radio frequency, microwave and millimeter-wave arrangements, and related methods are described. According to one aspect, an imaging system includes an antenna array, a position capture system configured to generate position information indicative of locations of one of the antenna array and the target at the first and second moments in time, and wherein the one of the antenna array and the target move between the first and second moments in time, a transceiver configured to control the antenna array to emit electromagnetic energy towards the target and to generate an output that is indicative of the received electromagnetic energy, a data acquisition system configured to generate radar data, processing circuitry configured to process the position information and the radar data to generate image data regarding the target, and an interface configured to use the image data to generate visual images regarding the target.

Sheen, David M.↗
DOE OSTI2021

Converting tabular data into images for deep learning with convolutional neural networks

Abstract Convolutional neural networks (CNNs) have been successfully used in many applications where important information about data is embedded in the order of features, such as speech and imaging. However, most tabular data do not assume a spatial relationship between features, and thus are unsuitable for modeling using CNNs. To meet this challenge, we develop a novel algorithm, image generator for tabular data (IGTD), to transform tabular data into images by assigning features to pixel positions so that similar features are close to each other in the image. The algorithm searches for an optimized assignment by minimizing the difference between the ranking of distances between features and the ranking of distances between their assigned pixels in the image. We apply IGTD to transform gene expression profiles of cancer cell lines (CCLs) and molecular descriptors of drugs into their respective image representations. Compared with existing transformation methods, IGTD generates compact image representations with better preservation of feature neighborhood structure. Evaluated on benchmark drug screening datasets, CNNs trained on IGTD image representations of CCLs and drugs exhibit a better performance of predicting anti-cancer drug response than both CNNs trained on alternative image representations and prediction models trained on the original tabular data.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Impact of simulated reduced injected dose on the assessment of amyloid PET scans

To investigate the impact of reduced injected doses on the quantitative and qualitative assessment of the amyloid PET tracers [ 18 F]flutemetamol and [ 18 F]florbetaben. Cognitively impaired and unimpaired individuals (N = 250, 36% Aβ-positive) were included and injected with [ 18 F]flutemetamol (N = 175) or [ 18 F]florbetaben (N = 75). PET scans were acquired in list-mode (90–110 min post-injection) and reduced-dose images were simulated to generate images of 75, 50, 25, 12.5 and 5% of the original injected dose. Images were reconstructed using vendor-provided reconstruction tools and visually assessed for Aβ-pathology. SUVRs were calculated for a global cortical and three smaller regions using a cerebellar cortex reference tissue, and Centiloid was computed. Absolute and percentage differences in SUVR and CL were calculated between dose levels, and the ability to discriminate between Aβ- and Aβ + scans was evaluated using ROC analyses. Finally, intra-reader agreement between the reduced dose and 100% images was evaluated. At 5% injected dose, change in SUVR was 3.72% and 3.12%, with absolute change in Centiloid 3.35CL and 4.62CL, for [ 18 F]flutemetamol and [ 18 F]florbetaben, respectively. At 12.5% injected dose, percentage change in SUVR and absolute change in Centiloid were < 1.5%. AUCs for discriminating Aβ- from Aβ + scans were high (AUC ≥ 0.94) across dose levels, and visual assessment showed intra-reader agreement of > 80% for both tracers. This proof-of-concept study showed that for both [ 18 F]flutemetamol and [ 18 F]florbetaben, adequate quantitative and qualitative assessments can be obtained at 12.5% of the original injected dose. However, decisions to reduce the injected dose should be made considering the specific clinical or research circumstances.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2023

Data Validation Experiments with a Computer-Generated Imagery Dataset for International Nuclear Safeguards

Computer vision models have great potential as tools for international nuclear safeguards verification activities, but off-the-shelf models require fine-tuning through transfer learning to detect relevant objects. Because open-source examples of safeguards-relevant objects are rare, and to evaluate the potential of synthetic training data for computer vision, we present the Limbo dataset. Limbo includes both real and computer-generated images of uranium hexafluoride containers for training computer vision models. Here, we generated these images iteratively based on results from data validation experiments that are detailed here. The findings from these experiments are applicable both for the safeguards community and the broader community of computer vision research using synthetic data.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2020

Camera settings and biome influence the accuracy of citizen science approaches to camera trap image classification

Scientists are increasingly using volunteer efforts of citizen scientists to classify images captured by motion-activated trail cameras. The rising popularity of citizen science reflects its potential to engage the public in conservation science and accelerate processing of the large volume of images generated by trail cameras. While image classification accuracy by citizen scientists can vary across species, the influence of other factors on accuracy is poorly understood. Inaccuracy diminishes the value of citizen science derived data and prompts the need for specific best-practice protocols to decrease error. We compare the accuracy between three programs that use crowdsourced citizen scientists to process images online: Snapshot Serengeti, Wildwatch Kenya, and AmazonCam Tambopata. We hypothesized that habitat type and camera settings would influence accuracy. To evaluate these factors, each photograph was circulated to multiple volunteers. All volunteer classifications were aggregated to a single best answer for each photograph using a plurality algorithm. Subsequently, a subset of these images underwent expert review and were compared to the citizen scientist results. Classification errors were categorized by the nature of the error (e.g., false species or false empty), and reason for the false classification (e.g., misidentification). Our results show that Snapshot Serengeti had the highest accuracy (97.9%), followed by AmazonCam Tambopata (93.5%), then Wildwatch Kenya (83.4%). Error type was influenced by habitat, with false empty images more prevalent in open-grassy habitat (27%) compared to woodlands (10%). For medium to large animal surveys across all habitat types, our results suggest that to significantly improve accuracy in crowdsourced projects, researchers should use a trail camera set up protocol with a burst of three consecutive photographs, a short field of view, and determine camera sensitivity settings based on in situ testing. Accuracy level comparisons such as this study can improve reliability of future citizen science projects, and subsequently encourage the increased use of such data.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Nanoscale chemical imaging with structured X-ray illumination

High-resolution imaging with compositional and chemical sensitivity is crucial for a wide range of scientific and engineering disciplines. Although synchrotron X-ray imaging through spectromicroscopy has been tremendously successful and broadly applied, it encounters challenges in achieving enhanced detection sensitivity, satisfactory spatial resolution, and high experimental throughput simultaneously. In this work, based on structured illumination, we develop a single-pixel X-ray imaging approach coupled with a generative image reconstruction model for mapping the compositional heterogeneity with nanoscale resolvability. This method integrates a full-field transmission X-ray microscope with an X-ray fluorescence detector and eliminates the need for nanoscale X-ray focusing and raster scanning. We experimentally demonstrate the effectiveness of our approach by imaging a battery sample composed of mixed cathode materials and successfully retrieving the compositional variations of the imaged cathode particles. Bridging the gap between structural and chemical characterizations using X-rays, this technique opens up vast opportunities in the fields of biology, environmental, and materials science, especially for radiation-sensitive samples.

Li, Jizhou↗
DOE OSTI2020

Monte Carlo control loops for cosmic shear cosmology with DES Year 1 data

Weak lensing by large-scale structure is a powerful probe of cosmology and of the dark universe. This cosmic shear technique relies on the accurate measurement of the shapes and redshifts of background galaxies and requires precise control of systematic errors. Monte Carlo control loops (MCCL) is a forward modeling method designed to tackle this problem. It relies on the ultra fast image generator (UFig) to produce simulated images tuned to match the target data statistically, followed by calibrations and tolerance loops. Here, we present the first end-to-end application of this method, on the Dark Energy Survey (DES) Year 1 wide field imaging data. We simultaneously measure the shear power spectrum $C_ℓ$ and the redshift distribution $n(z)$ of the background galaxy sample. The method includes maps of the systematic sources, point spread function (PSF), an approximate Bayesian computation (ABC) inference of the simulation model parameters, a shear calibration scheme, and a fast method to estimate the covariance matrix. We find a close statistical agreement between the simulations and the DES Y1 data using an array of diagnostics. In a nontomographic setting, we derive a set of $C_ℓ$ and $n(z)$ curves that encode the cosmic shear measurement, as well as the systematic uncertainty. Following a blinding scheme, we measure the combination of $Ω_m$, $σ_8$, and intrinsic alignment amplitude $A_{IA}$, defined as $S_8D_{IA}=σ_8(Ω_m/0.3)^{0.5}D_{IA}$, where $D_{IA}=1-0.11(A_{IA}-1)$. We find $S_8D_{IA}=0.8954_{-0.039}^{+0.054}$, where systematics are at the level of roughly 60% of the statistical errors. We discuss these results in the context of earlier cosmic shear analyses of the DES Y1 data. Our findings indicate that this method and its fast runtime offer good prospects for cosmic shear measurements with future wide-field surveys.

79 ASTRONOMY AND ASTROPHYSICS↗