Search NASA⌕ Search

SEARCH · Search NASA

Results for “image based modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Foundation Models for Zero-Shot Segmentation of Scientific Images without AI-Ready Data

Zero-shot and prompt-based models have excelled at visual reasoning tasks by leveraging large-scale natural image corpora, but they often fail on sparse and domain-specific scientific image data. We introduce Zenesis, a no-code interactive computer vision platform designed to reduce data readiness bottlenecks in scientific imaging workflows. Zenesis integrates lightweight multimodal adaptation for zero-shot inference on raw scientific data, human-in-the-loop refinement, and heuristic-based temporal enhancement. We validate our approach on Focused Ion Beam Scanning Electron Microscopy (FIB-SEM) datasets of catalyst-loaded membranes. Zenesis outperforms baselines, achieving an average accuracy of 0.947, Intersection over Union (IoU) of 0.858, and Dice score of 0.923 on amorphous catalyst samples; and 0.987 accuracy, 0.857 IoU, and 0.923 Dice on crystalline samples. These results represent a significant performance gain over conventional methods such as Otsu thresholding and standalone models like the Segment Anything Model (SAM). Zenesis enables effective image segmentation in domains where annotated datasets are limited, offering a scalable solution for scientific discovery.

Mukherjee, Shubhabrata↗
DOE OSTI2024

Score-based diffusion models for generating liquid argon time projection chamber images

For the first time, we show high-fidelity generation of Liquid Argon Time Projection Chamber (LArTPC-like) data using a generative neural network. This demonstrates that methods developed for natural images do transfer to LArTPC-produced images, which, in contrast to natural images, are globally sparse but locally dense. We present the score-based diffusion method employed. We evaluate the fidelity of the generated images using several quality metrics, including modified measures used to evaluate natural images, comparisons between high-dimensional distributions, and comparisons relevant to LArTPC experiments. Published by the American Physical Society 2024

Astronomy & Astrophysics↗
DOE OSTI2020

How Low Can You Go? Using Synthetic 3D Imagery to Drastically Reduce Real-World Training Data for Object Detection

Deep convolutional neural networks (DCNNs) currently provide state-of-the-art performance on image classification and object detection tasks, and there are many global security mission areas where such models could be extremely useful. Crucially, the success of these models is driven in large part by the widespread availability of high-quality open source data sets such as Image Net, Common Objects in Context (COCO), and KITTI, which contain millions of images with thousands of unique labels. However, global security relevant objects-of-interest can be difficult to obtain: relevant events are low frequency and high consequence; the content of relevant images is sensitive; and adversaries and proliferators seek to obscure their activities. For these cases where exemplar data is hard to come-by, even fine-tuning an existing model with available data can be effectively impossible. Recent work demonstrated that models can be trained using a combination of real-world and synthetic images generated from 3D representations; that such models can exceed the performance of models trained using real-world data alone; and that the generated images need not be perfectly realistic (Tremblay, et al., 2018). However, this approach still required hundreds to thousands of real-world images for training and fine tuning, which for sparse, global security-relevant datasets can be an unrealistic hurdle. In this research, we validate the performance and behavior of DCNN models as we drive the number of real-world images used for training object detection tasks down to a minimal set. We perform multiple experiments to identify the best approach to train DCNNs from an extremely small set of real-world images. In doing so, we: Develop state-of-the-art, parameterized 3D models based on real-world images and sample from their parameters to increase the variance in synthetic image training data; Use machine learning explainability techniques to highlight and correct through targeted training the biases that result from training using completely synthetic images; and Validate our results by comparing the performance of the models trained on synthetic data to one another, and to a control model created by fine-tuning an existing ImageNet-trained model with a limited number (hundreds) of real-world images.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2018

Regional evapotranspiration from an image-based implementation of the Surface Temperature Initiated Closure (STIC1.2) model and its validation across an aridity gradient in the conterminous US

Recent studies have highlighted the need for improved characterizations of aerodynamic conductance and temperature (g A and T 0 ) in thermal remote-sensing-based surface energy balance (SEB) models to reduce uncertainties in regional-scale evapotranspiration (ET) mapping. By integrating radiometric surface temperature (TR) into the Penman–Monteith (PM) equation and finding analytical solutions of gA and T0, this need was recently addressed by the Surface Temperature Initiated Closure (STIC) model. However, previous implementations of STIC were confined to the ecosystem-scale using flux tower observations of infrared temperature. This study demonstrates the first regional-scale implementation of the most recent version of the STIC model (STIC1.2) that integrates the Moderate Resolution Imaging Spectroradiometer (MODIS) derived TR and ancillary land surface variables in conjunction with NLDAS (North American Land Data Assimilation System) atmospheric variables into a combined structure of the PM and Shuttleworth–Wallace (SW) framework for estimating ET at 1 km × 1 km spatial resolution. Evaluation of STIC1.2 at 13 core AmeriFlux sites covering a broad spectrum of climates and biomes across an aridity gradient in the conterminous US suggests that STIC1.2 can provide spatially explicit ET maps with reliable accuracies from dry to wet extremes. When observed ET from one wet, one dry, and one normal precipitation year from all sites were combined, STIC1.2 explained 66 % of the variability in observed 8-day cumulative ET with a root mean square error (RMSE) of 7.4 mm/8-day, mean absolute error (MAE) of 5 mm/8-day, and percent bias (PBIAS) of -4 %. These error statistics showed relatively better accuracies than a widely used but previous version of the SEB-based Surface Energy Balance System (SEBS) model, which utilized a simple NDVI-based parameterization of surface roughness (z OM ), and the PM-based MOD16 ET. SEBS was found to overestimate (PBIAS = 28 %) and MOD16 was found to underestimate ET (PBIAS =-26 %). The performance of STIC1.2 was better in forest and grassland ecosystems as compared to cropland (20 % underestimation) and woody savanna (40 % overestimation). Model inter-comparison suggested that ET differences between the models are robustly correlated with g A and associated roughness length estimation uncertainties which are intrinsically connected to T R uncertainties, vapor pressure deficit (D A ), and vegetation cover. A consistent performance of STIC1.2 in a broad range of hydrological and biome categories, as well as the capacity to capture spatio-temporal ET signatures across an aridity gradient, points to the potential for this simplified analytical model for near-real-time ET mapping from regional to continental scales.

Bhattarai, Nishan (ORCID:0000000327493549)↗
DOE OSTI2022

Epidural anesthesia needle guidance by forward-view endoscopic optical coherence tomography and deep learning

Epidural anesthesia requires injection of anesthetic into the epidural space in the spine. Accurate placement of the epidural needle is a major challenge. To address this, we developed a forward-view endoscopic optical coherence tomography (OCT) system for real-time imaging of the tissue in front of the needle tip during the puncture. We tested this OCT system in porcine backbones and developed a set of deep learning models to automatically process the imaging data for needle localization. A series of binary classification models were developed to recognize the five layers of the backbone, including fat, interspinous ligament, ligamentum flavum, epidural space, and spinal cord. The classification models provided an average classification accuracy of 96.65%. During puncture, it is important to maintain a safe distance between the needle tip and the dura mater. Regression models were developed to estimate that distance based on the OCT imaging data. Based on the Inception architecture, our models achieved a mean absolute percentage error of 3.05% ± 0.55%. Overall, our results validated the technical feasibility of using this novel imaging strategy to automatically recognize different tissue structures and measure the distances ahead of the needle tip during the epidural needle placement.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2019

CT-based machine learning model to predict the Fuhrman nuclear grade of clear cell renal cell carcinoma

Purpose: To predict the Fuhrman grade of clear cell renal cell carcinoma (ccRCC) with a machine learning classifier based on single- or three-phase computed tomography (CT) images. Materials and methods: Patients with pathologically proven ccRCC from February 1, 2009 to September 31, 2018 who were not treated were retrospectively collected for machine learning-based analysis. The texture features were extracted and ranked from precontrast phase (PCP), corticomedullary phase (CMP), nephrographic phase (NP) and three-phase CT images, and open-source gradient boosting from the decision tree library of CatBoost was used to establish a machine learning classifier to differentiate low- from high-grade ccRCC. The performances of machine learning classifiers based on features from single- and three-phase CT images were compared with each other. Results: A total of 231 patients with 232 pathologically proven ccRCC lesions were retrospectively collected. 35, 36, 41, and 22 Features were extracted and ranked from PCP, CMP, NP, and three-phase CT images, respectively. The machine learning model based on three-phase CT images [area under the ROC curve (AUC) = 0.87] achieved the best diagnostic performance for differentiating low- from high-grade ccRCC, followed by single-phase NP (AUC = 0.84), CMP (AUC = 0.80), and PCP images (AUC = 0.82). Conclusion: Machine learning classifiers can be promising noninvasive techniques to differentiate low- and high-Fuhrman nuclear grade ccRCC, and classifiers based on three-phase CT images are superior to those based on features from each single phase.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2021

Generative Patch Priors for Practical Compressive Image Recovery

In this work, we propose the generative patch prior (GPP) that defines a generative prior for compressive image recovery, based on patch-manifold models. Unlike learned, image-level priors that are restricted to the range space of a pre-trained generator, GPP can recover a wide variety of natural images using a pre-trained patch generator. Additionally, GPP retains the benefits of generative priors like high reconstruction quality at extremely low sensing rates, while also being much more generally applicable. We show that GPP outperforms several unsupervised and supervised techniques on three different sensing models – linear compressive sensing with known, and unknown calibration settings, and the non-linear phase retrieval problem. Finally, we propose an alternating optimization strategy using GPP for joint calibration-and-reconstruction which performs favorably against several baselines on a real world, uncalibrated compressive sensing dataset. The code and models for GPP are available on github.

compressed sensing↗
DOE OSTI2022

FFT-based model for irradiated aggregate microstructures in concrete

The concrete biological shield of light water reactors is exposed to neutron and gamma irradiation throughout its lifetime, which results in the long-term degradation of the concrete’s mechanical properties. Under neutron irradiation, the concrete’s aggregates are subjected to radiation-induced volumetric expansion (RIVE), which strongly depends on the mineral content of the aggregate and exhibits the largest expansion in silicate-bearing minerals. In this work, the authors used the fast Fourier transform-based code Microstructure-Oriented Scientific Analysis of Irradiated Concrete (MOSAIC) in 2D to model the expansion of five different aggregates provided by the Japan Concrete Aging Management Program (JCAMP). Comparable rock specimens were irradiated at the JEEP-II test reactor. The model uses realistic aggregate microstructure reconstruction based on high-resolution characterization images. The model accounts for anisotropic RIVE, thermal expansion, and the associated initiation and propagation of damage. The RIVE models are calibrated based on expansion data in the literature. The authors assume that damage occurs exclusively at interfaces between the particles that compose an aggregate and that these interfaces also exhibit swelling. Using a micromechanical model, the evolution of Young’s modulus with RIVE is calculated for each aggregate and compared with Russian irradiation data. The modeled linear expansion agrees well with the experimentally measured expansion. Furthermore, the model also predicts that anisotropic RIVE and thermal expansion result in an earlier onset of damage with neutron fluence than in the isotropic case.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Lowering and Runtime Support for Fortran’s Multi-Image Parallel Features using LLVM Flang, PRIF, and Caffeine

This paper provides an overview of the multi-image parallel features in Fortran 2023 and their implementation in the LLVM flang compiler and the Caffeine parallel runtime library. The features of interest support a Single-Program, Multiple-Data (SPMD) programming model based on executing multiple “images”, each of which is a program instance. The features also support a Partitioned Global Address Space (PGAS) in the form of “coarray” distributed data structures. The paper discusses the lowering of multi-image features to the Parallel Runtime Interface for Fortran (PRIF) and the implementation of PRIF in the Caffeine parallel runtime library. This paper also provides an early view into the design of a new multi-image dialect of the LLVM Multi-Level Intermediate Representation (MLIR). We describe validation and testing of the resulting software stack, and demonstrate that performance compares favorably to another open-source compiler and runtime library: GNU Compiler Collection (GCC) gfortran and OpenCoarrays, respectively.

Bonachea, Dan↗
DOE OSTI2025

Deep inference of simulated strong lenses in ground-based surveys

The large number of strong lenses discoverable in future astronomical surveys will likely enhance the value of strong gravitational lensing as a cosmic probe of dark energy and dark matter. However, leveraging the increased statistical power of such large samples will require further development of automated lens modeling techniques. We show that deep learning and simulation-based inference (SBI) methods produce informative and reliable estimates of parameter posteriors for strong lensing systems in ground-based surveys. We present the examination and comparison of two approaches to lens parameter estimation for strong galaxy-galaxy lenses — Neural Posterior Estimation (NPE) and Bayesian Neural Networks (BNNs). We perform inference on 1-, 5-, and 12-parameter lens models for ground-based imaging data that mimics the Dark Energy Survey (DES). We find that NPE outperforms BNNs, producing posterior distributions that are more accurate, precise, and well-calibrated for most parameters. For the 12-parameter NPE model, the calibration is consistently within <10% of optimal calibration for all parameters, while the BNN is rarely within 20% of optimal calibration for any of the parameters. Similarly, residuals for most of the parameters are smaller (by up to an order of magnitude) with the NPE model than the BNN model. This work takes important steps in the systematic comparison of methods for different levels of model complexity.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

RELICS: A Very Large ( θ E ~ 40") Cluster Lens—RXC J0032.1+1808

Extensive surveys with the Hubble Space Telescope over the past decade, targeting some of the most massive clusters in the sky, have uncovered dozens of galaxy cluster strong lenses. The massive cluster strong-lens scale is typically θ E ~ 10'' to ~30''–35'', with only a handful of clusters known with Einstein radii θ E ~ 40'' or above (for z source = 2, nominally). Here we report another very large cluster lens, RXC J0032.1+1808 (z = 0.3956), the second-richest cluster in the redMapper cluster catalog and the 85th most massive cluster in the Planck Sunyaev–Zel'dovich catalog. With our light-traces-mass and fully parametric approaches, we construct strong-lensing models based on 18 multiple images of five background galaxies newly identified in the Hubble data, mainly from the Reionization Lensing Cluster Survey (RELICS), in addition to a known sextuply imaged system in this cluster. Furthermore, we compare these models to Lenstool and GLAFIC models that were produced independently as part of the RELICS program. All models reveal a large effective Einstein radius of θ E ≃ 40'' (z source = 2), owing to the obvious concentration of substructures near the cluster center. Although RXC J0032.1+1808 has a very large critical area and high lensing strength, only three magnified high-redshift candidates are found within the field targeted by RELICS. Nevertheless, we expect many more high-redshift candidates will be seen in wider and deeper observations with Hubble or the James Webb Space Telescope. Finally, the comparison between several algorithms demonstrates that the total error budget is largely dominated by systematic uncertainties.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS2012

GPR Imaging for Deeply Buried Objects: A Comparative Study Based on FDTD Models and Field Experiments

Conventional use of Ground Penetrating Radar (GPR) is hampered by variations in background environmental conditions, such as water content in soil, resulting in poor repeatability of results over long periods of time when the radar pulse characteristics are kept the same. Target objects types might include voids, tunnels, unexploded ordinance, etc. The long-term objective of this work is to develop methods that would extend the use of GPR under various environmental and soil conditions provided an optimal set of radar parameters (such as frequency, bandwidth, and sensor configuration) are adaptively employed based on the ground conditions. Towards that objective, developing Finite Difference Time Domain (FDTD) GPR models, verified by experimental results, would allow us to develop analytical and experimental techniques to control radar parameters to obtain consistent GPR images with changing ground conditions. Reported here is an attempt at developing 20 and 3D FDTD models of buried targets verified by two different radar systems capable of operating over different soil conditions. Experimental radar data employed were from a custom designed high-frequency (200 MHz) multi-static sensor platform capable of producing 3-D images, and longer wavelength (25 MHz) COTS radar (Pulse EKKO 100) capable of producing 2-D images. Our results indicate different types of radar can produce consistent images.

Tilley, roger↗
NASA NTRS1989

Neural networks for data compression and invariant image recognition

An approach to invariant image recognition (I2R), based upon a model of biological vision in the mammalian visual system (MVS), is described. The complete I2R model incorporates several biologically inspired features: exponential mapping of retinal images, Gabor spatial filtering, and a neural network associative memory. In the I2R model, exponentially mapped retinal images are filtered by a hierarchical set of Gabor spatial filters (GSF) which provide compression of the information contained within a pixel-based image. A neural network associative memory (AM) is used to process the GSF coded images. We describe a 1-D shape function method for coding of scale and rotationally invariant shape information. This method reduces image shape information to a periodic waveform suitable for coding as an input vector to a neural network AM. The shape function method is suitable for near term applications on conventional computing architectures equipped with VLSI FFT chips to provide a rapid image search capability.

Gardner, Sheldon↗
DOE OSTI2022

The Andromeda gamma-ray excess: background systematics of the millisecond pulsars and dark matter interpretations

ABSTRACT Since the discovery of an excess in gamma rays in the direction of M31, its cause has been unclear. Published interpretations focus on dark matter or stellar related origins. Studies of a similar excess in the Milky Way centre motivate a correlation of the spatial morphology of the signal with the distribution of stellar mass in M31. However, a robust determination of the best theory for the observed excess emission is challenging due to uncertainties in the astrophysical gamma-ray foreground model. We perform a spectro-morphological analysis of the M31 gamma-ray excess using state-of-the-art templates for the distribution of stellar mass in M31 and novel astrophysical foreground models for its sky region. We construct maps for the old stellar populations of M31 based on data from the PAndAS survey and carefully remove the foreground stars. We also produce improved astrophysical foreground models via novel image inpainting techniques based on machine learning methods. Our stellar maps, mimicking the location of a population of millisecond pulsars in the bulge of M31, reach a 5.4σ significance, making them as strongly favoured as the simple phenomenological models usually considered in the literature, e.g. disc-like templates. This detection is robust to generous variations of the astrophysical foreground model. Once the stellar templates are included in the astrophysical model, we show that the dark matter annihilation interpretation of the signal is unwarranted. We demonstrate that about one million unresolved millisecond pulsars naturally explain the observed gamma-ray luminosity per stellar mass, energy spectrum, and stellar bulge-to-disc flux ratio.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS2011

Simulated Seasonal Spatio-Temporal Patterns of Soil Moisture, Temperature, and Net Radiation in a Deciduous Forest

The temperature and moisture regimes in a forest are key components in the forest ecosystem dynamics. Observations and studies indicate that the internal temperature distribution and moisture content of the tree influence not only growth and development, but onset and cessation of cambial activity [1], resistance to insect predation[2], and even affect the population dynamics of the insects [3]. Moreover, temperature directly affects the uptake and metabolism of population from the soil into the tree tissue [4]. Additional studies show that soil and atmospheric temperatures are significant parameters that limit the growth of trees and impose treeline elevation limitation [5]. Directional thermal infrared radiance effects have long been observed in natural backgrounds [6]. In earlier work, we illustrated the use of physically-based models to simulate directional effects in thermal imaging [7-8]. In this paper, we illustrated the use of physically-based models to simulate directional effects in thermal, and net radiation in a adeciduous forest using our recently developed three-dimensional, macro-scale computational tool that simulates the heat and mass transfer interaction in a soil-root-stem systems (SRSS). The SRSS model includes the coupling of existing heat and mass transport tools to stimulate the diurnal internal and external temperatures, internal fluid flow and moisture distribution, and heat flow in the system.

Ballard, Jerrell R., Jr.↗
DOE OSTI2025

Point cloud-based diffusion models for the Electron-Ion Collider

At high-energy collider experiments, generative models can be used for a wide range of tasks, including fast detector simulations, unfolding, searches of physics beyond the Standard Model, and inference tasks. In particular, it has been demonstrated that score-based diffusion models can generate high-fidelity and accurate samples of jets or collider events. This work expands on previous generative models in three distinct ways. First, our model is trained to generate entire collider events, including all particle species with complete kinematic information. We quantify how well the model learns event-wide constraints such as the conservation of momentum and discrete quantum numbers. We focus on the events at the future Electron-Ion Collider, but we expect that our results can be extended to proton-proton and heavy-ion collisions. Second, previous generative models often relied on image-based techniques. The sparsity of the data can negatively affect the fidelity and sampling time of the model. We address these issues using point clouds and a novel architecture combining edge creation with transformer modules called Point Edge Transformers. Third, we adapt the foundation model OmniLearn, to generate full collider events. This approach may indicate a transition toward adapting and fine-tuning foundation models for downstream tasks instead of training new models from scratch.

Araz, Jack Y. [Stony Brook Univ., NY (United State↗
DOE OSTI2024

Image-Based Digital Twin for Assessing the Coupled Electro-Chemo-Mechanical Behavior of Li-Ion Batteries

In energy storage materials, strong electrochemical-mechanical coupling and highly anisotropic material properties contribute to the formation and propagation of micro-cracking during charge/discharge cycling, resulting in reduced performance and service life. In this work, a digital twin is created to investigate the performance of a Li-ion battery cathode and simulate degradation accumulation. Pixel-based model construction is used to represent the complex material geometries from microstructural images supplied by the National Renewable Energy Laboratory (NREL). Because of the expected large deformation and crack opening, the reproducing kernel particle method (RKPM), a meshfree method with discretization at the image pixels, is used to approximate the field variables: electrostatic potential, concentration, and displacement. An interface modified reproducing kernel (IM-RK) is constructed by scaling a smooth kernel function with an interface-distance function to achieve strategic discontinuity types (i.e. weak discontinuities for strain discontinuities and strong discontinuities for cracks) and alleviate Gibbs oscillations near these transition zones. The discrete nature of the images' pixel points is employed throughout the model and approximation construction. The mechanical model is verified using an image-based microstructure under tensile loading. A transient electro-chemo-mechanical coupled simulation is performed to evaluate the potential micro-cracking induced degradation of the battery cathode material subjected to charge/discharge cycling.

battery degradation↗