Search NASA⌕ Search

SEARCH · Search NASA

Results for “image based modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

The Characterization of a DIRSIG Simulation Environment to Support the Inter-Calibration of Spaceborne Sensors

Climate change studies require long-term, continuous records that extend beyond the lifetime, and the temporal resolution, of a single remote sensing satellite sensor. The inter-calibration of spaceborne sensors is therefore desired to provide spatially, spectrally, and temporally homogeneous datasets. The Digital Imaging and Remote Sensing Image Generation (DIRSIG) tool is a first principle-based synthetic image generation model that has the potential to characterize the parameters that impact the accuracy of the inter-calibration of spaceborne sensors. To demonstrate the potential utility of the model, we compare the radiance observed in real image data to the radiance observed in simulated image from DIRSIG. In the present work, a synthetic landscape of the Algodones Sand Dunes System is created. The terrain is facetized using a 2-meter digital elevation model generated from NASA Goddard's LiDAR, Hyperspectral, and Thermal (G-LiHT) imager. The material spectra are assigned using hyperspectral measurements of sand collected from the Algodones Sand Dunes System. Lastly, the bidirectional reflectance distribution function (BRDF) properties are assigned to the modeled terrain using the Moderate Resolution Imaging Spectroradiometer (MODIS) BRDF product in conjunction with DIRSIG's Ross-Li capability. The results of this work indicate that DIRSIG is in good agreement with real image data. The potential sources of residual error are identified and the possibilities for future work are discussed..

Ambeau, Brittany L.↗

Model-based Reconstruction for Single Particle Cryo-Electron Microscopy

Single particle cryo-electron microscopy is a vital tool for 3D characterization of protein structures. A typical workflow involves acquiring projection images of a collection of randomly oriented particles, picking and classifying individual particle projections by orientation, and finally using the individual particle projections to reconstruct a 3D map of the electron density profile. The reconstruction is challenging because of the low signal-to-noise ratio of the data, the unknown orientation of the particles, and the sparsity of data especially when dealing with flexible proteins where there may not be sufficient data corresponding to each class to obtain an accurate reconstruction using standard algorithms. In this paper we present a model-based image reconstruction technique that uses a regularized cost function to reconstruct the 3D density map by assuming known orientations for the particles. Our method casts the reconstruction as minimizing a cost function involving a novel forward model term that accounts for the contrast transfer function of the microscope, the orientation of the particles and the center of rotation offsets. We combine the forward model term with a regularizer that enforces desirable properties in the volume to be reconstructed. Using simulated data, we demonstrate how our method can significantly improve upon the typically used approach.

Venkatakrishnan, Singanallur↗

Shockwave/Boundary-Layer Interaction Studies Performed in the NASA Langley 20-Inch Mach 6 Air Tunnel

This paper highlights results from a collaborative study performed by The University of Tennessee Space Institute (UTSI) and NASA Langley Research Center on the Shockwave/Boundary-Layer Interaction (SWBLI) generated by a cylindrical protuberance on a flat plate in a Mach 6 flow. The study was performed in the 20-Inch Mach 6 Air Tunnel at NASA Langley Research Center and consisted of two separate entries. In the first entry, simultaneous high-speed schlieren and high-speed pressure-sensitive paint (PSP) imaging – which was performed for the first time in the 20-Inch Mach 6 facility at NASA Langley – were performed as well as simultaneous high-speed schlieren and oil-flow imaging. In the second entry, the model configuration was modified to increase the size of the interaction region. High-speed schlieren and infrared thermography (IR) surface imaging were performed in this second entry. The goal of these tests was to characterize the SBLI in the presence of a laminar, transitional, and turbulent boundary layer using high-speed optical imaging techniques. AoA = sting angle-of-attack (°) dcylinder = cylinder diameter (mm) dtrip = cylindrical tripping element diameter (mm) Δshock = shock stand-off distance (mm) hcylinder = cylinder height (mm) htrip = cylindrical tripping element height (mm) HSS = high-speed schlieren M∞ = freestream Mach number PSP = pressure-sensitive paint Re∞ = freestream unit Reynolds number (m-1) SWBLI = shockwave/boundary-layer interaction θplate = model plate angle (°) Introduction his paper highlights two experimental entries performed in the 20-Inch Mach 6 Air Blowdown Tunnel at NASA Langley Research Center in collaboration with The University of Tennessee Space Institute (UTSI). The purpose of these entries was to characterize the dynamic shockwave/boundary-layer interaction (SWBLI) between a vertical cylinder on a flat plate and laminar, transitional (XSWBLI), and turbulent (SWTBLI) boundary layers with a freestream Mach number of 6 using non-intrusive optical diagnostics. Experiments performed by Murphree et al.1,2 were among the first to specifically characterize XSWBLI induced by a vertical cylinder on a flat plate geometry using several optical measurement techniques. Recent optical studies of XSWBLI phenomenon have been performed by UTSI at Mach 2 in their low-enthalpy blow wind tunnel3-8 and by Texas A&M University and UTSI at Mach numbers of 6 and 7 in their Adjustable Contour Expansion wind tunnel.9 The experiments described in this paper were intended to complement previous studies by expanding the freestream unit Reynolds number range, Re∞, over which the XSWBLI phenomena has been observed. Additionally these experiments, made possible under NASA’s new facility funding model under the Aeronautics Evaluation and Test Capabilities (AETC) project, promoted collaboration between university and NASA researchers. The initial entry in the 20-Inch Mach 6 Air Tunnel at NASA Langley occurred in December of 2016. Originally, testing was to occur in November of 2016 in the 31-Inch Mach 10 Air Tunnel at NASA Langley. This facility was chosen so that the XSWBLI phenomenon could be observed at much higher Mach numbers than had previously been attempted in ground test experiments. The model selected for this experiment, a 10° half-angle wedge with a sharp leading edge (described in detail in section II.B), had previously been used by Danehy et al. [10] for boundary layer transition studies using the nitric oxide planar laser-induced fluorescence (NO PLIF) flow visualization technique. In that work, it was determined that transition could be induced downstream of a single htrip = 1-mm tall, dtrip = 4-mm diameter cylindrical tripping element and that the streamwise location of the transition could be changed for a single Re∞ by changing the model angle-of-attack (AoA) (see Fig. A3 in Ref. [10] for more details). Based on the findings of that work, a decision was made to use the wedge model with the cylindrical tripping element to trip the boundary layer flow ahead of a cylindrical protuberance in order to achieve a XSWBLI. Unfortunately, the 31-Inch Mach 10 facility had been taken offline for repairs in October of 2016 and a decision was made to move the test to the 20-Inch Mach 6 facility. Since the behavior of the boundary layer with the chosen model configuration had not been studied before in that facility and the available test time was limited, the entry was considered to be exploratory and was used to collect spatially-resolved and time-resolved flow and surface visualization data that would be used to inform a second entry. Test techniques included simultaneous high-speed schlieren (HSS) captured at 160 kHz and high-speed pressure sensitive paint captured at 10 kHz as well as oil flow visualization, captured at 750 Hz. The second entry in the 20-Inch Mach 6 facility occurred in June and July of 2017. In this follow-on test, modifications to the wind tunnel model were made based on observations made during the first entry and included removing the cylindrical tripping element, increasing the size of the cylinder used to induce the SWBLI to increase the size of the interaction while simultaneously improving spatial resolution, and using a swept ramp array, similar to that described in Ref. [11], to trip the flow to turbulence. Simultaneous HSS (captured at 140 kHz, 100 kHz, and 40 kHz) and conventional IR thermography (captured at 30 Hz) imaging were performed simultaneously in this follow-on entry. This paper is intended to serve as a summary of the work performed during these two entries, to detail lessons learned from each entry, and to highlight some of the datasets acquired. Details on the experimental setup, model configuration, and techniques used are provided. Papers providing a more rigorous analysis of data acquired during the second entry, including statistical, spectral, and modal decomposition methods, can be found in Refs. [12,13]. An entry examining XSWBLI in the 31-Inch Mach 10 Blowdown Wind Tunnel facility is currently planned for mid-to-late calendar year 2019, pending the success of facility repairs. The work performed and described in this paper and the upcoming entry in the 31-Inch Mach 10 facility at NASA Langley have been made possible by NASA’s new facility funding model under the Aeronautics Evaluation and Test Capabilities (AETC) project. Wind Tunnel Facility All experiments discussed in this paper were performed in the 20-Inch Mach 6 Air Tunnel at NASA Langley Research Center. Specific details pertaining to this facility can be found in Refs. [14,15], with only a brief description of the facility provided here. For both entries, the nominal freestream unit Reynolds number was varied between 1.8×106 m-1 (0.5×106 ft-1) and 26.3×106 m-1 (8×106 ft-1). The nominal stagnation pressure was varied between 0.21 MPa and 3.33 MPa and the nominal stagnation temperature was varied between 480 K and 520 K to achieve the desired Re∞ condition. For all runs, the nominal freestream Mach number was 6. The nearly square test section is 520.7-mm (20.5-inches) wide by 508-mm (20-inches) high. Two 431.8-mm (17-inch) diameter windows made of Corning 7940, Grade 5F schlieren-quality glass serve as the side walls of the tunnel and provide optical access for the high-speed schlieren measurements. A rectangular window made of the same material as the side windows served as the top wall of the test section and provided optical access for the high-speed PSP and oil flow measurements. For the second entry, this top window was replaced with a Zinc Selenide (ZnSe) window with an anti-reflection coating capable of passing IR wavelengths between 8μm and 12μm with greater than 98% transmittance. The model was sting supported by a strut attached to a hydraulic system that allows for the model pitch angle to be adjusted between -5° to +55°. For the first entry, an initial pitch/pause sweep of the model AoA was performed to observe the resulting SWBLI. Ultimately, however, the sting pitch angle for this entry was fixed at +10.0° so that the angle of the top surface of the wedge relative to the streamwise axis of the tunnel (referred to herein as the plate angle, θplate), was θplate = 0°. For the second entry, θplate = 0° and θplate = -13.25° were initially tested with the swept ramp array (discussed in the following section) to determine which orientation produced conditions most favorable for XSWBLI to occur based on the heating signatures observed over the top surface of the model in the IR thermography images. Based on these initial tests, θplate = -13.25° was set for the remainder of the runs in the second entry. For both entries, any model changes were performed in a housing located beneath the closed test section. Prior to performing a run of the tunnel, the housing was sealed and the tunnel started. Once the appropriate freestream conditions were achieved, the model was injected into the test section using a hydraulic injection system. B. Model Geometry For all runs, a 10° half-angle (20° full-angle) wedge model with a sharp leading edge was used. The model is described in detail in Refs. [10,16]. The top surface of the sharp leading edge of the model extended 47.8 mm from its upstream-most edge to a junction with the upstream edge of a stainless steel top plate that then extended an (a) (c) (b) Fig. 1 (a) Schematic of top surface of wedge model with gas seeding insert, (b) perspective view of the model in the 20-Inch Mach 6 tunnel with centerline pressure orifices on sharp leading edge, and (c) a perspective view of the model with stainless steel (top) and SLA middle insert (bottom) during the first entry. Flow occurs from left to right.

Bathel, Brett F.↗

Training calibration-based counterfactual explainers for deep learning models in medical image analysis

The rapid adoption of artificial intelligence methods in healthcare is coupled with the critical need for techniques to rigorously introspect models and thereby ensure that they behave reliably. This has led to the design of explainable AI techniques that uncover the relationships between discernible data signatures and model predictions. In this context, counterfactual explanations that synthesize small, interpretable changes to a given query while producing desired changes in model predictions have become popular. This under-constrained, inverse problem is vulnerable to introducing irrelevant feature manipulations, particularly when the model’s predictions are not well-calibrated. Hence, in this paper, we propose the TraCE (training calibration-based explainers) technique, which utilizes a novel uncertainty-based interval calibration strategy for reliably synthesizing counterfactuals. Given the wide-spread adoption of machine-learned solutions in radiology, our study focuses on deep models used for identifying anomalies in chest X-ray images. Using rigorous empirical studies, we demonstrate the superiority of TraCE explanations over several state-of-the-art baseline approaches, in terms of several widely adopted evaluation metrics. Our findings show that TraCE can be used to obtain a holistic understanding of deep models by enabling progressive exploration of decision boundaries, to detect shortcuts, and to infer relationships between patient attributes and disease severity.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Data‐Efficient Generation of Synthetic Microstructures of Polymer‐Bonded Energetic Material With Fine‐Tuned Stable Diffusion

Among current deep learning approaches for synthetic image generation, diffusion-based models stand out in terms of algorithmic stability and ability to retain high-fidelity image features with detailed resolution. Here, in this work, we employ Dreambooth, a method for fine-tuning Stable Diffusion, on X-ray CT images of microstructure of the polymer-bonded form (PBX) of a commonly used high explosive, Pentaerythritol tetranitrate (PETN), which yields generative models for creating synthetic PBX images. The models developed here represent five classes (or ‘lots’) of microstructures and demonstrate successful generation of images of each class with high fidelity, as verified by computed classification accuracy of ∼ 94% or higher. Data augmentation afforded by such image synthesis can be used to more reliably decipher underlying statistics, build processing-structure correlations, recognize off-normal structural anomalies, and identify age-related changes. Ideas related to converting image data into appropriate density mapping and performing mesoscale simulation or surrogate modeling of detonation are also discussed.

Dreambooth↗

Validation of Atmospheric Correction of Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) Radiance Data Based on Radiative Transfer Modeling

An evaluation of atmospheric correction of AVIRIS data using radiative transfer codes LOWTRAN7 and MODTRAN is presented. The algorithm employed is based on a simple model of radiance L at each wavelength at the sensor that can be written approximately LAV=Lp+Tp, where subscript AV referes to AVIRIS, Lp is the path radiance and Tp is the diffuse + direct transmitted radiance of the atmosphere at AVIRIS.

Infrared Mapping↗

A microlensing model for QSO 2237 + 0305

Models of microlensing are presented for the four images of QSO 2237 + 0305, with the surface mass density and shear for each image based on the macrolensing model developed by Schneider et al. (1988). The computations were done with a new code that makes use of the hierarchical tree method. The high efficiency of this approach makes it possible to include up to 60,000 lensing stars with different masses. Examples are given of amplification maps, light curves, correlation functions, and amplification probabilities. All these are very strongly affected by the shear due to macrolensing. The observed changes in the luminosity of the four images of QSO 2237 + 0305 are most likely induced by microlensing.

Wambsganss, J.↗

Deep Learning for Automated Detection and Identification of Migrating American Eel Anguilla rostrata from Imaging Sonar Data

Adult American eels (Anguilla rostrata) are vulnerable to hydropower turbine mortality during outmigration from growth habitat in inland waters to the ocean where they spawn. Imaging sonar is a reliable and proven technology for monitoring of fish passage and migration; however, there is no efficient automated method for eel detection. We designed a deep learning model for automated detection of adult American eels from sonar data. The method employs convolution neural network (CNN) to distinguish between 14 images of eels and non-eel objects. Prior to image classification with CNN, background subtraction and wavelet denoising were applied to enhance sonar images. The CNN model was first trained and tested on data obtained from a laboratory experiment, which yielded overall accuracies of >98% for image-based classification. Then, the model was trained and tested on field data that were obtained near the Iroquois Dam located on the St. Lawrence River; the accuracy achieved was commensurate with that of human experts.

13 HYDRO ENERGY↗

Sensor fusion display evaluation using information integration models in enhanced/synthetic vision applications

Based on existing integration models in the psychological literature, an evaluation framework is developed to assess sensor fusion displays as might be implemented in an enhanced/synthetic vision system. The proposed evaluation framework for evaluating the operator's ability to use such systems is a normative approach: The pilot's performance with the sensor fusion image is compared to models' predictions based on the pilot's performance when viewing the original component sensor images prior to fusion. This allows for the determination as to when a sensor fusion system leads to: poorer performance than one of the original sensor displays, clearly an undesirable system in which the fused sensor system causes some distortion or interference; better performance than with either single sensor system alone, but at a sub-optimal level compared to model predictions; optimal performance compared to model predictions; or, super-optimal performance, which may occur if the operator were able to use some highly diagnostic 'emergent features' in the sensor fusion display, which were unavailable in the original sensor displays.

Foyle, David C.↗

A non-intrusive framework using acoustic signals and deep learning for boiling diagnostics in visual-limited environments

Accurate monitoring of boiling heat transfer is critical for safeguarding high-power systems operating in environments where conventional optical diagnostics are hindered by radiation fields or restricted visual accessibility. This study presents a non-intrusive framework that integrates hydroacoustic sensing with deep learning to infer near-wall boiling characteristics and enable predictive thermal assessment without visual access. In a prototypical subcooled flow-boiling facility representative of the Isotope Production Facility (IPF) at Los Alamos, hydrophones capture boiling-induced acoustic emissions that are transformed into background-removed Short-Time Fourier Transform (STFT) spectrograms. A convolutional neural network (CNN) then regresses heat flux, wall superheat, and key bubble parameters directly from these spectrograms. The CNN achieved predictive accuracy under nominal conditions and demonstrated robustness and generalization under acoustic noise for Signal-to-Noise Ratios (SNRs) down to approximately 0 dB. When integrated into an ANSYS CFX wall-boiling model, the acoustically inferred parameters reproduced boiling curve and critical heat flux (CHF) values consistent with image-based benchmarks. Furthermore, the model retained reliable performance under moderate variations in bulk temperature, flow rate, and hydrophone placement, confirming its generalizability across practical boundary conditions. These results demonstrate the feasibility of hydroacoustic-based deep learning as a viable path toward real-time, radiation-tolerant boiling diagnostics and predictive thermal safety assessment in inaccessible systems such as the IPF.

42 ENGINEERING↗

Mimicking of corruption in images

Methods and systems are provided to generate an uncorrupted version of an image given an observed image that is a corrupted version of the image. In some embodiments, a corruption mimicking (“CM”) system iteratively trains a corruption mimicking network (“CMN”) to generate corrupted images given modeled images, updates latent vectors based on differences between the corrupted images and observed images, and applies a generator to the latent vectors to generate modeled images. The training, updating, and applying are performed until modeled images that are input to the CMN result in corrupted images that approximate the observed images. Because the CMN is trained to mimic the corruption of the observed images, the final modeled images represented the uncorrupted version of the observed images.

Anirudh, Rushil↗

Foundation Models for Zero-Shot Segmentation of Scientific Images without AI-Ready Data

Zero-shot and prompt-based models have excelled at visual reasoning tasks by leveraging large-scale natural image corpora, but they often fail on sparse and domain-specific scientific image data. We introduce Zenesis, a no-code interactive computer vision platform designed to reduce data readiness bottlenecks in scientific imaging workflows. Zenesis integrates lightweight multimodal adaptation for zero-shot inference on raw scientific data, human-in-the-loop refinement, and heuristic-based temporal enhancement. We validate our approach on Focused Ion Beam Scanning Electron Microscopy (FIB-SEM) datasets of catalyst-loaded membranes. Zenesis outperforms baselines, achieving an average accuracy of 0.947, Intersection over Union (IoU) of 0.858, and Dice score of 0.923 on amorphous catalyst samples; and 0.987 accuracy, 0.857 IoU, and 0.923 Dice on crystalline samples. These results represent a significant performance gain over conventional methods such as Otsu thresholding and standalone models like the Segment Anything Model (SAM). Zenesis enables effective image segmentation in domains where annotated datasets are limited, offering a scalable solution for scientific discovery.

Mukherjee, Shubhabrata↗

Score-based diffusion models for generating liquid argon time projection chamber images

For the first time, we show high-fidelity generation of Liquid Argon Time Projection Chamber (LArTPC-like) data using a generative neural network. This demonstrates that methods developed for natural images do transfer to LArTPC-produced images, which, in contrast to natural images, are globally sparse but locally dense. We present the score-based diffusion method employed. We evaluate the fidelity of the generated images using several quality metrics, including modified measures used to evaluate natural images, comparisons between high-dimensional distributions, and comparisons relevant to LArTPC experiments. Published by the American Physical Society 2024

Astronomy & Astrophysics↗

How Low Can You Go? Using Synthetic 3D Imagery to Drastically Reduce Real-World Training Data for Object Detection

Deep convolutional neural networks (DCNNs) currently provide state-of-the-art performance on image classification and object detection tasks, and there are many global security mission areas where such models could be extremely useful. Crucially, the success of these models is driven in large part by the widespread availability of high-quality open source data sets such as Image Net, Common Objects in Context (COCO), and KITTI, which contain millions of images with thousands of unique labels. However, global security relevant objects-of-interest can be difficult to obtain: relevant events are low frequency and high consequence; the content of relevant images is sensitive; and adversaries and proliferators seek to obscure their activities. For these cases where exemplar data is hard to come-by, even fine-tuning an existing model with available data can be effectively impossible. Recent work demonstrated that models can be trained using a combination of real-world and synthetic images generated from 3D representations; that such models can exceed the performance of models trained using real-world data alone; and that the generated images need not be perfectly realistic (Tremblay, et al., 2018). However, this approach still required hundreds to thousands of real-world images for training and fine tuning, which for sparse, global security-relevant datasets can be an unrealistic hurdle. In this research, we validate the performance and behavior of DCNN models as we drive the number of real-world images used for training object detection tasks down to a minimal set. We perform multiple experiments to identify the best approach to train DCNNs from an extremely small set of real-world images. In doing so, we: Develop state-of-the-art, parameterized 3D models based on real-world images and sample from their parameters to increase the variance in synthetic image training data; Use machine learning explainability techniques to highlight and correct through targeted training the biases that result from training using completely synthetic images; and Validate our results by comparing the performance of the models trained on synthetic data to one another, and to a control model created by fine-tuning an existing ImageNet-trained model with a limited number (hundreds) of real-world images.

97 MATHEMATICS AND COMPUTING↗

Regional evapotranspiration from an image-based implementation of the Surface Temperature Initiated Closure (STIC1.2) model and its validation across an aridity gradient in the conterminous US

Recent studies have highlighted the need for improved characterizations of aerodynamic conductance and temperature (g A and T 0 ) in thermal remote-sensing-based surface energy balance (SEB) models to reduce uncertainties in regional-scale evapotranspiration (ET) mapping. By integrating radiometric surface temperature (TR) into the Penman–Monteith (PM) equation and finding analytical solutions of gA and T0, this need was recently addressed by the Surface Temperature Initiated Closure (STIC) model. However, previous implementations of STIC were confined to the ecosystem-scale using flux tower observations of infrared temperature. This study demonstrates the first regional-scale implementation of the most recent version of the STIC model (STIC1.2) that integrates the Moderate Resolution Imaging Spectroradiometer (MODIS) derived TR and ancillary land surface variables in conjunction with NLDAS (North American Land Data Assimilation System) atmospheric variables into a combined structure of the PM and Shuttleworth–Wallace (SW) framework for estimating ET at 1 km × 1 km spatial resolution. Evaluation of STIC1.2 at 13 core AmeriFlux sites covering a broad spectrum of climates and biomes across an aridity gradient in the conterminous US suggests that STIC1.2 can provide spatially explicit ET maps with reliable accuracies from dry to wet extremes. When observed ET from one wet, one dry, and one normal precipitation year from all sites were combined, STIC1.2 explained 66 % of the variability in observed 8-day cumulative ET with a root mean square error (RMSE) of 7.4 mm/8-day, mean absolute error (MAE) of 5 mm/8-day, and percent bias (PBIAS) of -4 %. These error statistics showed relatively better accuracies than a widely used but previous version of the SEB-based Surface Energy Balance System (SEBS) model, which utilized a simple NDVI-based parameterization of surface roughness (z OM ), and the PM-based MOD16 ET. SEBS was found to overestimate (PBIAS = 28 %) and MOD16 was found to underestimate ET (PBIAS =-26 %). The performance of STIC1.2 was better in forest and grassland ecosystems as compared to cropland (20 % underestimation) and woody savanna (40 % overestimation). Model inter-comparison suggested that ET differences between the models are robustly correlated with g A and associated roughness length estimation uncertainties which are intrinsically connected to T R uncertainties, vapor pressure deficit (D A ), and vegetation cover. A consistent performance of STIC1.2 in a broad range of hydrological and biome categories, as well as the capacity to capture spatio-temporal ET signatures across an aridity gradient, points to the potential for this simplified analytical model for near-real-time ET mapping from regional to continental scales.

Bhattarai, Nishan (ORCID:0000000327493549)↗