Search NASA⌕ Search

SEARCH · Search NASA

Results for “Retrieval algorithm”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Aboveground Biomass Estimation Using NISAR Simulated ALOS-2 Time Series Data

Aboveground biomass (AGB) is a critical parameter to better understand the global carbon cycle and to develop sustainable forest management. However, a large uncertainty prevails. L-band SAR data have demonstrated strong potential to accurately retrieve AGB over low-biomass regions (<100 Mg ha-1). The upcoming NASA-ISRO Synthetic Aperture Radar mission will collect data at L- and S-band over earth’s landmass with a repeat period of 12 days, allowing us to have ample data for monitoring biomass and its dynamics. One of the key science requirements of the mission is to produce annual AGB maps at 1-ha resolution with RMS accuracy of 20 Mg/ha for 80 percentage of area over low-biomass regions in Calibration/Validation sites. The NISAR biomass algorithm will generate AGB maps based on the parameterization of semi-empirical model along with NISAR time-series dual pol data (HH and HV). To calibrate and validate the model for mission requirements, the mission will use reference estimates of AGB produced from ground inventory plots and airborne LiDAR data collected over selected sites distributed across different global ecoregions. This paper presents the initial results of the calibration/validation of the NISAR AGB retrieval algorithm over the Lenoir Landing (LENO), Alabama, USA site using NISAR simulated ALOS-2 time series data. Five multi-temporal dual-pol HH and HV NISAR Simulated ALOS 2 data collections were used as input to assess the performance of the model. The model AGB retrieval results shows that the NISAR model was able to achieve RMS accuracy within 20 Mg/ha.

Ramachandran, Naveen [Jet Propulsion Laboratory, C↗
DOE OSTI2026

Multi-Doppler radar analysis from CSAPR, CHIVO, COW, and RMA-1 radars during the CACTI/RELAMPAGO experiments in Argentina in 2018

This data set contains multi-Doppler radar analysis from CSAPR-2, CSU-CHIVO, COW, and RMA-1 radars. These radars were collecting dual-polarization data during the CACTI/RELAMPAGO experiments in Argentina in 2018. Doppler analysis is systematically conducted for 31 days with convection. Three-dimensional wind fields are retrieved using the PyDDA algorithm. Dual-polarization information is also included in the data set.

3D cartesian gridded corrected mean Doppler veloci↗
DOE OSTI2024

AI/ML Expo Boosting Job Performance with AI: Innovative Approaches and Success Stories

Our technology leverages artificial intelligence (AI) to enhance the user experience in High Performance Computing (HPC) environments. By analyzing user behavior and providing personalized recommendations, our AI system helps HPC users optimize their workflows and improve productivity. Additionally, we offer an advanced image similarity search feature, which utilizes AI algorithms to identify and retrieve visually similar images, saving users valuable time and effort in their research and analysis.

97 - MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Quantitative phase retrieval and characterization of magnetic nanostructures via Lorentz (scanning) transmission electron microscopy

Magnetic materials phase reconstruction using Lorentz transmission electron microscopy (LTEM) measurements have traditionally been achieved using longstanding methods such as off-axis holography (OAH) fast-Fourier transform technique and the transport-of-intensity equation (TIE). The increase in access to processing power alongside the development of advanced algorithms have allowed for phase retrieval of nanoscale magnetic materials with greater efficacy and resolution. Specifically, reverse-mode automatic differentiation (RMAD) and the extended electron ptychography iterative engine (ePIE) are two recent developments of phase retrieval that can be applied to analyzing micro-to-nano- scale magnetic materials. This work evaluates phase retrieval using TIE, RMAD, and ePIE in simulations of Permalloy (Ni 80 Fe 20 ) nanoscale islands, or nanomagnets. Extending beyond simulations, we demonstrate total phase retrieval and image reconstructions of a NiFe nanowire using OAH and RMAD in LTEM and ePIE in Lorentz-mode-4D scanning transmission electron microscopy experiments and determine the saturation magnetization through corroborations with micromagnetic modeling. Finally, we demonstrate the efficacy of these methods in retrieving the total phase and highlight its use in characterizing and analyzing the proximity effect of the magnetic nanostructures.

Lorentz transmission electron microscopy↗
DOE OSTI2026

Planetary Boundary-Layer Height (PBLHT) Value-Added Product: Remote-Sensing Retrievals

The planetary boundary layer (PBL) is fundamental to numerous atmospheric processes, including aerosol mixing and transport, cloud evolution, and precipitation formation. A critical parameter in these studies is the PBL height (PBLHT). This vertical depth is essential for characterizing PBL structures in numerical simulations and serves as a primary metric for estimating flux exchanges between the Earth’s surface and the atmosphere. Radiosonde (SONDE) observations provide high-vertical-resolution measurements of temperature and moisture profiles and are widely used to estimate PBLHT (Liu and Liang 2010, Seidel et al. 2010). The U.S. Department of Energy Atmospheric Radiation Measurement (ARM) User Facility’s PBLHT value-added product (VAP) for radiosonde measurements, known as PBLHTSONDE, applies three commonly used methods—the Heffter (1980) method, the Liu and Liang (2010) method, and the bulk Richardson number approach (Seibert et al. 2000)—to derive PBLHT. The PBLHTSONDE VAP operates routinely at ARM observatories and mobile facilities, with data available from the ARM Data Center shortly after sounding observations are collected (Sivaraman et al. 2013). However, radiosonde observations are limited by their low temporal resolution. Most stations launch soundings only twice daily, which constrains the ability to investigate and characterize the temporal evolution of the PBL using radiosonde data alone. The use of continuous remote-sensing observations provides high temporal resolution of PBLHT estimates. These observations include aerosol lidars (Dang et al. 2019, Su et al. 2020), Doppler lidar (DL; Tucker et al. 2009, Krishnamurthy et al. 2021), and water vapor and/or temperature lidars and radiometers (Turner et al. 2014). These observations provide valuable data on the PBL’s thermodynamic properties (e.g., water vapor and/or temperature lidars and radiometers), dynamic properties (e.g., DL), and distribution of tracer substances (e.g., aerosol lidars), all of which can be used to estimate PBLHT. ARM developed PBLHT estimates from the micropulse lidar (MPL; PBLHTMPL), Doppler lidar (PBLHTDL), and combined Raman lidar (RL)/atmospheric emitted radiance interferometer (AERI) thermodynamic profiles (PBLHTTHERMO). Each estimate captures different physical characteristics of the boundary layer—aerosol tracers, vertical velocity turbulence, and thermodynamic structure—and exhibits distinct strengths and limitations depending on the PBL regime and time of day. In addition, the ARM ceilometer (CEIL) provides three potential PBLHT candidates derived from the vendor's built-in algorithm. Building on these individual retrievals, ARM developed the PBLHTBEML VAP, which combines the four remote-sensing-based estimates with ancillary meteorological variables using the machine learning approach of Zhang et al. (2025) to produce a best-estimate PBLHT at 10-minute resolution.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Pan-tropical daily L-band microwave land surface emissivity retrieval from GNSS-R observations

The uncertainties in microwave land surface emissivity (MLSE) measurements have long limited the use of spaceborne microwave radiometer data. As an emerging observation method, Global Navigation Satellite System Reflectometry (GNSS-R) has demonstrated great potential in several land and ocean applications. In this study, a method for obtaining daily MLSE dataset in the pan-tropical region from Cyclone GNSS (CYGNSS) observations is presented and evaluated. The CYGNSS observations are first aggregated into the Equal-Area-Scalable-Earth (EASE) 2.0 36 km grid by a combined weight function of distance, time, and signal-to-noise ratio variance. Then, the method employs a pixel-by-pixel regression algorithm to conduct the daily MLSE retrieval using reference emissivity derived from the Soil Moisture Active Passive (SMAP) brightness temperature. The CYGNSS MLSE shows good agreement with SMAP MLSE, delivering an overall root-mean-square error (RMSE) of 0.022 and 0.017 for horizontal and vertical polarization, respectively, during the training set spanning the whole year of 2018. Furthermore, on the test set from January 2019 to May 2019, the RMSE values amounted to 0.030 and 0.023 for horizontal and vertical polarization, respectively. Temperature records from the International Soil Moisture Network are employed to calculate the emissivity and for in-situ validation, which yield an RMSE of 0.034 and 0.026 for the two polarizations, respectively. The proposed algorithm provides an encouraging approach to obtain accurate daily MLSE dataset for microwave remote sensing. Compared to the SMAP MLSE, the CYGNSS MLSE has a remarkable improvement of 86% in temporal resolution, greatly complementing the existing microwave emissivity datasets.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Reliable Determination of Pulses and Pulse-Shape Instability in Ultrashort Laser Pulse Trains Using Polarization-Gating and Transient-Grating Frequency-Resolved Optical Gating Using the RANA Approach

Devices that measure the presence of instability in the pulse shapes in trains of ultrashort laser pulses do not exist, so this task necessarily falls to pulse-measurement devices, like Frequency-Resolved Optical Gating (FROG) and its variations, which have proven to be a highly reliable class of techniques for measuring stable trains of ultrashort laser pulses. Fortunately, multi-shot versions of FROG have also been shown to sensitively distinguish trains of stable from those of unstable pulse shapes by displaying readily visible systematic discrepancies between the measured and retrieved traces in the presence of unstable pulse trains. However, the effects of pulse-shape instability and algorithm stagnation can be indistinguishable, so a never-stagnating algorithm—even when instability is present—is required and is generally important. In previous work, we demonstrated that our recently introduced Retrieved-Amplitude N-grid Algorithmic (RANA) approach produces highly reliable (100%) pulse-retrieval in the second-harmonic-generation (SHG) version of FROG for thousands of sample trains of pulses with stable pulse shapes. Further, it does so even for trains of unstable pulse shapes and thus both reliably distinguishes between the two cases and provides a rough measure of the degree of instability as well as a reasonable estimate of most typical pulse parameters. Here, we perform the analogous study for the polarization-gating (PG) and transient-grating (TG) versions of FROG, which are often used for higher-energy pulse trains. We conclude that PG and TG FROG, coupled with the RANA approach, also provide reliable indicators of pulse-shape instability. In addition, for PG and TG FROG, the RANA approach provides an even better estimate of a typical pulse in an unstable pulse train than SHG FROG does, even in cases of significant pulse-shape instability.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Replacing non-biomedical concepts improves embedding of biomedical concepts

Embeddings are semantically meaningful representations of words in a vector space, commonly used to enhance downstream machine learning applications. Traditional biomedical embedding techniques often replace all synonymous words representing biological or medical concepts with a unique token, ensuring consistent representation and improving embedding quality. However, the potential impact of replacing non-biomedical concept synonyms has received less attention. Embedding approaches often employ concept replacement to replace concepts that span multiple words, such as non-small-cell lung carcinoma, with a single concept identifier (e.g., D002289). Also, all synonyms of each concept are merged into the same identifier. Here, we additionally leveraged WordNet to identify and replace sets of non-biomedical synonyms with their most common representatives. This combined approach aimed to reduce embedding noise from non-biomedical terms while preserving the integrity of biomedical concept representations. We applied this method to 1,055 biomedical concept sets representing molecular signatures or medical categories and assessed the mean pairwise distance of embeddings with and without non-biomedical synonym replacement. A smaller mean pairwise distance was interpreted as greater intra-cluster coherence and higher embedding quality. Embeddings were generated using the Word2Vec algorithm applied to a corpus of 10 million PubMed abstracts. Our results demonstrate that the addition of non-biomedical synonym replacement reduced the mean intra-cluster distance by an average of 8%, suggesting that this complementary approach enhances embedding quality. Future work will assess its applicability to other embedding techniques and downstream tasks. Python code implementing this method is provided under an open-source license.

algorithms↗
DOE OSTI2026

The ABCs of phase retrieval: Connecting the acronyms of scanning transmission electron microscopy

High-resolution scanning transmission electron microscopy (S/TEM) is an indispensable tool for characterizing the structure and properties of materials down to the atomic scale. Conventional S/TEM imaging, however, is limited by the phase problem, whereby the phase of the electron exit wave is lost upon detection. Recent advances in diffractive imaging and 4D-STEM have enabled a range of phase-retrieval techniques that computationally reconstruct the missing information encoded in the phase of the transmission function. These approaches offer improved dose efficiency and enhanced sensitivity to weakly scattering signals, extending quantitative imaging to beam-sensitive materials composed of light elements. In this work, we introduce the phase problem in electron microscopy and survey the diverse landscape of phase-retrieval techniques used in the field. Despite their many acronyms and algorithmic variations, these techniques share a common physical and mathematical foundation. We present a unified framework that connects these seemingly distinct methods, from parallax imaging and tilt-corrected bright-field (tcBF-STEM), to aberration-corrected bright-field (acBF-STEM), optimum bright-field (OBF-STEM) and single-sideband (SSB) ptychography, as well as first-moment integrated center of mass techniques (iCOM) and iterative ptychographic algorithms. Based on these insights, we discuss the opportunities and practical limitations of applying these methods across different materials systems, detector designs, and microscope configurations.Graphical abstractRepresentative electron microscopy configurations used for phase retrieval and diffractive imaging in S/TEM: (a) Zernike phase-contrast transmission electron microscopy (TEM), (b) small-convergence-angle four-dimensional scanning transmission electron microscopy (4D-STEM) for nanobeam-based phase reconstruction methods, and (c) large-convergence-angle 4D-STEM for ptychographic and related diffractive imaging techniques reviewed in this work.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Estimating Fine-Resolution Shortwave Broadband Albedo of Croplands from Harmonized Landsat and Sentinel-2 Data

Altered surface albedo due to land-cover conversions and management is a significant driver of global climate change. Albedo can be directly measured at ground stations, and remote sensing data can be used to scale-up albedo values to regional and global levels. Some previous studies have retrieved fine-resolution (10–30 m) instantaneous albedo and coarse-resolution (500–1000 m) daily mean albedo from remote sensing data, but they all required the input of Moderate Resolution Imaging Spectroradiometer (MODIS) albedo information at 500-m resolution, and none have assembled both instantaneous and daily albedo based exclusively on fine-resolution satellite data. Here, to address this issue, we compiled 387 instantaneous and 346 daily albedo records using field net radiometer measurements from the bioenergy croplands at the W. K. Kellogg Biological Station in southwest Michigan. We then connected these albedo records with a suite of variables derived from harmonized Landsat and Sentinel-2 data through two machine learning algorithms (random forest regression and extreme gradient boosting) to retrieve clear-sky instantaneous and daily shortwave broadband albedo. The performance statistics indicate reasonable accuracy of model results [root-mean-square error (RMSE)] around or below 0.03 except for snow-covered surfaces), suggesting that the retrieval of both instantaneous and daily albedo based exclusively on fine-resolution satellite data is promising. To facilitate the use of fine-resolution albedo products at the global level, future efforts need to include more albedo records of diverse surface cover types, as well as to accurately model daily albedo for cloudy days to address the “clear-sky bias.”

Harmonized Landsat and Sentinel-2↗
DOE OSTI2025

The importance of shear on the collective charge transport in CDWs revealed by an XFEL source

Charge transport in materials has an impact on a wide range of devices based on semiconductor, battery, or superconductor technology. Charge transport in sliding charge density waves (CDW) differs from all others in that the atomic lattice is directly involved in the transport process. To obtain an overall picture of the structural changes associated to the collective transport, the large coherent x-ray beam generated by an x-ray free-electron laser (XFEL) source was used. The CDW phase can be retrieved over the entire sample from diffracted intensities using a genetic algorithm. For currents below threshold, increasing shear deformation is observed in the central part of the sample while longitudinal deformation appears above threshold when shear relaxes. Shear thus precedes longitudinal deformation, with relaxation of one leading to the appearance of the other. Moreover, strain accumulates on surface steps in the sliding regime, demonstrating the strong pinning character of these surface discontinuities. The sliding process of nanometric CDW involves macroscopic sample dimensions.

36 MATERIALS SCIENCE↗
DOE OSTI2024

X-ray nano-holotomography reconstruction with simultaneous probe retrieval

In conventional tomographic reconstruction, the pre-processing step includes flat-field correction, where each sample projection on the detector is divided by a reference image taken without the sample. When using coherent X-rays as a probe, this approach overlooks the phase component of the illumination field (probe), leading to artifacts in phase-retrieved projection images, which are then propagated to the reconstructed 3D sample representation. The problem intensifies in nano-holotomography with focusing optics, which, due to various imperfections creates high-frequency components in the probe function. Here, we present a new iterative reconstruction scheme for holotomography, simultaneously retrieving the complex-valued probe function. Implemented on GPUs, this algorithm results in 3D reconstruction resolving twice thinner layers in a 3D ALD standard sample measured using nano-holotomography.

Nikitin, Viktor↗
DOE OSTI2024

Phase retrieval for refraction-enhanced x-ray radiography using a deep neural network

X-ray refraction-enhanced radiography (RER) or phase contrast imaging is widely used to study internal discontinuities within materials. The resulting radiograph captures both the decrease in intensity caused by material absorption along the x-ray path, as well as the phase shift, which is highly sensitive to gradients in density. A significant challenge lies in effectively analyzing the radiographs to decouple the intensity and phase information and accurately ascertain the density profile. Conventional algorithms often yield ambiguous and unrealistic results due to difficulties in including physical constraints and other relevant information. We have developed an algorithm that uses a deep neural network to address these issues and applied it to extract the detailed density profile from an experimental RER. To generalize the applicability of our algorithm, we have developed a technique that quantitatively evaluates the complexity of the phase retrieval process based on the characteristics of the sample and the configuration of the experiment. Accordingly, this evaluation aids in the selection of the neural network architecture for each specific case. Beyond RER, the model has potential applications for other diagnostics where phase retrieval analysis is required.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Propagating information content: an example with advection

The mathematical algorithm to derive geophysical information from remote sensing observations is called a retrieval. The mathematics of many retrieval problems are ill-posed, and thus a priori information is used to help constrain the derived geophysical variable to realistic values. One quantity of interest, therefore, is the information content of the observation. Perfect information content in the observation would be achieved if the retrieval were able to capture any perturbation in the desired geophysical variable with the proper magnitude. Many new data products can be derived by combining geophysical variables retrieved from multiple different remote sensors. This paper explores, for the first time, how to derive the information content of these derived products. The approach uses traditional error propagation techniques to derive the uncertainty of the derived field twice, both when the observations are used in the retrieval and also when only the a priori information from each remote sensor is propagated. These two uncertainties are then used to provide an estimate of the information content of the derived geophysical variable. This study demonstrates how to propagate the uncertainties from six different instruments to provide the information content for water vapor and temperature advection. A multi-month analysis demonstrates that, in a mean sense, the information content for temperature advection is nearly unity for all heights below 700 m while, the information content for water vapor advection is somewhat more variable but still larger than 0.6 in the convective boundary layer.

Turner, David D. [National Oceanic and Atmospheric↗
DOE OSTI2026

NREL ASSIST Rhode Island / Thermodynamic retrievals TROPoe

This dataset contains daily files with thermodynamic profiles retrieved with the optimal estimation physical retrieval TROPoe (Turner and Löhnert 2014; Turner and Blumberg 2019; Turner and Löhnert 2021). The profiles are retrieved every 10 minutes from instantaneous observations from the NREL ASSIST-II (SN 11) infrared spectrometer. Observations are noise-filtered but not averaged in time to minimize errors due to non-uniform clouds. Additional input data in TROPoe are cloud base height from a collocated NREL Upgraded Galion lidar #1212-60 and temperature, RH, and pressure from collocated PNNL met station. The lidar beta is used to estimate the cloud base height through a modified algorithm by Newsom et al., 2019 used at ARM SGP. The full pipeline for running the retrieval is available at https://github.com/StefanoWind/TROPoe_processor. In addition to these temporally resolved input data, TROPoe requires an a priori dataset (prior) which provides mean climatological estimates of thermodynamic profiles and specifies how temperature and humidity covary with height as an input (for details see e.g. Djalalova et al. 2022). The prior is a key component of the retrieval and provides a constraint on the ill-posed inversion problem. A monthly prior was computed from operational radiosonde launches at Upton, NY.

17 WIND ENERGY↗
DOE OSTI2026

ARM Radiosondes for SNPP/JPSS Validation Field Campaign Report

This field campaign extension has been a coordinated effort involving the U.S. Department of Energy Atmospheric Radiation Measurement (ARM) User Facility, the University of Wisconsin at Madison, and the Joint Polar Satellite System (JPSS) project to validate NOAA Unique Combined Atmospheric Processing System (NUCAPS) temperature and moisture sounding products from the Cross-track Infrared Sounder (CrIS) and the Advanced Technology Microwave Sounder (ATMS) instruments on board the NOAA-20 and NOAA-21 satellite platforms. In this arrangement, funding for radiosondes and balloons was provided by the JPSS project to ARM. These radiosondes were launched coincident with NOAA-20 and NOAA-21 satellite overpasses at the ARM field sites at Eastern North Atlantic (ENA), North Slope Alaska (NSA), and Southern Great Plains (SGP). Combined with other ARM data, an assessment of the radiosonde data quality was performed and post-processing corrections applied. The dedicated radiosondes were integrated into the NOAA Products Validation System (NPROVS+), which collocated the radiosondes with satellite products (NOAA, National Aeronautics and Space Administration [NASA], European Organisation for the Exploitation of Meteorological Satellites [EUMETSAT], Geostationary Operational Environmental Satellite [GOES], Constellation Observing System for Meteorology, Ionosphere, and Climate [COSMIC]) and numerical weather prediction (NWP) forecasts for use in product assessment and algorithm development. This work is a part of the NOAA-20 and NOAA-21 satellite retrieval validation efforts and provides critical accuracy assessments of the temperature and water vapor soundings.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

AWAKEN 2023 CLAMPS2 MWR TROPoe Retrievals

These files contain 24 hour periods of retrieved thermodynamic profiles derived from observations collected by the CLAMPS2 Microwave Radiometer (MWR). The TROPoe algorithm is a python equivalent to the AERIoe algorithm (see Turner and Loehnert, 2014; Turner and Blumberg 2019). These data were collected during the AWAKEN project. MWR only data is available.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

PhaseT3M: 3D imaging at 1.6 Å resolution via electron cryo-tomography with nonlinear phase retrieval

Electron cryo-tomography (cryo-ET) enables 3D imaging of complex, radiation-sensitive structures with molecular detail. However, image contrast from the interference of scattered electrons is nonlinear with atomic density and multiple scattering further complicates interpretation. These effects degrade resolution, particularly in conventional reconstruction algorithms, which assume linearity. Particle averaging can reduce such issues but is unsuitable for heterogeneous or dynamic samples ubiquitous in biology, chemistry, and materials sciences. Here, we develop a phase retrieval-based cryo-ET method, PhaseT3M. We experimentally demonstrate its application to an approximately 7 nm Co3O4 nanoparticle on an approximately 30 nm carbon substrate, achieving a maximum resolution of 1.6 Å, surpassing conventional limits using standard cryo-TEM equipment. PhaseT3M uses a multislice model for multiple scattering and Bayesian optimization for alignment and computational aberration correction, with a positivity constraint to recover ‘missing wedge’ information. Applied directly to biological particles, it enhances reconstruction quality and reduces artifacts, establishing a standard for routine 3D imaging with phase contrast.

Biophysics↗