SEARCH · Search NASA

Results for “data retrieval”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

All sources NASA NTRS DOE OSTI

DOE OSTI2024

Use of Satellite, Surface Observations and Numerical Weather Prediction Model Data to Improve Cloud Base Height and Cloud Base Vertical Velocity Estimation

Cloud base height (CBH) and cloud base vertical velocity (CBVV) are important variables that impact the overall climate in a region as they influence the formulation, longevity, and evolution of clouds. Retrieval of both parameters have long used ground instrumentation (e.g., Doppler lidar (DL), ground base radar); however, retrieving CBH from satellites is particularly challenging given that space-based instruments only observe cloud tops. In this manuscript, CBH is retrieved using a multi-linear regression equation, while CBVV used a random forests model. Both retrievals combine satellite and numerical weather prediction data. The satellite data used are the Visible Infrared Imaging Radiometer Suite imagery, while measurements of CBH and CBVV include DL and radiosonde data at the Southern Great Plains (SGP) Atmospheric Radiation Measurement observatory. Data from 83 summer days (May-August) in 2018–2021 featuring cumulus clouds forced by solar heating were examined and used to train the models, with years 2022–2023 used for validation. Various spatial domains were defined with one large (2.4° longitude by 2.0° latitude) SGP domain being split into smaller sections (smallest being 0.99° and 0.61° longitude and latitude respectably). CBH and CBVV values obtained from the DL as compared to the models show root mean square errors between 150 and 200 m, with CBVV values between 0.45 and 1 ms -1 . Finally, it was found that the CBH formulation performs well over all domains, while the CBVV retrievals become less accurate due to more turbulence being introduced into the observations as the number of DL stations decreases in the smaller domains.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

CACTI CSAPR2 Taranis Retrievals

Taranis is an end-to-end processing chain for radar data written in Python with C extension for computation performance. Features include: masking for quality control, specific differential phase (Kdp), attenuation correction for reflectivity factor (Z) and differential reflectivity (Zdr) in rain, and additional geophysical retrievals. Retrievals are mostly drawn from literature or open-source software when appropriate, and have been tested, tuned, and modified to work with one another cohesively rather than using isolated off-the-shelf algorithms. Incorporated algorithms include hydrometeor (echo) identification, rain water content, raindrop mass-weighted mean diameter (gamma size distribution assumption), and rainfall rate (QPE). Taranis data sets exist for CSAPR2 PPI, HSRHI, and sector RHI scans. Cartesian-gridded data sets were also produced as well as a near-surface rain rate retrieval. More details can be found in the README.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

Enabling Robust Exoplanet Atmospheric Retrievals with Gaussian Processes

Atmospheric retrievals are essential tools for interpreting exoplanet transmission and eclipse spectra, enabling quantitative constraints on the chemical composition, aerosol properties, and thermal structure of planetary atmospheres. The James Webb Space Telescope (JWST) offers unprecedented spectral precision, resolution, and wavelength coverage, unlocking transformative insights into the formation, evolution, climate, and potential habitability of planetary systems. However, this opportunity is accompanied by challenges: modeling assumptions and unaccounted-for noise or signal sources can bias retrieval outcomes and their interpretation. To address these limitations, we introduce a Gaussian process (GP)-aided atmospheric retrieval framework that flexibly accounts for unmodeled features and correlated noise in exoplanet spectra. We validate this method on synthetic JWST observations, and show that GP-aided retrievals reduce bias in inferred abundances and better capture model–data mismatches than traditional approaches. We also introduce the concept of mean squared error to quantify the trade-off between bias and variance, arguing that this metric more accurately reflects retrieval performance than bias alone. We then reanalyze the NIRISS/SOSS JWST transmission spectrum of WASP-96 b, finding that GP-aided retrievals yield broader constraints on CO 2 and H 2 O, possibly alleviating tension between previous retrieval results and equilibrium predictions. Our GP framework provides precise and accurate constraints while highlighting regions where models fail to explain the data. As JWST matures and future facilities come online, a deeper understanding of the limitations of both data and models will be essential, and GP-enabled retrievals like the one presented here offer a principled path forward.

Rotman, Yoav [Arizona State Univ., Tempe, AZ (Unit↗

DOE OSTI2024

Effects of carbon concentration on the local atomic structure of amorphous GST

Ge-Sb-Te (GST) alloys are leading phase-change materials for data storage due to the fast phase transition between amorphous and crystalline states. Ongoing research aims at improving the stability of the amorphous phase to improve retention. This can be accomplished by the introduction of carbon as a dopant to Ge 2 Sb 2 Te 5 , which is known to alter the short- and mid-range structure of the amorphous phase and form covalently bonded C clusters, both of which hinder crystallization. The relative importance of these processes as a function of C concentration is not known. Here we used molecular dynamics simulation based on density functional theory to study how carbon doping affects the atomic structure of GST-C. Carbon doping results in an increase in tetrahedral coordination, especially of Ge atoms, and this is known to stabilize the amorphous phase. We observe an unexpected, non-monotonous trend in the number of tetrahedral bonded Ge with the amount of carbon doping. Our simulations show an increase in the number of tetrahedral bonded Ge up to 5 at.% C, after which the number saturates and begins to decrease above 14 at.% C. The carbon atoms aggregate into clusters, mostly in the form of chains and graphene flakes, leaving less carbon to disrupt the GST matrix at higher carbon concentrations. Different degrees of carbon clustering can explain divergent experimental results for recrystallization temperature for carbon doped GST.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2025

The Natural Products Magnetic Resonance Database (NP-MRD) for 2025

The Natural Products Magnetic Resonance Database or NP-MRD (https://np-mrd.org) is a comprehensive, freely accessible, web-based resource for the deposition, distribution, extraction and retrieval of nuclear magnetic resonance (NMR) data on natural products. The NP-MRD was initially established to support compound de-replication and data dissemination for the natural products community. However, that community has now grown to include many users from the metabolomics, microbiomics, foodomics and nutrition science fields. Indeed, since its launch in 2021, the NP-MRD has expanded enormously in size, scope and popularity. The current version of NP-MRD now contains nearly 7X more compounds (281,859 vs. 40,908) and 7X more NMR spectra (5.1 million vs. 817,000) than the first release. More specifically, an additional 4.6 million predicted spectra and another 11,000 spectra simulated from experimental chemical shifts were deposited into the database. Likewise, the number of NMR raw spectral data depositions has grown from a 165 spectra per year to more than 10,000 per year. As a result of this expansion, the number of monthly webpage views has grown from 55 to 20,000 and the number of monthly visitors has increased from 7 to 2500. To address this growth and to better support the expanding needs of its diverse community of users, many additional improvements to the NP-MRD have been made. These include significant enhancements to the data submission process, important improvements to the visualization and display of NMR spectra, notable updates to the database’s spectral search utilities and useful additions to support better NMR spectral analysis/prediction. Significant efforts have also been undertaken to remediate and update many of NP-MRD’s database entries. This manuscript describes these database improvements and expansion efforts, along with how they have been implemented and what future upgrades to the NP-MRD are planned.

Artifical Intelligence↗

DOE OSTI2024

$Z$-Pinch Interferometry Analysis With the Fourier-Based TNT Code

Here, we present the analysis of interferometry diagnostics with the user-friendly Talbot Numerical Tool (TNT), a Fourier-based postprocessing code that enables real-time assessment of plasma systems. TNT performance was explored with visible and infrared interferometry in pulsed-power-driven Z -pinch configurations to expand its capabilities beyond Talbot X-ray interferometry in the high-intensity laser environment. TNT enabled accurate electron density characterization of magnetically driven plasma flows and shocks through phase-retrieval methods that did not require data modification or masking. TNT demonstrated enhanced resolution, detecting below 4 % fringe shift, which corresponds to 8.7 × 10 15 cm –2 within 28 μ m, approaching the laser probing system limit. TNT was tested against a well-known interferometry analysis software, delivering an average resolving power nearly ten times better (~28 μ m versus ~ 210 μ m) when resolving plasma ablation features. TNT demonstrated higher sensitivity when probing sharp electron density gradients in supersonic shocks. A maximum electron areal density of 4.1 × 10 17 cm –2 was measured in the shocked plasma region, and a minimum electron density detection of ~ 1.0 × 10 15 cm –2 was achieved. When probing colliding plasma flows, the calculations of the effective adiabatic index and the associated errors were improved from γ* = 2.6 ± 1.6 – 1.4 ± 0.2 with TNT postprocessing, contributing valuable data for the interpretation of radiative transport. Additional applications of TNT in the characterization of pulsed-power plasmas and beyond are discussed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2025

LLaMP v0.1.0

Reducing hallucination of Large Language Models (LLMs) is imperative for use in the sciences, where reliability and reproducibility are crucial. However, LLMs inherently lack long-term memory, making it a nontrivial, ad hoc, and inevitably biased task to fine-tune them on domain-specific literature and data. LLaMP is a multimodal retrieval-augmented generation (RAG) framework of hierarchical reasoning and acting (ReAct) agents that can dynamically and recursively interact with Materials Project to ground large language models on high-fidelity materials informatics.

Riebesell, Janosh [Lawrence Berkeley National Labo↗

DOE OSTI2025

Propagating information content: an example with advection

The mathematical algorithm to derive geophysical information from remote sensing observations is called a retrieval. The mathematics of many retrieval problems are ill-posed, and thus a priori information is used to help constrain the derived geophysical variable to realistic values. One quantity of interest, therefore, is the information content of the observation. Perfect information content in the observation would be achieved if the retrieval were able to capture any perturbation in the desired geophysical variable with the proper magnitude. Many new data products can be derived by combining geophysical variables retrieved from multiple different remote sensors. This paper explores, for the first time, how to derive the information content of these derived products. The approach uses traditional error propagation techniques to derive the uncertainty of the derived field twice, both when the observations are used in the retrieval and also when only the a priori information from each remote sensor is propagated. These two uncertainties are then used to provide an estimate of the information content of the derived geophysical variable. This study demonstrates how to propagate the uncertainties from six different instruments to provide the information content for water vapor and temperature advection. A multi-month analysis demonstrates that, in a mean sense, the information content for temperature advection is nearly unity for all heights below 700 m while, the information content for water vapor advection is somewhat more variable but still larger than 0.6 in the convective boundary layer.

Turner, David D. [National Oceanic and Atmospheric↗

DOE OSTI2025

KAZR-based snowfall rates during SAIL

This data set provides KAZR radar based retrievals of snowfall rates for the two cold periods of the SAIL campaign (NOV 2021- APR 2022 and NOV 2022 - APR 2023).

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2026

Estimating Fine-Resolution Shortwave Broadband Albedo of Croplands from Harmonized Landsat and Sentinel-2 Data

Altered surface albedo due to land-cover conversions and management is a significant driver of global climate change. Albedo can be directly measured at ground stations, and remote sensing data can be used to scale-up albedo values to regional and global levels. Some previous studies have retrieved fine-resolution (10–30 m) instantaneous albedo and coarse-resolution (500–1000 m) daily mean albedo from remote sensing data, but they all required the input of Moderate Resolution Imaging Spectroradiometer (MODIS) albedo information at 500-m resolution, and none have assembled both instantaneous and daily albedo based exclusively on fine-resolution satellite data. Here, to address this issue, we compiled 387 instantaneous and 346 daily albedo records using field net radiometer measurements from the bioenergy croplands at the W. K. Kellogg Biological Station in southwest Michigan. We then connected these albedo records with a suite of variables derived from harmonized Landsat and Sentinel-2 data through two machine learning algorithms (random forest regression and extreme gradient boosting) to retrieve clear-sky instantaneous and daily shortwave broadband albedo. The performance statistics indicate reasonable accuracy of model results [root-mean-square error (RMSE)] around or below 0.03 except for snow-covered surfaces), suggesting that the retrieval of both instantaneous and daily albedo based exclusively on fine-resolution satellite data is promising. To facilitate the use of fine-resolution albedo products at the global level, future efforts need to include more albedo records of diverse surface cover types, as well as to accurately model daily albedo for cloudy days to address the “clear-sky bias.”

Harmonized Landsat and Sentinel-2↗

DOE OSTI2025

Self-supervised physics-informed generative networks for phase retrieval from a single X-ray hologram

X-ray phase contrast imaging significantly improves the visualization of structures with weak or uniform absorption, broadening its applications across a wide range of scientific disciplines. Propagation-based phase contrast is particularly suitable for time- or dose-critical in vivo/in situ/operando (tomography) experiments because it requires only a single intensity measurement. However, the phase information of the wave field is lost during the measurement and must be recovered. Conventional algebraic and iterative methods often rely on specific approximations or boundary conditions that may not be met by many samples or experimental setups. In addition, they require manual tuning of reconstruction parameters by experts, making them less adaptable for complex or variable conditions. Here we present a self-learning approach for solving the inverse problem of phase retrieval in the near-field regime of Fresnel theory using a single intensity measurement (hologram). A physics-informed generative adversarial network is employed to reconstruct both the phase and absorbance of the unpropagated wave field in the sample plane from a single hologram. Unlike most state-of-the-art deep learning approaches for phase retrieval, our approach does not require paired, unpaired, or simulated training data. This significantly broadens the applicability of our approach, as acquiring or generating suitable training data remains a major challenge due to the wide variability in sample types and experimental configurations. The algorithm demonstrates robust and consistent performance across diverse imaging conditions and sample types, delivering quantitative, high-quality reconstructions for both simulated data and experimental datasets acquired at beamline P05 at PETRA III (DESY, Hamburg), operated by Helmholtz-Zentrum Hereon. Furthermore, it enables the simultaneous retrieval of both phase and absorption information.

36 MATERIALS SCIENCE↗

DOE OSTI2025

MODIS Aerosol and Low‐Cloud Retrievals: Orographic Effects in the Wake of Macquarie Island

Abstract Visible/infrared imagery from passive satellites is commonly relied upon to study low cloud microphysics over oceanic regions, including for the Southern Ocean (SO), but relatively little validation has been undertaken for the SO. In this article, we compare low‐cloud effective radius ( r e ), cloud droplet number concentration ( N d ) and cloud liquid water path (LWP) retrievals from the NASA Moderate Imaging Spectroradiometer (MODIS) with surface measurements collected during the Macquarie Island Cloud and Radiation Experiment (MICRE). MODIS 3.7‐μm band retrievals show little bias and moderately good correlation relative to MICRE retrievals for liquid‐phase low clouds when restricted to Solar Zenith Angles <65° on spatial scales of 50–100 km. However, the low overall bias in 3.7‐μm band effective radius ( r e 3.7 ) retrievals partly results from cancellation of errors: r e 3.7 is overestimated for non‐to‐lightly precipitating clouds, and underestimated for heavier drizzling clouds by ∼1–1.5 μm. 1.6‐μm and 2.1‐μm band r e retrievals are biased high. N d may likewise be slightly under‐ or overestimated depending on the concentration, but there is insufficient data to provide confidence in this result. Interestingly, a composite of MODIS retrievals from 2002 to 2020 show a distinct region of enhanced cloud cover and N d (and lower r e ) in the wake of Macquarie Island associated with orographic cloud formation. MODIS retrievals of aerosol optical depth (AOD) and Angstrom Exponent (AE) upwind and downwind of the island do not differ significantly. Comparison with MICRE measurements suggests that MODIS Collection 6 AOD retrievals are reasonable, while AE is problematically large.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

AIACHNE's contribution for Nuclear Energy Agency Working Party on International Nuclear Data Evaluation Co-operation Subgroup 50

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2024

AIACHNE's contribution for Nuclear Energy Agency Working Party on International Nuclear Data Evaluation Co-operation Subgroup 50

The AIACHNE (AI/ML Informed cAlifornium CHi Nuclear data Experiment) project aims at designing an experiment for the 252 Cf Prompt Fission Neutron Spectrum (PFNS) that explores systematic biases in an experimental database retrieved from the EXFOR databases. To that end, machine learning (ML) methods were applied to pint-point measurement features likely related to bia. From that information, we selected a feature that should be explored by the AIACHNE experiment. Measurement features are metadata encapsulating all pertinent information about the physical measurement and analysis techniques. Examples are, for instance, what neutron and fission detectors were used for the physical metadata, and what background reduction techniques were employed for analysis techniques. Such metadata were retrieved both from EXFOR entries as well as the literature of data sets described in detail in Ref. [2]. The prerequisite for applying machine learning techniques is casting the metadata into a format that can be parsed by the algorithm. This step might seem trivial but requires to find a unique language where metadata that carry the same physics meaning across several experiments must have the same identifier. One example is, for instance, the neutron detector. As seen in Figure 1, the machine learning code identified the use of 6 Li detectors as being related to bias in some datasets of the AIACHNE 252 Cf PFNS experimental database. In fact, here are several experiments that used neutron detectors containing 6Li in the database, for instance for the example below. EXFOR format has a unique keywords describing detectors such as “SCIN” or “GLASD”. One may think that these keywords are already sufficient descriptors for ML to uniquely find an issue. However, “SCIN” (used for [3, 4]) and “GLASD” (used for [5]) fail to inform the algorithm what is the active material in the detector. And, the key common issue leading to bias in 252 Cf related to neutron detectors is not whether it is a glass detector or a scintillator. No, the issue is that 6 Li was within both detector types and that even small mistakes in the detector response functions around approximately 200 keV are amplified by the 6 Li(n,α) resonance there leading to bias in data as highlighted in Fig. 1 and Ref. [1]. Hence, the features describing the neutron detector must call out the active material in the detector, rather than the existing EXFOR detector keyword, that the ML algorithm can find physically meaningful features related to bias. The AIACHNE team used a precursor of the WPEC (Working Party on International Nuclear Data Evaluation Co-operation) SG(Subgroup)-50 format to store the metadata for the ML analysis.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2024

Roadmap on data-centric materials science

Science is and always has been based on data, but the terms ‘data-centric’ and the ‘4th paradigm’ of materials research indicate a radical change in how information is retrieved, handled and research is performed. It signifies a transformative shift towards managing vast data collections, digital repositories, and innovative data analytics methods. The integration of artificial intelligence and its subset machine learning, has become pivotal in addressing all these challenges. This Roadmap on Data-Centric Materials Science explores fundamental concepts and methodologies, illustrating diverse applications in electronic-structure theory, soft matter theory, microstructure research, and experimental techniques like photoemission, atom probe tomography, and electron microscopy. While the roadmap delves into specific areas within the broad interdisciplinary field of materials science, the provided examples elucidate key concepts applicable to a wider range of topics. The discussed instances offer insights into addressing the multifaceted challenges encountered in contemporary materials research.

36 MATERIALS SCIENCE↗

DOE OSTI2025

WREF Halo Streamline scanning lidar / Derived data / High-frequency wind profiles

This dataset contains wind profiles retrieved from 6-beam Velocity Azimuth Display (VAD) scans done by the UC Davis scanning Lidar. The wind components (expressed as zonal, meridional and vertical) are retrieved through the algorithm of Paschke et al. (2015). The quality control of the radial wind speed is performed following the algorithm of Goring & Nikora (2002).

17 WIND ENERGY↗

DOE OSTI2025

Domain-specific text embedding model for accelerator physics

Accelerator physics presents unique challenges for natural language processing (NLP) due to its specialized terminology and complex concepts. A key component in overcoming these challenges is the development of robust text embedding models that transform textual data into dense vector representations, facilitating efficient information retrieval and semantic understanding. In this work, we introduce AccPhysBERT, a sentence embedding model fine-tuned specifically for accelerator physics. Our model demonstrates superior performance across a range of downstream NLP tasks, surpassing existing models in capturing the domain-specific nuances of the field. We further showcase its practical applications, including semantic paper-reviewer matching and integration into retrieval-augmented generation systems, highlighting its potential to enhance information retrieval and knowledge discovery in accelerator physics. Published by the American Physical Society 2025

Hellert, Thorsten (ORCID:0000000227970926)↗

DOE OSTI2025

Evaluation of Hanford 200 West Area Tank Farms (241-S/241-SX-/241-U tank farms) Physical Properties Data for Use in Development of West Area Tank Treatment (WATT) Processing

With the recent acceptance of West Area Tank Treatment disposition alternative for 200 West Area tanks at the Hanford Site by the State of Washington and the U.S. Department of Energy, a review was initiated to identify the physical properties data available in the literature for the Hanford 241-S, 241-SX, and 241-U tank farms. The literature reviewed indicated that there is a relatively small set of useful data on physical properties of 200 West Area tanks, and the data that do exist are biased around a narrow range of tank samples. Much of the testing between the 1990s and mid-2010s was intended to support either enhanced sludge washing or feed delivery to the Pretreatment Facility at the Hanford Waste Treatment and Immobilization Plant. As such, some physical properties of 200 West Area samples were measured under conditions that are no longer relevant. Because of the distinctly different nature of many past processes at the 200 West Area compared to the 200 East Area, insight from waste testing in the 200 East Area waste should be used with caution, as there may be significantly different qualities in the physical properties data between these two areas (both in situ and as measured in laboratory analyses). Based on this assessment, there is a need to collect additional physical property data to support planning for 200 West Area retrievals.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗