Search NASA⌕ Search

SEARCH · Search NASA

Results for “visual relationship detection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

12 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Tackling the Challenges in Scene Graph Generation With Local-to-Global Interactions

In this work, we seek new insights into the underlying challenges of the scene graph generation (SGG) task. Quantitative and qualitative analysis of the visual genome (VG) dataset implies: 1) ambiguity: even if interobject relationship contains the same object (or predicate), they may not be visually or semantically similar; 2) asymmetry: despite the nature of the relationship that embodied the direction, it was not well addressed in previous studies; and 3) higher-order contexts: leveraging the identities of certain graph elements can help generate accurate scene graphs. Motivated by the analysis, we design a novel SGG framework, Local-to-global interaction networks (LOGINs). Locally, interactions extract the essence between three instances of subject, object, and background, while baking direction awareness into the network by explicitly constraining the input order of subject and object. Globally, interactions encode the contexts between every graph component (i.e., nodes and edges). Finally, Attract and Repel loss is utilized to fine-tune the distribution of predicate embeddings. By design, our framework enables predicting the scene graph in a bottom-up manner, leveraging the possible complementariness. To quantify how much LOGIN is aware of relational direction, a new diagnostic task called Bidirectional Relationship Classification (BRC) is also proposed. Overall, experimental results demonstrate that LOGIN can successfully distinguish relational direction than existing methods (in BRC task), while showing state-of-the-art results on the VG benchmark (in SGG task).

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

ARCH: Large-scale knowledge graph via aggregated narrative codified health records analysis

Objective: Electronic health record (EHR) systems contain a wealth of clinical data stored as both codified data and free-text narrative notes (NLP). The complexity of EHR presents challenges in feature representation, information extraction, and uncertainty quantification. Here, to address these challenges, we proposed an efficient Aggregated naRrative Codified Health (ARCH) records analysis to generate a large-scale knowledge graph (KG) for a comprehensive set of EHR codified and narrative features. Methods: Using data from 12.5 million Veterans Affairs patients, ARCH first derives embedding vectors and generates similarities along with associated p-values to measure the strength of relatedness between clinical features with statistical certainty quantification. Next, ARCH performs a sparse embedding regression to remove indirect linkage between features to build a sparse KG. Finally, ARCH was validated on various clinical tasks, including detecting known relationships between entity pairs, predicting drug side effects, disease phenotyping, as well as sub-typing Alzheimer’s disease patients. Results: ARCH produces high-quality clinical embeddings and KG for over 60,000 codified and narrative EHR concepts. The KG and embeddings are visualized in the R-shiny powered web-API.3 ARCH achieved high accuracy in detecting EHR concept relationships, with AUCs of 0.926 (codified) and 0.861 (NLP) for similar EHR concepts, and 0.810 (codified) and 0.843 (NLP) for related pairs. It detected drug side effects with a 0.723 AUC, which improved to 0.826 after fine-tuning. Using both codified and NLP features, the detection power increased significantly. Compared to other methods, ARCH has superior accuracy and enhances weakly supervised phenotyping algorithms’ performance. Notably, it successfully categorized Alzheimer’s patients into two subgroups with varying mortality rates. Conclusion: The proposed ARCH algorithm generates large-scale high-quality semantic representations and knowledge graph for both codified and NLP EHR features, useful for a wide range of predictive modeling tasks.

Electronic health records↗
DOE OSTI2023

A striking relationship between dust extinction and radio detection in DESI QSOs: evidence for a dusty blow-out phase in red QSOs

ABSTRACT We present the first eight months of data from our secondary target programme within the ongoing Dark Energy Spectroscopic Instrument (DESI) survey. Our programme uses a mid-infrared and optical colour selection to preferentially target dust-reddened quasi-stellar objects (QSOs) that would have otherwise been missed by the nominal DESI QSO selection. So far, we have obtained optical spectra for 3038 candidates, of which ∼70 per cent of the high-quality objects (those with robust redshifts) are visually confirmed to be Type 1 QSOs, consistent with the expected fraction from the main DESI QSO survey. By fitting a dust-reddened blue QSO composite to the QSO spectra, we find they are well-fitted by a normal QSO with up to AV ∼ 4 mag of line-of-sight dust extinction. Utilizing radio data from the LOFAR Two-metre Sky Survey (LoTSS) DR2, we identify a striking positive relationship between the amount of line-of-sight dust extinction towards a QSO and the radio detection fraction, that is not driven by radio-loud systems, redshift and/or luminosity effects. This demonstrates an intrinsic connection between dust reddening and the production of radio emission in QSOs, whereby the radio emission is most likely due to low-powered jets or winds/outflows causing shocks in a dusty environment. On the basis of this evidence, we suggest that red QSOs may represent a transitional ‘blow-out’ phase in the evolution of QSOs, where winds and outflows evacuate the dust and gas to reveal an unobscured blue QSO.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Detecting lithium plating dynamics in a solid-state battery with operando X-ray computed tomography using machine learning

Operando X-ray micro-computed tomography (µCT) provides an opportunity to observe the evolution of Li structures inside pouch cells. Segmentation is an essential step to quantitatively analyzing µCT datasets but is challenging to achieve on operando Li-metal battery datasets due to the low X-ray attenuation of the Li metal and the sheer size of the datasets. Herein, we report a computational approach, batteryNET, to train an Iterative Residual U-Net-based network to detect Li structures. The resulting semantic segmentation shows singular Li-related component changes, addressing diverse morphologies in the dataset. In addition, visualizations of the dead Li are provided, including calculations about the volume and effective thickness of electrodes, deposited Li, and redeposited Li. We also report discoveries about the spatial relationships between these components. The approach focuses on a method for analyzing battery performance, which brings insight that significantly benefits future Li-metal battery design and a semantic segmentation transferrable to other datasets.

25 ENERGY STORAGE↗
DOE OSTI2025

Unimodal Imaging of Monovalent Metal-Chelator Complexes and Lipids by MALDI Imaging Mass Spectrometry

Careful regulation of monovalent metal ions (M + ) is necessary to maintain a functional cellular system. Of these ions, appropriate sodium (Na + ) and potassium (K + ) concentrations are particularly integral for electrochemical signaling, as well as the secondary transport of nutrients and waste. Dysregulation of M + homeostasis can disrupt these mechanisms, potentially influencing the metabolism of downstream biomolecules such as lipids. Thus, the relationship between M + abundances and related biomolecular distributions must be elucidated to better understand the physiology of healthy and disordered tissues. Traditional techniques for imaging biological metal distributions include SIMS, LA-ICP-MS, and XRF; however, these capabilities are limited to elemental analysis or the analysis of molecular fragments and must be paired with other modalities to visualize distributions of more complex biomolecules within the same or similar samples. Conversely, matrix-assisted laser desorption/ionization imaging mass spectrometry (MALDI IMS) is a powerful tool often used for mapping such biomolecular distributions, but current methods are unable to detect metals within tissue. This study illustrates a novel methodology that adds metal detection to the MALDI IMS repertoire through which the simultaneous detection of M + metals and lipids is achievable. Using a robotic sprayer for homogeneous application, on-tissue deposition of the chelator deferiprone (DEF) enables subsequent detection of the ionizable metal-chelator complex by MALDI without hindering lipid detection. Our work provides proof-of-concept data for the simultaneous detection of K + , Na + , and intact lipids using MALDI IMS.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Topological Characterization and Uncertainty Visualization of Atmospheric Rivers

Atmospheric rivers (ARs) are long, narrow regions of water vapor in the Earth's atmosphere that transport heat and moisture from the tropics to the mid-latitudes. ARs are often associated with extreme weather events in North America and contribute significantly to water supply and flood risk. However, characterizing ARs has been a major challenge due to the lack of a universal definition and their structural variations. Existing AR detection tools (ARDTs) produce distinct AR boundaries for the same event, making the risk assessment of ARs a difficult task. Understanding these uncertainties is crucial to improving the predictability of AR impacts, including their landfall areas and associated precipitation, which could cause catastrophic flooding and landslides over the coastal regions. In this work, we develop an uncertainty visualization framework that captures boundary and interior uncertainties, i.e., structural variations, of an ensemble of ARs that arise from a set of ARDTs. We first provide a statistical overview of the AR boundaries using the contour boxplots of Whitaker et al. that highlight the structural variations of AR boundaries based on their nesting relationships. We then introduce the topological skeletons of ARs based on Morse complexes that characterize the interior variation of an ensemble of ARs. We propose an uncertainty visualization of these topological skeletons, inspired by MetroSets of Jacobson et al. that emphasizes the agreements and disagreements across the ensemble members. Through case studies and expert feedback, we demonstrate that the two approaches complement each other, and together they could facilitate an effective comparative analysis process and provide a more confident outlook on an AR's shape, area, and onshore impact.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Advances and Challenges in Fluorescence in situ Hybridization for Visualizing Fungal Endobacteria

We report that Several bacteria have long been known to interact intimately with fungi, but molecular approaches have only recently uncovered how cosmopolitan these interactions are in nature. Currently, bacterial–fungal interactions (BFI) are inferred based on patterns of co-occurrence in amplicon sequencing investigations. However, determining the nature of these interactions, whether the bacteria are internally or externally associated, remains a grand challenge in BFI research. Fluorescence in situhybridization (FISH) is a robust method that targets unique sequences of interest which can be employed for visualizing intra-hyphal targets, such as mitochondrial organelles or, as in this study, bacteria. We evaluate the challenges and employable strategies to resolve intra-hyphal BFI to address pertinent criteria in BFI research, such as culturing media, spatial distribution of bacteria, and abundance of bacterial 16S rRNA copies for fluorescent labeling. While these experimental factors influence labeling and detection of endobacteria, we demonstrate how to overcome these challenges thorough permeabilization, appropriate media choice, and targeted amplification using hybridization chain reaction FISH. Such microscopy imaging approaches can now be utilized by the broader research community to complement sequence-based investigations and provide more conclusive evidence on the nature of specific bacterial–fungal relationships.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

Framework Short-Range Order Observed in a Spinel-Type Li Superionic Conductor

Solid-state superionic conductors are characterized by rich structural disorders. Though structural complexities are central to their functionalities, they often give rise to short-range order that eludes detection by conventional diffraction-based techniques and is thus overlooked in establishing precise structure-property relationships. In this work, we synthesized single crystals of a recently discovered lithium (Li) superionic conductor Li16.2(1)In9.00(2)Sn1.10(1)O23.8 (LISO) for in-depth characterizations of structural subtleties. LISO exhibits an unusual spinel-like phase with significant Li overstoichiometry and a face-sharing Li network. Single-crystal neutron diffraction confirms significant Li disorder, as manifested in Li site splitting and partial occupancy. More importantly, synchrotron diffuse scattering combined with 3D-ΔPDF analysis and Monte Carlo simulations reveal short-range order in the nonalkali framework that might contribute to the phase stability and ionic conductivity. This work showcases an example in which subtle local energetics can be directly visualized in structurally disordered ionic conductors.

Chen, Yu↗
DOE OSTI2023

Amino mapping: possibility to visualize amino-N compounds in the rhizosphere of Zea Mays L.

Abstract Understanding N uptake by plants, the N cycle, and their relationship to soil heterogeneity has generated a great deal of interest in the distribution of amino-N compounds in soil. Visualization of the spatial distribution of amino-N in soil can provide insights into the role of labile N in plant-microbial mechanisms of N acquisition and plant N uptake, but until now, it has remained technically challenging. Here, we describe a novel technique to visualize the amino-N distribution at the root-soil interface. The technique is based on time-lapse amino mapping (TLAM) using membranes saturated with the fluorogenic OPAME reagent (O-phthalaldehyde and β-mercaptoethanol). OPAME in the membrane reacts with organic compounds containing a NH 2 functional group at the membrane-soil interface, generating a fluorescent product visible under UV light and detectable by a digital camera. The TLAM amino-mapping technique was applied to visualize and quantify the concentration of amino-N compounds in the rhizosphere of maize (Zea MaysL.). A ten times greater amino-N concentration was detected in the rhizosphere compared to non-rhizosphere soil. The high content of amino-N was mainly associated with the root tips and was 3 times larger than the average amino-N content at seminal roots. The amino-N rhizosphere was 2 times broader around the root tips than around other parts of the roots. We concluded that TLAM is a promising approach for monitoring the fate of labile N in soils. However, the technique needs to be standardized for different soil types, plant species, and climate conditions to allow wider application.

Agriculture↗
DOE OSTI2021

Quantifying Properties for a Mechanistic, Predictive Understanding of Aqueous Impact on Aging of Medium and Low Voltage AC and DC Cabling in Nuclear Power Plants

To address the gap in knowledge in understanding degradation in relevant service conditions, this project aimed to develop a mechanistic, predictive model of medium and low voltage cable failure based on the primary environmental degradation parameters of aqueous immersion time, temperature, and the oxidation extent. To do so, we took a two-fold approach toward evaluating degradation as related to the aqueous condition. First, we evaluated the chemical, mechanical, and electrical properties of polymers that comprise the cabling insulation under varied aqueous conditions at different temperatures. Secondly, we evaluated the performance of insulation materials under similar accelerated aging conditions in addition to the dielectric breakdown of the cabling under submersion conditions. Thermal oxidation and immersion of LDPE thin films were done using a Parr vessel and the extent of oxidation was monitored using the carbonyl index from ATR-FTIR spectrum, a ratio quantifying the carbonyl functionality produced on the LDPE film surface. Increasing the temperature, oxidation time, and oxygen pressure increased the water-vapor permeability and the carbonyl content. Thermogravimetric analysis of the films confirmed that there is indeed an initial weight loss of the smaller molecular weight molecules and volatiles. At higher temperatures, there is a secondary mass loss. Up to 70°C, the mass loss curves were similar until 80°C, when the aged films decreased at a much greater rate with respect to increasing temperature. This was seen in the 10, 50, 90% weight loss temperatures. The mechanical properties of sheet PP and HDPE as well as injection molded LDPE, HDPE, HDPP dog bones were plotted with respect to the time spent in the Parr vessel during thermal oxidation. For the sheet PP and HDPE, the UTS and the modulus of elasticity decreased while the elongation increased. The injection-molded LDPE, HDPE, and HDPP dog bones experienced a similar trend where the changes in the properties were within experimental uncertainty. This analysis of LDPE in dry and immersive oxygen-rich environments is an important baseline for future experiments looking at other degradation mechanisms. A predictive aging model for low-density polyethylene insulative cable housings was developed. This model revealed a combination of physical and chemical processes which lead to an increase in permeability and a decrease in strength of the insulator. In creating this predictive model, a gap of knowledge in the literature was revealed in two areas: understanding how the crystallinity of a polymer changes with time and visualizing the predicted pores formed through the insulator which leads to failure. Developing and using an adapted ATR-FTIR method, crystallinity was monitored and compared to bulk crystallinity found via DSC. Inhomogeneity in crystallinity changes were observed but the FTIR method but was found to be less reliable. Pore visualization was found utilizing electrical impedance spectroscopy saturated aged polyethylene films with synthesized citrate-capped gold nanoparticles, and chloroauric acid precursor. results indicate a decreasing impedance of the polyethylene films caused by the transport of ions through the film. SEM imaging was then performed for elemental analysis of the films and counter electrodes for the presence of ions. Chloride and gold ions were detected; however, no nanoparticles were found. This gives an estimated pore size of at least 0.3 nm through the aged film. Cyclic submergence of polyethylene and polypropylene in aqueous solutions of copper sulfate and Harrison’s solution were examined. It was discovered that aging in these mixed conditions and at 90°C did cause a small, yet significant increase to tensile strength for both unaged polyethylene and polypropylene. The PE and PP in cycled and submerged conditions did not have tensile strengths significantly different from dry-aged after 16 weeks. For both solutions, it was determined that capacitance increases with both water tree depth and cable temperature and is relatively independent of changing water tree AR. As for resistance, there is no apparent change between depth percentages of 10 and 80 for both solutions. This is because the water tree has not yet entered the conductor and thus there is no shorting current flowing through the tree yet. Between 80 and 100% water tree depth, it is observed that for both solutions there is a rapid decrease in resistance because the tree is now impacting the conductor shield and allowing shorting current to flow through it. The relationship between resistance and temperature was found to be inversed. As temperature increases, resistance decreases for both water tree solutions with distilled water having the most apparent difference across the range of temperatures simulated. With regards to water tree AR, resistance was found to be relatively independent at depth percentages of 10, 50, and 70, but there was some relationship at 100% depth for both solutions. At this depth, as water tree AR increased, resistance was found to also increase. Through the examination of voltage and electric field distribution plots, it was confirmed for EPR cables that increasing water tree depth leads to increasing distortion. The increase in shorting current at 100% depth for aqueous copper sulfate compared to distilled water was also visualized. Lastly, the relationship between shorting current and temperature for narrow water trees was visualized and validated using the distribution plots. This study has led to a better understanding of the effect of cable temperature, water tree solution, and geometry of the tree region on cable degradation. Furthermore, this study has documented simulation results of water tree degradation in EPR MV cables, which had been previously lacking in information. Future work in this area will add frequency into the mix and examine what effect it has on the rate of cable degradation as a result of water treeing. To compliment the work being carried by UMD on different polymer chemistries, harvested medium voltage (MV) cables were selected for accelerated aging study at ORNL. These medium voltage cables are representative of the vintages and materials that are currently in use at existing nuclear power plants (NPPs). These cables were immersed in water at 90°C and energized for a period of two years at elevated voltage. Partial discharge was measured during this period of time to track potential degradation. Unfortunately, due to the absence of failure, the extent of integration between the UMD techniques and the harvested MV insulation was limited. However, based on the findings and from the UMD research in the previous sections on polyethylene and polypropylene, follow-on characterization for harvested MV cable insulation should focus on sample preparation to take advantage of the UMD techniques to better understand mechanistic degradation in MV cable insulations. This would include: 1.) Utilization of solutions and impedance measurement insulation to track permeability in harvested and accelerated aging insulation samples, 2.) Adaptation of gold nanoparticle synthesis for electrical impedance spectroscopy with supporting SEM characterization to study pore formation in harvested and accelerated aged insulation samples, & 3.) ATR-FTIR crystallinity with multiple temperature dependent harvested MV cable insulation under different air and submerged accelerated aging. In addition, low voltage dielectric spectroscopy and high voltage dissipation factor, tan δ, could be implemented as a condition monitoring tool for harvested MV cable insulation in submerged environments.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Development of a Full-Scale Connected U-Net for Reflectivity Inpainting in Spaceborne Radar Blind Zones

CloudSat’s Cloud Profiling Radar is a valuable tool for remotely monitoring high-latitude snowfall, but its ability to observe hydrometeor activity near the Earth’s surface is limited by a radar blind zone caused by ground clutter contamination. This study presents the development of a deeply supervised U-Net-style convolutional neural network to predict cold season reflectivity profiles within the blind zone at two Arctic locations. The network learns to predict the presence and intensity of near-surface hydrometeors by coupling latent features encoded in blind zone-aloft clouds with additional context from collocated atmospheric state variables (i.e., temperature, specific humidity, and wind speed). Results show that the U-Net predictions outperform traditional linear extrapolation methods, with low mean absolute error, a 38% higher Sørensen–Dice coefficient, and vertical reflectivity distributions 60% closer to observed values. The U-Net is also able to detect the presence of near-surface cloud with a critical success index (CSI) of 72% and cases of shallow cumuliform snowfall and virga with 18% higher CSI values compared to linear methods. An explainability analysis shows that reflectivity information throughout the scene, especially at cloud edges and at the 1.2-km blind zone threshold, along with atmospheric state variables near the tropopause, are the most significant contributors to model skill. This surface-trained generative inpainting technique has the potential to enhance current and future remote sensing precipitation missions by providing a better understanding of the nonlinear relationship between blind zone reflectivity values and the surrounding atmospheric state.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Macro-physical Properties of Shallow Cumulus from Integrated ARM Observations (Final Report)

Fair-weather shallow cumuli (ShCu) play an important role in many climate-related processes. Irregular geometry of ShCu and their strong temporal and spatial variability make it challenging to observe ShCu holistically and to represent them correctly in climate models. To improve ShCu parameterizations, information on both vertically and horizontally resolved cloud properties is required. Commonly, the vertically resolved cloud properties are provided by zenith pointing lidar-radar observations with a very narrow field of view (FOV). Thus, these “pencil-beam” properties may not be representative of a larger surrounding area. Limited number of areal-averaged cloud properties, such as fractional sky cover (FSC), are offered typically by wide-FOV observations. The main goal of our project was to integrate advantages of the narrow-FOV (vertical structure of clouds) and wide-FOV (spatial arrangement of clouds) observations for an improved characterization of single-layer ShCu observed at the Atmospheric Radiation Measurement (ARM) Southern Great Plains (SGP) site for an 18-yr period (2000-2017). There are four major accomplishments of our project, First, an updated operational cloud classification for days with ShCu has been suggested and evaluated through a detailed comparison with the manually curated records. Our classification extends successfully the latest ARM cloud type Value Added Product (VAP) based on the Active Remote Sensing of Clouds (ARSCL) cloud product by incorporating both cloud fraction (CF) provided by narrow-FOV ceilometer data and FSC from wide-FOV images offered by a Total Sky Imager (TSI). Moreover, our classification allows one to identify impact of instrumentation changes at the SGP site, namely the transition to KAZRARSCL with the updated cloud radar, on the identification of periods with single-layer ShCu. Second, a new approach that resolves cloud area distributions for a given region (up to 4x4 km 2 ) has been suggested and cloud equivalent diameters (CEDs) have been estimated for the first time. These estimations have been performed over a wide range of cloud sizes (about 0.01–3.5 km) with high temporal resolution (30s) using wide-FOV TSI images and cloud base height (CBH) provided by complementary narrow-FOV lidar measurements. Our simple and computationally inexpensive approach offers a previously unavailable dataset for process studies in the convective boundary layer and evaluation of ShCu parameterizations in cloud-resolving models. Third, a long-term integrated record of ShCu macrophysical properties has been developed. The developed record represents the longest available compilation of events with ShCu and includes (i) a novel visualization of the spatial variability in cloud cover both along- and across-wind directions, (ii) updated estimates of narrow-FOV CF and wide-FOV FSC, (iii) updated narrow-FOV CBH, and (iv) complementary data, such as wind speed and direction from the 915-MHz Radar Wind Profiler (RWP) data. The developed record has been used successfully to assess conventional observational estimates of cloud cover and their sensitivity to the following two factors: (i) instrument-dependent cloud detection and data merging criteria and (ii) FOV configuration. Fourth, co-variability of the ShCu macrophysical properties and environmental parameters has been analyzed for a 3-yr period (2016-2018). Our initial analysis includes diurnal changes of FSCs obtained for clouds with small, moderate and large CEDs and several environmental parameters, such as lifted condensation level (LCL) and mixed layer height (zi). Preliminary results of our analysis suggest that the horizontal extent of ShCu is controlled substantially by the sign and magnitude of difference between these two parameters (zi-LCL): the CED tends to grow with increase of this difference (zi exceeds LCL). We have initiated relationships between the ShCu and key atmospheric parameters that control both the development and evolution of ShCu using our new data product, which combines effectively the advantages of narrow-FOV data offered by zenith pointing cloud radars and lidars and wide-FOV TSI images. While the latest instrumentation at the ARM sites may address these challenging relationships in the future, we believe that the historical ARM data at the SGP site has not yet been fully utilized. Overall, our data product can be used by researchers working on a wide range of climate-related projects. These projects may include (i) a comprehensive evaluation of outputs from the Large-Eddy Simulation (LES) and single-column models for their future improvement, (ii) the representativeness of “short-period” results obtained from the previous model and observational studies and (iii) the planning of future field campaigns with focus on improved understanding of the diurnal cycle of cumulus convection.

54 ENVIRONMENTAL SCIENCES↗