Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data Exploration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

VIBES: a workflow for annotating and visualizing viral sequences integrated into bacterial genomes

Abstract Bacteriophages are viruses that infect bacteria. Many bacteriophages integrate their genomes into the bacterial chromosome and become prophages. Prophages may substantially burden or benefit host bacteria fitness, acting in some cases as parasites and in others as mutualists. Some prophages have been demonstrated to increase host virulence. The increasing ease of bacterial genome sequencing provides an opportunity to deeply explore prophage prevalence and insertion sites. Here we present VIBES (Viral Integrations in Bacterial genomES), a workflow intended to automate prophage annotation in complete bacterial genome sequences. VIBES provides additional context to prophage annotations by annotating bacterial genes and viral proteins in user-provided bacterial and viral genomes. The VIBES pipeline is implemented as a Nextflow-driven workflow, providing a simple, unified interface for execution on local, cluster and cloud computing environments. For each step of the pipeline, a container including all necessary software dependencies is provided. VIBES produces results in simple tab-separated format and generates intuitive and interactive visualizations for data exploration. Despite VIBES’s primary emphasis on prophage annotation, its generic alignment-based design allows it to be deployed as a general-purpose sequence similarity search manager. We demonstrate the utility of the VIBES prophage annotation workflow by searching for 178 Pf phage genomes across 1072 Pseudomonas spp. genomes.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2019

Graph Generation with a Focusing Lexicon

Reference datasets are an essential part of developing effective data exploration tools. Many reference datasets are synthetic in nature, seeding real-world properties into generation routines. Others are laboriously curated from original source materials. This is a time-consuming process that requires significant domain expertise all along the process. This paper presents a third path: deriving a network from real-world source materials using automated tools. By properly grounding the tools in a small collection of curated documents, a larger corpus be automatically processed with greater confidence. The end system leverages human knowledge (in the initial document curation), but with much less time commitment enabled by automation. Our ultimate goal is to produce reference datasets, derived from real-world data that capture aspects salient to a specific activity in the context of all of the activities in the data-set. Our reference datasets take the form of graphs.

Chandra Shekar, Mayanka↗
DOE OSTI2022

The Energetics of the Central Engine in the Powerful Quasar 3C 298

The compact steep-spectrum radio source 3C 298 (redshift of 1.44) has the largest 178 MHz luminosity in the Third Cambridge Revised Catalogue (3CR); its radio lobes are among the most luminous in the universe. The plasma state of the radio lobes is modeled with the aid of interferometric radio observations (in particular, the new Low Frequency Array observation and archival MERLIN data) and archival single-station data. It is estimated that the long-term time-averaged jet power required to fill these lobes with leptonic plasma is $\overline{Q}\,\approx 1.28\pm 0.51\times {10}^{47}\,\mathrm{erg}\,{{\rm{s}}}^{-1}$, rivaling the largest time-averaged jet powers from any quasar. Supporting this notion of extraordinary jet power is a 0.5–10 keV luminosity of ≈ 5.2 × 10 46 erg s –1 , comparable to luminous blazars, yet there is no other indication of strong relativistic beaming. We combine two new high signal-to-noise ratio optical spectroscopic observations from the Hobby-Eberly Telescope with archival Hubble Space Telescope, Two Micron All Sky Survey, and Galaxy Evolutionary Explorer data to compute a bolometric luminosity from the accretion flow of L bol ≈ 1.55 ± 0.15 × 10 47 erg s –1 . The ratio, $\overline{Q}/{L}_{\mathrm{bol}}\approx 1$, is the approximate upper limit for quasars. Characteristic of a large $\overline{Q}/{L}_{\mathrm{bol}}$, we find an extreme-ultraviolet (EUV) spectrum that is very steep (the "EUV deficit" of powerful radio quasars relative to radio-quiet quasars), and this weak ionizing continuum is likely a contributing factor to the relatively small equivalent widths of the broad emission lines in this quasar.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

TX$^2$: Transformer eXplainability and eXploration

The Transformer eXplainability and eXploration (Martindale & Stewart, 2021), or TX 2 software package, is a library designed for artificial intelligence researchers to better understand the performance of transformer models (Vaswani et al., 2017) used for sequence classification. The tool is capable of integrating with a trained transformer model and a dataset split into training and testing populations to produce an ipywidget (Project Jupyter Contributors, 2021) dashboard with a number of visualizations to understand model performance with an emphasis on explainability and interpretability. The TX 2 package is primarily intended to integrate into a workflow centered around Jupyter Notebooks (Kluyver et al., 2016), and currently assumes the use of PyTorch (Paszke et al., 2019) and Hugging Face transformers library (Wolf et al., 2020). The dashboard includes visualization and data exploration features to aid researchers, including an interactive UMAP embedding graph (McInnes et al., 2018) to understand classification clusters, a word salience map that can be updated as researchers alter textual entries in near real time, a set of tools to understand word frequency and importance based on the clusters in the UMAP embedding graph, and a set of traditional confusion matrix analysis tools.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

MODE: A Web Application for Interactive Visualization and Exploration of Omics Data

Studies generating transcriptomics, proteomics, lipidomics, and metabolomics (colloquially referred to as “omics”) data allow researchers to find biomarkers or molecular targets, or understand complex biological structures and functions by identifying changes in biomolecule abundance and expression between experimental conditions. Omics data is multi-dimensional and oftentimes summarization techniques such as principal component analysis (PCA) are used to identify high-level patterns in data. Though useful, these summaries don’t allow exploration of detailed patterns in omics data that may have biological relevance. The use of interactive HTML displays with plots allows researchers to interact with omics data at a detailed level, but building these displays requires significant coding expertise. To overcome this barrier, the software MODE was built to empower users to build their own interactive HTML displays to support scientific discovery. These displays are easily shareable, do not depend on a specific operating system, and allow users to effortlessly sort and filter plots by categorical or numerical variables. MODE allows users to build and share these displays with several options for plot design and meta selection. In conclusion, the MODE web application and its capabilities are presented and then demonstrated on lipidomics data from a leaf wounding study.

lipidomics↗
DOE OSTI2020

A Moist Physics Parameterization Based on Deep Learning

Abstract Current moist physics parameterization schemes in general circulation models (GCMs) are the main source of biases in simulated precipitation and atmospheric circulation. Recent advances in machine learning make it possible to explore data‐driven approaches to developing parameterization for moist physics processes such as convection and clouds. This study aims to develop a new moist physics parameterization scheme based on deep learning. We use a residual convolutional neural network (ResNet) for this purpose. It is trained with 1‐year simulation from a superparameterized GCM, SPCAM. An independent year of SPCAM simulation is used for evaluation. In the design of the neural network, referred to as ResCu, the moist static energy conservation during moist processes is considered. In addition, the past history of the atmospheric states, convection, and clouds is also considered. The predicted variables from the neural network are GCM grid‐scale heating and drying rates by convection and clouds, and cloud liquid and ice water contents. Precipitation is derived from predicted moisture tendency. In the independent data test, ResCu can accurately reproduce the SPCAM simulation in both time mean and temporal variance. Comparison with other neural networks demonstrates the superior performance of ResNet architecture. ResCu is further tested in a single‐column model for both continental midlatitude warm season convection and tropical monsoonal convection. In both cases, it simulates the timing and intensity of convective events well. In the prognostic test of tropical convection case, the simulated temperature and moisture biases with ResCu are smaller than those using conventional convection and cloud parameterizations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Demonstration of event position reconstruction based on diffusion in the NEXT-white detector

Noble element time projection chambers are a leading technology for rare event detection in physics, such as for dark matter and neutrinoless double beta decay searches. Time projection chambers typically assign event position in the drift direction using the relative timing of prompt scintillation and delayed charge collection signals, allowing for reconstruction of an absolute position in the drift direction. In this paper, alternate methods for assigning event drift dis tance via quantification of electron diffusion in a pure high pressure xenon gas time projection chamber are explored. Data from the NEXT-White detector demonstrate the ability to achieve good position assignment accuracy for both high and low-energy events. Using point-like energy deposits from 83m Kr calibration electron captures (E ~ 45 keV), the position of origin of low-energy events is determined to 2 cm precision with bias < 1 mm. A convolutional neural network approach is then used to quantify diffusion for longer tracks (E ≥ 1.5 MeV), from radiogenic electrons, yielding a precision of 3 cm on the event barycenter. The precision achieved with these methods indicates the feasibility energy calibrations of better than 1% FWHM at Q ββ in pure xenon, as well as the potential for event fiducialization in large future detectors using an alternate method that does not rely on primary scintillation.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2026

datasight [SWR-26-045]

This software is an AI-powered data exploration with natural language. datasight connects an AI agent to your database and provides a web UI where you can ask questions in natural language. The agent writes SQL, runs queries, and generates interactive Plotly visualizations. Supports DuckDB, PostgreSQL, SQLite, and Flight SQL databases. Also queries local CSV and Parquet files directly — no database setup required. Supports Anthropic Claude (default), GitHub Models (open source), and Ollama (local) as LLM backends.

Thom, Daniel [National Laboratory of the Rockies (↗
DOE OSTI2021

Characterization of Extremes and Compound Impacts: Applications of Machine Learning and Interpretable Neural Networks

Focal Area: This white paper responds to Focal area III by exploring data fusion, learning and explainable AI methods in characterizing hydrological extremes and interconnections. It also addresses Focal area II by using probabilistic AI and ensemble ML for predicting extremes and compound extremes. Science Challenge: A key question associated with the integrated water (or hydrological) cycle grand challenge in the Earth and Environmental Systems Sciences Division (EESSD) strategic plan, is how the frequency and intensity of hydrological events will change. Prediction of the tail behavior (extremes) of the hydrological cycle is especially challenging, because of their stochasticity and low probability. These extreme events and their compound impacts have significant societal and economic consequences. It is anticipated for the next-generation Earth System models (ESMs), that model predictability of the water cycle will improve with increased resolution (e.g., regionally refined E3SM), advanced software and computational architectures, and improved model physics based on the data from ARM measurements and high-fidelity models. However, the challenges for predictability of low-probability high-impact extreme events will unlikely be alleviated with conventional modeling and data-driven approaches, as ESMs are calibrated largely for capturing the high-frequency mean climate states. Recent AI and ML applications have shown great potential in quantifying well-defined climate extremes (e.g., supervised learning of tropical cyclones/atmospheric rivers by ClimateNet1) but few efforts are dedicated to compound events, extreme drivers and uncertainty estimation. We envision the opportunity to develop and apply ML and interpretable AI methods extended on the existing efforts, specifically, for: (1) identification of compound extremes, (2) diagnosing drivers of extremes, (3) bias correction in extreme predictions and (4) probabilistic modeling of extremes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Tools for Water Ingress Testing

The Safety Storage and Engineering Team, as part of the Production Support Services division (PSS-2), is tasked with ensuring the safety of containers used for handling and storage of nuclear materials. As part of this work, water ingress tests are conducted to evaluate the water-tightness of containers intended for in-glovebox use. In collaboration, the statistics group of the Computer and Computational Sciences Division (CCS-6) provided support in developing a statistically defensible approach for determining appropriate sample sizes for water ingress testing. Water ingress testing involves multiple measurements on multiple containers. Our approach uses a simple random effects model to analyze a pilot data set, implementing prediction limits to evaluate the efficacy of collecting additional data. Although this study capitalizes on available data, our approach can be used with estimates of the ratio of between and within variability and average values, often available from past testing or expert knowledge. An interactive Shiny tool was developed as a final user-friendly product for future testing. The Shiny interface is an open-source package providing a framework for building web applications. Raw data exploration and prediction interval-based sample size assessments can quickly be conducted by the engineering team without needing to interact with the underlying code.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

Carbon Storage Site Mapping Inquiry Tool (MapIT)

The Carbon Storage Site Mapping Inquiry Tool (MapIT) is an online web mapping tool designed to help users discover available public-sourced data to facilitate data exploration in support of Underground Injection Control (UIC) Program Class VI Well Site permitting for the geologic sequestration of carbon dioxide.

Pantaleone, Scott↗
DOE OSTI2021

Identification of Preferential Recharge Zones in Karst Systems Based on the Correlation between the Spring Level and Precipitation: A Case Study from Jinan Spring Basin

The Jinan spring basin is located in the karst area of northern China, where springs serve as important sources of water supply. Several studies on spring protection and water supply have been carried out, and scholars have developed some laws on local groundwater flow dynamic and characteristics of aquifer structures. Unfortunately, there is a lack of detailed research on preferential recharge zones, which are the main recharge pathways of springs. Therefore, this research focuses on identifying preferential recharge zones based on the correlation between the spring level and precipitation. The results show that when precipitation is more intense or lasts longer, there is a stronger correlation between spring level and precipitation. It has been established that the precipitation at Donghongmiao station has the closest relationship with the dynamic of Baotu spring, which is found to be the most significant contribution to spring preservation. Two potential preferential recharge zones in the Jinan spring basin are detected through correlation analysis and geological exploration data. These findings support spring protection and water supply projects in karst regions.

58 GEOSCIENCES↗
DOE OSTI2025

Spectral Properties of Globally Distributed ENA Fluxes across Diverse Regions of the Heliosphere

This study analyzes energetic neutral atom (ENA) spectral properties across distinct regions of globally distributed flux (GDF) sky maps, using Interstellar Boundary Explorer data from a full solar cycle, corrected for time dispersion. By time-shifting the data to the heliosheath using GDF source distances from D. B. Reisenfeld et al., we achieve a more accurate representation of heliosheath GDF energy spectra. We quantify ENA spectral characteristics, heliosheath line-of-sight-integrated proton pressure, and heliosheath proton temperature, comparing these to solar wind properties at 1 au and interplanetary scintillation-derived solar wind data. Our findings show that the spectral index is generally anticorrelated with heliosheath proton temperature and pressure, except in the central tail, where a partial positive correlation is observed. The lowest spectral index values occur when high-latitude heliosheath regions are dominated by fast solar wind from polar coronal holes. The south pole exhibits the flattest energy spectra due to plasma heating from both fast solar wind and a late-2014 pressure pulse. The central tail shows shorter variability (5–6 yr) for spectral index and heliosheath proton temperature, while proton pressure follows the 11 yr solar cycle. Most spectral shapes exhibit a “knee” distribution, peaking during solar maximum, with an “ankle” shape observed only at the south pole during solar cycle transitions. Asymmetry in proton pressure in the lobes is driven by the draping effect of the local interstellar magnetic field. This study provides insights into the energetic properties of GDF across the heliosphere, enhancing our understanding of the heliospheric environment.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

DELVE Milky Way Satellite Galaxy Census. I. Satellite Population and Survey Selection Function in DES, DELVE, and Pan-STARRS

The properties of Milky Way satellite galaxies have important implications for galaxy formation, reionization, and the fundamental physics of dark matter. However, the population of Milky Way satellites includes the faintest known galaxies, and current observations are incomplete. To understand the impact of observational selection effects on the known satellite population, we perform rigorous, quantitative estimates of the Milky Way satellite galaxy detection efficiency in three wide-field survey datasets: the Dark Energy Survey Year 6, the DECam Local Volume Exploration Data Release 3, and the Pan-STARRS1 Data Release 1. Together, these surveys cover ∼13,600 deg 2 to g ∼ 24.0 and ∼27,700 deg 2 to g ∼ 22.5, spanning ∼91% of the high-Galactic-latitude sky (∣b∣ ≥ 15°). We apply multiple detection algorithms over the combined footprint and recover 49 known satellites above a strict census detection threshold. To characterize the sensitivity of our census, we run our detection algorithms on a large set of simulated galaxies injected into the survey data, which allows us to develop models that predict the detectability of satellites as a function of their properties. We then fit an empirical model to our data and infer the luminosity function, radial distribution, and size–luminosity relation of Milky Way satellite galaxies. Our empirical model predicts a total of $265^{+79}_{-47}$ satellite galaxies with −20 ≤ M V ≤ 0, half-light radii of 15 ≤ r 1/2 , (pc) ≤ 3000, and galactocentric distances of 10 ≤ D GC (kpc) ≤ 300. We also identify a mild anisotropy in the angular distribution of the observed galaxies, at a significance of ∼2σ, which can be attributed to the clustering of satellites associated with the LMC.

Tan, Chin Yi [Univ. of Chicago, IL (United States)↗
DOE OSTI2023

Nuclear data for space exploration

Understanding the harmful effects of galactic cosmic rays (GCRs) on space exploration requires a substantial amount of nuclear data. Specifically, the interaction of energetic GCR charged particles with spacecraft materials generates secondary radiations that, through energy deposition, can harm astronauts and electronic systems. By identifying the gaps in our knowledge of the relevant nuclear data—such as interaction cross sections—and identifying ways to fill those gaps—with measurements, compilations, evaluations, dissemination, reaction modeling, sensitivity studies, and uncertainty quantification—the safety and viability of space exploration can be improved. This work surveys the state of the art in this interdisciplinary field and identifies promising collaborative research topics that have significant potential to advance our understanding of the effects of the space radiation environment on space exploration.

42 ENGINEERING↗
DOE OSTI2026

Exploring Wildfire & Energy data toward State Prioritization Index (WESPI)

Energy infrastructure can both induce and suffer risks from wildfires ranging from direct damage to energy assets such as substations and power lines to Public Safety Power Shutoffs. Recent wildfire events underscore the need for data-driven approaches that help states and utilities proactively plan for wildfire risk. Existing national tools such as Federal Emergency Management Agency (FEMA)’s National Risk Index (NRI) are valuable for community hazard planning. However, they are less suited for energy infrastructure, as they emphasize population and building exposure rather than system vulnerabilities. In this paper, we explore relationships between energy and wildfire data and present a Wildfire-Energy State Prioritization Index (WESPI). Our methodology combines data from the US Forest Service’s Fire Simulation (FSIM) dataset with energy resilience metrics, historical fire incidents, and geospatial data on transmission lines and fire stations. Correlation analyses suggest that FSIM burn probability is more strongly associated with power outage metrics (ρ = 0.32) than NRI wildfire frequency, and counties with a greater density of fire stations experience more frequent, but less intense wildfires. We further leverage data for burn probability, transmission line density, and fire station density to develop a Wildfire-Energy State Prioritization Index (WESPI) to highlight counties where wildfire hazard, infrastructure exposure, and limited suppression capacity converge. The index provides a consistent, scalable framework for state energy offices and utilities to screen counties for vegetation management, optimization of outage management system deployment, and to inform wildfire mitigation plans.

Critical infrastructure↗
DOE OSTI2025

Exploring Continuous Seismic Data at an Industry Facility Using Unsupervised Machine Learning

Seismic data recorded at industrial sites contain valuable information on anthropogenic activities. With advances in machine learning and computing power, new opportunities have emerged to explore the seismic wavefield in these complex environments. We applied two unsupervised machine learning algorithms to analyze continuous seismic data collected from an industrial facility in Texas, United States. The Uniform Manifold Approximation and Projection for Dimension Reduction algorithm was used to reduce the dimensionality of the data and generate 2D embeddings. Then, the Hierarchical Density-Based Spatial Clustering of Applications with Noise method was employed to automatically group these embeddings into distinct signal clusters. Our analysis of over 1400 hr (around 59 days) of continuous seismic data revealed five and seven signal clusters at two separate stations. At both stations, we identified clusters associated with background noise and vehicle traffic, with the latter’s temporal patterns aligning closely with the facility’s work schedule. Furthermore, the algorithms detected signal clusters from unknown sources and underline the ability of unsupervised machine learning for uncovering previously unrecognized patterns. Our analysis demonstrates the effectiveness of unsupervised approaches in examining continuous seismic data without requiring prior knowledge or pre-existing labels.

58 GEOSCIENCES↗