Search NASA⌕ Search

SEARCH · Search NASA

Results for “data exploration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 757 records · Page 42

Automated Identification of Characteristic Droplet Size Distributions in Stratocumulus Clouds Utilizing a Data Clustering Algorithm

Abstract Droplet-level interactions in clouds are often parameterized by a modified gamma fitted to a “global” droplet size distribution. Do “local” droplet size distributions of relevance to microphysical processes look like these average distributions? This paper describes an algorithm to search and classify characteristic size distributions within a cloud. The approach combines hypothesis testing, specifically, the Kolmogorov–Smirnov (KS) test, and a widely used class of machine learning algorithms for identifying clusters of samples with similar properties: density-based spatial clustering of applications with noise (DBSCAN) is used as the specific example for illustration. The two-sample KS test does not presume any specific distribution, is parameter free, and avoids biases from binning. Importantly, the number of clusters is not an input parameter of the DBSCAN-type algorithms but is independently determined in an unsupervised fashion. As implemented, it works on an abstract space from the KS test results, and hence spatial correlation is not required for a cluster. The method is explored using data obtained from the Holographic Detector for Clouds (HOLODEC) deployed during the Aerosol and Cloud Experiments in the Eastern North Atlantic (ACE-ENA) field campaign. The algorithm identifies evidence of the existence of clusters of nearly identical local size distributions. It is found that cloud segments have as few as one and as many as seven characteristic size distributions. To validate the algorithm’s robustness, it is tested on a synthetic dataset and successfully identifies the predefined distributions at plausible noise levels. The algorithm is general and is expected to be useful in other applications, such as remote sensing of cloud and rain properties. Significance Statement A typical cloud can have billions of drops spread over tens or hundreds of kilometers in space. Keeping track of the sizes, positions, and interactions of all of these droplets is impractical, and, as such, information about the relative abundance of large and small drops is typically quantified with a “size distribution.” Droplets in a cloud interact locally, however, so this work is motivated by the question of whether the cloud droplet size distribution is different in different parts of a cloud. A new method, based on hypothesis testing and machine learning, determines how many different size distributions are contained in a given cloud. This is important because the size distribution describes processes such as cloud droplet growth and light transmission through clouds.

54 ENVIRONMENTAL SCIENCES↗

Automated metadata, provenance cataloging and navigable interfaces: ensuring the usefulness of extreme-scale data

The MPO (Metadata, Provenance, Ontology) Project successfully addressed the goal of improving the usefulness and traceability of scientific data by building a system that could capture and display all steps in the process of creating, analyzing and disseminating that data. Throughout history, scientists have generated handwritten logbooks to keep track of data, their hypotheses, assumptions, experimental setup, and computational processes as well as reflections on observations and issues encountered. Over the last several decades, with the growth of personal computers, handheld devices, and the World Wide Web, the handwritten logbook has begun to be replaced by electronic logbooks. This transition has brought increased capability such as supporting multi-media, hypertext, and fast searching. However, content creation and metadata (a set of data that describes and gives information about other data) capturing has for the most part remained a manual activity just as it was with handwritten logbooks. This has led to a fragmentation of data, processing, and annotation that has only accelerated as scientific workflows continue to increase in complexity. From a scientific perspective, it is very important to be able to understand the lineage of any piece of data: who, what, when, how, and why. This is typically referred to as data provenance. The fragmentation discussed previously often means that data provenance is lost. As scientific workflows move to powerful computers and become more complex, the ability to track all of the steps involved in creating a piece of data become even more difficult. It was the goal of the MPO (Metadata, Provenance, Ontology) Project to create a system (the MPO System) that allows for automatic provenance and metadata capturing in such a way to allow easy searching and browsing. This goal needed to be accomplished in a general way so that it may be used across a broad range of scientific domains, yet allow the addition of vocabulary (Ontology) that is domain specific as is required for intelligent searching and browsing in the scientific context. Through the creation and deployment of the MPO system, the goals of the project were achieved. An enhanced metadata, provenance, and ontology storage system was created. This was combined with innovative methodologies for navigating and exploring these data using a web browser for both experimental and simulation-based scientific research. In addition, a system to allow scientists to instrument their existing workflows for automatic metadata and provenance is part of the MPO system. In that way, a scientist can continue to use their existing methodology yet easily document their work. Workflows and data provenance can be displayed either graphically or in an electronic notebook format and support advanced search features including via ontology. The MPO system was successfully used in both Climate and Magnetic Fusion Energy Research. The software for the MPO system is located at https://github.com/MPO-Group/MPO and is open source distributed under the Revised BSD License. A demonstration site of the MPO system is open to the public and is available at https://mpo.psfc.mit.edu/. A Docker container release of the command line client is available for public download using the command docker pull jcwright/mpo-cli at https://hub.docker.com/r/jcwright/mpo-cli.

97 MATHEMATICS AND COMPUTING↗

International Symposium on Remote Sensing of Environment, Third Thematic Conference: Remote Sensing for Exploration Geology, Colorado Springs, CO, April 16-19, 1984, Proceedings. Volumes 1 & 2

A photogeologic and remote sensing model of porphyry type mineral sytems is considered along with a Landsat application to development of a tectonic model for hydrocarbon exploration of Devonian shales in west-central Virginia, remote sensing and the funnel philosophy, Landsat-based tectonic and metallogenic synthesis of the southwest United States, and an evolving paradigm for computer vision. Attention is given to the neotectonics of the Tibetan plateau deduced from Landsat MSS image interpretation, remote sensing in northern Arizona, the use of an airborne laser system for vegetation inventories and geobotanical prospecting, an evaluation of Thematic Mapper data for hydrocarbon exploration in low-relief basins, and an evaluation of the information content of high spectral resolution imagery. Other topics explored are related to a major source of new radar data for exploration research, the accuracy of geologic maps produced from Landsat data, and an approach for the geometric rectification of radar imagery.

Source record↗

Production Application Performance Data Streaming for System Monitoring

In this article, we present an approach to streaming collection of application performance data. Practical application performance tuning and troubleshooting in production high-performance computing (HPC) environments requires an understanding of how applications interact with the platform, including (but not limited to) parallel programming libraries such as Message Passing Interface (MPI). Several profiling and tracing tools exist that collect heavy runtime data traces either in memory (released only at application exit) or on a file system (imposing an I/O load that may interfere with the performance being measured). Although these approaches are beneficial in development stages and post-run analysis, a systemwide and low-overhead method is required to monitor deployed applications continuously. This method must be able to collect information at both the application and system levels to yield a complete performance picture. In our approach, an application profiler collects application event counters. A sampler uses an efficient inter-process communication method to periodically extract the application counters and stream them into an infrastructure for performance data collection. We implement a tool-set based on our approach and integrate it with the Lightweight Distributed Metric Service (LDMS) system, a monitoring system used on large-scale computational platforms. LDMS provides the infrastructure to create and gather streams of performance data in a low overhead manner. We demonstrate our approach using applications implemented with MPI, as it is one of the most common standards for the development of large-scale scientific applications. We utilize our tool-set to study the impact of our approach on an open source HPC application, Nalu. Our tool-set enables us to efficiently identify patterns in the behavior of the application without source-level knowledge. We leverage LDMS to collect system-level performance data and explore the correlation between the system and application events. Finally, we demonstrate how our tool-set can help detect anomalies with a low latency. We run tests on two different architectures: a system enabled with Intel Xeon Phi and another system equipped with Intel Xeon processor. Our overhead study shows our method imposes at most 0.5% CPU usage overhead on the application in realistic deployment scenarios.

59 BASIC BIOLOGICAL SCIENCES↗

Cosmic Reionization On Computers: The Galaxy-Halo Connection between $5 \leq z \leq10$

We explore the connection between the stellar component of galaxies and their host halos during the epoch of reionization (5 ≤ z ≤ 10) using the CROC (Cosmic Reionization on Computers) simulations. We compare simulated galaxies with observations and find that CROC underpredicts the abundance of luminous galaxies when compared to observed UV luminosity functions, and analogously the most massive galaxies when compared to observed stellar mass functions. We can trace the deficit of star formation to high redshifts, where the slope of the star formation rate to stellar mass relation is consistent with observations, but the normalization is systematically low. This results in a star formation rate density and stellar mass density that are systematically offset from observations. However, the less luminous or lower stellar mass objects have luminosities and stellar masses that agree fairly well with observational data. We explore the stellar-to-halo mass ratio (SHMR), a key quantity that is difficult to measure at high redshifts and that models do not consistently predict. In CROC, the SHMR decreases with redshift, a trend opposite to some abundance-matching studies. These discrepancies uncover where future effort should be focused in order to improve the fidelity of modeling cosmic reionization. We also compare the CROC galaxy bias with observational measurements using Lyman-break galaxy samples, finding reasonable consistency.

79 ASTRONOMY AND ASTROPHYSICS↗

Reduction and analysis of data from cosmic dust experiments on Mariner 4, OGO 3, and Lunar Explorer 35

The analysis of data from the cosmic dust experiment on three NASA missions is discussed. These missions were Mariner IV, OGO III, and Lunar Explorer 35. The analysis effort has included some work in the laboratory of the physics of microparticle hypervelocity impact. This laboratory effort was initially aimed at the calibration and measurements of the different sensors being used in the experiment. The latter effort was conducted in order to better understand the velocity and mass distributions of the picogram sized ejecta particles.

Source record↗

Exploring Synergistic Tools from NASA Satellite Data for Air Quality

Space-borne earth observation has been important to monitor the earth condition and played a critical role in validating other instruments or modeling's outputs. However, the data from satellite earth observation are usually very complex in terms of science contents, formats, and spatiotemporal granularities, making them difficult to use from many aspects. NASA Goddard Earth Sciences Data and Information Services Center (GES DISC), one of the 12 official NASA data centers, archives and distributes rich collections of data from multiple satellite missions and model results. The GES DISC is also the official archive center for data from the Ozone Monitoring Instrument (OMI) aboard NASA's Aura mission since 2004. Recently, the GES DISC has been evolving and improving its data management and services in order to promote NASA data to be easily discovered and accessed, as well as to facilitate interoperability. We'll show in this presentation how to explore and analyze NASA earth observation data for air quality through a suite of user-friendly tools - from Worldview to Giovanni, demonstrating in using this set of tools prepares us to serve the Sentinel 5P TROPOMI to the community.

air quality↗

Explore Air Quality from NASA Satellite Data

Space-borne earth observation has been important to monitor the earth condition and played acritical role in validating other instruments or modeling's outputs. However, the data from satellite earth observation are usually very complex in terms of science contents, formats, and spatiotemporal granularities, making them difficult to use from many aspects. NASA Goddard Earth Sciences Data and Information Services Center (GES DISC), one of the 12 official NASA data centers, archives and distributes rich collections of data from multiple satellite missions and model results. The GES DISC is also the official archive center for data from the Ozone Monitoring Instrument (OMI) aboard NASA's Aura mission since 2004. Recently, the GES DISChas been evolving and improving its data management and services in order to promote NASA data to be easily discovered and accessed, as well as to facilitate interoperability. We'll show in this presentation how to explore and analyze NASA earth observation data for air quality through a suite of user-friendly tools - from Giovanni to ArcGIS, demonstrating in using this set of tools prepares us to serve the Sentinel 5P TROPOMI to the community.

Wei, J.↗

NuGrid stellar data set. I. Stellar yields from H to BI for stars with metallicities Z = 0.02 and Z = 0.01

We provide a set of stellar evolution and nucleosynthesis calculations that applies established physics assumptions simultaneously to low- and intermediate-mass and massive star models. Our goal is to provide an internally consistent and comprehensive nuclear production and yield database for applications in areas such as presolar grain studies. Our non-rotating models assume convective boundary mixing (CBM) where it has been adopted before. We include 8 (12) initial masses for Z = 0.01 (0.02). Models are followed either until the end of the asymptotic giant branch phase or the end of Si burning, complemented by simple analytic core-collapse supernova (SN) models with two options for fallback and shock velocities. The explosions show which pre-SN yields will most strongly be effected by the explosive nucleosynthesis. We discuss how these two explosion parameters impact the light elements and the s and p process. For low- and intermediate-mass models, our stellar yields from H to Bi include the effect of CBM at the He-intershell boundaries and the stellar evolution feedback of the mixing process that produces the {sup 13}C pocket. All post-processing nucleosynthesis calculations use the same nuclear reaction rate network and nuclear physics input. We provide a discussion of the nuclear production across the entire mass range organized by element group. The entirety of our stellar nucleosynthesis profile and time evolution output are available electronically, and tools to explore the data on the NuGrid VOspace hosted by the Canadian Astronomical Data Centre are introduced.

79 ASTRONOMY AND ASTROPHYSICS↗

Supervised detection of anomalous light curves in massive astronomical catalogs

The development of synoptic sky surveys has led to a massive amount of data for which resources needed for analysis are beyond human capabilities. In order to process this information and to extract all possible knowledge, machine learning techniques become necessary. Here we present a new methodology to automatically discover unknown variable objects in large astronomical catalogs. With the aim of taking full advantage of all information we have about known objects, our method is based on a supervised algorithm. In particular, we train a random forest classifier using known variability classes of objects and obtain votes for each of the objects in the training set. We then model this voting distribution with a Bayesian network and obtain the joint voting distribution among the training objects. Consequently, an unknown object is considered as an outlier insofar it has a low joint probability. By leaving out one of the classes on the training set, we perform a validity test and show that when the random forest classifier attempts to classify unknown light curves (the class left out), it votes with an unusual distribution among the classes. This rare voting is detected by the Bayesian network and expressed as a low joint probability. Our method is suitable for exploring massive data sets given that the training process is performed offline. We tested our algorithm on 20 million light curves from the MACHO catalog and generated a list of anomalous candidates. After analysis, we divided the candidates into two main classes of outliers: artifacts and intrinsic outliers. Artifacts were principally due to air mass variation, seasonal variation, bad calibration, or instrumental errors and were consequently removed from our outlier list and added to the training set. After retraining, we selected about 4000 objects, which we passed to a post-analysis stage by performing a cross-match with all publicly available catalogs. Within these candidates we identified certain known but rare objects such as eclipsing Cepheids, blue variables, cataclysmic variables, and X-ray sources. For some outliers there was no additional information. Among them we identified three unknown variability types and a few individual outliers that will be followed up in order to perform a deeper analysis.

79 ASTRONOMY AND ASTROPHYSICS↗

Dust Aerosol, Clouds, and the Atmospheric Optical Depth Record over 5 Mars Years of the Mars Exploration Rover Mission

Dust aerosol plays a fundamental role in the behavior and evolution of the Martian atmosphere. The first five Mars years of Mars Exploration Rover data provide an unprecedented record of the dust load at two sites. This record is useful for characterization of the atmosphere at the sites and as ground truth for orbital observations. Atmospheric extinction optical depths have been derived from solar images after calibration and correction for time-varying dust that has accumulated on the camera windows. The record includes local, regional, and globally extensive dust storms. Comparison with contemporaneous thermal infrared data suggests significant variation in the size of the dust aerosols, with a 1 micrometer effective radius during northern summer and a 2 micrometer effective radius at the onset of a dust lifting event. The solar longitude (L (sub s)) 20-136 degrees period is also characterized by the presence of cirriform clouds at the Opportunity site, especially near LS = 50 and 115 degrees. In addition to water ice clouds, a water ice haze may also be present, and carbon dioxide clouds may be present early in the season. Variations in dust opacity are important to the energy balance of each site, and work with seasonal variations in insolation to control dust devil frequency at the Spirit site.

Atmospheric depth↗

High-Accuracy Tidal Flat Digital Elevation Model Construction Using TanDEM-X Science Phase Data

This study explored the feasibility of using TanDEM-X (TDX) interferometric observations of tidal flats for digital elevation model (DEM) construction. Our goal was to generate high-precision DEMs in tidal flat areas, because accurate intertidal zone data are essential for monitoring coastal environment sand erosion processes. To monitor dynamic coastal changes caused by waves, currents, and tides, very accurate DEMs with high spatial resolution are required. The bi- and monostatic modes of the TDX interferometer employed during the TDX science phase provided a great opportunity for highly accurate intertidal DEM construction using radar interferometry with no time lag (bistatic mode) or an approximately 10-s temporal baseline (monostatic mode) between the master and slave synthetic aperture radar image acquisitions. In this study, DEM construction in tidal flat areas was first optimized based on the TDX system parameters used in various TDX modes. We successfully generated intertidal zone DEMs with 57-m spatial resolutions and interferometric height accuracies better than 0.15 m for three representative tidal flats on the west coast of the Korean Peninsula. Finally, we validated these TDX DEMs against real-time kinematic-GPS measurements acquired in two tidal flat areas; the correlation coefficient was 0.97 with a root mean square error of 0.20 m.

Lee, Seung-Kuk↗

A Route to Design Novel Functional Peptides by Applying a Denoising Diffusional Model to mRNA Display Libraries

In vitro directed evolution techniques, such as mRNA display, enable peptide ligand discovery and optimization. However, physical libraries that rely on a genetic code can only search a small fraction of sequence space due to inherent biases in the genetic code and experimental limitations. To address this challenge, denoising diffusion implicit models (DDIMs) are applied to generate novel peptide ligands against B‐cell lymphoma extra‐large (Bcl‐x L ), a key cancer target. Starting with high‐throughput sequencing data from previous selections, a DDIM is trained to produce novel sequences with high affinity binding. Experimental validation confirms that most generated sequences are functionally equivalent to the original library members for Bcl‐x L binding and demonstrated comparable binding kinetics and affinity relative to the wildtype and nearest original neighbors. Importantly, this approach generated rare sequences not easily accessible via mutation and directed evolution. These results indicate that DDIMs can complement and expand directed evolution data, efficiently exploring underrepresented regions of sequence space. This approach provides a broadly applicable framework for accelerating ligand discovery and optimizing molecular properties across diverse targets.

Qi, Pearl [Mork Family Department of Chemical Engi↗

Finding Hidden Patterns in High Resolution Wind Flow Model Simulations

Wind flow data is critical in terms of investment decisions and policy making. High resolution data from wind flow model simulations serve as a supplement to the limited resource of original wind flow data collection. Given the large size of data, finding hidden patterns in wind flow model simulations are critical for reducing the dimensionality of the analysis. In this work, we first perform dimension reduction with two autoencoder models: the CNN-based autoencoder (CNN-AE) [1], and hierarchical autoencoder (HIER-AE) [2], and compare their performance with the Principal Component Analysis (PCA). We then investigate the super-resolution of the wind flow data. By training a Generative Adversarial Network (GAN) with 300 epochs, we obtained a trained model with 2× resolution enhancement. We compare the results of GAN with Convolutional Neural Network (CNN), and GAN results show finer structure as expected in the data field images. Also, the kinetic energy spectra comparisons show that GAN outperforms CNN in terms of reproducing the physical properties for high wavenumbers and is critical for analysis where high-wavenumber kinetics play an important role.

97 MATHEMATICS AND COMPUTING↗

Quantifying Microstructure Variability in Laser Powder Bed Fusion 316 L Stainless Steel Microstructures with Spatial Statistics

Here, we have explored data-driven methods for material microstructure quantification that improve sensitivity to microstructural changes compared to traditional approaches. The methods integrate multiple microstructural properties, including grain morphology, crystallographic orientation, and material phase information. The simpler method employs maps of the Euclidean distance transformation metric to evaluate the morphology of grain boundary networks. The more intensive approach employs generalized spherical harmonic mapping for crystallographic orientations, per-pixel phase information, and a variational auto-encoder for dimensionality reduction and results in a multidimensional clustering of by microstructure similarity. Applied to an experimental dataset of additively manufactured steel, both methods detected slight variations in samples produced under nominally identical processing conditions. Both methods were able to distinguish between samples from multiple (nominally identical) builds, while the generalized spherical harmonics-based method could additionally cluster data samples rotated at two orientations on the build plate. The improved sensitivity of the methods, demonstrated through comparison with traditional microstructure characterization techniques, offers advantages for microstructure quantification and comparisons in advanced manufacturing applications.

SS316L↗

Policy impact on economic and environmental sustainability of anaerobic digestion: Industrial case study Insights

This paper thoroughly examines how policy incentives impact the economic and environmental sustainability of anaerobic digestion (AD) systems. It uses techno-economic and life cycle analyses, along with real industry data, to explore the entire AD process—from feedstock acceptance to digestate disposal. It evaluates the effects of various U.S. policy crediting programs on the economic viability of different AD pathways for treating sewage sludge and food waste. Furthermore, tipping fees are identified as the primary driver of profitability, while policy credits play a crucial role in enhancing economic feasibility, particularly for renewable natural gas production. However, future regulatory changes could reshape this economic landscape. All AD pathways are found to significantly reduce greenhouse gas emissions, though economic outcomes are highly sensitive to digestate disposal costs and feedstock tipping fees. Co-digestion with food waste is proposed as a strategy to reduce dependence on policy credits and improve long-term economic stability.

Anaerobic Digestion↗

Whole-breast irradiation: a subgroup analysis of criteria to stratify for prone position treatment

To select among breast cancer patients and according to breast volume size those who may benefit from 3D conformal radiotherapy after conservative surgery applied with prone-position technique. Thirty-eight patients with early-stage breast cancer were grouped according to the target volume (TV) measured in the supine position: small ({<=}400 mL), medium (400-700 mL), and large ({>=}700 ml). An ad-hoc designed and built device was used for prone set-up to displace the contralateral breast away from the tangential field borders. All patients underwent treatment planning computed tomography in both the supine and prone positions. Dosimetric data to explore dose distribution and volume of normal tissue irradiated were calculated for each patient in both positions. Homogeneity index, hot spot areas, the maximum dose, and the lung constraints were significantly reduced in the prone position (p < 0.05). The maximum heart distance and the V{sub 5Gy} did not vary consistently in the 2 positions (p = 0.06 and p = 0.7, respectively). The number of necessary monitor units was significantly higher in the supine position (312 vs. 232, p < 0.0001). The subgroups analysis pointed out the advantage in lung sparing in all TV groups (small, medium and large) for all the evaluated dosimetric constraints (central lung distance, maximum lung distance, and V{sub 5Gy}, p < 0.0001). In the small TV group, a dose reduction in nontarget areas of 22% in the prone position was detected (p = 0.056); in the medium and high TV groups, the difference was of about -10% (p = NS). The decrease in hot spot areas in nontarget tissues was 73%, 47%, and 80% for small, medium, and large TVs in the prone position, respectively. Although prone breast radiotherapy is normally proposed in patients with breasts of large dimensions, this study gives evidence of dosimetric benefit in all patient subgroups irrespective of breast volume size.

61 RADIATION PROTECTION AND DOSIMETRY↗

Dramatic effect of electrode type on tunnel junction based molecular spintronic devices

A new class of molecular spintronic devices can be fabricated by chemically bonding magnetic molecular channels to the electrodes of a prefabricated tunnel junction with exposed side edges. Prior experimental studies showed that the cyanide-bridged octametallic molecular cluster, [(pzTp)FeIII(CN)3]4[NiII(L)]4¬[O3SCF3]4 [(pzTp) = tetra(pyrazol-1-yl)borate; L = 1-S(acetyl)tris(pyrazolyl)decane] molecule impact depended on the type of metallic electrodes used in the tunnel junction testbed. Experimental magnetization and transport studies showed a dramatic difference in molecule response on tunnel junctions with different combinations of metallic electrodes. Transport via paramagnetic molecular channels on a tunnel junction involving paramagnetic and ferromagnetic metal electrodes was dramatically different than the suppressed current state observed on tunnel junctions involving two ferromagnetic electrodes. We conducted theoretical studies to understand the experimental data and explore a wide range of electrode materials on tunnel junction-based molecular spintronics devices (TJMSD). Here, we report a Monte Carlo simulation study that focuses on understanding the effect of electrodes on the magnetic and physical properties of TJMSD. A 3D Heisenberg model of cross-junction-shaped TJMSD was used for the simulation study. We studied the effects of ferromagnetic, paramagnetic, and antiferromagnetic electrode materials. This study provides insights for designing and understanding futuristic molecular spintronics devices.

36 MATERIALS SCIENCE↗