Search NASA⌕ Search

SEARCH · Search NASA

Results for “data exploration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34

FleetREDI Dashboard Fleet DNA Data Summaries

Developing daily duty cycle summaries for every vehicle-day within NLR’s Fleet DNA database was a key output of the FleetREDI project. This project captured second-by-second GPS and controller area network (CAN) data on in-use medium- and heavy-duty fleet vehicles and then summarized the data to provide an overview of vehicle operation throughout the United States. These data summaries were then displayed in aggregated formats on the FleetREDI dashboard, where users can explore the data within Fleet DNA. Fleet DNA’s clearinghouse of commercial fleet vehicle operating data helps vehicle manufacturers and developers optimize vehicle designs and helps fleet managers choose advanced technologies for their fleets. This online tool, which provides data summaries and visualizations similar to real-world "genetics" for medium- and heavy-duty fleet vehicles, helps users understand the broad operational range of commercial vehicles across vocations and weight classes.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

TITUS: Visualization of Neutrino Events in Liquid Argon Time Projection Chambers

The amount and complexity of data recorded by high energy physics experiments are rapidly growing, and with these grow the difficulties in visualizing such data. To study the physics of neutrinos, a type of elementary particle, scientists use liquid argon time projection chamber (LArTPC) detectors, among other technologies. LArTPCs have a very high spatial resolution and resolve many of the elementary particles that come out of a neutrino interacting within the argon in the detector. Visualizing these neutrino interactions is of fundamental importance to understanding the properties of neutrinos, but also monitoring and checking on the detector conditions and operations. From these ideas, we have developed TITUS, an event display that shows images recorded by these neutrino detectors. TITUS is a piece of software that reads data coming from LArTPC detectors (as well as the corresponding simulation) and allows users to explore such data in multiple ways. TITUS is flexible to enable fast prototyping and customization.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

The evolution of the quasar continuum

We now have in hand a large data base of Roentgen Satellite (ROSAT), optical, and IR complementary data. We are in the process of obtaining a large amount of the International Ultraviolet Explorer (IUE) data for the same quasar sample. For our complementary sample at high redshifts, where the UV was redshifted into the optical, we have just had approved large amounts of observing time to cover the quasar continuum in the near-IR using the new Near-Infrared Camera and Multi-Object Spectrometer (NICMOS) array spectrographs. Ten micron, optical, and VLA radio, data also have approved time. An ISO US key program was approved to extend this work into the far-IR, and the launch of ASTRO-D (early in 1993) promises to extend it to higher energy X-rays.

Elvis, M.↗

Detection and Retrieval of Multi-Layered Cloud Properties Using Satellite Data

Four techniques for detecting multilayered clouds and retrieving the cloud properties using satellite data are explored to help address the need for better quantification of cloud vertical structure. A new technique was developed using multispectral imager data with secondary imager products (infrared brightness temperature differences, BTD). The other methods examined here use atmospheric sounding data (CO2-slicing, CO2), BTD, or microwave data. The CO2 and BTD methods are limited to optically thin cirrus over low clouds, while the MWR methods are limited to ocean areas only. This paper explores the use of the BTD and CO2 methods as applied to Moderate Resolution Imaging Spectroradiometer (MODIS) and Advanced Microwave Scanning Radiometer EOS (AMSR-E) data taken from the Aqua satellite over ocean surfaces. Cloud properties derived from MODIS data for the Clouds and the Earth's Radiant Energy System (CERES) Project are used to classify cloud phase and optical properties. The preliminary results focus on a MODIS image taken off the Uruguayan coast. The combined MW visible infrared (MVI) method is assumed to be the reference for detecting multilayered ice-over-water clouds. The BTD and CO2 techniques accurately match the MVI classifications in only 51 and 41% of the cases, respectively. Much additional study is need to determine the uncertainties in the MVI method and to analyze many more overlapped cloud scenes.

Minnis, Patrick↗

Temporal Summary Images: An Approach to Narrative Visualization via Interactive Annotation Generation and Placement

Visualization is a powerful technique for analysis and communication of complex, multidimensional, and time-varying data. However, it can be difficult to manually synthesize a coherent narrative in a chart or graph due to the quantity of visualized attributes, a variety of salient features, and the awareness required to interpret points of interest (POIs). We present Temporal Summary Images (TSIs) as an approach for both exploring this data and creating stories from it. As a visualization, a TSI is composed of three common components: (1) a temporal layout, (2) comic strip-style data snapshots, and (3) textual annotations. To augment user analysis and exploration, we have developed a number of interactive techniques that recommend relevant data features and design choices, including an automatic annotations workflow. As the analysis and visual design processes converge, the resultant image becomes appropriate for data storytelling. For validation, we use a prototype implementation for TSIs to conduct two case studies with large-scale, scientific simulation datasets.

97 MATHEMATICS AND COMPUTING↗

Finding Stuff Underwater: Open-Source Tools for Underwater Field Science

Since 2009, we have been developing and testing Exploration Ground Data Systems (xGDS). xGDS is a software suite, built on open-source web technologies, for supporting NASA terrestrial field science analog missions. We will describe our recent work supporting underwater mapping and dive operations at the Pavilion Lake Research Project (PLRP - www.pavilionlake.com). At PLRP we used open-source mapping technologies to meet an operational need to quickly guide divers and underwater vehicles to locations of interest, and the scientific goal of building a map showing the locations and characteristics of the microbialites at the bottom of the lake. We will discuss some of the benefits and lessons-learned from our recent transition from Google Earth to OpenLayers as the primary mapping engine to support our work. Well also explain the challenges we faced and solutions weve developed to support mapping and data collection in an underwater environment.Beyond their immediate value for advancing scientific research on Earth, NASA analogs explore new ideas for supporting scientists working in extreme environments (e.g. underwater) to develop best practices for future human missions to the Moon or Mars. Science at PLRP involved imaging, sampling and characterizing microbialites growing beneath the surface of an alpine lake in British Columbia. To support PLRP operations and science, xGDS helped plan data collection tasks and provided accurate tracking and mapping of the locations of the underwater assets (human-piloted submersibles, remotely operated vehicles (ROVs) and human divers) collecting imagery and samples from the lake. The data collected during our field work was registered with precursor bathymetry data collected by an autonomous underwater vehicle (AUV) and was globally located on a satellite base layer map of the area surrounding the lake.

Earth analogs↗

Interactive Visualization of Complex Seismic Data and Models Using Bokeh

Visualizing multidimensional data and models becomes more challenging as the volume and resolution of seismic data and models increase. But thanks to the development of powerful and accessible computer systems, a model web browser can be used to visualize complex scientific data and models dynamically. In this paper, we present four examples of seismic model visualization using an open-source Python package Bokeh. One example is a visualization of a surface-wave dispersion data set, another presents a view of three-component seismograms, and two illustrate methods to explore a 3D seismic-velocity model. Unlike other 3D visualization packages, our visualization approach has a minimum requirement on users and is relatively easy to develop, provided you have reasonable programming skills. Finally, utilizing familiar web browsing interfaces, the dynamic tools provide us an effective and efficient approach to explore large data sets and models.

58 GEOSCIENCES↗

Automated qualification data tool for high temperature metallic materials

This report describes a framework for storing, processing, and displaying qualification data for high temperature mechanical properties. The framework automates the process of generating design data from mechanical test results, for example for a data qualification report for the ASME Boiler \& Pressure Vessel Code. The framework has three parts: a data storage model with common formats for several types of typical mechanical property tests, a backend based on the \pycreep Python library for correlating and extrapolating the data to generate design material properties and allowable stresses, and a demonstration user interface for displaying, sorting, and filtering the data and exploring different options for modeling the design mechanical properties. The report discusses the options available for data processing, with illustrations from real test data on Alloy 617, Alloy 709, Alloy 740H, and Laser-Powder Bed Fusion 316H. The framework is complete for ASME type data analysis and will be used to store test data generated by the Department of Energy, Office of Nuclear Energy, Advanced Materials and Manufacturing Technologies sponsored qualification programs. Future work could extend the tool to other types of material properties and/or expand the demo user interface to make it accessible across the AMMT program.

36 MATERIALS SCIENCE↗

A reverse shock associated with a stream-stream interaction - The February 29, 1968, event

A clearly defined perpendicular fast reverse shock was found in the interplanetary plasma and magnetic field data from Explorer 33 and 35. A Pioneer 8 observation, which is not unambiguously identifiable because of insufficient data, indicates the evolution of this event. It is suggested that this reverse shock was formed from a stream-stream interaction and that an associated forward shock was developing and probably formed beyond the earth's orbit.

Chao, J. K.↗

Is it possible to identify a trend in problem/failure data

One of the major obstacles in identifying and interpreting a trend is the small number of data points. Future trending reports will begin with 1983 data. As the problem/failure data are aggregated by year, there are just seven observations (1983 to 1989) for the 1990 reports. Any statistical inferences with a small amount of data will have a large degree of uncertainty. Consequently, a regression technique approach to identify a trend is limited. Though trend determination by failure mode may be unrealistic, the data may be explored for consistency or stability and the failure rate investigated. Various alternative data analysis procedures are briefly discussed. Techniques that could be used to explore problem/failure data by failure mode are addressed. The data used are taken from Section One, Space Shuttle Main Engine, of the Calspan Quarterly Report dated April 2, 1990.

Church, Curtis K.↗

Real-Time Discovery Services over Large, Heterogeneous and Complex Healthcare Datasets Using Schema-Less, Column-Oriented Methods

We present a service platform for schema-leess exploration of data and discovery of patient-related statistics from healthcare data sets. The architecture of this platform is motivated by the need for fast, schema-less, and flexible approaches to SQL-based exploration and discovery of information embedded in the common, heterogeneously structured healthcare data sets and supporting components (electronic health records, practice management systems, etc.) The motivating use cases described in the paper are clinical trials candidate discovery, and a treatment effectiveness analysis. Following the use cases, we discuss the key features and software architecture of the platform, the underlying core components (Apache Parquet, Drill, the web services server), and the runtime profiles and performance characteristics of the platform. We conclude by showing dramatic speedup with some approaches, and the performance tradeoffs and limitations of others.

Apache Drill Apache Parquet Column Oriented Stores↗

Morphology of thermospheric composition variations in the quiet polar thermosphere from Dynamics Explorer measurements

Composition data obtained by the Neutral Atmosphere Composition Spectrometer carried aboard the Dynamics Explorer 2 satellite have been examined for variations in the polar regions during magnetically quiet conditions. A persistent enhancement of N2 density and a depletion of He density are present in the vicinity of the magnetic poles with maximum density response in the morning hours (magnetic) on average. A universal time (UT) variation in average density levels is evident near both the geographic and magnetic poles. There are systematic morphology changes with UT and between summer and winter which are qualitatively consistent with the shifting and spreading of thermospheric heating effects by the global circulation systems driven by EUV and magnetospheric sources. The magnitude of the UT variations is larger in the southern hemisphere on average, and the UT variations are larger in local winter than summer.

Hedin, A. E.↗

On parameterization of the inverse problem for estimating aquifer properties using tracer data

We consider a field-scale tracer experiment conducted in 2007 in a shallow uranium-contaminated aquifer at Rifle, Colorado. In developing a reliable approach for inferring hydrological properties at the site through inverse modeling of the tracer data, decisions made on how to parameterize heterogeneity (i.e., how to represent a heterogeneous distribution using a limited number of parameters that are amenable to estimation) are of paramount importance. We present an approach for hydrological inversion of the tracer data and explore, using a 2D synthetic example at first, how parameterization affects the solution, and how additional characterization data could be incorporated to reduce uncertainty. Specifically, we examine sensitivity of the results to the configuration of pilot points used in a geostatistical parameterization, and to the sampling frequency and measurement error of the concentration data. A reliable solution of the inverse problem is found when the pilot point configuration is carefully implemented. In addition, we examine the use of a zonation parameterization, in which the geometry of the geological facies is known (e.g., from geophysical data or core data), to reduce the non-uniqueness of the solution and the number of unknown parameters to be estimated. When zonation information is only available for a limited region, special treatment in the remainder of the model is necessary, such as using a geostatistical parameterization. Finally, inversion of the actual field data is performed using 2D and 3D models, and results are compared with slug test data.

54 ENVIRONMENTAL SCIENCES↗

Approximate Dynamic Programming With Enhanced Off-Policy Learning for Coordinating Distributed Energy Resources

Herein this paper proposes an innovative approximate dynamic programming (ADP) method for distributed energy resource coordination with the loss of life of battery energy storage system (BESS) explicitly modeled. The dispatch policy is designed to account for both calendrical and cyclical aging effects on BESS, explicitly modeling the impacts of ambient temperature on BESS lifespan. The proposed ADP employs an adaptive critic method and enhanced off-policy deterministic policy gradient (DPG) strategy, addressing the limitations of the on-policy gradient-based ADP approaches, including inadequate exploration, low data usage, and computational complexity. In particular, a customized policy is proposed to guide the algorithm to explore some promising decisions and thereby improve exploration capability and learning efficiency compared to conventional DPG-based learning approaches, which may struggle to find a global optimum due to random noisy action-based exploration or require expert demonstration with extra effort. The proposed method is illustrated using the IEEE 123-node system and compared with the existing ADP methods to prove solution accuracy and demonstrate the effects of incorporating degradation models into control design. Case studies showed that the proposed ADP effectively coordinates DERs with a 10 times smaller optimization gap compared to existing methods, and the incorporation of the BESS life loss model ensures the expected lifespan and results in significant cost savings.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Toward Drilling the Perfect Geothermal Well: An International Research Coordination Network for Geothermal Drilling Optimization Supported by Deep Machine Learning and Cloud Based Data Aggregation

The EDGE project, supported by the U.S. Department of Energy Geothermal Technologies Office under award DE-EE0008793, established a data-driven framework for improving the efficiency, cost-effectiveness, and reliability of geothermal well drilling. The project focused on developing scalable data infrastructure, advanced machine learning and probabilistic models, and integrated analytics tools to support continuous drilling optimization. A central objective was to reduce geothermal drilling costs by up to seventy percent while minimizing the risk of well failure through predictive diagnostics and adaptive planning. Over the project period, a comprehensive data repository was designed and deployed, incorporating records from over one hundred geothermal wells across varied geological settings. This repository supported both structured and unstructured data and adhered to FAIR data principles, enabling provenance tracking, quality control, and standardized metadata. The project introduced automated ingestion pipelines and a cloud-hosted platform that facilitated access to raw, processed, and derived datasets. This infrastructure served as the foundation for model development and analysis. Machine learning workflows were developed to predict key drilling metrics including rate of penetration, non-productive time, and total drilling costs. Self-organizing maps and dimensionality reduction methods were used to uncover operational patterns and outliers, while supervised learning algorithms such as random forests and deep neural networks were applied to forecast performance outcomes. The models were validated on heterogeneous datasets from both U.S. and Icelandic fields, demonstrating variable but significant predictive accuracy. The results indicated that finer temporal resolution, inclusion of lithological data, and consistency in operational annotations could substantially improve model performance. The project also implemented process mining techniques to reconstruct state-transition models from drilling event logs. These models enabled the identification of deviations from optimal workflows and provided insights into recurring failure modes. Analysis of non-productive time highlighted the impact of equipment failures, geological challenges, and human factors, offering opportunities for targeted mitigation strategies. The EDGE Dashboard was developed as a web-based expert system integrating data visualization, model outputs, and user-driven queries. It provided an accessible interface for operators to explore historical data, evaluate predicted outcomes, and compare drilling scenarios. Initial feedback from project partners suggested that the dashboard could serve as a foundation for more advanced advisory and optimization tools. Overall, the EDGE project demonstrated the feasibility and value of applying modern data science techniques to geothermal drilling. It delivered a set of interoperable tools and models that can support more efficient, lower-risk well development. The findings point toward a viable path for transitioning from advisory analytics to semi-autonomous drilling systems, contingent on continued collaboration, expanded datasets, and field validation. The project results have immediate relevance for drilling operations, data management practices, and future geothermal R&D efforts aimed at achieving reliable, cost-competitive geothermal energy at scale.

15 GEOTHERMAL ENERGY↗

A reverse shock associated with a stream-stream interaction: The 29th February 1968 event

A clearly defined perpendicular fast reverse shock was found in the interplanetary plasma and magnetic field data from Explorers 33 and 35. An observation by Pioneer 8, which is not unambiguously identifiable because of insufficient data, indicates the evolution of this event. It is suggested that this reverse shock was formed from a stream-stream interaction and that an associated foward shock was developing and probably formed beyond the earth's orbit.

Chao, J. K.↗

Data Mining for Science of the Sun-Earth Connection as a Single System

Establishing the Sun-Earth connection requires overcoming the challenges of exploring the data from past and current missions and leveraging tools and models (data mining) to create an efficient system treatment of the Sun and heliosphere. However, solar and heliospheric environment data constitute a vast source of information whose potential is far from being optimally exploited. In the next decade, the solar and heliospheric community will have to manage the increasing amount of information coming from new missions, improve reanalysis of data from past and current missions, and create new data products from the application of new methodologies. This complex task is further complicated by practical challenges such as different datasets and catalogs in different formats that may require different pre-processing and analysis tools, and the need for numerous analysis approaches that are not all fully optimized for large volumes of data. While several ongoing efforts aim at addressing these problems, the available datasets and tools are not always used to their full potential often due to lack of awareness of available resources. In this paper, we summarize the issues raised and goals discussed by members of the community during recent conference sessions focused on data mining for science.

Sun-Earth connection↗