Search NASA⌕ Search

SEARCH · Search NASA

Results for “data exploration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2018

SIRIUS: Enabling Progressive Data Exploration for Extreme-Scale Scientific Data

Scientific simulations on high performance computing (HPC) platforms generate large quantities of data. To bridge the widening gap between compute and I/O, and enable data to be more efficiently stored and analyzed, simulation outputs need to be refactored, reduced, and appropriately mapped to storage tiers. However, a systematic solution to support these steps has been lacking in the current HPC software ecosystem. To that end, this paper develops SIRIUS, a progressive JPEG-like data management scheme for storing and analyzing big scientific data. It co-designs data decimation, compression, and data storage, taking the hardware characteristics of each storage tier into considerations. With reasonably low overhead, our approach refactors simulation data, using either topological or uniform decimation, into a much smaller, reduced-accuracy base dataset, and a series of deltas that is used to augment the accuracy if needed. The base dataset and deltas are compressed and written to multiple storage tiers. Data saved on different tiers can then be selectively retrieved to restore the level of accuracy that satisfies data analytics. Thus, SIRIUS provides a paradigm shift towards elastic data analytics and enables end users to make trade-offs between analysis speed and accuracy on-the-fly. This paper further develops algorithms to preserve statistics for data decimation, a common requirement for reducing data. Here, we assess the impact of SIRIUS on unstructured triangular meshes, a pervasive data model used in scientific simulations. In particular, we evaluate two realistic use cases: the blob detection in fusion and high-pressure area extraction in computational fluid dynamics.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1992

Small Explorer Data System MIL-STD-1773 fiber optic bus

The MIL-STD-1773 Fiber Optic Data Bus as implemented in the GSFC Small Explorer Data System (SEDS) for the Small Explorer Program is described. It provides an overview of the SEDS MIL-STD-1773 bus components system design considerations, reliability figures, acceptance and qualification testing requirements, radiation requirements and tests, error handling considerations, and component heritage. The first mission using the bus will be launched in June of 1992.

Flanegan, Mark↗
DOE OSTI2017

RE Data Explorer: Informing Variable Renewable Energy Grid Integration for Low Emission Development

The RE Data Explorer, developed by the National Renewable Energy Laboratory, is an innovative web-based analysis tool that utilizes geospatial and spatiotemporal renewable energy data to visualize, execute, and support analysis of renewable energy potential under various user-defined scenarios. This analysis can inform high-level prospecting, integrated planning, and policy making to enable low emission development.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2022

Basin and Range Investigation for Developing Geothermal Energy: Exploration Data

This data package includes exploration material from the Basin & Range Investigation for Developing Geothermal Energy [in Hidden Systems] project (BRIDGE), which is part of a broader initiative to advance the exploration of hidden geothermal resources in the Basin & Range Province of the western U.S. Data modalities include a helicopter-borne time-domain electromagnetic survey, magnetotellurics, 2-meter temperature measurements, ground-based gravity and legacy aeromagnetic surveys, geochemistry, geologic mapping, LiDAR analysis, 3D models, associated geospatial data, and a bibliography of existing data and references utilized in prospect characterization and conceptual modeling. Key files are in CSV, Geosoft, and Geotools formats. Please refer to READMEs for dataset-specific information. Where applicable, acquisition data and inversion models for a particular prospect or area of interest are organized separately. This BRIDGE data package is the product of a collaboration led by Sandia National Laboratories with partners from Geologica Geothermal Group, Inc., the U.S. Navy Geothermal Program Office, and consultants Steven Sewell (Australis Geoscience Ltd) and William Cumming (Cumming Geoscience). The project's areas of interest (AOIs) are based off priority areas of interest in the southwestern portion of the Nevada Play Fairway map, distribution across tectonic provinces, accessibility, and the project team's extensive experience in the region. AOIs cover about a dozen basins that include unexplored prospects, partially explored prospects, and some developed analogue resources that provide validation cases. Many unexplored and partially explored prospects are on U.S. Department of Defense (DoD) land, though adjacent lands are included as well.

15 GEOTHERMAL ENERGY↗
DOE OSTI2020

ANDES (ARGONNE NUCLEAR DATA EXPLORATION SOFTWARE) - Physics Tools

A collection of physics tools used by the ANDES. The Argonne Nuclear Data Exploration Software (ANDES) is a collection of open-source C++ codes and ROOT scripts that enable the visualization of patterns emerging from nuclear data. From this global view, well-known phenomena such as major nuclear shell closures and pairing effects near N=Z nuclei, as well as more subtle features, such as quantum phase transition around the Zr isotopes or the charge radius staggering in the Hg isotopes, can be observed. This visualization tool apart from having pedagogic application can serve as a tool for discovering previously unknown phenomena in the nuclear chart.

Santiago-Gonzalez, Daniel↗
DOE OSTI2018

Forming IDEAS: Interactive Data Exploration & Analysis System

Modern cyber security operations collect an enormous amount of logging and alerting data. While analysts have the ability to query and compute simple statistics and plots from their data, current analytical tools are too simple to admit deep understanding. To detect advanced and novel attacks, analysts turn to manual investigations. While commonplace, current investigations are time-consuming, intuition-based, and proving insufficient. Our hypothesis is that arming the analyst with easy-to-use data science tools will increase their work efficiency, provide them with the ability to resolve hypotheses with scientific inquiry of their data, and support their decisions with evidence over intuition. To this end, we present our work to build IDEAS (Interactive Data Exploration and Analysis System). We present three real-world use-cases that drive the system design from the algorithmic capabilities to the user interface. Finally, a modular and scalable software architecture is discussed along with plans for our pilot deployment with a security operation command.

Bridges, Robert↗
NASA NTRS1990

Dayside auroral particle acceleration mechanisms derived from Dynamics Explorer data

The characteristics of dayside electron acceleration regions, or inverted V's, and the nature of the field-aligned currents flowing in their vicinity are studied by using data from Dynamics Explorer hot-plasma and magnetic-field instruments. It is shown that dayside inverted-V events are common features of the mid-altitude extension of the boundary layer, which lies equatorward of the cusp. Upward-accelerated ionospheric electron beams are found to be carriers of downward region-1 currents even in regions of downward electron acceleration. It is not clear, however, how the upward-accelerated cold electron beams can exist above an apparent upward parallel electric field, since such a potential different would tend to confine the cold ionospheric electrons to low altitudes.

Burch, J. L.↗
NASA NTRS2017

Giovanni in the Cloud: Earth Science Data Exploration in Amazon Web Services

Giovanni is an exploration tool at the NASA Goddard Earth Sciences Data Information Services Center (GES DISC), providing 22 analysis and visualization services for over 1600 Earth Science data variables. Owing to its popularity, Giovanni has experienced a consistent growth in overall demand, with periodic usage spikes attributed to trainings by education organizations, extensive data analysis in response to natural disasters, preparations for science meetings, etc. Furthermore, the new generation of spaceborne sensors and high resolution models have resulted in an exponential growth in data volume with data distributed across the traditional boundaries of data centers. Seamless exploration of data (without users having to worry about data center boundaries) has been a key recommendation of the GES DISC User Working Group. These factors have required new strategies for delivering acceptable performance. The cloud-based Giovanni, built on Amazon Web Services (AWS), evaluates (1) AWS native solutions to provide a scalable, serverless architecture; (2) open standards for data storage in the Cloud; (3) a cost model for operations; and (4) end-user performance. Our preliminary findings indicate that the use of serverless architecture has a potential to significantly reduce development and operational cost of Giovanni. The combination of using AWS managed services, storage of data in open standards, and schema-on-read data access strategy simplifies data access and analytics, in addition to making data more accessible to the end users of Giovanni through popular programming languages.

Giovanni↗
DOE OSTI2022

Mining G.O.L.D. (Geothermal Opportunities Leveraged Through Data): Exploring Synergies Between the Geothermal and Mining Industries

This report analyzes potential collaborations between the geothermal and locatable mineral industries (focused on the portion of the Basin and Range Province within Nevada, United States of America). The objectives of this study included analyzing: 1. The type and quality of data collected by the locatable mineral industry to determine feasibility for geothermal resource exploration; 2. The regulatory pathways and potential barriers that could prevent development of geothermal resources discovered via a mining claim (and vice versa) in the United States; 3. The historical development of geothermal resources discovered via mineral exploration data in the United States and illustrations of co-located mining and geothermal power projects; 4. The value propositions for both the locatable mineral and the geothermal industries to collaborate. This article concludes that many of the data collected by the mining industry as part of locatable mineral exploration (e.g., copper, gold, lithium) would also be useful for identifying and developing previously unknown geothermal resources (and in some notable cases, already have led to geothermal resource development). In addition, for minimal costs, the mining industry could catalogue these data and potentially monetize the data itself or use the data in the future to develop a geothermal project. Leveraging these locatable mineral data to develop geothermal resources and/or co-located minerals and geothermal resources would represent significant cost savings when compared to developing geothermal resources under a business-as-usual scenario as well as compared to current generating technologies (e.g., diesel-powered generators) employed at remote mining operations. Ultimately, leveraging mining industry data, knowledge, and expertise serves to effectively expand the geothermal exploration workforce, increase the rate of geothermal resource discovery, and potentially reduce geothermal electricity's levelized cost of energy (LCOE) by 23%-29%.

15 GEOTHERMAL ENERGY↗
NASA NTRSDate not supplied

Extravehicular Activity Mission System Software (EMSS) - Enabling Human Planetary Exploration Data Within The Broader Planetary Data Ecosystem

The planetary science community is once again on the verge of generating, capturing and analyzing human planetary exploration data, this time via the Artemis program. Artemis missions will involve robotic missions in addition to human extravehicular activity (EVA) where crew will be generating scientific data [1]. Present-day robotic mission data expectations for data archiving involves ingesting data into the Planetary Data System (PDS), but how might PDS be leveraged/adapted/ready (or not) for human spaceflight mission data, particularly EVA data that includes non-scientific data that provides important context to the scientific data gathered on the lunar surface? This question has broader implications than what this abstract can answer, but we wanted to pose the question to 1) get conversations started and 2) highlight how operations software data handling could play a role in overall data curation.

M J Miller↗
DOE OSTI2017

Redesigning the DOE Data Explorer to embed dataset relationships at the point of search and to reflect landing page organization

Scientific research is producing ever-increasing amounts of data. Organizing and reflecting relationships across data collections, datasets, publications, and other research objects are essential functionalities of the modern science environment, yet challenging to implement. Landing pages are often used for providing ‘big picture’ contextual frameworks for datasets and data collections, and many large-volume data holders are utilizing them in thoughtful, creative ways. The benefits of their organizational efforts, however, are not realized unless the user eventually sees the landing page at the end point of their search. What if that organization and ‘big picture’ context could benefit the user at the beginning of the search? That is a challenging approach, but The Department of Energy’s (DOE) Office of Scientific and Technical Information (OSTI) is redesigning the database functionality of the DOE Data Explorer (DDE) with that goal in mind. Phase I is focused on redesigning the DDE database to leverage relationships between two existing distinct populations in DDE, data Projects and individual Datasets, and then adding a third intermediate population, data Collections. Mapped, structured linkages, designed to show user relationships, will allow users to make informed search choices. These linkages will be sustainable and scalable, created automatically with the use of new metadata fields and existing authorities. Phase II will study selected DOE Data ID Service clients, analyzing how their landing pages are organized, and how that organization might be used to improve DDE search capabilities. At the heart of both phases is the realization that adding more metadata information for cross-referencing may require additional effort for data scientists. Finally, OSTI’s approach seeks to leverage existing metadata and landing page intelligence without imposing an additional burden on the data creators.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

NeuralCubes: Deep Representations for Visual Data Exploration

Visual exploration of large multi-dimensional datasets has seen tremendous progress in recent years, allowing users to express rich data queries that produce informative visual summaries, all in real time. Techniques based on data cubes are some of the most promising approaches. However, these techniques usually require a large memory footprint for large datasets. To tackle this problem, we present NeuralCubes: neural networks that predict results for aggregate queries, similar to data cubes. NeuralCubes learns a function that takes as input a given query, for instance, a geographic region and temporal interval, and outputs the result of the query. The learned function serves as a real-time, low-memory approximator for aggregation queries. Our models are small enough to be sent to the client side (e.g. the web browser for a web-based application) for evaluation, enabling data exploration of large datasets without database/network connection. Here, we demonstrate the effectiveness of NeuralCubes through extensive experiments on a variety of datasets and discuss how NeuralCubes opens up opportunities for new types of visualization and interaction.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Utilizing Novel Field and Data Exploration Methods to Explore Hot Moments in High-Frequency Soil Nitrous Oxide Emissions Data: Opportunities and Challenges

Soil nitrous oxide (N 2 O) emissions are an important driver of climate change and are a major mechanism of labile nitrogen (N) loss from terrestrial ecosystems. Evidence increasingly suggests that locations on the landscape that experience biogeochemical fluxes disproportionate to the surrounding matrix (hot spots) and time periods that show disproportionately high fluxes relative to the background (hot moments) strongly influence landscape-scale soil N 2 O emissions. However, substantial uncertainties remain regarding how to measure and model where and when these extreme soil N 2 O fluxes occur. High-frequency datasets of soil N 2 O fluxes are newly possible due to advancements in field-ready instrumentation that uses cavity ring-down spectroscopy (CRDS). Here, we outline the opportunities and challenges that are provided by the deployment of this field-based instrumentation and the collection of high-frequency soil N 2 O flux datasets. While there are substantial challenges associated with automated CRDS systems, there are also opportunities to utilize these near-continuous data to constrain our understanding of dynamics of the terrestrial N cycle across space and time. Finally, we propose future research directions exploring the influence of hot moments of N 2 O emissions on the N cycle, particularly considering the gaps surrounding how global change forces are likely to alter N dynamics in the future.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2015

A Data Exploration Tool for Large Sets of Spectra

We present an exploration tool for very large spectrum data sets such as the SDSS (Sloan Digital Sky Survey), LAMOST (Large Sky Area Multi-Object Fiber Spectroscopic Telescope), and 4MOST (4-meter Multi-Object Spectroscopic Telescope) data sets. The tool works in two stages: the first uses batch processing and the second runs interactively. The latter employs the NASA hyperwall, a configuration of 128 workstation displays (8 by 16 array) controlled by a parallelized software suite running on NASA's Pleiades supercomputer. The stellar subset of the Sloan Digital Sky Survey, DR10, was chosen to show how the our tool may be used. In stage one, SDSS files for 569,740 stars are processed through our data pipeline. The pipeline fits each spectrum using an iterative continuum algorithm, distinguishing emission from absorption and handling molecular absorption bands correctly. It then measures 1659 discrete atomic and molecular spectral features that were carefully preselected based on their likelihood of being visible at some spectral type. The depths relative to the local continuum at each feature wavelength are determined for each spectrum: these depths, the local S/N (signal to noise ratio) level, and DR10-supplied variables such as magnitudes, colors, positions, and radial velocities are the basic measured quantities used on the hyperwall. In stage two, each hyperwall panel is used to display a 2-D scatter plot showing the depth of feature A vs the depth of feature B for all of the stars. A and B change from panel to panel. The relationships between the various (A,B) strengths and any distinctive clustering are immediately apparent when examining and inter-comparing the different panels on the hyperwall. The interactive software allows the user to select the stars in any interesting region of any 2-D plot on the hyperwall, immediately rendering the same stars on all the other 2-D plots in a unique color. The process may be repeated multiple times, each selection displaying a distinctive color on all the plots. At any time, the spectra of the selected stars may be examined in detail on a connected workstation display. We illustrate how our approach allows us to quickly isolate and examine such interesting stellar subsets as EMP (Extremely Metal‐Poor) stars, CV (Cataclymic Variable) stars and C (Carbon)-rich stars.

Data Exploration↗
DOE OSTI2017

Web-based visual data exploration for improved radiological source detection

Radiation detection can provide a reliable means of detecting radiological material. Such capabilities can help to prevent nuclear and/or radiological attacks, but reliable detection in uncontrolled surroundings requires algorithms that account for environmental background radiation. The Berkeley Data Cloud (BDC) facilitates the development of such methods by providing a framework to capture, store, analyze, and share data sets. In the era of big data, both the size and variety of data make it difficult to explore and find data sets of interest and manage the data. Thus, in the context of big data, visualization is critical for checking data consistency and validity, identifying gaps in data coverage, searching for data relevant to an analyst's use cases, and choosing input parameters for analysis. Downloading the data and exploring it on an analyst's desktop using traditional tools are no longer feasible due to the size of the data. This study describes the design and implementation of a visualization system that addresses the problems associated with data exploration within the context of the BDC. Finally, the visualization system is based on a JavaScript front end communicating via REST with a back end web server.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗