Search NASA⌕ Search

SEARCH · Search NASA

Results for “data exploration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Meteorological data from the Billy Bar site at the East River, Colorado

This dataset includes Quality Assessed and Quality Controlled (QA/QC) meteorological data from the Billy Bar field site in the East River Watershed, Colorado in order to inform watershed hydrobiogeochemical processes. The data includes 1-hour aligned time series of Solar Radiation, Wind Speed, Wind Direction, Air Temperature, Relative Humidity, Barometric Pressure, and Precipitation. For each parameter, the QA flags are given: 1 is for extreme (potential abnormal values), and 0 is for values in the expected range. The Rmarkdown document is a stand-alone file/notebook that preserves the text, code, and code results, as well as formatting contained in the original R script. The Data profiling report is a summary and graphical presentation of the data exploration process for data analysis and model building, so that users could focus on understanding data and extracting insights. The report provides a summary of each variable and does data profiling.

54 ENVIRONMENTAL SCIENCES↗

Development and Validation of Southeast Asia Solar Resource Data [Slides]

Lack of access to high-quality, publicly available, time series solar data to inform decisions that will transform energy sectors in Southeast Asia is a challenge. The solution is to level the playing field by offering free, high-quality, robust solar data to inform private sector investment and policymaking. This is done by (1) leveraging deep NREL expertise in atmospheric science, solar resource assessment, high-performance computing, and cloud-based data dissemination, (2) producing and validating high spatial and temporal resolution solar resource data, (3) making data available on the USAID-funded global Renewable Energy Data Explorer platform, (4) providing capacity building for data and applications, and (5) informing future demand-driven tool development.

14 SOLAR ENERGY↗

Gap Assessment (FY 13 Update)

To help guide its future data collection efforts, The DOE GTO funded a data gap analysis in FY2012 to identify high potential hydrothermal areas where critical data are needed. This analysis was updated in FY2013 and the resulting datasets are represented by this metadata. The original process was published in FY 2012 and is available here: https://pangea.stanford.edu/ERE/db/GeoConf/papers/SGW/2013/Esposito.pdf Though there are many types of data that can be used for hydrothermal exploration, five types of exploration data were targeted for this analysis. These data types were selected for their regional reconnaissance potential, and include many of the primary exploration techniques currently used by the geothermal industry. The data types include: 1. well data 2. geologic maps 3. fault maps 4. geochemistry data 5. geophysical data To determine data coverage, metadata for exploration data (including data type, data status, and coverage information) were collected and catalogued from nodes on the National Geothermal Data System (NGDS). It is the intention of this analysis that the data be updated from this source in a semi-automated fashion as new datasets are added to the NGDS nodes. In addition to this upload, an online tool was developed to allow all geothermal data providers to access this assessment and to directly add metadata themselves and view the results of the analysis via maps of data coverage in Geothermal Prospector (http://maps.nrel.gov/gt_prospector). A grid of the contiguous U.S. was created with 88,000 10-km by 10-km grid cells, and each cell was populated with the status of data availability corresponding to the five data types. Using these five data coverage maps and the USGS Resource Potential Map, sites were identified for future data collection efforts. These sites signify both that the USGS has indicated high favorability of occurrence of geothermal resources and that data gaps exist. The uploaded data are contained in two data files for each data category. The first file contains the grid and is in the SHP file format (shape file.) Each populated grid cell represents a 10k area within which data is known to exist. The second file is a CSV (comma separated value) file that contains all of the individual layers that intersected with the grid. This CSV can be joined with the map to retrieve a list of datasets that are available at any given site. The attributes in the CSV include: 1. grid_id : The id of the grid cell that the data intersects with 2. title: This represents the name of the WFS service that intersected with this grid cell 3. abstract: This represents the description of the WFS service that intersected with this grid cell 4. gap_type: This represents the category of data availability that these data fall within. As the current processing is pulling data from NGDS, this category universally represents data that are available in the NGDS and are ready for acquisition for analytic purposes. 5. proprietary_type: Whether the data are considered proprietary 6. service_type: The type of service 7. base_url: The service URL

15 GEOTHERMAL ENERGY↗

Shedding light on U.S. small and midsize data centers: Exploring insights from the CBECS survey

As demand for digital services accelerates, the energy and environmental footprint of data centers faces increasing scrutiny. While hyperscale cloud facilities have driven efficiency gains, small and midsize U.S. data centers remain a critical yet underexamined segment with significant untapped potential for energy savings. This study leverages data from the Commercial Buildings Energy Consumption Survey (CBECS) to analyze trends in server stocks, computing customers, cooling system adoption and efficiency, and geospatial distribution from 2012 to 2018. Findings reveal a sharp decline in small and midsize data centers, from 1.764 million to 1.398 million, with server counts dropping from 5.177 million to 4.262 million—aligning with the broader shift toward cloud computing. More than 40 % of servers in small data centers and 55 % in midsize data centers are housed in office buildings, and over half of all servers are concentrated in climate zones 5A (cold), 3A (mixed-humid), and 4A (mixed-humid), with the highest densities in metropolitan hubs. While direct expansion units remain the dominant cooling system, a clear transition toward more energy-efficient solutions, particularly air economizers, is evident. By integrating server and cooling system distributions, we estimate Power Usage Effectiveness (PUE) and Water Usage Effectiveness (WUE) for U.S. data centers by size and year. Results show that midsize data centers are more energy-efficient but more water-intensive due to the widespread use of water-cooled chillers. These findings highlight the trade-offs in cooling system selection and provide a critical foundation for policies aimed at enhancing efficiency in an evolving data center landscape.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOECGF 2009 Site Report: Lawrence Livermore National Laboratory

The Data group provides data analysis and visualization support to its customers. This consists primarily of the development and support of VisIt, a data analysis and visualization tool. Support ranges from answering questions about the tool, providing classes on how to use the tool, and performing data analysis and visualization for customers. The Information Management and Graphics Group supports and develops tools that enhance our ability to access, display, and understand large, complex data sets. Activities include applying visualization software for terascale data exploration; running video production labs on two networks; supporting graphics libraries and tools for end users; maintaining PowerWalls and assorted other displays; and developing software for searching, managing, and browsing scientific data. Researchers in the Center for Applied Scientific Computing (CASC) work on various projects including the development of visualization techniques for terascale data exploration that are funded by the ASC program, among others. The researchers also have LDRD projects and collaborations with other lab researchers, academia, and industry.

99 GENERAL AND MISCELLANEOUS↗

DOECGF 2008 Site Report

The Data group provides data analysis and visualization support to its customers. This consists primarily of the development and support of VisIt, a data analysis and visualization tool. Support ranges from answering questions about the tool, providing classes on how to use the tool, and performing data analysis and visualization for customers. The Information Management and Graphics Group supports and develops tools that enhance our ability to access, display, and understand large, complex data sets. Activities include applying visualization software for terascale data exploration; running two video production labs; supporting graphics libraries and tools for end users; maintaining PowerWalls and assorted other displays; and developing software for searching, managing, and browsing scientific data. Researchers in the Center for Applied Scientific Computing (CASC) work on various projects including the development of visualization techniques for terascale data exploration that are funded by the ASC program, among others. The researchers also have LDRD projects and collaborations with other lab researchers, academia, and industry. During the past year we have completed our visualization cluster strategy of converting to Opteron/IB clusters. We support a 128-node Opteron/IB cluster providing a visualization production server for our unclassified systems and a 256-node Opteron/IB cluster for the classified systems, as well as several smaller clusters to drive the PowerWalls. We are in the process of updating projectors for one of the PowerWalls and acquiring new fiber modems for another. We deployed a 150 TB NFS server to provide dedicated storage for data analysis and visualization for our unclassified visualization server. The IMG group is located in the Terascale Simulation Facility, home to BGL, Purple, and Atlas, which includes both classified and unclassified visualization theaters, a visualization computer floor and deployment workshop, and video production labs. We continued to provide the traditional graphics group consulting and video production support. We maintained five PowerWalls and a host of other displays.

99 GENERAL AND MISCELLANEOUS↗

DOECGF 2010 Site Report

The Data group provides data analysis and visualization support to its customers. This consists primarily of the development and support of VisIt, a data analysis and visualization tool. Support ranges from answering questions about the tool, providing classes on how to use the tool, and performing data analysis and visualization for customers. The Information Management and Graphics Group supports and develops tools that enhance our ability to access, display, and understand large, complex data sets. Activities include applying visualization software for large scale data exploration; running video production labs on two networks; supporting graphics libraries and tools for end users; maintaining PowerWalls and assorted other displays; and developing software for searching and managing scientific data. Researchers in the Center for Applied Scientific Computing (CASC) work on various projects including the development of visualization techniques for large scale data exploration that are funded by the ASC program, among others. The researchers also have LDRD projects and collaborations with other lab researchers, academia, and industry. The IMG group is located in the Terascale Simulation Facility, home to Dawn, Atlas, BGL, and others, which includes both classified and unclassified visualization theaters, a visualization computer floor and deployment workshop, and video production labs. We continued to provide the traditional graphics group consulting and video production support. We maintained five PowerWalls and many other displays. We deployed a 576-node Opteron/IB cluster with 72 TB of memory providing a visualization production server on our classified network. We continue to support a 128-node Opteron/IB cluster providing a visualization production server for our unclassified systems and an older 256-node Opteron/IB cluster for the classified systems, as well as several smaller clusters to drive the PowerWalls. The visualization production systems includes NFS servers to provide dedicated storage for data analysis and visualization. The ASC projects have delivered new versions of visualization and scientific data management tools to end users and continue to refine them. VisIt had 4 releases during the past year, ending with VisIt 2.0. We released version 2.4 of Hopper, a Java application for managing and transferring files. This release included a graphical disk usage view which works on all types of connections and an aggregated copy feature for quickly transferring massive datasets quickly and efficiently to HPSS. We continue to use and develop Blockbuster and Telepath. Both the VisIt and IMG teams were engaged in a variety of movie production efforts during the past year in addition to the development tasks.

97 MATHEMATICS AND COMPUTING↗

ActiveSpaces: Exploring dynamic code deployment for extreme scale data processing: ActiveSpaces: Exploring dynamic code deployment for extreme scale data processing

Managing the large volumes of data produced by emerging scientific and engineering simulations running on leadership-class resources has become a critical challenge. The data have to be extracted off the computing nodes and transported to consumer nodes so that it can be processed, analyzed, visualized, archived, and so on. Several recent research efforts have addressed data-related challenges at different levels. One attractive approach is to offload expensive input/output operations to a smaller set of dedicated computing nodes known as a staging area. However, even using this approach, the data still have to be moved from the staging area to consumer nodes for processing, which continues to be a bottleneck. In this paper, we investigate an alternate approach, namely moving the data-processing code to the staging area instead of moving the data to the data-processing code. Specifically, we describe the ActiveSpaces framework, which provides (1) programming support for defining the data-processing routines to be downloaded to the staging area and (2) runtime mechanisms for transporting codes associated with these routines to the staging area, executing the routines on the nodes that are part of the staging area, and returning the results. We also present an experimental performance evaluation of ActiveSpaces using applications running on the Cray XT5 at Oak Ridge National Laboratory. Finally, we use a coupled fusion application workflow to explore the trade-offs between transporting data and transporting the code required for data processing during coupling, and we characterize sweet spots for each option.

97 MATHEMATICS AND COMPUTING↗

A probabilistic application of oil and gas data for exploration stage geothermal reservoir assessment in the Appalachian Basin

Geothermal energy is a renewable, widespread, baseload energy source that has the potential to supply a large portion of the world’s energy needs. High development risk, specifically high drilling costs combined with uncertainty in subsurface flow properties, have hampered growth of geothermal energy development. One option to reduce subsurface risk is to target locations where reservoir data are already available, including sedimentary basins where there has been extensive hydrocarbon production. Sedimentary basins are widespread and often have suitable geothermal gradients. This chapter presents a low-cost methodology that can be used at the pre-drilling exploration phase of a low-temperature geothermal project to predict the location of high-productivity and low-risk reservoirs, applied to a case study of the Appalachian Basin in the eastern United States. Because only averaged reservoir data were available for analysis, the technique uses a Monte Carlo simulation of the Reservoir Flow Capacity (RFC) and Reservoir Productivity Index (RPI) for over 1800 individual reservoirs, using liquid water or supercritical carbon dioxide (sCO 2 ) as the reservoir fluid. RFC is used as an initial screening tool to identify high-priority geologic formations and reservoirs. Here our results indicate that 99% of the reservoirs in the basin are of insufficient quality for geothermal heat production with water as the assumed fluid and without using stimulation technologies associated with Enhanced Geothermal Systems (EGS). RPI is also used as an alternative metric to identify high-productivity reservoirs. When comparing the RPI results to natural gas production volumes from several selected reservoirs, the predicted RPI proves to be a good estimate of flow potential for porous reservoirs, but overestimates flow by a factor of three for fractured or vuggy reservoirs. A greater uncertainty ought to be utilized when applying the RPI equation to non-porous media, therefore we recommend utilizing the RPI metric when higher resolution data are available for analysis. This methodology can be utilized in other basins that have experienced hydrocarbon exploration and production, to highlight low-risk reservoirs or geologic formations for further geothermal development.

15 GEOTHERMAL ENERGY↗

Photometric redshifts probability density estimation from recurrent neural networks in the DECam local volume exploration survey data release 2

Photometric wide-field surveys are imaging the sky in unprecedented detail. These surveys face a significant challenge in efficiently estimating galactic photometric redshifts while accurately quantifying associated uncertainties. In this work, we address this challenge by exploring the estimation of Probability Density Functions (PDFs) for the photometric redshifts of galaxies across a vast area of 17,000 square degrees, encompassing objects with a median 5 σ point-source depth of g = 24.3, r = 23 . 9 , i = 23.5, and z = 22.8 mag. Our approach uses deep learning, specifically integrating a Recurrent Neural Network architecture with a Mixture Density Network, to leverage magnitudes and colors as input features for constructing photometric redshift PDFs across the whole DECam Local Volume Exploration (DELVE) survey sky footprint. Subsequently, we rigorously evaluate the reliability and robustness of our estimation methodology, gauging its performance against other well-established machine learning methods to ensure the quality of our redshift estimations. Our best results constrain photometric redshifts with the bias of − 0 . 0013 , a scatter of 0.0293, and an outlier fraction of 5.1%. These point estimates are accompanied by well-calibrated PDFs evaluated using diagnostic tools such as Probability Integral Transform and Odds distribution. We also address the problem of the accessibility of PDFs in terms of disk space storage and the time demand required to generate their corresponding parameters.We present a novel Autoencoder model that reduces the size of PDF parameter arrays to one-sixth of their original length, significantly decreasing the time required for PDF generation to one-eighth of the time needed when generating PDFs directly from the magnitudes.

79 ASTRONOMY AND ASTROPHYSICS↗

Data-Driven Exploration of Climate Attractor Manifolds For Long-Term Predictability

Focal Area: This white paper responds to Focal Area 3. We seek to gain insight into decadal-scale climate predictability by applying novel manifold-finding probabilistic AI techniques to the complex data produced by Earth System models (ESMs) such as E3SM. The associated portfolio of research activities leverages DOE’s asset mix of HPC platforms, climate expertise, climate simulation codes, and AI expertise. Science Challenge: Climate and climate models are dynamical systems exhibiting properties that are interpretable through chaos theory. The theory contains an important concept that is relevant to multi-decade-scale climate prediction: a chaotic attractor. While the space containing all the possible states of the Earth’s atmosphere and ocean, the possible weather, is large, the realized states tend to stay near the smaller-dimensioned attractor. This behavior is responsible for the “order behind the irregularity” [1] of climate phenomena. Climate change can be thought of as a change in the properties of the attractor, and predicting the climate over years to decades is equivalent to predicting how those properties will change. To date, the attractor has been a useful conceptual tool, but has not been amenable to direct characterization. A new development is the advent of efficient high-dimensional manifold-finding probabilistic AI techniques, which permit a data-driven characterization of the ESM attractor and its probability distribution over weather states. Such a characterization would result in a natural dimensional reduction — a “non-linear Principal Components Analysis (PCA) adapted to climate simulation data” — leading to important advances in scenario-based long-term climate prediction, long-term prediction of water cycle extremes, ESM verification, inter-model comparison, and process model development.

54 ENVIRONMENTAL SCIENCES↗

Residential Mobility and Lung Cancer Risk: Data-Driven Exploration Using Internet Sources

Frequent relocation has been linked to health decline, particularly with respect to emotional and psychological wellbeing. In this paper we investigate whether there is an association between frequent relocation and lung cancer risk. For the initial investigation we leverage two online data sources to collect cancer and control subjects using web crawling and tailored text mining. The two data sources share different strengths and weaknesses in terms of the amount of detail, population representation, and sample size. One data source includes online obituaries. The second data source includes augmented LinkedIn profiles. For each data source, the subjects spatiotemporal history is reconstructed from the available information provided in the obituaries and from the education and work experience provided in the LinkedIn profiles. The study shows that lung cancer subjects have higher mobility frequency than the control group. This trend is consistent for both data sources.

Yoon, Hong-Jun↗

Data-driven exploration of the ionization-phonon partitioning in scintillating radiation detector materials

An information-based approach to scintillating materials development has been applied to ranking the alkali halide and alkali earth halide series in terms of their energy conversion efficiency. The efficiency of scintillating radiation detection materials can be viewed as the product of a consecutive series of electronic processes (energy conversion, transfer, and luminescence) as outlined by Lempicki and others. Relevant data are relatively sparse, but sufficient for the development of forward mapping of materials properties through materials signatures. These mappings have been used to explore the limits of the K ratio in the Lempicki model with chemical composition, and examine its relationship with another common design objective, density. The alkali halides and alkali earth halide compounds separate themselves into distinct behavior classes favoring heavier cations and anions for improved K ratio. While the coupling of ionization is strongly related to the optical phonon modes, both dielectric and band gap contributions cannot be ignored. When applied within a candidate screen, the resulting model for K imposes design rules—simple structural restrictions—on scintillating radiation detector materials.

36 MATERIALS SCIENCE↗

CoDA 2014 special issue: Exploring data-focused research across the department of energy: Editorial

Here, this collection of papers, written by researchers at the national labs, in academia, and in industry present real problems, massive and complex datasets, and novel statistical approaches motivated by the challenges presented by experimental and computational science. You'll find explorations of the trajectories of aircraft and of the light curves of supernovae, of computer network intrusions and of nuclear forensics, of photovoltaics and overhead imagery.

97 MATHEMATICS AND COMPUTING↗

Approach to using 3D laser-induced breakdown spectroscopy (LIBS) data to explore the interaction of FLiNaK and FLiBe molten salts with nuclear-grade graphite

Nuclear graphite has historically been a key component of many nuclear reactor designs and has emerged as key to numerous advanced nuclear reactor design concepts. Molten salt reactors (MSRs) are one broad group of advanced reactor designs currently being pursued by industry for commercialization. Several MSR designs under consideration use graphitic materials that directly interface with a molten salt, whether it is a fuel salt, coolant salt, or both. Therefore, the interaction of graphite materials with molten salts must be understood. To gain this required understanding, a range of data is needed including porosity, strength, and composition as a function of different salt exposure parameters. In this study, a laser-induced breakdown spectroscopy (LIBS) measurement and data analysis methodology was developed to obtain spatially resolved elemental composition information for graphite samples exposed to a molten fluoride salt. Traditional univariate emission line analysis of atomic, ionic, and molecular optical emission signals was coupled via correlation analysis with spectral decomposition of the data using principal component analysis. Elemental depth profiling and elemental mapping were also performed to visualize salt–graphite interactions. LIBS was demonstrated to be useful for measuring key analytes such as fluorine and hydrogen, which are troublesome for other analysis techniques. Evidence for complex behavior was found, thereby demonstrating the usefulness of the developed approach for future systematic studies.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Recent Advances in VisIt: AMR Streamlines and Query-Driven Visualization

Adaptive Mesh Refinement (AMR) is a highly effective method for simulations spanning a large range of spatiotemporal scales such as those encountered in astrophysical simulations. Combining research in novel AMR visualization algorithms and basic infrastructure work, the Department of Energy's (DOEs) Science Discovery through Advanced Computing (SciDAC) Visualization and Analytics Center for Enabling Technologies (VACET) has extended VisIt, an open source visualization tool that can handle AMR data without converting it to alternate representations. This paper focuses on two recent advances in the development of VisIt. First, we have developed streamline computation methods that properly handle multi-domain data sets and utilize effectively multiple processors on parallel machines. Furthermore, we are working on streamline calculation methods that consider an AMR hierarchy and detect transitions from a lower resolution patch into a finer patch and improve interpolation at level boundaries. Second, we focus on visualization of large-scale particle data sets. By integrating the DOE Scientific Data Management (SDM) Center's FastBit indexing technology into VisIt, we are able to reduce particle counts effectively by thresholding and by loading only those particles from disk that satisfy the thresholding criteria. Furthermore, using FastBit it becomes possible to compute parallel coordinate views efficiently, thus facilitating interactive data exploration of massive particle data sets.

97 MATHEMATICS AND COMPUTING↗

A Data-Driven Exploration of the Impact of Renewable Energy on Inter-Area Oscillations in the U.S. Eastern Interconnection

As increasing amounts of renewable energy (RE) resources are incorporated into the bulk-power grid, power system oscillations are expected to change. This work investigates how RE generation impacts the frequency and damping ratio (DR) of two dominant inter-area modes in the U.S. Eastern Interconnection (EI) using regularly updated estimates collected over a 12-month period. Quantile regression is used to derive the correlation between operating conditions and mode properties, and a bootstrap method is used to quantify the uncertainty associated with the correlation estimates. Results show that with an increase in system load, the frequency of a mode decreases and DR increases. Evidence that increasing RE generation results in an increase in frequency and decline in DR was found for one of the two modes studied. This work shows that increasing RE levels will impact the properties of inter-area oscillations in the EI, but it does not indicate the presence of immediate threats to grid stability. The outlined approach can be used to periodically assess changing mode properties as RE levels continue to grow and flag stability concerns before they become serious reliability threats.

Inter-area oscillation, mode meters, quantile regr↗