Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data exploration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Link Winds: A visual data analysis system and its application to the atmospheric ozone depletion problem

The Linked Windows Interactive Data System (LinkWinds) is a prototype visual data exploration system resulting from a NASA Jet Propulsion Laboratory (JPL) program of research into the application of graphical methods for rapidly accessing, displaying, and analyzing large multi variate multidisciplinary data sets. Running under UNIX it is an integrated multi-application executing environment using a data-linking paradigm to dynamically interconnect and control multiple windows containing a variety of displays and manipulators. This paradigm, resulting in a system similar to a graphical spreadsheet, is not only a powerful method for organizing large amounts of data for analysis, but leads to a highly intuitive, easy-to-learn user interface. It provides great flexibility in rapidly interacting with large masses of complex data to detect trends, correlations, and anomalies. The system, containing an expanding suite of non-domain-specific applications, provides for the ingestion of a variety of data base formats and hard -copy output of all displays. Remote networked workstations running LinkWinds may be interconnected, providing a multiuser science environment (MUSE) for collaborative data exploration by a distributed science team. The system is being developed in close collaboration with investigators in a variety of science disciplines using both archived and real-time data. It is currently being used to support the Microwave Limb Sounder (MLS) in orbit aboard the Upper Atmosphere Research Satellite (UARS). This paper describes the application of LinkWinds to this data to rapidly detect features, such as the ozone hole configuration, and to analyze correlations between chemical constituents of the atmosphere.

Jacobson, Allan S.↗

A probabilistic application of oil and gas data for exploration stage geothermal reservoir assessment in the Appalachian Basin

Geothermal energy is a renewable, widespread, baseload energy source that has the potential to supply a large portion of the world’s energy needs. High development risk, specifically high drilling costs combined with uncertainty in subsurface flow properties, have hampered growth of geothermal energy development. One option to reduce subsurface risk is to target locations where reservoir data are already available, including sedimentary basins where there has been extensive hydrocarbon production. Sedimentary basins are widespread and often have suitable geothermal gradients. This chapter presents a low-cost methodology that can be used at the pre-drilling exploration phase of a low-temperature geothermal project to predict the location of high-productivity and low-risk reservoirs, applied to a case study of the Appalachian Basin in the eastern United States. Because only averaged reservoir data were available for analysis, the technique uses a Monte Carlo simulation of the Reservoir Flow Capacity (RFC) and Reservoir Productivity Index (RPI) for over 1800 individual reservoirs, using liquid water or supercritical carbon dioxide (sCO 2 ) as the reservoir fluid. RFC is used as an initial screening tool to identify high-priority geologic formations and reservoirs. Here our results indicate that 99% of the reservoirs in the basin are of insufficient quality for geothermal heat production with water as the assumed fluid and without using stimulation technologies associated with Enhanced Geothermal Systems (EGS). RPI is also used as an alternative metric to identify high-productivity reservoirs. When comparing the RPI results to natural gas production volumes from several selected reservoirs, the predicted RPI proves to be a good estimate of flow potential for porous reservoirs, but overestimates flow by a factor of three for fractured or vuggy reservoirs. A greater uncertainty ought to be utilized when applying the RPI equation to non-porous media, therefore we recommend utilizing the RPI metric when higher resolution data are available for analysis. This methodology can be utilized in other basins that have experienced hydrocarbon exploration and production, to highlight low-risk reservoirs or geologic formations for further geothermal development.

15 GEOTHERMAL ENERGY↗

Photometric redshifts probability density estimation from recurrent neural networks in the DECam local volume exploration survey data release 2

Photometric wide-field surveys are imaging the sky in unprecedented detail. These surveys face a significant challenge in efficiently estimating galactic photometric redshifts while accurately quantifying associated uncertainties. In this work, we address this challenge by exploring the estimation of Probability Density Functions (PDFs) for the photometric redshifts of galaxies across a vast area of 17,000 square degrees, encompassing objects with a median 5 σ point-source depth of g = 24.3, r = 23 . 9 , i = 23.5, and z = 22.8 mag. Our approach uses deep learning, specifically integrating a Recurrent Neural Network architecture with a Mixture Density Network, to leverage magnitudes and colors as input features for constructing photometric redshift PDFs across the whole DECam Local Volume Exploration (DELVE) survey sky footprint. Subsequently, we rigorously evaluate the reliability and robustness of our estimation methodology, gauging its performance against other well-established machine learning methods to ensure the quality of our redshift estimations. Our best results constrain photometric redshifts with the bias of − 0 . 0013 , a scatter of 0.0293, and an outlier fraction of 5.1%. These point estimates are accompanied by well-calibrated PDFs evaluated using diagnostic tools such as Probability Integral Transform and Odds distribution. We also address the problem of the accessibility of PDFs in terms of disk space storage and the time demand required to generate their corresponding parameters.We present a novel Autoencoder model that reduces the size of PDF parameter arrays to one-sixth of their original length, significantly decreasing the time required for PDF generation to one-eighth of the time needed when generating PDFs directly from the magnitudes.

79 ASTRONOMY AND ASTROPHYSICS↗

Data-Driven Exploration of Climate Attractor Manifolds For Long-Term Predictability

Focal Area: This white paper responds to Focal Area 3. We seek to gain insight into decadal-scale climate predictability by applying novel manifold-finding probabilistic AI techniques to the complex data produced by Earth System models (ESMs) such as E3SM. The associated portfolio of research activities leverages DOE’s asset mix of HPC platforms, climate expertise, climate simulation codes, and AI expertise. Science Challenge: Climate and climate models are dynamical systems exhibiting properties that are interpretable through chaos theory. The theory contains an important concept that is relevant to multi-decade-scale climate prediction: a chaotic attractor. While the space containing all the possible states of the Earth’s atmosphere and ocean, the possible weather, is large, the realized states tend to stay near the smaller-dimensioned attractor. This behavior is responsible for the “order behind the irregularity” [1] of climate phenomena. Climate change can be thought of as a change in the properties of the attractor, and predicting the climate over years to decades is equivalent to predicting how those properties will change. To date, the attractor has been a useful conceptual tool, but has not been amenable to direct characterization. A new development is the advent of efficient high-dimensional manifold-finding probabilistic AI techniques, which permit a data-driven characterization of the ESM attractor and its probability distribution over weather states. Such a characterization would result in a natural dimensional reduction — a “non-linear Principal Components Analysis (PCA) adapted to climate simulation data” — leading to important advances in scenario-based long-term climate prediction, long-term prediction of water cycle extremes, ESM verification, inter-model comparison, and process model development.

54 ENVIRONMENTAL SCIENCES↗

Residential Mobility and Lung Cancer Risk: Data-Driven Exploration Using Internet Sources

Frequent relocation has been linked to health decline, particularly with respect to emotional and psychological wellbeing. In this paper we investigate whether there is an association between frequent relocation and lung cancer risk. For the initial investigation we leverage two online data sources to collect cancer and control subjects using web crawling and tailored text mining. The two data sources share different strengths and weaknesses in terms of the amount of detail, population representation, and sample size. One data source includes online obituaries. The second data source includes augmented LinkedIn profiles. For each data source, the subjects spatiotemporal history is reconstructed from the available information provided in the obituaries and from the education and work experience provided in the LinkedIn profiles. The study shows that lung cancer subjects have higher mobility frequency than the control group. This trend is consistent for both data sources.

Yoon, Hong-Jun↗

CoDA 2014 special issue: Exploring data-focused research across the department of energy: Editorial

Here, this collection of papers, written by researchers at the national labs, in academia, and in industry present real problems, massive and complex datasets, and novel statistical approaches motivated by the challenges presented by experimental and computational science. You'll find explorations of the trajectories of aircraft and of the light curves of supernovae, of computer network intrusions and of nuclear forensics, of photovoltaics and overhead imagery.

97 MATHEMATICS AND COMPUTING↗

Investigation of the diffuse ultraviolet background using satellite data: Dynamics explorer guest investigator program

The imaging instrumentation for the Dynamics Explorer Mission was designed primarily to obtain global auroral images. The instrument, however, was also used successfully to study marine bioluminescence, the geocorona, and the global distribution of atmospheric ozone. The imager has considerable potential for the study of astronomical sources of ultraviolet radiation as well. The data produced by the imager is used to study the brightness and isotrophy of the diffuse ultraviolet background.

Fix, J. D.↗

Investigation of the magnetospheric boundary plasma and magnetic field data from Explorers 33, 43, and 50

Understanding of the plasma depletion process in the dayside magnetosheath, the nature of magnetotail boundary motion, and the geometry of the magnetospheric boundary layers was examined. A model of the dayside boundary layers, based on the hypothesis that merging occurs only for strictly anitparallel fields was developed which provides a qualitative solution to the problem of the half-wave rectifier response of the magnetosphere to the solar wind electric field. Regarding magnetotail boundary motion, consideration of the data led to the conclusion that at lunar distance, substorms are associated with very large amplitude compressional wave motion of the sausage type. A study of IMF orientation for depletion and nondepletion cases suggests that depletion is most likely to occur for angles between the IMF and the normal to the magnetopause at the measurement location near 90 deg, in agreement with predictions. Observations of the heat flux in the dayside magnetosheath plasma suggest that the energized plasma ions have their source along a given flux tube at that intersection with the bow shock where the magnetic field is most compressed.

Siscoe, G. L.↗

Data Interconnection Exploration

This project involves innovating the way the Quality Assurance organization at the Jet Propulsion Laboratory (JPL) tracks the receiving inspection of JPL Critical Items (JCI) procured from suppliers. The Quality Assurance organization uses a Microsoft Access based front-end to enter items into an inspection queue. The current design has grown to be much more than was expected when the inspection queue system was created in 2007. The goal is to migrate to a web based solution that will allow the handling of more data, multiple input interfaces, and customizable display options. This has been achieved by implementing a divided tables scheme, the use of ColdFusion programming language, and the usage of Web 2.0 technologies such as AJAX and jQuery. These updates will allow for future expansion as well as the standardization of inspection queues for the Quality Assurance organization. When engineers and scientists order flight hardware, they cannot use it straight away. After a spacecraft or a satellite has been launched, it will be impossible to repair; therefore, the parts used must be inspected to make sure they are operating correctly and within the required specifications. The task of inspecting these JPL Critical Items (JCI) falls on the Quality Assurance organization. One of the tools the receiving inspection group uses is a database to maintain a queue of inspections that need to be done and of inspections that have been completed. The current Access interface has worked well but increased amounts of data, multiple input interfaces, and changes to how data is handled have made it necessary to seek a new way of organizing items for inspection. In addition, the different inspection groups have recently been merged and each has different ways of keeping track of inspection information. The ultimate goal is for the new group to have one shared inspection queue and website. To achieve this goal, I have been working with Ian Luczon of Procurement Quality Assurance and 3 Myers Hawkins, another intern, to not only create the new queue for receiving inspection but also a central web portal for the newly combined inspection group.

flight hardware↗

Approach to using 3D laser-induced breakdown spectroscopy (LIBS) data to explore the interaction of FLiNaK and FLiBe molten salts with nuclear-grade graphite

Nuclear graphite has historically been a key component of many nuclear reactor designs and has emerged as key to numerous advanced nuclear reactor design concepts. Molten salt reactors (MSRs) are one broad group of advanced reactor designs currently being pursued by industry for commercialization. Several MSR designs under consideration use graphitic materials that directly interface with a molten salt, whether it is a fuel salt, coolant salt, or both. Therefore, the interaction of graphite materials with molten salts must be understood. To gain this required understanding, a range of data is needed including porosity, strength, and composition as a function of different salt exposure parameters. In this study, a laser-induced breakdown spectroscopy (LIBS) measurement and data analysis methodology was developed to obtain spatially resolved elemental composition information for graphite samples exposed to a molten fluoride salt. Traditional univariate emission line analysis of atomic, ionic, and molecular optical emission signals was coupled via correlation analysis with spectral decomposition of the data using principal component analysis. Elemental depth profiling and elemental mapping were also performed to visualize salt–graphite interactions. LIBS was demonstrated to be useful for measuring key analytes such as fluorine and hydrogen, which are troublesome for other analysis techniques. Evidence for complex behavior was found, thereby demonstrating the usefulness of the developed approach for future systematic studies.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Scraping Unstructured Data to Explore the Relationship between Rainfall Anomalies and Vector-Borne Disease Outbreaks

According to the World Health Organization (WHO), vector-borne diseases such as malaria and dengue account for 17% of all infectious disease cases and lead to more than 700,000 deaths per year. Tracking and predicting the spread of vector-borne diseases is a vital task that could save hundreds of thousands of lives annually. Oftentimes, the first reports of vector-borne disease outbreaks occur through emails and online reporting systems long before they are officially documented. Tracking and predicting the emergence and spread of vector-borne disease outbreaks requires extracting data from these unstructured sources in combination with historical weather and climate data to understand the underlying background triggers and disease dynamics. In this work, we develop a data extraction pipeline for the online outbreak reporting website ProMED-mail that utilizes a web scraper, transformer neural network summarizer, and named entity recognizer to obtain a dataset of malaria, dengue, zika, and chikungunya outbreaks over the last 30 years. This scraped dataset was further analyzed in association with global rainfall anomalies derived from NASA’s Integrated Multi-satellitE Retrievals for GPM [Global Precipitation Mission] (IMERG) dataset. This preliminary analysis was to understand the effect of global rainfall patterns on the spread of vector-borne diseases. Analysis of the ProMED-mail and GPM data shows that vector-borne disease outbreaks are clustered towards the tropics and outbreaks are often amplified during the rainy seasons. Our scraped dataset can be a valuable tool in creating comprehensive georeferenced disease records for modeling and predicting future outbreaks.

Web scraping↗

Further evidence of a latitude gradient in the solar wind velocity

Simultaneous Mariner and Explorer data are used in the present paper to show that the large-scale gradient in the bulk velocity of the solar wind observed by Coles (1972) is a heliographic latitude gradient. A value of roughly 15 km/sec/deg for the gradient is derived by a correlation technique employed by Coleman and Rosenberg (1971). A simple model of the velocity/latitude dependence is developed and is shown to be consistent with a direct comparison of the observed Mariner and Explorer velocities. The gradient inferred from the Mariner and Explorer data is compared with values obtained from corresponding analyses of Vela and IPS data.

Rhodes, E. J., Jr.↗

Recent Advances in VisIt: AMR Streamlines and Query-Driven Visualization

Adaptive Mesh Refinement (AMR) is a highly effective method for simulations spanning a large range of spatiotemporal scales such as those encountered in astrophysical simulations. Combining research in novel AMR visualization algorithms and basic infrastructure work, the Department of Energy's (DOEs) Science Discovery through Advanced Computing (SciDAC) Visualization and Analytics Center for Enabling Technologies (VACET) has extended VisIt, an open source visualization tool that can handle AMR data without converting it to alternate representations. This paper focuses on two recent advances in the development of VisIt. First, we have developed streamline computation methods that properly handle multi-domain data sets and utilize effectively multiple processors on parallel machines. Furthermore, we are working on streamline calculation methods that consider an AMR hierarchy and detect transitions from a lower resolution patch into a finer patch and improve interpolation at level boundaries. Second, we focus on visualization of large-scale particle data sets. By integrating the DOE Scientific Data Management (SDM) Center's FastBit indexing technology into VisIt, we are able to reduce particle counts effectively by thresholding and by loading only those particles from disk that satisfy the thresholding criteria. Furthermore, using FastBit it becomes possible to compute parallel coordinate views efficiently, thus facilitating interactive data exploration of massive particle data sets.

97 MATHEMATICS AND COMPUTING↗

A Data-Driven Exploration of the Impact of Renewable Energy on Inter-Area Oscillations in the U.S. Eastern Interconnection

As increasing amounts of renewable energy (RE) resources are incorporated into the bulk-power grid, power system oscillations are expected to change. This work investigates how RE generation impacts the frequency and damping ratio (DR) of two dominant inter-area modes in the U.S. Eastern Interconnection (EI) using regularly updated estimates collected over a 12-month period. Quantile regression is used to derive the correlation between operating conditions and mode properties, and a bootstrap method is used to quantify the uncertainty associated with the correlation estimates. Results show that with an increase in system load, the frequency of a mode decreases and DR increases. Evidence that increasing RE generation results in an increase in frequency and decline in DR was found for one of the two modes studied. This work shows that increasing RE levels will impact the properties of inter-area oscillations in the EI, but it does not indicate the presence of immediate threats to grid stability. The outlined approach can be used to periodically assess changing mode properties as RE levels continue to grow and flag stability concerns before they become serious reliability threats.

Inter-area oscillation, mode meters, quantile regr↗