Search NASA⌕ Search

SEARCH · Search NASA

Results for “data discover”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
NASA NTRS2012

NASA Center for Climate Simulation (NCCS) Presentation

The NASA Center for Climate Simulation (NCCS) offers integrated supercomputing, visualization, and data interaction technologies to enhance NASA's weather and climate prediction capabilities. It serves hundreds of users at NASA Goddard Space Flight Center, as well as other NASA centers, laboratories, and universities across the US. Over the past year, NCCS has continued expanding its data-centric computing environment to meet the increasingly data-intensive challenges of climate science. We doubled our Discover supercomputer's peak performance to more than 800 teraflops by adding 7,680 Intel Xeon Sandy Bridge processor-cores and most recently 240 Intel Xeon Phi Many Integrated Core (MIG) co-processors. A supercomputing-class analysis system named Dali gives users rapid access to their data on Discover and high-performance software including the Ultra-scale Visualization Climate Data Analysis Tools (UV-CDAT), with interfaces from user desktops and a 17- by 6-foot visualization wall. NCCS also is exploring highly efficient climate data services and management with a new MapReduce/Hadoop cluster while augmenting its data distribution to the science community. Using NCCS resources, NASA completed its modeling contributions to the Intergovernmental Panel on Climate Change (IPCG) Fifth Assessment Report this summer as part of the ongoing Coupled Modellntercomparison Project Phase 5 (CMIP5). Ensembles of simulations run on Discover reached back to the year 1000 to test model accuracy and projected climate change through the year 2300 based on four different scenarios of greenhouse gases, aerosols, and land use. The data resulting from several thousand IPCC/CMIP5 simulations, as well as a variety of other simulation, reanalysis, and observationdatasets, are available to scientists and decision makers through an enhanced NCCS Earth System Grid Federation Gateway. Worldwide downloads have totaled over 110 terabytes of data.

Webster, William P.↗
DOE OSTI2014

Plenario: An Open Data Discovery and Exploration Platform for Urban Science

The past decade has seen the widespread release of open data concerning city services, conditions, and activities by government bodies and public institutions of all sizes. Hundreds of open data portals now host thousands of datasets of many different types. These new data sources represent enormous po- tential for improved understanding of urban dynamics and processes—and, ultimately, for more livable, efficient, and prosperous communities. However, those who seek to realize this potential quickly discover that discovering and applying those data relevant to any particular question can be extraordinarily dif- ficult, due to decentralized storage, heterogeneous formats, and poor documentation. In this context, we introduce Plenario, a platform designed to automating time-consuming tasks associated with the discovery, exploration, and application of open city data—and, in so doing, reduce barriers to data use for researchers, policymakers, service providers, journalists, and members of the general public. Key innovations include a geospatial data warehouse that allows data from many sources to be registered into a common spatial and temporal frame; simple and intuitive interfaces that permit rapid discovery and exploration of data subsets pertaining to a particular area and time, regardless of type and source; easy export of such data subsets for further analysis; a user-configurable data ingest framework for automated importing and periodic updating of new datasets into the data warehouse; cloud hosting for elastic scaling and rapid creation of new Plenario instances; and an open source implementation to enable community contributions. We describe here the architecture and implementation of the Plenario platform, discuss lessons learned from its use by several communities, and outline plans for future work.

Catlett, Charlie↗
DOE OSTI2022

The L-CAPE Project at FNAL

The controls system at FNAL records data asynchronously from several thousand Linac devices at their respective cadences, ranging from 15Hz down to once per minute. In case of downtimes, current operations are mostly reactive, investigating the cause of an outage and labeling it after the fact. However, as one of the most upstream systems at the FNAL accelerator complex, the Linac’s foreknowledge of an impending downtime as well as its duration could prompt downstream systems to go into standby, potentially leading to energy savings. The goals of the Linac Condition Anomaly Prediction of Emergence (L-CAPE) project that started in late 2020 are (1) to apply data-analytic methods to improve the information that is available to operators in the control room, and (2) to use machine learning to automate the labeling of outage types as they occur and discover patterns in the data that could lead to the prediction of outages. We present an overview of the challenges in dealing with time-series data from 2000+ devices, our approach to developing an ML-based automated outage labeling system, and the status of augmenting operations by identifying the most likely devices predicting an outage.

43 PARTICLE ACCELERATORS↗
NASA NTRS1981

Ambient ammonia measurements using laser photo-acoustic spectroscopy

Ammonia concentrations reached minimal levels (approximately 0.1 ppb) in early winter, followed by a sudden later winter increase. A direct relationship between ambient ammonia levels and air temperature was inferred from the data (linear correlation coefficient r=0.53). Ammonia concentrations were determined to be directly related to the absolute humidity of the air (r=0.72); a weaker relationship between ammonia concentrations and relative humidity was discovered (r=0.37). The data also indicated that ammonia levels were generally higher within continental air masses than those of maritime origin. Soil parameters such as pH and moisture content were found to have a major bearing on the release of gaseous ammonia from soils in the region.

Aldridge, M. D., III↗
DOE OSTI2015

Prior knowledge driven Granger causality analysis on gene regulatory network discovery

Our study focuses on discovering gene regulatory networks from time series gene expression data using the Granger causality (GC) model. However, the number of available time points (T) usually is much smaller than the number of target genes (n) in biological datasets. The widely applied pairwise GC model (PGC) and other regularization strategies can lead to a significant number of false identifications when n>>T. In this study, we proposed a new method, viz., CGC-2SPR (CGC using two-step prior Ridge regularization) to resolve the problem by incorporating prior biological knowledge about a target gene data set. In our simulation experiments, the propose new methodology CGC-2SPR showed significant performance improvement in terms of accuracy over other widely used GC modeling (PGC, Ridge and Lasso) and MI-based (MRNET and ARACNE) methods. In addition, we applied CGC-2SPR to a real biological dataset, i.e., the yeast metabolic cycle, and discovered more true positive edges with CGC-2SPR than with the other existing methods. In our research, we noticed a “ 1+1>2” effect when we combined prior knowledge and gene expression data to discover regulatory networks. Based on causality networks, we made a functional prediction that the Abm1 gene (its functions previously were unknown) might be related to the yeast’s responses to different levels of glucose. In conclusion, our research improves causality modeling by combining heterogeneous knowledge, which is well aligned with the future direction in system biology. Furthermore, we proposed a method of Monte Carlo significance estimation (MCSE) to calculate the edge significances which provide statistical meanings to the discovered causality networks. All of our data and source codes will be available under the link https://bitbucket.org/dtyu/granger-causality/wiki/Home.

60 APPLIED LIFE SCIENCES↗
NASA NTRS1990

Spacecraft studies of Phobos and Mars

Utilizing the Termoskan data set of the Phobos '88 mission we have recognized a new feature on Mars: Ejecta blanket Distinct In the THermal infrared (EDITH). Virtually all of the more than one hundred of these features discovered in the Termoskan data are located on the plains near Valles Manneris. EDITH's have a startlingly clear dependence upon terrains of Hesperian age, implying a spatial or temporal dependence on Hesperian terrains. Almost no thermally distinct ejecta blankets are associated with any of the thousands of craters within the data set that occur on the older Noachian units. EDITH's also do not appear on the portions of the younger Tharsis Amazonian units seen in the data. The Hesperian terrain dependence cannot be explained by either atmospheric or impactor variations; Noachian and Hesperian terrains must have experienced identical atmospheric and impactor conditions during Hesperian times. Thermally distinct eject a blankets therefore reflect target material differences and/or secondary modification processes. A further discussion of EIDTH's is presented.

Murray, Bruce C.↗
NASA NTRS1992

High time resolution studies of binary x ray pulsars

This report covers the period September 1, 1992 through August 1, 1993 for NASA grant NAG 5-1260 through the Astrophysics Data Program (ADP), for the project 'High Time Resolution Studies of Binary X-ray Pulsars'. During the past 11 months, we have concentrated on scientific analysis of the data, and have had to reanalyze several data sets, due to a newly discovered error in the unpacking of the count rate data. This error has now been corrected, but may have caused us to miss some scientific results, so we have gone back and reanalyzed the affected data sets, as well as continuing our analysis of other objects.

Cominsky, Lynn R.↗
NASA NTRS2019

A Web of Data Analytics Services

Cloud Computing has become the ubiquitous approach to our Big Data challenge. However, one will quickly discover that moving (a.k.a. forklifting) existing on-premise data analytics solutions to the Cloud doesn’t always translate to costing saving and performance boost. The Cloud’s elasticity, its availability, and its wide selection of computing options and selections of costing models making Cloud an attractive environment to tackle our Big Data challenge. The fact is Cloud, on its own, is not the silver bullet to our daunting challenge need for analyze and derive scientific inferences through vast collections of multi-sensor measurements. We would like to have all scientific data in one easy to access environment, but getting the world of scientific data in one analytic system is immensely difficult to achieve. This paper describes the data analytics web architecture NASA is developing by infusing instances of Integrated Data Analytics systems next to the data. The goal is to minimize unnecessary data movement through collection of data access and analytics webservices for researchers to interact with and analyze measurements without have to download data to their local computer. These services are RESTful and provisioned by the data centers with the help from subject matter and science experts. These services encapsulate the physical computing infrastructure, which could local computing cluster, on-premise or public Cloud environment.

Huang, Thomas↗
DOE OSTI2021

Topological Hall effect and magnetic states in the Nowotny chimney ladder compound Cr 11 Ge 19

In this report, we have investigated the magnetic and charge transport properties of single crystals of the Nowotny chimney ladder compound Cr 11 Ge 19 and mapped out a comprehensive phase diagram reflecting the complicated interplay between the Dzyaloshinskii-Moriya (DM) interaction, the dipolar interaction, and the magnetic anisotropy. We have identified a set of interesting magnetic phases and attributed a finite topological Hall effect to the recently discovered biskyrmion phase. These data also suggest the existence of an antiskyrmion state at finite fields for temperatures just below the magnetic ordering temperature T c as indicated by a distinct change in sign of the topological Hall effect. Above T c , we discovered a region of enhanced magnetic response corresponding to a disordered phase likely existing near the ferromagnetic critical point under small magnetic fields. Strong spin chirality fluctuations are demonstrated by the large value of the topological Hall resistivity persisting up to 1 T, which is most likely due to the existence of the DM interaction. We argue that changes to the topological Hall effect correspond to different topological spin textures that are controlled by magnetic dipolar and DM interactions that vary in importance with temperature

36 MATERIALS SCIENCE↗
DOE OSTI2016

Global metagenomic survey reveals a new bacterial candidate phylum in geothermal springs

Analysis of the increasing wealth of metagenomic data collected from diverse environments can lead to the discovery of novel branches on the tree of life. Here we analyse 5.2 Tb of metagenomic data collected globally to discover a novel bacterial phylum (' Candidatus Kryptonia') found exclusively in higherature pH-neutral geothermal springs. This lineage had remained hidden as a taxonomic 'blind spot' because of mismatches in the primers commonly used for ribosomal gene surveys. Genome reconstruction from metagenomic data combined with single-cell genomics results in several high-quality genomes representing four genera from the new phylum. Metabolic reconstruction indicates a heterotrophic lifestyle with conspicuous nutritional deficiencies, suggesting the need for metabolic complementarity with other microbes. Co-occurrence patterns identifies a number of putative partners, including an uncultured Armatimonadetes lineage. The discovery of Kryptonia within previously studied geothermal springs underscores the importance of globally sampled metagenomic data in detection of microbial novelty, and highlights the extraordinary diversity of microbial life still awaiting discovery.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1986

Observations of quasi-periodic oscillations from GX 5 - 1 and Cygnus X-2 with the Einstein (HEAO 2) Observatory

The bright galactic bulge X-ray source GX 5 - 1 was observed in April 1979 with the Monitor Proportional Counter on board the Einstein (HEAO 2) Observatory. Analysis of the high time resolution data from the Time Interval Processor confirms the recent Exosat discovery of quasi-periodic oscillations in the X-ray emission from GX 5 - 1. In addition, the summed 0.4 s power spectrum shows the low-frequency red noise component also discovered in the Exosat data. Low-frequency structure is also clearly present in data taken from the bright galaxtic X-ray source Cyg X-2 in December 1978. The expected power spectrum for quasi-periodic oscillations was calculated, including the low-frequency red noise component, using a simple shot noise model with oscillating shots.

Elsner, R. F.↗
DOE OSTI2023

Advanced Visualization for Scientific Data Analysis and Insight [Slides]

This talk will explore how we have used advanced visualization technologies to support analytical reasoning and knowledge discovery. Specifically, we will present several examples detailing some recent scientific successes using state-of-the-art immersive and high-resolution visualization at the National Renewable Energy Laboratory's Computational Science Center. On multiple occasions, we have observed scientists and engineers discover features in their data using advanced visualization technologies that they had not seen in prior investigations of their data on traditional desktop displays. We have embedded more information into our analytics tools, allowing engineers to explore complex multivariate spaces. We have observed how interactions seem to catalyze understanding.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Research challenges and directions in HVAC fault prevalence

This study provides a review of the current state of knowledge, gaps, and potential value in research on the prevalence of faults in commercial buildings. Two separate efforts were made in this study: (1) we performed a literature review to determine the extent of currently available fault prevalence data for heating, ventilation, and air-conditioning (HVAC) systems, and (2) we conducted dozens of interviews with subject matter experts and stakeholders to determine the HVAC fault data that would be of greatest value. Through the literature review and interviews, we discovered unmet needs for empirical data on the prevalence of faults at the desired level of granularity, consistency, and scale; this lack of data leads us to recommend future work studying commercial buildings’ HVAC fault prevalence, with robust fault taxonomy and a variety of meaningful fault prevalence metrics.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2017

Final Report: Sampling-Based Algorithms for Estimating Structure in Big Data.

The purpose of this project was to develop sampling-based algorithms to discover hidden struc- ture in massive data sets. Inferring structure in large data sets is an increasingly common task in many critical national security applications. These data sets come from myriad sources, such as network traffic, sensor data, and data generated by large-scale simulations. They are often so large that traditional data mining techniques are time consuming or even infeasible. To address this problem, we focus on a class of algorithms that do not compute an exact answer, but instead use sampling to compute an approximate answer using fewer resources. The particular class of algorithms that we focus on are streaming algorithms , so called because they are designed to handle high-throughput streams of data. Streaming algorithms have only a small amount of working storage - much less than the size of the full data stream - so they must necessarily use sampling to approximate the correct answer. We present two results: * A streaming algorithm called HyperHeadTail , that estimates the degree distribution of a graph (i.e., the distribution of the number of connections for each node in a network). The degree distribution is a fundamental graph property, but prior work on estimating the degree distribution in a streaming setting was impractical for many real-world application. We improve upon prior work by developing an algorithm that can handle streams with repeated edges, and graph structures that evolve over time. * An algorithm for the task of maintaining a weighted subsample of items in a stream, when the items must be sampled according to their weight, and the weights are dynamically changing. To our knowledge, this is the first such algorithm designed for dynamically evolving weights. We expect it may be useful as a building block for other streaming algorithms on dynamic data sets.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Evaluating State Space Discovery by Persistent Cohomology in the Spatial Representation System

Persistent cohomology is a powerful technique for discovering topological structure in data. Strategies for its use in neuroscience are still undergoing development. We comprehensively and rigorously assess its performance in simulated neural recordings of the brain's spatial representation system. Grid, head direction, and conjunctive cell populations each span low-dimensional topological structures embedded in high-dimensional neural activity space. We evaluate the ability for persistent cohomology to discover these structures for different dataset dimensions, variations in spatial tuning, and forms of noise. We quantify its ability to decode simulated animal trajectories contained within these topological structures. We also identify regimes under which mixtures of populations form product topologies that can be detected. Our results reveal how dataset parameters affect the success of topological discovery and suggest principles for applying persistent cohomology, as well as persistent homology, to experimental neural recordings.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRSDate not supplied

Developing a Vision for Heliophysics Infrastructure: The LIKED Resource and the DIARieS Ecosystem

Heliophysics data and computational infrastracture are not equipped for 21st science, suffering from holes in the know-how to build better systems. Without a clear vision, efforts to improve the infrastructure have been incremental and incoherent. This poster presents both the vision and the technology required: an online LIbrary KnowledgE and Discovery (LIKED) resource for discovering and implementing knowledge, data, and infrastructure resources; and an online analysis ecosystem to simplify Discovery, Implementation, Analysis, Reproducibility, and Sharing (DIARieS) of scientific results and environments. The LIKED and DIARieS solutions adopt FAIR data principles and the best practices from the budding field of open science. The proposed new infrastructure components will close many of the current gaps in heliophysics’ infrastructure, such as the ability to search for data and knowledge by phenomenon across domains, and to find software and examples relevant to the desired data set (including model data). Further, these components will enable community members to more efficiently use the resources already present and improve upon the content via a community-curated and trusted library. Combining these solutions lowers the barriers to heliophysics resources for all, increasing the return on our investments. Finally, the structure behind these ideas are topic-agnostic, so they are fully extensible to other fields, leading to invaluable connections to other disciplines. Just as with the development and construction of a long-term satellite mission, we must work together as a community to build a vision of the infrastructure that will most benefit the community, and then collaborate to construct, assemble, and test all the necessary pieces individually and as a unit. Our purpose in presenting this work is to not only describe the proposed vision, but also to gather feedback from the community on this topic.

infrastructure↗