Search NASA⌕ Search

SEARCH · Search NASA

Results for “data discover”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

A non-cooperative meta-modeling game for automated third-party calibrating, validating and falsifying constitutive laws with parallelized adversarial attacks

The evaluation of constitutive models, especially for high-risk and high-regret engineering applications, requires efficient and rigorous third-party calibration, validation and falsification. While there are numerous efforts to develop paradigms and standard procedures to validate models, difficulties may arise due to the sequential, manual, and often biased nature of the commonly adopted calibration and validation processes, thus slowing down data collections, hampering the progress towards discovering new physics, increasing expenses and possibly leading to misinterpretations of the credibility and application ranges of proposed models. This work attempts to introduce concepts from game theory and machine learning techniques to overcome many of these existing difficulties. Here, we introduce an automated meta-modeling game where two competing AI agents systematically generate experimental data to calibrate a given constitutive model and to explore its weakness such that the experiment design and model robustness can be improved through competitions. The two agents automatically search for the Nash equilibrium of the meta-modeling game in an adversarial reinforcement learning framework without human intervention. In particular, a protagonist agent seeks to find the more effective ways to generate data for model calibrations, while an adversary agent tries to find the most devastating test scenarios that expose the weaknesses of the constitutive model calibrated by the protagonist. By capturing all possible design options of the laboratory experiments into a single decision tree, we recast the design of experiments as a game of combinatorial moves that can be resolved through deep reinforcement learning by the two competing players. Our adversarial framework emulates idealized scientific collaborations and competitions among researchers to achieve a better understanding of the application range of the learned material laws and prevent misinterpretations caused by conventional AI-based third-party validation. Numerical examples are given to demonstrate the wide applicability of the proposed meta-modeling game with adversarial attacks on both human-crafted constitutive models and machine learning models.

97 MATHEMATICS AND COMPUTING↗

Processing and Managing the Kepler Mission's Treasure Trove of Stellar and Exoplanet Data

The Kepler telescope launched into orbit in March 2009, initiating NASAs first mission to discover Earth-size planets orbiting Sun-like stars. Kepler simultaneously collected data for 160,000 target stars at a time over its four-year mission, identifying over 4700 planet candidates, 2300 confirmed or validated planets, and over 2100 eclipsing binaries. While Kepler was designed to discover exoplanets, the long term, ultra- high photometric precision measurements it achieved made it a premier observational facility for stellar astrophysics, especially in the field of asteroseismology, and for variable stars, such as RR Lyraes. The Kepler Science Operations Center (SOC) was developed at NASA Ames Research Center to process the data acquired by Kepler from pixel-level calibrations all the way to identifying transiting planet signatures and subjecting them to a suite of diagnostic tests to establish or break confidence in their planetary nature. Detecting small, rocky planets transiting Sun-like stars presents a variety of daunting challenges, from achieving an unprecedented photometric precision of 20 parts per million (ppm) on 6.5-hour timescales, supporting the science operations, management, processing, and repeated reprocessing of the accumulating data stream. This paper describes how the design of the SOC meets these varied challenges, discusses the architecture of the SOC and how the SOC pipeline is operated and is run on the NAS Pleiades supercomputer, and summarizes the most important pipeline features addressing the multiple computational, image and signal processing challenges posed by Kepler.

high performance computing↗

Evolution of Web Services in EOSDIS: Search and Order Metadata Registry (ECHO)

During 2005 through 2008, NASA defined and implemented a major evolutionary change in it Earth Observing system Data and Information System (EOSDIS) to modernize its capabilities. This implementation was based on a vision for 2015 developed during 2005. The EOSDIS 2015 Vision emphasizes increased end-to-end data system efficiency and operability; increased data usability; improved support for end users; and decreased operations costs. One key feature of the Evolution plan was achieving higher operational maturity (ingest, reconciliation, search and order, performance, error handling) for the NASA s Earth Observing System Clearinghouse (ECHO). The ECHO system is an operational metadata registry through which the scientific community can easily discover and exchange NASA's Earth science data and services. ECHO contains metadata for 2,726 data collections comprising over 87 million individual data granules and 34 million browse images, consisting of NASA s EOSDIS Data Centers and the United States Geological Survey's Landsat Project holdings. ECHO is a middleware component based on a Service Oriented Architecture (SOA). The system is comprised of a set of infrastructure services that enable the fundamental SOA functions: publish, discover, and access Earth science resources. It also provides additional services such as user management, data access control, and order management. The ECHO system has a data registry and a services registry. The data registry enables organizations to publish EOS and other Earth-science related data holdings to a common metadata model. These holdings are described through metadata in terms of datasets (types of data) and granules (specific data items of those types). ECHO also supports browse images, which provide a visual representation of the data. The published metadata can be mapped to and from existing standards (e.g., FGDC, ISO 19115). With ECHO, users can find the metadata stored in the data registry and then access the data either directly online or through a brokered order to the data archive organization. ECHO stores metadata from a variety of science disciplines and domains, including Climate Variability and Change, Carbon Cycle and Ecosystems, Earth Surface and Interior, Atmospheric Composition, Weather, and Water and Energy Cycle. ECHO also has a services registry for community-developed search services and data services. ECHO provides a platform for the publication, discovery, understanding and access to NASA s Earth Observation resources (data, service and clients). In their native state, these data, service and client resources are not necessarily targeted for use beyond their original mission. However, with the proper interoperability mechanisms, users of these resources can expand their value, by accessing, combining and applying them in unforeseen ways.

Mitchell, Andrew↗

Tensor Analysis Methods for Activity Characterization in Spatiotemporal Data

Tensor (multiway array) factorization and decomposition offers unique advantages for activity characterization in spatio-temporal datasets because these methods are compatible with sparse matrices and maintain multiway structure that is otherwise lost in collapsing for regular matrix factorization. This report describes our research as part of the PANTHER LDRD Grand Challenge to develop a foundational basis of mathematical techniques and visualizations that enable unsophisticated users (e.g. users who are not steeped in the mathematical details of matrix algebra and mulitway computations) to discover hidden patterns in large spatiotemporal data sets.

97 MATHEMATICS AND COMPUTING↗

Data Mining of NASA Boeing 737 Flight Data: Frequency Analysis of In-Flight Recorded Data

Data recorded during flights of the NASA Trailblazer Boeing 737 have been analyzed to ascertain the presence of aircraft structural responses from various excitations such as the engine, aerodynamic effects, wind gusts, and control system operations. The NASA Trailblazer Boeing 737 was chosen as a focus of the study because of a large quantity of its flight data records. The goal of this study was to determine if any aircraft structural characteristics could be identified from flight data collected for measuring non-structural phenomena. A number of such data were examined for spatial and frequency correlation as a means of discovering hidden knowledge of the dynamic behavior of the aircraft. Data recorded from on-board dynamic sensors over a range of flight conditions showed consistently appearing frequencies. Those frequencies were attributed to aircraft structural vibrations.

Butterfield, Ansel J.↗

Studying the Ultraviolet Spectrum of the First Spectroscopically Confirmed Supernova at redshift two

Here, we present observations of DES16C2nm, the first spectroscopically confirmed hydrogen-free superluminous supernova (SLSN-I) at redshift z~2. DES16C2nm was discovered by the Dark Energy Survey (DES) Supernova Program, with follow-up photometric data from the Hubble Space Telescope , Gemini, and the European Southern Observatory Very Large Telescope supplementing the DES data. Spectroscopic observations confirm DES16C2nm to be at z=1.998, and spectroscopically similar to Gaia16apd (a SLSN-I at z=0.102), with a peak absolute magnitude of U=-22.26$\pm$0.06. The high redshift of DES16C2nm provides a unique opportunity to study the ultraviolet (UV) properties of SLSNe-I. Combining DES16C2nm with ten similar events from the literature, we show that there exists a homogeneous class of SLSNe-I in the UV (~2500A), with peak luminosities in the (rest-frame) U band, and increasing absorption to shorter wavelengths. There is no evidence that the mean photometric and spectroscopic properties of SLSNe-I differ between low (z<1) and high redshift (z>1), but there is clear evidence of diversity in the spectrum at <2000A, possibly caused by the variations in temperature between events. No significant correlations are observed between spectral line velocities and photometric luminosity. Using these data, we estimate that SLSNe-I can be discovered to z=3.8 by DES. While SLSNe-I are typically identified from their blue observed colors at low redshift (z<1), we highlight that at z>2 these events appear optically red, peaking in the observer-frame z-band. Such characteristics are critical to identify these objects with future facilities such as the Large Synoptic Survey Telescope, Euclid, and the Wide-Field Infrared Survey Telescope , which should detect such SLSNe-I to z=3.5, 3.7, and 6.6, respectively.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA GES DISC New Data Service and Data Management for the Air Quality Community

President Obama's Big Data Research and Development Initiative seeks to improve our ability to acquire knowledge and discover insights into large and complex collections of digital data. The Big Earth Data Initiative (BEDI) Invests in standardizing and optimizing the collection, management and delivery of U.S. Government's civil Earth observation data.

air pollution↗

Web-Based Geographic Information System Tool for Accessing Hanford Site Environmental Data

Data volume, complexity, and access issues pose severe challenges for analysts, regulators and stakeholders attempting to efficiently use legacy data to support decision making at the U.S. Department of Energy’s (DOE) Hanford Site. DOE has partnered with the Pacific Northwest National Laboratory (PNNL) on the PHOENIX (PNNL-Hanford Online Environmental Information System) project, which seeks to address data access, transparency, and integration challenges at Hanford to provide effective decision support. PHOENIX is a family of spatially-enabled web applications providing quick access to decades of valuable scientific data and insight through intuitive query, visualization, and analysis tools. PHOENIX realizes broad, public accessibility by relying only on ubiquitous web-browsers, eliminating the need for specialized software. It accommodates a wide range of users with intuitive user interfaces that require little or no training to quickly obtain and visualize data. Currently, PHOENIX is actively hosting three applications focused on groundwater monitoring, groundwater clean-up performance reporting, and in-tank monitoring. PHOENIX-based applications are being used to streamline investigative and analytical processes at Hanford, saving time and money. But more importantly, by integrating previously isolated datasets and developing relevant visualization and analysis tools, PHOENIX applications are enabling DOE to discover new correlations hidden in legacy data, allowing them to more effectively address complex issues at Hanford.

decision support↗

Process Mining in Healthcare - A Case Study for the Corporate Data Warehouse of the Veterans Affairs Office

Researchers at Oak Ridge National Laboratory are working with the Veteran’s Affairs Administration Office (VA) on a series of studies having the objective of detecting harmful anomalies (i.e., hazards) in VA health information technology systems using its Corporate Data Warehouse (CDW). This progress report describes an ORNL study focused on applying a process mining methodology to that CDW database. In the approach presented herein, process mining methodology is combined with additional software tools, metrics, and filters to permit a quick examination of large volumes of data to address specific research questions. In this work, a case study is presented in which the performance of the combined ORNL approach is evaluated by applying it to the CDW database. We performed an evidence-based study to effectively identify process models and to define metrics of frequency and performance for four health care domains: Consults, Radiology, Laboratory, and Outpatient Medication (RxOut) orders. Additionally, we classified the termination classes of the different cases by mapping to the OASIS Human Task Specification standard. We demonstrated, via process mining, that extracted raw data can aid the understanding of the flow of information in different clinical order processes. We showed that using the stepby- step approach described herein to discover processes in raw electronic health record data can be extremely effective in revealing irregular state transitions in the data and understanding clinical order information flows that are not apparent in analyzing the CDW as it is, without feature extraction.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Expert system shell to reason on large amounts of data

The current data base management systems (DBMS's) do not provide a sophisticated environment to develop rule based expert systems applications. Some of the new DBMS's come with some sort of rule mechanism; these are active and deductive database systems. However, both of these are not featured enough to support full implementation based on rules. On the other hand, current expert system shells do not provide any link with external databases. That is, all the data are kept in the system working memory. Such working memory is maintained in main memory. For some applications the reduced size of the available working memory could represent a constraint for the development. Typically these are applications which require reasoning on huge amounts of data. All these data do not fit into the computer main memory. Moreover, in some cases these data can be already available in some database systems and continuously updated while the expert system is running. This paper proposes an architecture which employs knowledge discovering techniques to reduce the amount of data to be stored in the main memory; in this architecture a standard DBMS is coupled with a rule-based language. The data are stored into the DBMS. An interface between the two systems is responsible for inducing knowledge from the set of relations. Such induced knowledge is then transferred to the rule-based language working memory.

Giuffrida, Gionanni↗

DESI Strong Lens Foundry. III. Keck Spectroscopy for Strong Lenses Discovered Using Residual Neural Networks

We present spectroscopic data of strong lenses and their source galaxies using the Keck Near-Infrared Echellette Spectrometer (NIRES) and the Dark Energy Spectroscopic Instrument (DESI), providing redshifts necessary for nearly all strong-lensing applications with these systems, especially the extraction of physical parameters from lensing modeling. These strong lenses were found in the DESI Legacy Imaging Surveys using residual neural networks and followed up by our Hubble Space Telescope program, with all systems displaying unambiguous lensed arcs. With NIRES, we target eight lensed sources at redshifts difficult to measure in the optical range and determine the source redshifts for six, between z s = 1.675 and 3.332. DESI observed one of the remaining source redshifts, as well as an additional source redshift within the six systems. The two systems with nondetections by NIRES were observed for a considerably shorter 600 s at high airmass. Combining NIRES infrared spectroscopy with optical spectroscopy from our DESI Strong Lensing Secondary Target Program, these results provide the complete lens and source redshifts for six systems, a resource for refining automated strong lens searches in future deep- and wide-field imaging surveys and addressing a range of questions in astrophysics and cosmology.

Agarwal, Shrihan [University of Chicago, IL (Unite↗

World Spatiotemporal Analytics and Mapping Project (WSTAMP): Discovering, Exploring, and Mapping Spatiotemporal Patterns across the World’s Largest Open Source Geographic Data Sets

The application of spatiotemporal (ST) analytics to integrated data from major sources such as the World Bank, United Nations, and dozens of others holds tremendous potential for shedding new light on the evolution of cultural, health, economic, and geopolitical landscapes on a global level. Realizing this potential first requires an ST data model that addresses challenges in properly merging data from multiple authors, with evolving ontological perspectives, semantical differences, and changing attributes, as well as content that is textual, numeric, categorical, and hierarchical. Equally challenging is the development of analytical and visualization approaches that provide a serious exploration of this integrated data while remaining accessible to practitioners with varied backgrounds. The WSTAMP project at Oak Ridge National Laboratory has yielded two major results in addressing these challenges: 1) development of the WSTAMP database, a significant advance in ST data modeling that integrates 10,000+ attributes covering over 200 nation states spanning over 50 years from over 30 major sources and 2) a novel online ST exploratory and analysis tool providing an array of modern statistical and visualization techniques for analyzing these data temporally, spatially, and spatiotemporally under a standard analytic workflow. We discuss the status of this work and report on major findings.Acknowledgment Prepared by Oak Ridge National Laboratory, P.O. Box 2008, Oak Ridge, Tennessee 37831-6285, managed by UT-Battelle, LLC for the U. S. Department of Energy under contract no. DEAC05-00OR22725. Copyright This manuscript has been authored by employees of UT-Battelle, LLC, under contract DE-AC05-00OR22725 with the U.S. Department of Energy. Accordingly, the United States Government retains and the publisher, by accepting the article for publication, acknowledges that the United States Government retains a non-exclusive, paid-up, irrevocable, world-wide license to publish or reproduce the published form of this manuscript, or allow others to do so, for United States Government purposes.

analytics↗

FNAS/LDEF Radiation Data Analysis

The radioactive isotope Be-7 was discovered on the forward-facing side of the LDEF satellite in amounts far exceeding that expected from direct cosmic ray activation of the spacecraft material. This prompted an examination of the production of cosmogenic isotopes in the atmosphere and of the processes by which they may be transported to orbital altitudes and absorbed by a spacecraft. Be-7 is only one of several atmospheric cosmogenic isotopes which might be detectable at orbital altitudes and which might prove to be as useful as tracers of atmospheric circulation processes in the mesosphere and thermosphere, as they have been in the lower layers of the atmosphere.

Gregory, John↗

Data-Intensive Science meets Inquiry-Driven Pedagogy: Interactive Big Data Exploration, Threshold Concepts, and Liminality

Threshold concepts in any discipline are the core concepts an individual must understand in order to master a discipline. By their very nature, these concepts are troublesome, irreversible, integrative, bounded, discursive, and reconstitutive. Although grasping threshold concepts can be extremely challenging for each learner as s/he moves through stages of cognitive development relative to a given discipline, the learner's grasp of these concepts determines the extent to which s/he is prepared to work competently and creatively within the field itself. The movement of individuals from a state of ignorance of these core concepts to one of mastery occurs not along a linear path but in iterative cycles of knowledge creation and adjustment in liminal spaces - conceptual spaces through which learners move from the vaguest awareness of concepts to mastery, accompanied by understanding of their relevance, connectivity, and usefulness relative to questions and constructs in a given discipline. For example, challenges in the teaching and learning of atmospheric science can be traced to threshold concepts in fluid dynamics. In particular, Dynamic Meteorology is one of the most challenging courses for graduate students and undergraduates majoring in Atmospheric Science. Dynamic Meteorology introduces threshold concepts - those that prove troublesome for the majority of students but that are essential, associated with fundamental relationships between forces and motion in the atmosphere and requiring the application of basic classical statics, dynamics, and thermodynamic principles to the three dimensionally varying atmospheric structure. With the explosive growth of data available in atmospheric science, driven largely by satellite Earth observations and high-resolution numerical simulations, paradigms such as that of dataintensive science have emerged. These paradigm shifts are based on the growing realization that current infrastructure, tools and processes will not allow us to analyze and fully utilize the complex and voluminous data that is being gathered. In this emerging paradigm, the scientific discovery process is driven by knowledge extracted from large volumes of data. In this presentation, we contend that this paradigm naturally lends to inquiry-driven pedagogy where knowledge is discovered through inductive engagement with large volumes of data rather than reached through traditional, deductive, hypothesis-driven analyses. In particular, data-intensive techniques married with an inductive methodology allow for exploration on a scale that is not possible in the traditional classroom with its typical problem sets and static, limited data samples. In addition, we identify existing gaps and possible solutions for addressing the infrastructure and tools as well as a pedagogical framework through which to implement this inductive approach.

Ramachandran, Rahul↗

Understanding Current Safety Issues for Trajectory Based Operations

Increases in procedural complexity were investigated as a possible contributor to flight path deviations in airline operations. Understanding current operational issues and their causes must be embraced to maintain current safety standards while increasing future functionality. ASRS data and expert narratives were used to discover factors relating to pilot deviations. Our investigation pointed to ATC intervention, automation confusion, procedure design, and mixed equipment as primary issues. Future work will need to include objective data and mitigation strategies.

RNAV STAR↗

Erasing the variable: empirical foreground discovery for global 21 cm spectrum experiments

Spectral measurements of the 21 cm monopole background have the promise of revealing the bulk energetic properties and ionization state of our universe from z ∼ 6-30. Synchrotron foregrounds are orders of magnitude larger than the cosmological signal and are the principal challenge faced by these experiments. While synchrotron radiation is thought to be spectrally smooth and described by relatively few degrees of freedom, the instrumental response to bright foregrounds may be much more complex. To deal with such complexities, we develop an approach that discovers contaminated spectral modes using spatial fluctuations of the measured data. This approach exploits the fact that foregrounds vary across the sky while the signal does not. The discovered modes are projected out of each line of sight of a data cube. An angular weighting then optimizes the cosmological signal amplitude estimate by giving preference to lower-noise regions. Using this method, we show that it is essential for the passband to be stable to at least ∼10{sup –4}. In contrast, the constraints on the spectral smoothness of the absolute calibration are mainly aesthetic if one is able to take advantage of spatial information. To the extent it is understood, controlling polarization to intensity leakage at the ∼10{sup –2} level will also be essential to rejecting Faraday rotation of the polarized synchrotron emission.

79 ASTRONOMY AND ASTROPHYSICS↗

Astronomaly at scale: searching for anomalies amongst 4 million galaxies

ABSTRACT Modern astronomical surveys are producing data sets of unprecedented size and richness, increasing the potential for high-impact scientific discovery. This possibility, coupled with the challenge of exploring a large number of sources, has led to the development of novel machine-learning-based anomaly detection approaches, such as astronomaly. For the first time, we test the scalability of astronomaly by applying it to almost 4 million images of galaxies from the Dark Energy Camera Legacy Survey. We use a trained deep learning algorithm to learn useful representations of the images and pass these to the anomaly detection algorithm isolation forest, coupled with astronomaly’s active learning method, to discover interesting sources. We find that data selection criteria have a significant impact on the trade-off between finding rare sources such as strong lenses and introducing artefacts into the data set. We demonstrate that active learning is required to identify the most interesting sources and reduce artefacts, while anomaly detection methods alone are insufficient. Using astronomaly, we find 1635 anomalies among the top 2000 sources in the data set after applying active learning, including eight strong gravitational lens candidates, 1609 galaxy merger candidates, and 18 previously unidentified sources exhibiting highly unusual morphology. Our results show that by leveraging the human–machine interface, astronomaly is able to rapidly identify sources of scientific interest even in large data sets.

Astronomy & Astrophysics↗

Photometric Observations of 6000 Stars in the Cygnus Field

A small photometer to detect transits by extrasolar planets has been assembled and is being tested at Lick Observatory on Mt. Hamilton, California. The Vulcan photometer is constructed from a 30 cm focal length, F/2.5 AeroEktar reconnaissance lens and Photometrics PXL16800 CCD camera. A spectral filter is used to confine the pass band from 480 to 763 mn. It simultaneously monitors 6000 stars brighter than 12th magnitude within a single star field in the galactic plane. When the data are folded and phased to discover low amplitude transits, the relative precision of one-hour samples is about 1 part per thousand (10 x l0(exp -3)) for many of the brighter stars. This precision is sufficient to find jovian-size planets orbiting solar-like stars, which have signal amplitudes from 5 to 30 x l0(exp -3) depending on the inflation of the planet and the size of the star. Based on the frequency of giant inner-planets discovered by Doppler-velocity method, one or two planets should be detectable in a rich star field. The goal of the observations is to obtain the sizes of giant extrasolar planets in short-period orbits and to combine these with masses determined from Doppler velocity measurements to determine the densities of these planets. A further goal is to compare the measured planetary diameters with those predicted from theoretical models. From August 10 through September 30 of 1998, a forty nine square degree field in the Cygnus constellation centered at RA and DEC of 19 hr 47 min, +36 deg 55 min was observed. Useful data were obtained on twenty-nine nights. Nearly fifty stars showed some evidence of transits with periods between 0.3 and 8 days. Most had amplitudes too large to be associated with planetary transits. However, several stars showed low amplitude transits. The data for several transits of each of these two stars have been folded and been folded into 30 minute periods. Only Cygl433 shows any evidence of a flattened bottom that is expected when a small object transits a much larger primary. However when high-resolution spectra were obtained for both stars, the stars were found to be double-lined binaries so similar in size as to have indistinguishable transit depths. The low amplitude of the transits is explained if the stellar orbital planes are tipped approximately 5 degrees from the line of sight causing both binaries to show grazing transits. The two absorption lines, due to the H(sub beta) feature in each star, are apparent and indicate the presence of a binary system with similar components.

Borucki, W.↗