Search NASA⌕ Search

SEARCH · Search NASA

Results for “data exploration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,639 records · Page 91

Mesospheric effects of solar ultraviolet variations - Further analysis of SME IR ozone and Nimbus 7 SAMS temperature data

In order to improve the constraints on models of the mesospheric response to solar UV variations, an analysis is conducted of the Solar Mesosphere Explorer (SME) IR ozone data and Nimbus 7 stratosphere and mesosphere sounder (SAMS) temperature data. Maximum low-altitude ozone and temperature-response amplitudes occur at about the same altitude, where a strong coupling between photochemical and thermal components of the mesospheric response is suggested by the simultaneous positive temperature and negative ozone response maxima. Increased Lyman-alpha dissociation of water vapor and temperature feedback are theorized to account for the negative ozone response. HO(x) chemical heating can increase as ozone destruction increases, and can therefore account for the positive temperature response.

Hood, L. L.↗

Dimensionality Reduction of SDSS Spectra with Variational Autoencoders

High-resolution galaxy spectra contain much information about galactic physics, but the high dimensionality of these spectra makes it difficult to fully utilize the information they contain. We apply variational autoencoders (VAEs), a nonlinear dimensionality reduction technique, to a sample of spectra from the Sloan Digital Sky Survey (SDSS). In contrast to principal component analysis (PCA), a widely used technique, VAEs can capture nonlinear relationships between latent parameters and the data. We find that a VAE can reconstruct the SDSS spectra well with only six latent parameters, outperforming PCA with the same number of components. Different galaxy classes are naturally separated in this latent space, without class labels having been given to the VAE. The VAE latent space is interpretable because the VAE can be used to make synthetic spectra at any point in latent space. For example, making synthetic spectra along tracks in latent space yields sequences of realistic spectra that interpolate between two different types of galaxies. Using the latent space to find outliers may yield interesting spectra: in our small sample, we immediately find unusual data artifacts and stars misclassified as galaxies. In this exploratory work, we show that VAEs create compact, interpretable latent spaces that capture nonlinear features of the data. While a VAE takes substantial time to train (≈1 day for 48,000 spectra), once trained, VAEs can enable the fast exploration of large astronomical data sets.

79 ASTRONOMY AND ASTROPHYSICS↗

Planetary magnetism

A synoptic view of early and recent data on the planetary magnetism of Mercury, Venus, the moon, Mars, Jupiter, and Saturn is presented. The data on Mercury from Mariner 10 are synthesized with various other sources, while data for Venus obtained from 120 orbits of Pioneer Venus give the upper limit of the magnetic dipole. Explorer 35 Lunar Orbiter data provided the first evidence of lunar magnetization, but it was the Apollo subsatellite data that measured accurately the magnetic dipole of the moon. A complete magnetic survey of Mars is still needed, and only some preliminary data are given on the magnetic dipole of the planet. Figures on the magnetic dipoles of Jupiter and Saturn are also suggested. It is concluded that if the magnetic field data are to be used to infer the interior properties of the planets, good measures of the multiple harmonics in the field are needed, which may be obtained only through low altitude polar orbits.

Russell, C. T.↗

Evaluation of Airborne Visible/Infrared Imaging Spectrometer Data of the Mountain Pass, California carbonatite complex

Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) data of the Mountain Pass, California carbonatite complex were examined to evaluate the AVIRIS instrument performance and to explore alternative methods of data calibration. Although signal-to-noise estimates derived from the data indicated that the A, B, and C spectrometers generally met the original instrument design objectives, the S/N performance of the D spectrometer was below expectations. Signal-to-noise values of 20 to 1 or lower were typical of the D spectrometer and several detectors in the D spectrometer array were shown to have poor electronic stability. The AVIRIS data also exhibited periodic noise, and were occasionally subject to abrupt dark current offsets. Despite these limitations, a number of mineral absorption bands, including CO3, Al-OH, and unusual rare earth element bands, were observed for mine areas near the main carbonatite body. To discern these bands, two different calibration procedures were applied to remove atmospheric and solar components from the remote sensing data. The two procedures, referred to as the single spectrum and the flat field calibration methods gave distinctly different results. In principle, the single spectrum method should be more accurate; however, additional fieldwork is needed to rigorously determine the degree of calibration success.

Crowley, James↗

The use of spectral data in wheat yield estimation - An assessment of techniques explored in LACIE

The object of the paper is to assess the results of the Large Area Crop Inventory Experiment (LACIE) and closely related research on yield estimation techniques based on remote sensing variables. The exploratory research conducted during LACIE substantiated the hypothesis of yield related information contained in Landsat multispectral scanner data and indicated some of its empirical characteristics. It is noted that leaf area and possibly other foliage features can be derived from spectral data for yield estimation through agrometeorological models and that multiple vegetative and grain related features may be discernable by Landsat derived wheat spectra at different points in the crop development.

Stuff, R. G.↗

Unsupervised Dictionary Learning for Signal-to-Noise Ratio Enhancement of Array Data

Waveform enhancement methods generally explore lateral coherency in arrivals, often assuming a linear moveout across an array, as exhibited by plane waves. Here, we illustrate how unsupervised dictionary learning combined with orthogonal matching pursuit for feature extraction can be used for signal-to-noise ratio (SNR) enhancement. In this strategy, waveform characteristics are directly learned from provided data samples; the created dictionary is then used for signal extraction. This combination prevents the need to set a predefined dictionary, and it becomes computationally efficient because learning is only done on smaller data portions. Because the dictionary is learned from data, there is no assumption regarding wavefront shape or form. Tests on synthetic and field data demonstrate the better denoising performance in terms of SNR enhancement compared to other methods.

58 GEOSCIENCES↗

Templates for developing and versioning data standards and reporting formats using GitHub

This data package contains three templates that can be used for creating README files and Issue Templates, written in the markdown language, that support community-led data reporting formats. We created these templates based on the results of a systematic review (see related references) that explored how groups developing data standard documentation use the Version Control platform GitHub, to collaborate on supporting documents. Based on our review of 32 GitHub repositories, we make recommendations for the content of README Files (e.g., provide a user license, indicate how users can contribute) and so 'README_template.md' includes headings for each section. The two issue templates we include ('issue_template_for_all_other_changes.md' and 'issue_template_for_documentation_change.md') can be used in a GitHub repository to help structure user-submitted issues, or can be modified to suit the needs of data standard developers. We used these templates when establishing ESS-DIVE's community space on GitHub (https://github.com/ess-dive-community) that includes documentation for community-led data reporting formats. We also include file-level metadata 'flmd.csv' that describes the contents of each file within this data package. Lastly, the temporal range that we indicate in our metadata is the time range during which we searched for data standards documented on GitHub.

54 ENVIRONMENTAL SCIENCES↗

The DECADE cosmic shear project I: A new weak lensing shape catalog of 107 million galaxies

We present the Dark Energy Camera All Data Everywhere (DECADE) weak lensing dataset: a catalog of 107 million galaxies observed by the Dark Energy Camera (DECam) in the northern Galactic cap. This catalog was assembled from public DECam data including survey and standard observing programs. These data were consistently processed with the Dark Energy Survey Data Management pipeline as part of the DECADE campaign and serve as the basis of the DECam Local Volume Exploration survey (DELVE) Early Data Release 3 (EDR3). We apply the Metacalibration measurement algorithm to generate and calibrate galaxy shapes. After cuts, the resulting cosmology-ready galaxy shape catalog covers a region of $5,\!412 \,\,{\rm deg}^2$ with an effective number density of $4.59\,\, {\rm arcmin}^{-2}$. The coadd images used to derive this data have a median limiting magnitude of $r = 23.6$, $i = 23.2$, and $z = 22.6$, estimated at ${\rm S/N} = 10$ in a 2 arcsecond aperture. We present a suite of detailed studies to characterize the catalog, measure any residual systematic biases, and verify that the catalog is suitable for cosmology analyses. In parallel, we build an image simulation pipeline to characterize the remaining multiplicative shear bias in this catalog, which we measure to be $m = (-2.454 \pm 0.124) \times10^{-2}$ for the full sample. Despite the significantly inhomogeneous nature of the data set, due to it being an amalgamation of various observing programs, we find the resulting catalog has sufficient quality to yield competitive cosmological constraints.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

The Intelligent Data Understanding Element of NASA's Intelligent Systems Program

Within the NASA Intelligent Systems Program, the Intelligent Data Understanding (IDU) element develops techniques for transforming data into scientific understanding. Automating such tools is critical for space science, space-based earth science, and planetary exploration with onboard scientific data analysis. Intelligent data understanding (IDU) is about extracting meaning from large, diverse science and engineering databases, via autonomous techniques that transform very large datasets into understanding. The earth science community in particular needs new tools for analyzing multi-formatted and geographically distributed datasets and for identifying cause-effect relationships in the complex data. Research within the IDU program element seeks to automate data analysis tasks so that humans can focus on creative hypothesis generation and knowledge synthesis. It may also enable NASA space missions in which autonomous agents must generate knowledge and take actions, and missions where limited bandwidth permits transmission of only the most interesting scientific observations, summaries, and conclusions. Twenty-seven research projects are-currently funded.

Coughlan, Joseph C.↗

NEEMO 18-20: Analog Testing for Mitigation of Communication Latency During Human Space Exploration

NASA Extreme Environment Mission Operations (NEEMO) is an underwater spaceflight analog that allows a true mission-like operational environment and uses buoyancy effects and added weight to simulate different gravity levels. Three missions were undertaken from 2014-2015, NEEMO's 18-20. All missions were performed at the Aquarius undersea research habitat. During each mission, the effects of communication latencies on operations concepts, timelines, and tasks were studied. METHODS: Twelve subjects (4 per mission) were weighed out to simulate near-zero or partial gravity extravehicular activity (EVA) and evaluated different operations concepts for integration and management of a simulated Earth-based science team (ST) to provide input and direction during exploration activities. Exploration traverses were preplanned based on precursor data. Subjects completed science-related tasks including pre-sampling surveys, geologic-based sampling, and marine-based sampling as a portion of their tasks on saturation dives up to 4 hours in duration that were designed to simulate extravehicular activity (EVA) on Mars or the moons of Mars. One-way communication latencies, 5 and 10 minutes between space and mission control, were simulated throughout the missions. Objective data included task completion times, total EVA times, crew idle time, translation time, ST assimilation time (defined as time available for ST to discuss data/imagery after data acquisition). Subjective data included acceptability, simulation quality, capability assessment ratings, and comments. RESULTS: Precursor data can be used effectively to plan and execute exploration traverse EVAs (plans included detailed location of science sites, high-fidelity imagery of the sites, and directions to landmarks of interest within a site). Operations concepts that allow for pre-sampling surveys enable efficient traverse execution and meaningful Mission Control Center (MCC) interaction across communication latencies and can be done with minimal crew idle time. Imagery and contextual information from the EVA crew that is transmitted real-time to the intravehicular (IV) crewmember(s) can be used to verify that exploration traverse plans are being executed correctly. That same data can be effectively used by MCC (across comm latency) to provide meaningful feedback and instruction to the crew regarding sampling priorities, additional tasks, and changes to the EVA timeline. Text / data capabilities are preferred over voice capabilities between MCC and IV when executing exploration traverse plans over communication latency.

Chappell, Steven P.↗

PHOTOMETRIC REDSHIFTS AND QUASAR PROBABILITIES FROM A SINGLE, DATA-DRIVEN GENERATIVE MODEL

We describe a technique for simultaneously classifying and estimating the redshift of quasars. It can separate quasars from stars in arbitrary redshift ranges, estimate full posterior distribution functions for the redshift, and naturally incorporate flux uncertainties, missing data, and multi-wavelength photometry. We build models of quasars in flux-redshift space by applying the extreme deconvolution technique to estimate the underlying density. By integrating this density over redshift, one can obtain quasar flux densities in different redshift ranges. This approach allows for efficient, consistent, and fast classification and photometric redshift estimation. This is achieved by combining the speed obtained by choosing simple analytical forms as the basis of our density model with the flexibility of non-parametric models through the use of many simple components with many parameters. We show that this technique is competitive with the best photometric quasar classification techniques-which are limited to fixed, broad redshift ranges and high signal-to-noise ratio data-and with the best photometric redshift techniques when applied to broadband optical data. We demonstrate that the inclusion of UV and NIR data significantly improves photometric quasar-star separation and essentially resolves all of the redshift degeneracies for quasars inherent to the ugriz filter system, even when included data have a low signal-to-noise ratio. For quasars spectroscopically confirmed by the SDSS 84% and 97% of the objects with Galaxy Evolution Explorer UV and UKIDSS NIR data have photometric redshifts within 0.1 and 0.3, respectively, of the spectroscopic redshift; this amounts to about a factor of three improvement over ugriz-only photometric redshifts. Our code to calculate quasar probabilities and redshift probability distributions is publicly available.

79 ASTRONOMY AND ASTROPHYSICS↗

Using cross-layer adaptations for dynamic data management in large scale coupled scientific workflows, In: SC '13 Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis

As system scales and application complexity grow, managing and processing simulation data has become a significant challenge. While recent approaches based on data staging and in-situ/in-transit data processing are promising, dynamic data volumes and distributions, such as those occurring in AMR-based simulations, make the efficient use of these techniques challenging. In this paper we propose cross-layer adaptations that address these challenges and respond at runtime to dynamic data management requirements. Specifically we explore (1) adaptations of the spatial resolution at which the data is processed, (2) dynamic placement and scheduling of data processing kernels, and (3) dynamic allocation of in-transit resources. We also exploit coordinated approaches that dynamically combine these adaptations at the different layers. We evaluate the performance of our adaptive cross-layer management approach on the Intrepid IBM-BlueGene/P and Titan Cray-XK7 systems using Chombo-based AMR applications, and demonstrate its effectiveness in improving overall time-to-solution and increasing resource efficiency.

Computer Science↗

Geological and geothermal investigations for HCMM-derived data

An attempt was made to match HCMM- and U2HCMR-derived temperature data over two test sites of very local size to similar data collected in the field at nearly the same times. Results indicate that HCMM investigations using resolutions cells of 500 m or so are best conducted with areally-extensive sites, rather than point observations. The excellent quality day-VIS imagery is particularly useful for lineament studies, as is the DELTA-T imagery. Attempts to register the ground observed temperatures (even for 0.5 sq mile targets) were unsuccessful due to excessive pixel-to-pixel noise on the HCMM data. Several computer models were explored and related to thermal parameter value changes with observed data. Unless quite complex models, with many parameters which can be observed (perhaps not even measured (perhaps not even measured) only under remote sensing conditions (e.g., roughness, wind shear, etc) are used, the model outputs do not match the observed data. Empirical relationship may be most readily studied.

Lyon, R. J. P.↗

Observing the polar oceans with spaceborne radar

The application of spaceborne imaging radar data to polar oceanography and sea ice is explored. Several problems come to mind which are presently ripe with ideas and models, but are in need of new data, SAR data, for any progress to be made. These are the study of the ice mass balance, the ice momentum balance, and the circulation of the Arctic Ocean. These problems are described along with the data which is applicable to them and can be extracted from SAR imagery. Some uses are discussed of these data to explore mesoscale processes which affect the oceans and ice cover.

Rothrock, Drew↗

Use of an approximate similarity principle for the thermal scaling of a full-scale thrust augmenting ejector

Full temperature ejector model simulations are expensive, and difficult to implement experimentally. If an approximate similarity principle could be established, properly chosen performance parameters should be similar for both hot and cold flow tests if the initial Mach number and total pressures of the flow field are held constant. Existing ejector data is used to explore the utility of one particular similarity principle; the Munk and Prim similarity principle for isentropic flows. Static performance test data for a full-scale thrust augmenting ejector are analyzed for primary flow temperatures up to 1560 R. At different primary temperatures, exit pressure contours are compared for similarity. A nondimensional flow parameter is then used to eliminate primary nozzle temperature dependence and verify similarity between the hot and cold flow experiments.

Barankiewicz, Wendy S.↗

Use of an approximate similarity principle for the thermal scaling of a full-scale thrust augmenting ejector

Full temperature ejector model simulations are expensive, and difficult to implement experimentally. If an approximate similarity principle could be established, properly chosen performance parameters should be similar for both hot and cold flow tests if the initial Mach number and total pressures of the flow field are held constant. Existing ejector data is used to explore the utility of one particular similarity principle; the Munk and Prim similarity principle for isentropic flows. Static performance test data for a full-scale thrust augmenting ejector are analyzed for primary flow temperatures up to 1560 R. At different primary temperatures, exit pressure contours are compared for similarity. A nondimensional flow paramenter is then used to eliminate primary nozzle temperature dependence and verify similarity between the hot and cold flow experiments.

Barankiewicz, Wendy↗

Formaldehyde Column Density as an Indicator for Elevated Surface Ozone

Efforts to observe near-surface ozone directly from space are hindered by the limited sensitivity of ozone satellite retrievals to the lower troposphere. Formaldehyde (HCHO) column observations from the NASA DISCOVER-AQ campaign showed a strong relationship with surface ozone, particularly when biogenic volatile organic compounds (VOCs) were the dominant ozone precursor due to their strong temperature-driven variability. Both tropospheric ozone and HCHO are secondarily produced through the oxidation of VOCs and in regions where the main fate of RO2 is reaction with NO, thus formaldehyde and ozone are generally co-produced. This work explores the relationship between column formaldehyde and surface ozone using data from two air quality research campaigns, the Long Island Sound Tropospheric Ozone Study (LISTOS) in 2018 and the Korea U.S. - Air Quality (KORUS-AQ) campaign in 2016. These campaigns included HCHO column information from airborne in-situ profiling and remote sensing and ground-based Pandora spectrometers in combination with surface ozone monitors in each region. These data are used to further explore the HCHO-ozone relationship and its potential for identifying areas of elevated ozone using remote sensing or satellite observations of column HCHO alone. These two regions offer a valuable comparison given their different VOC mixtures and the higher NOx levels in Seoul that result in ozone titration effects. This work will also address the potential for this application with future geostationary satellite observations.

Laura Margaret Judd↗

Computationally efficient CFD prediction of bubbly flow using physics-guided deep learning

To realize efficient computational fluid dynamics (CFD) prediction of two-phase flow, a multi-scale framework was proposed in this paper by applying a physics-guided data-driven approach. Instrumental to this framework, Feature Similarity Measurement (FSM) technique was developed for error estimation in two-phase flow simulation using coarse-mesh CFD, to achieve a comparable accuracy as fine-mesh simulations with fast-running feature. In this work, by defining physics-guided parameters and variable gradients as physical features, FSM has the capability to capture the underlying local patterns in the coarse-mesh CFD simulation. Massive low-fidelity data and respective high-fidelity data are used to explore the underlying information relevant to the main simulation errors and the effects of phenomenological scaling. By learning from previous simulation data, a surrogate model using deep feedforward neural network (DFNN) can be developed and trained to estimate the simulation error of coarse-mesh CFD. In a demonstration case of two-phase bubbly flow, the DFNN model well captured and corrected the unphysical “peaks” in the velocity and void fraction profiles near the wall in the coarse-mesh configuration, even for extrapolative predictions. The research documented supports the feasibility of the physics-guided deep learning methods for coarse mesh CFD simulations which has a potential for the efficient industrial design.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗