Search NASA⌕ Search

SEARCH · Search NASA

Results for “data exploration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
NASA NTRS2007

Multi-Sensor Data from A-Train Instruments Brought Together for Atmospheric Research

The A-Train is comprised of a series of instruments, developed independently, that measure highly related atmospheric components along the same flight path. In order to intercompare data from this multitude of sensors, researchers must access, subset, visualize, analyze and correlate distributed atmosphere measurements from the various A-Train instruments. The A-Train Data Depot (ATDD) has been operational for over a year, successfully performing the aforementioned functions on behalf of researchers, thus providing co-registered data from the Cloudsat, CALIOP, AIRS, and MODIS instruments for further intercomparisons. Of late, significant data from OM1 and POLDER are now included in the 'depot'. By specifying the desired spatial and temporal range, the researcher can subset, visualize, co-register, and access multi-sensor A-Train data related to: Cloud, aerosol, atmospheric temperature, and water vapor parameters (vertical profile visualizations); Cloud Pressure, cloud top temperature, water vapor, cloud optical thickness, and aerosol products (horizontal strips subsetted +/- 100km from the profile visualizations), and; Cloud pressure parameters (2-D line plots overlayed on the vertical profiles). All data is plotted using the GIOVANNI data exploration tool. A new feature of GIOVANNI is its ability to have collocated and subsetted data sets as well as PNG image files downloaded to the researcher's computing facility. By providing a convenient way to visualize and acquire multi-sensor data, ATDD affords users more time and effort to further their research.

Smith, Peter M.↗
NASA NTRS1985

NASA's Pilot Land Data System development program

The NASA Pilot Land Data System (PLDS) project is intended to enhance the effectiveness of data processing capabilities used by researchers applying remote sensing data in land science research. Two sites in the centerminous U.S. have been selected as study areas scanned by Landsat, Nimbus and GOES instruments. The data will be analyzed by teams of researchers representing different fields of expertise. The PLDS program will explore data management, networking and communications, system access capabilities, land analysis software, special processes and overall systems engineerng. The data will be processed by researchers working interactively through remote supermicrocomputer workstations using a variety of operating systems and on-site software capabilities.

Price, R. D.↗
NASA NTRS1993

The SAMPEX Data Processing Unit

The paper discusses salient features of the SAMPEX Data Processing Unit (DPU), the primary function of which is to collect sensor data to create telemetry packets for transmission to the solid-state recorder located within the Small Explorer Data System. Particular attention is given to the sensor interface electronics, the space command interface, the spacecraft telemetry interface, and the memory mapper of the DPU system; the task scheduling concept; and system reconfiguring. A block diagram of the DPU system is included.

Mabry, D. J.↗
NASA NTRSDate not supplied

Increasing Discovery and Usability of Earth Science Satellite Data with My NASA Data

For 20 years, the My NASA Data project at NASA Langley Research Center has developed innovative approaches to increase the use of NASA’s satellite data by learners. My NASA Data offers a variety of authentic Earth Science datasets and a data visualization tool, eliminating the need for educators and/or learners to obtain specialized knowledge of GIS data formats and software to access and use authentic Earth Science data. While there is no shortage of available data, as federal government agencies such as NASA house petabytes of freely accessible Earth Science datasets, much of the data are only available for download and visualization in specialized formats and software, limiting their accessibility to educators and learners, especially those in primary and secondary school. Using the Google Earth Engine platform, the My NASA Data team has recently reinvented their data visualization tool, called the Earth System Data Explorer (ESDE). The ESDE gives users the capability to explore over 60 Earth Science satellite datasets in a multitude of formats such as maps, graphs, and data table Its new and improved user interface design was developed based on the preferences of educators, whom the My NASA Data project has over 20 years’ experience working with. Earth Science and GIS Subject Matter Experts (SMEs) structured the data in a professional and scientific manner. During Fiscal Year 2023, the My NASA Data website received over 1 million digital engagements, with over one-third being visitors to the data visualization tool. These metrics highlight the interest in a visualization tool that is simple and free to use with reliable and trusted datasets. The ESDE empowers users to readily relate and analyze NASA Earth Science data within their area of interest. The team used a user-centered design (UCD) framework to receive and incorporate feedback into the application’s design. Core requested features include the ability to create time series graphs, comparative analysis of maps, and download the data as CSV file. Responses indicate that advances in data visualization tools such as the ESDE make authentic Earth Science data more accessible. This presentation will cover how the My NASA Data project develops tools to enhance data discovery and accessibility, as well as how SME and user suggestions are incorporated.

Desiray Wilson↗
NASA NTRS1985

DE-1 phase 3 extended mission data analysis of Dynamics Explorer retarding ion mass spectrometer flight data

Field-aligned motion of ionospheric ions at a low altitudes and different pitch angle distributions of ionospheric ions at high altitudes were studied. The objective is twofold: (1) to discover the degree to which observations made by Dynamics Explorer 1 (DE-1) and DE-2 agree when taken in the same ionospheric volume; (2) to understand the processes operating along a magnetic field tube connecting DE-1 and DE-2 that allow a reconciliation of the two data sets. A second investigation has two facets; to reconcile the observed occurrence of ionospheric ions at high altitudes with a point source injection in the ionosphere and subsequent E x B drift, and to reconcile the observed fluxes of ionospheric ions at high altitudes with the measured upward flux at low altitudes. An understanding of the effects of E x B drift molten on the dispersion of ionospheric ions is attained.

Source record↗
DOE OSTI2020

A Sparse Tensor Benchmark Suite for CPUs and GPUs

Tensor computations present significant performance chal- lenges that impact a wide spectrum of applications ranging from machine learning, healthcare analytics, social network analysis, data mining to quantum chemistry and signal processing. Efforts to improve the perfor- mance of tensor computations include exploring data layout, execution scheduling, and parallelism in common tensor kernels. This work presents a benchmark suite for arbitrary-order sparse tensor kernels using state- of-the-art tensor formats: coordinate (COO) and hierarchical coordinate (HiCOO) on CPUs and GPUs. It presents a set of reference tensor kernel implementations that are compatible with real-world tensors and power law tensors extended from synthetic graph generation techniques. We also propose Roofline performance models for these kernels to provide insights of computer platforms from sparse tensor view. This benchmark suite along with the synthetic tensor generator is publicly available.

Li, Jiajia↗
NASA NTRS2016

Earth Science Data Analytics: Preparing for Extracting Knowledge from Information

Data analytics is the process of examining large amounts of data of a variety of types to uncover hidden patterns, unknown correlations and other useful information. Data analytics is a broad term that includes data analysis, as well as an understanding of the cognitive processes an analyst uses to understand problems and explore data in meaningful ways. Analytics also include data extraction, transformation, and reduction, utilizing specific tools, techniques, and methods. Turning to data science, definitions of data science sound very similar to those of data analytics (which leads to a lot of the confusion between the two). But the skills needed for both, co-analyzing large amounts of heterogeneous data, understanding and utilizing relevant tools and techniques, and subject matter expertise, although similar, serve different purposes. Data Analytics takes on a practitioners approach to applying expertise and skills to solve issues and gain subject knowledge. Data Science, is more theoretical (research in itself) in nature, providing strategic actionable insights and new innovative methodologies. Earth Science Data Analytics (ESDA) is the process of examining, preparing, reducing, and analyzing large amounts of spatial (multi-dimensional), temporal, or spectral data using a variety of data types to uncover patterns, correlations and other information, to better understand our Earth. The large variety of datasets (temporal spatial differences, data types, formats, etc.) invite the need for data analytics skills that understand the science domain, and data preparation, reduction, and analysis techniques, from a practitioners point of view. The application of these skills to ESDA is the focus of this presentation. The Earth Science Information Partners (ESIP) Federation Earth Science Data Analytics (ESDA) Cluster was created in recognition of the practical need to facilitate the co-analysis of large amounts of data and information for Earth science. Thus, from a to advance science point of view: On the continuum of ever evolving data management systems, we need to understand and develop ways that allow for the variety of data relationships to be examined, and information to be manipulated, such that knowledge can be enhanced, to facilitate science. Recognizing the importance and potential impacts of the unlimited ways to co-analyze heterogeneous datasets, now and especially in the future, one of the objectives of the ESDA cluster is to facilitate the preparation of individuals to understand and apply needed skills to Earth science data analytics. Pinpointing and communicating the needed skills and expertise is new, and not easy. Information technology is just beginning to provide the tools for advancing the analysis of heterogeneous datasets in a big way, thus, providing opportunity to discover unobvious scientific relationships, previously invisible to the science eye. And it is not easy It takes individuals, or teams of individuals, with just the right combination of skills to understand the data and develop the methods to glean knowledge out of data and information. In addition, whereas definitions of data science and big data are (more or less) available (summarized in Reference 5), Earth science data analytics is virtually ignored in the literature, (barring a few excellent sources).

data analytics↗
NASA NTRSDate not supplied

Examining 18 Years of Journal Publications to Characterize Usage Modes of Giovanni, a Versatile Earth Science Data Web Service

Introduction to Giovanni (Geospatial Interactive Online Visualization ANd aNalysis Infrastructure) Giovanni … is a Web-based visualization and analysis system that provides 22 different visualization and analysis options, operating on thousands of Earth science data variables generated by satellite instrument observations and from related model datasets Giovanni … was originally conceived as a data exploration tool, but its ease-of-use, analytical capabilities (spatial and temporal subsetting, multi-period averaging, data mapping and time-series, and more) have led to its use as a multi-discipline research tool Giovanni … provided unprecedented access to NASA Earth science data for many different disciplines, AND is still providing a simple way to find, analyze, visualize, and utilize such data for a wide spectrum of research topics

James Acker↗
NASA NTRS2012

Exploratory Climate Data Visualization and Analysis Using DV3D and UVCDAT

Earth system scientists are being inundated by an explosion of data generated by ever-increasing resolution in both global models and remote sensors. Advanced tools for accessing, analyzing, and visualizing very large and complex climate data are required to maintain rapid progress in Earth system research. To meet this need, NASA, in collaboration with the Ultra-scale Visualization Climate Data Analysis Tools (UVCOAT) consortium, is developing exploratory climate data analysis and visualization tools which provide data analysis capabilities for the Earth System Grid (ESG). This paper describes DV3D, a UV-COAT package that enables exploratory analysis of climate simulation and observation datasets. OV3D provides user-friendly interfaces for visualization and analysis of climate data at a level appropriate for scientists. It features workflow inte rfaces, interactive 40 data exploration, hyperwall and stereo visualization, automated provenance generation, and parallel task execution. DV30's integration with CDAT's climate data management system (COMS) and other climate data analysis tools provides a wide range of high performance climate data analysis operations. DV3D expands the scientists' toolbox by incorporating a suite of rich new exploratory visualization and analysis methods for addressing the complexity of climate datasets.

Maxwell, Thomas↗
DOE OSTI2017

CPU Volume Rendering of Adaptive Mesh Refinement Data

Adaptive Mesh Refinement (AMR) methods are widespread in scientific computing, and visualizing the resulting data with efficient and accurate rendering methods can be vital for enabling interactive data exploration. In this work, we detail a comprehensive solution for directly volume rendering block-structured (Berger-Colella) AMR data in the OSPRay interactive CPU ray tracing framework. In particular, we contribute a general method for representing and traversing AMR data using a kd-tree structure, and four different reconstruction options, one of which in particular (the basis function approach) is novel compared to existing methods. Here, we demonstrate our system on two types of block-structured AMR data and compressed scalar field data, and show how it can be easily used in existing production-ready applications through a prototypical integration in the widely used visualization program ParaView.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

ExpoKids: An R-based tool for characterizing aggregate chemical exposure during childhood

Background: Aggregate exposure, the combined exposures to a single chemical from all pathways, is a critical children’s health issue. Objective: The primary objective is to develop a tool to illustrate potential differences in aggregate exposure at various childhood lifestages and the adult lifestage. Methods: We developed ExpoKids (an R-based tool) using oral exposure estimates across lifestages generated by US EPA’s Exposure Factors Interactive Resource for Scenarios Tool (ExpoFIRST). Results: ExpoKids is applied to illustrate aggregate oral exposure, for ten media, as average daily doses (ADD) and lifetime average daily doses (LADD) in five graphs organized across seven postnatal childhood lifestages and the adult lifestage. This data visualization tool conveys ExpoFIRST findings, from available exposure data, to highlight the relative contributions of media and lifestages to chemical exposure. To evaluate the effectiveness of ExpoKids, three chemical case examples (di[2-ethylhexyl] phthalate [DEHP], manganese, and endosulfan) were explored. Data available from the published literature and databases for each case example were used to explore research questions regarding media and lifestage contributions to aggregate exposure. Significance: These illustrative case examples demonstrate ExpoKids’ versatile application to explore a diverse set of children’s health risk assessment and management questions by visually depicting specific media and lifestage contributions to aggregate exposure.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS1989

Preliminary concept for lunar exploration tracking and data acquisition and data processing systems

The NASA Office of Exploration is evaluating potential scenarios for an ambitious and complex mission to the moon. This paper sumarizes the initial system engineering analyses being performed to identify the communications, data processing, and navigational support required by these case studies. A feasible option for providing tracking and data acquisition using technology available in the 1990s is described.

Hei, Donald, Jr.↗
DOE OSTI2026

Eta Fragmentation Functions Revisited

We revisit the extraction of parton-to-eta meson fragmentation functions at next-to-leading order accuracy in QCD in the light of the recent hadroproduction measurements in proton-proton collisions obtained by the PHENIX, LHCb, and ALICE collaborations. In addition to an increased precision, the data explore complementary rapidity ranges and center-of-mass system energies. The analysis exploits the theoretical scale dependence to ease tensions among the data sets at different energies that are potentially caused by QCD corrections beyond the next-to-leading order. The resulting set of fragmentation functions yields a consistent description of all available data. Estimates of uncertainties are obtained with the Monte Carlo replica method.

FOS: Physical sciences↗
DOE OSTI2018

Lossy Data Compression Effects on Wall-bounded Turbulence: Bounds on Data Reduction

Postprocessing and storage of large data sets represent one of the main computational bottlenecks in computational fluid dynamics. We assume that the accuracy necessary for computation is higher than needed for postprocessing. Therefore, in the current work we assess thresholds for data reduction as required by the most common data analysis tools used in the study of fluid flow phenomena, specifically wall-bounded turbulence. These thresholds are imposed a priori by the user in L 2 -norm, and we assess a set of parameters to identify the minimum accuracy requirements. The method considered in the present work is the discrete Legendre transform (DLT), which we evaluate in the computation of turbulence statistics, spectral analysis and resilience for cases highly-sensitive to the initial conditions. Maximum acceptable compression ratios of the original data have been found to be around 97%, depending on the application purpose. Furthermore, the new method outperforms downsampling, as well as the previously explored data truncation method based on discrete Chebyshev transform (DCT).

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1991

Using Gaussian windows to explore a multivariate data set

In an earlier paper, I recounted an exploratory analysis, using Gaussian windows, of a data set derived from the Infrared Astronomical Satellite. Here, my goals are to develop strategies for finding structural features in a data set in a many-dimensional space, and to find ways to describe the shape of such a data set. After a brief review of Gaussian windows, I describe the current implementation of the method. I give some ways of describing features that we might find in the data, such as clusters and saddle points, and also extended structures such as a 'bar', which is an essentially one-dimensional concentration of data points. I then define a distance function, which I use to determine which data points are 'associated' with a feature. Data points not associated with any feature are called 'outliers'. I then explore the data set, giving the strategies that I used and quantitative descriptions of the features that I found, including clusters, bars, and a saddle point. I tried to use strategies and procedures that could, in principle, be used in any number of dimensions.

Jaeckel, Louis A.↗
NASA NTRS2019

GeoNEX: A Cloud Gateway for Near Real-time Processing of Geostationary Satellite Products

The emergence of a new generation of geostationary satellite sensors provides land andatmosphere monitoring capabilities similar to MODIS and VIIRS with far greater temporal resolution (5-15 minutes). However, processing such large volume, highly dynamic datasets requires computing capabilities that (1) better support data access and knowledge discovery for scientists; (2) provide resources to enable real-time processing for emergency response (wildfire, smoke, dust, etc.); and (3) provide reliable and scalable services for the broader user community. This paper presents an implementation of GeoNEX (Geostationary NASA-NOAA Earth Exchange) services that integrate scientific algorithms with Amazon Web Services (AWS) to provide near realtime monitoring (~5 minute latency) capability in a hybrid cloud-computing environment. It offers a user-friendly, manageable and extendable interface and benefits from the scalability provided by Amazon Web Services. Four use cases are presented to illustrate how to (1) search and access geostationary data; (2) configure computing infrastructure to enable near real-time processing; (3) disseminate and utilize research results, visualizations, and animations to concurrent users; and (4) use a Jupyter Notebook-like interface for data exploration and rapid prototyping. As an example of (3), the Wildfire Automated Biomass Burning Algorithm (WF_ABBA) was implemented on GOES-16 and -17 data to produce an active fire map every 5 minutes over the conterminous US. Details of the implementation strategies, architectures, and challenges of the use cases are discussed.

GeoNEX↗
NASA NTRS2015

BIRD Data Report from Exploration Flight Test 1

This report summarizes the data acquired by the Battery-operated Independent Radiation Detector (BIRD) during Exploration Flight Test 1 (EFT-1). The BIRD, consisting of two redundant subsystems isolated electronically from the Orion MPCV, was developed to fly on the Orion EFT-1 to acquire radiation data throughout the mission. The BIRD subsystems successfully triggered using on-board accelerometers in response to launch accelerations, acquired and archived data through landing, and completed the shut down routine when battery voltage decreased to a specified value. The data acquired are important for understanding the radiation environment within the Orion MPCV during transit through the trapped radiation belts.

Orion↗