Search NASA⌕ Search

SEARCH · Search NASA

Results for “science data network”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,045 records · Page 58

Identifying precursors of daily to seasonal hydrological extremes over the USA using deep learning techniques and climate model ensembles

Focal Area(s): We focus on two areas of crosscutting interest for DOE: 1) predictability of extreme precipitation and drought in the USA and 2) the integration of climate models with new AI tools, such as convolutional neural networks (CNN) and methods to understand their output (e.g. layer-wise relevance propagation; LRP). This project fits into focus area 3 of this call for white paper using AI to gain insight from complex data, including explainable AI tools. Science Challenge: Predicting hydrological extremes is important due to their impacts on people, agriculture and infrastructure. This prediction is difficult due to the infrequent occurrence of extremes and their complexity. However, extreme events can be related to more predictable conditions in the ocean, such as El Nino, long-term soil moisture or large scale modes of climate variability, such as the North Atlantic Oscillation (NAO).

54 ENVIRONMENTAL SCIENCES↗

The 1991 research and technology report, Goddard Space Flight Center

The 1991 Research and Technology Report for Goddard Space Flight Center is presented. Research covered areas such as (1) earth sciences including upper atmosphere, lower atmosphere, oceans, hydrology, and global studies; (2) space sciences including solar studies, planetary studies, Astro-1, gamma ray investigations, and astrophysics; (3) flight projects; (4) engineering including robotics, mechanical engineering, electronics, imaging and optics, thermal and cryogenic studies, and balloons; and (5) ground systems, networks, and communications including data and networks, TDRSS, mission planning and scheduling, and software development and test.

Soffen, Gerald↗

The 2009 Mars Telecommunications Orbiter

The first spacecraft with a primary function of providing communication links while orbiting a foreign planet has begun development for a launch in 2009. NASA's Mars Telecommunications Orbiter would use three radio bands to magnify the benefits of other future Mars missions and enable some types of missions otherwise impractical. It would serve as the Mars hub for a growing interplanetary Internet. And it would pioneer the use of planet-to-planet laser communications to demonstrate the possibility for even greater networking capabilities in the future. With Mars Telecommunications Orbiter overhead in the martian sky, the Mars Science Laboratory rover scheduled to follow the orbiter to Mars by about a month could send to Earth more than 100 times as much data per day as it could otherwise send. The orbiter will be designed for the capability of relaying up to 15 gigabits per day from the rover, equivalent to more than three full compact discs each day. The same benefits would accrue to other future major Mars missions from any nation.

Wilson, G. R.↗

HDF-EOS Web Server

A shell script has been written as a means of automatically making HDF-EOS-formatted data sets available via the World Wide Web. ("HDF-EOS" and variants thereof are defined in the first of the two immediately preceding articles.) The shell script chains together some software tools developed by the Data Usability Group at Goddard Space Flight Center to perform the following actions: Extract metadata in Object Definition Language (ODL) from an HDF-EOS file, Convert the metadata from ODL to Extensible Markup Language (XML), Reformat the XML metadata into human-readable Hypertext Markup Language (HTML), Publish the HTML metadata and the original HDF-EOS file to a Web server and an Open-source Project for a Network Data Access Protocol (OPeN-DAP) server computer, and Reformat the XML metadata and submit the resulting file to the EOS Clearinghouse, which is a Web-based metadata clearinghouse that facilitates searching for, and exchange of, Earth-Science data.

Ullman, Richard↗

Probabilistic Guidance of a Swarm Deployed from the Back Shell of the Mars Spacecraft

This paper presents a probabilistic guidance algorithm for a swarm of assets deployed from the back shell of the Mars spacecraft. Such a swarm could provide valuable science data, with large spatiotemporal variation, from the Martian surface. Our probabilistic swarm guidance algorithm maximizes the coverage area of the swarm while uniformly distributing the assets on the Martian surface and guaranteeing strong connectivity of the swarm’s communication network topology. Numerical simulations demonstrate the effectiveness and versatility of our probabilistic swarm guidance algorithm.

Hadaegh, Fred↗

Artificial Neural Network (ANN) Surface Longwave and Shortwave Fluxes Trained on CERES Observations

The Clouds and Earth’s Radiant Energy System (CERES) project provides satellite-based observations of the radiative fluxes and clouds systems. CERES climate quality data products typically take several months of calibration and validation before release to the public. The Fast Longwave and Shortwave Radiative Flux (FLASHFlux) data product was developed to provide key data for the applied sciences and educational users within a week of observation. FLASHFlux achieves this by using simplified calibration, an operational meteorological product from Global Modeling and Assimilation Office (GMAO), and its own surface parameterizations model. The CERES FLASHFlux provides two data products: 1) an hourly Level 2 Single Scanner Footprint (SSF) data separately for Terra and NOAA-20 observations, and 2) a daily Level 3 Time Interpolated and Spatially Averaged (TISA) 1o x 1o gridded data that combines Terra and NOAA-20 observations. Currently, FLASHFlux uses the Langley Parameterized Shortwave Algorithm (LPSA) and Langley Parameterized Longwave Algorithm (LPLA) to derive its surface fluxes (Kratz et al., 2010; Gupta et al, 2001). A new Machine Learning (ML) based approach using Artificial Neural Networks to derive Surface Longwave (LW) & Shortwave (SW) fluxes based on training data from the CERES Clouds Radiative Swath (CRS) product is being investigated to replace LPSA and LPLA in the SSF surface flux products. One of the biggest hurdles in training ML model is model fitting. To overcome the problem of overfitting we use feature engineering that helps in finding the important feature and remove features that are irrelevant to the model. In our training we employed the Leave-One-Feature-Out Importance (LOFO) to evaluate the significance of each feature in our training. We intercompare ANN fluxes against surface fluxes produced from the Fu-Liou model in CRS and the LPSA/LPLA in FLASHFlux SSF. Furthermore, we validated ANN derived fluxes to the Baseline Surface Radiation Network (BSRN).

P C Sawaengphokhai↗

Comparative Performance Evaluation of High-performance Data Transfer Tools

Data transfer in wide-area networks has been long studied in different contexts, from data sharing among data centers to online access to scientific data. Many software tools and platforms have been developed to facilitate easy, reliable, fast, and secure data transfer over wide area networks, such as GridFTP, FDT, bbcp, mdtmFTP, and XDD. However, few studies have shown the full capabilities of existing data transfer tools from the perspective of whether such tools have fully adopted state-of-the-art techniques through meticulous comparative evaluations. In this paper, we evaluate the performance of the four highperformance data transfer tools (GridFTP, FDT, mdtmFTP, and XDD) in various environments. Our evaluation suggests that each tool has strengths and weaknesses. FDT and GridFTP perform consistently in diverse environments. XDD and mdtmFTP show improved performance in limited environments and datasets during our evaluation. Unlike other studies on data transfer tools, we also evaluate the predictability of the tools' performance, an important factor for scheduling different stages of science workflows. Performance predictability also helps in (auto)tuning the configurable parameters of the data transfer tool. We apply statistical learning techniques such as linear/polynomial regression, and k-nearest neighbors (kNN), to assess the performance predictability of each tool using its control parameters. Our results show that we can achieve good prediction performance for GridFTP and mdtmFTP using linear regression and kNN, respectively.

Nadig, Deepak↗

Space-based Science Operations Grid Prototype

Grid technology is the up and coming technology that is enabling widely disparate services to be offered to users that is very economical, easy to use and not available on a wide basis. Under the Grid concept disparate organizations generally defined as "virtual organizations" can share services i.e. sharing discipline specific computer applications, required to accomplish the specific scientific and engineering organizational goals and objectives. Grids are emerging as the new technology of the future. Grid technology has been enabled by the evolution of increasingly high speed networking. Without the evolution of high speed networking Grid technology would not have emerged. NASA/Marshall Space Flight Center's (MSFC) Flight Projects Directorate, Ground Systems Department is developing a Space-based Science Operations Grid prototype to provide to scientists and engineers the tools necessary to operate space-based science payloads/experiments and for scientists to conduct public and educational outreach. In addition Grid technology can provide new services not currently available to users. These services include mission voice and video, application sharing, telemetry management and display, payload and experiment commanding, data mining, high order data processing, discipline specific application sharing and data storage, all from a single grid portal. The Prototype will provide most of these services in a first step demonstration of integrated Grid and space-based science operations technologies. It will initially be based on the International Space Station science operational services located at the Payload Operations Integration Center at MSFC, but can be applied to many NASA projects including free flying satellites and future projects. The Prototype will use the Internet2 Abilene Research and Education Network that is currently a 10 Gb backbone network to reach the University of Alabama at Huntsville and several other, as yet unidentified, Space Station based science experimenters. There is an international aspect to the Grid involving the America's Pathway (AMPath) network, the Chilean REUNA Research and Education Network and the University of Chile in Santiago that will further demonstrate how extensive these services can be used. From the user's perspective, the Prototype will provide a single interface and logon to these varied services without the complexity of knowing the where's and how's of each service. There is a separate and deliberate emphasis on security. Security will be addressed by specifically outlining the different approaches and tools used. Grid technology, unlike the Internet, is being designed with security in mind. In addition we will show the locations, configurations and network paths associated with each service and virtual organization. We will discuss the separate virtual organizations that we define for the varied user communities. These will include certain, as yet undetermined, space-based science functions and/or processes and will include specific virtual organizations required for public and educational outreach and science and engineering collaboration. We will also discuss the Grid Prototype performance and the potential for further Grid applications both space-based and ground based projects and processes. In this paper and presentation we will detail each service and how they are integrated using Grid

Bradford, Robert N.↗

Oracle-Preserving Latent Flows

A fundamental task in data science is the discovery, description, and identification of any symmetries present in the data. We developed a deep learning methodology for the simultaneous discovery of multiple non-trivial continuous symmetries across an entire labeled dataset. The symmetry transformations and the corresponding generators are modeled with fully connected neural networks trained with a specially constructed loss function, ensuring the desired symmetry properties. The two new elements in this work are the use of a reduced-dimensionality latent space and the generalization to invariant transformations with respect to high-dimensional oracles. The method is demonstrated with several examples on the MNIST digit dataset, where the oracle is provided by the 10-dimensional vector of logits of a trained classifier. We find classes of symmetries that transform each image from the dataset into new synthetic images while conserving the values of the logits. We illustrate these transformations as lines of equal probability (“flows”) in the reduced latent space. These results show that symmetries in the data can be successfully searched for and identified as interpretable non-trivial transformations in the equivalent latent space.

97 MATHEMATICS AND COMPUTING↗

Synthesis of Remote Sensing and Field Observations to Model and Understand Disturbance and Climate Effects on the Carbon Balance of Oregon & Northern California

The goal is to quantify and explain the carbon (C) budget for Oregon and N. California. The research compares "bottom -up" and "top-down" methods, and develops prototype analytical systems for regional analysis of the carbon balance that are potentially applicable to other continental regions, and that can be used to explore climate, disturbance and land-use effects on the carbon cycle. Objectives are: 1) Improve, test and apply a bottom up approach that synthesizes a spatially nested hierarchy of observations (multispectral remote sensing, inventories, flux and extensive sites), and the Biome-BGC model to quantify the C balance across the region; 2) Improve, test and apply a top down approach for regional and global C flux modeling that uses a model-data fusion scheme (MODIS products, AmeriFlux, atmospheric CO2 concentration network), and a boundary layer model to estimate net ecosystem production (NEP) across the region and partition it among GPP, R(a) and R(h). 3) Provide critical understanding of the controls on regional C balance (how NEP and carbon stocks are influenced by disturbance from fire and management, land use, and interannual climate variation). The key science questions are, "What are the magnitudes and distributions of C sources and sinks on seasonal to decadal time scales, and what processes are controlling their dynamics? What are regional spatial and temporal variations of C sources and sinks? What are the errors and uncertainties in the data products and results (i.e., in situ observations, remote sensing, models)?

54 ENVIRONMENTAL SCIENCES↗

Inference of gene regulatory networks from genome-wide knockout fitness data

Motivation: Genome-wide fitness is an emerging type of highthroughput biological data generated for individual organisms by creating libraries of knockouts, subjecting them to broad ranges of environmental conditions, and measuring the resulting clone-specific fitnesses. Since fitness is an organism-scale measure of gene regulatory network behaviour, it may offer certain advantages when insights into such phenotypical and functional features are of primary interest over individual gene expression. Previous works have shown that genome-wide fitness data can be used to uncover novel gene regulatory interactions, when compared with results of more conventional gene expression analysis. Yet, to date, few algorithms have been proposed for systematically using genome-wide mutant fitness data for gene regulatory network inference. Results: In this article, we describe a model and propose an inference algorithm for using fitness data from knockout libraries to identify underlying gene regulatory networks. Unlike most prior methods, the presented approach captures not only structural, but also dynamical and non-linear nature of biomolecular systems involved. A state– space model with non-linear basis is used for dynamically describing gene regulatory networks. Network structure is then elucidated by estimating unknown model parameters. Unscented Kalman filter is used to cope with the non-linearities introduced in the model, which also enables the algorithm to run in on-line mode for practical use. Here, we demonstrate that the algorithm provides satisfying results for both synthetic data as well as empirical measurements of GAL network in yeast Saccharomyces cerevisiae and TyrR–LiuR network in bacteria Shewanella oneidensis.

59 BASIC BIOLOGICAL SCIENCES↗

A Quantitative Study of Deep Learning Training on Heterogeneous Supercomputers

Deep learning (DL) has become a key technique for solving complex problems in scientific research and discovery. DL training for science is substantially challenging because it has to deal with massive quantities of multi-dimensional data. High- performance computing (HPC) supercomputers are increasingly being employed for meeting the exponentially growing demand for DL. Multiple GPUs and high-speed interconnect network are needed for supporting DL on HPC systems. However, the excessive use of GPUs without considering effective benefits leads to inefficient resource utilization of these expensive setups. In this paper, we conduct a quantitative analysis to gauge the efficacy of DL workloads on the latest HPC system and identify viability of next-generation DL-optimized heterogeneous supercomputers for enabling researchers to develop more efficient resource management and distributed DL middleware. We evaluate well- known DL models with large-scale datasets using the popular TensorFlow framework, and provide a thorough evaluation in- cluding scalability, accuracy, variability, storage resource, GPU- GPU/GPU-CPU data transfer, and GPU utilization. Our analysis reveals that the latest heterogeneous supercomputing cluster shows varying performance trend as compared to the existing literature for single- and multi-node training. To the best of our knowledge, this is the first work to conduct such a quantitative and comprehensive study of DL training on a supercomputing system with multiple GPUs.

Han, Jingoo↗

Reliability Lessons Learned From GPU Experience With The Titan Supercomputer at Oak Ridge Leadership Computing Facility

The high computational capability of graphics processing units (GPUs) is enabling and driving the scientific discovery process at large-scale. The world’s second fastest supercomputer for open science, Titan, has more than 18,000 GPUs that computational scientists use to perform scientific simu- lations and data analysis. Understanding of GPU reliability characteristics, however, is still in its nascent stage since GPUs have only recently been deployed at large-scale. This paper presents a detailed study of GPU errors and their impact on system operations and applications, describing experiences with the 18,688 GPUs on the Titan supercom- puter as well as lessons learned in the process of efficient operation of GPUs at scale. These experiences are helpful to HPC sites which already have large-scale GPU clusters or plan to deploy GPUs in the future.

Tiwari, Devesh↗

Erratum to: Data Fusion to Support Integrated Nuclear Detonation Detection [Slides]

The original document (LA-UR-22-29547) contained minor equation errors that approximate correct equations that couple the multi-sensor, serial system detector thresholds for a seismic Rayleigh wave detector and an acoustic energy detector. Those errors appeared on slides 62-67. This erratum associates the following slides with the erroneous slides. The numbers of the erroneous slides are marked at the upper right in small text in orange. A result of those errors over-predict the performance of the two-sensor serial network, that is, the former document provides an optimistic estimate of system performance.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

TECHNICAL EVALUATION OF THE INTERACTION OF GROUNDWATER WITH THE COLUMBIA RIVER AT THE DEPARTMENT OF ENERGY HANFORD SITE 100-D AREA

Groundwater beneath much of Hanford's 100 Areas is contaminated with hexavalent chromium (Cr{sup +6}) as a consequence of treating reactor cooling water to prevent corrosion. Several treatment systems are in place to remove Cr{sup +6} from the groundwater; however, these systems currently do not reduce Cr{sup +6} to concentrations below aquatic standards. Of concern is the transport of Cr{sup +6} to areas within the channel of the river, as sensitive species inhabit the river and its associated transition zone. The aquatic standard for Cr{sup +6} is currently 11 ug/l under the Record of Decision (ROD) for Interim Action and Department of Energy (DOE) currently plans to pursue remediation of the groundwater to achieve the 11 ug/l standard. Because the compliance wells used to monitor the current remediation systems are located some distance from the river, they may not provide an accurate indication of Cr{sup +6} concentrations in the water that reaches the riverbed. In addition, because salmon spawning areas are considered a high priority for protection from Hanford contaminants, it would be advantageous to understand (1) to what extent Cr{sup +6} discharged to the near-shore or river ecosystems is diluted or attenuated and (2) mechanisms that could mitigate the exposure of the river ecosystems to the discharging Cr{sup +6}. The current concentration target for Cr{sup +6} at near-river groundwater monitoring locations is 20 {micro}g/L; it is assumed that this groundwater mixes with river water that contains virtually no chromium to meet Washington Department of Ecology's (Ecology) water quality standard of 10 {micro}g/L in the river environment. This dynamic mixing process is believed to be driven by daily and seasonal changes in river stage and groundwater remediation system operations, and has been validated using analytical data from numerous groundwater samples obtained adjacent to and within the banks of the river. Although the mean mixing factor of river water and site groundwater in this zone has been estimated to be equal parts of groundwater and river water, a wide range of mixing ratios likely occurs at various times of the day and year. The degree of mixing and dilution appears to be greatly influenced by the river stage and other groundwater/surface water interaction. The extent of mixing, thus, has implications for the design and operation of the groundwater remediation systems. Improved understanding of this 'dilution' mechanism is needed to design an optimum 'systems approach' to accelerate remediation of the near-shore contaminant plumes. More information on the pathway from near-river mapped plumes to riverbed receptor locations is also needed to develop a defensible proposed plan for a future ROD for final remedial action of contaminated groundwater. In April 2008, an expert panel of scientists was convened to review existing information and provide observations and suggestions to improve the current understanding of groundwater surface water interactions in the 100 Areas (primarily focusing on 100-D Area), and to identify what additional analyses or approaches may provide critical information needed to design and implement remediation systems that will minimize impacts to river aquatic systems. Specific objectives provided to the panel included: (1) comment on approaches and methods to improve the current understanding of groundwater-surface water interactions, specifically how contaminated groundwater enters the riverbed and how this relates to remediation of chromate in the groundwater in the 100 Areas; (2) evaluate past and current data collection methods, data analysis techniques, assumptions, and groundwater transport and mixing mechanisms; (3) evaluate the current monitoring network (monitoring wells, aquifer tubes, and shoreline/river monitoring); (4) evaluate the role played by modeling; and (5) suggest additional research to fill data gaps and perform modeling.

54 ENVIRONMENTAL SCIENCES↗

Data management for Large Space Telescope

The data management system for the Large Space Telescope (LST) must be capable of meeting requirements of 160 million bits per 95 min orbit with a bit error rate of less than 0.00001 for data. The system will be supported by the Tracking and Data Relay Satellite System of the Space Tracking and Data Network. The on-board system includes a general purpose computer that controls the vehicle as a stable observation platform and the array of instruments used for data collection. The ground-based system comprises a Mission Operations Center (MOC), a Science Institute where instrument data is processed, and a communications service for the space and point-to-point data flow. The allocation of hardware and software between on-board and ground-based components to achieve design objectives of maximum flexibility at minimum cost is discussed.

Hope, G. R., Jr.↗

NASA's Pilot Land Data System development program

The NASA Pilot Land Data System (PLDS) project is intended to enhance the effectiveness of data processing capabilities used by researchers applying remote sensing data in land science research. Two sites in the centerminous U.S. have been selected as study areas scanned by Landsat, Nimbus and GOES instruments. The data will be analyzed by teams of researchers representing different fields of expertise. The PLDS program will explore data management, networking and communications, system access capabilities, land analysis software, special processes and overall systems engineerng. The data will be processed by researchers working interactively through remote supermicrocomputer workstations using a variety of operating systems and on-site software capabilities.

Price, R. D.↗