Search NASA⌕ Search

SEARCH · Search NASA

Results for “large data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,171 records · Page 65

Extracting Compositional Variation from THEMIS Data for Features with Large Topography on Mars Via Atmospheric Equalization

We have developed a means of equalizing the atmospheric signature in Mars Odyssey Thermal Emission Imaging System (THEMIS) infrared data over regions with large topography such as the Valles Marineris (VM). This equalization allows for the analysis of compositional variations in regions that previously have been difficult to study because of the large differences in atmospheric path length that result from large changes in surface elevation. Specifically, our motivation for this study is to examine deposits that are small at the scales observable by the Thermal Emission Spectrometer (TES) onboard Mars Global Surveyor, but which are more readily resolved with THEMIS.

Anderson, F. S.↗

Improved hydrogeophysical characterization and monitoring through parallel modeling and inversion of time-domain resistivity andinduced-polarization data

Electrical geophysical methods have found wide use in the growing discipline of hydrogeophysics, both for characterizing the electrical properties of the subsurface, and for monitoring subsurface processes in terms of the spatiotemporal changes in subsurface conductivity, chargeability, and source currents they govern. Current multichannel and multielectrode data collections systems are able to collect large amounts of data in relatively short periods of time. However, practitioners are often unable to fully utilize these large data sets and the information they contain due to the processing limitations of standard desktop computers. This limitation can be addressed by utilizing the storage and processing capabilities of high-performance parallel computing environments. We present a parallel distributed-memory forward and inverse modeling algorithm for analyzing resistivity and time-domain induced polarization data. The primary components of the parallel computations include distributed computation of the pole solutions in forward mode, distributed storage and computation of the Jacobian matrix in inverse mode, and parallel execution of the inverse equation solver. We demonstrate the corresponding parallel code for three efforts: (1) resistivity characterization of the Hanford 300 Area Integrated Field Research Challenge site in Hanford, WA; (2) resistivity characterization of a volcanic island in the southern Tyrrhenian Sea in Italy; and (3) resistivity and IP monitoring of biostimulation at a superfund site in Brandywine, MD. Inverse analysis of each of these data sets would be limited (or impossible) in a standard serial computing environment which underscores the need for high-performance computing to fully utilize the potential of electrical geophysical methods in hydrogeophysical applications.

Hanford IFRC↗

Improved hydrogeophysical characterization and monitoring through parallel modeling and inversion of time-domain resistivity and induced-polarization data

Electrical geophysical methods have found wide use in the growing discipline of hydrogeophysics, both for characterizing the electrical properties of the subsurface, and for monitoring subsurface processes in terms of the spatiotemporal changes in subsurface conductivity, chargeability, and source currents they govern. Current multichannel and multielectrode data collections systems are able to collect large amounts of data in relatively short periods of time. However, practitioners are often unable to fully utilize these large data sets and the information they contain due to the processing limitations of standard desktop computers. This limitation can be addressed by utilizing the storage and processing capabilities of high-performance parallel computing environments. We present a parallel distributed-memory forward and inverse modeling algorithm for analyzing resistivity and time-domain induced polarization data. The primary components of the parallel computations include distributed computation of the pole solutions in forward mode, distributed storage and computation of the Jacobian matrix in inverse mode, and parallel execution of the inverse equation solver. We demonstrate the corresponding parallel code for three efforts: (1) resistivity characterization of the Hanford 300 Area Integrated Field Research Challenge site in Hanford, WA; (2) resistivity characterization of a volcanic island in the southern Tyrrhenian Sea in Italy; and (3) resistivity and IP monitoring of biostimulation at a superfund site in Brandywine, MD. Inverse analysis of each of these data sets would be limited (or impossible) in a standard serial computing environment which underscores the need for high-performance computing to fully utilize the potential of electrical geophysical methods in hydrogeophysical applications.

58 GEOSCIENCES↗

A Self-Evolution Data Fusion Platform for Large-Scale Water Models

Focal Area: Data acquisition and assimilation enabled by machine learning (ML), artificial intelligence (AI), and advanced methods including experimental/network design/optimization, unsupervised learning (deep learning), leveraging advanced hardware (e.g., edge computing). This development is to enable solving the science questions regarding the human and climatic factors that interact with and drive global water scarcity.

54 ENVIRONMENTAL SCIENCES↗

Hybrid methods for cybersecurity analysis :

Early 2010 saw a signi cant change in adversarial techniques aimed at network intrusion: a shift from malware delivered via email attachments toward the use of hidden, embedded hyperlinks to initiate sequences of downloads and interactions with web sites and network servers containing malicious software. Enterprise security groups were well poised and experienced in defending the former attacks, but the new types of attacks were larger in number, more challenging to detect, dynamic in nature, and required the development of new technologies and analytic capabilities. The Hybrid LDRD project was aimed at delivering new capabilities in large-scale data modeling and analysis to enterprise security operators and analysts and understanding the challenges of detection and prevention of emerging cybersecurity threats. Leveraging previous LDRD research e orts and capabilities in large-scale relational data analysis, large-scale discrete data analysis and visualization, and streaming data analysis, new modeling and analysis capabilities were quickly brought to bear on the problems in email phishing and spear phishing attacks in the Sandia enterprise security operational groups at the onset of the Hybrid project. As part of this project, a software development and deployment framework was created within the security analyst work ow tool sets to facilitate the delivery and testing of new capabilities as they became available, and machine learning algorithms were developed to address the challenge of dynamic threats. Furthermore, researchers from the Hybrid project were embedded in the security analyst groups for almost a full year, engaged in daily operational activities and routines, creating an atmosphere of trust and collaboration between the researchers and security personnel. The Hybrid project has altered the way that research ideas can be incorporated into the production environments of Sandias enterprise security groups, reducing time to deployment from months and years to hours and days for the application of new modeling and analysis capabilities to emerging threats. The development and deployment framework has been generalized into the Hybrid Framework and incor- porated into several LDRD, WFO, and DOE/CSL projects and proposals. And most importantly, the Hybrid project has provided Sandia security analysts with new, scalable, extensible analytic capabilities that have resulted in alerts not detectable using their previous work ow tool sets.

Dunlavy, Daniel M.↗

Avionic expert systems

At the heart of any intelligent flight control system, there is a knowledge based expert system. The efficiency of these knowledge bases is one of the major factors in the success of aviation and space control systems. In the future, the speed and the capabilities of the expert system and their underlying data base(s) will be the limiting factors in the ability to build more accurate real time space controllers. A methodology is proposed for design and construction of such expert systems. It is noted that existing expert systems are inefficient (slow) in dealing with nontrivial real world situations that involve a vast collection of data. However, current data bases, which are fast in handling large amounts of data, cannot carry out intelligent tasks normally expected from an expert system. The system presented provides the power of deduction (reasoning) along with the efficient mechanisms for management of large data bases. In the system, both straight forward evaluation procedures and sophisticated inference mechanisms coexist. The design methodology is based on mathematics and logic, which ensures the correctness of the final product.

Golshani, Forouzan↗

Meridional flow in the solar convection zone. I. Measurements from gong data

Large-scale plasma flows in the Sun's convection zone likely play a major role in solar dynamics on decadal timescales. In particular, quantifying meridional motions is a critical ingredient for understanding the solar cycle and the transport of magnetic flux. Because the signal of such features can be quite small in deep solar layers and be buried in systematics or noise, the true meridional velocity profile has remained elusive. We perform time-distance helioseismology measurements on several years worth of Global Oscillation Network Group Doppler data. A spherical harmonic decomposition technique is applied to a subset of acoustic modes to measure travel-time differences to try to obtain signatures of meridional flows throughout the solar convection zone. Center-to-limb systematics are taken into account in an intuitive yet ad hoc manner. Travel-time differences near the surface that are consistent with a poleward flow in each hemisphere and are similar to previous work are measured. Additionally, measurements in deep layers near the base of the convection zone suggest a possible equatorward flow, as well as partial evidence of a sign change in the travel-time differences at mid-convection zone depths. This analysis on an independent data set using different measurement techniques strengthens recent conclusions that the convection zone may have multiple 'cells' of meridional flow. The results may challenge the common understanding of one large conveyor belt operating in the solar convection zone. Further work with helioseismic inversions and a careful study of systematic effects are needed before firm conclusions of these large-scale flow structures can be made.

79 ASTRONOMY AND ASTROPHYSICS↗

Practical aspects of on-orbit modal identification using free-decay data

Future large space structures such as Space Station Freedom can be tested as a total structure on Earth. Size, zero g design, and the existing atmosphere conflict with traditional structural dynamic testing. On-orbit modal identification will become necessary. Practical aspects of performing such tests using time domain analysis of free decay data are discussed. The effects of environmental constraints, structural characteristics, and excitation and sensing are reviewed. A recent laboratory application and sensing are reviewed. In this test, an on-orbit experiment is simulated using free decay data and a limited number of excitation and measurement points. The test article is dynamically similar to the truss/solar arrays of Space Station. The identified modal parameters from this simulation correlate well, though not uniquely, with those obtained in a complete modal survey. Practical difficulties in performing the correlation are illustrated. Model parameters are identified with the Eigensystem Realization Algorithm.

Schenk, Axel↗

Parametric Analysis of a Hover Test Vehicle using Advanced Test Generation and Data Analysis

Large complex aerospace systems are generally validated in regions local to anticipated operating points rather than through characterization of the entire feasible operational envelope of the system. This is due to the large parameter space, and complex, highly coupled nonlinear nature of the different systems that contribute to the performance of the aerospace system. We have addressed the factors deterring such an analysis by applying a combination of technologies to the area of flight envelop assessment. We utilize n-factor (2,3) combinatorial parameter variations to limit the number of cases, but still explore important interactions in the parameter space in a systematic fashion. The data generated is automatically analyzed through a combination of unsupervised learning using a Bayesian multivariate clustering technique (AutoBayes) and supervised learning of critical parameter ranges using the machine-learning tool TAR3, a treatment learner. Covariance analysis with scatter plots and likelihood contours are used to visualize correlations between simulation parameters and simulation results, a task that requires tool support, especially for large and complex models. We present results of simulation experiments for a cold-gas-powered hover test vehicle.

Gundy-Burlet, Karen↗

Analysis of large system black box verification test data

Issues regarding black box, large systems verification are explored. It begins by collecting data from several testing teams. An integrated database containing test, fault, repair, and source file information is generated. Intuitive effectiveness measures are generated using conventional black box testing results analysis methods. Conventional analysts methods indicate that the testing was effective in the sense that as more tests were run, more faults were found. Average behavior and individual data points are analyzed. The data is categorized and average behavior shows a very wide variation in number of tests run and in pass rates (pass rates ranged from 71 percent to 98 percent). The 'white box' data contained in the integrated database is studied in detail. Conservative measures of effectiveness are discussed. Testing efficiency (ratio of repairs to number of tests) is measured at 3 percent, fault record effectiveness (ratio of repairs to fault records) is measured at 55 percent, and test script redundancy (ratio of number of failed tests to minimum number of tests needed to find the faults) ranges from 4.2 to 15.8. Error prone source files and subsystems are identified. A correlational mapping of test functional area to product subsystem is completed. A new adaptive testing process based on real-time generation of the integrated database is proposed.

Clapp, Kenneth C.↗

Impact of small-crack effects on design-life calculations

The potential impact of the observed small-crack-effect in 2024-T3 aluminum alloy on calculated crack-growth lives is described. The significance of the small-crack effect is assessed by comparing lives computed using only large-crack data to those computed using a combined small- and large-crack data base for constant-amplitude (R = -1 and 0) and fighter-wing spectrum loading (FALSTAFF) conditions. Based on the life calculations, the small-crack effect would have no impact on life analyses that assume an initial crack larger than about 0.3 mm; only a small impact on life analyses that assume an initial crack of 0.1 mm; but a large impact on life analyses that assume an initial crack of about 0.01 mm. When small-crack effects are taken into account, fatigue life analyses based solely on crack growth may provide a viable alternative to traditional two-part initiation-plus-crack-growth life analyses.

Phillips, E. P.↗

Optimizing checkpoint data placement with guaranteed burst buffer endurance in large-scale hierarchical storage systems

Non-volatile devices, such as SSDs, will be an integral part of the deepening storage hierarchy on large-scale HPC systems. These devices can be on the compute nodes as part of a distributed burst buffer service or they can be external. Wherever they are located in the hierarchy, one critical design issue is the SSD endurance under the write-heavy workloads, such as the checkpoint I/O for scientific applications. For these environments, it is widely assumed that checkpoint operations can occur once every 60 min and for each checkpoint step as much as half of the system memory can be written out. Unfortunately, for large-scale HPC applications, the burst buffer SSDs can be worn out much more quickly given the extensive amount of data written at every checkpoint step. One possible solution is to control the amount of data written by reducing the checkpoint frequency. However, a direct effect caused by reduced checkpoint frequency is the increased vulnerability window of system failures and therefore potentially wasted computation time, especially for large-scale compute jobs.

Computer Science↗

Diurnal and annual temperature variations in the 30-60 km region as indicated by statistical analysis of rocketsonde temperature data.

The relatively large amount of rocketsonde data now available for selected stations together with representative estimates of the solar radiation corrections has been utilized to establish the phases and amplitudes of the diurnal temperature oscillations from 30 to 60 km. Once the magnitude of the solar radiation errors and the diurnal temperature oscillations are established, these values are used to obtain new estimates of the actual mean temperatures for each calendar month.

Hoxit, L. R.↗

Parallelization and visual analysis of multidimensional fields: Application to ozone production, destruction, and transport in three dimensions

Atmospheric modeling is a grand challenge problem for several reasons, including its inordinate computational requirements and its generation of large amounts of data concurrent with its use of very large data sets derived from measurement instruments like satellites. In addition, atmospheric models are typically run several times, on new data sets or to reprocess existing data sets, to investigate or reinvestigate specific chemical or physical processes occurring in the earth's atmosphere, to understand model fidelity with respect to observational data, or simply to experiment with specific model parameters or components.

Schwan, Karsten↗

Distributed and cloud-based multi-model analytics experiments on large volumes of climate change data in the earth system grid federation eco-system

A case study on climate models intercomparison data analysis addressing several classes of multi-model experiments is being implemented in the context of the EU H2020 INDIGO-DataCloud project. Such experiments require the availability of large amount of data (multi-terabyte order) related to the output of several climate models simulations as well as the exploitation of scientific data management tools for large-scale data analytics. More specifically, the paper discusses in detail a use case on precipitation trend analysis in terms of requirements, architectural design solution, and infrastructural implementation. The experiment has been tested and validated on CMIP5 datasets, in the context of a large scale distributed testbed across EU and US involving three ESGF sites (LLNL, ORNL, and CMCC) and one central orchestrator site (PSNC).

Fiore, S.↗

Bulk Data Movement for Climate Dataset: Efficient Data Transfer Management with Dynamic Transfer Adjustment

Many scientific applications and experiments, such as high energy and nuclear physics, astrophysics, climate observation and modeling, combustion, nano-scale material sciences, and computational biology, generate extreme volumes of data with a large number of files. These data sources are distributed among national and international data repositories, and are shared by large numbers of geographically distributed scientists. A large portion of data is frequently accessed, and a large volume of data is moved from one place to another for analysis and storage. One challenging issue in such efforts is the limited network capacity for moving large datasets to explore and manage. The Bulk Data Mover (BDM), a data transfer management tool in the Earth System Grid (ESG) community, has been managing the massive dataset transfers efficiently with the pre-configured transfer properties in the environment where the network bandwidth is limited. Dynamic transfer adjustment was studied to enhance the BDM to handle significant end-to-end performance changes in the dynamic network environment as well as to control the data transfers for the desired transfer performance. We describe the results from the BDM transfer management for the climate datasets. We also describe the transfer estimation model and results from the dynamic transfer adjustment.

97 MATHEMATICS AND COMPUTING↗

Cost and performance characteristics of data system configurations for processing remotely sensed data

Some alternative approaches to constructing a large remote-sensing data system are explored. The cost and performance implications of using a collection of 'small' computers versus using one large computer are examined. Several architectures and associated costs for the large data system supporting a single data center are presented. Recurring cost factors (maintenance and operations) currently slightly favor the single large-machine architecture, but other factors may dictate the choice of one of the two multimachine architectures discussed.

Gregor, P. J.↗

Modelling Z→TT processes in ATLAS with T-embedded Z →μμ data

We describe the concept, technical realisation and validation of a largely data-driven method to model events with Z→ττ decays. In Z→μμ events selected from proton-proton collision data recorded at √s=8 TeV with the ATLAS experiment at the LHC in 2012, the Z decay muons are replaced by τ leptons from simulated Z →ττ decays at the level of reconstructed tracks and calorimeter cells. The τ lepton kinematics are derived from the kinematics of the original muons. Thus, only the well-understood decays of the Z boson and τ leptons as well as the detector response to the τ decay products are obtained from simulation. All other aspects of the event, such as the Z boson and jet kinematics as well as effects from multiple interactions, are given by the actual data. This so-called τ-embedding method is particularly relevant for Higgs boson searches and analyses in ττ final states, where Z→ττ decays constitute a large irreducible background that cannot be obtained directly from data control samples. In this paper, we discuss the relevant concepts based on the implementation used in the ATLAS Standard Model H→ττ analysis of the full datataset recorded during 2011 and 2012.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗