Search NASA⌕ Search

SEARCH · Search NASA

Results for “large data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34

Recovery Act: SeaMicro Volume Server Power Reduction Research Development

Cloud data centers are projected to be the fastest growing segment of the server market through 2015, according to IDC. Increasingly people and businesses rely on the Cloud to deliver digital content quickly and efficiently. Recovery Act funding from the Department of Energy has helped SeaMicro's technologies enhance the total cost of operation, performance and energy efficiency in large data center and Cloud environments. SeaMicro's innovative supercomputer fabric connects thousands of processor cores, memory, storage and input/output traffic. The company's fabric supports multiple processor instruction sets. Current systems featuring SeaMicro technology typically use one quarter the power and take one sixth the space of traditional servers with the same compute performance, yet deliver up to 12 times the bandwidth per core. Mozilla and eHarmony are two customers successfully using SeaMicro's technology. Numerous non-public customers have been successfully using the SeaMicro product in test and production facilities. As a result of the Recovery Act funding from the U.S. Department of Energy, more than 50 direct jobs were created at SeaMicro. To date, they primarily have been high-value, engineering jobs. Hardware, software and manufacturing engineering positions have been created, as well as sales and sales engineering. The positions have allowed SeaMicro to significantly accelerate engineering development and accelerate commercialization. As a result, commercialization and delivery to market are months ahead of initial schedule. Additional jobs were indirectly created through the development of the SeaMicro product. Through many years of research and hard work prior to receipt of public funding, SeaMicro was awarded 2 patents for its work. SeaMicro's product led the way for industry leaders to reconsider the market for low power servers and create new product lines. With valuable support of the U.S. Department of Energy and through SeaMicro's product, the market has been reshaped by the company's unique approach and ground breaking technology.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Calculating the dissociation chemistry and equation of state properties of materials [Slides]

Many experimental techniques are accurate enough to reveal glaring weaknesses in the material models used by physics codes to design them. This is requiring ever more stringent equation of state (EOS) development. Formerly, EOS models were built using limited gas gun shock data and a few general physics assumptions. With the ever increasing computer power available, we began using density functional theory (DFT) to approximate other EOS regimes such as the principal isentrope, critical point, and sometimes melt. With Sequoia, and only because of Sequoia’s capacity, we are now calculating a limited range, general EOS table and then deriving the above EOS properties based on that table, often on a shorter time frame and more thoroughly than we used to compute just the EOS sections listed above. The first project was to calculate a limited range EOS for CO 2 and specifically track the dissociated species present at each density and temperature. We would not see all of the possible species due to our small sample size and limited time, however, we should see the dominant species and general trends. This work was done to support a new, chemistry aware EOS model that is still under development at LANL. The second project was done for two reasons. The first is LANL and SNL are developing a new amorphous SiO 2 EOS for use in hydrocodes. There is extensive principal Hugoniot and isentrope data, but very little lower density data. There is also no real estimate of the critical point so we found the approximate value of that as well. The second reason for lower density SiO 2 is to test a new method for calculating the Hugoniot of porous materials. Because aerogel (low density SiO 2 ) is used extensively in many shock experiments, there was a large data set to compare with. As can be seen in the figure, the new method appears to work well and is tracking the porous Hugoniot within the experimental error bars (not shown). Finally, SNL is developing a new EOS for LiF because we were seeing discrepancies with the SESAME table. DFT has some issues calculating EOS values for LiF, so we will make some corrections, however, our first attempt appears to have very good results which confirm several experimentally seen properties, as seen on the previous slide.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Spaceflight Operations Services Grid Prototype

NASA over the years has developed many types of technologies and conducted various types of science resulting in numerous variations of operations, data and applications. For example, operations range from deep space projects managed by JPL, Saturn and Shuttle operations managed from JSC and KSC, ISS science operations managed from MSFC and numerous low earth orbit satellites managed from GSFC that are varied and intrinsically different but require many of the same types of services to fulfill their missions. Also, large data sets (databases) of Shuttle flight data, solar system projects and earth observing data exist which because of their varied and sometimes outdated technologies are not and have not been fully examined for additional information and knowledge. Many of the applications/systems supporting operational services e.g. voice, video, telemetry and commanding, are outdated and obsolete. The vast amounts of data are located in various formats, at various locations and range over many years. The ability to conduct unified space operations, access disparate data sets and to develop systems and services that can provide operational services does not currently exist in any useful form. In addition, adding new services to existing operations is generally expensive and with the current budget constraints not feasible on any broad level of implementation. To understand these services a discussion of each one follows. The Spaceflight User-based Services are those services required to conduct space flight operations. Grid Services are those Grid services that will be used to overcome, through middleware software, some or all the problems that currently exists. In addition, Network Services will be discussed briefly. Network Services are crucial to any type of remedy and are evolving adequately to support any technology currently in development.

Bradford, Robert N.↗

Characterization of AIRS temperature and water vapor measurement capability using correlative observations

In this presentation we address several fundamental issues in the measurement of temperature and water vapor by AIRS: accuracy, precision, vertical resolution and biases as a function of cloud amount. We use two correlative data sources. First we compare AIRS total water vapor with that from the Advanced microwave Sounding Radiometer for EOS (AMSR-E) instrument, also onboard the Aqua spacecraft. AMSRE uses a mature methodology with a heritage including the operational Special Sensor Microwave Imager (SSM/I) instruments. AIRS and AMSR-E observations are collocated and simultaneous, providing a very large data set for comparison: about 200,000 over-ocean matches daily. We show small cloud-dependent biases between AIRS and AMSR-E total water vapor for several oceanic regions. Our second correlative data source is several hundred dedicated radiosondes launched during AIRS overpasses.

meteorology↗

EMGeo 3.0

EMGeo 3.0 an algorithm that improves both the computational capabilities of joint 3D electromagnetic, EM and magnetotelluric and acoustic seismic wavefield simulation and inverse modeling. This seismic wavefield module requires that data be transformed first to the Laplace-Fourier Domain before processing. The inverse modeling is based upon non-liner conjugated gradients and 3D finite differences approximations of the seismic, EM and MT wavefields. Improved modeling efficiencies are obtain by separating the modeling grid from the simulation grid. This grid separation method allows for treatment of very large data sets and imaging volumes. Further computational efficiency is obtained by combining different levels of parallezation using the Message Passing Interface (MPI). Bound constraints are employed in the imaging process to insure stability. Additional acceleration of the inverse modeling is achieved by preconditioning the conjugate gradient optimizer using an approximate Hessian. The algorithm includes improved capabilities to accurately treat models that exhibit transverse anisotropy in the electrical conductivity. However, the seismic acoustic velocity is assumed to be isotropic. Models exhibiting topography and bathymetry can be treated. The software also includes a set of pre and post processing tools for designing input model meshes and data plotting.

Gregory Newman, Michael Commer↗

Contentious relationships in phylogenomic studies can be driven by a handful of genes

Phylogenomic studies have resolved countless branches of the tree of life, but remain strongly contradictory on certain, contentious relationships. Here, we use a maximum likelihood framework to quantify the distribution of phylogenetic signal among genes and sites for 17 contentious branches and 6 well-established control branches in plant, animal and fungal phylogenomic data matrices. We find that resolution in some of these 17 branches rests on a single gene or a few sites, and that removal of a single gene in concatenation analyses or a single site from every gene in coalescence-based analyses diminishes support and can alter the inferred topology. These results suggest that tiny subsets of very large data matrices drive the resolution of specific internodes, providing a dissection of the distribution of support and observed incongruence in phylogenomic analyses. We submit that quantifying the distribution of phylogenetic signal in phylogenomic data is essential for evaluating whether branches, especially contentious ones, are truly resolved. In conclusion, we offer one detailed example of such an evaluation for the controversy regarding the earliest-branching metazoan phylum, for which examination of the distributions of gene-wise and site-wise phylogenetic signal across eight data matrices consistently supports ctenophores as the sister group to all other metazoans.

59 BASIC BIOLOGICAL SCIENCES↗

SOLAR FLARE PREDICTION USING SDO/HMI VECTOR MAGNETIC FIELD DATA WITH A MACHINE-LEARNING ALGORITHM

We attempt to forecast M- and X-class solar flares using a machine-learning algorithm, called support vector machine (SVM), and four years of data from the Solar Dynamics Observatory's Helioseismic and Magnetic Imager, the first instrument to continuously map the full-disk photospheric vector magnetic field from space. Most flare forecasting efforts described in the literature use either line-of-sight magnetograms or a relatively small number of ground-based vector magnetograms. This is the first time a large data set of vector magnetograms has been used to forecast solar flares. We build a catalog of flaring and non-flaring active regions sampled from a database of 2071 active regions, comprised of 1.5 million active region patches of vector magnetic field data, and characterize each active region by 25 parameters. We then train and test the machine-learning algorithm and we estimate its performances using forecast verification metrics with an emphasis on the true skill statistic (TSS). We obtain relatively high TSS scores and overall predictive abilities. We surmise that this is partly due to fine-tuning the SVM for this purpose and also to an advantageous set of features that can only be calculated from vector magnetic field data. We also apply a feature selection algorithm to determine which of our 25 features are useful for discriminating between flaring and non-flaring active regions and conclude that only a handful are needed for good predictive abilities.

79 ASTRONOMY AND ASTROPHYSICS↗

RESULTS OF THE LICK OBSERVATORY SUPERNOVA SEARCH FOLLOW-UP PHOTOMETRY PROGRAM: BVRI LIGHT CURVES OF 165 TYPE Ia SUPERNOVAE

We present BVRI light curves of 165 Type Ia supernovae (SNe Ia) from the Lick Observatory Supernova Search follow-up photometry program from 1998 through 2008. Our light curves are typically well sampled (cadence of 3-4 days) with an average of 21 photometry epochs. We describe our monitoring campaign and the photometry reduction pipeline that we have developed. Comparing our data set to that of Hicken et al., with which we have 69 overlapping supernovae (SNe), we find that as an ensemble the photometry is consistent, with only small overall systematic differences, although individual SNe may differ by as much as 0.1 mag, and occasionally even more. Such disagreement in specific cases can have significant implications for combining future large data sets. We present an analysis of our light curves which includes template fits of light-curve shape parameters useful for calibrating SNe Ia as distance indicators. Assuming the B - V color of SNe Ia at 35 days past maximum light can be presented as the convolution of an intrinsic Gaussian component and a decaying exponential attributed to host-galaxy reddening, we derive an intrinsic scatter of {sigma} = 0.076 {+-} 0.019 mag, consistent with the Lira-Phillips law. This is the first of two papers, the second of which will present a cosmological analysis of the data presented herein.

79 ASTRONOMY AND ASTROPHYSICS↗

Caloris Basin - An enhanced source for potassium in Mercury's atmosphere

Enhanced abundances of neutral K in the atmosphere of Mercury have been found above the longitude range containing Caloris Basin. Results of a large data set including six elongations of the planet between June 1986 and January 1988 show typical K column abundances of about 5.4 x 10 to the 8th K atmos/sq cm. During the observing period in October 1987, when Caloris Basin was in view, the typical K column was about 2.7 x 10 to the 9th K atoms/sq cm. Another large value was seen over the Caloris antipode in January 1988. This enhancement is consistent with an increased source of K from the well-fractured crust and regolith associated with this large impact basin. The phenomenon is localized because at most solar angles, thermal alkali atoms cannot move more than a few hundred kilometers from their source before being lost to ionization by solar ultraviolet radiation.

Sprague, Ann L.↗

Linear Spectral Analysis of Plume Emissions Using an Optical Matrix Processor

Plume spectrometry provides a means to monitor the health of a burning rocket engine, and optical matrix processors provide a means to analyze the plume spectra in real time. By observing the spectrum of the exhaust plume of a rocket engine, researchers have detected anomalous behavior of the engine and have even determined the failure of some equipment before it would normally have been noticed. The spectrum of the plume is analyzed by isolating information in the spectrum about the various materials present to estimate what materials are being burned in the engine. Scientists at the Marshall Space Flight Center (MSFC) have implemented a high resolution spectrometer to discriminate the spectral peaks of the many species present in the plume. Researchers at the Stennis Space Center Demonstration Testbed Facility (DTF) have implemented a high resolution spectrometer observing a 1200-lb. thrust engine. At this facility, known concentrations of contaminants can be introduced into the burn, allowing for the confirmation of diagnostic algorithms. While the high resolution of the measured spectra has allowed greatly increased insight into the functioning of the engine, the large data flows generated limit the ability to perform real-time processing. The use of an optical matrix processor and the linear analysis technique described below may allow for the detailed real-time analysis of the engine's health. A small optical matrix processor can perform the required mathematical analysis both quicker and with less energy than a large electronic computer dedicated to the same spectral analysis routine.

Gary, C. K.↗

An Orbital Meteoroid Stream Survey Using the Southern Argentina Agile Meteor Radar (SAAMER) Based on a Wavelet Approach

Over a million individually measured meteoroid orbits were collected with the Southern Argentina Agile MEteor Radar (SAAMER) between 2012-2015. This provides a robust statistical database to perform an initial orbital survey of meteor showers in the Southern Hemisphere via the application of a 3D wavelet transform. The method results in a composite year from all 4 years of data, enabling us to obtain an undisturbed year of meteor activity with more than one thousand meteors per day. Our automated meteor shower search methodology identified 58 showers. Of these showers, 24 were associated with previously reported showers from the IAU catalogue while 34 showers are new and not listed in the catalogue. Our searching method combined with our large data sample provides unprecedented accuracy in measuring meteor shower activity and description of shower characteristics in the Southern Hemisphere. Using simple modeling and clustering methods we also propose potential parent bodies for the newly discovered showers.

Meteor showers↗

Using Cloud-Based Storage Technologies for Earth Science Data

Cloud based infrastructure may offer several key benefits of scalability, built in redundancy and reduced total cost of ownership as compared with a traditional data center approach. However, most of the tools and software systems developed for NASA data repositories were not developed with a cloud based infrastructure in mind and do not fully take advantage of commonly available cloud-based technologies. Object storage services are provided through all the leading public (Amazon Web Service, Microsoft Azure, Google Cloud, etc.) and private (Open Stack) clouds, and may provide a more cost-effective means of storing large data collections online. We describe a system that utilizes object storage rather than traditional file system based storage to vend earth science data. The system described is not only cost effective, but shows superior performance for running many different analytics tasks in the cloud. To enable compatibility with existing tools and applications, we outline client libraries that are API compatible with existing libraries for HDF5 and NetCDF4. Performance of the system is demonstrated using clouds services running on Amazon Web Services.

Data↗

Computational Systems Biology

Computational systems biology is the term that we use to describe computational methods to identify, infer, model, and store relationships between the molecules, pathways, and cells (“systems”) involved in a living organism. Based on this definition, the field of computational systems biology has been in existence for some time. However, the recent confluence of high throughput methodology for biological data gathering, genome-scale sequencing and computational processing power has driven a reinvention and expansion of this field. The expansions include not only modeling of small metabolic{Ishii, 2004 #1129; Ekins, 2006 #1601; Lafaye, 2005 #1744} and signaling systems{Stevenson-Paulik, 2006 #1742; Lafaye, 2005 #1744} but also modeling of the relationships between biological components in very large systems, incluyding whole cells and organisms {Ideker, 2001 #1124; Pe'er, 2001 #1172; Pilpel, 2001 #393; Ideker, 2002 #327; Kelley, 2003 #1117; Shannon, 2003 #1116; Ideker, 2004 #1111}{Schadt, 2003 #475; Schadt, 2006 #1661}{McDermott, 2002 #878; McDermott, 2005 #1271}. Generally these models provide a general overview of one or more aspects of these systems and leave the determination of details to experimentalists focused on smaller subsystems. The promise of such approaches is that they will elucidate patterns, relationships and general features that are not evident from examining specific components or subsystems. These predictions are either interesting in and of themselves (for example, the identification of an evolutionary pattern), or are interesting and valuable to researchers working on a particular problem (for example highlight a previously unknown functional pathway). Two events have occurred to bring about the field computational systems biology to the forefront. One is the advent of high throughput methods that have generated large amounts of information about particular systems in the form of genetic studies, gene expression analyses (both protein and mRNA) and metabolomics. With such tools, research to consider systems as a whole are being conceived, planned and implemented experimentally on an ever more frequent and wider scale. The other is the growth of computational processing power and tools. Methods to analyze large data sets of this kind are often computationally demanding and, as is the case in other areas, the field has benefited from continuing improvements in computational hardware and methods. The field of computational biology is very much like a telescope with two sequential lenses: one lens represents the biological data and the other represents a computational and/or mathematical model of the data. Both lenses must be properly coordinated to yield an image that reflects biological reality. This means that the design parameters for both lenses must be designed in concert to create a system that yields a model of the organism that provides both predictive and mechanistic information. The chapters in this book describe the construction of subcomponents of such a system. Computational systems biology is a rapidly evolving field and no single group of investigators has yet developed a compete system that integrates both data generation and data analysis in such a way so as to allow full and accurate modeling of any single biological organism. However, the field is rapidly moving in that direction. The chapters in this book represent a snapshot of the current methods being developed and used in the area of computational systems biology. Each method or database described within represents one or more steps on the path to a complete description of a biological system. How these tools will evolve and ultimately be integrated is an area of intense research and interest. We hope that readers of this book will be motivated by the chapters within and become involved in this exciting area of research.

59 BASIC BIOLOGICAL SCIENCES↗

Getting to the Core of PARAFAC2, A Nonnegative Approach

In this paper, the authors present a novel method of performing PARAFAC2 factorization of three-way data using a compact representation of that data. In the standard PARAFAC2 algorithm, two modes of the data are recovered directly during the decomposition while the third mode is returned as a transformation matrix, which is then used to rotate sets of orthogonal third-mode basis factors into interpretable factors. In our new method, the data are first decomposed into a core matrix and orthogonal factor loading matrices in the first two modes as well as sets of orthogonal factors in the third mode (as in standard PARAFAC2). The core matrix is then decomposed using a the standard PARAFAC2 strategy to produce transformation matrices in all three modes. The algorithm is particularly useful for very large data sets and essentially permits imposition of nonnegativity in all three modes.

97 MATHEMATICS AND COMPUTING↗

Online Visualization and Value Added Services of MERRA-2 Data at GES DISC

NASA climate reanalysis datasets from MERRA-2, distributed at the Goddard Earth Sciences Data and Information Services Center (GES DISC), have been used in broad research areas, such as climate variations, extreme weather, agriculture, renewable energy, and air quality, etc. The datasets contain numerous variables for atmosphere, land, and ocean, grouped into 95 products. The total archived volume is approximately 337 TB ( approximately 562K files) at the end of October 2017. Due to the large number of products and files, and large data volumes, it may be a challenge for a user to find and download the data of interest. The support team at GES DISC, working closely with the MERRA-2 science team, has created and is continuing to work on value added data services to best meet the needs of a broad user community. This presentation, using aerosol over Asia Monsoon as an example, provides an overview of the MERRA-2 data services at GES DISC, including: How to find the data? How many data access methods are provided? What are the best data access methods for me? How do download the subsetted (parameter, spatial, temporal) data and save in preferred spatial resolution and data format? How to visualize and explore the data online? In addition, we introduce a future online analytic tool designed for supporting application research, focusing on long-term hourly time-series data access and analysis.

Shen, Suhung↗

Data Mining and Analysis

The Data Mining project seeks to bring the capability of data visualization to NASA anomaly and problem reporting systems for the purpose of improving data trending, evaluations, and analyses. Currently NASA systems are tailored to meet the specific needs of its organizations. This tailoring has led to a variety of nomenclatures and levels of annotation for procedures, parts, and anomalies making difficult the realization of the common causes for anomalies. Making significant observations and realizing the connection between these causes without a common way to view large data sets is difficult to impossible. In the first phase of the Data Mining project a portal was created to present a common visualization of normalized sensitive data to customers with the appropriate security access. The tool of the visualization itself was also developed and fine-tuned. In the second phase of the project we took on the difficult task of searching and analyzing the target data set for common causes between anomalies. In the final part of the second phase we have learned more about how much of the analysis work will be the job of the Data Mining team, how to perform that work, and how that work may be used by different customers in different ways. In this paper I detail how our perspective has changed after gaining more insight into how the customers wish to interact with the output and how that has changed the product.

iss↗

Development of tools and techniques for momentum compression of fast rare isotopes

As part of our past research and development work, we have created and developed the LISE++ simulation code [Tar04, Tar08]. The LISE++ package was significantly extended with the addition of a Monte Carlo option that includes an option for calculating ion trajectories using a Taylor-series expansion up to fifth order, and implementation of the MOTER Monte Carlo code [Kow87] for ray tracing of the ions into the suite of LISE++ codes. The MOTER code was rewritten from FORTRAN into C++ and transported to the MS-Windows operating system. Extensive work went into the creation of a user-friendly interface for the code. An example of the graphical user interface created for the MOTER code is shown in the left panel of Figure 1 and the results of a typical calculation for the trajectories of particles that pass through the A1900 fragment separator are shown in the right panel. The MOTER code is presently included as part of the LISE++ package for downloading without restriction by the worldwide community. The LISE++ was extensively developed and generalized to apply to any projectile fragment separator during the early phase of this grant. In addition to the inclusion of the MOTER code, other important additions to the LISE++ code made during FY08/FY09 are listed. The LISE++ is distributed over the web (http://groups.nscl.msu.edu/lise ) and is available without charge to anyone by anonymous download, thus, the number of individual users is not recorded. The number of 'hits' on the servers that provide the LISE++ code is shown in Figure 3 for the last eight calendar years (left panel) along with the country from the IP address (right panel). The data show an increase in web-activity with the release of the new version of the program during the grant period and a worldwide impact. An important part of the proposed work carried out during FY07, FY08 and FY09 by a graduate student in the MSU Physics program was to benchmark the codes by comparison of detailed measurements to the LISE++ predictions. A large data set was obtained for fission fragments from the reaction of 238U ions at 81 MeV/u in a 92 mg/cm2 beryllium target with the A1900 projectile fragment separator. The data were analyzed and form the bulk of a Ph.D. dissertation that is nearing completion. The rich data set provides a number of benchmarks for the improved LISE++ code and only a few examples can be shown here. The primary information obtained from the measurements is the yield of the products as a function of mass, charge and momentum. Examples of the momentum distributions of individually identified fragments can be seen in Figures 2 and 4 along with comparisons to the predicted distributions. The agreement is remarkably good and indicates the general validity of the model of the nuclear reactions producing these fragments and of the higher order transmission calculations in the LISE++ code. The momentum distributions were integrated to provide the cross sections for the individual isotopes. As shown in Figure 5, there is good agreement with the model predictions although the observed cross sections are a factor of five or so higher in this case. Other comparisons of measured production cross sections from abrasion-fission reactions have been published by our group working at the NSCL during this period [Fol09] and through our collaboration with Japanese researchers working at RIKEN with the BigRIPS separator [Ohn08, Ohn10]. The agreement of the model predictions with the data obtained with two different fragment separators is very good and indicates the usefulness of the new LISE++ code.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

A Semiautomated Framework for Integrating Expert Knowledge into Disease Marker Identification

Background. The availability of large complex data sets generated by high throughput technologies has enabled the recent proliferation of disease biomarker studies. However, a recurring problem in deriving biological information from large data sets is how to best incorporate expert knowledge into the biomarker selection process. Objective. To develop a generalizable framework that can incorporate expert knowledge into data-driven processes in a semiautomated way while providing a metric for optimization in a biomarker selection scheme. Methods. The framework was implemented as a pipeline consisting of five components for the identification of signatures from integrated clustering (ISIC). Expert knowledge was integrated into the biomarker identification process using the combination of two distinct approaches; a distance-based clustering approach and an expert knowledge-driven functional selection. Results. The utility of the developed framework ISIC was demonstrated on proteomics data from a study of chronic obstructive pulmonary disease (COPD). Biomarker candidates were identified in a mouse model using ISIC and validated in a study of a human cohort. Conclusions. Expert knowledge can be introduced into a biomarker discovery process in different ways to enhance the robustness of selected marker candidates. Developing strategies for extracting orthogonal and robust features from large data sets increases the chances of success in biomarker identification.

Biomarker Identification↗