Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data visualization and analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,693 records · Page 94

A Unit Testing Framework for Scientific Legacy Code

Large-scale scientific applications play important roles in supporting research. However, it is often very expensive and time-consuming to make changes to, maintain and evolve the scientific code due to its complexity and poor programming skills of researchers. Therefore, in order to visualize scientific code architecture to optimize software design, understand undocumented source code, and analyze software flow and functionality, we first introduce a unit testing framework (UTF). Then, because such infrastructure's performance is very crucial in practical use since the scientific legacy applications simulate instances in a long period of time, we improve the UTF by applying Message Passing based Parallelization and parallel I/O operations. Furthermore, due to the scientific code has enormous state data and the I/O capacity on the server is limited, we apply in situ data analysis method to encounter fewer resource limitations, and adopt signal processing to greatly reduce data transfer. Last, we demonstrated the correctness and high-efficiency of our framework for legacy Earth model on Titan supercomputer.

97 MATHEMATICS AND COMPUTING↗

An affinity-structure database of helix-turn-helix: DNA complexes with a universal coordinate system

Molecular interactions between proteins and DNA molecules underlie many cellular processes, including transcriptional regulation, chromosome replication, and nucleosome positioning. Computational analyses of protein-DNA interactions rely on experimental data characterizing known protein-DNA interactions structurally and biochemically. While many databases exist that contain either structural or biochemical data, few integrate these two data sources in a unified fashion. Such integration is becoming increasingly critical with the rapid growth of structural and biochemical data, and the emergence of algorithms that rely on the synthesis of multiple data types to derive computational models of molecular interactions. We have developed an integrated affinity-structure database in which the experimental and quantitative DNA binding affinities of helix-turn-helix proteins are mapped onto the crystal structures of the corresponding protein-DNA complexes. This database provides access to: (i) protein-DNA structures, (ii) quantitative summaries of protein-DNA binding affinities using position weight matrices, and (iii) raw experimental data of protein-DNA binding instances. Critically, this database establishes a correspondence between experimental structural data and quantitative binding affinity data at the single basepair level. Furthermore, we present a novel alignment algorithm that structurally aligns the protein-DNA complexes in the database and creates a unified residue-level coordinate system for comparing the physico-chemical environments at the interface between complexes. Using this unified coordinate system, we compute the statistics of atomic interactions at the protein-DNA interface of helix-turn-helix proteins. We provide an interactive website for visualization, querying, and analyzing this database, and a downloadable version to facilitate programmatic analysis. Lastly, this database will facilitate the analysis of protein-DNA interactions and the development of programmatic computational methods that capitalize on integration of structural and biochemical datasets. The database can be accessed at http://ProteinDNA.hms.harvard.edu.

59 BASIC BIOLOGICAL SCIENCES↗

Summary of May 21st and 22nd Shear Campaign [Slides]

We have streaked imaging of both smooth and roughened foils in both Ti and Al at both early and late times. Further work will be needed to check if the signal is strong enough on all shots to extract reliable mix-widths. The initial test of the 3 slit streaked imaging setup was unsuccessful. Streaked images of a driven shots using the slit on the target resulted in low signal, while un-driven shots showed much higher signals. The working hypothesis is that the signal dropped due to slit closure on the target; the successful NIF setup used a much wider slit, on the order of 100 um instead of 20 um. We were able to get good streak data by switching back to a 20 um pinhole at the front of the SSCA and removing the slits from the targets. To obtain the best late-time streak data we had to overlap the two TIM4 BL groups (on the BL driver). We have sets of plan view radiographs for at least three different times for both smooth and roughened foils in both Ti and Al. There are visually identifiable difference between the plan view radiographs of the smooth and enhanced roughened foils. The enhanced roughening is apparent in the plan view images at early times and seems to persist as the dominant structure scale into late times. We have several streaked plan view images. Further analysis will be required to determine if this can be turned into a viable platform for turbulence studies. Signal strength on the Al streaked plan view looks promising.

Plasma Physics & Fusion Technology(70)↗

Measurements of Mode I Interlaminar Properties of Carbon Fiber Reinforced Polymers Using Digital Image Correlation

Numerical models based on cohesive zones are usually used to model and simulate the mechanical behavior of laminated carbon fiber reinforced polymers (CFRP) in automotive and aerospace applications and require different interlaminar properties. This work focuses on determining the interlaminar fracture toughness (G IC ) under Mode I loading of a double cantilever beam (DCB) specimen of unidirectional CFRP, serving as prototypical material. The novelty of this investigation is the improvement of the testing methodology by introducing digital image correlation (DIC) as an extensometer and this tool allows for crack growth measurement, phenomenological visualization and quantification of various material responses to Mode I loading. Multiple methodologies from different international standards and other common techniques are compared for the determination of the evolution of G IC as crack resistance curves (R-curves). The primarily metrological sources of uncertainty, in contrast to material specific related uncertainties, are discussed through a simple sensitivity analysis. Additionally, the current work offers a detailed insight into the constraints and assumptions to allow exploration of different methods for the determination of material properties using the DIC measured data. The main aim is an improvement of the measurement technique and an increase in the reliability of measured data during static testing, in advance of future rate dependent testing for crashworthiness simulations.

36 MATERIALS SCIENCE↗

Evaluation of artificial neural network performance for classification of potato plants infected with potato virus Y using spectral data on multiple varieties and genotypes

Potato virus Y (Potyviridae, PVY) is a plant virus that poses a significant threat to potato producers on a global basis. The pathogen has disrupted seed potato supplies and negatively impacted yield and quality of commercial potato crops. The potato industry currently manages PVY infection levels via insecticide applications, regional seed certification programs that rely on field scouting to visually assess individual plants for infection status, and destructive and costly tissue sampling coupled with laboratory assays. Despite these efforts, PVY continues to confound potato industry stakeholders resulting in economic harm. Remote sensing and machine learning provide for the development of new tools to more accurately detect and spatially quantify PVY-infected plants versus the current state of the art. However, there is a need to understand how the occurrence of many different potato varieties impact the dynamics of developing models to detect potato plants impacted with PVY and their potential effectiveness. This study evaluates classification modelling outcomes using spectral datasets collected in different temporal and spatial environments (greenhouse and a production field) on multiple potato varieties consisting of labelled instances of plants infected with PVY and those not infected with the virus. A modelling framework was developed to support iterative modelling runs using artificial neural network (ANN) architectures configured as binary classifiers to develop sample populations to support statistical analysis on model performance using specific spectral subsets. When using spectral data to detect PVY-infected plants, ANN models achieved the highest mean accuracy of 0.894 on a single variety. Conversely, the same ANN model architecture only achieved a mean accuracy of 0.575 on a spectral data set representing 29 potato breeding lines. Additionally, statistical analysis indicates spectral regions including the red edge, near infrared and shortwave infrared contain more important spectral features for the ANN classifier introduced in this research.

60 APPLIED LIFE SCIENCES↗

SDAT implementation for the analysis of radioxenon β–γ coincidence spectra

The Standard Deconvolution Analysis Tool (SDAT) was developed for analysis of radioxenon β-γ coincidence spectra measured as part of the International Monitoring System (IMS) as defined in the Comprehensive Nuclear-Test-Ban Treaty (CTBT). The SDAT software analyzes each β-γ coincidence spectrum by fitting library vectors of each radionuclide of interest: 131mXe, 133mXe, 133Xe, and 135Xe. Detector background and radon are incorporated as optional components of the sample solution. Results are reported in mBq m-3. A new graphical user interface has been developed to facilitate ease of use and improve the data visualization. Automated energy vs. channel calibration algorithms were developed and implemented based on 137Cs β-γ coincidence spectra. Details on the user tool and testing are included.

Biegalski, S.↗

Development of Saturated Zone Three-Dimensional Initial Condition Plumes for the Composite Analysis and Cumulative Impacts Evaluation Modeling

The purpose of this environmental calculation file (ECF) is to document and present the methodology, input data, and results of extending two-dimensional (2-D) plume depictions documented in DOE/RL- 2017-66, Hanford Site Groundwater Monitoring for 2017, into three dimensions (3-D) for select contaminants of interest (COIs) in the 200-BP-5, 200-UP-1, 200-ZP-1, and 200-PO-1 Groundwater Operable Units at the Hanford Site. Plumes with sufficient available vertical profile data were interpolated in 3-D using the Leapfrog Geo®1 geologic modeling platform, which includes an interpolation engine for analyzing and visualizing 3-D data. Results of these interpolations are intended for use in developing inputs for transport modeling to support forecasts of Central Plateau contaminant plume fate and transport.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Phase 1 Development Report for the SESSA Toolkit.

The Site Exploitation System for Situational Awareness ( SESSA ) tool kit , developed by Sandia National Laboratories (SNL) , is a comprehensive de cision support system for crime scene data acquisition and Sensitive Site Exploitation (SSE). SESSA is an outgrowth of another SNL developed decision support system , the Building R estoration Operations Optimization Model (BROOM), a hardware/software solution for data acquisition, data management, and data analysis. SESSA was designed to meet forensic crime scene needs as defined by the DoD's Military Criminal Investigation Organiza tion (MCIO) . SESSA is a very comprehensive toolki t with a considerable amount of database information managed through a Microsoft SQL (Structured Query Language) database engine, a Geographical Information System (GIS) engine that provides comprehensive m apping capabilities, as well as a an intuitive Graphical User Interface (GUI) . An electronic sketch pad module is included. The system also has the ability to efficiently generate necessary forms for forensic crime scene investigations (e.g., evidence submittal, laboratory requests, and scene notes). SESSA allows the user to capture photos on site, and can read and generate ba rcode labels that limit transcription errors. SESSA runs on PC computers running Windows 7, but is optimized for touch - screen tablet computers running Windows for ease of use at crime scenes and on SSE deployments. A prototype system for 3 - dimensional (3 D) mapping and measur e ments was also developed to complement the SESSA software. The mapping system employs a visual/ depth sensor that captures data to create 3D visualizations of an interior space and to make distance measurements with centimeter - level a ccuracy. Output of this 3D Model Builder module provides a virtual 3D %22walk - through%22 of a crime scene. The 3D mapping system is much less expensive and easier to use than competitive systems. This document covers the basic installation and operation of th e SESSA tool kit in order to give the user enough information to start using the tool kit . SESSA is currently a prototype system and this documentation covers the initial release of the tool kit . Funding for SESSA was provided by the Department of Defense (D oD), Assistant Secretary of Defense for Research and Engineering (ASD(R&E)) Rapid Fielding (RF) organization. The project was managed by the Defense Forensic Science Center (DFSC) , formerly known as the U.S. Army Criminal Investigation Laboratory (USACIL) . ACKNOWLEDGEMENTS The authors wish to acknowledge the funding support for the development of the Site Exploitation System for Situational Awareness (SESSA) toolkit from the Department of Defense (DoD), Assistant Secretary of Defense for Research and Engineering (ASD(R&E)) Rapid Fielding (RF) organization. The project was managed by the Defense Forensic Science Center (DFSC) , formerly known as the U.S. Army Criminal Investigation Laboratory (USACIL). Special thanks to Mr. Garold Warner, of DFSC, who served as the Project Manager. Individuals that worked on the design, functional attributes, algorithm development, system arc hitecture, and software programming include: Robert Knowlton, Brad Melton, Robert Anderson, and Wendy Amai.

Knowlton, Robert G.↗

In-situ 4D visualization and analysis of temperature-driven creep in an oil shale propped fracture

Here, the proppant embedment due to creep in shales is a known issue affecting the useable lifetime of wells in unconventional oil and gas recovery. One of the factors influencing creep is the presence of organics, whose properties can be very sensitive to temperature. In this work we investigated for the first time the role of temperature-induced creep increase in proppant embedment in an organics-rich Green River oil shale sample via in-situ synchrotron X-ray micro-computed tomography. We observed that temperatures as low as 75 °C already induce fast creep, with a fracture aperture closing rate of 13 μm/h and a loss of fracture conductivity rate of 8.7%/h, due only to proppant embedment, in the measured interval at the first heating stage. Local displacement data analysis provided evidence for markedly plastic deformation around the proppant-shale contacts, in contrast with the brittle proppant embedment observed on more cemented and less organics-rich shales at room temperature. The results highlight how the problem of temperature-dependent mechanical behavior might be more important than previously thought, in shales with a high content in organics, and that in-situ micro-imaging techniques can play a key role in understanding the underlying mechanisms, contributing to solve creep-related problems associated with hydraulic fracturing in complex scenarios.

02 PETROLEUM↗

DRoP: Automated detection of conserved solvent‐binding sites on proteins

Abstract Water and ligand binding play critical roles in the structure and function of proteins, yet their binding sites and significance are difficult to predict a priori. Multiple solvent crystal structures (MSCS) is a method where several X‐ray crystal structures are solved, each in a unique solvent environment, with organic molecules that serve as probes of the protein surface for sites evolved to bind ligands, while the first hydration shell is essentially maintained. When superimposed, these structures contain a vast amount of information regarding hot spots of protein‐protein or protein‐ligand interactions, as well as conserved water‐binding sites retained with the change in solvent properties. Optimized mining of this information requires reliable structural data and a consistent, objective analysis tool. Detection of related solvent positions (DRoP) was developed to automatically organize and rank the water or small organic molecule binding sites within a given set of structures. It is a flexible tool that can also be used in conserved water analysis given multiple structures of any protein independent of the MSCS method. The DRoP output is an HTML format list of the solvent sites ordered by conservation rank in its population within the set of structures, along with renumbered and recolored PDB files for visualization and facile analysis. Here, we present a previously unpublished set of MSCS structures of bovine pancreatic ribonuclease A (RNase A) and use it together with published structures to illustrate the capabilities of DRoP.

Kearney, Bradley M.↗

Structural Study of Analogues of Titan’s Haze by Trapped Ion Mobility Coupled with a Fourier Transform Ion Cyclotron Mass Spectrometer

The aerosols present in the atmosphere of the Saturn’s moon Titan are of particular planetary science interest and several spacecraft missions are already allowed to gather spectroscopic data. Titan haze’s analogs, so-called tholins, were produced on earth to push forward the comprehension of their formation and properties. In this study, this highly complex mixture was analyzed here for the first time by trapped ion mobility spectrometry coupled to ultra-high resolution mass spectrometry (FTICR MS). Electrospray ionization revealed the characteristic CHN{sub x}-class components, with CHN{sub 5–6} and DBE 6–7 most abundant. Deploying specialized visualization, enabled by accurate mass measurements and elemental composition assignments, the adapted Kendrick mass defect analysis highlights the C{sub 2}H{sub 3}N homolog series, whereas the nitrogen-modified van Krevelen diagram exhibits a clear trend towards H/C 1.5 and N/C 0.5. More interestingly, the representation of m/z versus collision cross section (CCS) allowed hypothesizing a ramified N-PAH structural motif. State-of-the-art IMS is currently not able to resolve the isomeric continuum of ultra-complex mixtures; thus, peak parameters other than the CCS value are explored. As such, analyzing the mobility peak width versus m/z shows a linear increase in isomeric diversity between m/z 170 and 350 and a near plateau in diversity at higher m/z for the N-PAH-like structure. Due to the high complexity of the sample, these structural insights are only to be revealed by TIMS-FTICR MS. .

79 ASTRONOMY AND ASTROPHYSICS↗

On-the-fly data assessment for high-throughput x-ray diffraction measurements

Investment in brighter sources and larger and faster detectors has accelerated the speed of data acquisition at national user facilities. The accelerated data acquisition offers many opportunities for the discovery of new materials, but it also presents a daunting challenge. The rate of data acquisition far exceeds the current speed of data quality assessment, resulting in less than optimal data and data coverage, which in extreme cases forces recollection of data. Herein, we show how this challenge can be addressed through the development of an approach that makes routine data assessment automatic and instantaneous. By extracting and visualizing customized attributes in real time, data quality and coverage, as well as other scientifically relevant information contained in large data sets, is highlighted. Deployment of such an approach not only improves the quality of data but also helps optimize the usage of expensive characterization resources by prioritizing measurements of the highest scientific impact. We anticipate our approach will become a starting point for a sophisticated decision-tree that optimizes data quality and maximizes scientific content in real time through automation. Finally, with these efforts to integrate more automation in data collection and analysis, we can truly take advantage of the accelerating speed of data acquisition.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

SU-E-J-42: Evaluation of Fiducial Markers for Ultrasound and X-Ray Images Used for Motion Tracking in Pancreas SBRT

Purpose Ultrasound tracking of target motion relies on visibility of vascular and/or anatomical landmark. However this is challenging when the target is located far from vascular structures or in organs that lack ultrasound landmark structure, such as in the case of pancreas cancer. The purpose of this study is to evaluate visibility, artifacts and distortions of fusion coils and solid gold markers in ultrasound, CT, CBCT and kV images to identify markers suitable for real-time ultrasound tracking of tumor motion in SBRT pancreas treatment. Methods Two fusion coils (1mm × 5mm and 1mm × 10 mm) and a solid gold marker (0.8mm × 10mm) were embedded in a tissue–like ultrasound phantom. The phantom (5cm × 12cm × 20cm) was prepared using water, gelatin and psyllium-hydrophilic-mucilloid fiber. Psylliumhydrophilic mucilloid acts as scattering medium to produce echo texture that simulates sonographic appearance of human tissue in ultrasound images while maintaining electron density close to that of water in CT images. Ultrasound images were acquired using 3D-ultrasound system with markers embedded at 5, 10 and 15mm depth from phantom surface. CT images were acquired using Philips Big Bore CT while CBCT and kV images were acquired with XVI-system (Elexta). Visual analysis was performed to compare visibility of the markers and visibility score (1 to 3) were assigned. Results All markers embedded at various depths are clearly visible (score of 3) in ultrasound images. Good visibility of all markers is observed in CT, CBCT and kV images. The degree of artifact produced by the markers in CT and CBCT images are indistinguishable. No distortion is observed in images from any modalities. Conclusion All markers are visible in images across all modalities in this homogenous tissue-like phantom. Human subject data is necessary to confirm the marker type suitable for real-time ultrasound tracking of tumor motion in SBRT pancreas treatment.

60 APPLIED LIFE SCIENCES↗

Core Characterization of Bakken Shale from the Bedwell 33-52-1-1H Well, Sheridan County, Montana

The computed tomography (CT) facilities and the Multi-Sensor Core Logger (MSCL) at the National Energy Technology Laboratory (NETL) in Morgantown, West Virginia were used to characterize core of the Bedwell 33-52-1-1H well (API 25-091-21920), a wildcat field in Sheridan County, Montana. The primary impetus of this work is to provide a unique dataset to researchers at universities, national laboratories, geological surveys, and other locations for additional analyses. The resultant datasets are presented in this report and can be accessed from NETL's Energy Data eXchange (EDX) online system using the following link: https://edx.netl.doe.gov/dataset/bedwell-33-52-1-1h-well. The equipment and techniques used to characterize the full core were non-destructive, enabling future examinations and analyses to be performed on these cores. However, none of the equipment used was suitable for direct visualization of the pore space in fine-grained structures such as those found in shales; fractures, discontinuities, and millimeter scale features were readily detectable with the methods tested. Imaging with the NETL medical CT scanner was performed on the entire core. Qualitative analysis of the medical CT images, coupled with X-ray fluorescence (XRF), P-wave, and magnetic susceptibility measurements from the MSCL were useful in identifying zones of interest for more detailed analysis. A selection of samples (Table 1) were cored, sliced, and powdered for additional characterization analyses. These analyses did involve destructive subsampling of the full core at discrete sections, and the results are presented here in the context of the larger core description. Selected sections of the core were removed from the full core for detailed analyses using the following destructive techniques: bulk inductively coupled plasma-optical emission spectroscopy (ICP-OES), isolation of carbon and sulfur, Fourier transform infrared (FTIR) spectroscopy, scanning electron microscopy (SEM), and higher resolution CT scan with NETL’s micro-CT scanning systems. The ability to quickly identify key areas for more detailed study with higher resolution will save time and resources in future studies. The combination of methods used provides a multi-scale analysis of the core; the resulting macro and micro descriptions are relevant to many subsurface energy related examinations traditionally performed at NETL.

04 OIL SHALES AND TAR SANDS↗

Evaluation of the Radioactive Material Release in the Harborview Research and Training Building and Implications for Emergency Response

On May 2, 2019, during the 137 Cs source recovery operation, a source capsule in a research irradiator containing approximately 77.1 TBq was breached. Based on a geometric reconstruction analysis of the damage to the capsule, approximately 46.3 GBq (0.04%) was impacted by the chop saw (grinder) inside a Mobile Hot Cell (MHC) on the loading dock at the University of Washington Harborview Research and Training (HRT) Building. A very small fraction of the material impacted, less than 1%) was released from the Mobile Hot Cell and then to the rest of the HRT Building. The objectives of this project were to assess the accidental release of 137 CsCl and its implications related to emergency response methods and the ramifications of 137 CsCl transport. The phenomenology of this event was also compared with past alkali halide dispersal events. The vast number of measurements and samples collected by the remediation contractors, the Department of Energy's Nuclear Emergency Support Team, and the small number of retrospective samples collected by the authors informed the analysis. The techniques included (1) autoradiography and electron microscopy of samples collected from the HRT Building and the irradiator, (2) 3D visualization of deposition on surfaces and within the ventilation system, and (3) a study of the damage to the source capsule to evaluate the Cs particle size and particle composition due to the grinding accident. Subsequently, the cesium contaminant transport through the numerous pathways in the building was reconstructed to assess the deposition on surfaces as a function of particle size. The implications for emergency response are relevant to data quality and management. A Data Quality Objective (DQO) guides data collection methods so that they have appropriate accuracy and precision for the intended application. Recommendations were made with respect to the sample collection protocols and sample archival.

61 RADIATION PROTECTION AND DOSIMETRY↗

Algal functional annotation tool

The Algal Functional Annotation Tool is a web-based comprehensive analysis suite integrating annotation data from several pathway, ontology, and protein family databases. The current version provides annotation for the model alga Chlamydomonas reinhardtii, and in the future will include additional genomes. The site allows users to interpret large gene lists by identifying associated functional terms, and their enrichment. Additionally, expression data for several experimental conditions were compiled and analyzed to provide an expression-based enrichment search. A tool to search for functionally-related genes based on gene expression across these conditions is also provided. Other features include dynamic visualization of genes on KEGG pathway maps and batch gene identifier conversion.

09 BIOMASS FUELS↗

Algal functional annotation tool

Abstract BACKGROUND: Progress in genome sequencing is proceeding at an exponential pace, and several new algal genomes are becoming available every year. One of the challenges facing the community is the association of protein sequences encoded in the genomes with biological function. While most genome assembly projects generate annotations for predicted protein sequences, they are usually limited and integrate functional terms from a limited number of databases. Another challenge is the use of annotations to interpret large lists of 'interesting' genes generated by genome-scale datasets. Previously, these gene lists had to be analyzed across several independent biological databases, often on a gene-by-gene basis. In contrast, several annotation databases, such as DAVID, integrate data from multiple functional databases and reveal underlying biological themes of large gene lists. While several such databases have been constructed for animals, none is currently available for the study of algae. Due to renewed interest in algae as potential sources of biofuels and the emergence of multiple algal genome sequences, a significant need has arisen for such a database to process the growing compendiums of algal genomic data. DESCRIPTION: The Algal Functional Annotation Tool is a web-based comprehensive analysis suite integrating annotation data from several pathway, ontology, and protein family databases. The current version provides annotation for the model alga Chlamydomonas reinhardtii, and in the future will include additional genomes. The site allows users to interpret large gene lists by identifying associated functional terms, and their enrichment. Additionally, expression data for several experimental conditions were compiled and analyzed to provide an expression-based enrichment search. A tool to search for functionally-related genes based on gene expression across these conditions is also provided. Other features include dynamic visualization of genes on KEGG pathway maps and batch gene identifier conversion. CONCLUSIONS: The Algal Functional Annotation Tool aims to provide an integrated data-mining environment for algal genomics by combining data from multiple annotation databases into a centralized tool. This site is designed to expedite the process of functional annotation and the interpretation of gene lists, such as those derived from high-throughput RNA-seq experiments. The tool is publicly available at http://pathways.mcdb.ucla.edu.

Source record↗

...And Eat it Too: High Read Performance in Write-Optimized HPC I/O Middleware File Formats

As HPC applications run on increasingly high process counts on larger and larger machines, both the frequency of checkpoints needed for fault tolerance and the resolution and size of Data Analysis Dumps are expected to increase proportionally. In order to maintain an acceptable ratio of time spent performing useful computation work to time spent performing I/O, write bandwidth to the underlying storage system must increase proportionally to this increase in the checkpoint and computation size. Unfortunately, popular scientific self-describing file formats such as netCDF and HDF5 are designed with a focus on portability and flexibility. Extra care and careful crafting of the output structure and API calls is required to optimize for write performance using these APIs. To provide sufficient write bandwidth to continue to support the demands of scientific applications, the HPC community has developed a number of I/O middleware layers, that structure output into write-optimized file formats. However, the obvious concern with any write optimized file format would be a corresponding penalty on reads. In the log-structured filesystem, for example, a file generated by random writes could be written efficiently, but reading the file back sequentially later would result in very poor performance. Simulation results require efficient read-back for visualization and analytics, and though most checkpoint files are never used, the efficiency of a restart is very important in the face of inevitable failures. The utility of write speed improving middleware would be greatly diminished if it sacrificed acceptable read performance. In this paper we examine the read performance of two write-optimized middleware layers on large parallel machines and compare it to reading data natively in popular file formats. The two I/O middleware layer examined in this paper are the Adaptable IO System (ADIOS), a library-based approach developed at Oak Ridge National Laboratory to provide a high-level IO API that can be used in place of netCDF or HDF5 to do much more aggressive write-behind and efficient reordering of data locations within the file; and the Parallel Log-structured Filesystem (PLFS), a stackable FUSE filesystem approach developed at Los Alamos National Laboratory that decouples concurrent writes to improve the speed of checkpoints. Since ADIOS is an I/O componentization that affords selection of different I/O methods at or during runtime, through a single API, users can have access to MPI-IO, Posix-IO, HDF5, netCDF, and staging methods. The ADIOS BP file format is a new log-file format that has a superset of the features of both HDF5 and netCDF, but is designed to be portable and flexible while being optimized for writing. PLFS, on the other hand, is mounted as a stackable filesystem on top of an existing parallel filesystem. Reads or writes to the PLFS filesystem are transparently translated into operations on per-process log files stored in the underlying parallel filesystem. Since PLFS performs this translation without application modification, users can write in HDF5, netCDF, or app-specific file formats and PLFS will store the writes in a set of efficiently written log-formatted files, while presenting the user with a logical 'flat' file on reads. Despite their different approaches, the commonality behind both of these middleware systems is that they both write to a log file format. As shown in previous publications, writes are fully optimized in both systems, sometimes resulting in 100x improvements over writing data in popular file formats. But as mentioned above, writing is only one part of the story. In this paper we examine the read performance of our middleware layers on large parallel machines and compare these to reading data either natively or from other popular file formats. We compare the reading performance in two different scenarios: (1) Reading back restarts from the same number of processors as wrote the data and (2) Reading back restart data from a different number of processors. We observe that not only can write-optimized I/O middleware be built to not penalize read speeds, but for important workloads, techniques that improve write performance can, perhaps counterintuitively, improve read speeds over reading from a contiguously organized file format. In the remainder of this paper, we investigate this further through case studies of PLFS and ADIOS on simulation checkpoint restarts.

99 GENERAL AND MISCELLANEOUS↗