Search NASA⌕ Search

SEARCH · Search NASA

Results for “HDFS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

31 records · Page 2

Senescence-related functional nuclear barrier by down-regulation of nucleo-cytoplasmic trafficking gene expression

One of the characteristic natures of senescent cells is the hypo- or irresponsiveness not only to growth factors but also to apoptotic stress. In the present study, we confirmed the inhibition of nuclear translocation of activated p-ERK1/2 and NF-kB p50 in response to growth stimuli or LPS in the senescent human diploid fibroblasts. In order to elucidate the underlying mechanism for the senescence-associated hypo-responsiveness, we carried out the comparison study for gene expression profiles through microarray analysis. In consequence, we observed the vast reduction in expression of nucleo-cytoplasmic trafficking genes in senescent cells, when compared with those in young cells. Expression levels of several nucleoporins, karyopherin {alpha}, karyopherin {beta}, Ran, and Ran-regulating factors were confirmed to be down-regulated in senescent HDFs by using RT-PCR and Western blot methods. Taken together, these data suggest the operation of certain senescence-associated functional nuclear barriers by down-regulation of the nucleo-cytoplasmic trafficking genes in the senescent cells.

60 APPLIED LIFE SCIENCES↗

Cell-free therapy based on adipose tissue stem cell-derived exosomes promotes wound healing via the PI3K/Akt signaling pathway

Highlights: • ADSC-Exos are internalized into HDFs and regulate their biological behaviors and functions. • ADSC-Exos play an important role in accelerating wound healing via activating PI3K/Akt signaling pathway. • ADSC-Exos may serve as a cell-free therapy for the potential clinical treatment of wound healing. Adipose tissue-derived stem cells (ADSCs) have been shown to enhance wound healing via their paracrine function. Exosomes, as one of the most important paracrine factors, play an essential role in this process. However, the concrete mechanisms that underlie this effect are poorly understood. In this study, we aim to explore the potential roles and molecular mechanisms of exosomes derived from ADSCs in cutaneous wound healing.

60 APPLIED LIFE SCIENCES↗

Controlled Placement of Microparticles at the Water–Liquid Crystal Elastomer Interface

Control of cells behavior through topography of substrates is an important theme in biomedical applications. Among many materials used as substrates, polymers show advantages since they can be tailored by chemical functionalization. Fabrication of polymer substrates with nano- and microscale topography requires processing by lithography, microprinting, etching, etc. In this work, we introduce a different approach based on anisotropic elastic properties of polymerized smectic A (SmA) liquid crystal elastomer (LCE). When the SmA liquid crystal coating is deposited onto a substrate with planar alignment of the molecules, it develops nanogrooves at its free surface. After photopolymerization, these nanogrooves show an excellent ability to align human dermal fibroblasts (hDFs) over large areas. The alignment quality is good for both bare SmA LCE substrates and for substrates coated with fibronectin. The SmA LCE nano-topographies show a high potential for tissue engineering.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

OPTICAL SPECTROSCOPY OF DISTANT RED GALAXIES

We present optical spectroscopic follow-up of a sample of distant red galaxies (DRGs) with K {sup tot} {sub s,Vega} < 22.5, selected by (J - K){sub Vega}>2.3, in the Hubble Deep Field South (HDFS), the MS 1054-03 field, and the Chandra Deep Field South (CDFS). Spectroscopic redshifts were obtained for 15 DRGs. Only two out of 15 DRGs are located at z < 2, suggesting a high efficiency to select high-redshift sources. From other spectroscopic surveys in the CDFS targeting intermediate to high-redshift populations selected with different criteria, we find spectroscopic redshifts for a further 30 DRGs. We use the sample of spectroscopically confirmed DRGs to establish the high quality (scatter in DELTAz/(1 + z) of approx0.05) of their photometric redshifts in the considered deep fields, as derived with EAZY. Combining the spectroscopic and photometric redshifts, we find that 74% of DRGs with K {sup tot} {sub s,Vega} < 22.5 lie at z>2. The combined spectroscopic and photometric sample is used to analyze the distinct intrinsic and observed properties of DRGs at z < 2 and z>2. In our photometric sample to K {sup tot} {sub s,Vega} < 22.5, low-redshift DRGs are brighter in K{sub s} than high-redshift DRGs by 0.7 mag, and more extincted by 1.2 mag in A{sub V} . Our analysis shows that the DRG criterion selects galaxies with different properties at different redshifts. Such biases can be largely avoided by selecting galaxies based on their rest-frame properties, which requires very good multi-band photometry and high quality photometric redshifts.

79 ASTRONOMY AND ASTROPHYSICS↗

XRootd, disk-based, caching proxy for optimization of data access, data placement and data replication

Following the success of the XRootd-based US CMS data federation, the AAA project investigated extensions of the federation architecture by developing two sample implementations of an XRootd, disk-based, caching proxy. The first one simply starts fetching a whole file as soon as a file open request is received and is suitable when completely random file access is expected or it is already known that a whole file be read. The second implementation supports on-demand downloading of partial files. Extensions to the Hadoop Distributed File System have been developed to allow for an immediate fallback to network access when local HDFS storage fails to provide the requested block. Both cache implementations are in pre-production testing at UCSD.

Bauerdick, L. A.T.↗

Engineering the CernVM-Filesystem as a High Bandwidth Distributed Filesystem for Auxiliary Physics Data

A common use pattern in the computing models of particle physics experiments is running many distributed applications that read from a shared set of data files. We refer to this data is auxiliary data, to distinguish it from (a) event data from the detector (which tends to be different for every job), and (b) conditions data about the detector (which tends to be the same for each job in a batch of jobs). Relatively speaking, conditions data also tends to be relatively small per job where both event data and auxiliary data are larger per job. Unlike event data, auxiliary data comes from a limited working set of shared files. Since there is spatial locality of the auxiliary data access, the use case appears to be identical to that of the CernVM- Filesystem (CVMFS). However, we show that distributing auxiliary data through CVMFS causes the existing CVMFS infrastructure to perform poorly. We utilize a CVMFS client feature called 'alien cache' to cache data on existing local high-bandwidth data servers that were engineered for storing event data. This cache is shared between the worker nodes at a site and replaces caching CVMFS files on both the worker node local disks and on the site's local squids. We have tested this alien cache with the dCache NFSv4.1 interface, Lustre, and the Hadoop Distributed File System (HDFS) FUSE interface, and measured performance. In addition, we use high-bandwidth data servers at central sites to perform the CVMFS Stratum 1 function instead of the low-bandwidth web servers deployed for the CVMFS software distribution function. We have tested this using the dCache HTTP interface. As a result, we have a design for an end-to-end high-bandwidth distributed caching read-only filesystem, using existing client software already widely deployed to grid worker nodes and existing file servers already widely installed at grid sites. Files are published in a central place and are soon available on demand throughout the grid and cached locally on the site with a convenient POSIX interface. This paper discusses the details of the architecture and reports performance measurements.

Dykstra, D.↗

VisIO: enabling interactive visualization of ultra-scale, time-series data via high-bandwidth distributed I/O systems

Petascale simulations compute at resolutions ranging into billions of cells and write terabytes of data for visualization and analysis. Interactive visuaUzation of this time series is a desired step before starting a new run. The I/O subsystem and associated network often are a significant impediment to interactive visualization of time-varying data; as they are not configured or provisioned to provide necessary I/O read rates. In this paper, we propose a new I/O library for visualization applications: VisIO. Visualization applications commonly use N-to-N reads within their parallel enabled readers which provides an incentive for a shared-nothing approach to I/O, similar to other data-intensive approaches such as Hadoop. However, unlike other data-intensive applications, visualization requires: (1) interactive performance for large data volumes, (2) compatibility with MPI and POSIX file system semantics for compatibility with existing infrastructure, and (3) use of existing file formats and their stipulated data partitioning rules. VisIO, provides a mechanism for using a non-POSIX distributed file system to provide linear scaling of 110 bandwidth. In addition, we introduce a novel scheduling algorithm that helps to co-locate visualization processes on nodes with the requested data. Testing using VisIO integrated into Para View was conducted using the Hadoop Distributed File System (HDFS) on TACC's Longhorn cluster. A representative dataset, VPIC, across 128 nodes showed a 64.4% read performance improvement compared to the provided Lustre installation. Also tested, was a dataset representing a global ocean salinity simulation that showed a 51.4% improvement in read performance over Lustre when using our VisIO system. VisIO, provides powerful high-performance I/O services to visualization applications, allowing for interactive performance with ultra-scale, time-series data.

97 MATHEMATICS AND COMPUTING↗

Data Intensive Computing on Amazon Web Services

The Geophysical Monitoring Program (GMP) has spent the past few years building up the capability to perform data intensive computing using what have been referred to as “big data” tools. These big data tools would be used against massive archives of seismic signals (>300 TB) to conduct research not previously possible. Examples of such tools include Hadoop (HDFS, MapReduce), HBase, Hive, Storm, Spark, Solr, and many more by the day. These tools are useful for performing data analytics on datasets that exceed the resources of traditional analytic approaches. To this end, a research big data cluster (“Cluster A”) was set up as a collaboration between GMP and Livermore Computing (LC).

97 MATHEMATICS AND COMPUTING↗

Ultraviolet Galaxy Counts From STIS Observations of The Hubble Deep Fields

We present galaxy counts in the near and far ultraviolet (NUV and FUV) obtained from Space Telescope Imaging Spectrograph (STIS) observations of portions of the Hubble Deep Field North, (HDFN), the Hubble Deep Field South, (HDFS) and a parallel field near the HDFN. All three fields have deep (AB>29) optical imaging, and we determine magnitudes by taking the ultraviolet flux detected within the limiting optical isophote. An analysis of the UV-optical colors of detected objects, combined with a visual inspection of the UV images, indicates that there are no detectable objects in the UV images which are not also detected in the optical. We measure the detection area and completeness as a function of magnitude by taking the size-magnitude distribution of galaxies in the entire HDFN WFPC2 V+I image, applying the measured UV-optical colors from the detected galaxies, and determining the total area over which each galaxy would have been detected in the UV images. The average area for the simulated galaxies in each UV magnitude bin, (including galaxies which would not be detected at all), provides the effective area and completeness for the bin. We test this procedure with Monte Carlo simulations. The galaxy counts reach to AB=29 in both the NUV and FUV; 1 magnitude fainter than the HDF F30OW counts, and 7 magnitudes fainter than balloon-based counts. We compare our measured counts to various models.

Gardner, J. P.↗

MERRA/AS: The MERRA Analytic Services Project Interim Report

MERRA AS is a cyberinfrastructure resource that will combine iRODS-based Climate Data Server (CDS) capabilities with Coudera MapReduce to serve MERRA analytic products, store the MERRA reanalysis data collection in an HDFS to enable parallel, high-performance, storage-side data reductions, manage storage-side driver, mapper, reducer code sets and realized objects for users, and provide a library of commonly used spatiotemporal operations that can be composed to enable higher-order analyses.

MapReduce↗

Simplifying Analysis of Hierarchical HDF5 and NetCDF4 Files with Xarray-Datatree

NASA’s Earth Observing System Data and Information System (EOSDIS) contains thousands of Earth science datasets from satellites, models, and field campaigns. EOSDIS data are stored in formats that are well supported by the Earth Science community. These formats include the Hierarchical Data Format (HDF), with derivative flavors such as HDF-5 and the Network Common Data Format (NetCDF-4). The HDF specification allows for a directory-like hierarchy within a single file, known as "groups". Observational data and associated metadata within a single file can be distributed amongst multiple internal groups, which can also be nested to multiple levels. Working with datasets that have a group hierarchical structure can be difficult because of the nested structure of groups. Widely used packages, such as xarray, have data models that do not accommodate the hierarchical structure within HDF files, requiring users to traverse the file and open different HDF groups as separate, unrelated objects. Xarray-datatree is a Python package developed to solve the difficulty of traversing HDFs with a hierarchical group structure by creating a tree-like hierarchical data structure in xarray. The tree-like structure allows each group to be accessed once a DataTree object is instantiated. The migration of xarray-datatree into the xarray core library will reduce barriers to accessing Earth science data by eliminating the need to understand and traverse the specific hierarchy of a grouped HDF file.

Eni Awowale↗

YARNsim: Simulating Hadoop YARN

Despite the popularity of the Apache Hadoop system, its success has been limited by issues such as single points of failure, centralized job/task management, and lack of support for programming models other than MapReduce. The next generation of Hadoop, Apache Hadoop YARN, is designed to address these issues. In this paper, we propose YARNsim, a simulation system for Hadoop YARN. YARNsim is based on parallel discrete event simulation and provides protocol-level accuracy in simulating key components of YARN. YARNsim provides a virtual platform on which system architects can evaluate the design and implementation of Hadoop YARN systems. Also, application developers can tune job performance and understand the tradeoffs between different configurations, and Hadoop YARN system vendors can evaluate system efficiency under limited budgets. To demonstrate the validity of YARNsim, we use it to model two real systems and compare the experimental results from YARNsim and the real systems. The experiments include standard Hadoop benchmarks, synthetic workloads, and a bioinformatics application. The results show that the error rate is within 10% for the majority of test cases. The experiments prove that YARNsim can provide what-if analysis for system designers in a timely manner and at minimal cost compared with testing and evaluating on a real system.

Hadoop↗