Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data Challenge”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

Wind Plant Performance Prediction Benchmark Phase 1 (Technical Report)

Financial risk resulting from the uncertainty associated with developing, owning, and operating wind power plants remains a barrier to reducing the levelized cost of energy (LCOE). On average, modern wind power plants in the U.S. underperform their expected annual energy output by 3.5-4.5% , with many underperforming by over 10%. To compensate for this uncertainty, investors require a larger return on investment (ROI) and apply "knock-down" factors that mask much of the underlying sources of uncertainty. Wind energy projects thus have reduced access to low-cost capital. Furthermore, operating wind plants often take a simple approach to estimating operations & maintenance (O&M) costs (e.g. straight-line estimates based on similar plants), which can eat into profits. To overcome these issues, the wind industry must improve the models they use for estimating wind plant performance and operations. An industry consortium (IC) requested that the National Renewable Energy Laboratory (NREL) lead a Department of Energy (DOE) working group to benchmark the accuracy of wind power plant energy predictions against real operational data. The IC was also motivated by DOE and NREL's potential to characterize systematic energy underperformance, identify sources of uncertainty, and explore root causes. The Wind Plant Performance Prediction (WP3) project was created out of this request, and this report represents the successful completion of Phase 1 of the WP3 project. During the project, wind plant owners provided both pre-construction and operational data to NREL. The pre-construction data was provided to wind resource assessment (WRA) consultants so they could conduct energy yield assessments (EYA). NREL took all of the completed EYAs, along with the operational data, and conducted an operational assessment to benchmark the EYA results against actual operational data. Given the large amounts of sensitive data required for this effort, as well as historical opposition to sharing data within industry, successful completion of Phase 1 represents an unprecedented milestone for industry data sharing. To improve the accuracy and confidence of pre-construction EYAs, wind plant owners and investors need better, more certain, energy yield predictions. The WP3 Benchmark Project is an industry-driven response to this reality. For the first time, industry has taken the important step of working together at scale, sharing valuable operational data with DOE and NREL in order to investigate the sources of bias and uncertainty in these energy estimates. This IC provides wind plant preconstruction and operational data to NREL in an organized and documented fashion and provides guidance and feedback as needed. The IC also provides introspection of the design of experiment, key metrics of success, data challenges, analysis best practices, and quality of results.

17 WIND ENERGY↗

DOE BSSD Performance Management Metrics Report Q2

The vision of the National Microbiome Data Collaborative (NMDC) centers on the concept of connecting data, people, and ideas to advance microbiome innovation and discovery. Building data infrastructure, while key to NMDC’s ability to execute on our vision, can only go so far in creating scientific impact. By fostering strong community partnerships and developing a set of robust community outreach and training programs, we are able to turn our products – the Submission Portal, NMDC EDGE, and the Data Portal – into tools that empower the scientific community. Our multi-pronged community building approach spans individual researchers, research teams, consortia and scientific societies, and institutions and federal agencies. To foster a collaborative and inclusive community-centered environment, we have identified three strategic objectives to promote an inclusive and connected community: (1) recognize and support the diverse research needs and perspectives of the microbiome research community; (2) promote best practices across the microbiome community, from researchers to funders, through community-driven practices (FAIR, CARE, and TRUST); and (3) build a microbiome ecosystem that enables scientific discovery and innovation across stakeholders. These strategic objectives allow our team to focus on impact across a diverse range of activities, from launching the American Society for Microbiology (ASM) Microbiome Data Prize to supporting the Ambassador and Champions programs fostering learning and building a collaborative network. We broadly communicate our work through social media (X/Twitter, LinkedIn, and Instagram), The Microbiome Standard (our quarterly newsletter), and Annual Reports. All our work is underpinned by a strong commitment to diversity, equity, and inclusion as articulated in our Action Plan that tracks progress towards key metrics. A core component of our engagement strategy is user research. User research ensures the Submission Portal, NMDC EDGE, Data Portal, and the new Field Notes mobile app are designed with and for the scientific community. Our user research efforts consist of asking researchers exploratory questions to collect information on researcher priorities, methodologies, and perceptions to ensure that we are aware of the current state of microbiome research. Our usability testing provides researchers with prototypes or test environments of the NMDC products, and we capture valuable information on how users interact with the products to make improvements. Given the diverse nature of microbiome work, we acknowledge that we are not aware of all pressing data challenges and thus rely on the research community to help us identify the most important issues to prioritize. To date, we have conducted 24 interviews and one beta-testing call with 10 participants across all NMDC products, which have generated 321 insights and 120 action items. Herein, we describe the ways we engage with the microbiome research community to advance the NMDC mission.

59 BASIC BIOLOGICAL SCIENCES↗

Evaluating Image Classification Deep Convolutional Neural Network Architectures for Remaining Useful Life Estimation of Turbofan Engines

Accurate estimation of the remaining useful life (RUL) is a key component of condition-based maintenance (CBM) and prognosis and health management (PHM). Data-based models for the estimation of RUL are of particular interest because expert knowledge of systems is not always available, and physical modeling is often not feasible. Additionally, using data-based models, which make decisions based on raw sensor data, allow features to be learned instead of manually determined. In this work, deep convolutional neural network (CNN) architectures are investigated for their ability to estimate the RUL of turbofan engines. To improve the accuracy of the models, CNN architectures, which have proven successful in image classification, are implemented and tested. Specifically, the blocks used in the Visual Geometry Group (VGG) architecture, inception modules used in the GoogLeNet architecture, and residual blocks used in the ResNet architecture are incorporated. To account for varying flight lengths, the input to the models is a window of time series data collected from the engine under test. Window locations at the climb, cruise, and descent stages are considered. To further improve the RUL estimations, multiple overlapping windows at each location are used. This increases the amount of training data available and is found to increase the accuracy of the resulting RUL estimations by averaging the estimates from all overlapping segments. The model is trained and tested using the new Commercial Modular Aero-Propulsion System Simulation (N-CMAPSS) data set, and high prognosis accuracy was achieved. Furthermore, this work expands on the model developed and used in the 2021 PHM Society Data Challenge, which received second place.

convolutional neural networks↗

Inception Based Deep Convolutional Neural Network for Remaining Useful Life Estimation of Turbofan Engines

Accurate estimation of the remaining useful life (RUL) is a key component of condition based maintenance (CBM) and prognosis and health management (PHM). Data-based models for the estimation of RUL are of particular interest because expert knowledge of systems is not always available and physical modeling is often not feasible. In this paper, a deep convolutional neural network (CNN) architecture is investigated for its ability to estimate the RUL of turbofan engines. The input to the model is a window of time series data collected from the engine under test. Inputting raw sensor data allows features to be learned instead of manually determined. To incorporate the ability to detect features of differing lengths, inception modules are used in the neural network architecture. The model is trained and tested using the new Commercial Modular Aero-Propulsion System Simulation (N-CMAPSS) data set and high prognosis accuracy was achieved. The developed model was used in the 2021 PHM Society Data Challenge and received second place, further validating its ability to accurately estimate RUL.

DeVol, Nathaniel↗

Testing the LSST Difference Image Analysis Pipeline Using Synthetic Source Injection Analysis

Abstract We evaluate the performance of the Legacy Survey of Space and Time Science Pipelines Difference Image Analysis (DIA) on simulated images. By adding synthetic sources to galaxies on images, we trace the recovery of injected synthetic sources to evaluate the pipeline on images from the Dark Energy Science Collaboration Data Challenge 2. The pipeline performs well, with efficiency and flux accuracy consistent with the signal-to-noise ratio of the input images. We explore different spatial degrees of freedom for the Alard–Lupton polynomial-Gaussian image subtraction kernel and analyze for trade-offs in efficiency versus artifact rate. Increasing the kernel spatial degrees of freedom reduces the artifact rate without loss of efficiency. The flux measurements with different kernel spatial degrees of freedom are consistent. We also here provide a set of DIA flags that substantially filter out artifacts from the DIA source table. We explore the morphology and possible origins of the observed remaining subtraction artifacts and suggest that given the complexity of these artifact origins, a convolution kernel with a set of flexible bases with spatial variation may be needed to yield further improvements.

Liu, S. (ORCID:0000000244612143)↗

Kilonovae and Long-duration Gamma-Ray Bursts

Recent detections of kilonova-like emission following long-duration gamma-ray bursts GRB 211211A and GRB 230307A have been interpreted as originating from the merger of two neutron stars. In this work, we demonstrate that these observations are also consistent with nucleosynthesis originating from a collapsar scenario. Our model is capable of reproducing the observed optical and infrared light curves using a single, weak r-process component. The absence of lanthanide-rich material in our model, consistent with the data, challenges the prevailing interpretation that a red evolution in such transients necessarily indicates the presence of heavy r-process elements.

79 ASTRONOMY AND ASTROPHYSICS↗

Ground Based, Millimeter Wave Measurement of Ozone in the Middle Atmosphere

There is a need for highly reliable measurements of stratospheric ozone. Policy makers worldwide concerned with public health rely oil a clear consensus from the scientific community as a basis for ozone-related environmental policy that has a significant impact oil national economies. Tile latest Such consensus was presented in WMO, and used in a 1999 meeting of the parties considering amendments to the Montreal Protocol oil Substances that Deplete the Ozone Layer. Tile scientific community, in turn, needs highly precise and accurate measurements of ozone levels, and small time derivatives of these levels, both in continued - development of its understanding of the physical and chemical processes involved and as clear evidence that these processes are occurring as stated. Over most of the world, changes in ozone levels are small. For example, over the heavily populated northern midlatitudes, the linearized rate of ozone decline is between 0.2% per year and 0.7% per year, depending on altitude. These values are small enough to make measurement requirements technically challenging. Data quality may suffer from imperfections in individual instruments. In one instance, early results from a satellite-borne ozone sensor were later found to be invalid because of calibration drift. Even in the absence of drift, tile absolute calibration of a new sensor may differ slightly from that of its predecessor in service. Most ozone remote sensing instruments operate at ultraviolet or infrared wavelengths where scattering from dust and aerosols must be taken into account; results from these systems may be or are affected following a major volcanic eruption, such as tile one at Mt. Pinatubo in 1991. Given these difficulties, a consensus of measurements from several independent systems is required to insure a reliable understanding of stratospheric ozone levels. Because of the above-described need for highly precise and accurate ozone measurements using several independent techniques, there was interest in developing several techniques which were known but not highly developed in the 1980's into systems capable of being used in ail operational manner to make measurements with the level of quality needed to-detect small trends in ozone levels. A ground-based microwave instrument capable of remotely sensing stratospheric ozone had been designed by tile Principal Investigator of the present project. This instrument was built at tile Millitech Corporation in South Deerfield, Massachusetts before tile present work began. (Funding for design and construction of the instrument came from sources other than the present grant.) Tile instrument measured the spectrum of one of the many emission lines produced by purely rotational transitions of ozone, one at a frequency of 110.8 GHz. The altitude distribution of ozone can. in principle, be retrieved from the details of the pressure-broadened spectrum of the ozone transition. However, the level of contamination of the spectral measurement by instrumentally induced artifacts must be very low in order to retrieve a ozone profile of useful quality from it. The Millitech instrument demonstrated spectral purity at ail adequate level, and there were promising ideas for instrumental improvements and for further development of the technique. The initial objectives of the present project, then, were to develop techniques for calibrating the Millitech instrument, to minimize artifacts in tile spectra it produces, to optimally retrieve ozone profiles from tile spectra, to test tile quality of the microwave profiles by comparing them with profiles obtained using several other, independent techniques over both short and periods of time, and to perform research using the ozone data gathered with the instrument.

Parrish, Alan↗

Model Analysis of an Aircraft Fueslage Panel using Experimental and Finite-Element Techniques

The application of Electro-Optic Holography (EOH) for measuring the center bay vibration modes of an aircraft fuselage panel under forced excitation is presented. The requirement of free-free panel boundary conditions made the acquisition of quantitative EOH data challenging since large scale rigid body motions corrupted measurements of the high frequency vibrations of interest. Image processing routines designed to minimize effects of large scale motions were applied to successfully resurrect quantitative EOH vibrational amplitude measurements

Fleming, Gary A.↗

Power combining considerations for project Prometheus TWTAs

NASA's Jupiter Icy Moons Orbiter (JIMO) mission would be faced with the challenging data transmission task of sending a 50 Mbps stream of science data back to Earth over a distance of 6.2 A.U. (9.3x10^8 km). This high data rate will require a transmitter power of 1 kW at 32 GHz which greatly exceeds the highest powers available from any currently existing space-qualified RF amplifiers. Initially, consideration was given to developing a space-qualified klystron or EIK because of the relatively narrow bandwidths implied by this data rate, but neither of these device types have any significant history of use in space.

power combining↗

Data Analysis for the LISA Pathfinder Mission

The LTP (LISA Technology Package) is the core part of the Laser Interferometer Space Antenna (LISA) Pathfinder mission. The main goal of the mission is to study the sources of any disturbances that perturb the motion of the freely-falling test masses from their geodesic trajectories as well as 10 test various technologies needed for LISA. The LTP experiment is designed as a sequence of experimental runs in which the performance of the instrument is studied and characterized under different operating conditions. In order to best optimize subsequent experimental runs, each run must be promptly analysed to ensure that the following ones make best use of the available knowledge of the instrument ' In order to do this, all analyses must be designed and tested in advance of the mission and have sufficient built-in flexibility to account for unexpected results or behaviour. To support this activity, a robust and flexible data analysis software package is also required. This poster presents two of the main components that make up the data analysis effort: the data analysis software and the mock-data challenges used to validate analysis procedures and experiment designs.

Thorpe, James Ira↗

A Galactic Binary Detection Pipeline

The Galaxy is suspected to contain hundreds of millions of binary white dwarf systems, a large fraction of which will have sufficiently small orbital period to emit gravitational radiation in band for space-based gravitational wave detectors such as the Laser Interferometer Space Antenna (LISA). LISA's main science goal is the detection of cosmological events (supermassive black hole mergers, etc.) however the gravitational signal from the galaxy will be the dominant contribution to the data - including instrumental noise over approximately two decades in frequency. The catalogue of detectable binary systems will serve as an unparalleled means of studying the Galaxy. Furthermore, to maximize the scientific return from the mission, the data must be "cleansed" of the galactic foreground. We will present an algorithm that can accurately resolve and subtract 2:: 10000 of these sources from simulated data supplied by the Mock LISA Data Challenge Task Force. Using the time evolution of the gravitational wave frequency, we will reconstruct the position of the recovered binaries and show how LISA will sample the entire compact binary population in the Galaxy.

Littenberg, Tyson B.↗

Simultaneous Planck, Swift, and Fermi Observations of X-Ray and gamma-Ray Selected Blazars

We present simultaneous Planck, Swift, Fermi, and ground-based data for 105 blazars belonging to three samples with flux limits in the soft X-ray, hard X-ray, and -ray bands, and we compare our results to those of a companion paper presenting simultaneous Planck and multi-frequency observations of 104 radio-loud northern active galactic nuclei selected at radio frequencies. While we confirm several previous results, our unique data set has allowed us to demonstrate that the selection method strongly influences the results, producing biases that cannot be ignored. Almost all the BL Lac objects have been detected by Fermi Large Area Telescope (LAT), whereas 30 to 40% of the flat-spectrum radio quasars (FSRQs) in the radio, soft X-ray, and hard X-ray selected samples are still below the gamma ray detection limit even after integrating 27 months of Fermi-LAT data. The radio to sub-millimetre spectral slope of blazars is quite flat, with [alpha] approximately 0 up to about 70 GHz, above which it steepens to [alpha] approximately -0.65. BL Lacs have significantly flatter spectra than FSRQs at higher frequencies. The distribution of the rest-frame synchrotron peak frequency (v(sup IC) (sub (PEAK)), ranges from 10(sup 21) to 10(sup 22) HZ. The distribution of the rest-frame synchrotron peak frequency (v(sup s)(sub peak)) in the spectral energy distribution (SED) of FSRQs is the same in all the blazar samples with (v(sup s)(sub peak) = 10(sup 13:1 plus or minus 0.1) Hz, while the mean inverse-Compton peak frequency,(v(sup IC)(sub peak) ranges from 10(sup 21) to 10(sup 22) Hz. The distributions of v(sup S)(sub peak) and of v(sup IC)(sub peak) of BL Lacs are much broader and are shifted to higher energies than those of FSRQs; their shapes strongly depend on the selection method. The Compton dominance of blazars ranges from less than 0.2 to nearly 100, with only FSRQs reaching values larger than about 3. Its distribution is broad and depends strongly on the selection method, with gamma-ray selected blazars peaking at approximately 7 or more, and radio-selected blazars at values close to 1, thus implying that the common assumption that the blazar power budget is largely dominated by high-energy emission is a selection effect. A comparison of our multi-frequency data with theoretical predictions shows that simple homogeneous SSC models cannot explain the simultaneous SEDs of most of the gamma-ray detected blazars in all samples. The SED of the blazars that were not detected by Fermi-LAT may instead be consistent with SSC emission. Our data challenge the correlation between bolometric luminosity and v(sup S)(sub peak) predicted by the blazar sequence.

Giommi, P.↗

A Detection Pipeline for Galactic Binaries in LISA Data

The Galaxy is suspected to contain hundreds of millions of binary white dwarf systems, a large fraction of which will have sufficiently small orbital period to emit gravitational radiation in band for space-based gravitational wave detectors such as the Laser Interferometer Space Antenna (LISA). LISA's main science goal is the detection of cosmological events (supermassive black hole mergers) etc.) however the gravitational signal from the galaxy will be the dominant contribution to the data - including instrumental noise - over approximately two decades in frequency. The catalogue of detectable binary systems will serve as an unparalleled means of studying the Galaxy. Furthermore, to maximize the scientific return from the mission, the data must be "cleansed" of the galactic foreground. We will present an algorithm that can accurately resolve and subtract greater than or equal to 10000 of these sources from simulated data supplied by the Mock LISA Data Challenge Task Force. Using the time evolution of the gravitational wave frequency, we will reconstruct the position of the recovered binaries and show how LISA will sample the entire compact binary population in the Galaxy.

Littenberg, Tyson B.↗

Simultaneous Planck, Swift, and Fermi Observations of X-ray and Gamma-ray Selected Blazars

We present simultaneous Planck, Swift, Fermi, and ground-based data for 105 blazars belonging to three samples with flux limits in the soft X-ray, hard X-ray, and gamma-ray bands, with additional 5 GHz flux-density limits to ensure a good probability of a Planck detection. We compare our results to those of a companion paper presenting simultaneous Planck and multi-frequency observations of 104 radio-loud northern active galactic nuclei selected at radio frequencies. While we confirm several previous results, our unique data set allows us to demonstrate that the selection method strongly influences the results, producing biases that cannot be ignored. Almost all the BL Lac objects have been detected by the Fermi Large Area Telescope (LAT), whereas 30% to 40% of the flat-spectrum radio quasars (FSRQs) in the radio, soft X-ray, and hard X-ray selected samples are still below the gamma-ray detection limit even after integrating 27 months of Fermi-LAT data. The radio to sub-millimetre spectral slope of blazars is quite flat, with (alpha) approx 0 up to about 70GHz, above which it steepens to (alpha) approx -0.65. The BL Lacs have significantly flatter spectra than FSRQs at higher frequencies. The distribution of the rest-frame synchrotron peak frequency (nu(sup s)(sub peak)) in the spectral energy distribution (SED) of FSRQs is the same in all the blazar samples with (nu(sup s)(sub peak)) = 10(exp 13.1 +/- 0.1) Hz, while the mean inverse Compton peak frequency, (nu(sup IC)(sub peak)), ranges from 10(exp 21) to 10(exp 22) Hz. The distributions of nu(sup s)(sub peak) and nu(sup IC)(sub peak) of BL Lacs are much broader and are shifted to higher energies than those of FSRQs; their shapes strongly depend on the selection method. The Compton dominance of blazars. defined as the ratio of the inverse Compton to synchrotron peak luminosities, ranges from less than 0.2 to nearly 100, with only FSRQs reaching values larger than about 3. Its distribution is broad and depends strongly on the selection method, with gamma-ray selected blazars peaking at approx 7 or more, and radio-selected blazars at values close to 1, thus implying that the common assumption that the blazar power budget is largely dominated by high-energy emission is a selection effect. A comparison of our multi-frequency data with theoretical predictions shows that simple homogeneous SSC models cannot explain the simultaneous SEDs of most of the gamma-ray detected blazars in all samples. The SED of the blazars that were not detected by Fermi~LAT may instead be consistent with SSC emission. Our data challenge the correlation between bolometric luminosity and nu(sup s)(sub peak) predicted by the blazar sequence.

Giommi, P.↗

On Advanced Estimation Techniques for Exoplanet Detection and Characterization using Ground-Based Coronagraphs

The direct imaging of planets around nearby stars is exceedingly difficult. Only about 14 exoplanets have been imaged to date that have masses less than 13 times that of Jupiter. The next generation of planet-finding coronagraphs, including VLT-SPHERE, the Gemini Planet Imager, Palomar P1640, and Subaru HiCIAO have predicted contrast performance of roughly a thousand times less than would be needed to detect Earth-like planets. In this paper we review the state of the art in exoplanet imaging, most notably the method of Locally Optimized Combination of Images (LOCI), and we investigate the potential of improving the detectability of faint exoplanets through the use of advanced statistical methods based on the concepts of the ideal observer and the Hotelling observer. We provide a formal comparison of techniques through a blind data challenge and evaluate performance using the Receiver Operating Characteristic (ROC) and Localization ROC (LROC) curves. We place particular emphasis on the understanding and modeling of realistic sources of measurement noise in ground-based AO-corrected coronagraphs. The work reported in this paper is the result of interactions between the co-authors during a week-long workshop on exoplanet imaging that was held in Squaw Valley, California, in March of 2012.

instrumentation↗

First Demonstration of Early Warning Gravitational-wave Alerts

Gravitational-wave observations became commonplace in Advanced LIGO-Virgo's recently concluded third observing run. 56 nonretracted candidates were identified and publicly announced in near real time. Gravitational waves from binary neutron star mergers, however, remain of special interest since they can be precursors to high-energy astrophysical phenomena like γ-ray bursts and kilonovae. While late-time electromagnetic emissions provide important information about the astrophysical processes within, the prompt emission along with gravitational waves uniquely reveals the extreme matter and gravity during—and in the seconds following—merger. Rapid communication of source location and properties from the gravitational-wave data is crucial to facilitate multimessenger follow-up of such sources. This is especially enabled if the partner facilities are forewarned via an early warning (pre-merger) alert. Here we describe the commissioning and performance of such a low-latency infrastructure within LIGO-Virgo. We present results from an end-to-end mock data challenge that detects binary neutron star mergers and alerts partner facilities before merger. We set expectations for these alerts in future observing runs.

Ryan Magee↗

The Magnesium Isotope Composition of Samples Returned From Asteroid Ryugu

The nucleosynthetic isotope composition of planetary materials provides a record of the heterogeneous distribution of stardust within the early solar system. In 2020 December, the Japan Aerospace Exploration Agency Hayabusa2 spacecraft returned to Earth the first samples of a primitive asteroid, namely, the Cb-type asteroid Ryugu. This provides a unique opportunity to explore the kinship between primitive asteroids and carbonaceous chondrites. We report high-precision μ 26 Mg* and μ 25 Mg values of Ryugu samples together with those of CI, CM, CV, and ungrouped carbonaceous chondrites. The stable Mg isotope composition of Ryugu aliquots defines μ 25 Mg values ranging from –160 ± 20 ppm to –272 ± 30 ppm, which extends to lighter compositions relative to Ivuna-type (CI) and other carbonaceous chondrite groups. We interpret the μ 25 Mg variability as reflecting heterogeneous sampling of a carbonate phase hosting isotopically light Mg (μ 25 Mg ∼ –1400 ppm) formed by low temperature equilibrium processes. After correcting for this effect, Ryugu samples return homogeneous μ 26 Mg* values corresponding to a weighted mean of 7.1 ± 0.8 ppm. Thus, Ryugu defines a μ 26 Mg* excess relative to the CI and CR chondrite reservoirs corresponding to 3.8 ± 1.1 and 11.9 ± 0.8 ppm, respectively. These variations cannot be accounted for by in situ decay of 26 Al given their respective 27 Al/ 24 Mg ratios. Instead, it requires that Ryugu and the CI and CR parent bodies formed from material with a different initial 26 Al/ 27 Al ratio or that they are sourced from material with distinct Mg isotope compositions. Thus, our new Mg isotope data challenge the notion that Ryugu and CI chondrites share a common nucleosynthetic heritage.

Solar system evolution↗

PCM-Based Durable Write Cache for Fast Disk I/O

Flash based solid-state devices (FSSDs) have been adopted within the memory hierarchy to improve the performance of hard disk drive (HDD) based storage system. However, with the fast development of storage-class memories, new storage technologies with better performance and higher write endurance than FSSDs are emerging, e.g., phase-change memory (PCM). Understanding how to leverage these state-of-the-art storage technologies for modern computing systems is important to solve challenging data intensive computing problems. In this paper, we propose to leverage PCM for a hybrid PCM-HDD storage architecture. We identify the limitations of traditional LRU caching algorithms for PCM-based caches, and develop a novel hash-based write caching scheme called HALO to improve random write performance of hard disks. To address the limited durability of PCM devices and solve the degraded spatial locality in traditional wear-leveling techniques, we further propose novel PCM management algorithms that provide effective wear-leveling while maximizing access parallelism. We have evaluated this PCM-based hybrid storage architecture using applications with a diverse set of I/O access patterns. Our experimental results demonstrate that the HALO caching scheme leads to an average reduction of 36.8% in execution time compared to the LRU caching scheme, and that the SFC wear leveling extends the lifetime of PCM by a factor of 21.6.

99 GENERAL AND MISCELLANEOUS↗