Search NASA⌕ Search

SEARCH · Search NASA

Results for “Resource allocation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26

Homogenizing OSG and XSEDE: Providing Access to XSEDE Allocations through OSG Infrastructure

We present a system that allows individual researchers and virtual organizations (VOs) to access allocations on Stampede2 and Bridges through the Open Science Grid (OSG), a national grid infrastructure for running high throughput computing (HTC) tasks. Using this system, VOs and researchers are able to run larger workflows than can be done with OSG resources alone. This system allows a VO or user to run on XSEDE resources (with their allocation) using the same framework used with OSG resources. The system consists of two parts: the compute element (CE) that routes workloads to the appropriate user accounts and allocation on XSEDE resources, and simulated access to the CernVM Filesystem (CVMFS) servers used by OSG and VOs to distribute software and data. This allows jobs submitted through this system to work on a homogeneous environment regardless of whether they run on XSEDE HPC resources (like Stampede2 and Bridges) or OSG.

Thapa, Thapa,Suchandra↗

The Argonne Leadership Computing Facility 2010 annual report.

Researchers found more ways than ever to conduct transformative science at the Argonne Leadership Computing Facility (ALCF) in 2010. Both familiar initiatives and innovative new programs at the ALCF are now serving a growing, global user community with a wide range of computing needs. The Department of Energy's (DOE) INCITE Program remained vital in providing scientists with major allocations of leadership-class computing resources at the ALCF. For calendar year 2011, 35 projects were awarded 732 million supercomputer processor-hours for computationally intensive, large-scale research projects with the potential to significantly advance key areas in science and engineering. Argonne also continued to provide Director's Discretionary allocations - 'start up' awards - for potential future INCITE projects. And DOE's new ASCR Leadership Computing (ALCC) Program allocated resources to 10 ALCF projects, with an emphasis on high-risk, high-payoff simulations directly related to the Department's energy mission, national emergencies, or for broadening the research community capable of using leadership computing resources. While delivering more science today, we've also been laying a solid foundation for high performance computing in the future. After a successful DOE Lehman review, a contract was signed to deliver Mira, the next-generation Blue Gene/Q system, to the ALCF in 2012. The ALCF is working with the 16 projects that were selected for the Early Science Program (ESP) to enable them to be productive as soon as Mira is operational. Preproduction access to Mira will enable ESP projects to adapt their codes to its architecture and collaborate with ALCF staff in shaking down the new system. We expect the 10-petaflops system to stoke economic growth and improve U.S. competitiveness in key areas such as advancing clean energy and addressing global climate change. Ultimately, we envision Mira as a stepping-stone to exascale-class computers that will be faster than petascale-class computers by a factor of a thousand. Pete Beckman, who served as the ALCF's Director for the past few years, has been named director of the newly created Exascale Technology and Computing Institute (ETCi). The institute will focus on developing exascale computing to extend scientific discovery and solve critical science and engineering problems. Just as Pete's leadership propelled the ALCF to great success, we know that that ETCi will benefit immensely from his expertise and experience. Without question, the future of supercomputing is certainly in good hands. I would like to thank Pete for all his effort over the past two years, during which he oversaw the establishing of ALCF2, the deployment of the Magellan project, increases in utilization, availability, and number of projects using ALCF1. He managed the rapid growth of ALCF staff and made the facility what it is today. All the staff and users are better for Pete's efforts.

54 ENVIRONMENTAL SCIENCES↗

I/O-aware bandwidth allocation for petascale computing systems

In the Big Data era, the gap between the storage performance and an appli- cation's I/O requirement is increasing. I/O congestion caused by concurrent storage accesses from multiple applications is inevitable and severely harms the performance. Conventional approaches either focus on optimizing an ap- plication's access pattern individually or handle I/O requests on a low-level storage layer without any knowledge from the upper-level applications. In this paper, we present a novel I/O-aware bandwidth allocation framework to coordinate ongoing I/O requests on petascale computing systems. The motivation behind this innovation is that the resource management system has a holistic view of both the system state and jobs' activities and can dy- namically control the jobs' status or allocate resource on the y during their execution. We treat a job's I/O requests as periodical subjobs within its lifecycle and transform the I/O congestion issue into a classical scheduling problem. Based on this model, we propose a bandwidth management mech- anism as an extension to the existing scheduling system. We design several bandwidth allocation policies with different optimization objectives either on user-oriented metrics or system performance. We conduct extensive trace- based simulations using real job traces and I/O traces from a production IBM Blue Gene/Q system at Argonne National Laboratory. Experimental results demonstrate that our new design can improve job performance by more than 30%, as well as increasing system performance.

I/O congestion↗

Spectroscopic analysis reveals that soil phosphorus availability and plant allocation strategies impact feedstock quality of nutrient-limited switchgrass

Abstract The perennial native switchgrass adapts better than other plant species do to marginal soils with low plant-available nutrients, including those with low phosphorus (P) content. Switchgrass roots and their associated microorganisms can alter the pools of available P throughout the whole soil profile making predictions of P availability in situ challenging. Plant P homeostasis makes monitoring of P limitation via measurements of plant P content alone difficult to interpret. To address these challenges, we developed a machine-learning model trained with high accuracy using the leaf tissue chemical profile, rather than P content. By applying this learned model in field trials across two sites with contrasting extractable soil P, we observed that actual plant available P in soil was more similar than expected, suggesting that adaptations occurred to alleviate the apparent P constraint. These adaptations come at a metabolic cost to the plant that have consequences for feedstock chemical components and quality. We observed that other biochemical signatures of P limitation, such as decreased cellulose-to-lignin ratios, were apparent, indicating re-allocation of carbon resources may have contributed to increased P acquisition. Plant P allocation strategies also differed across sites, and these differences were correlated with the subsequent year’s biomass yields.

59 BASIC BIOLOGICAL SCIENCES↗

Quality of service for input/output memory management unit

A data processing system includes a memory, a group of input/output (I/O) devices, an input/output memory management unit (IOMMU). The IOMMU is connected to the memory and adapted to allocate a hardware resource from among a group of hardware resources to receive an address translation request for a memory access from an I/O device. The IOMMU detects address translation requests from the plurality of I/O devices. The IOMMU reorders the address translation requests such that an order of dispatching an address translation request is based on a policy associated with the I/O device that is requesting the memory access. The IOMMU selectively allocates a hardware resource to the input/output device, based on the policy that is associated with the I/O device in response to the reordering.

Basu, Arkaprava↗

Conjunctive Surface and Groundwater Management in Utah. Implications for Oil Shale and Oil Sands Development

Unconventional fuel development will require scarce water resources. In an environment characterized by scarcity, and where most water resources are fully allocated, prospective development will require minimizing water use and seeking to use water resources in the most efficient manner. Conjunctive use of surface and groundwater provides just such an opportunity. Conjunctive use includes two main practices: First, integrating surface water diversions and groundwater withdrawals to maximize efficiency and minimize impacts on other resource users and ecological processes. Second, conjunctive use includes capturing surplus or unused surface water and injecting or infiltrating that water into groundwater aquifers in order to increase recharge rates. Conjunctive management holds promise as a means of addressing some of the West's most intractable problems. Conjunctive management can firm up water supplies by more effectively capturing spring runoff and surplus water, and by integrating its use with groundwater withdrawals; surface and groundwater use can be further integrated with managed aquifer recharge projects. Such integration can maximize water storage and availability, while simultaneously minimizing evaporative loss, reservoir sedimentation, and surface use impacts. Any of these impacts, if left unresolved, could derail commercial-scale unconventional fuel development. Unconventional fuel developers could therefore benefit from incorporating conjunctive use into their development plans. Despite its advantages, conjunctive use is not a panacea. Conjunctive use means using resources in harmony to maximize and stabilize long-term supplies it does not mean maximizing the use of two separate but interrelated resources for unsustainable short-term gains and it cannot resolve all problems or provide water where no unappropriated water exists. Moreover, conjunctive use may pose risks to ecological values forgone when water that would otherwise remain in a stream is diverted for aquifer recharge or other uses. To better understand the rapidly evolving field of conjunctive use, this Topical Report begins with a discussion of Utah water law, with an emphasis on conjunctive use issues. We contrast Utah's approach with efforts undertaken in neighboring states and by the federal government. We then relate conjunctive use to the unconventional fuel industry and discuss how conjunctive use can help address pressing challenges. While conjunctive management cannot create water where none exists, it does hold promise to manage existing resources in a more efficient manner. Moreover, conjunctive management reflects an important trend in western water law that could provide benefit to those contemplating activities that require large-scale water development.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Using Snow Fences to Augument Fresh Water Supplies in Shallow Arctic Lakes

This project was funded by the U.S. Department of Energy, National Energy Technology Laboratory (NETL) to address environmental research questions specifically related to Alaska's oil and gas natural resources development. The focus of this project was on the environmental issues associated with allocation of water resources for construction of ice roads and ice pads. Earlier NETL projects showed that oil and gas exploration activities in the U.S. Arctic require large amounts of water for ice road and ice pad construction. Traditionally, lakes have been the source of freshwater for this purpose. The distinctive hydrological regime of northern lakes, caused by the presence of ice cover and permafrost, exerts influence on lake water availability in winter. Lakes are covered with ice from October to June, and there is often no water recharge of lakes until snowmelt in early June. After snowmelt, water volumes in the lakes decrease throughout the summer, when water loss due to evaporation is considerably greater than water gained from rainfall. This balance switches in August, when air temperature drops, evaporation decreases, and rain (or snow) is more likely to occur. Some of the summer surface storage deficit in the active layer and surface water bodies (lakes, ponds, wetlands) is recharged during this time. However, if the surface storage deficit is not replenished (for example, precipitation in the fall is low and near-surface soils are dry), lake recharge is directly affected, and water availability for the following winter is reduced.

54 ENVIRONMENTAL SCIENCES↗

Assessing the Predictive Capability of the LIFEIV Nuclear Fuel Performance Code Using Sequential Calibration

This report considers the problem of calibrating a numerical model to data from an experimental campaign (or series of experimental tests). The issue is that when an experimental campaign is proposed, only the input parameters associated with each experiment are known (i.e. outputs are not known because the experiments have yet to be conducted). Faced with such a situation, it would be beneficial from the standpoint of resource management to carefully consider the sequence in which the experiments are conducted. In this way, the resources available for experimental tests may be allocated in a way that best 'informs' the calibration of the numerical model. To address this concern, the authors propose decomposing the input design space of the experimental campaign into its principal components. Subsequently, the utility (to be explained) of each experimental test to the principal components of the input design space is used to formulate the sequence in which the experimental tests will be used for model calibration purposes. The results reported herein build on those presented and discussed in [1,2] wherein Verification & Validation and Uncertainty Quantification (VU) capabilities were applied to the nuclear fuel performance code LIFEIV. In addition to the raw results from the sequential calibration studies derived from the above, a description of the data within the context of the Predictive Maturity Index (PMI) will also be provided. The PMI [3,4] is a metric initiated and developed at Los Alamos National Laboratory to quantitatively describe the ability of a numerical model to make predictions in the absence of experimental data, where it is noted that 'predictions in the absence of experimental data' is not synonymous with extrapolation. This simply reflects the fact that resources do not exist such that each and every execution of the numerical model can be compared against experimental data. If such resources existed, the justification for numerical models would be reduced considerably. The authors note that the PMI is primarily intended to provide a high-level, quantitative description of year-to-year (or version-to-version) improvements in numerical models, where these descriptions can be used as a means of justifying funding requests to support further model development research. It is in this context that the present report should be considered: the availability of data from experimental tests should be viewed as a time-dependent variable, where experiments are added to the calibration suite as resources become available. For the present report, the experimental data is of course already available (permitting demonstration of the proposed methodology). Furthermore, the authors are not proposing this methodology as the answer to the question of how to allocate resources for experimental tests, and readers are directed to [5] and the references contained in Section 1 of [5] for additional information on the subject. However, the strength of this methodology is that it offers a means by which to select the sequence of experiments in a pre-arranged experimental campaign (a situation for which the methods discussed in [5] are less appropriate). The report is organized as follows. Section 2 describes the methodology employed to formulate the sequences of experiments for the calibrations performed for this study. Section 3 then presents the results associated with two sequences; supplementary results are provided in the Appendix. The report then concludes in Section 4 with a brief summary.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Comparing the Efficiency of In Situ Visualization Paradigms at Scale

This work compares the two major paradigms for doing in situ visualization: in-line, where the simulation and visualization share the same resources, and in-transit, where simulation and visualization are given dedicated resources. Our runs vary many parameters, including simulation cycle time, visualization frequency, and dedicated resources, to study how tradeoffs change over configuration. In particular, we consider simulations as large as 1,024 nodes (16,384 cores) and dedicated visualization resources with as many as 512 nodes (8,192 cores). We draw conclusions about when each paradigm is superior, such as in-line being superior when the simulation cycle time is very fast. Surprisingly, we also find that in-transit can minimize the total resources consumed for some configurations, since it can cause the visualization routines to require fewer overall resources when they run at lower concurrency. For example, one of our scenarios finds that allocating 25% more resources for visualization allows the simulation to run 61% faster than its in-line comparator. Finally, we explore various models for quantifying the cost for each paradigm, and consider transition points when one paradigm is superior to the other. Our contributions inform design decisions for simulation scientists when performing in situ visualization.

Kress, James M.↗

HEPnOS: a Specialized Data Service for High Energy Physics Analysis

In this paper, we present HEPnOS, a distributed data service for managing data produced by high-energy physics (HEP) experiments. Using HEPnOS, HEP applications can use HPC resources more effciently than traditional fle-based applications. The fle-based model leads to a rigid, chunk-based allocation of computational resources and limits the number of cores that can be used concurrently by an HEP application. The fundamental problem is that organizing domain-specifc data into fles inadvertently introduces a single, artifcial, confated tuning parameter that puts key optimization goals into confict: larger fle sizes reduce metadata overhead and thus improve I/O effciency, but smaller fle sizes provide more opportunity for workfow parallelism and load balancing. In this work, we introduce a domain-specifc data service that decouples that constraint so that data can be accessed and processed in its natural granularity while still maintaining I/O effciency. By removing the constraints introduced by fle handling we are able to obtain better scaling and make effcient use of more cores for processing a fxed-sized data sample. We demonstrate the improved scalability by using an application developed in the fle-based paradigm and comparing it to a version modifed to use HEPnOS.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Systems and Photosystems: Cellular Limits of Autotrophic Productivity in Cyanobacteria

Recent advances in the modeling of microbial growth and metabolism have shown that growth rate critically depends upon the optimal allocation of finite proteomic resources among different cellular functions and that modeling growth rates becomes more realistic with the explicit accounting for the costs of macromolecular synthesis, most importantly, protein expression. The “proteomic constraint” is considered together with its application to understanding photosynthetic microbial growth. The central hypothesis is that physical limits of cellular space (and corresponding solvation capacity) in conjunction with cell surface-to-volume ratios represent the underlying constraints on the maximal rate of autotrophic microbial growth. The limitation of cellular space thus constrains the size the total complement of macromolecules, dissolved ions, and metabolites. To a first approximation, the upper limit in the cellular amount of the total proteome is bounded this space limit. This predicts that adaptation to osmotic stress will result in lower maximal growth rates due to decreased cellular concentrations of core metabolic proteins necessary for cell growth owing the accumulation of compatible osmolytes, as surmised previously. The finite capacity of membrane and cytoplasmic space also leads to the hypothesis that the species-specific differences in maximal growth rates likely reflect differences in the allocation of space to niche-specific proteins with the corresponding diminution of space devoted to other functions including proteins of core autotrophic metabolism, which drive cell reproduction. An optimization model for autotrophic microbial growth, the autotrophic replicator model, was developed based upon previous work investigating heterotrophic growth. The present model describes autotrophic growth in terms of the allocation protein resources among core functional groups including the photosynthetic electron transport chain, light-harvesting antennae, and the ribosome groups.

59 BASIC BIOLOGICAL SCIENCES↗

Alchemy to reason: Effective use of Cumulative Effects Assessment in resource management

Cumulative Effects Assessment (CEA) is a tool that can be useful in making decisions about natural resource management and allocation. The decisions to be made include those (i) necessary to construct planning and regulatory frameworks to control development activity so that societal goals will be achieved and (ii) whether or not to approve individual development projects, with or without conditions. The evolution of CEA into a more successful tool cannot occur independently of the evolution of decision making processes. Currently progress is painfully slow on both fronts. This paper explores some opportunities to accelerate improvements in decision making in natural resource management and in the utility of CEA as a tool to assist in making such decisions. The focus of the paper is on how to define the public interest by determining what is acceptable.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Power Sharing-Based Framework for Allocating Automatic Generation Control in Distributed Energy Resources: Preprint

The recent proliferation of distributed energy resources (DERs) in the power network along with the retirement of conventional generators has made it challenging to regulate system frequency. In this paper, we present a centralized control framework to leverage the potential of DERs in the distribution network in provisioning secondary frequency control services to the grid. The proposed framework is based on network volt-watt sensitivity analysis and takes into account DER operational and network-imposed constraints to allocate the automatic generation control (AGC) request among the aggregated units. The proposed framework was implemented on the IEEE 8500-node test feeder and results were validated against a standard linear programming-based scheme. Numerical results indicate that the proposed framework can successfully utilize the available power production headroom of the network to meet the AGC request while maintaining nodal voltages within acceptable limits.

distributed energy resources↗

Large Scale Computing and Storage Requirements for Nuclear Physics Research

The National Energy Research Scientific Computing Center (NERSC) is the primary computing center for the DOE Office of Science, serving approximately 4,000 users and hosting some 550 projects that involve nearly 700 codes for a wide variety of scientific disciplines. In addition to large-scale computing resources NERSC provides critical staff support and expertise to help scientists make the most efficient use of these resources to advance the scientific mission of the Office of Science. In May 2011, NERSC, DOE’s Office of Advanced Scientific Computing Research (ASCR) and DOE’s Office of Nuclear Physics (NP) held a workshop to characterize HPC requirements for NP research over the next three to five years. The effort is part of NERSC’s continuing involvement in anticipating future user needs and deploying necessary resources to meet these demands. The workshop revealed several key requirements, in addition to achieving its goal of characterizing NP computing. The key requirements include: 1. Larger allocations of computational resources at NERSC; 2. Visualization and analytics support; and 3. Support at NERSC for the unique needs of experimental nuclear physicists. This report expands upon these key points and adds others. The results are based upon representative samples, called “case studies,” of the needs of science teams within NP. The case studies were prepared by NP workshop participants and contain a summary of science goals, methods of solution, current and future computing requirements, and special software and support needs. Participants were also asked to describe their strategy for computing in the highly parallel, “multi-core” environment that is expected to dominate HPC architectures over the next few years. The report also includes a section with NERSC responses to the workshop findings. NERSC has many initiatives already underway that address key workshop findings and all of the action items are aligned with NERSC strategic plans.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Resource Management for Processing Wide Area Data Streams on Supercomputers

Modern scientific instruments generate enormous amount of data. Typically, the data collected from the instruments are stored in one or more files that are then moved to a distant supercomputer for processing. The final results are sent back to the user. In order to make effective use of the time on expensive instruments, experimenters want to process the data as they are generated. They want to stream the data from instruments' memory directly to a supercomputer's memory for analysis. Since the compute nodes in a supercomputer are not connected directly to the wide area network, the data streams need to be passed through intermediate gateway nodes. As opposed to the best effort file transfers, data streaming applications require resources at a specific time for a specific period. In this paper, we present a system model for enabling data streaming through gateway nodes and an algorithm to efficiently allocate gateway node resources along with compute nodes. We evaluate the algorithm using real-world traces on the Chameleon Cloud. The results show that our system can schedule compute and gateway resources efficiently for streaming analysis.

data streaming↗

Connecting Restricted, High-Availability, or Low-Latency Resources to a Seamless Global Pool for CMS

The connection of diverse and sometimes non-Grid enabled resource types to the CMS Global Pool, which is based on HTCondor and glideinWMS, has been a major goal of CMS. These resources range in type from a high-availability, low latency facility at CERN for urgent calibration studies, called the CAF, to a local user facility at the Fermilab LPC, allocation-based computing resources at NERSC and SDSC, opportunistic resources provided through the Open Science Grid, commercial clouds, and others, as well as access to opportunistic cycles on the CMS High Level Trigger farm. In addition, we have provided the capability to give priority to local users of beyond WLCG pledged resources at CMS sites. Many of the solutions employed to bring these diverse resource types into the Global Pool have common elements, while some are very specific to a particular project. This paper details some of the strategies and solutions used to access these resources through the Global Pool in a seamless manner.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Proportion of fine roots, but not plant biomass allocation below ground, increases with elevation in arctic tundra

Questions: Roots represent a considerable proportion of biomass, primary production and litter input in arctic tundra, and plant allocation of biomass to above- or below- ground tissue in response to climate change is a key factor in the future C balance of these ecosystems. According to optimality theory plants allocate C to the above- or below-ground structure that captures the most limiting resource. We used an elevational gradient to test this theory and as a space-for-time substitution to inform on tundra carbon allocation patterns under a shifting climate, by exploring if increasing elevation was positively related to the root:shoot ratio, as well as a larger plant allocation to adsorptive over storage roots. Location: Arctic tundra heath dominated by Empetrum hermaphroditum close to Abisko, Sweden. Methods: We measured root:shoot and fine:coarse root ratios of the plant communities along an elevational gradient by sampling above- and below-ground biomass, further separating root biomass into fine (<1 mm) and coarse roots. Results: Plant biomass was higher at the lower elevations, but the root:shoot ratio did not vary with elevation. Resource allocation to fine relative to coarse roots increased with elevation, resulting in a fine:coarse root ratio that more than doubled with in- creasing elevation. Conclusions: Contrary to previous works, the root:shoot ratio along this elevational gradient remained stable. However, communities along our study system were dominated by the same species at each elevation, which suggests that when changes in the root:shoot ratio occur with elevation these changes may be driven by differences in allocation patterns among species and thus turnover in plant community structure. Our results further reveal that the allocation of biomass to fine relative to coarse roots can differ between locations along an elevational gradient, even when overall above- vs below-ground biomass allocation does not. Given the functionally different roles of fine vs coarse roots this could have large implications for below-ground C cycling. Thus. our results highlight the importance of direct effects vs indirect effects (such as changes in plant community composition and nutrient availability) of climate change for future C allocation above and below ground.

59 BASIC BIOLOGICAL SCIENCES↗

Modeling and Automation Framework for High IBR Integration in Large-Scale Power Systems

The increasing prevalence of power electronics- interfaced renewable generation sources is leading to a gradual replacement of traditional thermal generation-based synchronous machines. In this context, the modeling of a large-scale power grid that incorporates a significant number of inverter-based resources is crucial for understanding the dynamics and effects of these resources on the power system. This study investigates the positive sequence model of grid-following and grid-forming inverters. Additionally, this work explores the integration of distributed energy resources using population as an indicator of their relative geographic locations. To address challenge to integrate these inverter based resources into a realistic grid of the US Western interconnection, automation scripts are developed to streamline the process of replacing conventional generators with grid-following and grid-forming inverters, as well as allocating distributed energy resources. Different penetration levels of these inverters are considered, and their frequency regulation support following a disturbance is compared through dynamic simulations.

Lyu, Xue↗