Search NASA⌕ Search

SEARCH · Search NASA

Results for “Resource allocation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 775 records · Page 43

I/O-aware bandwidth allocation for petascale computing systems

In the Big Data era, the gap between the storage performance and an appli- cation's I/O requirement is increasing. I/O congestion caused by concurrent storage accesses from multiple applications is inevitable and severely harms the performance. Conventional approaches either focus on optimizing an ap- plication's access pattern individually or handle I/O requests on a low-level storage layer without any knowledge from the upper-level applications. In this paper, we present a novel I/O-aware bandwidth allocation framework to coordinate ongoing I/O requests on petascale computing systems. The motivation behind this innovation is that the resource management system has a holistic view of both the system state and jobs' activities and can dy- namically control the jobs' status or allocate resource on the y during their execution. We treat a job's I/O requests as periodical subjobs within its lifecycle and transform the I/O congestion issue into a classical scheduling problem. Based on this model, we propose a bandwidth management mech- anism as an extension to the existing scheduling system. We design several bandwidth allocation policies with different optimization objectives either on user-oriented metrics or system performance. We conduct extensive trace- based simulations using real job traces and I/O traces from a production IBM Blue Gene/Q system at Argonne National Laboratory. Experimental results demonstrate that our new design can improve job performance by more than 30%, as well as increasing system performance.

I/O congestion↗

Sharing Resources In Mobile/Satellite Communications

Report presents preliminary theoretical analysis of several alternative schemes for allocation of satellite resource among terrestrial subscribers of landmobile/satellite communication system. Demand-access and random-access approaches under code-division and frequency-division concepts compared.

Yan, Tsun-Yee↗

Spectroscopic analysis reveals that soil phosphorus availability and plant allocation strategies impact feedstock quality of nutrient-limited switchgrass

Abstract The perennial native switchgrass adapts better than other plant species do to marginal soils with low plant-available nutrients, including those with low phosphorus (P) content. Switchgrass roots and their associated microorganisms can alter the pools of available P throughout the whole soil profile making predictions of P availability in situ challenging. Plant P homeostasis makes monitoring of P limitation via measurements of plant P content alone difficult to interpret. To address these challenges, we developed a machine-learning model trained with high accuracy using the leaf tissue chemical profile, rather than P content. By applying this learned model in field trials across two sites with contrasting extractable soil P, we observed that actual plant available P in soil was more similar than expected, suggesting that adaptations occurred to alleviate the apparent P constraint. These adaptations come at a metabolic cost to the plant that have consequences for feedstock chemical components and quality. We observed that other biochemical signatures of P limitation, such as decreased cellulose-to-lignin ratios, were apparent, indicating re-allocation of carbon resources may have contributed to increased P acquisition. Plant P allocation strategies also differed across sites, and these differences were correlated with the subsequent year’s biomass yields.

59 BASIC BIOLOGICAL SCIENCES↗

Quality of service for input/output memory management unit

A data processing system includes a memory, a group of input/output (I/O) devices, an input/output memory management unit (IOMMU). The IOMMU is connected to the memory and adapted to allocate a hardware resource from among a group of hardware resources to receive an address translation request for a memory access from an I/O device. The IOMMU detects address translation requests from the plurality of I/O devices. The IOMMU reorders the address translation requests such that an order of dispatching an address translation request is based on a policy associated with the I/O device that is requesting the memory access. The IOMMU selectively allocates a hardware resource to the input/output device, based on the policy that is associated with the I/O device in response to the reordering.

Basu, Arkaprava↗

Conjunctive Surface and Groundwater Management in Utah. Implications for Oil Shale and Oil Sands Development

Unconventional fuel development will require scarce water resources. In an environment characterized by scarcity, and where most water resources are fully allocated, prospective development will require minimizing water use and seeking to use water resources in the most efficient manner. Conjunctive use of surface and groundwater provides just such an opportunity. Conjunctive use includes two main practices: First, integrating surface water diversions and groundwater withdrawals to maximize efficiency and minimize impacts on other resource users and ecological processes. Second, conjunctive use includes capturing surplus or unused surface water and injecting or infiltrating that water into groundwater aquifers in order to increase recharge rates. Conjunctive management holds promise as a means of addressing some of the West's most intractable problems. Conjunctive management can firm up water supplies by more effectively capturing spring runoff and surplus water, and by integrating its use with groundwater withdrawals; surface and groundwater use can be further integrated with managed aquifer recharge projects. Such integration can maximize water storage and availability, while simultaneously minimizing evaporative loss, reservoir sedimentation, and surface use impacts. Any of these impacts, if left unresolved, could derail commercial-scale unconventional fuel development. Unconventional fuel developers could therefore benefit from incorporating conjunctive use into their development plans. Despite its advantages, conjunctive use is not a panacea. Conjunctive use means using resources in harmony to maximize and stabilize long-term supplies it does not mean maximizing the use of two separate but interrelated resources for unsustainable short-term gains and it cannot resolve all problems or provide water where no unappropriated water exists. Moreover, conjunctive use may pose risks to ecological values forgone when water that would otherwise remain in a stream is diverted for aquifer recharge or other uses. To better understand the rapidly evolving field of conjunctive use, this Topical Report begins with a discussion of Utah water law, with an emphasis on conjunctive use issues. We contrast Utah's approach with efforts undertaken in neighboring states and by the federal government. We then relate conjunctive use to the unconventional fuel industry and discuss how conjunctive use can help address pressing challenges. While conjunctive management cannot create water where none exists, it does hold promise to manage existing resources in a more efficient manner. Moreover, conjunctive management reflects an important trend in western water law that could provide benefit to those contemplating activities that require large-scale water development.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Using Snow Fences to Augument Fresh Water Supplies in Shallow Arctic Lakes

This project was funded by the U.S. Department of Energy, National Energy Technology Laboratory (NETL) to address environmental research questions specifically related to Alaska's oil and gas natural resources development. The focus of this project was on the environmental issues associated with allocation of water resources for construction of ice roads and ice pads. Earlier NETL projects showed that oil and gas exploration activities in the U.S. Arctic require large amounts of water for ice road and ice pad construction. Traditionally, lakes have been the source of freshwater for this purpose. The distinctive hydrological regime of northern lakes, caused by the presence of ice cover and permafrost, exerts influence on lake water availability in winter. Lakes are covered with ice from October to June, and there is often no water recharge of lakes until snowmelt in early June. After snowmelt, water volumes in the lakes decrease throughout the summer, when water loss due to evaporation is considerably greater than water gained from rainfall. This balance switches in August, when air temperature drops, evaporation decreases, and rain (or snow) is more likely to occur. Some of the summer surface storage deficit in the active layer and surface water bodies (lakes, ponds, wetlands) is recharged during this time. However, if the surface storage deficit is not replenished (for example, precipitation in the fall is low and near-surface soils are dry), lake recharge is directly affected, and water availability for the following winter is reduced.

54 ENVIRONMENTAL SCIENCES↗

Computational mechanics needs study

In order to assess the needs in computational mechanics over the next decade, we formulated a questionnaire and contacted computational mechanics researchers and users in industry, government, and academia. As expected, we found a wide variety of computational mechanics usage and research. This report outlines the activity discussed with those contacts, as well as that in our own organizations. It should be noted that most of the contacts were made before the recent decline of the defense industry. Therefore, areas which are strongly defense-oriented may decrease in relative importance. In order to facilitate updating of this study, names of a few key researchers in each area are included as starting points for future literature surveys. These lists of names are not intended to represent those persons doing the best research in that area, nor are they intended to be comprehensive. They are, as previously stated, offered as starting points for future literature searches. Overall, there is currently a broad activity in computational mechanics in this country, with the breadth and depth increasing as more sophisticated software and faster computers become more available. The needs and desires of the workers in this field are as diverse as their background and organizational products. There seems to be some degree of software development in any organization (although the level of activity is highly variable from one organization to another) which has any research component in its mission. It seems, however, that there is considerable use of commercial software in almost all organizations. In most industrial research organizations, it appears that very little actual software development is contracted out, but that most is done in-house, using a mixture of funding sources. Government agencies vary widely in the ratio of in-house to out-house ratio. There is a considerable amount of experimental verification in most, but not all, organizations. Generally, the amount of experimental verification is more than we expected. Of all the survey contacts, one or two believe that the resources they are allocated are sufficient, but most do not. Some believe they have only half the resources they need. Some see their resource deficits as short-term, while others see it as a trend which will continue or perhaps worsen. The pessimism is stronger in the defense and aerospace industry. When considering only the nonlinear development efforts, there appears to be an even mix of geometric and material nonlinearity. There is not much particular emphasis in linear analysis unless it is in extension of current analysis capabilities to larger problems. The primary exception is concern about modeling of composites, where proven methodologies have trailed element and computer hardware development. Most of the people we spoke to use finite element techniques, but there is some finite difference and boundary element work ongoing. There is also some interest in multiple methods. Coupling of finite elements and boundary elements appears to be of high interest, since the two analysis types are complementary.

Griffin, O. Hayden, Jr.↗

Assessing the Predictive Capability of the LIFEIV Nuclear Fuel Performance Code Using Sequential Calibration

This report considers the problem of calibrating a numerical model to data from an experimental campaign (or series of experimental tests). The issue is that when an experimental campaign is proposed, only the input parameters associated with each experiment are known (i.e. outputs are not known because the experiments have yet to be conducted). Faced with such a situation, it would be beneficial from the standpoint of resource management to carefully consider the sequence in which the experiments are conducted. In this way, the resources available for experimental tests may be allocated in a way that best 'informs' the calibration of the numerical model. To address this concern, the authors propose decomposing the input design space of the experimental campaign into its principal components. Subsequently, the utility (to be explained) of each experimental test to the principal components of the input design space is used to formulate the sequence in which the experimental tests will be used for model calibration purposes. The results reported herein build on those presented and discussed in [1,2] wherein Verification & Validation and Uncertainty Quantification (VU) capabilities were applied to the nuclear fuel performance code LIFEIV. In addition to the raw results from the sequential calibration studies derived from the above, a description of the data within the context of the Predictive Maturity Index (PMI) will also be provided. The PMI [3,4] is a metric initiated and developed at Los Alamos National Laboratory to quantitatively describe the ability of a numerical model to make predictions in the absence of experimental data, where it is noted that 'predictions in the absence of experimental data' is not synonymous with extrapolation. This simply reflects the fact that resources do not exist such that each and every execution of the numerical model can be compared against experimental data. If such resources existed, the justification for numerical models would be reduced considerably. The authors note that the PMI is primarily intended to provide a high-level, quantitative description of year-to-year (or version-to-version) improvements in numerical models, where these descriptions can be used as a means of justifying funding requests to support further model development research. It is in this context that the present report should be considered: the availability of data from experimental tests should be viewed as a time-dependent variable, where experiments are added to the calibration suite as resources become available. For the present report, the experimental data is of course already available (permitting demonstration of the proposed methodology). Furthermore, the authors are not proposing this methodology as the answer to the question of how to allocate resources for experimental tests, and readers are directed to [5] and the references contained in Section 1 of [5] for additional information on the subject. However, the strength of this methodology is that it offers a means by which to select the sequence of experiments in a pre-arranged experimental campaign (a situation for which the methods discussed in [5] are less appropriate). The report is organized as follows. Section 2 describes the methodology employed to formulate the sequences of experiments for the calibrations performed for this study. Section 3 then presents the results associated with two sequences; supplementary results are provided in the Appendix. The report then concludes in Section 4 with a brief summary.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Comparing the Efficiency of In Situ Visualization Paradigms at Scale

This work compares the two major paradigms for doing in situ visualization: in-line, where the simulation and visualization share the same resources, and in-transit, where simulation and visualization are given dedicated resources. Our runs vary many parameters, including simulation cycle time, visualization frequency, and dedicated resources, to study how tradeoffs change over configuration. In particular, we consider simulations as large as 1,024 nodes (16,384 cores) and dedicated visualization resources with as many as 512 nodes (8,192 cores). We draw conclusions about when each paradigm is superior, such as in-line being superior when the simulation cycle time is very fast. Surprisingly, we also find that in-transit can minimize the total resources consumed for some configurations, since it can cause the visualization routines to require fewer overall resources when they run at lower concurrency. For example, one of our scenarios finds that allocating 25% more resources for visualization allows the simulation to run 61% faster than its in-line comparator. Finally, we explore various models for quantifying the cost for each paradigm, and consider transition points when one paradigm is superior to the other. Our contributions inform design decisions for simulation scientists when performing in situ visualization.

Kress, James M.↗

HEPnOS: a Specialized Data Service for High Energy Physics Analysis

In this paper, we present HEPnOS, a distributed data service for managing data produced by high-energy physics (HEP) experiments. Using HEPnOS, HEP applications can use HPC resources more effciently than traditional fle-based applications. The fle-based model leads to a rigid, chunk-based allocation of computational resources and limits the number of cores that can be used concurrently by an HEP application. The fundamental problem is that organizing domain-specifc data into fles inadvertently introduces a single, artifcial, confated tuning parameter that puts key optimization goals into confict: larger fle sizes reduce metadata overhead and thus improve I/O effciency, but smaller fle sizes provide more opportunity for workfow parallelism and load balancing. In this work, we introduce a domain-specifc data service that decouples that constraint so that data can be accessed and processed in its natural granularity while still maintaining I/O effciency. By removing the constraints introduced by fle handling we are able to obtain better scaling and make effcient use of more cores for processing a fxed-sized data sample. We demonstrate the improved scalability by using an application developed in the fle-based paradigm and comparing it to a version modifed to use HEPnOS.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Systems and Photosystems: Cellular Limits of Autotrophic Productivity in Cyanobacteria

Recent advances in the modeling of microbial growth and metabolism have shown that growth rate critically depends upon the optimal allocation of finite proteomic resources among different cellular functions and that modeling growth rates becomes more realistic with the explicit accounting for the costs of macromolecular synthesis, most importantly, protein expression. The “proteomic constraint” is considered together with its application to understanding photosynthetic microbial growth. The central hypothesis is that physical limits of cellular space (and corresponding solvation capacity) in conjunction with cell surface-to-volume ratios represent the underlying constraints on the maximal rate of autotrophic microbial growth. The limitation of cellular space thus constrains the size the total complement of macromolecules, dissolved ions, and metabolites. To a first approximation, the upper limit in the cellular amount of the total proteome is bounded this space limit. This predicts that adaptation to osmotic stress will result in lower maximal growth rates due to decreased cellular concentrations of core metabolic proteins necessary for cell growth owing the accumulation of compatible osmolytes, as surmised previously. The finite capacity of membrane and cytoplasmic space also leads to the hypothesis that the species-specific differences in maximal growth rates likely reflect differences in the allocation of space to niche-specific proteins with the corresponding diminution of space devoted to other functions including proteins of core autotrophic metabolism, which drive cell reproduction. An optimization model for autotrophic microbial growth, the autotrophic replicator model, was developed based upon previous work investigating heterotrophic growth. The present model describes autotrophic growth in terms of the allocation protein resources among core functional groups including the photosynthetic electron transport chain, light-harvesting antennae, and the ribosome groups.

59 BASIC BIOLOGICAL SCIENCES↗

Alchemy to reason: Effective use of Cumulative Effects Assessment in resource management

Cumulative Effects Assessment (CEA) is a tool that can be useful in making decisions about natural resource management and allocation. The decisions to be made include those (i) necessary to construct planning and regulatory frameworks to control development activity so that societal goals will be achieved and (ii) whether or not to approve individual development projects, with or without conditions. The evolution of CEA into a more successful tool cannot occur independently of the evolution of decision making processes. Currently progress is painfully slow on both fronts. This paper explores some opportunities to accelerate improvements in decision making in natural resource management and in the utility of CEA as a tool to assist in making such decisions. The focus of the paper is on how to define the public interest by determining what is acceptable.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Power Sharing-Based Framework for Allocating Automatic Generation Control in Distributed Energy Resources: Preprint

The recent proliferation of distributed energy resources (DERs) in the power network along with the retirement of conventional generators has made it challenging to regulate system frequency. In this paper, we present a centralized control framework to leverage the potential of DERs in the distribution network in provisioning secondary frequency control services to the grid. The proposed framework is based on network volt-watt sensitivity analysis and takes into account DER operational and network-imposed constraints to allocate the automatic generation control (AGC) request among the aggregated units. The proposed framework was implemented on the IEEE 8500-node test feeder and results were validated against a standard linear programming-based scheme. Numerical results indicate that the proposed framework can successfully utilize the available power production headroom of the network to meet the AGC request while maintaining nodal voltages within acceptable limits.

distributed energy resources↗

Large Scale Computing and Storage Requirements for Nuclear Physics Research

The National Energy Research Scientific Computing Center (NERSC) is the primary computing center for the DOE Office of Science, serving approximately 4,000 users and hosting some 550 projects that involve nearly 700 codes for a wide variety of scientific disciplines. In addition to large-scale computing resources NERSC provides critical staff support and expertise to help scientists make the most efficient use of these resources to advance the scientific mission of the Office of Science. In May 2011, NERSC, DOE’s Office of Advanced Scientific Computing Research (ASCR) and DOE’s Office of Nuclear Physics (NP) held a workshop to characterize HPC requirements for NP research over the next three to five years. The effort is part of NERSC’s continuing involvement in anticipating future user needs and deploying necessary resources to meet these demands. The workshop revealed several key requirements, in addition to achieving its goal of characterizing NP computing. The key requirements include: 1. Larger allocations of computational resources at NERSC; 2. Visualization and analytics support; and 3. Support at NERSC for the unique needs of experimental nuclear physicists. This report expands upon these key points and adds others. The results are based upon representative samples, called “case studies,” of the needs of science teams within NP. The case studies were prepared by NP workshop participants and contain a summary of science goals, methods of solution, current and future computing requirements, and special software and support needs. Participants were also asked to describe their strategy for computing in the highly parallel, “multi-core” environment that is expected to dominate HPC architectures over the next few years. The report also includes a section with NERSC responses to the workshop findings. NERSC has many initiatives already underway that address key workshop findings and all of the action items are aligned with NERSC strategic plans.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Distributed Accounting on the Grid

By the late 1990s, the Internet was adequately equipped to move vast amounts of data between HPC (High Performance Computing) systems, and efforts were initiated to link together the national infrastructure of high performance computational and data storage resources together into a general computational utility 'grid', analogous to the national electrical power grid infrastructure. The purpose of the Computational grid is to provide dependable, consistent, pervasive, and inexpensive access to computational resources for the computing community in the form of a computing utility. This paper presents a fully distributed view of Grid usage accounting and a methodology for allocating Grid computational resources for use on a Grid computing system.

Thigpen, William↗

Automated Pollution Control

Patterned after the Cassini Resource Exchange (CRE), Sholtz and Associates established the Automated Credit Exchange (ACE), an Internet-based concept that automates the auctioning of "pollution credits" in Southern California. An early challenge of the Jet Propulsion Laboratory's Cassini mission was allocating the spacecraft's resources. To support the decision-making process, the CRE was developed. The system removes the need for the science instrument manager to know the individual instruments' requirements for the spacecraft resources. Instead, by utilizing principles of exchange, the CRE induces the instrument teams to reveal their requirements. In doing so, they arrive at an efficient allocation of spacecraft resources by trading among themselves. A Southern California RECLAIM air pollution credit trading market has been set up using same bartering methods utilized in the Cassini mission in order to help companies keep pollution and costs down.

Source record↗

Resource Management for Processing Wide Area Data Streams on Supercomputers

Modern scientific instruments generate enormous amount of data. Typically, the data collected from the instruments are stored in one or more files that are then moved to a distant supercomputer for processing. The final results are sent back to the user. In order to make effective use of the time on expensive instruments, experimenters want to process the data as they are generated. They want to stream the data from instruments' memory directly to a supercomputer's memory for analysis. Since the compute nodes in a supercomputer are not connected directly to the wide area network, the data streams need to be passed through intermediate gateway nodes. As opposed to the best effort file transfers, data streaming applications require resources at a specific time for a specific period. In this paper, we present a system model for enabling data streaming through gateway nodes and an algorithm to efficiently allocate gateway node resources along with compute nodes. We evaluate the algorithm using real-world traces on the Chameleon Cloud. The results show that our system can schedule compute and gateway resources efficiently for streaming analysis.

data streaming↗

Connecting Restricted, High-Availability, or Low-Latency Resources to a Seamless Global Pool for CMS

The connection of diverse and sometimes non-Grid enabled resource types to the CMS Global Pool, which is based on HTCondor and glideinWMS, has been a major goal of CMS. These resources range in type from a high-availability, low latency facility at CERN for urgent calibration studies, called the CAF, to a local user facility at the Fermilab LPC, allocation-based computing resources at NERSC and SDSC, opportunistic resources provided through the Open Science Grid, commercial clouds, and others, as well as access to opportunistic cycles on the CMS High Level Trigger farm. In addition, we have provided the capability to give priority to local users of beyond WLCG pledged resources at CMS sites. Many of the solutions employed to bring these diverse resource types into the Global Pool have common elements, while some are very specific to a particular project. This paper details some of the strategies and solutions used to access these resources through the Global Pool in a seamless manner.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗