Search NASA⌕ Search

SEARCH · Search NASA

Results for “earned value management”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

Earned Value Management Systems for Operations Activities

An earned value management system (EVMS), which monitors contractor performance, is a requirement for program and project management for all major acquisitions by the United States Federal Government with development effort: (i.e., an asset requiring management attention because of its importance to an agency’s mission; high development, operating, or maintenance costs; high risk and/or high return). As an area less explored in earned value management (EVM) practices, this paper will survey the application of an EVMS for operations activities defined as: (1) Non-capital asset activities that are projects (or project - like) with definable start and end dates, with discrete scopes of work, and measurable accomplishments; as well as (2) Routine or recurring facility or environmental operations. This paper will examine the use of an EVMS to evaluate performance of operations and maintenance activities required once construction of a capital asset is complete and being used as intended. Such activities include upgrades and maintenance in order for capital assets to meet their mission function over a life-cycle (through repair, replacement, etc.). This paper will provide background on this topic from the perspective of the Department of Energy (DOE) Environmental Management (EM) Program. In addition, it will provide material from a panel discussion provided by a group of experts from the October 2019 Office of Environmental Management Project Management Workshop, as well as material from subsequent research on this topic.

97 MATHEMATICS AND COMPUTING↗

Forward-Looking State-of-the-Art Review on Earned Value Management Systems: The Disconnect between Academia and Industry

Earned value management (EVM) is a project management approach that can enhance the probability of project success. It is applied widely across different industry sectors (e.g., energy, aerospace, construction, defense, and manufacturing), generally through the use of an earned value management system (EVMS). A holistic and up-to-date literature review on EVM and EVMS does not exist. A literature review can provide a comprehensive perspective on the topic, identifying and summarizing the existing body of knowledge, as a foundation to advance the state of practice of EVM/EVMS. Therefore, the objective of this paper is to investigate the EVM/EVMS state of the art by critically reviewing academic and industry publications, with a specific focus on the maturity of EVMS and the environment surrounding its implementation. By performing a systematic literature review, the authors identified 600 publications since the inception of the EVM concept in 1962, and then narrowed down this list to 160 relevant publications from the last decade for closer review. The findings include the discovery of eight emergent themes. Of these themes, “forecasting/prediction” constitutes the largest portion of the recent literature, followed by “application of EVMS.” One interesting finding is that EVMS maturity, although being a critical topic, is only discussed in one publication. Publications focused on EVM/EVMS have increased in the last decade and significant differences were found between academia and industry literature in terms of the limitations and extensions of EVM/EVMS, EVMS environment, and compliance. A key finding is that designing a reliable EVMS should combine both technical and social aspects of implementation. This forward-looking paper provides a state-of-the-art review while highlighting gaps in the existing EVM/EVMS body of knowledge and introducing new perspectives to support EVMS research and application.

42 ENGINEERING↗

Novel Earned Value Management System Maturity Framework and Its Relation to Project Performance

Earned value management systems (EVMS) are used by industry practitioners to successfully manage projects and programs; however, there has been no past study to characterize and evaluate the impact of EVMS maturity on project performance. This paper introduces a novel framework, developed to measure the EVMS maturity, composed of 56 attributes arrayed across ten subprocesses, which together make up an integrated project/program management system. This paper describes how the framework was conceived and developed, based on literature review and data collected from industry workshops. Then, it examines the relationship between EVMS maturity and ten project performance metrics through statistical analyses. The study analyzed project data from 35 projects and programs worth over $21.8 billion in total cost. For this sample, results showed statistically significant differences between projects with high and low EVMS maturity; on average, projects exhibiting high EVMS maturity have 54% less cost overruns and 19% less change orders versus their performance measurement baseline. Higher maturity projects and programs also achieve better customer satisfaction, meet business objectives more often, and are more often in compliance with EVMS standards and guidelines. This paper contributes to the body of knowledge by providing a practical and novel framework for assessing the maturity of earned value management systems. Practitioners can use the framework to improve their integrated project and program management.

99 GENERAL AND MISCELLANEOUS↗

An Effective Earned Value Management System (EVMS) is a Team Sport

We present a novel framework to assess 27 earned value management system (EVMS) environment factors and investigate their impact on project performance. A study of the EVMS literature, a survey of practitioners, and focus group meetings with 36 EVMS industry and government experts, supported the development of the framework. Focus groups involving 80 practitioners refined and tested it. We analyzed performance data from 35 completed projects/programs representing over US$21.8 billion in total cost; a project demonstrating a positive environment could save up to 25% in cost versus baseline. Practitioners can develop an effective EVMS environment by following the provided guidance.

Aramali, Vartenie↗

Using remote sensing to quantify the additional climate benefits of California forest carbon offset projects

Abstract Nature‐based climate solutions are a vital component of many climate mitigation strategies, including California's, which aims to achieve carbon neutrality by 2045. Most carbon offsets in California's cap‐and‐trade program come from improved forest management (IFM) projects. Since 2012, various landowners have set up IFM projects following the California Air Resources Board's IFM protocol. As many of these projects approach their 10th year, we now have the opportunity to assess their effectiveness, identify best practices, and suggest improvements toward future protocol revisions. In this study, we used remote sensing‐based datasets to evaluate the carbon trends and harvest histories of 37 IFM projects in California. Despite some current limitations and biases, these datasets can be used to quantify carbon accumulation and harvest rates in offset project lands relative to nearby similar “control” lands before and after the projects began. Five lines of evidence suggest that the carbon accumulated in offset projects to date has generally not been additional to what might have otherwise occurred: (1) most forests in northwestern California have been accumulating carbon since at least the mid‐1980s and continue to accumulate carbon, whether enrolled in offset projects or not; (2) harvest rates were high in large timber company project lands before IFM initiation, suggesting they are earning carbon credits for forests in recovery; (3) projects are often located on lands with higher densities of low‐timber‐value species; (4) carbon accumulation rates have not yet increased on lands that enroll as offset projects, relative to their pre‐enrollment levels; and (5) harvest rates have not decreased on most project lands since offset project initiation. These patterns suggest that the current protocol should be improved to robustly measure and reward additionality. In general, our framework of geospatial analyses offers an important and independent means to evaluate the effectiveness of the carbon offsets program, especially as these data products continue improving and as offsets receive attention as a climate mitigation strategy.

59 BASIC BIOLOGICAL SCIENCES↗

Valuing the Future Electric Grid: A Bid-Based Approach

Energy storage resources (ESRs) and other zero marginal cost (ZMC) resources have unique characteristics that are not fully captured in today’s electricity planning and operations modeling tools. Because the modeling assumptions used in these tools are simplified approximations of how operations and investment decisions occur in the real-world, accurately representing cost and operational characteristics are key for determining how these resources impact price formation. Questions such as—Where should we build new transmission? Will a small modular reactor earn enough revenue to participate in the future electric grid? Is retrofitting a coal plant with carbon capture technology economically feasible?—all require accurate electricity prices, which aren’t available from today’s electricity planning and operations modeling tools. As an example, production cost models (PCMs) are heavily utilized tools that determine the cost and reliability of the electric system. However, as PCMs were developed to help thermal generators manage their fuel inventories, production cost modeling is largely based on fuel prices. Because ESRs do not incur fuel costs, they are often modeled as ZMC resources. In reality, ESRs incur opportunity costs as well as technology-specific (degradation) costs that are non-trivial to calculate but are important for price formation. In this research, we identify options to incorporate more realistic opportunity and degradation costs in ESR bidding algorithms. Expanding available bidding assumptions allows energy system modelers to develop more accurate economic valuations for ESRs, leading to more accurate price formation from leading energy system modeling tools.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A National Infrastructure for Artificial Intelligence on the Grid (NI4AI) (Final Scientific/Technical Report)

Electric utilities have traditionally taken a very pragmatic yet myopic approach with grid sensors and the resulting collected data. Sensors are purchased and deployed to solve a specific, known problem that has risen to sufficient awareness as to justify the effort of deploying sensors and the needed capital investment. This sensor data flows into proprietary software packages with limited functionality intended only to address the initial problem. This approach aligns with the financial incentives of the utility to deploy capital into fixed hardware assets for which the corporations earn a rate of return. This mentality stands in stark contrast to the big data revolution that started nearly 25 years ago with the rise of Google. In this worldview, data is a fundamental business asset; successful organizations collect, store, explore, merge, and exploit as much data as possible to not only solve problems well understood today but also to tackle new problems that will inevitably rise tomorrow. The ARPA-E Open Innovation 2018 project entitled A National Infrastructure for Artificial Intelligence on the Grid or NI4AI for short was designed to demonstrate this alternative paradigm for using data. To do this, the project was composed of three key thrust areas. The first major component deployed a variety of high-frequency grid sensors and captured terabytes of both wide-scale and localized grid measurements, generating high-value datasets for grid research and algorithm development. The second aspect made available PingThings’ PredictiveGridTM, a horizontally scalable, cloud-based data management and AI platform built for time series data to explore and exploit the collected data. Finally, the project fostered a diverse and open research community composed of experts from numerous fields through focused educational content, code sharing, and data science competitions. Shifting away from “single use” sensors and closed data silos within electric utilities is a major benefit to the public at large. This legacy approach to data is incredibly (1) capital intensive (new sensors must be deployed for each new problem and problems tend to arise continuously) and (2) painfully slow (new problems must be identified first and then new sensors must be deployed to collect data to begin to address the issue). The transition to a carbon neutral grid requires a massive transformation of the existing grid infrastructure and will continue to challenge the legacy grid in unforeseen ways. The only way to make the energy transition cost effective is for utilities to abandon this dated data paradigm and adopt more contemporary approaches. NI4AI has shown that it is technically possible and economically feasible to ingest, explore, and exploit grid data collected from even very high frequency sensing, such as continuous point on wave sensors collecting measurements 10,000 times a second. In fact, the PredictiveGrid platform used is commercially available and deployed at several utilities in the United States. Project accomplishments were numerous and included (1) making available a state of the art time series platform to the community, (2) collecting over 520 streams of time series data from grid sensors totaling over 1 trillion grid measurements, and (3) developing and nurturing a community within the industry focused on the use of data to create value for utilities and, ultimately, end consumers.

97 MATHEMATICS AND COMPUTING↗