Search NASA⌕ Search

SEARCH · Search NASA

Results for “Earned Value Management”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

Earned Value Management Systems for Operations Activities

An earned value management system (EVMS), which monitors contractor performance, is a requirement for program and project management for all major acquisitions by the United States Federal Government with development effort: (i.e., an asset requiring management attention because of its importance to an agency’s mission; high development, operating, or maintenance costs; high risk and/or high return). As an area less explored in earned value management (EVM) practices, this paper will survey the application of an EVMS for operations activities defined as: (1) Non-capital asset activities that are projects (or project - like) with definable start and end dates, with discrete scopes of work, and measurable accomplishments; as well as (2) Routine or recurring facility or environmental operations. This paper will examine the use of an EVMS to evaluate performance of operations and maintenance activities required once construction of a capital asset is complete and being used as intended. Such activities include upgrades and maintenance in order for capital assets to meet their mission function over a life-cycle (through repair, replacement, etc.). This paper will provide background on this topic from the perspective of the Department of Energy (DOE) Environmental Management (EM) Program. In addition, it will provide material from a panel discussion provided by a group of experts from the October 2019 Office of Environmental Management Project Management Workshop, as well as material from subsequent research on this topic.

97 MATHEMATICS AND COMPUTING↗

Forward-Looking State-of-the-Art Review on Earned Value Management Systems: The Disconnect between Academia and Industry

Earned value management (EVM) is a project management approach that can enhance the probability of project success. It is applied widely across different industry sectors (e.g., energy, aerospace, construction, defense, and manufacturing), generally through the use of an earned value management system (EVMS). A holistic and up-to-date literature review on EVM and EVMS does not exist. A literature review can provide a comprehensive perspective on the topic, identifying and summarizing the existing body of knowledge, as a foundation to advance the state of practice of EVM/EVMS. Therefore, the objective of this paper is to investigate the EVM/EVMS state of the art by critically reviewing academic and industry publications, with a specific focus on the maturity of EVMS and the environment surrounding its implementation. By performing a systematic literature review, the authors identified 600 publications since the inception of the EVM concept in 1962, and then narrowed down this list to 160 relevant publications from the last decade for closer review. The findings include the discovery of eight emergent themes. Of these themes, “forecasting/prediction” constitutes the largest portion of the recent literature, followed by “application of EVMS.” One interesting finding is that EVMS maturity, although being a critical topic, is only discussed in one publication. Publications focused on EVM/EVMS have increased in the last decade and significant differences were found between academia and industry literature in terms of the limitations and extensions of EVM/EVMS, EVMS environment, and compliance. A key finding is that designing a reliable EVMS should combine both technical and social aspects of implementation. This forward-looking paper provides a state-of-the-art review while highlighting gaps in the existing EVM/EVMS body of knowledge and introducing new perspectives to support EVMS research and application.

42 ENGINEERING↗

Novel Earned Value Management System Maturity Framework and Its Relation to Project Performance

Earned value management systems (EVMS) are used by industry practitioners to successfully manage projects and programs; however, there has been no past study to characterize and evaluate the impact of EVMS maturity on project performance. This paper introduces a novel framework, developed to measure the EVMS maturity, composed of 56 attributes arrayed across ten subprocesses, which together make up an integrated project/program management system. This paper describes how the framework was conceived and developed, based on literature review and data collected from industry workshops. Then, it examines the relationship between EVMS maturity and ten project performance metrics through statistical analyses. The study analyzed project data from 35 projects and programs worth over $21.8 billion in total cost. For this sample, results showed statistically significant differences between projects with high and low EVMS maturity; on average, projects exhibiting high EVMS maturity have 54% less cost overruns and 19% less change orders versus their performance measurement baseline. Higher maturity projects and programs also achieve better customer satisfaction, meet business objectives more often, and are more often in compliance with EVMS standards and guidelines. This paper contributes to the body of knowledge by providing a practical and novel framework for assessing the maturity of earned value management systems. Practitioners can use the framework to improve their integrated project and program management.

99 GENERAL AND MISCELLANEOUS↗

An Effective Earned Value Management System (EVMS) is a Team Sport

We present a novel framework to assess 27 earned value management system (EVMS) environment factors and investigate their impact on project performance. A study of the EVMS literature, a survey of practitioners, and focus group meetings with 36 EVMS industry and government experts, supported the development of the framework. Focus groups involving 80 practitioners refined and tested it. We analyzed performance data from 35 completed projects/programs representing over US$21.8 billion in total cost; a project demonstrating a positive environment could save up to 25% in cost versus baseline. Practitioners can develop an effective EVMS environment by following the provided guidance.

Aramali, Vartenie↗

Use of Historical EM Practices and Policies for Management of Cleanup Program and Address GAO Concerns - 20222

As Department of Energy (DOE) Environmental Management (EM) program policies and management practices are revised over time, it might be useful to periodically reflect on the DOE EM program's past to identify practices that have worked and those that might be appropriate for possible reuse in the future. An added impetus to examine alternative approaches is the recent Government Accountability Office (GAO) report entitled 'Nuclear Waste Cleanup - DOE Could Improve Program and Project Management by Better Classifying Work and Following Leading Practices.' The February 2019 GAO report states that EM categorizes most of its work in a way that does not adequately involve independent experts and DOE senior leadership. It also noted that EM has not followed leading practices for program and project management that could help keep the cleanup efforts on schedule and control costs. The GAO report recommended that EM, working with DOE Office of Project Management (PM): - Establish requirements and then assess EM's ongoing operations activities to determine if some activities should be reclassified as capital asset projects based on these newly established requirements. - Review and revise EM's 2017 cleanup policy to include program management leading practices related to scope, cost, schedule performance, and independent reviews. - Update the cleanup policy to require that earned value management (EVM) systems be maintained and used in a way that follows EVM best practices. - Develop a policy to ensure that work is categorized as level of effort (LOE) only in appropriate, specified circumstances, such as when work is not measurable or when measurement is impractical. - Integrate EVM data into EM's performance metrics for operations activities. To assist with improving program performance and implementing audit recommendations, this paper reviewed past successful cleanups such as Weldon Springs, Rocky Flats, Fernald, Ashtabula, Battelle Columbus (abs, and other historical resources and people with experience during the early years of EM program. As such, there are several past practices which may well be suited for reuse today. Some of these practices include: - In 1990's, as the DOE EM cleanup program, known as Environmental Restoration came into effect, the known cleanup scope at each geographic location or site was organized into four levels ranging from overall site-wide cleanup effort to the individual 'release sites', providing high granularity to the program. - The cleanup program was organized by geography (Northwest, Southwest, Eastern Area Programs, etc.). These 'sub-program' managers provided a degree of Headquarters oversight and management allowing upper management (EM-1, 2, and 3) to focus on major decisions and issues. - Budget levels at selected cleanup sites were funded above 'minimum-safety' levels to accelerate actual cleanup work. - Past practice utilized EVM techniques and uniform EM oversight over all discrete project-like activities, providing for a coordinated cleanup effort. - EM managed LOE activities using benchmarking and best in class management practice techniques to help manage costs. - EM managed and reviewed entire site cleanup baselines, not only individual projects, focusing on a successful overall outcome. - Sites had a 'Road map' or 'Management Action Plan' that provided the overall strategy or plan for that site's cleanup - this helped with understanding and coordination of efforts. - EM had a robust lessons-learned program and database to capture and transmit worthy ideas. - EM had well-structured cleanup baseline change control policies to control cost and schedule changes, at the contractor and higher Headquarters levels. Finally, some of the GAO observations may be valid, however it is not clear as to their extent. For example, for some operation types of work, the use of the Level of Effort (LOE) earned value method to track progress may be appropriate. Also, to ensure independence of thought, and to obtain useful insight on past practices, it may be suitable to have former EM employees to assist with understanding past practices or to verify that activities have been properly identified. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Latest Developments in PM Systems and Methods and their Application to WM Projects - 20364

How do you improve on an industry that is well established yet often misses the mark on key metrics demonstrating effective planning and execution of project scope, schedule and budget? With the increased complexity of DOE projects relative to either poorly kept records of what wastes are stored or the lack of specific knowledge relative to the waste concentrations/quantities, this is a question continually asked and investigated by many. In fact, in 2017, the GAO's report to Congress indicated that although the DOE has made some progress on its monitoring effectiveness and demonstrating progress criteria, these goals were not met and there needs to be more improvement and monitoring. This paper will offer some insights into the latest developments in project management methodologies and the possible application of these to waste management projects. Traditional data generated via a project schedule that utilizes critical path methodology (CPM) and additional earned value management (EVM) data needs to be accurate and enable the project manager to better understand the probability of project success. Although this data has readily been available on most large-scale projects, success as measured by various stakeholder groups including the client, project team, regulators, etc. is less than optimal. Therefore, an urgent need exists to explore how traditional project data (CPM and EVM) coupled with new methodologies allows for better planning and execution by the project team. Many new approaches/methodologies can even be used to predict the success of options prior to full implementation on the actual project. Three approaches/methodologies will be discussed: - Artificial Intelligence; - Change Management; - Blend of Traditional Management (Gantt chart) and Agile Methodologies. As market forces change, so will the direction of project management. The days of 'one size fits all' are no longer valid. A combination of predictive and adaptive approaches in the management of projects is essential to enable execution of project deliverables on time, under budget, and within the contractual scope. This paper is intended to provide the reader with insight to the close relationship of project management trends and business management trends, and to provoke critical thinking about what it means to align project management strategy with an environment of non-stop innovation. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Decommissioning of the V1 Nuclear Power Plant Jaslovske Bohunice - 20270

The paper focuses on introducing the approach and method applied for decommissioning of the V1 nuclear power plant (further the 'V1 NPP') located in Jaslovske Bohunice in the Slovak Republic, to the conference participants. The Paper outlines activities and steps necessary to comply with the requirements contained in the decision of the Slovak government from 1999 regarding the early shutdown of the V1 NPP. The company responsible for the V1 NPP decommissioning is Jadrova a vyradovacia spolocnost, a.s., (further JAVYS) with the State as a sole shareholder. On the basis of the V1 NPP Decommissioning Conceptual Plan, out of four assessed options, JAVYS selected the immediate decommissioning option (the 'IDO') for the V1 NPP. On the basis of multi-criteria analysis, the IDO specified the approach of immediate and continuous dismantling of equipment followed by demolition of buildings and preparation of the site for its further potential use. The IDO also included the summary of technical, environmental, legislative information as well as the determination of assumed costs for decommissioning of the V1 NPP. Prior to commencement of the V1 NPP decommissioning, within the process of termination of operation, activities connected with de-fuelling, monitoring, processing of historical waste and, not to forget, the process of obtaining the license for the V1 NPP decommissioning were executed. JAVYS decided to divide the decommissioning process into two stages. In 2011, JAVYS obtained a license for the first stage of the V1 NPP decommissioning. Within this stage, dismantling of inactive equipment, demolitions of inactive buildings, monitoring of systems and preparatory works for the upcoming stage of decommissioning were implemented. In 2015, in line with the license for the 2. stage of the V1 NPP decommissioning, the activities of decontamination and dismantling of contaminated and active equipment as well as demolitions of remaining buildings began. In this stage radioactive waste (RAW) produced during the decommissioning is to be processed. After decontamination, the material fulfilling the free release criteria is to be released into the environment, the site is to be cleared from the scope of the Atomic Act and released from the surveillance of the national regulators. Future application of certain methods and techniques for decontamination and dismantling in similar environments might bring an added value to the operators. Paper includes a description of best practices for Nuclear Power Plant VVER type reactors decommissioning. Schedule comparison is given to show how the critical path of certain projects is being managed. Application of the International Standard for Decommissioning Costing (ISDC) methodology provides a uniform method which enables comparison of cost estimates to other nuclear facilities under decommissioning. The cost estimate for the V1 NPP decommissioning has been continuously updated based on more advanced and detailed information on the decommissioning activities and projects. Monitoring of progress of the V1 NPP decommissioning is performed via four key-performance indicators. The Earned Value Management (EVM) methodology is used for evaluating time and cost aspect of decommissioning activities while waste conditioning index is calculated by comparing the actually produced waste to planned values of waste for a respective monitored period. Radiological safety index is assessed by comparison of the personnel records on the individual yearly doses received by each respective employee to the boundary value. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Tailoring EVMS Tools for Projects under $50M

The Earned Value Management System (EVMS) Tailoring Guide for Projects Under $\$$50M is designed for U.S. Department of Energy (DOE) cost-reimbursed projects less than $50M where full EVMS is not required per DOE Order 413.3B but is applicable to all projects below a mandated compliant EVMS requirement. The guide provides an inventory of tools and rules typically used as part of a fully compliant EVMS. The ranking employed in this guide identifies key foundational tools, as well as identifying opportunities for tailoring based upon project size or risk. The goal is to provide guidance for companies to establish enterprise level tools that provide meaningful performance data as efficiently as possible.

99 GENERAL AND MISCELLANEOUS↗

Using remote sensing to quantify the additional climate benefits of California forest carbon offset projects

Abstract Nature‐based climate solutions are a vital component of many climate mitigation strategies, including California's, which aims to achieve carbon neutrality by 2045. Most carbon offsets in California's cap‐and‐trade program come from improved forest management (IFM) projects. Since 2012, various landowners have set up IFM projects following the California Air Resources Board's IFM protocol. As many of these projects approach their 10th year, we now have the opportunity to assess their effectiveness, identify best practices, and suggest improvements toward future protocol revisions. In this study, we used remote sensing‐based datasets to evaluate the carbon trends and harvest histories of 37 IFM projects in California. Despite some current limitations and biases, these datasets can be used to quantify carbon accumulation and harvest rates in offset project lands relative to nearby similar “control” lands before and after the projects began. Five lines of evidence suggest that the carbon accumulated in offset projects to date has generally not been additional to what might have otherwise occurred: (1) most forests in northwestern California have been accumulating carbon since at least the mid‐1980s and continue to accumulate carbon, whether enrolled in offset projects or not; (2) harvest rates were high in large timber company project lands before IFM initiation, suggesting they are earning carbon credits for forests in recovery; (3) projects are often located on lands with higher densities of low‐timber‐value species; (4) carbon accumulation rates have not yet increased on lands that enroll as offset projects, relative to their pre‐enrollment levels; and (5) harvest rates have not decreased on most project lands since offset project initiation. These patterns suggest that the current protocol should be improved to robustly measure and reward additionality. In general, our framework of geospatial analyses offers an important and independent means to evaluate the effectiveness of the carbon offsets program, especially as these data products continue improving and as offsets receive attention as a climate mitigation strategy.

59 BASIC BIOLOGICAL SCIENCES↗

Valuing the Future Electric Grid: A Bid-Based Approach

Energy storage resources (ESRs) and other zero marginal cost (ZMC) resources have unique characteristics that are not fully captured in today’s electricity planning and operations modeling tools. Because the modeling assumptions used in these tools are simplified approximations of how operations and investment decisions occur in the real-world, accurately representing cost and operational characteristics are key for determining how these resources impact price formation. Questions such as—Where should we build new transmission? Will a small modular reactor earn enough revenue to participate in the future electric grid? Is retrofitting a coal plant with carbon capture technology economically feasible?—all require accurate electricity prices, which aren’t available from today’s electricity planning and operations modeling tools. As an example, production cost models (PCMs) are heavily utilized tools that determine the cost and reliability of the electric system. However, as PCMs were developed to help thermal generators manage their fuel inventories, production cost modeling is largely based on fuel prices. Because ESRs do not incur fuel costs, they are often modeled as ZMC resources. In reality, ESRs incur opportunity costs as well as technology-specific (degradation) costs that are non-trivial to calculate but are important for price formation. In this research, we identify options to incorporate more realistic opportunity and degradation costs in ESR bidding algorithms. Expanding available bidding assumptions allows energy system modelers to develop more accurate economic valuations for ESRs, leading to more accurate price formation from leading energy system modeling tools.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A National Infrastructure for Artificial Intelligence on the Grid (NI4AI) (Final Scientific/Technical Report)

Electric utilities have traditionally taken a very pragmatic yet myopic approach with grid sensors and the resulting collected data. Sensors are purchased and deployed to solve a specific, known problem that has risen to sufficient awareness as to justify the effort of deploying sensors and the needed capital investment. This sensor data flows into proprietary software packages with limited functionality intended only to address the initial problem. This approach aligns with the financial incentives of the utility to deploy capital into fixed hardware assets for which the corporations earn a rate of return. This mentality stands in stark contrast to the big data revolution that started nearly 25 years ago with the rise of Google. In this worldview, data is a fundamental business asset; successful organizations collect, store, explore, merge, and exploit as much data as possible to not only solve problems well understood today but also to tackle new problems that will inevitably rise tomorrow. The ARPA-E Open Innovation 2018 project entitled A National Infrastructure for Artificial Intelligence on the Grid or NI4AI for short was designed to demonstrate this alternative paradigm for using data. To do this, the project was composed of three key thrust areas. The first major component deployed a variety of high-frequency grid sensors and captured terabytes of both wide-scale and localized grid measurements, generating high-value datasets for grid research and algorithm development. The second aspect made available PingThings’ PredictiveGridTM, a horizontally scalable, cloud-based data management and AI platform built for time series data to explore and exploit the collected data. Finally, the project fostered a diverse and open research community composed of experts from numerous fields through focused educational content, code sharing, and data science competitions. Shifting away from “single use” sensors and closed data silos within electric utilities is a major benefit to the public at large. This legacy approach to data is incredibly (1) capital intensive (new sensors must be deployed for each new problem and problems tend to arise continuously) and (2) painfully slow (new problems must be identified first and then new sensors must be deployed to collect data to begin to address the issue). The transition to a carbon neutral grid requires a massive transformation of the existing grid infrastructure and will continue to challenge the legacy grid in unforeseen ways. The only way to make the energy transition cost effective is for utilities to abandon this dated data paradigm and adopt more contemporary approaches. NI4AI has shown that it is technically possible and economically feasible to ingest, explore, and exploit grid data collected from even very high frequency sensing, such as continuous point on wave sensors collecting measurements 10,000 times a second. In fact, the PredictiveGrid platform used is commercially available and deployed at several utilities in the United States. Project accomplishments were numerous and included (1) making available a state of the art time series platform to the community, (2) collecting over 520 streams of time series data from grid sensors totaling over 1 trillion grid measurements, and (3) developing and nurturing a community within the industry focused on the use of data to create value for utilities and, ultimately, end consumers.

97 MATHEMATICS AND COMPUTING↗