Search NASA⌕ Search

SEARCH · Search NASA

Results for “reserve requirements”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Machine Learning Derived Dynamic Operating Reserve Requirements in High-Renewable Power Systems

Accurately forecasting wind and solar power output poses challenges for deeply decarbonized electricity systems. Grid operators must commit resources to provide reserves to ensure reliable operations in the face of forecast errors, a process which can increase fuel consumption and emissions. We apply neural network-based machine learning to expand the usefulness of median point forecast data by creating probabilistic distributions of short-term uncertainty in demand, wind, and solar forecasts that adapt to prevailing grid conditions. Machine learning derived estimates of forecast errors compare favorably to estimates based on incumbent methods. Reserves derived from machine learning are usually smaller than values derived using incumbent methods, which enables fuel savings during most hours. Machine learning reserves are generally larger than incumbent reserves during times of higher forecast error, potentially improving system reliability. Performance is tested using multi-stage production simulation modeling of the California Independent System Operator (CAISO) system. Machine learning reserves provide production cost and greenhouse gas (GHG) emission reductions of approximately 0.3% relative to historical 2019 requirements. Savings in the 2030 timeframe are highly dependent on battery storage capacity. At lower levels of battery capacity, savings of 0.4% from machine learning reserves are shown. Significant quantities of battery storage are expected to be added to meet California's resource adequacy needs and GHG reduction targets. Addition of these batteries saturate reserve needs and results in minimal within-hour balancing costs in 2030.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

An Analysis of PNM's Renewable Reserve Requirements to Meet New Mexico's Decarbonization Goals

Over the next three years, the Public Service Company of New Mexico (PNM) plans to increase utility-scale solar photovoltaic (PV) capacity from today’s roughly 330MW to about 1600MW. This massive increase in variable generation—from about 15% to 75% of peak load—will require changes in how PNM operates their system. We characterize the 5 and 30-minute solar and wind forecast errors that the system is likely to experience in order to determine the level of reserves needed to counteract such events. Our focus in this study is on negative forecast error (in other words, shortfalls relative to forecast) – whereas excess variable generation can be curtailed if needed, a shortfall must be compensated for to avoid loss of load. Calculating forecast error requires the use of the same forecasting methods that PNM uses or a reasonable approximation thereof. For wind, we use a persistence forecast on actual 5-minute 2019 wind output data (scaled up to reflect the amount of wind capacity planned for 2025). For solar, we use a formula incorporating the clear sky index (CSI) for the forecast. As the solar on the grid now is a small fraction of what is planned for 2025, we generated 5-minute solar data using 2019 weather inputs. We find that to handle 99.9% of the 5-minute negative forecast errors, a maximum of 275MW of variable generation reserve during daylight hours, and a maximum of 75MW during non-daylight hours, should be sufficient. Note that this variable generation reserve is an additional reserve category that specifies reserves over and above what are currently carried for contingency reserve. This would require a significant increase in reserve relative to what PNM currently carries or can call upon from other utilities per reserve sharing agreements. This variable generation reserve specification may overestimate the actual level needed to deal with PNM’s planned variable generation in 2025. The forecasting methodologies used in this study likely underperform PNM’s forecasting – and better forecasting allows for less reserve. To obtain more precise estimates, it is necessary to consider load and use the same forecasting inputs and methods used by PNM.

14 SOLAR ENERGY↗
DOE OSTI2024

Solar and Wind Forecast Error Reserve Sharing in a Multi-Utility Region

As electricity systems transition to higher levels of solar and wind generation, electric system operators will likely need to hold additional reserves to manage the forecast error associated with these resources. Because wind and solar forecast errors tend to be poorly correlated across space, system operators can reduce their reserve requirements by sharing reserves. This paper examines the value of forecast error reserve sharing among balancing areas in the Southeast United States. It finds that forecast error reserve requirements increase linearly with growth in solar and wind generation capacity but that reserve sharing can significantly reduce physical (MW) reserve requirements (from 25%-26% to 18%-19% of average load in high solar scenarios). It finds that the value of forecast error reserve sharing declines with higher levels of solar and wind generation, due to lower wholesale energy and reserve prices. Even with declines in wholesale prices, forecast error reserve sharing can still provide substantial value (as much as $\$$400 million per year in a high solar scenario), though with higher levels of solar, wind, and electricity storage, this value is increasingly tied to avoiding scarcity prices. The results suggest the importance of coordinated capacity expansion planning for forecast error reserve sharing.

14 SOLAR ENERGY↗
DOE OSTI2024

Solar and Wind Forecast Error Reserve Sharing in a Multi-Utility Region

As electricity systems transition to higher levels of solar and wind generation, electric system operators will likely need to hold additional reserves to manage solar and wind forecast error. Because solar and wind forecast errors tend to be weakly correlated across space, system operators can reduce their reserve requirements by sharing reserves. This paper examines the benefits of forecast error reserve sharing among balancing areas in the Southeastern United States, in scenarios in which solar and wind generation ranges from 34% to 65% of total generation. It finds that day-ahead forecast error reserve requirements increase linearly with growth in solar and wind generation capacity (6%-10% of total capacity), but that reserve sharing can significantly reduce these requirements (by 6%-29%). It finds that, in economic terms, the value of forecast error reserve sharing ($\$$0.09-$\$$1.24 billion per year, $\$$0.12-$\$$1.68/MWh of load across scenarios) tends to decline with higher levels of solar and wind generation, due to lower reserve and energy prices. Even with declines in reserve prices, forecast error reserve sharing can still provide substantial value, though with higher levels of solar, wind, and electricity storage this value is increasingly tied to avoiding scarcity prices.

14 SOLAR ENERGY↗
DOE OSTI2022

Operating Dynamic Reserve Dimensioning Using Probabilistic Forecasts

The rapid integration of variable energy sources (VRES) into power grids increases variability and uncertainty of the net demand, making the power system operation challenging. Operating reserve is used by system operators to manage and hedge against such variability and uncertainty. Traditionally, reserve requirements are determined by rules-of-thumb (static reserve requirements, e.g., NERC Reliability Standards), and more recently, dynamic reserve requirements from tools and methods which are in the adoption process (e.g., DynADOR, DRD, and RESERVE, among others). While these methods/tools significantly improve the static rule-of-thumb approaches, they rely exclusively on deterministic data (i.e., best guess only). Consequently, these methods disregard the probabilistic uncertainty thresholds associated with specific days and their weather conditions (i.e., best guess plus probabilistic uncertainty). This work presents practical approaches to determine the operating reserve requirements leveraging the wealth information from probabilistic forecasts. Proposed approaches are validated and tested using actual data from the CAISO system. Furthermore, results show the benefits in terms of risk reduction of considering the probabilistic forecast information into the dimensioning process of operating reserve requirements.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2023

Market Pricing and Settlements Analysis Considering Capacity Sharing and Reserve Substitutions of Operating Reserve Products

Electricity market pricing and settlement are the key signals for real-time dispatch and long-term investment decisions. Regional transmission operators (RTOs) in the U.S. adopt uniform pricing scheme, which is based on the marginal costs of supplying an incremental MW of electric services. The marginal cost of an electric service is highly dependent on the constraints in the pricing models of RTOs. A slight difference in constraint modeling of pricing model on energy and ancillary services could result in drastically different market clearing prices (MCPs), cleared reserve quantities, and associated revenue. RTOs in the U.S. have various market designs and assumptions in ancillary services modeling in capacity sharing and reserve substitutes. This paper examines four combination models of capacity sharing and reserve substitutes and analyzes the associated market implications. The numerical results present that 1) cascading reserve requirements have direct impact on reserve pricing schemes 2) both cascading reserve requirements and sharing capacity have significant impact on reserve MCPs and locational marginal prices, and thus result in drastically different reserve revenue, energy revenue, generation cost, and generation profit.

ancillary services↗
DOE OSTI2023

GRAF-Plan for Vietnam

Evaluates the reserve requirements for power system balancing areas based on variability and uncertainty of load as well as wind and solar generation scenarios. The tool uses minute‐by‐minute site‐specific generation and load information, as well as information from generation and load forecasting algorithms used in the balancing areas. The Balancing‐Plan Tool can be used directly by utility planners and operators to aid in the integration of intermittent renewable resources. The tool provides reserve requirements of various kinds, such as day‐ahead, load following and regulation, as well as estimates the capacity of the generation fleet to provide the require reserves.

Campbell, Allison↗
DOE OSTI2022

A Hybrid Reinforcement Learning-MPC Approach for Distribution System Critical Load Restoration

This paper proposes a hybrid control approach for distribution system critical load restoration, combining deep reinforcement learning (RL) and model predictive control (MPC) aiming at maximizing total restored load following an extreme event. RL determines a policy for quantifying operating reserve requirements, thereby hedging against uncertainty, while MPC models grid operations incorporating RL policy actions (i.e., reserve requirements), renewable (wind and solar) power predictions, and load demand forecasts. We formulate the reserve requirement determination problem as a sequential decision-making problem based on the Markov Decision Process (MDP) and design an RL learning environment based on the OpenAI Gym framework and MPC simulation. The RL agent reward and MPC objective function aim to maximize and monotonically increase total restored load and minimize load shedding and renewable power curtailment. The RL algorithm is trained offline using a historical forecast of renewable generation and load demand. The method is tested using a modified IEEE 13-bus distribution test feeder containing wind turbine, photovoltaic, microturbine, and battery. Case studies demonstrated that the proposed method outperforms other policies with static operating reserves.

distribution system↗
DOE OSTI2022

A Hybrid Reinforcement Learning-MPC Approach for Distribution System Critical Load Restoration: Preprint

This paper proposes a hybrid control approach for distribution system critical load restoration, combining deep reinforcement learning (RL) and model predictive control (MPC) aiming at maximizing total restored load following an extreme event. RL determines a policy for quantifying operating reserve requirements, thereby hedging against uncertainty, while MPC models grid operations incorporating RL policy actions, i.e., the reserve requirement, renewable (wind and solar) power predictions, and load demand forecasts. We formulate the reserve requirement determination problem as a sequential decision making problem based on the Markov Decision Process (MDP) and design an RL learning environment based on the OpenAI Gym framework and MPC. The RL agent reward and MPC objective function aim to maximize and monotonically increase total restored load and minimize load shedding and renewable power curtailment. The RL algorithm is trained off-line using historical forecast of renewable generation and load demand. The method is tested using a modified IEEE 13-bus distribution test feeder containing wind turbine, photovoltaic, microturbine and battery. Case studies demonstrated that the proposed method outperforms other operating reserve determination methods.

distribution system↗
DOE OSTI2022

Hybrid-RL-MPC4CLR (Hybird-Reinforcement-Learning-Model-Predictive-Control-for-Reserve-Policy-Assisted-Critical-Load-Restoration-in-Distribution-Grids)

Hybrid-RL-MPC4CLR was developed as a hybrid controller for active distribution grid critical load restoration, combining deep reinforcement learning (RL) and model predictive control (MPC) aiming at maximizing total restored load following an extreme event. The RL determines a policy for quantifying operating reserve requirements, thereby hedging against uncertainty, while the MPC models grid operations incorporating the RL policy actions (i.e., reserve requirements), renewable (wind and solar) power predictions, and load demand forecasts. The developers formulated the reserve requirement determination problem as a sequential decision-making problem based on the Markov Decision Process (MDP) and design an RL learning environment based on the OpenAI Gym framework and MPC simulation. The RL agent reward and MPC objective function aim to maximize and monotonically increase total restored load and minimize load shedding and renewable power curtailment. The software is developed using various software packages in Python. The MPC's optimal power flow (OPF) model is implemented using the Pyomo package, the RL simulation environment is implemented using the MPC simulation with various scenarios of renewable energy and load demand profiles and power outage beginning times, based on the OpenAI Gym framework. The RL agent training is performed using the RLlib Ray package. The RL algorithm is trained offline using historical forecasts of renewable generation and load demand profiles. Simulation analysis and performance tests are conducted using a modified IEEE 13-bus distribution test feeder containing wind turbine, photovoltaic, microturbine, and battery.

Eseye, Abinet Tesfaye↗
DOE OSTI2025

Getting brighter: Impacts of improved day-ahead solar forecasts in high-solar, high-storage electricity systems

This paper analyzes the impacts of improved day-ahead solar forecasts on costs and dispatch in the solar-rich Southeast U.S. It uses an optimized high-solar, high-storage resource portfolio in which solar generation capacity accounts for 45 % of total installed capacity (34 %–36 % of generation) and energy storage capacity (43 GW) is equivalent to 33 % of peak demand. In a base scenario, improved day-ahead solar forecasts reduce production costs by $\$87$ million per year ($\$0.13$ per MWh load, $2023$$). This level of savings is within the range or lower than earlier studies of solar forecast improvements at lower levels of solar generation (<25 % of total generation). In this study, solar expansion was accompanied by two important sources of flexibility for managing solar forecast error: energy storage and day-ahead solar curtailment. Furthermore, the analysis finds that regional coordination complements day-ahead solar forecast improvements while natural gas commitment flexibility is a substitute for forecast improvements, as the improved solar forecast leads to sub-optimal commitment of thermal units. Day-ahead solar forecast improvements reduce reserves required to manage forecast error by 30 %. Fewer reserves to manage large, infrequent solar forecast errors could be an important benefit of improved solar forecasts.

14 SOLAR ENERGY↗
DOE OSTI2022

Operational Probabilistic Tools for Solar Uncertainty (OPTSUN) (Final Project Report for DOE Solar Forecasting II Project)

Increasing levels of solar PV can challenge system operations and may require novel methods to operate the power system reliably and efficiently. Power system operating plans generally use deterministic forecasts, in which the variable energy resources are represented by the expected value for each interval of the decision horizon. Probabilistic forecasts are relatively new but have the potential to address the shortfalls of deterministic forecasts. However, understanding how best to use such forecasts is still a key gap in industry and was the focus of this project. The project had three workstreams. In a forecasting workstream, improvements were made to baseline probabilistic forecasts using a number of new approaches such as machine learning methods and improved input data. In a design workstream, advanced simulation tools used these forecasts to investigate newly proposed reserve determination methods. Lastly, in a demonstration workstream a scheduling management platform (SMP) was developed to leverage probabilistic forecasts in a modular and customizable manner. In order to study the benefits that could be accrued, the project team collaborated with three utility partners (Duke Energy, Southern Company and Hawaiian Electric) to deliver improved probabilistic forecasts for each region and to model each region in case studies using advanced production cost modeling tools. Different methods to determine operating reserve requirements from probabilistic forecasts were developed, simulated, and tested across each region. The benefits of using these newly proposed methods varied by utility, but, in general, using probabilistic forecasts as well as historical data to set the reserve requirements seems to improve reliability related results, with less risk of reserve or supply shortfalls. The cost implications were not always straightforward; in some cases the new methods could show a reduction in expected operating costs, but often the increase in reserves associated with better risk mitigation using probabilistic forecasts could result in an increase in operating costs in the simulations. The SMP tool was developed to process probabilistic forecasts from their initial receipt through to scheduling decisions. This open-source tool consists of several modules for scenario development, reserve requirements calculation, and visualization. The SMP tool was demonstrated to a wide range of operators and stakeholders at all three utilities and further improved based on their feedback. The tool will be available on www.epri.com/optsun. The proposed probabilistic information-based reserve determination approaches have the potential to be implemented by different regions to ensure an economic and reliable power system operation on power systems integrating increasing levels of variable renewable resources. The innovative yet practical methods developed in this project demonstrated tangible benefits from using probabilistic forecasts beyond just study-based assessments to include three unique balancing areas. The demonstrated benefits across the multiple utility environments, are expected to provide system operators in all regions the confidence required and a platform to adopt the new forecasting and operating methods.

14 SOLAR ENERGY↗
DOE OSTI2022

Allocating Reserves in Active Distribution Systems for Tertiary Frequency Regulation

This paper proposes a cooperative game theory-based approach for reserve optimization to enable distributed energy resources (DERs) participate in tertiary frequency regulation. Tertiary frequency regulation schemes ensure that reserve requirements of primary and secondary frequency regulation are fulfilled with a minimum cost. While the available reserve from a single distribution system may not suffice tertiary frequency regulation, stacked reserve from several distribution systems can enable them participate in tertiary frequency regulation at scale. In this paper, a two-stage strategy is proposed to effectively and precisely allocate spinning reserve requirement from each DER in distribution systems. In the first stage, two types of characteristic functions are computed: worthiness index (WI) and power loss reduction (PLR). In the second stage, the equivalent Shapley values are computed based on the characteristic functions, which are used to determine distribution factors for reserve allocation among DERs. The effectiveness of the proposed method for allocating reserves among DERs is demonstrated through several case studies on modified versions of the IEEE 13-node and 33-node distribution systems.

Gautam, Mukesh↗
DOE OSTI2025

Evaluating the Impact of Managed EV Charging for Reliable Operation of Bulk Power Systems with High Non-Dispatchable Generation

The growth of electric vehicles (EVs) and variable-generation (VG) sources introduces new challenges for power-system operations. This study introduces a modeling framework and evaluates five EV charging strategies under projected 2040 grid conditions in the Evergy service territory with high non-dispatchable generation. Using realistic EV behavior and generation models, their impacts on system peak demand, ramp rate, and reserve capacity are evaluated. Results show that only the peak-avoidance strategy effectively reduces system peak demand, while decentralized strategies-particularly cost based dynamic charging-can exacerbate peaks due to synchronized user behavior. However, ramp-rate minimization strategy significantly reduce the stress on dispatchable generation achieving the lowest maximum absolute ramp rate (MARR) (56.81 MW) and lowest reserve requirement (2.39 GW). In contrast, unmanaged and TOU random strategies increase the stress on dispatchable generation sources with increased MARR and reserve requirements. These findings highlight the importance of coordinated, system-aware managed charging strategies to ensure reliable and affordable grid operation in the presence of EVs and VG sources.

14 - SOLAR ENERGY↗
DOE OSTI2024

Modifications to Solar Titan-130 Combustion Systems for Efficient, High Turndown Operation

The project team of Southwest Research Institute® (SwRI®), Solar Turbines Incorporated (Solar), the Electric Power Research Institute (EPRI), the University of California, Irvine (UCI), and the Georgia Institute of Technology (Georgia Tech) investigated methods to allow higher efficiency part-load operation of a Solar Titan 130 gas turbine. The objective was to develop a low-emission combustion system capable of sustaining combustion and avoiding lean blowout during high turndown operation, which would allow the gas turbine to operate as efficiently as possible at part load. Currently, electric utility markets are beginning to experience substantial increases in renewable energy generation. Some of these renewable energy sources have highly variable output in an uncontrolled manner. In order to maintain grid stability, there is a need for power plants to ramp up power to the grid rapidly to make up for drops in renewable generation. This is often termed spinning reserve, but the size of this reserve may need to increase as renewable penetration into the electric utility market increases. Small combined heat and power (CHP) power plants provide a promising option for meeting this spinning reserve requirement. In order to operate in spinning reserve while still meeting the heat requirements for the CHP, the gas turbine needs to operate efficiently at very low loads. Efficient, high turndown operations in this engine are limited by the lean flammability limit of the premixed combustion system. This project sought enhance the lean operability range of the Titan 130 combustor. First, the project team participated in a brainstorming activity and ultimately selected two concepts to explore: fuel augmentation with hydrogen (H2) to improve the stability at lean operating conditions and modifications to the fuel nozzle to improve the emissions performance at lean operating conditions. Analytical and laboratory investigations were accomplished by UCI to investigate the efficacy of H2 addition at improving lean blow out (LBO) limits and the resulting emissions. These investigations used a variety of chemical reactor network (CRN) and CFD models, validated against laboratory data, to model the impact of H 2 and inform the experimental efforts accomplished by SwRI and Solar. Ultimately, both the CRN and CFD models yielded generally good agreement with the experimental data below a particular temperature threshold. Atmospheric tests of a full-scale T130 annular combustor were performed at SwRI facilities in San Antonio, Texas, to investigate the use of H 2 addition. For these tests, the T130 combustion system remained largely unchanged; minor modifications were performed to the fuel ducting to allow for the safe use of H 2 . The test ultimately demonstrated that the addition of H 2 to the fuel mixture significantly increased the AFR ratio at which the combustor could operate. This improvement to the LBO limit should allow for less use of compressor bleed and less throttling needed by the inlet guide vanes (IGV). This in turn could result in more efficient operation of the gas turbine at lower load points. The second modification explored in this work was a direct modification to the T130 injector. The project team hypothesized that modifications to the pilot of the T130 injector could provide lower emissions at high turn-down operations. These modifications were manufactured and explored by the team at Solar. High pressure rig tests, originally slated to occur at SwRI, were ultimately accomplished by Solar to maintain overall project budget and mitigate cost growth attributable to supply chain issues and inflation. The pressurized rig tests ultimately showed that the SwRI Project No. 18.24153 - DE-EE0008415 Page 2 Final Technical Report January 24, 2024 modifications did not significantly alter the performance of the combustion system at the high turn-down conditions; both the modified injectors and the baseline configuration exhibited elevated emissions comparted to the full-load operating condition. A final set of studies performed by EPRI investigated the benefit-cost of flexible CHP as well as a grid interconnection study for the California Independent System Operator (CAISO) grid. These studies considered: traditional CHP with no spinning reserve available for on-demand grid support, 50% flexible CHP where 50% of the machine’s capacity is consumed by on-site baseload operations while providing an additional 50% capacity for on-demand grid support, and 70% flexible CHP where 70% of capacity is consumed on-site by baseload operations and 30% is available for on-demand grid support. In all cases, the analyses showed a benefit-to-cost ratio greater than unity implying a positive net present value for all configurations. However, the traditional CHP showed the most economic benefit. These results are sensitive to several factors, many of which are not fully known and may vary over time. Thus site owners must be convinced that taking up the increased costs and risks from flexible CHP would be worth implementing. As the grid in California and across the country transition to incorporate larger renewable energy generation, flexible CHP can provide much needed operating reserves and dispatchability. Alternative fuel options, such as hydrogen blending and biofuels, may also lower carbon intensities of CHP. Flexible CHP should be examined in the evolving market to understand innovative business models, changes market rules and services, and new technologies.

20 FOSSIL-FUELED POWER PLANTS↗
DOE OSTI2023

Creation of Synthetic Electric Grids (SPP/MISO) Supporting PERFORM (Final Report)

Over the course of the project, two “realistic but not real” synthetic transmission-level grid models over the SPP-MISO and ERCOT footprints were created to provide more realistic data and increase the reliability and resiliency of the grids under a variety of scenarios. The synthetic ERCOT transmission grid is compatible with the distribution grid developed in collaboration with NREL. All generators are based on the EIA 860 data and a column with EIA plant code and Gen ID is added to generators of both grids so that they can be easily mapped. The improvements are also made to electric grids including N-1 contingencies with some remedial actions, improving the transmission lines to avoid lines in lakes, including an HVDC line to the SPP-MISO case, providing several generator parameters and their temporal constraints that were not included in EIA 860 form, generators’ cost curves, load offer curves, adding phase shifters and tap changers with impedance correction tables, adding reactive power control and partitioning the grids into active and reactive reserve zones and determine different types of the required reserve for each zone. Hourly load time series at the bus level were generated to create scenarios for solving power flow in different loading conditions. Weather measurement information and the models of renewable generators are used to directly include the impact of weather on the grids. Based on a variety of load and weather conditions the grids are improved to accommodate different conditions. The ERCOT 7k-bus grids were also modeled for the year 2030 with predicted improvements in renewable resources. The renewable generation model was also improved with historic weather data included. The impact of electric vehicles on the ERCOT grid is also modeled.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS2020

History and Logic Model NASA Goddard Space Flight Center Instrument and Payload Systems Engineering Technical Performance Study

Historically, some NASA missions have exceeded schedule and cost commitments. Studies suggest technical performance is a contributor. The 1980 NASA Project Management Study concluded, "one of the most significant contributors to cost and schedule growth is inadequate definition of technical and management aspects of a program..." (as cited in GAO/NSIAD-93-97, p. 11). The 1991 NASA Roles and Missions Report identified a "need for increased emphasis on technological readiness and requirements on the front end of a program" (as cited in GAO/NSIAD-93-97, p. 11). The 1992 NASA Program Costs Report stated that NASA officials identified, among other things, "insufficient definition studies... [and] program redesigns and technical complexities" as reasons for cost and schedule overruns (GAO/NSAID-93-97, p. 11). The 2002 Task Force on Acquisition of National Security Space Programs found "requirements definition and control issues, unhealthy cost bias in proposal evaluation, widespread lack of budget reserves required to implement high risk programs on schedule, and an overall underappreciation of the importance of appropriately staffed and trained system engineering staff to manage the technologically demanding and unique aspects of space programs" (DoD, 2003, p.i.) In 2007, The NASA Office of the Chief Engineer chartered the NASA Instrument Capability Study (NICS) “to determine whether NASA instrument developers are facing challenges that impact the capability to design and build quality instruments or whether there are flaws in the acquisition strategy evidenced by schedule delays, cost overruns, and increased technical risk via design deficiencies. The... team was also chartered to determine if occurrences [are]... isolated cases or if there are generic issues... If the issues [are] found to be generic, the team [is] to offer solutions to recover such capability" (NICS Report, 2008, p. vi). The 2008 NICS Report, led by Goddard Space Flight Center (GSFC), identified challenges to instrument technical performance consistent with findings from previous reports. In 2017, the Instrument Project Division (IPD) Implementation Study was initiated to determine if there was a change in meeting schedule and cost commitments after implementing certain NICS recommendations. In 2018, the Instrument Technical Performance Study was initiated to determine the current state of Instrument Technical Performance in the GSFC Payload & Instrument Systems Engineering Branch. The purpose of the combined studies is to answer the question, "Is there a relationship between meeting NASA scientific instrument technical success and meeting schedule and cost commitments? If yes, what is the relationship?" References Department of Defense Office of the Under Secretary of Defense for Acquisition, Technology, and Logistics. (2003). The report of the defense science board/ air force scientific advisory board joint task force on acquisition of national security space programs. Washington DC. Government Accounting Office. (1992). NASA program costs: Space missions require substantially more funding than initially estimated. GAO/NSIAD-93-97. Washington DC. National Aeronautics and Space Administration, National Oceanic and Atmospheric Agency, Department of Defense. (2008). The NASA instrument capability study final report. NP-2008-11-058-GSFC. Washington DC.

Robbins, Geraldine↗