Search NASA⌕ Search

SEARCH · Search NASA

Results for “Uncertainty management”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Quantifying the Effects of Departure and Flight Time Uncertainty on Urban Air Mobility Operations

Demand capacity balancing is a key mechanism for maintaining safe and efficient Urban Air Mobility (UAM) operations. However, uncertainties such as departure delays and flight time variation may reduce the effectiveness of algorithms used for balancing and detrimentally impact the safety and efficiency of UAM operations. In this paper, the effects of these uncertainties on UAM operations are quantified by modeling a distribution of departure and flight time errors. A route network in the Dallas/Fort Worth metropolitan area was used to simulate traffic demand with and without uncertainty. Simulations were conducted with three main models of uncertainty – first uncertainty in departure time delay resulting in late takeoffs, second with uncertainty in flight times in addition to departure delays, and finally, uncertainty in departure times that cause either late or early takeoffs. Each of these simulations were performed using varied standard deviations to fully understand the effects of uncertainties. Results from these simulations were compared to a baseline simulation using the same parameters, but without any uncertainty. The results suggest that both safety and efficiency are significantly impacted by uncertainty even with relatively low uncertainty introduced. These results work towards quantifying the effects of uncertainty in flight scheduling for UAM. They will also aid in the further development of the demand capacity balancing algorithms for UAM operations and associated air traffic management.

Urban Air Mobility↗

Modeling Global Water Use for the 21st Century: Water Futures and Solutions (WFaS) Initiative and Its Approaches

To sustain growing food demand and increasing standard of living, global water use increased by nearly 6 times during the last 100 years, and continues to grow. As water demands get closer and closer to the water availability in many regions, each drop of water becomes increasingly valuable and water must be managed more efficiently and intensively. However, soaring water use worsens water scarcity conditions already prevalent in semi-arid and arid regions, increasing uncertainty for sustainable food production and economic development. Planning for future development and investments requires that we prepare water projections for the future. However, estimations are complicated because the future of the world's waters will be influenced by a combination of environmental, social, economic, and political factors, and there is only limited knowledge and data available about freshwater resources and how they are being used. The Water Futures and Solutions (WFaS) initiative coordinates its work with other ongoing scenario efforts for the sake of establishing a consistent set of new global water scenarios based on the shared socio-economic pathways (SSPs) and the representative concentration pathways (RCPs). The WFaS "fast track" assessment uses three global water models, namely H08, PCR-GLOBWB, and WaterGAP. This study assesses the state of the art for estimating and projecting water use regionally and globally in a consistent manner. It provides an overview of different approaches, the uncertainty, strengths and weaknesses of the various estimation methods, types of management and policy decisions for which the current estimation methods are useful. We also discuss additional information most needed to be able to improve water use estimates and be able to assess a greater range of management options across the water-energy-climate nexus.

soaring↗

Utilization of Hydrologic Remote Sensing Data in Land Surface Modeling and Data Assimilation: Current Status and Challenges

Recent advances in remote sensing technologies have enabled the monitoring and measurement of the Earth's land surface at an unprecedented scale and frequency. The myriad of these land surface observations must be integrated with the state-of-the-art land surface model forecasts using data assimilation to generate spatially and temporally coherent estimates of environmental conditions. These analyses are of critical importance to real-world applications such as agricultural production, water resources management and flood, drought, weather and climate prediction. This need motivated the development of NASA Land Information System (LIS), which is an expert system encapsulating a suite of modeling, computational and data assimilation tools required to address challenging hydrological problems. LIS integrates the use of several community land surface models, use of ground and satellite based observations, data assimilation and uncertainty estimation techniques and high performance computing and data management tools to enable the assessment and prediction of hydrologic conditions at various spatial and temporal scales of interest. This presentation will focus on describing the results, challenges and lessons learned from the use of remote sensing data for improving land surface modeling, within LIS. More specifically, studies related to the improved estimation of soil moisture, snow and land surface temperature conditions through data assimilation will be discussed. The presentation will also address the characterization of uncertainty in the modeling process through Bayesian remote sensing and computational methods.

Kumar, Sujay V.↗

Software risk estimation and management techniques at JPL

In this talk we will discuss how uncertainty has been incorporated into the JPL software model, probabilistic-based estimates, and how risk is addressed, how cost risk is currently being explored via a variety of approaches, from traditional risk lists, to detailed WBS-based risk estimates to the Defect Detection and Prevention (DDP) tool.

software risk↗

Quantifying Effects of Departure and Flight Time Uncertainty on Urban Air Mobility Operations

Demand capacity balancing is a key mechanism for maintaining safe and efficient Urban Air Mobility (UAM) operations. However, uncertainties such as departure delays and flight time variation may reduce the effectiveness of algorithms used for balancing and detrimentally impact the safety and efficiency of UAM operations. In this paper, the effects of these uncertainties on UAM operations are quantified by modeling a distribution of departure and flight time errors. A route network in the Dallas/Fort Worth metropolitan area was used to simulate traffic demand with and without uncertainty. Simulations were conducted with three main models of uncertainty – first uncertainty in departure time delay resulting in late takeoffs, second with uncertainty in flight times in addition to departure delays, and finally, uncertainty in departure times that cause either late or early takeoffs. Each of these simulations were performed using varied standard deviations to fully understand the effects of uncertainties. Results from these simulations were compared to a baseline simulation using the same parameters, but without any uncertainty. The results suggest that both safety and efficiency are significantly impacted by uncertainty even with relatively low uncertainty introduced. These results work towards quantifying the effects of uncertainty in flight scheduling for UAM. They will also aid in the further development of the demand capacity balancing algorithms for UAM operations and associated air traffic management.

Urban Air Mobility↗

Conceptual design environment

Opportunities in conceptual design reside in the fact that the greatest chance for cost reduction occurs during the early stages of product development. The conceptual design problem encompasses managing complex engineering information, multiple interacting groups, and uncertainty. Presented in viewgraph form are the opportunities in conceptual design, the design scenario, and technical issues and approaches.

Buckley, Michael J.↗

Evaluation of Dynamic Coastal Response to Sea-level Rise Modifies Inundation Likelihood

Sea-level rise (SLR) poses a range of threats to natural and built environments, making assessments of SLR-induced hazards essential for informed decision making. We develop a probabilistic model that evaluates the likelihood that an area will inundate (flood) or dynamically respond (adapt) to SLR. The broad-area applicability of the approach is demonstrated by producing 30x30m resolution predictions for more than 38,000 sq km of diverse coastal landscape in the northeastern United States. Probabilistic SLR projections, coastal elevation and vertical land movement are used to estimate likely future inundation levels. Then, conditioned on future inundation levels and the current land-cover type, we evaluate the likelihood of dynamic response versus inundation. We find that nearly 70% of this coastal landscape has some capacity to respond dynamically to SLR, and we show that inundation models over-predict land likely to submerge. This approach is well suited to guiding coastal resource management decisions that weigh future SLR impacts and uncertainty against ecological targets and economic constraints.

Climate-change impacts↗

Probabilistic Modeling of a Three-Stage Human Landing System Architecture

Space Policy Directive-1 has led to NASA partnerships with commercial entities on procurement which includes the development of the Human Landing System (HLS) [1]. With the goal of delivering human crew to the lunar surface by 2024, system uncertainties become an important obstacle to the maturation of multiple new, driving technologies and mission concepts of the HLS program. As unmitigated uncertainties have previously led to failed development programs, these risks and their impacts must be understood and handled to ensure program success [2]. Sources of uncertainty include novel engine designs and configurations, increased reliance on cryogenic fluid management(CFM), and refueling technologies—which propagate as high-level performance metrics such as overall propellant mass and engine performance. Also, the occurrence of operational uncertainties—e.g. launch conditions or need to abort during the mission—can cause cascading effects on the rest of the mission that are difficult to definitively quantify, and are outside the scope of control. These concrete examples and other occurrences can be categorized as either epistemic or aleatory uncertainties.Epistemic uncertainty arises due to a lack of knowledge and can be alleviated with design and program maturation. Aleatory uncertainty is due to the inherent randomness of the system and cannot be directly reduced, unlike epistemic uncertainty. Robust design and probabilistic methods can compensate for aleatory effects. A taxonomy of uncertainty is referred to for this work [3]. In this paper, a probabilistic methodology to handle uncertainties has been demonstrated on a three-element HLS concept [1, 4], which allows tracking of current best estimates of the concept and assessment of concept design robustness against uncertainties. A sample case has been completed for this abstract, and an expansion on the methodology will be included in the final paper. This methodology has two key parts: first, the creation of a dynamic architecture model of a three-element HLS concept; and second, its use with surrogate modeling and range estimating techniques to capture and propagate uncertainties. This abstract will cover the basics of the approach used, and further details and justifications will be in the final paper.The mission profile associated with this three-element concept (Fig 1) was modeled as a set of mission events that facilitated mass changes, idles, or spacecraft maneuvers. The mission profile scope starts with each element’s NRHO orbit insertion and aggregation and ends at post-sortie rendezvous with Orion. More detail on the mission profile will be in the final paper. The DYnamic Rocket EQuation Tool (DYREQT), a space systems synthesis and sizing framework used by NASA, was used as the physics framework to model the HLS architecture for applying the probabilistic methodology [5, 6]. Specifically, a parametric representation of the lander, ascent, and transfer elements and the mission profile of each element was established, with vehicle and mission parameters available as inputs to allow for a dynamic model. Each vehicle stage was modeled with high-level performance metrics, using Isp and propellant mass fraction (PMF) to remain parametric. For the probabilistic analysis, uncertainties of interest within the HLS concept were enumerated and represented as parameters within the DYREQT model as inputs for vehicle stages or mission profile events. These parameters were frozen at their nominal values for the purposes of baselining architecture performance and sizing the vehicle appropriately based on reference documentation [1]. Range estimating—a probabilistic method that combines Monte Carlo sampling, focus on critical parameters, and heuristics to assess risk and opportunities—is traditionally used with Mass Equipment Lists (MELs), but has been adapted with operational parameters as well as vehicle parameters in theDYREQT model to capture mission uncertainty alongside vehicle uncertainty [7, 3]. This method was selected due to its application and insight on a system from a bottom-up perspective, independence from historical rules of thumb, and ability to generate sensitivities based on design decisions and uncertainties. As a sample case for the abstract, the boiloff rates of the vehicle elements and the loiter times during the mission (simulating launch time variations and changing window of opportunities) were used with range estimating to provide preliminary results. To perform the range estimation portion of this methodology (depicted in Fig. 3, further details in final paper), the DYREQT model was sampled using a Design of Experiments (DoE) to efficiently explore the architecture design space with respect to the sample set of uncertainty parameters; 5,000 cases via Latin Hypercube Sampling were computed on the DYREQT architecture model. Then, the results were used to create surrogate models, multivariate regressions that can visualize hypercube trends in the design space, of the architecture with respect to the uncertainty parameters. Range estimating was applied to the surrogates instead of the actual models, which saves computational expense due to the bulk of cases needed for the Monte Carlo simulation as part of range estimating. Uncertainty parameters were sampled independently from triangular distributions using the DoE ranges as ‘min’ and ‘max’, and the nominal value as ‘most likely’. Based engineering intuition, some uncertainty parameters are correlated—e.g. if the main propellant has a high boil-off rate, the oxidizer should follow suit as both are related to CFM technology.While a Monte Carlo simulation samples all inputs as independent, the results would show model correlations; thus, it is efficient to sample the inputs as correlated. Using a correlation matrix constructed for the uncertainty parameters, previously independent samples were transformed to perform a Correlated Monte Carlo. A table for the DoE ranges and probability distribution parameters is shown in Table 1, and more details on Correlated Monte Carlo Simulations will be discussed in the final paper. The model’s resulting DoE showed that multivariate polynomial equations fit via least squares method captured its behavior accurately for the sample case. For the Correlated Monte Carlo Simulation, a positive correlation between fuel and oxidizer boiloff rates was used as a demonstration. 10,000 cases were computed with the surrogates and the launched masses for each vehicle element was collated. The results can be displayed in a probability density function (PDF), showing the impact of the uncertainty parameters chosen. Integrating the PDFs will yield a cumulative distribution function (CDF) that shows the cumulative probability of a given value on the x-axis. For the sample case, the elements’ launch mass margin was calculated and represented in as CDFs, as a demonstrated representation of figures of merit for the HLS concept. For the lander and ascent elements, the NRHO mass insertion limit is 16t; the transfer element has a limit of 30t [1]. It can be seen with Figure 2 that this probabilistic methodology can provide insight into mass margin with respect to the uncertainties being modeled. Currently, the results show that the lander (descent) vehicle element has the most restrictive design space; it is the only element to show a 10% probability of negative margin. Further analysis on the Monte Carlo results will show sensitivities for driving constraints and parameters for architecture feasibility, which can lead to establishing potential mission rules.The combination of range estimating with a parametric architecture model for HLS demonstrated the capability of this probabilistic methodology in a sample case. As the HLS development progresses, this methodology has the potential for keeping current best estimates of architecture performance for awarded concepts due to the flexibility in DYREQT’s modeling framework and its parametric nature. Concept maturation and increased epistemic knowledge can be injected into the model probabilistic modeling, and thus continue to track probability of mission success.

Stephanie Y Zhu↗

Measurement of Cyanobacterial Bloom Magnitude Using Satellite Remote Sensing

Cyanobacterial harmful algal blooms (cyano HABs) are a serious environmental, water quality and public health issue worldwide because of their ability to form dense biomass and produce toxins. Models and algorithms have been developed to detect and quantify cyanoHABs biomass using remotely sensed data but not for quantifying bloom magnitude,information that would guide water quality management decisions. We propose a method to quantify seasonal and annual cyanoHAB magnitude in lakes and reservoirs. The magnitude is the spatio temporal mean of weekly or biweekly maximum cyanobacteria biomass for the season or year. CyanoHAB biomass is quantified using a standard reflectance spectral shape based algorithm that uses data from Medium Resolution Imaging Spectrometer (MERIS). We demonstrate the method to quantify annual and seasonal cyanoHAB magnitude in Florida and Ohio (USA) respectively during 2003-2011 and rank the lakes based on median magnitude over the study period. The new method can be applied to Sentinel-3 Ocean Land Color Imager (OLCI) data for assessment of cyanoHABs and the change over time, even with issues such as variable data acquisition frequency or sensor calibration uncertainties between satellites. CyanoHAB magnitude can support monitoring and management decision making for recreational and drinking water sources.

Sachidananda Mishra↗

Data Fusion With Uncertainty Quantification for Sub-City-Scale Air Quality Assessment and Forecasting

Many information sources can support air quality assessment and forecasting, including atmospheric chemistry model outputs, satellite retrievals of column chemical and aerosol constituents, and surface-based air quality monitoring data from both regulatory and low-cost instruments. Systematic integration of these data sources provides a major opportunity to improve understanding and management of air quality, but also presents technical barriers, especially in resource- and data-constrained settings in the Global South. This presentation describes a data fusion system, currently under development using the Google Earth Engine platform, which aims to integrate the information sources listed above to support comprehensive sub-city-scale assessment and management of air quality. Furthermore, the data fusion framework includes provisions for the quantification of uncertainties in the resulting fused estimates based on the variability of and among the input data sources. These capabilities will allow air quality managers to better understand their local air quality situation, including relative confidence in the fused estimates for different constituents, locations, and times, leading to better informed air quality management decisions. This presentation covers the underlying methodology of the data fusion and uncertainty quantification approaches, provides an update on the status of its implementation, and presents early qualitative and quantitative results.

Carl Malings↗

Risk Assessment Overview

Risk assessment is used in many industries to identify and manage risks. Initially developed for use on aeronautical and nuclear systems, risk assessment has been applied to transportation, chemical, computer, financial, and security systems among others. It is used to gain an understanding of the weaknesses or vulnerabilities in a system so modification can be made to increase operability, efficiency, and safety and to reduce failure and down-time. Risk assessment results are primary inputs to risk-informed decision making; where risk information including uncertainty is used along with other pertinent information to assist management in the decision-making process. Therefore, to be useful, a risk assessment must be directed at specific objectives. As the world embraces the globalization of trade and manufacturing, understanding the associated risk become important to decision making. Applying risk assessment techniques to a global system of development, manufacturing, and transportation can provide insight into how the system can fail, the likelihood of system failure and the consequences of system failure. The risk assessment can identify those elements that contribute most to risk and identify measures to prevent and mitigate failures, disruptions, and damaging outcomes. In addition, risk associated with public and environment impact can be identified. The risk insights gained can be applied to making decisions concerning suitable development and manufacturing locations, supply chains, and transportation strategies. While risk assessment has been mostly applied to mechanical and electrical systems, the concepts and techniques can be applied across other systems and activities. This paper provides a basic overview of the development of a risk assessment.

Prassinos, Peter G.↗

NASA Risk Management Handbook: Version 2.0, Part 1

The purpose of this handbook is to provide an in-depth reference for the practice of risk management in NASA, updating the guidance offered in its original version, NASA/SP-2011-3422 (November 2011), and closely aligning the updated guidance with the current NASA Procedural Requirements for Agency Risk Management, NPR 8000.4, and the parent NASA Policy Directive for NASA Governance and Strategic Management, NPD 1000.0. NPD 1000.0 introduces with emphasis the concept of “Risk Leadership,” making it a fundamental tenet and pillar of the risk management culture that it advocates for the Agency. NPR 8000.4 applies this concept and establishes Risk Management (RM) requirements for the Agency as an integrated enterprise, as well as the RM requirements for portfolio elements within the enterprise. Such elements include the various programs and projects that contribute to the Agency’s objectives and the various institutional activities carried out by entities that contribute to mission support. The present version of the handbook also emphasizes the integration of risk management processes across activity and project life cycles and their coordination and interaction with day-to-day programmatic and organizational functions. Areas of application of risk assessment and management that were not covered with specific guidance in the preceding version are addressed in this version with in-depth examples. The handbook is structured into two parts, whose chapters are in turn organized in a sequential order intended to facilitate a gradual and progressive introduction of the reader to risk management principles and practices. Part 1 of the handbook is dedicated to the introduction of the basic foundations of the NASA integrated risk management framework, the related fundamental risk concepts, the description of the risk management and decision processes that are to be implemented within the framework, the discussion of the risk assessment techniques that should be utilized in support of such processes, and the management and organizational interactions and interfaces that should be enabled to implement an effective integration of risk management activities within the Agency. Part 2 provides self-contained, end-to-end examples of application of the processes and techniques introduced in Part 1, in the context of both programmatic (i.e., project and/or mission related) and institutional activities.

Uncertainty↗

Software Model Of Software-Development Process

Collection of computer programs constitutes software tool for simulation of medium- to large-scale software-development projects. Necessary to include easily identifiable and more-readily quantifiable characteristics like costs, times, and numbers of errors. Mathematical model incorporating these and other factors of dynamics of software-development process implemented in the Software Life Cycle Simulator (SLICS) computer program. Simulates dynamics of software-development process. In combination with input and output expert software systems and knowledge-based management software system, develops information for use in managing large software-development project. Intended to aid managers in planning, managing, and controlling software-development processes by reducing uncertainties in budgets, required personnel, and schedules.

Lin, Chi Y.↗

Convective Weather Avoidance with Uncertain Weather Forecasts

Convective weather events have a disruptive impact on air traffic both in terminal area and in en-route airspaces. In order to make sure that the national air transportation system is safe and efficient, it is essential to respond to convective weather events effectively. Traffic flow control initiatives in response to convective weather include ground delay, airborne delay, miles-in-trail restrictions as well as tactical and strategic rerouting. The rerouting initiatives can potentially increase traffic density and complexity in regions neighboring the convective weather activity. There is a need to perform rerouting in an intelligent and efficient way such that the disruptive effects of rerouting are minimized. An important area of research is to study the interaction of in-flight rerouting with traffic congestion or complexity and developing methods that quantitatively measure this interaction. Furthermore, it is necessary to find rerouting solutions that account for uncertainties in weather forecasts. These are important steps toward managing complexity during rerouting operations, and the paper is motivated by these research questions. An automated system is developed for rerouting air traffic in order to avoid convective weather regions during the 20- minute - 2-hour time horizon. Such a system is envisioned to work in concert with separation assurance (0 - 20-minute time horizon), and longer term air traffic management (2-hours and beyond) to provide a more comprehensive solution to complexity and safety management. In this study, weather is dynamic and uncertain; it is represented as regions of airspace that pilots are likely to avoid. Algorithms are implemented in an air traffic simulation environment to support the research study. The algorithms used are deterministic but periodically revise reroutes to account for weather forecast updates. In contrast to previous studies, in this study convective weather is represented as regions of airspace that pilots are likely to avoid. The automated system periodically updates forecasts and reassesses rerouting decisions in order to account for changing weather predictions. The main objectives are to reroute flights to avoid convective weather regions and determine the resulting complexity due to rerouting. The eventual goal is to control and reduce complexity while rerouting flights during the 20 minute - 2 hour planning period. A three-hour simulation is conducted using 4800 flights in the national airspace. The study compares several metrics against a baseline scenario using the same traffic and weather but with rerouting disabled. The results show that rerouting can have a negative impact on congestion in some sectors, as expected. The rerouting system provides accurate measurements of the resulting complexity in the congested sectors. Furthermore, although rerouting is performed only in the 20-minute - 2-hour range, it results in a 30% reduction in encounters with nowcast weather polygons (100% being the ideal for perfectly predictable and accurate weather). In the simulations, rerouting was performed for the 20-minute - 2-hour flight time horizon, and for the en-route segment of air traffic. The implementation uses CWAM, a set of polygons that represent probabilities of pilot deviation around weather. The algorithms were implemented in a software-based air traffic simulation system. Initial results of the system's performance and effectiveness were encouraging. Simulation results showed that when flights were rerouted in the 20-minute - 2-hour flight time horizon of air traffic, there were fewer weather encounters in the first 20 minutes than for flights that were not rerouted. Some preliminary results were also obtained that showed that rerouting will also increase complexity. More simulations will be conducted in order to report conclusive results on the effects of rerouting on complexity. Thus, the use of the 20-minute - 2-hour flight time horizon weather avoidance teniques performed in the simulation is expected to provide benefits for short-term weather avoidance.

Karahan, Sinan↗

Controls Modeling Approach for Deployment of a Large Thin Structure for Solar Sails

One of the principal challenges with solar sails is to safely deploy the large sail structures while simultaneously maintaining attitude control. This challenge includes changing moments and products of inertia along with large sail shape uncertainties as it transitions from stowed to the fully deployed shape at the end of the deployment. With these changes, the control system must manage any potential momentum buildup and keep the pointing within mission requirements. The attitude determination and control system team for Solar Cruiser, a 1600 square meter solar sail project out of Marshall Space Flight Center, approached this problem by modeling the nominal moments and products of inertia for different stages of deployment from 10% to 100% in 10% increments. At each step, the inertias were used to generate tuned PID gains, which were used as part of a nominal deployment analysis to prevent unintentional slewing and tumbling. The team created and analyzed off nominal cases, where the moments of inertia and products were changed to induce uncertainties for the control system to manage during deployment. These cases helped verify that the control system can handle off-nominal deployments as well as any uncertainties occurring during deployment of the space sail system. This paper will show this method can be successfully used for modeling solar sail deployments as part of the attitude control system.

Solar Sails↗

Controls Modeling Approach for Deployment of a Large Thin Structures for Solar Sails

One of the principal challenges with solar sails is to safely deploy the large sail structures while simultaneously maintaining attitude control. This challenge includes changing moments and products of inertia along with large sail shape uncertainties as it transitions from stowed to the fully deployed shape at the end of the deployment. With these changes, the control system must manage any potential momentum buildup and keep the pointing within mission requirements. The attitude determination and control system team for Solar Cruiser, a 1600 square meter solar sail project out of Marshall Space Flight Center, approached this problem by modeling the nominal moments and products of inertia for different stages of deployment from 10% to 100% in 10% increments. At each step, the inertias were used to generate tuned PID gains, which were used as part of a nominal deployment analysis to prevent unintentional slewing and tumbling. The team created and analyzed off nominal cases, where the moments of inertia and products were changed to induce uncertainties for the control system to manage during deployment. These cases helped verify that the control system can handle off-nominal deployments as well as any uncertainties occurring during deployment of the space sail system. This paper will show this method can be successfully used for modeling solar sail deployments as part of the attitude control system.

Solar Sails↗

Chapter 13: Errors and Uncertainties Associated with Quasi-Global Satellite Precipitation Products

Measuring precipitation on a global scale is only possible from satellite platforms. Satellite precipitation estimates are based on geosynchronous infrared sensors on geostationary satellites, characterized by high sampling frequency, and polar-orbiting microwave sensors on low-Earth-orbiting satellites with less-frequent sampling. Assessing satellite product performance is fundamental to infer the reliability of such estimates and effectively use them in water resources management, extreme event characterization, disease control, or weather forecasting. Nevertheless, errors and uncertainties associated with satellite precipitation products are often masked due to temporal and spatial sampling, as well as bias-corrections against a reference dataset. Moreover, the verification of satellite precipitation products is easier over land areas, where rain gauges and ground radars are available as benchmark, but extremely limited over the oceans. Substantial work still remains to better quantify relative and absolute errors and uncertainties within satellite-based precipitation products over land and oceans.

Viviana Maggioni↗

NASA Risk Management Handbook

The purpose of this handbook is to provide guidance for implementing the Risk Management (RM) requirements of NASA Procedural Requirements (NPR) document NPR 8000.4A, Agency Risk Management Procedural Requirements [1], with a specific focus on programs and projects, and applying to each level of the NASA organizational hierarchy as requirements flow down. This handbook supports RM application within the NASA systems engineering process, and is a complement to the guidance contained in NASA/SP-2007-6105, NASA Systems Engineering Handbook [2]. Specifically, this handbook provides guidance that is applicable to the common technical processes of Technical Risk Management and Decision Analysis established by NPR 7123.1A, NASA Systems Engineering Process and Requirements [3]. These processes are part of the \Systems Engineering Engine. (Figure 1) that is used to drive the development of the system and associated work products to satisfy stakeholder expectations in all mission execution domains, including safety, technical, cost, and schedule. Like NPR 7123.1A, NPR 8000.4A is a discipline-oriented NPR that intersects with product-oriented NPRs such as NPR 7120.5D, NASA Space Flight Program and Project Management Requirements [4]; NPR 7120.7, NASA Information Technology and Institutional Infrastructure Program and Project Management Requirements [5]; and NPR 7120.8, NASA Research and Technology Program and Project Management Requirements [6]. In much the same way that the NASA Systems Engineering Handbook is intended to provide guidance on the implementation of NPR 7123.1A, this handbook is intended to provide guidance on the implementation of NPR 8000.4A. 1.2 Scope and Depth This handbook provides guidance for conducting RM in the context of NASA program and project life cycles, which produce derived requirements in accordance with existing systems engineering practices that flow down through the NASA organizational hierarchy. The guidance in this handbook is not meant to be prescriptive. Instead, it is meant to be general enough, and contain a sufficient diversity of examples, to enable the reader to adapt the methods as needed to the particular risk management issues that he or she faces. The handbook highlights major issues to consider when managing programs and projects in the presence of potentially significant uncertainty, so that the user is better able to recognize and avoid pitfalls that might otherwise be experienced.

Dezfuli, Homayoon↗