SEARCH · Search NASA

Results for “Uncertainty management”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

All sources NASA NTRS DOE OSTI

NASA NTRS1989

Computer-aided software development process design

The authors describe an intelligent tool designed to aid managers of software development projects in planning, managing, and controlling the development process of medium- to large-scale software projects. Its purpose is to reduce uncertainties in the budget, personnel, and schedule planning of software development projects. It is based on dynamic model for the software development and maintenance life-cycle process. This dynamic process is composed of a number of time-varying, interacting developmental phases, each characterized by its intended functions and requirements. System dynamics is used as a modeling methodology. The resulting Software LIfe-Cycle Simulator (SLICS) and the hybrid expert simulation system of which it is a subsystem are described.

Lin, Chi Y.↗

NASA NTRS1992

Extended abstract: Managing disjunction for practical temporal reasoning

One of the problems that must be dealt with in either a formal or implemented temporal reasoning system is the ambiguity arising from uncertain information. Lack of precise information about when events happen leads to uncertainty regarding the effects of those events. Incomplete information and nonmonotonic inference lead to situations where there is more than one set of possible inferences, even when there is no temporal uncertainty at all. In an implemented system, this ambiguity is a computational problem as well as a semantic one. In this paper, we discuss some of the sources of this ambiguity, which we will treat as explicit disjunction, in the sense that ambiguous information can be interpreted as defining a set of possible inferences. We describe the application of three techniques for managing disjunction in an implementation of Dean's Time Map Manager. Briefly, the disjunction is either: removed by limiting the expressive power of the system, or approximated by a weaker form of representation that subsumes the disjunction. We use a combination of these methods to implement an expressive and efficient temporal reasoning engine that performs sound inference in accordance with a well-defined formal semantics.

Boddy, Mark↗

NASA NTRS2004

Improving Project Management with Simulation and Completion Distribution Functions

Despite the critical importance of project completion timeliness, management practices in place today remain inadequate for addressing the persistent problem of project completion tardiness. A major culprit in late projects is uncertainty, which most, if not all, projects are inherently subject to. This uncertainty resides in the estimates for activity durations, the occurrence of unplanned and unforeseen events, and the availability of critical resources. In response to this problem, this research developed a comprehensive simulation based methodology for conducting quantitative project completion time risk analysis. It is called the Project Assessment by Simulation Technique (PAST). This new tool enables project stakeholders to visualize uncertainty or risk, i.e. the likelihood of their project completing late and the magnitude of the lateness, by providing them with a completion time distribution function of their projects. Discrete event simulation is used within PAST to determine the completion distribution function for the project of interest. The simulation is populated with both deterministic and stochastic elements. The deterministic inputs include planned project activities, precedence requirements, and resource requirements. The stochastic inputs include activity duration growth distributions, probabilities for events that can impact the project, and other dynamic constraints that may be placed upon project activities and milestones. These stochastic inputs are based upon past data from similar projects. The time for an entity to complete the simulation network, subject to both the deterministic and stochastic factors, represents the time to complete the project. Repeating the simulation hundreds or thousands of times allows one to create the project completion distribution function. The Project Assessment by Simulation Technique was demonstrated to be effective for the on-going NASA project to assemble the International Space Station. Approximately $500 million per month is being spent on this project, which is scheduled to complete by 2010. NASA project stakeholders participated in determining and managing completion distribution functions produced from PAST. The first result was that project stakeholders improved project completion risk awareness. Secondly, using PAST, mitigation options were analyzed to improve project completion performance and reduce total project cost.

Cates, Grant R.↗

NASA NTRS2010

Analysis of Flight Management System Predictions of Idle-Thrust Descents

To enable arriving aircraft to fly optimized descents computed by the flight management system (FMS) in congested airspace, ground automation must accurately predict descent trajectories. To support development of the predictor and its uncertainty models, descents from cruise to the meter fix were executed using vertical navigation in a B737-700 simulator and a B777-200 simulator, both with commercial FMSs. For both aircraft types, the FMS computed the intended descent path for a specified speed profile assuming idle thrust after top of descent (TOD), and then it controlled the avionics without human intervention. The test matrix varied aircraft weight, descent speed, and wind conditions. The first analysis in this paper determined the effect of the test matrix parameters on the FMS computation of TOD location, and it compared the results to those for the current ground predictor in the Efficient Descent Advisor (EDA). The second analysis was similar but considered the time to fly a specified distance to the meter fix. The effects of the test matrix variables together with the accuracy requirements for the predictor will determine the allowable error for the predictor inputs. For the B737, the EDA prediction of meter fix crossing time agreed well with the FMS; but its prediction of TOD location probably was not sufficiently accurate to enable idle-thrust descents in congested airspace, even though the FMS and EDA gave similar shapes for TOD location as a function of the test matrix variables. For the B777, the FMS and EDA gave different shapes for the TOD location function, and the EDA prediction of the TOD location is not accurate enough to fully enable the concept. Furthermore, the differences between the FMS and EDA predictions of meter fix crossing time for the B777 indicated that at least one of them was not sufficiently accurate.

Stell, Laurel↗

NASA NTRS2017

How Engineers Negotiate Domain Boundaries in a Complex, Interdisciplinary Engineering Project

Engineering educators have an essential role in preparing engineers to work in a complex, interdisciplinary workforce. While much engineering education focuses on teaching students to develop disciplinary expertise in specific engineering domains, there is a strong need to teach engineers about the knowledge that they develop or use in their work (Bucciarelli 1994, Allenby Sarewitz, 2011; Frodeman, 2013). The purpose of this research is to gain a better understanding of the knowledge systems of practicing engineers through observations of their practices such that the insights learned can guide future education efforts. Using an example from a complex and interdisciplinary engineering project, this paper presents a case study overviewing the types of epistemological (or knowledge-acquiring or using) complexities that engineers navigate. Specifically, we looked at a discussion of the thermal design of a CubeSat that occurred during an engineering review at NASA. We analyzed the review using a framework that we call 'peak events', or pointed discussions between reviewers, project engineers, and managers. We examined the dialog within peak events to identify the ways that knowledge was brought to bear, highlighting discussions of uncertainty and the boundaries of knowledge claims. We focus on one example discussion surrounding the thermal design of the CubeSat, which provides a particularly thorough example of a knowledge system since the engineers present explained, justified, negotiated, and defended knowledge within a social setting. Engineering students do not get much practice or instruction in explicitly negotiating knowledge systems and epistemic standards in this way. We highlight issues that should matter to engineering educators, such as the need to discuss what level of uncertainty is sufficient and the need to negotiate boundaries of system responsibility. Although this analysis is limited to a single discussion or 'peak event', our case shows that this type of discussion can occur in engineering and suggests that it could be important for future engineering education research.

ethnography↗

NASA NTRS2024

Climate Extremes and Risks: Links Between Climate Science and Decision-Making

The World Climate Research Programme (WCRP) envisions a future where actionable climate information is universally accessible, supporting decision makers in preparing for and responding to climate change. In this perspective, we advocate for enhancing links between climate science and decision-making through a better and more decision-relevant understanding of climate impacts. The proposed framework comprises three pillars: climate science, impact science, and decision-making, focusing on generating seamless climate information from sub-seasonal, seasonal, decadal to century timescales informed by observed climate events and their impacts. The link between climate science and decision-making has strengthened in recent years, partly owing to undeniable impacts arising from disastrous weather extremes. Enhancing decision-relevant understanding involves utilizing lessons from past extreme events and implementing impact-based early warning systems to improve resilience. Integrated risk assessment and management require a comprehensive approach that encompasses good knowledge about possible impacts, hazard identification, monitoring, and communication of risks while acknowledging uncertainties inherent in climate predictions and projections, but not letting the uncertainty lead to decision paralysis. The importance of data accessibility, especially in the Global South, underscores the need for better coordination and resource allocation. Strategic frameworks should aim to enhance impact-related and open-access climate services around the world. Continuous improvements in predictive modeling and observational data are critical, as is ensuring that climate science remains relevant to decision makers locally and globally. Ultimately, fostering stronger collaborations and dedicated investments to process and tailor climate data will enhance societal preparedness, enabling communities to navigate the complexities of a changing climate effectively.

climate extremes↗

NASA NTRS2016

Disturbance and the Carbon Balance of US Forests: A Quantitative Review of Impacts from Harvests, Fires, Insects, and Droughts

Disturbances are a major determinant of forest carbon stocks and uptake. They generally reduce land carbon stocks but also initiate a regrowth legacy that contributes substantially to the contemporary rate of carbon stock increase in US forestlands. As managers and policy makers increasingly look to forests for climate protection and mitigation, and because of increasing concern about changes in disturbance intensity and frequency, there is a need for synthesis and integration of current understanding about the role of disturbances and other processes in governing forest carbon cycle dynamics, and the likely future of this and other sinks for atmospheric carbon. This paper aims to address that need by providing a quantitative review of the distribution, extent and carbon impacts of the major disturbances active in the US. We also review recent trends in disturbances, climate, and other global environmental changes and consider their individual and collective contributions to the US carbon budget now and in the likely future. Lastly, we identify some key challenges and opportunities for future research needed to improve current understanding, advance predictive capabilities, and inform forest management in the face of these pressures. Harvest is found to be the most extensive disturbance both in terms of area and carbon impacts, followed by fire, windthrow and bark beetles, and lastly droughts. Collectively these lead to the gross loss of about 200 Tg C y(exp -1) in live biomass annually across the conterminous US. At the same time, the net change in forest carbon stocks is positive (190 Tg C y(exp -1)), indicating not only forest resilience but also an apparently large response to growth enhancements such as fertilization by CO2 and nitrogen. Uncertainty about disturbance legacies, disturbance interactions, likely trends, and global change factors make the future of the US forest carbon sink unclear. While there is scope for management to enhance carbon sinks in US forests, tradeoffs with other values and uses are likely to significantly limit practical implementation. Continued and expanded remote sensing and field-based monitoring capabilities and manipulative experimentation are needed to improve understanding of the US forest carbon sink, and assess how disturbance processes are responding to the pressures of global environmental change. In addition, continued development and application of holistic, decision support tools that consider a range of forest values are needed to enable managers and policy makers to use the best available information for guiding forest resources now and into the future.

Williams, Christopher A.↗

NASA NTRS2023

Evaluation of a Regional Crop Model Implementation for Sub-National Yield Assessments in Kenya

CONTEXT: Cropping system models can be used to both assess regional food security and to monitor and predict agricultural drought. Agriculture in Kenya is extremely important to both the economy and food security of the country. OBJECTIVE: This study evaluated a regional implementation of a widely used crop model, the Decision Support System for Agrotechnology Transfer (DSSAT), within a coupled modeling framework, the Regional Hydrologic Extremes Assessment System (RHEAS), over Kenya. The goal of this study was to assess the ability of RHEAS to simulate the annual variability of maize yields at the county level and evaluate the uncertainty inherent in the model and inputs. METHODS: The RHEAS system implements a stochastic ensemble approach to account for field scale variabilities in crop management practices and underlying soil and weather conditions. Satellite-derived datasets were used to evaluate the land surface component of the system and seasonally disaggregated yield for 5 years was used to assess the performance of the cropping system model. RESULTS AND CONCLUSIONS: The median correlation between RHEAS and satellite-derived soil moisture and evapotranspiration estimates were 0.78, and 0.51, respectively, indicating that the model is able to capture the key drivers of the hydrological budget. Overall, RHEAS simulated yearly yield variations with a median correlation of 0.7 with reported yields, with the best performance in the short rains season. However, across both seasons, the RHEAS model was positively biased on the order of ~1.6 MT/ha. The overall median unbiased RMSE was 0.66 MT/ha. The RHEAS system shows skill at simulating extreme departures in anomalies, and a majority of the time (62.5%) the reported yields fall within the interquartile range of the simulations. SIGNIFICANCE: One of the most important areas of improvement for the next generation of agricultural data and models is to better understand and communicate the inherent uncertainties. This is especially critical in data-limited regions. Here we present a modeling system and its implementation that begins to address these concerns. We demonstrate the ability to simulate broad trends in yields at the county level for sub-annual yields with skills that commensurate previous national/annual level studies.

Crop model↗

NASA NTRS1972

What motivates researchers in times of economic uncertainty.

Results of a study initiated late in 1970 to obtain both a measure of on-and-around-the-job factors which were 'motivating' to engineers and scientists, and to obtain an indication of how the relative importance of these factors changes as a result of the uncertain economic environment. A questionnaire, 'The Jackman Job Satisfaction Schedule,' was used to satisfy the needs of the study. It is concluded that managers can enhance the feeling of motivation by making individual job assignments interesting and challenging, by formulating significant milestones and end points into job content, and by assigning ample rewards with corresponding responsibility. In times of economic uncertainty increased emphasis should be given to security-related aspects of employment.

Bucher, G. C.↗

NASA NTRS2021

Romie: A Domain-Independent Tool for Computer-Aided Robust Operations Management

Romie is a decision support tool based on AI's latest advances in the domain of robust scheduling. Unlike all its predecessors, the tool allows to (i) visually model the operational problem and context entirely (ii) optimize to find near-optimal schedules while taking uncertainty into account and deals with (iii) a combination of various {key performance indicators (KPIs). It comes with a web user interface. Part or all of the modelled activities may be associated to random variables describing their stochastic durations, in order to produce schedules that are robust w.r.t. temporal uncertainty. Hence, depending on the pursued KPIs, the schedules maximize a combination of the following terms: the probability of satisfying the problem constraints, the expected return/efficiency, the expected outcome quality, and even the operators' wellness by minimizing its expected extra-hours. Initially developed for spatial exploration and demonstration in the context of Mars analog missions, this versatile tool is here applied to operations management in both biotechnology manufacturing and robots parametrization in a cave exploration context.

Chien, Steve A.↗

NASA NTRS2011

Climate Change Impact Uncertainties for Maize in Panama: Farm Information, Climate Projections, and Yield Sensitivities

We present results from a pilot project to characterize and bound multi-disciplinary uncertainties around the assessment of maize (Zea mays) production impacts using the CERES-Maize crop model in a climate-sensitive region with a variety of farming systems (Panama). Segunda coa (autumn) maize yield in Panama currently suffers occasionally from high water stress at the end of the growing season, however under future climate conditions warmer temperatures accelerate crop maturation and elevated CO (sub 2) concentrations improve water retention. This combination reduces end-of-season water stresses and eventually leads to small mean yield gains according to median projections, although accelerated maturation reduces yields in seasons with low water stresses. Calibrations of cultivar traits, soil profile, and fertilizer amounts are most important for representing baseline yields, however sensitivity to all management factors is reduced in an assessment of future yield changes (most dramatically for fertilizers), suggesting that yield changes may be more generalizable than absolute yields. Uncertainty around General Circulation Model (GCM)s' projected changes in rainfall gain in importance throughout the century, with yield changes strongly correlated with growing season rainfall totals. Climate changes are expected to be obscured by the large inter-annual variations in Panamanian climate that will continue to be the dominant influence on seasonal maize yield into the coming decades. The relatively high (A2) and low (B1) emissions scenarios show little difference in their impact on future maize yields until the end of the century. Uncertainties related to the sensitivity of CERES-Maize to carbon dioxide concentrations have a substantial influence on projected changes, and remain a significant obstacle to climate change impacts assessment. Finally, an investigation into the potential of simple statistical yield emulators based upon key climate variables characterizes the important uncertainties behind the selection of climate change metrics and their performance against more complex process-based crop model simulations, revealing a danger in relying only on long-term mean quantities for crop impact assessment.

Maize↗

NASA NTRS2020

Intelligent Contingency Management for Urban Air Mobility

The third aviation revolution is seeking to enable transportation where users have access to immediate and flexible air travel; the users dictate trip origin, destination and timing. One of the major components of this vision is urban air mobility (UAM) for the masses. UAM means a safe and efficient system for vehicles to move passengers and cargo within a city. In order to reach UAM’s full market potential the vehicle will have to be autonomous. One of the primary challenges of autonomous flight is dealing with off-nominal events, both common and unforeseen; thus, intelligent contingency management (ICM) is one of the enabling technologies. In this context, the vehicle has to be aware of its internal state and external environment at all times, ascertain its capability and make decisions about mission completion or modification. All of these functions require data to model and assess the environment and then take actions based on these models. Necessarily, there is uncertainty associated with the data and the models generated from it. Since we are dealing with safety-critical systems, one of the main challenges of ICM is to generate sufficient data and to minimize its uncertainty to enable practical and safe decision making. We propose an overall architecture that incorporates deterministic and learning algorithms together to assess vehicle capabilities, project these into the future and make decisions on mission management level. A layered approach allows for mature parts and technologies to be integrated into early highly automated vehicles before the final state of autonomy is reached.

data-driven systems↗

NASA NTRS1988

Machine intelligence and autonomy for aerospace systems

The present volume discusses progress toward intelligent robot systems in aerospace applications, NASA Space Program automation and robotics efforts, the supervisory control of telerobotics in space, machine intelligence and crew/vehicle interfaces, expert-system terms and building tools, and knowledge-acquisition for autonomous systems. Also discussed are methods for validation of knowledge-based systems, a design methodology for knowledge-based management systems, knowledge-based simulation for aerospace systems, knowledge-based diagnosis, planning and scheduling methods in AI, the treatment of uncertainty in AI, vision-sensing techniques in aerospace applications, image-understanding techniques, tactile sensing for robots, distributed sensor integration, and the control of articulated and deformable space structures.

Heer, Ewald↗

NASA NTRS2010

Predictability of Top of Descent Location for Operational Idle-Thrust Descents

To enable arriving aircraft to fly optimized descents computed by the flight management system (FMS) in congested airspace, ground automation must accurately predict descent trajectories. To support development of the trajectory predictor and its uncertainty models, commercial flights executed idle-thrust descents at a specified descent speed, and the recorded data included the specified descent speed profile, aircraft weight, and the winds entered into the FMS as well as the radar data. The FMS computed the intended descent path assuming idle thrust after top of descent (TOD), and the controllers and pilots then endeavored to allow the FMS to fly the descent to the meter fix with minimal human intervention. The horizontal flight path, cruise and meter fix altitudes, and actual TOD location were extracted from the radar data. Using approximately 70 descents each in Boeing 757 and Airbus 319/320 aircraft, multiple regression estimated TOD location as a linear function of the available predictive factors. The cruise and meter fix altitudes, descent speed, and wind clearly improve goodness of fit. The aircraft weight improves fit for the Airbus descents but not for the B757. Except for a few statistical outliers, the residuals have absolute value less than 5 nmi. Thus, these predictive factors adequately explain the TOD location, which indicates the data do not include excessive noise.

Stell, Laurel L.↗

NASA NTRS2011

Development of Risk Uncertainty Factors from Historical NASA Projects

NASA is a good investment of federal funds and strives to provide the best value to the nation. NASA has consistently budgeted to unrealistic cost estimates, which are evident in the cost growth in many of its programs. In this investigation, NASA has been using available uncertainty factors from the Aerospace Corporation, Air Force, and Booz Allen Hamilton to develop projects risk posture. NASA has no insight into the developmental of these factors and, as demonstrated here, this can lead to unrealistic risks in many NASA Programs and projects (P/p). The primary contribution of this project is the development of NASA missions uncertainty factors, from actual historical NASA projects, to aid cost-estimating as well as for independent reviews which provide NASA senior management with information and analysis to determine the appropriate decision regarding P/p. In general terms, this research project advances programmatic analysis for NASA projects.

Amer, Tahani R.↗

NASA NTRS2019

Continuously Improving Parametric Modeling with Historical Data on the ICESat-2 Mission

This paper delves into the details of the Joint Confidence Level (JCL) process performed for the Ice, Cloud, and Land Elevation Satellite (ICESat)-2 mission and how past performance was incorporated into subsequent JCL models to enable the project to continuously analyze potential slips to their launch readiness date (LRD). One year prior to the mission Preliminary Review (mPDR), the JCL model development process began. The first model was well received at the mPDR, held on October 10, 2012, and the input received by the Standing Review Board was incorporated into the model for the official data drop for key decision point (KDP)-C. The 70% JCL results of the October 2012 mPDR model forecast an LRD of February 2017 and associated cost of $830M. This result in 2012 immediately highlighted potential challenges with the project-planned LRD of July 2016. The year following the mPDR, the project had sustained a oneyear slip in the LRD due to problematic systems engineering requirement issues which impacted all project subsystems. This slip moved the project planned LRD from July 2016 to July 2017, an additional 5 months beyond the 2012 model’s 70% JCL result for the LRD of February 2017. As the project was quickly approaching the mission Critical Design Review (mCDR), the need for reliable JCL results increased significantly. The project held discussions on the JCL modeling process and focused on the input uncertainty distributions. Specifically, to identify the uncertainty distributions that the 2012 mPDR model would have needed to produce a 70% LRD result of July 2017. This led the project to compare multiple uncertainty distributions, and ultimately spurred the project to utilize uncertainty distributions that incorporated project past performance and historical data to forecast potential LRD slips. The revised results, created in 2014 and utilizing the new uncertainty distributions, showed that with 70% confidence, the ICESat-2 mission would launch in August 2018 with a cost of $1,044M. Today, ICESat-2 is scheduled to launch on September 15, 2018 with a project management (PM) agreement value of $1,056M. This illustrates how a JCL model can be continuously improved to produce valuable results for a project, even in cases of LRD delays. The primary reason for the ICESat-2 LRD delay is due to a laser failure on the primary instrument. Laser failure was one of the highest risk and uncertainty drivers within the JCL model. The project placed the most risk in this area of the model, and the model further identified the laser as the top risk driver and contributor to the LRD result. This further illustrates how a JCL can be used to predict and quantify possible issues on new technology missions.

Krygiel, Joseph↗

NASA NTRS2023

Vertiport Dynamic Density

Advanced Air Mobility (AAM) is envisioned to be another spoke in a region’s transportation system, supplementing ground-based travel with air-based travel. Eventually, air taxis will be pervasive, convenient, and affordable. As demand and operations tempo increase, congestion may arise. Several characteristics of AAM reduce the applicability of techniques used in today’s National Airspace System (NAS) to manage congestion. AAM will include both scheduled and non-scheduled, on-demand operations, challenging strategic deconfliction algorithms. Flights will be fairly short, traversing an urban area, not hundreds or thousands of miles, with corresponding low energy reserves, prohibiting excessive delays. Flight operators will need flexibility in operations, scheduling a flight only minutes before departure, or diverting to an alternate vertiport if it becomes advantageous, further adding to trajectory uncertainty that would challenge strategic deconfliction. Finally, operators will desire privacy to protect sensitive information or preserve competitive advantage, limiting early access to intent information. In this paper, we present an approach for managing congestion at vertiports by providing insight into the traffic situation to support operationally-advantageous and safe land or divert decisions. We propose a metric designed with usefulness and usability in AAM operations in mind. The metric uses the sociology concept of dynamic density (DD) that takes into consideration not only number of flights, but also the interaction of those flights with the vertiport’s limited resources, namely the landing pads and the parking spots. DD supports a Pilot in Command (PIC) with decisions about whether to proceed, expedite, delay, or divert; and supports air traffic control (ATC) and vertiport operators in airspace management and vertiport usage. We demonstrate the metric on a notional vertiport scenario. We also show that DD provides better insight into congestion and resulting flight delays than an aircraft count metric used in traditional air traffic management.

Lilly Spirkovska↗

NASA NTRSDate not supplied

Demand Capacity Balancing at Vertiports for Urban Air Mobility

Demand Capacity Balancing (DCB) can be applied in strategic conflict management for safe Urban Air Mobility (UAM) operations. Even when the operational tempo is low, traffic demand can locally exceed the capacity at airspace resources like vertiports. This paper proposes a DCB algorithm to manage the UAM traffic demand strategically, given the capacity at vertiports. The DCB algorithm is evaluated with traffic scenarios at Dallas/Fort Worth urban area in terms of various metrics such as demand distribution changes, pre-departure delay, and the number of simultaneous operations in the air. With the same experiment setup, more extended studies are also conducted to investigate how the UAM flight scheduling based on the DCB algorithm is affected by various conditions that can occur in a practical UAM environment, including vertiport capacity changes, a slot size parameter in capacity constraint, differences in operational policy between operators like lead time for flight plan submission and cruise flight speed, and uncertainties in actual departure and arrival times.

Urban Air Mobility↗