Search NASA⌕ Search

SEARCH · Search NASA

Results for “Uncertainty Management”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
NASA NTRS1990

Software Model Of Software-Development Process

Collection of computer programs constitutes software tool for simulation of medium- to large-scale software-development projects. Necessary to include easily identifiable and more-readily quantifiable characteristics like costs, times, and numbers of errors. Mathematical model incorporating these and other factors of dynamics of software-development process implemented in the Software Life Cycle Simulator (SLICS) computer program. Simulates dynamics of software-development process. In combination with input and output expert software systems and knowledge-based management software system, develops information for use in managing large software-development project. Intended to aid managers in planning, managing, and controlling software-development processes by reducing uncertainties in budgets, required personnel, and schedules.

Lin, Chi Y.↗
NASA NTRS2009

Convective Weather Avoidance with Uncertain Weather Forecasts

Convective weather events have a disruptive impact on air traffic both in terminal area and in en-route airspaces. In order to make sure that the national air transportation system is safe and efficient, it is essential to respond to convective weather events effectively. Traffic flow control initiatives in response to convective weather include ground delay, airborne delay, miles-in-trail restrictions as well as tactical and strategic rerouting. The rerouting initiatives can potentially increase traffic density and complexity in regions neighboring the convective weather activity. There is a need to perform rerouting in an intelligent and efficient way such that the disruptive effects of rerouting are minimized. An important area of research is to study the interaction of in-flight rerouting with traffic congestion or complexity and developing methods that quantitatively measure this interaction. Furthermore, it is necessary to find rerouting solutions that account for uncertainties in weather forecasts. These are important steps toward managing complexity during rerouting operations, and the paper is motivated by these research questions. An automated system is developed for rerouting air traffic in order to avoid convective weather regions during the 20- minute - 2-hour time horizon. Such a system is envisioned to work in concert with separation assurance (0 - 20-minute time horizon), and longer term air traffic management (2-hours and beyond) to provide a more comprehensive solution to complexity and safety management. In this study, weather is dynamic and uncertain; it is represented as regions of airspace that pilots are likely to avoid. Algorithms are implemented in an air traffic simulation environment to support the research study. The algorithms used are deterministic but periodically revise reroutes to account for weather forecast updates. In contrast to previous studies, in this study convective weather is represented as regions of airspace that pilots are likely to avoid. The automated system periodically updates forecasts and reassesses rerouting decisions in order to account for changing weather predictions. The main objectives are to reroute flights to avoid convective weather regions and determine the resulting complexity due to rerouting. The eventual goal is to control and reduce complexity while rerouting flights during the 20 minute - 2 hour planning period. A three-hour simulation is conducted using 4800 flights in the national airspace. The study compares several metrics against a baseline scenario using the same traffic and weather but with rerouting disabled. The results show that rerouting can have a negative impact on congestion in some sectors, as expected. The rerouting system provides accurate measurements of the resulting complexity in the congested sectors. Furthermore, although rerouting is performed only in the 20-minute - 2-hour range, it results in a 30% reduction in encounters with nowcast weather polygons (100% being the ideal for perfectly predictable and accurate weather). In the simulations, rerouting was performed for the 20-minute - 2-hour flight time horizon, and for the en-route segment of air traffic. The implementation uses CWAM, a set of polygons that represent probabilities of pilot deviation around weather. The algorithms were implemented in a software-based air traffic simulation system. Initial results of the system's performance and effectiveness were encouraging. Simulation results showed that when flights were rerouted in the 20-minute - 2-hour flight time horizon of air traffic, there were fewer weather encounters in the first 20 minutes than for flights that were not rerouted. Some preliminary results were also obtained that showed that rerouting will also increase complexity. More simulations will be conducted in order to report conclusive results on the effects of rerouting on complexity. Thus, the use of the 20-minute - 2-hour flight time horizon weather avoidance teniques performed in the simulation is expected to provide benefits for short-term weather avoidance.

Karahan, Sinan↗
DOE OSTI2025

The transition from resistance to acceptance: Managing a marine invasive species in a changing world

Abstract Marine invasive species can transform coastal ecosystems, yet mitigating their effects can be difficult, and even impractical. Often, marine invasive species are managed at poorly matched spatial scales, and at the same time, rates of spread and establishment are increasing under climate change and can outpace resources available for population suppression. These circumstances challenge traditional conservation goals of maintaining a historic environmental state, especially for a species like the European green crab ( Carcinus maenas ), a formidable invader with few examples of successful long‐term removal programs. A management paradigm where decision alternatives include resisting or accepting a new ecological trajectory may be needed. We apply mathematical concepts from decision theory to develop a quantitative framework for navigating management decisions in this new resist‐accept paradigm. We develop a model of European green crab growth, removal and colonization, and we find optimal levels of removal effort that minimize both ecological change and removal cost. We establish a benchmark of colonization pressure at which green crab density becomes decoupled from a decision maker's actions, such that population control can no longer shape the invasion trajectory. For informing the decision boundary between resistance and acceptance, our results highlight that a decision maker's understanding of how removal cost scales with removal effort is more important than understanding the density‐impact relationship. We show that assuming stationary system dynamics can result in sub‐optimal levels of species removal effort, highlighting the importance of developing anticipatory management strategies by accounting for non‐stationary dynamics. Policy implications . For marine invasive species that can disperse across long distances and recolonize rapidly after removal, the focus of conservation policy should shift away from understanding how to resist change to understanding when to stop resisting change. Navigating this decision problem involves trade‐offs among competing objectives, highlighting the need for structured approaches to elicit objective weights that reflect the values of the decision maker. For natural resource managers facing possible ecosystem transformation, this decision framework can enable proactive and strategic decisions made under uncertainty in a changing world.

Keller, Abigail G. [Department of Environment Scie↗
DOE OSTI2024

Glass Design Using Machine Learning Property Models with Prediction Uncertainties: Nuclear Waste Glass Formulation

The United States Department of Energy is responsible for managing the legacy nuclear waste stored in underground tanks at the Hanford Site. The waste will be separately vitrified as low-activity waste and high-level waste fractions. Waste glass formulation algorithms have been traditionally developed using partial quadratic mixture property-composition models. Recently, machine learning (ML) techniques have been used to predict glass properties and discover new glass materials for nuclear waste vitrification, and these advancements can be utilized to improve waste glass composition design. In this proof-of-principle study, ML algorithms such as Gaussian process regression (GPR) were used to interpolate glass properties (e.g., viscosity, electrical conductivity, chemical durability). After selecting appropriate sets of GPR hyper-parameters for each property, an optimization program was developed to formulate glass compositions to maximize waste loading while simultaneously satisfying property within constraints. The results of the ML-based waste loadings and glass compositions were compared to those obtained using the traditional methods. Comparing to the previous glass design framework, the ML-based optimization methods offer improved glass designs and a streamlined approach to generation of optimally designed data and near real-time updates.

glass formulation, machine learning, constraints, ↗
NASA NTRSDate not supplied

Controls Modeling Approach for Deployment of a Large Thin Structure for Solar Sails

One of the principal challenges with solar sails is to safely deploy the large sail structures while simultaneously maintaining attitude control. This challenge includes changing moments and products of inertia along with large sail shape uncertainties as it transitions from stowed to the fully deployed shape at the end of the deployment. With these changes, the control system must manage any potential momentum buildup and keep the pointing within mission requirements. The attitude determination and control system team for Solar Cruiser, a 1600 square meter solar sail project out of Marshall Space Flight Center, approached this problem by modeling the nominal moments and products of inertia for different stages of deployment from 10% to 100% in 10% increments. At each step, the inertias were used to generate tuned PID gains, which were used as part of a nominal deployment analysis to prevent unintentional slewing and tumbling. The team created and analyzed off nominal cases, where the moments of inertia and products were changed to induce uncertainties for the control system to manage during deployment. These cases helped verify that the control system can handle off-nominal deployments as well as any uncertainties occurring during deployment of the space sail system. This paper will show this method can be successfully used for modeling solar sail deployments as part of the attitude control system.

Solar Sails↗
NASA NTRSDate not supplied

Controls Modeling Approach for Deployment of a Large Thin Structures for Solar Sails

One of the principal challenges with solar sails is to safely deploy the large sail structures while simultaneously maintaining attitude control. This challenge includes changing moments and products of inertia along with large sail shape uncertainties as it transitions from stowed to the fully deployed shape at the end of the deployment. With these changes, the control system must manage any potential momentum buildup and keep the pointing within mission requirements. The attitude determination and control system team for Solar Cruiser, a 1600 square meter solar sail project out of Marshall Space Flight Center, approached this problem by modeling the nominal moments and products of inertia for different stages of deployment from 10% to 100% in 10% increments. At each step, the inertias were used to generate tuned PID gains, which were used as part of a nominal deployment analysis to prevent unintentional slewing and tumbling. The team created and analyzed off nominal cases, where the moments of inertia and products were changed to induce uncertainties for the control system to manage during deployment. These cases helped verify that the control system can handle off-nominal deployments as well as any uncertainties occurring during deployment of the space sail system. This paper will show this method can be successfully used for modeling solar sail deployments as part of the attitude control system.

Solar Sails↗
NASA NTRS2021

Chapter 13: Errors and Uncertainties Associated with Quasi-Global Satellite Precipitation Products

Measuring precipitation on a global scale is only possible from satellite platforms. Satellite precipitation estimates are based on geosynchronous infrared sensors on geostationary satellites, characterized by high sampling frequency, and polar-orbiting microwave sensors on low-Earth-orbiting satellites with less-frequent sampling. Assessing satellite product performance is fundamental to infer the reliability of such estimates and effectively use them in water resources management, extreme event characterization, disease control, or weather forecasting. Nevertheless, errors and uncertainties associated with satellite precipitation products are often masked due to temporal and spatial sampling, as well as bias-corrections against a reference dataset. Moreover, the verification of satellite precipitation products is easier over land areas, where rain gauges and ground radars are available as benchmark, but extremely limited over the oceans. Substantial work still remains to better quantify relative and absolute errors and uncertainties within satellite-based precipitation products over land and oceans.

Viviana Maggioni↗
DOE OSTI2024

Soil management practices can contribute to net carbon neutrality in California

Stabilizing climate requires reducing greenhouse gas (GHG) emissions and storing atmospheric carbon dioxide (CO 2 ) in land or ocean systems. Soil management practices can reduce GHG emissions or sequester atmospheric CO 2 into inorganic and organic forms. However, whether soil carbon strategies represent a viable and impactful climate mitigation pathway is uncertain. A specific question concerns the role that land-management practices and soil amendments can play in realizing California's ambition for carbon neutrality by 2045. Here we examine the carbon flux impacts of soil conservation (i.e., compost, reduced tillage, cover crop) and enhanced silicate rock weathering (EW) practices at different areal extents of implementation in cropland, grassland, and savanna in California under two climate change cases. We show that with implementation areas of 15% or 50% of private cultivated land, grassland, and savanna in California, soil conservation practices alone can contribute $1.4^{2.1}_{0.7}$% ($-1.8^{-2.7}_{ -0.9}$ Mt CO 2 eq y -1 ) and $4.6^{6.9}_{2.3}$% ($-6.0^{-8.9}_{-3.0}$ Mt CO 2 eq y -1 ) of the additional emissions reduction needed (beyond previous targets) to meet the 2045 net neutrality goal (-129.3 Mt CO 2 eq y -1 ), respectively, on an average annual basis, including climate uncertainty. Including EW in these scenarios increases the total contributions of management practices to $4.1^{5.6}_{2.5}$% ($-5.2^{-7.3}_{-3.2}$ Mt CO 2 eq y -1 ) and $13.5^{18.6}_{8.2}$% ($-17.5^{-24.2}_{-10.7}$ Mt CO 2 eq y -1 ), respectively, of this reduction. This highlights that the extent of implementation area is a major factor in determining benefits and that EW has the potential to make a real contribution to net reduction targets. Results are similar across climate cases, indicating that contemporary field data can be used to make future projections. With EW there remains mechanistic uncertainties, however, such as rock dissolution rate and environmental controls on weathering products, which require additional field research to improve understanding of the technological efficacy of this approach for California's 2045 carbon neutrality goal.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Model-Based Sequential Design of Experiments for Pilot Testing of Novel Water-Lean CO2 Capture Solvent

Poster for the 2024 Fossil Energy and Carbon Management Meeting. It summarizes work done on process modeling and uncertainty quantification in preparation for the test campaign at the National Carbon Capture Center for a general audience. The poster includes sections detailing background on the EEMPA solvent, sequential design of experiments, process modeling (including results from the model), uncertainty quantification, and the goals of the test campaign.

Hedrick, Katherine↗
NASA NTRS2011

NASA Risk Management Handbook

The purpose of this handbook is to provide guidance for implementing the Risk Management (RM) requirements of NASA Procedural Requirements (NPR) document NPR 8000.4A, Agency Risk Management Procedural Requirements [1], with a specific focus on programs and projects, and applying to each level of the NASA organizational hierarchy as requirements flow down. This handbook supports RM application within the NASA systems engineering process, and is a complement to the guidance contained in NASA/SP-2007-6105, NASA Systems Engineering Handbook [2]. Specifically, this handbook provides guidance that is applicable to the common technical processes of Technical Risk Management and Decision Analysis established by NPR 7123.1A, NASA Systems Engineering Process and Requirements [3]. These processes are part of the \Systems Engineering Engine. (Figure 1) that is used to drive the development of the system and associated work products to satisfy stakeholder expectations in all mission execution domains, including safety, technical, cost, and schedule. Like NPR 7123.1A, NPR 8000.4A is a discipline-oriented NPR that intersects with product-oriented NPRs such as NPR 7120.5D, NASA Space Flight Program and Project Management Requirements [4]; NPR 7120.7, NASA Information Technology and Institutional Infrastructure Program and Project Management Requirements [5]; and NPR 7120.8, NASA Research and Technology Program and Project Management Requirements [6]. In much the same way that the NASA Systems Engineering Handbook is intended to provide guidance on the implementation of NPR 7123.1A, this handbook is intended to provide guidance on the implementation of NPR 8000.4A. 1.2 Scope and Depth This handbook provides guidance for conducting RM in the context of NASA program and project life cycles, which produce derived requirements in accordance with existing systems engineering practices that flow down through the NASA organizational hierarchy. The guidance in this handbook is not meant to be prescriptive. Instead, it is meant to be general enough, and contain a sufficient diversity of examples, to enable the reader to adapt the methods as needed to the particular risk management issues that he or she faces. The handbook highlights major issues to consider when managing programs and projects in the presence of potentially significant uncertainty, so that the user is better able to recognize and avoid pitfalls that might otherwise be experienced.

Dezfuli, Homayoon↗
NASA NTRS2015

Underestimation of Project Costs

Large projects almost always exceed their budgets. Estimating cost is difficult and estimated costs are usually too low. Three different reasons are suggested: bad luck, overoptimism, and deliberate underestimation. Project management can usually point to project difficulty and complexity, technical uncertainty, stakeholder conflicts, scope changes, unforeseen events, and other not really unpredictable bad luck. Project planning is usually over-optimistic, so the likelihood and impact of bad luck is systematically underestimated. Project plans reflect optimism and hope for success in a supposedly unique new effort rather than rational expectations based on historical data. Past project problems are claimed to be irrelevant because "This time it's different." Some bad luck is inevitable and reasonable optimism is understandable, but deliberate deception must be condemned. In a competitive environment, project planners and advocates often deliberately underestimate costs to help gain project approval and funding. Project benefits, cost savings, and probability of success are exaggerated and key risks ignored. Project advocates have incentives to distort information and conceal difficulties from project approvers. One naively suggested cure is more openness, honesty, and group adherence to shared overall goals. A more realistic alternative is threatening overrun projects with cancellation. Neither approach seems to solve the problem. A better method to avoid the delusions of over-optimism and the deceptions of biased advocacy is to base the project cost estimate on the actual costs of a large group of similar projects. Over optimism and deception can continue beyond the planning phase and into project execution. Hard milestones based on verified tests and demonstrations can provide a reality check.

Cost estimation↗
NASA NTRSDate not supplied

Generation of Continental Scale Percent Tree Cover Product Using Deep-learning and Multi-scale Remote Sensing Data

Spatially explicit percent tree cover (TC) estimation is critical for mapping forest aboveground biomass and its dynamics. While various TC products have been developed, there has not been a generalized framework that can be applied to diverse terrestrial ecosystems due to underlain extreme complexities. Deep learning algorithms can learn a spatial pattern and radiometric characteristics of tree canopy as a robust approximation of physical or empirical models, and thus have emerged as promising and efficient tools for large-scale TC mapping. In this study, we synergistically use very high-resolution aerial imageries (National Agriculture Imagery Program, NAIP) and medium resolution Landsat data to map continental-scale TC (CONUS and Mexico) through a hierarchical deep learning approach (Convolutional Neural Network), i.e., NAIP TC generated from a NAIP model is utilized to train a Landsat model. The produced TC product (hereafter, NEX-TC) is able to capture the spatial pattern of TC distribution and its changes driven by natural disturbance and human land management. We further explore and analyze the reliability and potential uncertainty of the NEX-TC by comparing it to lidar- (lidar-TC), National Land Cover Database (NLCD-TC), and MODIS Vegetation Continuous Field (MODIS-TC). This evaluation practice reveals that TC products based on passive optical sensors tend to underestimate TC across all land cover types while Landsat-based TCs (i.e., NEX-TC & NLCD-TC) perform better than the coarser MODIS TC estimate. Our results show that the NEX-TC is generally comparable to NLCD-TC but it particularly outperforms NLCD-TC and MODIS-TC over the dense forests where lidar-TC indicates >80% TC. These results indicate that our hierarchical deep learning approach and TC product will be effective and useful for characterizing large-scale tree cover and possibly associated carbon dynamics.

Landsat↗
DOE OSTI2024

Control and Optimization of Energy Storage System in Power Distribution System

The widespread adoption of electric vehicles (EVs) and transportation electrification is encumbered by two chief barriers: i) the limited driving range of EVs in the market today and ii) inadequate fast-charging infrastructure for long-distance trips. Extreme fast charging (XFC) technology can recharge EVs in less than 10 minutes for 200 miles range. Firstly, a novel robust optimization-based mixed integer linear programming model is proposed to size a battery energy storage system (BESS) and PV system in an XFCS. In this part, it is assumed that the sizing and location of the XFCS are known. Secondly, the aforesaid assumption is relaxed, and a strategic multi-period coordinated planning model is proposed to optimally site and size BESS-assisted charging stations in a highway transportation network and PV systems in a power distribution network by considering the coupling between both networks. Optimal operation and control of BESS-assisted EV charging stations are vital to alleviate the adverse impact of extreme fast charging of EVs on the host power network. A joint solution is proposed to mitigate the steady state and transient impact of extremefast charging of EVs and ensure grid-friendly integration of XFCSs with the host grid. Lastly, to make the operation of the XFCS cost-effective, a multi-layered energy management framework is proposed for the XFCS by considering forecast uncertainties, monthly demand charges reduction, and BESS degradation.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS2016

An Integrated Gate Turnaround Management Concept Leveraging Big Data Analytics for NAS Performance Improvements

"Gate Turnaround" plays a key role in the National Air Space (NAS) gate-to-gate performance by receiving aircraft when they reach their destination airport, and delivering aircraft into the NAS upon departing from the gate and subsequent takeoff. The time spent at the gate in meeting the planned departure time is influenced by many factors and often with considerable uncertainties. Uncertainties such as weather, early or late arrivals, disembarking and boarding passengers, unloading/reloading cargo, aircraft logistics/maintenance services and ground handling, traffic in ramp and movement areas for taxi-in and taxi-out, and departure queue management for takeoff are likely encountered on the daily basis. The Integrated Gate Turnaround Management (IGTM) concept is leveraging relevant historical data to support optimization of the gate operations, which include arrival, at the gate, departure based on constraints (e.g., available gates at the arrival, ground crew and equipment for the gate turnaround, and over capacity demand upon departure), and collaborative decision-making. The IGTM concept provides effective information services and decision tools to the stakeholders, such as airline dispatchers, gate agents, airport operators, ramp controllers, and air traffic control (ATC) traffic managers and ground controllers to mitigate uncertainties arising from both nominal and off-nominal airport gate operations. IGTM will provide NAS stakeholders customized decision making tools through a User Interface (UI) by leveraging historical data (Big Data), net-enabled Air Traffic Management (ATM) live data, and analytics according to dependencies among NAS parameters for the stakeholders to manage and optimize the NAS performance in the gate turnaround domain. The application will give stakeholders predictable results based on the past and current NAS performance according to selected decision trees through the UI. The predictable results are generated based on analysis of the unique airport attributes (e.g., runway, taxiway, terminal, and gate configurations and tenants), and combined statistics from past data and live data based on a specific set of ATM concept-of-operations (ConOps) and operational parameters via systems analysis using an analytic network learning model. The IGTM tool will then bound the uncertainties that arise from nominal and off-nominal operational conditions with direct assessment of the gate turnaround status and the impact of a certain operational decision on the NAS performance, and provide a set of recommended actions to optimize the NAS performance by allowing stakeholders to take mitigation actions to reduce uncertainty and time deviation of planned operational events. An IGTM prototype was developed at NASA Ames Simulation Laboratories (SimLabs) to demonstrate the benefits and applicability of the concept. A data network, using the System Wide Information Management (SWIM)-like messaging application using the ActiveMQ message service, was connected to the simulated data warehouse, scheduled flight plans, a fast-time airport simulator, and a graphic UI. A fast-time simulation was integrated with the data warehouse or Big Data/Analytics (BAI), scheduled flight plans from Aeronautical Operational Control AOC, IGTM Controller, and a UI via a SWIM-like data messaging network using the ActiveMQ message service, illustrated in Figure 1, to demonstrate selected use-cases showing the benefits of the IGTM concept on the NAS performance.

Efficent ATM systems↗
NASA NTRS2016

State of the Carbon Cycle - Consequences of Rising Atmospheric CO2

The rise of atmospheric CO2, largely attributable to human activity through fossil fuel emissions and land-use change, has been dampened by carbon uptake by the ocean and terrestrial biosphere. We outline the consequences of this carbon uptake as direct and indirect effects on terrestrial and oceanic systems and processes for different regions of North America and the globe. We assess the capacity of these systems to continue to act as carbon sinks. Rising CO2 has decreased seawater pH; this process of ocean acidification has impacted some marine species and altered fundamental ecosystem processes with further effects likely. In terrestrial ecosystems, increased atmospheric CO2 causes enhanced photosynthesis, net primary production, and increased water-use efficiency. Rising CO2 may change vegetation composition and carbon storage, and widespread increases in water use efficiency likely influence terrestrial hydrology and biogeochemical cycling. Consequences for human populations include changes to ecosystem services including cultural activities surrounding land use, agricultural or harvesting practices. Commercial fish stocks have been impacted and crop production yields have been changed as a result of rising CO2. Ocean and terrestrial effects are contingent on, and feedback to, global climate change. Warming and modified precipitation regimes impact a variety of ecosystem processes, and the combination of climate change and rising CO2 contributes considerable uncertainty to forecasting carbon sink capacity in the ocean and on land. Disturbance regime (fire and insects) are modified with increased temperatures. Fire frequency and intensity increase, and insect lifecycles are disrupted as temperatures move out of historical norms. Changes in disturbance patterns modulate the effects of rising CO2 depending on ecosystem type, disturbance frequency, and magnitude of events. We discuss management strategies designed to limit the rise of atmospheric CO2 and reduce uncertainty in forecasts of decadal and centennial feedbacks of rising atmospheric CO2 on carbon storage.

Carbon Cycle↗
DOE OSTI2024

International Collaboration Activities in Geologic Disposal Research (FY24 Progress Report)

This report describes the FY24 status of international collaboration regarding geologic disposal research in the Office of Spent Fuel and Waste Science and Technology (SFWST) in the Department of Energy’s (DOE) Office of Nuclear Energy (NE). The mission of SFWST is to provide confidence in the safe long-term management of the nation’s spent nuclear fuel and high-level radioactive waste by reducing uncertainty and advancing technology for extended storage, transportation, and geologic disposal.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
NASA NTRS2014

Integrating Land Cover Modeling and Adaptive Management to Conserve Endangered Species and Reduce Catastrophic Fire Risk

Land cover modeling is used to inform land management, but most often via a two-step process where science informs how management alternatives can influence resources and then decision makers can use this to make decisions. A more efficient process is to directly integrate science and decision making, where science allows us to learn to better accomplish management objectives and is developed to address specific decisions. Co-development of management and science is especially productive when decisions are complicated by multiple objectives and impeded by uncertainty. Multiple objectives can be met by specification of tradeoffs, and relevant uncertainty can be addressed through targeted science (i.e., models and monitoring). We describe how to integrate habitat and fuels monitoring with decision making focused on dual objectives of managing for endangered species and minimizing catastrophic fire risk. Under certain conditions, both objectives might be achieved by a similar management policy, but habitat trajectories suggest tradeoffs. Knowledge about system responses to actions can be informed by applying competing management actions to different land units in the same system state and by ideas about fire behavior. Monitoring and management integration is important to optimize state-specific management decisions and increase knowledge about system responses. We believe this approach has broad utility for and cover modeling programs intended to inform decision making.

adaptive management↗
NASA NTRS2007

The Roles of Verification, Validation and Uncertainty Quantification in the NASA Standard for Models and Simulations

The National Aeronautics and Space Administration (NASA) recently issued an interim version of the Standard for Models and Simulations (M&S Standard) [1]. The action to develop the M&S Standard was identified in an internal assessment [2] of agency-wide changes needed in the wake of the Columbia Accident [3]. The primary goal of this standard is to ensure that the credibility of M&S results is properly conveyed to those making decisions affecting human safety or mission success criteria. The secondary goal is to assure that the credibility of the results from models and simulations meets the project requirements (for credibility). This presentation explains the motivation and key aspects of the M&S Standard, with a special focus on the requirements for verification, validation and uncertainty quantification. Some pilot applications of this standard to computational fluid dynamics applications will be provided as illustrations. The authors of this paper are the members of the team that developed the initial three drafts of the standard, the last of which benefited from extensive comments from most of the NASA Centers. The current version (number 4) incorporates modifications made by a team representing 9 of the 10 NASA Centers. A permanent version of the M&S Standard is expected by December 2007. The scope of the M&S Standard is confined to those uses of M&S that support program and project decisions that may affect human safety or mission success criteria. Such decisions occur, in decreasing order of importance, in the operations, the test & evaluation, and the design & analysis phases. Requirements are placed on (1) program and project management, (2) models, (3) simulations and analyses, (4) verification, validation and uncertainty quantification (VV&UQ), (5) recommended practices, (6) training, (7) credibility assessment, and (8) reporting results to decision makers. A key component of (7) and (8) is the use of a Credibility Assessment Scale, some of the details of which were developed in consultation with William Oberkampf, David Peercy and Timothy Trocano of Sandia National Laboratories. The focus of most of the requirements, including those for VV&UQ, is on the documentation of what was done and the reporting, using the Credibility Assessment Scale, of the level of rigor that was followed. The aspects of one option for the Credibilty Assessment Scale are (1) code verification, (2) solution verification, (3) validation, (4) predictive capability, (5) technical review, (6) process control, and (7) operator and analyst qualification.

Zang, Thomas A.↗