Search NASA⌕ Search

SEARCH · Search NASA

Results for “Uncertainty Management”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Sierra/SD – Verification Test Manual – 5.22

Verification and validation (V&V) of scientific computing programs are important at Sandia National Labs due to the expanding role of computational simulation in managing the United States nuclear stockpile. The complexities of structural response calculations used to analyze physical problems, the varieties of codes applied to the calculations, and the importance of accurate predictions when assessing field conditions demand confidence in the consistency and accuracy of computer codes. Confidence in the accuracy of the predictions arising from computer simulations must ultimately be gained through verification and validation. The Sierra salinas structural dynamics analysis code, Sierra/SD, is used at the DOE Laboratories, and in several DOD projects. The roles of Sierra/SD in the qualification of weapon systems and components for normal and hostile environments throughout the Stockpile-to-Target Sequence include to, • Redesign weapon components. • Certify weapon components and systems for target environments such as hypersonic vehicles. • Certify that components will survive the thermal mechanical shock loads associated with hostile environments. • Evaluate current stockpile issues, including issues associated with uncertainty quantification. • Address many other problems that are encountered in stockpile management. The Sierra/SD verification plan is described, and an evolving set of key verification tests are described in detail. The verification tests ensure the correctness of the mathematics and numerical algorithms associated with functionality describing engineering phenomena. Development is in accordance with a set of tailored Software Quality Engineering (SQE) practices. SQE practices guide the overall verification and validation effort.

97 MATHEMATICS AND COMPUTING↗

Quantitative 14 N NMR with Monte Carlo Uncertainty Analysis of Nitrate/Nitrite in Alkaline Nuclear Waste

While monitoring of nitrate and nitrite concentrations is important for managing corrosion in nuclear waste systems, existing analytical methods are hindered by turbidity, spectral interference, and delays from sample handling. Here, we demonstrate quantitative 14 N nuclear magnetic resonance (qNMR) spectroscopy as a direct, matrix-tolerant approach for nitrate and nitrite detection at natural abundance. Monte Carlo resampling was integrated into the workflow to quantify random error, establish precision–time tradeoffs, and separate noise-limited uncertainty from systematic bias arising from shimming, transmitter offset, or excitation pulse conditions. Quantification of nitrate and nitrite were validated in controlled alkaline matrix challenges and in 18-component Hanford-type simulants. These results establish 14 N qNMR as a practical, uncertainty-bounded tool for monitoring redox-active nitrogen species in chemically complex environments and provide a generalizable framework for quantitative analysis of quadrupolar nuclei.

Graham, Trent R. [Pacific Northwest National Labor↗

Roadmap for the future of extreme wildfire events

Background Extreme wildfire events (EWEs) represent a growing threat globally, posing substantial risks to ecosystems, human communities, and infrastructure. Despite increased recognition of their ecological, social, and economic significance, current definitions of EWEs vary widely, reflecting disciplinary biases and regional contexts. This article emerges from an interdisciplinary workshop convened to reassess and refine the definition of EWEs, examine their impacts across ecological and social dimensions, and identify critical knowledge gaps impeding our understanding of these infrequent but important events. Results Our synthesis highlights significant limitations with existing definitions, particularly their reliance on subjective thresholds and their emphasis on extreme fire behavior alone. EWEs encompass a spectrum of complex, multi-dimensional phenomena that extend beyond immediate biophysical characteristics to include cumulative social, economic, and ecological impacts. These impacts often manifest over extended timeframes and include hazardous environmental contamination, severe geomorphic disturbances, ecosystem transformations, and unintended consequences of post-fire management actions. Current wildfire modeling frameworks inadequately capture these compounding factors, particularly the interactions among social systems, ecological conditions, and extreme fire behavior. To overcome these issues, we advocate for an interdisciplinary and context-sensitive approach to defining and studying EWEs. This revised definition emphasizes wildfires exhibiting anomalies in fire behavior, ecological outcomes, or social impacts relative to historically observed baselines, accommodating variability across different geographic regions and ecological settings. Conclusions Adopting an interdisciplinary framework that integrates biophysical and social sciences will enhance the predictive capability of wildfire models and improve resilience planning and response strategies. Filling identified knowledge gaps—such as limited high-quality empirical fire behavior data and insufficient integration of social dynamics into modeling—will better prepare communities and ecosystems to cope with and adapt to EWEs. This inclusive approach underscores the necessity for collaboration across disciplines and sectors, essential to managing extreme wildfires in an era of increasing climatic and ecological uncertainty.

54 ENVIRONMENTAL SCIENCES↗

Analysis of Strategic Conflict Management Approaches as Applied to Simulated UAM Operations

This report presents the results of a comparison analysis of candidate Strategic Conflict Management (SCM) strategies as applied to Urban Air Mobility (UAM) operations. The SCM strategies investigated included: no SCM, resource scheduling (RS), resource flow rates (FR), area-based flow rates (AR), and conflict detection and resolution (CR). The study evaluated each strategy against the same 3 levels of flight demand in a representative airspace construct for the Dallas/Fort Worth region. The study also accounted for different levels of uncertainty in operational planning and equivalent levels of trajectory following error. In the analysis, we compared the SCM strategies’ effectiveness in reducing the need for the tactical conflict management layer to act and looked at the metrics of unmitigated losses-of-separation (LOS), flight delays imposed by strategic planning, and throughput of the overall airspace. The study results indicated that the CR strategy was the most effective at reducing LOS and percentage of flights with LOS, even in the presence of trajectory error when uncertainty is accounted for in planning. Thus, if the objective is to reduce the number of actions that the tactical conflict management layer will have to take, in terms of conflicts that may need to be resolved, CR is the strategy to use. The FR strategy was found to be the worst at reducing LOS and percentage of flights with LOS. Thus, it is not very effective at reducing the actions required by a tactical conflict management layer. In the airspace tested, the demand was high enough to produce unacceptable levels of flight delay and reductions of throughput when the SCM strategies were implemented. This was especially evident at the higher levels of trajectory uncertainty and error. The need to account for expected levels of uncertainty becomes more and more important as the demand level increases and as the level of trajectory error increases. This is because the likelihood of flights with LOS increases as the density of operations increases and as the level of trajectory error increases. Accounting for uncertainty in the SCM strategies improves the strategy effectiveness with respect to LOS but increases delays and reduces throughput. Thus, there is a tradeoff between scalability and allowable levels of uncertainty. That is, we can implement an air traffic management construct that allows high levels of uncertainty, but we can expect that same system to have limits on scalability that may be evident even at small demand levels, such as those used in this study. Therefore, the results in this study indicate that an air traffic system should attempt to implement mechanisms appropriate for reducing uncertainty where possible in order to increase the chances for scalability. And this increased level of predictability of operations needs to be balanced with mechanisms for ensuring flexibility when operational conditions and plans need to change, even though those types of changes should be the exception rather than the rule under normal conditions. The study also introduced a trade space that could serve as a mechanism for selecting the appropriate SCM strategy in a trade-off between uncertainty and error, mean flight delay, and the LOS metrics (which this study equates to the potential for tactical conflict management actions). The optimal solution for a given airspace, demand level, and other factors, could likely be a combination of SCM strategies, although this study only compared the use of a single SCM strategy at a time. The CR strategy appeared to have the best opportunity for scalability by limiting the number of potential tactical actions to nearly zero.

Strategic Conflict Management↗

Energy Management of the Multi-Mission Space Exploration Vehicle Using a Goal-Oriented Control System

Safe human exploration in space missions requires careful management of limited resources such as breathable air and stored electrical energy. Daily activities for astronauts must be carefully planned with respect to such resources, and usage must be monitored as activities proceed to ensure that they can be completed while maintaining safe resource margins. Such planning and monitoring can be complex because they depend on models of resource usage, the activities being planned, and uncertainties. This paper describes a system - and the technology behind it - for energy management of the NASA-Johnson Space Center's Multi-Mission Space Exploration Vehicles (SEV), that provides, in an onboard advisory mode, situational awareness to astronauts and real-time guidance to mission operators. This new capability was evaluated during this year's Desert RATS (Research and Technology Studies) planetary exploration analog test in Arizona. This software aided ground operators and crew members in modifying the day s activities based on the real-time execution of the plan and on energy data received from the rovers.

Braman, Julia M. B.↗

Multi-Agent Hierarchical Deep Reinforcement Learning for HVAC Control With Flexible DERs

As electricity consumption in commercial and residential buildings continues to rise, reducing energy costs presents an increasing challenge. Heating, ventilating, and air-conditioning (HVAC) systems, which typically account for 40%-50% of a building's energy use, are prime targets for energy savings. Intelligent control of HVAC temperature through the exploitation of HVAC load flexibility brings significant potential to reduce energy consumption and electricity expenses. The nonlinear models of HVAC systems challenge traditional control methods, while the uncertainty introduced by HVAC load flexibility complicates distributed energy resource (DER) management using conventional optimal dispatch techniques. In response to these challenges, we propose a hierarchical multi-agent deep reinforcement learning (DRL) approach. The lower-level agents focus on balancing comfort and energy conservation, while the upper-level DRL agents optimize the use of DERs to reduce peak demand based on the control outcomes of the HVAC by the lower-level agents. Here, in the upper-level agents, we incorporate a multi-agent structure based on ensemble learning, which acts based on historical and current data without relying on precise load forecasting to address the delayed rewarding issue in DRL. This allows for the effective reduction of energy costs. The proposed method is tested using a real-world microgrid comprising 413 buildings in Southern California, and the results demonstrate that our approach can significantly reduce overall electricity bills while ensuring the comfort of consumers and residents.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Atmospheric climate data: Problems and promises

The explosive growth in the quantity and diversity of weather and climate data, the growing handicap that the distinction between weather and climate in NOAA imposes on the efficient management and use of data is discussed. Also discussed is the uncertainty induced by the lack of clear commitment and consistent policies regarding federal roles and responsibilities in operating and maintaining the national weather and climate data system.

Source record↗

Estimating Model Prediction Error: Should You Treat Predictions as Fixed or Random?

Crop models are important tools for impact assessment of climate change, as well as for exploring management options under current climate. It is essential to evaluate the uncertainty associated with predictions of these models. We compare two criteria of prediction error; MSEP fixed, which evaluates mean squared error of prediction for a model with fixed structure, parameters and inputs, and MSEP uncertain( X), which evaluates mean squared error averaged over the distributions of model structure, inputs and parameters. Comparison of model outputs with data can be used to estimate the former. The latter has a squared bias term, which can be estimated using hindcasts, and a model variance term, which can be estimated from a simulation experiment. The separate contributions to MSEP uncertain (X) can be estimated using a random effects ANOVA. It is argued that MSEP uncertain (X) is the more informative uncertainty criterion, because it is specific to each prediction situation.

model structure uncertainty↗

Laboratory Evaluation of Dynamic Routing of Air Traffic in an En Route Arrival Metering Environment

Arrival air traffic operations in the presence of convective weather are subject to uncertainty in aircraft routing and subsequently in flight trajectory predictability. Current management of arrival operations in weather-impacted airspace results in significant flight delay and suspension of arrival metering operations. The Dynamic Routing for Arrivals in Weather (DRAW) concept provides flight route amendment advisories to Traffic Management Coordinators to mitigate the impacts of convective weather on arrival operations. DRAW provides both weather conflict and schedule information for proposed route amendments, allowing air traffic managers to simultaneously evaluate weather avoidance routing and potential schedule and delay impacts. Subject matter experts consisting of retired Traffic Management Coordinators and retired Sector Controllers with arrival metering experience participated in a simulation study of Fort Worth Air Route Traffic Control Center arrival operations. Data were collected for Traffic Management Coordinator and Sector Controller participants over three weeks of simulation activities in October, 2017. Traffic Management Coordinators reported acceptable workload levels, a positive impact on their ability to manage arrival traffic while using DRAW, and initiated weather mitigation reroutes earlier while using DRAW. Sector Controllers also reported acceptable workload levels while using DRAW.

Air Traffic Management↗

Laboratory Evaluation of Dynamic Routing of Air Traffic in an En Route Arrival Metering Environment

Arrival air traffic operations in the presence of convective weather are subject to uncertainty in aircraft routing and subsequently in flight trajectory predictability. Current management of arrival operations in weather-impacted airspace results in significant flight delay and suspension of arrival metering operations. The Dynamic Routing for Arrivals in Weather (DRAW) concept provides flight route amendment advisories to Traffic Management Coordinators to mitigate the impacts of convective weather on arrival operations. DRAW provides both weather conflict and schedule information for proposed route amendments, allowing air traffic managers to simultaneously evaluate weather avoidance routing and potential schedule and delay impacts. Subject matter experts consisting of retired Traffic Management Coordinators and retired Sector Controllers with arrival metering experience participated in a simulation study of Fort Worth Air Route Traffic Control Center arrival operations. Data were collected for Traffic Management Coordinator and Sector Controller participants over three weeks of simulation activities in October, 2017. Traffic Management Coordinators reported acceptable workload levels, a positive impact on their ability to manage arrival traffic while using DRAW, and initiated weather mitigation reroutes earlier while using DRAW. Sector Controllers also reported acceptable workload levels while using DRAW.

Air Traffic Management↗

The NASA Plankton, Aerosol, Cloud, Ocean Ecosystem (PACE) Mission: an Emerging Era of Global, Hyperspectral Earth System Remote Sensing

The Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) mission represents NASA's next investment in satellite ocean color and the study of Earth's ocean-atmosphere system, enabling new insights into oceanographic and atmospheric responses to Earth's changing climate. PACE objectives include extending systematic cloud, aerosol, and ocean biological and biogeochemical data records, making essential ocean color measurements to further understand marine carbon cycles and ecosystem responses to a changing climate, and improving knowledge of how aerosols influence ocean ecosystems and, conversely, how ocean ecosystems and photochemical processes affect the atmosphere. PACE objectives also encompass management of fisheries, large freshwater bodies, and water quality and reducing uncertainties in climate and radiative forcing models of the Earth system. PACE observations will also provide information on radiative properties of land surfaces and characterization of the vegetation and soils that dominate their reflectance. The primary PACE instrument - the Ocean Color Instrument (OCI) - is a hyperspectral imaging radiometer that spans the ultraviolet to shortwave infrared, with a ground sample distance of 1-kilometer at nadir. This includes continuous collection of spectra from 340 to 890 nanometers in 5-nanometer steps. The PACE payload is complemented by two multi-angle polarimeters with spectral ranges that span the visible to near-infrared region. Scheduled for launch in late 2022-to-early 2023, the PACE observatory will enable significant advances in the study of Earth's biogeochemistry, carbon cycle, clouds, hydrosols, and aerosols in the ocean-atmosphere system. We present a brief overview of the PACE mission, followed by a detailed discussion of the capabilities and design concept of OCI.

Passive Remote Sensing↗

The NASA Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) Mission: An Emerging Era of Global, Hyperspectral Earth System Remote Sensing

The Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) mission represents NASA’s next investment in satellite ocean color and the study of Earth’s ocean-atmosphere system, enabling new insights into oceanographic and atmospheric responses to Earth's changing climate. PACE objectives include extending systematic cloud, aerosol, ocean biological and biogeochemical data records, making essential ocean color measurements to further understand marine carbon cycles and ecosystem responses to a changing climate, as well as improving knowledge of how aerosols influence ocean ecosystems and, conversely, how ocean ecosystems and photochemical processes affect the atmosphere. PACE objectives also encompass management of fisheries, large freshwater bodies, and water quality and reducing uncertainties in climate and radiative forcing models of the Earth system. PACE observations will also provide information on radiative properties of land surfaces and characterization of the vegetation and soils that dominate their reflectance. The primary PACE instrument – the Ocean Color Instrument (OCI) – is a hyperspectral imaging radiometer that spans the ultraviolet to shortwave infrared, with a ground sample distance of 1-km at nadir. This includes continuous collection of spectra from 340 nm to 890 nm in 5 nm steps. The PACE payload is complemented by two multi-angle polarimeters with spectral ranges that span the visible to near-infrared region. Scheduled for launch in late 2022-to-early 2023, the PACE observatory will enable significant advances in the study of Earth’s biogeochemistry, carbon cycle, clouds, hydrosols, and aerosols in the ocean-atmosphere system. We present a brief overview of the PACE mission, followed by a discussion of the capabilities and design concept of OCI.

hyperspectral radiometer↗

Analysis of Multi-Flight Common Routes for Traffic Flow Management

This paper presents an approach for creating common weather avoidance reroutes for multiple flights and the associated benefits analysis, which is an extension of the single flight advisories generated using the Dynamic Weather Routes (DWR) concept. These multiple flight advisories are implemented in the National Airspace System (NAS) Constraint Evaluation and Notification Tool (NASCENT), a nation-wide simulation environment to generate time- and fuel-saving alternate routes for flights during severe weather events. These single flight advisories are clustered together in the same Center by considering parameters such as a common return capture fix. The clustering helps propose routes called, Multi-Flight Common Routes (MFCR), that avoid weather and other airspace constraints, and save time and fuel. It is expected that these routes would also provide lower workload for traffic managers and controllers since a common route is found for several flights, and presumably the route clearances would be easier and faster. This study was based on 30-days in 2014 and 2015 each, which had most delays attributed to convective weather. The results indicate that many opportunities exist where individual flight routes can be clustered to fly along a common route to save a significant amount of time and fuel, and potentially reducing the amount of coordination needed.

weather uncertainty↗

Advanced NASA Earth Science Mission Concept for Vegetation 3D Structure, Biomass and Disturbance

Carbon in forest canopies represents about 85% of the total carbon in the Earth's aboveground biomass (Olson et al., 1983). A major source of uncertainty in global carbon budgets derives from large errors in the current estimates of these carbon stocks (IPCC, 2001). The magnitudes and distributions of terrestrial carbon storage along with changes in sources and sinks for atmospheric C02 due to land use change remain the most significant uncertainties in Earth's carbon budget. These uncertainties severely limit accurate terrestrial carbon accounting; our ability to evaluate terrestrial carbon management schemes; and the veracity of atmospheric C02 projections in response to further fossil fuel combustion and other human activities. Measurements of vegetation three-dimensional (3D) structural characteristics over the Earth's land surface are needed to estimate biomass and carbon stocks and to quantify biomass recovery following disturbance. These measurements include vegetation height, the vertical profile of canopy elements (i.e., leaves, stems, branches), andlor the volume scattering of canopy elements. They are critical for reducing uncertainties in the global carbon budget. Disturbance by natural phenomena, such as fire or wind, as well as by human activities, such as forest harvest, and subsequent recovery, complicate the quantification of carbon storage and release. The resulting spatial and temporal heterogeneity of terrestrial biomass and carbon in vegetation make it very difficult to estimate terrestrial carbon stocks and quantify their dynamics. Vegetation height profiles and disturbance recovery patterns are also required to assess ecosystem health and characterize habitat. The three-dimensional structure of vegetation provides habitats for many species and is a control on biodiversity. Canopy height and structure influence habitat use and specialization, two fundamental processes that modify species richness and abundance across ecosystems. Accurate and consistent 3D measurements of forest structure at the landscape scale are needed for assessing impacts to animal habitats and biodiversity following disturbance.

Ranson, K. Jon↗

2009 Space Shuttle Probabilistic Risk Assessment Overview

Loss of a Space Shuttle during flight has severe consequences, including loss of a significant national asset; loss of national confidence and pride; and, most importantly, loss of human life. The Shuttle Probabilistic Risk Assessment (SPRA) is used to identify risk contributors and their significance; thus, assisting management in determining how to reduce risk. In 2006, an overview of the SPRA Iteration 2.1 was presented at PSAM 8 [1]. Like all successful PRAs, the SPRA is a living PRA and has undergone revisions since PSAM 8. The latest revision to the SPRA is Iteration 3. 1, and it will not be the last as the Shuttle program progresses and more is learned. This paper discusses the SPRA scope, overall methodology, and results, as well as provides risk insights. The scope, assumptions, uncertainties, and limitations of this assessment provide risk-informed perspective to aid management s decision-making process. In addition, this paper compares the Iteration 3.1 analysis and results to the Iteration 2.1 analysis and results presented at PSAM 8.

Hamlin, Teri L.↗

Dust Hazard Management in the Outer Solar System

Most robotic missions to the outer solar system must grapple with the hazards posed by the dusty rings of the gas giants. Early assessments of these hazards led simply to ring avoidance due to insufficient data and high uncertainties on the dust population present in such rings. Recent approaches, principal among them the Cassini dust hazard management strategy, provide useful results from detailed modeling of spacecraft vulnerabilities and dust hazard regions, which along with the range of mission trajectories are used to to assess the risks posed by each passage through a zone of potential hazard. This paper shows the general approach used to implement the analysis for Cassini, with recommendations for future outer planet missions.

mission hazards↗

Safety Risk Knowledge Elicitation in Support of Aeronautical R and D Portfolio Management: A Case Study

Aviation is a problem domain characterized by a high level of system complexity and uncertainty. Safety risk analysis in such a domain is especially challenging given the multitude of operations and diverse stakeholders. The Federal Aviation Administration (FAA) projects that by 2025 air traffic will increase by more than 50 percent with 1.1 billion passengers a year and more than 85,000 flights every 24 hours contributing to further delays and congestion in the sky (Circelli, 2011). This increased system complexity necessitates the application of structured safety risk analysis methods to understand and eliminate where possible, reduce, and/or mitigate risk factors. The use of expert judgments for probabilistic safety analysis in such a complex domain is necessary especially when evaluating the projected impact of future technologies, capabilities, and procedures for which current operational data may be scarce. Management of an R&D product portfolio in such a dynamic domain needs a systematic process to elicit these expert judgments, process modeling results, perform sensitivity analyses, and efficiently communicate the modeling results to decision makers. In this paper a case study focusing on the application of an R&D portfolio of aeronautical products intended to mitigate aircraft Loss of Control (LOC) accidents is presented. In particular, the knowledge elicitation process with three subject matter experts who contributed to the safety risk model is emphasized. The application and refinement of a verbal-numerical scale for conditional probability elicitation in a Bayesian Belief Network (BBN) is discussed. The preliminary findings from this initial step of a three-part elicitation are important to project management practitioners as they illustrate the vital contribution of systematic knowledge elicitation in complex domains.

Shih, Ann T.↗

Bayes_Opt-SWMM: A Gaussian process-based Bayesian optimization tool for real-time flood modeling with SWMM

Real-time flood model plays a pivotal role in averting urban flood damage, particularly when there is minimal lead time for preparatory measures. However, urban flood modeling in real-time often contends with inherent uncertainties arising from input data uncertainty and parameter ambiguities. Here this study introduces a real-time calibration (RTC) tool called Bayes_Opt-SWMM, specifically tailored for real-time urban flood modeling and uncertainty optimization. This tool leverages the Gaussian process-based Bayesian optimization algorithm and interfaces seamlessly with the Stormwater Management Model (SWMM). It integrates real-time model forcing data and flood monitoring collected through sensors and gauges which are strategically placed within critical locations of urban drainage systems. Our approach hinges on the Surrogate Model based Uncertainty Optimization (SMUO) concept, providing an avenue for enhancing real-time flood modeling. Bayes_Opt-SWMM runs the optimization process using a surrogate model called Gaussian Process emulator with two inference methods: (1) the Gaussian Process (GP) model and (2) Markov Chain Monte Carlo (MCMC) algorithm in GP model (GP_MCMC). Furthermore, three acquisition functions, namely Expected Improvement (EI), Maximum Probability of Improvement (MPI), and Lower Confidence Bound (LCB), facilitate optimal parameter fitting within the surrogate models. The efficiency of GP-based surrogate models in learning SWMM model parameters, leads to an improved uncertainty quantification and accelerated real-time flood modeling in urban areas. Overall, Bayes_Opt-SWMM emerges as a cost-effective and valuable tool for real-time flood modeling and monitoring, with significant potential for managing intelligent storm water systems in urban environments.

54 ENVIRONMENTAL SCIENCES↗