Search NASA⌕ Search

SEARCH · Search NASA

Results for “Decision Making”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

A Simple Data-Centric Methodology for Producible Geothermal Well Determinations: Preprint

The Bureau of Land Management (BLM) has traditionally lacked a standardized methodology for determining if a newly drilled geothermal well is "producible," a designation essential for deciding whether a lease should be "held by production." This is a straightforward problem to solve in oil and gas: Demonstrate that a well is economically viable, meaning it produces sufficient oil or gas to exceed direct operating costs and lease-related expenses, such as rentals or minimum royalties. In geothermal, the problem is more complex: Geothermal wells are tightly coupled with the downstream infrastructure - specifically, the power plant, which is often not designed until well after a lease is deemed as "held by production." Although this designation is critical for advancing geothermal power plant development on BLM-managed lands, current geothermal well assessments often rely on ad hoc approaches that can be complex, operator-biased, and heavy in assumptions related to economic viability. To address this, we have developed two complementary methodologies: a minimum power requirement-based approach and a productivity index (PI)-based approach. These methods leverage key flow test data - pressure, temperature, flow rate, and specific enthalpy - to provide reliable and standardized producible well determinations. The minimum power requirement-based approach evaluates wells against specific power output thresholds informed by reservoir experts and the associated temperature requirements. The PI-based approach assesses well productivity using widely accepted reservoir engineering metrics, proposing a threshold of 2.5 kg/s/bar. Both methods are data-driven and grounded in empirical production data from operational geothermal wells, avoiding uncertain economic assumptions while maintaining decision-making accuracy. Wells falling below key performance thresholds (i.e., PI, specific power) are deemed non-producible. These methodologies aim to streamline BLM's decision-making process, reduce nontechnical barriers to geothermal energy adoption, and enable regulatory expansion into states lacking geothermal expertise. Preliminary results indicate clear trends and thresholds in production data that provide actionable insights for evaluating well producibility. Validation using well completion report (WCR) data is ongoing, with promising results demonstrating the potential for these standardized methodologies to impact geothermal development significantly.

15 GEOTHERMAL ENERGY↗

Yes, No, Maybe So: Human Factors Considerations for Fostering Calibrated Trust in Foundation Models Under Uncertainty

High-stakes analytical environments require analysts to evaluate evidence and generate conclusions to inform critical decisions often under conditions of uncertainty. Probabilistic decision-making based on incomplete or inaccurate information can reduce productivity, compromise national interests, and endanger public safety. Researchers are developing expert systems built on foundation models (FMs) to support analysts’ decision-making processes by enabling human-artificial intelligence (AI) teaming, in part through the quantification and expression of uncertainty information. As FMs continue to mature, it is imperative to correspondingly consider analysts’ needs for appropriately interpreting and using uncertainty information. However, prior research indicates that it remains unclear how analysts engage with FM-generated uncertainty information and the extent to which these interactions influence trust in, and reliance on, expert systems. We plan to review the state of the science and conduct an exploratory, qualitative study to (a) understand how properly communicated uncertainty can foster calibrated trust and appropriate reliance and (b) identify approaches for effectively conveying FM-generated uncertainty information during analytical workflows. We will administer semi-structured interviews with analysts from a specific high-stakes analytical environment to collect their current experiences with job-related uncertainty and their impressions when viewing FM-generated uncertainty information. During the interview protocol, participants will be presented with several different FM outputs and invited to discuss their thoughts and beliefs about the uncertainty information displayed. Participants may provide insights into how trust and reliance may be influenced by uncertainty. The results of this study will help us to better understand how analysts currently interpret and use uncertainty information. Our findings may inform human factors recommendations for effectively conveying uncertainty information to foster calibrated trust in, and appropriate reliance on, expert systems. Interaction designers and FM developers can use this knowledge to enhance human-AI teaming and ensure the responsible deployment of FM-based expert systems in analytical workflows.

97 MATHEMATICS AND COMPUTING↗

Data-Informed Synthetic Networks of Water Distribution Systems for Resilience Analysis in Puerto Rico

The increasing potential of infrastructure disruptions calls for high-quality infrastructure models to be used in resilience analysis and decision making. Unfortunately, many utilities and communities do not have access to accurate and detailed models due to a lack of data and resources. Furthermore, security restrictions on sharing infrastructure models present roadblocks to research, analysis, and decision making. Recent advances in the development of synthetic water distribution models provide a potential solution to this problem. There is an opportunity to improve these methods by leveraging incomplete pipe datasets to aid synthetic network generation. To address this gap, we developed a methodology for synthetic network generation that incorporates partial pipe data using a modification of the minimum cost flow algorithm for network generation and pipe sizing. This methodology demonstrates how partial pipe data can be leveraged to improve site-specific synthetic network generation. For the study area of Mayagüez, Puerto Rico, a synthetic model generated using 50% of real pipe data matches the pressure of the validation system with an average error of 23.5 m of head, which improves upon the average error of 31.6 m of head produced by a synthetic model generated using no data of the real pipes. Additionally, synthetic networks are shown to replicate the pressure response under a disruption scenario of the validation network, suggesting potential use in resilience analysis.

resilience analysis↗

Verifying LLM generative agents reflect human behavior in contested information environments to effectively simulate disinformation campaigns (Proteus)

Disinformation poses a significant and evolving threat to today’s online environment. Individuals encounter challenges in detecting disinformation, subsequently influencing their behavior and decision-making processes. Our research examines the potential use of large language model (LLM) generative agents (LGAs) to replicate human behavior to better understand how disinformation is spread in online environments. Using human subjects research, we first investigate how personality traits, individual differences, and demographic factors relate to decision-making in simulated online disinformation environments. Then, we examine whether LGAs can effectively replicate human responses in the same simulated online environments when assigned personality traits, demographic characteristics and behavioral attributes. Our findings indicate that LGAs can align with human decisions in these scenarios; however, alignment is contingent upon scenario context, persona settings and LLM selection. Results provide valuable insights for methodology refinement in future research and in utilizing LGAs to model complex national security challenges such as disinformation campaigns.

97 MATHEMATICS AND COMPUTING↗

A model for selecting the best sustainable airport technology alternatives

Air transport is a continually expanding industry, a fact that has become even more evident with the recovery of the aviation industry post-COVID-19. This expansion amplified energy consumption at airports, which was already significantly high. Airport decision-makers are increasingly focusing on improving sustainability and addressing social, economic, and environmental criteria across airports worldwide. In this article, we propose a decision-making model for identifying a sustainable airport technology solution that minimizes the energy consumption of airport lighting while considering economic, emission, and life-cycle criteria. The proposed model combines data envelopment analysis and multi-criteria decision making techniques. We applied the model to the Dallas/Fort Worth International Airport (DFW) as a case study, considering eight lighting technology solutions, each with five luminous flux alternatives. Our model identified the best lighting technology solution for DFW outdoor and indoor environments based on the following criteria: luminous flux, capital costs, life-cycle costs, energy consumption, and emissions (CO2e, NOx, SO2, and PM2.5). The designed model is customizable to any airport and is applicable to a wide range of airport lighting technologies. In our analysis, Light-Emitting Diode lighting emerged as the most sustainable technology option. It ranked first in most cases due to its balance of high efficacy, long lifespan, low life-cycle cost, low capital cost, and lower emissions across all pollutants.

Tchivwila, Moise B↗

JUSTIFI: Software for Improving Performance Objectives via Energy Efficiency

With growing energy supply concerns and rising costs, energy efficiency is a critical component of industrial energy resilience and competitiveness by directly reducing energy operating costs. Energy efficiency projects in manufacturing also yield valuable benefits to other key metrics, such as improved quality, reduced maintenance costs, improved safety, decreased pollution, and enhanced productivity. However, it is difficult to receive approval for energy efficiency projects, so implementation rates are low, even when meeting capital project payback period criteria. The inclusion and quantification of non-energy benefits (NEBs) in the decision-making process for energy efficiency projects can improve the overall financial payback period while demonstrating a positive impact on the firm's key performance metrics and business strategy. Despite their significant financial and strategic value, NEBs are rarely factored into decision-making due to lack of tools to effectively identify and quantify them. Therefore, a comprehensive and integrative approach is needed for the rapidly evolving energy landscape. To address these challenges, through funding from U.S. Department of Energy, our new assessment methodology integrates common continuous improvement six sigma concepts, such as the DMAIC process, and a protocol of guiding questions, into energy efficiency assessments to identify NEBs. We have also developed open-source software, JUSTIFI, to guide users through this process, data collection, and quantification. It is designed to be used concurrently with DOE energy system analysis software suite, MEASUR. Our methodology and tools inform energy assessors, firm engineering, decision makers, and workforce seeking to increase energy resilience and to maximize benefits aligned with performance metrics.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

JUSTIFI: Software for Improving Performance Objectives via Energy Efficiency

With growing energy supply concerns and rising costs, energy efficiency is a critical component of industrial energy resilience and competitiveness by directly reducing energy operating costs. Energy efficiency projects in manufacturing also yield valuable benefits to other key metrics, such as improved quality, reduced maintenance costs, improved safety, decreased pollution, and enhanced productivity. However, it is difficult to receive approval for energy efficiency projects, so implementation rates are low, even when meeting capital project payback period criteria. The inclusion and quantification of non-energy benefits (NEBs) in the decision-making process for energy efficiency projects can improve the overall financial payback period while demonstrating a positive impact on the firm's key performance metrics and business strategy. Despite their significant financial and strategic value, NEBs are rarely factored into decision-making due to lack of tools to effectively identify and quantify them. Therefore, a comprehensive and integrative approach is needed for the rapidly evolving energy landscape. To address these challenges, through funding from U.S. Department of Energy, our new assessment methodology integrates common continuous improvement six sigma concepts, such as the DMAIC process, and a protocol of guiding questions, into energy efficiency assessments to identify NEBs. We have also developed open-source software, JUSTIFI, to guide users through this process, data collection, and quantification. It is designed to be used concurrently with DOE energy system analysis software suite, MEASUR. Our methodology and tools inform energy assessors, firm engineering, decision makers, and workforce seeking to increase energy resilience and to maximize benefits aligned with performance metrics.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Analysis of Rig Parameter Data Using Drilling Process Modeling Constraints, Volume 5: Utah FORGE Well 16B(78)-32

Drill rig parameter measurements are routinely used during deep well construction to monitor and guide drilling conditions for improved performance and reduced costs. While insightful into the drilling process, these measurements are of reduced value without a standard to aid in data evaluation and decision making. In the main body of this work (Volume 1), a method is demonstrated whereby rock reduction model constraints are used to interpret drilling response parameters; the method could be applied in real-time to improve decision-making in the field and to further discern technology performance during post-drilling evaluations. Drilling parameters are evaluated using laboratory-validated rock reduction models for predicting the phenomenological response of drag bits (Detournay and Defourny, 1992) in computational algorithms. The method presented has applicability to development of advanced analytics on future geothermal wells using real-time electronic data recording for improved performance and reduced drilling costs. A drilling cost model is also used to show the tradeoff between rate of penetration and bit life and the influence on interval drilling costs. Details of the bit specifications and performance are cataloged in an independent volume, documented under separate cover, for each of the four wells, and include Volume 2: Utah FORGE 16A(78)-32; Volume 3: Utah FORGE 56-32; Volume 4: Utah FORGE 78B-32 and Volume 5: Utah FORGE 16B(78)-32.

15 GEOTHERMAL ENERGY↗

Analysis of Rig Parameter Data Using Drilling Process Modeling Constraints, Volume 4: Utah FORGE Well 78B-32

Drill rig parameter measurements are routinely used during deep well construction to monitor and guide drilling conditions for improved performance and reduced costs. While insightful into the drilling process, these measurements are of reduced value without a standard to aid in data evaluation and decision making. In the main body of this work (Volume 1), a method is demonstrated whereby rock reduction model constraints are used to interpret drilling response parameters; the method could be applied in real-time to improve decision-making in the field and to further discern technology performance during post-drilling evaluations. Drilling parameters are evaluated using laboratory-validated rock reduction models for predicting the phenomenological response of drag bits (Detournay and Defourny, 1992) in computational algorithms. The method presented has applicability to development of advanced analytics on future geothermal wells using real-time electronic data recording for improved performance and reduced drilling costs. A drilling cost model is also used to show the tradeoff between rate of penetration and bit life and the influence on interval drilling costs. Details of the bit specifications and performance are cataloged in an independent volume, documented under separate cover, for each of the four wells, and include Volume 2: Utah FORGE 16A(78)-32; Volume 3: Utah FORGE 56-32; Volume 4: Utah FORGE 78B-32 and Volume 5: Utah FORGE 16B(78)-32.

15 GEOTHERMAL ENERGY↗

Analysis of Rig Parameter Data Using Drilling Process Modeling Constraints, Volume 3: Utah FORGE Well 56-32

Drill rig parameter measurements are routinely used during deep well construction to monitor and guide drilling conditions for improved performance and reduced costs. While insightful into the drilling process, these measurements are of reduced value without a standard to aid in data evaluation and decision making. In the main body of this work (Volume 1), a method is demonstrated whereby rock reduction model constraints are used to interpret drilling response parameters; the method could be applied in real-time to improve decision-making in the field and to further discern technology performance during post-drilling evaluations. Drilling parameters are evaluated using laboratory-validated rock reduction models for predicting the phenomenological response of drag bits (Detournay and Defourny, 1992) in computational algorithms. The method presented has applicability to development of advanced analytics on future geothermal wells using real-time electronic data recording for improved performance and reduced drilling costs. A drilling cost model is also used to show the tradeoff between rate of penetration and bit life and the influence on interval drilling costs. Details of the bit specifications and performance are cataloged in an independent volume, documented under separate cover, for each of the four wells, and include Volume 2: Utah FORGE 16A(78)-32; Volume 3: Utah FORGE 56-32; Volume 4: Utah FORGE 78B-32 and Volume 5: Utah FORGE 16B(78)-32.

15 GEOTHERMAL ENERGY↗

Analysis of Rig Parameter Data Using Drilling Process Modeling Constraints, Volume 1: Summary of Utah FORGE Wells 16A(78)-32, 56-32, 78B-32 and 16B(78)-32

Drill rig parameter measurements are routinely used during deep well construction to monitor and guide drilling conditions for improved performance and reduced costs. While insightful into the drilling process, these measurements are of reduced value without a standard to aid in data evaluation and decision making. In the main body of this work (Volume 1), a method is demonstrated whereby rock reduction model constraints are used to interpret drilling response parameters; the method could be applied in real-time to improve decision-making in the field and to further discern technology performance during post-drilling evaluations. Drilling parameters are evaluated using laboratory-validated rock reduction models for predicting the phenomenological response of drag bits (Detournay and Defourny, 1992) in computational algorithms. The method presented has applicability to development of advanced analytics on future geothermal wells using real-time electronic data recording for improved performance and reduced drilling costs. A drilling cost model is also used to show the tradeoff between rate of penetration and bit life and the influence on interval drilling costs. Details of the bit specifications and performance are cataloged in an independent volume, documented under separate cover, for each of the four wells, and include Volume 2: Utah FORGE 16A(78)-32; Volume 3: Utah FORGE 56-32; Volume 4: Utah FORGE 78B-32 and Volume 5: Utah FORGE 16B(78)-32.

15 GEOTHERMAL ENERGY↗

Equity-Centered Engagement Through Climate Resilience Policy in Massachusetts

Resilience efforts tend to reinforce injustices. Communities who experience disproportionate climate impacts are often excluded from resilience planning, and those plans do not typically address root causes of social vulnerability. More transformational approaches to resilience would shift decision-making power into communities and affect how people survive and thrive in a climate changing world. The Massachusetts Municipal Vulnerability Preparedness (MVP) 2.0 program is an attempt to change the status quo in resilience planning by bringing new voices into decision-making power, recognizing their labor, addressing root causes of vulnerability, and investing in social infrastructure. It aims to build capacity for equity-focused community engagement within teams of municipal staff and community liaisons, and ultimately build community cohesion. My mixed methods research investigates implementation of this state grant program in several Massachusetts towns. I am using document review, participant observation, and interviews to understand the MVP 2.0 process as written, how different municipalities navigate it, and how individuals make sense of their experiences in it. I seek to understand how those experiences explain relationships between engagement approaches, mediating factors, and process outcomes. I am interested in the conditions that allow for community empowerment and how a model like MVP 2.0 can shift conditions that hold systems in place. In a practical sense, my empirical results will help municipalities reflect on their work during MVP 2.0 and plan for future community engagement. They may be informative for designing future iterations of the MVP program and for other municipalities, offices of community engagement, and practitioners. The findings will also contribute to the participation, resilience, and climate justice literatures, by adding perspectives on equity-centered resilience and community engagement approaches in smaller towns and rural settings.

Callaham, Shannon↗

Ten questions concerning Large Language Models (LLMs) for building applications

Large Language Models (LLMs) are emerging as powerful AI tools capable of transforming how building information is collected, processed, analyzed, and applied across diverse research areas. Their capabilities can help building operators, facility managers and other stakeholders such as designers, architects and engineers by providing actionable insights for decision-making across planning, construction, operations, and maintenance of buildings and facilities. This paper explores ten key questions concerning the role of LLMs in shaping sustainable, intelligent, and human-centric buildings. From fundamental definitions to advanced applications, we examine how LLMs facilitate decision-making across the life cycle of buildings and energy systems. LLMs can enhance life cycle assessments (LCA), building energy simulations, and real-time data integration, empowering more efficient and adaptive human-AI environments. They can also contribute to streamlining regulatory compliance, improving post-occupancy evaluations, and fostering more inclusive and participatory design processes. Additionally, this paper addresses the ethical challenges posed by LLMs, such as bias, data privacy, and environmental impacts, and explores their potentials in advancing intelligent digital twins (DT) for ongoing building operations and maintenance. Built upon our applied research using LLMs and the review of tools, datasets, and research gaps, we provide a forward-looking perspective on how LLMs can drive innovation, collaboration, and productivity in the built environment while supporting ethical and effective implementation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Uncertainty Visualization Challenges in Decision Systems with Ensemble Data & Surrogate Models: Preprint

Uncertainty visualization is a key component in translating important insights from ensemble data into actionable decision-making by visually conveying various aspects of uncertainty within a system. With the recent advent of fast surrogate models for computationally expensive simulations, users can interact with more aspects of data spaces than ever before. However, the integration of ensemble data with surrogate models in a decision-making tool brings up new challenges for uncertainty visualization, namely how to reconcile and communicate the new and different types of uncertainties brought in by surrogates and how to utilize these new data estimates in actionable ways. In this work, we examine these issues as they relate to high-dimensional data visualization, the integration of discrete datasets and the continuous representations of those datasets, and the unique difficulties associated with systems that allow users to iterate between input and output spaces. We assess the role of uncertainty visualization in facilitating intuitive and actionable interaction with ensemble data and surrogate models, and highlight key challenges in this new frontier of computational simulation.

ensemble visualization↗

Organizational Resilience in the Context of Information Quality: An Agent-Based Simulation of Structural and Cognitive Influences

This study examines how organizational structure and stress levels affect decision-making with poor quality information. Using an agent-based model, it finds loosely structured organizations are timely but less effective at filtering bad information, while tightly structured ones are slower but better at filtering. The research highlights a trade-off between timeliness and robustness and suggests an optimal stress level for decision-making efficacy.

99 GENERAL AND MISCELLANEOUS↗

Uncertainty Visualization Challenges in Decision Systems with Ensemble Data & Surrogate Models

Uncertainty visualization is a key component in translating important insights from ensemble simulation data into actionable decision-making by visually conveying various aspects of uncertainty within a system. With the recent advent of fast surrogate models trained on ensemble data, we can substitute computationally expensive simulations, which allows users to interact with more aspects of data spaces than ever before. However, the use of ensemble data with surrogate models in a decision-making tool brings up new challenges for uncertainty visualization, namely how to reconcile and communicate the new and different types of uncertainties brought in by surrogates and how to utilize these new data estimates in actionable ways. In this work, we examine these issues as they relate to high-dimensional data visualization, the integration of discrete datasets and the continuous representations of those datasets, and the unique difficulties associated with systems that allow users to iterate between input and output spaces. We assess the role of uncertainty visualization in facilitating intuitive and actionable interaction with ensemble data and surrogate models, and highlight key challenges in this new frontier of computational simulation.

ensemble data↗

MSD CoP Webinar: Accounting for distributive justice in model-based decision support

Context: This webinar was hosted by the MultiSector Dynamics Community of Practice (MSD CoP; https://multisectordynamics.org). Abstract: Model-based analyses play an ever-increasing role in informing policy and decision-making. However, many large-scale societal challenges unavoidably involve questions about the fair distribution of positive and negative consequences. How are the costs of the energy transition distributed over households and businesses? How are flood risks redistributed under different flood risk management plans? How are the impacts of climate change and climate mitigation distributed over different parts of the world?These kinds of questions play an important role when deliberating public policy, and the lack, in many cases, of clear answers becomes an obstacle to decision-making. At recent COPs, for example, wicked questions about loss and damages and the phase-out versus phase-down of coal became obstacles to global climate action, illustrating the misalignment of the direction of scientific research and decision-makers' information needs. In this talk, I'll explore advances that are being made that enable analysts to start providing grounded model-based answers to questions of distributive justice, as well as argue that analysts should embrace and explicate the normative nature of their work instead of hiding behind the purported neutrality of science. Presenters: Dr. Jan Kwakkel (Delft University of Technology) Moderator(s): Rebecca Saari (MSD CoP Working Group Co-Chair; Univ. of Waterloo), Matt Sparks (Univ. of Waterloo); Sarah Fletcher (MSD CoP Working Group Co-Chair; Stanford University), Juan Moreno-Cruz (Univ. of Waterloo), Patrick Reed (MSD CoP Facilitation Team Member, Moderator and Organizer) This webinar was held on: November 13, 2024 from 1 PM - 2:15 PM ET

Kwakkel, Jan H.↗

Robust Explanations using Diverse Adversarially Trained Ensembles, Multi-Modal Contrastive Learning, and Attribution-based Confidence Metrics

The primary objective of this project is to strengthen the trustworthiness of AI systems by designing algorithms that make their internal decision-making processes more understandable to human users. This involves creating clear, interpretable explanations for AI decisions and developing metrics to assess these explanations' validity and reliability. Significant progress has been achieved through (i) developing symbolic explanations, (ii) generating meaningful interpretive insights, (iii) establishing accuracy and confidence metrics, and (iv) devising methods to evaluate the knowledge boundaries of AI models. To date, the research findings have been shared in peer-reviewed publications, with accompanying scientific and technical information (STI) detailed below.

97 MATHEMATICS AND COMPUTING↗