Search NASA⌕ Search

SEARCH · Search NASA

Results for “decision support system”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Objective Structured Clinical Evaluation (OSCE) of an Artificial Intelligence (AI) Clinical Decision Support System (CDSS) Tool

BACKGROUND Objective Structured Clinical Evaluations (OSCEs) have long been established as a robust methodology for summative assessment of clinical skills and decision-making during medical education. The recent integration of Artificial Intelligence (AI) into clinical decision-making processes has prompted the need for novel evaluation frameworks to assess the efficacy and reliability of AI clinical decision support system (CDSS) tools. This abstract outlines the process of quantitatively evaluating a novel CDSS (“Doc in a Box” Google 2024) trained on curated medical spaceflight data in the psychomotor domain as it interfaces with a human volunteer acting as the crew medical officer (CMO). PURPOSE The AI CDSS under review was developed as part of the Lunar Command and Control Interoperability (LuCCI) project, which is intended to address a gap in how Lunar Surface Systems (LSS) would interoperate across multiple programs, commercial partners, and international partners. The project objective is to define, prototype, integrate, and evaluate an interoperable lunar command, control, data, and software reference architecture to enable autonomy and informatics capability through common standards across LSS. A multi-modal AI-based CDSS compatible with Federated LSS will assist clinicians in diagnosing and managing complex medical conditions by providing evidence-based recommendations through predictive analytics. Given the critical role of decision-support as NASA continues to evolve its Earth-independent medical operations (EIMO), it is imperative to ensure that such AI tools perform reliably and align with clinical standards during progressive lunar and Martian exploration class missions. METHODS The OSCE framework, traditionally used for evaluating human clinicians, was adapted to assess the AI tool's decision-making capabilities in simulated clinical scenarios. In this adapted OSCE, the AI CDSS was tested across a series of structured clinical scenarios designed to mimic real-life spaceflight patient cases. These scenarios included a range of conditions and complexities, allowing for comprehensive assessment of the tool's performance. Key evaluation metrics included accuracy of diagnosis, timeliness of decision-making, and appropriate recommendations for therapies. The OSCE was scored by human physician evaluators who assessed the AI's recommendations in comparison with expert clinicians' medical decision making to ensure alignment with best practices and the standard of care. RESULTS Preliminary results indicate that the AI CDSS demonstrated high accuracy in diagnostic recommendations and decision support across various scenarios. However, certain limitations were noted, such as occasional discrepancies in handling complex or nuanced cases that required a more contextual understanding. Additionally, the tool scored higher on the diagnostic portion of the rubric, with lower scores in the therapeutic recommendations. These findings highlight the importance of continuous refinement and validation of AI tools through rigorous evaluation frameworks like the OSCE. The adaptation of OSCEs for AI tools presents several advantages, including a structured and reproducible approach to evaluation, the ability to test AI systems in diverse clinical scenarios, and the opportunity to benchmark AI performance against established clinical standards to permit charting of future progress as aerospace medicine evolves as a discipline. Remaining challenges include ensuring that these evaluations capture the full spectrum of clinical decision-making scenarios that will be confronted by CMOs during missions and adequately reflecting real-world variability of the austere spaceflight environment. CONCLUSION Employing OSCEs to evaluate AI clinical decision support tools offers a promising approach to validating their clinical utility and efficacy. This methodology not only provides insights into the tool's performance but also fosters ongoing improvement and alignment with standard of care practices. Future research should focus on refining these evaluation processes and addressing limitations to enhance the integration of AI tools in clinical spaceflight settings. REFERENCES Scott S, Hearns V, Barker MA. Testing Clinical Skills: A Look at the OSCE and USMLE Clinical Skills Exams. S D Med. 2019 Oct;72(10):451-453. Majumder MAA, Kumar A, Krishnamurthy K, Ojeh N, Adams OP, Sa B. An evaluative study of objective structured clinical examination (OSCE): students and examiners perspectives. Adv Med Educ Pract. 2019 Jun 5;10:387-397. Karam VY, Park YS, Tekian A, Youssef N. Evaluating the validity evidence of an OSCE: results from a new medical school. BMC Med Educ. 2018 Dec 20;18(1):313.

Ariana M Nelson↗

Expert system decision support for low-cost launch vehicle operations

Progress in assessing the feasibility, benefits, and risks associated with AI expert systems applied to low cost expendable launch vehicle systems is described. Part one identified potential application areas in vehicle operations and on-board functions, assessed measures of cost benefit, and identified key technologies to aid in the implementation of decision support systems in this environment. Part two of the program began the development of prototypes to demonstrate real-time vehicle checkout with controller and diagnostic/analysis intelligent systems and to gather true measures of cost savings vs. conventional software, verification and validation requirements, and maintainability improvement. The main objective of the expert advanced development projects was to provide a robust intelligent system for control/analysis that must be performed within a specified real-time window in order to meet the demands of the given application. The efforts to develop the two prototypes are described. Prime emphasis was on a controller expert system to show real-time performance in a cryogenic propellant loading application and safety validation implementation of this system experimentally, using commercial-off-the-shelf software tools and object oriented programming techniques. This smart ground support equipment prototype is based in C with imbedded expert system rules written in the CLIPS protocol. The relational database, ORACLE, provides non-real-time data support. The second demonstration develops the vehicle/ground intelligent automation concept, from phase one, to show cooperation between multiple expert systems. This automated test conductor (ATC) prototype utilizes a knowledge-bus approach for intelligent information processing by use of virtual sensors and blackboards to solve complex problems. It incorporates distributed processing of real-time data and object-oriented techniques for command, configuration control, and auto-code generation.

Szatkowski, G. P.↗

Creating a spatial multi-criteria decision support system for energy related integrated environmental impact assessment

By their spatially very distributed nature, profitability and impacts of renewable energy resources are highly correlated with the geographic locations of power plant deployments. A web-based Spatial Decision Support System (SDSS) based on a Multi-Criteria Decision Analysis (MCDA) approach has been implemented for identifying preferable locations for solar power plants based on user preferences. The designated areas found serve for the input scenario development for a subsequent integrated Environmental Impact Assessment. The capabilities of the SDSS service get showcased for Concentrated Solar Power (CSP) plants in the region of Andalusia, Spain. The resulting spatial patterns of possible power plant sites are an important input to the procedural chain of assessing impacts of renewable energies in an integrated effort. The applied methodology and the implemented SDSS are applicable for other renewable technologies as well. - Highlights: • The proposed tool facilitates well-founded CSP plant siting decisions. • Spatial MCDA methods are implemented in a WebGIS environment. • GIS-based SDSS can contribute to a modern integrated impact assessment workflow. • The conducted case study proves the suitability of the methodology.

14 SOLAR ENERGY↗

Artificial Intelligence (AI), Operations Research (OR), and Decision Support Systems (DSS): A conceptual framework

In recent years there has been increasing interest in applying the computer based problem solving techniques of Artificial Intelligence (AI), Operations Research (OR), and Decision Support Systems (DSS) to analyze extremely complex problems. A conceptual framework is developed for successfully integrating these three techniques. First, the fields of AI, OR, and DSS are defined and the relationships among the three fields are explored. Next, a comprehensive adaptive design methodology for AI and OR modeling within the context of a DSS is described. These observations are made: (1) the solution of extremely complex knowledge problems with ill-defined, changing requirements can benefit greatly from the use of the adaptive design process, (2) the field of DSS provides the focus on the decision making process essential for tailoring solutions to these complex problems, (3) the characteristics of AI, OR, and DSS tools appears to be converging rapidly, and (4) there is a growing need for an interdisciplinary AI/OR/DSS education.

Parnell, Gregory S.↗

SIAM-SERVIR: An Environmental Monitoring and Decision Support System for Mesoamerica

In 2002/2003 NASA, the World Bank and the United States Agency for International Development (USAID) joined with the Central American Commission for Environment and Development (CCAD) to develop an advanced decision support system for Mesoamerica (named SERVIR) as part of the Mesoamerican Environmental Information System (SIAM). Mesoamerica, composed of the seven Central American countries and the five southernmost states of Mexico, make up only a small fraction of the world's land surface. However, the region is home to seven to eight percent of the planet's biodiversity (14 biosphere reserves, 31 Ramsar sites, 8 world heritage sites, 589 protected areas) and 45 million people including more than 50 different ethnic groups. Today Mesoamerica's biological and cultural diversity is severely threatened by extensive deforestation, illegal logging, water pollution, and uncontrolled slash and burn agriculture. Additionally, Mesoamerica's distinct geology and geography result in disproportionate vulnerability to natural disasters such as earthquakes, hurricanes, drought, and volcanic eruptions. NASA Marshall Space Flight Center, together with the University of Alabama in Huntsville (UAH) and the SIAM-SERVIR partners are developing state-of-the-art decision support tools for environmental monitoring as well as disaster prevention and mitigation in Mesoamerica. These partners are contributing expertise in space-based observation with information management technologies and intimate knowledge of local ecosystems to create a system that is being used by scientists, educators, and policy makers to monitor and forecast ecological changes, respond to natural disasters and better understand both natural and human induced effects. In its first year of development and operation, the SIAM-SERVIR project has already yielded valuable information on Central American fires, weather conditions, and the first ever real-time data on red tides. This paper presents the progress thus far in the development of SIAM-SERVIR and the plans for the future.

Irwin, D. E.↗

SIAM-SERVIR: An Environmental Monitoring and Decision Support System for Mesoamerica

In 2002/2003 NASA, the World Bank and the United States Agency for International Development (USAID) joined with the Central American Commission for Environment and Development (CCAD) to develop an advanced decision support system for Mesoamerica (named SERVIR) as part of the Mesoamerican Environmental Information System (SIAM). Mesoamerica - composed of the seven Central American countries and the five southernmost states of Mexico - make up only a small fraction of the world s land surface. However, the region is home to seven to eight percent of the planet s biodiversity (14 biosphere reserves, 31 Ramsar sites, 8 world heritage sites, 589 protected areas) and 45 million people including more than 50 different ethnic groups. Today Mesoamerica s biological and cultural diversity is severely threatened by extensive deforestation, illegal logging, water pollution, and uncontrolled slash and burn agriculture. Additionally, Mesoamerica's distinct geology and geography result in disproportionate vulnerability to natural disasters such as earthquakes, hurricanes, drought, and volcanic eruptions. NASA Marshall Space Flight Center, together with the University of Alabama in Huntsville (UAH) and the SIAM-SERVIR partners are developing state-of-the-art decision support tools for environmental monitoring as well as disaster prevention and mitigation in Mesoamerica. These partners are contributing expertise in space-based observation with information management technologies and intimate knowledge of local ecosystems to create a system that is being used by scientists, educators, and policy makers to monitor and forecast ecological changes, respond to natural disasters and better understand both natural and human induced effects. In its first year of development and operation, the SIAM-SERVIR project has already yielded valuable information on Central American fires, weather conditions, and the first ever real-time data on red tides. This paper presents the progress thus far in the development of SIAM-SERVIR and the plans for the future.

Irwin, Daniel E.↗

Evaluation of a Potential for Enhancing the Decision Support System of the Interagency Modeling and Atmospheric Assessment Center with NASA Earth Science Research Results

NASA's objective for the Applied Sciences Program of the Science Mission Directorate is to expand and accelerate the realization of economic and societal benefits from Earth science, information, and technology. This objective is accomplished by using a systems approach to facilitate the incorporation of Earth observations and predictions into the decision-support tools used by partner organizations to provide essential services to society. The services include management of forest fires, coastal zones, agriculture, weather prediction, hazard mitigation, aviation safety, and homeland security. In this way, NASA's long-term research programs yield near-term, practical benefits to society. The Applied Sciences Program relies heavily on forging partnerships with other Federal agencies to accomplish its objectives. NASA chooses to partner with agencies that have existing connections with end-users, information infrastructure already in place, and decision support systems that can be enhanced by the Earth science information that NASA is uniquely poised to provide (NASA, 2004).

Blonski, Slawomir↗

A Cloud-Based Decision Support System Framework for Hydropower Biological Evaluation

Hydropower has become one of the most important energy sources: it accounts for more than 80% of the world’s renewable energy and about 16% of all the energy in the world. Significantly more hydropower capacity is planned to be developed. However, hydro-structures, including powered dams, may have adverse biological effects on fishes, especially on migrating fish. For instance, fish can be injured or even killed when they pass through turbines. This is why biological evaluations on hydro-structures are greatly needed to estimate fish injury and mortality rates. The Hydropower Biological Evaluation Toolset (HBET) is an integrated suite of science-based desktop tools designed to evaluate whether the hydraulic conditions of hydropower structures are fish friendly by analyzing collected data and providing estimated injury and mortality rates. Sensor Fish, a small, autonomous sensor package, is used by HBET to record data describing the conditions that live fish passing through a hydropower structure will face. In this paper, we incorporated cloud computing into HBET, and migrated it into a cloud-based decision support system framework for hydropower biological evaluation. This will make the evaluation systems more scalable and flexible; however, this also introduces a significant challenge: how to maintain the security while retaining scalability and flexibility. We discuss the technical methodologies and algorithms implemented in the proposed framework, and analyze the countermeasures implemented therein.

Decision Support System, Hydropower, Dam, Fish Inj↗

A web-based decision support system for collaborative mitigation of multiple water-related hazards using serious gaming

The paper presents a web-based application developed as a medium for executing a serious game to enhance multi-jurisdictional collaborative planning and decision making for mitigation of multiple hazards related to water (i.e., floods, soil erosions, water quality). The gaming application is integrated into the Iowa Watershed Decision Support System (IoWaDSS) designed to serve as a comprehensive multi-sectoral data repository along with the simulation results of process modeling to educate and inform communities on the status of their watersheds during extreme conditions. The interactive serious gaming application was devised to encourage public engagement, facilitate communication and positive relationship between watershed communities, and make the decision process more attractive and transparent for the stakeholders. The web environment offers easily-accessible, user-friendly interfaces that match the skills and knowledge level of a non-technical user. Developed with adaptive design and flexible architecture, the gaming application is generalizable and extendable to support hazard mitigation in other watersheds.

54 ENVIRONMENTAL SCIENCES↗

NASA Wrangler: Automated Cloud-Based Data Assembly in the RECOVER Wildfire Decision Support System

NASA Wrangler is a loosely-coupled, event driven, highly parallel data aggregation service designed to take advantageof the elastic resource capabilities of cloud computing. Wrangler automatically collects Earth observational data, climate model outputs, derived remote sensing data products, and historic biophysical data for pre-, active-, and post-wildfire decision making. It is a core service of the RECOVER decision support system, which is providing rapid-response GIS analytic capabilities to state and local government agencies. Wrangler reduces to minutes the time needed to assemble and deliver crucial wildfire-related data.

decision support↗

A decision support system for delivering optimal quality peach and tomato

Several studies have indicated that color and firmness are the two quality attributes most important to consumers in making purchasing decisions of fresh peaches and tomatoes. However, at present, retail produce managers do not have the proper information for handling fresh produce so it has the most appealing color and firmness when it reaches the consumer. This information should help them predict the consumer color and firmness perception and preference for produce from various storage conditions. Since 1987, for 'Redglobe' peach and 'Sunny' tomato, we have been generating information about their physical quality attributes (firmness and color) and their corresponding consumer sensory scores. This article reports on our current progress toward the goal of integrating such information into a model-based decision support system for retail level managers in handling fresh peaches and tomatoes.

Thai, C. N.↗

Architecture-Level Dependability Analysis of a Medical Decision Support System

Recent advances in techniques such as image analysis, text analysis and machine learning have shown great potential to assist physicians in detecting and diagnosing health issues in patients. In this paper, we describe the approach and findings of an architecture-level dependability analysis for a mammography decision support system that incorporates these techniques. The goal of the research described in this paper is to provide an initial understanding of the dependability issues, particularly the potential failure modes and severity, in order to identify areas of potential high risk. The results will guide design decisions and provide the basis of a dependability and performance evaluation program.

99 GENERAL AND MISCELLANEOUS↗

Evaluating the Socioeconomic Impacts of Rapid Assembly and Deployment of Geospatial Data in Wildfire Emergency Response Planning: A Case Study Using the NASA RECOVER Decision Support System (DSS)

Today’s extended fire seasons and large fire footprints have prompted state and federal land management agencies to devote increasingly larger portions of their budget to wildfire management. As fire costs continue to rise, timely and comprehensive fire information becomes increasingly critical to response and rehabilitation efforts. The NASA Rehabilitation Capability Convergence for Ecosystem Recovery (RECOVER) post-fire decision support system is a server-based application designed to rapidly provide land managers with the information needed to develop a comprehensive rehabilitation plan. This study tested the efficacy of RECOVER through structured interviews with land managers (n=15) who used RECOVER and were responsible for post-fire rehabilitation efforts on over 645 000 ha of fire-affected lands. Although the benefit of better-informed decisions is difficult to quantify, the results of this study illustrate RECOVER’s decision support capabilities provided information to land managers that either validated or altered their decisions on post-fire treatments estimated at over $1.2 million (USD) and saved nearly 800 hours of staff time by streamlining data collection as well as communication with local stakeholders and partnering agencies.

William Toombs↗

Towards Next-Generation Urban Decision Support Systems through AI-Powered Construction of Scientific Ontology Using Large Language Models—A Case in Optimizing Intermodal Freight Transportation

The incorporation of Artificial Intelligence (AI) models into various optimization systems is on the rise. However, addressing complex urban and environmental management challenges often demands deep expertise in domain science and informatics. This expertise is essential for deriving data and simulation-driven insights that support informed decision-making. In this context, we investigate the potential of leveraging the pre-trained Large Language Models (LLMs) to create knowledge representations for supporting operations research. By adopting ChatGPT-4 API as the reasoning core, we outline an applied workflow that encompasses natural language processing, Methontology-based prompt tuning, and Generative Pre-trained Transformer (GPT), to automate the construction of scenario-based ontologies using existing research articles and technical manuals of urban datasets and simulations. From these ontologies, knowledge graphs can be derived using widely adopted formats and protocols, guiding various tasks towards data-informed decision support. The performance of our methodology is evaluated through a comparative analysis that contrasts our AI-generated ontology with the widely recognized pizza ontology, commonly used in tutorials for popular ontology software. We conclude with a real-world case study on optimizing the complex system of multi-modal freight transportation. Our approach advances urban decision support systems by enhancing data and metadata modeling, improving data integration and simulation coupling, and guiding the development of decision support strategies and essential software components.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Towards a Decision Support System for Space Flight Operations

The Mission Operations Directorate (MOD) at the Johnson Space Center (JSC) has put in place a Model Based Systems Engineering (MBSE) technological framework for the development and execution of the Flight Production Process (FPP). This framework has provided much added value and return on investment to date. This paper describes a vision for a model based Decision Support System (DSS) for the development and execution of the FPP and its design and development process. The envisioned system extends the existing MBSE methodology and technological framework which is currently in use. The MBSE technological framework currently in place enables the systematic collection and integration of data required for building an FPP model for a diverse set of missions. This framework includes the technology, people and processes required for rapid development of architectural artifacts. It is used to build a feasible FPP model for the first flight of spacecraft and for recurrent flights throughout the life of the program. This model greatly enhances our ability to effectively engage with a new customer. It provides a preliminary work breakdown structure, data flow information and a master schedule based on its existing knowledge base. These artifacts are then refined and iterated upon with the customer for the development of a robust end-to-end, high-level integrated master schedule and its associated dependencies. The vision is to enhance this framework to enable its application for uncertainty management, decision support and optimization of the design and execution of the FPP by the program. Furthermore, this enhanced framework will enable the agile response and redesign of the FPP based on observed system behavior. The discrepancy of the anticipated system behavior and the observed behavior may be due to the processing of tasks internally, or due to external factors such as changes in program requirements or conditions associated with other organizations that are outside of MOD. The paper provides a roadmap for the three increments of this vision. These increments include (1) hardware and software system components and interfaces with the NASA ground system, (2) uncertainty management and (3) re-planning and automated execution. Each of these increments provide value independently; but some may also enable building of a subsequent increment.

Meshkat, Leila↗

Towards a decision support system for space flight operations

The Mission Operations Directorate (MOD) at the Johnson Space Center (JSC) has put in place a Model Based Systems Engineering (MBSE) technological framework for the development and execution of the Flight Production Process (FPP). This framework has provided much added value and return on investment to date. This paper describes a vision for a model based Decision Support System (DSS) for the development and execution of the FPP and its design and development process. The envisioned system extends the existing MBSE methodology and technological framework which is currently in use. The MBSE technological framework currently in place enables the systematic collection and integration of data required for building an FPP model for a diverse set of missions. This framework includes the technology, people and processes required for rapid development of architectural artifacts. It is used to build a feasible FPP model for the first flight of spacecraft and for recurrent flights throughout the life of the program. This model greatly enhances our ability to effectively engage with a new customer. It provides a preliminary work breakdown structure, data flow information and a master schedule based on its existing knowledge base. These artifacts are then refined and iterated upon with the customer for the development of a robust end-to-end, high-level integrated master schedule and its associated dependencies. The vision is to enhance this framework to enable its application for uncertainty management, decision support and optimization of the design and execution of the FPP by the program. Furthermore, this enhanced framework will enable the agile response and redesign of the FPP based on observed system behavior. The differences between the anticipated system behavior and the observed behavior may be due to the processing of tasks internally, or due to external factors such as changes in program requirements or conditions associated with other organizations that are outside of MOD. The paper provides a roadmap for the four increments of this vision. These increments include (1) the existing capabilities (2) hardware and software system components and interfaces with the NASA ground system, (3) uncertainty management and (4) re-planning and automated execution. Each of these increments provides value independently; but some may also enable building of a subsequent increment.

Ruszkowski, James↗

Wetland Flow and Salinity Budgets and Elements of a Decision Support System toward Implementation of Real-Time Seasonal Wetland Salinity Management

The project has provided science-based tools for the long-term management of salinity in drainage discharges from wetlands to the San Joaquin River. The results of the project are being used to develop best management practices (BMP) and a decision support system to assist wetland managers adjust the timing of salt loads delivered to the San Joaquin River during spring drawdown. Adaptive drainage management scheduling has the potential to improve environmental compliance with salinity objectives in the Lower San Joaquin River by reducing the frequency of violation of Vernalis salinity standards, especially in dry and critically dry years. The paired approach to project implementation whereby adaptively managed and traditional practices were monitored in a side-by-side fashion has provided a quantitative measure of the impacts of the project on the timing of salt loading to the San Joaquin River. The most significant accomplishments of the project has been the technology transfer to wetland biologists, ditch tenders and water managers within the Grasslands Ecological Area. This “learning by doing” has build local community capacity within the Grassland Water District and California Department of Fish and Game providing these institutions with new capability to assess and effectively manage salinity within their wetlands while simultaneously providing benefits to salinity management of the San Joaquin River.

54 ENVIRONMENTAL SCIENCES↗

Two-Stage Adaptive Restoration Decision Support System for a Self-Healing Power Grid

Power outages cost American industries and businesses billions of dollars and jeopardize the lives of hospital patients. The losses can be greatly reduced with a fast, reliable, and flexible self-healing tool. This paper is aimed to tackle the challenging task of developing an adaptive restoration decision support system (RDSS). The proposed RDSS determines restoration actions both in planning and real-time phases and adapts to constantly changing system conditions. The comprehensive formulation encompasses practical constraints including ac power flow, dynamic reserve, and load modeling. Here, the combinatorial problem is decomposed into a two-stage formulation solved by an integer L-shaped algorithm. The two stages are then executed online in the RDSS framework employing a sliding window method. The IEEE 39-bus system has been studied under normal and contingency conditions to demonstrate the effectiveness and efficiency of the proposed online RDSS.

24 POWER TRANSMISSION AND DISTRIBUTION↗