Objective Structured Clinical Evaluation (OSCE) of an Artificial Intelligence (AI) Clinical Decision Support System (CDSS) Tool
Explore the source record for details and available documents.
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
For over 50 years, NASA's crewed missions have been confined to the Earth-Moon system, where speed-of-light communications delays between crew and ground are practically nonexistent. This ground-centered mode of operations, with a large, ground-based support team, is not sustainable for NASAs future human exploration missions to Mars. Future astronauts will need smarter tools employing Artificial Intelligence (AI) techniques make decisions without inefficient communication back and forth with ground-based mission control. In this talk we will describe several demonstrations of astronaut decision support tools using AI techniques as a foundation. These demonstrations show that astronauts tasks ranging from living and working to piloting can benefit from AI technology development.
Predictive modeling through the use of AI techniques and AI-derived model components; the use of AI and other tools to design a prediction system comprising of a hierarchy of models (e.g.,AI driven model/component/parameterization selection). We propose a Bayesian neural network ensemble approach for improving large-scale streamflow predictability and understanding in a changing environment that combines multiple Earth system land model predictions by calculating spatiotemporally varying model weights and biases while accounting for various types of observations at multiple scales with uncertainty.
Focal Area(s): The focal area of this whitepaper is, “Predictive modeling through the use of AI techniques and AI-derived model components; the use of AI and other tools to design a prediction system comprising of a hierarchy of models (e.g., AI driven model/component/parameterization selection).” The ideas and frameworks described herein are deemed site agnostic. As a use case, this group will initially focus on the coupling between land processes, surface/subsurface hydrological processes, coastal processes, and human activities in the U.S. Gulf states.
Focal Area: Focal Area 2. Predictive modeling through the use of AI techniques and AI-derived model components; the use of AI and other tools to design a prediction system comprising of a hierarchy of models (e.g., AI driven model/component/parameterization selection). Science Challenge: A major challenge exists in the lack of reliable predictive modeling of water-cycle extremes using macro-scale hydrologic models that are driven by atmospheric climate data. This causes a critical knowledge gap in understanding the magnitudes, probabilities, and severity of droughts, rainfall, and flooding. Improved understanding of these extreme events requires more accurate modeling at high spatial and temporal resolutions. This shortcoming is especially apparent when complex couplings between atmospheric quantities and engineered systems emerge, such as during extreme precipitation or drought events and at intersections of atmospheric-land-fluvial-ocean systems. Added complexity around representing operations of engineered infrastructure leads to a limited capability to analyze the temporal and spatial implications of compounding extreme events across inland and coastal regions. This results in profound challenges for water and power systems operators, agriculture production, and regional infrastructure planning. The science challenge can be summarized as How can we use AI/ML to improve short term predictability of extreme water-cycle events and associated risk, especially compounding events and extreme rainfall patterns that result in flooding, to inland and coastal communities under different climate scenarios?
This whitepaper is responsive to focal area (2) Predictive modeling through the use of AI techniques and AI-derived model components: the use of AI and other tools to design a prediction system comprising of a hierarchy of models (e.g., AI driven model/component/parameterization selection). Here we describe scale-aware ML models for adaptive model refinement that allow us to bridge the spatial and/or temporal scales in simulation models and observation data for capturing and predicting extreme water cycles.
Focal area: Predictive modeling through the use of AI techniques and AI-derived model components; the use of AI and other tools to design a prediction system comprising of a hierarchy of models (e.g., AI driven model/component/parameterization selection)
Focal areas include: Predictive modeling through the use of AI techniques and AI-derived model components; the use of AI and other tools to design a prediction system composed of a hierarchy of models (e.g., AI driven model/component/parameterization selection). Insight gleaned from complex data (both observed and simulated) using AI, big data analytics, and other advanced methods, including explainable AI and physics- or knowledge-guided AI.
The proposed research addresses all three focus areas, but primarily (2): Predictive modeling through the use of AI techniques and AI-derived model components; the use of AI and other tools to design a prediction system comprising of a hierarchy of models (e.g., AI driven model /component/ parameterization selection)
Focal Area(s): Predictive modeling through the use of AI techniques and AI-derived model components; the use of AI and other tools to design a prediction system comprising of a hierarchy of models (e.g., AI-driven model/component/parameterization selection). Science Challenge: Watershed processes, such as the fate and transport of sediment, carbon and nutrients across landscapes and their fluxes to water bodies (e.g., streams, rivers and lakes), have important implications for global and regional carbon and nutrient dynamics, biogeochemical functioning of terrestrial ecosystems, and soil functions. The magnitude of lateral surface/subsurface transport and fluxes of sediment, carbon and nutrients are key factors controlling the vulnerability of watersheds to climate extremes such as droughts, wildfires, and floods. Recent field observations and other scientific evidence suggest that the magnitudes of lateral transport and fluxes of sediment, carbon and nutrients are governed primarily by the spatial and vertical heterogeneity of landscape and soil properties and by pedogenic processes. However, the current generation of land surface and watershed models do not mechanistically couple the terrestrial and hydrologic systems, nor do they represent sufficiently the spatial and vertical heterogeneity of land surface and subsurface properties. On the other hand, increasing complexity of coupled watershed and land surface models requires more data to parameterize, calibrate and validate. Remote sensing (RS) provides a means to acquire spatial data and characterize their heterogeneity at the watershed scale, overcoming a major limitation associated with conventional point measurements. To improve the representation of land-surface and surface/subsurface process coupling and sub-grid heterogeneity in watershed models, it is essential to build our predictive understanding by learning from both the multi-scale multi-process modeling and diverse multi-scale data while leveraging powerful artificial intelligence (AI) techniques.
This paper falls under Focal Area #2: Predictive modeling through the use of AI techniques and AI-derived model components; the use of AI and other tools to design a prediction system comprising of a hierarchy of models (e.g., AI-driven model/component/parameterization selection).
Romie is a decision support tool based on AI's latest advances in the domain of robust scheduling. Unlike all its predecessors, the tool allows to (i) visually model the operational problem and context entirely (ii) optimize to find near-optimal schedules while taking uncertainty into account and deals with (iii) a combination of various {key performance indicators (KPIs). It comes with a web user interface. Part or all of the modelled activities may be associated to random variables describing their stochastic durations, in order to produce schedules that are robust w.r.t. temporal uncertainty. Hence, depending on the pursued KPIs, the schedules maximize a combination of the following terms: the probability of satisfying the problem constraints, the expected return/efficiency, the expected outcome quality, and even the operators' wellness by minimizing its expected extra-hours. Initially developed for spatial exploration and demonstration in the context of Mars analog missions, this versatile tool is here applied to operations management in both biotechnology manufacturing and robots parametrization in a cave exploration context.
Collection of tools designed to parse documents, such as PDFs, and extract structured elements including URLs, citation contexts, tables, formulas, and figures. This toolset leverages AI-based text extraction and classification methods, providing robust solutions for various scholarly resources processing needs.
Recent advancements in AI models, like ChatGPT, are structured to retain user interactions, which could inadvertently include sensitive healthcare data. In the healthcare field, particularly when radiologists use AI-driven diagnostic tools hosted on online platforms, there is a risk that medical imaging data may be repurposed for future AI training without explicit consent, spotlighting critical privacy and intellectual property concerns around healthcare data usage. Addressing these privacy challenges, a novel approach known as Unlearnable Examples (UEs) has been introduced, aiming to make data unlearnable to deep learning models. A prominent method within this area, called Unlearnable Clustering (UC), has shown improved UE performance with larger batch sizes but was previously limited by computational resources (e.g., a single workstation). To push the boundaries of UE performance with theoretically unlimited resources, we scaled up UC learning across various datasets using Distributed Data Parallel (DDP) training on the Summit supercomputer. Our goal was to examine UE efficacy at high-performance computing (HPC) levels to prevent unauthorized learning and enhance data security, particularly exploring the impact of batch size on UE’s unlearnability. Utilizing the robust computational capabilities of the Summit, extensive experiments were conducted on diverse datasets such as Pets, MedMNist, Flowers, and Flowers102. Our findings reveal that both overly large and overly small batch sizes can lead to performance instability and affect accuracy. However, the relationship between batch size and unlearnability varied across datasets, highlighting the necessity for tailored batch size strategies to achieve optimal data protection. The use of Summit’s high-performance GPUs, along with the efficiency of the DDP framework, facilitated rapid updates of model parameters and consistent training across nodes. Our results underscore the critical role of selecting appropriate batch sizes based on the specific characteristics of each dataset to prevent learning and ensure data security in deep learning applications. The source code is publicly available at https: // github. com/ hrlblab/ UE_ HPC .
A great deal of attention has recently been given to Artificial Intelligence research in the area of computer aided diagnostics. Due to the dynamic and complex nature of space shuttle red-line parameters, a research effort is under way to develop a real time diagnostic tool that will employ historical and engineering rulebases as well as a sensor validity checking. The capability of AI software development tools (KEE and G2) will be explored by applying object oriented programming techniques in accomplishing the diagnostic evaluation.
Artificial intelligence (AI) and machine learning (ML) are near-ubiquitous in day-to-day life; from cars with automated driver-assistance, recommender systems, generative content platforms, and large language chatbots. Implementing AI as a tool for international safeguards could significantly decrease the burden on safeguards inspectors and nuclear facility operators. The use of AI would allow inspectors to complete their in-field activities quicker, while identifying patterns and anomalies and freeing inspectors to focus on the uniquely human component of inspections. Sandia National Laboratories has spent the past two and a half years developing on-device machine learning to develop both a digital and robotic assistant. This combined platform, which we term inspecta, has numerous on-device machine learning capabilities that have been demonstrated at the laboratory scale. Here this work describes early successes implementing AI/ML capabilities to reduce the burden of tedious inspector tasks such as seal examination, information recall, note taking, and more.
A research program for integrating artificial intelligence (AI) techniques with tools and methods used for aircraft flight control system design, development, and implementation is discussed. The application of the AI methods for the development and implementation of the logic software which operates with the control mode panel (CMP) of an aircraft is presented. The CMP is the pilot control panel for the automatic flight control system of a commercial-type research aircraft of Langley Research Center's Advanced Transport Operating Systems (ATOPS) program. A mouse-driven color-display emulation of the CMP, which was developed with AI methods and used to test the AI software logic implementation, is discussed. The operation of the CMP was enhanced with the addition of a display which was quickly developed with AI methods. The display advises the pilot of conditions not satisfied when a mode does not arm or engage. The implementation of the CMP software logic has shown that the time required to develop, implement, and modify software systems can be significantly reduced with the use of the AI methods.
In the rapidly evolving landscape of scientific computing, Graphics Processing Units (GPUs) have become indispensable for their unparalleled ability to handle parallel tasks in complex calculations, simulations, and data analysis. Their utility is further magnified in machine learning and AI applications, where they significantly accelerate model training and predictive analytics. Within this context, the Triton Inference Server emerges as a pivotal open-source tool, specializing in AI inferencing and optimizing GPU utilization across various platforms and frameworks. This paper presents an in-depth study on distributed High Throughput Computing (HTC), specifically focusing on the HTCondor framework and its resource provisioning tools, GlideinWMS and HEPCloud. These systems enable large-scale scientific experiments like CMS and DUNE to efficiently access and utilize vast computational resources. The paper explores the core architectural components of GlideinWMS, including jobs, user pools, and worker nodes, and discusses their integration with GPUs and the Triton server. The primary aim of this research is to develop a solution that optimizes GPU utilization by leveraging Glideins and containers. This approach allows computational jobs, particularly those involving AI models, to use GPUs only when essential, thereby facilitating efficient sharing of limited GPU resources. To validate this architecture, the study conducted three key tests involving custom scripts, container-based servers, and Triton server deployments. However, the study faces challenges, notably in locating the Triton server and ensuring secure remote access. To address these issues, future work will focus on developing a proxy mechanism and enhancing security protocols. In conclusion, this study offers a comprehensive roadmap for effective and efficient GPU utilization in distributed High Throughput Computing. It aims to contribute significantly to the scientific community by solving pressing problems and implementing robust solutions in collaboration with the GlideinWMS and HEPCloud teams. The research sets the stage for a more efficient, scalable, and cost-effective paradigm in scientific computing.