Search NASA⌕ Search

SEARCH · Search NASA

Results for “Mental Models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Mental Models for Managing Grid Cybersecurity Risk - ARC Industry Forum, Cybersecurity and Energy Transition

A proper mental model of the concepts of cyber risk and its components of threat and exploitability and consequence is necessary to allocate limited resources to different security activities, especially when considered alongside reliability and regulatory and economic risks. Understanding the consequence and frequency different risks are realized also helps align the right mitigations to the right risks. Cyber-informed engineering (CIE) is an emerging method to “engineer out” cyber risk across product and system lifecycles, and INL has a portfolio of programs operationalizing CIE’s principles for the energy sector.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Always look on the bright side of life: Taking a different perspective on cybersecurity performance

This presentation will introduce participants to key mental models on how to think about and understand safety from two of the leading voices in the discipline – Dr. Erik Hollnagel and Dr. Todd Conklin – and from there we ask the simple question of “how can we apply this to cybersecurity?” At the completion of this presentation attendees will be able to describe Dr. Hollnagel’s Safety-II approach and Dr. Conkiln’s definition of safety as “not the absence of accidents but the presence of effective defenses.” They will be able to explain how these ideas translate to the cybersecurity world broadly, and more specifically to operational technology cybersecurity where physical safety consequences are coupled to control system performance. Finally, participants will be able to identify how selected principles from Weick and Sutcliffe’s high reliability organization theory can help operationalize these key mental models around safety, for improved organizational cybersecurity over the long run.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2022

Information needs, approaches, and case studies in human health risk communication

This article uses ten case studies to illustrate the information needs, various communication approaches, and the communicator's role in explaining environmental health risks from a variety of hazards, to a variety of audiences, over time frames from days to years, using in person consultation, lectures, zooms, and email formats. Events often had a long history before the communication began and may have had a long tail afterward. Audiences may be public officials, companies, workers, communities, or individuals. Each individual may have their own understanding or mental model regarding the hazard, exposure, and risk. The communicator's role or intention may be to reassure an audience that has unrealistic exaggerated concerns or fears or to protect a client if the fears are realistic. Or it may be altruistic to inform a complacent audience to take the risks it faces more seriously. Although risk assessment research has advanced the techniques for communicating abstruse probabilities to audiences with low numeracy, in my experience, audiences are unimpressed by precise–sounding probability numbers, and are more interested in whether exposure is occurring or may occur and how to stop it. Often audiences have reason to be outraged and may be more concerned about punishing wrong doers than about the hazard itself, particularly when the exposure is past and cannot be undone. Thus, there is a difference between discussing the riskiness of a situation (risk communication) and what you are going to do about the situation (risk management). Risk communication is successful when the audience responds as intended, calming down or taking action. These case studies are drawn from a large number of risk communication experiences that I and my Rutgers colleagues have engaged in over the past four decades. Through the 20th century, New Jersey was the most densely industrialized State in United States. New Jersey experienced growth of the chemical and petrochemical industries and the unfortunately profligate disposal of toxic wastes. Having the most Superfund sites of any state is a dubious distinction, but New Jersey also has the most experience in evaluating and responding to these hazards.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2026

What Is the Agent Doing? Visualizing Agentic AI Querying Workflows

We explore how visualizations can help users understand what an AI agent is doing as it builds and runs queries over data. As part of the LinkQ system, a natural language interface for querying knowledge graphs with a large language model (LLM), we designed two complementary views: A State Diagram that shows where the agent is within a larger workflow, and a Live Action Display that gives real-time updates about the agent's current task. In a study with 14 practitioners, we found that these visuals helped participants build stronger mental models of the agent's behavior while also increasing their confidence in the system. However, we also observed that users sometimes trusted incorrect outputs simply because the agent appeared to be doing the "right" thing. Our findings point to both the value and risk of visualizing agent behavior in interactive AI systems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

“Shoulda, Coulda, Woulda”: Conceptualizing the Differences in Trust Between Human-Human Teaming and Human-Machine Teaming

Intelligent decision support systems (IDSSs) are machine teammates designed to facilitate better human decision-making in high-consequence domains such as health care, power grid operations, and fraud detection. IDSSs identify patterns in datasets and provide intelligent decision-making recommendations to human teammates. However, previous research indicates that humans often trust IDSS recommendations less than the recommendations from their human teammates, even when the machine teammate is more accurate. To conceptualize why trust differs, we review the literature surrounding trust, error, and predictability. Then, we compile and compare participant trust ratings and decision-making in an abridged systematic review of previous studies manipulating teammate type, error rate, and error type. Finally, we conduct a content analysis of participants’ qualitative responses to trust queries from a survey on generative language models. Results suggest that humans may trust IDSS teammates less than other human teammates because of differences in (1) interaction complexity, (2) blame attribution, and (3) swift trust. We conclude that human factors practitioners should collaborate with data scientists and domain experts to build and maintain trust in IDSSs by anthropomorphizing algorithms, matching mental models, and considering individual differences.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

‪A Novel Methodology for Longitudinal Studies of Home Thermal Comfort Perception and Behavior

Human-building interactions significantly influence building energy consumption and affect peak energy demand. For example, heating and cooling contribute 46% of daily peak residential energy demand. Grid-interactive efficient buildings (GEBs) can potentially increase energy-demand flexibility and accelerate the adoption of renewables. However, traditional demand response (DR) programs focused on shedding peak loads disregard the human-building interactions leading to occupant thermal frustration. Specifically, they do not model occupants’ ability to override thermostat controls, nor how indoor environmental conditions and sociocultural factors affect the timing and magnitude of overrides. Studies have found 20% of occupants override thermostat setpoints during DR events longer than 6 hours yet lack detail about the motivation that might guide more successful efforts. Balancing energy-demand flexibility with occupant thermal comfort requires understanding dynamic occupant behavior, the underlying psychophysiological drivers, in the context of homes. This paper presents methods for scalable longitudinal studies of residential occupant behavior dynamics to inform the development of psychophysiological occupant-centric building models. Smart sensors were installed to measure local environmental conditions in 20 homes in two regions of the United States. Just-in-time ecological momentary assessments (EMAs) provided qualitative data on occupant thermal comfort and local environmental conditions not captured in Internet-of-Things (IoT) based studies or existing datasets. Participant interviews provided insight into environmental attitudes, mental models, and the role of economics in comfort and behavior, which in turn may affect thermostat interactions. Based on these data, interventions in the next phase of the study will collect data and monitor occupant behavior during simulated DR events.

Kane, Michael↗
DOE OSTI2020

An Assessment of the Usability of Machine Learning Based Tools for the Security Operations Center

Gartner, a large research and advisory company, anticipates that by 2024 80% of security operation centers (SOCs) will use machine learning (ML) based solutions to enhance their operations. 1 1 https://www.ciodive.com/news/how-data-science-tools-can-lighten-the-load-for-cybersecurity-teams/572209/ In light of such widespread adoption, it is vital for the research community to identify and address usability concerns. This work presents the results of the first in situ usability assessment of ML-based tools. With the support of the US Navy, we leveraged the national cyber range-a large, air-gapped cyber testbed equipped with state-of-the-art network and user emulation capabilities-to study six US Naval SOC analysts' usage of two tools. Our analysis identified several serious usability issues, including multiple violations of established usability heuristics for user interface design. We also discovered that analysts lacked a clear mental model of how these tools generate scores, resulting in mistrust a and/or misuse of the tools themselves. Surprisingly, we found no correlation between analysts' level of education or years of experience and their performance with either tool, suggesting that other factors such as prior background knowledge or personality play a significant role in ML-based tool usage. Our findings demonstrate that ML-based security tool vendors must put a renewed focus on working with analysts, both experienced and inexperienced, to ensure that their systems are usable and useful in real-world security operations settings.

Oesch, T↗
DOE OSTI2022

Integrating Cybersecurity with System Operations and Restoration

This presentation covers the interaction of the discipline of system operations with the discipline of cybersecurity. First, a common mental model for risk - both cybersecurity and all-hazards - is presented, followed by a discussion of high-level management strategies for different kinds of cyber harm facing system operators, based on the consequences and frequencies of the harm. The next section covers the importance of cybersecurity for a system operator organization and explains some general concepts to understand the relationships. Finally the role of system operators in the security of the grid as a larger system of systems is discussed over the framework of a resilience event.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

HOP and Cybersecurity: Leveraging safety and reliability experience to improve digital security culture

This presentation will introduce participants to key mental models on how to think about and understand safety and the organizational attributes that support it from three of the leading voices in the discipline – David Marx, Dr. Erik Hollnagel and Dr. Todd Conklin – and from there we ask the simple question of “how can we apply this to cybersecurity?” Opportunities, similarities, and differences from the history of accomplishment applying human and organizational performance principles to safety and reliability can be collectively leveraged to the meet the challenge of cybersecurity for OT/ICS/cyber-physical systems. This is the same intent as the "Cybersecurity Culture" principle of Cyber-Informed Engineering (CIE).

42 ENGINEERING↗
DOE OSTI2021

Deconstructing criterion a of the alternative model for personality disorders.

Here, the construct composition of the Level of Personality Functioning Scale (LPFS; Criterion A) of the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition alternative model for personality disorders (American Psychiatric Association, 2013) was examined in a clinical vignette rating study. Multiple indices of level of personality functioning, psychiatric and psychosocial impairment, Criterion B maladaptive personality traits, and conceptually divergent variables (intellectual level, socioeconomic status, and likability) were used to deconstruct the LPFS. Most variables were highly intercorrelated, but partial correlational analyses showed the LPFS possesses meaningful personality construct variance not fully explained by severity of pathological traits, psychiatric and psychosocial impairment, or the conceptually divergent variables. This exploratory study offers initial evidence that the LPFS contains substantive LPF variance beyond PD severity. Results are framed and discussed in terms of the known conceptual and empirical overlap between Criterion A and Criterion B as well as the differing ways a dimension of personality disorder (PD) severity may be interpreted. Finally, we propose the LPFS is more than statistical artifact created by empirical covariation but less than a true latent dimension of PD severity. The LPFS may be understood as a methodologically pragmatic but theoretically substantive dimension of PD severity.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

A network analysis of the long-term quality of life and mental distress of COVID-19 survivors 1 year after hospital discharge

Objectives COVID-19 survivors suffer from persistent mental distress and impaired quality of life (QOL) after recovery from the infection. However, the symptom-symptom interaction between these psychological variables remained unexplored. The present study aimed to determine the symptom network of mental distress (depression, anxiety, sleep disturbance, fatigue, and post-traumatic stress disorder) and their association with QOL among 535 COVID-19 survivors 1 year after hospital discharge. Methods 9-item Patient Health Questionnaire, 7-item Generalized Anxiety Disorder Scale, Chalder fatigue scale, Impact of Event Scale-Revised, Pittsburgh Sleep Quality Index, and 36-Item Short-Form Health Survey were applied to measure depression, anxiety, fatigue, PTSD, sleep disturbances, and QOL, respectively. Two networks were estimated using Gaussian graphical model. Network 1 consisted of mental symptoms to determine the central and bridge symptoms. Network 2 additionally included QOL to determine which mental symptoms were mostly related to QOL. Results 60% of the COVID-19 survivors experienced mental distress 1 year after hospital discharge. Uncontrollable and excessive worry, psychomotor symptoms, intrusion, and daytime dysfunction were the most central symptoms. Daytime dysfunction and fatigue (especially mental fatigue and loss of energy) served as the bridge symptoms across the mental distress network and exhibited the most substantial association with QOL. Conclusion Our study demonstrated several key symptoms that played a vital role in mental distress and QOL among COVID-19 survivors. Prompt screening and targeted interventions for these symptoms might hold great promise in preventing mental distress and improving QOL in COVID-19 survivors.

Peng, Pu↗
DOE OSTI2021

10 New Insights in Climate Science 2020 - a Horizon Scan

We summarize some of the past year’s most important findings within climate change-related research. New research has improved our understanding of Earth’s sensitivity to carbon dioxide, finds that permafrost thaw could release more carbon emissions than expected and that the uptake of carbon in tropical ecosystems is weakening. Adverse impacts on human society include increasing water shortages and impacts on mental health. Options for solutions emerge from rethinking economic models, rights-based litigation, strengthened governance systems and a new social contract. The disruption caused by COVID-19 could be seized as an opportunity for positive change, directing economic stimulus towards sustainable investments.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

Transmission Operator Workflows for Real-Time Reliability Studies: A Review of Control Room Practices and Naturalistic Decision Making

This report provides an overview of real-time reliability study tools and their use by power system operators in the control room environment. After introducing some of the nuances of the control room environment and the differences in perspectives between power system engineers and operators, the roles and responsibilities of key entities involved in RTCA workflows are introduced. These are specifically the transmission system operator (TOP) and reliability coordinator (RC), which are required to run tools such as real-time contingency analysis (RTCA) as part of a real-time reliability assessment every 30 minutes, as dictated by a series of standards issued by the North American Electric Reliability Corporation (NERC). The process by which power systems operators operate the grid is discussed in terms of naturalistic decision making (NDM) and the recognition-primed decision-making (RPD) model. This cognitive model describe how experts working in high-risk, high-stress environments make safety-critical decisions under uncertainty and time pressure. For power system operators, the mental simulations involved in the traditional RPD model are supplemented by physics-based simulations using numerical tools, such as RTCA, to improve situational awareness and effectiveness of control actions. Next, a generic workflow is introduced to describe operator decision making for running RTCA tools and responding to system violations on a pre-contingent basis. The types of analysis performed and control actions chosen by power system operators are described in detail. The overall high-level workflow is then expanded in subsequent sections, with special attention given to high-voltage violations, low-voltage violations, and thermal overloads. Each type of violation is described in detail, with explanations of common causes, impacts on equipment and customers, and mitigation strategies. An additional workflow diagram is provided for each type of violation.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Comparison of Expert Vocabulary Usage Patterns Between Mental Health and Nonmental Health Clinicians When Diagnosing Pediatric Anxiety Disorders

Objective: To compare the utilization patterns of expert vocabulary (EVo) in diagnosing pediatric anxiety between mental health and non-mental health clinical notes from electronic health records to understand the role of Evo in informing classification and decision-making in anxiety diagnoses. Study design: We conducted a retrospective study using a cohort less than age 25 from Cincinnati Children's Hospital including 897 685 patients with 61 586 446 notes. We analyzed EVo, collected from mental health clinicians, in both mental and nonmental health notes. We compared classification accuracy using EVo-based patient-level embedding from all clinical notes, mental-health notes, and nonmental health notes for 2 tasks: 1) pre-vs postdiagnosis anxiety patients, and 2) prediagnosis anxiety vs nonanxiety patients. Results: EVo usage was highest in prediagnosis anxiety, lower in nonanxiety, and lowest in post-diagnosis. Classification models using EVo features from all, mental-health, and non-mental health notes showed similar F1 scores for prediagnosis anxiety (0.70 ± 0.2 for 2 categories). For anxiety vs nonanxiety classification, all clinical and nonmental health notes had better F1 scores than mental-health notes (above 0.90 for 3 categories). There was a notable difference in class-wise performance across both tasks. Conclusions: There are significant differences in anxiety EVo use between mental health and nonmental health clinicians. Despite less anxiety-specific terminology, non-mental health notes still captured key aspects of patient presentations, emphasizing the importance of including all clinicians' notes in analysis. EVo's utility for anxiety classification is most effective in prediagnostic phases, suggesting the need for a dedicated diagnostic lexicon and further study before incorporating EVo into classification models.

feature engineering↗
DOE OSTI2020

Description of the LASSO Data Bundles Product

The U. S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility began a pilot project in May 2015 to design a routine, high-resolution modeling capability to complement ARM’s extensive suite of measurements. This modeling capability has evolved into the Large-Eddy Simulation (LES) ARM Symbiotic Simulation and Observation (LASSO) datastream. The datastream, broadly termed data bundles, contains high-resolution model output, input files, observations for evaluation, and skill scores for the simulations. The initial focus of LASSO is on shallow convection at the ARM Southern Great Plains (SGP) atmospheric observatory. The availability of LES simulations with concurrent observations serves many purposes. LES helps bridge the scale gap between DOE ARM observations and models, and the use of routine LES adds value to observations. It provides a self-consistent representation of the atmosphere and a dynamical context for the observations. Further, it elucidates unobservable processes and properties. LASSO generates a simulation library for researchers that enables statistical approaches beyond a single-case mentality. It also provides tools necessary for modelers to reproduce the LES and conduct their own sensitivity experiments. The LASSO library of data bundles is designed to facilitate a wide range of research. For an observationalist, LASSO can help inform instrument remote-sensing retrievals, conduct observation system simulation experiments (OSSEs), and test implications of radar scan strategies or flight paths. For a theoretician, LASSO can help calculate estimates of fluxes and co-variability of values, and test relationships without having to run the model personally. For a modeler, LASSO can help one know ahead of time which days have good forcing, have co-registered observations at high-resolution scales, and have simulation inputs and corresponding outputs to test parameterizations. Further details on the overall LASSO project are available at https://www.arm.gov/capabilities/modeling/lasso.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Efficient and assured reinforcement learning-based building HVAC control with heterogeneous expert-guided training

Abstract Building heating, ventilation, and air conditioning (HVAC) systems account for nearly half of building energy consumption and $$20\%$$ of total energy consumption in the US. Their operation is also crucial for ensuring the physical and mental health of building occupants. Compared with traditional model-based HVAC control methods, the recent model-free deep reinforcement learning (DRL) based methods have shown good performance while do not require the development of detailed and costly physical models. However, these model-free DRL approaches often suffer from long training time to reach a good performance, which is a major obstacle for their practical deployment. In this work, we present a systematic approach to accelerate online reinforcement learning for HVAC control by taking full advantage of the knowledge from domain experts in various forms . Specifically, the algorithm stages include learning expert functions from existing abstract physical models and from historical data via offline reinforcement learning, integrating the expert functions with rule-based guidelines, conducting training guided by the integrated expert function and performing policy initialization from distilled expert function. Moreover, to ensure that the learned DRL-based HVAC controller can effectively keep room temperature within the comfortable range for occupants, we design a runtime shielding framework to reduce the temperature violation rate and incorporate the learned controller into it. Experimental results demonstrate up to 8.8 X speedup in DRL training from our approach over previous methods, with low temperature violation rate.

Xu, Shichao↗
DOE OSTI2025

Updating and Refining BISON TRISO Assessment

Several advanced reactor concepts consider tristructural isotropic (TRISO) fuel in their designs. To support the advanced reactor industry, the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program within the U.S. Department of Energy (DOE) is developing modeling and simulation capabilities within the BISON fuel performance code. Assessment of these capabilities against available experi- mental data, such as the Advanced Gas Reactor (AGR) program, is essential in instilling confidence in the code predictions. Associated uncertainties in model inadequacy, experimental measurements, and manufacturing are also of importance. This report discusses the updating and standardization of the existing assessment suite in BISON for TRISO fuel performance analysis. The cases considered the AGR-1, AGR-2, and AGR-3/4 experimental programs. The report also includes a preliminary investigation into the sources of model inadequacy associated with silver (Ag) release fractions using the AGR-2 Compact 2-1-2 as a case study. The results indicate that uncertainties in the operating temperatures supplied to the model and the form of those temperature conditions (spatially averaged versus spatially resolved) both affect Ag release predictions. This suggests that previously observed model inadequacy can be attributed to both physical models and the operating conditions supplied to them. These findings will be leveraged to guide development of assessment cases for additional experiments and refinement of physical models for behaviors that potentially influence Ag release, such as palladium penetration.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2020

Assessment of Demographic, Genetic, and Imaging Variables Associated With Brain Resilience and Cognitive Resilience to Pathological Tau in Patients With Alzheimer Disease

Importance: Better understanding is needed of the degree to which individuals tolerate Alzheimer disease (AD)-like pathological tau with respect to brain structure (brain resilience) and cognition (cognitive resilience). Objective: To examine the demographic (age, sex, and educational level), genetic (APOE-ε4 status), and neuroimaging (white matter hyperintensities and cortical thickness) factors associated with interindividual differences in brain and cognitive resilience to tau positron emission tomography (PET) load and to changes in global cognition over time. Design, setting, an participants: In this cross-sectional, longitudinal study, tau PET was performed from June 1, 2014, to November 30, 2017, and global cognition monitored for a mean [SD] interval of 2.0 [1.8] years at 3 dementia centers in South Korea, Sweden, and the United States. The study included amyloid-β-positive participants with mild cognitive impairment or AD dementia. Data analysis was performed from October 26, 2018, to December 11, 2019. Exposures: Standard dementia screening, cognitive testing, brain magnetic resonance imaging, amyloid-β PET and cerebrospinal fluid analysis, and flortaucipir (tau) labeled with fluor-18 (18F) PET. Main outcomes and measures: Separate linear regression models were performed between whole cortex [18F]flortaucipir uptake and cortical thickness, and standardized residuals were used to obtain a measure of brain resilience. The same procedure was performed for whole cortex [18F]flortaucipir uptake vs Mini-Mental State Examination (MMSE) as a measure of cognitive resilience. Bivariate and multivariable linear regression models were conducted with age, sex, educational level, APOE-ε4 status, white matter hyperintensity volumes, and cortical thickness as independent variables and brain and cognitive resilience measures as dependent variables. Linear mixed models were performed to examine whether changes in MMSE scores over time differed as a function of a combined brain and cognitive resilience variable. Results: A total of 260 participants (145 [55.8%] female; mean [SD] age, 69.2 [9.5] years; mean [SD] MMSE score, 21.9 [5.5]) were included in the study. In multivariable models, women (standardized β = -0.15, P = .02) and young patients (standardized β = -0.20, P = .006) had greater brain resilience to pathological tau. Higher educational level (standardized β = 0.23, P < .001) and global cortical thickness (standardized β = 0.23, P < .001) were associated with greater cognitive resilience to pathological tau. Linear mixed models indicated a significant interaction of brain resilience × cognitive resilience × time on MMSE (β [SE] = -0.235 [0.111], P = .03), with steepest slopes for individuals with both low brain and cognitive resilience. Conclusions and relevance: Results of this study suggest that women and young patients with AD have relative preservation of brain structure when exposed to neocortical pathological tau. Interindividual differences in resilience to pathological tau may be important to disease progression because participants with both low brain and cognitive resilience had the most rapid cognitive decline over time.

60 APPLIED LIFE SCIENCES↗