SEARCH · Search NASA

Results for “resilience assessments”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

All sources NASA NTRS DOE OSTI

NASA NTRSDate not supplied

Can Resilience Assessments Inform Early Design Human Factors Decision-making?

There is a growing call among researchers for tighter coupling between human factors and human reliability assessments. In this research, we explore if early design stage resilience assessments can help bridge some of the gaps between human factors and human reliability assessments. Resilience in systems is their ability to recover reasonably and operate within acceptable bounds during failures and unexpected events. The fmdtools toolkit allows designers to assess the resilience of a system by modeling the human error and machine-related failure propagation in both nominal and faulty scenarios during the early design stages. As a result, the fmdtools toolkit has a low-fidelity dynamic human reliability assessment component built into it. In this paper, we study if the results from the fmdtools simulations can help inform and prioritize human factors design decision-making, resulting in tighter coupling between human factors and human reliability assessments during the design process. Specifically, we explore the results from a rover design example to understand the types of information that can help guide human factor-related decision-making.

Resilience-based Design↗

NASA NTRS2015

Assessing Resilience of Scheduled Performance-Based Navigation Arrival Operations

This paper assesses the resilience of scheduled Performance-Based Navigation (PBN) arrival operations. Resilience is defined as an ability to return to nominal operations following a schedule perturbation. Results from a Human-in-the- Loop (HITL) experiment that included off-nominal events to perturb the schedule are described. The schedule comes from a precision trajectory-based arrival manager. The experiment collected data regarding the response to perturbed schedules in three conditions, where: 1) a disturbance rejection algorithm made schedule adjustments automatically, 2) a Traffic Management Coordinator (TMC) participant made schedule adjustments manually, or 3) no schedule adjustments were made. Analyses showed that the simulation’s scheduled PBN operations have inherent resilience, recovering from more than half of the perturbed schedules even with no schedule adjustments. Resilience to the same off-nominal events improved with schedule adjustments; an increased proportion of perturbed schedules recovered within the length of operation run, and the average duration of the schedule’s perturbed state decreased. Compared to the manual schedule adjustments condition, a greater number of schedule adjustments occurred for the same off-nominal events in the automated condition. However, perturbed schedules were recovered more frequently and perturbations were less severe in the automated condition. Subjective and objective workload in the manual and the automated schedule adjustment conditions were similar to the no schedule adjustment condition.

Resilience↗

NASA NTRSDate not supplied

Using Degradation Modeling to Identify Fragile Operational Conditions in Human- and Component-driven Resilience Assessment

Studying failure events shows that many high-impact events result from the complex interactions between precipitating failure events and degraded operational conditions. Often, when a system is put in operations, unforeseen practical realities (e.g., maintenance and/or workforce availability) lead the system to be operated in configurations outside its envisioned nominal range. However, design-time failure models often assume that the failure events are initiated in an idealized, nominal state of system operation, resulting in an incomplete assessment of future risk. To solve this, this paper develops a framework to consider degraded operational performance in scenario-based resilience models which uses a corresponding model of performance degradation to determine the values of deteriorated model parameters in the resilience model. This framework is demonstrated on a remotely-piloted rover to determine the (individual and combined) effect of drive-train wear and operator fatigue on the resilience of the rover to drive-train faults. This demonstration showed the substantial impact that degradation has on resilience, highlighting the need to account for degradation in resilience models–specifically, unconsidered degradation can lead to overestimates of resilience (and thus underestimates of safety margin) and because resilience can degrade prior to visible unreliability, which can lead to an operational environment with a high propensity for high-impact unforeseen failure events.

resilience↗

NASA NTRSDate not supplied

Using Degradation Modeling to Identify Fragile Operational Conditions in Human- and Component-driven Resilience Assessment

Studying failure events shows that many high-impact events result from the complex interactions between precipitating failure events and degraded operational conditions. Often, when a system is put in operations, unforeseen practical realities (e.g., maintenance and/or workforce availability) lead the system to be operated in configurations outside its envisioned nominal range. However, design-time failure models often assume that the failure events are initiated in an idealized, nominal state of system operation, resulting in an incomplete assessment of future risk. To solve this, this paper develops a framework to consider degraded operational performance in scenario-based resilience models which uses a corresponding model of performance degradation to determine the values of deteriorated model parameters in the resilience model. This framework is demonstrated on a remotely-piloted rover to determine the (individual and combined) effect of drive-train wear and operator fatigue on the resilience of the rover to drive-train faults. This demonstration showed the substantial impact that degradation has on resilience, highlighting the need to account for degradation in resilience models--specifically, unconsidered degradation can lead to overestimates of resilience (and thus underestimates of safety margin) and because resilience can degrade prior to visible unreliability, which can lead to an operational environment with a high propensity for high-impact unforeseen failure events.

Daniel Hulse↗

NASA NTRSDate not supplied

Florida Water Resources: Assessing Coastal Resiliency Across Florida's Aquatic Preserves Response To Hurricane Forces

Intensifying weather events, sea level rise, and extensive coastal development in Southwestern Florida are escalating the need for Florida’s mangrove conservation. These mangroves are imperative for coastline stabilization, habitat provision for native species, and water quality management. Our partner, the Florida Department of Environmental Protection (FDEP), Office of Resilience and Coastal Protection is tasked with monitoring and conserving the Charlotte Harbor, Estero Bay, Rookery Bay, and Pinellas County Aquatic Preserves. We developed the Growth, Resilience, and Optical Vegetation Evaluator (GROVE) Google Earth Engine toolset for partners to determine mangrove forest extent through time, analyze mangrove forest health, and collect several water quality parameters within the preserves from January 2002–August 2022. The toolset provides easily accessible data from Landsat 7 Enhanced Thematic Mapper Plus (ETM+), Landsat 8 Operational Land Imager (OLI), Landsat 9 Operational Land Imager 2 (OLI-2), and the Shuttle Radar Topography Mission (SRTM). Using training datasets of known mangrove forest locations, we also established a machine learning approach to create mangrove extent maps. Maps from all four preserves indicated migration of mangrove forests inland as the greatest areas of change were transitional zones. Additionally, normalized difference vegetation index (NDVI), normalized difference turbidity index (NDTI), and chlorophyll-a maps were generated for the partners. This project provides decision makers with a useful tool for understanding temporal changes in Florida’s aquatic preserves, identifying areas of ecological stress, and providing actionable data to make informed plans for mangrove preservation.

Samuel Perrello↗

NASA NTRS2022

Florida Water Resources: Assessing Coastal Resiliency Across Florida's Aquatic Preserves in Response to Hurricane Forces

Remote sensing↗

NASA NTRSDate not supplied

Reports of Resilient Performance: Investigating Operators' Descriptions of Safety-producing Behaviors in the Aviation Safety Reporting System

While many existing taxonomies and frameworks provide a common vocabulary for describing how human operators fail in the context of sociotechnical systems, at present, there is no common vocabulary to describe how humans succeed. Such a framework would facilitate systematically collecting and analyzing data on how human performance can produce safety, not just how it can reduce safety. One potentially rich source of currently available information for exploring desired performance is the reports submitted to NASA’s Aviation Safety Reporting System (ASRS). These de-identified, confidential, and voluntary narrative reports are submitted by pilots, controllers, ground operators, and others within aviation operations. While these reports are primarily submitted to describe safety risks, incidents, and problems, they also often describe how those risks were mitigated, and provide a window into aspects of everyday work in aviation. These reports can be searched in a variety of ways. This paper describes methods for systematically examining ASRS narratives to understand how operators talk about their own resilient behaviors during adverse safety conditions and events. Guided by Erik Hollnagel’s Resilience Assessment Grid framework (i.e., anticipate, monitor, respond, learn), various approaches and tools for such inquiries are described. The approach, process, challenges, and suggestions to building an operator-based description of resilient performance are discussed, and tools to facilitate data analysis to maximize learning from these reports are described.

ASRS narratives↗

NASA NTRSDate not supplied

Reports of Resilient Performance: Investigating Operators' Descriptions of Safety-producing Behaviors in the Aviation Safety Reporting System

While many existing taxonomies and frameworks provide a common vocabulary for describing how human operators fail in the context of sociotechnical systems, at present, there is no common vocabulary to describe how humans succeed. Such a framework would facilitate systematically collecting and analyzing data on how human performance can produce safety, not just how it can reduce safety. One potentially rich source of currently available information for exploring desired performance is the reports submitted to NASA’s Aviation Safety Reporting System (ASRS). These de-identified, confidential, and voluntary narrative reports are submitted by pilots, controllers, ground operators, and others within aviation operations. While these reports are primarily submitted to describe safety risks, incidents, and problems, they also often describe how those risks were mitigated, and provide a window into aspects of everyday work in aviation. This paper describes an analysis of ASRS narratives to understand how operators talk about their own resilient behaviors during adverse safety conditions and events. Guided by Erik Hollnagel’s Resilience Assessment Grid framework (i.e., anticipate, monitor, respond, learn), we illustrate our approach and methodology with examples from reports. We also highlight some of the challenges and how further research is needed in developing a taxonomy of operators’ descriptions of resilient performance.

resilient behaviors↗

NASA NTRS2014

Modeling and Simulation of Upset-Inducing Disturbances for Digital Systems in an Electromagnetic Reverberation Chamber

This report describes a modeling and simulation approach for disturbance patterns representative of the environment experienced by a digital system in an electromagnetic reverberation chamber. The disturbance is modeled by a multi-variate statistical distribution based on empirical observations. Extended versions of the Rejection Samping and Inverse Transform Sampling techniques are developed to generate multi-variate random samples of the disturbance. The results show that Inverse Transform Sampling returns samples with higher fidelity relative to the empirical distribution. This work is part of an ongoing effort to develop a resilience assessment methodology for complex safety-critical distributed systems.

Torres-Pomales, Wilfredo↗

NASA NTRS2013

An Approach for the Assessment of System Upset Resilience

This report describes an approach for the assessment of upset resilience that is applicable to systems in general, including safety-critical, real-time systems. For this work, resilience is defined as the ability to preserve and restore service availability and integrity under stated conditions of configuration, functional inputs and environmental conditions. To enable a quantitative approach, we define novel system service degradation metrics and propose a new mathematical definition of resilience. These behavioral-level metrics are based on the fundamental service classification criteria of correctness, detectability, symmetry and persistence. This approach consists of a Monte-Carlo-based stimulus injection experiment, on a physical implementation or an error-propagation model of a system, to generate a system response set that can be characterized in terms of dimensional error metrics and integrated to form an overall measure of resilience. We expect this approach to be helpful in gaining insight into the error containment and repair capabilities of systems for a wide range of conditions.

Torres-Pomales, Wilfredo↗

NASA NTRS2015

Assessing and Promoting Functional Resilience in Flight Crews During Exploration Missions

The NASA Human Research Program works to mitigate risks to health and performance on extended missions. However, research should be directed not only to mitigating known risks, but also to providing crews with tools to assess and enhance resilience, as a group and individually. We can draw on ideas from complexity theory to assess resilience. The entire crew or the individual crewmember can be viewed as a complex system composed of subsystems; the interactions between subsystems are of crucial importance. Understanding the interactions can provide important information even in the absence of complete information on the component subsystems. Enabled by advances in noninvasive measurement of physiological and behavioral parameters, subsystem monitoring can be implemented within a mission and during training to establish baselines. Coupled with mathematical modeling, this can provide assessment of health and function. Since the web of physiological systems (and crewmembers) can be interpreted as a network in mathematical terms, we can draw on recent work that relates the structure of such networks to their resilience (ability to self-organize in the face of perturbation). Some of the many parameters and interactions to choose from include: sleep cycles, coordination of work and meal times, cardiorespiratory rhythms, circadian rhythms and body temperature, stress markers and cognition, sleep and performance, immune function and nutritional status. Tools for resilience are then the means to measure and analyze these parameters, incorporate them into models of normal variability and interconnectedness, and recognize when parameters or their couplings are outside of normal limits.

Shelhamer, M.↗

NASA NTRS2015

Assessing and Promoting Functional Resilience in Flight Crews During Exploration Missions

NASA plans to send humans to Mars in about 20 years. The NASA Human Research Program supports research to mitigate the major risks to human health and performance on extended missions. However, there will undoubtedly be unforeseen events on any mission of this nature - thus mitigation of known risks alone is not sufficient to ensure optimal crew health and performance. Research should be directed not only to mitigating known risks, but also to providing crews with the tools to assess and enhance resilience, as a group and individually. We can draw on ideas from complexity theory and network theory to assess crew and individual resilience. The entire crew or the individual crewmember can be viewed as a complex system that is composed of subsystems (individual crewmembers or physiological subsystems), and the interactions between subsystems are of crucial importance for overall health and performance. An understanding of the structure of the interactions can provide important information even in the absence of complete information on the component subsystems. This is critical in human spaceflight, since insufficient flight opportunities exist to elucidate the details of each subsystem. Enabled by recent advances in noninvasive measurement of physiological and behavioral parameters, subsystem monitoring can be implemented within a mission and also during preflight training to establish baseline values and ranges. Coupled with appropriate mathematical modeling, this can provide real-time assessment of health and function, and detect early indications of imminent breakdown. Since the interconnected web of physiological systems (and crewmembers) can be interpreted as a network in mathematical terms, we can draw on recent work that relates the structure of such networks to their resilience (ability to self-organize in the face of perturbation). There are many parameters and interactions to choose from. Normal variability is an established characteristic of a healthy physiological response. Healthy coupling has been investigated less extensively, but there are cases in which too tight or too loose coupling can be problematic. This might be in inter-individual behaviors, such as sleep cycles, coordination of work and meal times, and coupled motions during communication. Less apparent are couplings of physiological systems, nevertheless examples abound of coupled systems which might be monitored: cardio-respiratory rhythms; circadian rhythms, body temperature, and sleep; stress markers and cognition, sleep, and performance; profiles of biochemical markers related to immune function and nutritional status; sensorimotor aspects such as motion sickness, ataxia, reaction time, and manual control. Tools for resilience are then the means to measure and analyze these parameters, incorporate them into appropriate models of normal variability and interconnectedness, and recognize when parameters or their couplings are outside of normal limits. What to do when a problem is identified depends on its nature. Changes can be made to crew procedures, work pacing, interpersonal interactions, sleep cycles, meal timing and content, as guided by the model. Use and continued development of these methods could not only provide tools for resilience, but also meaningful autonomous work for the crew on an extended flight.

Shelhamer, Mark↗

NASA NTRS2015

Identifying Cross-Disciplinary Interactions to Assess and Promote Functional Resilience in Flight Crews During Exploration Missions

NASA supports research to mitigate risks to health and performance on extended missions. Typically these risks are investigated independently. In reality, physiological systems are tightly coupled, and related to psychological and inter-individual factors (team cohesion, conflict). We draw on ideas from network theory to assess these interactions and better design a research framework to address them.

Shelhamer, M.↗

NASA NTRS1989

A performance assessment of a byzantine resilient fault-tolerant computer

This report presents the results of a performance analysis of a quad-redundant Fault-Tolerant Processor (FTP). The FTP is a computing system specifically designed for applications where very high reliability is required. Examples of such applications are flight control systems, nuclear power systems, and spacecraft control systems. The FTP performance was analyzed in a hierarchical manner encompassing the hardware, the operating system, and the application. At the hardware level, the hardware organization and design was assessed in relation to system throughput and response. Analysis at the operating system level revealed that the scheduler took only 3.2 percent of each 40ms frame, while the redundancy management software took 10.4 percent. The application level performance was analyzed via a synthetic workload and a representative flight control model. The estimated throughput for this application was found to be 317.6 KIPS if not exercising the voter. Exercising the voter to ensure fault tolerance will diminish this number linearly as the number of votes is increased. This performance analysis method was proven effective by uncovering undesirable behavior and anomalies in the FTP system.

Young, Steven D.↗

NASA NTRS2010

Resilience of Alaska's Boreal Forest to Climatic Change

This paper assesses the resilience of Alaska s boreal forest system to rapid climatic change. Recent warming is associated with reduced growth of dominant tree species, plant disease and insect outbreaks, warming and thawing of permafrost, drying of lakes, increased wildfire extent, increased postfire recruitment of deciduous trees, and reduced safety of hunters traveling on river ice. These changes have modified key structural features, feedbacks, and interactions in the boreal forest, including reduced effects of upland permafrost on regional hydrology, expansion of boreal forest into tundra, and amplification of climate warming because of reduced albedo (shorter winter season) and carbon release from wildfires. Other temperature-sensitive processes for which no trends have been detected include composition of plant and microbial communities, long-term landscape-scale change in carbon stocks, stream discharge, mammalian population dynamics, and river access and subsistence opportunities for rural indigenous communities. Projections of continued warming suggest that Alaska s boreal forest will undergo significant functional and structural changes within the next few decades that are unprecedented in the last 6000 years. The impact of these social ecological changes will depend in part on the extent of landscape reorganization between uplands and lowlands and on policies regulating subsistence opportunities for rural communities.

Chapin, F. S., III↗

NASA NTRS2023

Psychophysiological Research Methods to Assess Airline Flight Crew Resilient Performance in High-Fidelity Flight Simulation Scenarios

New concepts in aviation system safety thinking have emerged to consider not only what may go wrong, but also what can be learned when things go right. This approach forms a more comprehensive approach to system safety thinking. A need exists for methods to enable a better understanding of human contributions to aviation safety and how they may inform Safety Management Systems (SMS). A high-fidelity 737-800 simulation study was conducted to study how current type-rated commercial airline flight crews anticipate, monitor, respond to, and learn from expected and unexpected disturbances during line operations. A number of dependent measures were collected that included traditional SMS data types, but also non-traditional safety data to include multiple psychophysiological metrics. This paper describes the psychophysiological measures results that evinced the capability of measures to help identify resilient flight crews. Implications for future research and design of future In-time Aviation Safety Management Systems are discussed.

Psychophysiology↗

NASA NTRS2023

Psychophysiological Research Methods to Assess Airline Flight Crew Resilient Performance in High-Fidelity Flight Simulation Scenarios

Psychophysiology↗

NASA NTRSDate not supplied

Can We Model Forest Demography Globally? Benchmarking of State-of-the-Art Demographic DGVMs

Forests in Dynamic Global Vegetation Models (DGVMs) have historically been simulated as area-averaged plant functional types in each gridcell instead of representing communities of trees of different sizes and ages (demography). Just as the behaviour of a tree differs according to its ontogeny, so the behaviour of forests is known to differ depending on their demography. Accurately simulating demography is therefore key in order to address questions on afforestation and management strategies, as well as assessments of resilience of forests to disturbances such as drought and fire or diversity changes after a disturbance. Ultimately, demography determines the overall forest biomass in natural forests and is a key arbiter of growth and mortality rates. DGVMs are now able to simulate size and age structure of the trees in forests. However, these models have so far not been benchmarked alongside each other. We evaluate 6 DGVMs (BiomeE, CABLE-POP, FATES, LPJ-GUESS, JULES-RED, ORCHIDEE) against observations on regrowth dynamics as well as natural forests at boreal, temperate and tropical sites. We examine whether the models capture observed regrowth dynamics after disturbance, well-known stand size structure and well-established processes such as self-thinning. We outline the planned route forward towards a standardised international benchmarking framework for demographic DGVMs.

Dynamic Global Vegetation Models↗