Search NASA⌕ Search

SEARCH · Search NASA

Results for “Error Mitigation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

Towards Test Driven Development for Computational Science with pFUnit

Developers working in Computational Science & Engineering (CSE)/High Performance Computing (HPC) must contend with constant change due to advances in computing technology and science. Test Driven Development (TDD) is a methodology that mitigates software development risks due to change at the cost of adding comprehensive and continuous testing to the development process. Testing frameworks tailored for CSE/HPC, like pFUnit, can lower the barriers to such testing, yet CSE software faces unique constraints foreign to the broader software engineering community. Effective testing of numerical software requires a comprehensive suite of oracles, i.e., use cases with known answers, as well as robust estimates for the unavoidable numerical errors associated with implementation with finite-precision arithmetic. At first glance these concerns often seem exceedingly challenging or even insurmountable for real-world scientific applications. However, we argue that this common perception is incorrect and driven by (1) a conflation between model validation and software verification and (2) the general tendency in the scientific community to develop relatively coarse-grained, large procedures that compound numerous algorithmic steps.We believe TDD can be applied routinely to numerical software if developers pursue fine-grained implementations that permit testing, neatly side-stepping concerns about needing nontrivial oracles as well as the accumulation of errors. We present an example of a successful, complex legacy CSE/HPC code whose development process shares some aspects with TDD, which we contrast with current and potential capabilities. A mix of our proposed methodology and framework support should enable everyday use of TDD by CSE-expert developers.

pFUnit↗

R2U2 in Space: System and Software Health Management for Small Satellites

In order for small but complex systems like rovers, SmallSats, or Unmanned Aircraft (UAS) to operate autonomously, they must have a real-time solution for assessing their own system health. System and Software Health Management (SHM) enables better detection of faulty sensors and software problems, and enables better fault management including mitigation of unpredicted fault scenarios in the absence of a human on-board. In recent work, we have developed a Responsive, Realizable, Unobtrusive Unit (R2U2) for on-board SHM of autonomous UAS and demonstrated its ability to detect faults during flight time. These faults, from sensor failures, to software problems, to malicious security attacks, can present as transient temporal faults that even humans are challenged to find. An R2U2 congfiuration is a modular combination of multiple types of temporal logic runtime observers with fault-specic Bayesian Nets and sensor filters. R2U2 reasons about both on-board hardware and software components; R2U2 itself can be instantiated as an independent FPGA (Field-Programmable Gate Array)-based conguration or as a software component running independently from other software on-board. Small satellites, such as CubeSats, also require on-board SHM and failure mitigation, as limited telemetry bandwidth does not allow the transmission of the entire system state for ground-based health management. However, the autonomous operation of satellites brings a set of challenges different from UAS, including the effects of radiation on non-rad-hard, low-cost components, and the harsher environment of space. We surmise that a new extension of R2U2 could be adapted to help better detect, for example, radiation errors in cheaper COTS (Commercial Off the Shelf) (not rad-hard) components often used in small space systems. Since small satellites often operate in coordination, we will also examine new ways of distributed monitoring of their communication and cooperation and real-time detection of off-nominal situations utilizing multiple satellites. This talk will discuss preliminary work and ideas for building on terrestrial success of system and software health management for the harsher, and differently challenging, environment of space.

Runtime Verification & Validation↗

Deployment of Traditional and Hybrid Machine Learning for Critical Heat Flux Prediction in the CTF Thermal-Hydraulics Code

Critical heat flux (CHF) marks the transition from nucleate to film boiling, where heat transfer to the working fluid can rapidly deteriorate. Accurate CHF prediction is essential for efficiency, safety, and preventing equipment damage, particularly in nuclear reactors. Although widely used, empirical correlations frequently exhibit discrepancies when compared to experimental data, limiting their reliability in diverse operational conditions. Traditional machine learning (ML) approaches have demonstrated potential for CHF prediction but often suffer from limited interpretability, data scarcity, and insufficient knowledge of physical principles. Hybrid model approaches, which combine data-driven ML with base models, mitigate these concerns by incorporating prior knowledge of the domain. This study integrates an externally trained purely data-driven ML model and two hybrid models (using the Biasi and Bowring CHF correlations) within the CTF subchannel code via a custom Fortran framework. Performance was evaluated using two validation cases: a subset of the Nuclear Regulatory Commission (NRC) CHF database and the Bennett dryout experiments. In both cases, the hybrid models demonstrated significantly lower error metrics compared to conventional empirical correlations, with the best models often reducing relative error by about 5 percentage points. The pure ML model achieved comparable accuracy, outperforming the hybrid Biasi model in the NRC test case (3.3% versus 5.5% relative error) but exhibiting slightly higher error against the hybrid Bowring model in the Bennett test case (7.7% versus 6.1%). Trend analysis of error parity indicated that ML-based models reduced the tendency for CHF overprediction, improving overall accuracy. These results demonstrate that ML-based CHF models can be effectively integrated into subchannel codes and could potentially increase performance compared to conventional methods.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Delocalization error poisons the density-functional many-body expansion

The many-body expansion is a fragment-based approach to large-scale quantum chemistry that partitions a single monolithic calculation into manageable subsystems. This technique is increasingly being used as a basis for fitting classical force fields to electronic structure data, especially for water and aqueous ions, and for machine learning. Here, we show that the many-body expansion based on semilocal density functional theory affords wild oscillations and runaway error accumulation for ion–water interactions, typified by F − (H 2 O) N with N ≳ 15. We attribute these oscillations to self-interaction error in the density-functional approximation. The effect is minor or negligible in small water clusters, explaining why it has not been noticed previously, but grows to catastrophic proportion in clusters that are only moderately larger. This behavior can be counteracted with hybrid functionals but only if the fraction of exact exchange is ≳50%, whereas modern meta-generalized gradient approximations including ωB97X-V, SCAN, and SCAN0 are insufficient to eliminate divergent behavior. Other mitigation strategies including counterpoise correction, density correction (i.e., exchange–correlation functionals evaluated atop Hartree–Fock densities), and dielectric continuum boundary conditions do little to curtail the problematic oscillations. In contrast, energy-based screening to cull unimportant subsystems can successfully forestall divergent behavior. These results suggest that extreme caution is warranted when the many-body expansion is combined with density functional theory.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Broadband Achromatic Phase Shifter for a Nulling Interferometer

Nulling interferometry is a technique for imaging exoplanets in which light from the parent star is suppressed using destructive interference. Light from the star is divided into two beams and a phase shift of radians is introduced into one of the beams. When the beams are recombined, they destructively interfere to produce a deep null. For monochromatic light, this is implemented by introducing an optical path difference (OPD) between the two beams equal to lambda/2, where lambda is the wavelength of the light. For broadband light, however, a different phase shift will be introduced at each wavelength and the two beams will not effectively null when recombined. Various techniques have been devised to introduce an achromatic phase shift a phase shift that is uniform across a particular bandwidth. One popular technique is to use a series of dispersive elements to introduce a wavelength-dependent optical path in one or both of the arms of the interferometer. By intelligently choosing the number, material and thickness of a series of glass plates, a nearly uniform, arbitrary phase shift can be introduced between two arms of an interferometer. There are several constraints that make choosing the number, type, and thickness of materials a difficult problem, such as the size of the bandwidth to be nulled. Several solutions have been found for bandwidths on the order of 20 to 30 percent (Delta(lambda)/lambda(sub c)) in the mid-infrared region. However, uniform phase shifts over a larger bandwidth in the visible regime between 480 to 960 nm (67 percent) remain difficult to obtain at the tolerances necessary for exoplanet detection. A configuration of 10 dispersive glass plates was developed to be used as an achromatic phase shifter in nulling interferometry. Five glass plates were placed in each arm of the interferometer and an additional vacuum distance was also included in the second arm of the interferometer. This configuration creates a phase shift of pi radians with an average error of 5.97 x 10(exp -8) radians and standard deviation of 3.07 x 10(exp -4) radians. To reduce ghost reflections and interference effects from neighboring elements, the glass plates are tilted such that the beam does not strike each plate at normal incidence. Reflections will therefore walk out of the system and not contribute to the intensity when the beams are recombined. Tilting the glass plates, however, introduces several other problems that must be mitigated: (1) the polarization of a beam changes when refracted at an interface at non-normal incidence; (2) the beam experiences lateral chromatic spread as it traverses multiple glass plates; (3) at each surface, wavelength- dependent intensity losses will occur due to reflection. For a fixed angle of incidence, each of these effects must be balanced between each arm of the interferometer in order to ensure a deep null. The solution was found using a nonlinear optimization routine that minimized an objective function relating phase shift, intensity difference, chromatic beam spread, and polarization difference to the desired parameters: glass plate material and thickness. In addition to providing a uniform, broadband phase shift, the configuration achieves an average difference in intensity transmission between the two arms of the interferometer of 0.016 percent with a standard deviation of 3.64 x 10(exp -4) percent, an average difference in polarization between the two arms of the interferometer of 5.47 x 10(exp -5) percent with a standard deviation of 1.57 x 10(exp -6) percent, and an average chromatic beam shift between the two arms of the interferometer of -47.53 microns with a wavelength-by-wavelength spread of 0.389 microns.

Bolcar, Matthew R.↗

A Near-Real-Time Model for Predicting Electricity Disruptions in Texas During Winter Storms

There has been an increase in extreme weather events, posing a threat to power grid systems, potentially influenced by factors such as population growth, changes in ecosystems, land cover, and land use in the service area, as well as the growth of certain vegetation types. This research seeks to develop a predictive model to mitigate potential damages caused by future winter storms. This research utilizes the Light Gradient Boosting Machine (LightGBM), incorporating the number of power outages experienced at the county level, geographic details, weather information, and lagged outage and lagged weather data. The developed models were broadly divided into two groups, with six models in each group - one group without optimization and another with optimization, totaling 12 trained models. For model optimization, Bayesian optimization was employed using Root Mean Squared Error (RMSE) as the objective function. In results, when comparing Group 2 (the optimized group) with Group 1 (the non-optimized group), it was found that optimization did not always lead to a reduction in RMSE and Mean Absolute Error (MAE). However, in terms of Mean Directional Accuracy (MDA), while all results in Group 1 were below the baseline accuracy of 0.33, all results in Group 2 exceeded 0.33, with some cases showing an increase of more than three times the baseline. The results indicated that, in the optimized model group, Population and Pressure were the most influential factors when using current weather data and geographical information. When using lagged data, lagged recorded outages and lagged Pressure emerged as the most significant factors. Among the 12 developed models, the L-1-2-O model showed the lowest RMSE and MAE, as well as the highest accuracy, with values of 390.62 households and 168.13 households, respectively. To normalize the RMSE and MAE values, each metric was divided by the average number of households among the counties in Texas. For the L-1-2-O model, the scaled RMSE was 0.88% and the scaled MAE was 0.38%. In terms of MDA, which indicates the accuracy of the prediction direction, the L-1-O model achieved the highest score of 0.41. Although this study focused on Texas, which suffered the greatest impact from the winter storms in 2021, with additional validation, the methodology used in this research could be applied to other regions.

Lee, Jangjae [Texas A & M Univ., College Station, ↗

Enhancing Coherence Limits in Superconducting Quantum Systems for Computing and Sensing

This talk will highlight recent efforts at the SQMS Center to develop qudit-based quantum computing architectures using superconducting three-dimensional (3D) cavities, as well as the use of these ultra-coherent cavities for quantum sensing. I will present systematic studies of materials and devices aimed at identifying and mitigating the dominant sources of decoherence—including two-level systems (TLS), quasiparticles, and other noise mechanisms—in both transmons and 3D cavities. These investigations include microwave loss characterization of niobium, tantalum, aluminum, their native oxides, and substrate materials such as silicon and sapphire. By combining measurements on qubits and cavities, we disentangle subsystem-specific loss mechanisms and establish a hierarchy of mitigation strategies, leading to transmon coherence times exceeding one millisecond. I will also discuss studies of quasiparticle dynamics, including quasiparticle bursts observed in qubits operated both above ground and at the Gran Sasso underground laboratory, and the observation that applied magnetic fields can suppress temporal T₁ fluctuations. Building on these advances, we demonstrate a record-coherence two-cell cavity-qudit system with coherence times exceeding 20 milliseconds. Leveraging tunable sideband interactions together with error-resilient protocols, including measurement-based error correction and post-selection, we achieve high-fidelity quantum state control, including the preparation of Fock states up to N=20 with fidelities above 95% and the generation of high-fidelity two-mode entangled states. Finally, I will discuss how these ultra-coherent quantum systems are enabling emerging quantum sensing applications, including searches for dark matter and gravitational waves.

Roy, Tanay [Fermilab] (ORCID:000000019442862X)↗

Assessing the Viability of Using GEOS-Forecast Product for Landslides Forecasting: A Step Toward Early Warning System

Landslides across the globe are mostly triggered by extreme rainfall events affecting infrastructure, transportation and livelihoods. The risks are rarely quantified due to lack of data, analytical skills and limited modeling techniques. Knowledge of local to global scale landslide risks provides communities and national agencies the ability to adapt disaster management practices to mitigate and recover from these hazards. In order to minimize the risks and improve characterization of community resilience to landslides, it is vital to have reliable information about the factors triggering landslides such as rainfall, well ahead in time. Forecasting potential landslide activity and impacts can be achieved through reliable precipitation forecast models. However, it is challenging because of the temporal and spatial variability of precipitation, an important factor in triggering landslides. Evaluation of the precipitation field, associated errors, and sampling uncertainties is integral for development of efficient and reliable landslide forecasting and early warning system. This study develops a methodology to assess the viability of using a precipitation field provided by a global model and its potential integration in the landslide forecasting system. The study focuses on the comparison between the IMERG (Integrated Multi-satellitE Retrievals for Global Precipitation Mission) and GEOS (NASA Goddard Earth Observing System)-Forecast product over contiguous United States (CONUS). GEOS model assimilates new observations every 6 hours, at 00, 06, 12, and 18 UTC. The framework is tested on the GEOS-Forecast Model initialized at 00 UTC using daily IMERG early product as reference using both categorical and continuous statistics. The categorical statistics includes the probability of detection (POD), success ratio (SR), critical success index (CSI), and the hit bias. Continuous statistics such as correlation, normalized standard deviation, and root-mean-square error are also evaluated. Overall, GEOS-Forecast precipitation field over the analysis period (~1 year) show underestimation with respect to IMERG early for the daily accumulated rainfall. However, the probability distribution function and cumulative distribution function of both show similar patterns. In terms of correlations, POD, SR, CSI, hit bias, the performance varies with respect to the rainfall threshold used.

Sana Khan↗

Evaluation of the Linear Aerospike SR-71 Experiment (LASRE) Oxygen Sensor

The Linear Aerospike SR-71 Experiment (LASRE) was a propulsion flight experiment for advanced space vehicles such as the X-33 and reusable launch vehicle. A linear aerospike rocket engine was integrated into a semi-span of an X-33-like lifting body shape (model), and carried on top of an SR-71 aircraft at NASA Dryden Flight Research Center. Because no flight data existed for aerospike nozzles, the primary objective of the LASRE flight experiment was to evaluate flight effects on the engine performance over a range of altitudes and Mach numbers. Because it contained a large quantity of energy in the form of fuel, oxidizer, hypergolics, and gases at very high pressures, the LASRE propulsion system posed a major hazard for fire or explosion. Therefore, a propulsion-hazard mitigation system was created for LASRE that included a nitrogen purge system. Oxygen sensors were a critical part of the nitrogen purge system because they measured purge operation and effectiveness. Because the available oxygen sensors were not designed for flight testing, a laboratory study investigated oxygen-sensor characteristics and accuracy over a range of altitudes and oxygen concentrations. Laboratory test data made it possible to properly calibrate the sensors for flight. Such data also provided a more accurate error prediction than the manufacturer's specification. This predictive accuracy increased confidence in the sensor output during critical phases of the flight. This paper presents the findings of this laboratory test.

Ennix, Kimberly A.↗

Evaluation of the Linear Aerospike SR-71 Experiment (LASRE) Oxygen Sensor

The Linear Aerospike SR-71 Experiment (LASRE) was a propulsion flight experiment for advanced space vehicles such as the X-33 and reusable launch vehicle. A linear aerospike rocket engine was integrated into a semi-span of an X-33-like lifting body shape (model), and carried on top of an SR-71 aircraft at NASA Dryden Flight Research Center. Because no flight data existed for aerospike nozzles, the primary objective of the LASRE flight experiment was to evaluate flight effects on the engine performance over a range of altitudes and Mach numbers. Because it contained a large quantity of energy in the form of fuel, oxidizer, hypergolics, and gases at very high pressures, the LASRE propulsion system posed a major hazard for fire or explosion. Therefore, a propulsion-hazard mitigation system was created for LASRE that included a nitrogen purge system. Oxygen sensors were a critical part of the nitrogen purge system because they measured purge operation and effectiveness. Because the available oxygen sensors were not designed for flight testing, a laboratory study investigated oxygen-sensor characteristics and accuracy over a range of altitudes and oxygen concentrations. Laboratory test data made it possible to properly calibrate the sensors for flight. Such data also provided a more accurate error prediction than the manufacturer's specification. This predictive accuracy increased confidence in the sensor output during critical phases of the flight. This paper presents the findings of this laboratory test.

Ennix, Kimberly A.↗

Active Correction of Aberrations of Low-Quality Telescope Optics

A system of active optics that includes a wavefront sensor and a deformable mirror has been demonstrated to be an effective means of partly correcting wavefront aberrations introduced by fixed optics (lenses and mirrors) in telescopes. It is envisioned that after further development, active optics would be used to reduce wavefront aberrations of about one wave or less in telescopes having aperture diameters of the order of meters or tens of meters. Although this remaining amount of aberration would be considered excessive in scientific applications in which diffraction-limited performance is required, it would be acceptable for free-space optical- communication applications at wavelengths of the order of 1 m. To prevent misunderstanding, it is important to state the following: The technological discipline of active optics, in which the primary or secondary mirror of a telescope is directly and dynamically tilted, distorted, and/or otherwise varied to reduce wavefront aberrations, has existed for decades. The term active optics does not necessarily mean the same thing as does adaptive optics, even though active optics and adaptive optics are related. The term "adaptive optics" is often used to refer to wavefront correction at speeds characterized by frequencies ranging up to between hundreds of hertz and several kilohertz high enough to enable mitigation of adverse effects of fluctuations in atmospheric refraction upon propagation of light beams. The term active optics usually appears in reference to wavefront correction at significantly lower speeds, characterized by times ranging from about 1 second to as long as minutes. Hence, the novelty of the present development lies, not in the basic concept of active or adaptive optics, but in the envisioned application of active optics in conjunction with a deformable mirror to achieve acceptably small wavefront errors in free-space optical communication systems that include multi-meter-diameter telescope mirrors that are relatively inexpensive because their surface figures are characterized by errors as large as about 10 waves. Figure 1 schematically depicts the apparatus used in an experiment to demonstrate such an application on a reduced scale involving a 30-cm-diameter aperture.

Hemmati, Hamid↗

Physics Informed Neural Nets for Systems Health Management

To facilitate and solve the prediction problem, awareness of the current health state of the system is key, since it is necessary to perform condition-based predictions. To accurately predict the future state of any system, it is required to possess knowledge of its current health state and future operational conditions. Development in data-driven algorithms in regression of complex nonlinear functions and classification tasks have generated a growing interest in artificial intelligence for industrial applications. Complex multi-physics models as well as digital twins, once purely built on physics and corresponding simplified lumped parameter iterations, can now benefit from machine learning algorithms to mitigate the lack of understanding of some complex behavior. The research work presents application of physics-informed neural nets application to a representative electric powertrain for unmanned aerial vehicles. The model is composed of physics-derived and empirical equations, integrated with connected networks that are strategically placed within the model to substitute equations that are subject to large uncertainty. Polynomial fit driven by heuristics or empirical observations can be substituted by more flexible networks that can minimize the error between model predictions and observations without being restricted to a predefined functional form. This modeling strategy allows training of networks deep inside the model and unknown parameters in a single learning stage.

Physics Informed↗

A chemical kinetic analysis of knock propensity of methanol-to-gasoline fuel

Production of low carbon gasoline-like fuels such as methanol-to-gasoline (MTG) is a promising approach to achieve rapid greenhouse gas emission reduction of the transportation sector. Despite the fact that gasoline that meets the ASTM D4814 standard for automotive spark-ignition engine fuel can be readily produced from these processes, it is unclear how the composition of MTG may affect engine performance and emissions. Here, in this paper, a surrogate for an MTG is used to numerically study the effects of gasoline composition on knock propensity and on the sensitivity of knock to thermal and fuel stratification, to oxygen dilution and to nitric oxide from exhaust gas recirculation of residual gases. Simulations were performed in ANSYS CHEMKIN-PRO using a comprehensive chemical kinetic mechanism for gasoline surrogates, and results of the MTG surrogate were compared against those of a petroleum-based regular E10 gasoline, termed PACE-20. A premium-grade MTG fuel was also formulated by adding ethanol to the MTG surrogate, and results were compared against those of four premium-grade, gasoline-like fuels representative of future alternative gasoline formulations. Surrogates and mechanism were evaluated by comparison against experimental engine data, and the model showed high accuracy at stoichiometric conditions (mean absolute error of ignition timing equal to 1.46 crank angle degrees) but larger deviations at lean conditions (mean absolute error of ignition timing equal to 5.52 crank angle degrees). Despite the fact that the MTG surrogate has a RON 1.1 units higher than that of PACE-20, it may show higher knock propensity at medium temperature conditions due to a less intense NTC behavior. MTG autoignition was more temperature- and equivalence ratio-sensitive than that of PACE20, suggesting that MTG can benefit more from naturally-occurring thermal stratification or from induced fuel stratification of the end gas to mitigate knock intensity. The sensitivity of autoignition reactivity to oxygen dilution and to NO concentration was higher for MTG than for regular gasoline at medium loads, but the opposite trend was observed at high loads due to the effect of pressure on the low-temperature chemistry of regular gasoline. Approximately 14 % vol ethanol content was required to upgrade the octane rating of MTG from regular grade to premium grade. Adding 13.6 % vol ethanol made the fuel autoignition less sensitive to both oxygen dilution and NO content (ignition time varies approx. 17 % and 50 % less with oxygen dilution and NO addition, respectively, when adding ethanol at high engine loads).

02 PETROLEUM↗

Predicting weather impacts on corn production in a data-limited region using a transfer learning approach

The stability of food supply and prices may depend more on annual changes in yields from year-to-year variability in weather than on longer-term average changes from changing climatic conditions. However, the absence of high-quality data on crop yields at fine spatial resolutions in many regions of the world makes it challenging to statistically model their response to interannual variability in weather patterns. Therefore, there is a need for empirical methods that can project annual crop yield changes even in limited data regions. Here, we propose a transfer learning algorithm that uses high spatial resolution data from one region to project yields in another region with more limited data. The goal of our work is to understand what data types can be beneficial for transferring learning from a source region to a very different target region with more limited data. We utilize Long Short-Term Memory to develop a transfer learning model that is trained on historical county-level corn yield in the United States and predicts district-level corn yield variations in India. Even using smaller amounts of data in India, simulating a data-scarce region, we achieve an average root mean square error of 0.48 bu acre−1 in predicting interannual yield variations. Using Shapley values to interpret results, we explore the contribution of the different weather parameters to interannual yield variability and find a larger influence of precipitation-related variables. Our study demonstrates the usefulness of this method for transferring models of weather impacts on crop yields trained on a data-rich country to one with more limited data. It suggests the potential of applying the transfer learning model to mitigate the need for extensive raw data globally.

Vishwakarma, Srishti [ORNL] (ORCID:000000031674419↗

Reliability-Aware Requirements Development for Autonomy Software

Autonomy is the ability of a system to make decisions and take actions in the presence of uncertainty. Validating autonomy, therefore, is a matter of validating that the system makes intelligent decisions even when there might be discrepancies between the observed and the expected state of the world as well as when the possible outcome of each of the possible courses of action is uncertain. During the requirements engineering phase, the functions, including those that are required to be autonomous and their expected behavior are specified. However, in the case of autonomous software system, it is challenging to specify all possible scenarios that the software may encounter. Additionally, since autonomous behaviors cannot always be fully predetermined, it is difficult to reason about their completeness and correctness. While these challenges are also faced with non-autonomous system, they are more prevalent for autonomous system due to their complexity and emergent behavior. Our efforts have been three-fold. On one hand, we have developed a goal-based method for requirements decomposition. We have embedded this approach into a higher-level systems engineering framework and then developed methods for decision and reliability analysis within this framework. And finally, we use simulation analysis to validate the more theoretical methods and provide a feedback mechanism. The decision analysis approach (DA) helps in identifying and mitigating the run-time risks, by bringing to the forefront the uncertainties, decisions, interactions, and other factors that may cause autonomous software to make erroneous decisions. The DA framework is used to quantify, for each decision that the software can make, failure risk due to uncertainties. The information about the key decisions and circumstances that can cause autonomous system to make incorrect decisions are used to generate test scenarios to be run in a simulator to ensure that the system can handle error-prone circumstances. The results or outcomes from decisions, based on the simulated scenarios, can then be leveraged to further gain insight of the assured system. We combine a goal-based approach with simulation analysis to facilitate requirements development for autonomous systems and further provide a method for run-time systems level reliability considerations during the autonomous software development process. The DA and the reliability analysis methods provide a formalism for the consideration of uncertainty in the run time decision-making process for autonomous software. This formalism considers the uncertainty involved in the outcome of different courses of action, in terms of performance and cost, as well as a method to consider the system level reliability implications. System level reliability considerations for autonomous software decision making contribute to the satisfaction of the system level goals over the lifecycle of a given mission. We demonstrate our approach using a hypothetical rover path planning example. The requirements for our rover simulator are based on existing literature about Mars rovers and lessons learned from real world observations at JPL. The specifics of the autonomy design for the Mars rovers, that have not been previously cleared for external release, are not used for our demonstrations.

Lindvall, Mikael↗

Cognition in Space Workshop: Metrics and Models - 1

"Cognition in Space Workshop I: Metrics and Models" was the first in a series of workshops sponsored by NASA to develop an integrated research and development plan supporting human cognition in space exploration. The workshop was held in Chandler, Arizona, October 25-27, 2004. The participants represented academia, government agencies, and medical centers. This workshop addressed the following goal of the NASA Human System Integration Program for Exploration: to develop a program to manage risks due to human performance and human error, specifically ones tied to cognition. Risks range from catastrophic error to degradation of efficiency and failure to accomplish mission goals. Cognition itself includes memory, decision making, initiation of motor responses, sensation, and perception. Four subgoals were also defined at the workshop as follows: (1) NASA needs to develop a human-centered design process that incorporates standards for human cognition, human performance, and assessment of human interfaces; (2) NASA needs to identify and assess factors that increase risks associated with cognition; (3) NASA needs to predict risks associated with cognition; and (4) NASA needs to mitigate risk, both prior to actual missions and in real time. This report develops the material relating to these four subgoals.

Woolford, Barbara↗

Human Factors in Training

Future space missions will be significantly longer than current shuttle missions and new systems will be more complex than current systems. Increasing communication delays between crews and Earth-based support means that astronauts need to be prepared to handle the unexpected on their own. As crews become more autonomous, their potential span of control and required expertise must grow to match their autonomy. It is not possible to train for every eventuality ahead of time on the ground, or to maintain trained skills across long intervals of disuse. To adequately prepare NASA personnel for these challenges, new training approaches, methodologies, and tools are required. This research project aims at developing these training capabilities. By researching established training principles, examining future needs, and by using current practices in space flight training as test beds, both in Flight Controller and Crew Medical domains, this research project is mitigating program risks and generating templates and requirements to meet future training needs. Training efforts in Fiscal Year 08 (FY08) strongly focused on crew medical training, but also began exploring how Space Flight Resource Management training for Mission Operations Directorate (MOD) Flight Controllers could be integrated with systems training for optimal Mission Control Center (MCC) operations. The Training Task addresses Program risks that lie at the intersection of the following three risks identified by the Project: (1) Risk associated with poor task design (2) Risk of error due to inadequate information (3) Risk associated with reduced safety and efficiency due to poor human factors design

Barshi, Immanuel↗