Search NASA⌕ Search

SEARCH · Search NASA

Results for “uncertainty in complex systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

Affordable Development Strategy for NEP Nuclear Systems

One nuclear electric propulsion (NEP) reactor systems under consideration is a hydride moderated thermal spectrum reactor fueled by high assay low enriched uranium (HALEU). While such a reactor is expected to yield the lightest HALEU reactor design, its development challenges grow exponentially with increasing mission demands, most notably power output, specific weight of the overall system (which may require operation at temperatures exceeding 1200 K), service lifetime, and human-rated reliability. Two of the greatest cost drivers are full-powered nuclear demonstrations and extensive material development campaigns, so it is important to consider options that can minimize the need for or complexity of such tasks. This paper discusses a structured framework being developed for assessing how NEP design choices, such as materials selection, neutronic features, and heat-removal technologies, can translate into project risk and how project performance goals can be traded with development cost.Reactors operating at high temperatures often require cutting-edge heat transfer technologies and creep-resistant materials. Use of new materials in high temperature reactors brings additional complication beyond those common to any new space materials development campaign. For example, such materials may not possess necessary neutronic cross-sectional or neutronic irradiation data. Similarly, use of new materials may significantly influence core neutronics; in some extreme cases, neutronic reactivity feed-back of certain new materials can vary during their service life as radiation damage impacts the scattering cross-section. In an affordable development approach, high fidelity modeling and simulation tools are used to identify and characterize potential ‘knees-in-the-curves’ in the relationship that exists between the mission characteristics and the project risk. Of particular significance is use of modern uncertainty management and variance reduction methods to perform gap analyses that feed into phenomena identification and ranking tables (PIRT) commonly used to communicate nuclear readiness levels. Model-based measurements techniques are used to design sub-scale experiments as a substitute to minimize orcompletely eliminate the need for nuclear demonstrations.This paper will describe the approach and present preliminary results. It will lay the groundwork for developing a set of metrics that can be broadly characterized as system nuclear readiness levels and advancement degree of difficulty for nuclear systems. Equally importantly, a goal of this paper is to initiate a dialogue among stakeholders on what is the sufficient level of maturity that is required for launching a demonstration unit.

Dasari V Rao↗

Evaluating Algorithm Performance Metrics Tailored for Prognostics

Prognostics has taken a center stage in Condition Based Maintenance (CBM) where it is desired to estimate Remaining Useful Life (RUL) of the system so that remedial measures may be taken in advance to avoid catastrophic events or unwanted downtimes. Validation of such predictions is an important but difficult proposition and a lack of appropriate evaluation methods renders prognostics meaningless. Evaluation methods currently used in the research community are not standardized and in many cases do not sufficiently assess key performance aspects expected out of a prognostics algorithm. In this paper we introduce several new evaluation metrics tailored for prognostics and show that they can effectively evaluate various algorithms as compared to other conventional metrics. Specifically four algorithms namely; Relevance Vector Machine (RVM), Gaussian Process Regression (GPR), Artificial Neural Network (ANN), and Polynomial Regression (PR) are compared. These algorithms vary in complexity and their ability to manage uncertainty around predicted estimates. Results show that the new metrics rank these algorithms in different manner and depending on the requirements and constraints suitable metrics may be chosen. Beyond these results, these metrics offer ideas about how metrics suitable to prognostics may be designed so that the evaluation procedure can be standardized. 1

Saxena, Abhinav↗

Lucy Optical Navigation Performance During The (152830) Dinkinesh Encounter

The Lucy Jupiter-Trojan asteroid mission launched in November 2021. Its original mission concept included six small-body encounters over its 12-year primary mission. In the fall of 2022, an additional target of opportunity encounter was proposed to be executed in the fall of 2023. The encounter with (152830) Dinkinesh (previously 1999 VD57) presented myriad imaging, navigation, engineering, and planning challenges, as well as a chance to exercise and further refine the Optical NavigationSystem concept of operations, interfaces, and tools. Dinkinesh would be the smallest and dimmest target Lucy would encounter, with a higher uncertainty in these physical parameters than for other targets. While the Op Nav system and instruments carried a high amount of heritage from the New Horizons and OSIRIS-REx missions, this would be the first use of these systems on Lucy for navigation purposes. Despite these additional challenges, the Lucy Dinkinesh encounter was a resounding success throughout which the navigational system exceeded requirements.1Optical Navigation was successfully performed and fed into the orbit determination and trajectory maneuver activities up to the final knowledge update. The Dinkinesh encounter also proved to be greatly scientifically interesting, if not additionally challenging, as the Dinkinesh system was discovered to be a binary system through imaging during closest approach, and the secondary body was itself found to be a contact binary. This added complexity notwithstanding, the OpNav and OD teams were able to re-construct the close-approach trajectory of Dinkinesh in cooperation and concert with the Lucy Science Team’s shape modelling efforts.

Erik Lessac-Chenen↗

Investigation of the Potential for Lidar & Polarimeter Combined Aerosol Retrievals Using Various Instrument Combinations

As a scientific community, we are motivated to achieve better observational capabilities for aerosols, to reduce uncertainties about aerosol’s role in climate. Encouraged by the National Academies Decadal Survey, many are looking to the synergy of lidar and polarimeter as a means of achieving improved measurements. Polarimetric observations of total-column radiances have excellent sensitivity to aerosol size distribution and absorption properties. Active lidar measurements have fewer wavelengths and view angles and therefore more limited sensitivity to aerosol microphysical properties such as complex refractive index. Yet the advantage of vertically resolved profiles is game-changing, especially given that models contain significant uncertainty about the vertical distribution of aerosol and that polarimeter and other passive retrievals must make assumptions about vertical distribution which can impact performance. To optimize the synergy, a joint polarimeter + lidar mission requires a joint retrieval. However, the exact instruments that will be launched on a future satellite are unknown, and the capabilities of polarimeters and lidars cover a large range. In this study, we perform information content analysis for a range of nominal instrument combinations. The methodology is ideal for assessing the impact of measurements and a priori information (assumptions and constraints) with respect to the desired retrieval products, and for comparing measurement systems. It has advantages that make it useful in advance of or in parallel with retrieval development, such as producing quantitatively useful comparisons even for retrieval scenarios that are significantly underdetermined and therefore impossible to retrieve without significant assumptions, and it is not impacted by retrieval-specific sources of error such as incomplete or incorrect convergence which can complicate the interpretation of a retrieval performance analysis. Here, we will derive the expected uncertainty in retrieved aerosol concentration, effective radius, fine mode fraction and single scattering albedo, for a combination of a polarimeter with various grades of lidar, from an elastic backscatter lidar, similar to the pathfinder CALIOP on the CALIPSO satellite, to a multi-wavelength high spectral resolution lidar.

Sharon P Burton↗

ACS3: Flight Dynamics

The NASA's Advanced Composite Solar Sail System (ACS3) mission consist of a spacecraft that will deploy an 80 m2 solar sail in Low Earth Orbit (LEO). The main objective of the mission is to demonstrate that the solar wind can impulse the spacecraft to change the semimajor-axis and obtain a different orbit altitude. The sail will be composed of a combination of composite materials with distinct properties, and it will be deployed with lightweight booms from a 12U CubeSat bus, developed by Nanoavionics. The spacecraft will be launched aboard an Electron launch vehicle from Rocket LAB Launch Complex in New Zealand. This paper covers the orbital mechanics and navigation developments to support the mission, from the solar sail trajectory model to the actual flight dynamics system to provide the orbit determination analysis prior to flight. First, we introduce a description of our high-fidelity propagation that accounts for the solar radiation pressure to produce predictive ephemeris of the solar sail performance with several spacecraft attitude modes. As part of our results, we present plots of the expected altitudes achieved by the spacecraft once the solar sail is deployed under various assumptions of the solar weather. In addition to that, we present a full description of our orbit determination process which relies in GPS state vectors to accurately estimate the position and velocity uncertainties at a frequent cadence during the mission. The outcome of this process will be critical to achieving the objective of determining effective altitude change produced by the solar sail.

Solar sail↗

PACE Technical Report Series, Volume 11: The PACE Postlaunch Airborne eXperiment (PACE-PAX)

The Plankton, Aerosol, Cloud, ocean Ecosystem (PACE; https://pace.gsfc.nasa.gov) mission is NASA's latest and greatest effort to study the ocean-atmosphere system and build upon the legacy of previous satellite missions that have revolutionized our understanding of our home planet. By using advanced radiometric and polarimetric instruments to measure ocean color and key atmospheric variables, PACE aims to provide new insights into the complex interactions between the ocean, atmosphere, and biosphere. This information will be critical for improving our ability to model and predict changes in the Earth's climate, as well as to manage and conserve our planet's valuable natural resources. Performance assessments and science data product validation is a critical process for any Earth Science space-borne mission, as it involves assessing and verifying the quality of the data products generated by the mission while it is in orbit, as well as assigning uncertainties to these retrievals. More specifically, validation efforts are essential for assessing the accuracy of instrument data and the derived science products across varied spatial and temporal scales and ensuring their reliability and consistency with the mission's scientific goals and objectives. The overall plan for validation of PACE data is described in “PACE Science Data Product Validation Plan” (see, e.g., https://pace.gsfc.nasa.gov), and among range of post-launch activities, it describes the need and requirements for a post-launch airborne field campaign in support of PACE validation. This volume outlines the plans and requirements of the PACE Postlaunch Airborne eXperiment (PACE-PAX). The main goal of PACE-PAX is to gather validation and assessment data for the PACE mission, using a variety of airborne and ground-based assets. These assets will be coordinated to obtain complementary measurements of key ocean and atmospheric variables, such as ocean color, aerosols, and clouds. By collecting data from multiple sources, PACE-PAX will help to validate and refine the data products generated by the PACE mission, as well as to identify any potential errors or biases in the measurements. This will be essential for ensuring the accuracy and reliability of the PACE data products, and for maximizing the scientific value of the mission.

Kirk D Knobelspiesse↗

A unified process for systems identification based on performance assessment

Many modern spacecraft are complex multi-body dynamic systems where the bodies are connected by several active control systems for pointing and isolation. Mission requirements indicate that many structural modes and possibly some nonlinear effects will require characterization. Thus, even characterization at the subsystem level will become more difficult than usual. System level characterization difficulties will be compounded by the fact that only limited ground testing will be possible on the full up system, and flight testing will be restricted by an extremely limited measurements set. The object of the present discussion is the application of matrix majorant theory to the problem of assessing dynamic system performance when knowledge of the system is uncertain. We show how majorants provide an effective tool to relate required performance output to system identification test quality in terms of residual uncertainty in input-output relations, parameter values, nonlinearities, and interactions. The underlying machinery consists of the block-norm matrix which is a nonnegative matrix each of whose elements is the norm of a block of a suitably partitioned matrix. A matrix which bounds the block-norm matrix in the sense of nonnegative matrices, i.e., element by element is known as a majorant.

Hyland, C.↗

Probabilistic Design and Analysis Framework

PRODAF is a software package designed to aid analysts and designers in conducting probabilistic analysis of components and systems. PRODAF can integrate multiple analysis programs to ease the tedious process of conducting a complex analysis process that requires the use of multiple software packages. The work uses a commercial finite element analysis (FEA) program with modules from NESSUS to conduct a probabilistic analysis of a hypothetical turbine blade, disk, and shaft model. PRODAF applies the response surface method, at the component level, and extrapolates the component-level responses to the system level. Hypothetical components of a gas turbine engine are first deterministically modeled using FEA. Variations in selected geometrical dimensions and loading conditions are analyzed to determine the effects of the stress state within each component. Geometric variations include the cord length and height for the blade, inner radius, outer radius, and thickness, which are varied for the disk. Probabilistic analysis is carried out using developing software packages like System Uncertainty Analysis (SUA) and PRODAF. PRODAF was used with a commercial deterministic FEA program in conjunction with modules from the probabilistic analysis program, NESTEM, to perturb loads and geometries to provide a reliability and sensitivity analysis. PRODAF simplified the handling of data among the various programs involved, and will work with many commercial and opensource deterministic programs, probabilistic programs, or modules.

Strack, William C.↗

Climate Extremes and Risks: Links Between Climate Science and Decision-Making

The World Climate Research Programme (WCRP) envisions a future where actionable climate information is universally accessible, supporting decision makers in preparing for and responding to climate change. In this perspective, we advocate for enhancing links between climate science and decision-making through a better and more decision-relevant understanding of climate impacts. The proposed framework comprises three pillars: climate science, impact science, and decision-making, focusing on generating seamless climate information from sub-seasonal, seasonal, decadal to century timescales informed by observed climate events and their impacts. The link between climate science and decision-making has strengthened in recent years, partly owing to undeniable impacts arising from disastrous weather extremes. Enhancing decision-relevant understanding involves utilizing lessons from past extreme events and implementing impact-based early warning systems to improve resilience. Integrated risk assessment and management require a comprehensive approach that encompasses good knowledge about possible impacts, hazard identification, monitoring, and communication of risks while acknowledging uncertainties inherent in climate predictions and projections, but not letting the uncertainty lead to decision paralysis. The importance of data accessibility, especially in the Global South, underscores the need for better coordination and resource allocation. Strategic frameworks should aim to enhance impact-related and open-access climate services around the world. Continuous improvements in predictive modeling and observational data are critical, as is ensuring that climate science remains relevant to decision makers locally and globally. Ultimately, fostering stronger collaborations and dedicated investments to process and tailor climate data will enhance societal preparedness, enabling communities to navigate the complexities of a changing climate effectively.

climate extremes↗

Impact of Tactical and Strategic Weather Avoidance on Separation Assurance

The ability to keep flights away from weather hazards while maintaining aircraft-to-aircraft separation is critically important. The Advanced Airspace Concept is an automation concept that implements a ground-based strategic conflict resolution algorithm for management of aircraft separation. The impact of dynamic and uncertain weather avoidance on this concept is investigated. A strategic weather rerouting system is integrated with the Advanced Airspace Concept, which also provides a tactical weather avoidance algorithm, in a fast time simulation of the Air Transportation System. Strategic weather rerouting is used to plan routes around weather in the 20 minute to two-hour time horizon. To address forecast uncertainty, flight routes are revised at 15 minute intervals. Tactical weather avoidance is used for short term trajectory adjustments (30 minute planning horizon) that are updated every minute to address any weather conflicts (instances where aircraft are predicted to pass through weather cells) that are left unresolved by strategic weather rerouting. The fast time simulation is used to assess the impact of tactical weather avoidance on the performance of automated conflict resolution as well as the impact of strategic weather rerouting on both conflict resolution and tactical weather avoidance. The results demonstrate that both tactical weather avoidance and strategic weather rerouting increase the algorithm complexity required to find aircraft conflict resolutions. Results also demonstrate that tactical weather avoidance is prone to higher airborne delay than strategic weather rerouting. Adding strategic weather rerouting to tactical weather avoidance reduces total airborne delays for the reported scenario by 18% and reduces the number of remaining weather violations by 13%. Finally, two features are identified that have proven important for strategic weather rerouting to realize these benefits; namely, the ability to revise reroutes and the use of maneuvers that start far ahead of encountering a weather cell when rerouting around weather.

Refai, Mohamad S.↗

A Modeling Approach to Support Changeability Analysis and Management of Earth Observation Portfolios

Earth observing (EO) mission portfolios provide data on many geophysical parameters that collectively inform our understanding of the Earth system. To observe large-scale climate trends, it is important to collect data on many parameters over time. However, gaps may occur between missions due to formulation complexity, development delays, and uncertain events in operations. These gaps may impact the ability to provide sustained measurements. Developing a balanced EO mission portfolio is key to supporting study of the Earth system. Yet, decision-making at the portfolio level is a complex task because missions often address multiple parameters. Currently, the likelihood of data gaps is often assessed for an individual parameter, but decisions and events can impact data collection for many parameters. This poster introduces a modeling approach that supports management of the many parameter impacts of decisions and uncertain events. The approach provides a foundation for analyzing changeability in EO mission portfolios. Changeability analysis provides insight into a portfolio’s sensitivity to changes caused by decisions or uncertain events. The model is developed to analyze two aspects of changeability, robustness and flexibility, in EO mission portfolios. In context of these portfolios, the authors define robustness as a portfolio’s ability to provide sustained measurements despite future uncertainties, and they define flexibility as the availability of decision alternatives that contribute to parameter coverage at little detriment to the rest of the portfolio. The proposed model characterizes a portfolio’s sensitivity to change by capturing mission-parameter interconnectivity and redundancy in parameter coverage. The model can be analyzed to identify events that can create substantial gaps, thereby revealing focus areas for mitigation efforts. The model can also be analyzed to identify gap mitigation decisions that may improve parameter coverage with little detriment to the rest of the portfolio, thereby revealing favorable pathways for portfolio improvement. Developing a process for identifying these threats and opportunities will be the focus of future work. A parallel poster proposes a standard for visualizing and communicating portfolio-level impacts of decisions and uncertain events.

Lindsey Jacobson↗

Wind Information Uplink to Aircraft Performing Interval Management Operations

Interval Management (IM) is an ADS-B-enabled suite of applications that use ground and flight deck capabilities and procedures designed to support the relative spacing of aircraft (Barmore et al., 2004, Murdoch et al. 2009, Barmore 2009, Swieringa et al. 2011; Weitz et al. 2012). Relative spacing refers to managing the position of one aircraft to a time or distance relative to another aircraft, as opposed to a static reference point such as a point over the ground or clock time. This results in improved inter-aircraft spacing precision and is expected to allow aircraft to be spaced closer to the applicable separation standard than current operations. Consequently, if the reduced spacing is used in scheduling, IM can reduce the time interval between the first and last aircraft in an overall arrival flow, resulting in increased throughput. Because IM relies on speed changes to achieve precise spacing, it can reduce costly, low-altitude, vectoring, which increases both efficiency and throughput in capacity-constrained airspace without negatively impacting controller workload and task complexity. This is expected to increase overall system efficiency. The Flight Deck Interval Management (FIM) equipment provides speeds to the flight crew that will deliver them to the achieve-by point at the controller-specified time, i.e., assigned spacing goal, after the target aircraft crosses the achieve-by point (Figure 1.1). Since the IM and target aircraft may not be on the same arrival procedure, the FIM equipment predicts the estimated times of arrival (ETA) for both the IM and target aircraft to the achieve-by point. This involves generating an approximate four-dimensional trajectory for each aircraft. The accuracy of the wind data used to generate those trajectories is critical to the success of the IM operation. There are two main forms of uncertainty in the wind information used by the FIM equipment. The first is the accuracy of the forecast modeling done by the weather provider. This is generally a global environmental prediction obtained from a weather model such as the Rapid Refresh (RAP) from the National Centers for Environmental Prediction (NCEP). The weather forecast data will have errors relative to the actual, or truth, winds that the aircraft will encounter. The second source of uncertainty is that only a small subset of the forecast data can be uplinked to the aircraft for use by the FIM equipment. This results in loss of additional information. The Federal Aviation Administration (FAA) and RTCA are currently developing standards for the communication of wind and atmospheric data to the aircraft for use in NextGen operations. This study examines the impact of various wind forecast sampling methods on IM performance metrics to inform the standards development.

Ahmad, Nashat N.↗

Physics Informed Neural Nets for Systems Health Management

To facilitate and solve the prediction problem, awareness of the current health state of the system is key, since it is necessary to perform condition-based predictions. To accurately predict the future state of any system, it is required to possess knowledge of its current health state and future operational conditions. Development in data-driven algorithms in regression of complex nonlinear functions and classification tasks have generated a growing interest in artificial intelligence for industrial applications. Complex multi-physics models as well as digital twins, once purely built on physics and corresponding simplified lumped parameter iterations, can now benefit from machine learning algorithms to mitigate the lack of understanding of some complex behavior. The research work presents application of physics-informed neural nets application to a representative electric powertrain for unmanned aerial vehicles. The model is composed of physics-derived and empirical equations, integrated with connected networks that are strategically placed within the model to substitute equations that are subject to large uncertainty. Polynomial fit driven by heuristics or empirical observations can be substituted by more flexible networks that can minimize the error between model predictions and observations without being restricted to a predefined functional form. This modeling strategy allows training of networks deep inside the model and unknown parameters in a single learning stage.

Physics Informed↗

ACS3 - Flight Dynamics for A Solar Sail Technology Demonstration Mission

The NASA's Advanced Composite Solar Sail System (ACS3) mission consist of a spacecraft that will deploy an 80 m 2 solar sail in a 1000 km sun-synchronous orbit. The main objective of the mission is to demonstrate that the solar wind can impulse the spacecraft to change the semimajor-axis and obtain a different orbit altitude. The sail will be composed of a combination of composite materials with distinct properties, and it will be deployed with lightweight booms from a 12U CubeSat bus, developed by Nanoavionics. The spacecraft will be launched aboard an Electron launch vehicle from Rocket LAB Launch Complex in New Zealand no earlier than July 2023. This paper covers the orbital mechanics and navigation developments to support the mission, from the solar sail trajectory model to the actual flight dynamics system to provide the orbit determination analysis prior to flight. First, we introduce a description of our high-fidelity propagation that accounts for the solar radiation pressure to produce predictive ephemeris of the solar sail performance with several spacecraft attitude modes. As part of our results, we present plots of the expected altitudes achieved by the spacecraft once the solar sail is deployed under various assumptions of the solar weather. In addition to that, we present a full description of our orbit determination process which relies in GPS state vectors to accurately estimate the position and velocity uncertainties at a frequent cadence during the mission. The outcome of this process will be critical to achieving the objective of determining effective altitude change produced by the solar sail.

Solar Sail↗

An illustration of the complexity of continent formation

It was pointed out that a consensus may be emerging in crustal growth models, considering the clustering of most growth curves and their uncertainties. Curves most distant from this clustering represent models involving extensive recycling of continental material back into the mantle, but the author wondered if geochemical signatures for this would be recognizable considering the lack of evidence from seismic tomography for discrete mantle reservoirs, and the likelihood of core-mantle interaction based on recent high pressure experiments. Unreactivated Archean rocks represent only 2 percent of present continental area, and the author was uncomfortable about basing inferences on what the early Earth was like on such a small amount of information. He feels that the hypothesis of continental assembly that needs testing is that of banging together of island arcs, such as in Indonesia today. As an example of how complex this process can be, the author described the geology of the Caribbean arc system, which shows evidence for reversals of subduction polarity, numerous collisional events, and substantial strike-slip movements. It seemed unlikely to the author that Archean examples would have been less complicated.

Burke, Kevin↗

Usefulness of heart measures in flight simulation

The results of three studies performed at the NASA Langley Research Center are presented to indicate the areas in which heart measures are useful for detecting differences in the workload state of subjects. Tasks that involve the arousal of the sympathetic nervous system, such as landing approaches, were excellent candidates for the use of average heart-rate and/or the increase in heart-rate during a task. The latter of these two measures was the better parameter because it removed the effects of diurnal variations in heart-rate and some of the intersubject variability. Tasks which differ in the amount of mental resources required are excellent candidates for heart-rate variability measures. Heart-rate variability measures based upon power spectral density techniques were responsive to the changing task demands of landing approach tasks, approach guidance options, and 2 versus 20 second interstimulus-intervals of a monitoring task. Heart-rate variability measures were especially sensitive to time-on-task when the task was characterized by minimal novelty, complexity, and uncertainty (i.e., heart-rate variability increases as a function of the subjects boredom).

Harris, Randall L., Sr.↗

A Digital Twin Feasibility Study (Part II):Non-Deterministic Predictions of Fatigue Life Using In-Situ Diagnostics and Prognostics

The Digital Twin (DT) concept has the potential to revolutionize the way systems and their components are designed, managed, maintained, and operated across a vast number of fields from engineering to healthcare. The focus of this work is the implementation of DT for the health management of fatigue critical structures. This paper is the second part of a two-part series. The first of the series demonstrated the use of multi-scale, initiation-to-failure crack growth modeling to form non-deterministic predictions of fatigue life. In this second part, a general method for reducing uncertainty in fatigue life predictions is presented that couples in-situ diagnostics and prognostics in a probabilistic framework. Monte Carlo methods and high-fidelity finite element models are used to (i) generate probabilistic estimates of crack state throughout the life of the same geometrically complex test specimen and (ii) predict fatigue life with decreasing uncertainty as more of these diagnoses are obtained. The ability to predict accurately and in the presence of uncertainty is demonstrated, suggesting that the proposed DT method is feasible for fatigue life prognosis and should be pursued further with a focus on increasing application realism.

Patrick E Leser↗

Discrete Event Simulation-Based Timeline Validation Using R2U2

The Gateway Vehicle Systems Manager (VSM), the top-level software control system in a distributed, hierarchical Autonomous System Management Architecture is, like most modern spacecraft software control systems, heavily data-driven. For example, schedules (timelines) will be developed on the ground and, due to the high degree of autonomy, contain complex procedures involving conditional branching, variable timing, and resource contention resolution. In order to verify that an uploaded timeline will function correctly, it is necessary to explore the feasible set of possible executions. While it is possible to test a timeline using a mission simulation, the complexity of the system and duration of a timeline limits the number of trials and therefore the test coverage. To address this problem, the VSM team is using a discrete event system model that can rapidly generate from a timeline sets of event sequences using Monte Carlo techniques. To achieve rapid and trustworthy checking of the event sequences, we use an offline version of the runtime model checking tool R2U2. This presentation describes the approach the VSM team is using to implement the discrete event simulation and evaluate event sequences using R2U2. The presentation will discuss: 1. Description of the timelines by VSM in the context of VSM operations 2. Expansion of a timeline into a sequence of atomic events 3. Adjustment, in the Monte Carlo environment, of an event sequence to account for uncertainty, external events, and failures 4. Definition of R2U2 input and mission-time linear temporal logic files 5. Generation and use of R2U2 verdict sequences 6. Lessons learned and future work

Verification↗