Aerosol, Cloud, Convection, and Precipitation (ACCP) Science & Applications
Explore the source record for details and available documents.
Scott Braun↗
Engineering topics
Marie Ivanco
Publications and source records attributed to Marie Ivanco.
Sensitivity Analysis Method to Address User Disparities in the Analytic Hierarchy Process
Decision makers often face complex problems, which can seldom be addressed well without the use of structured analytical models. Mathematical models have been developed to streamline and facilitate decision making activities, and among these, the Analytic Hierarchy Process (AHP) constitutes one of the most utilized multi-criteria decision analysis methods. While AHP has been thoroughly researched and applied, the method still shows limitations in terms of addressing user profile disparities. A novel sensitivity analysis method based on local partial derivatives is presented here to address these limitations. This new methodology informs AHP users of which pairwise comparisons most impact the derived weights and the ranking of alternatives. The method can also be applied to decision processes that require the aggregation of results obtained by several users, as it highlights which individuals most critically impact the aggregated group results while also enabling to focus on inputs that drive the final ordering of alternatives. An aerospace design and engineering example that requires group decision making is presented to demonstrate and validate the proposed methodology.
Marie Ivanco↗
A Scenario-Based Approach to Assess Continuity Gaps in Earth Observations
Decision analysis processes outlined in systems engineering references, such as the Systems Engineering Body of Knowledge [1] or the NASA Systems Engineering Handbook [2], recommend following a series of steps to support decision-making for engineering applications. These steps are consistent across the literature and typically involve defining objectives, defining relevant criteria against which candidate alternatives can be assessed, selecting an evaluation method, assessing alternatives, and making a recommendation based on this assessment. These approaches are well-suited to assess systems for which sets of common objectives and constraints can be identified. A vast body of literature describes their application to numerous engineering problems, and many methods have been developed since the middle of the 20th century to support the assessment of candidate alternatives for such systems [3, 4, 5, 6]. These approaches, however, show some limitations when decisions pertain to systems of systems. These collections of individual systems typically do not share a common set of objectives and constraints, tend to be highly complex, and the definition of assessable, high-value candidate alternatives poses a challenge due to interdependencies. The formulation, development, operation, and funding of Earth observing missions are such that gaps may occur between missions, therefore impacting the continuity of measurements. These Earth observing mission architectures constitute systems of systems for which a common set of objectives and constraints can be challenging to define. When tasked with assessing gaps that may occur for a series of spaceborne missions that address similar science parameters, the authors therefore proposed to depart from the traditional objective- and criteria-based approach and instead adopted a scenario-based approach. This approach does not require a prioritized set of common objectives; rather, it assesses the impact of possible decisions on the system-of-systems and characterizes its possible future states. It also offers the flexibility to adjust assumptions, update inputs, and refine supporting models over time, while enabling the rapid, early identification of challenges and key decision points. By simulating the impact of potential decisions on the entirety of the system-of-systems, the approach enables the synchronization of multiple decisions that typically occur at the level of the individual system. This paper provides an overview of the approach that was developed to assess continuity gaps for a series of operational and planned spaceborne Earth observing missions, a description of its application to the problem at hand, and a discussion of currently known limitations.
scenario earth observations continuity gaps↗
A Scenario-Based Approach to Assess Continuity Gaps in Earth Observations
Decision analysis processes outlined in systems engineering references, such as the Systems Engineering Body of Knowledge [1] or the NASA Systems Engineering Handbook [2], recommend following a series of steps to support decision-making for engineering applications. These steps are consistent across the literature and typically involve defining objectives, defining relevant criteria against which candidate alternatives can be assessed, selecting an evaluation method, assessing alternatives, and making a recommendation based on this assessment. These approaches are well-suited to assess systems for which sets of common objectives and constraints can be identified. A vast body of literature describes their application to numerous engineering problems, and many methods have been developed since the middle of the 20th century to support the assessment of candidate alternatives for such systems [3, 4, 5, 6]. These approaches, however, show some limitations when decisions pertain to systems of systems. These collections of individual systems typically do not share a common set of objectives and constraints, tend to be highly complex, and the definition of assessable, high-value candidate alternatives poses a challenge due to interdependencies. The formulation, development, operation, and funding of Earth observing missions are such that gaps may occur between missions, therefore impacting the continuity of measurements. These Earth observing mission architectures constitute systems of systems for which a common set of objectives and constraints can be challenging to define. When tasked with assessing gaps that may occur for a series of spaceborne missions that address similar science parameters, the authors therefore proposed to depart from the traditional objective- and criteria-based approach and instead adopted a scenario-based approach. This approach does not require a prioritized set of common objectives; rather, it assesses the impact of possible decisions on the system-of-systems and characterizes its possible future states. It also offers the flexibility to adjust assumptions, update inputs, and refine supporting models over time, while enabling the rapid, early identification of challenges and key decision points. By simulating the impact of potential decisions on the entirety of the system-of-systems, the approach enables the synchronization of multiple decisions that typically occur at the level of the individual system. This paper provides an overview of the approach that was developed to assess continuity gaps for a series of operational and planned spaceborne Earth observing missions, a description of its application to the problem at hand, and a discussion of currently known limitations.
scenario earth observations continuity gaps↗
A Modeling Approach to Support Changeability Analysis and Management of Earth Observation Portfolios
Earth observing (EO) mission portfolios provide data on many geophysical parameters that collectively inform our understanding of the Earth system. To observe large-scale climate trends, it is important to collect data on many parameters over time. However, gaps may occur between missions due to formulation complexity, development delays, and uncertain events in operations. These gaps may impact the ability to provide sustained measurements. Developing a balanced EO mission portfolio is key to supporting study of the Earth system. Yet, decision-making at the portfolio level is a complex task because missions often address multiple parameters. Currently, the likelihood of data gaps is often assessed for an individual parameter, but decisions and events can impact data collection for many parameters. This poster introduces a modeling approach that supports management of the many parameter impacts of decisions and uncertain events. The approach provides a foundation for analyzing changeability in EO mission portfolios. Changeability analysis provides insight into a portfolio’s sensitivity to changes caused by decisions or uncertain events. The model is developed to analyze two aspects of changeability, robustness and flexibility, in EO mission portfolios. In context of these portfolios, the authors define robustness as a portfolio’s ability to provide sustained measurements despite future uncertainties, and they define flexibility as the availability of decision alternatives that contribute to parameter coverage at little detriment to the rest of the portfolio. The proposed model characterizes a portfolio’s sensitivity to change by capturing mission-parameter interconnectivity and redundancy in parameter coverage. The model can be analyzed to identify events that can create substantial gaps, thereby revealing focus areas for mitigation efforts. The model can also be analyzed to identify gap mitigation decisions that may improve parameter coverage with little detriment to the rest of the portfolio, thereby revealing favorable pathways for portfolio improvement. Developing a process for identifying these threats and opportunities will be the focus of future work. A parallel poster proposes a standard for visualizing and communicating portfolio-level impacts of decisions and uncertain events.
Lindsey Jacobson↗