Cryogenic Fluid Management Portfolio Project EXPL-05: NASA CFM Portfolio Project - 2023 Accomplishments and Highlights Progress on Flight Demos and Large CFM Demonstration (LCD)
Explore the source record for details and available documents.
CFM↗
SEARCH · Search NASA
Results for “Portfolio”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
A Modeling Approach to Support Changeability Analysis and Management of Earth Observation Portfolios
Earth observing (EO) mission portfolios provide data on many geophysical parameters that collectively inform our understanding of the Earth system. To observe large-scale climate trends, it is important to collect data on many parameters over time. However, gaps may occur between missions due to formulation complexity, development delays, and uncertain events in operations. These gaps may impact the ability to provide sustained measurements. Developing a balanced EO mission portfolio is key to supporting study of the Earth system. Yet, decision-making at the portfolio level is a complex task because missions often address multiple parameters. Currently, the likelihood of data gaps is often assessed for an individual parameter, but decisions and events can impact data collection for many parameters. This poster introduces a modeling approach that supports management of the many parameter impacts of decisions and uncertain events. The approach provides a foundation for analyzing changeability in EO mission portfolios. Changeability analysis provides insight into a portfolio’s sensitivity to changes caused by decisions or uncertain events. The model is developed to analyze two aspects of changeability, robustness and flexibility, in EO mission portfolios. In context of these portfolios, the authors define robustness as a portfolio’s ability to provide sustained measurements despite future uncertainties, and they define flexibility as the availability of decision alternatives that contribute to parameter coverage at little detriment to the rest of the portfolio. The proposed model characterizes a portfolio’s sensitivity to change by capturing mission-parameter interconnectivity and redundancy in parameter coverage. The model can be analyzed to identify events that can create substantial gaps, thereby revealing focus areas for mitigation efforts. The model can also be analyzed to identify gap mitigation decisions that may improve parameter coverage with little detriment to the rest of the portfolio, thereby revealing favorable pathways for portfolio improvement. Developing a process for identifying these threats and opportunities will be the focus of future work. A parallel poster proposes a standard for visualizing and communicating portfolio-level impacts of decisions and uncertain events.
Lindsey Jacobson↗
Creating Portfolio Management Concepts for Highly Agile and Innovative Government Research Programs Using Design Thinking and Lean Startup Methodologies
Managing a research and development (R&D) portfolio presents numerous challenges, such as prioritizing research areas, remaining agile, strategic workforce planning, and measuring return on investment, impact, and innovation. One government R&D program is charged with producing a high degree of innovative, transformational breakthroughs in aviation technology. A practical, structured methodology for strategically prioritizing emerging aviation R&D in such an environment is lacking. The existing multi-criteria decision aid tools are primarily utilized at an enterprise level, take months to set up and collect data, require large teams of experts, are used on an infrequent basis, and are not conducive to a highly innovative, high-risk portfolio. Prior to audaciously creating a new portfolio prioritization process, the exact challenges with portfolio management for R&D projects were identified using the design thinking and lean start-up methods. A key part of this discovery process was interviewing stakeholders, as well as other managers of organizations charged with producing innovative portfolios. These interviews, as well as additional techniques, were used to develop a deeper understanding of the challenges and, subsequently, lay the foundation for development of an effective portfolio prioritization process. Four potential concepts that represent key findings emerged: carefully selected criteria for portfolio assessment and selection, targeted portfolio turnover rate, dynamic portfolio prioritization framework, and streamlined transition or commercialization of R&D. Acting on any one of the resulting portfolio management concepts will increase the transparency and confidence in portfolio decisions and, ideally, result in a greater degree of transformational breakthroughs in aviation technology.
project portfolio management↗
Portfolios in Stochastic Local Search: Efficiently Computing Most Probable Explanations in Bayesian Networks
Portfolio methods support the combination of different algorithms and heuristics, including stochastic local search (SLS) heuristics, and have been identified as a promising approach to solve computationally hard problems. While successful in experiments, theoretical foundations and analytical results for portfolio-based SLS heuristics are less developed. This article aims to improve the understanding of the role of portfolios of heuristics in SLS. We emphasize the problem of computing most probable explanations (MPEs) in Bayesian networks (BNs). Algorithmically, we discuss a portfolio-based SLS algorithm for MPE computation, Stochastic Greedy Search (SGS). SGS supports the integration of different initialization operators (or initialization heuristics) and different search operators (greedy and noisy heuristics), thereby enabling new analytical and experimental results. Analytically, we introduce a novel Markov chain model tailored to portfolio-based SLS algorithms including SGS, thereby enabling us to analytically form expected hitting time results that explain empirical run time results. For a specific BN, we show the benefit of using a homogenous initialization portfolio. To further illustrate the portfolio approach, we consider novel additive search heuristics for handling determinism in the form of zero entries in conditional probability tables in BNs. Our additive approach adds rather than multiplies probabilities when computing the utility of an explanation. We motivate the additive measure by studying the dramatic impact of zero entries in conditional probability tables on the number of zero-probability explanations, which again complicates the search process. We consider the relationship between MAXSAT and MPE, and show that additive utility (or gain) is a generalization, to the probabilistic setting, of MAXSAT utility (or gain) used in the celebrated GSAT and WalkSAT algorithms and their descendants. Utilizing our Markov chain framework, we show that expected hitting time is a rational function - i.e. a ratio of two polynomials - of the probability of applying an additive search operator. Experimentally, we report on synthetically generated BNs as well as BNs from applications, and compare SGSs performance to that of Hugin, which performs BN inference by compilation to and propagation in clique trees. On synthetic networks, SGS speeds up computation by approximately two orders of magnitude compared to Hugin. In application networks, our approach is highly competitive in Bayesian networks with a high degree of determinism. In addition to showing that stochastic local search can be competitive with clique tree clustering, our empirical results provide an improved understanding of the circumstances under which portfolio-based SLS outperforms clique tree clustering and vice versa.
Mengshoel, Ole J.↗
Achieving a Prioritized Research and Technology Development Portfolio for the Dust Management Project
Mission architectures for human exploration of the lunar surface continue to advance as well as the definitions of capability needs, best practices and engineering design to mitigate the impact of lunar dust on exposed systems. The NASA DMP has been established as the agency focal point for dust characterization, technology, and simulant development. As described in this paper, the DMP has defined a process for selecting and justifying its R&T portfolio. The technology prioritization process, which is based on a ranking system according to weighted criteria, has been successfully applied to the current DMP dust mitigation technology portfolio. Several key findings emerged from this assessment. Within the dust removal and cleaning technologies group, there are critical technical challenges that must be overcome for these technologies to be implemented for lunar applications. For example, an in-situ source of CO2 on the moon is essential to the CO2 shower technology. Also, significant development effort is required to achieve technology readiness level TRL 6 for the electrostatic cleaning system for removal of particles smaller than 50 pm. The baseline materials related technologies require considerable development just to achieve TRL 6. It is also a nontrivial effort to integrate the materials in hardware for lunar application. At present, there are no terrestrial applications that are readily adaptable to lunar surface applications nor are there any obvious leading candidates. The unique requirements of dust sealing systems for lunar applications suggest an extensive development effort will be necessary to mature dust sealing systems to TRL 6 and beyond. As discussed here, several alternate materials and technologies have achieved high levels of maturity for terrestrial applications and warrant due diligence in ongoing assessment of the technology portfolio. The present assessment is the initial step in an ongoing effort to continually evaluate the DMP technology portfolio and external non-NASA relevant technology developments efforts to maintain an optimal investment profile. At the same time, there is an ongoing review of agency-wide dust-related R&T activities. The results of these ongoing assessments will be reported in future publications.
Hyatt, Mark J.↗
System-of-Systems Technology-Portfolio-Analysis Tool
Advanced Technology Life-cycle Analysis System (ATLAS) is a system-of-systems technology-portfolio-analysis software tool. ATLAS affords capabilities to (1) compare estimates of the mass and cost of an engineering system based on competing technological concepts; (2) estimate life-cycle costs of an outer-space-exploration architecture for a specified technology portfolio; (3) collect data on state-of-the-art and forecasted technology performance, and on operations and programs; and (4) calculate an index of the relative programmatic value of a technology portfolio. ATLAS facilitates analysis by providing a library of analytical spreadsheet models for a variety of systems. A single analyst can assemble a representation of a system of systems from the models and build a technology portfolio. Each system model estimates mass, and life-cycle costs are estimated by a common set of cost models. Other components of ATLAS include graphical-user-interface (GUI) software, algorithms for calculating the aforementioned index, a technology database, a report generator, and a form generator for creating the GUI for the system models. At the time of this reporting, ATLAS is a prototype, embodied in Microsoft Excel and several thousand lines of Visual Basic for Applications that run on both Windows and Macintosh computers.
O'Neil, Daniel↗
Development of a Portfolio Management Approach with Case Study of the NASA Airspace Systems Program
A portfolio management approach was developed for the National Aeronautics and Space Administration s (NASA s) Airspace Systems Program (ASP). The purpose was to help inform ASP leadership regarding future investment decisions related to its existing portfolio of advanced technology concepts and capabilities (C/Cs) currently under development and to potentially identify new opportunities. The portfolio management approach is general in form and is extensible to other advanced technology development programs. It focuses on individual C/Cs and consists of three parts: 1) concept of operations (con-ops) development, 2) safety impact assessment, and 3) benefit-cost-risk (B-C-R) assessment. The first two parts are recommendations to ASP leaders and will be discussed only briefly, while the B-C-R part relates to the development of an assessment capability and will be discussed in greater detail. The B-C-R assessment capability enables estimation of the relative value of each C/C as compared with all other C/Cs in the ASP portfolio. Value is expressed in terms of a composite weighted utility function (WUF) rating, based on estimated benefits, costs, and risks. Benefit utility is estimated relative to achieving key NAS performance objectives, which are outlined in the ASP Strategic Plan.1 Risk utility focuses on C/C development and implementation risk, while cost utility focuses on the development and implementation portions of overall C/C life-cycle costs. Initial composite ratings of the ASP C/Cs were successfully generated; however, the limited availability of B-C-R information, which is used as inputs to the WUF model, reduced the meaningfulness of these initial investment ratings. Development of this approach, however, defined specific information-generation requirements for ASP C/C developers that will increase the meaningfulness of future B-C-R ratings.
Neitzke, Kurt W.↗
BBN-Based Portfolio Risk Assessment for NASA Technology R&D Outcome
The NASA Aeronautics Research Mission Directorate (ARMD) vision falls into six strategic thrusts that are aimed to support the challenges of the Next Generation Air Transportation System (NextGen). In order to achieve the goals of the ARMD vision, the Airspace Operations and Safety Program (AOSP) is committed to developing and delivering new technologies. To meet the dual challenges of constrained resources and timely technology delivery, program portfolio risk assessment is critical for communication and decision-making. This paper describes how Bayesian Belief Network (BBN) is applied to assess the probability of a technology meeting the expected outcome. The network takes into account the different risk factors of technology development and implementation phases. The use of BBNs allows for all technologies of projects in a program portfolio to be separately examined and compared. In addition, the technology interaction effects are modeled through the application of object-oriented BBNs. The paper discusses the development of simplified project risk BBNs and presents various risk results. The results presented include the probability of project risks not meeting success criteria, the risk drivers under uncertainty via sensitivity analysis, and what-if analysis. Finally, the paper shows how program portfolio risk can be assessed using risk results from BBNs of projects in the portfolio.
Geuther, Steven C.↗
Using a Portfolio of Algorithms for Planning and Scheduling
The Automated Scheduling and Planning Environment (ASPEN) software system, aspects of which have been reported in several previous NASA Tech Briefs articles, includes a subsystem that utilizes a portfolio of heuristic algorithms that work synergistically to solve problems. The nature of the synergy of the specific algorithms is that their likelihoods of success are negatively correlated: that is, when a combination of them is used to solve a problem, the probability that at least one of them will succeed is greater than the sum of probabilities of success of the individual algorithms operating independently of each other. In ASPEN, the portfolio of algorithms is used in a planning process of the iterative repair type, in which conflicts are detected and addressed one at a time until either no conflicts exist or a user-defined time limit has been exceeded. At each choice point (e.g., selection of conflict; selection of method of resolution of conflict; or choice of move, addition, or deletion) ASPEN makes a stochastic choice of a combination of algorithms from the portfolio. This approach makes it possible for the search to escape from looping and from solutions that are locally but not globally optimum.
Sherwood, Robert↗
Flightdeck Automation Problems (FLAP) Model for Safety Technology Portfolio Assessment
NASA's Aviation Safety Program (AvSP) develops and advances methodologies and technologies to improve air transportation safety. The Safety Analysis and Integration Team (SAIT) conducts a safety technology portfolio assessment (PA) to analyze the program content, to examine the benefits and risks of products with respect to program goals, and to support programmatic decision making. The PA process includes systematic identification of current and future safety risks as well as tracking several quantitative and qualitative metrics to ensure the program goals are addressing prominent safety risks accurately and effectively. One of the metrics within the PA process involves using quantitative aviation safety models to gauge the impact of the safety products. This paper demonstrates the role of aviation safety modeling by providing model outputs and evaluating a sample of portfolio elements using the Flightdeck Automation Problems (FLAP) model. The model enables not only ranking of the quantitative relative risk reduction impact of all portfolio elements, but also highlighting the areas with high potential impact via sensitivity and gap analyses in support of the program office. Although the model outputs are preliminary and products are notional, the process shown in this paper is essential to a comprehensive PA of NASA's safety products in the current program and future programs/projects.
Ancel, Ersin↗
Outcomes of a NASA Workshop to Develop a Portfolio of Low Latency Datasets for Time-Sensitive Applications
It is widely accepted that time-sensitive remote sensing data serve the needs of decision makers in the applications communities and yet to date, a comprehensive portfolio of NASA low latency datasets has not been available. This paper will describe the NASA low latency, or Near-Real Time (NRT), portfolio, how it was developed and plans to make it available online through a portal that leverages the existing EOSDIS capabilities such as the Earthdata Search Client (https:search.earthdata.nasa.gov), the Common Metadata Repository (CMR) and the Global Imagery Browse Service (GIBS). This paper will report on the outcomes of a NASA Workshop to Develop a Portfolio of Low Latency Datasets for Time-Sensitive Applications (27-29 September 2016 at NASA Langley Research Center, Hampton VA). The paper will also summarize findings and recommendations from the meeting outlining perceived shortfalls and opportunities for low latency research and application science.
remote sensing↗
Portfolio Management
Enterprise Business Information Services Division (EBIS) supports the Laboratory and its functions through the implementation and support of business information systems on behalf of its business community. EBIS Five Strategic Focus Areas: (1) Improve project estimating, planning and delivery capability (2) Improve maintainability and sustainability of EBIS Application Portfolio (3) Leap forward in IT Leadership (4) Comprehensive Talent Management (5) Continuous IT Security Program. Portfolio Management is a strategy in which software applications are managed as assets
Information Technology Applications↗
Object-Oriented Bayesian Networks (OOBN) for Aviation Accident Modeling and Technology Portfolio Impact Assessment
The concern for reducing aviation safety risk is rising as the National Airspace System in the United States transforms to the Next Generation Air Transportation System (NextGen). The NASA Aviation Safety Program is committed to developing an effective aviation safety technology portfolio to meet the challenges of this transformation and to mitigate relevant safety risks. The paper focuses on the reasoning of selecting Object-Oriented Bayesian Networks (OOBN) as the technique and commercial software for the accident modeling and portfolio assessment. To illustrate the benefits of OOBN in a large and complex aviation accident model, the in-flight Loss-of-Control Accident Framework (LOCAF) constructed as an influence diagram is presented. An OOBN approach not only simplifies construction and maintenance of complex causal networks for the modelers, but also offers a well-organized hierarchical network that is easier for decision makers to exploit the model examining the effectiveness of risk mitigation strategies through technology insertions.
Shih, Ann T.↗
Safety Risk Knowledge Elicitation in Support of Aeronautical R and D Portfolio Management: A Case Study
Aviation is a problem domain characterized by a high level of system complexity and uncertainty. Safety risk analysis in such a domain is especially challenging given the multitude of operations and diverse stakeholders. The Federal Aviation Administration (FAA) projects that by 2025 air traffic will increase by more than 50 percent with 1.1 billion passengers a year and more than 85,000 flights every 24 hours contributing to further delays and congestion in the sky (Circelli, 2011). This increased system complexity necessitates the application of structured safety risk analysis methods to understand and eliminate where possible, reduce, and/or mitigate risk factors. The use of expert judgments for probabilistic safety analysis in such a complex domain is necessary especially when evaluating the projected impact of future technologies, capabilities, and procedures for which current operational data may be scarce. Management of an R&D product portfolio in such a dynamic domain needs a systematic process to elicit these expert judgments, process modeling results, perform sensitivity analyses, and efficiently communicate the modeling results to decision makers. In this paper a case study focusing on the application of an R&D portfolio of aeronautical products intended to mitigate aircraft Loss of Control (LOC) accidents is presented. In particular, the knowledge elicitation process with three subject matter experts who contributed to the safety risk model is emphasized. The application and refinement of a verbal-numerical scale for conditional probability elicitation in a Bayesian Belief Network (BBN) is discussed. The preliminary findings from this initial step of a three-part elicitation are important to project management practitioners as they illustrate the vital contribution of systematic knowledge elicitation in complex domains.
Shih, Ann T.↗
A Framework for Assessment of Aviation Safety Technology Portfolios
The programs within NASA's Aeronautics Research Mission Directorate (ARMD) conduct research and development to improve the national air transportation system so that Americans can travel as safely as possible. NASA aviation safety systems analysis personnel support various levels of ARMD management in their fulfillment of system analysis and technology prioritization as defined in the agency's program and project requirements. This paper provides a framework for the assessment of aviation safety research and technology portfolios that includes metrics such as projected impact on current and future safety, technical development risk and implementation risk. The paper also contains methods for presenting portfolio analysis and aviation safety Bayesian Belief Network (BBN) output results to management using bubble charts and quantitative decision analysis techniques.
Jones, Sharon M.↗
Airspace Research and Development Portfolio Assessment of Urban Air Mobility using Knowledge Graph Data Science
National Aeronautics and Space Administration (NASA) is spearheading an innovative digital engineering approach to integrate, communicate, and facilitate the research of Urban Air Mobility (UAM) operations. The UAM vision is one in which advanced technologies and new operational procedures enable practical and cost-effective air transport as an integrated mode of movement of people and goods throughout metropolitan areas. To safely support UAM operations at scale in the National Airspace System (NAS), NASA’s Air Traffic Management-Exploration (ATM-X) project has been conducting research that evolves the UAM air traffic management system towards a highly automated and operationally flexible system of the future. The complexity of UAM airspace evolution to accommodate the increasing tempo of UAM operations over time is managed through the UAM airspace research roadmap, which is a system engineering approach to the R&D of complex system-of-systems, where system’s interdependencies make it nearly impossible to define requirements for individual elements of the system in isolation. These interdependencies form a knowledge graph (node-link network) with a highly complex structure far beyond the human user’s ability to extract insights for project management’s research portfolio assessment. This study applies advanced data analytics in knowledge graph to the UAM knowledge graph to facilitate the portfolio assessment.
ATM↗
Airspace Research and Development Portfolio Assessment of Urban Air Mobility using Knowledge Graph Data Science
National Aeronautics and Space Administration (NASA) is spearheading an innovative digital engineering approach to integrate, communicate, and facilitate the research of Urban Air Mobility (UAM) operations. The UAM vision is one in which advanced technologies and new operational procedures enable practical and cost-effective air transport as an integrated mode of movement of people and goods throughout metropolitan areas. To safely support UAM operations at scale in the National Airspace System (NAS), NASA’s Air Traffic Management-Exploration (ATM-X) project has been conducting research that evolves the UAM air traffic management system towards a highly automated and operationally flexible system of the future. The complexity of UAM airspace evolution to accommodate the increasing tempo of UAM operations over time is managed through the UAM airspace research roadmap, which is a system engineering approach to the R&D of complex system-of-systems, where system’s interdependencies make it nearly impossible to define requirements for individual elements of the system in isolation. These interdependencies form a knowledge graph (node-link network) with a highly complex structure far beyond the human user’s ability to extract insights for project management’s research portfolio assessment. This study applies advanced data analytics in knowledge graph to the UAM knowledge graph to facilitate the portfolio assessment.
ATM↗
Postoptimality analysis in the selection of technology portfolios
This paper describes an approach for qualifying optimal technology portfolios obtained with a multi-attribute decision support system. The goal is twofold: to gauge the degree of confidence in the optimal solution and to provide the decision-maker with an array of viable selection alternatives, which take into account input uncertainties and possibly satisfy non-technical constraints.
portfolios↗