Cryogenic Fluid Management Portfolio Project EXPL-05: NASA CFM Portfolio Project - 2023 Accomplishments and Highlights Progress on Flight Demos and Large CFM Demonstration (LCD)
Explore the source record for details and available documents.
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
Earth observing (EO) mission portfolios provide data on many geophysical parameters that collectively inform our understanding of the Earth system. To observe large-scale climate trends, it is important to collect data on many parameters over time. However, gaps may occur between missions due to formulation complexity, development delays, and uncertain events in operations. These gaps may impact the ability to provide sustained measurements. Developing a balanced EO mission portfolio is key to supporting study of the Earth system. Yet, decision-making at the portfolio level is a complex task because missions often address multiple parameters. Currently, the likelihood of data gaps is often assessed for an individual parameter, but decisions and events can impact data collection for many parameters. This poster introduces a modeling approach that supports management of the many parameter impacts of decisions and uncertain events. The approach provides a foundation for analyzing changeability in EO mission portfolios. Changeability analysis provides insight into a portfolio’s sensitivity to changes caused by decisions or uncertain events. The model is developed to analyze two aspects of changeability, robustness and flexibility, in EO mission portfolios. In context of these portfolios, the authors define robustness as a portfolio’s ability to provide sustained measurements despite future uncertainties, and they define flexibility as the availability of decision alternatives that contribute to parameter coverage at little detriment to the rest of the portfolio. The proposed model characterizes a portfolio’s sensitivity to change by capturing mission-parameter interconnectivity and redundancy in parameter coverage. The model can be analyzed to identify events that can create substantial gaps, thereby revealing focus areas for mitigation efforts. The model can also be analyzed to identify gap mitigation decisions that may improve parameter coverage with little detriment to the rest of the portfolio, thereby revealing favorable pathways for portfolio improvement. Developing a process for identifying these threats and opportunities will be the focus of future work. A parallel poster proposes a standard for visualizing and communicating portfolio-level impacts of decisions and uncertain events.
Managing a research and development (R&D) portfolio presents numerous challenges, such as prioritizing research areas, remaining agile, strategic workforce planning, and measuring return on investment, impact, and innovation. One government R&D program is charged with producing a high degree of innovative, transformational breakthroughs in aviation technology. A practical, structured methodology for strategically prioritizing emerging aviation R&D in such an environment is lacking. The existing multi-criteria decision aid tools are primarily utilized at an enterprise level, take months to set up and collect data, require large teams of experts, are used on an infrequent basis, and are not conducive to a highly innovative, high-risk portfolio. Prior to audaciously creating a new portfolio prioritization process, the exact challenges with portfolio management for R&D projects were identified using the design thinking and lean start-up methods. A key part of this discovery process was interviewing stakeholders, as well as other managers of organizations charged with producing innovative portfolios. These interviews, as well as additional techniques, were used to develop a deeper understanding of the challenges and, subsequently, lay the foundation for development of an effective portfolio prioritization process. Four potential concepts that represent key findings emerged: carefully selected criteria for portfolio assessment and selection, targeted portfolio turnover rate, dynamic portfolio prioritization framework, and streamlined transition or commercialization of R&D. Acting on any one of the resulting portfolio management concepts will increase the transparency and confidence in portfolio decisions and, ideally, result in a greater degree of transformational breakthroughs in aviation technology.
Portfolio methods support the combination of different algorithms and heuristics, including stochastic local search (SLS) heuristics, and have been identified as a promising approach to solve computationally hard problems. While successful in experiments, theoretical foundations and analytical results for portfolio-based SLS heuristics are less developed. This article aims to improve the understanding of the role of portfolios of heuristics in SLS. We emphasize the problem of computing most probable explanations (MPEs) in Bayesian networks (BNs). Algorithmically, we discuss a portfolio-based SLS algorithm for MPE computation, Stochastic Greedy Search (SGS). SGS supports the integration of different initialization operators (or initialization heuristics) and different search operators (greedy and noisy heuristics), thereby enabling new analytical and experimental results. Analytically, we introduce a novel Markov chain model tailored to portfolio-based SLS algorithms including SGS, thereby enabling us to analytically form expected hitting time results that explain empirical run time results. For a specific BN, we show the benefit of using a homogenous initialization portfolio. To further illustrate the portfolio approach, we consider novel additive search heuristics for handling determinism in the form of zero entries in conditional probability tables in BNs. Our additive approach adds rather than multiplies probabilities when computing the utility of an explanation. We motivate the additive measure by studying the dramatic impact of zero entries in conditional probability tables on the number of zero-probability explanations, which again complicates the search process. We consider the relationship between MAXSAT and MPE, and show that additive utility (or gain) is a generalization, to the probabilistic setting, of MAXSAT utility (or gain) used in the celebrated GSAT and WalkSAT algorithms and their descendants. Utilizing our Markov chain framework, we show that expected hitting time is a rational function - i.e. a ratio of two polynomials - of the probability of applying an additive search operator. Experimentally, we report on synthetically generated BNs as well as BNs from applications, and compare SGSs performance to that of Hugin, which performs BN inference by compilation to and propagation in clique trees. On synthetic networks, SGS speeds up computation by approximately two orders of magnitude compared to Hugin. In application networks, our approach is highly competitive in Bayesian networks with a high degree of determinism. In addition to showing that stochastic local search can be competitive with clique tree clustering, our empirical results provide an improved understanding of the circumstances under which portfolio-based SLS outperforms clique tree clustering and vice versa.
The Workshop on Methods for R&D Portfolio Analysis and Evaluation convened on 17–18 July 2019 at the National Renewable Energy Laboratory in Golden, Colorado, and examined strengths and weaknesses of the various methodologies applicable to R&D portfolio modeling, analysis, and decision support, given pragmatic constraints such as data availability, uncertainties in estimating the impact of R&D spending, and practical operational overheads. Participants employed their deep expertise in approaches such as stochastic optimization, real options, Monte-Carlo analysis, Bayesian networks, decision theory, complex systems analysis, deep uncertainty, and technology-evolution modeling to critique the initial example models developed by the project’s core team and to conduct thought experiments grounded in real-life technology models, progress data, expert elicitation, and portfolio information. This engagement of participants’ methodological expertise with the practical requirements of real-life portfolio decision support yielded ideas for improved approaches, alternative methodological hypotheses, and hybridization of methodologies that are well-grounded theoretically, computationally sound, and realistically executable given data availability and other practical constraints.
The Workshop on Methods for R&D Portfolio Analysis and Evaluation convened on 17-18 July 2019 at the National Renewable Energy Laboratory in Golden, Colorado, and examined strengths and weaknesses of the various methodologies applicable to R&D portfolio modeling, analysis, and decision support, given pragmatic constraints such as data availability, uncertainties in estimating the impact of R&D spending, and practical operational overheads. Participants employed their deep expertise in approaches such as stochastic optimization, real options, Monte-Carlo analysis, Bayesian networks, decision theory, complex systems analysis, deep uncertainty, and technology-evolution modeling to critique the initial example models developed by the project’s core team and to conduct thought experiments grounded in real-life technology models, progress data, expert elicitation, and portfolio information. This engagement of participants’ methodological expertise with the practical requirements of real-life portfolio decision support yielded ideas for improved approaches, alternative methodological hypotheses, and hybridization of methodologies that are well-grounded theoretically, computationally sound, and realistically executable given data availability and other practical constraints.
While strategies to achieve net-zero emissions at an individual site are well understood, new analysis methods are required for organizations seeking to achieve net-zero across multiple facilities, each with concurrent priority goals. At a portfolio level, distinct locations present varied challenges that cannot be addressed through singular solutions, and competing goals can take precedence with the assumption that net-zero emissions strategies deter from energy resilience and cost savings, therefore negatively impacting nearby communities. This study tests these assumptions by analyzing 16 diverse sites (varying in size, climate, and energy use) to identify strategies that reduce emissions and assess the impact these strategies have on life cycle costs, resilience, and communities with environmental justice concerns. Methods were developed to approximate missing information essential to net-zero evaluation. Established methods were augmented to evaluate life cycle costs, resilience, and environmental justice impacts across a set of strategies and accommodate the multi-criteria analyses. Potential benefits from identified strategies were quantified using site characteristics and a set of corresponding metrics. The net-zero analysis found that 11 sites could use on-site strategies to eliminate all but 2% of emissions generated. The remaining emissions can be offset, for instance through sequestration, executed at the portfolio scale. On-site carbon-free energy was found to reduce 51% of emissions across all sites; efficiency reduced 19% of emissions; sequestration 16%; procured carbon-free energy 15%; fuel switching 1.6%; and fleet electrification 1.3%. Building electrification, however, increased emissions by 4.4%. Different strategies also provide cost, resilience, and/or environmental justice benefits—the degree to which varies with individual site conditions. The findings indicate an advantage to considering the strategies as a comprehensive set, which leads to co-benefits, both in the ability to achieve net-zero goals and in advancing other goals. The results present the case for comprehensive advanced planning at the portfolio level to prioritize investments that will balance the minimization of emissions and life cycle cost with the maximization of resilience and environmental justice benefits. The novel methods for evaluation and integration, valuation of benefits, and consideration at the portfolio scale allow organizations to select investments that simultaneously address multiple key priorities.
Mission architectures for human exploration of the lunar surface continue to advance as well as the definitions of capability needs, best practices and engineering design to mitigate the impact of lunar dust on exposed systems. The NASA DMP has been established as the agency focal point for dust characterization, technology, and simulant development. As described in this paper, the DMP has defined a process for selecting and justifying its R&T portfolio. The technology prioritization process, which is based on a ranking system according to weighted criteria, has been successfully applied to the current DMP dust mitigation technology portfolio. Several key findings emerged from this assessment. Within the dust removal and cleaning technologies group, there are critical technical challenges that must be overcome for these technologies to be implemented for lunar applications. For example, an in-situ source of CO2 on the moon is essential to the CO2 shower technology. Also, significant development effort is required to achieve technology readiness level TRL 6 for the electrostatic cleaning system for removal of particles smaller than 50 pm. The baseline materials related technologies require considerable development just to achieve TRL 6. It is also a nontrivial effort to integrate the materials in hardware for lunar application. At present, there are no terrestrial applications that are readily adaptable to lunar surface applications nor are there any obvious leading candidates. The unique requirements of dust sealing systems for lunar applications suggest an extensive development effort will be necessary to mature dust sealing systems to TRL 6 and beyond. As discussed here, several alternate materials and technologies have achieved high levels of maturity for terrestrial applications and warrant due diligence in ongoing assessment of the technology portfolio. The present assessment is the initial step in an ongoing effort to continually evaluate the DMP technology portfolio and external non-NASA relevant technology developments efforts to maintain an optimal investment profile. At the same time, there is an ongoing review of agency-wide dust-related R&T activities. The results of these ongoing assessments will be reported in future publications.
Advanced Technology Life-cycle Analysis System (ATLAS) is a system-of-systems technology-portfolio-analysis software tool. ATLAS affords capabilities to (1) compare estimates of the mass and cost of an engineering system based on competing technological concepts; (2) estimate life-cycle costs of an outer-space-exploration architecture for a specified technology portfolio; (3) collect data on state-of-the-art and forecasted technology performance, and on operations and programs; and (4) calculate an index of the relative programmatic value of a technology portfolio. ATLAS facilitates analysis by providing a library of analytical spreadsheet models for a variety of systems. A single analyst can assemble a representation of a system of systems from the models and build a technology portfolio. Each system model estimates mass, and life-cycle costs are estimated by a common set of cost models. Other components of ATLAS include graphical-user-interface (GUI) software, algorithms for calculating the aforementioned index, a technology database, a report generator, and a form generator for creating the GUI for the system models. At the time of this reporting, ATLAS is a prototype, embodied in Microsoft Excel and several thousand lines of Visual Basic for Applications that run on both Windows and Macintosh computers.
A portfolio management approach was developed for the National Aeronautics and Space Administration s (NASA s) Airspace Systems Program (ASP). The purpose was to help inform ASP leadership regarding future investment decisions related to its existing portfolio of advanced technology concepts and capabilities (C/Cs) currently under development and to potentially identify new opportunities. The portfolio management approach is general in form and is extensible to other advanced technology development programs. It focuses on individual C/Cs and consists of three parts: 1) concept of operations (con-ops) development, 2) safety impact assessment, and 3) benefit-cost-risk (B-C-R) assessment. The first two parts are recommendations to ASP leaders and will be discussed only briefly, while the B-C-R part relates to the development of an assessment capability and will be discussed in greater detail. The B-C-R assessment capability enables estimation of the relative value of each C/C as compared with all other C/Cs in the ASP portfolio. Value is expressed in terms of a composite weighted utility function (WUF) rating, based on estimated benefits, costs, and risks. Benefit utility is estimated relative to achieving key NAS performance objectives, which are outlined in the ASP Strategic Plan.1 Risk utility focuses on C/C development and implementation risk, while cost utility focuses on the development and implementation portions of overall C/C life-cycle costs. Initial composite ratings of the ASP C/Cs were successfully generated; however, the limited availability of B-C-R information, which is used as inputs to the WUF model, reduced the meaningfulness of these initial investment ratings. Development of this approach, however, defined specific information-generation requirements for ASP C/C developers that will increase the meaningfulness of future B-C-R ratings.
The NASA Aeronautics Research Mission Directorate (ARMD) vision falls into six strategic thrusts that are aimed to support the challenges of the Next Generation Air Transportation System (NextGen). In order to achieve the goals of the ARMD vision, the Airspace Operations and Safety Program (AOSP) is committed to developing and delivering new technologies. To meet the dual challenges of constrained resources and timely technology delivery, program portfolio risk assessment is critical for communication and decision-making. This paper describes how Bayesian Belief Network (BBN) is applied to assess the probability of a technology meeting the expected outcome. The network takes into account the different risk factors of technology development and implementation phases. The use of BBNs allows for all technologies of projects in a program portfolio to be separately examined and compared. In addition, the technology interaction effects are modeled through the application of object-oriented BBNs. The paper discusses the development of simplified project risk BBNs and presents various risk results. The results presented include the probability of project risks not meeting success criteria, the risk drivers under uncertainty via sensitivity analysis, and what-if analysis. Finally, the paper shows how program portfolio risk can be assessed using risk results from BBNs of projects in the portfolio.
Community solar offers multiple benefits to providers and residents of multifamily affordable housing (MFAH), including access to affordable renewable energy for low- and moderate-income households, tax credits and other financial benefits for property owners, and increased community resilience when paired with energy storage. Even so, MFAH providers interested in realizing these benefits may need support to identify where to start or how to expand and accelerate solar deployment across their property portfolios once they have completed their first few installations. This fact sheet describes a portfolio screening approach for MFAH providers to evaluate their multi-state building portfolios for community solar project viability. The approach was developed by the National Renewable Energy Laboratory as part of its support for the National Community Solar Partnership (NCSP) MFAH Collaborative. By utilizing NREL's companion Policy Screening Workbook in conjunction with the web-based tools PVWatts® Calculator and REopt™ (Renewable Energy Integration and Optimization), MFAH providers can take a data-informed approach to identifying and prioritizing buildings in their portfolios that are most amenable to community solar development.
The National Renewable Energy Laboratory (NREL), in collaboration with the U.S. Department of Energy's (DOE's) Water Power Technologies Office (WPTO), has developed a unique R&D approach to advance marine energy desalination. Desalination is a foundational investment within WPTO's Powering the Blue EconomyTM portfolio [1], and was the first investment within this portfolio. NREL's marine energy desalination spans techno-economic feasibility studies, numerical modeling, and laboratory testing at the component and subsystem level, as well as development of the Hydraulic and Electric Reverse Osmosis Wave Energy Converter (HERO WEC). This multilayered approach enables an innovative feedback loop where the data and lessons learned from laboratory and field experiments are used to refine modeling tools and analysis techniques, prioritize out-year activities, and refine strategic directions within NREL and across the WPTO portfolio. The primary objective of the NREL-led research is to identify key barriers associated with the commercialization of wave-powered desalination and develop solutions that can be adopted by the marine energy industry. It should be noted, while WPTO's marine energy portfolio includes wave, tidal, ocean current, thermal gradients, and pressure gradients the bulk of the marine energy desalination work has been focused on wave powered desalination. In parallel, these R&D activities can help inform technical assistance and support of industry and academic technologies. These two tracks help build a common solver community approach, while also identifying key stakeholders, government agencies, and other organizations outside of the marine sector that will be necessary for developing a robust industry.
Reducing the overall energy consumption and associated greenhouse gas emissions in the building sector is essential for meeting our future sustainability goals. Recently, smart energy metering facilities have been deployed to enable monitoring of energy consumption data with hourly or subhourly temporal resolution. This unprecedented data collection has created various opportunities for advanced data analytics involving load profiles (e.g., building energy benchmarking programs, building-to-grid integration, and calibration of urban-scale energy models). These applications often need preprocessing steps to detect daily load profile discords, such as: 1) outliers due to system malfunctions (the bad) and 2) irregular energy consumption patterns, such as those resulting from holidays (the ugly) compared to normal consumption patterns (the good). However, current preprocessing methods predominantly focus on filtering using statistical threshold values, which fail to capture the contextual discords of daily profiles. In addition, discord detection algorithms in building research are often aimed at finding individual building-level discords, which are not suitable at a large scale. Thus, here, we develop a method for automated load profile discord identification (ALDI) in a large portfolio of buildings (more than 100 buildings). Specifically, ALDI 1) uses the matrix profile (MP) method to quantify the similarities of daily subsequences in time series meter data, 2) compares daily MP values with typical-day MP distributions using the Kolmogorov-Smirnov test, and 3) identifies daily load profile discords in a large building portfolio. We evaluate ALDI using the metering data of both an academic campus and a residential neighborhood. Our results demonstrate that ALDI efficiently discovers measurement errors by system malfunctions and low energy consumption days in the academic campus portfolio, and it detects unique load shape patterns likely driven by occupant behavior and extreme weather conditions in the residential neighborhood.
Workflow Management Systems used to automate the execution of scientific workflow applications on parallel and distributed computing platforms must make scheduling decisions at runtime. A large number of workflow scheduling algorithms have been proposed in the literature, but often these algorithms are evaluated based on simplifying assumptions that may not hold in practice. Furthermore, published algorithm evaluation and/or comparison results are necessarily only for a subset of all possible scenarios, and thus may not include scenarios relevant to particular use-cases. Consequently, it is difficult for Workflow Management Systems (WMSs) developers to decide which scheduling algorithm should be implemented. To obviate this difficulty, one possible approach is to implement a portfolio of scheduling algorithms and select the most effective algorithm at runtime. One method for performing this selection is to run an online simulation for each algorithm in the portfolio. The algorithm that leads to the best performance, in simulation, is selected for future use. The above simulation-driven portfolio scheduling (SDPS) approach has been proposed in a few parallel and distributed computing contexts. The main objective of this work is to evaluate the feasibility and potential merit of SDPS if implemented in WMSs. Here we perform this evaluation using simulated WMS executions, where the simulations are instantiated from real-world platform and workflow configurations. Our main finding is that SDPS is on par with or outperforms an approach in which a single algorithm is used, where this algorithm is the one that performs best on average across all our experimental scenarios. Furthermore, we find that SDPS remains an attractive proposition even in the presence of high levels of simulation error and for simulators with relatively low levels of sophistication. In many of our experimental scenarios we find that mitigating simulation error at runtime can further improve performance. Finally, we show that simulation overhead can be made sufficiently low for SDPS to be feasible in practice.
Managing a large portfolio of buildings involves decisions on reuse, retrofit, renovation, rehabilitation, and new construction, influenced by trade-offs between performance metrics such as cost, time, and operational flexibility over the building's life cycle. Traditional life cycle assessment tools for evaluating these metrics can be labor- and compute-intensive, requiring extensive data and modeling for each building. Metamodels (or surrogate models) using machine learning have been explored as faster alternatives, but training these models has been hindered by the limited availability of comprehensive data on key life cycle metrics. Recent advancements in machine learning, particularly deep learning techniques like zero-shot and few-shot learning, allow models to learn from sparse or limited data. We propose a machine learning-based metamodel that leverages these techniques for rapid estimation of key building life cycle metrics. This presentation will cover the model architecture, data collection, training, and validation processes, along with an ongoing case study applied to a large portfolio of buildings. We will discuss the model's performance in terms of accuracy, compute time, limitations, and its potential for expanding to additional life cycle metrics. This data-driven approach offers a promising direction for the rapid evaluation of large building portfolios.
Runtime systems that automate the execution of applications on distributed cyberinfrastructures need to make scheduling decisions. Researchers have proposed many scheduling algorithms, but most of them are designed based on analytical models and assumptions that may not hold in practice. The literature is thus rife with algorithms that have been evaluated only within the scope of their underlying assumptions but whose practical effectiveness is unclear. It is thus difficult for developers to decide which algorithm to implement in their runtime systems.To obviate the above difficulty, we propose an approach by which the runtime system executes, throughout application execution, simulations of this very execution. Each simulation is for a different algorithm in a scheduling algorithm portfolio, and the best algorithm is selected based on simulation results. The main objective of this work is to evaluate the feasibility and potential merit of this portfolio scheduling approach, even in the presence of simulation inaccuracy, when compared to the traditional one-algorithm approach. We perform this evaluation via a case study in the context of scientific workflows. Our main finding is that portfolio scheduling can outperform the best one-algorithm approach even in the presence of relatively large simulation inaccuracies.
Energy Efficiency has historically focused on delivering savings to offset growth in energy supply. Today’s growing emphasis on decarbonization of the energy supply is driving renewables adoption and increased interest in electrification. As a result, energy efficiency is being assessed not just in its ability to offset load growth, but also for its ability to alleviate location-specific constraints on transmission and distribution infrastructure. This work demonstrates that advanced measurement and verification modeling techniques can be used to estimate the spatio-temporal grid impact of a portfolio of energy efficiency programs. It extends measurement-based methods to an entire Demand Side Management portfolio and uses a single model to predict annual as well as seasonal building energy use with near-zero bias. In addition, new metrics are introduced to assess grid level impacts of energy efficiency. The results show that the efficiency program portfolio delivers savings of over 12% at the territory-wide proxy level, with substation and feeder level savings ranging from 0.4% to 26%, and ~5%-42% respectively. Overall, these savings impacted 1.0%–1.4% of the energy used at these locations in the grid. This work provides a methodology with potential to connect efficiency with distribution planning, carrying implications for non-wires alternatives and targeted delivery of efficiency programs.