Results for “key performance metrics” — Page 7

NASA NTRS1992

Optimizing binary phase and amplitude filters for PCE, SNR, and discrimination

Binary phase-only filters (BPOFs) have generated much study because of their implementation on currently available spatial light modulator devices. On polarization-rotating devices such as the magneto-optic spatial light modulator (SLM), it is also possible to encode binary amplitude information into two SLM transmission states, in addition to the binary phase information. This is done by varying the rotation angle of the polarization analyzer following the SLM in the optical train. Through this parameter, a continuum of filters may be designed that span the space of binary phase and amplitude filters (BPAFs) between BPOFs and binary amplitude filters. In this study, we investigate the design of optimal BPAFs for the key correlation characteristics of peak sharpness (through the peak-to-correlation energy (PCE) metric), signal-to-noise ratio (SNR), and discrimination between in-class and out-of-class images. We present simulation results illustrating improvements obtained over conventional BPOFs, and trade-offs between the different performance criteria in terms of the filter design parameter.

Downie, John D.↗

NASA NTRS2016

Is It Worth It? - the Economics of Reusable Space Transportation

Over the past several decades billions of dollars have been invested by governments and private companies in the pursuit of lower cost access to space through earth-to-orbit (ETO) space transportation systems. Much of that investment has been focused on the development and operation of various forms of reusable transportation systems. From the Space Shuttle to current efforts by private commercial companies, the overarching belief of those making such investments has been that reusing system elements will be cheaper than utilizing expendable systems that involve throwing away costly engines, avionics, and other hardware with each flight. However, the view that reusable systems are ultimately a "better" approach to providing ETO transportation is not held universally by major stakeholders within the space transportation industry. While the technical feasibility of at least some degree of reusability has been demonstrated, there continues to be a sometimes lively debate over the merits and drawbacks of reusable versus expendable systems from an economic perspective. In summary, is it worth it? Based on our many years of direct involvement with the business aspects of several expendable and reusable transportation systems, it appears to us that much of the discussion surrounding reusability is hindered by a failure to clearly define and understand the financial and other metrics by which the financial "goodness" of a reusable or expandable approach is measured. As stakeholders, the different users and suppliers of space transportation have a varied set of criteria for determining the relative economic viability of alternative strategies, including reusability. Many different metrics have been used to measure the affordability of space transportation, such as dollars per payload pound (kilogram) to orbit, cost per flight, life cycle cost, net present value/internal rate of return, and many others. This paper will examine the key considerations that influence stakeholders as they make space transportation investment decisions, including primary metrics by which various stakeholders measure financial goodness and other factors that significantly shape decisions to invest in reusable or expendable systems. It must be noted at the outset that reusable systems take many forms and perform different transportation functions including, but not limited to, ETO payload delivery. The discussion in this paper is limited to the economics of ETO transportation systems.

Webb, Richard↗

NASA NTRS1978

Numerical aerodynamic simulation facility. Preliminary study extension

The production of an optimized design of key elements of the candidate facility was the primary objective of this report. This was accomplished by effort in the following tasks: (1) to further develop, optimize and describe the function description of the custom hardware; (2) to delineate trade off areas between performance, reliability, availability, serviceability, and programmability; (3) to develop metrics and models for validation of the candidate systems performance; (4) to conduct a functional simulation of the system design; (5) to perform a reliability analysis of the system design; and (6) to develop the software specifications to include a user level high level programming language, a correspondence between the programming language and instruction set and outline the operation system requirements.

Source record↗

NASA NTRS2019

Key Result Areas and Critical Success Factors

Measuring government agency performance is a relatively hot topic, yet the process continues to be problematic to implement. Identifying goals and objectives and determining the right measures is the subject of much literature and discussion, but according to the General Accounting Office (see below), there has been little success in the actual use of performance metrics. Fortunately, there is a logical thought process that can serve to facilitate the identification and implementation of appropriate measures.

Shepherd, Christena C.↗

NASA NTRSDate not supplied

Natural Language Processing Analysis of Notices to Airmen for Air Traffic Management Optimization

With new emerging technologies in the field of NLP, we explore their applications to digitize and analyze heritage Air Traffic Management (ATM) documents for planning and optimizing airspace operations. Specifically, this research focuses on harvesting semi-structured or un-structured information contained in Notices to Airmen (NOTAMs). Using NLP and other advanced data analytics, we will construct a data-driven framework which facilitates finding language patterns and the use of pretrained language models for classification and extraction of useful airspace constraints and restrictions. These may lead to tools that assist airspace users in understanding the constraints more efficiently, contributing to better route planning and safer execution. This paper explores three workflows entailing different NLP tasks. First, unsupervised techniques like word embedding and topic modeling are used for pattern finding and document classification. Second, a dataset is created by extracting information from the semi-structured NOTAM format as metadata for categorizing, visualizing, and extracting key entities driving NOTAM content. Third, modern pre-built deep learning based transformer models such as BERT, RoBERTa, and XLNet are evaluated on the question answering task, an even more robust approach to information extraction, as well as their respective fine-tuning tasks. In this work we include various performance metrics for the trained models to evaluate both accuracy and precision and we show that the models can be generalized for their respective tasks. The research work developed shows promise in uncovering trends in digital NOTAMs in the NAS and also offers a new framework for digitizing and inferring insights from free-form legacy NOTAMs, that are yet to be digitized.

Natural Language Processing↗

NASA NTRSDate not supplied

Natural Language Processing (NLP) Analysis of NOTAMs for Air Traffic Management Optimization

With new emerging technologies in the field of NLP, we explore their applications to digitize and analyze heritage Air Traffic Management (ATM) documents for planning and optimizing airspace operations. Specifically, this research focuses on harvesting semi-structured or un-structured information contained in Notices to Airmen (NOTAMs). Using NLP and other advanced data analytics, we will construct a data-driven framework which facilitates finding language patterns and the use of pretrained language models for classification and extraction of useful airspace constraints and restrictions. These may lead to tools that assist airspace users in understanding the constraints more efficiently, contributing to better route planning and safer execution. This paper explores three workflows entailing different NLP tasks. First, unsupervised techniques like word embedding and topic modeling are used for pattern finding and document classification. Second, a dataset is created by extracting information from the semi-structured NOTAM format as metadata for categorizing, visualizing, and extracting key entities driving NOTAM content. Third, modern pre-built deep learning based transformer models such as BERT, RoBERTa, and XLNet are evaluated on the question answering task, an even more robust approach to information extraction, as well as their respective fine-tuning tasks. In this work we include various performance metrics for the trained models to evaluate both accuracy and precision and we show that the models can be generalized for their respective tasks. The research work developed shows promise in uncovering trends in digital NOTAMs in the NAS and also offers a new framework for digitizing and inferring insights from free-form legacy NOTAMs, that are yet to be digitized. Video is an mp4 download, with a play time of 9 min 35 secs.

Natural Language Processing↗

NASA NTRS2026

PROTECT: Production and Reuse of Thermally Efficient Ceramic Thermal Protection Systems

PROTECT (Production and Reuse Of Thermally Efficient Ceramic TPS) is a NASA Early Career Initiative focused on developing the next generation of reusable ceramic thermal protection systems (TPS). This project addresses key challenges in TPS design, including temperature capability, thermal stability, and refurbishment time, by integrating novel material development with predictive modeling. Leveraging enhanced capabilities in NASA’s Porous Microstructure Analysis (PuMA) software, PROTECT introduces new modeling tools to predict the thermal and mechanical behavior of fibrous ceramic materials. These tools enable accurate prediction of performance metrics such as thermal conductivity and structural integrity, reducing reliance on costly physical testing. Preliminary advances in these areas will be presented. To support model validation, PROTECT is building a comprehensive database of raw material properties using advanced characterization techniques, including micro computed tomography (CT) scanning in collaboration with the University of Illinois Urbana-Champaign (UIUC). The presentation will detail the sampling workflows and analysis methods used to generate this detailed microstructural data and how it is used to develop improved models in PuMA. This multi-center collaboration, spanning NASA (JSC, ARC, KSC, GRC), Oak Ridge National Laboratory, UIUC, and SpaceX, is developing tailored TPS solutions for LEO, lunar, and Martian missions. By bridging heritage systems with the demands of modern spaceflight, PROTECT contributes to the advancement of reusable TPS technologies for future exploration missions.

Propulsion, Refractory, and Coating Materials↗

NASA NTRS2026

PROTECT: Production and Reuse of Thermally Efficient Ceramic Thermal Protection Systems

PROTECT (Production and Reuse Of Thermally Efficient Ceramic TPS) is a NASA Early Career Initiative focused on developing the next generation of reusable ceramic thermal protection systems (TPS). This project addresses key challenges in TPS design, including temperature capability, thermal stability, and refurbishment time, by integrating novel material development with predictive modeling. Leveraging enhanced capabilities in NASA’s Porous Microstructure Analysis (PuMA) software, PROTECT introduces new modeling tools to predict the thermal and mechanical behavior of fibrous ceramic materials. These tools enable accurate prediction of performance metrics such as thermal conductivity and structural integrity, reducing reliance on costly physical testing. Preliminary advances in these areas will be presented. To support model validation, PROTECT is building a comprehensive database of raw material properties using advanced characterization techniques, including micro computed tomography (CT) scanning in collaboration with the University of Illinois Urbana-Champaign (UIUC). The presentation will detail the sampling workflows and analysis methods used to generate this detailed microstructural data and how it is used to develop improved models in PuMA. This multi-center collaboration, spanning NASA (JSC, ARC, KSC, GRC), Oak Ridge National Laboratory, UIUC, and SpaceX, is developing tailored TPS solutions for LEO, lunar, and Martian missions. By bridging heritage systems with the demands of modern spaceflight, PROTECT contributes to the advancement of reusable TPS technologies for future exploration missions.

Propulsion, Refractory, and Coating Materials↗

NASA NTRS1985

FH/MFSK performance in multitone jamming

The performance of frequency-hopped (FH) M-ary frequency-shift keyed (MFSK) signals in partial-band noise was analyzed in the open literature. The previous research is extended to the usually more effective class of multitone jamming. Some objectives researched are: (1) To categorize several different multitone jamming strategies; (2) To analyze the performance of FH/MSFK signaling, both uncoded with diversity, assuming a noncoherent energy detection metric with linear combining and perfect jamming state side information, in the presence of worst case interference for each of these multitone categories; and (3) To compare the effectiveness of the various multitone jamming techniques, and contrast the results with the partial band noise jamming case.

Levitt, B. K.↗

NASA NTRS1985

FH/MFSK performance in multitone jamming

The performance of frequency-hopped (FH) M-ary frequency-shift keyed (MFSK) signals in partial-band noise as analyzed in the open literature. The previous research is extended to the usually more effective class of multitone jamming. Some objectives researched are: (1) To categorize several different multitone jamming strategies; (2) To analyze the performance of FH/MSFK signaling, both uncoded with diversity, assuming a noncoherent energy detection metric with linear combining and perfect jamming state side information, in the presence of worst case interference for each of these multitone categories; and (3) To compare the effectiveness of the various multitone jamming techniques, and contrast the results with the partial band noise jamming case.

Levitt, B. K.↗

NASA NTRS1996

An Analysis of NASA Technology Transfer

A review of previous technology transfer metrics, recommendations, and measurements is presented within the paper. A quantitative and qualitative analysis of NASA's technology transfer efforts is performed. As a relative indicator, NASA's intellectual property performance is benchmarked against a database of over 100 universities. Successful technology transfer (commercial sales, production savings, etc.) cases were tracked backwards through their history to identify the key critical elements that lead to success. Results of this research indicate that although NASA's performance is not measured well by quantitative values (intellectual property stream data), it has a net positive impact on the private sector economy. Policy recommendations are made regarding technology transfer within the context of the documented technology transfer policies since the framing of the Constitution. In the second thrust of this study, researchers at NASA Langley Research Center were surveyed to determine their awareness of, attitude toward, and perception about technology transfer. Results indicate that although researchers believe technology transfer to be a mission of the Agency, they should not be held accountable or responsible for its performance. In addition, the researchers are not well educated about the mechanisms to perform, or policies regarding, technology transfer.

Bush, Lance B.↗

NASA NTRS1992

Performance Evaluation and Modeling Techniques for Parallel Processors

In practice, the performance evaluation of supercomputers is still substantially driven by singlepoint estimates of metrics (e.g., MFLOPS) obtained by running characteristic benchmarks or workloads. With the rapid increase in the use of time-shared multiprogramming in these systems, such measurements are clearly inadequate. This is because multiprogramming and system overhead, as well as other degradations in performance due to time varying characteristics of workloads, are not taken into account. In multiprogrammed environments, multiple jobs and users can dramatically increase the amount of system overhead and degrade the performance of the machine. Performance techniques, such as benchmarking, which characterize performance on a dedicated machine ignore this major component of true computer performance. Due to the complexity of analysis, there has been little work done in analyzing, modeling, and predicting the performance of applications in multiprogrammed environments. This is especially true for parallel processors, where the costs and benefits of multi-user workloads are exacerbated. While some may claim that the issue of multiprogramming is not a viable one in the supercomputer market, experience shows otherwise. Even in recent massively parallel machines, multiprogramming is a key component. It has even been claimed that a partial cause of the demise of the CM2 was the fact that it did not efficiently support time-sharing. In the same paper, Gordon Bell postulates that, multicomputers will evolve to multiprocessors in order to support efficient multiprogramming. Therefore, it is clear that parallel processors of the future will be required to offer the user a time-shared environment with reasonable response times for the applications. In this type of environment, the most important performance metric is the completion of response time of a given application. However, there are a few evaluation efforts addressing this issue.

Dimpsey, Robert Tod↗

NASA NTRS2012

A Briefing on Metrics and Risks for Autonomous Decision-Making in Aerospace Applications

Significant technology advances will enable future aerospace systems to safely and reliably make decisions autonomously, or without human interaction. The decision-making may result in actions that enable an aircraft or spacecraft in an off-nominal state or with slightly degraded components to achieve mission performance and safety goals while reducing or avoiding damage to the aircraft or spacecraft. Some key technology enablers for autonomous decision-making include: a continuous state awareness through the maturation of the prognostics health management field, novel sensor development, and the considerable gains made in computation power and data processing bandwidth versus system size. Sophisticated algorithms and physics based models coupled with these technological advances allow reliable assessment of a system, subsystem, or components. Decisions that balance mission objectives and constraints with remaining useful life predictions can be made autonomously to maintain safety requirements, optimal performance, and ensure mission objectives. This autonomous approach to decision-making will come with new risks and benefits, some of which will be examined in this paper. To start, an account of previous work to categorize or quantify autonomy in aerospace systems will be presented. In addition, a survey of perceived risks in autonomous decision-making in the context of piloted aircraft and remotely piloted or completely autonomous unmanned autonomous systems (UAS) will be presented based on interviews that were conducted with individuals from industry, academia, and government.

Frost, Susan↗

NASA NTRSDate not supplied

Review of Controllers for Low-Power Free-Piston Stirling Convertors

In this paper, a review of various controller approaches for free-piston Stirling convertors (FPSCs) for low-power radioisotope power systems (RPS) is conducted to compare their performances in terms of critical metrics and provide an insight for designing better controllers for future flight projects. Design variables and general analysis methods for the controllers are described and the controllers are classified into different categories based on important design variables, followed by discussions on the operating principles and properties of various controller approaches in each classification category. Moreover, key features of the state-of-the-art controller approaches are summarized whose designs are hypothetically extended to flight designs to compare their critical metrics such as the estimated size, weight, and power with cost (SWaP-C) and reliability. Finally, design suggestions are made to improve certain metrics for future flight development projects. Along with maturation of free-piston Stirling convertor technologies for radioisotope power systems over the last three decades, various types of controllers have been proposed, among which a couple of them were developed to the Engineering Model (EM) for the Advanced Stirling Radioisotope Generator (ASRG) flight development project. Further improvements of the controllers have been made recently at NASA GRC and the improvements will continue for future flight development projects.

Free-Piston Stirling Convertor Controller↗

NASA NTRSDate not supplied

Review of Controllers for Low-Power Free-Piston Stirling Convertors

In this paper, a review of various controller approaches for free-piston Stirling convertors (FPSCs) for low-power radioisotope power systems (RPS) is conducted to compare their performances in terms of critical metrics and provide an insight for designing better controllers for future flight projects. Design variables and general analysis methods for the controllers are described and the controllers are classified into different categories based on important design variables, followed by discussions on the operating principles and properties of various controller approaches in each classification category. Moreover, key features of the state-of-the-art controller approaches are summarized whose designs are hypothetically extended to flight designs to compare their critical metrics such as the estimated size, weight, and power with cost (SWaP-C) and reliability. Finally, design suggestions are made to improve certain metrics for future flight development projects. Along with maturation of free-piston Stirling convertor technologies for radioisotope power systems over the last three decades, various types of controllers have been proposed, among which a couple of them were developed to the Engineering Model (EM) for the Advanced Stirling Radioisotope Generator (ASRG) flight development project. Further improvements of the controllers have been made recently at NASA GRC and the improvements will continue for future flight development projects.

Free-Piston Stirling Convertor Controller↗

NASA NTRS2024

An Approach to Evaluating the Impact of Small-Core Turbofan Technologies on Engine and Aircraft Performance

NASA’s Hybrid Thermally Efficient Core (HyTEC) project aims to accelerate the development of small-core turbofan engine technologies to enable a fuel burn reduction of 5 to 10 percent for next-generation aircraft, compared to 2020s best-in-class technology. This paper presents a demonstration of methods for evaluating the potential performance impact of small-core engine technologies developed under Phase 1 of the HyTEC project. The approach involves model-based systems analysis, where small-core innovations are integrated into baseline turbofan and aircraft systems models, creating a notional vision system. Performance of the vision system is examined at both the engine and vehicle level. The examined performance metrics include: engine bypass ratio, overall pressure ratio, high pressure compressor exit corrected mass flow, and aircraft fuel burn. The CFM LEAP-1B28 and Boeing 737 MAX 8 are chosen as the baseline state-of-the-art systems. Preliminary results map a design space for the small-core vision system and quantify the distinct effects of technologies on the key metrics.

Michael A Bennett↗

NASA NTRSDate not supplied

An Approach to Evaluating the Impact of Small-core Turbofan Technologies on Engine and Aircraft Performance

NASA’s Hybrid Thermally Efficient Core (HyTEC) project aims to accelerate the development of small-core turbofan engine technologies to enable a fuel burn reduction of 5 to 10 percent for next-generation aircraft, compared to 2020s best-in-class technology. This paper presents a demonstration of methods for evaluating the potential performance impact of small-core engine technologies developed under Phase 1 of the HyTEC project. The approach involves model-based systems analysis, where small-core innovations are integrated into baseline turbofan and aircraft systems models, creating a notional vision system. Performance of the vision system is examined at both the engine and vehicle level. The examined performance metrics include: engine bypass ratio, overall pressure ratio, high pressure compressor exit corrected mass flow, and aircraft fuel burn. The CFM LEAP-1B28 and Boeing 737 MAX 8 are chosen as the baseline state-of-the-art systems. Preliminary results map a design space for the small-core vision system and quantify the distinct effects of technologies on the key metrics.

Michael Bennett↗

NASA NTRSDate not supplied

Continued Exploration of the Electrified Aircraft Propulsion Design Space

A previous electrified aircraft propulsion (EAP) design space exploration study was continued to investigate the impact of mission constraints, further explore the design space of different sized aircraft, and improve the modeling process. Three aircraft were investigated, 18- and 48-passenger turboprops, and a 78-passenger turbofan. Baseline aircraft models were inherited from the earlier study and were hybridized by applying EAP technologies. A parametric study varying motor power and battery specific energy was conducted. For the 78-passenger turbofan, design range was also introduced as a parametric parameter. Key metrics for the study included equivalent lifecycle CO2 emissions and direct operating cost plus interest. Both turboprop aircraft demonstrated significant potential savings in block fuel consumption and CO2 emissions, but at increased operating costs compared to their baseline models. As the 78-passenger turbofan had shown no improvements in any metrics under reasonable technology assumptions, design range was shortened in an attempt to obtain performance benefits. When designed for a shorter range, the 78-passenger EAP vehicle showed potential improvements in block fuel when compared to a baseline with a similarly shortened design range, but not in any other metrics. Operating cost reductions were not achieved for any aircraft, but several designs came close to breaking even with their baselines. Smaller, shorter range aircraft and turboprops demonstrated larger performance benefits and smaller operating cost penalties, but a simple trade of electric energy storage in batteries for fuel is generally insufficient to produce a viable aircraft concept.

Electrified Aircraft Propulsion↗