Search NASA⌕ Search

SEARCH · Search NASA

Results for “complexity metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

A Ground-Delay-Based Approach to Reduce Impedance-Based Airspace Complexity

This paper introduces a ground-delay-based traffic management approach to reduce the impedance-based airspace complexity for a given scenario. This work extends our prior research on developing an impedance-based complexity metric for unmanned aircraft system traffic scenario classification. Impedance-based metric was evaluated for 1045 randomly generated scenarios. Scenarios with overall impedance above a certain threshold were declared as not feasible. A ground-delay-based approach was developed to be applied to the rest of the scenarios so as to remediate any scenarios with small areas of high impedance on their impedance maps. A sample application is shown for a scenario with sixty flights. The detailed trade-offs between overall accrued system delay, the number of delayed flights, the total number of conflicts and the highest impedance observed as a function of the delay tolerance for each aircraft are provided. Potential applications to Urban Air Mobility traffic scenarios are also discussed.

ground-delay based traffic management↗

On Optimal Input Design and Model Selection for Communication Channels

In this paper, the optimal model (structure) selection and input design which minimize the worst case identification error for communication systems are provided. The problem is formulated using metric complexity theory in a Hilbert space setting. It is pointed out that model selection and input design can be handled independently. Kolmogorov n-width is used to characterize the representation error introduced by model selection, while Gel fand and Time n-widths are used to represent the inherent error introduced by input design. After the model is selected, an optimal input which minimizes the worst case identification error is shown to exist. In particular, it is proven that the optimal model for reducing the representation error is a Finite Impulse Response (FIR) model, and the optimal input is an impulse at the start of the observation interval. FIR models are widely popular in communication systems, such as, in Orthogonal Frequency Division Multiplexing (OFDM) systems.

fast identification↗

Complexity and Pilot Workload Metrics for the Evaluation of Adaptive Flight Controls on a Full Scale Piloted Aircraft

Flight research has shown the effectiveness of adaptive flight controls for improving aircraft safety and performance in the presence of uncertainties. The National Aeronautics and Space Administration's (NASA)'s Integrated Resilient Aircraft Control (IRAC) project designed and conducted a series of flight experiments to study the impact of variations in adaptive controller design complexity on performance and handling qualities. A novel complexity metric was devised to compare the degrees of simplicity achieved in three variations of a model reference adaptive controller (MRAC) for NASA's F-18 (McDonnell Douglas, now The Boeing Company, Chicago, Illinois) Full-Scale Advanced Systems Testbed (Gen-2A) aircraft. The complexity measures of these controllers are also compared to that of an earlier MRAC design for NASA's Intelligent Flight Control System (IFCS) project and flown on a highly modified F-15 aircraft (McDonnell Douglas, now The Boeing Company, Chicago, Illinois). Pilot comments during the IRAC research flights pointed to the importance of workload on handling qualities ratings for failure and damage scenarios. Modifications to existing pilot aggressiveness and duty cycle metrics are presented and applied to the IRAC controllers. Finally, while adaptive controllers may alleviate the effects of failures or damage on an aircraft's handling qualities, they also have the potential to introduce annoying changes to the flight dynamics or to the operation of aircraft systems. A nuisance rating scale is presented for the categorization of nuisance side-effects of adaptive controllers.

pilot workload metrics↗

Complexity Management Using Metrics for Trajectory Flexibility Preservation and Constraint Minimization

The growing demand for air travel is increasing the need for mitigating air traffic congestion and complexity problems, which are already at high levels. At the same time new surveillance, navigation, and communication technologies are enabling major transformations in the air traffic management system, including net-based information sharing and collaboration, performance-based access to airspace resources, and trajectory-based rather than clearance-based operations. The new system will feature different schemes for allocating tasks and responsibilities between the ground and airborne agents and between the human and automation, with potential capacity and cost benefits. Therefore, complexity management requires new metrics and methods that can support these new schemes. This paper presents metrics and methods for preserving trajectory flexibility that have been proposed to support a trajectory-based approach for complexity management by airborne or ground-based systems. It presents extensions to these metrics as well as to the initial research conducted to investigate the hypothesis that using these metrics to guide user and service provider actions will naturally mitigate traffic complexity. The analysis showed promising results in that: (1) Trajectory flexibility preservation mitigated traffic complexity as indicated by inducing self-organization in the traffic patterns and lowering traffic complexity indicators such as dynamic density and traffic entropy. (2)Trajectory flexibility preservation reduced the potential for secondary conflicts in separation assurance. (3) Trajectory flexibility metrics showed potential application to support user and service provider negotiations for minimizing the constraints imposed on trajectories without jeopardizing their objectives.

Idris, Husni↗

A Flexible and Non-instrusive Approach for Computing Complex Structural Coverage Metrics

Software analysis tools and techniques often leverage structural code coverage information to reason about the dynamic behavior of software. Existing techniques instrument the code with the required structural obligations and then monitor the execution of the compiled code to report coverage. Instrumentation based approaches often incur considerable runtime overhead for complex structural coverage metrics such as Modified Condition/Decision (MC/DC). Code instrumentation, in general, has to be approached with great care to ensure it does not modify the behavior of the original code. Furthermore, instrumented code cannot be used in conjunction with other analyses that reason about the structure and semantics of the code under test. In this work, we introduce a non-intrusive preprocessing approach for computing structural coverage information. It uses a static partial evaluation of the decisions in the source code and a source-to-bytecode mapping to generate the information necessary to efficiently track structural coverage metrics during execution. Our technique is flexible; the results of the preprocessing can be used by a variety of coverage-driven software analysis tasks, including automated analyses that are not possible for instrumented code. Experimental results in the context of symbolic execution show the efficiency and flexibility of our nonintrusive approach for computing code coverage information

DO-178C↗

SU-E-T-353: Decoding the Beam Complexity in Intensity-Modulated Radiation Therapy Plans

Purpose: Modern IMRT relies on computers to generate treatment plans of varied complexity. A highly complex treatment plan may use a large number of small and irregular beam apertures in order to achieve high dose conformity. However, excessive beam complexity can increase dosimetric uncertainty, prolong treatment time, and increase susceptibility to target or organ motion. In this study we sought to develop metrics to assess the complexity of IMRT beams and plans. Methods: Based the information of leaf positions and MU for each beam segment, we calculated the following beam complexity metrics: aperture area, shape irregularity, and beam modulation. Then these beam complexity metrics were averaged to obtain the corresponding plan complexity metrics, using the beam MUs as weighting factors. We evaluated and compared the beam and plan complexity scores for 65 IMRT plans from 3 sites (prostate, head and neck, and spine). We also studied how the plan complexity scores were affected by adjusting inverse planning parameters. Results: For prostate IMRT, the lateral beams had large MUs and smaller shape irregularity, while the anterior or posterior beams had larger modulation values. On average, the prostate IMRT plans had the smallest shape irregularity and beam modulation; the HN IMRT plans had the largest aperture area, shape irregularity, and beam modulation; and the spine stereotactic IMRT plans often had small aperture area, which may be associated with relatively large discrepancies between calculated and measures doses. The plan complexity increased as the number of optimization iterations and the number of beam segments increased and as the minimum segment area decreased. Conclusion: Complexity of IMRT beams and plans were quantified in terms of aperture area, shape irregularity and beam modulation. The complexity metrics varied among IMRT plans for different disease sites and were affected when the planning parameters were adjusted.

60 APPLIED LIFE SCIENCES↗

Early Warning Look Ahead Metrics: The Percent Milestone Backlog Metric

All complex development projects experience delays and corresponding backlogs of their project control milestones during their acquisition lifecycles. NASA Goddard Space Flight Center (GSFC) Flight Projects Directorate (FPD) teamed with The Aerospace Corporation (Aerospace) to develop a collection of Early Warning Look Ahead metrics that would provide GSFC leadership with some independent indication of the programmatic health of GSFC flight projects. As part of the collection of Early Warning Look Ahead metrics, the Percent Milestone Backlog metric is particularly revealing, and has utility as a stand-alone execution performance monitoring tool. This paper describes the purpose, development methodology, and utility of the Percent Milestone Backlog metric. The other four Early Warning Look Ahead metrics are also briefly discussed. Finally, an example of the use of the Percent Milestone Backlog metric in providing actionable insight is described, along with examples of its potential use in other commodities.

acquisition lifecycles↗

Quantification of beam complexity in intensity-modulated radiation therapy treatment plans

Purpose: Excessive complexity in intensity-modulated radiation therapy (IMRT) plans increases the dose uncertainty, prolongs the treatment time, and increases the susceptibility to changes in patient or target geometry. To date, the tools for quantitative assessment of IMRT beam complexity are still lacking. In this study, The authors have sought to develop metrics to characterize different aspects of beam complexity and investigate the beam complexity for IMRT plans of different disease sites. Methods: The authors evaluated the beam complexity scores for 65 step-and-shoot IMRT plans from three sites (prostate, head and neck, and spine) and 26 volumetric-modulated arc therapy (VMAT) plans for the prostate. On the basis of the beam apertures and monitor unit weights of all segments, the authors calculated the mean aperture area, extent of aperture shape irregularity, and degree of beam modulation for each beam. Then the beam complexity values were averaged to obtain the complexity metrics of the IMRT plans. The authors studied the correlation between the beam complexity metrics and the quality assurance (QA) results. Finally, the effects of treatment planning parameters on beam complexity were studied. Results: The beam complexity scores were not uniform among the prostate IMRT beams from different gantry angles. The lateral beams had larger monitor units and smaller shape irregularity, while the anterior-posterior beams had larger modulation values. On average, the prostate IMRT plans had the smallest aperture irregularity, beam modulation, and normalized monitor units; the head and neck IMRT plans had large beam irregularity and beam modulation; and the spine stereotactic radiation therapy plans often had small beam apertures, which may have been associated with the relatively large discrepancies between planned and QA measured doses. There were weak correlations between the beam complexity scores and the measured dose errors. The prostate VMAT beams showed greater complexity than the prostate step-and-shoot IMRT beams. In the treatment planning process, the beam complexity increased as the minimum segment area decreased and as the number of optimization iterations and the maximum number of segments increased. Conclusions: The proposed metrics were effective in characterizing the beam complexity of different disease sites and for different treatment modalities. Efforts should be made to reduce the unnecessary complexity of IMRT beams to minimize the radiation dose uncertainties.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Study of Pairwise Deconfliction Metrics to Analyze Air Traffic Complexity in Upper Class E Airspace

Upper Class E Traffic Management (ETM) is envisioned to cooperatively facilitate operations of a diverse set of aerial vehicles, such as high-altitude long-endurance fixed-wing unmanned aircraft (low-speed and high-speed), high-altitude platforms, airships, stratospheric balloons, supersonic unmanned and commercial aircraft, etc., with a wide variety of mission types, performance characteristics, communication, navigation and surveillance capabilities, maneuverability, and on-board avionics in the National Airspace System (NAS) ’above’ 60,000 feet above mean sea level, without an active and direct control from human air traffic controllers. A diverse mixture of aerial vehicle types creates significant challenges in understanding air traffic complexity, which may not correlate strongly with air traffic density. One key step for determining air traffic complexity in upper class E airspace is to first understand pairwise deconfliction metrics such as reachability, reserve area, and reserve flight time for each pair of unique aerial vehicle types under potential conflict. Therefore, pairwise deconfliction metrics are first defined, and analytical equations are derived for conflict resolution using the heading change maneuver. Next, case studies are performed to analyze deconfliction metrics to avoid secondary conflicts in upper class E airspace. The study shows that pairwise deconfliction metrics are functions of maneuverability, performance characteristics, uncertainty in position and velocity, heading angle change, and conflict angle of aerial vehicles. The next step for this research is to build a mathematical model for air traffic complexity using pairwise deconfliction metrics and validate it in an upper Class E simulation environment.

Airspace Complexity↗

Study of Pairwise Deconfliction Metrics to Analyze Air Traffic Complexity in Upper Class E Airspace

Upper Class E Traffic Management (ETM) is envisioned to cooperatively facilitate operations of a diverse set of aerial vehicles, such as high-altitude long-endurance fixed-wing unmanned aircraft (low-speed and high-speed), high-altitude platforms, airships, stratospheric balloons, supersonic unmanned and commercial aircraft, etc., with a wide variety of mission types, performance characteristics, communication, navigation and surveillance capabilities, maneuverability, and on-board avionics in the National Airspace System (NAS) ’above’ 60,000 feet above mean sea level, without an active and direct control from human air traffic controllers. A diverse mixture of aerial vehicle types creates significant challenges in understanding air traffic complexity, which may not correlate strongly with air traffic density. One key step for determining air traffic complexity in upper class E airspace is to first understand pairwise deconfliction metrics such as reachability, reserve area, and reserve flight time for each pair of unique aerial vehicle types under potential conflict. Therefore, pairwise deconfliction metrics are first defined, and analytical equations are derived for conflict resolution using the heading change maneuver. Next, case studies are performed to analyze deconfliction metrics to avoid secondary conflicts in upper class E airspace. The study shows that pairwise deconfliction metrics are functions of maneuverability, performance characteristics, uncertainty in position and velocity, heading angle change, and conflict angle of aerial vehicles. The next step for this research is to build a mathematical model for air traffic complexity using pairwise deconfliction metrics and validate it in an upper Class E simulation environment.

Airspace Complexity↗

An empirical comparison of a dynamic software testability metric to static cyclomatic complexity

This paper compares the dynamic testability prediction technique termed 'sensitivity analysis' to the static testability technique termed cyclomatic complexity. The application that we chose in this empirical study is a CASE generated version of a B-737 autoland system. For the B-737 system we analyzed, we isolated those functions that we predict are more prone to hide errors during system/reliability testing. We also analyzed the code with several other well-known static metrics. This paper compares and contrasts the results of sensitivity analysis to the results of the static metrics.

Voas, Jeffrey M.↗

Metric analysis and data validation across FORTRAN projects

The desire to predict the effort in developing or explaining the quality of software has led to the proposal of several metrics. As a step toward validating these metrics, the Software Engineering Laboratory (SEL) has analyzed the software science metrics, cyclomatic complexity, and various standard program measures for their relation to effort (including design through acceptance testing), development errors (both discrete and weighted according to the amount of time to locate and fix), and one another. The data investigated are collected from a project FORTRAN environment and examined across several projects at once, within individual projects and by reporting accuracy checks demonstrating the need to validate a database. When the data comes from individual programmers or certain validated projects, the metrics' correlations with actual effort seem to be strongest. For modules developed entirely by individual programmers, the validity ratios induce a statistically significant ordering of several of the metrics' correlations. When comparing the strongest correlations, neither software science's E metric cyclomatic complexity not source lines of code appears to relate convincingly better with effort than the others.

Basili, Victor R.↗

Trajectory-Oriented Approach to Managing Traffic Complexity: Operational Concept and Preliminary Metrics Definition

This document describes preliminary research on a distributed, trajectory-oriented approach for traffic complexity management. The approach is to manage traffic complexity in a distributed control environment, based on preserving trajectory flexibility and minimizing constraints. In particular, the document presents an analytical framework to study trajectory flexibility and the impact of trajectory constraints on it. The document proposes preliminary flexibility metrics that can be interpreted and measured within the framework.

Idris, Husni↗

Systems engineering and integration: Cost estimation and benefits analysis

Space Transportation Avionics hardware and software cost has traditionally been estimated in Phase A and B using cost techniques which predict cost as a function of various cost predictive variables such as weight, lines of code, functions to be performed, quantities of test hardware, quantities of flight hardware, design and development heritage, complexity, etc. The output of such analyses has been life cycle costs, economic benefits and related data. The major objectives of Cost Estimation and Benefits analysis are twofold: (1) to play a role in the evaluation of potential new space transportation avionics technologies, and (2) to benefit from emerging technological innovations. Both aspects of cost estimation and technology are discussed here. The role of cost analysis in the evaluation of potential technologies should be one of offering additional quantitative and qualitative information to aid decision-making. The cost analyses process needs to be fully integrated into the design process in such a way that cost trades, optimizations and sensitivities are understood. Current hardware cost models tend to primarily use weights, functional specifications, quantities, design heritage and complexity as metrics to predict cost. Software models mostly use functionality, volume of code, heritage and complexity as cost descriptive variables. Basic research needs to be initiated to develop metrics more responsive to the trades which are required for future launch vehicle avionics systems. These would include cost estimating capabilities that are sensitive to technological innovations such as improved materials and fabrication processes, computer aided design and manufacturing, self checkout and many others. In addition to basic cost estimating improvements, the process must be sensitive to the fact that no cost estimate can be quoted without also quoting a confidence associated with the estimate. In order to achieve this, better cost risk evaluation techniques are needed as well as improved usage of risk data by decision-makers. More and better ways to display and communicate cost and cost risk to management are required.

Dean, ED↗

Scaling the PuNDIT project for wide area deployments

In today’s world of distributed scientific collaborations, there are many challenges to providing reliable inter-domain network infrastructure. Network operators use a combination of active monitoring and trouble tickets to detect problems, but these are often ineffective at identifying issues that impact wide-area network users. Additionally, these approaches do not scale to wide area inter-domain networks due to unavailability of data from all the domains along typical network paths. The Pythia Network Diagnostic InfrasTructure (PuNDIT) project aims to create a scalable infrastructure for automating the detection and localization of problems across these networks. The project goal is to gather and analyze metrics from existing perfSONAR monitoring infrastructures to identify the signatures of possible problems, locate affected network links, and report them to the user in an intuitive fashion. Simply put, PuNDIT seeks to convert complex network metrics into easily understood diagnoses in an automated manner. We present our progress in creating the PuNDIT system and our status in developing, testing and deploying PuNDIT. We report on the project progress to-date, describe the current implementation architecture and demonstrate some of the various user interfaces it will support. We close by discussing the remaining challenges and next steps and where we see the project going in the future.

97 MATHEMATICS AND COMPUTING↗

A Disturbance Rejection Approach to Actuator and Sensor Placement

For various reasons as discussed for instance in, the selection of actuator and sensor positions is still ad hoc. This is especially true for flexible structures where many candidate configurations can exist. This study is an attempt to make the selection process more methodical. One approach to actuator and sensor placement is to optimize a closed loop performance metric directly by selecting the actuators, sensors, and controller gains simultaneously. This direct approach makes sense if the desired closed loop performance is well defined. Since the individual actuator and sensor contributions to the closed loop performance metric is complex, the solution strategy usually employs non linear programming with many design and numerical iterations. A second approach is to select actuators and/or sensors based on open loop properties so that closed loop performance is indirectly optimized. Since the individual sensor and actuator contributions to the open loop metric is simple, nonlinear optimization is usually not needed. This approach will suggest efficient actuator and sensor configurations for any type of control law. The method suggested in this study falls into the latter class of approaches.

Lim, K. B.↗

New Chemical Dopant and Counterion Mechanism for Organic Electrochemical Transistors and Organic Mixed Ionic–Electronic Conductors

Abstract Organic mixed ionic–electronic conductors (OMIECs) have varied performance requirements across a diverse application space. Chemically doping the OMIEC can be a simple, low‐cost approach for adapting performance metrics. However, complex challenges, such as identifying new dopant materials and elucidating design rules, inhibit its realization. Here, these challenges are approached by introducing a new n‐dopant, tetrabutylammonium hydroxide (TBA‐OH), and identifying a new design consideration underpinning its success. TBA‐OH behaves as both a chemical n‐dopant and morphology additive in donor acceptor co‐polymer naphthodithiophene diimide‐based polymer, which serves as an electron transporting material in organic electrochemical transistors (OECTs). The combined effects enhance OECT transconductance, charge carrier mobility, and volumetric capacitance, representative of the key metrics underpinning all OMIEC applications. Additionally, when the TBA + counterion adopts an “edge‐on” location relative to the polymer backbone, Coulombic interaction between the counterion and polaron is reduced, and polaron delocalization increases. This is the first time such mechanisms are identified in doped‐OECTs and doped‐OMIECs. The work herein therefore takes the first steps toward developing the design guidelines needed to realize chemical doping as a generic strategy for tailoring performance metrics in OECTs and OMIECs.

36 MATERIALS SCIENCE↗