Search NASA⌕ Search

SEARCH · Search NASA

Results for “program metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

Characterization of Days Based On Analysis of National Airspace System Performance Metrics

Days of operations in the National Airspace System can be described in term of traffic demand, runway conditions, equipment outages, and surface and enroute weather conditions. These causes manifest themselves in terms of departure delays, arrival delays, enroute delays and traffic flow management delays, Traffic flow management initiatives such as, ground stops, ground delay programs, miles-in-trail restrictions, rerouting and airborne holding are imposed to balance the air traffic demand with respect to the available capacity, In order to maintain operational efficiency of the National Airspace System, the Federal Aviation Administration (FAA) maintains delay sad other statistics in the Air Traffic Operations Network (OPSNET) and the Aviation System Performance Metrics (ASPM) databases. OPSNET data includes reportable delays of fifteen minutes ox more experienced by Instrument Flight Rule (IFR) flights. Numbers of aircraft affected by departure delays, enroute delays, arrival delays and traffic flow delays are recorded in the OPSNET data. ASPM data consist of number of actual departures, number of canceled departures, percentage of on time departures, percentage of on time gate arrivals, taxi-out delays. taxi-in delays, gate delays, arrival delays and block delays. Surface conditions at the major U.S. airports are classified in terms of Instrument Meteorological Condition (IMC) and Visual Meteorological Condition (VMC) as a function of the time of the day in the ASPM data. The main objective of this paper is to use OPSNET and ASPM data to classify the days in the datasets into few distinct groups, where each group is separated from the other groups in terms of a distance metric. The motivations for classifying the days are two-fold, 1) to enable selection of days of traffic with particular operational characteristics for concept evaluation using system-wide simulation systems such as the National Aeronautics and Space Administration's Airspace Concepts Evaluation Tool (ACES) and 2) to enable evaluation of a given day with respect to the characteristics of the classified groups. The first part of the paper is devoted to the analysis of major trends seen in the OPSNET and ASPM data. The second part of the paper is devoted to describing features or measures derived from the OPSNET and ASPM data that are suitable for characterizing days, and the classification algorithm used for grouping the days. Finally, the method for evaluating the characteristics of a given day with respect to the properties of the groups is described.

Chatterji, Gano B.↗

Bayesian Model Selection for Reducing Bloat and Overfitting in Genetic Programming for Symbolic Regression

When performing symbolic regression using genetic programming, overfitting and bloat can negatively impact generalizability and interpretability of the resulting equations as well as increase computation times. A Bayesian fitness metric is introduced and its impact on bloat and overfitting during population evolution is studied and compared to common alternatives in the literature. The proposed approach was found to be more robust to noise and data sparsity in numerical experiments, guiding evolution to a level of complexity appropriate to the dataset. Further evolution of the population resulted not in overfitting or bloat, but rather in slight simplifications in model form. The ability to identify an equation of complexity appropriate to the scale of noise in the training data was also demonstrated. In general, the Bayesian model selection algorithm was shown to be an effective means of regularization which resulted in less bloat and overfitting when any amount of noise was present in the training data.

G F Bomarito↗

Bayesian Model Selection for Reducing Bloat and Overfitting in Genetic Programming for Symbolic Regression

When performing symbolic regression using genetic programming, overfitting and bloat can negatively impact generalizability and interpretability of the resulting equations as well as increase computation times. A Bayesian fitness metric is introduced and its impact on bloat and overfitting during population evolution is studied and compared to common alternatives in the literature. The proposed approach was found to be more robust to noise and data sparsity in numerical experiments, guiding evolution to a level of complexity appropriate to the dataset. Further evolution of the population resulted not in overfitting or bloat, but rather in slight simplifications in model form. The ability to identify an equation of complexity appropriate to the scale of noise in the training data was also demonstrated. In general, the Bayesian model selection algorithm was shown to be an effective means of regularization which resulted in less bloat and overfitting when any amount of noise was present in the training data.

Uncertainty quantification↗

An interactive machine learning platform for analyzing multi-particle coincidence data from cold target recoil ion momentum spectroscopy

We present SCULPT (Supervised Clustering and Uncovering Latent Patterns with Training), a comprehensive software platform for analyzing tabulated high-dimensional multi-particle coincidence data from Cold Target Recoil Ion Momentum Spectroscopy (COLTRIMS) experiments. The software addresses critical challenges in modern momentum spectroscopy by integrating advanced machine learning techniques with physics-informed analysis in an interactive web-based environment. SCULPT implements uniform manifold approximation and projection for non-linear dimensionality reduction to reveal correlations in high-dimensional data. We also discuss potential extensions to deep autoencoders for feature learning and genetic programming for automated discovery of physically meaningful observables. A novel adaptive confidence scoring system provides quantitative reliability assessments by evaluating user-selected clustering quality metrics with predefined weights that reflect each metric’s robustness. The platform features configurable molecular profiles for different experimental systems, interactive visualization with selection tools, and comprehensive data filtering capabilities. Utilizing a subset of SCULPT’s capabilities, we analyze photo-double-ionization data measured using the COLTRIMS method for three-body dissociation of the D 2 O molecule, revealing distinct fragmentation channels and their correlations with physics parameters. The software’s modular architecture and web-based implementation make it accessible to the broader atomic and molecular physics community, significantly reducing the time required for complex multi-dimensional analyses. This opens the door to finding and isolating rare events exhibiting non-linear correlations on the fly during experimental measurements, which can help steer exploration and improve the efficiency of experiments.

Artificial neural networks↗

A software technology evaluation program

A set of quantitative approaches is presented for evaluating software development methods and tools. The basic idea is to generate a set of goals which are refined into quantifiable questions which specify metrics to be collected on the software development and maintenance process and product. These metrics can be used to characterize, evaluate, predict, and motivate. They can be used in an active as well as passive way by learning form analyzing the data and improving the methods and tools based upon what is learned from that analysis. Several examples were given representing each of the different approaches to evaluation. The cost of the approaches varied inversely with the level of confidence in the interpretation of the results.

Novaes-Card, David N.↗

Configurable Multi-Purpose Processor

Advancements in technology have allowed the miniaturization of systems used in aerospace vehicles. This technology is driven by the need for next-generation systems that provide reliable, responsive, and cost-effective range operations while providing increased capabilities such as simultaneous mission support, increased launch trajectories, improved launch, and landing opportunities, etc. Leveraging the newest technologies, the command and telemetry processor (CTP) concept provides for a compact, flexible, and integrated solution for flight command and telemetry systems and range systems. The CTP is a relatively small circuit board that serves as a processing platform for high dynamic, high vibration environments. The CTP can be reconfigured and reprogrammed, allowing it to be adapted for many different applications. The design is centered around a configurable field-programmable gate array (FPGA) device that contains numerous logic cells that can be used to implement traditional integrated circuits. The FPGA contains two PowerPC processors running the Vx-Works real-time operating system and are used to execute software programs specific to each application. The CTP was designed and developed specifically to provide telemetry functions; namely, the command processing, telemetry processing, and GPS metric tracking of a flight vehicle. However, it can be used as a general-purpose processor board to perform numerous functions implemented in either hardware or software using the FPGA s processors and/or logic cells. Functionally, the CTP was designed for range safety applications where it would ultimately become part of a vehicle s flight termination system. Consequently, the major functions of the CTP are to perform the forward link command processing, GPS metric tracking, return link telemetry data processing, error detection and correction, data encryption/ decryption, and initiate flight termination action commands. Also, the CTP had to be designed to survive and operate in a launch environment. Additionally, the CTP was designed to interface with the WFF (Wallops Flight Facility) custom-designed transceiver board which is used in the Low Cost TDRSS Transceiver (LCT2) also developed by WFF. The LCT2 s transceiver board demodulates commands received from the ground via the forward link and sends them to the CTP, where they are processed. The CTP inputs and processes data from the inertial measurement unit (IMU) and the GPS receiver board, generates status data, and then sends the data to the transceiver board where it is modulated and sent to the ground via the return link. Overall, the CTP has combined processing with the ability to interface to a GPS receiver, an IMU, and a pulse code modulation (PCM) communication link, while providing the capability to support common interfaces including Ethernet and serial interfaces boarding a relatively small-sized, lightweight package.

Valencia, J. Emilio↗

Robust Acoustic Objective Functions and Sensitivities in Adjoint-Based Design Optimizations

The multidisciplinary design of aircraft typically includes considerations of performance, weight, fuel burn, and noise, among other factors. An objective function is applied to each of these considerations in order to weight the influence of trade-offs between different designs. Higher-order optimization exercises have utilized an adjoint approach to reach an optimal set of objective functions, such as maximum lift and reduced drag. Taking advantage of the adjoint approach significantly reduces the computational time required to find an optimal configuration. Including acoustics in the set of objective functions during an adjoint-based design optimization requires the sensitivity of the acoustic objective function. This document will present an approach for defining the sensitivity of several acoustic metrics and operations that can fill the role of the acoustic objective function. This includes time-integrated metrics such as effective perceived noise level (EPNL) and frequency-integrated metrics such as overall sound pressure level (OASPL). A demonstration case, validation, and details on the implementation in the second generation Aircraft NOise Prediction Program (ANOPP2) are also shown.

Lopes, Leonard V.↗

Integration of Design Data Into Automated Fiber Placement Process Planning Metrics

With the ever-expanding aviation industry, a need is arising for more rapid production of composite aircraft to meet increasing demand. State-of-the-art aircraft such as the Boeing 787showcase 50% composite material usage by weight, highlighting this emerging industry-wide adoption of the material system. Currently, many of the large structures associated with these aircraft are manufactured additively via Automated Fiber Placement (AFP). The AFP process shows great potential for efficient manufacturing, however unavoidable defects still occur because of tool surface geometry, placement errors, or poor process planning, resulting in decreased quality and throughput. Due to such effects, it is critical to incorporate design for manufacturing (DFM) principles to achieve the optimal manufacturing plan and resulting structure. This work will develop a methodology for incorporating design information into process planning metrics in an automated fashion to achieve an optimal set of process inputs.The analysis incorporates HyperX, Computer Aided Process Planning (CAPP) and Vericut Composite Programming (VCP). Safety margins from HyperX are imported into CAPP where AFP defects are mapped to the values. The resulting margins are then incorporated into the CAPP manufacturability algorithms, creating a design informed process planning analysis

Automated Fiber Placement↗

Quantification of Dynamic Model Validation Metrics Using Uncertainty Propagation from Requirements

The Space Launch System, NASA's new large launch vehicle for long range space exploration, is presently in the final design and construction phases, with the first launch scheduled for 2019. A dynamic model of the system has been created and is critical for calculation of interface loads and natural frequencies and mode shapes for guidance, navigation, and control (GNC). Because of the program and schedule constraints, a single modal test of the SLS will be performed while bolted down to the Mobile Launch Pad just before the first launch. A Monte Carlo and optimization scheme will be performed to create thousands of possible models based on given dispersions in model properties and to determine which model best fits the natural frequencies and mode shapes from modal test. However, the question still remains as to whether this model is acceptable for the loads and GNC requirements. An uncertainty propagation and quantification (UP and UQ) technique to develop a quantitative set of validation metrics that is based on the flight requirements has therefore been developed and is discussed in this paper. There has been considerable research on UQ and UP and validation in the literature, but very little on propagating the uncertainties from requirements, so most validation metrics are "rules-of-thumb;" this research seeks to come up with more reason-based metrics. One of the main assumptions used to achieve this task is that the uncertainty in the modeling of the fixed boundary condition is accurate, so therefore that same uncertainty can be used in propagating the fixed-test configuration to the free-free actual configuration. The second main technique applied here is the usage of the limit-state formulation to quantify the final probabilistic parameters and to compare them with the requirements. These techniques are explored with a simple lumped spring-mass system and a simplified SLS model. When completed, it is anticipated that this requirements-based validation metric will provide a quantified confidence and probability of success for the final SLS dynamics model, which will be critical for a successful launch program, and can be applied in the many other industries where an accurate dynamic model is required.

Brown, Andrew M.↗

Evaluation of selected chemical processes for production of low-cost silicon, phase 2

Potential designs for an integrated fluidized-bed reactor/zinc vaporizer/SiCl4 preheater unit are being considered and heat-transfer calculations have been initiated on versions of the zinc vaporizer section. Estimates of the cost of the silicon prepared in the experimental facility have been made for projected capacities of 25, 50, 75, and 100 metric ton of silicon. A 35 percent saving is obtained in going from 25 metric ton/year to the 50 metric ton/year level. This analysis, coupled with the recognition that use of two reactors in the 50 metric ton/year version allows for continued operation (at reduced capacity) with one reactor shut down, has resulted in a recommendation for adoption of an experimental facility capacity of 50 metric ton/year or greater. At this stage, the change to a larger size facility would not increase the design costs appreciably. In the experimental support program, the effects of seed bed particle size and depth were studied, and operation of the miniplant with a new zinc vaporizer was initiated, revealing the need for modification of the latter.

Blocher, J. M., Jr.↗

Collected software engineering papers, volume 3

Topics addressed include: software technology evaluation programs; collection of valid software engineering data; test processes using structural coverage; prototype expert system for software engineering management; use of an environment characteristic software metric set; software modulation; software development by analysis of change; and independent verification and validation.

Source record↗

An algorithm for the systematic disturbance of optimal rotational solutions

An algorithm for introducing a systematic rotational disturbance into an optimal (i.e., single axis) rotational trajectory is described. This disturbance introduces a motion vector orthogonal to the quaternion-defined optimal rotation axis. By altering the magnitude of this vector, the degree of non-optimality can be controlled. The metric properties of the distortion parameter are described, with analogies to two-dimensional translational motion. This algorithm was implemented in a motion-control program on a three-dimensional graphic workstation. It supports a series of human performance studies on the detectability of rotational trajectory optimality by naive observers.

Grunwald, Arthur J.↗

Software For Monitoring VAX Computer Systems

VAX Continuous Monitoring System (VAXCMS) computer program developed at NASA Headquarters to aid system managers in monitoring performances of VAX computer systems through generation of graphic images summarizing trends in performance metrics over time. VAXCMS written in DCL and VAX FORTRAN for use with DEC VAX-series computers running VMS 5.1 or later.

Farkas, Les↗

Automated Performance Prediction of Message-Passing Parallel Programs

The increasing use of massively parallel supercomputers to solve large-scale scientific problems has generated a need for tools that can predict scalability trends of applications written for these machines. Much work has been done to create simple models that represent important characteristics of parallel programs, such as latency, network contention, and communication volume. But many of these methods still require substantial manual effort to represent an application in the model's format. The NIK toolkit described in this paper is the result of an on-going effort to automate the formation of analytic expressions of program execution time, with a minimum of programmer assistance. In this paper we demonstrate the feasibility of our approach, by extending previous work to detect and model communication patterns automatically, with and without overlapped computations. The predictions derived from these models agree, within reasonable limits, with execution times of programs measured on the Intel iPSC/860 and Paragon. Further, we demonstrate the use of MK in selecting optimal computational grain size and studying various scalability metrics.

Block, Robert J.↗

A Synthetic Vision Preliminary Integrated Safety Analysis

This report documents efforts to analyze a sample of aviation safety programs, using the LMI-developed integrated safety analysis tool to determine the change in system risk resulting from Aviation Safety Program (AvSP) technology implementation. Specifically, we have worked to modify existing system safety tools to address the safety impact of synthetic vision (SV) technology. Safety metrics include reliability, availability, and resultant hazard. This analysis of SV technology is intended to be part of a larger effort to develop a model that is capable of "providing further support to the product design and development team as additional information becomes available". The reliability analysis portion of the effort is complete and is fully documented in this report. The simulation analysis is still underway; it will be documented in a subsequent report. The specific goal of this effort is to apply the integrated safety analysis to SV technology. This report also contains a brief discussion of data necessary to expand the human performance capability of the model, as well as a discussion of human behavior and its implications for system risk assessment in this modeling environment.

Hemm, Robert↗

Cryogenics and the Human Exploration of Mars

Current plans within NASA involve extending the human exploration of space from low earth orbit into the solar system, with the first human exploration of Mars presently planned in 2011. Integral to all hum Mars mission phases is cryogenic fluid management. Cryogenic fluids will be required both as propellant and for In-Situ Resource Utilization (ISRU). Without safe and efficient cryogen storage human Mars missions will not be possible. Effective control and handling of cryogenic fluids is the key to affordable Mars missions, and advancing active thermal control technology is synergistic with all of NASA's exploration initiatives and with existing and future instrument cooling programs, including MTPE and Origins. Present mission scenarios for human exploration require cryogenic propellant storage for up to 1700 days and for up to 60 metric tons. These requirements represent increases of an order of magnitude over previous storage masses and lifetimes. The key cryogenic terminology areas to be addressed in human Mars missions are long-term propellant storage, cryogenic refrigeration, cryogenic liquefaction, and zero gravity fluid management. Long-term storage for the thermal control of cryogenic propellants is best accomplished with a mix of passive and active technologies. Passive technologies such as advanced multilayer insulation (MLI) concepts will be combined with the development of active coolers (cryogenic refrigerators). Candidates for long-life active cooling applications include Reverse Turbo-Brayton, Stirling, and Pulse-Tube coolers. The integration of passive and active technologies will form a hybrid system optimized to minimize the launch mass while preserving the cryogenic propellants. Since cryogenic propellants are the largest mass that Mars missions must launch from earth, even a modest reduction in the percentage of propellant carried results in a significant weight saving. This paper will present a brief overview of cryogenic fluid management technology as it applies to the current human Mars mission scenarios.

Salerno, Louis J.↗

Solar Electric Propulsion Vehicle Design Study for Cargo Transfer to Earth-moon L1

A design study for a cargo transfer vehicle using solar electric propulsion was performed for NASA's Revolutionary Aerospace Systems Concepts program. Targeted for 2016, the solar electric propulsion (SEP) transfer vehicle is required to deliver a propellant supply module with a mass of approximately 36 metric tons from Low Earth Orbit to the first Earth-Moon libration point (LL1) within 270 days. Following an examination of propulsion and power technology options, a SEP transfer vehicle design was selected that incorporated large-area (approx. 2700 sq m) thin film solar arrays and a clustered engine configuration of eight 50 kW gridded ion thrusters mounted on an articulated boom. Refinement of the SEP vehicle design was performed iteratively to properly estimate the required xenon propellant load for the out-bound orbit transfer. The SEP vehicle performance, including the xenon propellant estimation, was verified via the SNAP trajectory code. Further efforts are underway to extend this system model to other orbit transfer missions.

Sarver-Verhey, Timothy R.↗

Recent Advances in Model-Assisted Probability of Detection

The increased role played by probability of detection (POD) in structural integrity programs, combined with the significant time and cost associated with the purely empirical determination of POD, provides motivation for alternate means to estimate this important metric of NDE techniques. One approach to make the process of POD estimation more efficient is to complement limited empirical experiments with information from physics-based models of the inspection process or controlled laboratory experiments. The Model-Assisted Probability of Detection (MAPOD) Working Group was formed by the Air Force Research Laboratory, the FAA Technical Center, and NASA to explore these possibilities. Since the 2004 inception of the MAPOD Working Group, 11 meetings have been held in conjunction with major NDE conferences. This paper will review the accomplishments of this group, which includes over 90 members from around the world. Included will be a discussion of strategies developed to combine physics-based and empirical understanding, draft protocols that have been developed to guide application of the strategies, and demonstrations that have been or are being carried out in a number of countries. The talk will conclude with a discussion of future directions, which will include documentation of benefits via case studies, development of formal protocols for engineering practice, as well as a number of specific technical issues.

Thompson, R. Bruce↗