Search NASA⌕ Search

SEARCH · Search NASA

Results for “tool evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

A dynamic systems engineering methodology research study. Phase 2: Evaluating methodologies, tools, and techniques for applicability to NASA's systems projects

A study of NASA's Systems Management Policy (SMP) concluded that the primary methodology being used by the Mission Operations and Data Systems Directorate and its subordinate, the Networks Division, is very effective. Still some unmet needs were identified. This study involved evaluating methodologies, tools, and techniques with the potential for resolving the previously identified deficiencies. Six preselected methodologies being used by other organizations with similar development problems were studied. The study revealed a wide range of significant differences in structure. Each system had some strengths but none will satisfy all of the needs of the Networks Division. Areas for improvement of the methodology being used by the Networks Division are listed with recommendations for specific action.

Paul, Arthur S.↗

General Tool for Evaluating High-Contrast Coronagraphic Telescope Performance Error Budgets

The Coronagraph Performance Error Budget (CPEB) tool automates many of the key steps required to evaluate the scattered starlight contrast in the dark hole of a space-based coronagraph. The tool uses a Code V prescription of the optical train, and uses MATLAB programs to call ray-trace code that generates linear beam-walk and aberration sensitivity matrices for motions of the optical elements and line-of-sight pointing, with and without controlled fine-steering mirrors (FSMs). The sensitivity matrices are imported by macros into Excel 2007, where the error budget is evaluated. The user specifies the particular optics of interest, and chooses the quality of each optic from a predefined set of PSDs. The spreadsheet creates a nominal set of thermal and jitter motions, and combines that with the sensitivity matrices to generate an error budget for the system. CPEB also contains a combination of form and ActiveX controls with Visual Basic for Applications code to allow for user interaction in which the user can perform trade studies such as changing engineering requirements, and identifying and isolating stringent requirements. It contains summary tables and graphics that can be instantly used for reporting results in view graphs. The entire process to obtain a coronagraphic telescope performance error budget has been automated into three stages: conversion of optical prescription from Zemax or Code V to MACOS (in-house optical modeling and analysis tool), a linear models process, and an error budget tool process. The first process was improved by developing a MATLAB package based on the Class Constructor Method with a number of user-defined functions that allow the user to modify the MACOS optical prescription. The second process was modified by creating a MATLAB package that contains user-defined functions that automate the process. The user interfaces with the process by utilizing an initialization file where the user defines the parameters of the linear model computations. Other than this, the process is fully automated. The third process was developed based on the Terrestrial Planet Finder coronagraph Error Budget Tool, but was fully automated by using VBA code, form, and ActiveX controls.

Marchen, Luis F.↗

Developer Tools for Evaluating Multi-Objective Algorithms

Multi-objective algorithms for scheduling offer many advantages over the more conventional single objective approach. By keeping user objectives separate instead of combined, more information is available to the end user to make trade-offs between competing objectives. Unlike single objective algorithms, which produce a single solution, multi-objective algorithms produce a set of solutions, called a Pareto surface, where no solution is strictly dominated by another solution for all objectives. From the end-user perspective a Pareto-surface provides a tool for reasoning about trade-offs between competing objectives. From the perspective of a software developer multi-objective algorithms provide an additional challenge. How can you tell if one multi-objective algorithm is better than another? This paper presents formal and visual tools for evaluating multi-objective algorithms and shows how the developer process of selecting an algorithm parallels the end-user process of selecting a solution for execution out of the Pareto-Surface.

multi-objective optimization↗

Programming Tools: Status, Evaluation, and Comparison

In this tutorial I will first describe the characteristics of scientific applications and their developers, and describe the computing environment in a typical high-performance computing center. I will define the user requirements for tools that support application portability and present the difficulties to satisfy them. These form the basis of the evaluation and comparison of the tools. I will then describe the tools available in the market and the tools available in the public domain. Specifically, I will describe the tools for converting sequential programs, tools for developing portable new programs, tools for debugging and performance tuning, tools for partitioning and mapping, and tools for managing network of resources. I will introduce the main goals and approaches of the tools, and show main features of a few tools in each category. Meanwhile, I will compare tool usability for real-world application development and compare their different technological approaches. Finally, I will indicate the future directions of the tools in each category.

Cheng, Doreen Y.↗

Experimental and analytical tools for evaluation of Stirling engine rod seal behavior

The first year of a two year experimental and analytical program is reported. The program is directed at the elastohydrodynamic behavior of sliding elastomeric rod seals for the Stirling engine. During the year, experimental and analytical tools were developed for evaluating seal leakage, seal friction, and the fluid film thickness at the seal/cylinder interface.

Krauter, A. I.↗

Simulation-modeling tool for evaluation of space telerobotic control strategies

An object-oriented software graphic simulation and modeling tool is developed to explore human/autonomous control allocation for varied operational scenarios. The system provides designers with LISP workstations through which to simulate telerobotic operations, model human performance in those operations, examine task performance profiles, and investigate control and diagnostic strategies. It is suggested that the provision of such analytic tools along with the presentation of performance projections can assist designers in rapidly and conveniently exploring design alternatives for telerobotic system control.

Corker, Kevin↗

A General Tool for Evaluating High-Contrast Coronagraphic Telescope Performance Error Budgets

This paper describes a general purpose Coronagraph Performance Error Budget (CPEB) tool that we have developed under the NASA Exoplanet Exploration Program. The CPEB automates many of the key steps required to evaluate the scattered starlight contrast in the dark hole of a space-based coronagraph. It operates in 3 steps: first, a CodeV or Zemax prescription is converted into a MACOS optical prescription. Second, a Matlab program calls ray-trace code that generates linear beam-walk and aberration sensitivity matrices for motions of the optical elements and line-of-sight pointing, with and without controlled coarse and fine-steering mirrors. Third, the sensitivity matrices are imported by macros into Excel 2007 where the error budget is created. Once created, the user specifies the quality of each optic from a predefined set of PSDs. The spreadsheet creates a nominal set of thermal and jitter motions and combines them with the sensitivity matrices to generate an error budget for the system. The user can easily modify the motion allocations to perform trade studies.

Terrestrial Planet Finder↗

Multi-modal virtual environment research at Armstrong Laboratory

One mission of the Paul M. Fitts Human Engineering Division of Armstrong Laboratory is to improve the user interface for complex systems through user-centered exploratory development and research activities. In support of this goal, many current projects attempt to advance and exploit user-interface concepts made possible by virtual reality (VR) technologies. Virtual environments may be used as a general purpose interface medium, an alternative display/control method, a data visualization and analysis tool, or a graphically based performance assessment tool. An overview is given of research projects within the division on prototype interface hardware/software development, integrated interface concept development, interface design and evaluation tool development, and user and mission performance evaluation tool development.

Eggleston, Robert G.↗

TRMM Common Microphysics Products: A Tool for Evaluating Spaceborne Precipitation Retrieval Algorithms

A customized product for analysis of microphysics data collected from aircraft during field campaigns in support of the TRMM program is described. These Common Microphysics Products (CMP's) are designed to aid in evaluation of TRMM spaceborne precipitation retrieval algorithms. Information needed for this purpose (e.g., particle size spectra and habit, liquid and ice water content) was derived using a common processing strategy on the wide variety of microphysical instruments and raw native data formats employed in the field campaigns. The CMP's are organized into an ASCII structure to allow easy access to the data for those less familiar with and without the tools to accomplish microphysical data processing. Detailed examples of the CMP show its potential and some of its limitations. This approach may be a first step toward developing a generalized microphysics format and an associated community-oriented, non-proprietary software package for microphysics data processing, initiatives that would likely broaden community access to and use of microphysics datasets.

Kingsmill, David E.↗

Simulation and Analysis of Technology and Operational Procedures to Reduce the Combined Effects of Emissions and Contrails

The development and evaluation of concepts and technology to support future air traffic management systems require a hierarchy of models ranging from real-time simulations to extensive field evaluations. Air traffic simulation models such as Airspace Concept Evaluation System, Center Tracon Automation System, Future Air traffic management Concept Evaluation Tool and others are used to design air traffic systems balancing the conflicting objectives of maximizing safety, meeting future demands for airports and airspace and increase efficiency of traffic flows in the presence of uncertain weather. The impact of aviation emissions and contrails on climate imposes another constraint on the design of aircraft and aviation operations. The understanding of the complex interaction between physical climate system, the carbon and other greenhouse gas emissions and aviation activity can be improved by the development of integrated assessment models that include emission and climate models together with air traffic simulations. The modeling of aircraft emissions and their interaction with each other to change the concentration levels of different gasses in the atmosphere and the resulting impact of the radiative forcing on the equilibrium of the Earth's atmosphere is complex and requires the use of coupled atmosphere-ocean general circulation models together with three-dimensional models of carbon cycle and chemistry of other non-CO2 greenhouse gases. These models are computationally intensive and unsuitable for studies involving the generation of multiple scenarios. Simple emission and climate models, based on the input-output relations of linear systems, capture the fundamental emission to climate impact behavior by careful selection of key variables and their dynamics. The impact of various greenhouse gases depends on the total concentration, effect per unit change in atmospheric concentration and the spatial distribution of the gas. All these quantities are influenced by the lifetime of the gas. The impact of a greenhouse gas depends on the interval of assessment, which may vary from a few decades to a few centuries. Climate metrics are aimed at providing a common scale to compare different greenhouse gases. If the metrics are to be used as a tool in developing and evaluating aviation operations, they should be transparent and easy to apply. Global Warming Potential and Aggregate Global Temperature Potential are some of the commonly used metrics. This paper integrates a national-level air traffic simulation and optimization capability with simple climate models and carbon cycle models, and climate metrics to assess the impact of aviation on climate. The capability brings together metrics, which are useful in aviation operations together with metrics used in climate studies. The capability can be used to make trade-offs between extra fuel cost and reduction in climate impact. There is considerable uncertainty in our understanding of the radiative forcing associated with emissions and contrails. The parameters in the simulation can be used to evaluate the effect of various uncertainties in emission models and contrails. It can also be used to evaluate the impact of different decision horizons. Alternatively, the optimization results from the simulation can be used as inputs to other tools that monetize global climate impacts like the FAA's Aviation Environmental Portfolio Management Tool for Impacts.

impact of aviation on the environment↗

Noise as a tool for evaluating the activation of cathodes

Measurements, at low frequencies, of the shot noise current from space charge limited cathodes always produced results substantially in excess of theoretical predictions. Measuring the ratio (I sub eq)/S yielded a relation (I sub eq)/S = 1.288 V sub k = 1.288 k(T sub k)/e, independent of the operating point of the diode (triode) as long as all parts of the cathode had a full space charge controlled emission. This method was so sensitive as to permit detection of cathode temperature changes by 1 K, thus it allowed a powerful screening method between well and poorly activated cathodes, superior to dip tests and other current-voltage methods.

Kosmahl, H.↗

Simulations as a tool for evaluating Landsat-based crop area estimation systems

An important use of remotely sensed data is in the estimation of agricultural production in foreign areas. Evaluation of such production estimates is difficult because of the lack of independent crop inventories. This paper presents simulation software developed to assess the effects of various factors on the performance of Landsat-based agricultural crop area estimators. An application of the simulator to determine whether the interaction of weather cycles with the Landsat orbital period could induce a systematic bias in large area crop estimates is discussed in detail. The simulation study was performed for the spring grains growing region of the Soviet Union.

Ramey, D. B.↗

Electroencephalogram (EEG) and Magnetoencephalogram (MEG) as Tools for Evaluation of Cognitive Function

We have developed computerized analysis and display techniques to help identify the origins of visually evoked scalped potentials (VESP). The potentials are recorded simultaneously from many electrodes (usually 40 to 48) spaced over the region of the scalp where appreciable evoked potentials are found in response to particular stimulus. Contour mapping algorithms are then used to display the time behavior of equipotential surfaces on the scalp during the VESP. We then use an optimization technique to select the parameters of arrays of current dipole sources within the model until the model equipotential field distribution closely fits the measured data. Computer graphics are then used to display, as a movie, the actual and model scalp potential fields and the parameters of the dipole generators within the model head during the course of VESP activity. We have devised reaction time tests that involve potentially separable stages of cognitive processing and utilize stimuli that produce measurable cognition-related features in the late component of the evoked potential. We have used these techniques to determine the loci in the brain where known cognition-related features in the evoked potential are generated and we have explored the extent to which each of these features can be related to the reaction time tasks. We have also examined the temporal-spatial aspects of their cerebral involvement. Our current work is planned to characterize the age-related changes in the processes performed by such sources. We also use a neuromagnetometer to measure the evoked magnetic fields in similar circumstances; we will discuss the relative merits of the two methodologies.

Fender, Derek H.↗

Compound-Specific Isotopic Analysis of Meteoritic Amino Acids as a Tool for Evaluating Potential Formation Pathways

Measurements of stable hydrogen, carbon, and nitrogen isotopic ratios (delta D, delta C-13, delta N-15) of organic compounds can reveal information about their origin and formation pathways. Several formation mechanisms and environments have been postulated for the amino acids detected in carbonaceous chondrites. As each proposed mechanism utilizes different precursor molecules, the isotopic signatures of the resulting amino acids may point towards the most likely of these proposed pathways. The technique of gas chromatography coupled with mass spectrometry and isotope ratio mass spectrometry provides compound-specific structural and isotopic information from a single splitless injection, enhancing the amount of information gained from small amounts of precious samples such as carbonaceous chondrites. We have applied this technique to measure the compound-specific C, N, and H isotopic ratios of amino acids from seven CM and CR carbonaceous chondrites. We are using these measurements to evaluate predictions of expected isotopic enrichments from potential formation pathways and environments, leading to a better understanding of the origin of these compounds.

Elsila, Jamie E.↗

A Monte Carlo Based Ray Tracing Tool for Evaluating Wolter-Type Prescriptions

Evaluating Wolter-like X-ray mirror prescriptions via ray tracing is useful for selecting and optimizing the right mirror prescriptions for a specified application. Moreover, incorporating real metrology data into a ray trace and simulating point spread functions (PSF) allows for performance predictions representative of real manufacturing errors and tolerances. In fulfillment of an internship project, an X-ray ray trace routine using a Monte-Carlo method has been developed to examine different Wolter-like prescriptions and characterize their theoretical performances over a specified field of view. This routine includes the ability to use real metrology data to evaluate the impact of figure error on imaging performance. As a test case, the Marshall Grazing Incidence X-ray Spectrometer (MaGIXS) Wolter-I mirror prescription and an equivalent Wolter-Schwarzschild prescription were traced and imaging performance of a specified field of view were mapped. Here we present the approach used in this routine, showcase example results, and discuss future goals for expanding the routine to address azimuthally varying figure errors and surface roughness.

X-ray optics↗