SEARCH · Search NASA
Results for “program metrics”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Overview of Mars Technology Program
This viewgraph presentation reviews the development of a technology program leading to Mars missions. The presentation includes: the goals of technology program, elements of technology program, program metrics, major accomplishments, examples and Information about the Mars Technology Program.
Testing, Requirements, and Metrics
The criticality of correct, complete, testable requirements is a fundamental tenet of software engineering. Also critical is complete requirements based testing of the final product. Modern tools for managing requirements allow new metrics to be used in support of both of these critical processes. Using these tools, potential problems with the quality of the requirements and the test plan can be identified early in the life cycle. Some of these quality factors include: ambiguous or incomplete requirements, poorly designed requirements databases, excessive or insufficient test cases, and incomplete linkage of tests to requirements. This paper discusses how metrics can be used to evaluate the quality of the requirements and test to avoid problems later. Requirements management and requirements based testing have always been critical in the implementation of high quality software systems. Recently, automated tools have become available to support requirements management. At NASA's Goddard Space Flight Center (GSFC), automated requirements management tools are being used on several large projects. The use of these tools opens the door to innovative uses of metrics in characterizing test plan quality and assessing overall testing risks. In support of these projects, the Software Assurance Technology Center (SATC) is working to develop and apply a metrics program that utilizes the information now available through the application of requirements management tools. Metrics based on this information provides real-time insight into the testing of requirements and these metrics assist the Project Quality Office in its testing oversight role. This paper discusses three facets of the SATC's efforts to evaluate the quality of the requirements and test plan early in the life cycle, thus preventing costly errors and time delays later.
Industrial Hygiene Issues
This breakout session is a traditional conference instrument used by the NASA industrial hygiene personnel as a method to convene personnel across the Agency with common interests. This particular session focused on two key topics, training systems and automation of industrial hygiene data. During the FY 98 NASA Occupational Health Benchmarking study, the training system under development by the U.S. Environmental Protection Agency (EPA) was deemed to represent a "best business practice." The EPA has invested extensively in the development of computer based training covering a broad range of safety, health and environmental topics. Currently, five compact disks have been developed covering the topics listed: Safety, Health and Environmental Management Training for Field Inspection Activities; EPA Basic Radiation Training Safety Course; The OSHA 600 Collateral Duty Safety and Health Course; and Key program topics in environmental compliance, health and safety. Mr. Chris Johnson presented an overview of the EPA compact disk-based training system and answered questions on its deployment and use across the EPA. This training system has also recently been broadly distributed across other Federal Agencies. The EPA training system is considered "public domain" and, as such, is available to NASA at no cost in its current form. Copies of the five CD set of training programs were distributed to each NASA Center represented in the breakout session. Mr. Brisbin requested that each NASA Center review the training materials and determine whether there is interest in using the materials as it is or requesting that EPA tailor the training modules to suit NASA's training program needs. The Safety, Health and Medical Services organization at Ames Research Center has completed automation of several key program areas. Mr. Patrick Hogan, Safety Program Manager for Ames Research Center, presented a demonstration of the automated systems, which are described by the following: (1) Safety, Health and Environmental Training. This system includes an assessment of training needs for every NASA Center organization, course descriptions, schedules and automated course scheduling, and presentation of training program metrics; (2) Safety and Health Inspection Information. This system documents the findings from each facility inspection, tracks abatement status on those findings and presents metrics on each department for senior management review; (3) Safety Performance Evaluation Profile. The survey system used by NASA to evaluate employee and supervisory perceptions of safety programs is automated in this system; and (4) Documentation Tracking System. Electronic archive and retrieval of all correspondence and technical reports generated by the Safety, Health and Medical Services Office are provided by this system.
NASA's Earth Observing Data and Information System
NASA's Earth Observing System Data and Information System (EOSDIS) has been a central component of NASA Earth observation program for over 10 years. It is one of the largest civilian science information system in the US, performing ingest, archive and distribution of over 3 terabytes of data per day much of which is from NASA s flagship missions Terra, Aqua and Aura. The system supports a variety of science disciplines including polar processes, land cover change, radiation budget, and most especially global climate change. The EOSDIS data centers, collocated with centers of science discipline expertise, archive and distribute standard data products produced by science investigator-led processing systems. Key to the success of EOSDIS is the concept of core versus community requirements. EOSDIS supports a core set of services to meet specific NASA needs and relies on community-developed services to meet specific user needs. EOSDIS offers a metadata registry, ECHO (Earth Observing System Clearinghouse), through which the scientific community can easily discover and exchange NASA s Earth science data and services. Users can search, manage, and access the contents of ECHO s registries (data and services) through user-developed and community-tailored interfaces or clients. The ECHO framework has become the primary access point for cross-Data Center search-and-order of EOSDIS and other Earth Science data holdings archived at the EOSDIS data centers. ECHO s Warehouse Inventory Search Tool (WIST) is the primary web-based client for discovering and ordering cross-discipline data from the EOSDIS data centers. The architecture of the EOSDIS provides a platform for the publication, discovery, understanding and access to NASA s Earth Observation resources and allows for easy integration of new datasets. The EOSDIS also has developed several methods for incorporating socioeconomic data into its data collection. Over the years, we have developed several methods for determining needs of the user community including use of the American Customer Satisfaction Index and a broad metrics program.
A Matrix Approach to Software Process Definition
The Software Engineering Laboratory (SEL) is currently engaged in a Methodology and Metrics program for the Information Systems Center (ISC) at Goddard Space Flight Center (GSFC). This paper addresses the Methodology portion of the program. The purpose of the Methodology effort is to assist a software team lead in selecting and tailoring a software development or maintenance process for a specific GSFC project. It is intended that this process will also be compliant with both ISO 9001 and the Software Engineering Institute's Capability Maturity Model (CMM). Under the Methodology program, we have defined four standard ISO-compliant software processes for the ISC, and three tailoring criteria that team leads can use to categorize their projects. The team lead would select a process and appropriate tailoring factors, from which a software process tailored to the specific project could be generated. Our objective in the Methodology program is to present software process information in a structured fashion, to make it easy for a team lead to characterize the type of software engineering to be performed, and to apply tailoring parameters to search for an appropriate software process description. This will enable the team lead to follow a proven, effective software process and also satisfy NASA's requirement for compliance with ISO 9001 and the anticipated requirement for CMM assessment. This work is also intended to support the deployment of sound software processes across the ISC.
Turbulence Detection and Mitigation Element
This paper presents viewgraphs on turbulence detection and mitigation technologies in weather accident prevention. The topics include: 1) Organization; 2) Scope of Turbulence Effort; 3) Background; 4) Turbulence Detection and Mitigation Program Metrics; 5) Approach; 6) Turbulence Team Relationships; 7) WBS Structure; 8) Deliverables; 9) TDAM Changes; 10) FY-01 Results/Accomplishments; 11) Out-year Plans; and 12) Element Status.
Space Transportation Systems Life Cycle Cost Assessment and Control
Civil and military applications of space transportation have been pursued for just over 50 years and there has been, and still is, a need for safe, dependable, affordable, and sustainable space transportation systems. Fully expendable and partially reusable space transportation systems have been developed and put in operation that have not adequately achieved this need. Access to space is technically achievable, but presently very expensive and will remain so until there is a breakthrough in the way we do business. Since 1991 the national Space Propulsion Synergy Team (SPST) has reviewed and assessed the lessons learned from the major U.S. space programs of the past decades focusing on what has been learned from the assessment and control of Life Cycle Cost (LCC) from these systems. This paper presents the results of a selected number of studies and analyses that have been conducted by the SPST addressing the need, as well as the solutions, for improvement in LCC. The major emphasis of the SPST processes is on developing the space transportation system requirements first (up front). These requirements must include both the usual system flight performance requirements and also the system functional requirements, including the infrastructure on Earth's surface, in-space and on the Moon and Mars surfaces to determine LCC. This paper describes the development of specific innovative engineering and management approaches and processes. This includes a focus on flight hardware maturity for reliability, ground operations approaches, and business processes between contractor and government organizations. A major change in program/project cost control is being proposed by the SPST to achieve a sustainable space transportation system LCC - controlling cost as a program metric in addition to the existing practice of controlling performance and weight. Without a firm requirement and methodically structured cost control, it is unlikely that an affordable and sustainable space transportation system LCC will ever be achieved. '
Artemis Missions Probabilistic Risk Assessment (PRA) & Reliability Assessment Overview
To show how NASA’s Moon-to-Mars (M2M) program can use hardware reliability assessments and comprehensive Probabilistic Risk Assessments (PRAs) to estimate risk of future missions and manage risk via safety and mission success requirements from the top down, so that this risk can be balanced with other program metrics like cost and schedule. These PRAs and reliability assessments can be used during the concept, design, and operational phases of development. This presentation also provides some thoughts on how the NASA process can be utilized for a lunar surface power grid development.
NASA Aviation Safety Program Systems Analysis/Program Assessment Metrics Review
The goal of this project is to evaluate the metrics and processes used by NASA's Aviation Safety Program in assessing technologies that contribute to NASA's aviation safety goals. There were three objectives for reaching this goal. First, NASA's main objectives for aviation safety were documented and their consistency was checked against the main objectives of the Aviation Safety Program. Next, the metrics used for technology investment by the Program Assessment function of AvSP were evaluated. Finally, other metrics that could be used by the Program Assessment Team (PAT) were identified and evaluated. This investigation revealed that the objectives are in fact consistent across organizational levels at NASA and with the FAA. Some of the major issues discussed in this study which should be further investigated, are the removal of the Cost and Return-on-Investment metrics, the lack of the metrics to measure the balance of investment and technology, the interdependencies between some of the metric risk driver categories, and the conflict between 'fatal accident rate' and 'accident rate' in the language of the Aviation Safety goal as stated in different sources.
Evaluation metrics of educational programs for teachers
A system for evaluating the teacher programs and services in the Education Services Branch was developed. The primary stakeholder was interested in determining the worth or usefulness of these services to educators. Therefore, two instruments were developed to collect the data. One questionnaire was administered. Data was collected, analyzed and reported. The other questionnaire was pilot tested and will be administered to teachers during the school year.
A Predictive Approach to Eliminating Errors in Software Code
NASA s Metrics Data Program Data Repository is a database that stores problem, product, and metrics data. The primary goal of this data repository is to provide project data to the software community. In doing so, the Metrics Data Program collects artifacts from a large NASA dataset, generates metrics on the artifacts, and then generates reports that are made available to the public at no cost. The data that are made available to general users have been sanitized and authorized for publication through the Metrics Data Program Web site by officials representing the projects from which the data originated. The data repository is operated by NASA s Independent Verification and Validation (IV&V) Facility, which is located in Fairmont, West Virginia, a high-tech hub for emerging innovation in the Mountain State. The IV&V Facility was founded in 1993, under the NASA Office of Safety and Mission Assurance, as a direct result of recommendations made by the National Research Council and the Report of the Presidential Commission on the Space Shuttle Challenger Accident. Today, under the direction of Goddard Space Flight Center, the IV&V Facility continues its mission to provide the highest achievable levels of safety and cost-effectiveness for mission-critical software. By extending its data to public users, the facility has helped improve the safety, reliability, and quality of complex software systems throughout private industry and other government agencies. Integrated Software Metrics, Inc., is one of the organizations that has benefited from studying the metrics data. As a result, the company has evolved into a leading developer of innovative software-error prediction tools that help organizations deliver better software, on time and on budget.
Engineering Lessons Learned and Technical Standards Integration: Capturing Key Technologies for Future Space Missions
Capturing engineering lessons learned derived from past experiences and new technologies, then integrating them with technical standards, provides a viable process for enhancing engineering capabilities. The development of future space missions will require ready access, not only to the latest technical standards, but also to lessons learned derived from past experiences and new technologies. The integration of this information such that it is readily accessible by engineering and programmatic personnel is a key aspect of enabling technology. This paper addresses the development of a new and innovative Lessons Learned/Best Practices/Applications Notes--Standards Integration System, including experiences with its initial implementation as a pilot effort within the NASA Technical Standards Program. Included are metrics on the Program, feedbacks from users, future plans, and key issues that are being addressed to expand the System's utility. The objective is the enhancement of engineering capabilities on all aspects of systems development applicable to the success of future space missions.
Metrics for the NASA Airspace Systems Program
This document defines an initial set of metrics for use by the NASA Airspace Systems Program (ASP). ASP consists of the NextGen-Airspace Project and the NextGen-Airportal Project. The work in each project is organized along multiple, discipline-level Research Focus Areas (RFAs). Each RFA is developing future concept elements in support of the Next Generation Air Transportation System (NextGen), as defined by the Joint Planning and Development Office (JPDO). In addition, a single, system-level RFA is responsible for integrating concept elements across RFAs in both projects and for assessing system-wide benefits. The primary purpose of this document is to define a common set of metrics for measuring National Airspace System (NAS) performance before and after the introduction of ASP-developed concepts for NextGen as the system handles increasing traffic. The metrics are directly traceable to NextGen goals and objectives as defined by the JPDO and hence will be used to measure the progress of ASP research toward reaching those goals. The scope of this document is focused on defining a common set of metrics for measuring NAS capacity, efficiency, robustness, and safety at the system-level and at the RFA-level. Use of common metrics will focus ASP research toward achieving system-level performance goals and objectives and enable the discipline-level RFAs to evaluate the impact of their concepts at the system level.
Performance Metrics for Monitoring Parallel Program Executions
Existing tools for debugging performance of parallel programs either provide graphical representations of program execution or profiles of program executions. However, for performance debugging tools to be useful, such information has to be augmented with information that highlights the cause of poor program performance. Identifying the cause of poor performance necessitates the need for not only determining the significance of various performance problems on the execution time of the program, but also needs to consider the effect of interprocessor communications of individual source level data structures. In this paper, we present a suite of normalized indices which provide a convenient mechanism for focusing on a region of code with poor performance and highlights the cause of the problem in terms of processors, procedures and data structure interactions. All the indices are generated from trace files augmented with data structure information.. Further, we show with the help of examples from the NAS benchmark suite that the indices help in detecting potential cause of poor performance, based on augmented execution traces obtained by monitoring the program.
Developing Metrics in Systems Integration (ISS Program COTS Integration Model)
This viewgraph presentation reviews some of the complications in developing metrics for systems integration. Specifically it reviews a case study of how two programs within NASA try to develop and measure performance while meeting the encompassing organizational goals.
PCMDI Metrics Package
The Program for Climate Model Diagnosis & Intercomparison (PCMDI) Metrics Package (PMP) is used to provide "quick-look" objective comparisons of Earth System Models (ESMs) with one another and available observations. The PMP provides a diverse suite of analysis utilities each of which produce summary statistics that gauge the consistency between climate model simulations and available observations. The primary application of the PMP is to evaluate simulations from the Coupled Model Intercomparison Project (CMIP). It can also be used to provide objective performance summaries during the model development process as well as selected research purposes.
Earned Value-Added
Earned value management [EVM] ...either you swear by it, or swear at it. Either way, there s no getting around the fact that EVM can be one of the most efficient and insightful methods of synthesizing cost, schedule, and technical status information into a single set of program health metrics. Is there a way of implementing EVM that allows a program to reap its early warning benefits while avoiding the pitfalls that make it infamous to its detractors? That s the question recently faced by the International Space Station [ISS] program.