Search NASA⌕ Search

SEARCH · Search NASA

Results for “metric standardization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Software Quality Assurance Metrics

Software Quality Assurance (SQA) is a planned and systematic set of activities that ensures conformance of software life cycle processes and products conform to requirements, standards and procedures. In software development, software quality means meeting requirements and a degree of excellence and refinement of a project or product. Software Quality is a set of attributes of a software product by which its quality is described and evaluated. The set of attributes includes functionality, reliability, usability, efficiency, maintainability, and portability. Software Metrics help us understand the technical process that is used to develop a product. The process is measured to improve it and the product is measured to increase quality throughout the life cycle of software. Software Metrics are measurements of the quality of software. Software is measured to indicate the quality of the product, to assess the productivity of the people who produce the product, to assess the benefits derived from new software engineering methods and tools, to form a baseline for estimation, and to help justify requests for new tools or additional training. Any part of the software development can be measured. If Software Metrics are implemented in software development, it can save time, money, and allow the organization to identify the caused of defects which have the greatest effect on software development. The summer of 2004, I worked with Cynthia Calhoun and Frank Robinson in the Software Assurance/Risk Management department. My task was to research and collect, compile, and analyze SQA Metrics that have been used in other projects that are not currently being used by the SA team and report them to the Software Assurance team to see if any metrics can be implemented in their software assurance life cycle process.

McRae, Kalindra A.↗

Evaluating Effectiveness of Modeling Motion System Feedback in the Enhanced Hess Structural Model of the Human Operator

In order to use the Hess Structural Model to predict the need for certain cueing systems, George and Cardullo significantly expanded it by adding motion feedback to the model and incorporating models of the motion system dynamics, motion cueing algorithm and a vestibular system. This paper proposes a methodology to evaluate effectiveness of these innovations by performing a comparison analysis of the model performance with and without the expanded motion feedback. The proposed methodology is composed of two stages. The first stage involves fine-tuning parameters of the original Hess structural model in order to match the actual control behavior recorded during the experiments at NASA Visual Motion Simulator (VMS) facility. The parameter tuning procedure utilizes a new automated parameter identification technique, which was developed at the Man-Machine Systems Lab at SUNY Binghamton. In the second stage of the proposed methodology, an expanded motion feedback is added to the structural model. The resulting performance of the model is then compared to that of the original one. As proposed by Hess, metrics to evaluate the performance of the models include comparison against the crossover models standards imposed on the crossover frequency and phase margin of the overall man-machine system. Preliminary results indicate the advantage of having the model of the motion system and motion cueing incorporated into the model of the human operator. It is also demonstrated that the crossover frequency and the phase margin of the expanded model are well within the limits imposed by the crossover model.

Zaychik, Kirill↗

Standardization of a Volumetric Displacement Measurement for Two-Body Abrasion Scratch Test Data Analysis

A limitation has been identified in the existing test standards used for making controlled, two-body abrasion scratch measurements based solely on the width of the resultant score on the surface of the material. A new, more robust method is proposed for analyzing a surface scratch that takes into account the full three-dimensional profile of the displaced material. To accomplish this, a set of four volume- displacement metrics was systematically defined by normalizing the overall surface profile to denote statistically the area of relevance, termed the Zone of Interaction. From this baseline, depth of the trough and height of the plowed material are factored into the overall deformation assessment. Proof-of-concept data were collected and analyzed to demonstrate the performance of this proposed methodology. This technique takes advantage of advanced imaging capabilities that allow resolution of the scratched surface to be quantified in greater detail than was previously achievable. When reviewing existing data analysis techniques for conducting two-body abrasive scratch tests, it was found that the ASTM International Standard G 171 specified a generic metric based only on visually determined scratch width as a way to compare abraded materials. A limitation to this method was identified in that the scratch width is based on optical surface measurements, manually defined by approximating the boundaries, but does not consider the three-dimensional volume of material that was displaced. With large, potentially irregular deformations occurring on softer materials, it becomes unclear where to systematically determine the scratch width. Specifically, surface scratches on different samples may look the same from a top view, resulting in an identical scratch width measurement, but may vary in actual penetration depth and/or plowing deformation. Therefore, two different scratch profiles would be measured as having identical abrasion properties, although they differ significantly.

Street, K. W. Jr.↗

Workshop Goals

The goals are: 1. Report and document recent progress on radiation belt model and plasma model development. Metrics for past and current programs. 2. Complete a roadmap for the development of new standard radiation belt and space plasma models for spacecraft engineering: input to agencies for future investments, interagency cooperation.

Barth, Janet↗

Assessment of Airframe Noise Reduction Technologies Based on EPNL from Flight Tests

The acoustic performance of various airframe noise reduction technologies – Adaptive Compliant Trailing Edge flap, main landing gear fairings, and gear cavity treatments – was determined, individually and in combination, using the Effective Perceived Noise Level metric. These noise measurements and calculations closely follow the Federal Aviation Administration aircraft noise certification standards, specifically for the approach noise measurement point. The flyover data correspond to pole-mounted, single-microphone measurements obtained during a series of flight tests, conducted under the NASA Flight Demonstrations and Capabilities project, that evaluated flap and landing gear noise reduction technologies. To minimize contributions from the propulsion system, the aircraft was flown along the approach path with engine thrust set at ground idle. Although contamination from engine, background, and secondary airframe noise sources partially masked the true performance of the tested technologies, the resulting acoustic data clearly showed substantial noise reductions relative to baseline levels. The acoustic benefits measured by the single microphones are consistent with previously reported trends in acoustic levels obtained from phased microphone array data.

Ravetta, Patricio A.↗

Climate, Health, Agricultural and Economic Impacts of Tighter Vehicle-Emission Standards

Non-CO2 air pollutants from motor vehicles have traditionally been controlled to protect air quality and health, but also affect climate. We use global composition climate modelling to examine the integrated impacts of adopting stringent European on-road vehicle-emission standards for these pollutants in 2015 in many developing countries. Relative to no extra controls, the tight standards lead to annual benefits in 2030 and beyond of 120,000-280,000 avoided premature air pollution-related deaths, 6.1-19.7 million metric tons of avoided ozone-related yield losses of major food crops, $US0.6-2.4 trillion avoided health damage and $US1.1-4.3 billion avoided agricultural damage, and mitigation of 0.20 (+0.14/-0.17) C of Northern Hemisphere extratropical warming during 2040-2070. Tighter vehicle-emission standards are thus extremely likely to mitigate short-term climate change in most cases, in addition to providing large improvements in human health and food security. These standards will not reduce CO2 emissions, however, which is required to mitigate long-term climate change.

Shindell, Drew↗

Viking relativity experiment - Verification of signal retardation by solar gravity

Analysis of 14 months of data obtained from radio ranging to the Viking spacecraft verified, to an estimated accuracy of 0.1%, the prediction of the general theory of relativity that the round-trip times of light signals traveling between the earth and Mars are increased by the direct effect of solar gravity. The corresponding value for the metric parameter gamma is 1.000 plus or minus 0.002, where the quoted uncertainty, twice the formal standard deviation, allows for possible systematic errors.

Reasenberg, R. D.↗

Auralization of a Supersonic Business Jet Using Advanced Takeoff Procedures

Recent NASA studies of a supersonic business jet airplane indicated that advanced takeoff procedures could be used to reduce noise at the lateral sideline location to a level at which Chapter 4 noise certification requirements could be met. The studies were conducted with the NASA Aircraft Noise Prediction Program, using an analytical model of the airframe and its engines. The advanced procedure consists of a higher-speed climbout and a programmed thrust lapse in which the engine thrust is automatically and gradually reduced immediately after the runway obstacle is cleared. In this paper, the authors utilize the results of the most recent study as the basis of an auralization of the predicted noise. Modifications to the NASA Auralization Framework necessary for that process are described. The auralizations are used to demonstrate differences between standard and advanced takeoff pro ond those that may be observed through comparison of integrated noise metrics.

Rizzi, Stephen A.↗

NASA's Space Launch System Begins Integration, Stacking in Preparation for Artemis I Launch

The Artemis era of human lunar exploration is nearing take-off as NASA’s new super heavy-lift launch vehicle, the Space Launch System (SLS), begins stack-ing and integration operations in mid-2020 at Kennedy Space Center (KSC) in Florida. With a planned upgrade path to progressively more powerful vehicles and availability in crew and cargo configurations, SLS provides a unique and flexible launch solution to send crew, large-scale infrastructure and robotic probes to deep space. The SLS Block 1 vehicle, the initial variant to fly, is optimized for lunar missions with a proven propulsion system consisting of four liquid hydrogen (LH2)/liquid oxygen (LOX)-fed RS-25 engines and twin five-segment solid rocket boosters (SRBs). The Block 1 vehicle can also be outfitted with an industry-standard 5 m-class payload fairing (the “cargo” configuration) and will launch at least 27 metric tons (t) of mass to trans-lunar injection (TLI). SLS is the backbone of NASA’s Artemis program, which will return the agency’s human spaceflight program to the Moon for the first time since 1972. For the Artemis I mission, SLS will send an uncrewed Orion spacecraft to TLI, where it will enter a distant retrograde lunar orbit and fly 38,000 nmi past the Moon – farther than any spacecraft built for humans has ever traveled. The SLS Block 1 vehicle for Artemis I completed manufacturing in 2019. Several elements, including the upper stage, have been delivered to the Exploration Ground Systems (EGS) program at KSC and are being prepped for integration and stack-ing. The five-segment solid rocket boosters – the largest and most powerful ever built for flight – are also complete. The booster motor segments for the Artemis I flight are scheduled to ship from prime contractor Northrop Grumman’s Utah facilities and begin stacking and integration at KSC in June 2020. The SLS core stage is the largest rocket stage NASA has ever built in terms of volume and height, and includes the avionics and the tanks that feed cryogenic propellant to the four RS-25s (formerly Space Shuttle Main Engines [SSMEs]). They have been modified with an updated controller and nozzle insulation to protect them from the hotter launch environment. The SLS core stage is currently being test-ed at NASA’s Stennis Space Center (SSC) in a series of “green run” tests to verify it meets design and performance requirements. Following the green run test series, which is scheduled to culminate with a full-duration hot-fire of the four RS-25 engines, the core stage will ship to KSC and be stacked between the sol-id rocket boosters in the Vehicle Assembly Building (VAB). Integration of the vehicle will continue with the upper stage, known as the Interim Cryogenic Propulsion Stage (ICPS) and the Launch Vehicle Stage Adapter (LVSA) on the core stage. Another adapter, the Orion Stage Adapter (OSA), connects SLS to Orion and provides housing for 13 6U CubeSat payloads manifested on Artemis I. The CubeSats will be released in deep space after Orion separates from the vehicle, and the flight marks the first ride share opportunity for independent small-sats to deep space. The second major SLS variant to come online, Block 1B, replaces the single-engine ICPS with a four-engine LH2/LOX Exploration Upper Stage (EUS). This more powerful upper stage, along with other vehicle up-grades, will enable the Block 1B vehicle to launch 38-42 t to TLI, depending on crew or cargo configuration. The final evolution of the vehicle, Block 2, will onramp evolved solid rocket boosters to increase mass to TLI to 43-46 t, de-pending on crew or cargo configuration. The Block 1B/Block 2 vehicles can be outfitted with an 8.4 m-diameter payload fairing in 19.1 m or 27.4 m lengths, to provide unprecedented volume for payloads. With the initial Block 1 vehicle completely manufactured and the core stage in final testing before shipping to KSC, the SLS Program and its industry partners have made significant progress manufacturing subsequent vehicles. For the second Block 1 vehicle, the solid rocket motor segments are complete, as are the RS-25 engines with controllers. All five major components of the Artemis II core stage – the forward skirt, LOX and LH2 tanks, intertank and engine section – are manufactured and technicians are installing subsystems at NASA’s rocket factory, Michoud Assembly Facility. The RL-10 engine for the Artemis II ICPS is complete and panels have been machined for its LH2 tank. In addition, panels are machined for the vehicle’s two adapters, with welding scheduled to begin in summer 2020. Flight hard-ware is also in production for the third SLS vehicle, with several booster motor segments cast. The pace of development on the EUS has increased, with the goal to complete Critical Design Review (CDR) in December 2020. Several EUS test rings have been machined at Michoud. The EUS is designed to exe-cute a variety of missions – human spaceflight, deployment of deep-space infra-structure, or high-C3 missions to the outer solar system – with crew and cargo configurations available beginning in the mid-2020s. The near-term goal for the nation’s powerful new space exploration asset, however, is to launch the Arte-mis program, and send the first woman and the next man to the lunar surface. At the Astrodynamics Specialist Conference, the SLS program will update the community on the progress of the initial Block 1 vehicle in final green run test-ing, integration and stacking. In addition, this paper will provide an update to the community on the manufacturing status of subsequent Block 1 and Block 1B vehicles.

Steve Creech↗

Summary of Propagation Cases of the Second AIAA Sonic Boom Prediction Workshop

A summary is provided for the propagation portion of the second AIAA Sonic Boom Workshop held January 8, 2017 in conjunction with the AIAA SciTech 2017 conference. Near-field pressure waveforms for two cases were supplied and ground signatures at multiple azimuthal angles as well as their corresponding loudness metrics were requested from 10 participants, representing 3 countries. Each case had some required runs, as well as some optional runs. The required cases included atmospheric profiles with measured data including winds, using Radiosonde balloon data at multiple geographically spread locations, while the optional cases included temperature and pressure profiles from the US Standard atmosphere. The humidity profiles provided for the optional cases were taken from ANSI guidance, as the authors were unaware of an accepted standard at the time the cases were released to the participants. Participants provided ground signatures along with the requested data, including some loudness metrics using their best practices, which included lossy as well as lossless schemes. All the participants' submissions, for each case, are compared and discussed. Noise or loudness measures are calculated and detailed comparisons and statistical analyses are performed and presented. It has been observed that the variation in the loudness measures and spread between participants' submissions increased as the computation proceeded from under-track locations towards the lateral cut-off. Lessons learned during this workshop are discussed and recommendations are made for potential improvements and possible subsequent workshops as we collectively attempt to refine our analysis methods.

Rallabhandi, Sriram↗

Summary of Propagation Cases of the Second AIAA Sonic Boom Prediction Workshop

A summary is provided for the propagation portion of the second AIAA Sonic Boom Workshop held January 8, 2017 in conjunction with the AIAA SciTech 2017 conference. Near-field pressure waveforms for two cases were supplied and ground signatures at multiple azimuthal angles as well as their corresponding loudness metrics were requested from 10 participants, representing 3 countries. Each case had some required, as well as some optional runs. The required cases included atmospheric profiles with measured data including winds, using Radiosonde balloon data at multiple geographically spread locations. The humidity profiles provided for the optional cases were taken from ANSI guidance, as the authors were unaware of an accepted standard at the time the cases were released to the participants. Participants provided ground signatures along with the requested data, including some loudness metrics using their best practices, which included lossy as well as lossless atmospheric propagation schemes. All the participants’ submissions, for each case, are compared and discussed. Noise or loudness measures are calculated and detailed comparisons and statistical analyses are performed and presented. It has been observed that the variation in the loudness measures and spread between participants’ submissions increased as the computation proceeded from under-track locations towards the lateral cut-off. Lessons learned during this workshop are discussed and recommendations are made for potential improvements and possible subsequent workshops as we collectively attempt to refine our analysis methods.

Rallabhandi, Sriram↗

Literature Review of Cumulative Noise Metrics Relevant to X-59 Supersonic Overflights

Upcoming studies with the X-59 aircraft will collect dose-response data to understand community response to en-route supersonic noise. This data collection effort will inform regulators in their efforts to potentially update the ban on commercial supersonic flight with acceptable noise standards. Part of the dataset will consist of end-of-day responses to the noise from multiple supersonic overflights. This document provides rationale from relevant literature surrounding which cumulative noise metric to pair with end-of-day survey responses for upcoming community studies with the X-59 aircraft. Despite its deficiencies, day-night average sound level (DNL) summation of candidate single-event metrics remains the most likely choice for a cumulative noise metric for multiple supersonic overflights because 1) it is widely used for other transportation noise sources and 2) its relevance for infrequent events is somewhat plausible, unlike some recent alternative metrics.

sonic boom↗

A Three-Dimensional Receiver Operator Characteristic Surface Diagnostic Metric

Receiver Operator Characteristic (ROC) curves are commonly applied as metrics for quantifying the performance of binary fault detection systems. An ROC curve provides a visual representation of a detection system s True Positive Rate versus False Positive Rate sensitivity as the detection threshold is varied. The area under the curve provides a measure of fault detection performance independent of the applied detection threshold. While the standard ROC curve is well suited for quantifying binary fault detection performance, it is not suitable for quantifying the classification performance of multi-fault classification problems. Furthermore, it does not provide a measure of diagnostic latency. To address these shortcomings, a novel three-dimensional receiver operator characteristic (3D ROC) surface metric has been developed. This is done by generating and applying two separate curves: the standard ROC curve reflecting fault detection performance, and a second curve reflecting fault classification performance. A third dimension, diagnostic latency, is added giving rise to 3D ROC surfaces. Applying numerical integration techniques, the volumes under and between the surfaces are calculated to produce metrics of the diagnostic system s detection and classification performance. This paper will describe the 3D ROC surface metric in detail, and present an example of its application for quantifying the performance of aircraft engine gas path diagnostic methods. Metric limitations and potential enhancements are also discussed

Simon, Donald L.↗

Robust statistical methods for automated outlier detection

The computational challenge of automating outlier, or blunder point, detection in radio metric data requires the use of nonstandard statistical methods because the outliers have a deleterious effect on standard least squares methods. The particular nonstandard methods most applicable to the task are the robust statistical techniques that have undergone intense development since the 1960s. These new methods are by design more resistant to the effects of outliers than standard methods. Because the topic may be unfamiliar, a brief introduction to the philosophy and methods of robust statistics is presented. Then the application of these methods to the automated outlier detection problem is detailed for some specific examples encountered in practice.

Jee, J. R.↗

Development of NASA Technical Standards Program Relative to Enhancing Engineering Capabilities

The enhancement of engineering capabilities is an important aspect of any organization; especially those engaged in aerospace development activities. Technical Standards are one of the key elements of this endeavor. The NASA Technical Standards Program was formed in 1997 in response to the NASA Administrator s directive to develop an Agencywide Technical Standards Program. The Program s principal objective involved the converting Center-unique technical standards into Agency wide standards and the adoption/endorsement of non-Government technical standards in lieu of government standards. In the process of these actions, the potential for further enhancement of the Agency s engineering capabilities was noted relative to value of being able to access Agencywide the necessary full-text technical standards, standards update notifications, and integration of lessons learned with technical standards, all available to the user from one Website. This was accomplished and is now being enhanced based on feedbacks from the Agency's engineering staff and supporting contractors. This paper addresses the development experiences with the NASA Technical Standards Program and the enhancement of the Agency's engineering capabilities provided by the Program s products. Metrics are provided on significant aspects of the Program.

Gill, Paul S.↗

The Multiplatform Precipitation Feature (MPF) Database: Synthesizing Satellite and Ground-Based Precipitation and Lightning Datasets for Convective Studies

NASA’s Lightning Imaging Sensor (LIS) and the Global Precipitation Measurement (GPM) mission have contributed a wealth of data toward global lightning and precipitation studies, respectively. Combining lightning and precipitation datasets leverages their unique insights into deep convective processes that inform about characteristics of convection and its intensity. Recent efforts to synthesize the LIS and GPM datasets prepare the opportunity for unprecedented large-scale, value-added multiplatform analyses of convection. This data synthesis proof-of-concept study elaborates on the creation of a database of reflectivity-based multiplatform precipitation features (MPFs) that capture a combination of information extracted from spatiotemporally coincident lightning and precipitation data within individual storm features. The space-based GPM Dual-frequency Precipitation Radar (DPR) provides a record of precipitation data, while the GPM Validation Network (VN) additionally incorporates ground-based polarimetric Doppler radar data to provide microphysical and kinematic context to DPR data. The LIS instrument onboard the International Space Station has contributed lightning observations since 2017. MPFs encapsulating information from these datasets are created from isolated regions of filtered, smoothed DPR reflectivity data to which ellipses are fit. Each MPF includes feature location, size, and eccentricity information as well as summary reflectivity characteristics. They also include summaries of precipitation microphysics and derived three-dimensional wind available from ground-based radar data. LIS data provides standard lightning characteristics such as flash count and density to each MPF as well as other informative metrics such as flash area and radiance. Each MPF file includes information about the original data from which the MPF and its characteristics were determined, allowing end-user reconstruction of the ellipse and deeper “level I” analysis of captured data. This database of VN-LIS MPFs enables broad statistical analysis of the relationships between the microphysical, kinematic, and electrical properties of convection. Preliminary results from a demonstration of the database will be described as well as ongoing efforts and avenues for future work.

Lightning↗

Comparison of the Performance of Noise Metrics as Predictions of the Annoyance of Stage 2 and Stage 3 Aircraft Overflights

Thirty audiometrically screened test participants judged the relative annoyance of two comparison (variable level) and thirty-four standard (fixed level) signals in an adaptive paired comparison psychoacoustic study. The signal ensemble included both FAR Part 36 Stage 2 and 3 aircraft overflights, as well as synthesized aircraft noise signatures and other non-aircraft signals. All test signals were presented for judgment as heard indoors, in the presence of continuous background noise, under free-field listening conditions in an anechoic chamber. Analyses of the performance of 30 noise metrics as predictors of these annoyance judgments confirmed that the more complex metrics were generally more accurate and precise predictors than the simpler methods. EPNL was somewhat less accurate and precise as a predictor of the annoyance judgments than a duration-adjusted variant of Zwicker's Loudness Level.

Pearsons, Karl S.↗

Drawbar Pull (DP) Procedures for Off-Road Vehicle Testing

As NASA strives to explore the surface of the Moon and Mars, there is a continued need for improved tire and vehicle development. When tires or vehicles are being designed for off-road conditions where significant thrust generation is required, such as climbing out of craters on the Moon, it is important to use a standard test method for evaluating their tractive performance. The drawbar pull (DP) test is a way of measuring the net thrust generated by tires or a vehicle with respect to performance metrics such as travel reduction, sinkage, or power efficiency. DP testing may be done using a single tire on a traction rig, or with a set of tires on a vehicle; this report focuses on vehicle DP tests. Though vehicle DP tests have been used for decades, there are no standard procedures that apply to exploration vehicles. This report summarizes previous methods employed, shows the sensitivity of certain test parameters, and provides a body of knowledge for developing standard testing procedures. The focus of this work is on lunar applications, but these test methods can be applied to terrestrial and planetary conditions as well. Section 1.0 of this report discusses the utility of DP testing for off-road vehicle evaluation and the metrics used. Section 2.0 focuses on test-terrain preparation, using the example case of lunar terrain. There is a review of lunar terrain analogs implemented in the past and a discussion on the lunar terrain conditions created at the NASA Glenn Research Center, including methods of evaluating the terrain strength variation and consistency from test to test. Section 3.0 provides details of the vehicle test procedures. These consist of a review of past methods, a comprehensive study on the sensitivity of test parameters, and a summary of the procedures used for DP testing at Glenn.

wheel↗