Search NASA⌕ Search

SEARCH · Search NASA

Results for “Coverage Metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Applying Simulated Annealing to Problems in Model-Based Diagnosis

Generating all diagnoses is computationally intractable. Therefore, many of the state-of-the-art approaches are incomplete. Quantum computers may however offer a solution. The first commercially available quantum computer is being used to minimize polynomials that are difficult for classical simulated annealing but easy for quantum annealing. All problems in Model-based Diagnosis (MBD) can be transformed into a polynomial minimization problem, allowing one to apply a quantum algorithm called quantum annealing to solve MBD problems. To better understand the need for this quantum approach, we designed two simulated annealingdiagnostic algorithms tailored to run on a polynomial representation of MBD. These algorithms differ on their policy for random neighborhood variable selection. In addition, enhanced metrics were devised to provide more diagnostic coverage. Finally, these two simulated annealing algorithms were analyzed and empirically evaluated and compared against state-of-the-art probabilistic methods for MBD such as SAFARI using ISCAS-85.

Simulated annealing↗

Vehicle Integrated Prognostic Reasoner (VIPR) Metric Report

This document outlines a set of metrics for evaluating the diagnostic and prognostic schemes developed for the Vehicle Integrated Prognostic Reasoner (VIPR), a system-level reasoner that encompasses the multiple levels of large, complex systems such as those for aircraft and spacecraft. VIPR health managers are organized hierarchically and operate together to derive diagnostic and prognostic inferences from symptoms and conditions reported by a set of diagnostic and prognostic monitors. For layered reasoners such as VIPR, the overall performance cannot be evaluated by metrics solely directed toward timely detection and accuracy of estimation of the faults in individual components. Among other factors, overall vehicle reasoner performance is governed by the effectiveness of the communication schemes between monitors and reasoners in the architecture, and the ability to propagate and fuse relevant information to make accurate, consistent, and timely predictions at different levels of the reasoner hierarchy. We outline an extended set of diagnostic and prognostics metrics that can be broadly categorized as evaluation measures for diagnostic coverage, prognostic coverage, accuracy of inferences, latency in making inferences, computational cost, and sensitivity to different fault and degradation conditions. We report metrics from Monte Carlo experiments using two variations of an aircraft reference model that supported both flat and hierarchical reasoning.

Cornhill, Dennis↗

Apollo 15 orbital science summary.

In this paper, summary results of the Apollo 15 orbital science payload are given, and some quick-look results of Apollo 16 are discussed. Geochemical instruments, consisting of gamma-ray, X-ray, and alpha particle spectrometers, have provided a chemical map of the lunar surface flown over by Apollo 15. The Laser Altimeter and frontside gravity data have shown some unexpected results with regard to the lunar shape, and provided new basis for understanding lunar mascons. A magnetometer, aboard the small subsatellite, has located magnetic anomalies principally on the lunar farside, and has shown that the small lunar magnetic field is smoother on the frontside than on the back. The mass spectrometer, in orbit aboard the Command and Service Modules, has measured unexpectedly large populations of molecules at orbital altitude (110 km), mostly due to spacecraft contamination. Two major camera systems have provided the first systematic metric quality photography and concurrent high resolution stereo coverage of the lunar surface.

Esenwein, G. F.↗

The spatial distribution of ionospheric threats to WAAS integrity, 2000 – 2019: a systematic analysis

The United States’ Wide Area Augmentation System (WAAS) broadcasts data to facilitate aircraft navigation. This paper examines the spatial dependence of ionospheric disturbances that have threatened the accuracy and reliability of position estimates derived from these data over the period 2000 – 2019. We address two distinct aspects of this spatial dependence: (1) the geographic distribution of these threats, in particular, in relation to geomagnetic latitude, and (2) the geometric dependence of threats relative to the locations of the receiver sites that comprise the WAAS network. We analyze threat distributions in terms of the various means that WAAS employs to mitigate these threats, including the Extreme Storm Detector, the Moderate Storm Detector, local irregularity detectors, and the ionospheric threat model. Distinct distributions are presented for threats occurring in Solar Cycle 23 and those of Solar Cycle 24. To study the geometric dependence of threats on receiver locations, we use as a metric the distance separating a threat from the centroid of the nearest Ncentroid receivers. Large values of this metric identify threats at or beyond the edge of coverage. We conclude by discussing the implications of our results for WAAS operations.

Altshuler, Eric↗

The Inspectability Metric: A Formalized System Of Measurement Enabling The Design For Inspection Framework

Nondestructive evaluation (NDE) engineers are often confronted with structural design choices that present challenges to meeting inspection requirements. These challenges, at best, increase the resources needed to design an inspection solution and, at worst, require resource intensive redesign of the structure. If the inspectability of the structure can be determined early in the design cycle, these challenging inspection scenarios can be avoided. The emergence of additive manufacturing has further compounded this problem by enabling the creation of highly optimized structures with no regard to inspection constraints. Design for inspection (DFI) offers a framework to integrate nondestructive evaluation (NDE) into the design process to alleviate the mechanisms that produce uninspectable designs. DFI is the concept of including inspectability in a multi-objective optimization framework so that it can be considered in parallel to other metrics such as mass and manufacturability. This allows rapid evaluation of the trade-off between design metrics to find solutions that meet the inspection needs of a particular material system, structural concept, or vehicle program. To enable DFI, there must be a system by which the inspectability of a structure can be measured. This system must be agile to produce results quickly, it must be versatile to work with the type of incomplete information one would encounter early in the design process (such as lack of inspection requirements), and it must be delivered in a form that is easily understood by designers. To meet this need, this presentation introduces the novel inspectability metric as a system to measure inspectability. The inspectability metric is a standardized, automation friendly procedure that uses simulations to determine inspectability. Along with guidelines to properly process designs and integrate with existing workflows, the inspectability metric provides a suite of simulation tests to interrogate the ability to find defects and the sensitivity to variability. The testing rubric is designed to maximize the coverage of the parameter space while minimizing the number of simulations needed. The inspectability metric has been in development in collaboration with industry partners to ensure compatibility with modern simulation tools and aerospace design workflows. In this study, we will demonstrate how the inspectability metric is able to determine the inspectability of multiple types of structures, including aerospace composites and additively manufactured parts. We will then show how the inspectability score can be plugged into existing design optimization tasks, such as structural sizing algorithms or design for manufacturing (DFM) frameworks.

Design for inspection↗

Development and Initial Validation of HFBP-EM Short-Form Surveys

The Human Factors and Behavioral Performance Exploration Measures (HFBP-EM) suite includes self-report surveys designed to assess Behavioral Medicine (BMed) and Team risks for future exploration class missions. Survey data was collected during the Human Exploration Research Analog (HERA) Campaign 4 (C4), HERA Campaign 5 (C5), and during SIRIUS19 missions in the Russian Ground Based Experiment Complex, NEK. Crew time in spaceflight analogs and in spaceflight is typically limited. Extensive self-report surveys can be a significant burden to participants and are not operationally acceptable for spaceflight. The purpose of this project was to comprehensively assess the reliability and validity of the standard-length HFBP-EM surveys, identify acceptable short forms to administer during HERA C6, examine initial validation evidence for the proposed short form measures, and identify key measurement gaps in HFBP-EM coverage. In this presentation, we will report reliability and validity metrics of standard form data, describe the proposed new short forms, and present initial psychometric analyses supporting the use of these short forms.

S T Bell↗

The Utility of Auroral Image-based Activities Metrics

Auroral activity indices such as Hemispheric Power and Auroral Boundary are currently key data products used for space weather predictions and nowcasting. However, these products are necessarily based on limited observations which must be extrapolated to provide global coverage. The advent of routine space-based auroral imaging in the last decade offers the seeming advantage of more detailed measures of auroral activity. Examples of image-derived products include energy deposition maps, oval location, cap size, and morphological classification. However, activity metrics derived from auroral images have shortcomings, as well. For example, limited fields-of-view and orbital motion prevent full coverage of the auroral regions. This paper will examine the utility of activity metrics derived h m auroral images for operational purposes. The eight-year collection of Polar UVI images databased in the UVI Online Search Tool (OST) will be used to illustrate the advantages and shortcomings of auroral activity metrics. The potential role of other currently-active imaging missions will also be examined and correlative studies to date using auroral imaging will be summarized.

Germany, G.↗

Spatial Coverage Planning and Optimization for Planetary Exploration

We are developing onboard planning and scheduling technology to enable in situ robotic explorers, such as rovers and aerobots, to more effectively assist scientists in planetary exploration. In our current work, we are focusing on situations in which the robot is exploring large geographical features such as craters, channels or regional boundaries. In to develop valid and high quality plans, the robot must take into account a range of scientific and engineering constraints and preferences. We have developed a system that incorporates multiobjective optimization and planning allowing the robot to generate high quality mission operations plans that respect resource limitations and mission constraints while attempting to maximize science and engineering objectives. An important scientific objective for the exploration of geological features is selecting observations that spatially cover an area of interest. We have developed a metric to enable an in situ explorer to reason about and track the spatial coverage quality of a plan. We describe this technique and show how it is combined in the overall multiobjective optimization and planning algorithm.

autonomy↗

Structural aspects of Imbrium sculpture, part G

Apollo 16 metric photographs taken at low to high sun angles provided the first stereographic coverage of the distinctive landforms collectively referred to as Imbrium sculpture. The sculpture consists of a series of nearly linear ridges and troughs extending radially outward for more than 1000 km from the rim of the Imbrium Basin. The origin of the ridges and troughs, whether by deposition and impact scoring by fluidized clouds of ejecta from the Imbrium Basin or by faulting and volcanism during and subsequent to basin formation, is controversial. Evidence indicative of the mode of origin of Imbrium sculpture is summarized as follows. Evidence of volcano-tectonic mode of origin is favored by: (1) wide variation in relative age of parts of the sculpture; (2) furrows without rims; (3) absence of ballistic shielding; (4) asymmetry of sculpture; (5) absence of randomly oriented clusters; and (6) association with other features of structural origin. An origin by ejecta scoring and deposition is favored by the gradational ejecta with a Fra Mauro-type texture. Features that are ambiguous as to mode or origin are furrows made of coalesced crater chains and prominent rims on furrows.

Scott, D. H.↗

Investigation of Non-Equilibrium Radiation for Earth Entry

This paper presents measurements and simulations of non-equilibrium shock layer radiation relevant to high-speed Earth entry data obtained in the NASA Ames Research Center's Electric Arc Shock Tube (EAST) facility. The experiments were aimed at measuring the spatially and spectrally resolved radiance at relevant entry conditions for both an approximate Earth atmosphere (79 N2 : 21 O2) as well as a more accurate composition featuring the trace species Ar and CO2 (78.08 N2 : 20.95 O2 : 0.04 CO2 : 0.93 Ar). The experiments were configured to target a wide range of conditions, of which shots from 8 to 11.5 km/s at 0.2 Torr (26.7 Pa) are examined in this paper. The non-equilibrium component was chosen to be the focus of this study as it can account for a significant percentage of the emitted radiation for Earth entry, and more importantly, non-equilibrium has traditionally been assigned a large uncertainty for vehicle design. The main goals of this study are to present the shock tube data in the form of a non-equilibrium metric, evaluate the level of agreement between the experiment and simulations, identify key discrepancies and to promote discussion about various aspects of modeling non-equilibrium radiating flows. Radiance profiles integrated over discreet wavelength regions, ranging from the VUV through to the NIR, were compared in order to maximize both the spectral coverage and the number of experiments that could be used in the analysis. A previously defined non-equilibrium metric has been used to allow comparisons with several shots and reveal trends in the data. Overall, LAURAHARA is shown to under-predict EAST by as much as 50 and over-predict by as much as 20 depending on the shock speed. DPLRNEQAIR is shown to under-predict EAST by as much as 40 and over-predict by as much as 12 depending on the shock speed. In terms of an upper bound estimate for the absolute error in wall-directed heat flux, at the lower speeds investigated in this paper, 8 to 9 km/s, even though there are some large relative differences, the absolute error in radiance will be less then 1 Wcm2. At the highest shock speed of 11 km/s, the error will be less than 20 W/ sq cm.

Radiation↗

Collected software engineering papers, volume 3

Topics addressed include: software technology evaluation programs; collection of valid software engineering data; test processes using structural coverage; prototype expert system for software engineering management; use of an environment characteristic software metric set; software modulation; software development by analysis of change; and independent verification and validation.

Source record↗

Design for Inspection: A Formalized Approach to Evaluating the Inspectability of Aerospace Structures Early in the Design Process

NDE engineers are often confronted with structural design choices that present challenges to meeting inspection requirements. These challenges at best increase the resources needed to design an inspection solution and, at worst, require resource intensive redesign of the structure. If the inspectability of structure can be determined early in the design cycle, these challenging inspection scenarios can be avoided. Therefore, there exists a need for a resource friendly formalized approach to gauge the inspectability of a structure. This paper proposes the use of a novel inspectability metric to meet this need. The inspectability metric is a standardized, automation friendly procedure that uses simulations to determine inspectability. It provides a suite of simulation tests to interrogate the ability to find defects and the sensitivity to variability. The testing rubric is designed to maximize the coverage of the parameter space while minimizing the number of simulations needed. In this preliminary study, we will demonstrate how the inspectability metric is able to determine the inspectability of a structure as a function of changes in the structure’s design.

Peter Juarez↗

Investigation of Non-Equilibrium Radiation for Earth Entry

For Earth re-entry at velocities between 8 and 11.5 km/s, the accuracy of NASA's computational uid dynamic and radiative simulations of non-equilibrium shock layer radiation is assessed through comparisons with measurements. These measurements were obtained in the NASA Ames Research Center's Electric Arc Shock Tube (EAST) facility. The experiments were aimed at measuring the spatially and spectrally resolved radiance at relevant entry conditions for both an approximate Earth atmosphere (79% N2 : 21% O2 by mole) as well as a more accurate composition featuring the trace species Ar and CO2 (78.08% N2 : 20.95% O2 : 0.04% CO2 : 0.93% Ar by mole). The experiments were configured to target a wide range of conditions, of which shots from 8 to 11.5 km/s at 0.2 Torr (26.7 Pa) are examined in this paper. The non-equilibrium component was chosen to be the focus of this study as it can account for a significant percentage of the emitted radiation for Earth re-entry, and more importantly, non-equilibrium has traditionally been assigned a large uncertainty for vehicle design. The main goals of this study are to present the shock tube data in the form of a non-equilibrium metric, evaluate the level of agreement between the experiment and simulations, identify key discrepancies and to examine critical aspects of modeling non-equilibrium radiating flows. Radiance pro les integrated over discreet wavelength regions, ranging from the Vacuum Ultra Violet (VUV) through to the Near Infra-Red (NIR), were compared in order to maximize both the spectral coverage and the number of experiments that could be used in the analysis. A previously defined non-equilibrium metric has been used to allow comparisons with several shots and reveal trends in the data. Overall, LAURA/HARA is shown to under-predict EAST by as much as 40% and over-predict by as much as 12% depending on the shock speed. DPLR/NEQAIR is shown to under-predict EAST by as much as 50% and over-predict by as much as 20% depending on the shock speed. The one standard deviation scatter in the EAST results was calculated to be 31%. An estimate for the upper bound of the absolute error in wall-directed heat flux was calculated. Below 9 km/s, where the relative difference is large, the absolute error in radiative heat flux due to non-equilibrium models is estimated to be less then 1 W/sq cm. At the highest shock speed of 11 km/s, the error in non-equilibrium is estimated to be less than 20 W/sq cm.

Shock Tube↗

The Impacts of Microphysics and Planetary Boundary Layer Physics on Model Simulations of U. S. Deep South Summer Convection

Inspection of output from various configurations of high-resolution, explicit convection forecast models such as the Weather Research and Forecasting (WRF) model indicates significant sensitivity to the choices of model physics parameterizations employed. Some of the largest apparent sensitivities are related to the specifications of the cloud microphysics and planetary boundary layer physics packages. In addition, these sensitivities appear to be especially pronounced for the weakly-sheared, multicell modes of deep convection characteristic of the Deep South of the United States during the boreal summer. Possible ocean-land sensitivities also argue for further examination of the impacts of using unique ocean-land surface initialization datasets provided by the NASA Short-term Prediction Research and Transition (SPoRT Center to select NOAA/NWS weather forecast offices. To obtain better quantitative understanding of these sensitivities and also to determine the utility of the ocean-land initialization data, we have executed matrices of regional WRF forecasts for selected convective events near Mobile, AL (MOB), and Houston, TX (HGX). The matrices consist of identically initialized WRF 24-h forecasts using any of eight microphysics choices and any of three planetary boundary layer choices. The resulting 24 simulations performed for each event within either the MOB or HGX regions are then compared to identify the sensitivities of various convective storm metrics to the physics choices. Particular emphasis is placed on sensitivities of precipitation timing, intensity, and coverage, as well as amount and coverage of lightning activity diagnosed from storm kinematics and graupel in the mixed phase layer. The results confirm impressions gleaned from study of the behavior of variously configured WRF runs contained in the ensembles produced each spring at the Center for the Analysis and Prediction of Storms, but with the benefit of more straightforward control of the physics package choices. The design of the experiments thus allows for more direct interpretation of the sensitivities to each possible physics combination. The results should assist forecasters in their efforts to anticipate and correct for possible biases in simulated WRF convection patterns, and help the modeling community refine their model parameterizations.

McCaul, E. W., Jr.↗

The Impact of Microphysics and Planetary Boundary Layer Physics on Model Simulation of U.S. Deep South Summer Convection

Inspection of output from various configurations of high-resolution, explicit convection forecast models such as the Weather Research and Forecasting (WRF) model indicates significant sensitivity to the choices of model physics pararneterizations employed. Some of the largest apparent sensitivities are related to the specifications of the cloud microphysics and planetary boundary layer physics packages. In addition, these sensitivities appear to be especially pronounced for the weakly-sheared, multicell modes of deep convection characteristic of the Deep South of the United States during the boreal summer. Possible ocean-land sensitivities also argue for further examination of the impacts of using unique ocean-land surface initialization datasets provided by the NASA Short-term Prediction Research and Transition (SPoRn Center to select NOAAlNWS weather forecast offices. To obtain better quantitative understanding of these sensitivities and also to determine the utility of the ocean-land initialization data, we have executed matrices of regional WRF forecasts for selected convective events near Mobile, AL (MOB), and Houston, TX (HGX). The matrices consist of identically initialized WRF 24-h forecasts using any of eight microphysics choices and any of three planetary boWldary layer choices. The resulting 24 simulations performed for each event within either the MOB or HGX regions are then compared to identify the sensitivities of various convective storm metrics to the physics choices. Particular emphasis is placed on sensitivities of precipitation timing, intensity, and coverage, as well as amount and coverage oflightuing activity diagnosed from storm kinematics and graupel in the mixed phase layer. The results confirm impressions gleaned from study of the behavior of variously configured WRF runs contained in the ensembles produced each spring at the Center for the Analysis and Prediction of Storms, but with the benefit of more straightforward control of the physics package choices. The design of the experiments thus allows for more direct interpretation of the sensitivities to each possible physics combination. The results should assist forecasters in their efforts to anticipate and correct for possible biases in simulated WRF convection patterns, and help the modeling community refine their model parameterizations.

McCaul, Eugene W., Jr.↗

Marin County Wildfires Ii: Improving Fire Suppression Modeling to Inform Fire Prevention and Suppression Decisions in Marin County, Ca

A future of increased wildfires requires greater integration of spatial analysis and local knowledge of emergency responders. We examine the application of a Potential Operational Delineations (PODs) framework for strategic pre-fire planning in Marin County. PODs are spatial units for wildfire management that combine predictive modeling and local firefighter expertise to identify potential control locations as unit boundaries and assess the difficulty of suppression within units. Additionally, this project explores the integration of road networks and social vulnerability to assess environmental justice in evacuation safety. This project constitutes a novel application of the PODs framework as it integrates expertise from Marin County senior firefighters with a Fireline Location Model (FLM) to achieve POD definition and uses a Suppression Difficulty Score (SDS) to rank each POD. The FLM uses network analysis and hydrologic modeling to identify key roads and ridgelines as boundaries and combines them with expert knowledge, in the form of workshops, to construct PODs. Once identified, PODs are classified using SDS, which includes processed inputs such as LiDAR-derived aboveground biomass, ECOSTRESS Evaporative Stress Index, land use cover type from Sentinel-2 Imagery, and a digital elevation model. Environmental justice for evacuation safety incorporated three key road metrics such as connectivity, travel area, and exit capacity, the Social Vulnerability Index from the Center for Disease Control, and cell coverage to determine a final Evacuation Difficulty Score. Results indicate a strong link between road networks as primary POD boundaries, with ridgelines and waterways as secondary and tertiary locations. Specifically, we find 78.5% of expertise-identified POD boundaries align with FLM-determined boundaries. More validation is needed to support this process; however, initial results signal a feasible framework to integrate expertise and spatial analysis in local level strategic fire planning

Wildfire modeling↗

Current status of metric reduction of (passive) scanner data

The extraction of metric information from scanner (particularly multispectral) data is presented. Data from both aircraft and spacecraft; singly scanned areas and areas with multiple coverage; various mathematical models used up to the present time; and published numerical results are considered. Future trends are also discussed.

Mikhail, E. M.↗

Mare Imbrium lava flows and their relationship to color boundaries, part M

The Apollo 15 metric camera photography provided a number of spectacular views of most of the southern and central portions of the unique systems of major lava flows that stretch diagonally across Mare Imbrium from the general area of Euler Crater to a point east of Le Verrier Crater. A preliminary examination of the photographs indicates that the source of the material comprising the major flows is situated to the west of Euler Crater and south of the limits of the photographic coverage. The photographs also show clearly that most, if not all, the mare ridges included were formed after the solidification of the flows. Few color boundaries exist in the area of metric photography where the illumination angle is low enough to show the fronts of some of the very thin flows. However, patches of redder material lying northeast of Mt. Lahire are found to be enclosed by low flow fronts, confirming the theory that the redder material represents an earlier filling of the Imbrium basin.

Whitaker, E. A.↗