Search NASA⌕ Search

SEARCH · Search NASA

Results for “timing error evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

Quantifying Diurnal Cloud Radiative Effects by Cloud Type in the Tropical Western Pacific

Cloud radiative effects are examined using long-term datasets collected at the three Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) Climate Research Facilities in the tropical western Pacific. We quantify the surface radiation budget, cloud populations, and cloud radiative effects by partitioning the data by cloud type, time of day, and as a function of large scale modes of variability such as El Niño Southern Oscillation (ENSO) phase and wet/dry seasons at Darwin. The novel facet of our analysis is that we break aggregate cloud radiative effects down by cloud type across the diurnal cycle. The Nauru cloud populations and subsequently the surface radiation budget are strongly impacted by ENSO variability whereas the cloud populations over Manus only shift slightly in response to changes in ENSO phase. The Darwin site exhibits large seasonal monsoon related variations. We show that while deeper convective clouds have a strong conditional influence on the radiation reaching the surface, their limited frequency reduces their aggregate radiative impact. The largest source of shortwave cloud radiative effects at all three sites comes from low clouds. We use the observations to demonstrate that potential model biases in the amplitude of the diurnal cycle and mean cloud frequency would lead to larger errors in the surface energy budget compared to biases in the timing of the diurnal cycle of cloud frequency. Our results provide solid benchmarks to evaluate model simulations of cloud radiative effects in the tropics.

54 ENVIRONMENTAL SCIENCES↗

Fast Evaluation of Aircraft Icing Severity Using Machine Learning Based on XGBoost

Aircraft icing represents a serious hazard in aviation which has caused a number of fatal accidents over the years. In addition, it can lead to substantial increase in drag and weight, thus reducing the aerodynamics performance of the airplane. The process of ice accretion on a solid surface is a complex interaction of aerodynamic and environmental variables. The complex relationship makes machine learning-based methods an attractive alternative to traditional numerical simulation-based approaches. In this study, we introduce a purely data-driven approach to find the complex pattern between different flight conditions and aircraft icing severity prediction. The supervised learning algorithm Extreme Gradient Boosting (XGBoost) is applied to establish the prediction framework which makes prediction based on any set of observations. The input flight conditions for the proposed prediction framework are liquid water content, droplet diameter and exposure time. The proposed approach is demonstrated in three cases: maximum ice thickness prediction, icing area prediction and icing severity level evaluation. Performance comparison studies and error analysis are also conducted to verify the effectiveness and performance of the proposed method. Results show that the proposed method has reasonable capability in evaluating aircraft icing severity.

Li, Sibo (ORCID:000000021705844X)↗

The practical application of a finite difference method for analyzing transonic flow over oscillating airfoils and wings

Separating the velocity potential into steady and unsteady parts and linearizing the resulting unsteady equations for small disturbances was performed. The steady velocity potential was obtained first from the well known nonlinear equation for steady transonic flow. The unsteady velocity potential was then obtained from a linear differential equation in complex form with spatially varying coefficients. Since sinusoidal motion is assumed, the unsteady equation is independent of time. The results of an investigation into the relaxation-solution-instability problem was discussed. Concepts examined include variations in outer boundary conditions, a coordinate transformation so that the boundary condition at infinity may be applied to the outer boundaries of the finite difference region, and overlapping subregions. The general conclusion was that only a full direct solution in which all unknowns are obtained at the same time will avoid the solution instabilities of relaxation. An analysis of the one-dimensional form of the unsteady transonic equation was studied to evaluate errors between exact and finite difference solutions. Pressure distributions were presented for a low-aspect-ratio clipped delta wing at Mach number of 0.9 and for a moderate-aspect-ratio rectangular wing at a Mach number of 0.875.

Weatherill, W. H.↗

Transmission media effects on precise Doppler tracking

The effects of the transmission media - the earth's troposphere and ionosphere, and the solar wind - on precise Doppler tracking are discussed. The charged particle effects can be largely removed by dual frequency observations; however there are limitations to these corrections (besides system noise and/or finite integration times) including the effects of magnetic fields, diffraction, and differential refraction, all of which must be carefully evaluated. The earth's troposphere can contribute an error of delta f/f approximately 10 to the minus 14th power.

Callahan, P. S.↗

Locating rocket triggered lightning using the LLP lightning locating system at the NASA Kennedy Space Center

Five rocket-triggered cloud-to-ground lightning flashes were detected by the operational lightning-locating system at the NASA Kennedy Space Center on August 17, 1984. The locating system, which was designed to detect natural lightning, detected at least 2 and as many as 6 strokes in the triggered flashes, suggesting that some of the strokes in the triggered lightning had signal-amplitude and waveshape characteristics similar to natural lightning. However, not all triggered strokes were detected, indicating that some strokes were atypical in nature. Since the ground-strike points of the triggered flashes were known quite precisely, the accuracy of the lightning-locating system was also evaluated. The three direction finders were found to have a mean bearing accuracy of + or - 0.5-0.6 deg. The distance errors of the real-time position solutions of the locating system on the triggered flashes were in the range of 195-770 m, with a mean of 480 m.

Maier, M. W.↗

Satellite ground-terminal user simulation

Realistic simulation of satellite communication systems and evaluation of satellite networking schemes require emulation of the systems's users. A laboratory model of a Ka-band satellite-switched time-division multiple-access (SS-TDMA) communication network, referred to as the System Integration, Test, and Evaluation (SITE) project, uses special bit-error-rate (BER) test sets to simulate the transmitting and receiving users of a communication network. The bit-error-rate test sets contain circuit boards that can be modified to create a variety of interfaces to satellite system ground terminals.

Shalkhauser, Mary Jo W.↗

On Using Taylor's Hypothesis for Three-Dimensional Mixing Layers

In the present study, errors in using Taylor's hypothesis to transform measurements obtained in a temporal (or phase) frame onto a spatial one were evaluated. For the first time, phase-averaged ('real') spanwise and streamwise vorticity data measured on a three-dimensional grid were compared directly to those obtained using Taylor's hypothesis. The results show that even the qualitative features of the spanwise and streamwise vorticity distributions given by the two techniques can be very different. This is particularly true in the region of the spanwise roller pairing. The phase-averaged spanwise and streamwise peak vorticity levels given by Taylor's hypothesis are typically lower (by up to 40%) compared to the real measurements.

LeBoeuf, Richard L.↗

On Using Taylor's Hypothesis for Three-Dimensional Mixing Layers

In the present study, errors in using Taylor's hypothesis to transform measurements obtained in a temporal (or phase) frame onto a spatial one were evaluated. For the first time, phase-averaged ('real') spanwise and streamwise vorticity data measured on a three-dimensional grid were compared directly to those obtained using Taylor's hypothesis. The results show that even the qualitative features of the spanwise and streamwise vorticity distributions given by the two techniques can be very different. This is particularly true in the region of the spanwise roller pairing. The phase-averaged spanwise and streamwise peak vorticity levels given by Taylor's hypothesis are typically lower (by up to 40%) compared to the real measurements.

LeBoeuf, Richard L.↗

Interface Consistency: Phase I Results & Phase II Status

Future exploration missions will rely on designing and developing vehicles and complex systems from within NASA and through multiple external commercial partners to meet mission goals. Despite existing consistency-related agency requirements, NASA’s approach to commercial spaceflight development encourages providers’ flexibility and innovation. This strategy is resulting in significant design diversity across Artemis vehicles. Design best practices and guidelines champion interface consistency to promote mental model development and knowledge transfer. However, research investigating the benefits of consistency is mixed, and little is known about its role in complex systems. Determining the level of risk that system diversity presents is difficult, as there is no established method for quantifying the degree of consistency within and across interfaces, nor is there information about the differential impacts of different types of inconsistency. Phase I of this project (Characterization and Measurement) served as a starting point to better understand the construct of consistency, its application, and the range of studies and methods for measuring it. The project team created a taxonomy of consistency to apply to interfaces as a framework to guide the development of tools to assess intersystem consistency. Checklist and cognitive walkthrough methods were developed for use by human factors (HF) and human-computer interaction (HCI) experts. The Intersystem Consistency Scale (ICS) was developed for interface evaluations with crew. A pilot study evaluated the methods’ ability to distinguish differences between Artemis-like prototype pairs exhibiting either high or low design consistency. In addition, click errors and time on task were collected within the ICS (crew-like) group. Results from our exploratory analysis and lessons learned from the pilot study will be discussed. The project team will also present the status of Phase II (Risk Assessment, Standards and Guidelines). This includes incorporating feedback to redesign the assessment tools, and inputs from displays and training Subject Matter Experts to update tasks and prototype designs. The team will present the risk assessment study design to identify the types and levels of inconsistency that pose the greatest risk to performance. Plans to apply these results toward agency standards and guideline recommendations will also be discussed.

Human-Computer Interaction↗

YARNsim: Simulating Hadoop YARN

Despite the popularity of the Apache Hadoop system, its success has been limited by issues such as single points of failure, centralized job/task management, and lack of support for programming models other than MapReduce. The next generation of Hadoop, Apache Hadoop YARN, is designed to address these issues. In this paper, we propose YARNsim, a simulation system for Hadoop YARN. YARNsim is based on parallel discrete event simulation and provides protocol-level accuracy in simulating key components of YARN. YARNsim provides a virtual platform on which system architects can evaluate the design and implementation of Hadoop YARN systems. Also, application developers can tune job performance and understand the tradeoffs between different configurations, and Hadoop YARN system vendors can evaluate system efficiency under limited budgets. To demonstrate the validity of YARNsim, we use it to model two real systems and compare the experimental results from YARNsim and the real systems. The experiments include standard Hadoop benchmarks, synthetic workloads, and a bioinformatics application. The results show that the error rate is within 10% for the majority of test cases. The experiments prove that YARNsim can provide what-if analysis for system designers in a timely manner and at minimal cost compared with testing and evaluating on a real system.

Hadoop↗

Resilience Design Patterns: A Structured Approach to Resilience at Extreme Scale (V.2.0)

Reliability is a serious concern for future extreme-scale high-performance computing (HPC) systems. Projections based on the current generation of HPC systems and technology roadmaps suggest the prevalence of very high fault rates in future systems. The errors resulting from these faults will propagate and generate various kinds of failures, which may result in outcomes ranging from result corruptions to catastrophic application crashes. Therefore, the resilience challenge for extreme-scale HPC systems requires coordination between various hardware and software technologies that are capable of handling a broad set of fault models at accelerated fault rates. Also, due to practical limits on power consumption in future HPC systems, they are likely to embrace innovative architectures, increasing the levels of hardware and software complexities. Therefore, the techniques that seek to improve resilience must navigate the complex trade-off space between resilience and the overheads to power consumption and performance. While the HPC community has developed various resilience solutions, application-level techniques as well as system-based solutions, the solution space of HPC resilience techniques remains fragmented. There are no formal methods to integrate the various HPC resilience techniques into composite solutions, nor are there methods to holistically evaluate the adequacy and efficacy of such solutions in terms of their protection coverage, and their performance & power efficiency characteristics. Additionally, few implementations of current resilience solutions are portable to newer architectures and software environments that will be deployed on future systems. We developed a new structured approach to the management of HPC resilience using the concept of resilience-based design patterns. In general, a design pattern is a repeatable solution to a commonly occurring problem. We identified the well-known solutions that are commonly used to deal with faults, errors and failures in HPC systems. In the initial design patterns specification (version 1.0), we described the various solutions, which address specific problems in the design of resilient HPC environments, in the form of patterns. Each pattern describes a problem caused by a fault, error or failure event in an HPC environment, and then describes the core of the solution of the problem in such a way that this solution may be adapted to different systems and implemented at different layers of the system stack. The catalog of these resilience design patterns provides designers with a collection of design elements. To construct complete resilience solutions using combinations of various patterns, we defined a framework that enhances HPC designers' understanding of the important constraints and the opportunities for the design patterns to be implemented and deployed at various layers of the system stack. The design framework is also useful for establishing interfaces and mechanisms to coordinate flexible fault management across hardware and software components, as well as to consider the trade-off between performance, resilience, and power consumption when constructing a solution. The resilience design patterns specification version 1.1 included more detailed explanations of the pattern solutions, the context in which the patterns are applicable, and the implications for hardware or software design. It also provided several additional examples and detailed case studies to demonstrate the use of patterns to build realistic solutions. In version 1.2 of the specification document, we have improved the pattern descriptions, including graphical representations of the pattern components. These improvements are largely based on critical comments, feedback and suggestions received from pattern experts and readers of the previous versions of the specification. The pattern classification has been modified to further clarify the relationships between pattern categories. This version of the specification also introduces a pattern language for resilience design patterns. The pattern language presents the patterns in the catalog as a network, revealing the relations among the resilience patterns. The language provides designers with the means to explore alternative techniques for handling a specific fault model that may have different efficiency and complexity characteristics. Using the pattern language also enables the design and implementation of comprehensive resilience solutions as a set of interconnected resilience patterns that can be instantiated across layers of the system stack. The overall goal of this work is to provide hardware and software designers, as well as the users and operators of HPC systems, a systematic methodology for the design and evaluation of resilience technologies in HPC systems that keep scientific applications running to a correct solution in a timely and cost-efficient manner despite frequent faults, errors, and failures of various types. Version 2.0 expands the resilience design pattern classification and catalog to include self-stabilization patterns and reliability, availability and performance models for each structural pattern.

97 MATHEMATICS AND COMPUTING↗

Resilience Design Patterns - A Structured Approach to Resilience at Extreme Scale (version 1.2)

We developed a new structured approach to the management of HPC resilience using the concept of resilience-based design patterns. In general, a design pattern is a repeatable solution to a commonly occurring problem. We identified the well-known solutions that are commonly used to deal with faults, errors and failures in HPC systems. In the initial design patterns specification (version 1.0), we described the various solutions, which address specific problems in the design of resilient HPC environments, in the form of patterns. Each pattern describes a problem caused by a fault, error or failure event in an HPC environment, and then describes the core of the solution of the problem in such a way that this solution may be adapted to different systems and implemented at different layers of the system stack. The catalog of these resilience design patterns provides designers with a collection of design elements. To construct complete resilience solutions using combinations of various patterns, we defined a framework that enhances HPC designers’ understanding of the important constraints and the opportunities for the design patterns to be implemented and deployed at various layers of the system stack. The design framework is also useful for establishing interfaces and mechanisms to coordinate flexible fault management across hardware and software components, as well as to consider the trade-off between performance, resilience, and power consumption when constructing a solution. The resilience design patterns specification version 1.1 included more detailed explanations of the pattern solutions, the context in which the patterns are applicable, and the implications for hardware or software design. It also provided several additional examples and detailed case studies to demonstrate the use of patterns to build realistic solutions. In this version 1.2 of the specification document, we have improved the pattern descriptions, including graphical representations of the pattern components. These improvements are largely based on critical comments, feedback and suggestions received from pattern experts and readers of the previous versions of the specification. The pattern classification has been modified to further clarify the relationships between pattern categories. This version of the specification also introduces a pattern language for resilience design patterns. The pattern language presents the patterns in the catalog as a network, revealing the relations among the resilience patterns. The language provides designers with the means to explore alternative techniques for handling a specific fault model that may have different effciency and complexity characteristics. Using the pattern language also enables the design and implementation of comprehensive resilience solutions as a set of interconnected resilience patterns that can be instantiated across layers of the system stack. The overall goal of this work is to provide hardware and software designers, as well as the users and operators of HPC systems, a systematic methodology for the design and evaluation of resilience technologies in HPC systems that keep scientific applications running to a correct solution in a timely and cost-effcient manner despite frequent faults, errors, and failures of various types.

97 MATHEMATICS AND COMPUTING↗

Real-time flutter analysis of an active flutter-suppression system on a remotely piloted research aircraft

Flight-test results of the first three flights of an aeroelastic research wing are described. The flight flutter-test technique used to obtain real-time damping estimates from fast-frequency sweep data was obtained and the open-loop flutter boundary determined. Nyquist analyses of sweep maneuvers appear to provide additional valuable information about flutter suppression system operation, both in terms of phase-margin estimates and as a means of evaluating maneuver quality. An error in implementing the flutter-suppression system required in a one-half nominal gain configuration, which caused the wing to be unstable at lower Mach numbers than anticipated, and the vehicle experienced closed-loop flutter on its third flight. Real-time flutter-testing procedures were improved.

Gilyard, G. B.↗

Resilience Design Patterns - A Structured Approach to Resilience at Extreme Scale (version 1.0)

Reliability is a serious concern for future extreme-scale high-performance computing (HPC) systems. Projections based on the current generation of HPC systems and technology roadmaps suggest that very high fault rates in future systems. The errors resulting from these faults will propagate and generate various kinds of failures, which may result in outcomes ranging from result corruptions to catastrophic application crashes. Practical limits on power consumption in HPC systems will require future systems to embrace innovative architectures, increasing the levels of hardware and software complexities. The resilience challenge for extreme-scale HPC systems requires management of various hardware and software technologies that are capable of handling a broad set of fault models at accelerated fault rates. These techniques must seek to improve resilience at reasonable overheads to power consumption and performance. While the HPC community has developed various solutions, application-level as well as system-based solutions, the solution space of HPC resilience techniques remains fragmented. There are no formal methods and metrics to investigate and evaluate resilience holistically in HPC systems that consider impact scope, handling coverage, and performance & power eciency across the system stack. Additionally, few of the current approaches are portable to newer architectures and software ecosystems, which are expected to be deployed on future systems. In this document, we develop a structured approach to the management of HPC resilience based on the concept of resilience-based design patterns. A design pattern is a general repeatable solution to a commonly occurring problem. We identify the commonly occurring problems and solutions used to deal with faults, errors and failures in HPC systems. The catalog of resilience design patterns provides designers with reusable design elements. We define a design framework that enhances our understanding of the important constraints and opportunities for solutions deployed at various layers of the system stack. The framework may be used to establish mechanisms and interfaces to coordinate flexible fault management across hardware and software components. The framework also enables optimization of the cost-benefit trade-os among performance, resilience, and power consumption. The overall goal of this work is to enable a systematic methodology for the design and evaluation of resilience technologies in extreme-scale HPC systems that keep scientific applications running to a correct solution in a timely and cost-ecient manner in spite of frequent faults, errors, and failures of various types.

97 MATHEMATICS AND COMPUTING↗

Quality and accuracy of cone beam computed tomography gated by active breathing control

The purpose of this study was to evaluate the quality and accuracy of cone beam computed tomography (CBCT) gated by active breathing control (ABC), which may be useful for image guidance in the presence of respiration. Comparisons were made between conventional ABC-CBCT (stop and go), fast ABC-CBCT (a method to speed up the acquisition by slowing the gantry instead of stopping during free breathing), and free breathing respiration correlated CBCT. Image quality was assessed in phantom. Accuracy of reconstructed voxel intensity, uniformity, and root mean square error were evaluated. Registration accuracy (bony and soft tissue) was quantified with both an anthropomorphic and a quality assurance phantom. Gantry angle accuracy was measured with respect to gantry speed modulation. Conventional ABC-CBCT scan time ranged from 2.3 to 5.8 min. Fast ABC-CBCT scan time ranged from 1.4 to 1.8 min, and respiratory correlated CBCT scans took 2.1 min to complete. Voxel intensity value for ABC gated scans was accurate relative to a normal clinical scan with all projections. Uniformity and root mean square error performance degraded as the number of projections used in the reconstruction of the fast ABC-CBCT scans decreased (shortest breath hold, longest free breathing segment). Registration accuracy for small, large, and rotational corrections was within 1 mm and 1 degree sign . Gantry angle accuracy was within 1 degree sign for all scans. For high-contrast targets, performance for image-guidance purposes was similar for fast and conventional ABC-CBCT scans and respiration correlated CBCT.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Test and evaluation of bubble memories

A description is presented of a test program which has shown that well-constructed bubble memories can operate reliably over long periods of time and at low error rates. Even the relatively high error rate of one memory during burn-in can be considered acceptable if compared with tape recorder standards. No wear-out mechanism or aging could be detected. Bubble memories are now considered suitable for long-duration space missions and certainly are suitable for many military and commercial applications. It must be recognized, however, that bubble memories are complex devices and not yet fully understood. While the particular memory tested may never find practical applications, it nevertheless has provided insight into performance characteristics considered typical of bubble memories.

Bahm, E.↗

Generating data ensembles over a model grid from sparse climate measurements.

Parameterizations in high-end climate models can be evaluated with observed climate and meteorological data. Often this evaluation is achieved by averaging measured quantities over time and space to match the spatial and temporal resolution of a gridded climate model without any regard for the statistical errors in doing so. We present a statistical method to interpolate sparsely located surface measurements into a uniform spatial grid representative of global and regional models of the atmosphere and climate. This method provides estimates of mean values over the entire domain containing the measurement sites as well as the uncertainty in the estimated quantities at the grid locations through multiple simulations to create 'data ensembles.' We demonstrate this method using measurements of surface sensible heat flux over the southern Great Plains region gathered through the Department of Energy's Atmospheric Radiation Measurement (ARM) program. Application to the numerous other climate variables measured through the ARM program and the development of a software tool to streamline data management and implementation of the statistical models is also discussed.

54 ENVIRONMENTAL SCIENCES↗