Search NASA⌕ Search

SEARCH · Search NASA

Results for “error impact analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Uncertainty Analysis of the CE-22 Advanced Nozzle Test Facility

This paper presents methods and results of a detailed measurement uncertainty analysis that was performed for the Advanced Nozzle Test Facility, CE-22, located at the NASA Glenn Research Center. Results for the uncertainty in thrust and flow coefficients, in addition to other variables of interest, are provided. Results are presented separately as random uncertainty (characterizing errors inherent to instrument or measurement environment, impacting repeatability), systematic uncertainty (capturing inaccuracies due to measurement process, calibration, installation effects or other sources which may introduce bias), and total combined uncertainty. The statistical methods and engineering judgments used to estimate elemental uncertainties are described. The analysis tool MANTUS (Measurement Analysis Tool for Uncertainty in Systems) was used to quantify instrumentation system uncertainty, and statistical analysis and engineering judgment were used to quantify other random and systematic uncertainty sources. The Monte Carlo method was used to propagate systematic and random elemental uncertainties to determine the uncertainties of various calculated variables of interest.

data quality↗

Sources of error and methods to improve accuracy in interface state density analysis using quasi-static capacitance–voltage measurements in wide bandgap semiconductors

Characterizing interface trap states in commercial wide bandgap devices using frequency-based measurements requires unconventionally high probing frequencies to account for both fast and slow traps associated with wide bandgap materials. The C - ψs technique has been suggested as a viable quasi-static method for determining the interface trap state densities in wide bandgap systems, but the results are shown to be susceptible to errors in the analysis procedure. Here this work explores the primary sources of errors present in the C - ψs technique using an analytical model that describes the apparent response for wide bandgap MOS capacitor devices. Measurement noise is shown to greatly impact the linear fitting routine of the 1/C$^{*2}_s$ vs Ψ s plot to calibrate the additive constant in the surface potential/gate voltage relationship, and an inexact knowledge of the oxide capacitance is also shown to impede interface trap state analysis near the band edge. In addition, a slight nonlinearity that is typically present throughout the 1/C$^{*2}_s$ vs Ψ s plot hinders the accurate estimation of interface trap densities, which is demonstrated for a fabricated n-SiC MOS capacitor device. Methods are suggested to improve quasi-static analysis, including a novel method to determine an approximate integration constant without relying on a linear fitting routine.

42 ENGINEERING↗

THE ARECIBO LEGACY FAST ALFA SURVEY: THE {alpha}.40 H I SOURCE CATALOG, ITS CHARACTERISTICS AND THEIR IMPACT ON THE DERIVATION OF THE H I MASS FUNCTION

We present a current catalog of 21 cm H I line sources extracted from the Arecibo Legacy Fast Arecibo L-band Feed Array (ALFALFA) survey over {approx}2800 deg{sup 2} of sky: the {alpha}.40 catalog. Covering 40% of the final survey area, the {alpha}.40 catalog contains 15,855 sources in the regions 07{sup h}30{sup m} < R.A. < 16{sup h}30{sup m}, +04 Degree-Sign < decl. <+16 Degree-Sign , and +24 Degree-Sign < decl. <+28 Degree-Sign and 22{sup h} < R.A. < 03{sup h}, +14 Degree-Sign < decl. <+16 Degree-Sign , and +24 Degree-Sign < decl. < + 32 Degree-Sign . Of those, 15,041 are certainly extragalactic, yielding a source density of 5.3 galaxies per deg{sup 2}, a factor of 29 improvement over the catalog extracted from the H I Parkes All-Sky Survey. In addition to the source centroid positions, H I line flux densities, recessional velocities, and line widths, the catalog includes the coordinates of the most probable optical counterpart of each H I line detection, and a separate compilation provides a cross-match to identifications given in the photometric and spectroscopic catalogs associated with the Sloan Digital Sky Survey Data Release 7. Fewer than 2% of the extragalactic H I line sources cannot be identified with a feasible optical counterpart; some of those may be rare OH megamasers at 0.16 < z < 0.25. A detailed analysis is presented of the completeness, width-dependent sensitivity function and bias inherent of the {alpha}.40 catalog. The impact of survey selection, distance errors, current volume coverage, and local large-scale structure on the derivation of the H I mass function is assessed. While {alpha}.40 does not yet provide a completely representative sampling of cosmological volume, derivations of the H I mass function using future data releases from ALFALFA will further improve both statistical and systematic uncertainties.

79 ASTRONOMY AND ASTROPHYSICS↗

Non-LTE modelling of cyanoacetylene: evidence for isomer-specific excitation

ABSTRACT Cyanoacetylene molecules are widespread in the interstellar medium (ISM) and several of its isomers have been detected in cold molecular clouds and circumstellar gas. Accurate estimates of the abundance ratio of cyanoacetylene isomers may provide deep insight into their environment. Such knowledge requires rigorous modelling of the emission spectra based on non-local thermodynamic equilibrium (LTE) radiative transfer calculations. To this end, we computed excitation cross-sections of HC2NC and HNC3 induced by collision with para- and ortho-H2, using a quantum mechanical close-coupling method. Then, by thermally averaging these data, we derived rate coefficients for the first 31 low-lying rotational levels of each isomer for temperatures up to 80 K. For the para-H2 collider, the propensity rules are in favour of rotational transitions involving Δj1 = 2 for both isomers, while for the ortho-H2 collider, Δj1 = 2 and Δj1 = 1 rotational transitions are favoured for HC2NC and HNC3, respectively. A comparison of rate coefficients for the HC3N isomers shows differences up to an order of magnitude, especially at low temperatures. Finally, we performed non-LTE radiative transfer calculations to assess the impact of such variations in the analysis of observations. Our simulation suggests that the lack of collisional data specific to each isomer could lead to errors up to a factor of 2–3 in the excitation temperatures. We expect that these data could help in better understanding the cyanoacetylene chemistry and constraining the nitrogen chemistry in the ISM.

79 ASTRONOMY AND ASTROPHYSICS↗

Accurate contrast determination for X-ray speckle visibility spectroscopy

X-ray speckle visibility spectroscopy using X-ray free-electron lasers has long been proposed as a probe of fast dynamics in noncrystalline materials. In this paper, numerical modeling is presented to show how the data interpretation of visibility spectroscopy can be impacted by the nonidealities of real-life X-ray detectors. Using simulated detector data, this work provides a detailed analysis of the systematic errors of several contrast extraction algorithms in the context of low-count-rate X-ray speckle visibility spectroscopy and their origins are discussed. Here, it was found that the finite detector charge cloud and pixel size lead to an unavoidable `degeneracy' in photon position determination, and that the contrasts extracted using different algorithms can all be corrected by a simple linear model. The results suggest that experimental calibration of the correction coefficient at the count rate of interest is possible and essential. This allows computationally lightweight algorithms to be implemented for on-the-fly analysis.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Quantifying Uncertainty of Landing and Takeoff Noise for Commercial Supersonic Aircraft

Of the many challenges faced by manufacturers attempting to offer supersonic travel to the public, the uncertainty in predicting the noise of these aircraft in airport operations has an immediate impact. No noise regulation exists in FAA or ICAO for certifying such aircraft, as these organization require solid data, usually from existing aircraft. Manufacturers are taking large risks to design a vehicle not knowing whether it will be allowed to fly. A partial solution to this conundrum is to use physics-based simulations to provide the “data” used to calibrate system-level prediction methods, carefully documenting the uncertainty of the method for application to supersonic aircraft. A close look at the accuracy of empirical prediction methods points to areas where improvements need to be made if noise studies of supersonic aircraft are to be useful. As NASA embarks on a focused research program to improve predictions of noise from the noise-dominant propulsion noise of commercial supersonic aircraft, this paper documents the work done to baseline the uncertainties found in today’s noise prediction methods. A relatively simplistic method was developed, summarizing the error of the empirical methods on a component basis and following their impact on the total aircraft during landing and takeoff operations using Monte Carlo analysis. By this method it is found that current empirical noise prediction methods have an uncertainty of 1.5 EPNdB cumulative for propulsion noise of a representative conventional subsonic passenger aircraft. When applied to likely near-term supersonic commercial aircraft, the uncertainty is 7.6 EPNdB cumulative, a difference that must be reduced if the prediction methods are to guide decision makers.

Airport noise↗

Exact revision of the elliptically bent mirror theory

One of the main hurdles for nanometer focusing by a bending mirror lies in the theoretical surface errors by its approximations used for the traditional theory. The impacts of approximations and analytical corrections have been discussed, and the elliptically bent mirror theory has been described during exact mathematical analysis without any approximations. These approximations are harmful for the focusing system with bigger grazing angle, bigger mirror length, and bigger numerical aperture. The properties of equal-moment and single-moment bent mirrors have been described and discussed. Because of its obvious advantages, a single-moment bending mirror has high potential ability for nanometer focusing.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Modeling in the State Flow Environment to Support Launch Vehicle Verification Testing for Mission and Fault Management Algorithms in the NASA Space Launch System

Analysis methods and testing processes are essential activities in the engineering development and verification of the National Aeronautics and Space Administration's (NASA) new Space Launch System (SLS). Central to mission success is reliable verification of the Mission and Fault Management (M&FM) algorithms for the SLS launch vehicle (LV) flight software. This is particularly difficult because M&FM algorithms integrate and operate LV subsystems, which consist of diverse forms of hardware and software themselves, with equally diverse integration from the engineering disciplines of LV subsystems. M&FM operation of SLS requires a changing mix of LV automation. During pre-launch the LV is primarily operated by the Kennedy Space Center (KSC) Ground Systems Development and Operations (GSDO) organization with some LV automation of time-critical functions, and much more autonomous LV operations during ascent that have crucial interactions with the Orion crew capsule, its astronauts, and with mission controllers at the Johnson Space Center. M&FM algorithms must perform all nominal mission commanding via the flight computer to control LV states from pre-launch through disposal and also address failure conditions by initiating autonomous or commanded aborts (crew capsule escape from the failing LV), redundancy management of failing subsystems and components, and safing actions to reduce or prevent threats to ground systems and crew. To address the criticality of the verification testing of these algorithms, the NASA M&FM team has utilized the State Flow environment6 (SFE) with its existing Vehicle Management End-to-End Testbed (VMET) platform which also hosts vendor-supplied physics-based LV subsystem models. The human-derived M&FM algorithms are designed and vetted in Integrated Development Teams composed of design and development disciplines such as Systems Engineering, Flight Software (FSW), Safety and Mission Assurance (S&MA) and major subsystems and vehicle elements such as Main Propulsion Systems (MPS), boosters, avionics, Guidance, Navigation, and Control (GN&C), Thrust Vector Control (TVC), liquid engines, and the astronaut crew office. Since the algorithms are realized using model-based engineering (MBE) methods from a hybrid of the Unified Modeling Language (UML) and Systems Modeling Language (SysML), SFE methods are a natural fit to provide an in depth analysis of the interactive behavior of these algorithms with the SLS LV subsystem models. For this, the M&FM algorithms and the SLS LV subsystem models are modeled using constructs provided by Matlab which also enables modeling of the accompanying interfaces providing greater flexibility for integrated testing and analysis, which helps forecast expected behavior in forward VMET integrated testing activities. In VMET, the M&FM algorithms are prototyped and implemented using the same C++ programming language and similar state machine architectural concepts used by the FSW group. Due to the interactive complexity of the algorithms, VMET testing thus far has verified all the individual M&FM subsystem algorithms with select subsystem vendor models but is steadily progressing to assessing the interactive behavior of these algorithms with LV subsystems, as represented by subsystem models. The novel SFE applications has proven to be useful for quick look analysis into early integrated system behavior and assessment of the M&FM algorithms with the modeled LV subsystems. This early MBE analysis generates vital insight into the integrated system behaviors, algorithm sensitivities, design issues, and has aided in the debugging of the M&FM algorithms well before full testing can begin in more expensive, higher fidelity but more arduous environments such as VMET, FSW testing, and the Systems Integration Lab7 (SIL). SFE has exhibited both expected and unexpected behaviors in nominal and off nominal test cases prior to full VMET testing. In many findings, these behavioral characteristics were used to correct the M&FM algorithms, enable better test coverage, and develop more effective test cases for each of the LV subsystems. This has improved the fidelity of testing and planning for the next generation of M&FM algorithms as the SLS program evolves from non-crewed to crewed flight, impacting subsystem configurations and the M&FM algorithms that control them. SFE analysis has improved robustness and reliability of the M&FM algorithms by revealing implementation errors and documentation inconsistencies. It is also improving planning efficiency for future VMET testing of the M&FM algorithms hosted in the LV flight computers, further reducing risk for the SLS launch infrastructure, the SLS LV, and most importantly the crew.

Trevino, Luis↗

Assimilation of MODIS Dark Target and Deep Blue Observations in the Dust Aerosol Component of NMMB-MONARCH version 1.0

A data assimilation capability has been built for the NMMB-MONARCH chemical weather prediction system, with a focus on mineral dust, a prominent type of aerosol. An ensemble-based Kalman filter technique (namely the local ensemble transform Kalman filter - LETKF) has been utilized to optimally combine model background and satellite retrievals. Our implementation of the ensemble is based on known uncertainties in the physical parametrizations of the dust emission scheme. Experiments showed that MODIS AOD retrievals using the Dark Target algorithm can help NMMB-MONARCH to better characterize atmospheric dust. This is particularly true for the analysis of the dust outflow in the Sahel region and over the African Atlantic coast. The assimilation of MODIS AOD retrievals based on the Deep Blue algorithm has a further positive impact in the analysis downwind from the strongest dust sources of the Sahara and in the Arabian Peninsula. An analysis-initialized forecast performs better (lower forecast error and higher correlation with observations) than a standard forecast, with the exception of underestimating dust in the long-range Atlantic transport and degradation of the temporal evolution of dust in some regions after day 1. Particularly relevant is the improved forecast over the Sahara throughout the forecast range thanks to the assimilation of Deep Blue retrievals over areas not easily covered by other observational datasets.The present study on mineral dust is a first step towards data assimilation with a complete aerosol prediction system that includes multiple aerosol species.

atmospheric dust↗

On the Correspondence between Mean Forecast Errors and Climate Errors in CMIP5 Models

The present study examines the correspondence between short- and long-term systematic errors in five atmospheric models by comparing the 16 five-day hindcast ensembles from the Transpose Atmospheric Model Intercomparison Project II (Transpose-AMIP II) for July–August 2009 (short term) to the climate simulations from phase 5 of the Coupled Model Intercomparison Project (CMIP5) and AMIP for the June–August mean conditions of the years of 1979–2008 (long term). Because the short-term hindcasts were conducted with identical climate models used in the CMIP5/AMIP simulations, one can diagnose over what time scale systematic errors in these climate simulations develop, thus yielding insights into their origin through a seamless modeling approach. The analysis suggests that most systematic errors of precipitation, clouds, and radiation processes in the long-term climate runs are present by day 5 in ensemble average hindcasts in all models. Errors typically saturate after few days of hindcasts with amplitudes comparable to the climate errors, and the impacts of initial conditions on the simulated ensemble mean errors are relatively small. This robust bias correspondence suggests that these systematic errors across different models likely are initiated by model parameterizations since the atmospheric large-scale states remain close to observations in the first 2–3 days. However, biases associated with model physics can have impacts on the large-scale states by day 5, such as zonal winds, 2-m temperature, and sea level pressure, and the analysis further indicates a good correspondence between short- and long-term biases for these large-scale states. Therefore, improving individual model parameterizations in the hindcast mode could lead to the improvement of most climate models in simulating their climate mean state and potentially their future projections.

54 ENVIRONMENTAL SCIENCES↗

Fast Fault Injection and Sensitivity Analysis for Collective Communications, In: 2015 IEEE International Conference on Cluster Computing

The collective communication operations, which are widely used in parallel applications for global communication and synchronization are critical for application's performance and scalability. However, how faulty collective communications impact the application and how errors propagate between the application processes is largely unexplored. One of the critical reasons for this situation is the lack of fast evaluation method to investigate the impacts of faulty collective operations. The traditional random fault injection methods relying on a large amount of fault injection tests to ensure statistical significance require a significant amount of resources and time. These methods result in prohibitive evaluation cost when applied to the collectives. In this paper, we introduce a novel tool named Fast Fault Injection and Sensitivity Analysis Tool (FastFIT) to conduct fast fault injection and characterize the application sensitivity to faulty collectives. The tool achieves fast exploration by reducing the exploration space and predicting the application sensitivity using Machine Learning (ML) techniques. A basis for these techniques are implicit correlations between MPI semantics, application context, critical application features, and application responses to faulty collective communications. The experimental results show that our approach reduces the fault injection points and tests by 97% for representative benchmarks (NAS Parallel Benchmarks (NPB)) and a realistic application (Large-scale Atomic/Molecular Massively Parallel Simulator (LAMMPS)) on a production supercomputer. Further, we statistically generalize the application sensitivity to faulty collective communications for these workloads, and present correlation between application features and the sensitivity.

Computer Science↗

Onboard Navigation Error Analysis for Aerocapture at Uranus

Capturing into an orbit around Uranus using aerocapture allows one to design a mission with faster interplanetary trajectories and less propellant requirements. Such an aerocapture mission would rely on the onboard Guidance, Navigation, and Control (GNC) subsystems to successfully capture into an orbit around Uranus. Uncertainty in the state information and the noise in the sensor measurements induce navigation errors in the guidance and control subsystems, which can affect the overall performance of the aerocapture mission at Uranus. Understanding the effect of these navigation errors on mission performance is essential. To this end, this work considers different sensors with varying quality to understand their impact on the overall mission performance. In addition, this paper studies the impact of the uncertainty in the initial states used to initialize the onboard navigation filter and understands their effect on mission performance. This paper also shows the onboard navigation errors obtained from the Linear Covariance (LinCov) analysis and uses them for verification and validation (V&V) of the results from Program to Optimize and Simulate Trajectories-II (POST2).

Pardha Sai Chadalavada↗

Onboard Navigation Error Analysis for Aerocapture at Uranus

Capturing into an orbit around Uranus using aerocapture allows one to design a mission with faster interplanetary trajectories and less propellant requirements. Such an aerocapture mission would rely on the onboard Guidance, Navigation, and Control (GNC) subsystems to successfully capture into an orbit around Uranus. Uncertainty in the state information and the noise in the sensor measurements induce navigation errors in the guidance and control subsystems, which can affect the overall performance of the aerocapture mission at Uranus. Understanding the effect of these navigation errors on mission performance is essential. To this end, this work considers different sensors with varying quality to understand their impact on the overall mission performance. In addition, this paper studies the impact of the uncertainty in the initial states used to initialize the onboard navigation filter and understands their effect on mission performance. This paper also shows the onboard navigation errors obtained from the Linear Covariance (LinCov) analysis and uses them for verification and validation (V\&V) of the results from Program to Optimize and Simulate Trajectories-II (POST2).

Aerocapture↗

A non-intrusive optical (NIO) approach to characterize heliostats in utility-scale power tower plants: Sensitivity study

Power towers, a type of concentrating power tower technology, use a large number of heliostats to concentrate sunlight and produce renewable energy. Optical errors of heliostats can cause drastic losses in the efficiency of power-tower plants. Accurately measuring optical errors is crucial to assessing and improving plant performance. This analysis discusses an innovate non-intrusive optical (NIO) approach to measure slope, canting, and tracking errors by detecting distortions in the reflected tower structure in heliostat images. Further in this work a sensitivity study is carefully conducted to determine the uncertainty requirements to allow the method to calculate slope errors with an accuracy of 0.25 mrad. Measurement uncertainty sources include camera resolution and position uncertainty, tower position uncertainty, and number of collected images. Each uncertainty source is investigated to determine its impact on the accuracy of the slope-error calculation. A combination of theoretical results and experimental results obtained from data collected on a heliostat at Sandia National Laboratories is used to determine and validate uncertainty requirements. The analysis shows that a measurement uncertainty of 0.25 mrad can be realized by realistically controlling uncertainty sources when implementing the NIO method. It demonstrates the superior performance of NIO in performing in-situ optical characterization.

14 SOLAR ENERGY↗

Numerical error analysis of SOLPS-ITER simulations of EAST

Abstract Plasma edge simulations with codes like SOLPS-ITER are widely employed to interpret fusion experiments. However, numerical errors appearing in such simulations are rarely investigated, despite their potential large impact on simulation results. These errors consist of the statistical error and the bias, both resulting from the finite number of employed EIRENE Monte Carlo particles and incomplete convergence, and the discretization error due to the finite resolution of the computational grids. In this contribution, the resulting numerical errors on simulations of pure deuterium and neon seeded H-mode EAST discharges are examined. The statistical error can be kept small compared to other numerical error contributions by averaging the plasma profiles. This allows investigating the bias and discretization errors using Richardson extrapolation. It is shown that grid refinement and the number of employed Monte Carlo particles have the largest influence on the result, in agreement with similar studies of an ITER deuterium case. For the first time, numerical error bars on the entire simulated target profiles are determined showing that the largest numerical error is 17.9%, mainly due to the plasma grid discretization. On top, also numerical errors on simulated neutral pressures are investigated in detail, for which the statistical error is dominant. The analysis demonstrates which setup is needed to keep numerical errors limited: the SOLPS-ITER averaging procedure should be employed including enough EIRENE particles, and the involved grids should be sufficiently refined to reduce discretization errors.

Boeyaert, Dieter (ORCID:0000000309208660)↗

Man-Machine Integration Design and Analysis System (MIDAS) v5: Augmentations, Motivations, and Directions for Aeronautics Applications

As automation and advanced technologies are introduced into transport systems ranging from the Next Generation Air Transportation System termed NextGen, to the advanced surface transportation systems as exemplified by the Intelligent Transportations Systems, to future systems designed for space exploration, there is an increased need to validly predict how the future systems will be vulnerable to error given the demands imposed by the assistive technologies. One formalized approach to study the impact of assistive technologies on the human operator in a safe and non-obtrusive manner is through the use of human performance models (HPMs). HPMs play an integral role when complex human-system designs are proposed, developed, and tested. One HPM tool termed the Man-machine Integration Design and Analysis System (MIDAS) is a NASA Ames Research Center HPM software tool that has been applied to predict human-system performance in various domains since 1986. MIDAS is a dynamic, integrated HPM and simulation environment that facilitates the design, visualization, and computational evaluation of complex man-machine system concepts in simulated operational environments. The paper will discuss a range of aviation specific applications including an approach used to model human error for NASA s Aviation Safety Program, and what-if analyses to evaluate flight deck technologies for NextGen operations. This chapter will culminate by raising two challenges for the field of predictive HPMs for complex human-system designs that evaluate assistive technologies: that of (1) model transparency and (2) model validation.

Gore, Brian F.↗

Subjective evaluation of the combined influence of satellite temperature sounding data and increased model resolution on numerical weather forecasting

The present evaluation is concerned with (1) the significance of prognostic differences resulting from the inclusion of satellite-derived temperature soundings, (2) how specific differences between the SAT and NOSAT prognoses evolve, and (3) comparison of two experiments using the Goddard Laboratory for Atmospheric Sciences general circulation model. The subjective evaluation indicates that the beneficial impact of sounding data is enhanced with increased resolution. It is suggested that satellite sounding data posses valuable information content which at times can correct gross analysis errors in data sparse regions.

Atlas, R.↗