Search NASA⌕ Search

SEARCH · Search NASA

Results for “error impact analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

Assimilation of X-band Phased-Array Radar Data with EnKF for the Analysis and Warning Forecast of a Tornadic storm

The impact of assimilating China's operational X-band Phased-Array radar's (X-PAR) data on the analysis and warning forecast of the vortex structure and intensity of the June 8, 2018 Foshan, Guangdong province, tornadic storm was investigated for the first time using an Ensemble Kalman Filter (EnKF) data assimilation system. Both radar radial velocity (Vr) and reflectivity (Z) from two S-band operational radars and one X-PAR were assimilated. Deterministic forecasts were launched every 6 min from 05:42 UTC (20 min before the tornado touched down) to 06:00 UTC from the EnKF mean analysis field. Five experiments were conducted to examine the added capability of Z assimilation of the EnKF system, and to investigate the impact of assimilating X-PAR data on the analysis and prediction of the tornadic storm. Compared to the experiment without Z assimilation, the assimilation of Z reduced the analysis error and greatly reduced the forecast error of Z. Furthermore, the assimilation of X-PAR data greatly improved the vortex structure of the tornadic storm at low levels, and improved the intensity of the rear inflow of the tornadic storm, especially with a higher assimilation frequency. Compared to the experiments without X-PAR data assimilation, assimilating X-PAR data improved the predictability of tornadic storm.

54 ENVIRONMENTAL SCIENCES↗

Impact of Assimilating AIRS Cloud Cleared Radiances on the Analysis and Forecast of Polar Lows

Previous work by this team (Reale et al. 2018) has found that the current assimilation of AIRS (Atmospheric InfraRed Sounder) radiances on a regularly spaced thinning grid is suboptimal, probably because of horizontal error correlation over meteorologically inactive areas. Moreover, cloud-cleared radiances appear to be a better product than clear-sky radiances, but need to be assimilated at a much lower density globally, because of the higher information content. Specifically: 1. Assimilation of AIRS cloud-cleared radiances at a density of about one quarter of the clear-sky radiances improves global forecast skill; 2. An adaptive thinning strategy assimilating cloud-cleared radiances at reduced density globally except around tropical cyclones (TCs), leads to substantial improvement in the structure and intensity forecast of TCs without damaging global skill.

Polar Low↗

Misclassification of causes of death among a small all-autopsied group of former nuclear workers: Death certificates vs. autopsy reports

The U.S. Transuranium and Uranium Registries performs autopsies on each of its deceased Registrants as a part of its mission to follow up occupationally-exposed individuals. This provides a unique opportunity to explore death certificate misclassification errors, and the factors that influence them, among this small population of former nuclear workers. Underlying causes of death from death certificates and autopsy reports were coded using the 10 th revision of the International Classification of Diseases (ICD-10). These codes were then used to quantify misclassification rates among 268 individuals for whom both full autopsy reports and death certificates with legible underlying causes of death were available. When underlying causes of death were compared between death certificates and autopsy reports, death certificates correctly identified the underlying cause of death’s ICD-10 disease chapter in 74.6% of cases. The remaining 25.4% of misclassified cases resulted in over-classification rates that ranged from 1.2% for external causes of mortality to 12.2% for circulatory disease, and under-classification rates that ranged from 7.7% for external causes of mortality to 47.4% for respiratory disease. Neoplasms had generally lower misclassification rates with 4.3% over-classification and 13.3% under-classification. A logistic regression revealed that the odds of a match were 2.8 times higher when clinical history was mentioned on the autopsy report than when it was not. Similarly, the odds of a match were 3.4 times higher when death certificates were completed using autopsy findings than when autopsy findings were not used. This analysis excluded cases where it could not be determined if autopsy findings were used to complete death certificates. The findings of this study are useful to investigate the impact of death certificate misclassification errors on radiation risk estimates and, therefore, improve the reliability of epidemiological studies.

63 RADIATION, THERMAL, AND OTHER ENVIRON. POLLUTAN↗

WE-H-BRC-05: Catastrophic Error Metrics for Radiation Therapy

Purpose: Intuitive evaluation of complex radiotherapy treatments is impractical, while data transfer anomalies create the potential for catastrophic treatment delivery errors. Contrary to prevailing wisdom, logical scrutiny can be applied to patient-specific machine settings. Such tests can be automated, applied at the point of treatment delivery and can be dissociated from prior states of the treatment plan, potentially revealing errors introduced early in the process. Methods: Analytical metrics were formulated for conventional and intensity modulated RT (IMRT) treatments. These were designed to assess consistency between monitor unit settings, wedge values, prescription dose and leaf positioning (IMRT). Institutional metric averages for 218 clinical plans were stratified over multiple anatomical sites. Treatment delivery errors were simulated using a commercial treatment planning system and metric behavior assessed via receiver-operator-characteristic (ROC) analysis. A positive result was returned if the erred plan metric value exceeded a given number of standard deviations, e.g. 2. The finding was declared true positive if the dosimetric impact exceeded 25%. ROC curves were generated over a range of metric standard deviations. Results: Data for the conventional treatment metric indicated standard deviations of 3%, 12%, 11%, 8%, and 5 % for brain, pelvis, abdomen, lung and breast sites, respectively. Optimum error declaration thresholds yielded true positive rates (TPR) between 0.7 and 1, and false positive rates (FPR) between 0 and 0.2. Two proposed IMRT metrics possessed standard deviations of 23% and 37%. The superior metric returned TPR and FPR of 0.7 and 0.2, respectively, when both leaf position and MUs were modelled. Isolation to only leaf position errors yielded TPR and FPR values of 0.9 and 0.1. Conclusion: Logical tests can reveal treatment delivery errors and prevent large, catastrophic errors. Analytical metrics are able to identify errors in monitor units, wedging and leaf positions with favorable sensitivity and specificity. In part by Varian.

60 APPLIED LIFE SCIENCES↗

Generalized Augmented-State Covariance Analysis for Spaceflight

The use of linear covariance analysis techniques, also known as LinCov, has been used extensively for more than a half century for spaceflight applications. Originally, its primary purpose was to facilitate navigation analysis. For many past and current applications, the specific implementations only support navigation studies still. When the concept of an augmented-state linear covariance analysis approach was initially introduced that allowed for both navigation and trajectory dispersion analysis, the enhancement was motivated and primarily utilized to support navigation filter tuning and error budget analysis. Relatively few utilize this alternate augmented-state formulation of LinCov due to its additional complexity. The untapped potential of the augmented-state linear covariance analysis technique slowly unfolded in the past two-decades as its capability to rapidly and reliably capture the integrated closed-loop guidance, navigation, and control (GN&C) system performance became more apparent. Even with this dual purpose of generating insights to both navigation errors along with trajectory and delta-v dispersions, the core theoretical development had a heavy emphasis on the impacts of the navigation system and largely neglected the details of the actual guidance, targeting, and control systems. This paper extends the navigation-centric theoretical development by formulating a generalized augmented-state covariance analysis (GAUSCOV) technique that allows for the intricacies of a variety of targeting and control strategies along with ground planning and mission operations to be more formally included in assessing the impacts to spaceflight GN&C system performance.

Linear Covariance Analysis↗

Procedures for experimental measurement and theoretical analysis of large plastic deformations

Theoretical equations are derived and analytical procedures are presented for the interpretation of experimental measurements of large plastic strains in the surface of a plate. Orthogonal gage lengths established on the metal surface are measured before and after deformation. The change in orthogonality after deformation is also measured. Equations yield the principal strains, deviatoric stresses in the absence of surface friction forces, true stresses if the stress normal to the surface is known, and the orientation angle between the deformed gage line and the principal stress-strain axes. Errors in the measurement of nominal strains greater than 3 percent are within engineering accuracy. Applications suggested for this strain measurement system include the large-strain-stress analysis of impact test models, burst tests of spherical or cylindrical pressure vessels, and to augment small-strain instrumentation tests where large strains are anticipated.

Morris, R. E.↗

Volcanic Contribution to Decadal Changes in Tropospheric Temperature

Despite continued growth in atmospheric levels of greenhouse gases, global mean surface and tropospheric temperatures have shown slower warming since 1998 than previously. Possible explanations for the slow-down include internal climate variability, external cooling influences and observational errors. Several recent modelling studies have examined the contribution of early twenty-first-century volcanic eruptions to the muted surface warming. Here we present a detailed analysis of the impact of recent volcanic forcing on tropospheric temperature, based on observations as well as climate model simulations. We identify statistically significant correlations between observations of stratospheric aerosol optical depth and satellite-based estimates of both tropospheric temperature and short-wave fluxes at the top of the atmosphere. We show that climate model simulations without the effects of early twenty-first-century volcanic eruptions overestimate the tropospheric warming observed since 1998. In two simulations with more realistic volcanic influences following the 1991 Pinatubo eruption, differences between simulated and observed tropospheric temperature trends over the period 1998 to 2012 are up to 15% smaller, with large uncertainties in the magnitude of the effect. To reduce these uncertainties, better observations of eruption-specific properties of volcanic aerosols are needed, as well as improved representation of these eruption-specific properties in climate model simulations.

Atmospheric temperature↗

Global-scale Evaluation of SMAP, SMOS and ASCAT Soil Moisture Products Using Triple Collocation

Global-scale surface soil moisture products are currently available from multiple remote sensing platforms. Footprint-scale assessments of these products are generally restricted to limited number of densely-instrumented validation sites. However, by taking active and passive soil moisture products together with a third independent soil moisture estimates via land surface modeling, triple collocation (TC) can be applied to estimate the correlation metric of satellite soil moisture products (versus an unknown ground truth) over a quasi-global domain. Here, an assessment of Soil Moisture Active Passive (SMAP), Soil Moisture Ocean Salinity (SMOS) and Advanced SCATterometer (ASCAT) surface soil moisture retrievals via TC is presented. Considering the potential violation of TC error assumptions, the impact of active-passive and satellite-model error cross correlations on the TC-derived inter-comparison results is examined at in situ sites using quadruple collocation analysis. In addition, confidence intervals for the TC-estimated correlation metric are constructed from moving-block bootstrap sampling designed to preserve the temporal persistence of the original (unevenly-sampled) soil moisture time-series. This study is the first to apply TC to obtain a robust global-scale cross-assessment of SMAP, SMOS and ASCAT soil moisture retrieval accuracy in terms of anomaly temporal correlation. Our results confirm the overall advantage of SMAP (with a global average anomaly correlation of 0.76) over SMOS (0.66) and ASCAT (0.63) that has been established in several recent regional, ground-based studies. SMAP is also the best-performing product over the majority of applicable land pixels (52%), although SMOS and ASCAT each shows advantage in distinct geographic regions.

global-scale↗

THREE-POINT CORRELATION FUNCTIONS OF SDSS GALAXIES: CONSTRAINING GALAXY-MASS BIAS

We constrain the linear and quadratic bias parameters from the configuration dependence of the three-point correlation function (3PCF) in both redshift and projected space, utilizing measurements of spectroscopic galaxies in the Sloan Digital Sky Survey Main Galaxy Sample. We show that bright galaxies (M{sub r} < -21.5) are biased tracers of mass, measured at a significance of 4.5{sigma} in redshift space and 2.5{sigma} in projected space by using a thorough error analysis in the quasi-linear regime (9-27 h{sup -1} Mpc). Measurements on a fainter galaxy sample are consistent with an unbiased model. We demonstrate that a linear bias model appears sufficient to explain the galaxy-mass bias of our samples, although a model using both linear and quadratic terms results in a better fit. In contrast, the bias values obtained from the linear model appear in better agreement with the data by inspection of the relative bias and yield implied values of {sigma}{sub 8} that are more consistent with current constraints. We investigate the covariance of the 3PCF, which itself is a measurement of galaxy clustering. We assess the accuracy of our error estimates by comparing results from mock galaxy catalogs to jackknife re-sampling methods. We identify significant differences in the structure of the covariance. However, the impact of these discrepancies appears to be mitigated by an eigenmode analysis that can account for the noisy, unresolved modes. Our joint analysis of both redshift space and projected measurements allows us to identify systematic effects affecting constraints from the 3PCF.

79 ASTRONOMY AND ASTROPHYSICS↗

Six Degree-of-Freedom Entry Dispersion Analysis for the METEOR Recovery Module

The present study performs a six degree-of-freedom entry dispersion analysis for the Multiple Experiment Transporter to Earth Orbit and Return (METEOR) mission. METEOR offered the capability of flying a recoverable science package in a microgravity environment. However, since the Recovery Module has no active control system, an accurate determination of the splashdown position is difficult because no opportunity exists to remove any errors. Hence, uncertainties in the initial conditions prior to deorbit burn initiation, during deorbit burn and exo-atmospheric coast phases, and during atmospheric flight impact the splashdown location. This investigation was undertaken to quantify the impact of the various exo-atmospheric and atmospheric uncertainties. Additionally, a Monte-Carlo analysis was performed to statistically assess the splashdown dispersion footprint caused by the multiple mission uncertainties. The Monte-Carlo analysis showed that a 3-sigma splashdown dispersion footprint with axes of 43.3 nm (long), -33.5 nm (short), and 10.0 nm (crossrange) can be constructed. A 58% probability exists that the Recovery Module will overshoot the nominal splashdown site.

Desai, Prasun N.↗

Early Battery Performance Prediction for Mixed Use Charging Profiles Using Hierarchal Machine Learning

A key step limiting how fast batteries can be deployed is the time necessary to provide evaluation and validation of performance. Using data analysis approaches, such as machine learning, the validation process can be accelerated. However, questions on the validity of projecting models trained on limited data or simple cycling profiles, such as constant current cycling, to real-world scenarios with complex loads remains. Here, we present the ability to predict performance with less than 1.2% mean absolute percent error when trained on cells aged using complex electric vehicle discharge profiles, and either AC Level 2 charge or DC Fast charge profiles, using only the first 45 cycles, namely 5% of the total testing time. While error is low across the projections, this study also highlights that battery lifetime analysis using only cycling data may not extrapolate safely to certain real-world conditions due to the impact of calendar degradation.

25 ENERGY STORAGE↗

Analysis of the impact of broad absorption lines on quasar redshift measurements with synthetic observations

ABSTRACT Accurate quasar classifications and redshift measurements are increasingly important to precision cosmology experiments. Broad absorption line (BAL) features are present in 15–20 per cent of all quasars, and these features can introduce systematic redshift errors, and in extreme cases produce misclassifications. We quantitatively investigate the impact of BAL features on quasar classifications and redshift measurements with synthetic spectra that were designed to match observations by the Dark Energy Spectroscopic Instrument (DESI) survey. Over the course of 5 yr, DESI aims to measure spectra for 40 million galaxies and quasars, including nearly three million quasars. Our synthetic quasar spectra match the signal-to-noise ratio and redshift distributions of the first year of DESI observations, and include the same synthetic quasar spectra both with and without BAL features. We demonstrate that masking the locations of the BAL features decreases the redshift errors by about 1 per cent and reduces the number of catastrophic redshift errors by about 80 per cent. We conclude that identifying and masking BAL troughs should be a standard part of the redshift determination step for DESI and other large-scale spectroscopic surveys of quasars.

(galaxies:) quasars: absorption↗

Bias-Variance Trade-Off in Physics-Informed Neural Networks with Randomized Smoothing for High-Dimensional PDEs

Physics-Informed Neural Networks (PINNs) have triggered a paradigm shift in scientific computing, leveraging mesh-free properties and robust approximation capabilities. While proving effective for low-dimensional partial differential equations (PDEs), the computational cost of PINNs remains a hurdle in high-dimensional scenarios. This is particularly pronounced when computing high-order and high-dimensional derivatives in the physics-informed loss. Randomized Smoothing PINN (RS-PINN) introduces Gaussian noise for stochastic smoothing of the original neural net model, enabling the use of Monte Carlo methods for derivative approximation, which eliminates the need for costly automatic differentiation. Despite its computational efficiency, especially in the approximation of high-dimensional derivatives, RS-PINN introduces biases in both loss and gradients, negatively impacting convergence, especially when coupled with stochastic gradient descent (SGD) algorithms. We present a comprehensive analysis of biases in RS-PINN, attributing them to the nonlinearity of the Mean Squared Error (MSE) loss as well as the intrinsic nonlinearity of the PDE itself. We propose tailored bias correction techniques, delineating their application based on the order of PDE nonlinearity. The derivation of an unbiased RS-PINN allows for a detailed examination of its advantages and disadvantages compared to the biased version. Specifically, the biased version has a lower variance and runs faster than the unbiased version, but it is less accurate due to the bias. To optimize the bias-variance trade-off, we combine the two approaches in a hybrid method that balances the rapid convergence of the biased version with the high accuracy of the unbiased version. In addition to methodological contributions, we present an enhanced implementation of RS-PINN. Extensive experiments on diverse high-dimensional PDEs, including Fokker-Planck, Hamilton-Jacobi-Bellman (HJB), viscous Burgers’, Allen-Cahn, and Sine-Gordon equations, illustrate the bias-variance trade-off and highlight the effectiveness of the hybrid RS-PINN. Empirical guidelines are provided for selecting biased, unbiased, or hybrid versions, depending on the dimensionality and nonlinearity of the specific PDE problem.

97 MATHEMATICS AND COMPUTING↗

Exploring Methods to Collect and Analyze Data on Human Contributions to Aviation Safety: A Panel Discussion

Focusing on undesired operator behaviors is pervasive in system design and safety management cultures in aviation. This focus limits the data that are collected, the questions that are asked during data analysis, and therefore our understanding of what operators do in everyday work. Human performance represents a significant source of aviation safety data that includes both desired and undesired actions. When safety is characterized only in terms of errors and failures, the vast majority of human impacts on system safety and performance are ignored. The outcomes of safety data analyses dictate what is learned from those data, which in turn informs safety policies and safety-related decision making. When learning opportunities are systematically restricted by focusing only on rare failure events, not only do we learn less (and less often), but we can draw misleading conclusions by relying on a non-representative sample of human performance data. Changes in how we define and think about safety can highlight new opportunities for collection and analysis of safety-relevant data. Developing an integrated safety picture to better inform safety-related decision making and policies depends upon identifying, collecting, and interpreting safety-producing behaviors in addition to safety-reducing behaviors. Opportunities and challenges in collecting and analyzing the largely unexploited data on desired, safety-producing operator behaviors are discussed.

Aviation Safety↗

Exploring Methods to Collect and Analyze Data on Human Contributions to Aviation Safety: A Panel Discussion

Focusing on undesired operator behaviors is pervasive in system design and safety management cultures in aviation. This focus limits the data that are collected, the questions that are asked during data analysis, and therefore our understanding of what operators do in everyday work. Human performance represents a significant source of aviation safety data that includes both desired and undesired actions. When safety is characterized only in terms of errors and failures, the vast majority of human impacts on system safety and performance are ignored. The outcomes of safety data analyses dictate what is learned from those data, which in turn informs safety policies and safety-related decision making. When learning opportunities are systematically restricted by focusing only on rare failure events, not only do we learn less (and less often), but we can draw misleading conclusions by relying on a non-representative sample of human performance data. Changes in how we define and think about safety can highlight new opportunities for collection and analysis of safety-relevant data. Developing an integrated safety picture to better inform safety-related decision making and policies depends upon identifying, collecting, and interpreting safety producing behaviors in addition to safety reducing behaviors. The panel will discuss opportunities and challenges in collecting and analyzing the largely unexploited data on desired, safety-producing operator behaviors.

aviation safety↗

EnKF OSSE Experiments Assessing the Impact of HIRAD Wind Speed and HIWRAP Radial Velocity Data on Analysis of Hurricane Karl (2010)

Previous studies (e.g., Zhang et al. 2009, Weng et al. 2011) have shown that radial velocity data from airborne and ground-based radars can be assimilated into ensemble Kalman filter (EnKF) systems to produce accurate analyses of tropical cyclone vortices, which can reduce forecast intensity error. Recently, wind speed data from SFMR technology has also been assimilated into the same types of systems and has been shown to improve the forecast intensity of mature tropical cyclones. Two instruments that measure these properties were present during the NASA Genesis and Rapid Intensification Processes (GRIP) field experiment in 2010 which sampled Hurricane Karl, and will next be co-located on the same aircraft for the subsequent NASA HS3 experiment. The High Altitude Wind and Rain Profiling Radar (HIWRAP) is a conically scanning Doppler radar mounted upon NASAs Global Hawk unmanned aerial vehicle, and the usefulness of its radial velocity data for assimilation has not been previously examined. Since the radar scans from above with a fairly large fixed elevation angle, it observes a large component of the vertical wind, which could degrade EnKF analyses compared to analyses with data taken from lesser elevation angles. The NASA Hurricane Imaging Radiometer (HIRAD) is a passive microwave radiometer similar to SFMR, and measures emissivity and retrieves hurricane surface wind speeds and rain rates over a much wider swath. Thus, this study examines the impact of assimilating simulated HIWRAP radial velocity data into an EnKF system, simulated HIRAD wind speed, and HIWRAP+HIRAD with the Weather Research and Forecasting (WRF) model and compares the results to no data assimilation and also to the Truth from which the data was simulated for both instruments.

Albers, Cerese↗

Identifying Human Factors Issues in Aircraft Maintenance Operations

Maintenance operations incidents submitted to the Aviation Safety Reporting System (ASRS) between 1986-1992 were systematically analyzed in order to identify issues relevant to human factors and crew coordination. This exploratory analysis involved 95 ASRS reports which represented a wide range of maintenance incidents. The reports were coded and analyzed according to the type of error (e.g, wrong part, procedural error, non-procedural error), contributing factors (e.g., individual, within-team, cross-team, procedure, tools), result of the error (e.g., aircraft damage or not) as well as the operational impact (e.g., aircraft flown to destination, air return, delay at gate). The main findings indicate that procedural errors were most common (48.4%) and that individual and team actions contributed to the errors in more than 50% of the cases. As for operational results, most errors were either corrected after landing at the destination (51.6%) or required the flight crew to stop enroute (29.5%). Interactions among these variables are also discussed. This analysis is a first step toward developing a taxonomy of crew coordination problems in maintenance. By understanding what variables are important and how they are interrelated, we may develop intervention strategies that are better tailored to the human factor issues involved.

Veinott, Elizabeth S.↗

Ice storage model-predictive control in an office building with PV: scenario, error and sensitivity analysis

Thermal energy storage (TES) can enable more building-sited renewable electricity generation and lower utility bill costs for buildings owners and occupants, especially when there are high demand and variable time-of-use (TOU) charges. A model predictive control (MPC) strategy can offer additional savings over a schedule-based control with added complexity and reliance on forecasts. Here, this study examines savings for medium office buildings with chiller plants in three locations with building-installed solar photovoltaics (PV) to understand the impact of MPC. Control setpoints are fixed by a schedule-based control or optimized by nonlinear MPC. These control setpoints are actuated within EnergyPlus building models to simulate the utility cost of the chiller plant. NLP solutions can be unstable or unrealistic, but our results show that by regularizing the NLP, the solutions can be reasonably followed by the building model. MPC models make simplifications that lead to errors once the controller is participating in and changing the operation of the building. These errors average 9 % across the cases, showing that the most important parts of the system are represented. The no-thermal load costs are computed to show that the optimization can in some cases achieve both the minimum TOU and minimum monthly demand costs by demand management while reducing TOU energy costs by energy arbitrage. The MPC saves 35–66 % in the annual chiller plant operating costs, which is an additional savings above the schedule by 1–33 %. PV and TES are complementary and mostly independent, but a load with PV often results in better performance for the schedule. Our case study and sensitivity analysis show the importance of modeling and optimization for complex rates, but also the circumstances wherein a simpler strategy achieves the same performance with less potential for error.

14 SOLAR ENERGY↗