Search NASA⌕ Search

SEARCH · Search NASA

Results for “error impact analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Measurement and correction of leaf open times in helical tomotherapy

Purpose: The binary multileaf collimator (MLC) is one of the most important components in helical tomotherapy (HT), as it modulates the dose delivered to the patient. However, methods to ensure MLC quality in HT treatments are lacking. The authors obtained data on the performance of the MLC in treatments administered in their department in order to assess possible delivery errors due to the MLC. Correction methods based on their data are proposed. Methods: Twenty sinograms from treatments delivered using both of the authors HT systems were measured and analyzed by recording the fluence collected by the imaging detector. Planned and actual sinograms were compared using distributions of leaf open time (LOT) errors, as well as differences in fluence reconstructed at each of the 51 projections into which the treatment planning system divides each rotation for optimization purposes. They proposed and applied a method based on individual leaf error correction and the increase in projection time to prevent latency effects when LOT is close to projection time. In order to analyze the dosimetric impact of the corrections, inphantom measurements were made for four corrected treatments. Results: The LOTs measured were consistent with those planned. Most of the mean errors in LOT distributions were within 1 ms with standard deviations of over 4 ms. Reconstructed fluences showed good results, with over 90% of points passing the 3% criterion, except in treatments with a short mean LOT, where the percentage of passing points was as low as 66%. Individual leaf errors were as long as 4 ms in some cases. Corrected sinograms improved error distribution, with standard deviations of over 3 ms and increased percentages of points passing 3% in the fluence per angle analysis, especially in treatments with a short mean LOT and those that were more subject to latency effects. The minimum percentage of points within 3% increased to 86%. In-phantom measurements of the corrected treatments showed that, while treatments affected by latency effects were improved, those affected by individual leaf errors were not. Conclusions: Measurement of MLC performance in real treatments provides the authors with a valuable tool for ensuring the quality of HT delivery. The LOTs of MLC are very accurate in most cases. Sources of error were found and correction methods proposed and applied. The corrections decreased the amount of LOT errors. The dosimetric impact of these corrections should be evaluated more thoroughly using 3D dose distribution analysis.

07 ISOTOPE AND RADIATION SOURCES↗

SU-E-T-334: Dosimetric Impacts of Organ at Risk (OAR) Contour Errors in Prostate Volumetric Modulated Arc Therapy (VMAT) Planning: A Sensitivity Study

Purpose: To investigate the dosimetric impacts of OAR contour errors in prostate VMAT planning with a sensitivity analysis method. Methods: Ten randomly selected prostate VMAT patients were used to simulate OAR contour error in rectum and bladder. For each OAR 12 even spaced contour control points were selected in every three slices. For each simulation, only one of the control points was simulated to move inwards or outwards by up to 6 voxels and coordinates of adjacent voxels to that moving control point were moved accordingly with a 3D-spline smooth function. An in-house software was used to predict OARs dosimetric endpoints based on geometric relationship between PTV and OAR. In this study, the V75, V70, V65, V60 of rectum and V80, V75, V70, V65 of bladder with and without perturbed contours were calculated and compared. Results: The percentage of OAR dose volume difference around the reference OAR contours were plotted as iso-error lines overlaid on CT images. The significant difference was shown in OAR contours adjacent to the PTV where high dose gradient exists. When one of the 12 points adjacent to the PTV moved up to 6 voxels, maximum errors of 1.99%, 2.46%, 2.89%, and 3.19% were found in V75, V70, V65, and V60 of the rectum, and 1.59%, 1.67%, 1.87%, and 1.90% were found in V80, V75, V70, and V65 of the bladder, respectively. Conclusion: We can quantify the dosimetric impact of OAR contouring error by evaluating the percentage of OAR dose volume changes in prostate VMAT planning. For the adaptive radiation therapy, the iso-error lines can provide the planner a guideline that which portion of contour needed to be checked carefully because dosimetric sensitivity of contour errors are different for different part of contours.

60 APPLIED LIFE SCIENCES↗

Spurious Shear in Weak Lensing with LSST

The complete 10-year survey from the Large Synoptic Survey Telescope (LSST) will image {approx} 20,000 square degrees of sky in six filter bands every few nights, bringing the final survey depth to r {approx} 27.5, with over 4 billion well measured galaxies. To take full advantage of this unprecedented statistical power, the systematic errors associated with weak lensing measurements need to be controlled to a level similar to the statistical errors. This work is the first attempt to quantitatively estimate the absolute level and statistical properties of the systematic errors on weak lensing shear measurements due to the most important physical effects in the LSST system via high fidelity ray-tracing simulations. We identify and isolate the different sources of algorithm-independent, additive systematic errors on shear measurements for LSST and predict their impact on the final cosmic shear measurements using conventional weak lensing analysis techniques. We find that the main source of the errors comes from an inability to adequately characterise the atmospheric point spread function (PSF) due to its high frequency spatial variation on angular scales smaller than {approx} 10{prime} in the single short exposures, which propagates into a spurious shear correlation function at the 10{sup -4}-10{sup -3} level on these scales. With the large multi-epoch dataset that will be acquired by LSST, the stochastic errors average out, bringing the final spurious shear correlation function to a level very close to the statistical errors. Our results imply that the cosmological constraints from LSST will not be severely limited by these algorithm-independent, additive systematic effects.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

TU-C-BRE-05: Clinical Implications of AAA Commissioning Errors and Ability of Common Commissioning ' Credentialing Procedures to Detect Them

Purpose: To test the ability of the TG-119 commissioning process and RPC credentialing to detect errors in the commissioning process for a commercial Treatment Planning System (TPS). Methods: We introduced commissioning errors into the commissioning process for the Anisotropic Analytical Algorithm (AAA) within the Eclipse TPS. We included errors in Dosimetric Leaf Gap (DLG), electron contamination, flattening filter material, and beam profile measurement with an inappropriately large farmer chamber (simulated using sliding window smoothing of profiles). We then evaluated the clinical impact of these errors on clinical intensity modulated radiation therapy (IMRT) plans (head and neck, low and intermediate risk prostate, mesothelioma, and scalp) by looking at PTV D99, and mean and max OAR dose. Finally, for errors with substantial clinical impact we determined sensitivity of the RPC IMRT film analysis at the midpoint between PTV and OAR using a 4mm distance to agreement metric, and of a 7% TLD dose comparison. We also determined sensitivity of the 3 dose planes of the TG-119 C-shape IMRT phantom using gamma criteria of 3% 3mm. Results: The largest clinical impact came from large changes in the DLG with a change of 1mm resulting in up to a 5% change in the primary PTV D99. This resulted in a discrepancy in the RPC TLDs in the PTVs and OARs of 7.1% and 13.6% respectively, which would have resulted in detection. While use of incorrect flattening filter caused only subtle errors (<1%) in clinical plans, the effect was most pronounced for the RPC TLDs in the OARs (>6%). Conclusion: The AAA commissioning process within the Eclipse TPS is surprisingly robust to user error. When errors do occur, the RPC and TG-119 commissioning credentialing criteria are effective at detecting them; however OAR TLDs are the most sensitive despite the RPC currently excluding them from analysis.

60 APPLIED LIFE SCIENCES↗

High Temperature Additive Architectures for 65% Efficiency (Final Technical Report)

This project aimed to develop advanced high-temperature additive components that contribute towards the DOE’s goal for advanced gas turbines that are capable of at least 65% efficiency in combined cycle application. The objective was to leverage state-of-the-art additive manufacturing to develop an innovative stage 1 turbine nozzle (S1N) that can provide cooling flow savings while maintaining the component durability expected in today’s gas turbines. The program had two phases. Phase I was a conceptual phase for novel advanced cooling designs enabled by additive manufacturing, as well as proposals for validation. Phase II included execution of the Phase I conceptual design, including manufacturing of prototype hardware and validation within an environment that is similar to engine operation. During Phase I of the program, the team devised a concept to reduce cooling air usage. The cooling air used in the side walls is filmed out along the side walls, while the cooling air used in the airfoil is eventually directed to near-wall channels and exits holes along the airfoil trailing end. During this program, the team performed additive trials to analyze the geometric limitations of additive manufacturing. This helped the team understand minimum wall thicknesses, hole sizes, and cooling channel dimensions among other limits. Phase II of this program pushed GE Vernova beyond its previous experience of designing and manufacturing an additively manufactured hot gas path component. Modern hot gas path components utilize material chemistries that are traditionally hard to weld, such as cast Renè 108, and exhibit solidification cracking when additively manufactured using Direct Metal Laser Melting (DMLM). Note that AM108 is a powder form of Renè 108. A S1N with advanced cooling is larger and more complex than parts previously built by additive manufacturing and required new learnings to resolve risks around solidification cracking. Finally, the team validated the design in a combustion rig that replicated operation in a gas turbine. In order to properly quantify the benefits of the new additive design, a baseline was also tested in the rig and operated under the same conditions. In addition, an uncertainty analysis was done to quantify any sources of error that could impact the results. At the end of the validation effort, it was determined that the additive nozzle exceeded the 15% reduction in cooling flow goal even with the worst-case assumptions for uncertainty.

03 NATURAL GAS↗

Orbit Determination Support for the Microwave Anisotropy Probe (MAP)

NASA's Microwave Anisotropy Probe (MAP) was launched from the Cape Canaveral Air Force Station Complex 17 aboard a Delta II 7425-10 expendable launch vehicle on June 30, 2001. The spacecraft received a nominal direct insertion by the Delta expendable launch vehicle into a 185-km circular orbit with a 28.7deg inclination. MAP was then maneuvered into a sequence of phasing loops designed to set up a lunar swingby (gravity-assisted acceleration) of the spacecraft onto a transfer trajectory to a lissajous orbit about the Earth-Sun L2 Lagrange point, about 1.5 million km from Earth. Because of its complex orbital characteristics, the mission provided a unique challenge for orbit determination (OD) support in many orbital regimes. This paper summarizes the premission trajectory covariance error analysis, as well as actual OD results. The use and impact of the various tracking stations, systems, and measurements will be also discussed. Important lessons learned from the MAP OD support team will be presented. There will be a discussion of the challenges presented to OD support including the effects of delta-Vs at apogee as well as perigee, and the impact of the spacecraft attitude mode on the OD accuracy and covariance analysis.

Bauer, Frank↗

Estimation of Model Error Variances During Data Assimilation

Data assimilation is all about understanding the error characteristics of the data and models that are used in the assimilation process. Reliable error estimates are needed to implement observational quality control, bias correction of observations and model fields, and intelligent data selection. Meaningful covariance specifications are obviously required for the analysis as well, since the impact of any single observation strongly depends on the assumed structure of the background errors. Operational atmospheric data assimilation systems still rely primarily on climatological background error covariances. To obtain error estimates that reflect both the character of the flow and the current state of the observing system, it is necessary to solve three problems: (1) how to account for the short-term evolution of errors in the initial conditions; (2) how to estimate the additional component of error caused by model defects; and (3) how to compute the error reduction in the analysis due to observational information. Various approaches are now available that provide approximate solutions to the first and third of these problems. However, the useful accuracy of these solutions very much depends on the size and character of the model errors and the ability to account for them. Model errors represent the real-world forcing of the error evolution in a data assimilation system. Clearly, meaningful model error estimates and/or statistics must be based on information external to the model itself. The most obvious information source is observational, and since the volume of available geophysical data is growing rapidly, there is some hope that a purely statistical approach to model error estimation can be viable. This requires that the observation errors themselves are well understood and quantifiable. We will discuss some of these challenges and present a new sequential scheme for estimating model error variances from observations in the context of an atmospheric data assimilation system.

Dee, Dick↗

Adjoint Estimation of Observation Impact Explored with an Observing System Simulation Experiment

In an Observing System Simulation Experiment, the full, true state of the simulated atmosphere is known. This knowledge allows the direct calculation of analysis and forecast errors, and also may be used in conjunction with an adjoint tool to calculate metrics that are unachievable in the real world. For example, the errors that result from the use of the analysis state as verification when running adjoint calculations of observation impact on a forecast can be quantified. The adjoint itself can also be used to operate on the analysis state rather than on the forecast state. Results from these and other adjoint experiments using the NASA/GMAO OSSE framework will be presented.

Prive, Nikki↗

Monte Carlo analysis of satellite debris footprint dispersion

A comprehensive study is performed to investigate satellite debris impact point dispersion using a combination of Monte Carlo statistical analysis and parametric methods. The Monte Carlo technique accounts for nonlinearities in the entry point dispersion, which is represented by a covariance matrix of position and velocity errors. Because downrange distance of impact is a monotonic function of debris ballistic coefficient, a parametric method is useful for determining dispersion boundaries. The scheme is applied in the present analysis to estimate the Skylab footprint dispersions for a controlled reentry. A significant increase in the footprint dispersion is noticed for satellite breakup above a 200,000-ft altitude. A general discussion of the method used for analysis is presented together with some typical results obtained for the Skylab deboost mission, which was designed before NASA abandoned plans for a Skylab controlled reentry.

Rao, P. P.↗

Effective structural impact detection and localization using convolutional neural network and Bayesian information fusion with limited sensors

Due to their unpredictable nature, many impact events (e.g., overheight vehicles striking on bridges) go unnoticed or get reported many hours later. However, they can induce structural failures or hidden damage that accelerates the structure’s long-term degradation. Therefore, prompt impact detection and localization strategies are essential for early warning of impact events and rapid maintenance of structures. Most existing impact detection strategies are developed for aircraft composite panels utilizing high-rate synchronized measurement from densely deployed sensors. Limited efforts have been made for infrastructure or human habitats which generally require large-scale but low-rate measurement. In particular, due to harsh environments (e.g., deep space habitats under meteoroids), structural impact localization must be robust to limited sensors (e.g., sensor damage during impacts) and multi-source errors (e.g., measurement errors). In this study, an effective impact detection and localization strategy is proposed using a limited number of vibration measurements, especially in harsh environments (e.g. in deep space). Convolutional neural networks are trained for each sensor node and are fused using Bayesian theory to improve the accuracy of impact localization. Special considerations are paid to evaluate the effect of both measurement error and modeling error in the analysis. The proposed strategy is illustrated using 1D structure, and further validated in 3D geodesic dome structure numerically. The results demonstrate that it can detect and localize impact events accurately and robustly on structures.

Yuguang Fu↗

A Systematic Approach to Isolating the Causes and Impacts of Climate Model Bias Employing Analysis Increments

One of the most promising approaches to isolating the causes and understanding the impacts of climate model formulation errors is through the utilization of information contained in short-term forecast errors. The underlying assumption being that by capturing the errors at the very early stages of growth (before nonlinearities develop), we should be able to associate those errors with specific deficiencies in the model's formulation of the relevant physical processes. Here, we provide an example of utilizing the long-term mean of the 6-hourly analysis increments (first guess forecast minus analysis) produced by MERRA-2 to correct the NASA/GEOS AGCM over well-defined regions, thereby allowing us to quantify how the reduced tendency errors in these regions manifest themselves both locally and remotely through large-scale teleconnections to reduce the model's climatological biases. We extend previous work (focused on boreal summer) to address the full annual cycle of model bias. A key result is the large seasonality of the errors over the Tibet region and their impacts on the Northern Hemisphere jet biases, and related precipitation and temperature biases over North American. Attempts to correct the phase and amplitude errors of the climatological boreal winter ridge over western North America (a likely key requirement for improving winter climate forecasts over North America) reveal a surprising complexity in the sources of the errors in what is otherwise manifest as a rather simple PNA-like bias structure.

Schubert, S.↗

A general framework for removing point-spread function additive systematics in cosmological weak lensing analysis

ABSTRACT Cosmological weak lensing measurements rely on a precise measurement of the shear two-point correlation function (2PCF) along with a deep understanding of systematics that affect it. In this work, we demonstrate a general framework for detecting and modelling the impact of PSF systematics on the cosmic shear 2PCF and mitigating its impact on cosmological analysis. Our framework can detect PSF leakage and modelling error from all spin-2 quantities contributed by the PSF second and higher moments, rather than just the second moments, using the cross-correlations between galaxy shapes and PSF moments. We interpret null tests using the HSC Year 3 (Y3) catalogs with this formalism and find that leakage from the spin-2 combination of PSF fourth moments is the leading contributor to additive shear systematics, with total contamination that is an order-of-magnitude higher than that contributed by PSF second moments alone. We conducted a mock cosmic shear analysis for HSC Y3 and find that, if uncorrected, PSF systematics can bias the cosmological parameters Ωm and S8 by ∼0.3σ. The traditional second moment-based model can only correct for a 0.1σ bias, leaving the contamination largely uncorrected. We conclude it is necessary to model both PSF second and fourth moment contaminations for HSC Y3 cosmic shear analysis. We also reanalyse the HSC Y1 cosmic shear analysis with our updated systematics model and identify a 0.07σ bias on Ωm when using the more restricted second moment model from the original analysis. We demonstrate how to self-consistently use the method in both real space and Fourier space, assess shear systematics in tomographic bins, and test for PSF model overfitting.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Thermal-mechanical behavior of high precision composite mirrors

Composite mirror panels were designed, constructed, analyzed, and tested in the framework of a NASA precision segmented reflector task. The deformations of the reflector surface during the exposure to space enviroments were predicted using a finite element model. The composite mirror panels have graphite-epoxy or graphite-cyanate facesheets, separated by an aluminum or a composite honeycomb core. It is pointed out that in order to carry out detailed modeling of composite mirrors with high accuracy, it is necessary to have temperature dependent properties of the materials involved and the type and magnitude of manufacturing errors and material nonuniformities. The structural modeling and analysis efforts addressed the impact of key design and materials parameters on the performance of mirrors.

Kuo, C. P.↗

Flight Path Control Error Analysis for the Helioswarm Observatory

The HelioSwarm Observatory requires specific geometries be formed by the nine satellites in the swarm to resolve different scales of solar wind turbulence. Maneuver execution and state estimation drive flight path control errors that could disrupt the swarm geometry. Using a Monte-Carlo analysis, flight path control errors for dispersed trajectories were generated and the impact to science performance and other mission constraints evaluated. The results highlight the unique aspects of swarm-type multi-satellite missions in terms of maneuver planning and error tolerance.

Stephen West↗

Flight Path Control Error Analysis for the Helioswarm Observatory

The HelioSwarm Observatory requires specific geometries be formed by the nine satellites in the swarm to resolve different scales of solar wind turbulence. Maneuver execution and state estimation drive flight path control errors that could disrupt the swarm geometry. Using a Monte-Carlo analysis, flight path control errors for dispersed trajectories were generated and the impact to science performance and other mission constraints evaluated. The results highlight the unique aspects of swarm-type multi-satellite missions in terms of maneuver planning and error tolerance.

Swarm↗

A Study of the Trade-off Between Reducing Precision and Reducing Resolution for Data Analysis and Visualization

There presently exist two dominant strategies to reduce data sizes in analysis and visualization: reducing the precision of the data, e.g., through quantization, or reducing its resolution, e.g., by subsampling. Both have advantages and disadvantages and both face fundamental limits at which the reduced information ceases to be useful. The paper explores the additional gains that could be achieved by combining both strategies. In particular, we present a common framework that allows us to study the trade-off in reducing precision and/or resolution in a principled manner. We represent data reduction schemes as progressive streams of bits and study how various bit orderings such as by resolution, by precision, etc., impact the resulting approximation error across a variety of data sets as well as analysis tasks. Additionally, we compute streams that are optimized for different tasks to serve as lower bounds on the achievable error. Scientific data management systems can use the results proposed in this paper as guidance on how to store and stream data to make efficient use of the limited storage and bandwidth in practice.

97 MATHEMATICS AND COMPUTING↗

Understanding and Estimating Error Propagation in Neural Networks for Scientific Data Analysis

Neural networks are increasingly integrated into scientific discovery, where input data reduction and model quantization play a key role in accelerating inference. However, understanding and mitigating the impact of these techniques on output error is critical for ensuring reliable results, particularly in tasks demanding high numerical precision. This paper introduces a comprehensive framework for optimizing neural network inference in scientific computing by combining data reduction and weight quantization while maintaining error-controlled outcomes. We develop theoretical analyses to bound error propagation under these reductions and propose a framework that balances computational performance with error constraints. Evaluation on real-world learning-based combustion simulations and satellite image classification demonstrates that our derived error bounds accurately predict observed errors while enabling significant computational speedup under our framework. This work highlights the potential for further leveraging advancements in modern lossy compression algorithms and hardware accelerators that support lower-precision formats.

He, Weiming [New Jersey Institute of Technology]↗

Improving Reanalyses Using TRMM and SSM/I-Derived Precipitation and Total Precipitable Water Observations

Global reanalyses currently contain significant errors in the primary fields of the hydrological cycle such as precipitation, evaporation, moisture, and the related cloud fields, especially in the tropics. The Data Assimilation Office (DAO) at the NASA Goddard Space Flight Center has been exploring the use of rainfall and total precipitable water (TPW) observations from the Tropical Rainfall Measuring Mission (TRMM) Microwave Imager (TMI) and the Special Sensor Microwave/ Imager (SSM/I) instruments to improve these fields in reanalyses. The DAO has developed a "1+1"D procedure to assimilate 6-hr averaged rainfall and TPW into the Goddard Earth Observing System (GEOS) Data Assimilation System (DAS). The algorithm is based on a 6-hr time integration of a column version of the GEOS DAS. The "1+1" designation refers to one spatial dimension plus one temporal dimension. The scheme minimizes the least-square differences between the satellite-retrieved rain rates and those produced by the column model over the 6-hr analysis window. The control variables are analysis increments of moisture within the Incremental Analysis Update (IAU) framework of the GEOS DAS. This 1+1D scheme, in its generalization to four dimensions, is related to the standard 4D variational assimilation but differs in its choice of the control variable. Instead of estimating the initial condition at the beginning of the assimilation cycle, it estimates the constant IAU forcing applied over a 6-hr assimilation cycle. In doing so, it imposes the forecast model as a weak constraint in a manner similar to the variational continuous assimilation techniques. We present results from an experiment in which the observed rain rate and TPW are assumed to be "perfect". They show that assimilating the TMI and SSM/I-derived surface precipitation and TPW observations improves not only the precipitation and moisture fields but also key climate parameters directly linked to convective activities such as clouds, the outgoing longwave radiation, and the large-scale circulation in the tropics. In particular, assimilating these data types reduce the state-dependent systematic errors in the assimilated products. The improved analysis also leads to a better short-range forecast, but the impact is modest compared with improvements in the time-averaged fields. These results suggest that, in the presence of biases and other errors of the forecast model, it is possible to improve the time-averaged "climate content" in the assimilated data without comparable improvements in the short-range forecast skill. Results of this experiment provide a useful benchmark for evaluating error covariance models for optimal use of these data types.

Hou, Arthur Y.↗