Search NASA⌕ Search

SEARCH · Search NASA

Results for “Smoothing methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33

A high-order gas-kinetic Navier-Stokes flow solver

The foundation for the development of modern compressible flow solver is based on the Riemann solution of the inviscid Euler equations. The high-order schemes are basically related to high-order spatial interpolation or reconstruction. In order to overcome the low-order wave interaction mechanism due to the Riemann solution, the temporal accuracy of the scheme can be improved through the Runge-Kutta method, where the dynamic deficiencies in the first-order Riemann solution is alleviated through the sub-step spatial reconstruction in the Runge-Kutta process. The close coupling between the spatial and temporal evolution in the original nonlinear governing equations seems weakened due to its spatial and temporal decoupling. Many recently developed high-order methods require a Navier-Stokes flux function under piece-wise discontinuous high-order initial reconstruction. However, the piece-wise discontinuous initial data and the hyperbolic-parabolic nature of the Navier-Stokes equations seem inconsistent mathematically, such as the divergence of the viscous and heat conducting terms due to initial discontinuity. In this paper, based on the Boltzmann equation, we are going to present a time-dependent flux function from a high-order discontinuous reconstruction. The theoretical basis for such an approach is due to the fact that the Boltzmann equation has no specific requirement on the smoothness of the initial data and the kinetic equation has the mechanism to construct a dissipative wave structure starting from an initially discontinuous flow condition on a time scale being larger than the particle collision time. The current high-order flux evaluation method is an extension of the second-order gas-kinetic BGK scheme for the Navier-Stokes equations (BGK-NS). The novelty for the easy extension from a second-order to a higher order is due to the simple particle transport and collision mechanism on the microscopic level. This paper will present a hierarchy to construct such a high-order method. The necessity to couple spatial and temporal evolution nonlinearly in the flux evaluation can be clearly observed through the numerical performance of the scheme for the viscous flow computations.

97 MATHEMATICS AND COMPUTING↗

Generic Sensor Modeling Using Pulse Method

Recent development of high spatial resolution satellites such as IKONOS, Quickbird and Orbview enable observation of the Earth's surface with sub-meter resolution. Compared to the 30 meter resolution of Landsat 5 TM, the amount of information in the output image was dramatically increased. In this era of high spatial resolution, the estimation of spatial quality of images is gaining attention. Historically, the Modulation Transfer Function (MTF) concept has been used to estimate an imaging system's spatial quality. Sometimes classified by target shapes, various methods were developed in laboratory environment utilizing sinusoidal inputs, periodic bar patterns and narrow slits. On-orbit sensor MTF estimation was performed on 30-meter GSD Landsat4 Thematic Mapper (TM) data from the bridge pulse target as a pulse input . Because of a high resolution sensor s small Ground Sampling Distance (GSD), reasonably sized man-made edge, pulse, and impulse targets can be deployed on a uniform grassy area with accurate control of ground targets using tarps and convex mirrors. All the previous work cited calculated MTF without testing the MTF estimator's performance. In previous report, a numerical generic sensor model had been developed to simulate and improve the performance of on-orbit MTF estimating techniques. Results from the previous sensor modeling report that have been incorporated into standard MTF estimation work include Fermi edge detection and the newly developed 4th order modified Savitzky-Golay (MSG) interpolation technique. Noise sensitivity had been studied by performing simulations on known noise sources and a sensor model. Extensive investigation was done to characterize multi-resolution ground noise. Finally, angle simulation was tested by using synthetic pulse targets with angles from 2 to 15 degrees, several brightness levels, and different noise levels from both ground targets and imaging system. As a continuing research activity using the developed sensor model, this report was dedicated to MTF estimation via pulse input method characterization using the Fermi edge detection and 4th order MSG interpolation method. The relationship between pulse width and MTF value at Nyquist was studied including error detection and correction schemes. Pulse target angle sensitivity was studied by using synthetic targets angled from 2 to 12 degrees. In this report, from the ground and system noise simulation, a minimum SNR value was suggested for a stable MTF value at Nyquist for the pulse method. Target width error detection and adjustment technique based on a smooth transition of MTF profile is presented, which is specifically applicable only to the pulse method with 3 pixel wide targets.

Helder, Dennis L.↗

IGA-MPM: The Isogeometric Material Point Method

In this work, we propose the use of Isogeometric Analysis (IGA) within the context of the Material Point Method (MPM), and refer to the approach as IGA-MPM. We use the idea of IGA, and its instantiation based on Non-Uniform Rational B-Splines (NURBS), to build higher-order accurate and smooth approximation for MPM. Higher-order smoothness yields a continuous representation of the strain rate, and, as a result, prevents jumps in the stress and other history variables as the material points cross the element boundaries. Furthermore, NURBS can exactly represent all conic sections and the corresponding symmetries in the solution, which may be important in some applications. Several numerical examples of increasing complexity are presented, and show the ability of IGA-MPM to eliminate the well known cell-crossing instability of the conventional MPM. In addition, the examples presented demonstrate improved accuracy, convergence, and symmetry preservation of IGA-MPM compared to the conventional MPM, both for rectilinear and curved geometries.

42 ENGINEERING↗

Nanostructural engineering of nitride nucleation layers for GaN substrate dislocation reduction.

With no lattice matched substrate available, sapphire continues as the substrate of choice for GaN growth, because of its reasonable cost and the extensive prior experience using it as a substrate for GaN. Surprisingly, the high dislocation density does not appear to limit UV and blue LED light intensity. However, dislocations may limit green LED light intensity and LED lifetime, especially as LEDs are pushed to higher current density for high end solid state lighting sources. To improve the performance for these higher current density LEDs, simple growth-enabled reductions in dislocation density would be highly prized. GaN nucleation layers (NLs) are not commonly thought of as an application of nano-structural engineering; yet, these layers evolve during the growth process to produce self-assembled, nanometer-scale structures. Continued growth on these nuclei ultimately leads to a fully coalesced film, and we show in this research program that their initial density is correlated to the GaN dislocation density. In this 18 month program, we developed MOCVD growth methods to reduce GaN dislocation densities on sapphire from 5 x 10{sup 8} cm{sup -2} using our standard delay recovery growth technique to 1 x 10{sup 8} cm{sup -2} using an ultra-low nucleation density technique. For this research, we firmly established a correlation between the GaN nucleation thickness, the resulting nucleation density after annealing, and dislocation density of full GaN films grown on these nucleation layers. We developed methods to reduce the nuclei density while still maintaining the ability to fully coalesce the GaN films. Ways were sought to improve the GaN nuclei orientation by improving the sapphire surface smoothness by annealing prior to the NL growth. Methods to eliminate the formation of additional nuclei once the majority of GaN nuclei were developed using a silicon nitride treatment prior to the deposition of the nucleation layer. Nucleation layer thickness was determined using optical reflectance and the nucleation density was determined using atomic force microscopy (AFM) and Nomarski microscopy. Dislocation density was measured using X-ray diffraction and AFM after coating the surface with silicon nitride to delineate all dislocation types. The program milestone of producing GaN films with dislocation densities of 1 x 10{sup 8} cm{sup -2} was met by silicon nitride treatment of annealed sapphire followed by the multiple deposition of a low density of GaN nuclei followed by high temperature GaN growth. Details of this growth process and the underlying science are presented in this final report along with problems encountered in this research and recommendations for future work.

36 MATERIALS SCIENCE↗

Adjoint Formulation for an Embedded-Boundary Cartesian Method

Many problems in aerodynamic design can be characterized by smooth and convex objective functions. This motivates the use of gradient-based algorithms, particularly for problems with a large number of design variables, to efficiently determine optimal shapes and configurations that maximize aerodynamic performance. Accurate and efficient computation of the gradient, however, remains a challenging task. In optimization problems where the number of design variables dominates the number of objectives and flow- dependent constraints, the cost of gradient computations can be significantly reduced by the use of the adjoint method. The problem of aerodynamic optimization using the adjoint method has been analyzed and validated for both structured and unstructured grids. The method has been applied to design problems governed by the potential, Euler, and Navier-Stokes equations and can be subdivided into the continuous and discrete formulations. Giles and Pierce provide a detailed review of both approaches. Most implementations rely on grid-perturbation or mapping procedures during the gradient computation that explicitly couple changes in the surface shape to the volume grid. The solution of the adjoint equation is usually accomplished using the same scheme that solves the governing flow equations. Examples of such code reuse include multistage Runge-Kutta schemes coupled with multigrid, approximate-factorization, line-implicit Gauss-Seidel, and also preconditioned GMRES. The development of the adjoint method for aerodynamic optimization problems on Cartesian grids has been limited. In contrast to implementations on structured and unstructured grids, Cartesian grid methods decouple the surface discretization from the volume grid. This feature makes Cartesian methods well suited for the automated analysis of complex geometry problems, and consequently a promising approach to aerodynamic optimization. Melvin e t al. developed an adjoint formulation for the TRANAIR code, which is based on the full-potential equation with viscous corrections. More recently, Dadone and Grossman presented an adjoint formulation for the Euler equations. In both approaches, a boundary condition is introduced to approximate the effects of the evolving surface shape that results in accurate gradient computation.

Nemec, Marian↗

Microwave plasma enhanced chemical vapor deposition of nanocrystalline diamond films by bias-enhanced nucleation and bias-enhanced growth

Effects of biasing voltage-current relationship on microwave plasma enhanced chemical vapor deposition of ultrananocrystalline diamond (UNCD) films on (100) silicon in hydrogen diluted methane by bias-enhanced nucleation and bias-enhanced growth processes are reported. Three biasing methods are applied to study their effects on nucleation, growth, and microstructures of deposited UNCD films. Method A employs 320 mA constant biasing current and a negative biasing voltage decreasing from −490 V to −375 V for silicon substrates pre-heated to 800 °C. Method B employs 400 mA constant biasing current and a decreasing negative biasing voltage from −375 V to −390 V for silicon pre-heated to 900 °C. Method C employs −350 V constant biasing voltage and an increasing biasing current up to 400 mA for silicon pre-heated to 800 °C. UNCD nanopillars, merged clusters, and dense films with smooth surface morphology are deposited by the biasing methods A, B, and C, respectively. Effects of ion energy and flux controlled by the biasing voltage and current, respectively, on nucleation, growth, microstructures, surface morphologies, and UNCD contents are confirmed by scanning electron microscopy, high-resolution transmission-electron-microscopy, and UV Raman scattering.

36 MATERIALS SCIENCE↗

Multiscale embedded printing of engineered human tissue and organ equivalents

Creating tissue and organ equivalents with intricate architectures and multiscale functional feature sizes is the first step toward the reconstruction of transplantable human tissues and organs. Existing embedded ink writing approaches are limited by achievable feature sizes ranging from hundreds of microns to tens of millimeters, which hinders their ability to accurately duplicate structures found in various human tissues and organs. In this study, a multiscale embedded printing (MSEP) strategy is developed, in which a stimuli-responsive yield-stress fluid is applied to facilitate the printing process. A dynamic layer height control method is developed to print the cornea with a smooth surface on the order of microns, which can effectively overcome the layered morphology in conventional extrusion-based three-dimensional bioprinting methods. Since the support bath is sensitive to temperature change, it can be easily removed after printing by tuning the ambient temperature, which facilitates the fabrication of human eyeballs with optic nerves and aortic heart valves with overhanging leaflets on the order of a few millimeters. The thermosensitivity of the support bath also enables the reconstruction of the full-scale human heart on the order of tens of centimeters by on-demand adding support bath materials during printing. Here, the proposed MSEP demonstrates broader printable functional feature sizes ranging from microns to centimeters, providing a viable and reliable technical solution for tissue and organ printing in the future.

3D bioprinting↗

A brief description of a new numerical framework for solving conservation laws: The method of space-time conservation element and solution element

A new numerical method for solving conservation laws is being developed. It differs substantially from the well established methods, i.e., finite difference, finite volume, finite element, and spectral methods, in both concept and methodology. It is much simpler than a typical high resolution method. No flux limiter or any technique related to characteristics is involved. No artificial viscosity or smoothing is introduced, and no moving mesh is used. Yet this method is capable of generating highly accurate shock tube solutions. The slight numerical overshoot and/or oscillations generated can be removed if a simple averaging formula initially used is replaced by a weighted formula. This modification has little effect on other parts of the solution. Because of its simplicity, generalization of this new method for multi-dimensional problems is straightforward.

Chang, Sin-Chung↗

Estimators and Fusers for Fiber Delay Estimation Using Environmental Measurements

The properties of deployed network fiber are affected by environmental factors due to their exposure to the elements. Particularly for quantum networks, the resultant delay variations may have significant impacts due to the extreme sensitivity of synchronization, coincidence counting, and other critical operations. In this paper, the delays of 15 km aerial-inground fiber connections are measured, and effects due to temperature, humidity and wind speed are analyzed over multiple periods spanning four seasons of a year. Machine learning methods are first utilized to reveal surprisingly pronounced effects of humidity on the delay, in addition to the expected temperature and its seasonal variations. Estimator and fusion methods are developed to estimate the delay using temperature, humidity and wind speed measurements, by utilizing smooth Gaussian Process Regression (GPR) and nonsmooth Ensemble of Trees (EOT) methods. Measurements from winter and summer periods are temporally fused using twelve different methods, and eight methods provide estimates for the delay throughout the year with median test errors under 1.28%. The results reveal distinct temperature-humidity trends across the seasons, and the ability of estimator and temporal fusion methods to exploit them for estimating the delay. These results constitute a case study of machine learning analytical results, wherein generalization equations explain the performance of various estimator and fuser methods.

Rao, Nageswara [ORNL] (ORCID:0000000234085941)↗

Determination of free energy profiles by repository based adaptive umbrella sampling: Bridging nonequilibrium and quasiequilibrium simulations

We propose a new adaptive sampling approach to determine free energy profiles with molecular dynamics simulations, which is called as 'repository based adaptive umbrella sampling' (RBAUS). Its main idea is that a sampling repository is continuously updated based on the latest simulation data, and the accumulated knowledge and sampling history are then employed to determine whether and how to update the biasing umbrella potential for subsequent simulations. In comparison with other adaptive methods, a unique and attractive feature of the RBAUS approach is that the frequency for updating the biasing potential depends on the sampling history and is adaptively determined on the fly, which makes it possible to smoothly bridge nonequilibrium and quasiequilibrium simulations. The RBAUS method is first tested by simulations on two simple systems: a double well model system with a variety of barriers and the dissociation of a NaCl molecule in water. Its efficiency and applicability are further illustrated in ab initio quantum mechanics/molecular mechanics molecular dynamics simulations of a methyl-transfer reaction in aqueous solution.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Minimal multi-element stochastic collocation for uncertainty quantification of discontinuous functions

We propose a multi-element stochastic collocation method that can be applied in high-dimensional parameter space for functions with discontinuities lying along manifolds of general geometries. The key feature of the method is that the parameter space is decomposed into multiple elements defined by the discontinuities and thus only the minimal number of elements are utilized. On each of the resulting elements the function is smooth and can be approximated using high-order methods with fast convergence properties. The decomposition strategy is in direct contrast to the traditional multi-element approaches which define the sub-domains by repeated splitting of the axes in the parameter space. Such methods are more prone to the curse-of-dimensionality because of the fast growth of the number of elements caused by the axis based splitting. The present method is a two-step approach. Firstly a discontinuity detector is used to partition parameter space into disjoint elements in each of which the function is smooth. The detector uses an efficient combination of the high-order polynomial annihilation technique along with adaptive sparse grids, and this allows resolution of general discontinuities with a smaller number of points when the discontinuity manifold is low-dimensional. After partitioning, an adaptive technique based on the least orthogonal interpolant is used to construct a generalized Polynomial Chaos surrogate on each element. The adaptive technique reuses all information from the partitioning and is variance-suppressing. We present numerous numerical examples that illustrate the accuracy, efficiency, and generality of the method. When compared against standard locally-adaptive sparse grid methods, the present method uses many fewer number of collocation samples and is more accurate.

97 MATHEMATICS AND COMPUTING↗

Enhanced Tensor Completion Based Approaches for State Estimation in Distribution Systems

Grid state estimation is essential for effective control and management of distribution systems. While weighted least squares has been the conventional method for state estimation, sparsity-aware methods have become popular due to their superior performance with limited data. Matrix completion and compressed sensing-based state estimation approaches exploit the underlying smoothness in the state variables. However, classic matrix completion methods do not take into account the temporal correlation of system states. Compressed sensing methods, on the other hand, require an appropriate choice of sparsifying basis that may not be easy to identify. This paper proposes a blocktensor completion based framework which uses an alternative approach to estimate voltage phasor, power injections and branch currents. This approach utilizes the temporal correlation of the system states in a tensor trace-norm minimization formulation with power flow equations as constraints. Herein, feature scaling is introduced in the problem formulation to benefit from the improved sensitivity of the tensor trace norm to the matrix columns in the scaled unfoldings of the tensor. Weighted tensor norm is utilized to exploit the structures of the different unfoldings of the state measurement tensor to improve the voltage estimation. The estimation accuracy is further improved by alternatively estimating the tensor columns and increasing the available data at each stage in the tensor completion process. The proposed methods are evaluated on the IEEE-33, 37 test systems and a 100- node test system. The proposed methods are shown to provide significant performance gains relative to the classic matrix and tensor completion based approaches.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Turbulent mixing in a precessing sphere

By numerically simulating turbulent flows at high Reynolds numbers in a precessing sphere, we propose a method to enhance the mixing of a fluid confined within a smooth cavity by its rotational motion alone. To precisely evaluate the mixing efficiency, we extend the quantification method proposed by Danckwerts [“The definition and measurement of some characteristics of mixtures,” Appl. Sci. Res. A 3, 279–296 (1952)] to the case in which only a finite number of fluid particle trajectories can be known. Our accurate numerical tracking of fluid particles in the flow, which is controlled by the Reynolds number (an indicator of the spin rate) and the Poincaré number (the precession rate), shows the following results. First, the mixing process on the time scale normalized by the spin period is independent of the Reynolds number as long as it is high enough for the flow to be developed turbulence. Second, fastest mixing is achieved under weak precession (Poincaré number ≈0.1); in such cases, perfect mixing requires only 10–15 spins of the container. Third, the power to sustain turbulence is a weakly increasing function of the Poincaré number, and the energy efficiency of the mixing is also maximized when the Poincaré number is about 0.1. Fourth, efficient mixing driven by the weak precession arises from the effective cooperation of complex large-scale flow and small-scale turbulence, which itself is sustained by the large-scale flow.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

MO-FG-CAMPUS-IeP2-04: Multiple Penalties with Different Orders for Structure Adaptive CBCT Reconstruction

Purpose: To combine total variation (TV) and Hessian penalty in a structure adaptive way for cone-beam CT (CBCT) reconstruction. Methods: TV is a widely used first order penalty with good ability in suppressing noise and preserving edges but leads to the staircase effect in regions with smooth intensity transition. The second order Hessian penalty can effectively suppress the staircase effect with extra cost of blurring object edges. To take the best of both penalties we proposed a novel method to combine both for CBCT reconstruction in a structure adaptive way. The proposed method adaptively determined the weight of each penalty according to the geometry of local regions. An specially-designed exponent term with image gradient involved was used to characterize the local geometry such that the weights for Hessian and TV were 1 and 0 respectively at uniform local regions and 0 and 1 at edge regions. For other local regions the weights varied from 0 to 1. The objective functional was minimized using the majorzationminimization approach. We evaluated the proposed method on a modified 3D shepp-logan and a CatPhan 600 phantom. The full-width-at-halfmaximum (FWHM) and contrast-to-noise (CNR) were calculated. Results: For 3D shepp-logan the reconstructed images using TV had an obvious staircase effect while those using the proposed method and Hessian preserved the smooth transition regions well. FWHMs of the proposed method TV and Hessian penalty were 1.75 1.61 and 3.16 respectively, indicating that both TV and the proposed method is able to preserve edges. For CatPhan 600 CNR values of the proposed method were similar to those of TV and Hessian. Conclusion: The proposed method retains favorable properties of TV like preserving edges and also has the ability in better preserving gradual transition structure as Hessian does. All methods performs similarly in suppressing noise. This work was supported in part by National Natural Science Foundation of China (NNSFC) under Grant Nos.60971112 and 61375018 grants from the Cancer Prevention and Research Institute of Texas (RP130109 and RP110562-P2) National Institute of Biomedical Imaging and Bioengineering (R01 EB020366) and a grant from the American Cancer Society (RSG-13-326-01-CCE).

60 APPLIED LIFE SCIENCES↗

The DQ and DQΦ electronic structure diabatization methods: Validation for general applications

We recently proposed the dipole-quadrupole (DQ) method for transforming adiabatic electronic states to diabatic states by using matrix elements of the dipole and quadrupole operators, and we applied the method to 3-state diabatizations of LiH and phenol. Here we extend the method to also include the electrostatic potential, and we call the resulting method the DQΦ method, which denotes the dipole–quadrupole–electrostatic-potential diabatization method. The electrostatic potential provides extra flexibility, and the goal of the present work is to test and illustrate the robustness of the methods for producing diabatic potential energy curves that tend to the adiabatic curves away from crossings and avoided crossings and are smooth in regions of crossings and avoided crossings. We illustrate the generality of the methods by an application to LiH with four states and by two-state diabatizations of HCl, (H{sub 2}){sub 2}, O{sub 3}, and the reaction Li + HF → LiF + H. We find that—if enough states are included—the DQ method does not have a significant dependence on the parameter weighting the quadrupole moment, and a geometry-independent value of 10 a{sub 0}{sup −2} is adequate in all cases tested. We also find that the addition of the electrostatic potential improves the diabatic potentials in some cases and provides an additional property useful for increasing the generality of the method for diabatization.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Iterative and function-continuation Fourier deconvolution methods for enhancing mass spectrometer resolution

Mass spectrometer data in the form of ion current versus mass-to-charge ratio often include overlapping mass peaks, especially in low- and medium-resolution instruments. Numerical deconvolution of such data effectively enhances the resolution by decreasing the overlap of mass peaks. In this paper two approaches to deconvolution are presented: a function-domain iterative technique and a Fourier transform method which uses transform-domain function-continuation. Both techniques include data smoothing to reduce the sensitivity of the deconvolution to noise. The efficacy of these methods is demonstrated through application to representative mass spectrometer data and the deconvolved results are discussed and compared to data obtained from a spectrometer with sufficient resolution to achieve separation of the mass peaks studied. A case for which the deconvolution is seriously affected by Gibbs oscillations is analyzed.

Ioup, J. W.↗

Applying a Compact Porous Media Model to Numerically Derive Resistance Coefficients for Lattice Structures

Additive Manufacturing allows for exploring various geometries to achieve specific engineering criteria. Lattices are one geometry with unique properties, including being periodically repeating structures which allow flow through them to be represented as a porous media according to Darcy-Forchheimer equations. These equation’s coefficients are generally experimentally derived, but this work demonstrates the ability to numerically derive them with CFD. Simulations were performed using three-dimensional stead state Reynolds-averaged Navier-Stokes with a k-ω Shear Stress Transport turbulence model using Ansys Fluent. Three lattice geometries were investigated and drag coefficients were derived. The method was validated against externally published data for similar geometries demonstrating strong agreement, and grid convergence for all simulations was calculated with a Grid Convergence Index method. Wall roughness is demonstrated to have a non-negligible impact on results and roughness values are considered for the primary focus Octahedral geometry where both smooth wall and rough wall coefficients were derived. The porosity coefficients for the Octahedral geometry at 1.0 [m/s] were found to be 2.89×10 6 and 2.90×10 6 [1/(Pa*m*s)] for the permeability coefficients, 6.37×10 1 and 5.44×10 1 [m 2 /kg] for the inertial resistance coefficients, and with a max pressure drop of 5116.7 [Pa] and 4429.5 [Pa] for the smooth walls and rough walls, respectively. The derived numerical method enables rapid exploration and optimization of new lattice designs for diverse engineering applications.

42 ENGINEERING↗

Interpreting SBUV Smoothing Errors: an Example Using the Quasi-biennial Oscillation

The Solar Backscattered Ultraviolet (SBUV) observing system consists of a series of instruments that have been measuring both total ozone and the ozone profile since 1970. SBUV measures the profile in the upper stratosphere with a resolution that is adequate to resolve most of the important features of that region. In the lower stratosphere the limited vertical resolution of the SBUV system means that there are components of the profile variability that SBUV cannot measure. The smoothing error, as defined in the optimal estimation retrieval method, describes the components of the profile variability that the SBUV observing system cannot measure. In this paper we provide a simple visual interpretation of the SBUV smoothing error by comparing SBUV ozone anomalies in the lower tropical stratosphere associated with the quasi-biennial oscillation (QBO) to anomalies obtained from the Aura Microwave Limb Sounder (MLS). We describe a methodology for estimating the SBUV smoothing error for monthly zonal mean (mzm) profiles. We construct covariance matrices that describe the statistics of the inter-annual ozone variability using a 6 yr record of Aura MLS and ozonesonde data. We find that the smoothing error is of the order of 1percent between 10 and 1 hPa, increasing up to 15-20 percent in the troposphere and up to 5 percent in the mesosphere. The smoothing error for total ozone columns is small, mostly less than 0.5 percent. We demonstrate that by merging the partial ozone columns from several layers in the lower stratosphere/troposphere into one thick layer, we can minimize the smoothing error. We recommend using the following layer combinations to reduce the smoothing error to about 1 percent: surface to 25 hPa (16 hPa) outside (inside) of the narrow equatorial zone 20 S-20 N.

ozone profile retrievals↗