Search NASA⌕ Search

SEARCH · Search NASA

Results for “data smoothing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28

Sampling Density in Regional Exploration and Environmental Geochemical Studies: A Review

A variety of factors contribute to the proper and efficient evaluation of geochemical programs including sampling medium, sample size and sample fraction, sampling density, digestion procedure, and analytical techniques. Among the aforementioned factors, sampling density is of great importance, affecting project ability to detect anomalous sites, which are either economically viable or environmentally hazardous. It is quite critical to have a sufficient number of samples to delineate geochemical anomalies or baselines and to reveal the relative variations in elemental concentrations in a study area. The resolution of the subsequent maps obtained by sampling greatly depends on sampling density. While a large number of samples may generate redundant data, a small number of samples smooth out the patterns and may completely miss anomalies. This review provides a platform for applied geochemists who desire to design a sampling scheme for a regional geochemical program and do not have the financial resources to perform an orientation survey, which will give them the necessary information for designing, according to project objectives, a cost-effective regional geochemical survey for their study area. It is advisable to integrate during the desktop study all available information, such as geological, structural, geophysical, remote sensing data and topographical data by using different data fusion algorithms to arrive at a sampling density fit-for-purpose of the target area. This in turn facilitates an effective spatial positioning of sample locations. Quantitative analyses of the efficiency of different sampling densities for delineating geochemical patterns have not been well documented, warranting more attention and research.

58 GEOSCIENCES↗

Analysis of Wind Power and Load Data at Multiple Time Scales

In this study we develop and apply new methods of data analysis for high resolution wind power and system load time series, to improve our understanding of how to characterize highly variable wind power output and the correlations between wind power and load. These methods are applied to wind and load data from the ERCOT region, and wind power output from the PJM and NYISO areas. We use a wavelet transform to apply mathematically well-defined operations of smoothing and differencing to the time series data. This approach produces a set of time series of the changes in wind power and load (or ?deltas?), over a range of times scales from a few seconds to approximately one hour. A number of statistical measures of these time series are calculated. We present sample distributions, and devise a method for fitting the empirical distribution shape in the tails. We also evaluate the degree of serial correlation, and linear correlation between wind and load. Our examination of the data shows clearly that the deltas do not follow a Gaussian shape; the distribution is exponential near the center and appears to follow a power law for larger fluctuations. Gaussian distributions are frequently used in modeling studies. These are likely to over-estimate the probability of small to moderate deviations. This in turn may lead to an over-estimation of the additional reserve requirement (hence the cost) for high penetration of wind. The Gaussian assumption provides no meaningful information about the real likelihood of large fluctuations. The possibility of a power law distribution is interesting because it suggests that the distribution shape for of wind power fluctuations may become independent of system size for large enough systems.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

The least squares process of MEDIA for computing DRVID calibration polynomials

A process is described and evaluated for computing a least squares polynomial approximation of data points in which the optimum degree of the polynomial is automatically determined. An iterative smoothing technique is used to replace every point with the value taken on by a moving least squares polynomial computed from a subset of points centered at the point to be replaced. The optimum degree of the resulting polynomial approximation is determined by analyzing the finite differences of each successive set of smoothed points. To evaluate the process, both artificially constructed data and actual Mariner Mars 1971 (MM'71) tracking data are used. This process was incorporated into a transmission media calibration computer program (MEDIA), which calibrates radiometric data to overcome the effects on the tracking signal of charged particle media. MEDIA was used in support of MM'71.

Leavitt, R. K.↗

Modeling of LEO Orbital Debris Populations in Centimeter and Millimeter Size Regimes

The building of the NASA Orbital Debris Engineering Model, whether ORDEM2000 or its recently updated version ORDEM2010, uses as its foundation a number of model debris populations, each truncated at a minimum object-size ranging from 10 micron to 1 m. This paper discusses the development of the ORDEM2010 model debris populations in LEO (low Earth orbit), focusing on centimeter (smaller than 10 cm) and millimeter size regimes. Primary data sets used in the statistical derivation of the cm- and mm-size model populations are from the Haystack radar operated in a staring mode. Unlike cataloged objects of sizes greater than approximately 10 cm, ground-based radars monitor smaller-size debris only in a statistical manner instead of tracking every piece. The mono-static Haystack radar can detect debris as small as approximately 5 mm at moderate LEO altitudes. Estimation of millimeter debris populations (for objects smaller than approximately 6 mm) rests largely on Goldstone radar measurements. The bi-static Goldstone radar can detect 2- to 3-mm objects. The modeling of the cm- and mm-debris populations follows the general approach to developing other ORDEM2010-required model populations for various components and types of debris. It relies on appropriate reference populations to provide necessary prior information on the orbital structures and other important characteristics of the debris objects. NASA's LEO-to-GEO Environment Debris (LEGEND) model is capable of furnishing such reference populations in the desired size range. A Bayesian statistical inference process, commonly adopted in ORDEM2010 model-population derivations, changes a priori distribution into a posteriori distribution and thus refines the reference populations in terms of data. This paper describes key elements and major steps in the statistical derivations of the cm- and mm-size debris populations and presents results. Due to lack of data for near 1-mm sizes, the model populations of 1- to 3.16-mm objects are an empirical extension from larger debris. The extension takes into account the results of micro-debris (from 10 micron to 1 mm) population modeling that is based on shuttle impact data, in the hope of making a smooth transition between micron and millimeter size regimes. This paper also includes a brief discussion on issues and potential future work concerning the analysis and interpretation of Goldstone radar data.

Xu, Y.-L.↗

Interpolation Methods for GTD Analysis of Shaped Reflectors

The finding of smooth analytic representations for antenna reflector surfaces which are prescribed only by discretized data obtained by various synthesis methods is examined. Frequently the data are distributed in a nonuniform grid and contain noise. The smoothness required is to C sub 1 for physical optics diffraction analysis and to C sub 2 for geometrical theory of diffraction (GTD) analysis. The GTD analysis approach requires a surface description which returns data very rapidly. Two methods of interpolation, the global and the local methods, are discussed. They each have advantages and disadvantages; characteristics are discussed and examples are presented.

Galindo-Israel, V.↗

Comparison of Turbulent Thermal Diffusivity and Scalar Variance Models

In this study, several variable turbulent Prandtl number formulations are examined for boundary layers, pipe flow, and axisymmetric jets. The model formulations include simple algebraic relations between the thermal diffusivity and turbulent viscosity as well as more complex models that solve transport equations for the thermal variance and its dissipation rate. Results are compared with available data for wall heat transfer and profile measurements of mean temperature, the root-mean-square (RMS) fluctuating temperature, turbulent heat flux and turbulent Prandtl number. For wall-bounded problems, the algebraic models are found to best predict the rise in turbulent Prandtl number near the wall as well as the log-layer temperature profile, while the thermal variance models provide a good representation of the RMS temperature fluctuations. In jet flows, the algebraic models provide no benefit over a constant turbulent Prandtl number approach. Application of the thermal variance models finds that some significantly overpredict the temperature variance in the plume and most underpredict the thermal growth rate of the jet. The models yield very similar fluctuating temperature intensities in jets from straight pipes and smooth contraction nozzles, in contrast to data that indicate the latter should have noticeably higher values. For the particular low subsonic heated jet cases examined, changes in the turbulent Prandtl number had no effect on the centerline velocity decay.

computational fluid dynamics↗

A Centralized AI Lakehouse Framework for Brain Tumor MRI Classification and Segmentation, University KPI Forecasting, and Water Potability Prediction

In many university and healthcare projects, models are built for very different data types such as tables, institutional time series, and medical images, but they are deployed as separate applications. In this work, that separation made testing and maintenance difficult because each module had its own pipeline and runtime requirements. This paper presents an integrated AI lakehouse-style implementation that runs three model pipelines inside one containerized backend. For medical imaging, we used MRI datasets from IEEE DataPort: a four-class classification set with 7012 images (5708 train/1304 test) and a segmentation set with 3063 image–mask pairs. The classification model (ResNet50 transfer learning) is evaluated using a proper train–validation–test protocol across multiple splits (80/10/10, 70/10/20, 60/10/30, and 10/30/60), achieving a test accuracy of 99.00% under the standard 80/10/10 split. Additionally, a patient-level evaluation is conducted using an external glioma dataset to provide a more realistic assessment without data leakage. The segmentation model (DeepLabV3-ResNet50) achieved 83.09% validation mIoU and 88.79% Dice score. For university KPI forecasting, we used annual IPEDS and NSF HERD data from 2010 to 2023 for three universities (BSU, EOU, and UAB). To examine the effect of preprocessing on forecasting performance, two case studies are conducted. In the first case, linear interpolation is applied to generate semester-level data. In the second case, the original annual data is used directly without interpolation. Random Forest regression and ARIMA models are evaluated using MAE, RMSE, MAPE, and R 2 . The results showed that interpolation improved apparent forecasting performance due to smoothing, while evaluation on the original annual data provided a more realistic assessment of model behavior. To further validate the framework on a larger dataset, an additional case study is conducted using a student dropout dataset. For water potability, we trained and compared multiple tabular classifiers on a large dataset (1,048,575 samples). A Random Forest model (100 trees, max depth 10) achieved 85.86% test accuracy and high recall for unsafe samples (0.8447). All modules are served via FastAPI and deployed together using Docker, with workflow automation routing requests to the correct endpoint. System-level benchmarking indicates that the backend maintains stable throughput and latency under concurrent requests.

97 MATHEMATICS AND COMPUTING↗

Reduction of Marine Magnetic Data for Modeling the Main Field of the Earth

The marine data set archived at the National Geophysical Data Center (NGDC) consists of shipborne surveys conducted by various institutes worldwide. This data set spans four decades (1953, 1958, 1960-1987), and contains almost 13 million total intensity observations. These are often less than 1 km apart. These typically measure seafloor spreading anomalies with amplitudes of several hundred nanotesla (nT) which, since they originate in the crust, interfere with main field modeling. The source for these short wavelength features are confined within the magnetic crust (i.e., sources above the Curie isotherm). The main field, on the other hand, is of much longer wavelengths and originates within the earth's core. It is desirable to extract the long wavelength information from the marine data set for use in modeling the main field. This can be accomplished by averaging the data along the track. In addition, those data which are measured during periods of magnetic disturbance can be identified and eliminated. Thus, it should be possible to create a data set which has worldwide data distribution, spans several decades, is not contaminated with short wavelengths of the crustal field or with magnetic storm noise, and which is limited enough in size to be manageable for the main field modeling. The along track filtering described above has proved to be an effective means of condensing large numbers of shipborne magnetic data into a manageable and meaningful data set for main field modeling. Its simplicity and ability to adequately handle varying spatial and sampling constraints has outweighed consideration of more sophisticated approaches. This filtering technique also provides the benefits of smoothing out short wavelength crustal anomalies, discarding data recorded during magnetically noisy periods, and assigning reasonable error estimates to be used in the least square modeling. A useful data set now exists which spans 1953-1987.

Baldwin, R. T.↗

Data compression preserving statistical independence

The purpose of this study was to determine the optimum points of evaluation of data compressed by means of polynomial smoothing. It is shown that a set y of m statistically independent observations Y(t sub 1), Y(t sub 2), ... Y(t sub m) of a quantity X(t), which can be described by a (n-1)th degree polynomial in time, may be represented by a set Z of n statistically independent compressed observations Z (tau sub 1), Z (tau sub 2),...Z (tau sub n), such that The compressed set Z has the same information content as the observed set Y. the times tau sub 1, tau sub 2,.. tau sub n are the zeros of an nth degree polynomial P sub n, to whose definition and properties the bulk of this report is devoted. The polynomials P sub n are defined as functions of the observation times t sub 1, t sub 2,.. t sub n, and it is interesting to note that if the observation times are continuously distributed the polynomials P sub n degenerate to legendre polynomials. The proposed data compression scheme is a little more complex than those usually employed, but has the advantage of preserving all the information content of the original observations.

Morduch, G. E.↗

Kinetically Controlled Fabrication of Single‐Crystalline TiO 2 Nanobrush Architectures with High Energy {001} Facets

This study demonstrates that precise control of nonequilibrium growth conditions during pulsed laser deposition (PLD) can be exploited to produce single‐crystalline anatase TiO 2 nanobrush architectures with large surface areas terminated with high energy {001} facets. The data indicate that the key to nanobrush formation is controlling the atomic surface transport processes to balance defect aggregation and surface‐smoothing processes. High‐resolution scanning transmission electron microscopy data reveal that defect‐mediated aggregation is the key to TiO 2 nanobrush formation. The large concentration of defects present at the intersection of domain boundaries promotes aggregation of PLD growth species, resulting in the growth of the single‐crystalline nanobrush architecture. This study proposes a model for the relationship between defect creation and growth mode in nonequilibrium environments, which enables application of this growth method to novel nanostructure design in a broad range of materials.

36 MATERIALS SCIENCE↗

Three-Dimensional High-Order Spectral Volume Method for Solving Maxwell's Equations on Unstructured Grids

A three-dimensional, high-order, conservative, and efficient discontinuous spectral volume (SV) method for the solutions of Maxwell's equations on unstructured grids is presented. The concept of discontinuous 2nd high-order loca1 representations to achieve conservation and high accuracy is utilized in a manner similar to the Discontinuous Galerkin (DG) method, but instead of using a Galerkin finite-element formulation, the SV method is based on a finite-volume approach to attain a simpler formulation. Conventional unstructured finite-volume methods require data reconstruction based on the least-squares formulation using neighboring cell data. Since each unknown employs a different stencil, one must repeat the least-squares inversion for every cell at each time step, or to store the inversion coefficients. In a high-order, three-dimensional computation, the former would involve impractically large CPU time, while for the latter the memory requirement becomes prohibitive. In the SV method, one starts with a relatively coarse grid of triangles or tetrahedra, called spectral volumes (SVs), and partition each SV into a number of structured subcells, called control volumes (CVs), that support a polynomial expansion of a desired degree of precision. The unknowns are cell averages over CVs. If all the SVs are partitioned in a geometrically similar manner, the reconstruction becomes universal as a weighted sum of unknowns, and only a few universal coefficients need to be stored for the surface integrals over CV faces. Since the solution is discontinuous across the SV boundaries, a Riemann solver is thus necessary to maintain conservation. In the paper, multi-parameter and symmetric SV partitions, up to quartic for triangle and cubic for tetrahedron, are first presented. The corresponding weight coefficients for CV face integrals in terms of CV cell averages for each partition are analytically determined. These discretization formulas are then applied to the integral form of the Maxwell equations. All numerical procedures for outer boundary, material interface, zonal interface, and interior SV face are unified with a single characteristic formulation. The load balancing in a massive parallel computing environment is therefore easier to achieve. A parameter is introduced in the Riemann solver to control the strength of the smoothing term. Important aspects of the data structure and its effects to communication and the optimum use of cache memory are discussed. Results will be presented for plane TE and TM waves incident on a perfectly conducting cylinder for up to fifth order of accuracy, and a plane wave incident on a perfectly conducting sphere for up to fourth order of accuracy. Comparisons are made with exact solutions for these cases.

Liu, Yen↗

Interannual fires as a source for subarctic summer decadal climate variability mediated by permafrost thawing

Climate model simulations run under the Coupled Model Intercomparison Project Phase 6 (CMIP6) use an inhomogeneous biomass burning aerosol (BBA) emission dataset, which exhibits pronounced interannual variability from 1997–2014 due to the infusion of satellite data. Using the Community Earth System Model version 2 Large Ensemble (CESM2-LE) with original and smoothed CMIP6 BBA forcings, we show that the CMIP6 data inhomogeneity causes spurious decadal subarctic land warming. During years with reduced aerosol concentrations, increased solar radiation can trigger abrupt subarctic permafrost thawing, increased soil water drainage, upper soil drying, and subsequent surface warming. This slow process, which is further amplified by nonlinear cloud-aerosol interactions, cannot be completely offset during years of increased aerosol fluxes, thereby reddening surface temperature spectra in response to large-amplitude interannual aerosol forcing. More generally, our CESM2 experiments identify a pathway for generating decadal variability in high latitudes, involving interannual shortwave forcing and slow nonlinear soil responses.

54 ENVIRONMENTAL SCIENCES↗

Towards a unified nonlocal, peridynamics framework for the coarse-graining of molecular dynamics data with fractures

Molecular dynamics (MD) has served as a powerful tool for designing materials with reduced reliance on laboratory testing. However, the use of MD directly to treat the deformation and failure of materials at the mesoscale is still largely beyond reach. In this work, we propose a learning framework to extract a peridynamics model as a mesoscale continuum surrogate from MD simulated material fracture data sets. Firstly, we develop a novel coarse-graining method, to automatically handle the material fracture and its corresponding discontinuities in the MD displacement data sets. Inspired by the weighted essentially non-oscillatory (WENO) scheme, the key idea lies at an adaptive procedure to automatically choose the locally smoothest stencil, then reconstruct the coarse-grained material displacement field as the piecewise smooth solutions containing discontinuities. Then, based on the coarse-grained MD data, a two-phase optimization-based learning approach is proposed to infer the optimal peridynamics model with damage criterion. In the first phase, we identify the optimal nonlocal kernel function from the data sets without material damage to capture the material stiffness properties. Then, in the second phase, the material damage criterion is learnt as a smoothed step function from the data with fractures. As a result, a peridynamics surrogate is obtained. As a continuum model, our peridynamics surrogate model can be employed in further prediction tasks with different grid resolutions from training, and hence allows for substantial reductions in computational cost compared with MD. We illustrate the efficacy of the proposed approach with several numerical tests for the dynamic crack propagation problem in a single-layer graphene. Our tests show that the proposed data-driven model is robust and generalizable, in the sense that it is capable of modeling the initialization and growth of fractures under discretization and loading settings that are different from the ones used during training.

97 MATHEMATICS AND COMPUTING↗

Ensemble variational Fokker-Planck methods for data assimilation

Particle flow filters solve Bayesian inference problems by smoothly transforming a set of particles into samples from the posterior distribution. Particles move in state space under the flow of an McKean-Vlasov-Itˆo process. This work introduces the Variational Fokker-Planck (VFP) framework for data assimilation, a general approach that includes previously known particle flow filters as special cases. The McKean-Vlasov-Itˆo process that transforms particles is defined via an optimal drift that depends on the selected diffusion term. It is established that the underlying probability density - sampled by the ensemble of particles - converges to the Bayesian posterior probability density. For a finite number of particles the optimal drift contains a regularization term that nudges particles toward becoming independent random variables. Based on this analysis, we derive computationally-feasible approximate regularization approaches that penalize the mutual information between pairs of particles, and avoid particle collapse. Moreover, the diffusion plays a role akin to a particle rejuvenation approach that aims to alleviate particle collapse. The VFP framework is very flexible. Different assumptions on prior and intermediate probability distributions can be used to implement the optimal drift, and localization and covariance shrinkage can be applied to alleviate the curse of dimensionality. A robust implicit-explicit method is discussed for the efficient integration of stiff McKean- Vlasov-Itˆo processes. Here, the effectiveness of the VFP framework is demonstrated on three progressively more challenging test problems, namely the Lorenz ’63, Lorenz ’96 and the quasi-geostrophic equations.

97 MATHEMATICS AND COMPUTING↗

Testing Different Methods for Estimating Uncertainties on Rietveld Refined Parameters Using SrRietveld

The advent of fast computing allows more computationally expensive, though possibly more accurate, approaches for estimating uncertainties on Rietveld refined parameters. Here we compare three such methods, using two different refinement programs, FullProf and GSAS. This is facilitated by the use of a new Rietveld refinement package, SrRietveld, that provides Python wrappers for FullProf and GSAS. The refined values on the parameters from two different refinement engines match each other very well. The uncertainty estimates determined using the different methods are also consistent, though FullProf and GSAS estimate the parameter uncertainties slightly differently from each other, which is discussed. More importantly, we find that the refined results are very sensitive to the statistical weights used in the least squares equation. Different weights, for example from uncertain or incorrectly propagated random errors on the data, lead to significantly different refined values. This means that uncertainty estimates on refined parameters should be increased when the random errors on the data are not well known, as for example in many cases where area detectors are used, and care should be taken to propagate errors correctly in any data preprocessing such as normalization by a smoothed spectrum. The computationally expensive bootstrap error estimation methods are facilitated by the use of SrRietveld, but are not required in most cases though may be useful in some cases, for example if the random errors on the data are not well known.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Annular honeycomb seals: Test results for leakage and rotordynamic coefficients; comparisons to labyrinth and smooth configurations

Test results are presented for leakage and rotordynamic coefficients for seven honeycomb seals. All seals have the same radius, length, and clearance; however, the cell depths and diameters are varied. Rotordynamic data, which are presented, consist of the direct and cross-coupled stiffness coefficients and the direct damping coefficients. The rotordynamic-coefficient data show a considerable sensitivity to changes in cell dimensions; however, no clear trends are identifiable. Comparisons of test data for the honeycomb seals with labyrinth and smooth annular seals show the honeycomb seal had the best sealing (minimum leakage) performance, followed in order by the labyrinth and smooth seals. For prerotated fluid entering the seal, in the direction of shaft rotation, the honeycomb seal has the best rotordynamic stability followed in order by the labyrinth and smooth. For no prerotation, or fluid prerotation against shaft rotation, the labyrinth seal has the best rotordynamic stability followed in order by the smooth and honeycomb seals.

Childs, Dara W.↗

Annular honeycomb seals: Test results for leakage and rotordynamic coefficients - Comparisons to labyrinth and smooth configurations

Test results are presented for leakage and rotordynamic coefficients for seven honeycomb seals. All seals have the same radius, length, and clearance; however, the cell depths and diameters are varied. Rotordynamic data, which are presented, consist of the direct and cross-coupled stiffness coefficients and the direct damping coefficients. The rotordynamic-coefficient data show a considerable sensitivity to changes in cell dimensions; however, no clear trends are identifiable. Comparisons of test data for the honeycomb seals with labyrinth and smooth annular seals shows the honeycomb seal had the best sealing (minimum leakage) performance, followed in order by the labyrinth and smooth seals. For prerotated fluids entering the seal, in the direction of shaft rotation, the honeycomb seal has the best rotordynamic stability followed in order by the labyrinth and smooth. For no prerotation, or fluid prerotation against shaft rotation, the labyrinth seal has the best rotordynamic stability followed in order by the smooth and honeycomb seals.

Childs, D.↗

The variation of corrosion potential with time for coated metal surfaces

The variation of corrosion potential (EsubCORR) with time has been measured for 4130 steel coated with a preservative compound and for primer coated 2219-T87 aluminum. The data for coated steel samples show a great deal of scatter, and a smoothing procedure has been developed to enable proper interpretation of the data. The EsubCORR-time curves for coated steel exhibit a maximum, in agreement with the results of previous studies, where the data were the average of those for a large number of samples, while the present data were obtained from a single sample. In contrast, the EsubCORR-time curves for primer coated 2219-T87 aluminum samples show no significant variations, although considerable activity is indicated by the resistance-time and corrosion rate-time curves.

Danford, M. D.↗