Search NASASearch

SEARCH · Search NASA

Results for “Streaming Algorithms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Computation of three-dimensional flows using two stream functions

An approach to compute 3-D flows using two stream functions is presented. The method generates a boundary fitted grid as part of its solution. Commonly used two steps for computing the flow fields are combined into a single step in the present approach: (1) boundary fitted grid generation; and (2) solution of Navier-Stokes equations on the generated grid. The presented method can be used to directly compute 3-D viscous flows, or the potential flow approximation of this method can be used to generate grids for other algorithms to compute 3-D viscous flows. The independent variables used are chi, a spatial coordinate, and xi and eta, values of stream functions along two sets of suitably chosen intersecting stream surfaces. The dependent variables used are the streamwise velocity, and two functions that describe the stream surfaces. Since for a 3-D flow there is no unique way to define two sets of intersecting stream surfaces to cover the given flow, different types of two sets of intersecting stream surfaces are considered. First, the metric of the (chi, xi, eta) curvilinear coordinate system associated with each type is presented. Next, equations for the steady state transport of mass, momentum, and energy are presented in terms of the metric of the (chi, xi, eta) coordinate system. Also included are the inviscid and the parabolized approximations to the general transport equations.

Greywall, Mahesh S.

Heterogeneous Multi-Domain Dataset Synthesis to Facilitate Privacy and Risk Assessments in Smart City IoT

The emergence of the Smart Cities paradigm and the rapid expansion and integration of Internet of Things (IoT) technologies within this context have created unprecedented opportunities for high-resolution behavioral analytics, urban optimization, and context-aware services. However, this same proliferation intensifies privacy risks, particularly those arising from cross-modal data linkage across heterogeneous sensing platforms. To address these challenges, this paper introduces a comprehensive, statistically grounded framework for generating synthetic, multimodal IoT datasets tailored to Smart City research. The framework produces behaviorally plausible synthetic data suitable for preliminary privacy risk assessment and as a benchmark for future re-identification studies, as well as for evaluating algorithms in mobility modeling, urban informatics, and privacy-enhancing technologies. As part of our approach, we formalize probabilistic methods for synthesizing three heterogeneous and operationally relevant data streams—cellular mobility traces, payment terminal transaction logs, and Smart Retail nutrition records—capturing the behaviors of a large number of synthetically generated urban residents over a 12-week period. The framework integrates spatially explicit merchant selection using K-Dimensional (KD)-tree nearest-neighbor algorithms, temporally correlated anchor-based mobility simulation reflective of daily urban rhythms, and dietary-constraint filtering to preserve ecological validity in consumption patterns. In total, the system generates approximately 116 million mobility pings, 5.4 million transactions, and 1.9 million itemized purchases, yielding a reproducible benchmark for evaluating multimodal analytics, privacy-preserving computation, and secure IoT data-sharing protocols. To show the validity of this dataset, the underlying distributions of these residents were successfully validated against reported distributions in published research. We present preliminary uniqueness and cross-modal linkage indicators; comprehensive re-identification benchmarking against specific attack algorithms is planned as future work. This framework can be easily adapted to various scenarios of interest in Smart Cities and other IoT applications. By aligning methodological rigor with the operational needs of Smart City ecosystems, this work fills critical gaps in synthetic data generation for privacy-sensitive domains, including intelligent transportation systems, urban health informatics, and next-generation digital commerce infrastructures.

IoT

A simple Lagrangian forecast system with aviation forecast potential

A trajectory forecast procedure is developed which uses geopotential tendency fields obtained from a simple, multiple layer, potential vorticity conservative isentropic model. This model can objectively account for short-term advective changes in the mass field when combined with fine-scale initial analyses. This procedure for producing short-term, upper-tropospheric trajectory forecasts employs a combination of a detailed objective analysis technique, an efficient mass advection model, and a diagnostically proven trajectory algorithm, none of which require extensive computer resources. Results of initial tests are presented, which indicate an exceptionally good agreement for trajectory paths entering the jet stream and passing through an intensifying trough. It is concluded that this technique not only has potential for aiding in route determination, fuel use estimation, and clear air turbulence detection, but also provides an example of the types of short range forecasting procedures which can be applied at local forecast centers using simple algorithms and a minimum of computer resources.

Petersen, R. A.

Vectorization of linear discrete filtering algorithms

Linear filters, including the conventional Kalman filter and versions of square root filters devised by Potter and Carlson, are studied for potential application on streaming computers. The square root filters are known to maintain a positive definite covariance matrix in cases in which the Kalman filter diverges due to ill-conditioning of the matrix. Vectorization of the filters is discussed, and comparisons are made of the number of operations and storage locations required by each filter. The Carlson filter is shown to be the most efficient of the filters on the Control Data STAR-100 computer.

Schiess, J. R.

Spatial and Temporal Distribution of Cloud Properties Observed by MODIS: Preliminary Level-3 Results from the Collection 5 Reprocessing

The Moderate Resolution Imaging Spectroradiometer (MODIS) was developed by NASA and launched onboard the Terra spacecraft on December 18, 1999 and Aqua spacecraft on May 4, 2002. It achieved its final orbit and began Earth observations on February 24, 2000 for Terra and June 24, 2002 for Aqua. A comprehensive set of operational algorithms for the retrieval of cloud physical and optical properties (optical thickness, effective particle radius, water path, thermodynamic phase) have recently been updated and are being used in the new "Collection 5" processing stream being produced by the MODIS Adaptive Processing System (MODAPS) at NASA GSFC. All Terra and Aqua data are undergoing Collection 5 reprocessing with an expected completion date by the end of 2006. The archived products from these algorithms include 1 km pixel-level (Level-2) and global gridded Level-3 products. The cloud products have applications in climate change studies, climate modeling, numerical weather prediction, as well as fundamental atmospheric research. In this talk, we will summarize the available Level-3 cloud properties and their associated statistical data sets, and show preliminary Terra and Aqua results from the available Collection 5 reprocessing effort. Anticipated results include the latitudinal distribution of cloud optical and radiative properties for both liquid water and ice clouds, as well as joint histograms of cloud optical thickness and effective radius for selected geographical locations around the world.

King, Michael D.

An iterative implicit DDADI algorithm for solving the Navier-Stokes equation

An algorithm utilizing a first order upwind split flux technique and the diagonally dominant treatment is proposed to be the temporal operator for solving the Navier-Stokes equations. Given the limit of a five point stencil, the right hand side flux derivatives are formulated by several commonly used central and upwind schemes. Their performances are studied through a test case of free vortex convection in a uniform stream. From these results, a superior treatment for evaluating the flux term is proposed and compared with the rest. The application of the proposed algorithm to the full Navier-Stokes equations is demonstrated through a calculation of flow over a backward facing step. Results are compared against the calculation done by using the fourth order central differencing scheme with artificial damping.

Chen, S. C.

On the solution of the unsteady Navier-Stokes equations for hypersonic flow about axially-symmetric blunt bodies

A formulation of the complete Navier-Stokes problem for a viscous hypersonic flow in general curvilinear coordinates is presented. This formulation is applicable to both the axially symmetric and three dimensional flows past bodies of revolution. The equations for the case of zero angle of attack were solved past a circular cylinder with hemispherical caps by point SOR finite difference approximation. The free stream Mach number and the Reynolds number for the test case are respectively 22.04 and 168883. The whole algorithm is presented in detail along with the preliminary results for pressure, temperature, density and velocity distributions along the stagnation line.

Warsi, Z. U. A.

Concepts for on board satellite image registration. Volume 4: Impact of data set selection on satellite on board signal processing

The NASA NEEDS program goals present a requirement for on-board signal processing to achieve user-compatible, information-adaptive data acquisition. This volume addresses the impact of data set selection on data formatting required for efficient telemetering of the acquired satellite sensor data. More specifically, the FILE algorithm developed by Martin-Marietta provides a means for the determination of those pixels from the data stream effects an improvement in the achievable system throughput. It will be seen that based on the lack of statistical stationarity in cloud cover, spatial distribution periods exist where data acquisition rates exceed the throughput capability. The study therefore addresses various approaches to data compression and truncation as applicable to this sensor mission.

Ruedger, W. H.

Leading-edge receptivity for blunt-nose bodies

This research program investigates boundary-layer receptivity in the leading-edge region for bodies with blunt leading edges. Receptivity theory provides the link between the unsteady distrubance environment in the free stream and the initial amplitudes of the instability waves in the boundary layer. This is a critical problem which must be addressed in order to develop more accurate prediction methods for boundary-layer transition. The first phase of this project examines the effects of leading-edge bluntness and aerodynamic loading for low Mach number flows. In the second phase of the project, the investigation is extended to supersonic Mach numbers. Singular perturbation techniques are utilized to develop an asymptotic theory for high Reynolds numbers. In the first year, the asymptotic theory was developed for leading-edge receptivity in low Mach number flows. The case of a parabolic nose is considered. Substantial progress was made on the Navier-Sotkes computations. Analytical solutions for the steady and unsteady potential flow fields were incorporated into the code, greatly expanding the types of free-stream disturbances that can be considered while also significantly reducing the the computational requirements. The time-stepping algorithm was modified so that the potential flow perturbations induced by the unsteady pressure field are directly introduced throughout the computational domain, avoiding an artificial 'numerical diffusion' of these from the outer boundary. In addition, the start-up process was modified by introducing the transient Stokes wave solution into the downstream boundary conditions.

Kerschen, Edward J.

A Study of Cloud Radiative Forcing and Feedback

The main objective of the grant proposal was to participate in the CERES (Cloud and Earth's Radiant Energy System) Satellite experiment and perform interdisciplinary investigation of NASA's Earth Observing System (EOS). During the grant period, massive amounts of scientific data from diverse platforms have been accessed, processed and archived for continuing use; several software packages have been developed for integration of different data streams for performing scientific evaluation; extensive validation studies planned have been completed culminating in the development of important algorithms that are being used presently in the operational production of data from the CERES. Contributions to the inter-disciplinary science investigations have been significantly more than originally envisioned. The results of these studies have appeared in several refereed journals and conference proceedings. They are listed at the end of this report.

Ramanathan, Veerabhadran

1D-Convolutional Neural Network Architecture for Generalized Time-series Segmentation

Time segmentation of experimental data is a common and often difficult task. Consequently, it is of interest to automate this type of segmentation to reduce manual inputs, which are labor intensive and less consistent. However, simple thresholding algorithms are often insufficiently robust due either to noise or inconsistent data. This paper proposes a simple 1D convolutional neural net (CNN) architecture as a generalized solution for typical time segmentation tasks. The layer architecture, training methods, and methods for simple customization will be described as well as the results of application to three separate data streams: facility condition segmentation, video highlight segmentation, and calorimeter time-series segmentation. In all three test cases the 1D-CNN performs better than tailored integral/derivative/thresholding algorithms across a range of signal-to-noise levels.

CNN

1D-Convolutional Neural Network Architecture for Generalized Time-series Segmentation

Time segmentation of experimental data is a common and often difficult task. Consequently, it is of interest to automate this type of segmentation to reduce manual inputs, which are labor intensive and less consistent. However, simple thresholding algorithms are often insufficiently robust due either to noise or inconsistent data. This paper proposes a simple 1D convolutional neural net (CNN) architecture as a generalized solution for typical time segmentation tasks. The layer architecture, training methods, and methods for simple customization will be described as well as the results of application to three separate data streams: facility condition segmentation, video highlight segmentation, and calorimeter time-series segmentation. In all three test cases the 1D-CNN performs better than tailored integral/derivative/thresholding algorithms across a range of signal-to-noise levels.

CNN

Algorithms for Spectral Decomposition with Applications to Optical Plume Anomaly Detection

The analysis of spectral signals for features that represent physical phenomenon is ubiquitous in the science and engineering communities. There are two main approaches that can be taken to extract relevant features from these high-dimensional data streams. The first set of approaches relies on extracting features using a physics-based paradigm where the underlying physical mechanism that generates the spectra is used to infer the most important features in the data stream. We focus on a complementary methodology that uses a data-driven technique that is informed by the underlying physics but also has the ability to adapt to unmodeled system attributes and dynamics. We discuss the following four algorithms: Spectral Decomposition Algorithm (SDA), Non-Negative Matrix Factorization (NMF), Independent Component Analysis (ICA) and Principal Components Analysis (PCA) and compare their performance on a spectral emulator which we use to generate artificial data with known statistical properties. This spectral emulator mimics the real-world phenomena arising from the plume of the space shuttle main engine and can be used to validate the results that arise from various spectral decomposition algorithms and is very useful for situations where real-world systems have very low probabilities of fault or failure. Our results indicate that methods like SDA and NMF provide a straightforward way of incorporating prior physical knowledge while NMF with a tuning mechanism can give superior performance on some tests. We demonstrate these algorithms to detect potential system-health issues on data from a spectral emulator with tunable health parameters.

Srivastava, Askok N.

OCTS And Seawifs Bio-Optical Algorithm and Product Vaildattion and Intercomparison in US Coastal Waters

Monitoring the health of U.S. coastal waters is an important goal of the National Oceanic and Atmospheric Administration (NOAA). Satellite sensors are capable of providing daily synoptic data of large expanses of the U.S. coast. Ocean color sensor, in particular, can be used to monitor the water quality of coastal waters on an operational basis. To appraise the validity of satellite-derived measurements, such as chlorophyll concentration, the bio-optical algorithms used to derive them must be evaluated in coastal environments. Towards this purpose, over 21 cruises in diverse U.S. coastal waters have been conducted. Of these 21 cruises, 12 have been performed in conjunction with and under the auspices of the NASA/SIMBIOS Project. The primary goal of these cruises has been to obtain in-situ measurements of downwelling irradiance, upwelling radiance, and chlorophyll concentrations in order to evaluate bio-optical algorithms that estimate chlorophyll concentration. In this Technical Memorandum, we evaluate the ability of five bio-optical algorithms, including the current SeaWiFS algorithm, to estimate chlorophyll concentration in surface waters of the South Atlantic Bight (SAB). The SAB consists of a variety of environments including coastal and continental shelf regimes, Gulf Stream waters, and the Sargasso Sea. The biological and optical characteristics of the region is complicated by temporal and spatial variability in phytoplankton composition, primary productivity, and the concentrations of colored dissolved organic matter (CDOM) and suspended sediment. As such, the SAB is an ideal location to test the robustness of algorithms for coastal use.

Brow, Chirstopher

OCTS and SeaWiFS Bio-Optical Algorithm and Product Validation and Intercomparison in US Coastal Waters

Monitoring the health of US coastal waters is an important goal of the National Oceanic and Atmospheric Administration (NOAA). Satellite sensors are capable of providing daily synoptic data of large expanses of the US coast. Ocean color sensors, in particular, can be used to monitor the water quality of coastal waters on an operational basis. To appraise the validity of satellite-derived measurements, such as chlorophyll concentration, the bio-optical algorithms used to derive them must be evaluated in coastal environments. Towards this purpose, over 21 cruises in diverse US coastal waters have been conducted. Of these 21 cruises, 12 have been performed in conjunction with and under the auspices of the NASA/Sensor Intercomparison and Merger for Biological and Interdisciplinary Oceanic Studies (SIMBIOS) Project. The primary goal of these cruises has been to obtain in-situ measurements of downwelling irradiance, upwelling radiance, and chlorophyll concentrations in order to evaluate bio-optical algorithms that estimate chlorophyll concentration. In this Technical Memorandum, we evaluate the ability of five bio-optical algorithms, including the current Sea-Viewing Wide Field-of-view Sensor (SeaWiFS) algorithm, to estimate chlorophyll concentration in surface waters of the South Atlantic Bight (SAB). The SAB consists of a variety of environments including coastal and continental shelf regimes, Gulf Stream waters, and the Sargasso Sea. The biological and optical characteristics of the region is complicated by temporal and spatial variability in phytoplankton composition, primary productivity, and the concentrations of colored dissolved organic matter (CDOM) and suspended sediment. As such, the SAB is an ideal location to test the robustness of algorithms for coastal use.

Brown, Christopher W.

Moment-based adaptive time integration for thermal radiation transport

Here, in this paper we develop a framework for moment-based adaptive time integration of deterministic multifrequency thermal radiation transpot (TRT). We generalize our recent semi-implicit-explicit (IMEX) integration framework for gray TRT to multifrequency TRT, and also introduce a semi-implicit variation that facilitates higher-order integration of TRT, where each stage is implicit in all components except opacities. To appeal to the broad literature on adaptivity with Runge–Kutta methods, we derive new embedded methods for four asymptotic preserving IMEX Runge–Kutta schemes we have found to be robust in our previous work on TRT and radiation hydrodynamics. We then use a moment-based high-order-low-order representation of the transport equations. Due to the high dimensionality, memory is always a concern in simulating TRT. We form error estimates and adaptivity in time purely based on temperature and radiation energy, for a trivial overhead in computational cost and memory usage compared with the base second order integrators. We then test the adaptivity in time on the tophat and Larsen problem, demonstrating the ability of the adaptive algorithm to naturally vary the timestep across 4–5 orders of magnitude, ranging from the dynamical timescales of the streaming regime to the thick diffusion limit.

97 MATHEMATICS AND COMPUTING

Direct simulation of high-speed mixing layers

A computational study of a nonreacting high-speed mixing layer is performed. A higher order algorithm with sufficient grid points is used to resolve all relevant scales. In all cases, a temporal free-stream disturbance is introduced. The resulting flow is time-sampled to generate a statistical cross section of the flow properties. The studies are conducted at two convective Mach numbers, three free-stream turbulence intensities, three Reynolds numbers, and two types of initial profiles-hyperbolic tangent (tanh) and boundary layer. The boundary-layer profile leads to more realistic predictions of the transition processes. The predicted transition Reynolds number of 0.18 x 10(exp 6) compares well with experimental data. Normalized vortex spacings for the boundary-layer case are about 3.5 and compare favorably with the 1.5 to 2.5 found in experimental measurements. The tanh profile produces spacings of about 10. The growth rate of the layer is shown to be moderately affected by the initial disturbance field, but comparison with experimental data shows moderate agreement. For the boundary-layer case, it is shown that noise at the Strouhal number of 0.007 is selectively amplified and shows little Reynolds number dependence.

Mukunda, H. S.

Do Better Satellite Precipitation Algorithms Improve Landslide Hazard Assessment?

Satellites make it possible to estimate precipitation in near real time. Given the challenges of achieving global coverage by other means, these data are used widely. However, few systems for landslide hazard assessment rely on satellite precipitation estimates. This could be due in part to perceptions of accuracy, although latency, spatial resolution, and other factors may also be important. We test whether recent changes to data streams from the Global Precipitation Measurement mission (GPM) have improved its potential for use in landslide prediction. Specifically, we examine data produced by the Integrated Multi-satellitERetrievals for the GPM (IMERG) algorithm, which was upgraded to version 7 this year. IMERG relies upon other algorithms, including the Goddard Profiling Algorithm (GPROF) and the GPM Combined Radar-Radiometer Algorithm (CORRA). Many changes have been made during the switch from IMERG version 6 to version 7. These include upgrading CORRA and GPROF to version 7, to improve the accuracy of precipitation in frozen, mountainous, and coastal areas. The measured intensity of some storms has been enhanced with a new algorithm, the Scheme for Histogram Adjustment with Ranked Precipitation Estimates in the Neighborhood. Combined with many others, these changes to IMERG should improve its utility for landslide hazard assessment in a variety of contexts. To test this idea, we retrain the global Landslide Hazard Assessment for Situational Awareness (LHASA) model twice—first with data from IMERG version 6B and second with 7B. Since current daily rainfall is the most important variable in determining outcomes predicted by LHASA, it should reflect changes made to that input. First, we grid the landslides at a daily, thirty-arcsecond resolution. This serves as the response variable. At each of these sites current and antecedent rainfall are extracted, along with antecedent snow mass and soil moisture, slope, and PGA. In addition, one million grid cells are selected at random points to represent conditions under which landslides (probably) do not occur. After merging these data, we hold back 20% of the dataset for validation purposes and train a machine-learning model with the rest. We assess both the model’s overall ability to identify landslides and its ability to predict specific large landslide disasters.

Thomas A Stanley