Search NASA⌕ Search

SEARCH · Search NASA

Results for “data flow statistics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

An Assessment of Non-Powered Dam Hydropower Development Opportunities in the United States

Retrofitting non-powered dams (NPDs) to add hydropower offers multiple benefits over traditional, new hydropower development. Since much of the civil works infrastructure already exists, many retrofits require minimal new construction and can leverage existing water conveyances and discharge for generation. Although NPDs vary considerably in terms of their defining characteristics, identifying similarities helps support targeted investment and find opportunities to develop solutions for common challenges. With the publication of NPD-related data in 2022 (Hansen et al. 2022b), the US Department of Energy and relevant stakeholders are equipped with key information across roughly 89,000 US NPDs. These data represent the best-available information to date and extend beyond previous assessments of potential power capacity by describing design, operational, socioeconomic, environmental aspects of NPDs (Hadjerioua et al. 2012). To capitalize on these efforts to improve breadth and depth of NPD data access, this study uses a data-driven approach to assess NPD hydropower development opportunities in the United States. To help describe project feasibility drivers for NPDs, recent NPD retrofits were reviewed to examine variability with respect to a variety of characteristics. Based on the assessment of recent retrofits and data availability, several attributes were selected to characterize the remaining NPD population: (1) owner type, (2) 30% exceedance flow (a common design flow that describes the flow that is exceeded by 30% of the flow in the record), (3) hydraulic head, and (4) maximum reservoir storage. These four characteristics were used as inputs to a statistical clustering analysis (a common technique for grouping individuals of a population based on similarities or how closely associated individuals are to one another) of a set of 2,709 NPDs with at least 100 kW potential capacity and recently retrofit dams with available data. With the large dataset of NPDs, the clusters help describe how the population breaks down into different types (i.e., how many types of dams there are and what portion of the population belongs to each cluster).

13 HYDRO ENERGY↗

Observation of Kolmogorov turbulence due to multiscale vortices in dusty plasma experiments

We report the experimental observation of fully developed Kolmogorov turbulence originating from self-excited vortex flows in a three-dimensional (3D) dust cloud. The characteristic -5/3 scaling of 3D Kolmogorov turbulence is consistent in both the spatial and temporal energy spectra within a statistical variation of experimental data. Additionally, the 2/3 scaling in the second-order structure function further supports the presence of Kolmogorov turbulence. We also identified a slight deviation in the tails of the probability distribution functions for velocity gradients, a reflection of intermittency. The experiment showed the formation of a dust cloud in the diffused plasma region away from the electrodes. The dust rotation was observed in multiple experimental campaigns under different discharge conditions at different spatial locations and background plasma environments.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Atmospheric condition identification in multivariate data through a metric for total variation

Identification of atmospheric conditions within a multivariable atmospheric data set is a necessary step in the validation of emerging and existing high-fidelity models used to simulate wind plant flows and operation.Atmospheric conditions relevant for wind energy research include stationary conditions, given the need for well-converged statistics for model validation, as well as conditions observed less frequently, such as extreme atmospheric events, which are used in wind turbine and wind plant design.Aggregation of observations without regard to covariance between time series discounts the dynamical nature of the atmosphere and is not sufficiently representative of atmospheric conditions.Identification and characterization of continuous time periods with atmospheric conditions that have a high value for analysis or simulation set the stage for more advanced model validation and the development of real-time control and operational strategies.The current work explores a single metric for variation in a multivariate data sample that quantifies variability within each channel as well as covariance between channels.The total variation is used to identify conditions of interest that conform to desired objective functions, such as stationary conditions, ramps or waves of wind speed, and changes in wind direction.Total variation is somewhat sensitive to the presence of outliers in the input data, and the method is best complemented by quality-control procedures to ensure reliable results.The direct detection and classification of events or conditions of interest within atmospheric data sets is vital to developing our understanding of wind plant response and to the formulation of forecasting and control models.

17 WIND ENERGY↗

Generation Forecasting for Small Run-of-the-River Hydroelectric Systems Using Statistical Learning Models

With an increasing interest in constructing new run-of-the-river (ROR) hydroelectric generation over the more traditional reservoir-based hydroelectric systems, there is an increasing operational challenge due to the volatility of stream flow. The Snohomish County Public Utilities District (SnoPUD) has recently invested in the construction and operation of 3 new run-of-the-river projects in Northwestern Washington along Calligan Creek, Hancock Creek, and Youngs Creek. In order to effectively plan generation dispatch, SnoPUD has expressed interest in the development of an accurate forecasting tool to predict the generation capacity for these ROR systems. The following research project aims to use statistical learning models, namely Hidden Markov Models (HMMs), to predict day-ahead generation capacities for the aforementioned ROR systems. These models are constructed using 12 years of historical stream flow data collected at the intake sites and precipitation data recorded at the National Oceanic and Atmospheric Administration (NOAA) Alpine Meadows station. Four methods of constructing the models are studied for their forecast accuracies, and are compared with the persistence model. Despite using only one set of observable variables, the HMMs are shown to have slight improvements in accuracy over the persistence model approach, which shows great optimism for future work.

13 HYDRO ENERGY↗

Neural-network learning of SPOD latent dynamics

Here, we aim to reconstruct the latent space dynamics of high dimensional, quasi-stationary systems using model order reduction via the spectral proper orthogonal decomposition (SPOD). The proposed method is based on three fundamental steps: in the first, once that the mean flow field has been subtracted from the realizations (also referred to as snapshots), we compress the data from a high-dimensional representation to a lower dimensional one by constructing the SPOD latent space; in the second, we build the time-dependent coefficients by projecting the snapshots containing the fluctuations onto the SPOD basis and we learn their evolution in time with the aid of recurrent neural networks; in the third, we reconstruct the high-dimensional data from the learnt lower -dimensional representation. The proposed method is demonstrated on two different test cases, namely, a compressible jet flow, and a geophysical problem known as the Madden-Julian Oscillation. An extensive comparison between SPOD and the equivalent POD-based counterpart is provided and differences between the two approaches are highlighted. The numerical results suggest that the proposed model is able to provide low rank predictions of complex statistically stationary data and to provide insights into the evolution of phenomena characterized by specific range of frequencies. The comparison between POD and SPOD surrogate strategies highlights the need for further work on the characterization of the interplay of error between data reduction techniques and neural network forecasts.

97 MATHEMATICS AND COMPUTING↗

Recurrent flow analysis in spatiotemporally chaotic 2-dimensional Kolmogorov flow

Motivated by recent success in the dynamical systems approach to transitional flow, we study the efficiency and effectiveness of extracting simple invariant sets (recurrent flows) directly from chaotic/turbulent flows and the potential of these sets for providing predictions of certain statistics of the flow. Two-dimensional Kolmogorov flow (the 2D Navier-Stokes equations with a sinusoidal body force) is studied both over a square [0, 2π]{sup 2} torus and a rectangular torus extended in the forcing direction. In the former case, an order of magnitude more recurrent flows are found than previously [G. J. Chandler and R. R. Kerswell, “Invariant recurrent solutions embedded in a turbulent two-dimensional Kolmogorov flow,” J. Fluid Mech. 722, 554–595 (2013)] and shown to give improved predictions for the dissipation and energy pdfs of the chaos via periodic orbit theory. Analysis of the recurrent flows shows that the energy is largely trapped in the smallest wavenumbers through a combination of the inverse cascade process and a feature of the advective nonlinearity in 2D. Over the extended torus at low forcing amplitudes, some extracted states mimic the statistics of the spatially localised chaos present surprisingly well recalling the findings of Kawahara and Kida [“Periodic motion embedded in plane Couette turbulence: Regeneration cycle and burst,” J. Fluid Mech. 449, 291 (2001)] in low-Reynolds-number plane Couette flow. At higher forcing amplitudes, however, success is limited highlighting the increased dimensionality of the chaos and the need for larger data sets. Algorithmic developments to improve the extraction procedure are discussed.

42 ENGINEERING↗

Statistical methods for network surveillance

The term network surveillance is defined in general terms and illustrated with many examples. Statistical methodologies that can be used as tools for network surveillance are discussed. Details for 3 illustrative examples that address network security, surveillance for data network failures, and surveillance of email traffic flows are presented. Some open areas of research are identified.

Jeske, Daniel R.↗

Effects of cation stoichiometry on surface morphology and crystallinity of ZnGeN 2 films grown on GaN by metalorganic chemical vapor deposition

ZnGeN 2 films were grown on GaN-on-sapphire templates via metalorganic chemical vapor deposition. Energy dispersive X-ray spectroscopy was used to estimate the Zn/(Zn+Ge) composition ratio in the films. This ratio decreased with increase in growth temperature but increased with increase in total reactor pressure or Zn/Ge precursor flow rate ratio. Systematic mapping of these key growth parameters has allowed us to identify the growth window to achieve ZnGeN 2 with stoichiometric cation composition. Compositional and statistical analyses performed on data acquired from atom probe tomography provided insight into the local compositional homogeneity. The cations Zn and Ge did not demonstrate segregation or clustering at the sub-nanometer level. Based on X-ray diffraction 2θ-ω scan profiles and transmission electron microscope nano-diffraction patterns, the films with near-stoichiometric cation ratios were single crystalline with planar surfaces, whereas zinc-rich or zinc-poor films were polycrystalline with nonplanar surfaces. The growth direction of the single crystalline ZnGeN 2 films on GaN templates was along the c-axis. Room temperature Raman spectra showed features associated with the phonon density of states, indicating the presence of cation disorder in the lattice. A cathodoluminescence peak associated with transitions involving deep level defects was observed around 640 nm. The intensity of this peak increased by almost 2.5 times as the temperature was reduced to 77 K from room temperature. A similar peak was observed in photoluminescence spectra collected at 80 K.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Public Reference Data for Megawatt-Scale Hydrogen Electrolysis - NLR Historical Wind

The U.S. Department of Energy and the National Laboratory of the Rockies (NLR) demonstrate hydrogen electrolysis from variable sources, hydrogen compression and storage, and hydrogen fuel cell power production using megawatt-scale equipment at NLR’s Flatirons Campus as part of the Advanced Research on Integrated Energy Systems (ARIES) initiative. This dataset represents part of that effort and is intended for academic, national laboratory, industrial, and other stakeholders to plan, design, and validate models of megawatt-scale hydrogen technologies and diverse energy infrastructure nationwide. These data provide a baseline for how existing hydrogen electrolysis technologies perform when coupled with various energy technologies. Future datasets will demonstrate how existing hydrogen fuel cell technologies can provide controllable, dispatchable, and variable power output for artificial intelligence (AI) data centers and other variable loads. This dataset entry describes hydrogen production by conducting a statistical analysis of historical wind data over a five-year period (2020-2025) from a single 1.5MW turbine manufactured by General Electric (GE) located at NLR’s Flatirons Campus, to generate an experimental test profile that was deployed on a 1.25-MW proton exchange membrane type MC250 electrolyzer system manufactured by Nel Hydrogen . [1] While the electrolyzer balance-of-plant supports up to 2.5 MW of electrolysis, NLR only has a single 1.25-MW electrolysis stack. The historical wind data provided several metrics, however, the analysis particularly focused on the measured power output by the wind turbine. The power output time series of data for each day was categorized by total energy generation and standard deviation, and the day that represented the highest combination of these two metrics was chosen – December 25th, 2022. This process was then repeated for a moving four-hour window within this day to identify the most statistically variable period. Finally, this four-hour period was scaled by 65% to match the 1.25 MW electrolyzer. The electrolysis system controls hydrogen production by varying DC current applied to the stack, from a maximum of 3000 A to a minimum safe operation of 300 A, or 10%. Because the current – voltage characteristic changes as the stack ages and efficiency degrades, the actual minimum safe operating power changes over time. The historical wind profiles were translated from power (kilowatts) to current (amperes) using a curve fit with calibration data and sent to the electrolyzer power supply at 1 Hz frequency. For more details on the statistical analysis process, see the presentation labeled “ Public Reference Data for Megawatt-Scale Hydrogen Electrolysis” provided with each data entry. These datasets report relevant hydrogen balance-of-plant and system data, all captured at 1 Hz, including hydrogen mass production measured with an Emerson Coriolis flow meter. Each .zip file represents a single wind turbine electrolysis experiment and is formatted as follows: {technology}_{scaling factor}-{electrolyzer ramp rate in amperes/second} For instance, “wind-GE1.5MW_0.65-400.zip” represents the hour-long experiment using historical data from the wind-GE1.5MW turbine, scaled to 65%, with the electrolyzer power supply set to a maximum ramp rate (gain and slew) of 400 A/s. Each .zip folder contains the following files: A .csv file containing raw data An .xlsx file explaining all the fields in the raw data. A .png plot showing the time series of hydrogen production, electrolysis power consumption, and wind power input. A PDF file detailing the historical wind data statistical analysis used to generate the wind profile. An experiment labeled “characterization_200.zip” demonstrates the MC250 electrolyzer steady-state response with 30-minute load steps for a total duration of 5 hours. Finally, a .csv file is provided with all simulated wind experiments combined into one dataset labeled "combined_historical_wind_experiments.csv". NLR also built an AI/machine-learning predictive model based on these datasets. The model ingests the electrolyzer current command in amperes, as well as various pressures and temperatures across the system, and predicts hydrogen output in kilograms per hour. The complete model can be found at https://huggingface.co/NatLabRockies/ptmelt-hydrogen-electrolysis [1] nelhydrogen.com/product/mc-series-electrolyser .

08 HYDROGEN↗

Extracting a mixing parameter from 2D radiographic imaging of variable-density turbulent flow

We extract a suitably averaged fluctuating density from the two-dimensional radiographic image of a flow. The X-ray attenuation is given by the Beer–Lambert law which exponentially damps the incident beam intensity by a factor proportional to the density, opacity and thickness of the target. By making reasonable assumptions for the mean density, opacity and effective thickness of the target flow, we estimate the density fluctuation contribution to the attenuation. The extracted density fluctuations averaged across the thickness of the flow in the direction of the beam may be used to form the density–specific-volume correlation $b$. In a statistical description of variable-density turbulence, $b$ quantifies the degree of mixedness. The ability to extract a measure of mixedness from experimental data would be a powerful tool that could be used in the validation of mix models. The scheme proposed is tested for DNS data computed for variable density buoyancy-driven mixing. We quantify the deficits in the extracted value of $b$ due to target thickness, Atwood number and modeled signal noise. This analysis justifies using the proposed scheme to infer the mix parameter from thin targets at moderate to low Atwood numbers. Furthermore, to illustrate how the scheme might be used in a practical problem, we demonstrate its application to a radiographic image of counter-shear flow obtained from experiments at the National Ignition Facility.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

HIERARCHICAL STRUCTURE OF MAGNETOHYDRODYNAMIC TURBULENCE IN POSITION-POSITION-VELOCITY SPACE

Magnetohydrodynamic turbulence is able to create hierarchical structures in the interstellar medium (ISM) that are correlated on a wide range of scales via the energy cascade. We use hierarchical tree diagrams known as dendrograms to characterize structures in synthetic position-position-velocity (PPV) emission cubes of isothermal magnetohydrodynamic turbulence. We show that the structures and degree of hierarchy observed in PPV space are related to the presence of self-gravity and the global sonic and Alfvenic Mach numbers. Simulations with higher Alfvenic Mach number, self-gravity and supersonic flows display enhanced hierarchical structure. We observe a strong dependency on the sonic and Alfvenic Mach numbers and self-gravity when we apply the statistical moments (i.e., mean, variance, skewness, kurtosis) to the leaf and node distribution of the dendrogram. Simulations with self-gravity, larger magnetic field and higher sonic Mach number have dendrogram distributions with higher statistical moments. Application of the dendrogram to three-dimensional density cubes, also known as position-position-position (PPP) cubes, reveals that the dominant emission contours in PPP and PPV are related for supersonic gas but not for subsonic. We also explore the effects of smoothing, thermal broadening, and velocity resolution on the dendrograms in order to make our study more applicable to observational data. These results all point to hierarchical tree diagrams as being a promising additional tool for studying ISM turbulence and star forming regions for obtaining information on the degree of self-gravity, the Mach numbers and the complicated relationship between PPV and PPP data.

79 ASTRONOMY AND ASTROPHYSICS↗

RELAXATION PROCESSES IN SOLAR WIND TURBULENCE

Based on global conservation principles, magnetohydrodynamic (MHD) relaxation theory predicts the existence of several equilibria, such as the Taylor state or global dynamic alignment. These states are generally viewed as very long-time and large-scale equilibria, which emerge only after the termination of the turbulent cascade. As suggested by hydrodynamics and by recent MHD numerical simulations, relaxation processes can occur during the turbulent cascade that will manifest themselves as local patches of equilibrium-like configurations. Using multi-spacecraft analysis techniques in conjunction with Cluster data, we compute the current density and flow vorticity and for the first time demonstrate that these localized relaxation events are observed in the solar wind. Such events have important consequences for the statistics of plasma turbulence.

79 ASTRONOMY AND ASTROPHYSICS↗

Reliable algorithms for power system analysis in the presence of data uncertainties

A robust and reliable power flow analysis represents an essential requirement for many power systems applications as far as network optimization, voltage control, state estimation, and service restoration are concerned. The most common power flow approach, referred to here as a deterministic power flow (PLF), requires precise or 'crisp' values chosen by the analyst for each input variable. The solution provides precise network voltages and flows through each line. The specified values rest upon assumptions about the operating condition derived from historical measurements or predictions about future conditions and thus, cannot be considered accurate. Even in the case where the inputs are based on measurements, inaccuracies arise from time-skew problems, three-phase unbalance, static modeling approximations of dynamic components (e.g., transformer tap changers), variations in line parameters, and so on. The advent of deregulation and competitive power markets will only exacerbate this problem as well-known generation patterns change, loading becomes less predictable and the transmission paths grow more diverse. Conventional methodologies proposed in literature address tolerance analysis of power flow solution by means of detailed probabilistic methods, accounting for the variability and stochastic nature of the input data, and sampling based approaches. In particular uncertainty propagation using sampling based methods, such as the Monte Carlo, requires several model runs that sample various combinations of input values. Since the number of model runs can sometimes be very large, the required computer resources can sometimes be prohibitively expensive resulting in substantial computational demands. As far as probabilistic methods are concerned, they represent a useful tool, especially for planning studies, but, as evidenced by the many discussions reported in literature, they could reveal some shortcomings principally arising from: (1) the non-normal distribution and the statistical dependence of the input data; and (2) the difficulty arising in accurately identifying probability distributions for some input data, such as the power generated by wind or photovoltaic generators. All these could result in time consuming computations with several limitations in practical applications especially in power flow analysis of complex power networks. In order to try and overcome some of these limitations, obtaining thereby comprehensive power flow solution tolerance analysis at adequate computational costs, self validated computation could play a crucial role. Armed with such a vision, this chapter will analyze two advanced techniques for power flow analysis in the presence of data uncertainty namely the boundary power flow and the affine arithmetic power flow.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A Geostatistical Study in Support of CO 2 Storage in Deep Saline Aquifers of the Shenhua CCS Project, Ordos Basin, China

The Shenhua Carbon Capture and Storage (CCS) project at the Shenbei Slope injection site in North Yulin is the first 100,000 ton-per-year scale CCS pilot project in China with an injection operation lasting nearly 3 years. In this study, we investigate various geostatistical methods and their impact on the respective geologic models on which simulation is performed to understand the phenomena observed during 3 years of Shenhua CCS operations. Although there was a brief period of wellhead pressure increase at the injection well, it unexpectedly dropped for most of the time. Another interesting observation showed that the majority of CO 2 gas injection was received by the topmost sandstone Liujiagou formation instead of the basement limestone Majiagou formation, which was predicted to have much more injectivity and storage capacity. Based on the current geostatistical methods and available data, 3 steps of reservoir modeling and flow simulation are carried out and they go from having homogeneous property models to incorporating standard 2-point geostatistical methods to using object-based models. The layer-cake models generate a rather uniform plume shape and increased pressure response. Meanwhile, two-point statistical models add more complexity to the size and shape of CO 2 plume, however are not capable of reproducing the pressure decline behavior. These results demonstrate homogeneous and 2-point geostatistical models are inadequate in interpreting subsurface heterogeneity, both due to their method and data limitations. Further work is being done with object-based models to produce a system of meandering rivers based on the geological concept of Shenhua injection site. This will help offset the data limitation and bring our model closer to geologic reality.

54 ENVIRONMENTAL SCIENCES↗

Speeding Up the Dissipating Energy Flow Based Oscillation Source Detection

This paper enhances the Dissipating Energy Flow (DEF) method for forced oscillation source detection. The development focuses on improving the speed of the DEF method for oscillation source detection employed by ISO-NE. This is accomplished by using multi-signal modal estimation and statistical correlation to achieve robustness and detection accuracy. The effectiveness of the proposed method is tested on simulated and actual oscillation data showing that detection and localization can be achieved with shorter data windows. In addition, the utilization of the DEF as an energy filter to minimize false alarm rates is examined. Finally, real PMU data is used to evaluate the consistency of the DEF method and track the actual direction the Dissipating Energy (DE) flows in the power network.

Kirihara, Kenta↗

Smooth full field reconstruction of velocity and its gradients from noisy scattered velocimetry data in a cross-slot flow

We present a method combining generalized Tikhonov regularization with a finite element approximation for reconstructing smooth velocity and velocity gradient fields from spatially scattered and noisy velocity data in a two-dimensional complex flow domain. Synthetic velocity data for a cross-slot geometry are generated using the Oldroyd-B solution, subsequently perturbed by random noise. Performances of diverse finite element continuity-regularization criterion combinations are tested against noise-free data, while the optimum regularization parameter is determined using generalized cross-validation. The best performance is achieved for the velocity field and its gradients simultaneously by C{sup 2} continuous Hermite finite elements and minimization of a norm of the velocity's third derivative. The standard regularization criterion based on the second derivative is shown to lead to systematic distortions in boundary regions, allowing therefore a lower reduction in the statistical error. Furthermore, optical fields are calculated by applying a differential constitutive equation directly to the reconstructed flow kinematics; high quality velocity gradient fields are shown to be an essential prerequisite for their reliable prediction. Overall, the method is expedient to implement and does not require boundary conditions.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Divide and conquer: Learning chaotic dynamical systems with multistep penalty neural ordinary differential equations

Forecasting high-dimensional dynamical systems is a fundamental challenge in various fields, such as geosciences and engineering. Neural Ordinary Differential Equations (NODEs), which combine the power of neural networks and numerical solvers, have emerged as a promising algorithm for forecasting complex nonlinear dynamical systems. However, classical techniques used for NODE training are ineffective for learning chaotic dynamical systems. In this work, we propose a novel NODE-training approach that allows for robust learning of chaotic dynamical systems. Here, our method addresses the challenges of non-convexity and exploding gradients associated with underlying chaotic dynamics. Training data trajectories from such systems are split into multiple, non-overlapping time windows. In addition to the deviation from the training data, the optimization loss term further penalizes the discontinuities of the predicted trajectory between the time windows. The window size is selected based on the fastest Lyapunov time scale of the system. Multi-step penalty(MP) method is first demonstrated on Lorenz equation, to illustrate how it improves the loss landscape and thereby accelerates the optimization convergence. MP method can optimize chaotic systems in a manner similar to least-squares shadowing with significantly lower computational costs. Our proposed algorithm, denoted the Multistep Penalty NODE, is applied to chaotic systems such as the Kuramoto-Sivashinsky equation, the two-dimensional Kolmogorov flow, and ERA5 reanalysis data for the atmosphere. It is observed that MP-NODE provide viable performance for such chaotic systems, not only for short-term trajectory predictions but also for invariant statistics that are hallmarks of the chaotic nature of these dynamics.

Chaotic dynamical systems↗