Search NASA⌕ Search

SEARCH · Search NASA

Results for “high performance and distributed computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,549 records · Page 86

Large-scale seismic waveform quality metric calculation using Hadoop

Here in this work we investigated the suitability of Hadoop MapReduce and Apache Spark for large-scale computation of seismic waveform quality metrics by comparing their performance with that of a traditional distributed implementation. The Incorporated Research Institutions for Seismology (IRIS) Data Management Center (DMC) provided 43 terabytes of broadband waveform data of which 5.1 TB of data were processed with the traditional architecture, and the full 43 TB were processed using MapReduce and Spark. Maximum performance of ~0.56 terabytes per hour was achieved using all 5 nodes of the traditional implementation. We noted that I/O dominated processing, and that I/O performance was deteriorating with the addition of the 5th node. Data collected from this experiment provided the baseline against which the Hadoop results were compared. Next, we processed the full 43 TB dataset using both MapReduce and Apache Spark on our 18-node Hadoop cluster. We conducted these experiments multiple times with various subsets of the data so that we could build models to predict performance as a function of dataset size. We found that both MapReduce and Spark significantly outperformed the traditional reference implementation. At a dataset size of 5.1 terabytes, both Spark and MapReduce were about 15 times faster than the reference implementation. Furthermore, our performance models predict that for a dataset of 350 terabytes, Spark running on a 100-node cluster would be about 265 times faster than the reference implementation. We do not expect that the reference implementation deployed on a 100-node cluster would perform significantly better than on the 5-node cluster because the I/O performance cannot be made to scale. Finally, we note that although Big Data technologies clearly provide a way to process seismic waveform datasets in a high-performance and scalable manner, the technology is still rapidly changing, requires a high degree of investment in personnel, and will likely require significant changes in other parts of our infrastructure. Nevertheless, we anticipate that as the technology matures and third-party tool vendors make it easier to manage and operate clusters, Hadoop (or a successor) will play a large role in our seismic data processing.

58 GEOSCIENCES↗

A New LMP-Sensitivity-Based Heterogeneous Decomposition for Transmission and Distribution Coordinated Economic Dispatch

Transmission and distribution coordinated economic dispatch (TDCED) will be necessary to settle the problems caused by high penetrations of distributed generators in future grids. An efficient heterogeneous decomposition algorithm (HGD) was proposed to solve the TDCED, but it may diverge occasionally. To overcome this shortcoming, a new HGD (N-HGD) with enhanced convergency is proposed and studied in this paper. Compared with the previous HGD, the N-HGD similarly decomposes the TDCED into transmission ED and distribution ED subproblems, but it considers the sensitivity of the boundary locational marginal price to load injections to enhance convergency and avoid divergence. Two kinds of sensitivity computing methods, M-c and M-p, are studied. M-c is based on a centralized sensitivity equation, executed on the transmission side. M-p is based on a probing mechanism and can be executed distributedly on the distribution side. The reason for the N-HGD's improved convergency is theoretically analyzed, and the optimality is proven. Numerical tests show that N-HGD performs better than the original HGD, as well as a penalty-based modified HGD that needs a careful parametertuning process. Furthermore, compared with M-c, an M-p-based N-HGD is preferable because it has a much lower computational cost and no additional communicational cost.

distribution↗

ResStock™ v3.2.0 [SWR-19-15 and SWR-20-07]

The ResStock™ analysis tool was built on NREL's OpenStudio® platform, and is a project geared at modeling existing residential building stocks at national, regional, or local scales with a high-degree of granularity (e.g., one physics-based simulation model for every 200 dwelling units), using the EnergyPlus® simulation engine. Information about ComStock™, a sister tool for modeling the commercial building stock, can be found here: https://www.nrel.gov/buildings/comstock.html This repository contains: Housing characteristics of the U.S. residential building stock, in the form of conditional probability distributions stored as tab-separated value (.tsv) files. Comments at the bottom of each file document data sources and assumptions for each. A library of housing characteristic "options" that translate high-level characteristic parameters into arguments for OpenStudio measures, and which are referenced by the housing characteristic .tsv files and building energy upgrades defined in project definition files Project definition files: v2.3.0 and later: buildstockbatch YML files openable in any text editor v2.2.5 and prior: Project folder openable in PAT Unit-level OpenStudio Measures for automatically constructing OpenStudio Models of each representative dwelling unit model: v3.0.0 and later: OpenStudio-HPXML Measures v2.5.0 and prior: OpenStudio Measures Higher-level OpenStudio Measures for controlling simulation inputs and outputs This repository does not contain software for running ResStock simulations, which can be found as follows: Versions 2.3.0 and later only support the use of buildstockbatch for deploying simulations on high-performance or cloud computing. Version 2.3.0 also removed separate projects for single-family detached and multifamily buildings, in lieu of a combined project_national representing the U.S. residential building stock. See the changelog for more details. Versions 2.2.5 and prior support the use of the publicly available OpenStudio-PAT software as an interface for deploying simulations on cloud computing. Read the documentation for v2.2.5.

Horowitz, Scott↗

Accelerated Data Analytics for Power-System Time-Series (ADAPT) [Final Project Report]

Over the past decade, electric utilities have made significant progress in deploying networks of phasor measurement units (PMUs). The high-speed measurements provided by PMUs are valuable for offline analysis, but the sheer volume of data presents a challenge for utilities. The Accelerated Data Analytics for Power-System Time-Series (ADAPT) project was created to address this challenge by developing SciSync, an open-source software tool that enables utilities to rapidly read, process, analyze, and review grid measurements. SciSync was designed to provide the capabilities of Archive Walker, a research tool developed by PNNL, along with the reliability and performance of commercial-grade software.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Reviews and syntheses: Opportunities for robust use of peak intensities from high-resolution mass spectrometry in organic matter studies

Abstract. Earth's biogeochemical cycles are intimately tied to the biotic and abiotic processing of organic matter (OM). Spatial and temporal variations in OM chemistry are often studied using direct infusion, high-resolution Fourier transform mass spectrometry (FTMS). An increasingly common approach is to use ecological metrics (e.g., within-sample diversity) to summarize high-dimensional FTMS data, notably Fourier transform ion cyclotron resonance mass spectrometry (FT-ICR MS). However, problems can arise when FTMS peak-intensity data are used in a way that is analogous to abundances in ecological analyses (e.g., species abundance distributions). Using peak-intensity data in this way requires the assumption that intensities act as direct proxies for concentrations. Here, we show that comparisons of the same peak across samples (within-peak) may carry information regarding variations in relative concentration, but comparing different peaks (between-peak) within or between samples does not. We further developed a simulation model to study the quantitative implications of using peak intensities to compute ecological metrics (e.g., intensity-weighted mean properties and diversity) that rely on information about both within-peak and between-peak shifts in relative abundance. We found that, despite analytical limitations in linking concentration to intensity, ecological metrics often perform well in terms of providing robust qualitative inferences and sometimes quantitatively accurate estimates of diversity and mean molecular characteristics. We conclude with recommendations for the robust use of peak intensities for natural organic matter studies. A primary recommendation is the use and extension of the simulation model to provide objective guidance on the degree to which conceptual and quantitative inferences can be made for a given analysis of a given dataset. Broad use of this approach can help ensure rigorous scientific outcomes from the use of FTMS peak intensities in environmental applications.

54 ENVIRONMENTAL SCIENCES↗

Turbulence Measurements and Computations for the Predication of Broadband Noise in High Bypass Ratio Fans

Work was performed under this grant with a view to providing the experimental and computational results needed to improve the prediction of broadband stator noise in large bypass ratio aircraft engines. The central hypothesis of our study was that a large fraction of this noise was generated by the fan tip leakage vortices. More specifically, that these vortices are a significant component of the fan wake turbulence and they contain turbulent eddies of a type that can produce significant broadband noise. To test this hypothesis we originally proposed experimental work and computations with the following objectives: (1) to build a large scale two-dimensional cascade with a tip gap and a stationary endwall that, as far as possible, simulates the fan tip geometry, (2) to build a moving endwall for use with the large scale cascade, (3) to measure, in detail, the turbulence structure and spectrum generated by the blade wake and tip leakage vortex, for both endwall configurations, (4) to use the CFD to compute the flow and turbulence distributions for both the experimental configurations and the ADP fan, (5) to provide the experimental and CFD results for the cascades and the physical understanding gained from their study as a basis for improving the broadband noise prediction method. In large part these objectives have been achieved. The most important achievements and findings of our experimental and computational efforts are summarized below. The bibliography at the end of this report includes a list of all publications produced to date under this project. Note that this list is necessarily incomplete the task of publication (particularly in journal papers) continues.

Devenport, William J.↗

Angular Distribution of Elastically Scattered Electrons Determined and Its Effect on Collector Performance Computed

It has been demonstrated that the suppression of secondary electron emission significantly improves the performance of electron beam collectors (ref. 1). However, a complete analysis of the effects of secondary electron emission with respect to collector performance has not been possible because of the lack of quantitative data on angular distributions of secondary electrons. Secondary electrons are emitted with energies ranging from near zero to the energy of the incident primary. For our purposes, we define elastically scattered electrons as secondary electrons within 20 percent of the incident energy. Elastically scattered electrons are of great concern because their energy allows them to follow trajectories that can carry them almost anywhere within the vacuum envelope. If these secondaries leave the collector and reenter the slow wave circuit, they can produce undesired signal distortion and oscillation.This apparatus, which was built by Krainsky (ref. 2), was used at the NASA Lewis Research Center to obtain detailed measurements of the angular distributions of elastically scattered secondaries. Data were obtained for three surfaces of significant interest to collector applications: highly polished copper, copper roughened by ion sputtering, and isotropic graphite. Lewis researchers discovered that elastically scattered electrons have a complex angular distribution that is strongly dependent on the atomic number and surface morphology of the target material, as well as the energy and angle of incidence of the primary beam. At low energies, secondary emission from polished copper in the chosen energy range is primarily directed back to the source of primary electrons (backscattering). Forward scattering increases with primary energy until, at high energies, forward scattering dominates the angular distribution. Although back-scattered secondaries dominate the distributions of the textured copper surface, the yield is substantially lower. From the standpoint of secondary emission, isotropic graphite is the most attractive material because it exhibits low yield and little back scattering.

Krainsky, Isay L.↗

Automated reaction kinetics and network exploration (Arkane): A statistical mechanics, thermodynamics, transition state theory, and master equation software

The open-source statistical mechanics software described here, Arkane–Automated Reaction Kinetics and Network Exploration–facilitates computations of thermodynamic properties of chemical species, high-pressure limit reaction rate coefficients, and pressure-dependent rate coefficient over multi-well molecular potential energy surfaces (PES) including the effects of collisional energy transfer on phenomenological kinetics. Arkane can use estimates to fill in information for molecules or reactions where quantum chemistry information is missing. The software solves the internal energy master equation for complex unimolecular reaction systems. Inputs to the software include converged electronic structure computations performed by the user using a variety of supported software packages (Gaussian, Molpro, Orca, TeraChem, Q-Chem, Psi4). The software outputs high-pressure limit rate coefficients and pressure-dependent phenomenological rate coefficients, as well as computed thermodynamic properties (enthalpy, entropy, and constant pressure heat capacity) with added energy corrections. Some of the key features of Arkane include treatment of 1D, 2D or ND hindered internal rotation modes, treatment of free internal rotation modes, quantum tunneling effect consideration, transition state theory (TST) and Rice-Ramsperger-Kassel-Marcus (RRKM) rate coefficient computations, master equation solution with four implemented methods, inverse-Laplace transform of high-pressure limit rate coefficients into the energy domain, energy corrections based on bond-additivity or isodesmic reactions, automated and efficient PES exploration, and PES sensitivity analysis. The present work describes the design of Arkane, how it should be used, and refers to the theory that it employs. Arkane is distributed via the RMG-Py software suite (https://github.com/ReactionMechanismGenerator/RMG-Py).

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Computational Framework for Machine-Learning-Enabled 13 C Fluxomics

13 C metabolic flux analysis (MFA) has emerged as a powerful tool for synthetic biology. This optimization-based approach suffers long computation time and unstable solutions depending on the initial guess. Here, we develop a machine-learning-based framework for 13 C fluxomics. Specifically, training and test data sets are generated by metabolic network decomposition and flux sampling, in which flux ratios at metabolic nodes and simulated labeling patterns of metabolites are used as training targets and features, respectively. To improve prediction accuracy and simplify the model, automated processes are developed for flux ratio selection based on solvability and feature screening based on importance. We found that predictive performance can be significantly improved using both amino acids and central carbon metabolites in comparison with amino acids alone. Together with measured external fluxes, the predicted flux ratios determine the mass balance system, yielding global flux distributions. This approach is validated by flux estimation using both simulated and experimental data in comparison with canonical 13 C MFA. The approach represents a reliable fluxomics method readily applicable to high-throughput metabolic phenotyping, which highlights the advances of intelligent learning algorithms in synthetic biology, specifically in the Test and Learn stage of the Design-Build-Test-Learn cycle.

13C metabolic flux analysis↗

Tropical Cyclone Super Resolution using conditional diffusion denoising probabilistic model from mesoscale simulation to LES

Accurate modeling of tropical cyclone wind fields is essential for the design, risk assessment, and operational planning of offshore energy infrastructure. While mesoscale simulations are widely used thanks to their computational efficiency, they lack the necessary resolution to capture key features such as wind shear and veer profiles as well as the distribution turbulent kinetic energy (TKE). High-fidelity large-eddy simulation (LES) models on the other hand, can resolve turbulent structures and provide a more accurate representation of the complex wind field, albeit at a higher computational cost. To address this modeling gap, we introduce a two-part generative framework to enhance the resolution and physics-capturing ability of mesoscale simulations. First, a reduced-order model based on Karhunen–Loève (KL) decomposition is used to extract dominant spatial modes from one-dimensional mean wind profiles. A multilayer perceptron (MLP) is trained to map mesoscale mode weights to their LES counterparts, enabling accurate reconstruction of vertical velocity profiles. Second, a conditional Diffusion Denoising Probabilistic Model (DDPM) is developed to super-resolve coarse and low-fidelity mesoscale velocity fields, recovering fine-scale turbulence structures and stress distributions. The framework is evaluated across different tropical cyclone intensity categories defined by the Saffir–Simpson scale and demonstrates strong performance in both interpolation and extrapolation tasks. The generated fields accurately reproduce spatial coherence, stress distributions, and spectral energy characteristics observed in LES data. By bridging the fidelity gap between mesoscale and LES outputs, this approach offers a scalable, data-driven solution for enhancing the representation of tropical cyclone wind fields, enabling more robust offshore energy infrastructure systems design in tropical-cyclone-prone areas.

17 WIND ENERGY↗

Application of new electro-optic technology to Space Station Freedom data management system

A low risk design methodology to permit the local bus structures to support increased data carrying capacities and to speed messages and data flow between nodes or stations on the Space Station Freedom Data Management System in anticipation of growing requirements was evaluated and recommended. The recommended design employs a collateral fiber optic technique that follows a NATO avionic standard that is developed, tested, and available. Application of this process will permit a potential 25 fold increase in data transfer performance on the local wire bus network with a fiber optic network, maintaining the functionality of the low-speed bus and supporting all of the redundant transmission and fault detection capabilities designed into the existing system. The application of wavelength division multiplexing (WDM) technology to both the local data bus and global data bus segments of the Data Management System to support anticipated additional highspeed data transmission requirements was also examined. Techniques were examined to provide a dual wavelength implementation of the fiber optic collateral networks. This dual wavelength implementation would permit each local bus to support two simultaneous high-speed transfers on the same fiber optic bus structure and operate within the limits of the existing protocol standard. A second WDM study examined the use of spectral sliced technology to provide a fourfold increase in the Fiber Distributed Data Interface (FDDI) global bus networks without requiring modifications to the existing installed cable plant. Computer simulations presented indicated that this data rate improvement can be achieved with commercially available optical components.

Husbands, C. R.↗

Opus: A Coordination Language for Multidisciplinary Applications

Data parallel languages, such as High Performance fortran, can be successfully applied to a wide range of numerical applications. However, many advanced scientific and engineering applications are multidisciplinary and heterogeneous in nature, and thus do not fit well into the data parallel paradigm. In this paper we present Opus, a language designed to fill this gap. The central concept of Opus is a mechanism called ShareD Abstractions (SDA). An SDA can be used as a computation server, i.e., a locus of computational activity, or as a data repository for sharing data between asynchronous tasks. SDAs can be internally data parallel, providing support for the integration of data and task parallelism as well as nested task parallelism. They can thus be used to express multidisciplinary applications in a natural and efficient way. In this paper we describe the features of the language through a series of examples and give an overview of the runtime support required to implement these concepts in parallel and distributed environments.

Chapman, Barbara↗

Polar Dunes Resolved by the Mars Orbiter Laser Altimeter Gridded Topography and Pulse Widths

The Mars Orbiter Laser Altimeter (MOLA) polar data have been refined to the extent that many features poorly imaged by Viking Orbiters are now resolved in densely gridded altimetry. Individual linear polar dunes with spacings of 0.5 km or more can be seen as well as sparsely distributed and partially mantled dunes. The refined altimetry will enable measurements of the extent and possibly volume of the north polar ergs. MOLA pulse widths have been recalibrated using inflight data, and a robust algorithm applied to solve for the surface optical impulse response. It shows the surface root-mean-square (RMS) roughness at the 75-m-diameter MOLA footprint scale, together with a geological map. While the roughness is of vital interest for landing site safety studies, a variety of geomorphological studies may also be performed. Pulse widths corrected for regional slope clearly delineate the extent of the polar dunes. The MOLA PEDR profile data have now been re-released in their entirety (Version L). The final Mission Experiment Gridded Data Records (MEGDR's) are now provided at up to 128 pixels per degree globally. Densities as high as 512 pixels per degree are available in a polar stereographic projection. A large computational effort has been expended in improving the accuracy of the MOLA altimetry themselves, both in improved orbital modeling and in after-the-fact adjustment of tracks to improve their registration at crossovers. The current release adopts the IAU2000 rotation model and cartographic frame recommended by the Mars Cartography Working Group. Adoption of the current standard will allow registration of images and profiles globally with an uncertainty of less than 100 m. The MOLA detector is still operational and is currently collecting radiometric data at 1064 nm. Seasonal images of the reflectivity of the polar caps can be generated with a resolution of about 300 m per pixel.

Gregory A Neumann↗

A Low-Enriched Uranium (LEU) option for the conversion of FRM II

The Forschungs-Neutronenquelle Heinz Maier-Leibnitz (FRM II) is Germany’s most powerful research reactor and uses Highly Enriched Uranium (HEU) fuel enriched at 93 %. The Technical University of Munich (TUM) operates the reactor and has been mandated to convert the FRM II to a lower-enrichment fuel. In preparation for the lower-enrichment fuel downselection, planned for 2023, TUM is evaluating multiple conversion scenarios. In this paper, it is demonstrated that a conversion of FRM II to Low-Enriched Uranium (LEU) is scientifically possible when using the novel monolithic U-10Mo fuel system, which is currently in the qualification process. As a research reactor, safety criteria, neutron flux distribution and cycle length are key metrics. To begin, neutronic and thermal-hydraulic models were created based on current technical drawings and relevant material properties. Specifically tailored computational methods and coupling schemes have also been developed to properly evaluate all relevant characteristics for the conversion of the FRM II reactor. Using these models and methods, a systematic parameter study was performed to explore the defined design space. The results of that study indicate that many LEU designs using monolithic U-10Mo appear to be viable to convert FRM II to LEU. One example of an LEU solution for the FRM II reactor that fulfills the stated safety, compatibility and scientific performance requirements is discussed in more detail.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Mutual capacitance of liquid conductors in deformable tactile sensing arrays

Advances in highly deformable electronics are needed in order to enable emerging categories of soft computing devices ranging from wearable electronics, to medical devices, and soft robotic components. The combination of highly elastic substrates with intrinsically stretchable conductors holds the promise of enabling electronic sensors that can conform to curved objects, reconfigurable displays, or soft biological tissues, including the skin. Here, we contribute sensing principles for tactile (mechanical image) sensors based on very low modulus polymer substrates with embedded liquid metal microfluidic arrays. The sensors are fabricated using a single-step casting method that utilizes fine nylon filaments to produce arrays of cylindrical channels on two layers. The liquid metal (gallium indium alloy) conductors that fill these channels readily adopt the shape of the embedding membrane, yielding levels of deformability greater than 400%, due to the use of soft polymer substrates. We modeled the sensor performance using electrostatic theory and continuum mechanics, yielding excellent agreement with experiments. Using a matrix-addressed capacitance measurement technique, we are able to resolve strain distributions with millimeter resolution over areas of several square centimeters.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Molecular hydrodynamics: Vortex formation and sound wave propagation

In the present study, quantitative feasibility tests of the hydrodynamic description of a two-dimensional fluid at the molecular level are performed, both with respect to length and time scales. Using high-resolution fluid velocity data obtained from extensive molecular dynamics simulations, we computed the transverse and longitudinal components of the velocity field by the Helmholtz decomposition and compared them with those obtained from the linearized Navier-Stokes (LNS) equations with time-dependent transport coefficients. By investigating the vortex dynamics and the sound wave propagation in terms of these field components, we confirm the validity of the LNS description for times comparable to or larger than several mean collision times. The LNS description still reproduces the transverse velocity field accurately at smaller times, but it fails to predict characteristic patterns of molecular origin visible in the longitudinal velocity field. Based on these observations, we validate the main assumptions of the mode-coupling approach. The assumption that the velocity autocorrelation function can be expressed in terms of the fluid velocity field and the tagged particle distribution is found to be remarkably accurate even for times comparable to or smaller than the mean collision time. This suggests that the hydrodynamic-mode description remains valid down to the molecular scale.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Optimal net-load balancing in smart grids with high PV penetration

Mitigating mismatches in supply demand curve is critical for smooth power grid operation. Traditionally, load curtailment techniques such as Demand Response (DR) have been used for this purpose. However, smart grids with high PV penetration sometimes exhibit supply surplus causing over-voltages. Thus, load curtailment techniques cannot be the only component of a net-load balancing framework. Supply curtailment techniques such as Volt-Var Optimizations are complex and computationally expensive. This increases the complexity of net-load balancing systems used by the grid operator and limits their scalability. Recently, new technologies have been developed that enable the rapid and selective connection of PV modules of an installation to the grid. Taking advantage of these advancements, we develop a unified optimal net-load balancing framework which performs both load and solar curtailment. We show that when the available curtailment values are discrete, this problem is NP-hard and develop bounded approximation algorithms for minimizing the curtailment cost. Our algorithms produce fast solutions, given the tight timing constraints required for grid operation. We also incorporate the notion of fairness to ensure that curtailment is evenly distributed among all the nodes. Finally, we develop an online algorithm which performs net-load balancing using only data available for the current interval. Using both theoretical analysis and practical evaluations, we show that our net-load balancing algorithms provide solutions which are close to optimal in a small amount of time.

14 SOLAR ENERGY↗

Integrating Cache Performance Modeling and Tuning Support in Parallelization Tools

With the resurgence of distributed shared memory (DSM) systems based on cache-coherent Non Uniform Memory Access (ccNUMA) architectures and increasing disparity between memory and processors speeds, data locality overheads are becoming the greatest bottlenecks in the way of realizing potential high performance of these systems. While parallelization tools and compilers facilitate the users in porting their sequential applications to a DSM system, a lot of time and effort is needed to tune the memory performance of these applications to achieve reasonable speedup. In this paper, we show that integrating cache performance modeling and tuning support within a parallelization environment can alleviate this problem. The Cache Performance Modeling and Prediction Tool (CPMP), employs trace-driven simulation techniques without the overhead of generating and managing detailed address traces. CPMP predicts the cache performance impact of source code level "what-if" modifications in a program to assist a user in the tuning process. CPMP is built on top of a customized version of the Computer Aided Parallelization Tools (CAPTools) environment. Finally, we demonstrate how CPMP can be applied to tune a real Computational Fluid Dynamics (CFD) application.

Waheed, Abdul↗