Search NASA⌕ Search

SEARCH · Search NASA

Results for “data aggregation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 865 records · Page 48

Theoretical investigations of the physical properties of zircon-type YVO{sub 4}

The crystal structure, electronic properties, elastic properties, hardness and thermodynamic properties of the laser host material zircon-type YVO{sub 4} are studied using the pseudopotential plane wave method within the local density approximation (LDA) and generalized gradient approximation (GGA). The calculated ground state values such as lattice parameter, bulk modulus and its pressure derivative, the band structure and densities of states were in favorable agreement with previous works and the existed experimental data. The elastic constants C{sub ij}, the aggregate elastic moduli (B, G, E), Poisson's ratio and elastic anisotropy have been investigated. In YVO{sub 4}, V-O bonds with shorter bond length and larger Mulliken population make great contribution to hardness than Y-O bonds. Using quasi-harmonic Debye model considering the phonon effects, bulk modulus, heat capacity and thermal expansion coefficient of YVO{sub 4} are calculated within a range of 0-6 GPa and 0-1200 K. - Graphical Abstract: (a) Directional dependence of Young's modulus in zircon-type YVO{sub 4} and (b) projections of the directional dependent Young's modulus in different planes for zircon-type YVO{sub 4}. The units are in GPa. Highlights: Black-Right-Pointing-Pointer This paper systematically studied the physical properties of zircon-type YVO{sub 4} from first-principles calculations. Black-Right-Pointing-Pointer Zircon-type YVO{sub 4} is mechanically stable and it is ductile for B/G>1.75 and v>0.26. Black-Right-Pointing-Pointer Universal elastic anisotropy index A{sup U} for zircon-type YVO{sub 4} is 2.41, so YVO{sub 4} is anisotropic. Black-Right-Pointing-Pointer V-O bonds with shorter bond length and larger Mulliken population make greater contribution to the hardness of YVO{sub 4}.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Scalable line and plane relaxation in a parallel structured multigrid solver

The efficient solution of sparse, linear systems that arise through the discretization of partial differential equations remains a key challenge for a range of high performance scientific simulations. One approach for reducing data movement and improving performance is by exposing and exploiting structure in a problem through the use of robust structured multilevel solvers. By choosing coarsening that preserves the structure of the problem, these methods maintain efficient structured computation and communication throughout the multigrid hierarchy. However, when coarsening is not permitted to be dependent on the operator, anisotropy must be addressed by the smoother — producing error compatible for coarse-grid correction with structured coarsening. Here, the components required in a scalable parallel structured solver are described with a focus on memory and communication efficiency of robust smoothers. While the implementation of communication and memory reduction techniques in smoothers integrated in a complete 3D solver present a significant engineering challenge, a novel approach is proposed that addresses these challenges systematically through a change to the solver’s execution model. Enabled by user-level threading paired with a set of data and communication abstractions, this approach permits seamless aggregation of communication in plane smoothers — directly reusing code for a 2D distributed multilevel cycle. Results show an effective reduction in communication costs for coarse-grid problems, and result in a speedup of 8.7x in smoothing routines shown in Fig. 12 using this approach. This produces a significant improvement to strong scalability while maintaining favorable weak scaling behavior. Finally, a parallel scaling study using a series of refined meshes is included that demonstrates the effectiveness of this approach in an application of interest.

97 MATHEMATICS AND COMPUTING↗

Light absorption and plasmon – exciton interaction in three-layer nanorods with a gold core and outer shell composed of molecular J- and H-aggregates of dyes

Optical properties of hybrid rod-like nanoparticles, consisting of a gold core, an intermediate passive organic layer (spacer) and outer layer of ordered molecular cyanine dye aggregates, are experimentally and theoretically investigated. It is shown that these dyes can form not only ordered J-aggregates but also H-aggregates (differing by the packing angle of dye molecules in an aggregate and having other spectral characteristics) in the outer shell of the hybrid nanostructure. Absorption spectra of synthesised three-layer nanorods are recorded, and their sizes are determined. The optical properties of the composite nanostructures under study are found to differ significantly, depending on the type of the molecular aggregate formed in the outer shell. The experimental data are quantitatively explained based on computer simulation using the finite-difference time-domain (FDTD) method, and characteristic features of the plasmon – exciton interaction in the systems under study are revealed. (nanophotonics)

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

PERIODIC VARIABILITY OF LOW-MASS STARS IN SLOAN DIGITAL SKY SURVEY STRIPE 82

We present a catalog of periodic stellar variability in the 'Stripe 82' region of the Sloan Digital Sky Survey. After aggregating and re-calibrating catalog-level data from the survey, we ran a period-finding algorithm (Supersmoother) on all point-source light curves. We used color selection to identify systems that are likely to contain low-mass stars, in particular M dwarfs and white dwarfs. In total, we found 207 candidates, the vast majority of which appear to be in eclipsing binary systems. The catalog described in this paper includes 42 candidate M dwarf/white dwarf pairs, four white dwarf pairs, 59 systems whose colors indicate they are composed of two M dwarfs and whose light-curve shapes suggest they are in detached eclipsing binaries, and 28 M dwarf systems whose light-curve shapes suggest they are in contact binaries. We find no detached systems with periods longer than 3 days, thus the majority of our sources are likely to have experienced orbital spin-up and enhanced magnetic activity. Indeed, 26 of 27 M dwarf systems that we have spectra for show signs of chromospheric magnetic activity, far higher than the 24% seen in field stars of the same spectral type. We also find binaries composed of stars that bracket the expected boundary between partially and fully convective interiors, which will allow the measurement of the stellar mass-radius relationship across this transition. The majority of our contact systems have short orbital periods, with small variance (0.02 days) in the sample near the observed cutoff of 0.22 days. The accumulation of these stars at short orbital period suggests that the process of angular momentum loss, leading to period evolution, becomes less efficient at short periods. These short-period systems are in a novel regime for studying the effects of orbital spin-up and enhanced magnetic activity, which are thought to be the source of discrepancies between mass-radius predictions and measurements of these properties in eclipsing binaries.

79 ASTRONOMY AND ASTROPHYSICS↗

Optimizing the Four-Index Integral Transform Using Data Movement Lower Bounds Analysis

The four-index integral transform is a fundamental and computationally demanding calculation used in many computational chemistry suites such as NWChem. It transforms a four-dimensional tensor from an atomic basis to a molecular basis. This transformation is most efficiently implemented as a sequence of four tensor contractions that each contract a four-dimensional tensor with a two-dimensional transformation matrix. Differing degrees of permutation symmetry in the intermediate and final tensors in the sequence of contractions cause intermediate tensors to be much larger than the final tensor and limit the number of electronic states in the modeled systems. Loop fusion, in conjunction with tiling, can be very effective in reducing the total space requirement, as well as data movement. However, the large number of possible choices for loop fusion and tiling, and data/computation distribution across a parallel system, make it challenging to develop an optimized parallel implementation for the four-index integral transform. We develop a novel approach to address this problem, using lower bounds modeling of data movement complexity. We establish relationships between available aggregate physical memory in a parallel computer system and ineffective fusion configurations, enabling their pruning and consequent identification of effective choices and a characterization of optimality criteria. This work has resulted in the development of a significantly improved implementation of the four-index transform that enables higher performance and the ability to model larger electronic systems than the current implementation in the NWChem quantum chemistry software suite.

Rajbhandari, Samyam↗

The crop assessment subsystem: System implementation and approaches used for the generation of crop production reports

The primary responsibility of the crop assessment subsystem (CAS) during the three phases of LACIE was to produce crop reports that included estimates of wheat area, yield, and production, as well as a specified set of associated statistical descriptors. The operations of CAS are described with emphasis on sampling strategy, input/output data, evolution of aggregation/reporting system capabilities, and CAS aggregation procedures.

Mcallum, W. E.↗

A Boundary Condition for Simulation of Flow Over Porous Surfaces

A new boundary condition is presented.for simulating the flow over passively porous surfaces. The model builds on the prior work of R.H. Bush to eliminate the need for constructing grid within an underlying plenum, thereby simplifying the numerical modeling of passively porous flow control systems and reducing computation cost. Code experts.for two structured-grid.flow solvers, TLNS3D and CFL3D. and one unstructured solver, USM3Dns, collaborated with an experimental porosity expert to develop the model and implement it into their respective codes. Results presented,for the three codes on a slender forebody with circumferential porosity and a wing with leading-edge porosity demonstrate a good agreement with experimental data and a remarkable ability to predict the aggregate aerodynamic effects of surface porosity with a simple boundary condition.

Frink, Neal T.↗

Processing AIRS Scientific Data Through Level 3

The Atmospheric Infra-Red Sounder (AIRS) Science Processing System (SPS) is a collection of computer programs, known as product generation executives (PGEs). The AIRS SPS PGEs are used for processing measurements received from the AIRS suite of infrared and microwave instruments orbiting the Earth onboard NASA's Aqua spacecraft. Early stages of the AIRS SPS development were described in a prior NASA Tech Briefs article: Initial Processing of Infrared Spectral Data (NPO-35243), Vol. 28, No. 11 (November 2004), page 39. In summary: Starting from Level 0 (representing raw AIRS data), the AIRS SPS PGEs and the data products they produce are identified by alphanumeric labels (1A, 1B, 2, and 3) representing successive stages or levels of processing. The previous NASA Tech Briefs article described processing through Level 2, the output of which comprises geo-located atmospheric data products such as temperature and humidity profiles among others. The AIRS Level 3 PGE samples selected information from the Level 2 standard products to produce a single global gridded product. One Level 3 product is generated for each day s collection of Level 2 data. In addition, daily Level 3 products are aggregated into two multiday products: an eight-day (half the orbital repeat cycle) product and monthly (calendar month) product.

Granger, Stephanie↗

Hard Disk/Solid State Drive Synergy in Support of Data-Intensive Computing [Slides]

Data-intensive applications are becoming increasingly common in high-performance computing. Examples include combustion simulation, human genome analysis, and satellite image processing. Efficient access of data sets is critical to the performance of these applications. Because of the size of the data today's economically feasible approach is to store the data files on an array of hard disks or data servers equipped with hard disks and managed by a parallel file system such as PVFS or Lustre wherein the data is striped over a (large) number of disks for high aggregate I/O throughout. With file striping, a request for a segment of logically contiguous file space is decomposed into multiple sub-requests, each to a different server. While the data unit for this striping is usually reasonably large to benefit disk efficiency, the first and/or last sub-requests can be much smaller than the striping unit if the request does not align with the striping pattern, severely compromising hard disk efficiency and thus application performance. We propose to exploit solid state drives (SSD), whose efficiency is much less sensitive to small random accesses, to enable the alignment of requests to disk with the data striping pattern. In this scheme hard disks mainly serve large, aligned, sequential requests, with SSDs serving small or unaligned requests, thus respecting the relative cost, performance, and durability characteristics of the two media, and thereby achieving synergy in performance/cost. We will describe the design of the proposed scheme, its implementation on CCS-7's Darwin cluster, and performance results.

97 MATHEMATICS AND COMPUTING↗

Stream Temperature Predictions for River Basin Management in the Pacific Northwest and Mid-Atlantic Regions Using Machine Learning

Stream temperature (Ts) is an important water quality parameter that affects ecosystem health and human water use for beneficial purposes. Accurate Ts predictions at different spatial and temporal scales can inform water management decisions that account for the effects of changing climate and extreme events. In particular, widespread predictions of Ts in unmonitored stream reaches can enable decision makers to be responsive to changes caused by unforeseen disturbances. In this study, we demonstrate the use of classical machine learning (ML) models, support vector regression and gradient boosted trees (XGBoost), for monthly Ts predictions in 78 pristine and human-impacted catchments of the Mid-Atlantic and Pacific Northwest hydrologic regions spanning different geologies, climate, and land use. The ML models were trained using long-term monitoring data from 1980–2020 for three scenarios: (1) temporal predictions at a single site, (2) temporal predictions for multiple sites within a region, and (3) spatiotemporal predictions in unmonitored basins (PUB). In the first two scenarios, the ML models predicted Ts with median root mean squared errors (RMSE) of 0.69–0.84 °C and 0.92–1.02 °C across different model types for the temporal predictions at single and multiple sites respectively. For the PUB scenario, we used a bootstrap aggregation approach using models trained with different subsets of data, for which an ensemble XGBoost implementation outperformed all other modeling configurations (median RMSE 0.62 °C).The ML models improved median monthly Ts estimates compared to baseline statistical multi-linear regression models by 15–48% depending on the site and scenario. Air temperature was found to be the primary driver of monthly Ts for all sites, with secondary influence of month of the year (seasonality) and solar radiation, while discharge was a significant predictor at only 10 sites. The predictive performance of the ML models was robust to configuration changes in model setup and inputs, but was influenced by the distance to the nearest dam with RMSE <1 °C at sites situated greater than 16 and 44 km from a dam for the temporal single site and regional scenarios, and over 1.4 km from a dam for the PUB scenario. Our results show that classical ML models with solely meteorological inputs can be used for spatial and temporal predictions of monthly Ts in pristine and managed basins with reasonable (<1 °C) accuracy for most locations.

54 ENVIRONMENTAL SCIENCES↗

FFT-based model for irradiated aggregate microstructures in concrete

The concrete biological shield of light water reactors is exposed to neutron and gamma irradiation throughout its lifetime, which results in the long-term degradation of the concrete’s mechanical properties. Under neutron irradiation, the concrete’s aggregates are subjected to radiation-induced volumetric expansion (RIVE), which strongly depends on the mineral content of the aggregate and exhibits the largest expansion in silicate-bearing minerals. In this work, the authors used the fast Fourier transform-based code Microstructure-Oriented Scientific Analysis of Irradiated Concrete (MOSAIC) in 2D to model the expansion of five different aggregates provided by the Japan Concrete Aging Management Program (JCAMP). Comparable rock specimens were irradiated at the JEEP-II test reactor. The model uses realistic aggregate microstructure reconstruction based on high-resolution characterization images. The model accounts for anisotropic RIVE, thermal expansion, and the associated initiation and propagation of damage. The RIVE models are calibrated based on expansion data in the literature. The authors assume that damage occurs exclusively at interfaces between the particles that compose an aggregate and that these interfaces also exhibit swelling. Using a micromechanical model, the evolution of Young’s modulus with RIVE is calculated for each aggregate and compared with Russian irradiation data. The modeled linear expansion agrees well with the experimentally measured expansion. Furthermore, the model also predicts that anisotropic RIVE and thermal expansion result in an earlier onset of damage with neutron fluence than in the isotropic case.

36 MATERIALS SCIENCE↗

Thermodynamics, morphology, and kinetics of early-stage self-assembly of π-conjugated oligopeptides

Synthetic oligopeptides containing π-conjugated cores self-assemble novel materials with attractive electronic and photophysical properties. All-atom, explicit solvent molecular dynamics simulations of Asp-Phe-Ala-Gly-OPV3-Gly-Ala-Phe-Asp peptides were used to parameterize an implicit solvent model to simulate early-stage self-assembly. Under low-pH conditions, peptides assemble into β-sheet-like stacks with strongly favorable monomer association free energies of ΔF ≈ -25kBT. Aggregation at high-pH produces disordered aggregates destabilized by Coulombic repulsion between negatively charged Asp termini (ΔF ≈ -5kBT). In simulations of hundreds of monomers over 70 ns we observe the spontaneous formation of up to undecameric aggregates under low-pH conditions. Modeling assembly as a continuous-time Markov process, we infer transition rates between different aggregate sizes and microsecond relaxation times for early-stage assembly. Our data suggests a hierarchical model of assembly in which peptides coalesce into small clusters over tens of nanoseconds followed by structural ripening and diffusion limited aggregation on longer time scales. This work provides new molecular-level understanding of early-stage assembly, and a means to study the impact of peptide sequence and aromatic core chemistry upon the thermodynamics, assembly kinetics, and morphology of the supramolecular aggregates.

36 MATERIALS SCIENCE↗

A comparison of thermal zone aggregation methods

The impact of increasing energy prices on building operation budgets has fueled demand for more energy-efficient structures. Existing building energy simulation tools generate an immense amount of data yet comparatively little knowledge. This paper introduces a framework that allows aggregation-based model reduction to operate on geometric building information models. The resulting aggregation sequence provides designers with faster simulations and affords insight into complex multi-scale thermal interactions. A comparison of the trade-off between simulation speed and accuracy for three hierarchical cluster partitioning methods concludes the discussion.

97 MATHEMATICS AND COMPUTING↗

A Unified Ice Microphysical Parameterization for Numerical Models: Development and Testing with In-situ Data

The primary goal of the project is to develop and test new microphysical parameterizations of ice crystal growth. Over the past 7 years, we have developed a bulk ice microphysical model that evolves a measure of particle shape and density during vapor diffusional growth. The method allows smaller, pristine ice crystals to evolve into larger snow crystals in a more natural fashion than traditional microphysical schemes. In doing so, the new method avoids problems that occur when ice is transferred among pre-defined classes. The new model was developed and tested for vapor grown ice only, and so the goal of this project is to develop bulk parameterizations of the missing physics for the model including the prediction of surface deposition coefficients, riming, and aggregation. The parameterizations are being developed using prior laboratory data as a constraint, and then will be tested in simulations of case studies.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Constructing a Database from Multiple 2D Images for Camera Pose Estimation and Robot Localization

The LMDB (Landmark Database) Builder software identifies persistent image features (landmarks) in a scene viewed multiple times and precisely estimates the landmarks 3D world positions. The software receives as input multiple 2D images of approximately the same scene, along with an initial guess of the camera poses for each image, and a table of features matched pair-wise in each frame. LMDB Builder aggregates landmarks across an arbitrarily large collection of frames with matched features. Range data from stereo vision processing can also be passed to improve the initial guess of the 3D point estimates. The LMDB Builder aggregates feature lists across all frames, manages the process to promote selected features to landmarks, and iteratively calculates the 3D landmark positions using the current camera pose estimations (via an optimal ray projection method), and then improves the camera pose estimates using the 3D landmark positions. Finally, it extracts image patches for each landmark from auto-selected key frames and constructs the landmark database. The landmark database can then be used to estimate future camera poses (and therefore localize a robotic vehicle that may be carrying the cameras) by matching current imagery to landmark database image patches and using the known 3D landmark positions to estimate the current pose.

Wolf, Michael↗

High Performance Access to Archival Data Stored in HDF4 and HDF5 on Cloud Object Stores Without Reformatting the Files

Cloud computing offers numerous advantages for users of extensive Earth science data collections. These benefits encompass direct online access to data files and granules from any location, scalable access supporting parallel computing workflows, and flexible computing tools enabling innovative experimentation with processing techniques. However, older archival file formats designed for distinct computing systems hinder efficient access to decade-long time-series data when compared to data stored in modern cloud-optimized formats like Web Object Stores (WOS), exemplified by Amazon Web Services’ Simple Storage Service (S3). We describe DMR++ (Dataset Metadata Response plus plus), a technology facilitating efficient access to HDF5 (Hierarchical Data Format, version 5) and HDF4 files stored on WOS systems without requiring data reformatting. DMR++ achieves performance comparable to technologies like Zarr while preserving the original file structure, a substantial benefit considering the vast quantity of archival files held by organizations such as NASA. Moreover, DMR++ typically outperforms cloud-optimized versions of HDF5. Essentially an XML (Extensible Markup Language) document usually stored alongside the described data, DMR++ can also be generated on-the-fly but is generally created during data staging to the WOS. Archival files that use HDF4/5 often store large arrays of numerical data. The data in these files is often compressed, typically reducing their size by a factor of four or more. To achieve efficient access to portions of those arrays, they are 'chunked' into smaller sub-arrays, each individually compressed. The chunk size is a compromise, where spinning disks can efficiently access data in smaller chunks while S3 favors larger chunks. A simple optimization of aggregating smaller chunks that are stored adjacently, transferring them in a single access and then individually decompressing them will improve performance. NASA data pose an additional challenge: special Application Programmer Interface (API) libraries are often needed to compute some variables. These libraries are incompatible with WOS environments. Our solution involves storing computed values in the DMR++ document or a companion file, making them accessible like other variables and eliminating the need for specialized APIs. We outline specific optimizations for both satellite grid and swath data stored in HDF4-EOS2 (Earth Observing System).

James Gallagher↗

Long-term Differences in Tillage and Land Use Affect Intra-aggregate Pore Heterogeneity

Recent advances in computed tomography provide measurement tools to study internal structures of soil aggregates at micrometer resolutions and to improve our understanding of specific mechanisms of various soil processes. Fractal analysis is one of the data analysis tools that can be helpful in evaluating heterogeneity of the intra-aggregate internal structures. The goal of this study was to examine how long-term tillage and land use differences affect intra-aggregate pore heterogeneity. The specific objectives were: (i) to develop an approach to enhance utility of box-counting fractal dimension in characterizing intra-aggregate pore heterogeneity; (ii) to examine intra-aggregate pores in macro-aggregates (4-6 mm in size) using the computed tomography scanning and fractal analysis, and (iii) to compare heterogeneity of intra-aggregate pore space in aggregates from loamy Alfisol soil subjected to 20 yr of contrasting management practices, namely, conventional tillage (chisel plow) (CT), no-till (NT), and native succession vegetation (NS). Three-dimensional images of the intact aggregates were obtained with a resolution of 14.6 {micro}m at the Advanced Photon Source, Argonne National Laboratory, Argonne, IL. Proposed box-counting fractal dimension normalization was successfully implemented to estimate heterogeneity of pore voxel distributions without bias associated with different porosities in soil aggregates. The aggregates from all three studied treatments had higher porosity associated with large (>100 {micro}m) pores present in their centers than in their exteriors. Pores 15 to 60 {micro}m were equally abundant throughout entire aggregates but their distributions were more heterogeneous in aggregate interiors. The CT aggregates had greater numbers of pores 15 to 60 {micro}m than NT and NS. Distribution of pore voxels belonging to large pores was most heterogeneous in the aggregates from NS, followed by NT and by CT. This result was consistent with presence of very large pores associated with former root channels in NT and NS aggregates. Our findings indicate that mechanisms of macro-aggregate formation might differ in their importance in different land use and management practices.

43 PARTICLE ACCELERATORS↗