Search NASA⌕ Search

SEARCH · Search NASA

Results for “Domain Distributed Framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
NASA NTRS1998

Parallel Implicit Algorithms for CFD

The main goal of this project was efficient distributed parallel and workstation cluster implementations of Newton-Krylov-Schwarz (NKS) solvers for implicit Computational Fluid Dynamics (CFD.) "Newton" refers to a quadratically convergent nonlinear iteration using gradient information based on the true residual, "Krylov" to an inner linear iteration that accesses the Jacobian matrix only through highly parallelizable sparse matrix-vector products, and "Schwarz" to a domain decomposition form of preconditioning the inner Krylov iterations with primarily neighbor-only exchange of data between the processors. Prior experience has established that Newton-Krylov methods are competitive solvers in the CFD context and that Krylov-Schwarz methods port well to distributed memory computers. The combination of the techniques into Newton-Krylov-Schwarz was implemented on 2D and 3D unstructured Euler codes on the parallel testbeds that used to be at LaRC and on several other parallel computers operated by other agencies or made available by the vendors. Early implementations were made directly in Massively Parallel Integration (MPI) with parallel solvers we adapted from legacy NASA codes and enhanced for full NKS functionality. Later implementations were made in the framework of the PETSC library from Argonne National Laboratory, which now includes pseudo-transient continuation Newton-Krylov-Schwarz solver capability (as a result of demands we made upon PETSC during our early porting experiences). A secondary project pursued with funding from this contract was parallel implicit solvers in acoustics, specifically in the Helmholtz formulation. A 2D acoustic inverse problem has been solved in parallel within the PETSC framework.

Keyes, David E.↗
NASA NTRS2011

Uncertainty Analysis via Failure Domain Characterization: Polynomial Requirement Functions

This paper proposes an uncertainty analysis framework based on the characterization of the uncertain parameter space. This characterization enables the identification of worst-case uncertainty combinations and the approximation of the failure and safe domains with a high level of accuracy. Because these approximations are comprised of subsets of readily computable probability, they enable the calculation of arbitrarily tight upper and lower bounds to the failure probability. A Bernstein expansion approach is used to size hyper-rectangular subsets while a sum of squares programming approach is used to size quasi-ellipsoidal subsets. These methods are applicable to requirement functions whose functional dependency on the uncertainty is a known polynomial. Some of the most prominent features of the methodology are the substantial desensitization of the calculations from the uncertainty model assumed (i.e., the probability distribution describing the uncertainty) as well as the accommodation for changes in such a model with a practically insignificant amount of computational effort.

Crespo, Luis G.↗
NASA NTRS2017

Framework for Processing Citizens Science Data for Applications to NASA Earth Science Missions

Citizen science (or crowdsourcing) has drawn much high-level recent and ongoing interest and support. It is poised to be applied, beyond the by-now fairly familiar use of, e.g., Twitter for natural hazards monitoring, to science research, such as augmenting the validation of NASA earth science mission data. This interest and support is seen in the 2014 National Plan for Civil Earth Observations, the 2015 White House forum on citizen science and crowdsourcing, the ongoing Senate Bill 2013 (Crowdsourcing and Citizen Science Act of 2015), the recent (August 2016) Open Geospatial Consortium (OGC) call for public participation in its newly-established Citizen Science Domain Working Group, and NASA's initiation of a new Citizen Science for Earth Systems Program (along with its first citizen science-focused solicitation for proposals). Over the past several years, we have been exploring the feasibility of extracting from the Twitter data stream useful information for application to NASA precipitation research, with both "passive" and "active" participation by the twitterers. The Twitter database, which recently passed its tenth anniversary, is potentially a rich source of real-time and historical global information for science applications. The time-varying set of "precipitation" tweets can be thought of as an organic network of rain gauges, potentially providing a widespread view of precipitation occurrence. The validation of satellite precipitation estimates is challenging, because many regions lack data or access to data, especially outside of the U.S. and in remote and developing areas. Mining the Twitter stream could augment these validation programs and, potentially, help tune existing algorithms. Our ongoing work, though exploratory, has resulted in key components for processing and managing tweets, including the capabilities to filter the Twitter stream in real time, to extract location information, to filter for exact phrases, and to plot tweet distributions. The key step is to process the "precipitation" tweets to be compatible with satellite-retrieved precipitation data. These key components for processing and managing "precipitation" tweets (and additional ones to be developed) are not limited to precipitation, nor are they limited to the Twitter social medium. Indeed, to maximize the value of our work for NASA earth science programs, these components should be generalized and be part of an overall framework for processing citizen science data for science research. In this paper, we outline such a framework.

earth science satellite data↗
NASA NTRS2018

Climatespark: an In-Memory Distributed Computing Framework for Big Climate Data Analytics

The unprecedented growth of climate data creates new opportunities for climate studies, and yet big climate data pose a grand challenge to climatologists to efficiently manage and analyze big data. The complexity of climate data content and analytical algorithms increases the difficulty of implementing algorithms on high performance computing systems. This paper proposes an in-memory, distributed computing framework, ClimateSpark, to facilitate complex big data analytics and time-consuming computational tasks. Chunking data structure improves parallel I/O efficiency, while a spatiotemporal index is built for the chunks to avoid unnecessary data reading and preprocessing. An integrated, multi-dimensional, array-based data model (ClimateRDD) and ETL operations are developed to address big climate data variety by integrating the processing components of the climate data lifecycle. ClimateSpark utilizes Spark SQL and Apache Zeppelin to develop a web portal to facilitate the interaction among climatologists, climate data, analytic operations and computing resources (e.g., using SQL query and Scala/Python notebook). Experimental results show that ClimateSpark conducts different spatiotemporal data queries/analytics with high efficiency and data locality. ClimateSpark is easily adaptable to other big multiple- dimensional, array-based datasets in various geoscience domains.

Hu, Fei↗
NASA NTRS2008

The Super Tuesday Outbreak: Forecast Sensitivities to Single-Moment Microphysics Schemes

Forecast precipitation and radar characteristics are used by operational centers to guide the issuance of advisory products. As operational numerical weather prediction is performed at increasingly finer spatial resolution, convective precipitation traditionally represented by sub-grid scale parameterization schemes is now being determined explicitly through single- or multi-moment bulk water microphysics routines. Gains in forecasting skill are expected through improved simulation of clouds and their microphysical processes. High resolution model grids and advanced parameterizations are now available through steady increases in computer resources. As with any parameterization, their reliability must be measured through performance metrics, with errors noted and targeted for improvement. Furthermore, the use of these schemes within an operational framework requires an understanding of limitations and an estimate of biases so that forecasters and model development teams can be aware of potential errors. The National Severe Storms Laboratory (NSSL) Spring Experiments have produced daily, high resolution forecasts used to evaluate forecast skill among an ensemble with varied physical parameterizations and data assimilation techniques. In this research, high resolution forecasts of the 5-6 February 2008 Super Tuesday Outbreak are replicated using the NSSL configuration in order to evaluate two components of simulated convection on a large domain: sensitivities of quantitative precipitation forecasts to assumptions within a single-moment bulk water microphysics scheme, and to determine if these schemes accurately depict the reflectivity characteristics of well-simulated, organized, cold frontal convection. As radar returns are sensitive to the amount of hydrometeor mass and the distribution of mass among variably sized targets, radar comparisons may guide potential improvements to a single-moment scheme. In addition, object-based verification metrics are evaluated for their utility in gauging model performance and QPF variability.

Molthan, Andrew L.↗
NASA NTRS2018

The NASA Eulerian Snow on Sea Ice Model (NESOSIM) v1.0: initial model development and analysis

The NASA Eulerian Snow On Sea Ice Model (NESOSIM) is a new, open-source snow budget model that is currentlyconfigured to produce daily estimates of the depth and density of snow on sea ice across the Arctic Ocean throughthe accumulation season. NESOSIM has been developed in a three-dimensional Eulerian framework and includes two(vertical) snow layers and several simple parameterizations (accumulation, wind packing, advection_divergence, blowingsnow lost to leads) to represent key sources and sinks of snow on sea ice. The model is forced with daily inputs of snowfall and near-surface winds (from reanalyses), sea ice concentration (from satellite passive microwave data) and sea ice drift (from satellite feature tracking) during the accumulation season (August through April). In this study, we present the NESOSIM formulation, calibration efforts, sensitivity studies and validation efforts across an Arctic Ocean domain (100 km horizontal resolution). The simulated snow depth and density are calibrated with in situ data collected on drifting ice stations during the 1980s. NESOSIM shows strong agreement with the in situ seasonal cycles of snow depth and density, and shows good (moderate) agreement with the regional snow depth (density) distributions. NESOSIM is run for a contemporary period (2000 to 2015), with the results showing strong sensitivity to the reanalysis derived snowfall forcing data, with the Modern-Era Retrospective analysis for Research and Applications (MERRA) and the Japanese Meteorological Agency 55-year reanalysis (JRA-55) forced snow depths generally higher than ERA-Interim,and the Arctic System Reanalysis (ASR) generally lower. We also generate and force NESOSIM with a consensus "median" daily snowfall dataset from these reanalyses.The results are compared against snow depth estimates derived from NASA's Operation IceBridge (OIB) snow radar data from 2009 to 2015, showing moderate_strong correlations and root mean squared errors of 10 cm depending on the OIB snow depth product analyzed, similar to the comparisons between OIB snow depths and the commonly used modified Warren snow depth climatology. Potential improvements to this initial NESOSIM formulation are discussed in the hopes of improving the accuracy and reliability of these simulated snow depths and densities.

Petty, Alek A.↗
NASA NTRS2003

Computation of Domain-Averaged Shortwave Irradiance by a One-Dimensional Algorithm Incorporating Correlations between Optical Thickness and Direct Incident Radiation

A one-dimensional radiative transfer algorithm that accounts for correlations between the optical thickness and the incident direct solar radiation is developed to compute the domain-averaged shortwave irradiance profile. It divides the direct irradiance into four components and treats the direct irradiance in two separate, clear and cloudy columns to account for the fact that clouds attenuate the direct irradiance more than clear-sky. The horizontal inhomogeneity of clouds in the cloudy column is treated by the gamma weighted two-stream approximation, which assumes that the optical thickness of clouds follows a gamma distribution. The algorithm inputs the cloud fraction, cumulative cloud fraction as a function of height, and a parameter expressing the shape of the probability density function of the cloud optical thickness distribution in addition to inputs required for a two-stream radiative transfer model. These cloud property inputs can be obtained using ground- and satellite-based instruments. Therefore, the algorithm can treat realistic cloud overlap features and horizontal inhomogeneity of clouds in a framework of one- dimensional radiative transfer. Heating rates computed by the algorithm using cloud fields generated by cloud resolving models agree with those computed with a Monte Carlo model. If optical properties in computational layers that divide a vertically extensive cloud are correlated, the irradiance profile computed by the algorithm further improves.

Kato, S.↗
NASA NTRS2010

Metrics for Offline Evaluation of Prognostic Performance

Prognostic performance evaluation has gained significant attention in the past few years. Currently, prognostics concepts lack standard definitions and suffer from ambiguous and inconsistent interpretations. This lack of standards is in part due to the varied end-user requirements for different applications, time scales, available information, domain dynamics, etc. to name a few. The research community has used a variety of metrics largely based on convenience and their respective requirements. Very little attention has been focused on establishing a standardized approach to compare different efforts. This paper presents several new evaluation metrics tailored for prognostics that were recently introduced and were shown to effectively evaluate various algorithms as compared to other conventional metrics. Specifically, this paper presents a detailed discussion on how these metrics should be interpreted and used. These metrics have the capability of incorporating probabilistic uncertainty estimates from prognostic algorithms. In addition to quantitative assessment they also offer a comprehensive visual perspective that can be used in designing the prognostic system. Several methods are suggested to customize these metrics for different applications. Guidelines are provided to help choose one method over another based on distribution characteristics. Various issues faced by prognostics and its performance evaluation are discussed followed by a formal notational framework to help standardize subsequent developments.

Saxena, Abhinav↗
NASA NTRS2011

Numerical Solution of the Radiative Transfer Equation: X-Ray Spectral Formation from Cylindrical Accretion onto a Magnetized Neutron Star

Predicting the emerging X-ray spectra in several astrophysical objects is of great importance, in particular when the observational data are compared with theoretical models. This requires developing numerical routines for the solution of the radiative transfer equation according to the expected physical conditions of the systems under study. Aims. We have developed an algorithm solving the radiative transfer equation in the Fokker-Planck approximation when both thermal and bulk Comptonization take place. The algorithm is essentially a relaxation method, where stable solutions are obtained when the system has reached its steady-state equilibrium. Methods. We obtained the solution of the radiative transfer equation in the two-dimensional domain defined by the photon energy E and optical depth of the system pi using finite-differences for the partial derivatives, and imposing specific boundary conditions for the solutions. We treated the case of cylindrical accretion onto a magnetized neutron star. Results. We considered a blackbody seed spectrum of photons with exponential distribution across the accretion column and for an accretion where the velocity reaches its maximum at the stellar surface and at the top of the accretion column, respectively. In both cases higher values of the electron temperature and of the optical depth pi produce flatter and harder spectra. Other parameters contributing to the spectral formation are the steepness of the vertical velocity profile, the albedo at the star surface, and the radius of the accretion column. The latter parameter modifies the emerging spectra in a specular way for the two assumed accretion profiles. Conclusions. The algorithm has been implemented in the XPEC package for X-ray fitting and is specifically dedicated to the physical framework of accretion at the polar cap of a neutron star with a high magnetic field (approx > 10(exp 12) G). This latter case is expected to be of typical accreting systems such as X-ray pulsars and supergiant fast X ray transients.

Fairnelli, R.↗
NASA NTRS1998

Instrument Remote Control via the Astronomical Instrument Markup Language

The Instrument Remote Control (IRC) project ongoing at NASA's Goddard Space Flight Center's (GSFC) Information Systems Center (ISC) supports NASA's mission by defining an adaptive intranet-based framework that provides robust interactive and distributed control and monitoring of remote instruments. An astronomical IRC architecture that combines the platform-independent processing capabilities of Java with the power of Extensible Markup Language (XML) to express hierarchical data in an equally platform-independent, as well as human readable manner, has been developed. This architecture is implemented using a variety of XML support tools and Application Programming Interfaces (API) written in Java. IRC will enable trusted astronomers from around the world to easily access infrared instruments (e.g., telescopes, cameras, and spectrometers) located in remote, inhospitable environments, such as the South Pole, a high Chilean mountaintop, or an airborne observatory aboard a Boeing 747. Using IRC's frameworks, an astronomer or other scientist can easily define the type of onboard instrument, control the instrument remotely, and return monitoring data all through the intranet. The Astronomical Instrument Markup Language (AIML) is the first implementation of the more general Instrument Markup Language (IML). The key aspects of our approach to instrument description and control applies to many domains, from medical instruments to machine assembly lines. The concepts behind AIML apply equally well to the description and control of instruments in general. IRC enables us to apply our techniques to several instruments, preferably from different observatories.

Sall, Ken↗
NASA NTRS2010

Sources of Uncertainty in Predicting Land Surface Fluxes Using Diverse Data and Models

In the domain of predicting land surface fluxes, models are used to bring data from large observation networks and satellite remote sensing together to make predictions about present and future states of the Earth. Characterizing the uncertainty about such predictions is a complex process and one that is not yet fully understood. Uncertainty exists about initialization, measurement and interpolation of input variables; model parameters; model structure; and mixed spatial and temporal supports. Multiple models or structures often exist to describe the same processes. Uncertainty about structure is currently addressed by running an ensemble of different models and examining the distribution of model outputs. To illustrate structural uncertainty, a multi-model ensemble experiment we have been conducting using the Terrestrial Observation and Prediction System (TOPS) will be discussed. TOPS uses public versions of process-based ecosystem models that use satellite-derived inputs along with surface climate data and land surface characterization to produce predictions of ecosystem fluxes including gross and net primary production and net ecosystem exchange. Using the TOPS framework, we have explored the uncertainty arising from the application of models with different assumptions, structures, parameters, and variable definitions. With a small number of models, this only begins to capture the range of possible spatial fields of ecosystem fluxes. Few attempts have been made to systematically address the components of uncertainty in such a framework. We discuss the characterization of uncertainty for this approach including both quantifiable and poorly known aspects.

Dungan, Jennifer L.↗
NASA NTRS2020

Evaluating Precipitation Features and Rainfall Characteristics in a Multi‐Scale Modeling Framework

Cloud and precipitation systems are simulated with a multi‐scale modeling framework (MMF) and compared over the Tropics and Subtropics against the Tropical Rainfall Measuring Mission (TRMM) Radar‐defined Precipitation Features (RPFs) product. A methodology, in close analogy to the TRMM RPFs, is developed to produce simulated precipitation features (PFs) from the output of the embedded two‐dimensional (2D) cloud‐resolving models (CRMs) within an MMF. Despite the limitations of 2D CRMs, the simulated population distribution, horizontal and vertical structure of PFs, and the geographical location and local rainfall contribution of mesoscale convective systems (MCSs) are in good agreement with the TRMM observations. However, some model discrepancies are found and can be identified and quantified within the PF distributions. Using model biases in relative population and rainfall contributions, PFs can be characterized into four size categories: small, medium to large, very large, and extremely large. Four different major mechanisms might account for the model biases in each different category: (1) the two‐dimensionality of the CRMs, (2) a positive convection‐wind‐evaporation feedback loop, (3) an artificial dynamic constraint in a bounded CRM domain with cyclic boundaries, and (4) the limited CRM domain size. The second and fourth mechanisms tend to contribute to the excessive tropical precipitation biases commonly found in most MMFs, whereas the other mechanisms reduce rainfall contributions from small and very large PFs. MMF sensitivity experiments with various CRM domain sizes and grid spacings showed that larger domains (higher resolutions) tend to shift PF populations toward larger (smaller) sizes.

Jiun-Dar Chern↗
NASA NTRS2013

Downscaling Satellite Precipitation with Emphasis on Extremes: A Variational 1-Norm Regularization in the Derivative Domain

The increasing availability of precipitation observations from space, e.g., from the Tropical Rainfall Measuring Mission (TRMM) and the forthcoming Global Precipitation Measuring (GPM) Mission, has fueled renewed interest in developing frameworks for downscaling and multi-sensor data fusion that can handle large data sets in computationally efficient ways while optimally reproducing desired properties of the underlying rainfall fields. Of special interest is the reproduction of extreme precipitation intensities and gradients, as these are directly relevant to hazard prediction. In this paper, we present a new formalism for downscaling satellite precipitation observations, which explicitly allows for the preservation of some key geometrical and statistical properties of spatial precipitation. These include sharp intensity gradients (due to high-intensity regions embedded within lower-intensity areas), coherent spatial structures (due to regions of slowly varying rainfall),and thicker-than-Gaussian tails of precipitation gradients and intensities. Specifically, we pose the downscaling problem as a discrete inverse problem and solve it via a regularized variational approach (variational downscaling) where the regularization term is selected to impose the desired smoothness in the solution while allowing for some steep gradients(called 1-norm or total variation regularization). We demonstrate the duality between this geometrically inspired solution and its Bayesian statistical interpretation, which is equivalent to assuming a Laplace prior distribution for the precipitation intensities in the derivative (wavelet) space. When the observation operator is not known, we discuss the effect of its misspecification and explore a previously proposed dictionary-based sparse inverse downscaling methodology to indirectly learn the observation operator from a database of coincidental high- and low-resolution observations. The proposed method and ideas are illustrated in case studies featuring the downscaling of a hurricane precipitation field.

Hurricanes↗
NASA NTRS2006

Slat Cove Unsteadiness Effect of 3D Flow Structures

Previous studies have indicated that 2D, time accurate computations based on a pseudo-laminar zonal model of the slat cove region (within the framework of the Reynolds-Averaged Navier-Stokes equations) are inadequate for predicting the full unsteady dynamics of the slat cove flow field. Even though such computations could capture the large-scale, unsteady vorticity structures in the slat cove region without requiring any external forcing, the simulated vortices were excessively strong and the recirculation zone was unduly energetic in comparison with the PIV measurements for a generic high-lift configuration. To resolve this discrepancy and to help enable physics based predictions of slat aeroacoustics, the present paper is focused on 3D simulations of the slat cove flow over a computational domain of limited spanwise extent. Maintaining the pseudo-laminar approach, current results indicate that accounting for the three-dimensionality of flow fluctuations leads to considerable improvement in the accuracy of the unsteady, nearfield solution. Analysis of simulation data points to the likely significance of turbulent fluctuations near the reattachment region toward the generation of broadband slat noise. The computed acoustic characteristics (in terms of the frequency spectrum and spatial distribution) within short distances from the slat resemble the previously reported, subscale measurements of slat noise.

Choudhari, Meelan M.↗
NASA NTRS2022

Soil Moisture Estimation in South Asia via Assimilation of SMAP Retrievals

A soil moisture retrieval assimilation framework is implemented across South Asia in an attempt to improve regional soil moisture estimation as well as to provide a consistent regional soil moisture dataset. This study aims to improve the spatiotemporal variability of soil moisture estimates by assimilating Soil Moisture Active Passive (SMAP) near-surface soil moisture retrievals into a land surface model. The Noah-MP (v4.0.1) land surface model is run within the NASA Land Information System software framework to model regional land surface processes. NASA Modern-Era Retrospective Analysis for Research and Applications (MERRA2) and Global Precipitation Measurement (GPM) Integrated Multi-satellitE Retrievals (IMERG) provide the meteorological boundary conditions to the land surface model. Assimilation is carried out using both cumulative distribution function (CDF)-corrected (DA-CDF) and uncorrected SMAP retrievals (DA-NoCDF). CDF matching is applied to correct the statistical moments of the SMAP soil moisture retrieval relative to the land surface model. Comparison of assimilated and model-only soil moisture estimates with publicly available in situ measurements highlights the relative improvement in soil moisture estimates by assimilating SMAP retrievals. Across the Tibetan Plateau, DA-NoCDF reduced the mean bias and RMSE by 8.4 % and 9.4 %, even though assimilation only occurred during less than 10 % of the study period due to frozen (or partially frozen) soil conditions. The best goodness-of-fit statistics were achieved for the IMERG DA-NoCDF soil moisture experiment. The general lack of publicly available in situ measurements across irrigated areas limited a domain-wide direct model validation. However, comparison with regional irrigation patterns suggested correction of biases associated with an unmodeled hydrologic phenomenon (i.e., anthropogenic influence via irrigation) as a result of SMAP soil moisture retrieval assimilation. The greatest sensitivity to assimilation was observed in cropland areas. Improvements in soil moisture potentially translate into improved spatiotemporal patterns of modeled evapotranspiration, although limited influence from soil moisture assimilation was observed on modeled processes within the carbon cycle such as gross primary production. Improvement in fine-scale modeled estimates by assimilating coarse-scale retrievals highlights the potential of this approach for soil moisture estimation over data-scarce regions.

Jawairia Ahmad↗
NASA NTRS2001

Linear and Order Statistics Combiners for Pattern Classification

Several researchers have experimentally shown that substantial improvements can be obtained in difficult pattern recognition problems by combining or integrating the outputs of multiple classifiers. This chapter provides an analytical framework to quantify the improvements in classification results due to combining. The results apply to both linear combiners and order statistics combiners. We first show that to a first order approximation, the error rate obtained over and above the Bayes error rate, is directly proportional to the variance of the actual decision boundaries around the Bayes optimum boundary. Combining classifiers in output space reduces this variance, and hence reduces the 'added' error. If N unbiased classifiers are combined by simple averaging. the added error rate can be reduced by a factor of N if the individual errors in approximating the decision boundaries are uncorrelated. Expressions are then derived for linear combiners which are biased or correlated, and the effect of output correlations on ensemble performance is quantified. For order statistics based non-linear combiners, we derive expressions that indicate how much the median, the maximum and in general the i-th order statistic can improve classifier performance. The analysis presented here facilitates the understanding of the relationships among error rates, classifier boundary distributions, and combining in output space. Experimental results on several public domain data sets are provided to illustrate the benefits of combining and to support the analytical results.

Tumer, Kagan↗
NASA NTRS2006

Implementing Access to Data Distributed on Many Processors

A reference architecture is defined for an object-oriented implementation of domains, arrays, and distributions written in the programming language Chapel. This technology primarily addresses domains that contain arrays that have regular index sets with the low-level implementation details being beyond the scope of this discussion. What is defined is a complete set of object-oriented operators that allows one to perform data distributions for domain arrays involving regular arithmetic index sets. What is unique is that these operators allow for the arbitrary regions of the arrays to be fragmented and distributed across multiple processors with a single point of access giving the programmer the illusion that all the elements are collocated on a single processor. Today's massively parallel High Productivity Computing Systems (HPCS) are characterized by a modular structure, with a large number of processing and memory units connected by a high-speed network. Locality of access as well as load balancing are primary concerns in these systems that are typically used for high-performance scientific computation. Data distributions address these issues by providing a range of methods for spreading large data sets across the components of a system. Over the past two decades, many languages, systems, tools, and libraries have been developed for the support of distributions. Since the performance of data parallel applications is directly influenced by the distribution strategy, users often resort to low-level programming models that allow fine-tuning of the distribution aspects affecting performance, but, at the same time, are tedious and error-prone. This technology presents a reusable design of a data-distribution framework for data parallel high-performance applications. Distributions are a means to express locality in systems composed of large numbers of processor and memory components connected by a network. Since distributions have a great effect on the performance of applications, it is important that the distribution strategy is flexible, so its behavior can change depending on the needs of the application. At the same time, high productivity concerns require that the user be shielded from error-prone, tedious details such as communication and synchronization.

James, Mark↗
NASA NTRS2019

Evaluating Precipitation Features and Rainfall Characteristics in a Multi-scale Modeling Framework

Cloud and precipitation systems over the tropics and subtropics are simulated with a multi-scale modeling framework (MMF) and compared against the TRMM radar precipitation features (RPFs) product. A methodology, in close analogy to the TRMM RPFs, is developed to analyze simulated cloud precipitating structures from the embedded two-dimensional cloud-resolving models (CRMs) within an MMF. Despite the two-dimensionality of the CRMs, the simulated RPFs population distribution, and horizontal and vertical structure are in good agreement with TRMM observations. However, some deficits are also found in the model simulations. The model tends to overestimate mean convective precipitation rates for RPFs with a size less than 100 km, contributing to the excessive precipitation biases in the warm pool and western Pacific, western and northern India Ocean, and eastern Pacific commonly found in most MMFs. For large features with a size greater than 150 km, both convective and stratiform rain rates are underestimated. The distribution of maximum radar echo top heights as a function of RPF size is well simulated except the model tends to underestimate the occurrence frequency of maximum heights greater than 15 km. The maximum echo top heights for convective cells embedded within large RPFs with a size greater than 150 km are also underestimated. The cyclic lateral boundary with a limited model domain generates artificial occurrences for RPFs with a size close to the model domain size, producing a significant contribution to the total rainfall due to their sizes. This cyclic lateral boundary effect can be easily identified and quantified in both probability and cumulative distribution functions of RPFs. The geophysical distribution of the population of the largest RPFs in the control experiment shows they are mainly located in the Subtropics but also partially contribute to the common MMF biases of excessive precipitation in the Tropics. Sensitivity experiments using CRMs with different domain sizes and different grid spacings show larger domains (higher resolution) tend to shift the RPFs distribution to large (small) sizes. The cyclic lateral boundary biases increase as CRM domain size decreases. The impacts of model horizontal and vertical resolution on simulated convective systems are also investigated.

Chern, Jiun-Dar↗