Search NASA⌕ Search

SEARCH · Search NASA

Results for “Ensemble computing.”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,441 records · Page 80

Ensembles of radial basis function networks for spectroscopic detection of cervical precancer

The mortality related to cervical cancer can be substantially reduced through early detection and treatment. However, current detection techniques, such as Pap smear and colposcopy, fail to achieve a concurrently high sensitivity and specificity. In vivo fluorescence spectroscopy is a technique which quickly, noninvasively and quantitatively probes the biochemical and morphological changes that occur in precancerous tissue. A multivariate statistical algorithm was used to extract clinically useful information from tissue spectra acquired from 361 cervical sites from 95 patients at 337-, 380-, and 460-nm excitation wavelengths. The multivariate statistical analysis was also employed to reduce the number of fluorescence excitation-emission wavelength pairs required to discriminate healthy tissue samples from precancerous tissue samples. The use of connectionist methods such as multilayered perceptrons, radial basis function (RBF) networks, and ensembles of such networks was investigated. RBF ensemble algorithms based on fluorescence spectra potentially provide automated and near real-time implementation of precancer detection in the hands of nonexperts. The results are more reliable, direct, and accurate than those achieved by either human experts or multivariate statistical algorithms.

Cervix Neoplasms/pathology↗

Lithium-Ion Battery Diagnostics Using Electrochemical Impedance via Machine-Learning

Diagnosing battery states such as health, state-of-charge, or temperature is crucial for ensuring the safety and reliability of electrochemical energy storage systems. While some states, such as temperature, may be measured using cheap sensors, accurate diagnosis of battery health metrics usually requires time-consuming performance measurements, making them infeasible for use in real-world operation. These health metrics can be measured during lab-testing and then estimated on-line using predictive life models or via state observer algorithms such as Kalman filters, but these predictive methods should be supplemented by actual measurement of battery health whenever possible to ensure reliability. Rapid measurement of battery health may be done by various types of fast diagnostic techniques such as electrochemical impedance spectroscopy (EIS), which can be performed in only a few minutes and require only a fraction of the energy and power needed for a full charge and discharge measurement. But there is a substantial challenge for estimating battery health using EIS data, as EIS is sensitive to cell temperature, state-of-charge, current, and resting time in addition to health. Thus, utilizing EIS data to predict battery capacity requires correcting for all these additional variables, a task that is extremely difficult to handle analytically. This talk utilizes machine-learning methods to estimate the effectiveness of battery capacity prediction from EIS data, leveraging a data set of hundreds of EIS measurements recorded at varying temperature and state-of-charge throughout a 500-day aging study of 32 commercial, large-format NMC-Graphite lithium-ion batteries. Using EIS as input to machine-learning models is complicated by the nonlinear response of impedance to battery health, temperature, and state-of-charge, as well as the collinearity between the impedance response at neighboring frequencies, which can easily lead to overfit models. To train robust models, features from EIS data need to be extracted from the data or some subset of critical frequencies selected. Many approaches for extracting and selecting features from EIS data from electrochemical analysis and machine-learning fields were identified for analysis: using the entire raw spectra; selection of one, two, or many frequencies from the entire spectra; selecting interesting points from the EIS measurement using domain knowledge; fitting EIS with an equivalent-circuit model; calculating statistics on the raw impedance values; and reducing the dimensionality of the data using unsupervised linear (principal component analysis) and non-linear (uniform manifold approximation and projection) methods. These approaches were rigorously compared using a machine-learning pipeline approach, training linear, Gaussian process, and random forest regression models and quantifying performance using cross-validation as well as a held-out test set. An artificial neural network model trained on the raw spectra was also tested. Promising pipelines were fine-tuned via Bayesian hyperparameter optimization using cross-validation loss and training with class-specific weights to counter data set imbalance. The most reliable method for utilizing impedance in this work was the selection of two optimal frequencies through an exhaustive search, resulting in about 2% mean absolute error on test data for both Gaussian process and random forest model architectures. Interrogation of a variety of models reveals critical frequencies of 100 Hz and 103 Hz for this data set, though the optimal set of frequencies is not necessarily intuitive, i.e., the best performing models are not simply those that use impedance at frequencies that have the highest correlation to the relative discharge capacity. The best performing model is an ensemble model, which is able to predict battery capacity with 1.9% mean absolute error for unseen cells using impedance recorded at a variety of temperatures and states-of-charge.

battery↗

Detecting and Testing for Structural Error in Computer Models with Application to the Community Atmospheric Model

Bayesian calibration/inversion methods for uncertain input parameters to simulation codes have generated an increasing amount of interest in the climate community in the recent years. This approach uses multiple disparate observational datasets related to the output of the simulator of interest to yield a probabilistic constraint on the uncertain inputs (i.e. probability distribution). A major challenge in applying Bayesian calibration methods to simulation codes is related to the possible presence of a large structural error in the output fields of interest; that is, the presence of discrepancy between the observed and the simulated output that is neither explained by the uncertainty in the inputs nor the observations. We present here methods to test for and visualize structural error in an ensemble of input-perturbed simulations. The methods are based on bootstrap (resmpling) test statistics and well-known metrics to quantify the difference between two probability distributions. The proposed methods are demonstrated using selected precipitation output fields of the Community Atmospheric Model (CAM), which are compared to observations provided by the Global Precipitation Climatology Project (GPCP). The methods are found to be useful in identifying regions and seasons with a large structural error. The proposed structural error detection methodology can be used to screen multiple observational datasets of interest for structural error, making it possible to retain only the datasets with a small structural error for use in Bayesian calibration. In addition, information about the amount of structural error can be valuable to model developers.

58 GEOSCIENCES↗

Bottomonium spectrum from lattice QCD with 2+1 flavors of domain wall fermions

Recently, realistic lattice QCD calculations with 2+1 flavors of domain wall fermions and the Iwasaki gauge action have been performed by the RBC and UKQCD Collaborations. Here, results for the bottomonium spectrum computed on their gauge configurations of size 24{sup 3}x64 with a lattice spacing of approximately 0.11 fm and four different values for the light quark mass are presented. Improved lattice nonrelativistic QCD is used to treat the b quarks inside the bottomonium. The results for the radial and orbital energy splittings are found to be in good agreement with experimental measurements, indicating that systematic errors are small. The calculation of the {upsilon}(2S)-{upsilon}(1S) energy splitting provides an independent determination of the lattice spacing. For the most physical ensemble it is found to be a{sup -1}=1.740(25)(19) GeV, where the first error is statistical/fitting and the second error is an estimate of the systematic errors due to the lattice nonrelativistic QCD action.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

TABLET: The personal computer of the year 2000

The University of Illinois design of the TABLET portable computer extends the freedom of pen and notepad with a machine that draws on the projected power of 21st century technology. Without assuming any new, major technological breakthroughs, it seeks to balance the promises of today's growing technologies with the changing role of computers in tomorrow's education, research, security, and commerce. It seeks to gather together in one basket the matured fruits of such buzzword technologies as LCD, GPS, CCD, WSI, and DSP. The design is simple, yet sleek. Roughly the size and weight of a notebook, the machine is a dark, featureless monolith with no moving parts. Through magneto-optics, a simple LaserCard provides exchangeable, mass data storage. Its I/O surface, in concert with built-in infrared and cellular transceivers, puts the user in touch with anyone and anything. The ensemble of these components, directed by software that can transform it into anything from a keyboard or notepad to an office or video studio, suggests an instrument of tremendous power and freedom.

Mel, Bartlett W.↗

Precipitation Processes Developed During ARM (1997), TOGA COARE (1992), GATE (1974), SCSMEX (1998), and KWAJEX (1999): Consistent 2D, Semi-3D and 3D Cloud Resolving Model Simulations

Real clouds and cloud systems are inherently three-dimensional (3D). Because of the limitations in computer resources, however, most cloud-resolving models (CRMs) today are still two-dimensional (2D). A few 3D CRMs have been used to study the response of clouds to large-scale forcing. In these 3D simulations, the model domain was small, and the integration time was 6 hours. Only recently have 3D experiments been performed for multi-day periods for tropical cloud systems with large horizontal domains at the National Center for Atmospheric Research (NACAR) and at NASA Goddard Space Flight Center . At Goddard, a 3D Goddard Cumulus Ensemble (GCE) model was used to simulate periods during TOGA COARE, SCSMEX and KWAJEX using 512 by 512 km domain (with 2 km resolution). The results indicate that surface precipitation and latent heating profiles are very similar between the 2D and 3D GCE model simulations. The reason for the strong similarity between the 2D and 3D CRM simulations is that the same observed large-scale advective tendencies of potential temperature, water vapor mixing ratio, and horizontal momentum were used as the main focusing in both the 2D and 3D models. Interestingly, the 2D and 3D versions of the CRM used at CSU showed significant differences in the rainfall and cloud statistics for three ARM cases. The major objectives of this paper are: (1) to assess the performance of the super-parameterization technique, (2) calculate and examine the surface energy (especially radiation) and water budgets, and (3) identify the differences and similarities in the organization and entrainment rates of convection between simulated 2D and 3D cloud systems.

Tao, W-K.↗

A New Approach to Using a Cloud-Resolving Model to Study the Interactions between Clouds, Precipitation and Aerosols

Recently Grabowski and Khairoutdinov and Randall have proposed and demonstrated, the feasibility of using 2D CRMs (these did not include detailed land processes and used periodic lateral boundary conditions) as 'super-parameterizations or a multi-scale modeling framework MMF' for cloud processes within atmospheric generation circulation models (GCMs). In the MMF, a fine-resolution 2D CRM takes the place of the single-column parameterization that is used in conventional GCMs. An overview of this approach is given by Randall et al.. Since a CRM can explicitly simulate cloud processes at the natural space and time scales of clouddynamical processes, it's possible to compute statistics of cloud fields, including radiances and radar backscatters, directly simulated/produced by the CRM. A seed fund is available at NASA Goddard to build a MMF based on a 2D GCE model and the Goddard fvGCM. A prototype MMF will be developed at end of 2004. The major objectives are to test and evaluate its performance using the GCE model as the super parameterization and compare its results with other super parameterizations, conventional GCMs and observations. Recently, a detailed spectral-bin microphysical scheme was implemented into the Goddard Cumulus Ensemble (WE) model. The GCE model is a CRM and it has been improved and applied to study the precipitation processes in the past two decades. Atmospheric aerosols are also described using number density size-distribution functions. The model is tested by studying the evolution of deep tropical clouds in the west Pacific warm pool region and summertime convection over a mid-latitude continent with different concentrations of CCN: a low 'clean' concentration and a high 'dirty' concentration. The impact of atmospheric aerosol concentration on cloud and precipitation will be investigated. In addition, the similarities and differences between bulk- and spectral-bin microphysics will be presented,

Tao, Wei-Kuo↗

Computationally Efficient Modeling and Data Assimilation of Near-Surface Variability

Near-surface (< 20m) ocean exhibits high variability due to coupled interactions, for e.g., with the atmosphere, sea ice, land, etc. Here we focus on atmospheric heat and momentum (wind) forcing, which are known to cause diurnal variability within the mixed layer. Only recently with a combination of sufficiently high vertical/horizontal resolution (75L, 1/4deg) and sub-daily atmospheric forcing fields, ocean models are starting to resolve this diurnal variability. However, the computation expense of such a high vertical resolution is burdensome in the context of coupled modeling and data assimilation. An alternative approach is to parameterize this diurnal variability with a prognostic model, that is embedded into the ocean model.In the first part of this presentation, we will demonstrate results with the above two approaches, by comparing them to profiles of near-surface temperature and salinity. In the context of data assimilation and reanalysis, this modeling capability opens the door to re-examine and perhaps improve specification of background (or, ensemble) error characteristics. The second half of this talk will focus on illustrating diurnally varying errors within an ensemble DA, and possible approaches to improve localization (horizontal/vertical) to extract maximum possible observational information content from in-situ and satellite observations of sea surface temperature.

Akella, Santha↗

Ensemble transfer learning for the prediction of anti-cancer drug response

Abstract Transfer learning, which transfers patterns learned on a source dataset to a related target dataset for constructing prediction models, has been shown effective in many applications. In this paper, we investigate whether transfer learning can be used to improve the performance of anti-cancer drug response prediction models. Previous transfer learning studies for drug response prediction focused on building models to predict the response of tumor cells to a specific drug treatment. We target the more challenging task of building general prediction models that can make predictions for both new tumor cells and new drugs. Uniquely, we investigate the power of transfer learning for three drug response prediction applications including drug repurposing, precision oncology, and new drug development, through different data partition schemes in cross-validation. We extend the classic transfer learning framework through ensemble and demonstrate its general utility with three representative prediction algorithms including a gradient boosting model and two deep neural networks. The ensemble transfer learning framework is tested on benchmark in vitro drug screening datasets. The results demonstrate that our framework broadly improves the prediction performance in all three drug response prediction applications with all three prediction algorithms.

60 APPLIED LIFE SCIENCES↗

Classical strongly coupled quark-gluon plasma. III. The free energy

We explore further the classical quark-gluon plasma using methods from classical liquids. The partition function of an ensemble of SU(N{sub c}) colored charge spheres is constructed. We analyze it using a cumulant expansion (low density) and a loop expansion (high temperature) after resumming the Debye screening effects. The pertinent free energies are derived in both limits and compared with recent molecular dynamics results.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Identification of Differential Equations by Dynamics-Guided Weighted Weak Form with Voting

In the identification of differential equations from data, significant progresses have been made with the weak/integral formulation. In this paper, we explore the direction of finding more efficient and robust test functions adaptively given the observed data. While this is a difficult task, we propose weighting a collection of localized test functions for better identification of differential equations from a single trajectory of noisy observations on the differential equation. We find that using high dynamic regions is effective in finding the equation as well as the coefficients, and propose a dynamics indicator per differential term and weight the weak form accordingly. For stable identification against noise, we further introduce a voting strategy to identify the active features from an ensemble of recovered results by selecting the features that frequently occur in different weighting of test functions. Systematic numerical experiments are provided to demonstrate the robustness of our method.

97 MATHEMATICS AND COMPUTING↗

Isobaric molecular dynamics version of the generalized replica exchange method (gREM): Liquid–vapor equilibrium

A prescription for sampling isobaric generalized ensembles with molecular dynamics is presented and applied to the generalized replica exchange method (gREM), which was designed for simulating first-order phase transitions. The properties of the isobaric gREM ensemble are discussed and a study is presented of the liquid-vapor equilibrium of the guest molecules given for gas hydrate formation with the mW water model. As a result, phase diagrams, critical parameters, and a law of corresponding states are obtained.

36 MATERIALS SCIENCE↗

A Bayesian Neural Network Ensemble Approach for Improving Large-Scale Streamflow Predictability

Predictive modeling through the use of AI techniques and AI-derived model components; the use of AI and other tools to design a prediction system comprising of a hierarchy of models (e.g.,AI driven model/component/parameterization selection). We propose a Bayesian neural network ensemble approach for improving large-scale streamflow predictability and understanding in a changing environment that combines multiple Earth system land model predictions by calculating spatiotemporally varying model weights and biases while accounting for various types of observations at multiple scales with uncertainty.

58 GEOSCIENCES↗

Some Continuum Aspects of Data Assimilation

A long-sought goal in data assimilation is to build more fully the time dimension into the data assimilation process. Truly four-dimensional data assimilation requires evolving second-moment information, namely the estimation error covariance, along with the state estimate itself. The continuum evolution equations for the estimation error covariance constitute a system of partial differential equations in six space dimensions, forced by a model error covariance and by the observations themselves. The high dimensionality of this system poses a difficult computational problem. Numerous methods have been proposed for approximate, discrete solution of this system of equations. Four-dimensional variational schemes solve these equations indirectly, while schemes based on Kalman filtering solve the equations more directly, usually on a small subspace of the full six-dimensional space. In both cases, most proposed solution methods are not derived from the continuum covariance evolution equations themselves. Instead, most methods simply inherit the discretization used for evolving the state estimate, either in the form of a discrete tangent linear model or, in the case of ensemble schemes, in the form of a fully nonlinear discrete model. In this lecture we show that solutions of the continuum covariance evolution equations possess simple properties that are not readily satisfied upon discretization of the equations. we give numerical examples illustrating that "inherited" discretizations sometimes fail to produce meaningfully accurate solutions. Finally, we suggest alternative discretization methods that may yield more faithful approximate solutions of the continuum problem.

Cohn, Stephen E.↗

Adding GPU Support to the Markov Chain Monte Carlo Code Catmip

In geophysics, we are confronted with many under-determined inverse problems. For example, all of our observations of earthquakes are made at the Earth’s surface. So, when we try to infer how slip during an earthquake evolves in space and time, we find that there are many potential slip histories that are consistent with our limited observations and our understanding of earthquake physics. One way to approach these problems is with Bayesian analysis which allows us to infer the ensemble of all potential slip models that satisfy the observations and our prior knowledge of earthquake physics. In Bayesian analysis, our prior knowledge is known as the prior probability density function or prior PDF, the fit to the data is known as the data likelihood, and the target PDF that satisfies both the prior PDF and data likelihood is known as the posterior PDF. However, simulating the posterior PDF typically requires using Markov Chain Monte Carlo (MCMC) to draw tens of billions of random realizations of earthquake slip models, which may not be computationally feasible. To make this and similar geophysical inversions computationally tractable, we developed the Cascading Adaptive Transitional Metropolis In Parallel (CATMIP) algorithm. CATMIP is an efficient parallel Markov Chain Monte Carlo (MCMC) sampler that is used for model fitting and uncertainty quantification in geophysics. Example use cases are earthquake rupture modeling, determining mineral composition on Mars, reconstructing the history of ocean salinity, and historical earthquake relocation. CATMIP employs many parallel instances of the Metropolis algorithm for sampling in a transitioning framework. Transitioning is a process in which a set of random samples at equilibrium with a known probability density function (PDF) are used as seeds for the Markov chains to sample successive target PDFs that incrementally move the distribution from the starting seeds to the final desired PDF that describes the relative plausibility of potential values for the model parameters. The algorithm is implemented as a Master-Worker model employing MPI for communication. The worker processes are loosely coupled with global parameters periodically optimized by the master process. This provides a very high amount of parallelism with little communication between updates. During the presentation we will discuss the history of the algorithm and elaborate the earthquake rupture modeling use case for the CATMIP package. Our first step toward GPU optimization was to optimize the code for the CPU. CPU profiling revealed that most of the compute time is spent in calls to level 2 BLAS routines and calls to GSL random number generators. We revised the algorithm to employ level 3 BLAS routines instead. In our presentation we will describe how this was accomplished. Adding GPU support to CATMIP consisted mostly of replacing the calls to GSL with calls to GPU vendor-provided library routines. A small number of loops were directly implemented in CUDA. In the presentation will provide implementation details. Finally, we will discuss methods for profiling and opportunities for further optimizing GPU execution. By creating a code with the flexibility to run on either a CPU or GPU architecture, CATMIP can be used on systems ranging from large CPU-based HPC environments to single servers with GPU acceleration and everything in between.

HECC↗

Automated Tracking of Shallow Maritime Clouds on Geostationary Imagery to Extract Lifecycle Characteristics

Shallow moist convection is ubiquitous throughout the tropics and represents a key player in boundary layer processes. Satellites have provided valuable insight on shallow clouds, such as size, structure, and geographical coverage, from static views of recurring cloud fields. But determining why certain cloud features appear and persist for different periods requires a time-evolving view of their behaviors. Geostationary satellites provide a unique opportunity to follow the time evolution of individual convective features, given their enhanced spatial and temporal sampling. A cloud-tracking tool was developed to identify properties of cloud lifecycle from the NASA Cloud, Aerosol, and Monsoon Processes Philippines Experiment (CAMP2EX) field campaign of 2019. The mission conducted intensive sampling of shallow cumulus in the West Pacific Ocean, in tandem with Rapid Scan imagery from the Advanced Himawari Imager (AHI) on the Japan Meteorological Agency’s (JMA) Himawari-8 satellite. Shallow cumulus were segmented according to thresholds in 0.5-km visible reflectance and with blurring techniques. Despite being limited to daytime hours, the segmentations yielded the best resolution available for capturing cloud initiation, growth, and decay. The tracking procedure is based on a computer vision package that includes Kalman filters for motion prediction, object overlap search, and the Hungarian (or Kuhn-Munkres) matching algorithm for track designation. AHI radiances available within the tracked cloud boundaries are assembled to form individual spectral histories. The resulting catalog provides thousands of cloud histories for domains measuring only a few degrees in latitude and longitude. We present an overview of the cloud-tracking tool and its results for cloud fields sampled throughout CAMP2EX by the airborne P-3. Cloud tracks were selected from about 10 flights to form ensembles, specific groups of tracks occurring in a region with airborne sampling. Cloud lifecycle properties, including duration and maximum area, are calculated for all ensemble members, and analyzed for cloud behavior and P-3 coincidences. By following this strategy, we quantitatively assess the degree of airborne sampling for specific cloud classes defined by the lifecycle calculations. We can summarize which cloud classes had more sampling, the stage of development during sampling, and general differences in character (e.g., isolated congestus vs. cold-pool producer).

Cloud Tracking↗

Ensemble models for circuit topology estimation, fault detection and classification in distribution systems

This paper presents a methodology for simultaneous fault detection, classification, and topology estimation for adaptive protection of distribution systems. The methodology estimates the probability of the occurrence of each one of these events by using a hybrid structure that combines three sub-systems, a convolutional neural network for topology estimation, a fault detection based on predictive residual analysis, and a standard support vector machine with probabilistic output for fault classification. The input to all these sub-systems is the local voltage and current measurements. A convolutional neural network uses these local measurements in the form of sequential data to extract features and estimate the topology conditions. The fault detector is constructed with a Bayesian stage (a multitask Gaussian process) that computes a predictive distribution (assumed to be Gaussian) of the residuals using the input. Since the distribution is known, these residuals can be transformed into a Standard distribution, whose values are then introduced into a one-class support vector machine. The structure allows using a one-class support vector machine without parameter cross-validation, so the fault detector is fully unsupervised. Finally, a support vector machine uses the input to perform the classification of the fault types. All three sub-systems can work in a parallel setup for both performance and computation efficiency. In conclusion, we test all three sub-systems included in the structure on a modified IEEE123 bus system, and we compare and evaluate the results with standard approaches.

24 POWER TRANSMISSION AND DISTRIBUTION↗