Search NASA⌕ Search

SEARCH · Search NASA

Results for “Subset selection for regression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2019

A Potent and Selective Small-Molecule Degrader of STAT3 Achieves Complete Tumor Regression In Vivo

Signal transducer and activator of transcription 3 (STAT3) is an attractive cancer therapeutic target. Here we report the discovery of SD-36, a small-molecule degrader of STAT3. SD-36 potently induces the degradation of STAT3 protein in vitro and in vivo and demonstrates high selectivity over other STAT members. Induced degradation of STAT3 results in a strong suppression of its transcription network in leukemia and lymphoma cells. SD-36 inhibits the growth of a subset of acute myeloid leukemia and anaplastic large-cell lymphoma cell lines by inducing cell-cycle arrest and/or apoptosis. SD-36 achieves complete and long-lasting tumor regression in multiple xenograft mouse models at well-tolerated dose schedules. Degradation of STAT3 protein, therefore, is a promising cancer therapeutic strategy.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2019

Bayesian and LASSO Regressions for Comparative Permeability Modeling of Sandstone Reservoirs

In this research, Bayesian model averaging (BMA) and least absolute shrinkage and selection operator regression (LASSO) algorithms were adopted for the core permeability modeling as a function of well log and core measurements. More specifically, the core permeability (dependent factor) was modeled given the well log and core data (independent variables) and then predicted in non-cored intervals of a well in a sandstone formation. The BMA is a stochastic linear modeling and a Bayesian parameter selection. Among 50 linear models generated as a function of the independent variables and depicted in Occam’s window, the best model of the highest posterior probability is determined. The best model has the optimal subset parameters that most influences the response factor. The core permeability modeling was again conducted using the LASSO algorithm, which adopts a completely different way of modeling and subset selection by using the penalized least-squared equation. Both BMA and LASSO resulted in a very accurate prediction of the core permeability by achieving perfect measured and calculated permeability matching. Matches for the two algorithms were quantified by computing the adjusted R-squared and root-mean-squared prediction error. In addition, results of the BMA and LASSO were compared to the conventional multiple linear regression (LM). The LASSO algorithm led to an accurate matching similar to LM, but slightly better than BMA. Therefore, both BMA and LASSO represent integrated procedures for accurate permeability estimation similar to conventional regression analysis.

58 GEOSCIENCES↗
DOE OSTI2023

Band gap predictions of double perovskite oxides using machine learning

Abstract The compositional and structural variety inherent to oxide perovskites spawn wide-ranging applications. In perovskites, the band gap E g , a key material parameter for these applications, can be optimally controlled by varying the composition. Here, we implement a hierarchical screening process in which two cross-validated and predictive machine learning models for band gap classification and regression, trained using exhaustive datasets that span 68 elements of the periodic table, are applied sequentially. The classification model separates wide band gap materials, with E g ≥ 0.5 eV, from materials which have zero or relatively small band gaps, namely E g < 0.5 eV, and the second regression model quantitatively predicts the gap value of the wide band gap compounds. The study down-selects 13,589 cubic oxide perovskite compositions that are predicted to be experimentally formable, thermodynamically stable, and have a wide band gap. Of these, a subset of 310 compounds, which are predicted to be stable and formable with a confidence greater than 90%, are identified for further investigation. Our models are methodically analyzed via performance metrics and inter-dependence of model features to gain physical insight into the band gap prediction problem. Design maps to identify the variation of band gap with substitution of different elements are also presented.

36 MATERIALS SCIENCE↗
NASA NTRSDate not supplied

A Combined Al-Mg/Pb-Pb Age of the Solar System

Astrophysical models of planet formation and protoplanetary disk evolution demand precise and accurate timing of the sequence of events in the solar nebula, relative to a time t=0, usually taken to be during the short epoch of CAI (Ca-rich, Al-rich inclusion) formation. Most CAIs formed withlive26Al (mean-life τ26= 1.034 Myr [1]), with an abundance 26Al/27Al ≈ (26Al/27Al)SS= 5.23 × 10-5[2]. We adopt this as the widespread level of 26Al in the solar nebula at t=0. Assuming spatial homogeneity of 26Al, an inclusion that had less 26Al, (26Al/27Al)0, formed a time Δt26= τ26ln[(26Al/27Al)SS/ (26Al/27Al)0] after t=0.These ages are typical precise to within ±0.1 Myr. Igneous bulk meteorites and inclusions can be relatively dated by the Al-Mg chronometer, but only ifΔt26<6 Myr. The Pb-Pb system is useful as a longer relative chronometer. It yields absolute ages tPb using 207Pb/206Pb, 206Pb/204Pb, and 238U/235U ratios measured indifferent portions of a sample, assuming certain half-lives [4]. These absolute ages are uncertain to within ±9 Myr due to uncertainties in the 235U half-life[3], but times of formation ΔtPb= tCAI–tPb relative to t=0, are more precise(±0.5Myr),iftCAI can be found. Here, tCAI means the Pb-Pb age that would be measured in CAIs using the half-lives the community typically uses, if they achieved isotopic closure at t=0. Unfortunately, direct Pb-Pb dating of CAIs has not definitively determined tCAI. Based on four CAIs with canonical (26Al/27Al)0,[5,6] found tPb= 4567.30 ± 0.16 Myr. No other CAI ages with measured 238U/235U have been reported in the refereed literature, but there are hints of other CAIs with ages tPb= 4568.0 ± 0.2 Myr [7] and tPb= 4568.3 ± 0.2 Myr [8].It is unclear whether anyof these igneous type B CAIs isotopically closed at t=0 or represents tCAI. Instead of measurements, we advocate finding tCAI by minimizing the discrepancies between the Al-Mg and Pb-Pb chronometers. Assuming Δt26=ΔtPb, we find the implied t’CAI= tPb+Δt26, then define t*CAIas the weighted mean of the t’CAI. t*CAIis the best guess for the Pb-Pb age of t=0; the assumption of homogeneity is justified if the t’CAI cluster within errors around t*CAI. This statistical approach is similar to, but improves on, that of[9]. We find t*CAI= 4568.73 ± 0.16 Myr. Below we discuss our methodology and the implications of this age for CAIs, 1.4 Myr older than the reported and typically used age 4567.30±0.16 Myr. Methods: We base our estimate of t*CAIon five achondrites for which published (26Al/27Al)0and Pb-Pb ages exist: the quenched angrites D’Orbigny, Sahara 99555 (SAH 99555), and Northwest Africa (NWA) 1670; the pseudo-eucrite Asuka 881394; and the inner disk achondrite. All are “NC” (non-carbonaceous) achondrites that likely cooled quickly enough that the Al-Mg and Pb-Pb systems achieved isotopic closure simultaneously. We also considered the “CC” (carbonaceous chondrite-like) achondrites NWA 2796 and NWA 6704, butdo not include them in our fit. Al-Mg and Pb-Pb seem not to have closed simultaneously, possibly because formation in the outer disk from volatile-rich composition led to slower cooling. Of the 8 chondrules from NWA 5697 measured by [20,21], we also consider the 4 for which 238U/235U was measured: 2-C1, 5-C2, 3-C5, 11-C1.Depending on their post-formation thermal histories, the Al-Mg and Pb-Pb systems in chondrules may or may not have closed simultaneously. Table 1: (26Al/27Al)0, Pb-Pb ages of selected samplesSample(26Al/27Al)0/ 10-6RefPb-PbRefD’Orbigny3.98±0.15104563.43±0.19♮10-12SAH 995553.64±0.18104563.88±0.2712NWA16705.92±0.59104564.39±0.24*10Asuka 88139413.1±0.5613-154564.98±0.1715NWA 73253.03±0.14164563.4±2.616NWA 27963.94±0.16174562.89±0.5917NWA 67043.03±0.14184562.76±0.26192-C17.56±1.53204567.57±0.56*215-C27.04±1.51204567.54±0.52*213-C58.85±1.83204566.20±0.63*2111-C15.55±1.84204565.84±0.72*21*regression based on one subset of data points ♮weighted mean of two datasets Pb-Pb ages are proportional to the intercept of the line formed by linear regression of 207Pb/206Pb vs. 206Pb/204Pb data from various washes, leachates and residues of acid dissolution of a sample. Because contamination by terrestrial or primordial Pb is pervasive, some fractions must be excluded from regressions to ensure a fit with acceptable mean squares weighted deviation (MSWD). Usually points are excluded based on low [Pb], or low 206Pb/204Pb ratio(low radiogenic component), with single outliers identified [11,12,15,16,17]. In the starred examples (Table 1)and the case of 3 CAI Pb-Pb ages [5], up to half the points were excluded solely because did not fit a pre-determined line. This approach is vulnerable to confirmation bias and produces fits with low MSWD and too-low Pb-Pb age uncertainty. Regressing the same data points as [10], were produce the Pb-Pb age of NWA 1670 of 4564.39±0.24 Myr. But selecting other combinations of data points, other, equally valid, isochrons yield ages from 4563.77±0.21 Myr to 4564.64±0.23 Myr. Similar arguments apply to the Pb-Pb isochrons built by [21] for chondrules 2-C1 (we find 4567.33±0.44 to 4567.85±0.46 Myr), 5-C2 (4566.84±0.53 to 4567.70±0.44 Myr), 3-C5 (4565.84±0.54to 4567.04±0.54)and 11-C1 (4565.36±0.51 to 4565.74±0.45 Myr). Our adopted ages for these and NWA 1670 are listed in Table 2.Table 2. tCAI estimated from various components, using our regressions for the chondrules & NWA 1670.SampleΔt26(Myr)tPb(Myr)t’CAI(Myr)D’Orbigny5.05±0.044563.43±0.194568.48±0.19SAH 995555.14±0.054563.88±0.274569.02±0.27NWA16704.64±0.104564.21±0.634568.85±0.67Asuka 8813943.81±0.044564.98±0.174568.79±0.17NWA 73255.33±0.054563.4±2.64568.7±2.6NWA 27965.06±0.044562.89±0.594567.95±0.59NWA 67045.29±0.134562.76±0.264568.05±0.292-C12.00±0.214567.59±0.704569.59±0.725-C22.07±0.224567.23±0.914569.30±0.933-C51.84±0.214566.44±1.124568.28±1.1411-C12.32±0.344565.52±0.664567.84±0.73achondrite4568.72±0.16chondrules4568.76±0.58combined4568.73±0.16A weighted average of the five NC achondrites(or just D’Orbigny, SAH 99555 and Asuka 881394)yields t*CAI= 4568.72 ± 0.16Myr. All are consistent with this value to within 1.8σ, and MSWD=1.5. Including the 4 U-corrected chondrules, t*CAI= 4568.73± 0.16Myrwith MSWD=1.66, which is statistically significant. All chondrules and NC achondrites are consistent with this to within 1.8σ, (Figure 1).Figure 1. Al-Mg formation times after t=0 vs. Pb-Pb ages. The five NC achondrites and four chondrules are consistent with a Pb-Pb age of t=0 of 4568.7 Myr. Discussion: The data from achondrites and chondrules are consistent with a single Pb-Pb age at t=0, justifying the assumption of 26Al homogeneity. The age, 4568.7 Myr, is ≈1.4 Myr older than the commonly accepted Pb-Pb age of CAIs that formed with canonical 26Al/27Al at t=0 [3]. Others have interpreted the discrepancy to signify 26Al heterogeneity in the CAI-forming region[5,21]. We suggest instead that CAIs were exposed to transient heating events that reset the Pb-Pb system without disturbing the Al-Mg system. Notably, chondrules typically experienced transient heating at these times in the nebula [22]. If so, direct measurements of CAIs will not yield as reliable a Pb-Pb age of t=0 as statistical approaches like this and that of [9].References:[1] Auer et al. 2009. [2] Jacobsen, B et al. 2008, EPSL 272, 353-364. [3] Tissot, Fet al. 2017, GCA 213, 593-617.[4] Villa, I et al. 2016, GCA 172, 387-392.[5] Amelin, Y et al. 2010, EPSL 300, 343-350.[6] Connelly, Jet al. 2012, Science 338, 651.[7] Bouvier, Aet al. 2011, LPICo 1639, 9054. [8] Bouvier, Aand Wadhwa, M2010, Nat Geosci 3, 637-641.[9] Nyquist, Let al. 2009, GCA 73, 5115-5136.[10] Schiller et al. 2015. [11] Wadhwa & Brennecka 2012. [12] Tissot et al. 2017. [13] Nyquist et al. 2003. [14] Wadhwa et al. 2009. [15] Wimpenny et al. 2019, GCA 244, 478-501.[16] Koefoed et al. 2016, GCA 183, 31-45. [17] Bouvier, A et al. 2011, GCA 75, 5310-5323. [18] Sanborn, Met al. 2019, GCA 245, 577-596. [19] Amelin, Yet al. 2019, GCA 245, 628-642.[20] Bollard, Jet al. 2017, Sci Adv 3 ,e1700407. [21] Bollard, Jet al. 2019, GCA 260, 62-83.[22] Villeneuve, J et al. 2009, Science 325, 985

S. J. Desch↗
NASA NTRS2018

Calibration of the DSCOVR EPIC Visible and NIR Channels using MODIS Terra and Aqua Data and EPIC Lunar Observations

The unique position of the Deep Space Climate Observatory (DSCOVR) Earth Polychromatic Imaging Camera (EPIC) at the Lagrange 1 point makes an important addition to the data from currently operating low Earth orbit observing instruments. EPIC instrument does not have an onboard calibration facility. One approach to its calibration is to compare EPIC observations to the measurements from polar-orbiting radiometers. Moderate Resolution Imaging Spectroradiometer (MODIS) is a natural choice for such comparison due to its well-established calibration record and wide use in remote sensing. We use MODIS Aqua and Terra L1B 1km reflectances to infer calibration coefficients for four EPIC visible and NIR channels: 443, 551, 680 and 780 nm. MODIS and EPIC measurements made between June 2015 and 2016 are employed for comparison. We first identify favorable MODIS pixels with scattering angle matching temporarily collocated EPIC observations. Each EPIC pixel is then spatially collocated to a subset of the favorable MODIS pixels within 25 km radius. Standard deviation of the selected MODIS pixels as well as of the adjacent EPIC pixels is used to find the most homogeneous scenes. These scenes are then used to determine calibration coefficients using a linear regression between EPIC counts/sec and reflectances in the close MODIS spectral channels. We present thus inferred EPIC calibration coefficients and discuss sources of uncertainties. The lunar EPIC observations are used to calibrate EPIC O2 absorbing channels (688 and 764 nm), assuming that there is a small difference between moon reflectances separated by approx.10 nm in wavelength provided the calibration factors of the red (680 nm) and near-IR (780 nm) are known from comparison between EPIC and MODIS.

Geogdzhayev, Igor V.↗
NASA NTRS1977

Utility of correlation techniques in gravity and magnetic interpretation

Internal correspondence uses Poisson's Theorem in a moving-window linear regression analysis between the anomalous first vertical derivative of gravity and total magnetic field reduced to the pole. The regression parameters provide critical information on source characteristics. The correlation coefficient indicates the strength of the relation between magnetics and gravity. Slope value gives delta j/delta sigma estimates of the anomalous source. The intercept furnishes information on anomaly interference. Cluster analysis consists of the classification of subsets of data into groups of similarity based on correlation of selected characteristics of the anomalies. Model studies are used to illustrate implementation and interpretation procedures of these methods, particularly internal correspondence. Analysis of the results of applying these methods to data from the midcontinent and a transcontinental profile shows they can be useful in identifying crustal provinces, providing information on horizontal and vertical variations of physical properties over province size zones, validating long wavelength anomalies, and isolating geomagnetic field removal problems.

Chandler, V. W.↗
DOE OSTI2022

Sensor selection and tool wear prediction with data‐driven models for precision machining

Abstract Estimation of tool wear in precision machining is vital in the traditional subtractive machining industry to reduce processing cost, improve manufacturing efficiency and product quality. In this vein, fusion of time and frequency‐domain features of commonly sensed signals can provide an early indication of tool wear and improve its prediction accuracy for prognostics and health management. This paper presents a data‐driven methodology and a complete tool chain for the inference of precision machining tool wear from fused machine measurements, such as cutting force, power, audio and vibration signals, and quantify the usefulness of each measurement. Indicators of tool wear are extracted from time‐domain signal statistics, frequency‐domain analysis, and time‐frequency domain analysis. Correlation coefficients between the extracted features (indicators) and the tool wear are used to select the most informative features. Principal Component Analysis and Partial Least‐Squares are used to reduce the dimensionality of the feature space. Regression models, including linear regression, support vector regression, Decision tree regression, neural network regression and Gaussian process regression, are used to predict the tool wear using data from a Haas milling machine performing spiral boss face milling. The performance of the regression models based on subsets of sensors validates the preliminary estimates about the saliency of the sensors. The experimental results show that the proposed methods can predict the machine tool wear precisely, with readily available sensor measurements. Neural network and Gaussian process regression were able to achieve good estimates of tool wear at different machine operating conditions. The most informative signal in predicting tool wear was shown to be the vibration signal. Time‐frequency domain features were the most informative features among the combination of features of three domains. In addition, using partial least squares components extracted from the original features of signals led to higher prediction accuracy.

Han, Seulki↗
NASA NTRS1998

Experiments to Determine Whether Recursive Partitioning (CART) or an Artificial Neural Network Overcomes Theoretical Limitations of Cox Proportional Hazards Regression

New computationally intensive tools for medical survival analyses include recursive partitioning (also called CART) and artificial neural networks. A challenge that remains is to better understand the behavior of these techniques in effort to know when they will be effective tools. Theoretically they may overcome limitations of the traditional multivariable survival technique, the Cox proportional hazards regression model. Experiments were designed to test whether the new tools would, in practice, overcome these limitations. Two datasets in which theory suggests CART and the neural network should outperform the Cox model were selected. The first was a published leukemia dataset manipulated to have a strong interaction that CART should detect. The second was a published cirrhosis dataset with pronounced nonlinear effects that a neural network should fit. Repeated sampling of 50 training and testing subsets was applied to each technique. The concordance index C was calculated as a measure of predictive accuracy by each technique on the testing dataset. In the interaction dataset, CART outperformed Cox (P less than 0.05) with a C improvement of 0.1 (95% Cl, 0.08 to 0.12). In the nonlinear dataset, the neural network outperformed the Cox model (P less than 0.05), but by a very slight amount (0.015). As predicted by theory, CART and the neural network were able to overcome limitations of the Cox model. Experiments like these are important to increase our understanding of when one of these new techniques will outperform the standard Cox model. Further research is necessary to predict which technique will do best a priori and to assess the magnitude of superiority.

Kattan, Michael W.↗
DOE OSTI2024

The Role of Data Filtering in Open Source Software Ranking and Selection

Faced with more than 100M open source projects, a more manageable small subset is needed for most empirical investigations. More than half of the research papers in leading venues investigated filtering projects by some measure of popularity with explicit or implicit arguments that unpopular projects are not of interest, may not even represent "real" software projects, or that less popular projects are not worthy of study. However, such filtering may have enormous effects on the results of the studies if and precisely because the sought-out response or prediction is in any way related to the filtering criteria.This paper exemplifies the impact of this common practice on research outcomes, specifically how filtering of software projects on GitHub based on inherent characteristics affects the assessment of their popularity. Using a dataset of over 100,000 repositories, we used multiple regression to model the number of stars -a commonly used proxy for popularity- based on factors such as the number of commits, the duration of the project, the number of authors and the number of core developers. Our control model included the entire dataset, while a second filtered model considered only projects with ten or more authors. The results indicated that while certain characteristics of the repository consistently predict popularity, the filtering process significantly alters the relationships between these characteristics and the response. We found that the number of commits exhibited a positive correlation with popularity in the control sample but showed a negative correlation in the filtered sample. These findings highlight the potential biases introduced by data filtering and emphasize the need for careful sample selection in empirical research of mining software repositories. We recommend that empirical work should either analyze complete datasets such as World of Code, or employ stratified random sampling from a complete dataset to ensure that filtering is not biasing the results.

Malviya Thakur, Addi↗
NASA NTRS1983

Selection of optimum frequencies for atmospheric electric path length measurement by satellite-borne microwave radiometers

Numerical experiments using regressions by leaps and bounds have been performed to determine the optimum frequencies for satellite-borne microwave radiometers to estimate atmospheric electrical path length over the sea. The frequency range 5-40 GHz was searched. The effect of surface wind speed, sea surface temperature, and clouds was considered in the optimum frequency selection. The analysis indicates that approximately 0.6-cm rms accuracy is possible for one-way path length measurement using a proper pair of frequencies. The best two-channel subset selected by the leaps and bounds techniques is (16.0, 21.0) GHz.

Pandey, P. C.↗
NASA NTRS2006

A LEAST ABSOLUTE SHRINKAGE AND SELECTION OPERATOR (LASSO) FOR NONLINEAR SYSTEM IDENTIFICATION

Identification of parametric nonlinear models involves estimating unknown parameters and detecting its underlying structure. Structure computation is concerned with selecting a subset of parameters to give a parsimonious description of the system which may afford greater insight into the functionality of the system or a simpler controller design. In this study, a least absolute shrinkage and selection operator (LASSO) technique is investigated for computing efficient model descriptions of nonlinear systems. The LASSO minimises the residual sum of squares by the addition of a 1 penalty term on the parameter vector of the traditional 2 minimisation problem. Its use for structure detection is a natural extension of this constrained minimisation approach to pseudolinear regression problems which produces some model parameters that are exactly zero and, therefore, yields a parsimonious system description. The performance of this LASSO structure detection method was evaluated by using it to estimate the structure of a nonlinear polynomial model. Applicability of the method to more complex systems such as those encountered in aerospace applications was shown by identifying a parsimonious system description of the F/A-18 Active Aeroelastic Wing using flight test data.

Kukreja, Sunil L.↗
DOE OSTI2018

Strategies and Software for Machine Learning Accelerated Discovery in Transition Metal Chemistry

Machine learning the electronic structure of open shell transition metal complexes presents unique challenges, including robust and automated data set generation. In this report we introduce tools that simplify data acquisition from density functional theory (DFT) and validation of trained machine learning models using the molSimplify automatic design (mAD) workflow. We demonstrate this workflow by training and comparing the performance of LASSO, kernel ridge regression (KRR), and artificial neural network (ANN) models using heuristic, topological revised autocorrelation (RAC) descriptors we have recently introduced for machine learning inorganic chemistry. On a series of open shell transition metal complexes, we evaluate set aside test errors of these models for predicting the HOMO level and HOMO–LUMO gap. The best performing models are ANNs, which show 0.15 and 0.25 eV test set mean absolute errors on the HOMO level and HOMO–LUMO gap, respectively. Poor performing KRR models using the full 153-feature RAC set are improved to nearly the same performance as the ANNs when trained on down-selected subsets of 20–30 features. Analysis of the essential descriptors for HOMO level and HOMO–LUMO gap prediction as well as comparison to subsets previously obtained for other properties reveal the paramount importance of nonlocal, steric properties in determining frontier molecular orbital energetics. We demonstrate our model performance on diverse complexes and in the discovery of molecules with target HOMO–LUMO gaps from a large 15,000 molecule design space in minutes rather than days that full DFT evaluation would require.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Permutation-adapted complete and independent basis for atomic cluster expansion descriptors

Atomic cluster expansion (ACE) methods provide a systematic way to describe particle local environments of arbitrary body order. For practical applications it is often required that the basis of cluster functions be symmetrized with respect to rotations and permutations. Existing methodologies yield sets of symmetrized functions that are over-complete. These methodologies thus require an additional numerical procedure, such as singular value decomposition (SVD), to eliminate redundant functions. In this work, it is shown that analytical linear relationships for subsets of cluster functions may be derived using recursion and permutation properties of generalized Wigner symbols. From these relationships, subsets (blocks) of cluster functions can be selected such that, within each block, functions are guaranteed to be linearly independent. It is conjectured that this block-wise independent set of permutation-adapted rotation and permutation invariant (PA-RPI) functions forms a complete, independent basis for ACE. Along with the first analytical proofs of block-wise linear dependence of ACE cluster functions and other theoretical arguments, numerical results are offered to demonstrate this. The utility of the method is demonstrated in the development of an ACE interatomic potential for tantalum. Using the new basis functions in combination with Bayesian compressive sensing sparse regression, some high degree descriptors are observed to persist and help achieve high-accuracy models.

Angular momentum↗
DOE OSTI2023

Lithium-Ion Battery Diagnostics Using Electrochemical Impedance via Machine-Learning

Diagnosing battery states such as health, state-of-charge, or temperature is crucial for ensuring the safety and reliability of electrochemical energy storage systems. While some states, such as temperature, may be measured using cheap sensors, accurate diagnosis of battery health metrics usually requires time-consuming performance measurements, making them infeasible for use in real-world operation. These health metrics can be measured during lab-testing and then estimated on-line using predictive life models or via state observer algorithms such as Kalman filters, but these predictive methods should be supplemented by actual measurement of battery health whenever possible to ensure reliability. Rapid measurement of battery health may be done by various types of fast diagnostic techniques such as electrochemical impedance spectroscopy (EIS), which can be performed in only a few minutes and require only a fraction of the energy and power needed for a full charge and discharge measurement. But there is a substantial challenge for estimating battery health using EIS data, as EIS is sensitive to cell temperature, state-of-charge, current, and resting time in addition to health. Thus, utilizing EIS data to predict battery capacity requires correcting for all these additional variables, a task that is extremely difficult to handle analytically. This talk utilizes machine-learning methods to estimate the effectiveness of battery capacity prediction from EIS data, leveraging a data set of hundreds of EIS measurements recorded at varying temperature and state-of-charge throughout a 500-day aging study of 32 commercial, large-format NMC-Graphite lithium-ion batteries. Using EIS as input to machine-learning models is complicated by the nonlinear response of impedance to battery health, temperature, and state-of-charge, as well as the collinearity between the impedance response at neighboring frequencies, which can easily lead to overfit models. To train robust models, features from EIS data need to be extracted from the data or some subset of critical frequencies selected. Many approaches for extracting and selecting features from EIS data from electrochemical analysis and machine-learning fields were identified for analysis: using the entire raw spectra; selection of one, two, or many frequencies from the entire spectra; selecting interesting points from the EIS measurement using domain knowledge; fitting EIS with an equivalent-circuit model; calculating statistics on the raw impedance values; and reducing the dimensionality of the data using unsupervised linear (principal component analysis) and non-linear (uniform manifold approximation and projection) methods. These approaches were rigorously compared using a machine-learning pipeline approach, training linear, Gaussian process, and random forest regression models and quantifying performance using cross-validation as well as a held-out test set. An artificial neural network model trained on the raw spectra was also tested. Promising pipelines were fine-tuned via Bayesian hyperparameter optimization using cross-validation loss and training with class-specific weights to counter data set imbalance. The most reliable method for utilizing impedance in this work was the selection of two optimal frequencies through an exhaustive search, resulting in about 2% mean absolute error on test data for both Gaussian process and random forest model architectures. Interrogation of a variety of models reveals critical frequencies of 100 Hz and 103 Hz for this data set, though the optimal set of frequencies is not necessarily intuitive, i.e., the best performing models are not simply those that use impedance at frequencies that have the highest correlation to the relative discharge capacity. The best performing model is an ensemble model, which is able to predict battery capacity with 1.9% mean absolute error for unseen cells using impedance recorded at a variety of temperatures and states-of-charge.

battery↗
DOE OSTI2023

Variability in modelled reservoir greenhouse gas emissions: comparison of select US hydropower reservoirs against global estimates

Abstract Greenhouse gas (GHG) emissions from reservoirs have most often been evaluated on a global extent through areal scaling or linear-regression models. These models typically rely on a limited number of characteristics such as age, size, and average temperature to estimate per reservoir or areal flux. Such approaches may not be sufficient for describing conditions at all types of reservoirs. Emissions from hydropower reservoirs have received increasing attention as industry and policy makers seek to better understand the role of hydropower in sustainable energy solutions. In the United States (US), hydropower reservoirs span a wide range of climate regions and have diverse design and operational characteristics compared to those most heavily represented in model literature (i.e., large, tropical reservoirs). It is not clear whether estimates based on measurements and modeling of other subsets of reservoirs describe the diverse types of hydropower reservoirs in the US. We applied the Greenhouse Gas from Reservoirs (G‐res) emissions model to 28 hydropower reservoirs located in a variety of ecological, hydrological, and climate settings that represent the range of sizes and types of facilities within the US hydropower fleet. The dominant pathways for resulting GHG emissions estimates in the case-study reservoirs were diffusion of carbon dioxide, followed by methane ebullition. Among these case-study reservoirs, total post-impoundment areal flux of carbon ranges from 84 to 767 mgCm −2 d −1 , which is less variable than what has been reported through measurements at other US and global reservoirs. The net GHG reservoir footprint was less variable and towards the lower end of the range observed from modeling larger global reservoirs, with a range of 138 to 1,052 g CO 2 eq m −2 y −1 , while the global study reported a range of 115 to 145,472 g CO 2 eq m −2 y −1 . High variation in emissions normalized with respect to area and generation highlights the need to be cautious when using area or generation in predicting or communicating emissions footprints for reservoirs relative to those of other energy sources, especially given that many of the hydropower reservoirs in the US serve multiple purposes beyond power generation.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2007

Aeroelastic Model Structure Computation for Envelope Expansion

Structure detection is a procedure for selecting a subset of candidate terms, from a full model description, that best describes the observed output. This is a necessary procedure to compute an efficient system description which may afford greater insight into the functionality of the system or a simpler controller design. Structure computation as a tool for black-box modelling may be of critical importance in the development of robust, parsimonious models for the flight-test community. Moreover, this approach may lead to efficient strategies for rapid envelope expansion which may save significant development time and costs. In this study, a least absolute shrinkage and selection operator (LASSO) technique is investigated for computing efficient model descriptions of nonlinear aeroelastic systems. The LASSO minimises the residual sum of squares by the addition of an l(sub 1) penalty term on the parameter vector of the traditional 2 minimisation problem. Its use for structure detection is a natural extension of this constrained minimisation approach to pseudolinear regression problems which produces some model parameters that are exactly zero and, therefore, yields a parsimonious system description. Applicability of this technique for model structure computation for the F/A-18 Active Aeroelastic Wing using flight test data is shown for several flight conditions (Mach numbers) by identifying a parsimonious system description with a high percent fit for cross-validated data.

Kukreja, Sunil L.↗
NASA NTRS2007

Aeroelastic Model Structure Computation for Envelope Expansion

Structure detection is a procedure for selecting a subset of candidate terms, from a full model description, that best describes the observed output. This is a necessary procedure to compute an efficient system description which may afford greater insight into the functionality of the system or a simpler controller design. Structure computation as a tool for black-box modeling may be of critical importance in the development of robust, parsimonious models for the flight-test community. Moreover, this approach may lead to efficient strategies for rapid envelope expansion that may save significant development time and costs. In this study, a least absolute shrinkage and selection operator (LASSO) technique is investigated for computing efficient model descriptions of non-linear aeroelastic systems. The LASSO minimises the residual sum of squares with the addition of an l(Sub 1) penalty term on the parameter vector of the traditional l(sub 2) minimisation problem. Its use for structure detection is a natural extension of this constrained minimisation approach to pseudo-linear regression problems which produces some model parameters that are exactly zero and, therefore, yields a parsimonious system description. Applicability of this technique for model structure computation for the F/A-18 (McDonnell Douglas, now The Boeing Company, Chicago, Illinois) Active Aeroelastic Wing project using flight test data is shown for several flight conditions (Mach numbers) by identifying a parsimonious system description with a high percent fit for cross-validated data.

Kukreja, Sunil L.↗
NASA NTRS2012

Using Statistical Multivariable Models to Understand the Relationship Between Interplanetary Coronal Mass Ejecta and Magnetic Flux Ropes

In-situ measurements of interplanetary coronal mass ejections (ICMEs) display a wide range of properties. A distinct subset, "magnetic clouds" (MCs), are readily identifiable by a smooth rotation in an enhanced magnetic field, together with an unusually low solar wind proton temperature. In this study, we analyze Ulysses spacecraft measurements to systematically investigate five possible explanations for why some ICMEs are observed to be MCs and others are not: i) An observational selection effect; that is, all ICMEs do in fact contain MCs, but the trajectory of the spacecraft through the ICME determines whether the MC is actually encountered; ii) interactions of an erupting flux rope (PR) with itself or between neighboring FRs, which produce complex structures in which the coherent magnetic structure has been destroyed; iii) an evolutionary process, such as relaxation to a low plasma-beta state that leads to the formation of an MC; iv) the existence of two (or more) intrinsic initiation mechanisms, some of which produce MCs and some that do not; or v) MCs are just an easily identifiable limit in an otherwise corntinuous spectrum of structures. We apply quantitative statistical models to assess these ideas. In particular, we use the Akaike information criterion (AIC) to rank the candidate models and a Gaussian mixture model (GMM) to uncover any intrinsic clustering of the data. Using a logistic regression, we find that plasma-beta, CME width, and the ratio O(sup 7) / O(sup 6) are the most significant predictor variables for the presence of an MC. Moreover, the propensity for an event to be identified as an MC decreases with heliocentric distance. These results tend to refute ideas ii) and iii). GMM clustering analysis further identifies three distinct groups of ICMEs; two of which match (at the 86% level) with events independently identified as MCs, and a third that matches with non-MCs (68 % overlap), Thus, idea v) is not supported. Choosing between ideas i) and iv) is more challenging, since they may effectively be indistinguishable from one another by a single in-situ spacecraft. We offer some suggestions on how future studies may address this.

Riley, P.↗