Search NASA⌕ Search

SEARCH · Search NASA

Results for “ridge regression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Machine learning Frenkel Hamiltonian parameters to accelerate simulations of exciton dynamics

In this manuscript, we develop multiple machine learning (ML) models to accelerate a scheme for parameterizing site-based models of exciton dynamics from all-atom configurations of condensed phase sexithiophene systems. This scheme encodes the details of a system’s specific molecular morphology in the correlated distributions of model parameters through the analysis of many single-molecule excited-state electronic-structure calculations. These calculations yield excitation energies for each molecule in the system and the network of pair-wise intermolecular electronic couplings. In this work, we demonstrate that the excitation energies can be accurately predicted using a kernel ridge regression (KRR) model with Coulomb matrix featurization. We present two ML models for predicting intermolecular couplings. The first one utilizes a deep neural network and bi-molecular featurization to predict the coupling directly, which we find to perform poorly. The second one utilizes a KRR model to predict unimolecular transition densities, which can subsequently be analyzed to compute the coupling. We find that the latter approach performs excellently, indicating that an effective, generalizable strategy for predicting simple bimolecular properties is through the indirect application of ML to predict higher-order unimolecular properties. Such an approach necessitates a much smaller feature space and can incorporate the insight of well-established molecular physics.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Resolving the fast ion distribution from imaging neutral particle analyzer measurements

A recently developed imaging neutral particle analyzer (INPA) on the DIII-D tokamak (Du 2018 Nucl. Fusion 58 082006) enables fast ion velocity-space tomography of high fidelity at the interrogated phase space. To accomplish this, the spatial and energy depending fast ( E < 80 keV) neutral flux towards the INPA stripping foils is calculated with FIDASIM and a newly developed code INPASIM simulates the INPA instrumental response to this neutral flux. Included in INPASIM is the neutral-foil interaction, the Larmor orbit tracing between the foil and the phosphor, the phosphor response to the incident ion flux as well as camera focusing. Benefiting from heavy, localized velocity-space weights and excellent signal to noise, computed tomography using the Ridge regression method is able to successfully reconstruct fine-scale velocity-space structures produced by multiple neutral beams separated by as small as ~3 keV in tests. Applying the inversion method to a sawtooth crash event reveals a significant profile flattening of confined passing particles across q = 1 flux surface, as well as a redistribution of fast ions into the trapped orbits at the plasma edge close to the last closed flux surface.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Many-body expansion based machine learning models for octahedral transition metal complexes

Abstract Graph-based machine learning (ML) models for material properties show great potential to accelerate virtual high-throughput screening of large chemical spaces. However, in their simplest forms, graph-based models do not include any 3D information and are unable to distinguish stereoisomers such as those arising from different orderings of ligands around a metal center in coordination complexes. In this work we present a modification to revised autocorrelation descriptors, a molecular graph featurization method, for predicting spin state dependent properties of octahedral transition metal complexes (TMCs). Inspired by analytical semi-empirical models for TMCs, the new modeling strategy is based on the many-body expansion (MBE) and allows one to tune the captured stereoisomer information by changing the truncation order of the MBE. We present the necessary modifications to include this approach in two commonly used ML methods, kernel ridge regression and feed-forward neural networks. On a test set composed of all possible isomers of binary TMCs, the best MBE models achieve mean absolute errors (MAEs) of 2.75 kcal mol −1 on spin-splitting energies and 0.26 eV on frontier orbital energy gaps, a 30%–40% reduction in error compared to models based on our previous approach. We also observe improved generalization to previously unseen ligands where the best-performing models exhibit MAEs of 4.00 kcal mol −1 (i.e. a 0.73 kcal mol −1 reduction) on the spin-splitting energies and 0.53 eV (i.e. a 0.10 eV reduction) on the frontier orbital energy gaps. Because the new approach incorporates insights from electronic structure theory, such as ligand additivity relationships, these models exhibit systematic generalization from homoleptic to heteroleptic complexes, allowing for efficient screening of TMC search spaces.

Meyer, Ralf (ORCID:0000000322360261)↗

Predicting impurity spectral functions using machine learning

The Anderson Impurity Model (AIM) is a canonical model of quantum many-body physics. Here we investigate whether machine learning models, both neural networks (NN) and kernel ridge regression (KRR), can accurately predict the AIM spectral function in all of its regimes, from empty orbital, to mixed valence, to Kondo. To tackle this question, we construct two large spectral databases containing approximately 410 000 and 600 000 spectral functions of the single-channel impurity problem. We show that the NN models can accurately predict the AIM spectral function in all of its regimes, with pointwise mean absolute errors down to 0.003 in normalized units. We find that the trained NN models outperform models based on KRR and enjoy a speedup on the order of 10 5 over traditional AIM solvers. Finally, the required size of the training set of our model can be significantly reduced using farthest point sampling in the AIM parameter space, which is important for generalizing our method to more complicated multichannel impurity problems of relevance to predicting the properties of real materials.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Data-Driven Mean-Corrected Recursive Estimation-Based Optimal DER Dispatch for Distribution System Voltage Control

Recent advances in smart inverters offer opportunities to mitigate adverse grid impacts caused by high penetrations of distributed photovoltaics (PV) in distribution grids, such as voltage violations. Here, this paper proposes a novel measurement-driven optimal power flow (OPF)-based distributed energy resource management system (DERMS) voltage regulation via recursive sensitivity estimation informed coordinated control of distributed PV inverters. The proposed approach leverages available grid and controllable DER measurements, eliminating reliance on system model information while being adaptive and robust to volatile operating conditions. A mean-corrected recursive ridge regression (MCRRR) algorithm is proposed for sensitivity estimation, continuously refining the sensitivity model through a closed-form solution. It effectively manages varying grid operating conditions, such as changes in power injections and topology reconfiguration, to facilitate a time-varying update of the Load Sensitivity Factors (LSF). The proposed approach is formulated as a linear programming (LP) problem and is thus scalable to larger-scale distribution systems. Its effectiveness and efficiency are demonstrated on a realistic distribution feeder with high PV penetrations in Southern California, USA.

14 SOLAR ENERGY↗

Optimizing transmit field inhomogeneity of parallel RF transmit design in 7T MRI using deep learning

Ultrahigh field (UHF) Magnetic Resonance Imaging (MRI) provides a higher signal-to-noise ratio and, thereby, higher spatial resolution. However, UHF MRI introduces challenges such as transmit radiofrequency (RF) field (B+1) inhomogeneities, leading to uneven flip angles and image intensity anomalies. These issues can significantly degrade imaging quality and its medical applications. This study addresses B+1 field homogeneity through a novel deep learning-based strategy. Traditional methods like Magnitude Least Squares (MLS) optimization have been effective but are time-consuming and dependent on the patient’s presence. Recent machine learning approaches, such as RF Shim Prediction by Iteratively Projected Ridge Regression and deep learning frameworks, have shown promise but face limitations like extensive training times and oversimplified architectures. We propose a two-step deep learning strategy. First, we obtain the desired reference RF shimming weights from multi-channel B+1 fields using random-initialized Adaptive Moment Estimation. Then, we employ Residual Networks (ResNets) to train a model that maps B+1 fields to target RF shimming outputs. Our approach does not rely on pre-calculated reference optimizations for the testing process and efficiently learns residual functions. Comparative studies with traditional MLS optimization demonstrate our method’s advantages in terms of speed and accuracy. The proposed strategy achieves a faster and more efficient RF shimming design, significantly improving imaging quality at UHF. This advancement holds potential for broader applications in medical imaging and diagnostics.

Lu, Zhengyi [Vanderbilt University]↗

MSU Disentanglement Analysis Software

This software is used to disentangle the forced-versus-unforced components of tropospheric temperature change over the satellite era (after 1979) using maps of surface temperature change as a predictor. In general, the software assembles training datasets (from pre-computed surface temperature trend maps and domain averaged tropospheric warming rates), trains statistical/machine learning (ML) algorithms, applies the trained statistical/ML model to climate model data and observations, and then saves the results. A leave-one-out approach is used in which the statistical/ML models are iteratively trained on (N- 1) climate model and then applied to the remaining climate model (and observations). Each model includes a large ensemble (i.e., >10) of model simulations. The software relies on scikit-learn ridge regression, PLS regression, and neural network algorithms.

Po-Chedley, StephenD↗

Toward Discovering the Structure and Dynamics of the Sun-Interstellar Medium System (Los Alamos LDRD Report)

We have taken major steps toward developing the tools necessary to explore with unprecedented resolution the plasma structure and dynamics of the Sun-interstellar medium (ISM) interaction region, known as the heliosheath. We have applied a rigorous imaging technique known as Generalized Ridge Regression (GRR) to construct statistically robust sky maps of hydrogen energetic neutral atoms (ENAs) emanating from this region and detected by the Los Alamos-led IBEX-Hi ENA imager [1] on NASA’s Interstellar Boundary Explorer (IBEX) mission [2]. Our methods go far beyond the map reconstruction process currently applied by the IBEX Science Operations Center (ISOC), opening up the possibility of new discovery science with the IBEX data set and positioning LANL for a lead science role for the upcoming Interstellar Mapping and Acceleration Probe (IMAP) mission [3] for which LANL is providing two key experiments. We have successfully demonstrated that the new maps are higher resolution and are capable of revealing structures that are not presently resolveable in standard ISOC maps

58 GEOSCIENCES↗

Robust global detection of forced changes in mean and extreme precipitation despite observational disagreement on the magnitude of change

Detection and attribution (D&A) of forced precipitation change are challenging due to internal variability, limited spatial, and temporal coverage of observational records and model uncertainty. These factors result in a low signal-to-noise ratio of potential regional and even global trends. Here, we use a statistical method – ridge regression – to create physically interpretable fingerprints for the detection of forced changes in mean and extreme precipitation with a high signal-to-noise ratio. The fingerprints are constructed using Coupled Model Intercomparison Project phase 6 (CMIP6) multi-model output masked to match coverage of three gridded precipitation observational datasets – GHCNDEX, HadEX3, and GPCC – and are then applied to these observational datasets to assess the degree of forced change detectable in the real-world climate in the period 1951–2020. We show that the signature of forced change is detected in all three observational datasets for global metrics of mean and extreme precipitation. Forced changes are still detectable from changes in the spatial patterns of precipitation even if the global mean trend is removed from the data. This shows the detection of forced change in mean and extreme precipitation beyond a global mean trend is robust and increases confidence in the detection method's power as well as in climate models' ability to capture the relevant processes that contribute to large-scale patterns of change. We also find, however, that detectability depends on the observational dataset used. Not only coverage differences but also observational uncertainty contribute to dataset disagreement, exemplified by the times of emergence of forced change from internal variability ranging from 1998 to 2004 among datasets. Furthermore, different choices for the period over which the forced trend is computed result in different levels of agreement between observations and model projections. These sensitivities may explain apparent contradictions in recent studies on whether models under- or overestimate the observed forced increase in mean and extreme precipitation. Lastly, the detection fingerprints are found to rely primarily on the signal in the extratropical Northern Hemisphere, which is at least partly due to observational coverage but potentially also due to the presence of a more robust signal in the Northern Hemisphere in general.

54 ENVIRONMENTAL SCIENCES↗

Investigation of Air Transportation Technology at Ohio University, 1989-1990

The activities of the participants in the Joint University Program (JUP) at Ohio University are briefly surveyed. During 1989 to 1990, five topics received emphasis. A spectrum-efficient weather data uplink system was designed, constructed, and flight tested. An integrated Global Positioning System/Inertial Navigation System (GPS/INS) study continued, utilizing the Redundant strapdown Inertial Measurement Unit (IMU) on loan from NASA. The Ridge Regression theory was refined and applied to air navigation scenarios. System Identification theory was applied to GPS data to point the way to better understanding of the effects of Selective Availability on civilian users of this navigation system. An analysis of thought-related (electroencephalographic) signals for application to control of computer systems that could have significance in aiding paraplegics or for hands-off systems control in industrial or air traffic control areas was carried out.

Lilley, Robert W.↗

Study of the crust and mantle using magnetic surveys by Magsat and other satellites

This article summarizes some of the methodology and results for studies of the earth's mantle and crust. Mantle conductivity studies can be made either by studying signals impressed on the earth from outside, e.g., the ionosphere or magnetosphere, or by studing signals originating in the core and transmitted through the mantle. Crustal field studies begin with a careful selection of the data and subsequent removal of core and external fields by some sort of filtering. Average maps from different local times sometimes differ, presumably due to the remaining presence of fields of external origin. Several techniques for further filtering are discussed. Where large-area aeromagnetic maps are available, crustal maps derived from satellite data can be compared with upward continued data. In general, the comparisons show agreement, with some differences, particularly in and near the auroral belts. The satellite data are further reduced by various methods of inverse and forward modeling, sometimes including reduction to the pole. These techniques are generally unstable at the equator. Common methods of stabilizing the inversions include principle components analysis and ridge regression. Because of the presence of the core field, the entire crustal contribution from the field is not known. Also, there is a basic nonuniqueness to the inverse solutions. Nevertheless, magnetizations that are interpretable can be derived.

Langel, Robert A.↗

Variance Decomposition of MEDLI2 Reconstructed Heating Using Neural Networks

The Mars Entry, Descent, and Landing Instrumentation (MEDLI2) sensor suite collected data during entry of the Mars 2020 Perseverance rover into Mars’ atmosphere. This suite included a network of MEDLI2 Instrumented Sensor Plugs (MISPs). Each MISP was comprised of a cylinder made of Thermal Protection System (TPS) material with 1-3 embedded thermocouples (TCs), and it was flush mounted into the heatshield or backshell. Data from these in-depth TCs were used to reconstruct the aeroheating environment of the vehicle throughout entry. Surface heating was posed as an inverse problem, with the goal of estimating the surface heating by minimizing an objective function of the difference between MISP temperature measurements during flight and the temperature predictions derived from the Fully Implicit Ablation and Thermal response (FIAT) program. Given an aerothermal environment, FIAT calculates the material response and provides in-depth temperatures throughout the TPS material. To achieve the reverse, an internal tool called FIAT_Opt runs through multiple different environments until the output temperature at the TC depth closely matches the flight data. 95% confidence intervals on the reconstructed surface heating were obtained using Monte Carlo analysis, in which uncertainties in the thermocouple depth and the TPS material properties (e.g., density, thermal conductivity, heat capacity, emissivity) based on flight-lot material testing were included. A variance decomposition method using Sobol indices was employed to assess the sensitivity of the reconstructed peak heating to the TC placement and material property uncertainties. Variance decomposition was found to require tens of thousands of FIAT_Opt runs in order for the Sobol indices to converge. With a single FIAT_Opt run taking on the order of 40 minutes, the required number of computations would take months to complete, even if using multiple CPUs. To mitigate this problem, three machine learning models (ridge regression with cross-validation, random forest regression, and a deep neural network) were trained and tested using the 2000 Monte Carlo runs that were already completed. A subset of 1600 runs were used to train the model (i.e., training set), while the remaining 400 runs were used as the test set. The predictions from the deep neural network (DNN) on the test set showed nearly perfect agreement to the actual values computed with FIAT_Opt (R2 > 0.99). Using the DNN as a surrogate model, the variance decomposition using 50,000 runs was completed within minutes. The resulting Sobol indices showed that the reconstructed peak surface heating was most sensitive to the uncertainties in the thermal conductivity (ST = 0.37) and heat capacity (ST = 0.26). This method can be leveraged to provide requirements for material property measurements needed to improve the accuracy of surface heating prediction and ultimately lead to the reduction of design margins in the future. This presentation will include background on the MEDLI2 suite; the method used for inverse heating estimation; the way that material property uncertainties were accounted for using Monte Carlo analysis; a brief background on variance decomposition; the motivation for using machine learning in this context; how a neural network was trained on the data to enable variance decomposition in a fraction of the time; and the variance decomposition results for one of the MISPs.

Hannah Alpert↗

Regularized Differentiation for Bioburden Density Estimation in Planetary Protection

In this paper, we propose and investigate the performance of two novel shrinkage estimators for bioburden density estimation in planetary protection. The estimators are based on the regularized differentiation of a cumulative count of colony forming units collected throughout the data collecting session or the life cycle of the entire mission. The regularized differentiation recasts the problem of bioburden density estimation as a linear least squares problem. The least squares problem is then solved through regularization techniques, such as truncated singular value decomposition and penalized least squares. The regularization is necessary to avoid noise amplification during the differentiation of noisy data. The two regularization estimators are compared with four other commonly used estimators to simultaneously evaluate the means of multivariable independent Poisson distributions: the maximum likelihood, noninformative Bayes estimator with Jeffreys prior, Empirical Bayes using conjugate gamma-Poisson model with gamma parameters selected by method of moments, and the Clevenson-Zidek estimator. It is shown through computer-simulated data that the regularized differentiation based on ridge regression has the smallest mean-squared error among all estimators. The analysis of shrinkage mechanism implemented by regularized differentiation is performed, and it is shown that the regularized differentiation amounts to performing a weighted averaging of all the samples. The weights are determined by the regularization parameter automatically selected by the L-curve technique. Since the method of least squares makes no distributional assumptions about the data, it presents an attractive technique for bioburden density estimation when there are concerns about the misspecification of the distributional model. The paper concludes with the analysis of the bioburden data collected during InSight mission and directions for future work.

97 - MATHEMATICS AND COMPUTING↗

2021 Monthly Rice Production in Chinese Coastal Provinces

This paper explores the dynamics of rice production in the Chinese provinces of Liaoning, Jilin, Heilongjiang, Shanghai, Jiangsu, and Zhejiang and seeks to predict monthly rice production in the months of April through October using precipitation and Normalized Difference Vegetation Index as the predictor variables available. We utilize ridge and lasso regression models to predict the rice yield. Results indicate that a lasso regression model with an R 2 value of 0.9991501 with an adjusted R 2 value of 0.9991502 and a ridge regression model with an R 2 value of 0.9865443 with an adjusted R 2 value of 0.9870637 are possible. The lasso regression model does not account for all predictor variables while the ridge regression model does. Both models could be expanded upon to include more observations.

Tubbs, Heidi↗

Adaptive spectra-to-exposure conversion using ridge regularized polynomial response models

Real-time gamma spectra-to-exposure conversion in aerial and ground monitoring commonly relies on calibration-derived, detector- or system-specific conversion coefficients that are assumed to generalize across operational environments. In practice, deployment specific differences in spectral composition and transport conditions can introduce systematic bias relative to reference instruments, motivating methods that adapt coefficients using minimal field supervision while explicitly limiting overfitting. In this work, we present a conservative coefficient adaptation framework that updates a baseline polynomial energy-weighting function using ridge-regularized regression, with leave-one-out cross-validation (LOOCV) used to select the regularization strength. The findings support ridge-constrained minimal-supervision adaptation as a practical mechanism to suppress site-specific bias without destabilizing a calibration-derived baseline.

61 RADIATION PROTECTION AND DOSIMETRY↗

Model Residuals as Shields: A Two-Level Formulation to Defend Smart Grids From Poisoning Attacks

The advancement of smart grids presents both vast opportunities and heightened cybersecurity risks. Data-driven defense mechanisms, though designed as a shield against these threats, can fall prey to poisoning attacks. We delve into regression settings, underscoring the imperative to fortify defenses against a spectrum of poison ratios, notably those above 0.5—an issue scarcely addressed in prior studies. Recognizing the susceptibilities of smart grids and their manipulable sensors, we exploit the very intent of poisoning attacks, compromising model accuracy, as our defense mechanism. Our proposed two-level optimization framework discerns between poisoned and authentic data based on model residuals, outperforming or matching existing methods in 72% to 77% of precision and 75% to 80% of recalls across various poisoning attacks, poison ratios, and datasets. Once the authentic data are identified, the trained model is adaptable for a variety of applications. Comprehensive evaluations on different smart grid datasets, pitted against myriad poisoning schemes, validate our methodology’s edge over existing methods. Here, we also shed light on the implications of model misspecification originating from temporal auto-correlation, a common feature in Internet of Things and smart grid data.

Adversarial machine learning (ML)↗

Nonadditive gene expression is correlated with nonadditive phenotypic expression in interspecific triploid hybrids of willow ( Salix spp.)

Many studies have highlighted the complex and diverse basis for heterosis in inbred crops. Despite the lack of a consensus model, it is vital that we turn our attention to understanding heterosis in undomesticated, heterozygous, and polyploid species, such as willow (Salix spp.). Shrub willow is a dedicated energy crop bred to be fast-growing and high yielding on marginal land without competing with food crops. A trend in willow breeding is the consistent pattern of heterosis in triploids produced from crosses between diploid and tetraploid species. Here, we test whether differentially expressed genes are associated with heterosis in triploid families derived from diploid Salix purpurea, diploid Salix viminalis, and tetraploid Salix miyabeana parents. Three biological replicates of shoot tips from all family progeny and parents were collected after 12 weeks in the greenhouse and RNA extracted for RNA-Seq analysis. This study provides evidence that nonadditive patterns of gene expression are correlated with nonadditive phenotypic expression in interspecific triploid hybrids of willow. Expression-level dominance was most correlated with heterosis for biomass yield traits and was highly enriched for processes involved in starch and sucrose metabolism. In addition, there was a global dosage effect of parent alleles in triploid hybrids, with expression proportional to copy number variation. Importantly, differentially expressed genes between family parents were most predictive of heterosis for both field and greenhouse collected traits. Altogether, these data will be used to progress models of heterosis to complement the growing genomic resources available for the improvement of heterozygous perennial bioenergy crops.

59 BASIC BIOLOGICAL SCIENCES↗

Investigating genomic prediction strategies for grain carotenoid traits in a tropical/subtropical maize panel

Abstract Vitamin A deficiency remains prevalent on a global scale, including in regions where maize constitutes a high percentage of human diets. One solution for alleviating this deficiency has been to increase grain concentrations of provitamin A carotenoids in maize (Zea mays ssp. mays L.)—an example of biofortification. The International Maize and Wheat Improvement Center (CIMMYT) developed a Carotenoid Association Mapping panel of 380 inbred lines adapted to tropical and subtropical environments that have varying grain concentrations of provitamin A and other health-beneficial carotenoids. Several major genes have been identified for these traits, 2 of which have particularly been leveraged in marker-assisted selection. This project assesses the predictive ability of several genomic prediction strategies for maize grain carotenoid traits within and between 4 environments in Mexico. Ridge Regression-Best Linear Unbiased Prediction, Elastic Net, and Reproducing Kernel Hilbert Spaces had high predictive abilities for all tested traits (β-carotene, β-cryptoxanthin, provitamin A, lutein, and zeaxanthin) and outperformed Least Absolute Shrinkage and Selection Operator. Furthermore, predictive abilities were higher when using genome-wide markers rather than only the markers proximal to 2 or 13 genes. These findings suggest that genomic prediction models using genome-wide markers (and assuming equal variance of marker effects) are worthwhile for these traits even though key genes have already been identified, especially if breeding for additional grain carotenoid traits alongside β-carotene. Predictive ability was maintained for all traits except lutein in between-environment prediction. The TASSEL (Trait Analysis by aSSociation, Evolution, and Linkage) Genomic Selection plugin performed as well as other more computationally intensive methods for within-environment prediction. The findings observed herein indicate the utility of genomic prediction methods for these traits and could inform their resource-efficient implementation in biofortification breeding programs.

59 BASIC BIOLOGICAL SCIENCES↗