Search NASA⌕ Search

SEARCH · Search NASA

Results for “Regression approach”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
NASA NTRS2015

On the Relative Stability of CERES Reflected Shortwave and MISR and MODIS Visible Radiance Measurements During the Terra Satellite Mission

Fifteen years of visible, near-infrared, and broadband shortwave radiance measurements from Clouds and the Earth's Radiant Energy System (CERES), Multiangle Imaging Spectroradiometer (MISR), and Moderate Resolution Imaging Spectroradiometer (MODIS) instruments on board NASA's Terra satellite are analyzed in order to assess their long-term relative stability for climate purposes. A regression-based approach between CERES, MODIS, and MISR (An camera only) reflectances is used to calculate the bias between the different reflectances relative to a reference year. When compared to the CERES shortwave broadband reflectance, relative drift between the MISR narrowbands is within 1%/decade. Compared to the CERES shortwave reflectance, the MODIS narrowband reflectances show a relative drift of less than −1.33%/decade. When compared to MISR, the MODIS reflectances show a relative drift of between −0.36%/decade and −2.66%/decade. We show that the CERES Terra SW measurements are stable over the time period relative to CERES Aqua. Using this as evidence that CERES Terra may be absolutely stable, we suggest that the CERES, MISR, and MODIS instruments meet the radiometric stability goals for climate applications set out in Ohring et al. (2005).

Corbett, J. G.↗
NASA NTRS2024

Vegetation Greening Mitigates the Impacts of Increasing Extreme Rainfall on Runoff Events

Future flood risk assessment has primarily focused on heavy rainfall as the main driver, with the assumption that projected increases in extreme rain events will lead to subsequent flooding. However, the presence of and changes in vegetation have long been known to influence the relationship between rainfall and runoff. Here, we extract historical (1850–1880) and projected (2070–2100) daily extreme rainfall events, the corresponding runoff, and antecedent conditions simulated in a prominent large Earth system model ensemble to examine the shifting extreme rainfall and runoff relationship. Even with widespread projected increases in the magnitude (78% of the land surface) and number (72%) of extreme rainfall events, we find projected declines in event-based runoff ratio (runoff/rainfall) for a majority (57%) of the Earth surface. Runoff ratio declines are linked with decreases in antecedent soil water driven by greater transpiration and canopy evaporation (both linked to vegetation greening) compared to areas with runoff ratio increases. Using a machine learning regression tree approach, we find that changes in canopy evaporation is the most important variable related to changes in antecedent soil water content in areas of decreased runoff ratios (with minimal changes in antecedent rainfall) while antecedent ground evaporation is the most important variable in areas of increased runoff ratios. Our results suggest that simulated interactions between vegetation greening, increasing evaporative demand, and antecedent soil drying are projected to diminish runoff associated with extreme rainfall events, with important implications for society.

soil moisture↗
DOE OSTI2025

Predicting Initial Trans-Membrane Pressure for Optimized Operations in UF Unit Using Random Forest

With the growing scarcity of freshwater, innovative process design mechanisms like Reverse Osmosis (RO) are increasingly gaining attention among water treatment utilities to address the rising demand. Ensuring reliable water production necessitates efficient resource utilization, minimizing downtime in (ultra-filtration) UF systems. Recent advancements in machine learning (ML) have enabled the development of accurate data-driven models for Model Predictive Control (MPC), often requiring minimal prior knowledge of underlying physical processes. In this study, we present predictive regression models based on Random Forest (RF) and Auto-Regressive (AR) approaches to forecast the initial Trans-Membrane Pressure (TMP) for each filtration cycle in data generated by Direct Potable Reuse (DPR) systems. The proposed RF-based model demonstrates superior performance compared to baseline methods, including historical mean, Last Observation Carried Forward (LOCF), and naïve AR models, across various forecasting horizons in terms of root mean square error (RMSE) metric. To evaluate how different classes of process variables contribute to TMP dynamics over time, we examine the feature importance of independent covariates across multiple forecast horizons. This analysis provides insight into the temporal relevance of operational and sensor-derived features, guiding control and monitoring strategies. Additionally, the impact of hyperparameter tuning on TMP prediction performance is studied for both direct and recursive RF modelling approaches across increasing forecast horizons. Accurate prediction of initial TMP is critical for optimizing RO operations, as it enables the development of robust modelling frameworks by accurately estimating membrane fouling trends, thereby enhancing process efficiency and long-term reliability. The demonstrated efficacy of the RF-based approach highlights its potential as a tool for real-time decision-making in water treatment systems, paving the way for advanced process optimization and sustainable water resource management.

Mukherjee, Subrata [ORNL] (ORCID:0000000309930338)↗
DOE OSTI2025

Predicting Initial Trans-Membrane Pressure for Optimized Operations in UF Unit Using Random Forest

With the growing scarcity of freshwater, innovative process design mechanisms like Ultra-filtration(UF) units are increasingly gaining attention among water treatment utilities to address the rising demand. Ensuring reliable water production necessitates efficient resource utilization, minimizing downtime in UF systems. Recent advancements in machine learning (ML) have enabled the development of accurate data-driven models for Model Predictive Control (MPC), often requiring minimal prior knowledge of underlying physical processes. In this study, we present predictive regression models based on Random Forest (RF) and Auto-Regressive (AR) approaches to forecast the initial Trans-Membrane Pressure (TMP) for each filtration cycle in data generated by Direct Potable Reuse (DPR) systems. The proposed RF-based model demonstrates superior performance compared to baseline methods, including historical mean, Last Observation Carried Forward (LOCF), and naïve AR models, across various forecasting horizons in terms of root mean square (RMSE) metric. Accurate prediction of initial TMP is critical for optimizing CCRO operations, as it enables the development of robust modelling frameworks that enhance process efficiency and reliability. The demonstrated efficacy of the RF-based approach highlights its potential as a tool for real-time decision-making in water treatment systems, paving the way for advanced process optimization and sustainable water resource management.

Mukherjee, Subrata [ORNL] (ORCID:0000000309930338)↗
DOE OSTI2021

Early season prediction of within-field crop yield variability by assimilating CubeSat data into a crop model

Accurate early season predictions of crop yield at the within-field scale can be used to address a range of crop production, management, and precision agricultural challenges. While the remote sensing of within-field insights has been a research goal for many years, it is only recently that observations with the required spatio-temporal resolutions, together with efficient assimilation methods to integrate these into modeling frameworks, have become available to advance yield prediction efforts. Here we explore a yield prediction approach that combines daily high-resolution CubeSat imagery with the APSIM crop model. The approach employs APSIM to train a linear regression that relates simulated yield to simulated leaf area index (LAI). That relationship is then used to identify the optimal regression date at which the LAI provides the best prediction of yield: in this case, approximately 14 weeks prior to harvest. Instead of applying the regression on satellite imagery that is coincident, or closest to, the regression date, our method implements a particle filter that integrates CubeSat-based LAI into APSIM to provide end-of-season high-resolution (3 m) yield maps weeks before the optimal regression date. The approach is demonstrated on a rainfed maize field located in Nebraska, USA, where suitable collections of both imagery and in-situ data were available for assessment. The procedure does not require in-field data to calibrate the regression model, with results showing that even with a single assimilation step, it is possible to provide yield estimates with good accuracy up to 21 days before the optimal regression date. Yield spatial variability was reproduced reasonably well, with a strong correlation to independently collected measurements (R 2 = 0.73 and rRMSE = 12%). When the field averaged yield was compared, our approach reduced yield prediction error from 1 Mg/ha (control case based on a calibrated APSIM model), to 0.5 Mg/ha (using satellite imagery alone), and then to 0.2 Mg/ha (results with assimilation up to three weeks prior to the optimal regression date). Such a capacity to provide spatially explicit yield predictions early in the season has considerable potential to enhance digital agricultural goals and improve end-of-season yield predictions.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2004

Kernel PLS Estimation of Single-trial Event-related Potentials

Nonlinear kernel partial least squaes (KPLS) regressior, is a novel smoothing approach to nonparametric regression curve fitting. We have developed a KPLS approach to the estimation of single-trial event related potentials (ERPs). For improved accuracy of estimation, we also developed a local KPLS method for situations in which there exists prior knowledge about the approximate latency of individual ERP components. To assess the utility of the KPLS approach, we compared non-local KPLS and local KPLS smoothing with other nonparametric signal processing and smoothing methods. In particular, we examined wavelet denoising, smoothing splines, and localized smoothing splines. We applied these methods to the estimation of simulated mixtures of human ERPs and ongoing electroencephalogram (EEG) activity using a dipole simulator (BESA). In this scenario we considered ongoing EEG to represent spatially and temporally correlated noise added to the ERPs. This simulation provided a reasonable but simplified model of real-world ERP measurements. For estimation of the simulated single-trial ERPs, local KPLS provided a level of accuracy that was comparable with or better than the other methods. We also applied the local KPLS method to the estimation of human ERPs recorded in an experiment on co,onitive fatigue. For these data, the local KPLS method provided a clear improvement in visualization of single-trial ERPs as well as their averages. The local KPLS method may serve as a new alternative to the estimation of single-trial ERPs and improvement of ERP averages.

Rosipal, Roman↗
NASA NTRS2021

Expanding the application of soil moisture monitoring systems through regression-based transformation

Relative to other geophysical variables, soil moisture (SM) estimates derived from land surface models (LSMs) and land data assimilation systems (LDAS) are difficult to transfer between platforms and applications. This difficulty stems from the highly model-dependent nature of LSM SM estimates and differences in the vertical support of discretized SM values. As a result, operational SM estimates generated by one LSM (or LDAS) cannot generally be directly applied to a hydrologic monitoring or forecast system designed around a second LSM. This lack of transferability is particularly problematic for LDAS applications, where the time, expertise, and computational resources required to generate an operational LDAS analysis cannot be practically duplicated for every LSM-specific application. Here, we develop a set of simple regression tools for translating SM estimates between LSMs and multiple LDAS analyses. Results demonstrate that simple multivariate linear regression - utilizing independent variables based on multi-layer and temporally lagged SM estimates - can significantly improve upon baseline transformation approaches using direct percentile matching. The proposed regression approaches are effective for both the LSM-to-LSM and LDAS-to-LDAS transformation of multi-layer SM percentiles. Application of this approach will expand the utility of existing, high-quality (but LSM-specific) operational sources of SM information like the NASA Soil Moisture Active Passive Level-4 Soil Moisture product.

Soil Moisture↗
DOE OSTI2020

Regression models using shapes of functions as predictors

Functional variables are often used as predictors in regression problems. A commonly used parametric approach, called scalar-on-function regression, uses the $\mathbb L^2$ inner product to map functional predictors into scalar responses. This method can perform poorly when predictor functions contain undesired phase variability, causing phases to have disproportionately large influence on the response variable. One past solution has been to perform phase–amplitude separation (as a pre-processing step) and then use only the amplitudes in the regression model. In this paper, we propose a more integrated approach, termed elastic functional regression model (EFRM), where phase-separation is performed inside the regression model, rather than as a pre-processing step. This approach generalizes the notion of phase in functional data, and is based on the norm-preserving time warping of predictors. Due to its invariance properties, this representation provides robustness to predictor phase variability and results in improved predictions of the response variable over traditional models. We demonstrate this framework using a number of datasets involving gait signals, NMR data, and stock market prices.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2002

Locally-Based Kernal PLS Smoothing to Non-Parametric Regression Curve Fitting

We present a novel smoothing approach to non-parametric regression curve fitting. This is based on kernel partial least squares (PLS) regression in reproducing kernel Hilbert space. It is our concern to apply the methodology for smoothing experimental data where some level of knowledge about the approximate shape, local inhomogeneities or points where the desired function changes its curvature is known a priori or can be derived based on the observed noisy data. We propose locally-based kernel PLS regression that extends the previous kernel PLS methodology by incorporating this knowledge. We compare our approach with existing smoothing splines, hybrid adaptive splines and wavelet shrinkage techniques on two generated data sets.

Rosipal, Roman↗
NASA NTRSDate not supplied

Comparison of Two Load Prediction Methods for Strain-Gage Balances

Data from a high-capacity semi-span balance is used to perform a detailed comparison of the load prediction accuracy of two strain-gage balance load prediction methods. Both methods independently obtain their load prediction equations from multivariate least squares fits of balance calibration data. The first method is called Non-Iterative Method. This approach directly uses regression models of the individual load components of a balance for the load prediction. The second method is called Iterative Method. This alternate approach uses a load iteration equation for the load prediction that is constructed from the regression models of the gage outputs of the balance. Basic characteristics of the two methods are reviewed. Afterwards, both methods are applied to calibration and check load data of the chosen balance. Finally, selected analysis results are compared. These comparisons confirmed that the load prediction accuracy of the two methods is the same for all practical purposes.

wind tunnel test↗
NASA NTRSDate not supplied

Comparison of Two Load Prediction Methods for Strain-Gage Balances

Data from a five-component semi-span balance is used to perform a systematic comparison of the load prediction accuracy of two load prediction methods. Both methods independently obtain the load prediction equations from multivariate least squares fits of balance calibration data. The first method is called the Non-Iterative Method. This approach directly uses regression models of the individual load components of a balance for the load prediction. The second method is called the Iterative Method. This alternate approach uses a load iteration equation for the load prediction that is constructed from the regression coefficients of the gage outputs of the balance. Basic characteristics of the two methods are reviewed. Afterwards, both methods are applied to calibration, check load, and wind tunnel test data of a five-component semi-span balance. Selected analysis results are compared. These comparisons confirm that the accuracy of the two methods is the same for all practical purposes.

strain-gage balance↗
DOE OSTI2022

Learning protein fitness models from evolutionary and assay-labeled data

Machine learning-based models of protein fitness typically learn from either unlabeled, evolutionarily related sequences or variant sequences with experimentally measured labels. For regimes where only limited experimental data are available, recent work has suggested methods for combining both sources of information. Toward that goal, we propose a simple combination approach that is competitive with, and on average outperforms more sophisticated methods. Our approach uses ridge regression on site-specific amino acid features combined with one probability density feature from modeling the evolutionary data. Within this approach, we find that a variational autoencoder-based probability density model showed the best overall performance, although any evolutionary density model can be used. Moreover, our analysis highlights the importance of systematic evaluations and sufficient baselines.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

A semiparametric latent factor model for large scale temporal data with heteroscedasticity

Large scale temporal data have flourished in a vast array of applications, and their sophisticated structures, especially the heteroscedasticity among subjects with inter- and intra-temporal dependence, have fueled a great demand for new statistical models. In this paper, with covariate information, we consider a flexible model for large scale temporal data with subject-specific heteroscedasticity. Formally, the model employs latent semiparametric factors to simultaneously account for the subject-specific heteroscedasticity and the contemporaneous and/or serial correlations. The subject-specific heteroscedasticity is modeled as the product of the unobserved factor process and subject’s covariate effect, which is further characterized via additive models. For estimation, we propose a two-step procedure. First, the latent factor process and nonparametric loading are recovered through projection-based methods, and following, we estimate the regression components by approaches motivated from the generalized least squares. By scrupulously examining the non-asymptotic rates for recovering the factor process and its loading, we show the consistency and efficiency of estimated regression coefficients in the absence of prior knowledge of latent factor process and subject’s covariate effect. Here, the statistical guarantees remain valid even for finite time points that makes our method particularly appealing when the subjects significantly outnumber the observation time points. Using comprehensive simulations, we demonstrate the finite sample performance of our method, which corroborates the theoretical findings. Finally, we apply our method to a data set of air quality and energy consumption collected at 129 monitoring sites in the United States in 2015.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Nonlinear Logistic Regression Mixture Experiment Modeling for Binary Data Using Dimensionally Reduced Components

This article presents and illustrates an approach using nonlinear logistic regression for modeling binary response data from a mixture experiment when the components can be partitioned into groups used to form dimensionally-reduced pseudocomponents (DRPs). A DRP is a linear combination of the components in a group, where the linear combinations over all groups are normalized so that the DRP proportions sum to unity. Nonlinear logistic regression is required because, after normalization of the linear combinations, the model expressed in terms of the DRPs is nonlinear in the parameters that specify the linear combinations. A method for obtaining nonparametric tolerance limits on the probability of a “success” for the binary response variable using a bootstrap approach is also presented. Having three DRPs enables viewing data and modeling results on a ternary plot even though there may be many more than three mixture components. A real database, involving whether or not nepheline crystals form in simulated nuclear waste glass after cooling, is used to illustrate the nonlinear logistic regression modeling and nonparametric tolerance limit approaches when there are three DRPs.

Waste glass, Nepheline, Mixture experiment, Logist↗
DOE OSTI2021

Non-intrusive data-driven model reduction for differential–algebraic equations derived from lifting transformations

In this paper we present a non-intrusive data-driven approach for model reduction of nonlinear systems. The approach considers the particular case of nonlinear partial differential equations (PDEs) that form systems of partial differential–algebraic equations (PDAEs) when lifted to polynomial form. Such systems arise, for example, when the governing equations include Arrhenius reaction terms (e.g., in reacting flow models) and thermodynamic terms (e.g., the Helmholtz free energy terms in a phase-field solidification model). Using the known structured form of the lifted algebraic equations, the approach computes the reduced operators for the algebraic equations explicitly, using straightforward linear algebra operations on the basis matrices. The reduced operators for the differential equations are inferred from lifted snapshot data using operator inference, which solves a linear least squares regression problem. The approach is illustrated for the nonlinear model of solidification of a pure material. The lifting transformations reformulate the solidification PDEs as a system of PDAEs that have cubic structure. The operators of the lifted system for this solidification example have affine dependence on key process parameters, permitting us to learn a parametric reduced model with operator inference. Numerical experiments show the effectiveness of the resulting reduced models in capturing key aspects of the solidification dynamics.

42 ENGINEERING↗