SEARCH · Search NASA
Results for “Linear Regression”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Projection-based multifidelity linear regression for data-scarce applications
Surrogate modeling for systems with high-dimensional quantities of interest remains challenging, particularly when training data are costly to acquire. This work develops multifidelity methods for multiple-input multiple-output linear regression targeting data-limited applications with high-dimensional outputs. Multifidelity methods integrate many inexpensive low-fidelity model evaluations with limited, costly high-fidelity evaluations. We introduce two projection-based multifidelity linear regression approaches with linear and nonlinear features that leverage principal component basis vectors for dimensionality reduction and combine multifidelity data through: (i) a direct data augmentation using low-fidelity data, and (ii) a data augmentation incorporating explicit linear corrections between low-fidelity and high-fidelity data. The data augmentation approaches combine high-fidelity and low-fidelity data into a unified training set and train the linear regression model through weighted least squares with fidelity-specific weights. We introduce a proximity-based weighting scheme with automatic weight selection strategy through cross-validation. Here, the proposed multifidelity linear regression methods are demonstrated on approximating the surface pressure field of a hypersonic vehicle in flight and the temperature field on an aircraft disc braking system. In an ultra low-data regime of no more than twelve high-fidelity samples, multifidelity linear regression achieves approximately 2% – 12% improvement in median accuracy and a higher R 2 score relative to single-fidelity methods at comparable computational cost.
Comparison of One- and Two-Variable Linear Regression Models and Classic Energy Intensity for Energy Performance Tracking of Two Manufacturing Sectors
We report manufacturing facilities consumed about 32% of total domestic energy in the United States in 2016. To evaluate the energy savings achieved through the implementation of energy conservation projects and to establish powerful arguments for future projects, accurate energy performance tracking methods are necessary. The classic energy intensity method (i.e., the ratio of annual total energy over annual total production) is the means most widely used to measure savings because it can be understood and calculated easily. This method considers the variation in production rates to some extent; however, it fundamentally assumes facilities' base energy consumption (energy consumption at zero production) to be zero, which rarely holds true. Furthermore, this method does not consider variations in other relevant parameters, such as weather conditions. Therefore, the regression models approach is commonly recommended to track energy performance improvements. However, because it requires more data and statistical expertise, the regression models approach has been adopted by only a few facilities, and many others suspect it is not worth the effort for their specific cases. For this reason, the improved accuracy this approach offers needs to be demonstrated. By analyzing 477 monthly energy (electricity and natural gas) data sets, this study quantitatively compared the accuracy of classic energy intensity, one-variable (production only) linear regression models, and two-variable (i.e., production and weather) linear regression models for two manufacturing sectors (primary metal and transportation equipment manufacturing). Results showed that significant improvements in accuracy were achieved with one-variable regression models when compared with the classic energy intensity method and with two-variable regression models when compared with one-variable regression models. These improvements were demonstrated using the p values of intercept, cooling degree days, and heating degree days. Based on these results, to achieve a good balance between accuracy improvements and resources requirements, one-variable (production only) linear regression models for electricity consumption and two-variable (production and heating degree days) linear regression models for natural gas consumption are recommended for both sectors in the case of limited resources. Lastly, facilities can also use the results to decide which approaches fit better in their cases.
Predictive and mechanistic multivariate linear regression models for reaction development
Multivariate Linear Regression (MLR) models utilizing computationally-derived and empirically-derived physical organic molecular descriptors are described in this review. Several reports demonstrating the effectiveness of this methodological approach towards reaction optimization and mechanistic interrogation are discussed. A detailed protocol to access quantitative and predictive MLR models is provided as a guide for model development and parameter analysis.
SU-G-BRA-08: Diaphragm Motion Tracking Based On KV CBCT Projections with a Constrained Linear Regression Optimization
Purpose: To develop a novel strategy to extract the respiratory motion of the thoracic diaphragm from kilovoltage cone beam computed tomography (CBCT) projections by a constrained linear regression optimization technique. Methods: A parabolic function was identified as the geometric model and was employed to fit the shape of the diaphragm on the CBCT projections. The search was initialized by five manually placed seeds on a pre-selected projection image. Temporal redundancies, the enabling phenomenology in video compression and encoding techniques, inherent in the dynamic properties of the diaphragm motion together with the geometrical shape of the diaphragm boundary and the associated algebraic constraint that significantly reduced the searching space of viable parabolic parameters was integrated, which can be effectively optimized by a constrained linear regression approach on the subsequent projections. The innovative algebraic constraints stipulating the kinetic range of the motion and the spatial constraint preventing any unphysical deviations was able to obtain the optimal contour of the diaphragm with minimal initialization. The algorithm was assessed by a fluoroscopic movie acquired at anteriorposterior fixed direction and kilovoltage CBCT projection image sets from four lung and two liver patients. The automatic tracing by the proposed algorithm and manual tracking by a human operator were compared in both space and frequency domains. Results: The error between the estimated and manual detections for the fluoroscopic movie was 0.54mm with standard deviation (SD) of 0.45mm, while the average error for the CBCT projections was 0.79mm with SD of 0.64mm for all enrolled patients. The submillimeter accuracy outcome exhibits the promise of the proposed constrained linear regression approach to track the diaphragm motion on rotational projection images. Conclusion: The new algorithm will provide a potential solution to rendering diaphragm motion and ultimately improving tumor motion management for radiation therapy of cancer patients.
Mountain Basin Controls on the Snow-to-Streamflow Signal: An AIC-Weighted Multiple Linear Regression Framework
A regression-based analysis quantifies how basin characteristics modulate the snow-to-streamflow signal. First, we use the ERA5-Land reanalysis gridded product (European Centre for Medium Range Weather Forecasts reanalysis 5 -Land component) for 4,655 hydrologic unit code - 10 (HUC10) mountain basins across the western United States (US) for water years 1987–2024. Linear regressions are performed for peak snow water equivalent (SWE) and annual streamflow for each mountain basin. Models use ordinary least squares in Python’s statsmodels package. After which, an Akaike Information Criterion (AIC)–weighted ensemble multiple linear regression (MLR) framework with 47 watershed traits is used to predict the linear regression coefficient of determination (r-squared) defining the ability of peak SWE to predict annual streamflow across all mountain basin. Predictor sets are constrained to avoid multicollinearity by excluding models with variance inflation factors (VIF) greater than 5. Mountain basin traits included in the MLR include seasonal climate, topography, vegetation type and structure, and bedrock geology. Accepted models are considered if their AIC is within 2.0 of the model with the minimum AIC, or best model. To compare predictor influence across acceptable models, we computed standardized regression coefficients. To evaluate structural redundancy among models, we constructed binary inclusion vectors for each acceptable model, denoting whether a predictor was present (1) or absent (0). Core predictor variables are defined as occurring in at least 67% of the acceptable models. For this regional analysis, only one model was found acceptable, with higher snow-to-streamflow translation (higher r-squared) occurring in colder mountain basins with higher relative winter precipitation, more snow accumulation and a lower fraction of annual precipitation that falls in the spring and summer. The second component of the data package uses previously published, high-resolution output from an integrated hydrological model of the East River watershed using the U.S. Geological Survey Groundwater and Surface water Flow model (GSFLOW, doi:10.15485/1998576). East River MLR expands upon the approach described above to explore the response of five streamflow metrics—annual streamflow, runoff efficiency, 7-day minimum flow, low-flow duration, and non-perennial stream fraction to snow system indicators including peak SWE, snow-covered area, snow disappearance date, and the fraction of basin area characterized by low-to-no snow, as well as seasonal precipitation and temperature, and annual hydrologic variables representing soil moisture, evapotranspiration (ET), the partitioning of incoming precipitation to evapotranspiration (ET/P), groundwater storage, and groundwater inflow to streams. MLR was done on all water years (P0: 1987-2024) and for each period as determined in the split analysis using pooled regression techniques (P1: 1987-2011 and P2: 2012-2024) to evaluate shifting predictor variable emphasis on streamflow generation. Results indicate that since 2012, peak SWE has lost statistical strength in its prediction of annual streamflow and runoff efficiency, and the indirect influence of spring temperature has emerged as critically important. Low-flow metrics remain largely influenced by soil moisture, vegetation water use and groundwater inflows with summer precipitation becoming a direct influence on minimum summer flow. Together, these data and Python-based analysis tools provide a framework for identifying the key watershed characteristics that control how streamflow responds to snow from year to year. The package also helps quantify uncertainty in statistical models and assess how snow–streamflow relationships vary across regions and over time. This dataset contains comma-separated values files (.csv), text files (.txt), python code files (.py), figure files (.png), and shapefiles (.cpg, .dbf, .prj, .sbn, .sbx, .shp, .xml). Further details on file contents and MLR execution can be found in the readme file and the FLMD files. Work was supported by the Watershed Function Science Focus Area at Lawrence Berkeley National Laboratory funded by the US Department of Energy, Office of Science, Biological and Environmental Research under Contract No. DE-AC02-05CH11231.
Two-Step Estimation in a Heteroscedastic Linear Regression Model
We study the problem of estimating a parameter in some heteroscedastic linear regression model in the case where the regressors consist of all order statistics based on the sample of identically distributed not necessarily independent observations with finite second moment. It is assumed that the random errors depend on the parameter and distributions of the corresponding regressors. We propose a two-step procedure for finding explicit asymptotically normal estimators.
Decorrelating effects in multiple linear regression to decompose and attribute risk to common and proper effects
Effects in multiple linear regression may be decorrelated to decompose and attribute risk to common and proper effects. In other words, an attribute risk may be decomposed to two or more causes, where each cause is characterized by multiple attributes. The risk decomposition may decompose risk into a first residual part associated with a first set of risk factors, a second residual part associated with a second set of risk factors, and a common part associated with a set of common hidden variables that minimize a correlation between the first set of factors and the second set of factors. The common hidden variables may be modeled using a hidden factor model. An effect of the correlation may be minimized on the first set of risk factors and the second set of risk factors, and how correlated the terms of the risk decomposition are may be quantified.
Fitting program for linear regressions according to Mahon (1996)
This program takes the users' Input data and fits a linear regression to it using the prescription presented by Mahon (1996). Compared to the commonly used York fit, this method has the correct prescription for measurement error propagation. This software should facilitate the proper fitting of measurements with a simple Interface.
Bayesian Linear Regression for Hugoniot Data
This repository provides the code and datasets used in the paper Bayesian Analysis of Linear Shock Compression Data. This paper analyzes publicly available shock compression datasets on copper, argon, and nickel from Marsh (1980) using Bayesian linear regression, and compares the results with those obtained using bootstrapping methods. References: - Marsh, S. P. (1980). LASL shock Hugoniot data (Vol. 5). Univ of California Press.
Sensor Anomaly Detection for Nuclear Reactor Systems Utilizing Linear Regression and K-Means Unsupervised Machine Learning
Nuclear reactors and related systems are becoming increasingly complex due to advancing technologies in next-generation power reactors. This increased complexity necessitates enhanced automation and data management capabilities. To successfully realize autonomous systems, methods must be developed to handle vast volumes of data and effectively distinguish anomalous data from noise and expected data. While impressive models utilizing digital twins and similar approaches are under development, here we propose a simplified model for analyzing fundamental methods and techniques. Initially, we created a general dataset by using initial data from PCTRAN in order to represent ideal steady-state conditions. We then inserted anomalies based on prevalent sensor anomaly types (e.g., point anomalies, linear drift, and downward deviations), along with unusual anomalies such as exponential drift and upward deviations. To detect anomalies, we developed a program that employs data partitioning and linear regression to preprocess and filter the anomalous data. A K-Means machine learning (ML) method was then applied to separate and count the data within the anomalous partition. The results from all datasets—apart from exponential growth—demonstrated positive outcomes, with each returning multiple instances of greaterthan-95% accuracy. We conducted further investigations using Idaho National Laboratory’s RAVEN software to perform a sensitivity analysis on the input variables (R 2 Tolerance, Slope Tolerance, and Window Size) and found that the output variables (Accuracy and Time) were most sensitive to the Window Size. Despite the promising results published, further development is required to effectively apply these methods to nuclear systems. Nevertheless, the strengths of this approach are evident and hold promise for future applications in the field.
Linear Regression Based Multi-fidelity Surrogate for Disturbance Amplification in Multi-phase Explosion
When simulations are very expensive and many are required, as for optimization or uncertainty quantification, a way to reduce cost is using surrogates. With multiple simulations to predict the quantity of interest, some being very expensive and accurate (high-fidelity simulations) and others cheaper but less accurate (low-fidelity simulations), it may be worthwhile to use multifidelity surrogates (MFSs). Moreover, if we can afford just a few high-fidelity simulations or experiments, MFS becomes necessary. Co-Kriging, which is probably the most popular MFS, replaces both low-fidelity and high-fidelity simulations by a single MFS. A recently proposed linear regression–based MFS (LR-MFS) offers the option to correct the LF simulations instead of correcting the LF surrogate in the MFS. When the low-fidelity simulation is cheap enough for use in an application, such as optimization, this may be an attractive option. Here, we explore the performance of LR-MFS using exact and surrogate-replaced low-fidelity simulations. The concern studied is a cylindrical dispersal of 100-μ m-diameter solid particles after detonation and the quantity of interest is a measure of the amplification of the departure from axisymmetry. We find very substantial accuracy improvements for this problem using the LR-MFS with exact low-fidelity simulations. Inspired by these results, we also compare the performance of co-Kriging to the use of Kriging to correct exact low-fidelity simulations and find a similar accuracy improvement when simulations are directly used. For this problem, further improvements in accuracy are achievable by taking advantage of inherent parametric symmetries. These findings may alert users of MFSs to the possible advantages of using exact low-fidelity simulations when this is affordable.
Estimating Field-Level Perennial Bioenergy Grass Biomass Yields Using the Normalized Difference Red-Edge Index and Linear Regression Analysis for Central Virginia, USA
We investigated the indicative power of the normalized difference red-edge index (NDRE) for estimating field-level perennial bioenergy grass biomass yields utilizing Sentinel-2 imagery and a linear regression model as a rapid, cost-effective method for biomass yield estimations for bioenergy. We used 2019 data from three study sites containing mature perennial bioenergy grass stands in central Virginia, USA. Of the simulated daily NDRE values based on the temporally weighted averaging of two temporal neighbors, we found the strongest index–yield correlation on 11 August (R = 0.85). We estimated the perennial bioenergy grass biomass yields for (1) all sites using the data pooled from the three sites (all-site estimation) and (2) each site using the data pooled from the other two sites (cross-site estimation). The estimated field-level perennial bioenergy grass biomass yields strongly correlated with the recorded yields (average R2 = 0.76), with a root mean square error (RMSE) of 1.5 Mg/ha and a mean absolute error (MAE) of 1.2 Mg/ha for the all-site estimation. For the cross-site estimation, the site with diverse perennial grass types had the weakest correlation (R2 = 0.44) of the sites, indicating a difficulty in accounting for heterogeneous index–yield relationships in a single model. In addition to identifying a strong indicative power of the NDRE for estimating the overall perennial bioenergy grass biomass yields at a field level, the findings from this study call for an analysis across multiple perennial grasses and a comparison using multiple sites to understand (1) if the indicative power of the index shifts from the biomass of the specific perennial bioenergy grass type to the overall biomass during the growing season and (2) the level of perennial bioenergy grass heterogeneity that may hinder the remotely sensed biomass yield estimation using a single model.
The use of artificial neural networks and multiple linear regression to predict rate of medical waste generation
Prediction of the amount of hospital waste production will be helpful in the storage, transportation and disposal of hospital waste management. Based on this fact, two predictor models including artificial neural networks (ANNs) and multiple linear regression (MLR) were applied to predict the rate of medical waste generation totally and in different types of sharp, infectious and general. In this study, a 5-fold cross-validation procedure on a database containing total of 50 hospitals of Fars province (Iran) were used to verify the performance of the models. Three performance measures including MAR, RMSE and R{sup 2} were used to evaluate performance of models. The MLR as a conventional model obtained poor prediction performance measure values. However, MLR distinguished hospital capacity and bed occupancy as more significant parameters. On the other hand, ANNs as a more powerful model, which has not been introduced in predicting rate of medical waste generation, showed high performance measure values, especially 0.99 value of R{sup 2} confirming the good fit of the data. Such satisfactory results could be attributed to the non-linear nature of ANNs in problem solving which provides the opportunity for relating independent variables to dependent ones non-linearly. In conclusion, the obtained results showed that our ANN-based model approach is very promising and may play a useful role in developing a better cost-effective strategy for waste management in future.
Robust Predictive Design of Field Measurements for Evapotranspiration Barriers Using Universal Multiple linear Regression
Surface barriers are normally installed to reduce downward water movement into contaminated zones. Specifically, evapotranspiration (ET) barriers are used to store water and release it, via ET, before it can percolate into an underlying waste zone. To assess the effectiveness of a surface barrier, we used an existing data set, model-simulated data, and a dimensionality reduction approach called universal multiple linear regression (uMLR) to optimize the required number of sensors in a 2-m thick surface barrier. To understand the usefulness of implementing predictive uMLR to accommodate multiple monitoring objectives, we compare several network designs, selected based on down-sampling of existing data, with a recommended sensor design based on model simulations performed without consideration of existing data. We further added consideration of “fuzzy” design, which allows more practical guidelines for field implementation of uMLR. We discovered that uMLR, combined with robust decision-making, provides a simple, flexible, and high-quality network design for monitoring the total water stored in a surface barrier across multiple uncertain conditions.
Degeneracy engineering for classical and quantum annealing: A case study of sparse linear regression in collider physics
Classical and quantum annealing are computing paradigms that have been proposed to solve a wide range of optimization problems. In this paper, we aim to enhance the performance of annealing algorithms by introducing the technique of degeneracy engineering, through which the relative degeneracy of the ground state is increased by modifying a subset of terms in the objective Hamiltonian. We illustrate this novel approach by applying it to the example of ℓ 0 -norm regularization for sparse linear regression, which is, in general, an NP-hard optimization problem. Specifically, we show how to cast ℓ 0 -norm regularization as a quadratic unconstrained binary optimization (QUBO) problem, suitable for implementation on annealing platforms. As a case study, we apply this QUBO formulation to energy flow polynomials in high-energy collider physics, finding that degeneracy engineering substantially improves the annealing performance. Furthermore, our results motivate the application of degeneracy engineering to a variety of regularized optimization problems.
Adiabatic quantum linear regression
Abstract A major challenge in machine learning is the computational expense of training these models. Model training can be viewed as a form of optimization used to fit a machine learning model to a set of data, which can take up significant amount of time on classical computers. Adiabatic quantum computers have been shown to excel at solving optimization problems, and therefore, we believe, present a promising alternative to improve machine learning training times. In this paper, we present an adiabatic quantum computing approach for training a linear regression model. In order to do this, we formulate the regression problem as a quadratic unconstrained binary optimization (QUBO) problem. We analyze our quantum approach theoretically, test it on the D-Wave adiabatic quantum computer and compare its performance to a classical approach that uses the Scikit-learn library in Python. Our analysis shows that the quantum approach attains up to $${2.8 \times }$$ 2.8 × speedup over the classical approach on larger datasets, and performs at par with the classical approach on the regression error metric. The quantum approach used the D-Wave 2000Q adiabatic quantum computer, whereas the classical approach used a desktop workstation with an 8-core Intel i9 processor. As such, the results obtained in this work must be interpreted within the context of the specific hardware and software implementations of these machines.