Search NASA⌕ Search

SEARCH · Search NASA

Results for “regression modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Predicting the evolution of biomass bulk density through feedstock preprocessing: Discrete element modeling, regression analysis, and pilot-scale validation

Bulk density is an important material property of biomass feedstocks, influencing handling, storage, transport costs, and conversion efficiency. In this study, predictive regression models for loose and tapped bulk densities of Alamo and Cave-in-Rock switchgrass are developed using a comprehensive dataset generated via calibrated bonded-sphere discrete element method (DEM) simulations. Here, a key contribution of this study is the use of a DEM-based approach, which correlates density with moisture content and particle size distribution parameters and enables analysis across a continuous particle size range, overcoming limitations of purely experimental data. For comparison, regression models are also developed using only experimental data from pilot-scale runs at the Biomass Feedstock National User Facility at Idaho National Laboratory. Validation against pilot-scale data showed reasonable prediction accuracy for both model types, particularly for smaller particle sizes (post-secondary grinding). While the experimental model showed slightly better performance matching the validation data in some cases, the DEM-based model benefits from a much larger dataset, reduced predictor multicollinearity, and continuous parameter coverage, highlighting the utility of validated simulation models for developing robust predictive tools for biomass preprocessing applications.

09 - BIOMASS FUELS↗
DOE OSTI2021

Interpreting Write Performance of Supercomputer I/O Systems with Regression Models

This work seeks to advance the state of the art in HPC I/O performance analysis and interpretation. In particular, we demonstrate effective techniques to: (1) model output performance in the presence of I/O interference from production loads; (2) build features from write patterns and key parameters of the system architecture and configurations; (3) employ suitable machine learning algorithms to improve model accuracy. We train models with five popular regression algorithms and conduct experiments on two distinct production HPC platforms. We find that the lasso and random forest models predict output performance with high accuracy on both of the target systems. We also explore use of the models to guide adaptation in I/O middleware systems, and show potential for improvements of at least 15% from model-guided adaptation on 70% of samples, and improvements up to 10× on some samples for both of the target systems.

Xie, Bing↗
DOE OSTI2019

Investigation of goodness of model data fit using PLSR and PCR regression models to determine informative wavelength band in NIR region for non-invasive blood glucose prediction

Diabetes mellitus is a metabolic disorder characterized by the deficiency in insulin secretion or insulin action on target tissues. Diabetes being diagnosed, requires frequent monitoring. Current measurement techniques are invasive in nature, which is painful. Non-invasive measurement methods for the prediction of blood glucose is a big challenge. Hence this paper focuses on a comparative study to analyze the performance of the two regression models: partial least square regression (PLSR) and principal component regression (PCR) models to arrive at the best regression model for the prediction of blood glucose non-invasively based on NIR diffuse reflectance spectroscopy. The regression model developed involves spectral data collected from 32 subjects from a diabetic center using diffuse reflectance spectrometer (DRS). The spectroscopic data were acquired from the subjects both invasively using clinical method and non-invasively using DRS setup in the NIR spectral range whose wavelength ranges from 750 to 1040 nm. Multivariate analysis using PLSR is found to be a better regression model in terms of the fitted response and estimated mean square prediction error. It is observed that the mean square error value is 0.04 mg/dl for the tenth component in the PLSR model. The developed regression model also proves to be a useful tool in identifying the informative wavelength bands for blood glucose measurement.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

Identifying microbial drivers in biological phenotypes with a Bayesian network regression model

Abstract In Bayesian Network Regression models, networks are considered the predictors of continuous responses. These models have been successfully used in brain research to identify regions in the brain that are associated with specific human traits, yet their potential to elucidate microbial drivers in biological phenotypes for microbiome research remains unknown. In particular, microbial networks are challenging due to their high dimension and high sparsity compared to brain networks. Furthermore, unlike in brain connectome research, in microbiome research, it is usually expected that the presence of microbes has an effect on the response (main effects), not just the interactions. Here, we develop the first thorough investigation of whether Bayesian Network Regression models are suitable for microbial datasets on a variety of synthetic and real data under diverse biological scenarios. We test whether the Bayesian Network Regression model that accounts only for interaction effects (edges in the network) is able to identify key drivers (microbes) in phenotypic variability. We show that this model is indeed able to identify influential nodes and edges in the microbial networks that drive changes in the phenotype for most biological settings, but we also identify scenarios where this method performs poorly which allows us to provide practical advice for domain scientists aiming to apply these tools to their datasets. BNR models provide a framework for microbiome researchers to identify connections between microbes and measured phenotypes. We allow the use of this statistical model by providing an easy‐to‐use implementation which is publicly available Julia package at https://github.com/solislemuslab/BayesianNetworkRegression.jl .

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2018

Comparison of One- and Two-Variable Linear Regression Models and Classic Energy Intensity for Energy Performance Tracking of Two Manufacturing Sectors

We report manufacturing facilities consumed about 32% of total domestic energy in the United States in 2016. To evaluate the energy savings achieved through the implementation of energy conservation projects and to establish powerful arguments for future projects, accurate energy performance tracking methods are necessary. The classic energy intensity method (i.e., the ratio of annual total energy over annual total production) is the means most widely used to measure savings because it can be understood and calculated easily. This method considers the variation in production rates to some extent; however, it fundamentally assumes facilities' base energy consumption (energy consumption at zero production) to be zero, which rarely holds true. Furthermore, this method does not consider variations in other relevant parameters, such as weather conditions. Therefore, the regression models approach is commonly recommended to track energy performance improvements. However, because it requires more data and statistical expertise, the regression models approach has been adopted by only a few facilities, and many others suspect it is not worth the effort for their specific cases. For this reason, the improved accuracy this approach offers needs to be demonstrated. By analyzing 477 monthly energy (electricity and natural gas) data sets, this study quantitatively compared the accuracy of classic energy intensity, one-variable (production only) linear regression models, and two-variable (i.e., production and weather) linear regression models for two manufacturing sectors (primary metal and transportation equipment manufacturing). Results showed that significant improvements in accuracy were achieved with one-variable regression models when compared with the classic energy intensity method and with two-variable regression models when compared with one-variable regression models. These improvements were demonstrated using the p values of intercept, cooling degree days, and heating degree days. Based on these results, to achieve a good balance between accuracy improvements and resources requirements, one-variable (production only) linear regression models for electricity consumption and two-variable (production and heating degree days) linear regression models for natural gas consumption are recommended for both sectors in the case of limited resources. Lastly, facilities can also use the results to decide which approaches fit better in their cases.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2020

Regression models using shapes of functions as predictors

Functional variables are often used as predictors in regression problems. A commonly used parametric approach, called scalar-on-function regression, uses the $\mathbb L^2$ inner product to map functional predictors into scalar responses. This method can perform poorly when predictor functions contain undesired phase variability, causing phases to have disproportionately large influence on the response variable. One past solution has been to perform phase–amplitude separation (as a pre-processing step) and then use only the amplitudes in the regression model. In this paper, we propose a more integrated approach, termed elastic functional regression model (EFRM), where phase-separation is performed inside the regression model, rather than as a pre-processing step. This approach generalizes the notion of phase in functional data, and is based on the norm-preserving time warping of predictors. Due to its invariance properties, this representation provides robustness to predictor phase variability and results in improved predictions of the response variable over traditional models. We demonstrate this framework using a number of datasets involving gait signals, NMR data, and stock market prices.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

A Robust Segmented Mixed Effect Regression Model for Baseline Electricity Consumption Forecasting

Renewable energy production has been surging around the world in recent years. To mitigate the increasing uncertainty and intermittency of the renewable generation, proactive demand response algorithms and programs are proposed and developed to further improve the utilization of load flexibility and increase the efficiency of power system operation. One of the biggest challenges to efficient control and operation of demand response resources is how to forecast the baseline electricity consumption and estimate the load impact from demand response resources accurately. In this paper, we propose a mixed effect segmented regression model and a new robust estimate for forecasting the baseline electricity consumption in Southern California, USA, by combining the ideas of random effect regression model, segmented regression model, and the least trimmed squares estimate. Since the log-likelihood of the considered model is not differentiable at breakpoints, we propose a new backfitting algorithm to estimate the unknown parameters. The estimation performance of the new estimation procedure has been demonstrated with both simulation studies and the real data application for the electric load baseline forecasting in Southern California.

42 ENGINEERING↗
DOE OSTI2024

Comparing Designed Training Sets to Optimize Multivariate Regression Models for Pr, Nd, and Nitric Acid Using Spectrophotometry

Chemometric regression models were developed for the quantification of praseodymium (Pr, 0–1000 µg/mL), neodymium (Nd, 0–1000 µg/mL), and nitric acid (HNO 3 , 0.1–5 M) using spectrophotometry. Designed calibration sets were composed of 20 samples each: 10 model points and 10 lack-of-fit (LOF) points. The D-optimal designs effectively minimized the number of samples required to build models, and each design resulted in similar prediction performance, suggesting that statistical design of experiments can provide a reliable framework for selecting training set samples in three-variable systems. Partial least squares regression (PLSR) models were validated against a one-factor-at-a-time validation set composed of 125 samples (three variables, five levels). The top PLS-1 models resulted in average percent root mean square error of prediction error values of 3.5%, 1.7%, and 1.2% for Pr(III), Nd(III), and HNO 3 , respectively. Power set augmentations of the model and LOF samples were investigated to optimize the number of training set samples. PLSR models built using just required model points (10) had similar predictive capabilities as models including the LOF points (20) but with fewer samples. The number of validation samples was also varied systematically to learn how many samples are needed to validate regression models. This work addresses long-standing questions in the field of chemometrics to help make this approach amenable to the near-real-time quantification of hazardous species in remote settings.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Improving Prediction of Peroxide Value of Edible Oils Using Regularized Regression Models

We present four unique prediction techniques, combined with multiple data pre-processing methods, utilizing a wide range of both oil types and oil peroxide values (PV) as well as incorporating natural aging for peroxide creation. Samples were PV assayed using a standard starch titration method, AOCS Method Cd 8-53, and used as a verified reference method for PV determination. Near-infrared (NIR) spectra were collected from each sample in two unique optical pathlengths (OPLs), 2 and 24 mm, then fused into a third distinct set. All three sets were used in partial least squares (PLS) regression, ridge regression, LASSO regression, and elastic net regression model calculation. While no individual regression model was established as the best, global models for each regression type and pre-processing method show good agreement between all regression types when performed in their optimal scenarios. Furthermore, small spectral window size boxcar averaging shows prediction accuracy improvements for edible oil PVs. Best-performing models for each regression type are: PLS regression, 25 point boxcar window fused OPL spectral information RMSEP = 2.50; ridge regression, 5 point boxcar window, 24 mm OPL, RMSEP = 2.20; LASSO raw spectral information, 24 mm OPL, RMSEP = 1.80; and elastic net, 10 point boxcar window, 24 mm OPL, RMSEP = 1.91. The results show promising advancements in the development of a full global model for PV determination of edible oils.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Addressing bias in bagging and boosting regression models

As artificial intelligence (AI) becomes widespread, there is increasing attention on investigating bias in machine learning (ML) models. Previous research concentrated on classification problems, with little emphasis on regression models. This paper presents an easy-to-apply and effective methodology for mitigating bias in bagging and boosting regression models, that is also applicable to any model trained through minimizing a differentiable loss function. Our methodology measures bias rigorously and extends the ML model's loss function with a regularization term to penalize high correlations between model errors and protected attributes. We applied our approach to three popular tree-based ensemble models: a random forest model (RF), a gradient-boosted model (GBT), and an extreme gradient boosting model (XGBoost). We implemented our methodology on a case study for predicting road-level traffic volume, where RF, GBT, and XGBoost models were shown to have high accuracy. Despite high accuracy, the ML models were shown to perform poorly on roads in minority-populated areas. Our bias mitigation approach reduced minority-related bias by over 50%.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

A precise non-invasive blood glucose measurement system using NIR spectroscopy and Huber’s regression model

Diabetes is one of the prominent diseases around the world. Presently, invasive techniques need a finger prick blood sample . A repetitively painful procedure that produces the chance of infection. To resolve this issue, non-invasive measurement approach is proposed. In this paper, an efficient NIR wave based optical detection system is proposed with optimized post-processing regression model. After real-time data analysis, it has been found that the coefficient of determination (R{sup 2}) is improved with the value of 0.9084 using proposed regression model. Mean absolute derivative is also increased with 3.87 mg/dl corresponding to predicted blood glucose concentration. Mean absolute relative difference has exceeded to 3.25%, and average error is improved with 3.77% using proposed regression model. Average accuaracy has been analyzed 94–95% for predicted blood glucose concentration.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2025

Meta‐Analysis and Regression Modeling of the Impacts of Four Indoor Environmental Quality Metrics on Office Performance

Awareness of how buildings interact with the occupant experience—especially human performance—is becoming more prevalent, as seen by increasing interest and investment in healthy built environments. However, there is a need to synthesize the wide array of existing indoor environmental assessment and performance research in a way that can translate directly to building design and operation. Existing research in this area typically focuses on a single isolated metric and has not focused on making the results utilizable by building practitioners. The aim of this research is to investigate existing office performance literature through meta‐analyses and produce regression models for four indoor environmental quality (IEQ) metrics to support critical decision‐making for building operation and renovation. To reach this aim, a literature review was conducted to identify studies that measure the impact of changing ventilation rate, temperature, horizontal illuminance, and noise level in offices on occupant task performance. This repository of field and laboratory studies was analyzed to visualize the trends between the selected IEQ metrics and task performance. The temperature, ventilation rate, and horizontal illuminance regression models showed clear improvement potential when modifying indoor conditions toward the defined high‐performance range, while the regression model for noise level was inconclusive. The discussion notes the importance of designing holistically for all components of these IEQ categories to utilize the results, for example, good filtration on outdoor air for quantifying ventilation impact and uniform overhead lighting with low contrast for quantifying horizontal illuminance impact. The novelty of this work is in considering multiple facets of the indoor environment under a single, unified analysis schema and producing IEQ‐based performance gains that can directly inform cost‐benefit analyses of building design and renovation.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2018

A fuzzy logistic regression model based on the least squares estimation

To construct the relationship between fuzzy inputs and fuzzy output described by linguistic variable, we develop a fuzzy logistic regression model, which can be applied for various problems, such as clinical research, risk investment and decision making. In this regard, we introduce the integral calculation of distance of cut sets and a fuzzy adjustment term which could prevent a large fuzzy error for a fuzzy output caused by the output degenerating into crisp number when the independent variables are crisp numbers. The parameters of the fuzzy logistic regression model are derived by means of the least squares method. We adopt three criteria involving mean square error, Kim and Bishu criterion and capability index and also perform two ways of prediction including the in-sample forecast as well as the one-leave-out cross validation. The comparisons with five existing methods show that our proposed method has satisfactory performance and the results are illustrated in some case studies.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Parton labeling without matching: unveiling emergent labelling capabilities in regression models

Parton labeling methods are widely used when reconstructing collider events with top quarks or other massive particles. State-of-the-art techniques are based on machine learning and require training data with events that have been matched using simulations with truth information. In nature, there is no unique matching between partons and final state objects due to the properties of the strong force and due to acceptance effects. We propose a new approach to parton labeling that circumvents these challenges by recycling regression models. The final state objects that are most relevant for a regression model to predict the properties of a particular top quark are assigned to said parent particle without having any parton-matched training data. This approach is demonstrated using simulated events with top quarks and outperforms the widely used $χ$ 2 method.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2018

Hourly land-use regression models based on low-cost PM monitor data

Highlights: • A network of 23 low-cost PM monitors was deployed across an urban area. • Land use regression models predict the hourly intra-urban PM variations. • Coefficients of determination for hourly PM predictions ranged 0.66–0.76. • Low-cost PM monitor data need to be carefully evaluated before use. • The combination of low-cost monitors and modeling provides useful PM estimates. Land-use regression (LUR) models provide location and time specific estimates of exposure to air pollution and thereby improve the sensitivity of health effects models. However, they require pollutant concentrations at multiple locations along with land-use variables. Often, monitoring is performed over short durations using mobile monitoring with research-grade instruments. Low-cost PM monitors provide an alternative approach that increases the spatial and temporal resolution of the air quality data. LUR models were developed to predict hourly PM concentrations across a metropolitan area using PM concentrations measured simultaneously at multiple locations with low-cost monitors. Monitors were placed at 23 sites during the 2015/16 heating season. Monitors were externally calibrated using co-located measurements including a reference instrument (GRIMM particle spectrometer). LUR models for each hour of the day and weekdays/weekend days were developed using the deletion/substitution/addition algorithm. Coefficients of determination for hourly PM predictions ranged from 0.66 and 0.76 (average 0.7). The hourly-resolved LUR model results will be used in epidemiological studies to examine if and how quickly, increases in ambient PM concentrations trigger adverse health events by reducing the exposure misclassification that arises from using less time resolved exposure estimates.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Classification and regression models of audio and vibration signals for machine state monitoring in precision machining systems

Here we present a data-driven method for monitoring machine status in manufacturing processes. Audio and vibration data from precision machining are used for inference in two operating scenarios: (a) variable machine health states (anomaly detection); and (b) settings of machine operation (state estimation). Audio and vibration signals are first processed through Fast Fourier Transform and Principal Component Analysis to extract transformed and informative features. These features are then used in the training of classification and regression models for machine state monitoring. Specifically, three classifiers (K-nearest neighbors, convolutional neural networks and support vector machines) and two regressors (support vector regression and neural network regression) were explored, in terms of their accuracy in machine state prediction. It is shown that the audio and vibration signals are sufficiently rich in information about the machine that 100% state classification accuracy could be accomplished. Data fusion was also explored, showing overall superior accuracy of data-driven regression models.

42 ENGINEERING↗
DOE OSTI2023

Machine Learning-Based Regression Models for Ironmaking Blast Furnace Automation

Computational fluid dynamics (CFD)-based simulation has been the traditional way to model complex industrial systems and processes. One very large and complex industrial system that has benefited from CFD-based simulations is the steel blast furnace system. The problem with the CFD-based simulation approach is that it tends to be very slow for generating data. The CFD-only approach may not be fast enough for use in real-time decisionmaking. To address this issue, in this work, the authors propose the use of machine learning techniques to train and test models based on data generated via CFD simulation. Regression models based on neural networks are compared with tree-boosting models. In particular, several areas (tuyere, raceway, and shaft) of the blast furnace are modeled using these approaches. The results of the model training and testing are presented and discussed. The obtained R 2 metrics are, in general, very high. The results appear promising and may help to improve the efficiency of operator and process engineer decisionmaking when running a blast furnace.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2018

Predictive and mechanistic multivariate linear regression models for reaction development

Multivariate Linear Regression (MLR) models utilizing computationally-derived and empirically-derived physical organic molecular descriptors are described in this review. Several reports demonstrating the effectiveness of this methodological approach towards reaction optimization and mechanistic interrogation are discussed. A detailed protocol to access quantitative and predictive MLR models is provided as a guide for model development and parameter analysis.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗