Search NASA⌕ Search

SEARCH · Search NASA

Results for “regression modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

A simplified regression building thermal modelling method for detached two-floor house in U.S.

The residential building sector accounts for approximately 37% of total U.S. electricity consumption. Within the residential building sector, heating and cooling is the main target for peak load shifting/reduction since it is the largest contributor to peak demand. In fact, the flexibility of residential HVAC loads can provide continuous variation of demand to provide grid services by varying their demand over a baseline. The performance of HVAC load control to provide grid services relies heavily on the accuracy of indoor air temperature or cooling/heating demand predictions and therefore the quality of building model. Besides forward models, popular building models are data-driven models which can be broken down into two categories: gray-box model, e.g. Resistance-Capacitance (RC) model and black-box model. RC model, also called lumped capacitance or network model, which is constituted with electrical analogue pattern with resistance (R) and capacitance (C). In general, RC models require considerable computation burden and long periods of data to train limited number of model coefficients. Black-box models have gained increasing interest due to their capability in analyzing large-scale data and flexibility in practical applications. But, the data-mining based (machine learning algorithms/techniques based) models tend to have invisible model structures which poses a problem when trying to use the model for optimal control or model predictive control of the HVAC system. Hence, there is a continuing need for efficient online system identification techniques, which can provide explicit parameters for the model. Traditional regression models fit well for this specific purpose. This paper presents an innovative way to predict average indoor temperature in separate floors of typical detached residential house. A rolling horizon linear regression model, which includes online adaptive correction component, is proposed to predict the temperature difference between downstairs and upstairs. A RC model is used to predict the overall mean indoor air temperature. Since the adaptive algorithm needs to be implemented online, a less computation-demanding polynomial fitting algorithm is adopted. This kind of fitting problem can be cast as linear regression problem with multiple variables, parameters of which can be efficiently obtained by well-known gradient descent method.The validation is conducted by comparing the predicted results with the results from data-mining based models as well as measured data from a real typical detached two-floor house. The results show that the developed method has satisfactory performance in predicting the building indoor temperature in 1st and 2nd floors.

Cui, Borui↗

Logistic Regression in Clinical Studies

• A logistic regression model is used when the outcome of interest is binary. The term “logistic” refers to the underlying “logit” (log odds) function that is used to model the binary outcome. • Odds ratios are produced from a logistic regression model and have a useful interpretation. • Tips, tricks and concepts used to fit logistic regression models are similar to those used in linear regression models. • Modeling building that is knowledge-based rather than automatic is preferred in most applications of logistic regression. • A logistic regression model that is overparameterized (ie, too many variables for too few events) can result in odds ratios that are implausibly large and confidence intervals that are wide and uninterpretable. These types of “overfitted” models should be avoided. • Logistic regression models can be fit using most standard statistical software.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Biological monitoring of smoke exposure among wildland firefighters: A pilot study comparing urinary methoxyphenols with personal exposures to carbon monoxide, particulate matter, and levoglucosan.

Urinary methoxyphenols (MPs) have been proposed as biomarkers of woodsmoke exposure. However, few field studies have been undertaken to evaluate the relationship between woodsmoke exposure and urinary MP concentrations. We conducted a pilot study at the US Forest ServiceFSavannah River Site, in which carbon monoxide (CO), levoglucosan (LG), and particulate matter (PM2.5) exposures were measured in wildland firefighters on prescribedburn days. Pre- and post-shift urine samples were collected from each subject, and cross-shift changes in creatinine-corrected urinary MP concentrations were calculated. Correlations between exposure measures and creatine-adjusted urinary MP concentrations were explored, and regression models were developed relating changes in urinary MP concentrations to measured exposure levels. Full-shift measurements were made on 13 firefighters over 20 work shifts in winter 2004 at the US Forest Service Savannah River site, a National Environmental Research Park. The average workshift length across the 20 measured shifts was 701±95 min. LG and CO exposures were significantly correlated for samples where the filter measurement captured at least 60% of the work shift (16 samples), as well as for the smaller set of full-shift exposure samples (n¼9). PM2.5 and CO exposures were not significantly correlated, and LG and PM2.5 exposures were only significantly correlated for samples representing at least 60% of the work shift. Creatinine-corrected urinary concentrations for 20 of the 22 MPs showed cross-shift increases, with 14 of these changes showing statistical significance. Individual and summed creatinine-adjusted guaiacol urinary MPs were highly associated with CO (and, to a lesser degree, LG) exposure levels, and random-effects regression models including CO and LG exposure levels explained up to 80% of the variance in cross-shift changes in summed creatinine-adjusted guaiacol urinary MP concentrations. Although limited by the small sample size, this pilot study demonstrates that urinary MP concentrations may be effective biomarkers of occupational exposure to wood smoke among wildland firefighters.

60 APPLIED LIFE SCIENCES↗

Comparison of Iterative and Non-Iterative Strain-Gage Balance Load Calculation Methods

The accuracy of iterative and non-iterative strain-gage balance load calculation methods was compared using data from the calibration of a force balance. Two iterative and one non-iterative method were investigated. In addition, transformations were applied to balance loads in order to process the calibration data in both direct read and force balance format. NASA's regression model optimization tool BALFIT was used to generate optimized regression models of the calibration data for each of the three load calculation methods. This approach made sure that the selected regression models met strict statistical quality requirements. The comparison of the standard deviation of the load residuals showed that the first iterative method may be applied to data in both the direct read and force balance format. The second iterative method, on the other hand, implicitly assumes that the primary gage sensitivities of all balance gages exist. Therefore, the second iterative method only works if the given balance data is processed in force balance format. The calibration data set was also processed using the non-iterative method. Standard deviations of the load residuals for the three load calculation methods were compared. Overall, the standard deviations show very good agreement. The load prediction accuracies of the three methods appear to be compatible as long as regression models used to analyze the calibration data meet strict statistical quality requirements. Recent improvements of the regression model optimization tool BALFIT are also discussed in the paper.

Ulbrich, N.↗

Quantifying the statistical importance of utilizing regression over classic energy intensity calculations for tracking efficiency improvements in industry

In the United States, manufacturing facilities account for about 32% of total domestic energy consumption in 2014. Robust energy tracking methodologies are critical to understanding energy performance in manufacturing facilities. Due to its simplicity and intuitiveness, the classic energy intensity method (i.e. the ratio of total energy use over total production) is the most widely adopted. However, the classic energy intensity method does not take into account the variation of other relevant parameters (i.e. product type, feed stock type, weather, etc.). Furthermore, the energy intensity method assumes that the facilities’ base energy consumption (energy use at zero production) is zero, which rarely holds true. Therefore, it is commonly recommended to utilize regression models rather than the energy intensity approach for tracking improvements at the facility level. Unfortunately, many energy managers have difficulties understanding why regression models are statistically better than utilizing the classic energy intensity method. While anecdotes and qualitative information may convince some, many have major reservations about the accuracy of regression models and whether it is worth the time and effort to gather data and build quality regression models. This paper will explain why regression models are theoretically and quantitatively more accurate for tracking energy performance improvements. Based on the analysis of data from 114 manufacturing plants over 12 years, this paper will present quantitative results on the importance of utilizing regression models over the energy intensity methodology. This paper will also document scenarios where regression models do not have significant relevance over the energy intensity method.

Wenning, Thomas↗

Nitrate removal in stream ecosystems measured by 15N addition experiments: Total uptake

We measured uptake length of {sup 15}NO{sub 3}{sup -} in 72 streams in eight regions across the United States and Puerto Rico to develop quantitative predictive models on controls of NO{sub 3}{sup -} uptake length. As part of the Lotic Intersite Nitrogen Experiment II project, we chose nine streams in each region corresponding to natural (reference), suburban-urban, and agricultural land uses. Study streams spanned a range of human land use to maximize variation in NO{sub 3}{sup -} concentration, geomorphology, and metabolism. We tested a causal model predicting controls on NO{sub 3}{sup -} uptake length using structural equation modeling. The model included concomitant measurements of ecosystem metabolism, hydraulic parameters, and nitrogen concentration. We compared this structural equation model to multiple regression models which included additional biotic, catchment, and riparian variables. The structural equation model explained 79% of the variation in log uptake length (S{sub Wtot}). Uptake length increased with specific discharge (Q/w) and increasing NO{sub 3}{sup -} concentrations, showing a loss in removal efficiency in streams with high NO{sub 3}{sup -} concentration. Uptake lengths shortened with increasing gross primary production, suggesting autotrophic assimilation dominated NO{sub 3}{sup -} removal. The fraction of catchment area as agriculture and suburban-urban land use weakly predicted NO{sub 3}{sup -} uptake in bivariate regression, and did improve prediction in a set of multiple regression models. Adding land use to the structural equation model showed that land use indirectly affected NO{sub 3}{sup -} uptake lengths via directly increasing both gross primary production and NO{sub 3}{sup -} concentration. Gross primary production shortened S{sub Wtot}, while increasing NO{sub 3}{sup -} lengthened S{sub Wtot} resulting in no net effect of land use on NO{sub 3}{sup -} removal.

54 ENVIRONMENTAL SCIENCES↗

Municipal solid waste generation in municipalities: Quantifying impacts of household structure, commercial waste and domestic fuel

Waste management planning requires reliable data concerning waste generation, influencing factors on waste generation and forecasts of waste quantities based on facts. This paper aims at identifying and quantifying differences between different municipalities' municipal solid waste (MSW) collection quantities based on data from waste management and on socio-economic indicators. A large set of 116 indicators from 542 municipalities in the Province of Styria was investigated. The resulting regression model included municipal tax revenue per capita, household size and the percentage of buildings with solid fuel heating systems. The model explains 74.3% of the MSW variation and the model assumptions are met. Other factors such as tourism, home composting or age distribution of the population did not significantly improve the model. According to the model, 21% of MSW collected in Styria was commercial waste and 18% of the generated MSW was burned in domestic heating systems. While the percentage of commercial waste is consistent with literature data, practically no literature data are available for the quantity of MSW burned, which seems to be overestimated by the model. The resulting regression model was used as basis for a waste prognosis model (Beigl and Lebersorger, in preparation).

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

2021 Monthly Rice Production in Chinese Coastal Provinces

This paper explores the dynamics of rice production in the Chinese provinces of Liaoning, Jilin, Heilongjiang, Shanghai, Jiangsu, and Zhejiang and seeks to predict monthly rice production in the months of April through October using precipitation and Normalized Difference Vegetation Index as the predictor variables available. We utilize ridge and lasso regression models to predict the rice yield. Results indicate that a lasso regression model with an R 2 value of 0.9991501 with an adjusted R 2 value of 0.9991502 and a ridge regression model with an R 2 value of 0.9865443 with an adjusted R 2 value of 0.9870637 are possible. The lasso regression model does not account for all predictor variables while the ridge regression model does. Both models could be expanded upon to include more observations.

Tubbs, Heidi↗

Neural Network and Regression Soft Model Extended for PAX-300 Aircraft Engine

In fiscal year 2001, the neural network and regression capabilities of NASA Glenn Research Center's COMETBOARDS design optimization testbed were extended to generate approximate models for the PAX-300 aircraft engine. The analytical model of the engine is defined through nine variables: the fan efficiency factor, the low pressure of the compressor, the high pressure of the compressor, the high pressure of the turbine, the low pressure of the turbine, the operating pressure, and three critical temperatures (T(sub 4), T(sub vane), and T(sub metal)). Numerical Propulsion System Simulation (NPSS) calculations of the specific fuel consumption (TSFC), as a function of the variables can become time consuming, and numerical instabilities can occur during these design calculations. "Soft" models can alleviate both deficiencies. These approximate models are generated from a set of high-fidelity input-output pairs obtained from the NPSS code and a design of the experiment strategy. A neural network and a regression model with 45 weight factors were trained for the input/output pairs. Then, the trained models were validated through a comparison with the original NPSS code. Comparisons of TSFC versus the operating pressure and of TSFC versus the three temperatures (T(sub 4), T(sub vane), and T(sub metal)) are depicted in the figures. The overall performance was satisfactory for both the regression and the neural network model. The regression model required fewer calculations than the neural network model, and it produced marginally superior results. Training the approximate methods is time consuming. Once trained, the approximate methods generated the solution with only a trivial computational effort, reducing the solution time from hours to less than a minute.

Patnaik, Surya N.↗

Winter Wheat Yield Assessment from Landsat 8 and Sentinel-2 Data: Incorporating Surface Reflectance, Through Phenological Fitting, into Regression Yield Models

A combination of Landsat 8 and Sentinel-2 offers a high frequency of observations (3–5 days) at moderate spatial resolution (10–30 m), which is essential for crop yield studies. Existing methods traditionally apply vegetation indices (VIs) that incorporate surface reflectances (SRs) in two or more spectral bands into a single variable, and rarely address the incorporation of SRs into empirical regression models of crop yield. In this work, we address these issues by normalizing satellite data (both VIs and SRs) derived from NASA’s Harmonized Landsat Sentinel-2 (HLS) product, through a phenological fitting. We apply a quadratic function to fit VIs or SRs against accumulated growing degree days (AGDDs), which affects the rate of crop development. The derived phenological metrics for VIs and SRs, namely peak, area under curve (AUC), and fitting coefficients from a quadratic function, were used to build empirical regression winter wheat models at a regional scale in Ukraine for three years, 2016–2018. The best results were achieved for the model with near infrared (NIR) and red spectral bands and derived AUC, constant, linear, and quadratic coefficients of the quadratic model. The best model yielded a root mean square error (RMSE) of 0.201 t/ha (5.4%) and coefficient of determination R2 = 0.73 on cross-validation.

phenological fitting↗

SLAB: simultaneous labeling and binding affinity prediction for protein–ligand structures

Machine learning models are often used as scoring functions to predict the binding affinity of a protein–ligand complex. These models are trained with limited amounts of data with experimentally measured binding affinity values. A large number of compounds are labeled inactive through single-concentration screens without measuring binding affinities. These inactive compounds, along with the active ones, can be used to train binary classification models, while regression models are trained using compounds with binding affinities only. However, the classification and regression tasks are often handled separately, without sharing the learned feature representations. In this paper, we propose a novel model architecture that jointly performs regression and classification objectives, aiming to maximize data utilization and improve predictive performance by leveraging two complementary tasks. In our setup, the regression yields the binding affinity, whereas the classification task yields the label as active or inactive. We demonstrate our method using PDBbind, the standard 3D structure database, as well as a dataset of flavivirus protease compounds with binding affinity data. Our experiments show that the new joint training strategy improves the accuracy of the model, increasing applicability in various practical drug screening scenarios.

Biological and medical sciences↗

Development of a Non-Iterative Balance Load Prediction Algorithm for the NASA Ames Unitary Plan Wind Tunnel

A non-iterative load prediction algorithm for strain-gage balances was developed for the NASA Ames Unitary Plan Wind Tunnels that computes balance loads from the electrical outputs of the balance bridges and a set of state variables. A state variable could be, for example, a balance temperature difference or the bellows pressure of a flow-through balance. The algorithm directly uses regression models of the balance loads for the load prediction that were obtained by applying global regression analysis to balance calibration data. This choice greatly simplifies both implementation and use of the load prediction process for complex balance configurations as no load iteration needs to be performed. The regression model of a balance load is constructed by using terms from a total of nine term groups. Four term groups are derived from a Taylor Series expansion of the relationship between the load, gage outputs, and state variables. The remaining five term groups are defined by using absolute values of the gage outputs and state variables. Terms from these groups should only be included in the regression model if calibration data from a balance with known bi-directional outputs is analyzed. It is illustrated in detail how global regression analysis may be applied to obtain the coefficients of the chosen regression model of a load component assuming that no linear or massive near-linear dependencies between the regression model terms exist. Data from the machine calibration of a six-component force balance is used to illustrate both application and accuracy of the non-iterative load prediction process.

Ulbrich, Norbert M.↗

Functional Predictor Variables for the Leaching Potential of Arsenic and Selenium from Coal Fly Ash

The release of leachates from intact coal ash impoundments is a concern due to the enrichment and mobilization of toxic elements such as arsenic (As) and selenium (Se). This study aims to explore the intrinsic properties of coal fly ash that correlate with the relative leachability of As and Se. We performed leaching experiments with 52 fly ash samples collected from 15 different U.S. power plants and representing coal feedstocks from the three major domestic regions. We assessed the mobilization potential of As and Se in fly ash based on standardized leaching protocols and performed multivariate and lasso regression analyses to explore correlations of leachable As and Se contents with characteristics such as major element contents, loss on ignition, and pH. The results of regression models indicated that major elements (Fe, Ca, and Al) for a wide range of fly ashes can serve as predictor variables for the leaching potential of As but not for Se. LOI and pH were not important predictive variables in the models. Both regression approaches resulted in relatively strong fits for leachable As (correlation coefficient R 2 = 0.78 for both models) compared to models for leachable Se (R 2 = 0.49). Overall, these results suggest that correlation models combined with on-site elemental analysis with portable analyzers may enable a screening method for leachable As in coal ash.

01 COAL, LIGNITE, AND PEAT↗

A model of the effects of flow fluctuations on fall Chinook salmon spawning habitat availability in the Columbia River

Previously we reported that about 30% to 60% of the area predicted to be used by fall Chinook salmon (Oncorhynchus tshawytscha) for spawning in the Hanford Reach of the Columbia River did not contain redds. One explanation for the overprediction of habitat was that our model did not incorporate streamflow fluctuation. Daily fluctuation in flow caused by load-following operations (power generation to meet short-term electrical demand) at Priest Rapids Dam, situated at the upper end of the Hanford Reach, changes the hydraulic characteristics to which fish respond in selecting redd sites. The purpose of the study described here was to examine the effect of flow changes on spawning habitat modeling and, in particular, to look at the connection between spawning and the variability and persistence of habitat variables caused by rapid changes in flow resulting from load-following operations at Priest Rapids Dam. We found that spawning habitat use by fall Chinook salmon was consistent with previous fall Chinook salmon studies in the Reach. Dynamic variables that were based on hourly time series were used to account for the variability in habitat as a result of flow fluctuations. The analysis showed that the proportion of velocities that fell within the range of 1.0 to 2.5 m/s differed significantly between locations that were predicted to be spawning by the logistic regression model where spawning actually occurred and locations that were predicted to be spawning where spawning did not occur. However, the resulting sequential logistic regression model that incorporated the dynamic variables did not provide significant improvement in the percentage of errors for areas predicted to be spawning; the model’s overprediction errors still ranged from 63% to 78%. We suggest that while flow fluctuation may affect spawning habitat and individual fish behavior, the high correlation between time-averaged velocities and the proportion of hourly velocities that fell within the most favorable range negated any improvements in model predictions.

54 ENVIRONMENTAL SCIENCES↗

In silico prediction of toxicity of non-congeneric industrial chemicals using ensemble learning based modeling approaches

Ensemble learning approach based decision treeboost (DTB) and decision tree forest (DTF) models are introduced in order to establish quantitative structure–toxicity relationship (QSTR) for the prediction of toxicity of 1450 diverse chemicals. Eight non-quantum mechanical molecular descriptors were derived. Structural diversity of the chemicals was evaluated using Tanimoto similarity index. Stochastic gradient boosting and bagging algorithms supplemented DTB and DTF models were constructed for classification and function optimization problems using the toxicity end-point in T. pyriformis. Special attention was drawn to prediction ability and robustness of the models, investigated both in external and 10-fold cross validation processes. In complete data, optimal DTB and DTF models rendered accuracies of 98.90%, 98.83% in two-category and 98.14%, 98.14% in four-category toxicity classifications. Both the models further yielded classification accuracies of 100% in external toxicity data of T. pyriformis. The constructed regression models (DTB and DTF) using five descriptors yielded correlation coefficients (R{sup 2}) of 0.945, 0.944 between the measured and predicted toxicities with mean squared errors (MSEs) of 0.059, and 0.064 in complete T. pyriformis data. The T. pyriformis regression models (DTB and DTF) applied to the external toxicity data sets yielded R{sup 2} and MSE values of 0.637, 0.655; 0.534, 0.507 (marine bacteria) and 0.741, 0.691; 0.155, 0.173 (algae). The results suggest for wide applicability of the inter-species models in predicting toxicity of new chemicals for regulatory purposes. These approaches provide useful strategy and robust tools in the screening of ecotoxicological risk or environmental hazard potential of chemicals. - Graphical abstract: Importance of input variables in DTB and DTF classification models for (a) two-category, and (b) four-category toxicity intervals in T. pyriformis data. Generalization and predictive abilities of the constructed (c) DTB and (d) DTF regression models to predict the T. pyriformis toxicity of diverse chemicals. - Highlights: • Ensemble learning (EL) based models constructed for toxicity prediction of chemicals • Predictive models used a few simple non-quantum mechanical molecular descriptors. • EL-based DTB/DTF models successfully discriminated toxic and non-toxic chemicals. • DTB/DTF regression models precisely predicted toxicity of chemicals in multi-species. • Proposed EL based models can be used as tool to predict toxicity of new chemicals.

60 APPLIED LIFE SCIENCES↗

Machine Learning Accelerated First-Principles Study of the Hydrodeoxygenation of Propanoic Acid

The complex reaction network of catalytic biomass conversions often involves hundreds of surface intermediates and thousands of reaction steps, greatly hindering the rational design of metal catalysts for these conversions. Here, we present a framework of machine learning (ML)-accelerated first-principles studies for the hydrodeoxygenation (HDO) of propanoic acid over transition metal surfaces. The microkinetic model (MKM) is initially parametrized by ML-predicted energies and iteratively improved by identifying the rate-determining species and steps (RDS), computing their energies by density functional theory (DFT), and reparameterizing the MKM until all the RDS are computed by DFT. The Gaussian process (GP) model performs significantly better than the linear ridge regression model for predicting both the adsorption free energies and transition state free energies. Parameterized with energies from the GP model, only 5–20% of the full reaction network has to be computed by DFT for the MKM to possess DFT-level accuracy for the TOF and dominant reaction pathway. While the linear ridge regression model performs worse than the GP model, its performance is greatly improved when only transition states are predicted by the regression model and adsorption energies are computed by DFT. Overall, we find that a high accuracy in adsorption free energies is more important for a reliable MKM than a high accuracy in TS free energies. Lastly, based on the GP model with GOH and GCHCHCO as catalyst descriptors, we build two-dimensional volcano plots in activity and selectivity that can help design promising alloy catalysts for HDO reactions of organic acids.

adsorption↗