Search NASA⌕ Search

SEARCH · Search NASA

Results for “nonlinear regression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

A Nonlinear Regression Method for Composite Protection Modeling of Induction Motor Loads

Protection equipment are used to prevent damages to induction motor loads by isolating those from the power network in the event of severe faults. Modeling the response of induction motor loads and their protection is vital for power system planning and operation, especially in understanding system's response moments after a fault has occurred. This article proposes an optimization based framework to generate composite protection models for commercial building motor loads. Introducing a mathematical abstraction, the task of finding a suitable (simplified) model of the composite protection scheme is formulated as a nonlinear regression problem. Numerical examples are provided to illustrate the application of the framework.

Kundu, Soumya↗
DOE OSTI2021

Development of a Filtered CFD-DEM Drag Model with Multiscale Markers Using an Artificial Neural Network and Nonlinear Regression

Here, the accuracy of coarse-grained Euler-Lagrangian simulations of fluidized beds heavily depends on the mesoscale drag models to account for the influences of the unresolved sub-grid structures. Traditional filtered drag models are regressed with mesoscale markers such as voidage and slip velocities. In this research, a filtered drag was regressed with both mesoscale and macro-scale markers using fine grid Computational Fluid Dynamics - Discrete Element Method (CFD-DEM) simulations. The traditional non-linear regression method was compared with machine learning regression using an Artificial Neural Network (ANN) implemented in PyTorch and coupled with MFiX. The new drag showed higher accuracy than the Wen-Yu drag and another filtered drag derived from the two-fluid model. The nonlinear regression shows slightly better results than ANN regression in cases with similar R 2 values. The utilization of the gas inlet velocity as an additional macro-scale marker reduced the errors by up to 55.3% in the tested cases.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Comparing Calibration Algorithms for the Rapid Characterization of Pretreated Corn Stover Using Near-Infrared Spectroscopy

Rapid characterization of biomass composition is a key enabling technology for biorefineries—the ability to measure the chemical composition of biomass materials entering the biorefinery as well as the composition of key process intermediate streams would allow real-time process control and the development of robust models to predict process performance. The utility of near-infrared (NIR) spectroscopy for rapid characterization requires multivariate algorithms for building calibration models. The most prevalent algorithm used for building calibration models using NIR spectra is the linear modeling algorithm Partial Least Squares Regression (PLS). Nonlinear regression algorithms (which are typically more computationally intensive than linear modeling approaches) have gained popularity in recent years due to their ability to solve a wide variety of classification and regression problems and the dramatic increase in available computational resources. In this work, we demonstrate that a calibration model can predict the composition of corn stover process intermediate samples pretreated with three different treatments—hot water (HW), dilute acid (DA), and deacetylation followed by dilute acid (DDA). We quantitatively compare three different algorithms for building prediction models based on near-infrared spectroscopy—partial least squares (PLS), support vector machines (SVM), and random forests (RF). We demonstrate the utility of improving model performance by accounting for instrument performance variability using repeated measurements of standard materials (e.g., the “repeatability file” strategy) and investigate its performance with nonlinear regression techniques, and we discuss methods for quantifying the uncertainties of specific predictions among the three methods.

09 BIOMASS FUELS↗
DOE OSTI2020

Nonlinear Logistic Regression Mixture Experiment Modeling for Binary Data Using Dimensionally Reduced Components

This article presents and illustrates an approach using nonlinear logistic regression for modeling binary response data from a mixture experiment when the components can be partitioned into groups used to form dimensionally-reduced pseudocomponents (DRPs). A DRP is a linear combination of the components in a group, where the linear combinations over all groups are normalized so that the DRP proportions sum to unity. Nonlinear logistic regression is required because, after normalization of the linear combinations, the model expressed in terms of the DRPs is nonlinear in the parameters that specify the linear combinations. A method for obtaining nonparametric tolerance limits on the probability of a “success” for the binary response variable using a bootstrap approach is also presented. Having three DRPs enables viewing data and modeling results on a ternary plot even though there may be many more than three mixture components. A real database, involving whether or not nepheline crystals form in simulated nuclear waste glass after cooling, is used to illustrate the nonlinear logistic regression modeling and nonparametric tolerance limit approaches when there are three DRPs.

Waste glass, Nepheline, Mixture experiment, Logist↗
DOE OSTI2022

Automated and efficient local adaptive regression for principal component-based reduced-order modeling of turbulent reacting flows

Principal Component Analysis can be used to reduce the cost of Computational Fluid Dynamics simulations of turbulent reacting flows by reducing the dimensionality of the transported variables through projection of the thermochemical state onto a lower-dimensional manifold. However, because of the nonlinearity of the principal component source terms, nonlinear regression techniques must be utilized for the source terms in terms of the principal components. Unfortunately, widely available and utilized nonlinear regression techniques can have prohibitive computational requirements and/or accuracy that is highly dependent on user experience in ad hoc tuning of model architecture and hyperparameters. Here, in this work, a new nonlinear regression approach is proposed that is both computationally efficient and automated so does not require any user input. The approach is evaluated through a priori prediction of principal component source terms using data from a Direct Numerical Simulation of a turbulent nonpremixed n-heptane/air jet flame. In particular, the proposed framework consists of local regressions whose complexity is adapted according to the local nonlinearity of the data: local linear regression when accurate enough and local Artificial Neural Networks when nonlinear regression is required. The number of local clusters for local regression is determined automatically using the Davies-Bouldin index. In addition, Bayesian optimization is utilized for model training (i.e., to select the best architectures and hyperparameters of the nonlinear regressions in an unsupervised fashion), eliminating ad hoc hand-tuning and/or expensive grid searches. Overall, compared to a single, global neural network, the new local adaptive regression approach is shown to have comparable accuracy but 69% less training time due to the utilization of local linear regression and faster training of local neural networks.

42 ENGINEERING↗
DOE OSTI2025

Explaining drivers of housing prices with nonlinear hedonic regressions

Housing markets play a critical role in shaping the spatial and demographic evolution of urban areas. Simulating housing price dynamics can enhance projections of future urban development outcomes. However, traditional hedonic regressions for housing prices, which neglect nonlinear interactions among explanatory variables, often exhibit limited predictive performance. While machine learning (ML) methods can provide a more flexible representation of the relationships between predictors, they are often regarded as “black boxes” due to their complexity and lack of transparency. Interpretable ML techniques provide a promising route by combining the flexibility of ML methods with approaches to analyze the relationships between inputs and outputs. In this study, we employ interpretable ML to analyze the patterns driving the housing market in Baltimore, Maryland, USA. We train an Artificial Neural Network (ANN) to predict Baltimore housing prices based on structural characteristics (e.g., home size, number of stories) and locational attributes (e.g., distance to the city center). We then conduct sensitivity and Partial Dependence Plot (PDP) analyses to interpret the fitted ANN model. We find that the ML model achieves higher predictive accuracy and explains 16 % more of housing price variance than a traditional linear regression model. The interpretable ML model also reveals more nuanced and realistic nonlinear relationships between housing sales price and predictors as well as interactive effects underlying Baltimore home price dynamics. For instance, while the linear model indicates a steady housing price increase over time, our interpretable ML model detects a post-2008 decline, with smaller properties experiencing the sharpest drop.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

The older plant gets the sun: Age-related changes in Miscanthus × giganteus phenology

Age-related changes are usually overlooked in perennial grass research; when they are considered it is usually as a change in plant size (e.g., biomass). Whether other physiological or developmental aspects change as stands age, and how those aspects may impact long-term stand dynamics, remains unclear. Conventional experimental designs study a single stand over multiple growing seasons and thereby confound age-related changes with growing season conditions. Here we used a staggered-start experimental design with three repeated planting years over two growing seasons to isolate growing season effects. We studied changes in Miscanthus × giganteus phenology during its yield-building stage (first 3 years) and estimated age, growing season and nitrogen (N) effects on development using nonlinear regression parameters. Stand age clearly changed plant growth; faster developmental rates were usually seen in 1-year-old stands (young), but because 2- and 3-year-old stands (mature) emerged 3 months earlier than newly planted stands they produced ~30% more stems with 30%–60% more leaves. Nitrogen fertilization modulated some age-related phenological changes. Fertilized 2-year-old stands reached similar stem densities as unfertilized 3-year-old stands and had fewer number of senesced leaves like 1-year-old stands. In addition, N fertilization had no effect on young M. × giganteus , but extended mature stands’ growing season more than 2 weeks by hastening emergence and delaying senescence. It also delayed flowering regardless of stand age. Our results suggest that, along with changes in size, M. × giganteus stands showed shifts in developmental strategies: young stands emerged later and developed faster, while mature stands grew for longer but more slowly. In temperate regions, where hard frost events are likely to interrupt development in late autumn, rapid early development is critical to plant survival. Nonlinear regression parameter differences proved effective in identifying phenological shifts.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Cost function for low-dimensional manifold topology assessment

Abstract In reduced-order modeling, complex systems that exhibit high state-space dimensionality are described and evolved using a small number of parameters. These parameters can be obtained in a data-driven way, where a high-dimensional dataset is projected onto a lower-dimensional basis. A complex system is then restricted to states on a low-dimensional manifold where it can be efficiently modeled. While this approach brings computational benefits, obtaining a good quality of the manifold topology becomes a crucial aspect when models, such as nonlinear regression, are built on top of the manifold. Here, we present a quantitative metric for characterizing manifold topologies. Our metric pays attention to non-uniqueness and spatial gradients in physical quantities of interest, and can be applied to manifolds of arbitrary dimensionality. Using the metric as a cost function in optimization algorithms, we show that optimized low-dimensional projections can be found. We delineate a few applications of the cost function to datasets representing argon plasma, reacting flows and atmospheric pollutant dispersion. We demonstrate how the cost function can assess various dimensionality reduction and manifold learning techniques as well as data preprocessing strategies in their capacity to yield quality low-dimensional projections. We show that improved manifold topologies can facilitate building nonlinear regression models.

42 ENGINEERING↗
DOE OSTI2021

Assessment the leaching characteristics and long-term leaching behavior of some radionuclides from synthesized zeolite cement matrix

Highlights: • Synthesis and characterization of zeolite cement synthesized from fly ash • Leaching tests were used to assess the release rate of {sup 85}Sr and {sup 60}Co radionuclides. • Simple mathematical models were used to detect leaching mechanisms. • Long-term leaching behavior of {sup 85}Sr and {sup 60}Co from cementitious matrix was assessed. The development of cementitious materials remains a vital goal to produce valuable products with good mechanical, physical and chemical properties suitable for the safe disposal of concentrated radionuclides resulted from the treatment of contaminated solutions. In this paper, zeolite cement with good properties was laboratory synthesized from industrial by-products fly ash and characterized using various characterization techniques. The leaching characteristics of strontium and cobalt radionuclides from the synthesized zeolite cement were scrutinized conforming with the standard leaching methodology of International Atomic Energy Authority (IAEA). A mechanical strength assessment was executed to characterize the extent of immobilization process of the solidified matrices. The cumulative leaching fraction (φ) of the two studied radionuclides was found to be less than 5% in all examined conditions, which implies the applicability of the IAEA-recommended methodology for estimating the diffusion coefficient. The experimental leaching data were regressed nonlinearly to various mathematical kinetic models to assess the controlling leaching mechanism and to determine the leaching parameters. The regression results indicated that strontium ({sup 85}Sr) and cobalt ({sup 60}Co) leaching resulted from two succeeding mechanisms: as first order kinetic reaction, and then diffusion. The calculated values of leachability indices signify that the performance of each of the studied matrices is within an acceptable range. A simplified mathematical model, rooted in the first order reaction and diffusion mechanisms, was simulated to predict the radionuclides leaching rates from zeolite cement matrices. By comparing the synthesized zeolite cement with other cementitious materials, it can be concluded that the synthesized material can be classified as an efficient material suitable to immobilize {sup 85}Sr and {sup 60}Co from radioactive wastes. The acquired findings demonstrated that the studied immobilized waste matrices have acceptable mechanical effectiveness.

36 MATERIALS SCIENCE↗
DOE OSTI2019

On the variable effects of climate change on Pacific salmon

Pacific salmon are sensitive to changes in water temperature and streamflow. Climate change and water management may alter the streamflow and temperature regimes to which local species have adapted, hence affecting the survival and growth of juvenile salmon. This study estimates the changes in smolt survival rates of Chinook (Oncorhynchus tshawytscha) and Steelhead (Oncorhynchus mykiss) in Columbia River Basin (CRB) due to climatic changes and water management practices (reservoir regulation and water extraction). A multivariate nonlinear regression model is developed between juvenile survival rate and streamflow as well as stream temperature, and incorporates the inherent nonlinearity between survival rate and stream temperature. Using streamflow and stream temperature simulations from a state-of-the-art integrated earth system model, results indicate that climatic changes may reduce basin average juvenile Steelhead survival rates and smolt Chinook survival in Snake River by the 2080s. Water management, on the other hand, can alleviate the reduction in Chinook and Steelhead survival rates induced by climate change through mitigation of stream temperature warming. Integration of the nonlinear response of survival rate to stream temperature in addition to considering water management impacts on streamflow and temperature reduces the overestimate of the negative impacts from climate change. Furthermore, stream warming likely benefits juvenile survival in areas where the current stream temperature is lower than the optimal temperature zone. Our findings add new insights on climate and human impacts on juvenile salmon survival in CRB that are useful for conservation planning.

Zhang, Xiao↗
DOE OSTI2022

When physics-informed data analytics outperforms black-box machine learning: A case study in thickness control for additive manufacturing

Aerosol jet printing (AJP) has emerged as a promising noncontact additive manufacturing method for high-resolution printing for a wide range of material systems. A key challenge limiting the broader adoption of AJP in the material science community is the lack of methods to precisely control thickness. Herein, we develop a model-based design of experiment (MBDoE) framework that integrates physics-informed models, nonlinear regression, and information criteria to postulate, select and calibrate the best model to describe and optimize the AJP manufacturing process. Starting with already available data from system commissioning (e.g., prior single variable sensitivity analysis), four candidate physics-informed models are postulated and trained. MBDoE identifies a single additional optimal experiment to validate these predictive models with quantified uncertainties, which are then used to determine the best experimental conditions to control printed film thickness. As a comparative benchmark, the analysis is repeated using the same dataset with nonparametric Gaussian process regression (GPR) model that does not incorporate physical information. Using MBDoE principles, we find that only five experiments are necessary to calibrate the nonlinear physics-informed parametric model, and with said limited data, this model outperforms the black-box machine learning GPR model. This key result underscores an emerging trend in the data science community: incorporating physical information into predictive models often drastically reduces the data requirements. Leveraging MBDoE further increased the data efficiency. By design, the proposed data science framework is general in nature and can be easily extended to other experimental and additive manufacturing systems beyond AJP.

Aerosol jet printing↗
DOE OSTI2022

Accurate parameterization of the kinetic energy functional for calculations using exact-exchange

In this report, electronic structure calculations based on Kohn-Sham density functional theory (KSDFT) that incorporate exact exchange or hybrid functionals are associated with large computational expense, a consequence of the inherent cubic scaling bottleneck and large associated prefactor, which limits the length and time scales that can be accessed. Though orbital-free density functional theory (OFDFT) calculations scale linearly with system size and are associated with significantly smaller prefactor, they are limited by the absence of accurate density-dependent kinetic energy functionals. Therefore, the development of accurate density-dependent kinetic energy functionals is important for OFDFT calculations of large realistic systems. To this end, we propose a method to train kinetic energy functional models at the exact-exchange level of theory by using a dictionary of physically relevant terms that have been proposed in the literature in conjunction with linear or nonlinear regression methods to obtain the fitting coefficients. For our dictionary, we use gradient expansion of the kinetic energy, nonlocal models proposed in the literature and their nonlinear combinations, such as a model that incorporates spatial correlations between higher order derivatives of electron density at two points. The predictive capabilities of these models are assessed by using a variety of model one-dimensional systems that exhibit diverse bonding characteristics, such as a chain of eight hydrogens, LiF, LiH, C 4 H 2 , C 4 N 2 and C 3 O 2 . We show that by using data from model one-dimensional KSDFT calculations performed using the exact-exchange functional for only a few neutral structures, it is possible to generate models with high accuracy for charged systems as well as electron and kinetic energy densities during self-consistent field iterations. In addition, we show that it possible to learn both the orbital dependent terms, i.e., the kinetic energy and the exact-exchange energy, and models that incorporate additional nonlinearities in spatial correlations, such as a quadratic model, are needed to capture subtle features of the kinetic energy density that are present in exact-exchange-based KSDFT calculations.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2019

Quantifying Disconnection of Groundwater From Managed‐Ephemeral Surface Water During Drought and Conjunctive Agricultural Use

Abstract The physics of disconnection between interrelated surface and groundwater has evolved considerably in recent years, especially since conjunctive use of water resources is increasingly dependent on groundwater resilience, but methods to measure disconnection on a river basin scale are lacking especially for managed‐ephemeral and irrigated‐agricultural systems. Multiyear drought limited surface water along Rincon Valley within the Elephant Butte Irrigation District (EBID) in the arid, Lower Rio Grande Basin of south‐central New Mexico, USA, and effects were compounded by continued extraction of groundwater to meet crop requirements. Average year‐end water table elevations in recent years have been below the average elevation of the riverbed, indicating potential disconnection between the river and the aquifer even when the river flows during the irrigation season. This study analyzed data from EBID groundwater monitoring wells adjacent to the river, infiltration determined from river flows, and riverbed measurements along the Rincon Valley reach to determine net annual seepage discharge to the aquifer and annual average pressure head below the river. Annual assessment from 2010 to 2017 confirmed that the drought shifted the system from connection to transition and then to disconnection. Nonlinear regression was used to quantify this shift to disconnection and back, enabled determination of several disconnection process metrics, and was also used to confirm that nonlinear disconnection behavior was reversible without significant hysteresis. The method developed herein confirms that the total head difference transition threshold can be determined from river/riparian monitoring sites over reach to basin scales.

Fuchs, Erek H.↗
DOE OSTI2018

Rock-Forming Minerals Radiation-Induced Volumetric Expansion – Revisiting Literature Data

Neutron radiation-induced volumetric expansion (RIVE) of concrete aggregate is recognized as a major degradation mechanism causing extensive damage to concrete constituents (Hilsdorf et al. 1978; Seeberger and Hilsdorf 1982; Field et al. 2015). Nearly 400 RIVE data obtained in test-reactors on varied rock-forming minerals were collected by Denisov et al. (2012). These data were input into the Oak Ridge National Laboratory (ORNL) irradiated minerals, aggregates and concrete (IMAC) database and were reanalyzed in order to develop a general empirical model for minerals RIVE and interpret the susceptibility of silicates toward expansion. Furthermore, the empirical models best regression coefficient (r2 ≈ 0.95) is obtained by combining two different modeling techniques: (1) an interpolation-like model based on the relative distance to existing data points, and, (2) a nonlinear regression model assuming varied mathematical forms to describe RIVE as a function of the neutron fluence3 and the average irradiation temperature. The susceptibility to develop irradiation-induced expansion greatly varies with the nature of minerals. Silicates, i.e., [SiO4]4– bearing minerals show a wide range of maximum RIVEs, from a few percents to what appears as a bounding value of 17.8% for quartz. The maximum RIVE of varied silicates appears to be governed, macroscopically, by three parameters: (1) Primarily, the dimensionality of silicate polymerization (DOSP), (2) the relative number of Si–O bond per unit cell, and, (3) the relative bonding energy (RBE) of the unit cell.

58 GEOSCIENCES↗
DOE OSTI2021

Deep Learning for Rapid Analysis of Spectroscopic Ellipsometry Data

High‐throughput experimental approaches to rapidly develop new materials require high‐throughput data analysis methods to match. Spectroscopic ellipsometry is a powerful method of optical properties characterization, but for unknown materials and/or layer structures the data analysis using traditional methods of nonlinear regression is too slow for autonomous, closed‐loop, high‐throughput experimentation. Herein, three methods (termed spectral, piecewise, and pointwise) of spectroscopic ellipsometry data analysis based on deep learning are introduced and studied. After initial training, the incremental time for inferring optical properties can be a thousand times faster than traditional methods. Results for multilayer sample structures with optically isotropic materials are presented, appropriate for high‐throughput studies of thin films of phase‐change materials such as GeSbTe (GST) alloys. Results for studies on highly birefringent layered materials are also presented, exemplified by the transition metal dichalcogenide MoS 2 . How the materials under test and the experimental objectives may guide the choice of analysis methods are discussed. The utility of our approach is demonstrated by analyzing data measured on a composition spread of GeSbTe phase‐change alloys containing 177 distinct compositions, and identifying the composition with optimal phase‐change figure of merit in only 1.4 s of analysis time.

Li, Yifei↗
DOE OSTI2018

Energy modeling and efficiency analysis of aluminum die-casting processes

Energy modeling and efficiency analysis are considered the foundation of manufacturing process optimization to improve quality and efficiency and reduce energy consumption and carbon emissions during aluminum die-casting processes. Our report introduced an energy modeling method to connect gas and electric energy consumption with production rate of aluminum die-casting processes based on data collected at workshops with various combination of machines and products. The detailed modeling process involved the development of a data-acquiring system and the comparison of various kinds of nonlinear regression methods. The resulting models were confirmed with actual production data and were also used to improve production scheduling. Furthermore, it was found that if the modeling results are reasonably used and production is accordingly well-scheduled, 10 to 15% of energy savings could be realized without sacrificing profits.

42 ENGINEERING↗