Search NASA⌕ Search

SEARCH · Search NASA

Results for “piecewise linear model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Hyperplane decision trees as piecewise linear surrogate models for chemical process design

Recent trends in chemical engineering research point towards an increasing reliance on data-driven modeling approaches. Neural networks, for instance, have proven to be accurate when data is plentiful and high-dimensional, but in many cases, they require computationally-intensive training procedures. Here, in this work, we describe hyperplane decision trees (HT) as a highly expressive and low-compute machine learning model architecture. These models are locally linear and have linear decision boundaries, resulting in a piecewise linear model of the data. This property allows them to be converted into mixed-integer linear constraints which can be globally optimized. Our open-source PyTorch implementation of this method is a fast, flexible, and accessible way to build accurate piecewise linear models of data.

Decision trees↗
DOE OSTI2022

Self‐gated, dynamic contrast‐enhanced magnetic resonance imaging with compressed‐sensing reconstruction for evaluating endothelial permeability in the aortic root of atherosclerotic mice

High‐risk atherosclerotic plaques are characterized by active inflammation and abundant leaky microvessels. We present a self‐gated, dynamic contrast‐enhanced magnetic resonance imaging (DCE‐MRI) acquisition with compressed sensing reconstruction and apply it to assess longitudinal changes in endothelial permeability in the aortic root of Apoe −/− atherosclerotic mice during natural disease progression. Twenty‐four, 8‐week‐old, female Apoe −/− mice were divided into four groups (n = 6 each) and imaged with self‐gated DCE‐MRI at 4, 8, 12, and 16 weeks after high‐fat diet initiation, and then euthanized for CD68 immunohistochemistry for macrophages. Eight additional mice were kept on a high‐fat diet and imaged longitudinally at the same time points. Aortic‐root pseudo‐concentration curves were analyzed using a validated piecewise linear model. Contrast agent wash‐in and washout slopes ( b 1 and b 2 ) were measured as surrogates of aortic root endothelial permeability and compared with macrophage density by immunohistochemistry. b 2 , indicating contrast agent washout, was significantly higher in mice kept on an high‐fat diet for longer periods of time ( p = 0.03). Group comparison revealed significant differences between mice on a high‐fat diet for 4 versus 16 weeks ( p = 0.03). Macrophage density also significantly increased with diet duration ( p = 0.009). Spearman correlation between b 2 from DCE‐MRI and macrophage density indicated a weak relationship between the two parameters (r = 0.28, p = 0.20). Validated piecewise linear modeling of the DCE‐MRI data showed that the aortic root contrast agent washout rate is significantly different during disease progression. Further development of this technique from a single‐slice to a 3D acquisition may enable better investigation of the relationship between in vivo imaging of endothelial permeability and atherosclerotic plaques' genetic, molecular, and cellular makeup in this important model of disease.

Calcagno, Claudia↗
DOE OSTI2020

A Model Tree Generator (MTG) Framework for Simulating Hydrologic Systems: Application to Reservoir Routing

Data-driven algorithms have been widely used as effective tools to mimic hydrologic systems. Unlike black-box models, decision tree algorithms offer transparent representations of systems and reveal useful information about the underlying process. A popular class of decision tree models is model tree (MT), which is designed for predicting continuous variables. Most MT algorithms employ an exhaustive search mechanism and a pre-defined splitting criterion to generate a piecewise linear model. However, this approach is computationally intensive, and the selection of the splitting criterion can significantly affect the performance of the generated model. These drawbacks can limit the application of MTs to large datasets. To overcome these shortcomings, a new flexible Model Tree Generator (MTG) framework is introduced here. MTG is equipped with several modules to provide a flexible, efficient, and effective tool for generating MTs. The application of the algorithm is demonstrated through simulation of controlled discharge from several reservoirs across the Contiguous United States (CONUS).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Virtual refrigerant charge sensor for variable-speed heat pumps based on feature selection

The refrigerant charge level in heat pump systems significantly impacts their energy efficiency. Virtual refrigerant charge (VRC) sensing technology has been comprehensively investigated and well-established due to its lower cost compared to physical sensors. However, the previous VRC research often relied on expert judgment and physical reasoning for their variable selection, which can potentially select redundant (or highly correlated) or insignificant features, and it is also primarily focused on single-speed systems. To address these challenges, this study proposes a VRC algorithm for variable-speed heat pumps that selects features through a rigorous feature selection method in combination with physical insights. We also propose a piecewise linear model structure segmented by subcooling temperature to accurately predict charge levels, particularly when subcooling temperatures are substantially low. The proposed algorithm was evaluated using experimental data of a residential R410A heat pump, and the performance was compared with two baseline VRC algorithms. The results are: (1) The proposed algorithm outperforms for the case with subcooling temperature less than 1 °C. (2) The proposed algorithm achieves a tested mean absolute percentage error (MAPE) of 4.23%, and improves the overall accuracy for cooling conditions by approximately 60%, compared with the two baseline algorithms. (3) The proposed algorithm uses two fewer features and improves the accuracy for undercharge cooling conditions by 68.0%, compared with baseline algorithm 2. These improvements enhance prediction accuracy and prevent overfitting, providing a more reliable refrigerant charge level prediction and helping improve the heat pump energy efficiency.

Liang, Chenjiyu↗
DOE OSTI2022

Determining the bubble nucleation efficiency of low-energy nuclear recoils in superheated C 3 F 8 dark matter detectors

The bubble nucleation efficiency of low-energy nuclear recoils in superheated liquids plays a crucial role in interpreting results from direct searches for weakly interacting massive particle (WIMP) dark matter. Here, the PICO collaboration presents the results of the efficiencies for bubble nucleation from carbon and fluorine recoils in superheated C 3 F 8 from calibration data taken with five distinct neutron spectra at various thermodynamic thresholds ranging from 2.1 to 3.9 keV. Instead of assuming any particular functional forms for the nuclear recoil efficiency, a generalized piecewise linear model is proposed with systematic errors included as nuisance parameters to minimize model-introduced uncertainties. A Markov chain Monte Carlo routine is applied to sample the nuclear recoil efficiency for fluorine and carbon at 2.45 and 3.29 keV thermodynamic thresholds simultaneously. The nucleation efficiency for fluorine was found to be ≥ 50% for nuclear recoils of 3.3 keV (3.7 keV) at a thermodynamic Seitz threshold of 2.45 keV (3.29 keV), and for carbon the efficiency was found to be ≥ 50% for recoils of 10.6 keV (11.1 keV) at a threshold of 2.45 keV (3.29 keV). Simulated datasets are used to calculate a p value for the fit, confirming that the model used is compatible with the data. The fit paradigm is also assessed for potential systematic biases, which although small, are corrected for. Additional steps are performed to calculate the expected interaction rates of WIMPs in the PICO-60 detector, a requirement for calculating WIMP exclusion limits.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Determining the bubble nucleation efficiency of low-energy nuclear recoils in superheated C$_3$F$_8$ dark matter detectors

The bubble nucleation efficiency of low-energy nuclear recoils in superheated liquids plays a crucial role in interpreting results from direct searches for weakly interacting massive particle (WIMP) dark matter. The PICO Collaboration presents the results of the efficiencies for bubble nucleation from carbon and fluorine recoils in superheated C$_3$F$_8$ from calibration data taken with 5 distinct neutron spectra at various thermodynamic thresholds ranging from 2.1 keV to 3.9 keV. Instead of assuming any particular functional forms for the nuclear recoil efficiency, a generalized piecewise linear model is proposed with systematic errors included as nuisance parameters to minimize model-introduced uncertainties. A Markov-Chain Monte-Carlo (MCMC) routine is applied to sample the nuclear recoil efficiency for fluorine and carbon at 2.45 keV and 3.29 keV thermodynamic thresholds simultaneously. The nucleation efficiency for fluorine was found to be $\geq 50\, \%$ for nuclear recoils of 3.3 keV (3.7 keV) at a thermodynamic Seitz threshold of 2.45 keV (3.29 keV), and for carbon the efficiency was found to be $\geq 50\, \%$ for recoils of 10.6 keV (11.1 keV) at a threshold of 2.45 keV (3.29 keV). Simulated data sets are used to calculate a p-value for the fit, confirming that the model used is compatible with the data. The fit paradigm is also assessed for potential systematic biases, which although small, are corrected for. Additional steps are performed to calculate the expected interaction rates of WIMPs in the PICO-60 detector, a requirement for calculating WIMP exclusion limits.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

Deep Learning for Multigroup Cross-Section Representation in Two-Step Core Calculations

Here we investigate using deep learning, a type of machine-learning algorithm employing multiple layers of artificial neurons, for the mathematical representation of multigroup cross sections for use in the Griffin reactor multiphysics code for two-step deterministic neutronics calculations. A three-dimensional fuel element typical of a high-temperature gas reactor as well as a two-dimensional sodium-cooled fast reactor lattice are modeled using the Serpent Monte Carlo code, and multigroup macroscopic cross sections are generated for various state parameters to produce a training data set and a separate validation data set. A fully connected, feedforward neural network is trained using the open-source PyTorch machine-learning framework, and its accuracy is compared against the standard piecewise linear interpolation model. Additionally, we provide in this work a generic technique for propagating the cross-section model errors up to the k eff using sensitivity coefficients with the first-order uncertainty propagation rule. Quantifying the eigenvalue error due to the cross-section regression errors is especially practical for appropriately selecting the mathematical representation of the cross sections. We demonstrate that the artificial neural network model produces lower errors and therefore enables better accuracy relative to the piecewise linear model when the cross sections exhibit nonlinear dependencies; especially when a coarse grid is employed, where the errors can be halved by the artificial neural network. However, for linearly dependent multigroup cross sections as found for the sodium-cooled fast reactor case, a simpler linear regression outperforms deeper networks.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Convex Optimization of Integrated Power-Gas Energy Flow Model With Applications to Probabilistic Energy Flow

Energy flow calculation is a fundamental problem of the integrated power and gas system (IPGS) operation and planning. However, the nonlinear gas flow model introduces major challenges to the energy flow calculation. In this paper, we propose a tractably convex optimization model to solve the energy flow problem in IPGSs. It is demonstrated that the proposed optimization model has the same optimal solution as the original nonlinear steady energy flow model. Also, piecewise linearization is adopted to tightly linearize the nonlinear objective function of the model, which transforms the formulated convex optimization into a linear program one. Thus, the computation complexity of the proposed energy flow model is significantly reduced as compared with the existing methods. In addition, the proposed model can be extended to probabilistic energy flow estimation. Extensive case studies are conducted to validate the effectiveness of the proposed energy flow model using three IPGSs.

42 ENGINEERING↗
DOE OSTI2023

Linear model decision trees as surrogates in optimization of engineering applications

Machine learning models are promising as surrogates in optimization when replacing difficult to solve equations or black-box type models. This work demonstrates the viability of linear model decision trees as piecewise-linear surrogates in decision-making problems. Linear model decision trees can be represented exactly in mixed-integer linear programming (MILP) and mixed-integer quadratic constrained programming (MIQCP) formulations. Furthermore, they can represent discontinuous functions, bringing advantages over neural networks in some cases. We present several formulations using transformations from Generalized Disjunctive Programming (GDP) formulations and modifications of MILP formulations for gradient boosted decision trees (GBDT). We then compare the computational performance of these different MILP and MIQCP representations in an optimization problem and illustrate their use on engineering applications. Importantly, we observe faster solution times for optimization problems with linear model decision tree surrogates when compared with GBDT surrogates using the Optimization and Machine Learning Toolkit (OMLT).

42 ENGINEERING↗
DOE OSTI2022

Modeling the AC Power Flow Equations with Optimally Compact Neural Networks: Application to Unit Commitment

Nonlinear power flow constraints render a variety of power system optimization problems computationally intractable. Emerging research shows, however, that the nonlinear AC power flow equations can be successfully modeled using neural networks. These neural networks can be exactly transformed into mixed integer linear programs and embedded inside challenging optimization problems, thus replacing nonlinearities that are intractable for many applications with tractable piecewise linear approximations. Such approaches, though, suffer from an explosion of the number of binary variables needed to represent the neural network. Accordingly, this paper develops a technique for training an "optimally compact'' neural network, i.e., one that can represent the power flow equations with a sufficiently high degree of accuracy while still maintaining a tractable number of binary variables. We demonstrate the use of this neural network as an approximator of the nonlinear power flow equations by embedding it in the AC unit commitment problem, transforming the problem from a mixed integer nonlinear program into a more manageable mixed integer linear program. We use the 14-, 57-, and 89-bus networks as test cases and compare the AC-feasibility of commitment decisions resulting from the neural network, DC, and linearized power flow approximations. Our results show that the neural network model outperforms both the DC and linearized power flow approximations when embedded in the unit commitment problem. The neural network formulation most often selects a feasible unit commitment schedule, and furthermore, it only s

AC power flow↗
DOE OSTI2020

A Sensorless Coil Detection Scheme based on Dead-Time Effect in Dynamic Wireless Power Transfer Systems

The detection of electric vehicles in dynamic wireless power transfer (DWPT) systems is important to reduce the standby losses and comply with the electromagnetic-field emission guidelines recommended by the International Commission for Non-Ionizing Radiation Protection. This paper discusses a novel sensorless coil detection scheme, which exploits the phenomenon of voltage-polarity reversal/notches caused by the dead-time effect in the full-bridge inverter. The variations in the system impedance and dead-time effects are collectively exploited to detect the receiver coil in the DWPT system. The proposed coil detection scheme is accomplished at low excitation voltage, which reduces the inverter standby losses. The theoretical analysis of the notch occurrence and open-loop simulation results are presented using a DWPT model developed in the piecewise linear electrical circuit simulation software.

Kavimandan, Utkarsh↗
DOE OSTI2025

Simplifying activations with linear approximations in neural networks

A key step in Neural Networks is activation. Among the different types of activation functions, sigmoid, tanh, and others involve the usage of exponents for calculation. From a hardware perspective, exponential implementation implies the usage of Taylor series or repeated methods involving many addition, multiplication, and division steps, and as a result are power-hungry and consume many clock cycles. We implement a piecewise linear approximation of the sigmoid function as a replacement for standard sigmoid activation libraries. This approach provides a practical alternative by leveraging piecewise segmentation, which simplifies hardware implementation and improves computational efficiency. In this paper, we detail piecewise functions that can be implemented using linear approximations and their implications for overall model accuracy and performance gain. Our results show that for the DenseNet, ResNet, and GoogLeNet architectures, the piecewise linear approximation of the sigmoid function provides faster execution times compared to the standard TensorFlow sigmoid implementation while maintaining comparable accuracy. Specifically, for MNIST with DenseNet, accuracy reaches 99.91% (Piecewise) vs. 99.97% (Base) with up to 1.31x speedup in execution time. For CIFAR-10 with DenseNet, accuracy improves to 98.97% (Piecewise) vs. 99.40% (Base) while achieving 1.24x faster execution. Similarly, for CIFAR-100 with DenseNet, the accuracy is 97.93% (Piecewise) vs. 98.39% (Base), with a 1.18x execution time reduction. These results confirm the proposed method’s capability to efficiently process large-scale datasets and computationally demanding tasks, offering a practical means to accelerate deep learning models, including LSTMs, without compromising accuracy.

Activation function↗
DOE OSTI2022

Multi-Segment Decentralized Control Strategies for Renewables-Rich Microgrids in Extreme Conditions

Microgrids provide a promising approach to accommodating various distributed energy resources (DERs), while requiring significant communication infrastructures that may be affected by extreme conditions such as natural disasters and cyber-attacks. In this paper, a fully decentralized control strategy without the need for communication is proposed for islanded microgrids with high renewables penetration. First, special multi-segment power/frequency characteristic curves are designed, so that different DERs can be automatically coordinated in a prioritized manner such as renewables first to maintain power balance while DER frequencies are regulated at their reference values. Second, piecewise linear served load versus frequency models are designed to prioritize loads according to their significance, so that only noncritical loads will be curtailed as needed while critical loads are supplied without any interruptions during power deficiency. The proposed strategy can effectively deal with various normal and extreme system conditions including 100% renewables penetration, loads and renewables variations, power deficiencies requiring load curtailments, disconnection of existing DERs, connection of new DERs as well as network sectionalization and reconfiguration. As a result, the proposed control strategy is validated in the real-time digital simulator (RTDS) model of the IIT Campus Microgrid to demonstrate its effectiveness in enhancing the resiliency of renewables-rich microgrids in extreme conditions.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

The impacts of convex piecewise linear cost formulations on AC optimal power flow

Despite strong connections through shared application areas, research efforts on power market optimization (e.g., unit commitment) and power network optimization (e.g., optimal power flow) remain largely independent. A notable illustration of this is the treatment of power generation cost functions, where nonlinear network optimization has largely used polynomial representations and market optimization has adopted piecewise linear encodings. This work combines state-of-the-art results from both lines of research to understand the best mathematical formulations of the nonlinear AC optimal power flow problem with piecewise linear generation cost functions. An extensive numerical analysis of non-convex models, linear approximations, and convex relaxations across fifty-four realistic test cases illustrates that nonlinear optimization methods are surprisingly sensitive to the mathematical formulation of piecewise linear functions. The results indicate that a poor formulation choice can slow down algorithm performance by a factor of ten, increasing the runtime from seconds to minutes. Furthermore, these results provide valuable insights into the best formulations of nonlinear optimal power flow problems with piecewise linear cost functions, an important step towards building a new generation of energy markets that incorporate the nonlinear AC power flow model.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2022

Systems and methods for direct estimation of battery parameters using only charge/discharge curves

Electrochemical models for the lithium-ion battery are useful in predicting and controlling its performance. The values of the parameters in these models are vital to their accuracy. However, not all parameters can be measured precisely, especially when destructive methods are prohibited. In some embodiments of the present disclosure, a parameter estimation approach is used to estimate the open circuit potential of the positive electrode (Up) using piecewise linear approximation together with all the other parameters of a single particle model. Up and 10 more parameters may be estimated from a single discharge curve without knowledge of the electrode chemistry using a technique such as a genetic algorithm. Different case studies were presented for estimating Up with different types of parameters of the battery model. The estimated parameters were then validated by comparing simulations at different discharge rates with experimental data.

Qi, Yanbo↗
DOE OSTI2020

Distributionally robust facility location problem under decision-dependent stochastic demand

While the traditional facility location problem considers exogenous demand, in some applications, locations of facilities could affect the willingness of customers to use certain types of services, e.g., carsharing, and therefore they also affect realizations of random demand. Moreover, a decision maker may not know the exact distribution of such endogenous demand and how it is affected by location choices. In this paper, we consider a distributionally robust facility location problem, in which we interpret the moments of stochastic demand as functions of facility-location decisions. We reformulate a two-stage decision-dependent distributionally robust optimization model as a monolithic formulation, and then derive exact mixed-integer linear programming reformulation as well as valid inequalities when the means and variances of demand are piecewise linear functions of location solutions. We conduct extensive computational studies, in which we compare our model with a decision-dependent deterministic model, as well as stochastic programming and distributionally robust models without the decision-dependent assumption. Here, the results show superior performance of our approach with remarkable improvement in profit and quality of service under various settings, in addition to computational speed-ups given by formulation enhancements. These results draw attention to the need of considering the impact of location decisions on customer demand within this strategic-level planning problem.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Dynamic characterization and performance evaluation of a 10-kW power take-off with mechanical motion rectifier for wave energy conversion

The power take-off (PTO) is a key component for wave energy converters. In this paper, a compact PTO with mechanical motion rectification rated at 10 kW is designed and prototyped, and characterized. A piecewise nonlinear dynamic model is established to describe its unique dynamic property. A linear hydraulic actuator is adopted in lab testing to drive the prototype and the unknown parameters of the dynamic model are identified. Further verification shows that the model can predict the dynamic performance of the PTO well. The test results show that the mechanical motion rectifier-based PTO can achieve overall energy transfer efficiency as high as 65% in regular waves even when the generator is working below the rated electric load and speed. In the irregular wave test, the PTO achieved the overall energy transfer efficiency of 54%, and the peak-to-average ratio acquired during the test is 12.5.

16 TIDAL AND WAVE POWER↗