Search NASA⌕ Search

SEARCH · Search NASA

Results for “LEAST SQUARES METHOD”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Potential energy surfaces for high-energy N + O 2 collisions

Potential energy surfaces for high-energy collisions between an oxygen molecule and a nitrogen atom are useful for modeling chemical dynamics in shock waves. In the present work, we present doublet, quartet, and sextet potential energy surfaces that are suitable for studying collisions of O 2 ( 3 Σ$^{–}_{g}$) with N( 4 S) in the electronically adiabatic approximation. Two sets of surfaces are developed, one using neural networks (NNs) with permutationally invariant polynomials (PIPs) and one with the least-squares many-body (MB) method, where a two-body part is an accurate diatomic potential and the three-body part is expressed with connected PIPs in mixed-exponential-Gaussian bond order variables (MEGs). We find, using the same dataset for both fits, that the fitting performance of the PIP-NN method is significantly better than that of the MB-PIP-MEG method, even though the MB-PIP-MEG fit uses a higher-order PIP than those used in previous MB-PIP-MEG fits of related systems (such as N 4 and N 2 O 2 ). However, the evaluation of the PIP-NN fit in trajectory calculations requires about 5 times more computer time than is required for the MB-PIP-MEG fit.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

An accurate, non-empirical method for incorporating decoherence into Ehrenfest dynamics

In mixed quantum-classical nonadiabatic molecular dynamics methods, the anchoring of the electronic wave function to a single nuclear geometry results in both quantitative and qualitative errors in the dynamics. In the context of both Ehrenfest and trajectory surface hopping methods, methods for incorporating decoherence are widely used to eliminate these errors. However, the accuracy of these methods often depends strongly on the parameterization of the decoherence time and/or other related quantities. Here, we present a refinement of the recently introduced collapse to a block (TAB) scheme for incorporating decoherence into Ehrenfest dynamics. The proposed approach incorporates an approximation to the history of the population dynamics and treats the coherence decay as Gaussian, rather than exponential. This method uses parameters that can be obtained from first principles, rather than empirical fitting. Application to one-dimensional models indicates excellent agreement with numerically exact simulations. We also introduce a second refinement to the TAB method: a robust linear least-squares algorithm for determining collapse probabilities.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Enhanced Tensor Completion Based Approaches for State Estimation in Distribution Systems

Grid state estimation is essential for effective control and management of distribution systems. While weighted least squares has been the conventional method for state estimation, sparsity-aware methods have become popular due to their superior performance with limited data. Matrix completion and compressed sensing-based state estimation approaches exploit the underlying smoothness in the state variables. However, classic matrix completion methods do not take into account the temporal correlation of system states. Compressed sensing methods, on the other hand, require an appropriate choice of sparsifying basis that may not be easy to identify. This paper proposes a blocktensor completion based framework which uses an alternative approach to estimate voltage phasor, power injections and branch currents. This approach utilizes the temporal correlation of the system states in a tensor trace-norm minimization formulation with power flow equations as constraints. Herein, feature scaling is introduced in the problem formulation to benefit from the improved sensitivity of the tensor trace norm to the matrix columns in the scaled unfoldings of the tensor. Weighted tensor norm is utilized to exploit the structures of the different unfoldings of the state measurement tensor to improve the voltage estimation. The estimation accuracy is further improved by alternatively estimating the tensor columns and increasing the available data at each stage in the tensor completion process. The proposed methods are evaluated on the IEEE-33, 37 test systems and a 100- node test system. The proposed methods are shown to provide significant performance gains relative to the classic matrix and tensor completion based approaches.

24 POWER TRANSMISSION AND DISTRIBUTION↗

An Evolve-Then-Correct Reduced Order Model for Hidden Fluid Dynamics

In this paper, we put forth an evolve-then-correct reduced order modeling approach that combines intrusive and nonintrusive models to take hidden physical processes into account. Specifically, we split the underlying dynamics into known and unknown components. In the known part, we first utilize an intrusive Galerkin method projected on a set of basis functions obtained by proper orthogonal decomposition. We then present two variants of correction formula based on the assumption that the observed data are a manifestation of all relevant processes. The first method uses a standard least-squares regression with a quadratic approximation and requires solving a rank-deficient linear system, while the second approach employs a recurrent neural network emulator to account for the correction term. We further enhance our approach by using an orthonormality conforming basis interpolation approach on a Grassmannian manifold to address off-design conditions. The proposed framework is illustrated here with the application of two-dimensional co-rotating vortex simulations under modeling uncertainty. The results demonstrate highly accurate predictions underlining the effectiveness of the evolve-then-correct approach toward real-time simulations, where the full process model is not known a priori.

long short-term memory↗

Searches for New Physics With Muon Conversion at Fermilab and Triboson Production at the LHC

We report on several efforts to search for physics beyond the standard model of particle physics at broad energy scales. The Mu2e experiment at Fermilab will search for charged lepton flavor violation via the muon to electron conversion process, which is suppressed in the Standard Model. Mu2e will be operated at a low energy, yet can probe New Physics at very high mass scales (O(1e3 - 1e4 ) TeV). At high energies, the CMS experiment at the CERN LHC continues to deliver an impressive suite of Standard Model measurements and limits on a variety of New Physics signatures. Mu2e is under construction and slated to collect its first physics data in the coming years. This thesis describes work done during the construction phase of Mu2e and focuses on two critical areas: magnetic field modeling and statistical analysis. We describe a novel method for field modeling which we validate using a simulated dataset representing the expected magnetic field in the Detector Solenoid. This method blends a standard least-squares fitting technique that utilizes physically motivated analytical model functions with a novel physics informed network that is constructed to obey Maxwell’s equations. We show the technique can model the field with an accuracy of 10−7 despite the presence of injected noise in the pseudo-measurements at the 10−5 level. We then present preliminary results of the calibration of 3D Hall probes at the sub-10−4 level. These probes will be used to directly measure the Mu2e Detector Solenoid magnetic field on a sparse grid; these measurements serve as the input to the field model fitting. Finally, we describe the first implementation of both an unbinned shape analysis and a Bayesian interpretation applied to Mu2e pseudo-data. Up to 20% tighter limits can be set by the shape analysis compared to a standard cut & count analysis. The AlCap experiment collected data at PSI in 2015 to measure several important quantities related to nuclear muon capture on an aluminum target, which is a significant background process for Mu2e. The neutron emission from muon capture can introduce background hits in the Mu2e detectors and can increase radiation damage in various elements of the apparatus. We present measurements of the neutron group fluence and mean neutron multiplicity for muon capture on aluminum nuclei. Finally, we discuss an analysis of triboson production at CMS using an Effective Field Theory framework. Standard Model triboson production, which was first observed at CMS in 2020, has a relatively small cross section and provides direct access to both anomalous triple gauge couplings and quartic gauge couplings. These couplings, interpreted in the Standard Model Effective Field Theory, are studied in the present work. We target the boosted regime where the background rate is low and yields are enhanced when dimension-6 and dimension-8 Wilson coefficients are non-zero. We do not observe an excess in the data and therefore set bounds on the Wilson coefficients. For dimension-6 coefficients the tightest observed (expected) bounds are set on cW /Λ2 where Λ is the mass scale of new physics; the bounds are [−0.13, 0.12] TeV−2 ([−0.12, 0.12] TeV−2 ) at 95% CL. The tightest bounds in dimension-8 are set on fT,0 / Λ4 ; the observed (expected) bounds at 95% CL are [−0.63, 0.69] TeV−4 ([−0.54, 0.62] TeV−4 ). Additional results are presented which include scenarios where multiple Wilson coefficients are non-zero, the application of signal model clipping to address unitarity violation in Effective Field Theories, and a novel template fit developed for easier reinterpretation of our results.

Kampa, Cole Erik [Northwestern U. (main)] (ORCID:0↗

QuadSync: Quadrifocal tensor synchronization via Tucker decomposition

In structure from motion, quadrifocal tensors capture more information than their pairwise counterparts (essential matrices), yet they have often been thought of as impractical and only of theoretical interest. In this work, we challenge such beliefs by providing a new framework to recover n cameras from the corresponding collection of quadrifocal tensors. We form the block quadrifocal tensor and show that it admits a Tucker decomposition whose factor matrices are the stacked camera matrices, and which thus has a multilinear rank of (4,4,4,4) independent of n. We develop the first synchronization algorithm for quadrifocal tensors, using Tucker decomposition, alternating direction method of multipliers, and iteratively reweighted least squares. We further establish relationships between the block quadrifocal, trifocal, and bifocal tensors, and introduce an algorithm that jointly synchronizes these three entities. Numerical experiments demonstrate the effectiveness of our methods on modern datasets, indicating the potential and importance of using higher-order information in synchronization.

Miao, Daniel [University of Minnesota]↗

Lift & Learn: Physics-informed machine learning for large-scale nonlinear dynamical systems

In this work, we present Lift & Learn, a physics-informed method for learning low-dimensional models for large-scale dynamical systems. The method exploits knowledge of a system’s governing equations to identify a coordinate transformation in which the system dynamics have quadratic structure. This transformation is called a lifting map because it often adds auxiliary variables to the system state. The lifting map is applied to data obtained by evaluating a model for the original nonlinear system. This lifted data is projected onto its leading principal components, and low-dimensional linear and quadratic matrix operators are fit to the lifted reduced data using a least-squares operator inference procedure. Analysis of our method shows that the Lift & Learn models are able to capture the system physics in the lifted coordinates at least as accurately as traditional intrusive model reduction approaches. This preservation of system physics makes the Lift & Learn models robust to changes in inputs. Numerical experiments on the FitzHugh–Nagumo neuron activation model and the compressible Euler equations demonstrate the generalizability of our model.

97 MATHEMATICS AND COMPUTING↗

Transient Catalytic Reaction Analysis Through Signal Defragmentation

The Temporal Analysis of Products (TAP) pulse response technique provides valuable insights into catalytic function and reaction kinetics. However, complex fragmentation patterns in the TAP mass spectrometry signals can complicate precise quantification, particularly when analyzing transient gas flux data typical of TAP experiments. This work demonstrates a standard defragmentation method that deconvolves transient TAP signals while maintaining the temporal resolution of the experiment. First, the integrals of calibration gas fluxes are used to determine the fingerprint fragmentation pattern and construct a fragmentation matrix. This matrix is then used to defragment experimental flux data at each recorded time point via a non-negative least squares regression. The effectiveness of this method is demonstrated using virtual data and control experiments with a TAP reactor system. The defragmentation is then applied to the more complex propane dehydrogenation reaction on a chromia/alumina catalyst, which can contain up to ten significant gas species in the reactor outlet. Initial propane pulsing reveals an induction period during which propane is fully oxidized to CO2, followed by partial reduction to CO. Afterwards, there is a transition in chemistries towards coking and propylene production. Our example illustrates a practical method for the accurate determination of the time-dependent reactant/product concentrations and rates for a thorough analysis of the propane dehydrogenation kinetics. This approach can be broadly applied to any transient mass spectrometry experiment for a better understanding of catalyst-reaction dynamics.

36 - MATERIALS SCIENCE↗

Detector alignment for X-ray crystallography using Millepede-II

I describe a method for accurately refining the geometrical parameters of segmented X-ray area detectors on the basis of serial crystallography data, using 'Millepede' – an algorithm created for a very similar problem in high-energy physics. The Millepede method for serial crystallography builds on the approach of Brewster et al. [Acta Cryst. (2018), D74, 877–894], in which the detector parameters are refined simultaneously with the parameters for each individual crystal. This accounts for the mutual dependency between the parameters and thereby avoids the bias and slow convergence problems that have afflicted older approaches in which the deviations between observed and calculated Bragg peak positions were taken directly as the updates for the detector panel positions. The Millepede method uses the special structure of the least-squares normal equations to reduce them to a much smaller form that can be solved very quickly, even compared with the sparse matrix methods used previously. This makes it practical to refine the detector geometry frequently and thereby maintain accurate calibration without specialized alignment campaigns. Tilts of detector panels out of the plane can be reliably refined, as can the overall distance of the detector in the beam direction. With a simulated test case, the new method produced panel shifts within 7% of the correct values with only one iteration, and produced almost exactly correct shifts after a second iteration. A simulated out-of-plane panel rotation was correctly determined to within 0.001°. Applied to experimental data from an X-ray free-electron laser, the method increased the indexable fraction of frames from 30% to 91% in a single iteration, and to 96% after two further iterations. Computing the geometry updates on the basis of 2060 crystals took only 0.819 s on desktop computing hardware, including the time taken to read the required data from disk. The scaling was found to be very close to linear for up to 100 980 sets of crystal parameters, which took only 78.2 s to process under the same conditions. The method has been applied as part of a real-time feedback system at a synchrotron radiation beamline, in which an out-of-plane detector tilt of 0.04° was detected and corrected. Possible further applications are also described here.

Millepede-II↗

Plateau Phenomenon in Gradient Descent Training of RELU Networks: Explanation, Quantification, and Avoidance

The ability of neural networks to provide ‘best in class’ approximation across a wide range of applications is well-documented. Nevertheless, the powerful expressivity of neural networks comes to naught if one is unable to effectively train (choose) the parameters defining the network. In general, neural networks are trained by gradient descent type optimization methods,a stochastic variant thereof. In practice, such methods result in the loss function decreases rapidly at the beginning of training but then, after a relatively small number of steps, significantly slow down. The loss may even appear to stagnate over the period of a large number of epochs, only to then suddenly start to decrease fast again for no apparent reason. This so-called plateau phenomenon manifests itself in many learning tasks. The present work aims to identify and quantify the root causes of plateau phenomenon.analysis is carried out in the setting of univariate ReLU networks. No assumptions are made on the number of neurons relative to the number of training data, and our results hold for both the lazy and adaptive regimes. Here, the main findings are: plateaux correspond to periods during which activation patterns remain constant, where activation pattern refers to the number of data points that activate a given neuron; quantification of convergence of the gradient flow dynamics; and, characterization stationary points in terms solutions of local least squares regression lines over subsets of the training data. Based on these conclusions, we propose a new iterative training method, the Active Neuron Least Squares (ANLS), characterised by the explicit adjustment of the activation pattern at each step, which is designed to enable a quick exit from a plateau. Illustrative numerical examples are included throughout.

97 MATHEMATICS AND COMPUTING↗

Numerical solution of singular Lyapunov equations

We consider the numerical solution of large scale singular (continuous-time) Lyapunov equations of the form AX + XA T + BB T = 0, where A is semistable, that is, its spectrum is contained in the left half plane, with the exception of a few semisimple eigenvalues at zero. We also consider the case of a few semisimple eigenvalues on the imaginary axis. We assume that we know these few eigenvalues (zero or imaginary), and that we have or can compute the corresponding invariant subspaces. We use this information to build an appropriate newly proposed subspace on which to project the Lyapunov equations, and then compute a low-rank approximation to the least squares solution. Selected illustrative numerical examples are provided.

97 MATHEMATICS AND COMPUTING↗

Derivative-free stochastic optimization via adaptive sampling strategies

In this paper, we present a novel derivative-free framework for solving unconstrained stochastic optimization problems. Many problems in fields ranging from simulation optimization to reinforcement learning to quantum computing involve settings where only stochastic function values are obtained via a zeroth-order oracle, which has no available gradient information and necessitates the usage of derivative-free optimization methodologies. Our approach includes estimating gradients using stochastic function evaluations and integrating adaptive sampling techniques to control the accuracy in these stochastic approximations. Our framework encapsulates several gradient estimation techniques, including standard finite-difference, Gaussian smoothing, sphere smoothing, randomized coordinate finite-difference, and randomized subspace finite-difference methods. We provide theoretical convergence guarantees for our framework and analyze the worst-case iteration and sample complexities associated with each gradient estimation method. Finally, we demonstrate the empirical performance of the methods on logistic regression and nonlinear least squares problems.

Adaptive sampling↗

Correction for Neutral Pressure-Driven Signal in Radiated Power Measurements on Proto-MPEX

A pinhole camera using four-channel resistive bolometers was designed and implemented on the Prototype Material Plasma Exposure eXperiment (Proto-MPEX) to measure the plasma radiated power. Quantification of the radiated power is required for comprehensive power balance assessments but faces unique challenges on linear plasma devices due to weak absolute signal, compared to typical use in toroidal fusion plasmas, and high neutral pressure changes. Around 1 mTorr, the pressure-driven signal contribution was shown to overwhelm the radiated power signal in Proto-MPEX, found to be ~3 μW . Since the pressure-driven signals could not be predicted from first principle arguments, the signals were corrected using empirical models that take two experimental pressure measurements and the raw bolometer signal to reveal the radiated power signals. Four “gas-only” Proto-MPEX shots were taken, without the radio frequency (rf) plasma discharge, to train, optimize, and validate empirical models. The data included two pressure measurements at different locations along with the bolometer signal. Multiple models were tested; partial least-squares regression with a cross correlation method to account for the time offset in the pressure measurements provided the best combination of accuracy and stability. The model was validated to have a modeling error of 0.0036 V, which was lower than 10% of the expected radiated power signal. The model was tested on a different “gas-only” shot with a complete time-series data. For plasma operation shots, the corrected bolometer measurements were compared with an absolute extreme ultraviolet photodiode measurement and similarities and differences are discussed.

Lee, Seungsup↗

Samoa Updater: An Application of the Levenberg-Marquardt Method to Update DELFIC Predictions Using Field Measurements

The US Department of Energy (DOE) Forensics Operations (DFO) is a member of the Ground Collections Task Force (GCTF), which is responsible for sample collection of radiological debris for attribution should a nuclear detonation ever occur in the United States. The DFO runs the Defense Land Fallout Interpretive Code (DELFIC) Fallout Planning Tool to predict the deposition of fallout from a nuclear detonation. This prediction is refined using the DELFIC Updater tool, which takes ground measurements and adjusts DELFIC inputs to minimize the difference between prediction and observation, yielding improved predictions of fallout in locations both measured and not yet measured. Samoa, a framework for uncertainty analysis and optimization, is used to improve DELFIC predictive fallout modeling. This new capability using Samoa, dubbed “Samoa Updater,” is compared with the current DELFIC Updater, a brute-force sampling approach. Samoa Updater uses the Levenberg– Marquardt (LM) method, a gradient-based nonlinear least squares approach that uses the functional shape of the input space to increase optimization speed. In simulated test cases Samoa Updater yields faster and more accurate solutions than the current Updater.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

An improved Method for Determining Transient Fuel Dilution of Oil in an Internal-Combustion Engine Using Laser-Induced Florescence and Multivariate Least Square Calibration

An optical diagnostic, based on laser-induced fluorescence (LIF), has been developed for on-engine measurements of real-time fuel dilution of engine oil or fuel in oil (FIO). Fuel dilution of oil is broadly relevant to advancing engine technology including durability, calibration, and catalyst-system management, and believed to promote destructive stochastic pre-ignition (SPI) during high-load engine operations. While standard (e.g., ASTM D3524-90) methods are not capable of real-time transient measurements, the LIF technique resolves transient dilution on the minutes time scale. We have expanded on our original FIO instrument development by introducing an improved analysis based on multivariate least square chemometrics analysis. The measurement uses a fuel dye (180–1300 parts per million, by mass) and monitors for its presence in the oil using 532 nm excitation and LIF. While the original FIO instrument utilized a two-color ratio method for analysis, the improved chemometric analysis uses the fully resolved LIF dye spectra to provide better predictive FIO accuracy (>92%) over a wide FIO range (1.5–14%) typical of engine application. We also investigate the effect of oil temperature on the LIF signal. Limited engine applications for demonstrating and validating the improved FIO instrument are shown, and the related data used to quantify practical detection limit and sensitivity. The improved analysis is insensitive to laser power fluctuation and change in detector integration time, providing an excellent FIO sensitivity (1–2%) and detection limit (0.01 %FIO) over a wide range of loads and injection timings, illustrating this updated approach to be a promising tool for advancing engine technology.

42 ENGINEERING↗

New Absolute Cavity Pyrgeometer equation by application of Kirchhoff's law and adding a convection term

An equation for the Absolute Cavity Pyrgeometer (ACP) is derived from application of Kirchhoff's law and the addition of a convection term to account for the thermopile being open to the environment, unlike a domed radiometer. The equation is then used to investigate four methods to characterise key instrumental parameters using laboratory and field measurements. The first uses solar irradiance to estimate the thermopile responsivity, the second uses a minimisation method that solves for the thermopile responsivity and transmission of the cavity, and the third and fourth revisit the Reda et al. (2012) linear least squares calibration technique. Data were collected between January and November 2020, when the ACP96 and two IRIS radiometers monitoring terrestrial irradiances were available. The results indicate good agreement with IRIS irradiances using the new equation. The analysis also indicates that while the thermopile responsivity, concentrator transmission and emissivity of an ACP can be determined independently, as an open instrument, the impact of the convection term is minor in steady-state conditions but significant when the base of the instrument is being subjected to rapid artificial cooling or heating. Using laboratory characterisation of the transmission and emissivity, together with use of an estimated solar calibration of the thermopile, generated mean differences of less than 1.5 Wm -2 to the two IRIS radiometers. A minimisation method using each IRIS radiometer as the reference also provided similar results, and the derived thermopile responsivity was within 0.3 µV W -1 m 2 of the solar-calibration-derived infrared responsivity estimate of 10.5 µV W -1 m 2 estimated using a nominal solar calibration and provide irradiances within ±2 % of the terrestrial irradiance measured by the reference pyrgeometers traceable to the International System of Units (SI). The calibration method using linear least squares regression introduced by Reda et al. (2012) that relies on rapid cooling of the ACP base but utilising the new equation was found to produce consistent results but was dependent on the assumed temperature of the air above the thermopile. This study demonstrates the potential of the ACP as another independent reference radiometer for terrestrial irradiance once the magnitude of the convection coefficient and any potential variations in it have been resolved.

47 OTHER INSTRUMENTATION↗

Stand validation of lidar forest inventory modeling for a managed southern pine forest

We evaluated area-based approaches (ABAs) to light detection and ranging (lidar) predictions of plot- and stand-level forest attributes (tree count, height, basal area, volume, aboveground biomass, broadleaf/conifer, and diameter at breast height — “diameter”). ABA methods included post-stratification (PS), ordinary least squares (OLSs) regression, k nearest neighbors ( kNN), and random forest (RF). This study was conducted on the Savannah River Site in South Carolina, USA. Plot- and stand-level predictions were validated against fixed-radius 0.04 ha (0.1 acre) plots in 49 ≈2.0 ha (5 acre) stands. Our findings demonstrate that lidar can be incorporated operationally into forest inventory systems to provide stand-level inferences for a wide range of forest attributes. Volume predictions for specific diameter classes, however, often fared poorly (root mean squared error (RMSE) > 100%) for the methods we explored, especially for larger (less common) diameter trees. Stand-level results were consistently better than pixel-level results (10–200+ percentage points). kNN and RF performed similarly and better than OLS and PS, but RF was the most robust to model configurations, while kNN has practical advantages such as simultaneous predictions of many attributes.

Forestry↗

Operator inference for non-intrusive model reduction of systems with non-polynomial nonlinear terms

Here in this work we present a non-intrusive model reduction method to learn low-dimensional models of dynamical systems with non-polynomial nonlinear terms that are spatially local and that are given in analytic form. In contrast to state-of-the-art model reduction methods that are intrusive and thus require full knowledge of the governing equations and the operators of a full model of the discretized dynamical system, the proposed approach requires only the non-polynomial terms in analytic form and learns the rest of the dynamics from snapshots computed with a potentially black-box full-model solver. The proposed method learns operators for the linear and polynomially nonlinear dynamics via a least-squares problem, where the given non-polynomial terms are incorporated on the right-hand side. The least-squares problem is linear and thus can be solved efficiently in practice. The proposed method is demonstrated on three problems governed by partial differential equations, namely the diffusion–reaction Chafee–Infante model, a tubular reactor model for reactive flows, and a batch-chromatography model that describes a chemical separation process. The numerical results provide evidence that the proposed approach learns reduced models that achieve comparable accuracy as models constructed with state-of-the-art intrusive model reduction methods that require full knowledge of the governing equations.

42 ENGINEERING↗