Search NASA⌕ Search

SEARCH · Search NASA

Results for “Nonlinear optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,207 records · Page 67

CO 2 storage site characterization using ensemble-based approaches with deep generative models

Estimating spatially distributed properties such as permeability from available sparse measurements is a great challenge in efficient subsurface CO 2 storage operations. In this paper, a deep generative model that can accurately capture complex subsurface structure is tested with an ensemble-based inversion method for accurate and accelerated characterization of CO 2 storage sites. We chose Wasserstein Generative Adversarial Network with Gradient Penalty (WGAN-GP) for its realistic reservoir property representation and Ensemble Smoother with Multiple Data Assimilation (ES-MDA) for its robust data fitting and uncertainty quantification capability. WGAN-GP are trained to generate high-dimensional permeability fields from a low-dimensional latent space and ES-MDA then updates the latent variables by assimilating available measurements. Several subsurface site characterization examples including Gaussian, channelized, and fractured reservoirs are used to evaluate the accuracy and computational efficiency of the proposed method and the main features of the unknown permeability fields are characterized accurately with reliable uncertainty quantification. Furthermore, the estimation performance is compared with a widely-used variational, i.e., optimization-based, inversion approach, and the proposed approach outperforms the variational inversion method in several benchmark cases. We explain such superior performance by visualizing the objective function in the latent space: because of nonlinear and aggressive dimension reduction via generative modeling, the objective function surface becomes extremely complex while the ensemble approximation can smooth out the multi-modal surface during the minimization. This suggests that the ensemble-based approach works well over the variational approach when combined with deep generative models at the cost of forward model runs unless convergence-ensuring modifications are implemented in the variational inversion.

42 ENGINEERING↗

Data-driven optimization of mixed-integer bi-level multi-follower integrated planning and scheduling problems under demand uncertainty

The coordination of interconnected elements across the different layers of the supply chain is essential for all industrial processes and the key to optimal decision-making. Yet, the modeling and optimization of such interdependent systems are still burdensome. Here we address the simultaneous modeling and optimization of medium-term planning and short-term scheduling problems under demand uncertainty using mixed-integer bi-level multi-follower programming and data-driven optimization. Bi-level multi-follower programs model the natural hierarchy between different layers of supply chain management holistically, while scenario analysis and data-driven optimization allow us to retrieve the guaranteed feasible solutions of the integrated formulation under various demand considerations. We address the data-driven optimization of this challenging class of problems using the DOMINO framework, which was initially developed to solve single-leader single-follower bi-level optimization problems to guaranteed feasibility. This framework is extended to solve single-leader multi-follower stochastic formulations and its performance is characterized by well-known single and multi-product process scheduling case studies. Through our data-driven algorithmic approach, we present guaranteed feasible solutions to linear and nonlinear mixed-integer bi-level formulations of simultaneous planning and scheduling problems and further characterize the effects of the scheduling level complexity on the solution performance, which spans over several hundred continuous and binary variables, and thousands of constraints.

42 ENGINEERING↗

Beyond 100 Gb/s: Capacity, Flexibility, and Network Optimization

Here, we discuss building blocks that enable the exploitation of optical capacities beyond 100 Gb/s. Optical networks will benefit from more flexibility and agility in their network elements, especially from coherent transceivers. To achieve capacities of 400 Gb/s and more, coherent transceivers will operate at higher symbol rates. This will be made possible with higher bandwidth components using new electro-optic technologies implemented with indium phosphide and silicon photonics. Digital signal processing will benefit from new algorithms. Multi-dimensional modulation, of which some formats are already in existence in current flexible coherent transceivers, will provide improved tolerance to noise and fiber nonlinearities. Constellation shaping will further improve these tolerances while allowing a finer granularity in the selection of capacity. Frequency-division multiplexing will also provide improved tolerance to the nonlinear characteristics of fibers. Algorithms with reduced computation complexity will allow the implementation, at speeds, of direct pre-compensation of nonlinear propagation effects. Advancement in forward error correction will shrink the performance gap with Shannon's limit. At the network control and management level, new tools are being developed to achieve a more efficient utilization of networks. This will also allow for network virtualization, orchestration, and management. Lastly, FlexEthernet and FlexOTN will be put in place to allow network operators to optimize capacity in their optical transport networks without manual changes to the client hardware.

47 OTHER INSTRUMENTATION↗

Efficiency-optimized relativistic plasma harmonics for extreme fields

Bright harmonic radiation from relativistically oscillating laser plasmas offers a direct route for generating extreme electromagnetic fields. Theory predicts that under optimized conditions, the plasma medium can support strong spatiotemporal compression of laser energy in a coherent harmonic focus (CHF), delivering intensity boosts many orders of magnitude greater than the incident driving laser pulse. Although diffraction-limited performance (spatial compression) and attosecond phase locking (temporal compression) have been demonstrated experimentally, efficient coupling of relativistically intense laser pulse energy into the emitted harmonic cone has not been realized so far. Here we demonstrate that this highly nonlinear interaction can be tailored to deliver the maximum conversion efficiencies predicted from simulations. By fine-tuning the temporal profile of the driving laser on sub-picosecond (<10 −12 s) timescales, energies >9 mJ between the 12th and 47th harmonics are observed. These results are in agreement with the theoretically expected efficiency dependence on harmonic order, verifying that optimal conditions have been achieved in the generation process. This is the important final element required to achieve the expected intensity boosts from a CHF in experiments. Although obtaining spatiotemporal compression and optimal efficiency simultaneously remains challenging, the path to realizing extreme optical field strengths approaching the critical field of quantum electrodynamics (the Schwinger limit at >10 16 V cm −1 or >10 29 W cm −2 ) is now open, permitting all-optical studies of the quantum vacuum and new frontiers for intense attosecond science.

High-harmonic generation↗

Spectral dependence of purely-Kerr-driven filamentation in air and argon

Based on numerical simulations, we show that higher-order nonlinear indices (up to n{sub 8} and n{sub 10}, respectively) of air and argon have a dominant contribution to both focusing and defocusing in the self-guiding of ultrashort laser pulses over most of the spectrum. Plasma generation and filamentation are therefore decoupled. As a consequence, ultraviolet wavelength may not be the optimal wavelength for applications requiring to maximize ionization.

74 ATOMIC AND MOLECULAR PHYSICS↗

A general framework of noise suppression in material decomposition for dual-energy CT

Purpose: As a general problem of dual-energy CT (DECT), noise amplification in material decomposition severely reduces the signal-to-noise ratio on the decomposed images compared to that on the original CT images. In this work, the authors propose a general framework of noise suppression in material decomposition for DECT. The method is based on an iterative algorithm recently developed in their group for image-domain decomposition of DECT, with an extension to include nonlinear decomposition models. The generalized framework of iterative DECT decomposition enables beam-hardening correction with simultaneous noise suppression, which improves the clinical benefits of DECT. Methods: The authors propose to suppress noise on the decomposed images of DECT using convex optimization, which is formulated in the form of least-squares estimation with smoothness regularization. Based on the design principles of a best linear unbiased estimator, the authors include the inverse of the estimated variance–covariance matrix of the decomposed images as the penalty weight in the least-squares term. Analytical formulas are derived to compute the variance–covariance matrix for decomposed images with general-form numerical or analytical decomposition. As a demonstration, the authors implement the proposed algorithm on phantom data using an empirical polynomial function of decomposition measured on a calibration scan. The polynomial coefficients are determined from the projection data acquired on a wedge phantom, and the signal decomposition is performed in the projection domain. Results: On the Catphan{sup ®}600 phantom, the proposed noise suppression method reduces the average noise standard deviation of basis material images by one to two orders of magnitude, with a superior performance on spatial resolution as shown in comparisons of line-pair images and modulation transfer function measurements. On the synthesized monoenergetic CT images, the noise standard deviation is reduced by a factor of 2–3. By using nonlinear decomposition on projections, the authors’ method effectively suppresses the streaking artifacts of beam hardening and obtains more uniform images than their previous approach based on a linear model. Similar performance of noise suppression is observed in the results of an anthropomorphic head phantom and a pediatric chest phantom generated by the proposed method. With beam-hardening correction enabled by their approach, the image spatial nonuniformity on the head phantom is reduced from around 10% on the original CT images to 4.9% on the synthesized monoenergetic CT image. On the pediatric chest phantom, their method suppresses image noise standard deviation by a factor of around 7.5, and compared with linear decomposition, it reduces the estimation error of electron densities from 33.3% to 8.6%. Conclusions: The authors propose a general framework of noise suppression in material decomposition for DECT. Phantom studies have shown the proposed method improves the image uniformity and the accuracy of electron density measurements by effective beam-hardening correction and reduces noise level without noticeable resolution loss.

60 APPLIED LIFE SCIENCES↗

Bias-Variance Trade-Off in Physics-Informed Neural Networks with Randomized Smoothing for High-Dimensional PDEs

Physics-Informed Neural Networks (PINNs) have triggered a paradigm shift in scientific computing, leveraging mesh-free properties and robust approximation capabilities. While proving effective for low-dimensional partial differential equations (PDEs), the computational cost of PINNs remains a hurdle in high-dimensional scenarios. This is particularly pronounced when computing high-order and high-dimensional derivatives in the physics-informed loss. Randomized Smoothing PINN (RS-PINN) introduces Gaussian noise for stochastic smoothing of the original neural net model, enabling the use of Monte Carlo methods for derivative approximation, which eliminates the need for costly automatic differentiation. Despite its computational efficiency, especially in the approximation of high-dimensional derivatives, RS-PINN introduces biases in both loss and gradients, negatively impacting convergence, especially when coupled with stochastic gradient descent (SGD) algorithms. We present a comprehensive analysis of biases in RS-PINN, attributing them to the nonlinearity of the Mean Squared Error (MSE) loss as well as the intrinsic nonlinearity of the PDE itself. We propose tailored bias correction techniques, delineating their application based on the order of PDE nonlinearity. The derivation of an unbiased RS-PINN allows for a detailed examination of its advantages and disadvantages compared to the biased version. Specifically, the biased version has a lower variance and runs faster than the unbiased version, but it is less accurate due to the bias. To optimize the bias-variance trade-off, we combine the two approaches in a hybrid method that balances the rapid convergence of the biased version with the high accuracy of the unbiased version. In addition to methodological contributions, we present an enhanced implementation of RS-PINN. Extensive experiments on diverse high-dimensional PDEs, including Fokker-Planck, Hamilton-Jacobi-Bellman (HJB), viscous Burgers’, Allen-Cahn, and Sine-Gordon equations, illustrate the bias-variance trade-off and highlight the effectiveness of the hybrid RS-PINN. Empirical guidelines are provided for selecting biased, unbiased, or hybrid versions, depending on the dimensionality and nonlinearity of the specific PDE problem.

97 MATHEMATICS AND COMPUTING↗

High-yield hydrogen production from biomass by in vitro metabolic engineering: Mixed sugars coutilization and kinetic modeling

The use of hydrogen (H 2 ) as a fuel offers enhanced energy conversion efficiency and tremendous potential to decrease greenhouse gas emissions, but producing it in a distributed, carbon-neutral, low-cost manner requires new technologies. Herein we demonstrate the complete conversion of glucose and xylose from plant biomass to H 2 and CO 2 based on an in vitro synthetic enzymatic pathway. Glucose and xylose were simultaneously converted to H 2 with a yield of two H 2 per carbon, the maximum possible yield. Parameters of a nonlinear kinetic model were fitted with experimental data using a genetic algorithm, and a global sensitivity analysis was used to identify the enzymes that have the greatest impact on reaction rate and yield. After optimizing enzyme loadings using this model, volumetric H 2 productivity was increased 3-fold to 32 mmol H 2 ∙L ₋1 ∙h ₋1 . The productivity was further enhanced to 54 mmol H 2 ∙L ₋1 ∙h ₋1 by increasing reaction temperature, substrate, and enzyme concentrations—an increase of 67-fold compared with the initial studies using this method. The production of hydrogen from locally produced biomass is a promising means to achieve global green energy production.

08 HYDROGEN↗

Reduction or Enhancement of Stellarator Turbulence by Impurities

A systematic study of the impact of impurities on the turbulent heat fluxes is presented for the stellarator Wendelstein 7-X (W7-X) and, for comparison, the Large Helical Device and ITER. By means of nonlinear multispecies gyrokinetic simulations, it is shown that impurities, depending on the sign of their density gradient, can significantly enhance or reduce turbulent ion heat losses. For the relevant scenario of turbulence reduction, an optimal impurity concentration that minimizes the ion heat diffusivity emerges as a universal feature. This result demonstrates the potential of impurities for controlling turbulence and accessing enhanced confinement regimes in fusion plasmas and, in particular, in W7-X. Published by the American Physical Society 2024

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Algorithms for propagating uncertainty across heterogeneous domains

We address an important research area in stochastic multi-scale modeling, namely the propagation of uncertainty across heterogeneous domains characterized by partially correlated processes with vastly different correlation lengths. This class of problems arise very often when computing stochastic PDEs and particle models with stochastic/stochastic domain interaction but also with stochastic/deterministic coupling. The domains may be fully embedded, adjacent or partially overlapping. The fundamental open question we address is the construction of proper transmission boundary conditions that preserve global statistical properties of the solution across different subdomains. Often, the codes that model different parts of the domains are black-box and hence a domain decomposition technique is required. No rigorous theory or even effective empirical algorithms have yet been developed for this purpose, although interfaces defined in terms of functionals of random fields (e.g., multi-point cumulants) can overcome the computationally prohibitive problem of preserving sample-path continuity across domains. The key idea of the different methods we propose relies on combining local reduced-order representations of random fields with multi-level domain decomposition. Specifically, we propose two new algorithms: The first one enforces the continuity of the conditional mean and variance of the solution across adjacent subdomains by using Schwarz iterations. The second algorithm is based on PDE-constrained multi-objective optimization, and it allows us to set more general interface conditions. The effectiveness of these new algorithms is demonstrated in numerical examples involving elliptic problems with random diffusion coefficients, stochastically advected scalar fields, and nonlinear advection-reaction problems with random reaction rates.

Cho, Heyrim↗

A Flexible Variable Truncated Power Series Algebra in Zlib

Zlib is a numerical library for Truncated Power Series Algebra (TPSA) and Lie Algebra for application to nonlinear analysis of single particle dynamics. The first version was developed in 1990 with the use of the One-Step Index Pointers (OSIP's). The OSIP's form the Zlib nerve that offers optimal computation and alloworder grading as well as flexible initialization of the global number of variables for the TPSA. While the OSIP's are still kept for minimum index passing to achieve efficient computation, Zlib has been being upgraded to allow flexible and gradable local number of variables in each C++ object of the Truncated Power Series (Tps) class. Possible applications using Zlib are discussed.

43 PARTICLE ACCELERATORS↗

Group-invariant solutions of semilinear Schrödinger equations in multi-dimensions

Symmetry group methods are applied to obtain all explicit group-invariant radial solutions to a class of semilinear Schrödinger equations in dimensions n ≠ 1. Both focusing and defocusing cases of a power nonlinearity are considered, including the special case of the pseudo-conformal power p = 4/n relevant for critical dynamics. The methods involve, first, reduction of the Schrödinger equations to group-invariant semilinear complex 2nd order ordinary differential equations (ODEs) with respect to an optimal set of one-dimensional point symmetry groups, and second, use of inherited symmetries, hidden symmetries, and conditional symmetries to solve each ODE by quadratures. Through Noether's theorem, all conservation laws arising from these point symmetry groups are listed. Some group-invariant solutions are found to exist for values of n other than just positive integers, and in such cases an alternative two-dimensional form of the Schrödinger equations involving an extra modulation term with a parameter m = 2−n ≠ 0 is discussed.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Nonlinear post-compression in multi-pass cells in the mid-IR region using bulk materials

We numerically investigate the regime of nonlinear pulse compression at mid-IR wavelengths in a multi-pass cell (MPC) containing a dielectric plate. This post-compression setup allows for ionization-free spectral broadening and self-compression while mitigating self-focusing effects. We find that self-compression occurs for a wide range of MPC and pulse parameters and derive scaling rules that enable its optimization. We also reveal the solitonic dynamics of the pulse propagation in the MPC and its limitations and show that spatiotemporal/spectral couplings can be mitigated for appropriately chosen parameters. In addition, we reveal the formation of spectral features akin to quasi-phase matched degenerate four-wave mixing. Finally, we present two case studies of self-compression at 3-μm and 6-μm wavelengths using pulse parameters compatible with driving high-field physics experiments. The simulations presented in this paper set a framework for future experimental work using few-cycle pulses at mid-IR wavelengths.

Carlson, D. (ORCID:0000000346836463)↗

Optimisation of spontaneous four-wave mixing in a ring microcavity

A theory of spontaneous four-wave mixing in a ring microcavity is developed. The rate of emission of biphotons for pulsed and monochromatic pumping with allowance for the dispersion of group velocities is analytically calculated. In the first case, pulses in the form of an increasing exponential are considered, which are optimal for excitation of an individual resonator mode. The behaviour of the group velocity dispersion as a function of the width and height of the waveguide is studied for a specific case of a ring microcavity made of silicon nitride. The results of the numerical calculation are in good agreement with the experimental data. The ring microcavity is made of two types of waveguides: completely etched and half etched. It is found that the latter allow for better control over the parameters in the manufacturing process, making them more predictable. (nonlinear optical phenomena)

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Single-Phase to Split-Phase Inverters with Advanced Grid Support Functions for Grid-Interactive Applications

This work presents a cost-effective single-phase to split-phase inverter with a reduced switch count, achieving grid interactive performance while maintaining operational efficiency. The proposed system integrates an Andronov-Hopf oscillator based secondary controller, which inherently embeds a nonlinear resistive droop architecture, ensuring rapid dynamic response. A Lyapunov energy function-based primary control enhances transient stability and regulation, while an internal model-based point of common coupling voltage estimation enables cost optimization without additional sensors. Equipped with advanced grid support functionalities, the inverter facilitates seamless distribution system operation with enhanced robustness. The effectiveness of the proposed architecture and control strategy is validated through MATLAB/Simulink and PLECS simulations, demonstrating its feasibility for high-performance grid-supportive applications.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A Novel Deep Reinforcement Learning Approach to Traffic Signal Control with Connected Vehicles

The advent of connected vehicle (CV) technology offers new possibilities for a revolution in future transportation systems. With the availability of real-time traffic data from CVs, it is possible to more effectively optimize traffic signals to reduce congestion, increase fuel efficiency, and enhance road safety. The success of CV-based signal control depends on an accurate and computationally efficient model that accounts for the stochastic and nonlinear nature of the traffic flow. Without the necessity of prior knowledge of the traffic system’s model architecture, reinforcement learning (RL) is a promising tool to acquire the control policy through observing the transition of the traffic states. In this paper, we propose a novel data-driven traffic signal control method that leverages the latest in deep learning and reinforcement learning techniques. By incorporating a compressed representation of the traffic states, the proposed method overcomes the limitations of the existing methods in defining the action space to include more practical and flexible signal phases. The simulation results demonstrate the convergence and robust performance of the proposed method against several existing benchmark methods in terms of average vehicle speeds, queue length, wait time, and traffic density.

42 ENGINEERING↗

Finite-Time Analysis of Whittle Index based Q-Learning for Restless Multi-Armed Bandits with Neural Network Function Approximation

Whittle index policy is a heuristic to the intractable restless multi-armed bandits (RMAB) problem. Although it is provably asymptotically optimal, finding Whittle indices remains difficult. In this paper, we present Neural-Q-Whittle, a Whittle index based Q-learning algorithm for RMAB with neural network function approximation, which is an example of nonlinear two-timescale stochastic approximation with Q-function values updated on a faster timescale and Whittle indices on a slower timescale. Despite the empirical success of deep Q-learning, the non-asymptotic convergence rate of Neural-Q-Whittle, which couples neural networks with two-timescale Q-learning largely remains unclear. This paper provides a finite-time analysis of Neural-Q-Whittle, where data are generated from a Markov chain, and Q-function is approximated by a ReLU neural network. Our analysis leverages a Lyapunov drift approach to capture the evolution of two coupled parameters, and the nonlinearity in value function approximation further requires us to characterize the approximation error. Combing these provide Neural-Q-Whittle with convergence rate, where is the number of iterations.

reinforcement learning, structured learning, conve↗