Search NASA⌕ Search

SEARCH · Search NASA

Results for “Pareto optimal”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

A Multi-Objective Bayesian Optimized Human Assessed Multi-Target Generated Spectral Recommender System for Rapid Pareto Discoveries of Material Properties

Optimization for different tasks like material characterization, synthesis, and functional properties for desired applications over multi-dimensional control parameter and function spaces need a rapid strategic search through active learning. However, in all cases prior to optimization, the target material properties are assumed known and fixed, which mostly deviates from real-world scenarios in material synthesis. This can be critical for running expensive experiments on new materials, when the experimental results are fuzzy for any scientific outcomes due to improper target setting, ultimately wasting time and cost. The failure rate and cost are even higher over exploring on multi-target space, where we want to learn the pareto among multiple properties, to jointly optimize during material synthesis for desired applications. To address the challenge, here we introduce the human-operator attempt flexibility in the active learning based automated experiment framework, with generating multiple human assessed targets through a voting-based recommender system during real-time microscope measurements over the large material image space, sequentially learn/update multiple desired targets through a weighting system, and adaptively search in multiple material properties functional space for non-dominated pareto discoveries to maximize the custom structural similarity based acquisition function. We term this a multi-objective Bayesian optimized human assessed multi-target generated spectral recommender systems (MOBO-HAM-SRS). The approach has been demonstrated to peizoresponse force spectroscopy of a ferroelectric thin film, exploring with different kernels and acquisition functions. This work shows an advancement towards human-AI collaborated automated experiments, steering optimization trajectories through human overpowering AI at the early stage when uncertainty is high and AI overpowering human at the later stage with rapid exploration towards optimal goal, following human-assessed multiple targets properties.

Biswas, Arpan↗

Optimizing pollinator conservation and crop yield among perennial bioenergy crops

In order to both combat the decline of biodiversity and produce food, fuel, and fiber for a growing human population, current agricultural landscapes must transition into diversified, multifunctional systems. Perennial cellulosic biofuel crops have potential to meet both of these challenges, acting as multifunctional systems that can enhance biodiversity. What is not well understood, and what we test here, are the tradeoffs among different perennial crops in their performance as biofuels and in biodiversity conservation. Working in an established bioenergy experiment with four native, perennial, cellulosic biofuel crop varieties - ranging from monoculture to diverse restoration planting - we tested the effect of biofuel crop management on flower communities, pollinator communities, and crop yield. The greatest abundance and diversity of pollinators and flowers were in treatments that were successional (unmanaged), followed by restored prairie (seeded mix of native grasses and forbs), switchgrass, and a mix of native grasses. However, biofuel crop yield was approximately the inverse, with native grasses having the highest yield, followed by switchgrass and prairie, then successional treatments. Restored prairie was the optimal biofuel crop when both pollinator conservation and crop yield are valued similarly. We add to mounting evidence that policy is needed to create sustainable markets that value the multifunctionality of perennial biofuel systems in order to achieve greater ecosystem services from agricultural landscapes.

09 BIOMASS FUELS↗

Single- and Multiple-Objective Optimization with Differential Evolution and Neural Networks

Genetic and evolutionary algorithms have been applied to solve numerous problems in engineering design where they have been used primarily as optimization procedures. These methods have an advantage over conventional gradient-based search procedures became they are capable of finding global optima of multi-modal functions and searching design spaces with disjoint feasible regions. They are also robust in the presence of noisy data. Another desirable feature of these methods is that they can efficiently use distributed and parallel computing resources since multiple function evaluations (flow simulations in aerodynamics design) can be performed simultaneously and independently on ultiple processors. For these reasons genetic and evolutionary algorithms are being used more frequently in design optimization. Examples include airfoil and wing design and compressor and turbine airfoil design. They are also finding increasing use in multiple-objective and multidisciplinary optimization. This lecture will focus on an evolutionary method that is a relatively new member to the general class of evolutionary methods called differential evolution (DE). This method is easy to use and program and it requires relatively few user-specified constants. These constants are easily determined for a wide class of problems. Fine-tuning the constants will off course yield the solution to the optimization problem at hand more rapidly. DE can be efficiently implemented on parallel computers and can be used for continuous, discrete and mixed discrete/continuous optimization problems. It does not require the objective function to be continuous and is noise tolerant. DE and applications to single and multiple-objective optimization will be included in the presentation and lecture notes. A method for aerodynamic design optimization that is based on neural networks will also be included as a part of this lecture. The method offers advantages over traditional optimization methods. It is more flexible than other methods in dealing with design in the context of both steady and unsteady flows, partial and complete data sets, combined experimental and numerical data, inclusion of various constraints and rules of thumb, and other issues that characterize the aerodynamic design process. Neural networks provide a natural framework within which a succession of numerical solutions of increasing fidelity, incorporating more realistic flow physics, can be represented and utilized for optimization. Neural networks also offer an excellent framework for multiple-objective and multi-disciplinary design optimization. Simulation tools from various disciplines can be integrated within this framework and rapid trade-off studies involving one or many disciplines can be performed. The prospect of combining neural network based optimization methods and evolutionary algorithms to obtain a hybrid method with the best properties of both methods will be included in this presentation. Achieving solution diversity and accurate convergence to the exact Pareto front in multiple objective optimization usually requires a significant computational effort with evolutionary algorithms. In this lecture we will also explore the possibility of using neural networks to obtain estimates of the Pareto optimal front using non-dominated solutions generated by DE as training data. Neural network estimators have the potential advantage of reducing the number of function evaluations required to obtain solution accuracy and diversity, thus reducing cost to design.

Rai, Man Mohan↗

Pareto v1.0.0

An Optimization Framework for Produced Water Management and Beneficial Reuse

Beattie, KeithS↗

Input-response space-filling designs

Traditional space-filling designs are a convenient way to explore throughout an input space of flexible dimension and have design points close to any region where future predictions might be of interest. In some applications, there may be a model connecting the input factors to the response(s), which provides an opportunity to consider the spacing not only in the input space but also in the response space. In this paper, we present an approach for leveraging current understanding of the relationship between inputs and responses to generate designs that allow the experimenter to flexibly balance the spacing in these two regions to find an appropriate design for the experimental goals. Applications where good spacing of the observed response values include calibration problems where the goal is to demonstrate the adequacy of the model across the range of the responses, sensitivity studies where the outputs from a submodel may be used as inputs for subsequent models, and inverse problems where the outputs of a process will be used in the inverse prediction for the unknown inputs. Here, we use the multi-objective optimization method of Pareto fronts to generate multiple non-dominated designs with different emphases on the input and response space-filling criteria from which the experimenter can choose. The methods are illustrated through several examples and a chemical engineering case study.

42 ENGINEERING↗

Optimization of the Second Target Station cold source moderators using an automated workflow

The Second Target Station (STS) at the US Department of Energy’s Oak Ridge National Laboratory is designed to become the world’s highest peak-brightness spallation source of cold neutrons. Successful completion of the STS, which is currently in the preliminary design phase, will provide transformative new capabilities to examine novel materials for future technologies. At STS, neutrons will be generated by spallation reactions in a solid tungsten target. They will be moderated and thermalized in two cold (20 K) para-hydrogen moderators. Careful optimization of these moderators is essential to the project’s success. To find optimal moderator designs, an advanced optimization workflow integrates high-fidelity neutronics calculations using the Monte Carlo N-Particle (MCNP) transport code MCNP6.2 with state-of-the-art optimization algorithms in the Dakota optimization toolkit. For each design iteration, a parametrized solid CAD geometry is generated in Creo and automatically converted into an unstructured mesh geometry by Attila 4MC for the neutronics calculation with MCNP. Iterations repeat until optimal designs are found. Herein this paper presents the results of a sensitivity and optimization study for the cylindrical and tube moderators. Both moderators can be optimized for maximum peak brightness, maximum time-integrated brightness, or any combination between these extremes. Maximum peak brightness is achieved by using smaller optimal dimensions of the moderators, whereas maximum time-integrated brightness is achieved by using larger dimensions. A Pareto front details the designs that optimally balance both brightness metrics. The Pareto front can be found in only 40–110 iterations with 4–5 design parameters when using the efficient global and Pareto-set optimization algorithms in Dakota. Additionally, important engineering constraints can be taken into account, such as the coupling between the cylindrical moderator radius and aluminum vessel wall thicknesses required to ensure structural integrity of the vessels. This interaction has a significant impact on the resulting optimal designs. Our new, highly efficient, fully automated optimization workflow will be used to optimize additional STS components in the future and can be adopted for design and optimization studies at other experimental neutron and accelerator facilities.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learning

Large language models (LLMs) are increasingly adapted to downstream tasks via reinforcement learning (RL) methods like Group Relative Policy Optimization (GRPO), which often require thousands of rollouts to learn new tasks. We argue that the interpretable nature of language often provides a much richer learning medium for LLMs, compared to policy gradients derived from sparse, scalar rewards. To test this, we introduce GEPA (Genetic-Pareto), a prompt optimizer that thoroughly incorporates natural language reflection to learn high-level rules from trial and error. Given any AI system containing one or more LLM prompts, GEPA samples trajectories (e.g., reasoning, tool calls, and tool outputs) and reflects on them in natural language to diagnose problems, propose and test prompt updates, and combine complementary lessons from the Pareto frontier of its own attempts. As a result of GEPA's design, it can often turn even just a few rollouts into a large quality gain. Across six tasks, GEPA outperforms GRPO by 6% on average and by up to 20%, while using up to 35x fewer rollouts. GEPA also outperforms the leading prompt optimizer, MIPROv2, by over 10% (e.g., +12% accuracy on AIME-2025), and demonstrates promising results as an inference-time search strategy for code optimization. We release our code at https://github.com/gepa-ai/gepa.

97 MATHEMATICS AND COMPUTING↗

Tula: Optimizing Time, Cost, and Generalization in Distributed Large-Batch Training

Distributed training increases the number of batches processed per iteration either by scaling-out (adding more nodes) or scaling-up (increasing the batch-size). However, the largest configuration does not necessarily yield the best performance. Horizontal scaling introduces additional communication overhead, while vertical scaling is constrained by computation cost and device memory limits. Thus, simply increasing the batch-size leads to diminishing returns: training time and cost decrease initially but eventually plateaus, creating a knee-point in the time/cost vs. batch-size pareto curve. The optimal batch-size therefore depends on the underlying model, data and available compute resources. Large batches also suffer from worse model quality due to the well-known “generalization gap”. In this paper, we present Tula, an online service that automatically optimizes time, cost, and convergence quality for large-batch training of convolutional models. It combines parallel-systems modeling with statistical performance prediction to identify the optimal batchsize. Tula predicts training time and cost within 7.5−14% error across multiple models, and achieves up to 20× overall speedup and improves test accuracy by ≈9% on average over standard large-batch training on various vision tasks, thus successfully mitigating the generalization gap and accelerating training at the same time.

Tyagi, Sahil [ORNL] (ORCID:0009000783144745)↗

Surrogate Model Guided Optimization of Expensive Black-Box Multi-Objective Problems: A Posteriori Methods

Many engineering applications require the simultaneous optimization of multiple conflicting objective functions. Often, these objective functions are evaluated using highly accurate computer simulations that are computationally too expensive to be evaluated hundreds or thousands of times during optimization. Thus, the goal is to find good approximations of the Pareto front using as few of these expensive simulations as possible. Here, we describe an optimization approach based on surrogate models and diverse sampling strategies to accelerate the search for the Pareto solutions. We use a separate surrogate model for approximating each objective function and then we use the surrogate models to inform where additional expensive simulations should be run. The surrogate models are updated in an active learning framework whenever new information from the expensive simulations becomes available. The sampling strategies aim at balancing local improvements of the approximate Pareto front and global exploration to identify the extrema and fill in large gaps of the approximate Pareto front. We demonstrate on a large set of benchmark problems the effectiveness of the method for finding good approximations of the Pareto front.

MATHEMATICS AND COMPUTING↗

Selection of Alternator Voltage for Dynamic Radioisotope Power Systems

In this paper, we present a study to select an appropriate alternator voltage of the free-piston Stirling convertors (FPSC) for efficient and light Dynamic Radioisotope Power Systems (DRPS). With a system thermal-to-electrical efficiency 3-4 times greater than radioisotope thermoelectric generator (RTG) systems and a higher power density than Brayton systems in the power range of interest for radioisotope-powered systems, Stirling-based DRPS is uniquely suited to benefit upcoming NASA missions. Much effort has been invested in the design and optimization of the thermal, mechanical, and materials aspects of FPSCs, but the electrical aspect has been more nebulous. Therefore, in this paper, a preliminary study will be presented to select the appropriate Stirling alternator voltage to develop a light and efficient system using available flight components. Power conversion systems face a trade between efficiency and system volume/mass with the optimal trade being determined by the application. Neglecting non-idealities related to insulation thickness and winding packing factor and assuming a constant winding area, alternator efficiency is independent of alternator voltage. Because wire size and alternator current can be traded against turn count and alternator voltage without impacting efficiency, the guidance on the optimal design comes from analysis of the controller power electronics and the remainder of the system. Properties of available flight-qualified electrical components, such as rated voltage/current and on-resistance, typically come in discrete values instead of a continuous range of values. With multiple components being required to form the power conversion stage of the controller, each limited to incremental values, a continuous optimization is of little benefit. Instead of a continuous optimization, a random process using properties of the available components can be used to develop a Pareto design front indicating the optimized trade space. The most advantageous trade between system efficiency and mass for the system at hand can then be selected from the range of feasible designs. In the final paper, the design process, assumptions, and preliminary results will be presented.

Free-Piston Stirling Convertor Controller, Dynamic↗

Constraining nuclear mass models using 𝑟-process observables with multiobjective optimization

Modeling nuclear masses, particularly for nuclei far from stability, remains a key objective in nuclear physics. One contemporary approach is machine learning (ML), which trains on experimental data, but can suffer large errors when extrapolating toward neutron-rich species. In nature, such masses shape observables for the rapid neutron capture process (𝑟 process), which in principle could inform ML models. Here, we introduce a multiobjective optimization approach using the Pareto front algorithm. We show that this technique, capable of identifying models that generate 𝑟-process abundances aligning with both solar and stellar data, is a promising method to select ML models with reliable extrapolation power.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗