Search NASA⌕ Search

SEARCH · Search NASA

Results for “sequential experimental design”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Bayesian sequential optimal experimental design for nonlinear models using policy gradient reinforcement learning

We present a mathematical framework and computational methods for optimally designing a finite sequence of experiments. This sequential optimal experimental design (sOED) problem is formulated as a finite-horizon partially observable Markov decision process (POMDP) under a Bayesian setting and with information-theoretic utilities. The formulation is general and may accommodate continuous random variables, non-Gaussian posteriors, and nonlinear forward models. The sOED design policy incorporates elements of feedback and lookahead simultaneously, and we show it to generalize the commonly-used batch and greedy design strategies. We solve for the sOED policy using the policy gradient (PG) method from reinforcement learning, and provide a derivation for the PG expression in the sOED context. Adopting an actor-critic approach, the policy and value functions are parameterized using deep neural networks and improved via PG estimates produced from simulated episodes of designs and observations. The new PG-sOED algorithm is first validated on a linear-Gaussian benchmark, and then compared against other design baselines on a sensor movement problem for contaminant source inversion in a convection-diffusion field. As a result, we provide explanation for the policy behaviors using knowledge of the underlying physical process.

97 MATHEMATICS AND COMPUTING↗

Practical and Optimal Sequential Bayesian Experimental Design for Complex Systems Incorporating Human Experimenter Preferences (Final Scientific/Technical Report)

Experiments are indispensable for developing models of complex systems. Carefully designed experiments can provide substantial savings for these expensive data-acquisition opportunities. However, designs based on heuristics are often suboptimal for systems with multiphysics, nonlinear dynamics, and uncertain and noisy environments. Optimal experimental design, while leveraging predictive models, seeks to systematically quantify and maximize the value of experiments. In this project, we focused on the design of multiple experiments, where current approaches are largely suboptimal: batch-design does not adapt to new data acquired during the experiment campaign (no feedback), and greedy/myopic design ignores future dynamics and consequences (no lookahead). We developed the mathematical framework and computational methods for sequential optimal experimental design (sOED) for complex systems. We enabled tractable model-based sOED in a rigorous manner through novel algorithms based on reinforcement learning, and investigated the effects of human experimenters on the design process. Our methods are fully Bayesian, able to quantify and update uncertainty in a principled manner. The traits aimed by our approach—mathematical rigor and optimality, human effects and uncertainty quantification, computational practicality—are crucial for elevating the standards of artificial intelligence (AI) to support decision-making in scientific domains, and contribute toward trust and realistic adoption of AI in experimental design practice.

97 MATHEMATICS AND COMPUTING↗

Sequential Bayesian Experimental Design for Calibration of Expensive Simulation Models

Simulation models of critical systems often have parameters that need to be calibrated using observed data. For expensive simulation models, calibration is done using an emulator of the simulation model built on simulation output at different parameter settings. Using intelligent and adaptive selection of parameters to build the emulator can drastically improve the efficiency of the calibration process. The article proposes a sequential framework with a novel criterion for parameter selection that targets learning the posterior density of the parameters. The emergent behavior from this criterion is that exploration happens by selecting parameters in uncertain posterior regions while simultaneously exploitation happens by selecting parameters in regions of high posterior density. Furthermore, the advantages of the proposed method are illustrated using several simulation experiments and a nuclear physics reaction model.

97 MATHEMATICS AND COMPUTING↗

Towards informatics-driven design of nuclear waste forms

Informatics-driven approaches, such as machine learning and sequential experimental design, have shown the potential to drastically impact next-generation materials discovery and design.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Dial

A key step in almost all scientific endeavors is answering the question: Given this data I already collected, what new data do I expect will yield the most useful information toward my scientific objective? The area of (sequential) experimental design has long been investigating answers to this question, but in recent years techniques from the machine learning subfield of active learning are increasingly applied. Researchers need a simple software tool for active learning applied to experimental design that can easily integrate into their existing workflows. This computer code, Dial, provides a microservice in ORNL's INTERSECT ecosystem for active learning applied to experimental design. By being part of the INTERSECT ecosystem, Dial is simple to integrate into any INTERSECT-based workflow. Dial provides multiple backend options, where a backend is an implementation of a specific active learning method. Users can select the backend that performs best for their application. Developers can also add new backends as needed. At its core, Dial receives a set of pre-existing measurements and input parameter bounds and then recommends one or more new sets of parameters to measure. Dial also includes interfaces to other microservices in the INTERSECT ecosystem so that it can be incorporated into INTERSECT campaigns. Dial provides a simple, yet powerful interface to convert automated INTERSECT workflows into autonomous workflows that adapt based on the results that are obtained. A shared microservice for active learning prevents duplicated effort by each application team implementing its own adaptive design of experiments tool.

Drane, Lance [Oak Ridge National Laboratory (ORNL)↗

Efficient and Selective Chemical Transformations in Highly Charged and Confined Nanodroplets

The acceleration of chemical reaction rates and the increased product selectivity in microdroplets compared to that in bulk solutions has become a topic of increasing interest that has been extensively characterized by electrospray ionization mass spectrometry (ESI-MS). However, the sources of this acceleration and the detailed relationships between droplet properties and resulting reaction rate acceleration are still under debate. Moreover, droplet properties are governed by multiple interrelated experimental parameters, i.e., electrospray voltage, solution flow rate, etc., which makes it difficult and time-consuming to explore this diverse parameter space using traditional manual experimental or computational approaches. In this work, we developed an automated experimental platform integrating reactions in controlled charged microdroplet environments with ESI-MS characterization and sequential hybrid Bayesian modeling, as well as an optimal experimental design framework, to achieve multidimensional parameter optimization for higher reaction turnover rates, based on a model reaction of tetraethylenepentamine (TEPA) with carbon dioxide. With the current platform, we have achieved automated scans with a range of electrospray voltages and solution flow rates, and determined and optimized parameter settings to achieve increased reaction turnovers. We have also linked this platform to the underlying properties of droplets via a hybrid model incorporating physics, high-level theoretical calculations, and machine learning (ML) approaches. The autonomous platform is broadly applicable to a range of chemical reactions relevant to DOE’s mission in chemical separations, catalysis, and materials synthesis.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Sequential Selection for Minimizing the Variance with Application to Crystallization Experiments

For many crystal-based products (e.g., pharmaceuticals, energy storage), the size uniformity is not only a key quality attribute, but sometimes also an indicator of other attributes such as solid purity. This article proposes a sequential selection approach to find a proper experimental setting that leads to high uniformity, or equivalently, small variance for crystal sizes, from the advanced slug flow reaction crystallization process of a model crystal, called manganese oxalate hydrate. The proposed sequential selection approach contains a Bayesian adaptive method to incorporate new uniformity measurements in each step and two design acquisition functions to improve the selection of the most promising experimental setting in terms of minimizing the variance. We study the performance of the proposed approach through multiple synthetic numerical studies, as well as a case study based on data from slug flow crystallization experiments. Throughout these studies, the proposed approach shows competitive performance in identifying the best experimental setting.

Expected improvement↗

Spatially Patterned Architectures to Modulate CO 2 Reduction Cascade Catalysis Kinetics

Electrochemical CO 2 reduction using renewable sources of electrical energy holds promise for converting CO 2 into fuels and chemicals. The complex interactions among chemical/electrochemical reactions and mass transport make it difficult to analyze the effect of an individual process on electrode performance based only on experimental methods. Here, we developed a generalized steady-state simulation to describe an electrode surface in which sequential cascade catalysts are patterned in a periodic trench design. If appropriately constructed, this trench geometry is hypothesized to be able to yield a higher net current density for a CO 2 reduction (CO 2 R) cascade reaction. We have used realistic experimental reaction kinetics to investigate the role of trench geometry in mass transport, local microenvironments, and selectivity for a model CO 2 R cascade reaction. The model considers local concentration gradients of bicarbonate species at quasi-equilibrium and catalytic surface reactions based on concentration-dependent Butler–Volmer kinetics. Our results suggest that varying the spatial distribution of active sites plays a significant role in facilitating effective mass transport between active sites, modulating selectivity for the cascade reaction, and enhancing the yield of desirable cascade products. Moreover, we observe that this trench geometry significantly alters the cascade reaction rate by affecting the local pH, which can cause inadvertent depletion of available aqueous CO 2 to limit the CO 2 R cascade kinetics and modest suppression of the hydrogen evolution reaction (HER). The results highlight the trade-offs between mass transport, pH, and reaction kinetics that become apparent only when considering the coupled physics of all processes at the electrode surface. Here, this model can thus serve as a primary tool to build more selective and efficient patterned architectures for the CO 2 R cascade catalysis.

CO2 reduction↗

Targeted materials discovery using Bayesian algorithm execution

Rapid discovery and synthesis of future materials requires intelligent data acquisition strategies to navigate large design spaces. A popular strategy is Bayesian optimization, which aims to find candidates that maximize material properties; however, materials design often requires finding specific subsets of the design space which meet more complex or specialized goals. We present a framework that captures experimental goals through straightforward user-defined filtering algorithms. These algorithms are automatically translated into one of three intelligent, parameter-free, sequential data collection strategies (SwitchBAX, InfoBAX, and MeanBAX), bypassing the time-consuming and difficult process of task-specific acquisition function design. Our framework is tailored for typical discrete search spaces involving multiple measured physical properties and short time-horizon decision making. We demonstrate this approach on datasets for TiO 2 nanoparticle synthesis and magnetic materials characterization, and show that our methods are significantly more efficient than state-of-the-art approaches. Overall, our framework provides a practical solution for navigating the complexities of materials design, and helps lay groundwork for the accelerated development of advanced materials.

42 ENGINEERING↗

200-DV-1 Laboratory Treatability Study: Proof-of-Principle Results

This document presents the Phase 1 technical approach and results of laboratory-scale treatability testing of nine in situ remedial technologies for their consideration in a future Feasibility Study (FS) for the 200-DV-1 OU. The primary objective of this initial assessment was a proof-of-principle testing evaluation primarily via batch experiments to determine the potential reduction and sequestration of primary contaminants of interest with and without potential co-contaminants of interest. An effectiveness rate of 35% transformation to immobile or nontoxic end products, along with other experimental indicators, was used by the project team to determine the technologies that advanced to Phase 2 for further evaluations. For most technologies, the performance was evaluated based on a series of sequential extractions designed to evaluate the mobility of contaminants before and after treatment, with each subsequent extraction representing a relative decrease in mobility. The results of this study will be used to inform testing for Phase 2 of the treatability study for further evaluation of selected technologies. The final results from the treatability study, following the completion of remaining experimental phases, will be used to determine whether the technologies tested can be appropriately evaluated in a FS to expand on the limited number of viable DVZ remediation technologies. After completion of the laboratory treatability study and the 200-DV-1 OU Remedial Investigation (RI) and Resource Conservation and Recovery Act Facility Investigation (RFI) of the waste sites, results will be evaluated to determine whether field studies are needed to provide additional information on effectiveness, implementability, or costs for evaluating these technologies in the FS for their site-specific application.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Validation Framework for Post-Combustion Carbon Capture CFD Simulations

First-principles based computational fluid dynamics (CFD) simulations are proposed as a fundamental tool for investigating solvent-based CO2 absorption in packed columns, due to the ability to accurately represent the underlying non-linear multiscale dynamics. In this work, we employ such models to investigate hydrodynamics of columns with structured by assessing the key hydrodynamic metrics, such as pressure drop and liquid holdup. Our models are validated with experimental data from a specifically designed column for this line of work. The test cases of gas and liquid flowrates and operating conditions were selected through a comprehensive sequential design of experiments approach offered by the CCSI2 toolset.

Panagakos, Grigorios↗

A Simulator for Neyer Tests of Explosives

Explosives and explosive devices such as detonators are typically tested by applying a range of stimuli such as voltage or mechanical shock, and recording binary “detonated/did not detonate” responses. These are analyzed using maximum likelihood or generalized linear models to provide estimates of quantities such as the all-fire and no-fire points. Given that the true threshold for detonation is unknown a priori , sequential design methods are typically used to optimize the set of test points. One popular method, implemented in commercial software, is Neyer’s algorithm. To support simulation and experimental design, we have developed code in the R programming language to duplicate the functions of the Neyer software. We provide code for the simulator along with a description and examples of usage.

42 ENGINEERING↗

Machine learning for automated experimentation in scanning transmission electron microscopy

Abstract Machine learning (ML) has become critical for post-acquisition data analysis in (scanning) transmission electron microscopy, (S)TEM, imaging and spectroscopy. An emerging trend is the transition to real-time analysis and closed-loop microscope operation. The effective use of ML in electron microscopy now requires the development of strategies for microscopy-centric experiment workflow design and optimization. Here, we discuss the associated challenges with the transition to active ML, including sequential data analysis and out-of-distribution drift effects, the requirements for edge operation, local and cloud data storage, and theory in the loop operations. Specifically, we discuss the relative contributions of human scientists and ML agents in the ideation, orchestration, and execution of experimental workflows, as well as the need to develop universal hyper languages that can apply across multiple platforms. These considerations will collectively inform the operationalization of ML in next-generation experimentation.

36 MATERIALS SCIENCE↗

Dynamic Multiplexed Control and Modeling of Optogenetic Systems Using the High-Throughput Optogenetic Platform, Lustro

The ability to control cellular processes using optogenetics is inducer-limited, with most optogenetic systems responding to blue light. To address this limitation, we leverage an integrated framework combining Lustro, a powerful high-throughput optogenetics platform, and machine learning tools to enable multiplexed control over blue light-sensitive optogenetic systems. Specifically, we identify light induction conditions for sequential activation as well as preferential activation and switching between pairs of light-sensitive split transcription factors in the budding yeast, Saccharomyces cerevisiae. We use the high-throughput data generated from Lustro to build a Bayesian optimization framework that incorporates data-driven learning, uncertainty quantification, and experimental design to enable the prediction of system behavior and the identification of optimal conditions for multiplexed control. This work lays the foundation for designing more advanced synthetic biological circuits incorporating optogenetics, where multiple circuit components can be controlled using designer light induction programs, with broad implications for biotechnology and bioengineering.

59 BASIC BIOLOGICAL SCIENCES↗

Anticipating gelation and vitrification with medium amplitude parallel superposition (MAPS) rheology and artificial neural networks

Abstract Anticipating qualitative changes in the rheological response of complex fluids (e.g., a gelation or vitrification transition) is an important capability for processing operations that utilize such materials in real-world environments. One class of complex fluids that exhibits distinct rheological states are soft glassy materials such as colloidal gels and clay dispersions, which can be well characterized by the soft glassy rheology (SGR) model. We first solve the model equations for the time-dependent, weakly nonlinear response of the SGR model. With this analytical solution, we show that the weak nonlinearities measured via medium amplitude parallel superposition (MAPS) rheology can be used to anticipate the rheological aging transitions in the linear response of soft glassy materials. This is a rheological version of a technique called structural health monitoring used widely in civil and aerospace engineering. We design and train artificial neural networks (ANNs) that are capable of quickly inferring the parameters of the SGR model from the results of sequential MAPS experiments. The combination of these data-rich experiments and machine learning tools to provide a surrogate for computationally expensive viscoelastic constitutive equations allows for rapid experimental characterization of the rheological state of soft glassy materials. We apply this technique to an aging dispersion of Laponite ® clay particles approaching the gel point and demonstrate that a trained ANN can provide real-time detection of transitions in the nonlinear response well in advance of incipient changes in the linear viscoelastic response of the system.

Lennon, Kyle R. (ORCID:0000000212515461)↗

Qudit Gate Decomposition Dependence for Lattice Gauge Theories

In this work, we investigate the effect of decomposition basis on primitive qudit gates on superconducting radio-frequency cavity-based quantum computers with applications to lattice gauge theory. Three approaches are tested: SNAP & Displacement gates, ECD & single-qubit rotations $R(\theta,\phi)$, and optimal pulse control. For all three decompositions, implementing the necessary sequence of rotations concurrently rather then sequentially can reduce the primitive gate run time. The number of blocks required for the faster ECD &$R_p(\theta)$ is found to scale $\mathcal{O}(d^2)$, while slower SNAP & Displacement set scales at worst $\mathcal{O}(d)$. For qudits with $d<10$, the resulting gate times for the decompositions is similar, but strongly-dependent on experimental design choices. Optimal control can outperforms both decompositions for small $d$ by a factor of 2-12 at the cost of higher classical resources. Lastly, we find that SNAP & Displacement are slightly more robust to a simplified noise model.

Kürkçüoglu, Doga Murat↗

Terahertz Chiral Metamaterials Enabling Broadband Polarization Conversion Using Polarization Guiding Effect

Polarization control plays a vital role in terahertz (THz) photonics, enabling a wide range of applications from imaging and spectroscopy to sensing and wireless communication. However, conventional polarization control methods at THz frequencies are limited by narrow operational bandwidths and excessive absorption losses. In this work, we present a broadband THz polarization control based on the polarization guiding effect. We design and fabricate a THz polarization rotator capable of rotating incident linear polarization by 90°. The device consists of 24 twistingly stacked silicon–air metagrating layers that introduce a large degree of form birefringence, with each metagrating layer being 280 µm thick and sequentially twisted by 3.75°. Numerical simulations using the Berreman 4 × 4 method predict broadband operation of the device. Experimental validation using THz time-domain spectroscopy confirms efficient and broadband 90° polarization rotation from 0.2 to 1.25 THz. Based on this concept, we further propose THz Q-plates for the generation of broadband structured vector beams with radial and azimuthal polarization states. This work offers a scalable, material-agnostic platform for advanced THz polarization manipulation and vector beam engineering, opening new pathways for next-generation THz photonic devices.

36 MATERIALS SCIENCE↗