Search NASA⌕ Search

SEARCH · Search NASA

Results for “online optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26

Contextual Active Online Model Selection with Expert Advice

How can we collect the most useful labels to learn a model selection policy, when presented with arbitrary heterogeneous data streams? In this paper, we formulate this task as a contextual active model selection problem, where at each round the learner receives an unlabeled data point along with a context. The goal is to output the best model for any given context without obtaining an excessive amount of labels. In particular, we focus on the task of selecting pre-trained classifiers, and propose a contextual active model selection algorithm (CAMS), which relies on a novel uncertainty sampling query criterion defined on a given policy class for adaptive model selection. In comparison to prior art, our algorithm does not assume a globally optimal model. We provide rigorous theoretical analysis for the regret and query complexity under both adversarial and stochastic settings. Our experiments on several benchmark classification datasets demonstrate the algorithm’s effectiveness in terms of both regret and query complexity. Notably, to achieve the same accuracy, CAMS incurs less than 10% of the label cost when compared to the best online model selection baselines on CIFAR10.

Liu, Xuefeng↗

A Computational Theory for the Emergence of Grammatical Categories in Cortical Dynamics

A general agreement in psycholinguistics claims that syntax and meaning are unified precisely and very quickly during online sentence processing. Although several theories have advanced arguments regarding the neurocomputational bases of this phenomenon, we argue that these theories could potentially benefit by including neurophysiological data concerning cortical dynamics constraints in brain tissue. In addition, some theories promote the integration of complex optimization methods in neural tissue. In this paper we attempt to fill these gaps introducing a computational model inspired in the dynamics of cortical tissue. In our modeling approach, proximal afferent dendrites produce stochastic cellular activations, while distal dendritic branches–on the other hand–contribute independently to somatic depolarization by means of dendritic spikes, and finally, prediction failures produce massive firing events preventing formation of sparse distributed representations. The model presented in this paper combines semantic and coarse-grained syntactic constraints for each word in a sentence context until grammatically related word function discrimination emerges spontaneously by the sole correlation of lexical information from different sources without applying complex optimization methods. By means of support vector machine techniques, we show that the sparse activation features returned by our approach are well suited—bootstrapping from the features returned by Word Embedding mechanisms—to accomplish grammatical function classification of individual words in a sentence. In this way we develop a biologically guided computational explanation for linguistically relevant unification processes in cortex which connects psycholinguistics to neurobiological accounts of language. We also claim that the computational hypotheses established in this research could foster future work on biologically-inspired learning algorithms for natural language processing applications.

59 BASIC BIOLOGICAL SCIENCES↗

A Predictive Prescription Framework for Stochastic Unit Commitment Using Boosting Ensemble Learning Algorithms

To take unit commitment (UC) decisions under uncertain load, most existing stochastic optimization (SO) frameworks adopt a generic representation of uncertainty. While load levels that materialize on a particular day are influenced by various covariates (such as the day of the week or temperature), SO frameworks typically disregard such side observations, wasting actionable information that could significantly enhance decision quality. Here, this article proposes a contextual SO (CSO) framework for UC under uncertain load, which can effectively exploit covariate observations in conjunction with a class of machine learning (ML) algorithms to improve the out-of-sample performance of UC decisions. It shows how three ML algorithms, adaptive boosting, gradient boosted trees, and extreme gradient boosting, can be used to this end, constituting the first application of these algorithms in any CSO framework. Using real-world data harvested from the New York ISO grid, we measure the out-of-sample performance of the framework in terms of total operation cost, shed load values, locational marginal prices, and total payments by the loads, against several benchmark methods proposed in the literature. The article has an online companion (Yurdakul et al.), wherein we present additional results and lay out further mathematical formulations used in this work.

42 ENGINEERING↗

FAULT PROPAGATION AND EFFECTS ANALYSIS FOR DESIGNING AN ONLINE MONITORING SYSTEM FOR THE SECONDARY LOOP OF A NUCLEAR POWER PLANT PART OF A HYBRID ENERGY SYSTEM

This paper studies the propagation and effects of faults of critical components that pertain to the secondary loop of a nuclear power plant found in Nuclear Hybrid Energy Systems (NHES). This information is used to design an on-line monitoring (OLM) system which is capable of detecting and forecasting faults that are likely to occur during NHES operation. In this research, the causes, features, and effects of possible faults are investigated by simulating the propagation of faults in the secondary loop. The simulation is accomplished by using the Integrated System Failure Analysis (ISFA). ISFA is used for analyzing hardware and software faults during the conceptual design phase. In this paper, the models of system components required by ISFA are initially constructed. Then, the fault propagation analysis is implemented, which is conducted under the bounds set by acceptance criteria derived from the design of an OLM system. The result of the fault simulation is utilized to build a database for fault detection and diagnosis, provide preventive measures, and propose an optimization plan for the OLM system.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Convergence Analysis for an Online Data-Driven Feedback Control Algorithm

This paper presents convergence analysis of a novel data-driven feedback control algorithm designed for generating online controls based on partial noisy observational data. The algorithm comprises a particle filter-enabled state estimation component, estimating the controlled system’s state via indirect observations, alongside an efficient stochastic maximum principle-type optimal control solver. By integrating weak convergence techniques for the particle filter with convergence analysis for the stochastic maximum principle control solver, we derive a weak convergence result for the optimization procedure in search of optimal data-driven feedback control. Numerical experiments are performed to validate the theoretical findings.

97 MATHEMATICS AND COMPUTING↗

An Online Reinforcement Learning Controller Design For Mars Ascent Vehicle

This paper presents a neural network (NN) approximator-based online reinforcement learning (ORL) controller design for Mars Ascent Vehicle (MAV) under parametric variation and significant external disturbances. The ORL controller, which does not require any offline training, involves two NNs where an action NN produces optimal short-term control performance while a critic NN evaluates the performance of the action NN using an approximated cost function. The simulation example with comparisons against baseline Proportional-Integral-Derivative (PID) and gain scheduled pole-placement PID (GS-PP-PID) controllers show the proposed controller’s effectiveness and robustness under parametric variation and high external disturbances.

Han Woong Bae↗

Predicting departure from nucleate boiling with advanced data- and physics-driven approaches

The subcooled and low-quality saturated flow boiling critical heat flux (CHF) corresponding to the departure from nucleate boiling (DNB) is one of the major limiting factors in the design and operation of pressurized water reactors (PWRs). Due to lack of agreement on its physical mechanisms, development of an accurate DNB-type CHF model has been elusive. The various steady-state (SS) predictive tools that have been proposed can be grouped into two categories: (1) data-driven methods—namely best-fit empirical correlations and look-up tables that result in relatively good agreement with specific experimental datasets but often fail to extend beyond their ranges of validity, and (2) the physics-based mechanistic models that rely on reasonable yet limited understanding of the underlying physics and apply constitutive relations to close the conservation equations. On one hand, with recent advances in computational capabilities and optimization techniques, machine learning (ML)-based methods constitute an alternative and a more advanced, data-driven approach. With enough data, they can be particularly useful in engineering fields where the physical phenomena are complex and challenging to model. On the other hand, a state-of-the-art physics-driven approach would not only provide more accurate prediction of SS CHF, but it would also help better understand and model transient applications. The data-driven regression models use deep feed-forward neural networks (NNs) and random forests to cross-validate with 1,865 CHF test cases, covering a wide range of flow conditions and channel geometries. The best-estimate ML-based predictors compare favorably with the widely used look-up table for annulus and plate, and sensitivity analysis has confirmed their effectiveness. The key advantage of ML-based methods is their online extensibility of applicability domain. The proposed physics-driven approach combines key assumptions and parameters in the relatively well-accepted theories of liquid sublayer dryout and near-wall bubble crowding. A more realistic understanding of local mechanisms has been modeled. The new model has been optimized and validated against 1,439 tube data, and it shows considerably improved performance when compared to a recent mechanistic model, demonstrating unbiased close agreement with measurements over a wide range of operating conditions. Future work will extend the improved physics-driven model to non-tube geometry applications and will couple the model with ML via a hybrid approach. The mechanistic SS work will also serve to improve understanding and to model transient CHF scenarios.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Lossy Compression: An Online Multi-Stage Technology for High-Fidelity Synchro- Waveform Measurements

Effective real-time monitoring and analysis of distributed grids necessitate the use of synchro-waveform measurements, which capture almost all high-frequency disturbances and transient phenomena. However, due to limitations in high-speed measurements and network bandwidth, it is challenging to transfer all high-fidelity synchro-waveforms losslessly and successfully. To cope with these challenges, a hybrid-based online multi-stage compression algorithm is proposed to significantly improve the compression efficiency for synchro-waveform measurements. Initially, the multiple discrete Wavelet transformation is deployed to deconstruct the waveform components. The delta encoding is further developed to decrease the magnitude. In conjunction with the Lempel-Ziv-Markov chain, the hybrid compression algorithm is implemented to achieve real-time compression for the synchro-waveform measurements. Moreover, an innovative error index that synergizes the time and frequency domain error and correlation is formulated to evaluate the waveform distortion. By integrating compression ratio, suitable parameters can be optimally selected. Finally, the simulation, laboratory experiments, as well as field tests across a spectrum of sampling frequencies and time intervals are conducted to substantiate the efficacy of the proposed method. Here, the outcomes demonstrated that a compression ratio of approximately 15.5 and 17.83 can be reached for 0.5 s and 1 s data under both offline and online scenarios, which equates to a substantial 93.5% to 94.39% reduction in data storage requirements.

High-fidelity synchro-waveform measurements↗

Cross-Layer Self-Adaptive/Self-Aware System Software for Exascale Systems

The extreme level of parallelism coupled with the limited available power budget expected in the exascale era brings unprecedented challenges that demand optimization of performance, power and resiliency in unison. Scalability on such systems is of paramount importance, while power and reliability issues may change the execution environment in which a parallel application runs. To solve these challenges exascale systems will require an introspective system software that combines system and application observations across all system stack layers with online feedback and adaptation mechanisms. In this paper we propose the design of a novel self-aware, self-adaptive system software in which a kernel-level Monitor, which continuously inspects the evolution of the target system through observation of Sensors, is combined with a user-level Controller, which reacts to changes in the execution environment, explores opportunities to increase performance, save power and adapts applications to new execution scenarios. We show that the monitoring system accurately monitors the evolution of parallel applications with a runtime overhead below 1-2%. As a test case, we design and implement a user-runtime system that aims at optimizing application’s performance and system power consumption on complex hierarchical architectures. Our results show that our adaptive system reaches 98% of performance efficiency of manually-tuned applications.

High Performance computing, Self-aware/self-adapti↗

Model-based Dynamic Control of Speculative Forays in Parallel Computation

In simulations running in parallel, the processors would have to synchronize with other processors to maintain correct global order of computations. This can be done either by blocking computation until correct order is guaranteed, or by \textit{speculatively} proceeding with the best guess (based on local information) and later correcting errors if/as necessary. Since the gainful lengths of speculative forays depend on the dynamics of the application software and hardware at runtime, an online control system is necessary to dynamically choose and/or switch between the blocking and speculative strategies. In this paper, we formulate the reversible speculative computing in large-scale parallel computing as a dynamic linear feedback control (optimization) system model and evaluate its performance in terms of time and cost savings as compared to the traditional (forward) computing. We illustrate with an exact analogy in the form of vehicular travel under dynamic, delayed route information. The objective is to assist in making the optimal decision on what computational approach is to be chosen, by predicting the amount of time and cost savings (or losing) under different environments represented by different parameters and probability distribution functions. We consider the cases of Gaussian, exponential and log-normal distribution functions. The control system is intended for incorporating into speculative parallel applications such as optimistic parallel discrete event simulations to decide at runtime when and to what extent speculative execution can be performed gainfully.

Perumalla, Kalyan↗

Multi-objective Optimization Paradigm for Toroidal Inductors with Spatially Tuned Permeability

Spatially tuning core permeability of an electromagnetic device enables superior performance. A permeability profile can be heuristically selected to improve the flux distribution in a device with a given geometry, but in order to fully leverage the capacity of spatial dependent permeability engineering, the geometry and the permeability should be optimized simultaneously. The work herein presented sets forth a multi-physics design optimization paradigm that includes the permeability profile tuning in the context of an inductor design. This approach enables the determination of Pareto optimal fronts consisting of a set of optimal solutions against competing objectives (e.g. mass and loss) under imposed constraints. To this end, analytical solutions of the heat transfer and electromagnetic formulations are derived for toroidal inductors. The software implemented in Matlab 2018b is available online as an attachment to this paper.

42 ENGINEERING↗

Recovery Act: Training Program Development for Commercial Building Equipment Technicians (Final Scientific/Technical Report)

The overall goal of this project has been to develop curricula, certification requirements, and accreditation standards for training on energy efficient practices and technologies for commercial building technicians. These training products will advance industry expertise towards net-zero energy commercial building goals and will result in a substantial reduction in energy use. The ultimate objective is to develop a workforce that can bring existing commercial buildings up to their energy performance potential and ensure that new commercial buildings do not fall below their expected optimal level of performance. Commercial building equipment technicians participating in this training program will learn how to best operate commercial buildings to ensure they reach their expected energy performance level. The training is a combination of classroom, online and on-site lessons. The Texas Engineering Extension Service (TEEX) developed curricula using subject matter and adult learning experts to ensure the training meets certification requirements and accreditation standards for training these technicians. The training targets a specific climate zone to meets the needs, specialized expertise, and perspectives of the commercial building equipment technicians in that zone. The combination of efficient operations and advanced design will improve the internal built environment of a commercial building by increasing comfort and safety, while reducing energy use and environmental impact. Properly trained technicians will ensure equipment operates at design specifications. A second impact is a more highly trained workforce that is better equipped to obtain employment. Organizations that contributed to the development of the training program include TEEX and the Texas Engineering Experiment Station (TEES) (both members of The Texas A&M University System). TEES is also a member of the Building Commissioning Association. This report includes a description of the project accomplishments, including the course development phases, tasks associated with each phase, and detailed list of the course materials developed. A summary of each year's activities is also included.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Comparison of Various Online Strategies to Account for Interfractional Variations for Pancreatic Cancer

Purpose: To identify practical techniques to address the large interfractional variations for pancreas irradiation by comparing various used/proposed online strategies. Methods and Materials: The daily computed tomography (CT) images acquired using a respiration-gated in-room CT (CTVision; Siemens) for 10 pancreatic cancer patients treated with image guided radiation therapy (IGRT) were analyzed. The contours of the pancreas and organs at risk on each daily CT set were generated by populating from the planning CT using a deformable registration tool (ABAS; Elekta) with manual editing. Nine online strategies were considered: (1) standard IGRT (ie, IGRT with 0-mm additional margin [AM]); (2) IGRT with 2-mm AM; (3) IGRT with 5-mm AM; (4) IGRT with plan renormalized to maintain 95% planning target volume (PTV) coverage; (5) full-scale reoptimization; (6) reoptimization starting from the original plan; (7) segment aperture morphing (SAM) from the original plan, based on PTV shape change; (8) SAM plus segment weight optimization; and (9) reoptimization starting from the SAM plan. One-way analysis of variance was applied to plan qualities for the 9 strategies to assess statistical significance in difference. Results: The 3 IGRT strategies (1-3) lead to either inadequate PTV coverage or higher doses to critical structures, indicating that the additional margins alone are not adequate to account for the changes. The full-scale reoptimization results in the best plan but requires the delineation of several structures, which is time consuming. The SAM strategy (7) was the fastest one, because it requires delineating only 1 structure (target), and its plan quality was comparable to that for the full-scale reoptimization. Conclusion: Online replanning strategies can lead to either reduced organs-at-risk dose and/or improved target coverage as compared with the current practice of IGRT. The SAM-based online replanning is comparable to full-scale reoptimization and is efficient for practical use.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

FINETUNA: fine-tuning accelerated molecular simulations

Abstract Progress towards the energy breakthroughs needed to combat climate change can be significantly accelerated through the efficient simulation of atomistic systems. However, simulation techniques based on first principles, such as density functional theory (DFT), are limited in their practical use due to their high computational expense. Machine learning approaches have the potential to approximate DFT in a computationally efficient manner, which could dramatically increase the impact of computational simulations on real-world problems. However, they are limited by their accuracy and the cost of generating labeled data. Here, we present an online active learning framework for accelerating the simulation of atomic systems efficiently and accurately by incorporating prior physical information learned by large-scale pre-trained graph neural network models from the Open Catalyst Project. Accelerating these simulations enables useful data to be generated more cheaply, allowing better models to be trained and more atomistic systems to be screened. We also present a method of comparing local optimization techniques on the basis of both their speed and accuracy. Experiments on 30 benchmark adsorbate-catalyst systems show that our method of transfer learning to incorporate prior information from pre-trained models accelerates simulations by reducing the number of DFT calculations by 91%, while meeting an accuracy threshold of 0.02 eV 93% of the time. Finally, we demonstrate a technique for leveraging the interactive functionality built in to Vienna ab initio Simulation Package (VASP) to efficiently compute single point calculations within our online active learning framework without the significant startup costs. This allows VASP to work in tandem with our framework while requiring 75% fewer self-consistent cycles than conventional single point calculations. The online active learning implementation, and examples using the VASP interactive code, are available in the open source FINETUNA package on Github.

97 MATHEMATICS AND COMPUTING↗

Learning with Adaptive Conservativeness for Distributionally Robust Optimization: Incentive Design for Voltage Regulation

Information asymmetry between the Distribution System Operator (DSO) and Distributed Energy Resource Aggregators (DERAs) obstructs designing effective incentives for voltage regulation. To capture this effect, we employ a Stackelberg game-theoretic framework, where the DSO seeks to overcome the information asymmetry and refine its incentive strategies by learning from DERA behavior over multiple iterations. We introduce a model-based online learning algorithm for the DSO, aimed at inferring the relationship between incentives and DERA responses. Given the uncertain nature of these responses, we also propose a distributionally robust incentive design model to control the probability of voltage regulation failure and then reformulate it into a convex problem. This model allows the DSO to periodically revise distribution assumptions on uncertain parameters in the decision model of the DERA. Finally, we present a gradient-based method that permits the DSO to adaptively modify its conservativeness level, measured by the size of a Wasserstein metric-based ambiguity set, according to historical voltage regulation performance. The effectiveness of our proposed method is demonstrated through numerical experiments.

adaptation models↗

CASSIS: THE CORNELL ATLAS OF SPITZER/INFRARED SPECTROGRAPH SOURCES

We present the spectral atlas of sources observed in low resolution with the Infrared Spectrograph on board the Spitzer Space Telescope. More than 11,000 distinct sources were extracted using a dedicated algorithm based on the SMART software with an optimal extraction (AdOpt package). These correspond to all 13,000 low-resolution observations of fixed objects (both single source and cluster observations). The pipeline includes image cleaning, individual exposure combination, and background subtraction. Particular attention is given to bad pixel and outlier rejection at the image and spectra levels. Most sources are spatially unresolved so that optimal extraction reaches the highest possible signal-to-noise ratio. For all sources, an alternative extraction is also provided that accounts for all of the source flux within the aperture. CASSIS provides publishable quality spectra through an online database together with several important diagnostics, such as the source spatial extent and a quantitative measure of detection level. Ancillary data such as available spectroscopic redshifts are also provided. The database interface will eventually provide various ways to interact with the spectra, such as on-the-fly measurements of spectral features or comparisons among spectra.

79 ASTRONOMY AND ASTROPHYSICS↗