Search NASA⌕ Search

SEARCH · Search NASA

Results for “BOX MODELS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

Role of Uncertainty Quantification in the Explainability of Large Language Models for the Nuclear Industry

The meteoric rise of generative artificial intelligence (AI) large language models (LLMs) has created an opportunity to utilize them to increase efficiencies in a multitude of industries. While LLMs carry great potential to revolutionize the manner in which work is performed, numerous known deficiencies limit their utility, including the black box nature of the models, the stochastic nature of the response (i.e., presenting the same prompt multiple times results in different responses), and the potential for hallucination. Widespread adoption of LLMs in safety-critical industries such as nuclear will require some form of explainability to assure end users that the LLM’s response to a given query is valid. Model uncertainty is inherently linked to the concepts of trust and explainability, and can be used to identify situations in which the model is insufficiently certain about its answer. Although uncertainty is not enough in and of itself to determine the suitability of an answer—a model can be very certain of an inaccurate answer—it still provides valuable supporting information. Practical methodologies for gauging or quantifying the uncertainty in LLM outputs are presented herein, along with examples based on nuclear-specific prompts.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Novel Approach to PV Inverter Modeling and Simulation Leveraging Experiments, Learning Based Modeling and Co-Simulation: Preprint

Photovoltaic inverter (PV) inverter manufacturers use custom, proprietary control approaches and topologies in their inverter design. Due to this proprietary nature, it is not possible to share EMT domain models for system studies. This research work presents a novel approach in experimental design, high fidelity data collection, use of learning-based modeling, and co-simulation to enhance the PV inverter modeling. We used a 20 kW off-the-shelf grid following PV inverter and subjected the inverter to controlled tests including voltage and frequency step changes, as well as solar irradiance variations. The recorded high frequency data was used in learning-based model training. This learning-based model was imported into an Electromagnetic Transient (EMT) simulation tool using co-simulation techniques to complete the modeling effort and integrate the model into an EMT simulation tool. The three key components in this research work are the design of experimental setup, use of learning-based approach for model development and use of co-simulation to complete the approach. The proposed approach will allow users to develop a model in a really short period of time and achieve reasonable inverter models.

artificial intelligence↗

Coupled aero-hydro-geotech real-time hybrid simulation of offshore wind turbine monopile structures

Real-time hybrid simulation (RTHS) divides a structural system into an analytical and experimental substructure. The former is based on a well-established analytical model while the latter consists of a physical model in the laboratory, for which there is not a well-established analytical model. This paper extends real-time hybrid simulation to monopile-type Offshore Wind Turbines (OWTs) to enable the investigation of their behavior considering the response of pile foundations under operational and more severe conditions. The embedded foundation and surrounding soil of the OWT are modeled physically in a soil box in the laboratory while the remaining parts of the system and loading are modeled analytically. The program OpenFAST, developed by the National Renewable Energy Laboratory (NREL), is linked to the RTHS coordinator to determine the hydrodynamic and aerodynamic loads acting on the OWT, along with modeling the dynamics of the electric power generation equipment and associated controller for the OWT. The RTHS framework along with its initial implementation and validation are described in this paper. RTHSs of a 5 MW OWT subjected to operational and more severe conditions are performed to experimentally validate the framework. The framework offers a realistic approach to investigate the behavior of OWT structures supported on monopiles. Furthermore, this approach accounts for the coupled response of the OWT structure with its foundation, while experimentally capturing the nonlinearities of the soil-foundation interaction in real-time.

17 WIND ENERGY↗

Machine-Learning of Nonlocal Kernels for Anomalous Subsurface Transport from Breakthrough Curves

Anomalous behavior is ubiquitous in subsurface solute transport due to the presence of high degrees of heterogeneity at different scales in the media. Although fractional models have been extensively used to describe the anomalous transport in various subsurface applications, their application is hindered by computational challenges. Simpler nonlocal models characterized by integrable kernels and finite interaction length represent a computationally feasible alternative to fractional models; yet, the informed choice of their kernel functions still remains an open problem. We propose a general data-driven framework for the discovery of optimal kernels on the basis of very small and sparse data sets in the context of anomalous subsurface transport. Using spatially sparse breakthrough curves recovered from fine-scale particle-density simulations, we learn the best coarse-scale nonlocal model using a nonlocal operator regression technique. Predictions of the breakthrough curves obtained using the optimal nonlocal model show good agreement with fine-scale simulation results even at locations and time intervals different from the ones used to train the kernel, confirming the excellent generalization properties of the proposed algorithm. A comparison with trained classical models and with black-box deep neural networks confirms the superiority of the predictive capability of the proposed model.

97 MATHEMATICS AND COMPUTING↗

Critical Infrastructure Classification via CNN-based Modeling and Image Analysis

With recent advances in the fields of satellite imagery and machine learning we now have the ability to develop explainable deep learning models that enhance critical infrastructure analysis. Funded through Idaho National Laboratory’s (INL) Laboratory Directed Research and Development (LDRD) office we are in the process of developing a deep learning model capable of identifying critical infrastructure facilities and embedded features within those facilities. Utilizing current limit of practice techniques in the machine learning areas of explainability and transfer learning our model, once complete, will have the capacity to be used on multiple different imagery data sets and produce results that not only classify critical infrastructure facilities, but also explain why a critical infrastructure facility was classified as a certain type of facility. These advancements eliminate the ‘black box’ approach deep learning models have had in the past, where a user will have to trust the conclusion of a model without understanding what reasoning when into the model’s classification process. They also expand a model’s usefulness, traditionally a deep learning model will have to use the same data set it was originally trained on. Given the long training times of deep learning models this is impractical in a number of scenarios. By utilizing transfer learning advancements, we are eliminating the need to train our model on the same data set it is then run on to classify critical infrastructure facilities. We are also enabling the analysis and classification of data sets that are potentially too small to be divided into a training and testing data set. Once completed this model can provide a foundation to enhanced critical infrastructure analysis, dependency analysis, and potential disaster relief efforts.

97 MATHEMATICS AND COMPUTING↗

Semantic Search with Sentence-BERT for Design Information Retrieval

Managing and referencing design knowledge is a critical activity in the design process. However, reliably retrieving useful knowledge can be a frustrating experience for users of knowledge management systems due to inherent limitations of standard keyword-based searches. In this research, we consider the task of retrieving relevant lessons learned from the NASA Lessons Learned Information System (LLIS). To this end, we apply a state-of-the-art natural language processing (NLP) technique for information retrieval: semantic search with sentence-BERT, which is a modification of a Bidirectional Encoder Representations from Transformers (BERT) model that uses siamese and triplet network architectures to obtain semantically meaningful sentence embeddings. While the pretrained sBERT model shows excellent out-of-the-box performance, we further fine-tune the model on data from the LLIS so that it learns on design engineering-relevant vocabulary. We quantify the improvement in query results using both standard sBERT and fine-tuned sBERT over the LLIS’s built-in keyword search. Additionally, we demonstrate a use case for the query system by searching for lessons learned relevant to specific requirements from a NASA project as part of a broader knowledge management and retrieval system. Results indicate that applying state-of-the-art natural language processing techniques, especially when fine-tuned using engineering data, to design information retrieval tasks shows significant promise in modernizing design knowledge management systems.

Hannah S. Walsh↗

A Portfolio Approach to Massively Parallel Bayesian Optimization

One way to reduce the time of conducting optimization studies is to evaluate designs in parallel rather than just one-at-a-time. For expensive-to-evaluate black-boxes, batch versions of Bayesian optimization have been proposed. They work by building a surrogate model of the black-box to simultaneously select multiple designs via an infill criterion. Still, despite the increased availability of computing resources that enable large-scale parallelism, the strategies that work for selecting a few tens of parallel designs for evaluations become limiting due to the complexity of selecting more designs. It is even more crucial when the black-box is noisy, necessitating more evaluations as well as repeating experiments. Here we propose a scalable strategy that can keep up with massive batching natively, focused on the exploration/exploitation trade-off and a portfolio allocation. We compare the approach with related methods on noisy functions, for mono and multi-objective optimization tasks. These experiments show orders of magnitude speed improvements over existing methods with similar or better performance.

97 MATHEMATICS AND COMPUTING↗

A Multi-Objective Bayesian Optimization Approach Using the Weighted Tchebycheff Method

Abstract Bayesian optimization (BO) is a low-cost global optimization tool for expensive black-box objective functions, where we learn from prior evaluated designs, update a posterior surrogate Gaussian process model, and select new designs for future evaluation using an acquisition function. This research focuses upon developing a BO model with multiple black-box objective functions. In the standard multi-objective (MO) optimization problem, the weighted Tchebycheff method is efficiently used to find both convex and non-convex Pareto frontiers. This approach requires knowledge of utopia values before we start optimization. However, in the BO framework, since the functions are expensive to evaluate, it is very expensive to obtain the utopia values as a prior knowledge. Therefore, in this paper, we develop a MO-BO framework where we calibrate with multiple linear regression (MLR) models to estimate the utopia value for each objective as a function of design input variables; the models are updated iteratively with sampled training data from the proposed MO-BO. These iteratively estimated mean utopia values are used to formulate the weighted Tchebycheff MO acquisition function. The proposed approach is implemented in two numerical test examples and one engineering design problem of optimizing thin tube geometries under constant loading of temperature and pressure, with minimizing the risk of creep-fatigue failure and design cost, along with risk-based and manufacturing constraints. Finally, the model accuracy with frequentist, Bayesian and without MLR-based calibration are compared to true Pareto solutions.

Engineering↗

Global dynamic modeling of a transmission system

The work performed on global dynamic simulation and noise correlation of gear transmission systems at the University of Akron is outlined. The objective is to develop a comprehensive procedure to simulate the dynamics of the gear transmission system coupled with the effects of gear box vibrations. The developed numerical model is benchmarked with results from experimental tests at NASA Lewis Research Center. The modal synthesis approach is used to develop the global transient vibration analysis procedure used in the model. Modal dynamic characteristics of the rotor-gear-bearing system are calculated by the matrix transfer method while those of the gear box are evaluated by the finite element method (NASTRAN). A three-dimensional, axial-lateral coupled bearing model is used to couple the rotor vibrations with the gear box motion. The vibrations between the individual rotor systems are coupled through the nonlinear gear mesh interactions. The global equations of motion are solved in modal coordinates and the transient vibration of the system is evaluated by a variable time-stepping integration scheme. The relationship between housing vibration and resulting noise of the gear transmission system is generated by linear transfer functions using experimental data. A nonlinear relationship of the noise components to the fundamental mesh frequency is developed using the hypercoherence function. The numerically simulated vibrations and predicted noise of the gear transmission system are compared with the experimental results from the gear noise test rig at NASA Lewis Research Center. Results of the comparison indicate that the global dynamic model developed can accurately simulate the dynamics of a gear transmission system.

Choy, F. K.↗

Performance evaluation of automated data-driven feature extraction and selection methods for practical and scalable building energy consumption prediction models

Here, this study quantifies the impact of automated feature engineering methods (feature extraction and selection) on the quality and accuracy of machine learning models that predict building energy consumption. The case study compares model performance for three main scenarios: baseline (no feature extraction and selection), feature extraction only, and feature extraction combined with feature selection (filter and/or wrapper methods) for fully trained machine learning models for 200 metered/sub-metered energy measurements across 118 real buildings. For consistency, the same machine learning model architecture (a black box deep learning neural network with probabilistic forecast output) was used for all scenarios. Based on results, all feature engineering methods provided noticeable prediction accuracy improvements (e.g., 29%-68% median prediction improvement) compared to baseline scenarios. However, in this application, feature selection methods provide little practical value due to their limited performance gains and high computational cost. Smarter algorithm development supported by better computational environments will be needed before feature selection methods can reliably and efficiently improve predictive model performance.

97 MATHEMATICS AND COMPUTING↗

Materials Graph Library (MatGL), an open-source graph deep learning library for materials science and chemistry

Graph deep learning models, which incorporate a natural inductive bias for atomic structures, are of immense interest in materials science and chemistry. Here, we introduce the Materials Graph Library (MatGL), an open-source graph deep learning library for materials science and chemistry. Built on top of the popular Deep Graph Library (DGL) and Python Materials Genomics (Pymatgen) packages, MatGL is designed to be an extensible “batteries-included” library for developing advanced model architectures for materials property predictions and interatomic potentials. At present, MatGL has efficient implementations for both invariant and equivariant graph deep learning models, including the Materials 3-body Graph Network (M3GNet), MatErials Graph Network (MEGNet), Crystal Hamiltonian Graph Network (CHGNet), TensorNet and SO3Net architectures. MatGL also provides several pre-trained foundation potentials (FPs) with coverage of the entire periodic table, and property prediction models for out-of-box usage, benchmarking and fine-tuning. Finally, MatGL integrates with PyTorch Lightning to enable efficient model training.

chemistry↗

Quantifying the impact of sub-grid surface wind variability on sea salt and dust emissions in CAM5

This paper evaluates the impact of sub-grid variability of surface wind on sea salt and dust emissions in the Community Atmosphere Model version 5 (CAM5). The basic strategy is to calculate emission fluxes multiple times, using different wind speed samples of a Weibull probability distribution derived from model-predicted grid-box mean quantities. In order to derive the Weibull distribution, the sub-grid standard deviation of surface wind speed is estimated by taking into account four mechanisms: turbulence under neutral and stable conditions, dry convective eddies, moist convective eddies over the ocean, and air motions induced by mesoscale systems and fine-scale topography over land. The contributions of turbulence and dry convective eddy are parameterized using schemes from the literature. Wind variabilities caused by moist convective eddies and fine-scale topography are estimated using empirical relationships derived from an operational weather analysis data set at 15 km resolution. The estimated sub-grid standard deviations of surface wind speed agree well with reference results derived from 1 year of global weather analysis at 15 km resolution and from two regional model simulations with 3 km grid spacing. The wind-distribution-based emission calculations are implemented in CAM5. In terms of computational cost, the increase in total simulation time turns out to be less than 3 %. Simulations at 2° resolution indicate that sub-grid wind variability has relatively small impacts (about 7 % increase) on the global annual mean emission of sea salt aerosols, but considerable influence on the emission of dust. Among the considered mechanisms, dry convective eddies and mesoscale flows associated with topography are major causes of dust emission enhancement. With all the four mechanisms included and without additional adjustment of uncertain parameters in the model, the simulated global and annual mean dust emission increase by about 50 % compared to the default model. By tuning the globally constant dust emission scale factor, the global annual mean dust emission, aerosol optical depth, and top-of-atmosphere radiative fluxes can be adjusted to the level of the default model, but the frequency distribution of dust emission changes, with more contribution from weaker wind events and less contribution from stronger wind events. Lastly, in Africa and Asia, the overall frequencies of occurrence of dust emissions increase, and the seasonal variations are enhanced, while the geographical patterns of the emission frequency show little change.

58 GEOSCIENCES↗

Global and Local Stress Analyses of McDonnell Douglas Stitched/RFI Composite Wing Stub Box

This report contains results of structural analyses performed in support of the NASA structural testing of an all-composite stitched/RFI (resin film infusion) wing stub box. McDonnell Douglas Aerospace Company designed and fabricated the wing stub box. The analyses used a global/local approach. The global model contains the entire test article. It includes the all-composite stub box, a metallic load-transition box and a metallic wing-tip extension box. The two metallic boxes are connected to the inboard and outboard ends of the composite wing stub box, respectively. The load-transition box was attached to a steel and concrete vertical reaction structure and a load was applied at the tip of the extension box to bend the wing stub box upward. The local model contains an upper cover region surrounding three stringer runouts. In that region, a large nonlinear deformation was identified by the global analyses. A more detailed mesh was used for the local model to obtain more accurate analysis results near stringer runouts. Numerous analysis results such as deformed shapes, displacements at selected locations, and strains at critical locations are included in this report.

Wang, John T.↗

Enhanced Oblique Decision Tree Enabled Policy Extraction for Deep Reinforcement Learning in Power System Emergency Control

Deep reinforcement learning (DRL) algorithms have successfully solved many challenging problems in various power system control scenarios. However, their decision-making process is usually regarded as black-boxes. Furthermore, how DRL models interact with human intelligence remains an open problem. Thus, this paper proposes a policy extraction framework to extract a complex DRL model into an explainable policy. This framework includes three parts: 1) DRL training and data generation. We train an agent for a specific control task and generate data, which contains the control policy of the agent. 2) Policy extraction. We propose an information gain rate based weighted oblique decision tree (IGR-WODT) for DRL policy extraction. 3) Policy evaluation. We define three metrics to evaluate the performance of the proposed approach. A case study for the under-voltage load shedding problem shows that the IGR-WODT presents a performance enhancement compared with DRL, weighted oblique decision tree, and univariate decision tree. The proposed policy extraction method could provide an intuitive explanation of the neural network decision-making process to the dispatchers when making final decisions on power grid operation. Also, the resulted rule-based controller could replace the deep neural network-based controller in many field edge devices with limited computing resources, providing comparable performance.

deep reinforcement learning↗

An analytic theory for the degree of Arctic Amplification

Arctic Amplification (AA), the amplified surface warming in the Arctic relative to the global mean, is a robust and impactful feature of climate change. While the basic physical picture of AA has been depicted, a clear understanding of how the degree of AA is determined has not been established. Here, by deciphering the intricate role of atmospheric heat transport (AHT), we build a two-box energy-balance model of AA and derive that the degree of AA is a simple nonlinear function of the Arctic and global feedbacks, the meridional heterogeneity in radiative forcing, and the partial sensitivities of AHT to global mean warming and meridional warming gradient. The formula captures the varying degree of AA in individual climate models and attributes the variation to specific physical factors. It further conveys a concise picture of how essential physics mutually determine the degree of AA and limit the range within 1.5~3.5. Our results articulate AHT as both forcing and feedback to AA, highlighting its partial sensitivities instead of total change as the key parameters for understanding AA. We also find that the effect of lapse rate feedback, a widely-recognized major contributor to AA, is fully offset by the effect of water vapor feedback.

54 ENVIRONMENTAL SCIENCES↗

Ion-acoustic shocks with self-regulated ion reflection and acceleration

Here, an analytic solution describing an ion-acoustic collisionless shock, self-consistently with the evolution of shock-reflected ions, is obtained. The solution extends the classic soliton solution beyond a critical Mach number, where the soliton ceases to exist because of the upstream ion reflection. The reflection transforms the soliton into a shock with a trailing wave and a foot populated by the reflected ions. The solution relates parameters of the entire shock structure, such as the maximum and minimum of the potential in the trailing wave, the height of the foot, as well as the shock Mach number, to the number of reflected ions. This relation is resolvable for any given distribution of the upstream ions. In this paper, we have resolved it for a simple “box” distribution. Two separate models of electron interaction with the shock are considered. The first model corresponds to the standard Boltzmannian electron distribution in which case the critical shock Mach number only insignificantly increases from M ≈ 1:6 (no ion reflection) to M ≈ 1:8 (substantial reflection). The second model corresponds to adiabatically trapped electrons. They produce a stronger increase, from M ≈ 3:1 to M ≈ 4:5 . The shock foot that is supported by the reflected ions also accelerates them somewhat further. A self-similar foot expansion into the upstream medium is described analytically.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Semi-analytic solutions to the Noh problem with a black box EoS

The objective of this paper is to derive a method of constructing semi-analytic solutions to the Noh problem when the equation of state is a black box. Such solutions can be used for verification tests of hydrodynamics codes. We present the underlying theory, the method for finding solutions, and several examples of derived semi-analytic solutions. We end by performing a classic verification convergence test comparing numerical results from a hydrodynamics code against a non-trivial semi-analytic solution.

97 MATHEMATICS AND COMPUTING↗

A survey of nonlinear robust optimization

Robust optimization (RO) has attracted great attention from the optimization community over the past decade. RO is dedicated to solving optimization problems subject to uncertainty: design constraints must be satisfied for all the values of the uncertain parameters within a given uncertainty set. Uncertainty sets may be modeled as deterministic sets (boxes, polyhedra, ellipsoids), in which case the RO problem may be reformulated via worst-case analysis, or as families of distributions. The challenge of RO is to reformulate or approximate robust constraints so that the uncertain optimization problem is transformed into a tractable deterministic optimization problem. Most reformulation methods assume linearity of the robust constraints or uncertainty sets of favorable shape, which represents only a fraction of real-world applications. This survey addresses nonlinear RO and includes problem formulations and applications, solution approaches, and available software with code samples.

97 MATHEMATICS AND COMPUTING↗