Knowledge Graph Embedding using Large Language Models for COVID-19
CoVID-19 (cord19) open data source for training knowledge graph with LLM
Cord19↗
SEARCH · Search NASA
Results for “Knowledge Modeling”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Quantifying model prediction sensitivity to model-form uncertainty
Computational and mathematical models are essential to understanding complex systems and phenomena. However, when developing such models, limited knowledge and/or resources necessitates the use of simplifying assumptions. It is therefore crucial to quantify the impact of such simplifying assumptions on the reliability and accuracy of resulting model predictions. This work develops a first-of-its-kind approach to quantify the impact of physics modeling assumptions on predictions. Here, we leverage the emerging field of model-form uncertainty (MFU) representations, which are parameterized modifications to modeling assumptions, in combination with grouped Sobol’ indices to quantitatively measure an assumption’s importance. Specifically, we compute the grouped Sobol’ index for the MFU representation’s parameters as a single importance measure of the assumption for which the MFU representation characterizes uncertainty. To ensure this approach is robust to the subjective choice of how to parameterize a MFU representation, we establish bounds for the difference between sensitivity results for two different MFU representations based on differences in model prediction statistics. The capabilities associated with this approach are demonstrated on three exemplar problems: an upscaled subsurface contaminant transport problem, ablation modeling for hypersonic flight, and nuclear waste repository modeling. We found that our grouped approach is able to assess the impact of modeling assumptions on predictions and offers computational advantages over classical Sobol’ index computation while providing more interpretable results.
97 MATHEMATICS AND COMPUTING↗
Development and assessment of a reactor system prognosis model with physics-guided machine learning
Autonomous control systems provide recommendations to help operators in decision-making during plant operations ranging from normal operation to accident management. An important step of autonomous control is prognosis. In nuclear engineering domain, prognosis is the process of predicting future conditions of a system or equipment based on present signs and symptoms of a fault. The prognosis model allows predicting future reactor states for possible candidate control strategies so that the outcomes can be evaluated to determine the best control strategy. The prognosis model requires representing direct relationships between the symptoms and the predictions. In nuclear engineering, computational simulations are approximate representations of the operation of the real system. However, prognosis with computational simulations requires high computation power and time due to possible large number of scenarios. Necessary computation resources can be reduced with machine learning (ML) approach for fast predictions by building a surrogate function using the simulation data. A critical issue is, ML models are ignorant of physical knowledge, and these models approximate statistical relationships between the system variables. This ignorance can produce results that are inconsistent with physical laws, even if an optimal result is achieved from a mathematical point of view. Physics-guided machine learning (PGML) is an approach to tackle this issue. Here, this work formulates and illustrates a framework to guide development and assessment of the ML-based prognosis model for autonomous control systems. The development of the prognosis model considers the training of a ML model which consists of optimizing many aspects of the ML approach. The assessment of the prognosis model considers training data limitations and uncertainties of the ML approach. Prognosis models with standalone ML and PGML are developed and assessed on the loss-of-flow scenario of Experimental Breeder Reactor II. The results indicate that PGML based prognosis model has the best performance compared to other prognosis models.
21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
Posterior Regularized Bayesian Neural Network
Traditional NNs often lack the ability for uncertainty quantification. Bayesian NNs(BNNs) could help measure the confidence level by using distributions in NNs modeling. Besides, knowledge is commonly available and could improve the performance of BNNs if it can be properly incorporated. In this work, we propose a novel Posterior-Regularized BNN(PR-BNN) model by incorporating soft and hard constraints as a posterior regularization term. We also propose an augmented Lagrangian method and stochastic optimization algorithm for efficient updating via Monte Carlo sampling. The simulations and case studies in solar energy prediction have shown the performance improvement of the proposed model over traditional BNNs.
14 SOLAR ENERGY↗
Leveraging transfer learning and leaf spectroscopy for leaf trait prediction with broad spatial, species, and temporal applicability
Accurate and reliable prediction of leaf traits is crucial for understanding plant adaptations to environmental variation, monitoring terrestrial ecosystems, and enhancing comprehension of functional diversity and ecosystem functioning. Currently, various approaches (e.g., statistical, physical models) have been developed to estimate leaf traits through hyperspectral remote sensing and leaf spectroscopy. However, the absence of high-performing, transferable, and stable models across various domains of space, plant functional types (PFTs) and seasons hinder our ability to quantify and comprehend spatiotemporal variations in leaf traits. This study proposes robust and highly transferable models for better predicting leaf traits with hyperspectral reflectance. Initially, three datasets were assembled, pairing common leaf traits — chlorophyll (Chla+b), carotenoids (Ccar), leaf mass per area (LAM), equivalent water thickness (EWT) — with leaf spectra measurements collected across diverse geographic locations in the U.S. and Europe, PFTs, and seasons. Measurements were acquired using spectroradiometers (e.g., ASD FieldSpec 3/4/Pro and SVC HR-1024i) with integrating spheres, leaf clips, and contact probes. Here, we then developed transfer learning-based hybrid models that incorporated the domain knowledge of radiative transfer models (RTMs) through pretraining processes and were well-constrained by fine-tuning with field measurements. Through comparison with other state-of-the-art statistical models, including partial-least squares regression (PLSR) and Gaussian Process Regression (GPR), as well as pure physical models, we found that the proposed transfer learning models achieved better predictive performance and higher transferability. Specifically, compared to other statistical models and pure RTMs, the transfer learning model exhibited higher coefficient of determination (R 2 ) values with range of 0.01 to 0.79, lower normalized root mean square error (NRMSE) with range of 0.06 % to 33.25 % in model performance. Additionally, the models exhibited improved transferability, with higher R 2 values range from 0.04 to 0.32, lower NRMSE range from 0.08 % to 30.81 %. The findings underscore that transfer learning models through integrating domain knowledge from RTMs and limited observations, can harness the advantages of both RTMs and statistical models and serve as a promising approach for effectively predicting leaf traits.
59 BASIC BIOLOGICAL SCIENCES↗
A Roadmap for a Lightning Modeling Grand Challenge
This document is a roadmap for building an interconnected model of the physical processes that produce a lightning discharge, and its observable optical and radio signals. We call this a Lightning Modeling Grand Challenge, recognizing that significant effort and coordination of human and financial resources is required to realize the capability. The roadmap serves to outline the coordination of resources necessary to enable stitching together existing knowledge and model components to make a lightning prediction, and to test these predictions with observations. Such a capability does not currently exist. The roadmap is motivated not only by a spirit of scientific inquiry, but by practical challenges faced by US Federal and societal stakeholders. Advancements in lightning observations have outpaced our tests of integrated understanding, leaving many stakeholders unsure how to design their missions to properly detect and discriminate lightning, and unsure how to apply the sometimes-disagreeing lightning signals from diverse instruments. The time is right to connect existing theories and models to support stakeholders in understanding the signals they observe, for needs as diverse as climate monitoring, national security, weather forecasting, public safety, and protection of natural and built environments. The roadmap’s two main technical sections describe the components of a linked physical model, followed by a description of models of lightning signals and sensors that are driven by outputs from the physical model. The goal is to predict the time-varying physical properties of lightning that are self-consistent with the thunderstorm’s structure and dynamics. These lightning signals then propagate through the storm, with realistic dispersion and attenuation, to receivers on the ground or in space. At a high level, the model begins with weather (cloud) model output, including explicit prediction of the electrification of cloud particles. The cloud’s electrical structure drives a model of lightning physics, from initiation, through channel development, and discharges along those channels. Key lightning parameters, such as the temperature and currents in the channel, and their space and time distribution, are then used to produce optical and electromagnetic signal sources that propagate to modeled receivers. This architecture therefore generates a dataset suitable for comparison to existing and envisioned observing systems. The need for additional measurements and field campaigns to support model development is described. In each model sub-component, inputs, outputs, uncertainties, evaluation methods, and next steps are summarized, interleaved with references to the scientific literature. Identifying boundaries between the model sub-components aids in segmenting an integrated, complex model into practical work packages and system sub-components, allowing a diverse team to contribute and maintain the system. We estimate that at least five years of effort and a $\$$10M initial investment is necessary to make a significant step forward. Mechanisms to facilitate community coordination, including annual workshops and open-source code repositories, are described.
54 ENVIRONMENTAL SCIENCES↗
Race conditions and data partitioning: risks posed by common errors to reproducible parallel simulations
When parallel algorithms for simulation were introduced in the 1970s, their development and use interested only experts in parallel computation. This circumstance changed as multi-core processors became commonplace, putting a parallel computer into the hands of every modeler. A natural outcome is growing interest in parallel simulation among persons not intimately familiar with parallel computing. At the same time, parallel simulation tools continue to be developed with the implicit assumption that the modeler is knowledgeable about parallel programming. The unintended consequence is a rapidly growing number of users of parallel simulation tools that are unlikely to recognize when the interaction of race conditions, partitioning strategies, and simultaneous action in their simulation models make results non-reproducible, thereby calling into question the validity of conclusions drawn from the simulation data. Here, we illustrate the potential dangers of exposing parallel algorithms to users who are not experts in parallel computation with example models constructed using existing parallel simulation tools. By doing so, we hope to refocus tool developers on usability, even if this new focus incurs loss of some performance.
97 MATHEMATICS AND COMPUTING↗
An adaptive knowledge-based data-driven approach for turbulence modeling using ensemble learning technique under complex flow configuration: 3D PWR sub-channel with DNS data
This work describes a new approach to increase the accuracy of Reynolds-averaged Navier–Stokes (RANS) in modeling turbulence flow leveraging the machine learning technique. Traditionally, different turbulence models for Reynolds stress are developed for different flow patterns based on human knowledge. Each turbulence model has a certain application domain and prediction uncertainty. In recent years, with the rapid improvements of machine learning techniques, researchers start to develop an approach to compensate for the prediction discrepancy of traditional turbulence models with statistical models and data. However, the approach has deficiencies in several aspects. For example, the amount of human knowledge introduced to the statistical model couldn’t be controlled, which makes the statistical model learn from a very naïve stage and limits its application. In this work, a new approach is developed to address those deficiencies. Here, the new approach uses the “ensemble learning” technique to control the amount of human knowledge introduced into the statistical model. Therefore, the new approach could be adaptive to the multiple application domains. In conclusion, according to the results of case study, the new approach shows higher accuracy than both traditional turbulence models and the previous machine learning approach.
42 ENGINEERING↗
Reducing Model Uncertainty of Climate Change Impacts on High Latitude Carbon Assimilation
The Arctic Boreal Region (ABR) has a large impact on global vegetation-atmosphere interactions and is experiencing markedly greater warming than the rest of the planet, a trend that is projected to continue with anticipated future emissions of CO 2 . The ABR is a significant source of uncertainty in estimates of carbon uptake in terrestrial biosphere models (TBMs) such that reducing this uncertainty is critical for more accurately estimating global carbon cycling and understanding the response of the region to global change. Process representation and parameterization associated with gross primary productivity (GPP) drives a large amount of this model uncertainty, particularly within the next 50 years, where the response of existing vegetation to climate change will dominate estimates of GPP for the region. Furthermore, we review our current understanding and model representation of GPP in northern latitudes, focusing on vegetation composition, phenology and physiology, and consider how climate change alters these three components. We highlight challenges in the ABR for predicting GPP, but also focus on the unique opportunities for advancing knowledge and model representation, particularly through the combination of remote sensing and traditional boots-on-the-ground science.
54 ENVIRONMENTAL SCIENCES↗
Redshift space power spectrum beyond Einstein-de Sitter kernels
Abstract We develop a framework to compute the redshift space power spectrum (PS), with kernels beyond Einstein-de Sitter (EdS), that can be applied to a wide variety of generalized cosmologies. We build upon a formalism that was recently employed for standard cosmology in Chen, Vlah & White (2020), and utilize an expansion of the density-weighted velocity moment generating function that explicitly separates the magnitude of the k-modes and their angle to the line-of-sight direction dependencies. We compute the PS for matter and biased tracers to 1-loop Perturbation Theory (PT) and show that the expansion has a correct infrared and ultraviolet behavior, free of unwanted divergences. We also add Effective Field Theory (EFT) counterterms, necessary to account for small-scale contributions to PT, and employ an IR-resummation prescription to properly model the smearing of the BAO due to large scale bulk flows within Standard-PT. To demonstrate the applicability of our formalism, we apply it on the ΛCDM and the Hu-Sawicki f(R) models, and compare our numerical results against the elephant suite of N-body simulations, finding very good agreement up to k = 0.27 Mpc -1 h at z = 0.5 for the first three non-vanishing Legendre multipoles of the PS. To our knowledge, the model presented in this work is the most accurate theoretical EFT-PT for modified gravity to date, being the only one that accounts for beyond linear local biasing in redshift-space. Hence, we argue our RSD modeling is a promising tool to construct theoretical templates in order to test deviations from ΛCDM using real data obtained from the next stage of cosmological surveys such as DESI and LSST.
Astronomy & Astrophysics↗
Ontologies for Intelligent Data Science
As anyone even vaguely aware of current technology can tell you, machine learning (ML) and artificial intelligence (AI) have made exceptional breakthroughs in recent years. Generative artificial intelligence (GAI) emerged circa 2022 dominated by Large Language Models (LLMs) and generative tools for images emerged at about the same time.
96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
Insights into Slip-Rate Time Functions, Rupture Parameter Correlations, and Ground Motions from Validated Multicycle Earthquake Ruptures
Earthquake strong-motion predictions using kinematic source modeling require knowledge of the slip-rate functions (SRFs) along the rupture and their distinct characteristics in asperities, background (off-asperity) areas and near the surface. Here, in this study we analyzed SRFs from well-validated, self-consistent, and fully dynamic rupture models from earthquake cycles obeying a rate-and-state friction law, from our companion study (Galvez et al., 2021). The shapes of SRFs in asperities are well described by the regularized Yoffe function (RYF), which has only two parameters: rise time T r and smoothing time T s , which control the generation of long- and short-period ground motions, respectively. In background areas, we demonstrate that, in addition to the primary rupture, multiple secondary ruptures may also nucleate from rupture heterogeneities related to asperities, resulting in SRFs with multiple peaks. Because it is impossible to fit a multiple-peak SRF by the single-peak RYF, we describe SRFs in background areas in an effective way by fitting their amplitude spectra with the RYF spectra. Such spectrally effective RYFs capture salient aspects of seismic-wave generation and can be used in rupture generators for strong motion prediction. We found that small T s values correlate with small characteristic weakening distances, large peak slip rates (PSRs), and large rupture velocities. T r values are larger in background areas and smaller in asperities. Within the shallow aseismic zone, T s values approximately quadruple whereas T r values approximately double. Because of this dominant T s increase, PSR values decrease in the near-surface zone. These features indicate that the generation of strong motions by the near-surface portions of the rupture is negligible in the studied scenarios.
Geosciences↗
Heavy-Duty Low-Temperature and Diesel Combustion & Heavy-Duty Combustion Modeling (FY 2018 Annual Progress Report)
Regulatory drivers and market demands for lower pollutant emissions, lower carbon dioxide emissions, and lower fuel consumption motivate the development of clean and fuel-efficient engine operating strategies. Most current production engines use a combination of both in-cylinder and exhaust emission control strategies to achieve these goals. The emissions and efficiency performance of in-cylinder strategies depend strongly on flow and mixing processes associated with fuel injection. Both heavy- and light-duty engine/vehicle manufacturers use multiple-injection strategies to reduce noise, emissions, and fuel consumption. For both conventional and low-temperature diesel combustion, the state of knowledge and modeling tools for multiple injections are far less advanced than for single-injection strategies. Engine efficiency is limited to some degree by tradeoffs that must be accepted to meet particulate matter (including soot) emissions limits. Recent work on this project has filled some knowledge gaps on soot oxidation with multiple injections, and the current work for Fiscal Year (FY) 2018 addresses knowledge gaps on soot formation for multiple injections. While total in-cylinder soot is readily measured, discerning formation from oxidation is difficult. The FY 2018 experiments are designed to create in-cylinder conditions at the threshold of soot formation, where processes that affect soot formation can be more readily discerned. Soot formation pathways under such conditions are fraught with uncertainties, and soot models significantly overpredict polyaromatic hydrocarbon (PAH) and soot, so experimental data at these conditions will provide much needed data for improvements to PAH and soot models.
02 PETROLEUM↗
On the prediction of critical heat flux using a physics-informed machine learning-aided framework
The critical heat flux (CHF) corresponding to the departure from nucleate boiling (DNB) crisis is essential to the design and safety of a two-phase flow boiling system. Despite the abundance of predictive tools available to the thermal engineering community, the path for an accurate, robust CHF model remains elusive due to lack of consensus on the DNB triggering mechanism. This work aims to apply a physics-informed machine learning (ML)-aided hybrid framework to achieve superior predictive capabilities. Such a hybrid approach takes advantage of existing understanding in the field of interest (i.e., domain knowledge) and uses ML to capture undiscovered information from the mismatch between the actual and domain knowledge-predicted target. A detailed case study is carried out with an extensive DNB-specific CHF database to demonstrate (1) the improved performance of the hybrid approach as compared to traditional domain knowledge-based models, and (2) the hybrid model’s superior generalization capabilities over standalone ML methods across a wide range of flow conditions. The hybrid framework could also readily extend its applicability domain and complexity on the fly, showing an elevated level of flexibility and robustness. Based on the case study conclusions, the window-type extrapolation mapping methodology is further proposed to better inform high-cost experimental work.
42 ENGINEERING↗
Model Assumptions and Data Characteristics: Impacts on Domain Adaptation in Building Segmentation
Studies on domain adaptation (DA) for remote sensing (RS) imagery analysis lack consistency in selection and description of evaluation scenarios. Without properly characterizing datasets, model assumptions, and evaluation scenarios, it is difficult to objectively compare DA methods and reach conclusions about their suitability across different applications. With this motivation, this work seeks to empirically assess to which extent the interaction between data characteristics and model assumptions influences the effectiveness of DA methods. Using the widely explored task of building footprint segmentation as a case study, we perform a large-scale study across over 200 DA scenarios that include variations across view angles, areas observed, and sensors used for data acquisition. Rather than adopting different model architectures or optimization criteria, we contrast the performances of two DA methods based on adversarial learning that differ only in their assumptions about source and target domains. Informed by metadata and data characteristics unveiled using traditional computer vision (CV) techniques as well as pretrained deep models, we provide a detailed meta-analysis of experiments highlighting the importance of accurately considering data assumptions for DA in RS segmentation tasks. As demonstrated by a “cherry-picking” exercise, different claims regarding which model is best could be made by selecting different subsets of evaluation scenarios. While well-calibrated assumptions can be beneficial, mismatching assumptions can lead to negative biases in DA applications. Furthermore, this study intends to motivate the community toward more consistent evaluation protocols while providing recommendations and insights toward creating novel benchmark datasets, documenting data characteristics, application-specific knowledge, and model assumptions.
42 ENGINEERING↗
Knowledge-informed deep learning for hydrological model calibration: an application to Coal Creek Watershed in Colorado
Abstract. Deep learning (DL)-assisted inverse mapping has shown promise in hydrological model calibration by directly estimating parameters from observations. However, the increasing computational demand for running the state-of-the-art hydrological model limits sufficient ensemble runs for its calibration. In this work, we present a novel knowledge-informed deep learning method that can efficiently conduct the calibration using a few hundred realizations. The method involves two steps. First, we determine decisive model parameters from a complete parameter set based on the mutual information (MI) between model responses and each parameter computed by a limited number of realizations (∼50). Second, we perform more ensemble runs (e.g., several hundred) to generate the training sets for the inverse mapping, which selects informative model responses for estimating each parameter using MI-based parameter sensitivity. We applied this new DL-based method to calibrate a process-based integrated hydrological model, the Advanced Terrestrial Simulator (ATS), at Coal Creek Watershed, CO. The calibration is performed against observed stream discharge (Q) and remotely sensed evapotranspiration (ET) from the water year 2017 to 2019. Preliminary MI analysis on 50 realizations resulted in a down-selection of 7 out of 14 ATS model parameters. Then, we performed a complete MI analysis on 396 realizations and constructed the inverse mapping from informative responses to each of the selected parameters using a deep neural network. Compared with calibration using observations covering all time steps, the new inverse mapping improves parameter estimations, thus enhancing the performance of ATS forward model runs. The Nash–Sutcliffe efficiency (NSE) of streamflow predictions increases from 0.53 to 0.8 when calibrating against Q alone. Using ET observations, on the other hand, does not show much improvement on the performance of ATS modeling mainly due to both the uncertainty of the remotely sensed product and the insufficient coverage of the model ET ensemble in capturing the observation. By using observed Q only, we further performed a multiyear analysis and show that Q is best simulated (NSE > 0.8) by including in the calibration the dry-year flow dynamics that show more sensitivity to subsurface characteristics than the other wet years. Moreover, when continuing the forward runs till the end of 2021, the calibrated models show similar simulation performances during this evaluation period as the calibration period, demonstrating the ability of the estimated parameters in capturing climate sensitivity. Our success highlights the importance of leveraging data-driven knowledge in DL-assisted hydrological model calibration.
54 ENVIRONMENTAL SCIENCES↗
Progressive transfer learning for advancing machine learning-based reduced-order modeling
Abstract To maximize knowledge transfer and improve the data requirement for data-driven machine learning (ML) modeling, a progressive transfer learning for reduced-order modeling (p-ROM) framework is proposed. A key concept of p-ROM is to selectively transfer knowledge from previously trained ML models and effectively develop a new ML model(s) for unseen tasks by optimizing information gates in hidden layers. The p-ROM framework is designed to work with any type of data-driven ROMs. For demonstration purposes, we evaluate the p-ROM with specific Barlow Twins ROMs (p-BT-ROMs) to highlight how progress learning can apply to multiple topological and physical problems with an emphasis on a small training set regime. The proposed p-BT-ROM framework has been tested using multiple examples, including transport, flow, and solid mechanics, to illustrate the importance of progressive knowledge transfer and its impact on model accuracy with reduced training samples. In both similar and different topologies, p-BT-ROM achieves improved model accuracy with much less training data. For instance, p-BT-ROM with four-parent (i.e., pre-trained models) outperforms the no-parent counterpart trained on data nine times larger. The p-ROM framework is poised to significantly enhance the capabilities of ML-based ROM approaches for scientific and engineering applications by mitigating data scarcity through progressively transferring knowledge.
97 MATHEMATICS AND COMPUTING↗
Systems Analysis Approach to Polyethylene Terephthalate and Olefin Plastics Supply Chains in the Circular Economy: A Review of Data Sets and Models
The environmental and economic impacts of implementing a circular economy in plastic waste supply chains are not well understood. The proposed systems analysis framework assesses environmental, social, and economic impacts of plastic waste supply chains in a circular economy. The first objective of this article is to identify datasets, models and knowledge gaps associated with waste plastic supply chain processes, mainly in the U.S. Our literature review indicated that the best datasets exist for virgin plastic resin production, mechanical recycling, landfilling, and incineration, with materials recovery facility being intermediate, and with chemical recycling the lowest. The second objective of this article is to develop an illustrative application of the framework by conducting a preliminary systems analysis of PET bottles with closed-loop recycling. Here, the preliminary systems analysis of PET bottles utilized a linear programming optimization method. Our optimization model indicated that both chemical and mechanical recycling processes are needed to achieve a true circular economy of PET bottles with the least greenhouse gas emissions, specifically reductions of 24% when compared with the linear economy. Good quality and standardized life cycle assessment and techno-economic analysis studies are needed to better understand the environmental, economic, and social impacts of advanced sorting and chemical recycling technologies.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗