Search NASA⌕ Search

SEARCH · Search NASA

Results for “model complexity”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Feedback density and causal complexity of simulation model structure

Measures of simulation model complexity generally focus on outputs; we propose measuring the complexity of a model’s causal structure to gain insight into its fundamental character. This article introduces tools for measuring causal complexity. First, we introduce a method for developing a model’s causal structure diagram, which characterises the causal interactions present in the code. Causal structure diagrams facilitate comparison of simulation models, including those from different paradigms. Next, we develop metrics for evaluating a model’s causal complexity using its causal structure diagram. We discuss cyclomatic complexity as a measure of the intricacy of causal structure and introduce two new metrics that incorporate the concept of feedback, a fundamental component of causal structure. The first new metric introduced here is feedback density, a measure of the cycle-based interconnectedness of causal structure. The second metric combines cyclomatic complexity and feedback density into a comprehensive causal complexity measure. Finally, we demonstrate these complexity metrics on simulation models from multiple paradigms and discuss potential uses and interpretations. These tools enable direct comparison of models across paradigms and provide a mechanism for measuring and discussing complexity based on a model’s fundamental assumptions and design.

97 MATHEMATICS AND COMPUTING↗

Do Machine Learning Approaches Offer Skill Improvement for Short-Term Forecasting of Wind Gust Occurrence and Magnitude?

Abstract Wind gusts, and in particular intense gusts, are societally relevant but extremely challenging to forecast. This study systematically assesses the skill enhancement that can be achieved using artificial neural networks (ANNs) for forecasting of wind gust occurrence and magnitude. Geophysical predictors from the ERA5 reanalysis are used in conjunction with an autoregressive term in regression and ANN models with different predictors, and varying model complexity. Models are derived and assessed for the warm (April–September) and cold (October–March) seasons for three high passenger volume airports in the United States. Model uncertainty is assessed by deriving models for 1000 different randomly selected training (70%) and testing (30%) subsets. Gust prediction fidelity in independent test samples is critically dependent on inclusion of an autoregressive term. Gust occurrence probabilities derived using five-layer ANNs exhibit consistently higher fidelity than those from regression models and shallower ANNs. Inclusion of the autoregressive term and increasing the number of hidden layers in ANNs from 1 to 5 also improve the model performance for gust magnitudes (lower RMSE, increased correlation, and model standard deviations that more closely approximate observed values). Deeper ANNs (e.g., 20 hidden layers) exhibit higher skill in forecasting strong (17–25.7 m s −1 ) and damaging (≥25.7 m s −1 ) wind gusts. However, such deep networks exhibit evidence of overfitting and still substantially underestimate (by 50%) the frequency of strong and damaging wind gusts at the three airports considered herein. Significance Statement Improved short-term forecasting of wind gusts will enhance aviation safety and logistics and may offer other societal benefits. Here we present a rigorous investigation of the relative skill of models of wind gust occurrence and magnitude that employ different statistical methods. It is shown that artificial neural networks (ANNs) offer considerable skill enhancement over regression methods, particularly for strong and damaging wind gusts. For wind gust magnitudes in particular, application of deeper learning networks (e.g., five or more hidden layers) offers tangible improvements in forecast accuracy. However, deeper networks are vulnerable to overfitting and exhibit substantial variability with the specific training and testing data subset used. Also, even deep ANNs reproduce only half of strong and damaging wind gusts. These results indicate the need for future work to elucidate the dynamical mechanisms of intense wind gusts and advance solutions to their prediction.

54 ENVIRONMENTAL SCIENCES↗

Bringing 2D Eclipse Mapping out of the Shadows with Leave-one-out Cross Validation

Abstract Eclipse mapping is a technique for inferring 2D brightness maps of transiting exoplanets from the shape of an eclipse light curve. With JWST’s unmatched precision, eclipse mapping is now possible for a large number of exoplanets. However, eclipse mapping has only been applied to two planets, and the nuances of fitting eclipse maps are not yet fully understood. Here, we use Leave-one-out Cross Validation (LOO-CV) to investigate eclipse mapping, with application to a JWST NIRISS/SOSS observation of the ultrahot Jupiter WASP-18b. LOO-CV is a technique that provides insight into the out-of-sample predictive power of models on a data-point-by-data-point basis. We show that constraints on planetary brightness patterns behave as expected, with large-scale variations driven by the phase-curve variation in the light curve and smaller-scale structures constrained by the eclipse ingress and egress. For WASP-18b we show that the need for higher model complexity (smaller-scale features) is driven exclusively by the shape of the eclipse ingress and egress. We use LOO-CV to investigate the relationship between planetary brightness map components when mapping under a positive-flux constraint to better understand the need for complex models. Finally, we use LOO-CV to understand the degeneracy between the competing “hot spot” and “plateau” brightness map models of WASP-18b, showing that the plateau model is driven by the ingress shape and the hot spot model is driven by the egress shape, but preference for neither model is due to outliers or unmodeled signals. Based on this analysis, we make recommendations for the use of LOO-CV in future eclipse-mapping studies.

79 ASTRONOMY AND ASTROPHYSICS↗

Siloxyaluminate and Siloxygallate Complexes as Models for Framework and Partially Hydrolyzed Framework Sites in Zeolites and Zeotypes.

Anionic molecular models for nonhydrolyzed and partially hydrolyzed aluminum and gallium framework sites on silica, M[OSi(OtBu) 3 ] 4 - and HOM[OSi(OtBu) 3 ] 3 - (where M=Al or Ga), were synthesized from anionic chlorides Li{M[OSi(OtBu) 3 ] 3 Cl} in salt metathesis reactions. Sequestration of lithium cations with [12]crown-4 afforded charge-separated ion pairs composed of monomeric anions M[OSi(OtBu) 3 ] 4 - with outer-sphere [([12]crown-4) 2 Li] + cations, and hydroxides {HOM[OSi(OtBu) 3 ] 3 } with pendant [([12]crown-4)Li] + cations. These molecular models were characterized by single-crystal X-ray diffraction, vibrational spectroscopy, mass spectrometry and NMR spectroscopy. Upon treatment of monomeric [([12]crown-4)Li]{HOM[OSi(OtBu) 3 ] 3 } complexes with benzyl alcohol, benzyloxide complexes were formed, modeling a possible pathway for the formation of active sites for Meerwin-Ponndorf-Verley (MPV) transfer hydrogenations with Al/Ga-doped silica catalysts.

Dombrowski, James P↗

The role of chromatin state in intron retention: A case study in leveraging large scale deep learning models

Complex deep learning models trained on very large datasets have become key enabling tools for current research in natural language processing and computer vision. By providing pre-trained models that can be fine-tuned for specific applications, they enable researchers to create accurate models with minimal effort and computational resources. Large scale genomics deep learning models come in two flavors: the first are large language models of DNA sequences trained in a self-supervised fashion, similar to the corresponding natural language models; the second are supervised learning models that leverage large scale genomics datasets from ENCODE and other sources. We argue that these models are the equivalent of foundation models in natural language processing in their utility, as they encode within them chromatin state in its different aspects, providing useful representations that allow quick deployment of accurate models of gene regulation. We demonstrate this premise by leveraging the recently created Sei model to develop simple, interpretable models of intron retention, and demonstrate their advantage over models based on the DNA language model DNABERT-2. Our work also demonstrates the impact of chromatin state on the regulation of intron retention. Using representations learned by Sei, our model is able to discover the involvement of transcription factors and chromatin marks in regulating intron retention, providing better accuracy than a recently published custom model developed for this purpose.

Biochemistry & Molecular Biology↗

A Fast Time-Stepping Strategy for Dynamical Systems Equipped with a Surrogate Model

Simulation of complex dynamical systems arising in many applications is computationally challenging due to their size and complexity. Model order reduction, machine learning, and other types of surrogate modeling techniques offer cheaper and simpler ways to describe the dynamics of these systems but are inexact and introduce additional approximation errors. In order to overcome the computational difficulties of the full complex models, on one hand, and the limitations of surrogate models, on the other, this work proposes a new accelerated time-stepping strategy that combines information from both. This approach is based on the multirate infinitesimal general-structure additive Runge--Kutta framework. The inexpensive surrogate model is integrated with a small time step to guide the solution trajectory, and the full model is treated with a large time step to occasionally correct for the surrogate model error and ensure convergence. Here, we provide a theoretical error analysis, and several numerical experiments, to show that this approach can be significantly more efficient than using only the full or only the surrogate model for the integration.

Surrogate models↗

nn-PINNs: Non-Newtonian physics-informed neural networks for complex fluid modeling

Time- and rate-dependent material functions in non-Newtonian fluids in response to different deformation fields pose a challenge in integrating different constitutive models into conventional computational fluid dynamic platforms. Considering their relevance in many industrial and natural settings alike, robust data-driven frameworks that enable accurate modeling of these complex fluids are of great interest. The main goal is to solve the coupled Partial Differential Equations (PDEs) consisting of the constitutive equations that relate the shear stress to the deformation and fully capture the behavior of the fluid under various flow protocols with different boundary conditions. Here, in this work, we present non-Newtonian physics-informed neural networks (nn-PINNs) for solving systems of coupled PDEs adopted for complex fluid flow modeling. The proposed nn-PINN method is employed to solve the constitutive models in conjunction with conservation of mass and momentum by benefiting from Automatic Differentiation (AD) in neural networks, hence avoiding the mesh generation step. nn-PINNs are tested for a number of different complex fluids with different constitutive models and for several flow protocols. These include a range of Generalized Newtonian Fluid (GNF) empirical constitutive models, as well as some phenomenological models with memory effects and thixotropic timescales. nn-PINNs are found to obtain the correct solution of complex fluids in spatiotemporal domains with good accuracy compared to the ground truth solution. We also present applications of nn-PINNs for complex fluid modeling problems with unknown boundary conditions on the surface, and show that our approach can successfully recover the velocity and stress fields across the domain, including the boundaries, given some sparse velocity measurements.

42 ENGINEERING↗

Machine learning based algorithms for uncertainty quantification in numerical weather prediction models

Complex numerical weather prediction models incorporate a variety of physical processes, each described by multiple alternative physical schemes with specific parameters. The selection of the physical schemes and the choice of the corresponding physical parameters during model configuration can significantly impact the accuracy of model forecasts. There is no combination of physical schemes that works best for all times, at all locations, and under all conditions. It is therefore of considerable interest to understand the interplay between the choice of physics and the accuracy of the resulting forecasts under different conditions. This paper demonstrates the use of machine learning techniques to study the uncertainty in numerical weather prediction models due to the interaction of multiple physical processes. The first problem addressed herein is the estimation of systematic model errors in output quantities of interest at future times, and the use of this information to improve the model forecasts. The second problem considered is the identification of those specific physical processes that contribute most to the forecast uncertainty in the quantity of interest under specified meteorological conditions. In order to address these questions we employ two machine learning approaches, random forests and artificial neural networks. The discrepancies between model results and observations at past times are used to learn the relationships between the choice of physical processes and the resulting forecast errors. Numerical experiments are carried out with the Weather Research and Forecasting (WRF) model. The output quantity of interest is the model precipitation, a variable that is both extremely important and very challenging to forecast. The physical processes under consideration include various micro-physics schemes, cumulus parameterizations, short wave, and long wave radiation schemes. The experiments demonstrate the strong potential of machine learning approaches to aid the study of model errors.

97 MATHEMATICS AND COMPUTING↗

Combined selection of the dynamic model and modeling error in nonlinear aeroelastic systems using Bayesian Inference

Here, we report a Bayesian framework for concurrent selection of physics-based models and (modeling) error models. We investigate the use of colored noise to capture the mismatch between the predictions of calibrated models and observational data that cannot be explained by measurement error alone within the context of Bayesian estimation for stochastic ordinary differential equations. Proposed models are characterized by the average data-fit, a measure of how well a model fits the measurements, and the model complexity measured using the Kullback–Leibler divergence. The use of a more complex error models increases the average data-fit but also increases the complexity of the combined model, possibly over-fitting the data. Bayesian model selection is used to find the optimal physical model as well as the optimal error model. The optimal model is defined using the evidence, where the average data-fit is balanced by the complexity of the model. The effect of colored noise process is illustrated using a nonlinear aeroelastic oscillator representing a rigid NACA0012 airfoil undergoing limit cycle oscillations due to complex fluid–structure interactions. Several quasi-steady and unsteady aerodynamic models are proposed with colored noise or white noise for the model error. The use of colored noise improves the predictive capabilities of simpler models.

42 ENGINEERING↗

Approach to Quality Assurance for Complex Environmental Modeling - 20407

A strong Quality Assurance (QA) program for complex environmental modeling is essential for regulatory and public acceptance and trust, but it does not have to be onerous. Neptune and Company, Inc. (Neptune) has developed a strong QA program that improves transparency, traceability, reproducibility, and therefore, defensibility and trust. Neptune's QA program has evolved over the past 27 years, transitioning from an ad hoc QA program, to a program that is currently Nuclear Quality Assurance-1 (NQA-1) compliant, and will soon be NQA-1/DOE approved for DOE EM modeling work. In addition, Neptune is a qualified laboratory assessor and qualified auditor for reference materials, a proficiency testing provider, and fully complies with the Environmental Protection Agency (EPA) QA program. Neptune's President and CEO, Kelly Black, was recently named the Chairperson of the International Organization for Standardization (ISO) Technical Committee 69, Application of Statistical Methods. A strong QA program has been developed for Neptune's radiological performance assessment (PA) program. Although pieces of their QA program are currently in development, their current program includes document control using Subversion, issue tracking and work flow tracking using JIRA, and transparency and traceability via a system of 'calc sheets' for documentation of all data analysis and modeling combined with 'check print' documentation of QA checking, and rigorous model testing and configuration control. All work is reviewed by an independent subject matter expert who is not associated with the collection and assembly of information, for an internal peer review. The program is enforced with a handful of Standard Operation Procedures (SOPs), Work Instructions, QA Project Plans (QAPPs), and Quality Management Plans (QMPs) that are updated frequently, with required annual training and acknowledgment. In addition, effective communication of modeling approaches and results to clients and stakeholders are integral to their QA program. Many of their models are built using the GoldSim modeling platform, for which their models are well-known for their level of transparency, documentation, and QA traceability. This level of QA is also applied to their process-level models. Neptune has taken some lessons learned from the extremely rigorous QA program required for the Yucca Mountain Project (YMP), and imposed the YMP requirements of complete traceability, transparency, and reproducibility, but avoided the inflexibility of a QA program that likely contributed to the suspect e-mails in 2005 that resulted in loss of trust in the YMP, and in nuclear waste disposal (and nuclear power) in general. There are far too many examples of loss of public trust due to poor QA that could have been easily avoided with a simple and straight-forward QA program combined with stakeholder engagement. The purpose of this paper is to share features of Neptune's Radiological Performance Assessment program QA program, and some of their QA related lessons learned over the past 27 years of QA for complex environmental modeling. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Vibrational characterization of a diiron bridging hydride complex – a model for hydrogen catalysis

A diiron complex containing a bridging hydride and a protonated terminal thiolate of the form [(m,k 2 - bdtH)(m-PPh 2 )(m-H)Fe 2 (CO) 5 ] + has been investigated through 57 Fe nuclear resonance vibrational spectroscopy (NRVS) and interpreted using density functional theory (DFT) calculations. We report the Fe–mH–Fe wagging mode, and indications for Fe–mD stretching vibrations in the D-isotopologue, observed by 57 Fe-NRVS. Our combined approach demonstrates an asymmetric sharing of the hydride between the two iron sites that yields two nondegenerate Fe–mH/D stretching vibrations. The studied complex provides an important model relevant to biological hydrogen catalysis intermediates. The complex mimics proposals for the binuclear metal sites in [FeFe] and [NiFe] hydrogenases. It is also an appealing prototype for the ‘Janus intermediate’ of nitrogenase, which has been proposed to contain two bridging Fe–H–Fe hydrides and two protonated sulfurs at the FeMo-cofactor. The significance of observing indirect effects of the bridging hydride, as well as obstacles in its direct observation, is discussed in the context of biological hydrogen intermediates.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Matilda v1.0: An R package for probabilistic climate projections using a reduced complexity climate model

A primary advantage to using reduced complexity climate models (RCMs) has been their ability to quickly conduct probabilistic climate projections, a key component of uncertainty quantification in many impact studies and multisector systems. Providing frameworks for such analyses has been a target of several RCMs used in studies of the future co-evolution of the human and Earth systems. In this paper, we present Matilda, an open-science R software package that facilitates probabilistic climate projection analysis, implemented here using the Hector simple climate model in a seamless and easily applied framework. The primary goal of Matilda is to provide the user with a turn-key method to build parameter sets from literature-based prior distributions, run Hector iteratively to produce perturbed parameter ensembles (PPEs), weight ensembles for realism against observed historical climate data, and compute probabilistic projections for different climate variables. This workflow gives the user the ability to explore viable parameter space and propagate uncertainty to model ensembles with just a few lines of code. The package provides significant freedom to select different scoring criteria and algorithms to weight ensemble members, as well as the flexibility to implement custom criteria. Additionally, the architecture of the package simplifies the process of building and analyzing PPEs without requiring significant programming expertise, to accommodate diverse use cases. We present a case study that provides illustrative results of a probabilistic analysis of mean global surface temperature as an example of the software application.

54 ENVIRONMENTAL SCIENCES↗

Prediction of Complex Observed Shear Wave Splitting Patterns at Ryukyu Subduction Zone Using a Strong Intra-Slab Anisotropy Model

Complex shear wave splitting (SWS) patterns in subduction zones are often interpreted geodynamically as resulting from complex mantle flow; however, this may not always be necessary. We analyzed 7,093 high-quality SWS measurements from teleseismic S waves recorded by Hi-net stations across the Ryukyu arc in Japan. Our findings show a systematic rotation of the fast S polarization from trench-parallel to trench-perpendicular depending on the earthquake backazimuth. For the same earthquake, the measured splitting patterns also vary spatially across the southwest Japan. Using full-wave seismic modeling, we showed that a dipping slab with ~30% shear anisotropy of the tilted transverse isotropy (TTI) type, with a symmetry axis perpendicular to the slab interface, can predict the observed delay times and polarization rotation. Our results highlight the importance of considering dipping anisotropic slabs in interpreting SWS at subduction zones.

58 GEOSCIENCES↗

Two-Layer Dynamic Recycling Model (2L-DRM): Learning from Moisture Tracking Models of Different Complexity

Atmospheric moisture tracking models are used to identify and quantify sources and sinks of water in the atmospheric branch of the hydrologic cycle. These models are primarily used to investigate the origin of moisture resulting in precipitation for particular regions around the globe. Moisture tracking models vary widely in their level of complexity, depending on the number of physical processes represented. Complex models are comprehensive in their physical representation, but computationally much more expensive than simple models, which only focus on specific physical processes and use simplifying assumptions. We present the mathematical derivation of the new two-layer dynamical recycling model (2L-DRM), a simple analytical moisture tracking model that relaxes the vertically-integrated formulation of the original one-layer DRM (Dominguez et al., 2006). By comparing the simple DRM to a very complex moisture tracking model that uses water vapor tracers embedded within the Weather Research and Forecast regional climate model (WRF-WVT) for the North American Monsoon region, we pinpoint the absence of vertical wind shear as the main deficiency in the simple DRM. When comparing both simple models (DRM and 2L-DRM) to the WRF-WVT (which we treat as ‘truth’), the 2L-DRM better captures the spatial extent, the net amount and the temporal variability of precipitation that originates from oceanic and local terrestrial sources. The 2L-DRM is well suited to study the large-scale climatological sources of moisture, and for these applications, performs on-par with the much more complex and computationally demanding WRF-WVT model.

Dominguez, Francina↗