Me, Math Modelling, and DUET
Explore the source record for details and available documents.
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
Cyberattacks against industrial control systems have increased over the last decade, making it more critical than ever for system owners to have the tools necessary to understand the cyber resilience of their systems. However, existing tools are often qualitative, subject matter expertise-driven, or highly generic, making thorough, data-driven cyber resilience analysis challenging. The ADROC project proposed to develop a platform to enable efficient, repeatable, data-driven cyber resilience analysis for cyber-physical systems. The approach consists of two phases of modeling: computationally efficient math modeling and high-fidelity emulations. The first phase allows for scenarios of low concern to be quickly filtered out, conserving resources available for analysis. The second phase supports more detailed scenario analysis, which is more predictive of real-world systems. Data extracted from experiments is used to calculate cyber resilience metrics. ADROC then ranks scenarios based on these metrics, enabling prioritization of system resources to improve cyber resilience.
On Thursday, September 12 OpenAI released “a new series of models designed to spend more time thinking… they can reason through complex tasks and solve harder problems than previous models in science, coding, and math.” These models are referred to as o1-preview and o1-mini and appear to be first results of what had been a closely held project called Strawberry within OpenAI. The models are not described as successors in the earlier GPT series because they provide a qualitatively different type of capability, especially step-by-step reasoning.
The remediation of hazardous, toxic, and radioactive waste (HTRW) sites produces cost-related risks associated with the estimation of contaminated soil or debris volumes. Historical risk-management techniques include cost contingencies to cover volume uncertainties that affect project budgeting and decision-making. The Buffalo District teamed with project partners to lessen volume uncertainty and reduce project risks at multiple HTRW sites managed under the Formerly Utilized Sites Remedial Action Program (FUSRAP). Historical remedial investigations under FUSRAP commonly identified the presence of radiological material in site media, the associated human health risk, and then areas of remediation. To manage remedial execution and reduce risk, pre-design or remediation-phase sampling essentially 'chased' contamination, which was not conducive to efficient predictive budgeting derived from Feasibility Study (FS) cost analyses. The Buffalo District first optimized their approach to better understand volume uncertainty by utilizing the Argonne National Laboratory's Bayesian Approaches for Adaptive Spatial Sampling (BAASS) software [1]. BAASS processed soft data (e.g., gamma walk-over data) and spatial sampling data to estimate the lateral extent of contaminated soil irrespective of depth (i.e., gross contamination extent) and define areas of contaminant uncertainty. The software performed a binary transformation of contaminant concentrations at all sampling points based upon remedial action goals or a sum of ratios approach (i.e., clean, impacted, or range of impacts in soil). The model produced two-dimensional (horizontal) contaminant probability contours and statistical uncertainty in the sampling coverage and resulting contaminant extents. This method was translated vertically by partitioning the sampling data into depth brackets that produced a stacked representation of contaminant extents and uncertainty in the subsurface (i.e., similar to construction lifts). The results commonly led to a better understanding of project uncertainty and the need for sampling strategies that produce high-confidence soil volumes, which control costs. The BAASS-based delineations were eventually replaced by Empirical Bayesian Kriging (EBK) methods available in ArcGIS Spatial or 3D Analysts [2]. The EBK method calculates contaminant probability zones derived from user-controlled semivariograms of the spatial datasets. The resulting probability zones (e.g., 50% or 80% of contaminant probability) represent the two-dimensional surface delineation of the overall horizontal remedial area, similarly to BAASS. However, unlike BAASS, the vertical sampling data within these probability zones became vertical control points to contour a subterranean surface that connects subsurface points to the land-surface delineations of contamination. The resulting representation of horizontal and vertical impacts within an enclosed envelop (volume) of soil included uncertainty distributions that are used to plan uncertainty-reduction sampling. These data-driven and math-based models of three-dimensional sampling results produced well-bounded remedial volumes for project planning and better uncertainty predictions during project budgeting. The EBK method was applied to several FUSRAP sites managed by the Buffalo District and compared to less rigorously modeled sites previously remediated by the District. The comparison of modeled to actual remediated volumes provide a basis for validating the volume-estimation method. This comparison is important to ensure modeled volumes match physical boundaries of site remediation. FUSRAP sites with denser investigative sampling and lesser volume uncertainty proved useful in remedial planning and contracting. The Buffalo District noted that historical sites with sparser sampling arrays had greater disparity between estimated volumes and final remedial volumes. The benefit achieved over the cost of detailed soil sampling appears positive for FUSRAP projects, especially where impacts vary widely and appear unbounded by investigation-phase sampling. The subsequent Empirical Bayesian Kriging of contamination coupled with vertical contouring for soil estimations reduces uncertainty in soil volumes or indicates where sampling is required to reduce uncertainty, which together optimize remedial planning and budgeting. (authors)
The main contribution of this work is to increase the coding productivity of GPU programming by using the concept of Static Graphs. GPU capabilities have been increasing significantly in terms of performance and memory capacity. However, there are still some problems in terms of scalability and limitations to the amount of work that a GPU can perform at a time. To minimize the overhead associated with the launch of GPU kernels, as well as to maximize the use of GPU capacity, we have combined the new CUDA Graph API with the CUDA programming model (including CUDA math libraries) and the OpenACC programming model. We use as test cases two different, well-known and widely used problems in HPC and AI: the Conjugate Gradient method and the Particle Swarm Optimization. In the first test case (Conjugate Gradient) we focus on the integration of Static Graphs with CUDA. In this case, we are able to significantly outperform the NVIDIA reference code, reaching an acceleration of up to 11x thanks to a better implementation, which can benefit from the new CUDA Graph capabilities. In the second test case (Particle Swarm Optimization), we complement the OpenACC functionality with the use of CUDA Graph, achieving again accelerations of up to one order of magnitude, with average speedups ranging from 2x to 4x, and performance very close to a reference and optimized CUDA code. Our main target is to achieve a higher coding productivity model for GPU programming by using Static Graphs, which provides, in a very transparent way, a better exploitation of the GPU capacity. The combination of using Static Graphs with two of the current most important GPU programming models (CUDA and OpenACC) is able to reduce considerably the execution time w.r.t. the use of CUDA and OpenACC only, achieving accelerations of up to more than one order of magnitude. Finally, we propose an interface to incorporate the concept of Static Graphs into the OpenACC Specifications.
SAND2023-07883O Kokkos software implements C++ performance portability programming models, tools and math libraries, which enables science and engineering software developers to use single-source codes for a wide range of computer architectures. Kokkos also provides implementations of existing and proposed C++ standard features that support programming model and math libraries that are used for implementing performance-portable scientific and engineering applications. The Kokkos libraries provide algorithms, data structures, and tools to enable high-performance computing developers to write performance-portable code. Capabilities fall into three broad categories: Kokkos Core, Kokkos Kernels, and Kokkos Tools. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.
There has been significant recent interest in studying multiscale characteristics of current and next-generation batteries, including lithium-metal and lithium-sulfur batteries. Advances in computing power make researchers believe that the detailed multiscale models can be efficiently simulated to arrive at the insights for the degradation and performance loss; however, this is not true and special attention needs to be paid to local singularities, boundary layers, moving boundaries, etc. This article presents 2D examples that illustrate the importance of grid convergence studies, provides well-defined detailed models to test the efficiency of numerical schemes, and discusses the associated simulation challenges.
State of the art Engineering and Science codes have grown in complexity dramatically over the last two decades. As a consequence application teams have adopted more sophisticated development strategies, leveraging third party libraries, deploying comprehensive testing and using advanced debugging and profiling tools. In todays environment of diverse hardware platforms, these applications also desire performance portability - avoiding the need to duplicate work for various platforms - which makes it necessary that these tools and libraries also work across the various systems. The Kokkos EcoSystem provides that portable software stack. Based on the Kokkos Core Programming Model, the EcoSystem provides math libraries, interoperability capabilities with Python and Fortran, and Tools for analysing, debugging, and optimizing applications. In this paper we will provide an overview of the components, discuss some specific use cases, and highlight how co-designing these components enables a more developer friendly experience.
In 2016/2017, the field of High-Performance Computing (HPC) entered a new era driven by fundamental physics challenges to produce ever more energy and cost-efficient processors. Since the convergence on the Message-Passing Interface (MPI) standard in the mid-1990s, application developers enjoyed a seemingly static view of the underlying machine — that of a distributed collection of homogeneous nodes executing in collaboration. However, after almost two decades of dominance, the sole use of MPI to derive parallelism acted as a limiter to improved future performance. While MPI is widely expected to continue to function as the basic mechanism for communication between compute nodes for the immediate future, additional parallelism is required on the computing node itself if high performance and efficiency goals are to be realized. When reviewing the architectures of the top HPC systems today, the change in paradigm is clear: the compute nodes of the leading machines in the world are either powered by many-core chips with a few dozen cores each, or use heterogeneous designs, where traditional CPUs marshal work to massively parallel compute accelerators which has as many as 200,000 processing threads in flight simultaneously. Complicating matters further for application developers, each processor vendor has its own preferred way of writing code for their architecture.The Kokkos EcoSystem was released by Sandia in 2017 to address this new era in HPC system design by providing a vendor independent performance portable programming system for scientific, engineering, and mathematical software applications written in the C++ programming language. Using Kokkos, application developers can be more productive because they will not have to create and maintain separate versions of their software for each architecture, nor will they have to be experts in each architecture's peculiar requirements. Instead, they will have a single method of programming for the diverse set of modern HPC architectures. While Kokkos started in 2011 as a programming model only, it soon became clear that complex applications needed more. It is also critical to have a portable mathematical functions and developers need tools to debug their applications, gain insight into the performance characteristics of their codes and tune algorithm performance parameters through automated processes. The Kokkos EcoSystem addresses those needs through its three main components: the Kokkos Core programming model, the Kokkos Kernels math library, and the Kokkos Tools project.
The study of complex biological systems necessitates computational modeling approaches that are currently underutilized in plant biology. Many plant biologists have trouble identifying or adopting modeling methods to their research, particularly mechanistic mathematical modeling. Here we address challenges that limit the use of computational modeling methods, particularly mechanistic mathematical modeling. We divide computational modeling techniques into either pattern models (e.g., bioinformatics, machine learning, or morphology) or mechanistic mathematical models (e.g., biochemical reactions, biophysics, or population models), which both contribute to plant biology research at different scales to answer different research questions. We present arguments and recommendations for the increased adoption of modeling by plant biologists interested in incorporating more modeling into their research programs. As some researchers find math and quantitative methods to be an obstacle to modeling, we provide suggestions for easy-to-use tools for non-specialists and for collaboration with specialists. This may especially be the case for mechanistic mathematical modeling, and we spend some extra time discussing this. Through a more thorough appreciation and awareness of the power of different kinds of modeling in plant biology, we hope to facilitate interdisciplinary, transformative research.
ChatHPC democratizes large language models for the high-performance computing (HPC) community by providing the infrastructure, ecosystem, and knowledge needed to apply modern generative AI technologies to rapidly create specific capabilities for critical HPC components while using relatively modest computational resources. Our divide-and-conquer approach focuses on creating a collection of reliable, highly specialized, and optimized AI assistants for HPC based on the cost-effective and fast Code Llama fine-tuning processes and expert supervision. We target major components of the HPC software stack, including programming models, runtimes, I/O, tooling, and math libraries. Thanks to AI, ChatHPC provides a more productive HPC ecosystem by boosting important tasks related to portability, parallelization, optimization, scalability, and instrumentation, among others. With relatively small datasets (on the order of KB), the AI assistants, which are created in a few minutes by using one node with two NVIDIA H100 GPUs and the ChatHPC library, can create new capabilities with Meta’s 7-billion parameter Code Llama base model to produce high-quality software with a level of trustworthiness of up to 90% higher than the 1.8-trillion parameter OpenAI ChatGPT-4o model for critical programming tasks in the HPC software stack.
AI benchmarking is a method for evaluating the effectiveness of an AI model using a set of standardized metrics, for example, high school-level math exams. These benchmarks and their results will enable ranking various AI models based on their effectiveness in performing a specific task.
Both steady-state and dynamic simulations have been widely used by HVAC&R industry to support product/equipment development for decades. Steady-state simulation focuses on the system mass, energy and momentum balance of an equilibrium state. It is based on high-fidelity components models, and thus is suitable for system and component design optimization. Dynamic simulation studies the system transient response and is generally used for controls development and verification. It usually does not require rigorous component models of high accuracy because 1) the commonly used PID control is feedback control whose control performance evaluation doesn’t require high fidelity system/plant model; 2) high-fidelity dynamic model significantly increases the number of equations and variables and creates tremendous challenge for math solver. For supervisory control, transactive control or optimization of an integrated building system, the HVAC&R equipment is often one of the sub-components to be controlled. High-fidelity equipment models are required for accurately evaluating control strategies. In addition, building equipment manufacturers have developed a lot of high-fidelity steady-state equipment/component models per their expertise. Thus, a platform that can integrate OEM high-fidelity steady-state model with dynamic building simulation and/or electric power system & grid simulation to support the development and verification of supervisory control for integrated building systems is necessary. In this study, ORNL’s heat pump design tool (HPDM) is utilized to develop a co-simulation platform for supervisory control and optimization in integrated building systems. It is based on a model that integrates high-fidelity steady-state simulation equipment models with dynamic building simulation. A practical case of using the proposed co-simulation platform to develop and evaluate the supervisory control and optimization is presented and discussed.
Broadband physics-based simulated earthquake ground motions are utilized to characterize the regional-scale seismic risk to modern reinforced concrete (RC) structures. A highly dense dataset of ground motions covering a 100-km urn:x-wiley:00988847:media:eqe3413:eqe3413-math-0001 40-km domain was generated using kinematic fault rupture models with varying rupture characteristics to represent shallow crustal earthquakes and resolved up to frequencies of 5 Hz. Over 40,000 nonlinear response history simulations of short- and mid-rise RC special moment frame buildings were conducted using simulation models that are capable of representing nonlinear behavior and component deterioration effects. The spatial variability of structural risk within a single earthquake scenario and between different rupture scenarios is examined, and the regions of strongest directivity effects and highest structural demands are identified. The structural demands may vary by factor of up to 8.0 at very short distances from the fault, and the large dispersion in the demands decreases significantly beyond a distance of 15 km. The interstory drift and member rotation demands are substantially impacted by important features of the geological structure and the characteristics of the rupture scenarios, particularly the presence of localized high-slip regions. The frequency characteristics of the structures are found to play an important role in determining the effects of near-fault ground motions on the structural response and expected damage. The results of this study suggest that the simulated ground motions, particularly those generated using the hybrid rupture approach, may offer reasonable structural risk estimates for low-frequency structures and conservative estimates for high-frequency structures.
The dominant U.S. cultural norms shape science, technology, engineering, and math (STEM), and in turn, these norms shape science communication, further perpetuating oppressive systems. Despite being a core scientific skill, science communication research and practice lack inclusive training spaces that center marginalized identities. We address this need with a healing-centered counterspace grounded in the key principles of inclusive science communication: ReclaimingSTEM. ReclaimingSTEM is a science communication and science policy training space that centers the experiences, needs, and wants of people from marginalized communities. ReclaimingSTEM problematizes and expands the definitions of “what counts” as science communication. We organize ReclaimingSTEM with intentionality, emphasizing inclusion at every part of the process. Since initiating in 2018, five ReclaimingSTEM workshops have been held in multiple locations, both in-person and virtually, reaching more than 700 participants from all over the globe. In this paper, we share our model for ReclaimingSTEM, reflections of workshop participants and speakers, barriers faced during organizing, and recommendations for creating truly inclusive practices in science communication spaces.
Sustained advances in the mathematics of modeling and simulation have resulted in the capability today for routine simulation of a number of large scale complex DOE-relevant systems. As remarkable as this capability for solving the so-called forward problem is, it is typically only the first step-an inner loop within an outer loop that explores the simulation model's parameter space and decision space to characterize uncertainty in the model's predictions, learn unknown model parameters from data, design the most informative experiments, determine optimal control strategies, and create optimal designs. Broadly, what unifies all of these outer loop problems is that they are, in one form or another, optimization problems over parameter/control/design space that are constrained by complex uncertain models. To fully realize the power of scientific simulation as a basis for scientific discovery, technological innovation, and rational decision-making, it is imperative to move beyond simulation to tackle the outer loop of optimization for learning from data, experimental design, and control with complex uncertain models. When the models under consideration are large-scale and complex, and when the optimization variable and uncertain parameter spaces are high (or infinite) dimensional, this constitutes a grand challenge of the highest order, and is intractable with conventional methods. To overcome these challenges, the AEOLUS Center was established to develop a unified mathematical, computational, and statistical framework for (1) Learning predictive models from complex data via Bayesian inference and optimization, and (2) Optimizing experiments, processes, and designs using the resulting uncertain models. These problems are intractable with conventional methods, for several reasons: (1) The simulation problems that govern the inner loops of the optimization problems are expensive to execute (due to severe nonlinearity, heterogeneity, multiphysics/multiscale coupling); (2) The optimization variable and uncertain parameter spaces are high dimensional, often stemming from discretizations of infinite dimensional fields such as initial conditions, sources, or material properties. We argue that the key to overcoming these challenges is to develop new mathematical, computational, and statistical methods that exploit the structure of the Bayesian inference and optimization problems mediated by their underlying complex uncertain models. This structure includes the regularity, sparsity, geometry, low intrinsic dimensionality, and multifidelity nature of the maps from uncertain parameter/optimization variable spaces to the specific objectives targeted: Bayesian inference, optimal experimental design, and optimal control design. Black box methods developed as generic tools are incapable of exploiting this structure. To be successful, we must create, integrate, and cross-fertilize ideas across multiple areas of applied math--including approximation theory, Bayesian inference, data science, experimental design, information theory, machine learning, model reduction, optimal control theory, parallel algorithms, PDE-constrained optimization, randomized algorithms, stochastic optimization, and uncertainty quantification--all while exploiting the structure of the problems at hand. With this goal in mind, we have marshaled a team of leading authorities in these areas. While the methods we develop will be broadly applicable across a wide spectrum of DOE problems in which experiments inform models and the systems those models describe must be optimized under uncertainty, we have chosen a specific area, advanced manufacturing and materials, to drive our work. AMM is characterized by complex models across multiple scales, and is a rich source of challenging problems in inference, experimental design, and optimal control, requiring multifaceted and integrated advances in applied mathematics. As such, AMM serves as an excellent vehicle to motivate and demonstrate the advances in applied mathematics developed by our center.
Forest structural diversity and community composition are key in regulating forest microclimates. When disturbance affects structural diversity or composition, forest microclimates may be altered due to changes in soil temperature, soil water content, and light availability. It is unclear however which structural or compositional components, when changed or to what extent, result in microclimatic change. To address this question, we used data from a large scale, manipulative stem-girdling experiment in northern, lower Michigan—the Forest Resilience and Threshold Experiment (FoRTE). FoRTE follows a factorial design with multiple levels of disturbance severity (0, 45, 65, 85%) based on targeted reductions in gross leaf area index via stem-girdling induced mortality. These disturbance severity treatments are applied in two ways: either as top-down (largest trees are killed) or bottom-up (small to medium trees killed) treatments. We examined how multiple components of structural diversity and community composition changed as a product of disturbance severity and type, and then tested for resulting effects on forest microclimates (light availability, soil temperature, and soil water), using a multivariate, Random Forest framework. We found that measures of community composition (species richness, species evenness, and Shannon-Wiener Diversity Index) and stand structure (basal area, standard deviation of DBH, tree size diversity) declined more following disturbance than did measures of canopy cover, heterogeneity, arrangement, or height. However, when changes in each variable from pre- to post-disturbance, measured as log change, were employed in a multivariate, Random Forest regression framework, structural diversity measures of heterogeneity (rugosity, top rugosity), cover (canopy cover), and arrangement (porosity) were the most influential variables, but with differences among bottom-up and top-down treatments We found that the death of large trees from disturbance impacts soil temperature, water, and light environments more substantially and uniformly across disturbance gradients than does the death of smaller trees. Furthermore, our results have implications for both statistical and process-based modeling of forest disturbance.
SAND2021-1505 O. TINES is an open source software providing math infrastructure for solving many stiff time ordinary differential equations (ODEs) and/or differential algebraic equations (DAEs) using a batch hierarchical parallelism. The code is written using a parallel programming model (i.e., Kokkos) to future-proof the next generation parallel computing platforms such as GPU accelerators. This code is developed to support Exascale Catalytic Chemistry (ECC) Project. The code provides fundamental math helpers that can aid other research projects. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.