Search NASA⌕ Search

SEARCH · Search NASA

Results for “Modeling workflow”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Integration of Open-Source URBANopt and Dragonfly Energy Modeling Capabilities into Practitioner Workflows for District-Scale Planning and Design

High-performance districts and communities offer opportunities for reducing energy use, emissions, and costs, and can be instrumental in helping cities achieve their climate goals. The design of such communities requires identification of opportunities early on and their re-evaluation throughout the planning process. There is a need for energy modeling tools that connect 3D Computer-Aided Design (CAD) platforms to simulation engines, enabling detailed energy analysis of districts within the workflows and tools used by practitioners. This paper introduces the Dragonfly and URBANoptTM combined toolset that supports the creation of urban models from a range of geometry formats typically used by designers and planners, and provides an integrated pathway to simulate district-scale energy systems. The toolset is piloted by a global architecture and master planning firm to evaluate several key urban-scale technical questions for the design of a district in Chicago. The findings indicate that, while energy savings can be achieved through traditional architectural studies and enhancements to individual building efficiency, the modeling toolset helps identify additional savings and insights that can be achieved when considering district-scale energy systems. Finally, this study demonstrates how the Dragonfly/URBANopt toolset can integrate with master planning workflows, thereby enabling an iterative performance-based design process.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

New Virtual Test Bed Capabilities: Virtual DOME Model and New Updates to Repository

The Department of Energy (DOE) Office of Nuclear Energy National Reactor Innovation Center accelerates the deployment of novel reactor concepts by establishing both physical and virtual spaces for building and testing various components, systems, and complete pilot plants. The Virtual Test Bed represents the virtual arm of the National Reactor Innovation Center and is a joint effort with the DOE Nuclear Energy Advanced Modeling and Simulation Program. The Virtual Test Bed mission is to accelerate the deployment of advanced reactors by facilitating the adoption of cutting-edge DOE advanced modeling and simulation tools to design, evaluate, and license reactors. This is primarily achieved by storing example challenge problems in an externally available repository and by developing models to fill the M&S gaps needed for potential demonstrators. Activities conducted this fiscal year focused on developing of a Demonstration of Microreactor Experiments shield model to help accelerate the confirmatory analysis required for the reactor demonstration. This model and workflow will allow developers to leverage advanced modeling and simulation tools to ensure their reactor demonstration concept will meet dose requirements and that the surrounding shield will stay within concrete temperature limits during steady-state and transient operation conditions. An initial model has been developed to evaluate the temperature distribution in the concrete shield during steady-state operation, including neutron and gamma heating effects. Various modeling strategies have been examined to understand their applicability and limitations with different reactor designs to make the workflow as reactor-agnostic as possible and computationally effective to maximize its usability. In addition to describing the Demonstration of Microreactor Experiments shield model and associated results, this report summarizes other accomplishments regarding repository maintenance and improvement and new external models hosted on the repository.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DeepClone: Lightweight State Replication of Deep Learning Models for Data Parallel Training

Training modern deep neural network (DNN) models involves complex workflows triggered by model exploration, sensitivity analysis, explainability, etc. A key primitive in this context is the ability to clone a model training instance, i.e. “fork” the training process in a potentially different direction, which enables comparisons of different evolution paths using variations of training data and model parameters. However, in a quest improve the training throughput, a mix of data parallel, model parallel, pipeline parallel and layer-wise parallel approaches are making the problem of cloning highly complex. In this paper, we explore the problem of efficient cloning under such circumstances. To this end, we leverage several properties of data-parallel training and layer-wise parallelism to design DeepClone, a cloning approach based on augmenting the execution graph to gain direct access to tensors, which are then sharded and reconstructed asynchronously in order to minimize runtime overhead, standby duration, readiness duration. Compared with state-of-art approaches, DeepClone shows orders of magnitude improvement for several classes of DNN models.

data-parallel training↗

Sensitivity and Uncertainty Workflow of Full System SIERRA Models Supporting High Consequence Applications (Executive Summary)

The overall goal of this work was to advance the integrated workflow capabilities to provide the weapon system analysts the tools to construct, communicate and robustly execute end-to-end computational simulation models and analysis. Specifically, this includes developing and running automated, CompSim workflows that map model inputs to responses from large-scale studies executed on a distributed, heterogenous computing environment (e.g., CAD applications on Windows laptop to Sierra FEM codes on Trinity within a single workflow). The workflows developed enable ensemble calculations in support of ND program decisions, including sensitivity analysis, optimization and uncertainty quantification.

97 MATHEMATICS AND COMPUTING↗

Predictive Modeling and Diagnostic Monitoring of Extreme Science Workflows (Final Report)

This proposal addresses a critical issue of performance prediction identified in the report from the ASCR \Computational Modeling of Big Networks (COMBINE)" workshop: "end-to-end performance is not predictable due to a variety of factors. Even when some performance forecasts or predictions can be made, they often cannot explain the reasons why some predictions fail." We will develop new analytical models to predict the end-to-end performance of scientific workflows on DOE computing infrastructures, and use simulations and experimentation to validate and refine these models, as well as to pinpoint the sources of model inaccuracy. We will also use these models to help diagnose application and infrastructure problems, and to adapt the system based on this diagnosis. This section provides background in the areas relevant to the proposed work. RPI’s specific tasks within the Panorama project are as follows: (1) Develop Aspen-Simulation interface for Workflow Model Driven Simulation. (2) Validate manual performance models of two target workflow scenarios with empirical measurement and simulation. (3) Extend ROSS-Aspen API to simulate workflow descriptions when required. (4) Validate Aspen performance models of two target workflow scenarios with automatic performance model empirical measurement and simulation. (5) Design and implement final system to automatically generate Aspen performance models from workflow descriptions (including methods to compensate for limitations of Aspen analytical models). (6) Validate improved Aspen performance models with target workflow on production infrastructure. To date, all the project milestones assigned to us where reached within the best of our abilities over the course of the project performance period. Below describes the key outcome from our collaborative research in a system named, Durango .

97 MATHEMATICS AND COMPUTING↗

C3F: Collaborative Container-based Model Coupling Framework

Solving complex real-world grand challenge problems requires in-depth collaboration of researchers from multiple disciplines. Such collaboration often involves harnessing multiscale and multi-dimensional data and combining models from different fields to simulate systems. However, the progress on this front has been limited mainly due to significant gaps in domain knowledge and tools that are typically employed in silos of the domains. Researchers from different fields face considerable barriers to understanding and reusing each other’s data/models in order to collaborate effectively. For example, in solving the global sustainability problems, researchers from hydrology, climate science, agriculture, and economics need to run their respective models to study different components of the global and local food, energy and water systems while, at the same time, need to interact with other researchers and integrate the results of one model with another. Developing this kind of model coupling workflow calls for (1) a large amount of data being processed and exchanged across domains and organizations, (2) identifying and processing the output of one model to make it ready for integration into another model, (3) controlling the workflow dynamically so that it runs until a certain convergence condition or other criteria is met, and (4) close collaboration among the modelers to explore, tune, and test the configuration and data transformation needed to link the models. We have developed C3F, a flexible collaborative model coupling framework to help researchers accelerate their model integration and linking efforts by leveraging advanced cyberinfrastructure such as high-performance computing and virtual containers. In this paper, we describe our experience and lessons learned in developing this cyberinfrastructure solution to support the linking of Water Balance Model (WBM) and SIMPLE-G agricultural economic model in an NSF funded INFEWS project and a DOE-funded Program on Coupled Human and Earth Systems (PCHES) to study the implications of groundwater scarcity for food-energy-water systems. The C3F model coupling framework can be extended to facilitate other model linkages as well.

containerization↗

Asynchronous Execution of Heterogeneous Tasks in ML-Driven HPC Workflows

Heterogeneous scientific workflows consist of numerous types of tasks that require execution on heterogeneous resources. Asynchronous execution of those tasks is crucial to improve resource utilization, task throughput and reduce workflows' makespan. Therefore, middleware capable of scheduling and executing different task types across heterogeneous resources must enable asynchronous execution of tasks. In this paper, we investigate the requirements and properties of the asynchronous task execution of machine learning (ML)-driven high-performance computing (HPC) workflows. We model the degree of asynchronicity permitted for arbitrary workflows and propose key metrics that can be used to determine qualitative benefits when employing asynchronous execution. Our experiments represent relevant scientific drivers, we perform them at scale on Summit, and we show that the performance enhancements due to asynchronous execution are consistent with our model.

97 MATHEMATICS AND COMPUTING↗

Integrating AlphaFold and deep learning for atomistic interpretation of cryo-EM maps

Abstract Interpretation of cryo-electron microscopy (cryo-EM) maps requires building and fitting 3D atomic models of biological molecules. AlphaFold-predicted models generate initial 3D coordinates; however, model inaccuracy and conformational heterogeneity often necessitate labor-intensive manual model building and fitting into cryo-EM maps. In this work, we designed a protein model-building workflow, which combines a deep-learning cryo-EM map feature enhancement tool, CryoFEM (Cryo-EM Feature Enhancement Model) and AlphaFold. A benchmark test using 36 cryo-EM maps shows that CryoFEM achieves state-of-the-art performance in optimizing the Fourier Shell Correlations between the maps and the ground truth models. Furthermore, in a subset of 17 datasets where the initial AlphaFold predictions are less accurate, the workflow significantly improves their model accuracy. Our work demonstrates that the integration of modern deep learning image enhancement and AlphaFold may lead to automated model building and fitting for the atomistic interpretation of cryo-EM maps.

59 BASIC BIOLOGICAL SCIENCES↗

Application-Driven Creation of Building Metadata Models with Semantic Sufficiency

Semantic metadata models such as Brick, RealEstateCore, Project Haystack, and BOT promise to simplify and lower the cost of developing software for smart buildings, enabling the widespread deployment of energy efficiency applications. However, creating these models remains a challenge. Despite recent advances in creating models from existing digital representations like point labels and architectural models, there is still no feedback mechanism to ensure that the human input to these methods results in a model that can actually support the desired software. In this paper, we introduce the notion of semantic sufficiency, a practical principle for semantic metadata model creation that asserts that a model is "finished" when it contains the metadata necessary to support a given set of applications. To support semantic sufficiency, we design a standard representation for capturing application metadata requirements and a templating system for generating common metadata model components with limited user input. We then construct an iterative model creation workflow that integrates metadata requirements to direct the model creation effort, and present several novel optimizations that increase the model utility while minimizing the effort by a human operator. These new abstractions for model creation and validation lower model development costs and ensure the utility of the resulting model, thus facilitating the adoption of intelligent building applications.

applications↗

Scoping assessments and review of sub-scale models in support of DuraMAT Predictive Simulation Capability Area #2

The goal of the DuraMAT Predictive Simulation Capability Area is to develop a suite of modeling and simulation tools to enhance understanding of module-level thermo-mechanical-electrical effects contributing to degradation of solar photovoltaic modules. Since these effects invoke multiple physical mechanisms and take place over greatly varied time- and length- scales, developing a module-level model of sufficient resolution to capture all geometries and physics of interest was expected to be near code capability and computational resource limits. A series of sub-models and workflows were developed to assess physics and material model maturity and the necessary computational capacity for resolving degradation mechanisms of interest. Knowledge gained from these activities help to better scope future development efforts, in line with available computational and code capabilities. This memo serves as the DuraMAT Quarterly Progress Indicator (QPI) for Quarter 3 of Fiscal Year 2017 (Project Quarter 1 / Month 3), and documents completion of Milestone Subtask 2.2.1.

14 SOLAR ENERGY↗

NREL Stratus - Enabling Workflows to Fuse Data Streams, Modeling, Simulation, and Machine Learning

Integrating cloud services into advanced computing facilities provides significant new capabilities over focusing solely on traditional high performance computing (HPC) workloads. This brings complementary capabilities as well as enabling new focused roles for HPC. They are especially potent for workflows that fuse data streams, modeling and simulation ('modsim') and machine learning. A key challenge to adopting a hybrid edge-cloud-HPC model is to align optimal capability, data, and user intent on the right resources for each step in a workflow.?The NREL Stratus service provides a basis for this: Stratus layers capabilities needed to make?cloud services accessible to a lab-based scientific community on commercial offerings, and; currently supports upwards of 200 projects ranging from IOT integration to traditional modeling and simulation. This provides a real-world inventory of scientific workflow elements. A growing knowledge base enables placing these elements appropriately between the edge, cloud, and traditional HPC. This paper outlines a vision via reference architecture and the application of that architecture in a typical workflow highlighting multiple components: sensor data intake, cleaning and transforming (edge/cloud suitable); generation of synthetic data through modsim, computationally heavy ML training and hyperparameter optimization (HPC suitable), and; inference and deployment (cloud ideal). Every step in such a workflow involves a cost-benefit analysis regarding the data movement, computational efficiency, availability, latency, and resource capabilities. The reference architecture and examples outlined allow for understanding new opportunities in the context of emerging workflows that combine IOT, cloud, and HPC to bolster scientific productivity.

AI↗

28 NREL Stratus - Enabling Workflows to Fuse Data Streams, Modeling, Simulation, and Machine Learning: Preprint

Integrating cloud services into advanced computing facilities provides significant new capabilities over focusing solely on traditional high performance computing (HPC) workloads. This brings complementary capabilities as well as enabling new focused roles for HPC. They are especially potent for workflows that fuse data streams, modeling and simulation ('modsim') and machine learning. A key challenge to adopting a hybrid edge-cloud-HPC model is to align optimal capability, data, and user intent on the right resources for each step in a workflow.?The NREL Stratus service provides a basis for this: Stratus layers capabilities needed to make?cloud services accessible to a lab-based scientific community on commercial offerings, and; currently supports upwards of 200 projects ranging from IOT integration to traditional modeling and simulation. This provides a real-world inventory of scientific workflow elements. A growing knowledge base enables placing these elements appropriately between the edge, cloud, and traditional HPC. This paper outlines a vision via reference architecture and the application of that architecture in a typical workflow highlighting multiple components: sensor data intake, cleaning and transforming (edge/cloud suitable); generation of synthetic data through modsim, computationally heavy ML training and hyperparameter optimization (HPC suitable), and; inference and deployment (cloud ideal). Every step in such a workflow involves a cost-benefit analysis regarding the data movement, computational efficiency, availability, latency, and resource capabilities. The reference architecture and examples outlined allow for understanding new opportunities in the context of emerging workflows that combine IOT, cloud, and HPC to bolster scientific productivity.

AI↗

Charter for the ARM Atmospheric Modeling Advisory Group

The Atmospheric Modeling Advisory Group of the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) Climate Research Facility is guided by the following: 1. The group will provide feedback on the overall project plan including input on how to address priorities and trade-offs in the modeling and analysis workflow, making sure the modeling follows general best practices, and reviewing the recommendations provided to ARM for the workflow implementation. 2. The group will consist of approximately 6 members plus the PI and co-PI of the Large-Eddy Simulation (LES) ARM Symbiotic Simulation and Observation (LASSO) pilot project. The ARM Technical Director, or his designee, serves as an ex-officio member. This size is chosen based on the ability to efficiently conduct teleconferences and to span the general needs for input to the LASSO pilot project.

54 ENVIRONMENTAL SCIENCES↗

ML-based Data Assimilation and History Matching: Application to the IBDP CCS Project

It is crucial to monitor the CO2 plume effectively throughout the life cycle of a geologic CO2 sequestration project to ensure safety and storage efficiency. However, the computational cost of existing data assimilation methods can be prohibitively expensive due to the complex physics with multi-component non-isothermal simulation and high dimensionality of large-scale reservoir models. We address this challenge by proposing an accelerated deep learning-based workflow for model calibration and prediction of CO2 plume evolution in the reservoir.The power and efficacy of our workflow is demonstrated by application to the Illinois Basin-Decatur Project (IBDP), a large-scale CO2 storage test in saline aquifer. The data assimilation process is implemented rapidly by the proposed workflow with given field measurements including distributed pressure and temperature sensing (DTS) data at an injection and a monitoring well. CO2 plume evolution is predicted by running the simulations of the calibrated reservoir models.

Nagao, Masahiro↗

Co-scheduling Ensembles of In Situ Workflows

Molecular dynamics (MD) simulations are widely used to study large-scale molecular systems. HPC systems are ideal platforms to run these studies, however, reaching the necessary simulation timescale to detect rare processes is challenging, even with modern supercomputers. To overcome the timescale limitation, the simulation of a long MD trajectory is replaced by multiple short-range simulations that are executed simultaneously in an ensemble of simulations. Analyses are usually co-scheduled with these simulations to efficiently process large volumes of data generated by the simulations at runtime, thanks to in situ techniques. Executing a workflow ensemble of simulations and their in situ analyses requires efficient co- scheduling strategies and sophisticated management of computational resources so that they are not slowing down each other. In this paper, we propose an efficient method to co-schedule simulations and in situ analyses such that the makespan of the workflow ensemble is minimized. We present a novel approach to allocate resources for a workflow ensemble under resource constraints by using a theoretical framework modeling the workflow ensemble’s execution. We evaluate the proposed approach using an accurate simulator based on the WRENCH simulation framework on various workflow ensemble configurations. Results demonstrate the significance of co-scheduling simulations and in situ analyses that couple data together to benefit from data locality, in which inefficient scheduling decisions can lead to slowdown in makespan up to a factor of 30.

Do, Tu Mai Anh↗