Search NASA⌕ Search

SEARCH · Search NASA

Results for “Workflow”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,765 records · Page 98

EMBOS User Manual

The Electronic Medical Business Operations System (EMBOS) is a state-of-the-art, web-based electronic medical records (EMR) system. It captures all patient data and the medical workflow, giving the medical provider a knowledge-based tool to support the health assessment process. EMBOS is a comprehensive system providing the following features: (1) Easy-to-use interface that reflects provider and support staff real-world workflows; (2) On-line patient questionnaires that enable pre-appointment updating of medical histories; (3) Patient scheduling and auto-scheduling of recurring exams with automated preappointment notifications and single-click patient registration; (4) Automated interfaces to lab devices and digital imaging systems; (5) Easy navigation to patient electronic health record summaries with drill-down functionality; (6) Support of psychological evaluation with results imported from standard psychological tools; (7) Real-time entry of clinical notes in easy-to-use exam forms; and (8) Roll-based function and data access, ensuring maximum security of patient health information.

99 GENERAL AND MISCELLANEOUS↗

Virtualized Network Control (VNC)

The focus of this project was on the development of a "Network Service Plane" as an abstraction model for the control and provisioning of multi-layer networks. The primary motivation for this work were the requirements of next generation networked applications which will need to access advanced networking as a first class resource at the same level as compute and storage resources. A new class of "Intelligent Network Services" were defined in order to facilitate the integration of advanced network services into application specific workflows. This new class of network services are intended to enable real-time interaction between the application co-scheduling algorithms and the network for the purposes of workflow planning, real-time resource availability identification, scheduling, and provisioning actions.

97 MATHEMATICS AND COMPUTING↗

In-Situ Statistical Analysis of Autotune Simulation Data using Graphical Processing Units

Developing accurate building energy simulation models to assist energy efficiency at speed and scale is one of the research goals of the Whole-Building and Community Integration group, which is a part of Building Technologies Research and Integration Center (BTRIC) at Oak Ridge National Laboratory (ORNL). The aim of the Autotune project is to speed up the automated calibration of building energy models to match measured utility or sensor data. The workflow of this project takes input parameters and runs EnergyPlus simulations on Oak Ridge Leadership Computing Facility’s (OLCF) computing resources such as Titan, the world’s second fastest supercomputer. Multiple simulations run in parallel on nodes having 16 processors each and a Graphics Processing Unit (GPU). Each node produces a 5.7 GB output file comprising 256 files from 64 simulations. Four types of output data covering monthly, daily, hourly, and 15- minute time steps for each annual simulation is produced. A total of 270TB+ of data has been produced. In this project, the simulation data is statistically analyzed in-situ using GPUs while annual simulations are being computed on the traditional processors. Titan, with its recent addition of 18,688 Compute Unified Device Architecture (CUDA) capable NVIDIA GPUs, has greatly extended its capability for massively parallel data processing. CUDA is used along with C/MPI to calculate statistical metrics such as sum, mean, variance, and standard deviation leveraging GPU acceleration. The workflow developed in this project produces statistical summaries of the data which reduces by multiple orders of magnitude the time and amount of data that needs to be stored. These statistical capabilities are anticipated to be useful for sensitivity analysis of EnergyPlus simulations

accelerators↗

National Computational Infrastructure for LatticeGauge Theory SciDAC-2 Closeout Report

As part of the reliability project work, researchers from Vanderbilt University, Fermi National Laboratory and Illinois Institute of technology developed a real-time cluster fault-tolerant cluster monitoring framework. The goal for the scientific workflow project is to investigate and develop domain-specific workflow tools for LQCD to help effectively orchestrate, in parallel, computational campaigns consisting of many loosely-coupled batch processing jobs.

97 MATHEMATICS AND COMPUTING↗

Final Report: Sublinear Algorithms for In-situ and In-transit Data Analysis at Exascale.

Post-Moore's law scaling is creating a disruptive shift in simulation workflows, as saving the entirety of raw data to persistent storage becomes expensive. We are moving away from a post-process centric data analysis paradigm towards a concurrent analysis framework, in which raw simulation data is processed as it is computed. Algorithms must adapt to machines with extreme concurrency, low communication bandwidth, and high memory latency, while operating within the time constraints prescribed by the simulation. Furthermore, in- put parameters are often data dependent and cannot always be prescribed. The study of sublinear algorithms is a recent development in theoretical computer science and discrete mathematics that has significant potential to provide solutions for these challenges. The approaches of sublinear algorithms address the fundamental mathematical problem of understanding global features of a data set using limited resources. These theoretical ideas align with practical challenges of in-situ and in-transit computation where vast amounts of data must be processed under severe communication and memory constraints. This report details key advancements made in applying sublinear algorithms in-situ to identify features of interest and to enable adaptive workflows over the course of a three year LDRD. Prior to this LDRD, there was no precedent in applying sublinear techniques to large-scale, physics based simulations. This project has definitively demonstrated their efficacy at mitigating high performance computing challenges and highlighted the rich potential for follow-on re- search opportunities in this space.

97 MATHEMATICS AND COMPUTING↗

PANTHER. Pattern ANalytics To support High-performance Exploitation and Reasoning.

Sandia has approached the analysis of big datasets with an integrated methodology that uses computer science, image processing, and human factors to exploit critical patterns and relationships in large datasets despite the variety and rapidity of information. The work is part of a three-year LDRD Grand Challenge called PANTHER (Pattern ANalytics To support High-performance Exploitation and Reasoning). To maximize data analysis capability, Sandia pursued scientific advances across three key technical domains: (1) geospatial-temporal feature extraction via image segmentation and classification; (2) geospatial-temporal analysis capabilities tailored to identify and process new signatures more efficiently; and (3) domain- relevant models of human perception and cognition informing the design of analytic systems. Our integrated results include advances in geographical information systems (GIS) in which we discover activity patterns in noisy, spatial-temporal datasets using geospatial-temporal semantic graphs. We employed computational geometry and machine learning to allow us to extract and predict spatial-temporal patterns and outliers from large aircraft and maritime trajectory datasets. We automatically extracted static and ephemeral features from real, noisy synthetic aperture radar imagery for ingestion into a geospatial-temporal semantic graph. We worked with analysts and investigated analytic workflows to (1) determine how experiential knowledge evolves and is deployed in high-demand, high-throughput visual search workflows, and (2) better understand visual search performance and attention. Through PANTHER, Sandia's fundamental rethinking of key aspects of geospatial data analysis permits the extraction of much richer information from large amounts of data. The project results enable analysts to examine mountains of historical and current data that would otherwise go untouched, while also gaining meaningful, measurable, and defensible insights into overlooked relationships and patterns. The capability is directly relevant to the nation's nonproliferation remote-sensing activities and has broad national security applications for military and intelligence- gathering organizations.

58 GEOSCIENCES↗

Echo™ User Manual

Echo™ is a MATLAB-based software package designed for robust and scalable analysis of complex data workflows. An alternative to tedious, error-prone conventional processes, Echo is based on three transformative principles for data analysis: self-describing data, name-based indexing, and dynamic resource allocation. The software takes an object-oriented approach to data analysis, intimately connecting measurement data with associated metadata. Echo operations in an analysis workflow automatically track and merge metadata and computation parameters to provide a complete history of the process used to generate final results, while automated figure and report generation tools eliminate the potential to mislabel those results. History reporting and visualization methods provide straightforward auditability of analysis processes. Furthermore, name-based indexing on metadata greatly improves code readability for analyst collaboration and reduces opportunities for errors to occur. Echo efficiently manages large data sets using a framework that seamlessly allocates resources such that only the necessary computations to produce a given result are executed. Echo provides a versatile and extensible framework, allowing advanced users to add their own tools and data classes tailored to their own specific needs. Applying these transformative principles and powerful features, Echo greatly improves analyst efficiency and quality of results in many application areas.

97 MATHEMATICS AND COMPUTING↗

Programming Models in HPC

These are the slides for a presentation on programming models in HPC, at the Los Alamos National Laboratory's Parallel Computing Summer School. The following topics are covered: Flynn's Taxonomy of computer architectures; single instruction single data; single instruction multiple data; multiple instruction multiple data; address space organization; definition of Trinity (Intel Xeon-Phi is a MIMD architecture); single program multiple data; multiple program multiple data; ExMatEx workflow overview; definition of a programming model, programming languages, runtime systems; programming model and environments; MPI (Message Passing Interface); OpenMP; Kokkos (Performance Portable Thread-Parallel Programming Model); Kokkos abstractions, patterns, policies, and spaces; RAJA, a systematic approach to node-level portability and tuning; overview of the Legion Programming Model; mapping tasks and data to hardware resources; interoperability: supporting task-level models; Legion S3D execution and performance details; workflow, integration of external resources into the programming model.

97 MATHEMATICS AND COMPUTING↗

Echo

This document is a white paper marketing proposal for Echo™ is a data analysis platform designed for efficient, robust, and scalable creation and execution of complex workflows. Echo’s analysis management system refers to the ability to track, understand, and reproduce workflows used for arriving at results and decisions. Echo improves on traditional scripted data analysis in MATLAB, Python, R, and other languages to allow analysts to make better use of their time. Additionally, the Echo platform provides a powerful data management and curation solution allowing analysts to quickly find, access, and consume datasets. After two years of development and a first release in early 2016, Echo is now available for use with many data types in a wide range of application domains. Echo provides tools that allow users to focus on data analysis and decisions with confidence that results are reported accurately.

97 MATHEMATICS AND COMPUTING↗

Web-Based Computational Model Builder For Nuclear Energy Advanced Modeling and Simulation (Final Report)

According to the World Nuclear Association, the U.S. is the largest producer of nuclear power worldwide. In fact, the U.S. provides over 30 percent of the world's nuclear generation of electricity. Although few new reactors have been built in the past 30 years, the association anticipates that four to six reactors may be built by 2020. The first of the reactors will be built in response to 16 license applications, which have been completed since 2007, to build 24 additional nuclear reactors. Currently, both government and industry are working to accelerate approval for the construction and design of new nuclear energy plants. The U.S. nuclear industry has already achieved significant developments in the implementation of nuclear power plants due to advancements in refueling, maintenance, and safety systems at current power plants. Meanwhile, changes in government policy, which have occurred since the late 1990s, have provided for noteworthy expansion in nuclear capacity. For example, the Energy Policy Act of 2005 evoked investment in electricity infrastructure such as nuclear power. To design future systems and continue operational improvements at existing U.S. plants, advanced modeling and simulation of nuclear reactors are crucial. We developed a Cloud/Web-based tool, HPCCloud, that enables nuclear energy firms, or other manufacturing and engineering companies, to innovate using advanced modeling and simulation. Through the Web-Based Computational Model Builder for Nuclear Energy Advanced Modeling and Simulation grant, we develop HPCCloud to simplify and democratize advanced modeling and simulation in the nuclear energy industry on a range of nuclear engineering applications. It leverages millions of investment dollars from the Department of Energy's Consortium for Advanced Simulation of Light Water Reactors (CASL) and the Office of Nuclear Energy's research and development in Nuclear Energy Advanced Modeling and Simulation (NEAMS). Our approach simplifies the workflow, alleviates the need for in-house computational science and engineering experts, and lowers the capital investments required for advanced modeling and simulation. The Cloud/Web-based simulation environment guides end-users and developers through the advanced modeling and simulation lifecycle. In addition to providing significantly improved, intuitive software, the environment offers reproducible workflows where one can save, share, and even publish the full path of data from input to final analyzed results. HPCCloud addresses identified challenges to the nuclear energy industry's use of advanced modeling and simulation. With this unique Cloud/Web-based environment, we enable an ecosystem of synergistic activities, fueling new research and development for nuclear energy. HPCCloud lays the groundwork for commercialization, through customization, technology integration, and advanced research and development services.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Resource Aware Intelligent Network Services (RAINS) Final Technical Report

The Resource Aware Intelligent Network Services (RAINS) project conducted research and developed technologies in the area of cyber infrastructure resource modeling and computation. The goal of this work was to provide a foundation to enable intelligent, software defined services which spanned the network AND the resources which connect to the network. A Multi-Resource Service Plane (MRSP) was defined, which allows resource owners/managers to locate and place themselves from a topology and service availability perspective within the dynamic networked cyberinfrastructure ecosystem. The MRSP enables the presentation of integrated topology views and computation results which can include resources across the spectrum of compute, storage, and networks. The RAINS project developed MSRP includes the following key components: i) Multi-Resource Service (MRS) Ontology/Multi-Resource Markup Language (MRML), ii) Resource Computation Engine (RCE), iii) Modular Driver Framework (to allow integration of a variety of external resources). The MRS/MRML is a general and extensible modeling framework that allows for resource owners to model, or describe, a wide variety of resource types. All resources are described using three categories of elements: Resources, Services, and Relationships between the elements. This modeling framework defines a common method for the transformation of cyber infrastructure resources into data in the form of MRML models. In order to realize this infrastructure datification, the RAINS project developed a model based computation system, i.e. “RAINS Computation Engine (RCE)”. The RCE has the ability to ingest, process, integrate, and compute based on automatically generated MRML models. The RCE interacts with the resources thru system drivers which are specific to the type of external network or resource controller. The RAINS project developed a modular and pluggable driver system which facilities a variety of resource controllers to automatically generate, maintain, and distribute MRML based resource descriptions. Once all of the resource topologies are absorbed by the RCE, a connected graph of the full distributed system topology is constructed, which forms the basis for computation and workflow processing. The RCE includes a Modular Computation Element (MCE) framework which allows for tailoring of the computation process to the specific set of resources under control, and the services desired. The input and output of an MCE are both model data based on MRS/MRML ontology and schema. Some of the RAINS project accomplishments include: Development of general and extensible multi-resource modeling framework; Design of a Resource Computation Engine (RCE) system which includes the following key capabilities; Absorb a variety of multi-resource model types and build integrated models; Novel architecture which uses model based communications across the full stack for all Flexible provision of abstract or intent based user facing interfaces; Workflow processing based on model descriptions; Release of the RCE as an open source software; Deployment of RCE in the University of Maryland/Mid-Atlantic Crossroad ScienceDMZ in prototype mode with a plan under way to transition to production; Deployment at the Argonne National Laboratory DTN Facility in prototype mode; Selection of RCE by the DOE SENSE (SDN for End-to-end Networked Science at the Exascale) project as the basis for their orchestration service.

97 MATHEMATICS AND COMPUTING↗

GMD Coupling to Power Systems and Disturbance Mitigation

Presentation includes slides on Geomagnetic Disturbance: Ground Fields; Geomagnetic Disturbance: Coupling to Bulk Electric System; Geomagnetic Disturbance: Transformers; GMD Assessment Workflow (TPL-007-1); FERC order 830; Goals; SuperMag (1 min data) Nov. 20-21, 2003 Storm (DST = -422); Spherical Harmonics; Spherical Harmonics Nov. 20-21, 2003 Storm (DST = -422); DST vs HN0,0; Fluctuations vs. DST; Fluctuations; Conclusions and Next Steps; GMD Assessment Workflow (TPL-007-1); EMP E3 Coupling to Texas 2000 Bus Model; E3 Coupling Comparison (total GIC) Varying Ground Zero; E3 Coupling Comparison (total MVAR) Varying Ground Zero; E3 Coupling Comparison (GIC) at Peak Ground Zero; E3 Coupling Comparison (GIC) at Peak Ground Zero; and Conclusion.

58 GEOSCIENCES↗

mystic - a brief introduction

The mystic framework enables the solving of difficult optimization problems through three major innovations: (1) plug-and-play component-based optimization algorithms, (2) the ability to dynamically construct and apply generalzed trnasforms, K , where x' = K(x) , and (3) workflows providing asynchronous execution and statefulness. These features, in conjunction with supporting packages pathos , pyina , and klepto , can provide massively-parallel scalable workflows for quickly solving optimization problems in complex nonlinear spaces. mystic can be used to simplify non-convex optimization problems by transforming away nonlinearities through user-built kernel transforms. This tutorial demonstrates using mystic for machine learning with automated dimensional-reduction, using embarrasingly parallel solver ensembles to find an accurate interpolated surrogate for a nonlinear surface, and the determination of worst-case bounds on expectation value of an objective function under uncertainty.

97 MATHEMATICS AND COMPUTING↗

Creating an Interprocedural Analyst-Oriented Data Flow Representation for Binary Analysts (CIAO)

National security missions require understanding third-party software binaries, a key element of which is reasoning about how data flows through a program. However, vulnerability analysts protecting software lack adequate tools for understanding data flow in binaries. To reduce the human time burden for these analysts, we used human factors methods in a rolling discovery process to derive user-centric visual representation requirements. We encountered three main challenges: analysis projects span weeks, analysis goals significantly affect approaches and required knowledge, and analyst tools, techniques, conventions, and prioritization are based on personal preference. To address these challenges, we initially focused our human factors methods on an attack surface characterization task. We generalized our results using a two-stage modified sorting task, creating requirements for a data flow visualization. We implemented these requirements partially in manual static visualizations, which we informally evaluated, and partially in automatically generated interactive visualizations, which have yet to be integrated into workflows for evaluation. Our observations and results indicate that 1) this data flow visualization has the potential to enable novel code navigation, information presentation, and information sharing, and 2) it is an excellent time to pursue research applying human factors methods to binary analysis workflows.

42 ENGINEERING↗

Analysis of Differential Financial Impacts of LWR Load-Following Operations. Revision 1

This document reports the application of HERON (Holistic Energy Resource Optimization Network), a newly-developed RAVEN (Risk Analysis Virtual ENvironment) plugin for grid and capacity optimization, to a case study conducted in collaboration with Arizona Public Service (APS). The study is a work in progress; this report presents a description of current models and corresponding results for a particular consideration. APS is anticipating several operational challenges. The first is rapid growth of Variable Renewable Energy (VRE) sources such as wind and solar power providing energy to the grid in the APS service region. This creates challenges for baseload operation of the Palo Verde Generating Station (PVGS), a nuclear power plant co-owned and operated by APS. The second challenge for APS is a change in the cooling water acquisition contract with the Sub Regional Operating Group (SROG). The existing contract is expiring soon, and a renewal is only available for a significantly higher price of water. These two challenges represent a difficulty in maintaining profitability for PVGS as local area demand is highly fluctuant and water prices may increase. Furthermore, excess production at PVGS is currently traded on the Palo Verde energy Hub (PVH), which occasionally offers very low or negative locational marginal prices (LMP) for electricity. This analysis considers the potential benefits of occasional curtailment of PVGS as a method to mitigate unprofitable production hours. Similar to load following, optional daily curtailment would allow APS to elect curtailment of PVGS as low as 70% of its nominal operating level between the hours of 08:00 and 16:00 provided local area demand is met and it is profitable to do so. This document reports a stochastic differential analysis of the Net Present Value (NPV) of PVGS as operated by NPS as a result of optional curtailment operation. To model this differential case, HERON has been designed from previous efforts in this study as a generic tool to accelerate the design and execution of RAVEN workflows for technoeconomic analysis of grid energy systems. HERON leverages both RAVEN and the CashFlow plugin for RAVEN to stochastically explore or optimize a response surface with energy grid system production capacities as inputs and mean NPV as a goal function. HERON performs these evaluations by stochastically sampling market, weather, and demand events using RAVEN’s ARMA reduced-order model capability to generate boundary conditions for dispatch optimization. The algorithm performs the dispatch optimization for each of the synthetic scenarios. For this case, HERON designs workflows to simulate behavior of the PVH, wind, solar, and APS local area demand, and use these synthetic scenarios to stochastically evaluate the differential benefit of optional curtailment for each scenario. While this study finds optional curtailment to be a potential source of revenue, the magnitude of the differential NPV is sufficiently small that it is unlikely a priority for increasing the profitability of PVGS. Further, the differential NPV shrinks throughout the simulated years, suggesting the long-term benefit of such operation given current assumptions is negligible.

14 SOLAR ENERGY↗

Implementation and Verification of Isolated Defects for GTS Lifecycle Analyses

Often, the presence of cracks in manufactured components are detrimental to their overall performance. We develop a workflow and tools in this report using CUBIT and Sierra/SM for generating and modeling crack defects to better understand their impact on such components. To this end, we provide a CUBIT library of various prototypical crack defects embedded in pipes and plates that can be readily used in a wide range of simulations, with specific application to those used in Gas Transfer Systems (GTS). We verify the accuracy of the J-integral post-processing capability in Sierra against solutions available in existing literature for the cracks and geometries of interest within the context of linear elastic fracture mechanics, and describe ongoing efforts to quantify and assess numerical errors. Through this process, we outline overall suggestions and recommendations to the user based on the proposed workflow.

97 MATHEMATICS AND COMPUTING↗

SDN-NGenIA, a Software Defined Next Generation Integrated Architecture for HEP and Data Intensive Science

This project aims to enable the LHC and other leading programs in high energy physics and other global science domains funded by the DOE to operate with a new level of efficiency and control, through the development of a Next Generation Integrated Architecture (NGenIA) based on intelligent software defined network (SDN)-driven network systems coupled to high throughput applications. While the initial focus is on the challenging LHC use case, the systems and products being developed are general, and apply to many fields of data intensive science ranging from astrophysical sky surveys to bioinformatics and earth observation, as well as other organizations facing the challenges of extracting knowledge from distributed multi-petabyte data stores. A central concept in this development program is a new paradigm ‘consistent network operations’ among widely distributed computing and storage facilities, where stable high throughput flows, at set rates, cross load-balanced network paths, up to flexible high water marks that are adjusted in real time to accommodate other network traffic. The large smooth flows are launched and managed by SDN services that act in concert with the experiments’ site-resident data distribution and management systems, to meet the expanding needs of the science programs. The technical goals include the construction of autonomous, intelligent site-resident services that interact dynamically with network-resident services, and with the science programs’ principal data distribution and management tools, to request or command network resources in support of high throughput petascale to exascale workflow Specific work items include: 1. Developing compact Data Transfer Nodes (DTNs) with auto-tuning functions that support data transfer rates in the 100 Gbps to the 1 Tbps range when used with high throughput data transfer applications 2. Deep site orchestration among virtualized clusters, storage subsystems and subnets to successfully coschedule CPU, storage and network resources 3. Science-program designed site architectures, operational modes, and policy and resource usage priorities, adjudicated across multiple network domains and virtual organizations, using the orchestration functions and methods 4. Seamlessly extending end-to-end operation across both extra-site and intra-site boundaries through the use of Open vSwitch (OVS), FireQoS + next generation Science DMZs 5. Novel methods of system integration that enable granular control of extreme scale long distance transfers through flow matching of scattered source-destination address pairs to multi-domain dynamic circuits 6. Funneling massive sets of streams to DTNs at the site edge hosting petascale buffer pools configured for flows of 100 Gbps and up, exploiting state of the art data transfers 7. Adaptive scheduling based on pervasive end-to-end monitoring, including DTN or compute-node resident agents providing comprehensive end-system profiling 8. Developing unsupervised and supervised machine learning and modeling methods to optimize the workflow involving terabyte to multi-petabyte datasets.

47 OTHER INSTRUMENTATION↗

Realizing High-Accuracy Low-Cost Measurement and Verification for Deep Cost Savings (BPA Cost Share CRADA)

Developed practitioner workflows that integrate advanced M&V tools with supplementary automated routines for non-routine adjustments and for quantification of savings uncertainty to indicate rigor. Demonstrated these workflows with Seattle City Light, in collaboration with their implementers and evaluators – determine labor and time/cost savings, and uncertainty of the results obtained. Engaged the Pacific Northwest regulatory community to determine acceptance criteria for the required accuracy and reporting of advanced whole-building M&V. Documented the findings to facilitate broad industry uptake of the solutions.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗