Search NASA⌕ Search

SEARCH · Search NASA

Results for “Visualization systems and software”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

Metrics for evaluating tropical cyclones in climate data

This manuscript describes a software suite that can be used for objective evaluation of tropical cyclones (TCs) in gridded climate data. Using cyclone trajectories derived from 6-hourly data, a comprehensive set of metrics is defined to systematically compare and contrast products to one another. In addition to annual TC climatologies, attention is paid to spatial and temporal patterns of storm occurrence and intensity. Assessment can be performed either on the global scale or regional domains. Simple to visualize ‘scorecards’ allow for rapid credibility assessment. We showcase three key findings enabled by this suite. First, we compare the representation of TCs in seven current-generation global reanalyses and conclude that higher resolution models and those with TC-specific assimilation contain more accurate storm climatologies. Second, using a free-running Earth system model (ESM) we find that full basin refinement is required in variable-resolution configurations to adequately simulate North Atlantic TC frequency. Furthermore, upstream refinement over northern Africa offers little benefit in simulating storm occurrence but spatial genesis patterns are improved. Finally, we show that TCs simulated by ESMs can be highly sensitive to individual parameterizations in climate models, with North Atlantic TC metrics varying greatly depending on version of the Morrison-Gettelman microphysics package.

54 ENVIRONMENTAL SCIENCES↗

Grid Modernization of Cooperatives and Municipal Utilities via Breakthrough System Monitoring, Control and Optimization (CRADA Final Report)

This project aims at developing and demonstrating successful implementation of breakthrough approaches in real-time data visualization as well as real-time distributed DER control and optimization to provide ample benefits to both utilities and end users. The National Renewable Energy Laboratory (NREL), Holy Cross Energy (HCE), National Rural Electric Cooperative Association (NRECA) and Survalent are collaborating to enable Cooperative and Municipal utilities to fully leverage DERs as part of their strategies for providing safe, reliable, and affordable electric services to their customers and help meet DOE Grid modernization goal of achieving at least 10% active devices to provide grid flexibility by 2035. This project will use novel real-time control algorithms and approaches for distributed control recently developed under DOE-funded projects, using the date from the Survalent’s basic SCADA engine, GIS and AMI engines deployed at HCE combined with NRECA’s globally-used MultiSpeak(R) software interoperability specification for seamless and real-time communications between electric utility enterprise software to embrace DER as part of their strategies for providing safe, reliable and affordable electric service to their customers.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Substation Secondary Asset Health Monitoring and Management System (SSHM)

Electric Power Group, LLC (EPG) was awarded DOE OE0000850 to design, develop, and demonstrate a real-time software application for substation secondary equipment health monitoring and management at host utility American Electric Power (AEP), a cost share partner. This project addresses the need for monitoring substation equipment health and providing operators with tools to identify and take pre-emptive action to avoid catastrophic equipment failure. By monitoring synchrophasor data in real time, data anomalies that indicate potential asset failure can be detected and alerts can be sent to operators in time to take corrective actions. EPG developed two data driven algorithms to identify abnormal equipment signature patterns as well as a method using substation linear state estimation (SLSE). The software has been deployed on hardened PC’s and tested and validated for cost share partner AEP’s substations - 138kV and 765 kV. The SSHM software has been accepted by AEP and final demonstration of DOE - OE0000850 for AEP and DOE was successfully completed on March 17th, 2020. EPG developed the Substation Secondary Asset Health Monitoring (SSHM) Platform to analyze equipment failure signatures in PMU data and alert substation personnel when pre-emptive inspection, repairs and other actions are warranted to prevent potential catastrophic failures. This is the first system that automatically monitors the health of substation secondary assets and alerts users to emerging failures using synchrophasor measurements. SSHM uses high resolution PMU data from PTs, CTs, and CCVTs to analyze equipment signatures and identify anomalies that are precursor indicators of potential equipment failure. When an anomaly is detected, there is a likelihood of potential failure of monitored equipment, the system alerts the user with visual alarms including alarm trend charts and indicator lights on a oneline diagram of the substation.

24 POWER TRANSMISSION AND DISTRIBUTION↗

New Developments and Capabilities Within WEC-Sim

WEC-Sim is an open-source software for simulating wave energy converters and has been actively developed and applied since its initial release in 2014 to simulate a wide variety of device archetypes. WEC-Sim is developed jointly by the National Renewable Energy Laboratory and Sandia National Laboratories within the MATLAB/SIMULINK environment. A general wave-to-wire model begins with a deployment site resource characterization, which is used to complete the hydrodynamic simulation of wave energy converters (WEC), with the power generation profile imported to a grid simulator to understand the influence on the local electrical network. While modeling the entire wave-to-wire is difficult and encompasses multiple time scales and physics, WEC-Sim is focused on the hydrodynamics simulation to predict, analyze, and optimize WEC dynamics and power performance. WEC-Sim simulations are performed in the time domain based on the radiation and diffraction method using hydrodynamics coefficients derived from boundary element method (BEM)-based frequency-domain potential flow solvers (e.g., WAMIT, NEMOH, Capytaine, or ANSYS-AQWA). With this level of modeling fidelity, WEC-Sim can handle floating body hydrodynamics, mechanical and electrical power generation methods, advanced control implementation, mooring systems, and other unique applications such as desalination. Additional WEC-Sim functionalities include pre-built Simulink blocks and MATLAB scripts that can simulate a wide range of floating systems and the corresponding auxiliary subsystems. The developers of WEC-Sim continue to release new versions of the software, at least annually, with the latest release in September 2022. These releases include bug fixes, updates to software documentation, as well as new features to expand WEC-Sim's capabilities to model a wide range of WEC concepts. This publication will highlight the new features added to WEC-Sim between versions 4.1.0 to 5.0.1, which spans a 2-year period from June 2020 to September 2022. New features described here include topics such as continuous integration checks, revised Morison Element and nonlinear hydro implementations, run directly from Simulink (required for hardware-in-the-loop execution), BEMIO updates to import Capytaine BEM hydrodynamics, addition of cable blocks, and new wave visualization features.

TIDAL AND WAVE POWER↗

Modeling of diatomic molecule using the Morse potential and the Verlet algorithm

Performing molecular modeling usually uses special software for Molecular Dynamics (MD) such as: GROMACS, NAMD, JMOL etc. Molecular dynamics is a computational method to calculate the time dependent behavior of a molecular system. In this work, MATLAB was used as numerical method for a simple modeling of some diatomic molecules: HCl, H{sub 2} and O{sub 2}. MATLAB is a matrix based numerical software, in order to do numerical analysis, all the functions and equations describing properties of atoms and molecules must be developed manually in MATLAB. In this work, a Morse potential was generated to describe the bond interaction between the two atoms. In order to analyze the simultaneous motion of molecules, the Verlet Algorithm derived from Newton’s Equations of Motion (classical mechanics) was operated. Both the Morse potential and the Verlet algorithm were integrated using MATLAB to derive physical properties and the trajectory of the molecules. The data computed by MATLAB is always in the form of a matrix. To visualize it, Visualized Molecular Dynamics (VMD) was performed. Such method is useful for development and testing some types of interaction on a molecular scale. Besides, this can be very helpful for describing some basic principles of molecular interaction for educational purposes.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Analysis of Radiation Transport Due to Activated Coolant in the ITER Neutral Beam Injection Cell

Detailed spatial distributions of the biological dose rate due to a variety of sources are required for the design of the ITER tokamak facility to ensure that all radiological zoning limits are met. During operation, water in the Integrated loop of Blanket, Edge-localized mode and vertical stabilization coils, and Divertor (IBED) cooling system will be activated by plasma neutrons and will flow out of the bioshield through a complex system of pipes and heat exchangers. This paper discusses the methods used to characterize the biological dose rate outside the tokamak complex due to 16 N gamma radiation emitted by the activated coolant in the Neutral Beam Injection (NBI) cell of the tokamak building. Activated coolant will enter the NBI cell through the IBED Primary Heat Transfer System (PHTS), and the NBI PHTS will also become activated due to radiation streaming through the NBI system. To properly characterize these gamma sources, the production of 16 N, the decay of 16 N, and the flow of activated water through the coolant loops were modeled. The impact of conservative approximations on the solution was also examined. Once the source due to activated coolant was calculated, the resulting biological dose rate outside the north wall of the NBI cell was determined through the use of sophisticated variance reduction techniques. The AutomateD VAriaNce reducTion Generator (ADVANTG) software implements methods developed specifically to provide highly effective variance reduction for complex radiation transport simulations such as those encountered with ITER. Using ADVANTG with the Monte Carlo N-particle (MCNP) radiation transport code, radiation responses were calculated on a fine spatial mesh with a high degree of statistical accuracy. In conclusion, advanced visualization tools were also developed and used to determine pipe cell connectivity, to facilitate model checking, and to post-process the transport simulation results.

59 BASIC BIOLOGICAL SCIENCES↗

Damaris: Addressing performance variability in data management for post-petascale simulations

With exascale computing on the horizon, reducing performance variability in data management tasks (storage, visualization, analysis, etc.) is becoming a key challenge in sustaining high performance. Here, this variability significantly impacts the overall application performance at scale and its predictability over time. In this article, we present Damaris, a system that leverages dedicated cores in multicore nodes to offload data management tasks, including I/O, data compression, scheduling of data movements, in situ analysis, and visualization. We evaluate Damaris with the CM1 atmospheric simulation and the Nek5000 computational fluid dynamic simulation on four platforms, including NICS’s Kraken and NCSA’s Blue Waters. Our results show that (1) Damaris fully hides the I/O variability as well as all I/O-related costs, thus making simulation performance predictable; (2) it increases the sustained write throughput by a factor of up to 15 compared with standard I/O approaches; (3) it allows almost perfect scalability of the simulation up to over 9,000 cores, as opposed to state-of-the-art approaches that fail to scale; and (4) it enables a seamless connection to the VisIt visualization software to perform in situ analysis and visualization in a way that impacts neither the performance of the simulation nor its variability. In addition, we extended our implementation of Damaris to also support the use of dedicated nodes and conducted a thorough comparison of the two approaches—dedicated cores and dedicated nodes—for I/O tasks with the aforementioned applications.

97 MATHEMATICS AND COMPUTING↗

Basin Assessment Spatial Planning Platform

The tool is intended to facilitate hydropower development and water resource planning by improving synthesis and interpretation of disparate spatial datasets that are considered in development actions (e.g., hydrological characteristics, environmentally and culturally sensitive areas, existing or proposed water power resources, climate-informed forecasts). The tool enables this capability by providing a unique framework for assimilating, relating, summarizing, and visualizing disparate spatial data through the use of spatial aggregation techniques, relational geodatabase platforms, and an interactive web-based Geographic Information Systems (GIS). Data are aggregated and related based on shared intersections with a common spatial unit; in this case, industry-standard hydrologic drainage areas for the U.S. (National Hydrography Dataset) are used as the spatial unit to associate planning data. This process is performed using all available scalar delineations of drainage areas (i.e., region, sub-region, basin, sub-basin, watershed, sub-watershed, catchment) to create spatially hierarchical relationships among planning data and drainages. These entity-relationships are stored in a relational geodatabase that provides back-end structure to the web GIS and its widgets. The full technology stack was built using all open-source software in modern programming languages. Interactive widgets that function within the viewport are also compatible with all modern browsers.

Source record↗

Research and Development Toward Massive Liquid Argon Time Projection Chambers for Neutrino Detection

Liquid argon (LAr) time projection chambers (TPC) have rapidly increased in importance as particle detectors throughout the past four decades. While much research has been completed, there are still many areas which require further development to build and operate the next generation LAr TPC experiment, such as the Deep Underground Neutrino Experiment (DUNE). These include high voltage breakdown, argon purification and purity monitoring, and vacuum ultraviolet (VUV) scintillation light measurement. Visual monitoring of high voltage breakdown is helpful in allowing assessment of the performance of high voltage component design. Thus, a system of cryogenic cameras, the first of its kind, was developed for use in a large LAr cryostat, without the need for additional electronics heating. The system functioned without problem for 50 days at cryogenic temperature, with some degradation of image quality, and provided a useful monitor for the DUNE 35-ton cryogenics systems. The system did not observe any high voltage breakdowns during the run. Further development of the concept is ongoing for future installation in other experiments. The monitoring of LAr purity using TPC data is a fundamental study for LAr TPC experiments. However, the study has not been performed for a large LAr TPC in the presence of high electronic noise. Custom software was developed and validated for the accurate reconstruction of signals in noisy TPC data. The results of the reconstruction were used to successfully measure the LAr electron lifetime with an uncertainty comparable to alternate methods of measurement. The electron lifetime of the 35-ton Phase II run is determined to be 4.12 ± 0.17 (stat.) ±0.40 (syst.) ms. For general purpose research and development of high purity LAr as a particle detection medium, a dedicated test stand was designed, constructed, and commissioned. The system is used to test the gaseous photomultiplier (GPM) performance at cryogenic temperatures. The GPM functions with photoelectron multiplication at 77 K, at a reduced gain. Further study is required to show the detector’s direct sensitivity to LAr VUV scintillation light.

Thiesse, Matthew↗

New Developments and Capabilities Within WEC-Sim: Preprint

WEC-Sim is an open-source software for simulating wave energy converters, which has been actively developed and applied since its initial release in 2014 to simulate a wide variety of device archetypes. WEC-Sim is developed jointly by the National Renewable Energy Laboratory (NREL) and Sandia National Laboratories (Sandia) within the MATLAB/SIMULINK environment. A general wave-to-wire model begins with a deployment site resource characterization, which is used to complete the hydrodynamic simulation of wave energy converters (WEC), with the power generation profile imported to a grid simulator to understand the influence on the local electrical network. While modeling the entire wave-to-wire is difficult and encompasses multiple time scales and physics, WEC-Sim is focused on the hydrodynamics simulation to predict, analyze, and optimize WEC dynamics and power performance. WEC-Sim simulations are performed in the time domain based on the radiation and diffraction method using hydrodynamics coefficients derived from boundary element method (BEM)-based frequency-domain potential flow solvers (e.g., WAMIT, NEMOH, Capytaine, or ANSYS-AQWA). With this level of modeling fidelity, WEC-Sim can handle floating body hydrodynamics, mechanical and electrical power generation methods, advanced control implementation, mooring systems, and other unique applications such as desalination. Additional WEC-Sim functionalities include pre-built Simulink blocks and MATLAB scripts that can simulate a wide range of floating systems and the corresponding auxiliary subsystems. The developers of WEC-Sim continue to release new versions of the software, at least annually, with our latest release in September 2022. These releases include bug fixes, updates to software documentation, as well as new features to expand WEC-Sim's capabilities to model a wide range of WEC concepts. This publication will highlight the new features added to WEC-Sim between versions 4.1.0 to 5.0.1 which spans over a two year period from June 2020 to September 2022. New features to be described will include topics such as continuous integration checks, revised Morison Element and nonlinear hydro implementations, run directly from Simulink (required for hardware-in-the-loop execution), BEMIO updates to import Capytaine BEM hydrodynamics, addition of cable blocks, and new wave visualization features.

TIDAL AND WAVE POWER↗

Preprocessing Prediction of Advanced Algorithms for Medical Imaging

Advanced medical imaging algorithms (such as bone removal, vessel segmentation, or a lung nodule detection) can provide extremely valuable information to the radiologists, but they might sometimes be very time consuming. Being able to run the algorithms in advance can be a possible solution. However, we do not know which algorithm to run on a given dataset before it is actually used. It is possible to manually insert matching rules for preprocessing algorithms, but it requires high maintenance and does not work well in practice. This paper presents a dynamic machine learning solution for predicting which advanced visualization (AV) algorithm needs to be applied on a given series. The system gets a handful of free text DICOM tags as an input and builds a model in the clinical setting. It incorporates a Bag of Words (BOW) feature extractor and a Random Forest classifier. The approach was tested on two datasets from clinical sites which use different languages and varying scanner models. We show that even without feature extraction, sensitivity of above 90% can be reached on both of them. By using BOW feature extractor, precision and sensitivity can usually be further improved. Even on a noisy and highly unbalanced dataset, only around 100 samples were needed to reach sensitivity of above 80% and specificity of above 97%. We show how the solution can be part of a Smart Preprocessing mechanism in a viewing software. Using such a system will ultimately minimize the time to launch studies and improve radiologists reading time efficiency.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

A framework for stochastic simulations and visualization of biological electron-transfer dynamics

Electron transfer (ET) dictates a wide variety of energy-conversion processes in biological systems. Visualizing ET dynamics could provide key insight into understanding and possibly controlling these processes. We present a computational framework named VizBET to visualize biological ET dynamics, using an outer-membrane Mtr–Omc cytochrome complex in Shewanella oneidensis MR-1 as an example. Starting from X-ray crystal structures of the constituent cytochromes, molecular dynamics simulations are combined with homology modeling, protein docking, and binding free energy computations to sample the configuration of the complex as well as the change of the free energy associated with ET. This information, along with quantum-mechanical calculations of the electronic coupling, provides inputs to kinetic Monte Carlo (KMC) simulations of ET dynamics in a network of heme groups within the complex. Visualization of the KMC simulation results has been implemented as a plugin to the Visual Molecular Dynamics (VMD) software. Finally, VizBET has been used to reveal the nature of ET dynamics associated with novel nonequilibrium phase transitions in a candidate configuration of the Mtr–Omc complex due to electron–electron interactions.

74 ATOMIC AND MOLECULAR PHYSICS↗

Combining Measurements with Three-Dimensional Laser Scanning System and Coded Aperture Gamma-Ray Imaging System for International Safeguards Applications

Being able to verify the operator's declaration in regard to the technical design of nuclear facilities is an important aspect of every safeguards approach. In addition to visual observation, it is necessary to know if nuclear material is present or has been present in undeclared piping and ducts. The possibility of combining the results from different measurement techniques into one easily interpreted product should optimize the inspection effort and increase safeguards effectiveness. A collaborative effort to investigate the possibility of combining measurements from a three-dimensional (3D) laser scanning system and gamma-ray imaging systems is under way. The feasibility of the concept has been previously proven with different laboratory prototypes of gamma-ray imaging systems. Recently, simultaneous measurements were conducted with a new highly portable, mechanically cooled, High Purity Germanium (HPGe), coded-aperture gamma-ray imager and a 3D laser scanner in an operational facility with complex configuration and different enrichment levels and quantities of uranium. With specially designed software, data from both instruments were combined and a 3D model of the facility was generated that also identified locations of radioactive sources. This paper provides an overview of the technology, describes the measurements, discusses the various safeguards scenarios addressed, and presents results of experiments.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Phase II Nevada Water Resources Data, Modeling, and Visualization (DMV) Center (Final Report)

Water is unquestionably a critical resource throughout the United States. In the semi-arid west -- an area stressed by increase in human population and sprawl of the built environment -- water is the most important limiting resource. Crucially, science must understand factors that affect availability and distribution of water. To sustain growing consumptive demand, science needs to translate understanding into reliable and robust predictions of availability under weather conditions that could be average but might be extreme. These predictions are needed to support current and long-term planning. Similar to the role of weather forecast and climate prediction, water prediction over short and long temporal scales can contribute to resource strategy, governmental policy and municipal infrastructure decisions, which are arguably tied to the natural variability and unnatural change to climate. Change in seasonal and annual temperature, precipitation, snowmelt, and runoff affect the distribution of water over large temporal and spatial scales, which impact the risk of flooding and the groundwater recharge. Anthropogenic influences and impacts increase the complexity and urgency of the challenge. The goal of this project has been to develop a decision support framework of data acquisition, digital modeling, and 3D visualization. This integrated framework consists of tools for compiling, discovering and projecting our understanding of processes that control the availability and distribution of water. The framework is intended to support the analysis of the complex interactions between processes that affect water supply, from controlled availability to either scarcity or deluge. The developed framework enables DRI to promote excellence in water resource management, particularly within the Lake Tahoe basin. In principle, this framework could be replicated for other watersheds throughout the United States. Phase II of this project builds upon the research conducted during Phase I, in which the hydrologic framework was investigated and the development initiated. Phase II concentrates on practical implementation of the earlier work but emphasizes applications to the hydrology of the Lake Tahoe basin. Phase 1 efforts have been refined and extended by creating a toolset for geographic information systems (GIS) that is usable for disparate types of geospatial and geo-referenced data. The toolset is intended to serve multiple users for a variety of applications. The web portal for internet access to hydrologic and remotely sensed product data, prototyped in Phase I, has been significantly enhanced. The portal provides high performance access to LANDSAT-derived data using techniques developed during the course of the project. The portal is interactive, and supports the geo-referenced display of hydrologic information derived from remotely sensed data, such as various vegetative indices used to calculate water consumption. The platform can serve both internal and external constituencies using inter-operating infrastructure that spans both sides of the DRI firewall. The platform is intended grow its supported data assets and to serve as a template for replication to other geographic areas. An unanticipated development during the project was the use of ArcGIS software on a new computer system, called the IBM PureSytems, and the parallel use of the systems for faster, more efficient image processing. Additional data, independent of the portal, was collected within the Sagehen basin and provides detailed information regarding the processes that control hydrologic responses within mountain watersheds. The newly collected data include elevation, evapotranspiration, energy balance and remotely sensed snow-pack data. A Lake Tahoe basin hydrologic model has been developed, in part to help predict the hydrologic impacts of climate change. The model couples both the surface and subsurface hydrology, with the two components having been independently calibrated. Results from the coupled simulations involving both surface water and groundwater processes show that it is possible to fairly accurately simulate lake effects and water budget variables over a wide range of dry and wet cycles in the historical record. The Lake Tahoe basin is representative of the hydrology, topography and climate throughout the Sierra Nevada Range, and the entire model development is prototypical of the efforts required to replicate the decision support framework to other locales. The Lake Tahoe model in particular, could allow water managers to evaluate more accurately components of the water budget (ET, runoff, groundwater, etc) and to answer important questions regarding water resources in northern Nevada. This report discusses the geographic scale and the hydrologic complexity of the calibrated model developed as part of this project, as well as simulation results for historical and future climate projects To enable human-driven data exploration and discovery, de novo software for a globalized rendering module that extends the capability of our evolving custom visualization engine from Phase I (called SMEngine) has been developed. The new rendering component, called Horizon, supports terrain rendering capable of displaying and interrogating both remotely sensed and modeled data. The development of Horizon necessitated adaptation of the visualization engine to allow extensible integration of components such as the global rendering module and support for associated features. The resulting software is general in its GIS capability, but a specific Lake Tahoe visualization application suitable for immersive decision support in the DRIVE6 virtual reality facility has been developed. During the development, various features to enhance the value of the visualization experience were explored, including the use of hyperspectral image overlays. An over-arching goal of the visualization aspect of the project has been to develop and demonstrate the CAVE (CAVE Automatic Virtual Environment) as a practical tool for hydrologic research.

54 ENVIRONMENTAL SCIENCES↗

Job Management with mpi_jm

About this book: This book constitutes the refereed post-conference proceedings of 13 workshops held at the 33rd International ISC High Performance 2018 Conference, in Frankfurt, Germany, in June 2018: HPC I/O in the Data Center, HPC-IODC 2018; Workshop on Performance and Scalability of Storage Systems, WOPSSS 2018; 13th Workshop on Virtualization in High­-Performance Cloud Computing, VHPC 2018; Third International Workshop on In Situ Visualization, WOIV 2018; 4th International Workshop on Communication Architectures for HPC, Big Data, Deep Learning and Clouds at Extreme Scale, ExaComm 2018; International Workshop on OpenPOWER for HPC, IWOPH 2018; IXPUG Workshop: Many-Core Computing on Intel Processors; Workshop on Sustainable Ultrascale Computing Systems; Approximate and Transprecision Computing on Emerging Technologies, ATCET 2018; First Workshop on the Convergence of Large-Scale Simulation and Artificial Intelligence; Third Workshop for Open Source Supercomputing, OpenSuCo 2018; First Workshop on Interactive High-Performance Computing; Workshop on Performance Portable Programming Models for Accelerators, P^3MA 2018. The 53 full papers included in this volume were carefully reviewed and selected from 80 submissions. They cover all aspects of research, development, and application of large-scale, high performance experimental and commercial systems. Topics include HPC computer architecture and hardware; programming models, system software, and applications; solutions for heterogeneity, reliability, power efficiency of systems; virtualization and containerized environments; big data and cloud computing; and artificial intelligence.

Berkowitz, Evan↗

GRACC: GRid ACcounting Collector

The OSG has long maintained a central accounting system called Gratia. It uses small probes on each computing and storage resource in order to collect resource usage. The probes report to a central collector which stores the usage in a database. The database is then queried to generate reports. As the OSG aged, the size of the database grew very large. It became too large for the database technology to efficiently query to generate detailed reports. The design of a replacement requires data storage that could be queried efficiently to generate multi-year reports. Additionally, it requires flexibilityto add new attributes to the collected data.In this paper we will describe updates to the GRACC architecture in the last 18 months. GRACC uses modern web technologies that were designed for large data storage, query, and visualization. That includes the open source database Elasticsearch, message broker software RabbitMQ, and Grafana and Kibana as data visualization platforms. It uses multiple agents that perform operations on the data to transform it for easier querying and summarization.

Weitzel, Derek↗

Evolving the Land Information System into a Cloud Computing Service

The Land Information System (LIS) was developed to use advanced flexible land surface modeling and data assimilation frameworks to integrate extremely large satellite- and ground-based observations with advanced land surface models to produce continuous high-resolution fields of land surface states and fluxes. The resulting fields are extremely useful for drought and flood assessment, agricultural planning, disaster management, weather and climate forecasting, water resources assessment, and the like. We envisioned transforming the LIS modeling system into a scientific cloud computing-aware web and data service that would allow clients to easily setup and configure for use in addressing large water management issues. The focus of this Phase 1 project was to determine the scientific, technical, commercial merit and feasibility of the proposed LIS-cloud innovations that are currently barriers to broad LIS applicability. We (a) quantified the barriers to broad LIS utility and commercialization (high performance computing, big data, user interface, and licensing issues); (b) designed the proposed LIS-cloud web service, model-data interface, database services, and user interfaces; (c) constructed a prototype LIS user interface including abstractions for simulation control, visualization, and data interaction, (d) used the prototype to conduct a market analysis and survey to determine potential market size and competition, (e) identified LIS software licensing and copyright limitations and developed solutions, and (f) developed a business plan for development and marketing of the LIS-cloud innovation. While some significant feasibility issues were found in the LIS licensing, overall a high degree of LIS-cloud technical feasibility was found.

54 ENVIRONMENTAL SCIENCES↗