Search NASA⌕ Search

SEARCH · Search NASA

Results for “data visualizations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,153 records · Page 64

A CATALOG OF CORONAL 'EIT WAVE' TRANSIENTS

Solar and Heliospheric Observatory (SOHO) Extreme ultraviolet Imaging Telescope (EIT) data have been visually searched for coronal 'EIT wave' transients over the period beginning from 1997 March 24 and extending through 1998 June 24. The dates covered start at the beginning of regular high-cadence (more than 1 image every 20 minutes) observations, ending at the four-month interruption of SOHO observations in mid-1998. One hundred and seventy six events are included in this catalog. The observations range from 'candidate' events, which were either weak or had insufficient data coverage, to events which were well defined and were clearly distinguishable in the data. Included in the catalog are times of the EIT images in which the events are observed, diagrams indicating the observed locations of the wave fronts and associated active regions, and the speeds of the wave fronts. The measured speeds of the wave fronts varied from less than 50 to over 700 km s{sup -1} with 'typical' speeds of 200-400 km s{sup -1}.

79 ASTRONOMY AND ASTROPHYSICS↗

Meeting Global Health Needs via Infectious Disease Forecasting: Development of a Reliable Data-Driven Framework

Infectious diseases (IDs) have a significant detrimental impact on global health. Timely and accurate ID forecasting can result in more informed implementation of control measures and prevention policies. To meet the operational decision-making needs of real-world circumstances, we aimed to build a standardized, reliable, and trustworthy ID forecasting pipeline and visualization dashboard that is generalizable across a wide range of modeling techniques, IDs, and global locations. We forecasted 6 diverse, zoonotic diseases (brucellosis, campylobacteriosis, Middle East respiratory syndrome, Q fever, tick-borne encephalitis, and tularemia) across 4 continents and 8 countries. We included a wide range of statistical, machine learning, and deep learning models (n=9) and trained them on a multitude of features (average n=2326) within the One Health landscape, including demography, landscape, climate, and socioeconomic factors. The pipeline and dashboard were created in consideration of crucial operational metrics—prediction accuracy, computational efficiency, spatiotemporal generalizability, uncertainty quantification, and interpretability—which are essential to strategic data-driven decisions. While no single best model was suitable for all disease, region, and country combinations, our ensemble technique selects the best-performing model for each given scenario to achieve the closest prediction. For new or emerging diseases in a region, the ensemble model can predict how the disease may behave in the new region using a pretrained model from a similar region with a history of that disease. The data visualization dashboard provides a clean interface of important analytical metrics, such as ID temporal patterns, forecasts, prediction uncertainties, and model feature importance across all geographic locations and disease combinations. As the need for real-time, operational ID forecasting capabilities increases, this standardized and automated platform for data collection, analysis, and reporting is a major step forward in enabling evidence-based public health decisions and policies for the prevention and mitigation of future ID outbreaks.

60 APPLIED LIFE SCIENCES↗

Detecting Cellulase Penetration Into Corn Stover Cell Walls by Immuno-Electron Microscopy

In general, pretreatments are designed to enhance the accessibility of cellulose to enzymes, allowing for more efficient conversion. In this study, we have detected the penetration of major cellulases present in a commercial enzyme preparation (Spezyme CP) into corn stem cell walls following mild-, moderate- and high-severity dilute sulfuric acid pretreatments. The Trichoderma reesei enzymes, Cel7A (CBH I) and Cel7B (EG I), as well as the cell wall matrix components xylan and lignin were visualized within digested corn stover cell walls by immuno transmission electron microscopy (TEM) using enzyme- and polymer-specific antibodies. Low severity dilute-acid pretreatment (20 min at 100 C) enabled <1% of the thickness of secondary cell walls to be penetrated by enzyme, moderate severity pretreatment at (20 min at 120 C) allowed the enzymes to penetrate {approx}20% of the cell wall, and the high severity (20 min pretreatment at 150 C) allowed 100% penetration of even the thickest cell walls. These data allow direct visualization of the dramatic effect dilute-acid pretreatment has on altering the condensed ultrastructure of biomass cell walls. Loosening of plant cell wall structure due to pretreatment and the subsequently improved access by cellulases has been hypothesized by the biomass conversion community for over two decades, and for the first time, this study provides direct visual evidence to verify this hypothesis. Further, the high-resolution enzyme penetration studies presented here provide insight into the mechanisms of cell wall deconstruction by cellulolytic enzymes.

AGRICULTURAL WASTES↗

VizBin - an application for reference-independent visualization and human-augmented binning of metagenomic data

Background: Metagenomics is limited in its ability to link distinct microbial populations to genetic potential due to a current lack of representative isolate genome sequences. Reference-independent approaches, which exploit for example inherent genomic signatures for the clustering of metagenomic fragments (binning), offer the prospect to resolve and reconstruct population-level genomic complements without the need for prior knowledge. Results: We present VizBin, a Java™-based application which offers efficient and intuitive reference-independent visualization of metagenomic datasets from single samples for subsequent human-in-the-loop inspection and binning. The method is based on nonlinear dimension reduction of genomic signatures and exploits the superior pattern recognition capabilities of the human eye-brain system for cluster identification and delineation. We demonstrate the general applicability of VizBin for the analysis of metagenomic sequence data by presenting results from two cellulolytic microbial communities and one human-borne microbial consortium. The superior performance of our application compared to other analogous metagenomic visualization and binning methods is also presented. Conclusions: VizBin can be applied de novo for the visualization and subsequent binning of metagenomic datasets from single samples, and it can be used for the post hoc inspection and refinement of automatically generated bins. Due to its computational efficiency, it can be run on common desktop machines and enables the analysis of complex metagenomic datasets in a matter of minutes. The software implementation is available at https://claczny.github.io/ VizBin under the BSD License (four-clause) and runs under Microsoft Windows™, Apple Mac OS X™ (10.7 to 10.10), and Linux.

97 MATHEMATICS AND COMPUTING↗

Parsnip Parser Creation Application

Parsnip has three parts. The first part is the front-end user experience. The front end will be a graphical representation of the intermediate language. Once a user is satisfied with the information on the front end, Parsnip translates the data from the visual application into the second part of Parsnip - the intermediate language. More advanced users may skip the front end and generate their own intermediate language files. The final part is the backend which takes the intermediate language files and generates Zeek and Spicy code. Parsnip will not completely replace parser developers. Many protocols have unique challenges requiring manual effort; however, the goal of Parsnip is to automate at least 90% of the development that largely consists of repetitive tasks. Parsnip output will compile a functioning parser but may not include all PDU types or parse all data.

Huddleston, TimothyA.↗

Expanding Accessibility of Energy Modeling in Hawaii

Engage is a free, publicly available web application for energy system modeling. It can augment the energy system planning process by empowering more stakeholders to understand energy system planning options. Engage is user-friendly, free accessible, collaborative, and communicative. The Hawaii Advanced Visualization Environment Nexus (HAVEN) is an outputs-based application for rendering high-impact communicative visualizations of complex data. Engage and HAVEN were developed in collaboration with the U.S. Department of Energy's National Renewable Energy Laboratory and the Hawaii State Energy Office. This use case provides an overview of Hawaii's use of Engage and HAVEN concurrently in working to meet the state's energy goals.

48 EE - Weatherization and Intergovernmental Progr↗

EPIsembleVis: A geo-visual analysis and comparison of the prediction ensembles of multiple COVID-19 models

In this work, we present EPIsembleVis, a web-based comparative visual analysis tool for evaluating the consistency of multiple COVID-19 prediction models. Our approach analyzes a collection of COVID-19 predictions from different epidemiological models as an ensemble and utilizes two metrics to quantify model performance. These metrics include (a) prediction uncertainty (represented as the dispersion of predictions in each ensemble) and (b) prediction error (calculated by comparing individual model predictions with the recorded data). Through an interactive visual interface, our approach provides a data-driven workflow for (a) selecting and constructing the COVID-19 model prediction ensemble based on the spatiotemporal overlap of available predictions of multiple epidemiological models, (b) quantifying the model performance using both the uncertainty of each model prediction ensemble, and the error of each ensemble member that represents individual model predictions, and (c) visualizing the spatiotemporal variability in the projection performance of individual models using a suite of novel ensemble visualization techniques, such as the data availability map, a spatiotemporal textured-tile calendar, multivariate rose chart, and time-series leaflet glyph. We demonstrate the capability of our ensemble visual interface through a case study that investigates the performance of weekly COVID-19 predictions, which are provided through the COVID-19 Forecast Hub UMass-Amherst Influenza Forecasting Center of Excellence [47] for the United States and United States Territories. The EPIsembleVis tool is implemented using open-source web technologies and adaptive system design, rendering it interoperable with Elasticsearch and Kibana for automatically ingesting COVID-19 predictions from online repositories, and it is generalizable for analyzing worldwide projections from more epidemiological models.

60 APPLIED LIFE SCIENCES↗

JANIS 4: An Improved Version of the NEA Java-based Nuclear Data Information System

JANIS is software developed to facilitate the visualization and manipulation of nuclear data, giving access to evaluated data libraries, and to the EXFOR and CINDA databases. It is stand-alone Java software, downloadable from the web and distributed on DVD. Used offline, the system also makes use of an internet connection to access the NEA Data Bank database. It is now also offered as a full web application, only requiring a browser. The features added in the latest version of the software and this new web interface are described.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

HERO WEC V1 Upgrade - 2023 Laboratory Testing (processed data)

The following submission includes processed laboratory data from NREL's Hydraulic and Electric Reverse Osmosis Wave Energy Converter (HERO WEC), in the form of MATLAB workspaces. This dataset was created using NREL's Large Amplitude Motion Platform (LAMP) and collected between August and September 2023. Included with this submission is a test log of all the processed data "HERO WEC LAMP test run log.xlsx" so that the user can easily find the data of interest. Additionally, more detailed descriptions of the type of data and how it was processed, or calculated, can be found in the document titled "Lamp Data Description.docx". The MATLAB workspaces can be visualized using the file "LAMP_Data_Viewer_Ver2.m/mlx". The user simply needs to upload the workspace of interest and run the file "LAMP_Data_Viewer_Ver2.m/mlx". Both the .m and .mlx file format has been provided depending on the user's preference. The MATLAB workspaces have been separated into zip files corresponding to either Drivetrain, Hydraulic, or Electric configuration runs representing the respective test cases that were run. The drivetrain runs were used to characterize the drivetrain only (no pump or generator). The Hydraulic runs represent the configuration when the seawater pump is installed, and the Electric runs represents the configuration when the generator is installed. The following sub-categories of data are included for each type: - DW - Deep water sine wave profile (not run in drivetrain configuration) - Heave - Heave only sine wave profile - Heave_NoRO (hydraulic configuration only) - Heave_ACC (hydraulic configuration only) - IR - Surge and heave irregular wave profile (not run in drivetrain configuration) - RW - Heave only profile created from real world encoder data (not run in drivetrain configuration) For those interested in the raw, unprocessed, data the authors have created a separate submission, linked below. This submission includes the raw TDMS files and associated files necessary to translate the data into either python or MATLAB formats. This data set has been developed by the National Renewable Energy Laboratory, operated by Alliance for Sustainable Energy, LLC, for the U.S. Department of Energy (DOE) under Contract No. DE-AC36-08GO28308. Funding provided U.S. Department of Energy Office of Energy Efficiency and Renewable Energy Water Power Technologies Office.

16 TIDAL AND WAVE POWER↗

Acoustic Monitoring of Beluga Whale Interactions with Cook Inlet Tidal Energy Project

Cook Inlet, Alaska is home to some of the greatest tidal energy resources in the U.S., as well as an endangered population of beluga whales (Delphinapterus leucas). Successfully permitting and operating a tidal power project in Cook Inlet requires a biological assessment of the potential and realized effects of the physical presence and sound footprint of tidal turbines on the distribution, relative abundance, and behavior of Cook Inlet beluga whales. ORPC Alaska, working with the Project Team—LGL Alaska Research Associates, University of Alaska Anchorage, TerraSond, and Greeneridge Science—undertook the following U.S. Department of Energy (DOE) study to characterize beluga whales in Cook Inlet – Acoustic Monitoring of Beluga Whale Interactions with the Cook Inlet Tidal Energy Project (Project). ORPC Alaska, LLC, is a wholly-owned subsidiary of Ocean Renewable Power Company, LLC, (collectively, ORPC). ORPC is a global leader in the development of hydrokinetic power systems and eco-conscious projects that harness the power of ocean and river currents to create clean, predictable renewable energy. ORPC is developing a tidal energy demonstration project in Cook Inlet at East Foreland where ORPC has a Federal Energy Regulatory Commission (FERC) preliminary permit (P-13821). The Project collected baseline data to characterize pre-deployment patterns of marine mammal distribution, relative abundance, and behavior in ORPC’s proposed deployment area at East Foreland. ORPC also completed work near Fire Island where ORPC held a FERC preliminary permit (P-12679) until March 6, 2013. Passive hydroacoustic devices (previously utilized with bowhead whales in the Beaufort Sea) were adapted for study of beluga whales to determine the relative abundance of beluga whale vocalizations within the proposed deployment areas. Hydroacoustic data collected during the Project were used to characterize the ambient acoustic environment of the project site pre-deployment to inform the FERC pilot project process. The Project compared results obtained from this method to results obtained from other passive hydrophone technologies and to visual observation techniques performed simultaneously. This Final Report makes recommendations on the best practice for future data collection, for ORPC’s work in Cook Inlet specifically, and for tidal power projects in general. This Project developed a marine mammal study design and compared technologies for hydroacoustic and visual data collection with potential for broad application to future tidal and hydrokinetic projects in other geographic areas. The data collected for this Project will support the environmental assessment of future Cook Inlet tidal energy projects, including ORPC’s East Foreland Tidal Energy Project and any tidal energy developments at Fire Island. The Project’s rigorous assessment of technology and methodologies will be invaluable to the hydrokinetic industry for developing projects in an environmentally sound and sustainable way for areas with high marine mammal activity or endangered populations. By combining several different sampling methods this Project will also contribute to the future preparation of a comprehensive biological assessment of ORPC’s projects in Cook Inlet.

16 TIDAL AND WAVE POWER↗

EnergyIQ

EnergyIQ-the first "action-oriented" benchmarking tool for non-residential buildings-provides a standardized opportunity assessment based on benchmarking results. along with decision-support information to help refine action plans. EnergyIQ offers a wide array of benchmark metrics, with visuall as well as tabular display. These include energy, costs, greenhouse-gas emissions, and a large array of characteristics (e.g. building components or operational strategies). The tool supports cross-sectional benchmarking for comparing the user's building to it's peers at one point in time, as well as longitudinal benchmarking for tracking the performance of an individual building or enterprise portfolio over time. Based on user inputs, the tool generates a list of opportunities and recommended actions. Users can then explore the "Decision Support" module for helpful information on how to refine action plans, create design-intent documentation, and implement improvements. This includes information on best practices, links to other energy analysis tools and more. The variety of databases are available within EnergyIQ from which users can specify peer groups for comparison. Using the tool, this data can be visually browsed and used as a backdrop against which to view a variety of energy benchmarking metrics for the user's own building. User can save their project information and return at a later date to continue their exploration. The initial database is the CA Commercial End-Use Survey (CEUS), which provides details on energy use and characteristics for about 2800 buildings (and 62 building types). CEUS is likely the most thorough survey of its kind every conducted. The tool is built as a web service. The EnergyIQ web application is written in JSP with pervasive us of JavaScript and CSS2. EnergyIQ also supports a SOAP based web service to allow the flow of queries and data to occur with non-browser implementations. Data are stored in an Oracle 10g database. References: Mills, Mathew, Brook and Piette. 2008. "Action Oriented Benchmarking: Concepts and Tools." Energy Engineering, Vol.105, No. 4, pp 21-40. LBNL-358E; Mathew, Mills, Bourassa, Brook. 2008. "Action-Oriented Benchmarking: Using the CEUS Database to Benchmark Commercial Buildings in California." Energy Engineering, Vol 105, No. 5, pp 6-18. LBNL-502E.

MILLS, EVAN↗

Atypical Behavior Identification in Large Scale Network Traffic

Cyber analysts are faced with the daunting challenge of identifying exploits and threats within potentially billions of daily records of network traffic. Enterprise-wide cyber traffic involves hundreds of millions of distinct IP addresses and results in data sets ranging from terabytes to petabytes of raw data. Creating behavioral models and identifying trends based on those models requires data intensive architectures and techniques that can scale as data volume increases. Analysts need scalable visualization methods that foster interactive exploration of data and enable identification of behavioral anomalies. Developers must carefully consider application design, storage, processing, and display to provide usability and interactivity with large-scale data. We present an application that highlights atypical behavior in enterprise network flow records. This is accomplished by utilizing data intensive architectures to store the data, aggregation techniques to optimize data access, statistical techniques to characterize behavior, and a visual analytic environment to render the behavioral trends, highlight atypical activity, and allow for exploration.

99 GENERAL AND MISCELLANEOUS↗

Web application for machining parameter recommendation using visual analytics

The computer codes create a web application including multiple user interfaces, visualizations, interaction modules between the user, and visualizations. The visualizations will be interactive, allowing users to query the data directly, and they will be arranged in a dashboard. When selections are made in one visualization, filters will be applied to all other visualizations providing a coordinated system for asking questions about the data. The visualization can be utilized for manufacturing data management, analysis, and recommendation.

Chae, Junghoon↗

iSpy: A powerful and lightweight event display

iSpy is a general-purpose event data and detector visualization program that was developed as an event display for the CMS experiment at the LHC and has seen use by the general public and teachers and students in the context of education and outreach. Central to the iSpy design philosophy is ease of installation, use, and extensibility. The application itself uses the open-access packages Qt4 and Open Inventor and is distributed either as a fully-bound executable or a standard installer package: one can simply download and double-click to begin. Mac OSX, Linux, and Windows are supported. iSpy renders the standard 2D, 3D, and tabular views, and the architecture allows for a generic approach to production of new views and projections. iSpy reads and displays data in the ig format: event information is written in compressed JSON format files designed for distribution over a network. This format is easily extensible and makes the iSpy client indifferent to the original input data source. The ig format is the one used for release of approved CMS data to the public.

Alverson, G.↗

A Public-Private-Academic Partnership to Advance Solar Power Forecasting

Executive Summary NOAA is making major contributions to the solar forecasting project in three areas. First, it is improving its forecasts of solar irradiance, clouds, and aerosols in its numerical weather prediction models. Second, it is providing advanced satellite products for DOE's FOA awardees to use in their forecast systems. Third, it is using high-quality ground-based measurements from SURFRAD and ISIS stations to verify and validate forecast model output. This reports covers results from all three areas for the period May 1, 2014 - April 30, 2015. Modeling In its modeling effort, NOAA continues work to improve the skill of solar forecasts from the Earth System Research Lab (ESRL) research versions of the 13-km Rapid Refresh (RAP) and the 3-km High-Resolution Rapid Refresh (HRRR) models, which are in turn transitioned into operations at the National Centers for Environmental Prediction (NCEP). A major milestone was achieved in September 2014 with the initial operational implementation of the HRRR at NCEP. In the ESRL research versions of the models, testing and development, in both real-time runs and retrospective experiments, is guided by an extensive in-house verification system. Early in the SFIP project, we developed the capability to verify our model forecasts against the high-quality surface radiation measurements from the SURFRAD and ISIS networks. This highlighted some shortcomings with the RAP and HRRR forecasts of incoming shortwave radiation. Most of our effort during Phase 1 of SFIP was focused on addressing these problems with a variety of model system improvements. The RAP and HRRR models during the warm season of 2014 had a noticeable warm and dry bias in near-surface conditions over most of the central and eastern United States, and our new SURFRAD/ISIS verification revealed that there was also a large excess of incoming global horizontal irradiance in the models. We hypothesized that a lack of cloud cover (particularly low-level cloud cover) in the models was resulting in too much heating of the land surface. This, in turn, caused unrealistically strong surface heat fluxes and turbulent mixing in the planetary boundary layer (PBL), which further reduced the already deficient cloud cover. We addressed these issues with a combination of data assimilation system modifications and model physics improvements. Many of our data assimilation changes were made with a view towards improving the near-term representation of clouds and precipitation. One of these changes involved better accounting for regions of weak reflectivity in the RAP cloud / hydrometeor assimilation system, in order to improve the representation of light precipitation in the RAP initial conditions and provide more realistic initial cloud cover. Additional modifications more accurately accounted for radar beam blockage and data gaps (particularly in the western United States), which improves shorter lead times forecasts of clouds and precipitation. We have also tested the assimilation of new data sources within the RAP and the HRRR, including radar radial velocity data and surface mesonet observations. Within the HRRR, we have tested the cycling of the 3-km land surface fields to allow a higher-resolution treatment of land surface processes. In terms of model physics development for SFIP, we have implemented a shallow cumulus scheme within the RAP, and have made numerous improvements to the Mellor-Yamada-Nakanishi-Niino (MYNN) PBL scheme to address insufficient low-level cloud cover in the models. We have conducted tests incorporating the radiation effects of (parameterized) boundary-layer clouds within the modified MYNN PBL scheme (independent of the convective schemes). The Grell-Freitas-Olson shallow cumulus scheme has also been tested within the 3-km HRRR. Finally, we have also modified the RUC land surface model (LSM) treatment of the vegetation wilting point, reducing it to increase evapotranspiration and increase cloud cover in the boundary layer. All of these changes work in tandem to significantly improve the model forecasts of cloud cover, incoming shortwave radiation, and near-surface temperature and moisture. Satellite The role of NOAA/NESDIS in the Solar Forecasting Improvement Project is to provide Advanced Satellite Products (ASPs) for the two forecasting teams at NCAR and IBM. The ASPs are cloud, surface, and atmosphere products derived from geostationary satellite imagery at the highest possible spatial and temporal resolution - such quantities as cloud mask, cloud probability, cloud transmission, cloud top height, cloud top temperature, cloud effective particle size, etc. Ancillary data, such as elevation and numerical weather prediction fields are provided in the files at the same resolution as well. There are at this time 147 different variables in the ASP output, including quality flags and processing information. The main goals for Year 1 of the project were to implement an Advanced Satellite Products system for the use of the IBM and NCAR teams, begin validation, and make any needed changes based on feedback from the teams. ASP files are being produced every GOES Imager acquisition, which occur on a 15-30 minute schedule. Processing is done on a dedicated computer, with a turn-around time of 8-21 minutes from image acquisition to results available on ftp. Several helpful visualizations of the data are also created for users on web pages. Users have been provided with a document titled "User's Guide for 1km Cloud Products Derived from GOES Imager Data using CLAVR-x", which discusses the basics of the source imagery, the process by which it is turned into Advanced Satellite Products, and considerations users should make when using the data. Validation of selected variables from the older 4km version of the products was also included. Future work will concentrate on validation of the 1km products and improving the turn-around time, product variety, and product quality as needed. Ground Observations In the ground-based measurement effort, NOAA's main objectives are to provide high quality radiation products for validation and verification of short-term to day-ahead solar forecasts. More specifically for the three year project, our goals include (1) Maintaining and providing data from our 7 SURFRAD and 7 ISIS; (2) Update ISIS radiation measurements from 3 min to 1 min data: (3) Purchase and install new pyrheliometers for direct solar irradiance measurements at the 7 SURFRAD sites; (4) Building, testing, and deploying two mobile SURFRAD stations at two utility plants in collaboration with DOE sponsored partners, and includes ongoing maintenance and processing of the data at the mobile sites; (5) Upgrading the data acquisition and communications at 7 SURFRAD sites and 7 ISIS sites; (6) Providing radiation data at the 7 SURFRAD sites in near real-time; (7) Develop and provide aerosol optical depth and cloud images and cloud fraction at our two mobile sites; (8) Provide data recovery rates each year; (9) Provide temporally and spatially averaged radiation products for comparison to HRRR and RAP solar forecasts and advanced satellite products; (10) Provide a data-set for analysis of conversion of direct and diffuse to sloped surfaces; (11) and as time permits develop and provide spectral solar irradiance, cloud optical depth and spectral albedo from the mobile sites. Milestones this year include working with the DOE sponsored teams to find locations to deploy two mobile SURFRAD stations. One existing unit was deployed at a 30MW PV facility in the San Luis Valley in collaboration with Xcel and the NCAR team in August, 2014. The second unit was built and tested at our facilities in Boulder, CO and deployed near Green Mountain Power's Education Center in Rutland, VT in collaboration with Green Mountain Power and the IBM Team in October, 2014. Data processing was implemented and the radiation data from these two mobile sites have been made available on our ftp server in near real-time. We also are providing images and cloud fraction from the TSI cameras for these two mobile sites on our ftp site. Another milestone was upgrading our data acquisition and communication systems at 7 SURFRAD and 7 ISIS sites. We accelerated our schedule for these upgrades to provide timely radiation products. These upgrades allow more reliable and near-real time radiation data delivery to the DOE sponsored teams to meet their goals. Lastly, we changed the data rate at the ISIS sites from 3 min to 1 min.

14 SOLAR ENERGY↗

Visualization and Analysis for Near-Real-Time Decision Making in Distributed Workflows

Data driven science is becoming increasingly more common, complex, and is placing tremendous stresses on visualization and analysis frameworks. Data sources producing 10GB per second (and more) are becoming increasingly commonplace in both simulation, sensor and experimental sciences. These data sources, which are often distributed around the world, must be analyzed by teams of scientists that are also distributed. Enabling scientists to view, query and interact with such large volumes of data in near-real-time requires a rich fusion of visualization and analysis techniques, middleware and workflow systems. Here, this paper discusses initial research into visualization and analysis of distributed data workflows that enables scientists to make near-real-time decisions of large volumes of time varying data.

97 MATHEMATICS AND COMPUTING↗

Exascale Virtualized and Programmable Distributed Cyber Resource Control: Final Scientific Technical Report

Extreme-science drives the need for distributed exascale processing and communications that are carefully, yet flexibly, managed. Exponential growth of data for scientific simulations, experimental data, collaborative data analyses, remote visualization and GRID computing requirements of scientists in fields as diverse as high energy physics, climate change, genomics, fusion, synchrotron radiation, material science, medicine, and other scientific disciplines cannot be accommodated by simply applying existing transport protocols to faster pipes. Further, scientific challenges today demand diverse research teams, heightening the need for and increasing the complexity of collaboration. To address these issues within the network layer and physical layer, we have performed a number of research activities surrounding effective allocation and management of elastic optical network (EON) resources, particularly focusing on FlexGrid transponders. FlexGrid transponders support the opportunity to build Layer-1 connections at a wide range of bandwidths and to reconfigure them rapidly. The new flexibility supports complex new ways of using the physical layer that must be carefully managed and hidden from the scientist end-users. FlexGrid networks utilize flexible (or elastic) spectral bandwidths for each data link without using fixed wavelength grids. The flexibility in spectrum allocation brings many appealing features to network operations. Current networks are designed for the worst case impairments in transmission performance and the assigned spectrum is over-provisioned. In contrast, the FlexGrid networks can operate with the highest spectral efficiency and minimum bandwidth for the given traffic demand while meeting the minimum quality of transmission (QoT) requirement. Two primary focuses of our research are: (1) resource and spectrum allocation (RSA) for IP traffic over EONs, and (2) RSA for cross-domain optical networks. Previous work concentrates primarily on large file transfers within a single domain. Adding support for IP traffic changes the nature of the RSA problem: instead of choosing to accept or deny each request for network support, IP traffic is inherently elastic and thus lends itself to a bandwidth maximization formulation. We developed a number of algorithms that could be easily deployed within existing and new FlexGrid networks, leading to networks that better support scientific collaboration. Cross-domain RSA research is essential to support large-scale FlexGrid networks, since configuration information is generally not shared or coordinated across domains. The results presented here are in their early stages. They are technically feasible and practical, but still require coordination among organizations and equipment owners and a higher-layer framework for managing network requests.

42 ENGINEERING↗

Scalable Contour Tree Computation by Data Parallel Peak Pruning

As data sets grow to exascale, automated data analysis and visualization are increasingly important, to intermediate human understanding and to reduce demands on disk storage via in situ analysis. Trends in architecture of high performance computing systems necessitate analysis algorithms to make effective use of combinations of massively multicore and distributed systems. One of the principal analytic tools is the contour tree, which analyses relationships between contours to identify features of more than local importance. Unfortunately, the predominant algorithms for computing the contour tree are explicitly serial, and founded on serial metaphors, which has limited the scalability of this form of analysis. While there is some work on distributed contour tree computation, and separately on hybrid GPU-CPU computation, there is no efficient algorithm with strong formal guarantees on performance allied with fast practical performance. Furthermore, we report the first shared SMP algorithm for fully parallel contour tree computation, with formal guarantees of O(lg V lg t) parallel steps and O(V lg V) work for data with V samples and t contour tree supernodes, and implementations with more than 30× parallel speed up on both CPU using TBB and GPU using Thrust and up 70× speed up compared to the serial sweep and merge algorithm.

97 MATHEMATICS AND COMPUTING↗