Search NASA⌕ Search

SEARCH · Search NASA

Results for “Visual analytic software”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Legacy surface change analyses of the 1993 Rock Valley earthquake sequence for direct comparison to planned NA-22 underground conventional high-explosive experiments (Source Physics Experiment 3 (SPE3) - RV/DC Task 1.3 FY22 Final Report)

Recent work under two previous phases of the NNSA NA-22 Source Physics Experiment (SPE) have shown that underground chemical high-explosive experiments can produce detectable surface changes that differ in spatial extent and vertical magnitude depending on the geologic media at the site (Schultz-Fellenz et al., 2018; 2020; Crawford et al., 2021). Neither of these two prior phases of SPE identified natural earthquake-related surface effects in the same region that occurred at a similar depth as the explosive experiments for direct comparison. While earthquakes can also produce surface changes that are detectable using remote sensing data analyses, it is expected that the pattern and spatial extent of surface changes would vary between earthquakes and explosions. However, no direct-observed surface-change signature comparison between earthquakes and explosions has ever been performed. The SPE Phase 3 Rock Valley/Direct Comparison (RV/DC) program presents a unique opportunity to investigate and characterize co-occurrence of both earthquakes and explosions. In this project, we worked to address five tasks in a workflow, as follows: 1. Identify and obtain existing high-resolution legacy satellite and aerial imagery as close in time before and after the 1993 Rock Valley earthquake sequence to temporally constrain the analyses. 2. Transform these pre-earthquake and post-earthquake datasets into digital elevation models (DEMs) using geospatial analysis software packages (e.g., ArcGIS, Agisoft Metashape, and Google Earth Engine). 3. Perform DEM differencing analyses to assess and quantify earthquake-related changes from the 1993 sequence, and develop map products that visualize these analyses. 4. Use the analyses from (3) to: (a) assess spatial distribution and magnitude of surface changes due to the 1993 Rock Valley earthquake sequence, and (b) determine parameters of forthcoming, planned explosion-related surface change data collection from sensors mounted on unmanned aerial vehicles (UAVs) (e.g., spatial extent of collection, design and density of survey control, sensors to deploy, forward speed and line spacing of UAV flight lines, flight altitude). 5. Develop a summary report on the analyses, including how the analyses define parameters and identify focus areas for any future surface change analytical field campaigns related to the explosive experiment. Analyzing these legacy data and identifying whether they can detect any surface changes related to the earthquake sequence facilitates opportunities for direct signature comparison of surface change from explosions at one location, which has never previously been performed. Comparing the surface change signatures from a co-located and depth-equivalent earthquake and an explosion could help to advance remote sensing event discrimination techniques. This report summarizes the work completed toward this ambitious goal.

42 ENGINEERING↗
DOE OSTI2015

Grandmaster: Interactive text-based analytics of social media

People use social media resources like Twitter, Facebook, forums etc. to share and discuss various activities or topics. By aggregating topic trends across many individuals using these services, we seek to construct a richer profile of a person’s activities and interests as well as provide a broader context of those activities. This profile may then be used in a variety of ways to understand groups as a collection of interests and affinities and an individual’s participation in those groups. Our approach considers that much of these data will be unstructured, free-form text. By analyzing free-form text directly, we may be able to gain an implicit grouping of individuals with shared interests based on shared conversation, and not on explicit social software linking them. In this paper, we discuss a proof-of-concept application called Grandmaster built to pull short sections of text, a person’s comments or Twitter posts, together by analysis and visualization to allow a gestalt understanding of the full collection of all individuals: how groups are similar and how they differ, based on their text inputs.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2012

XCMS Online: A Web-Based Platform to Process Untargeted Metabolomic Data

Recently, interest in untargeted metabolomics has become prevalent in the general scientific community among an increasing number of investigators. The majority of these investigators, however, do not have the bioinformatic expertise that has been required to process metabolomic data by using command-line driven software programs. Here we introduce a novel platform to process untargeted metabolomic data that uses an intuitive graphical interface and does not require installation or technical expertise. This platform, called XCMS Online, is a web-based version of the widely used XCMS software that allows users to easily upload and process liquid chromatography/mass spectrometry data with only a few mouse clicks. XCMS Online provides a solution for the complete untargeted metabolomic workflow including feature detection, retention time correction, alignment, annotation, statistical analysis, and data visualization. Results can be browsed online in an interactive, customizable table showing statistics, chromatograms, and putative METLIN identities for each metabolite. Additionally, all results and images can be downloaded as zip files for offline analysis and publication. XCMS Online is available at https://xcmsonline.scripps.edu.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Learning Global Proliferation Expertise Evolution Using AI-Driven Analytics and Public Information

Detecting and anticipating global proliferation expertise and capability evolution from unstructured, noisy, and incomplete public data streams is a highly desired, but extremely challenging task. Here, in this article, we present our pioneering data-driven approach to support the non-proliferation mission to detect and explain the evolution of proliferation expertise and capability development globally from terabytes of publicly available information (PAI), focusing on our knowledge extraction pipeline and descriptive analytics. We first discuss how we fuse nine open-source data streams, including multilingual data, to convert 4 TB of unstructured data to structured knowledge and encode dynamically evolving proliferation expertise representations—content and context graphs. For this, we rely on natural language processing (NLP) and deep learning (DL) models to perform information extraction, topic modeling, and distributed text representation (aka embedding) learning. We then present interactive, usable, and explainable descriptive analytics to refine domain knowledge and present it in a human-understandable form. Finally, we introduce future work avenues that will leverage our dynamic knowledge representations and descriptive analytics to enable predictive and prescriptive inferences to achieve real-time domain understanding and contextual reasoning about global proliferation expertise and capability evolution.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2024

A New Default Colormap for ParaView

ParaView is one of the most prominent software tools for scientific visualization used by scientists around the world. Color is a primary conduit to visually map data to its representation and, thus, enable investigation and interpretation of the data. Colormap selection has a significant impact on the data revealed; its design and selection is a critical aspect of scientific data visualization. A common choice for a user is the program’s default colormap, so careful consideration of this default is consequential. Although the current default colormap in ParaView, a succession of hues from cool blue to warm red, has served the community well, research shows that more nuanced colormap configurations increase discriminability while maintaining other critical metrics. These findings inspire us to revisit and update the default colors in ParaView. Here, in this study, we present a new ParaView default colormap, the criteria and methods of development, and example visualizations and analytic metrics.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

Building analytics and monitoring-based commissioning: industry practice, costs, and savings

As building energy and system-level monitoring becomes more common, facility teams are faced with an overwhelming amount of data. This data does not typically lead to insights, corrective actions, and energy savings unless it is stored, organized, analyzed, and prioritized in automated ways. The Smart Energy Analytics Campaign is a public-private sector partnership program focused on supporting commercially available energy management and information systems (EMIS) technology use and monitoring-based commissioning (MBCx) practices. MBCx is an ongoing commissioning process with focus on analyzing large amounts of data on a continuous basis. EMIS tools are used in the MBCx process to organize, present, visualize, and analyze the data. With campaign data from over 400 million square feet (sq. ft.) of installed space, this paper presents the results achieved by owners that are implementing EMIS, along with associated technology costs. The study’s EMIS users that reported savings achieved the median cost savings of $0.19/sq. ft. and 7% annually, with savings shown to increase over time. For 35 portfolio owners, the median base cost to install an EMIS was $0.03/sq. ft., with an annual recurring software cost of $0.02/sq. ft. and an estimated annual labor cost of $0.03/sq. ft. Two types of EMIS systems -- energy information systems and fault detection and diagnostic systems -- are defined in the body of the paper. Of the two, we find that fault detection and diagnostic systems have both higher savings and higher costs. The paper offers a characterization of EMIS products, MBCx services, and trends in the industry.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2011

The Integrated Basin-Scale Opportunity Assessment Initiative, FY 2011 Year-End Report: Deschutes Basin Preliminary Hydropower Opportunity Assessment. Draft Report

This document reports on first-year progress of the Integrated Basin-Scale Opportunity Assessment Initiative, an action item of the March 24, 2010 Sustainable Hydropower Memorandum of Understanding (MOU) between the U.S. Department of Energy (DOE), U.S. Army Corps of Engineers, and the Bureau of Reclamation. As envisioned in the MOU, an integrated basin-scale opportunity assessment would take a system-scale approach to identifying opportunities and actions to both increase hydropower and enhance environmental conditions within the context of existing water uses in river basins of the United States. Assessments are intended to be collaborative processes that work with stakeholders at the basin scale to identify hydropower and environmental opportunity scenarios. Opportunity scenarios are analyzed, again in collaboration with stakeholders, through modeling and visualization software to assess tradeoffs and system-scale effects. Opportunity assessments are not intended to produce decisional documents or substitute for basin planning processes; assessments are instead intended to provide tools, information, and a forum for catalyzing conversation about scenarios where environmental and hydropower gains can both be realized within a given basin. In fiscal year 2011, DOE’s Energy Efficiency and Renewable Energy Water Power Team provided funding to Pacific Northwest National Laboratory, Oak Ridge National Laboratory, and Argonne National Laboratory to develop an assessment approach and toolbox, and carry out an initial pilot opportunity assessment. In February 2011, the Upper Deschutes/Crooked River Basin in central Oregon was selected as the pilot basin. Through establishment of stakeholder working groups, a technical site visit, a series of interviews, a stakeholder workshop, and identification of existing tools and data sets, initial opportunities have been identified and analytical tools selected to explore opportunity scenarios. This report documents project progress to date, describes the opportunity assessment approach, and establishes an agenda for analysis of stakeholder-identified opportunities in fiscal year 2012. Findings presented here are preliminary; the final Deschutes Basin pilot study report will be submitted at the end of fiscal year 2012.

13 HYDRO ENERGY↗
DOE OSTI2023

Online Analytics for Remedy Support at DOE Environmental Management Sites

Environmental data is important for managing environmental restoration/waste site remediation, planning of monitoring efforts, addressing climate resilience, and engaging with stakeholders and regulators. A major challenge is how to manage the many different types and the large volume of environmental data in a way that allows practitioners and site managers to understand data implications and support decisions. The Suite Of Comprehensive Rapid Analysis Tools for Environmental Sites (SOCRATES, https://www.pnnl.gov/projects/socrates) is a web application that provides data access, visualization, and rapid analytics to help make sense of environmental data, support remedy decisions, and communicate information. Development of SOCRATES has been funded through the DOE Richland Operations Office (RL) to support communication and decision making for the Hanford Site, thus is only tied into Hanford environmental data. However, the capabilities of SOCRATES are more broadly applicable to DOE-EM sites engaged in environmental remediation and management. This report describes the work to develop mechanisms for bringing non-Hanford data into SOCRATES so that other DOE-EM sites could make use of the visualization and analysis capabilities to support communication and decision making related to managing environmental restoration/waste site remediation, optimization/exit strategies for pump-and-treat systems, planning monitoring efforts, addressing climate resilience, and/or engaging with stakeholders and regulators. The background, approach, data transfer formats, examples, and next steps for this new SOCRATES-EM software are described in this report.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2011

Data Intensive Architecture for Scalable Cyber Analytics

Cyber analysts are tasked with the identification and mitigation of network exploits and threats. These compromises are difficult to identify due to the characteristics of cyber communication, the volume of traffic, and the duration of possible attack. In this paper, we describe a prototype implementation designed to provide cyber analysts an environment where they can interactively explore a month’s worth of cyber security data. This prototype utilized On-Line Analytical Processing (OLAP) techniques to present a data cube to the analysts. The cube provides a summary of the data, allowing trends to be easily identified as well as the ability to easily pull up the original records comprising an event of interest. The cube was built using SQL Server Analysis Services (SSAS), with the interface to the cube provided by Tableau. This software infrastructure was supported by a novel hardware architecture comprising a Netezza TwinFin® for the underlying data warehouse and a cube server with a FusionIO drive hosting the data cube. We evaluated this environment on a month’s worth of artificial, but realistic, data using multiple queries provided by our cyber analysts. As our results indicate, OLAP technology has progressed to the point where it is in a unique position to provide novel insights to cyber analysts, as long as it is supported by an appropriate data intensive architecture.

Olsen, Bryan K.↗
DOE OSTI2014

Conformation-independent structural comparison of macromolecules with ProSMART

The Procrustes Structural Matching Alignment and Restraints Tool (ProSMART) has been developed to allow local comparative structural analyses independent of the global conformations and sequence homology of the compared macromolecules. This allows quick and intuitive visualization of the conservation of backbone and side-chain conformations, providing complementary information to existing methods. The identification and exploration of (dis)similarities between macromolecular structures can help to gain biological insight, for instance when visualizing or quantifying the response of a protein to ligand binding. Obtaining a residue alignment between compared structures is often a prerequisite for such comparative analysis. If the conformational change of the protein is dramatic, conventional alignment methods may struggle to provide an intuitive solution for straightforward analysis. To make such analyses more accessible, the Procrustes Structural Matching Alignment and Restraints Tool (ProSMART) has been developed, which achieves a conformation-independent structural alignment, as well as providing such additional functionalities as the generation of restraints for use in the refinement of macromolecular models. Sensible comparison of protein (or DNA/RNA) structures in the presence of conformational changes is achieved by enforcing neither chain nor domain rigidity. The visualization of results is facilitated by popular molecular-graphics software such as CCP4mg and PyMOL, providing intuitive feedback regarding structural conservation and subtle dissimilarities between close homologues that can otherwise be hard to identify. Automatically generated colour schemes corresponding to various residue-based scores are provided, which allow the assessment of the conservation of backbone and side-chain conformations relative to the local coordinate frame. Structural comparison tools such as ProSMART can help to break the complexity that accompanies the constantly growing pool of structural data into a more readily accessible form, potentially offering biological insight or influencing subsequent experiments.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2012

A View from Above: Cloud Plots to Visualize Global Metabolomic Data

Global metabolomics describes the comprehensive analysis of small molecules in a biological system without bias. With mass spectrometry-based methods, global metabolomic data sets typically comprise thousands of peaks, each of which is associated with a mass-to-charge ratio, retention time, fold change, p-value, and relative intensity. Although several visualization schemes have been used for metabolomic data, most commonly used representations exclude important data dimensions and therefore limit interpretation of global data sets. Given that metabolite identification through tandem mass spectrometry data acquisition is a time-limiting step of the untargeted metabolomic workflow, simultaneous visualization of these parameters from large sets of data could facilitate compound identification and data interpretation. Here, we present such a visualization scheme of global metabolomic data using a so-called “cloud plot” to represent multidimensional data from septic mice. While much attention has been dedicated to lipid compounds as potential biomarkers for sepsis, the cloud plot shows that alterations in hydrophilic metabolites may provide an early signature of the disease prior to the onset of clinical symptoms. The cloud plot is an effective representation of global mass spectrometry-based metabolomic data, and we describe how to extract it as standard output from our XCMS metabolomic software.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Dalton Project: A Python platform for molecular- and electronic-structure simulations of complex systems

The Dalton Project provides a uniform platform access to the underlying full-fledged quantum chemistry codes Dalton and LSDalton as well as the PyFraME package for automatized fragmentation and parameterization of complex molecular environments. The platform is written in Python and defines a means for library communication and interaction. Intermediate data such as integrals are exposed to the platform and made accessible to the user in the form of NumPy arrays, and the resulting data are extracted, analyzed, and visualized. Complex computational protocols that may, for instance, arise due to a need for environment fragmentation and configuration-space sampling of biochemical systems are readily assisted by the platform. The platform is designed to host additional software libraries and will serve as a hub for future modular software development efforts in the distributed Dalton community.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Integrated multi-wavelength microscope combining TIRFM and IRM modalities for imaging cellulases and other processive enzymes

We describe a multimodal microscope for visualizing processive enzymes moving on immobilized substrates. The instrument combines interference reflection microscopy (IRM) with multi-wavelength total internal reflectance fluorescence microscopy (TIRFM). The microscope can localize quantum dots with a precision of 2.8 nm at 100 frames/s, and was used to image the dynamics of the cellulase, Cel7a interacting with surface-immobilized cellulose. The instrument, which was built with off-the-shelf components and is controlled by custom software, is suitable for tracking other degradative enzymes such as collagenases, as well as motor proteins moving along immobilized tracks.

09 BIOMASS FUELS↗
DOE OSTI2020

In-situ Detection of Glovebox Glove Degradation Prior to Glove Failure; Effects on Safety, Waste, and Operational Costs - 20402

Glovebox glove pressure decay leak testing and analysis of the data can greatly improve glovebox safety, minimize Transuranic (TRU) glove waste, and minimize operational cost. It is well known, the weakest point of containment on a glovebox is the glove. Mitigating unplanned openings in gloves is critical to minimizing operational and safety costs in glovebox operations. Mitigating unplanned glove openings due to glove failures will be discussed in this paper. The lack of an engineered solution to determine a gloves operational life in nuclear operations, has lead to use of theoretical and manual subjective methods to determine the life and safety of a glovebox glove. Whether the glove is inspected visually prior to use, or gloves are changed regularly to theoretically avoid failure, both the operators PPE and the room are being exposed to contamination, or un-necessary amounts of TRU glove waste are being generated. Millions of dollars yearly in operational costs are spent on glove failures due to loss of production, incident analysis, regulatory audits, clean up, and paperwork. In a nuclear application, a glove failure could contaminate an operator and laboratory, shut down the operation for weeks, potentially create a regulatory audit, and potentially create a media frenzy; the damages to the organization can be astronomical. Elimination of glove failures is possible by tracking glove material degradation and setting limits to allow glove change when it becomes necessary, prior to glove failure. Analytical pressure decay leak testing allows the detection of material degradation, and in turn the ability to limit operational glove failures. A German based company called MK Versuchsanlagen, e.K., has developed an advanced Glove Integrity Testing System. The system, with its use of proprietary RFID and special software technology, is unique in its capabilities. The system is capable to perform highly accurate regular glove testing on any size glovebox line in minimal time. The system records and can analyze a tremendous amount of system data that in turn can determine, for example, a safe glove change time prior to a glove material failure. This paper will show how an advanced Glove Integrity Testing System can detect glove material degradation and help determine a safe change point prior to glove failure. Pressure decay curves of new gloves and recorded effects of accelerated aging on the glove over time will be shown. The use of this technology in nuclear facilities can greatly improve glovebox operational safety, minimize glovebox glove TRU waste, and save organizations tremendous costs in downtime, clean up, documentation, and potential regulatory review. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2012

Visual Data Analysis as an Integral Part of Environmental Management

The U.S. Department of Energy's (DOE) Office of Environmental Management (DOE/EM) currently supports an effort to understand and predict the fate of nuclear contaminants and their transport in natural and engineered systems. Geologists, hydrologists, physicists and computer scientists are working together to create models of existing nuclear waste sites, to simulate their behavior and to extrapolate it into the future. We use visualization as an integral part in each step of this process. In the first step, visualization is used to verify model setup and to estimate critical parameters. High-performance computing simulations of contaminant transport produces massive amounts of data, which is then analyzed using visualization software specifically designed for parallel processing of large amounts of structured and unstructured data. Finally, simulation results are validated by comparing simulation results to measured current and historical field data. We describe in this article how visual analysis is used as an integral part of the decision-making process in the planning of ongoing and future treatment options for the contaminated nuclear waste sites. Lessons learned from visually analyzing our large-scale simulation runs will also have an impact on deciding on treatment measures for other contaminated sites.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2013

Improving best-phase image quality in cardiac CT by motion correction with MAM optimization

Purpose: Research in image reconstruction for cardiac CT aims at using motion correction algorithms to improve the image quality of the coronary arteries. The key to those algorithms is motion estimation, which is currently based on 3-D/3-D registration to align the structures of interest in images acquired in multiple heart phases. The need for an extended scan data range covering several heart phases is critical in terms of radiation dose to the patient and limits the clinical potential of the method. Furthermore, literature reports only slight quality improvements of the motion corrected images when compared to the most quiet phase (best-phase) that was actually used for motion estimation. In this paper a motion estimation algorithm is proposed which does not require an extended scan range but works with a short scan data interval, and which markedly improves the best-phase image quality. Methods: Motion estimation is based on the definition of motion artifact metrics (MAM) to quantify motion artifacts in a 3-D reconstructed image volume. The authors use two different MAMs, entropy, and positivity. By adjusting the motion field parameters, the MAM of the resulting motion-compensated reconstruction is optimized using a gradient descent procedure. In this way motion artifacts are minimized. For a fast and practical implementation, only analytical methods are used for motion estimation and compensation. Both the MAM-optimization and a 3-D/3-D registration-based motion estimation algorithm were investigated by means of a computer-simulated vessel with a cardiac motion profile. Image quality was evaluated using normalized cross-correlation (NCC) with the ground truth template and root-mean-square deviation (RMSD). Four coronary CT angiography patient cases were reconstructed to evaluate the clinical performance of the proposed method. Results: For the MAM-approach, the best-phase image quality could be improved for all investigated heart phases, with a maximum improvement of the NCC value by 100% and of the RMSD value by 81%. The corresponding maximum improvements for the registration-based approach were 20% and 40%. In phases with very rapid motion the registration-based algorithm obtained better image quality, while the image quality of the MAM algorithm was superior in phases with less motion. The image quality improvement of the MAM optimization was visually confirmed for the different clinical cases. Conclusions: The proposed method allows a software-based best-phase image quality improvement in coronary CT angiography. A short scan data interval at the target heart phase is sufficient, no additional scan data in other cardiac phases are required. The algorithm is therefore directly applicable to any standard cardiac CT acquisition protocol.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Tutorial on Chemical Pressure Analysis: How Atomic Packing Drives Laves/Zintl Intergrowth in K3Au5Tl

The tight atomic packing generally exhibited by alloys and intermetallics can create the impression of their being composed of hard spheres arranged to maximize their density. As such, the atomic size factor has historically been central to explanations of the structural chemistry of these systems. However, the role atomic size plays structurally has traditionally been inferred from empirical considerations. The recently developed DFT-Chemical Pressure (CP) analysis has opened a path to investigating these effects with theory. In this article, we provide a step-by-step tutorial on the DFT-CP method for non-specialists, along with advances in the approach that broaden its applicability. A new version of the CP software package is introduced, which features an interactive system that guides the user in preparing the necessary electronic structure data and generating the CP scheme, with the results being readily visualized with a web browser (and easily incorporated into websites). For demonstration purposes, we investigate the origins of the crystal structure of K3Au5Tl, which represents an intergrowth of Laves and Zintl phase domains. Here, CP analysis reveals that the intergrowth is supported by complementary CP features of NaTl-type KTl and MgCu2-type KAu2 phases. In this way, K3Au5Tl exemplifies how CP effects can drive the merging for geometrical motifs derived from different families of intermetallics through a mechanism referred to as epitaxial stabilization.

36 MATERIALS SCIENCE↗
DOE OSTI2015

Deactivation and decommissioning web log analysis using big data technology - 15710

The D and D Knowledge Management Information Tool (D and D KM- IT) is a web-based knowledge management information tool built for the D and D user community. Big data is a massive volume of structured and unstructured datasets which is so large that it's difficult to process using traditional database techniques. Web logs are the repository of files which are generated automatically for any operation on the web site. Web log files generated from the D and D KM-IT will be processed using the Apache Hadoop Framework to extract meaningful data. Hadoop is an open-source software framework for storing and processing big data in a distributed environment on large clusters of commodity hardware. Hadoop framework consists of two main layers: Hadoop distributed file system (HDFS) and the Execution engine (MapReduce). Automatic parallelization and distribution; clean and simple programming abstraction. Implementation: Web log files from the D and D KM-IT server are fetched using Apache Flume and loaded into the Hadoop distributed file system. Using the Apache Hcatalog tool, the web log data is parsed and converted into a structured table format. A Pig program is developed to query the tables to retrieve and store the significant information onto the HDFS. The extracted data is fed to business visualization tools such as Microsoft Excel for analysis and reporting. Results The reports generated through the web log data processing will be analyzed to improve the usability and performance of the D and D KM-IT. Conclusion/Future Work: User keyword information can be explored to add new trending topics to the D and D KM-IT application. Statistics generated can be compared to analysis reports from existing analytical tools.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗