Search NASA⌕ Search

SEARCH · Search NASA

Results for “software: data analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,099 records · Page 61

AKUNA – INTEGRATED TOOLSETS SUPPORTING ADVANCED SUBSURFACE FLOW AND TRANSPORT SIMULATIONS FOR ENVIRONMETAL MANAGEMENT

A next generation open source subsurface simulator and user environment for environmental management is being developed through a collaborative effort across Department of Energy National Laboratories. The flow and transport simulator, Amanzi, will be capable of modeling complex subsurface environments and processes using both unstructured and adaptive meshes at very fine spatial resolutions that require supercomputing-scale resources. The user environment, Akuna, provides users with a range of tools to manage environmental and simulator data sets, create models, manage and share simulation data, and visualize results. Underlying the user interface are core toolsets that provide algorithms for sensitivity analysis, parameter estimation, and uncertainty quantification. Akuna is open-source, cross platform software that is initially being demonstrated on the Hanford BC Cribs remediation site. In this paper, we describe the emerging capabilities of Akuna and illustrate how these are being applied to the BC Cribs site.

user interface, data management, uncertainty quant↗

Tutorial: Crystal orientations and EBSD — Or which way is up?

Electron backscatter diffraction (EBSD) is an automated technique that can measure the orientation of crystals in a sample very rapidly. There are many sophisticated software packages that present measured data. Unfortunately, due to crystal symmetry and differences in the set-up of microscope and EBSD software, there may be accuracy issues when linking the crystal orientation to a particular microstructural feature. In this paper we outline a series of conventions used to describe crystal orientations and coordinate systems. These conventions have been used to successfully demonstrate that a consistent frame of reference is used in the sample, unit cell, pole figure and diffraction pattern frames of reference. We establish a coordinate system rooted in measurement of the diffraction pattern and subsequently link this to all other coordinate systems. A fundamental outcome of this analysis is to note that the beamshift coordinate system needs to be precisely defined for consistent 3D microstructure analysis. This is supported through a series of case studies examining particular features of the microscope settings and/or unambiguous crystallographic features. These case studies can be generated easily in most laboratories and represent an opportunity to demonstrate confidence in use of recorded orientation data. Finally, we include a simple software tool, written in both MATLAB® and Python, which the reader can use to compare consistency with their own microscope set-up and which may act as a springboard for further offline analysis. - Highlights: • Presentation of conventions used to describe crystal orientations • Three case studies that outline how conventions are consistent • Demonstrates a pathway for calibration and validation of EBSD based orientation measurements • EBSD computer code supplied for validation by the reader.

36 MATERIALS SCIENCE↗

DOECGF 2009 Site Report: Lawrence Livermore National Laboratory

The Data group provides data analysis and visualization support to its customers. This consists primarily of the development and support of VisIt, a data analysis and visualization tool. Support ranges from answering questions about the tool, providing classes on how to use the tool, and performing data analysis and visualization for customers. The Information Management and Graphics Group supports and develops tools that enhance our ability to access, display, and understand large, complex data sets. Activities include applying visualization software for terascale data exploration; running video production labs on two networks; supporting graphics libraries and tools for end users; maintaining PowerWalls and assorted other displays; and developing software for searching, managing, and browsing scientific data. Researchers in the Center for Applied Scientific Computing (CASC) work on various projects including the development of visualization techniques for terascale data exploration that are funded by the ASC program, among others. The researchers also have LDRD projects and collaborations with other lab researchers, academia, and industry.

99 GENERAL AND MISCELLANEOUS↗

Setting up a STAR Tier 2 Site at Golias/Prague Farm

High Energy Nuclear Physics (HENP) collaborations experience show that the computing resources available at a single site are often neither sufficient nor satisfy the need of remote collaborators eager to carry their analysis in the fastest and most convenient way. From latencies in the network connectivity to the lack of interactivity, work at distant computing centers is often inefficient. Having fully functional software stack on local resources is a strong enabler of science opportunities for any local group who can afford the time investment. The situation becomes more complex as vast amount of data are often needed to perform meaningful analysis. Prague's heavy-ions group participating in STAR experiment at RHIC has been a strong advocate of local computing as the most efficient means of data processing and physics analyses. To create an environment where science can freely thrive, a Tier 2 computing center was set up at a Regional Computing Center for Particle Physics called 'Golias'. It is the biggest farm in the Czech Republic fully dedicated for particle physics experiments. We report on our experience in setting up a fully functional Tier 2 center leveraging the minimal locally available human and financial resources. We discuss the solutions chosen to address storage space and analysis issues and the impact on the farms overall functionality. This includes a locally built STAR analysis framework, integration with a local DPM system (a cost effective storage solution), the influence of the availability and quality of the network connection to Tier 0 via a dedicated CESNET/ESnet link and the development of light-weight yet fully automated data transfer tools allowing the movement of entire datasets from BNL (Tier 0) to Golias (Tier 2). We will summarize the impact of the gained computing performance on the efficiency of the local physics group at offline physics analysis and show the feasibility of such a solution that can used by other groups as well.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DART 7.0 User Guide

The Desktop Analysis Reporting Tool (DART) is a software package that allows users to easily view and analyze daily files that span long periods. DART gives users the capability to quickly determine the state of health of a radiation portal monitor (RPM), troubleshoot and diagnose problems, and view data in various time frames to perform trend analysis. In short, it converts the data strings written in the daily files into meaningful tables and plots. The standalone version of DART (“soloDART”) utilizes a database engine that is included with the application; no additional installations are necessary. There is also a networked version of DART (“polyDART”) that is designed to maximize the benefit of a centralized data repository while distributing the workload to individual desktop machines. This networked approach requires a more complex database manager Structured Query Language (SQL) Server; however, SQL Server is not currently provided with DART. Regardless of which version is used, DART will import daily files from RPMs, store the relevant data in its database, and it can produce reports for status, trend analysis, and reporting purposes.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Gene set analyses for interpreting microarray experiments on prokaryotic organisms.

Background: Recent advances in microarray technology have brought with them the need for enhanced methods of biologically interpreting gene expression data. Recently, methods like Gene Set Enrichment Analysis (GSEA) and variants of Fisher’s exact test have been proposed which utilize a priori biological information. Typically, these methods are demonstrated with a priori biological information from the Gene Ontology. Results: Alternative gene set definitions are presented based on gene sets inferred from the SEED: open-source software environment for comparative genome annotation and analysis of microbial organisms. Many of these gene sets are then shown to provide consistent expression across a series of experiments involving Salmonella Typhimurium. Implementation of the gene sets in an analysis of microarray data is then presented for the Salmonella Typhimurium data. Conclusions: SEED inferred gene sets can be naturally defined based on subsystems in the SEED. The consistent expression values of these SEED inferred gene sets suggest their utility for statistical analyses of gene expression data based on a priori biological information

59 BASIC BIOLOGICAL SCIENCES↗

Evaluating the Feasibility of Transactive Approach for Voltage Management Using Inverters of a PV Plant

This article evaluates the feasibility of a double-auction-based Transactive Energy System (TES) for engaging the reactive power (Var) capability of inverters in a utility-scale pho¬tovoltaic (PV) plant for voltage management in distribution feed¬ers. In this approach, a PV plant owner (seller) provides Var supply curves in terms of price-quantity pairs consider¬ing the inverters’ P-Q capability, efficiency, opportunity cost for real power curtail¬ment, losses, etc. At the same time, the utility (buyer) proposes Var demand curves in price-quantity pairs exhibiting the marginal price of Var. Then, market clearing points are obtained from the intersection points of supply and demand curves which are then used to create Var dispatch sig-nals from the PV plant. To conduct a fea¬sibility study of this approach, an Australian distribution network with a utility-scale PV plant (capacity 3.275 MWP) is modeled in RSCAD and simu¬lated in real-time on MATLAB, RSCAD-RTDS co-simulation platform using real historical data. Consid¬ering a use case, namely, conservation voltage reduction (CVR), the operational feasibility along with cost-benefit analysis is demonstrated in software-in-the-loop (SIL) and hardware-in-the-loop (HIL) platform. Another use case, exploring the benefit from tap-change reduction of step-voltage-regulator, is investigated. These studies explore further use cases, e.g., PV hosting capacity, network reconfiguration, etc., to be incorporated in TES for experiencing substantial economic benefits.

Alam, Mollah Rezaul↗

Production Operations Management System (POMS) for Fermilab Experiments

The Production Operations Management System (POMS) software allows production teams and analysis groups across multiple Fermilab experiments to launch, modify and monitor large scale campaigns of related Monte Carlo or data processing jobs, and currently manages the majority of production computing of experiments at Fermilab.POMS provides a web service interface that enables automated job submission on distributed resources according to customers’ requests, as well as subsequent monitoring of those submissions as well as recovery of failed submissions, debugging and record keeping.POMS interfaces with existing HEP data access, processing, movement and monitoring tools at Fermilab, including Jobsub (for job submission), SAM (for data management), and Landscape (for monitoring), and in combination with them handles the creation of intermediate datasets of files for multistage campaigns.POMS visualizes these campaigns with an interactive GUI interface. An important feature of POMS is a one-to-one connection between the GUI campaign visualizer and a text based representation of the complete campaign configuration. An extensible library of template campaign configurations is available. The templates are user modifiable and map cleanly to and from the GUI description of the campaign.This paper will discuss the current usage, history, and some technical details of POMS, as well as planned future extensions, particularly interfacing with Rucio as well as SAM for file movement.

Mengel, Marc↗

Big Data in HEP: A comprehensive use case study

Experimental Particle Physics has been at the forefront of analyzing the worlds largest datasets for decades. The HEP community was the first to develop suitable software and computing tools for this task. In recent times, new toolkits and systems collectively called Big Data technologies have emerged to support the analysis of Petabyte and Exabyte datasets in industry. While the principles of data analysis in HEP have not changed (filtering and transforming experiment-specific data formats), these new technologies use different approaches and promise a fresh look at analysis of very large datasets and could potentially reduce the time-to-physics with increased interactivity. In this talk, we present an active LHC Run 2 analysis, searching for dark matter with the CMS detector, as a testbed for Big Data technologies. We directly compare the traditional NTuple-based analysis with an equivalent analysis using Apache Spark on the Hadoop ecosystem and beyond. In both cases, we start the analysis with the official experiment data formats and produce publication physics plots. Lastly, we will discuss advantages and disadvantages of each approach and give an outlook on further studies needed.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Open-Source Suite for Advanced Synchrophasor Analysis

The paper presents the results of the development of the open-source suite of applications for synchrophasor analysis. The suite includes several software tools for oscillation analysis, power plant model validation, and frequency response analysis using synchrophasor measurements. All tools are based on the common framework and data sources. The developed tools have been used by the Bonneville Power Administration and other utilities for synchrophasor analysis. The paper includes several use cases based on the actual system PMU data.

PMU, model validation, Oscillation Modes, Open Sou↗

HepSim: A Repository with Predictions for High-Energy Physics Experiments

A file repository for calculations of cross sections and kinematic distributions using Monte Carlo generators for high-energy collisions is discussed. The repository is used to facilitate effective preservation and archiving of data from theoretical calculations and for comparisons with experimental data. The HepSim data library is publicly accessible and includes a number of Monte Carlo event samples with Standard Model predictions for current and future experiments. The HepSim project includes a software package to automate the process of downloading and viewing online Monte Carlo event samples. Data streaming over a network for end-user analysis is discussed.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

AUTOPERF

AutoPerf is a collection of modules for low-overhead performance monitoring on HPC systems, the modules collect monitoring data such as MPI data, network counter data etc. Autoperf modules interoperate with the Open source Darshan software (xgitlab.cels.anl.gov/darshan/) as submodules and leverages the Darshan's log recording and analysis framework.

CHUNDURI, DEVISUDHEER KUMAR↗

Baycal

Bayesian Model Calibration (BayCal) toolkit is a software plugin for Risk Analysis Virtual Environment (RAVEN) framework, arming at inversely quantifying the uncertainties associated with simulation model parameters based on available experiment data. BayCal seeks statistical inference of the uncertain input parameters that are consistent with the available measurement data or observed data. The unique feature of BayCal is the capability to be linked with RAVEN to build corresponding calibration workflows for complex multi-physics simulations. In addition to be able to use the machine learning capability of RAVEN to significantly reduce the computational cost of expensive simulation models, another distinctive feature of BayCal is the capability to deal with high-dimensional correlated model outputs, such as time series observations at multiple locations, via principal component analysis (PCA) technique.

Wang, Congjian↗

TASLIMAGE System #2 Technical Equivalence Evaluation

In early 2017, a second TASLIMAGE system (TASL 2) was procured from Track Analysis Systems, Ltd. The new device is intended to complement the first system (TASL 1) and to provide redundancy to the original system which was acquired in 2009. The new system functions primarily the same as the earlier system, though with different X-Y stage hardware and a USB link from the camera to the host computer, both of which contribute to a reduction in CR-39 foil imaging time. The camera and image analysis software are identical between the two systems. Neutron dose calculations are performed externally and independent of the imaging system used to collect track data, relying only on the measured recoil proton track density per cm 2 for a set of known-dose CR-39 foils processed in each etch.

61 RADIATION PROTECTION AND DOSIMETRY↗

Open Source Suite for Advanced Synchrophasor Analysis

The report presents the results of the development of the open-source suite of applications for synchrophasor analysis. The suite includes several software tools for oscillation analysis, power plant model validation, and frequency response analysis using synchrophasor measurements. All tools are based on the common framework and data sources. The developed tools have been used by different electrical utilities for synchrophasor analysis. The report includes several use cases based on the actual system PMU data.

20 FOSSIL-FUELED POWER PLANTS↗

H420 Imager Calibration Procedure: Field of View Scan

Gamma-ray imagers with coded apertures have a finite field of view (FOV) within which an image of a source can be generated. A “FOV scan” is a facet of imager calibration procedure that involves collecting specialized data for a range of source locations filling the FOV in order to understand and correct for differences in imager performance. Systematic distortions reveal relative displacements between internal imager components, which can be accounted for in data analysis. The success of this scan requires a stable imager position during the full measurement duration (~hours). This document summarizes the hardware and software tools required to conduct a FOV calibration scan of an H3D H420 Coded Aperture Gamma-Ray Imager.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Monte Carlo Uncertainty Quantification for an Unattended Enrichment Monitor

As a case study for uncertainty analysis, we consider a model flow monitor for measuring enrichment in gas centrifuge enrichment plants (GCEPs) that could provide continuous monitoring of all declared gas flow and provide high-accuracy gas enrichment estimates as a function of time. The monitor system could include NaI(Tl) gamma-ray spectrometers, a pressure signal-sharing device to be installed on an operator\rq{}s pressure gauge or a dedicated inspector pressure sensor, and temperature sensors attached to the outside of the header pipe, to provide pressure, temperature, and gamma-ray spectra measurements of UF$_6$ gas flow through unit header pipes. Our study builds on previous modeling and analysis methods development for enrichment monitor concepts and a software tool that was developed at Oak Ridge National Laboratory to generate and analyze synthetic data.

international safeguards↗

SCPAssistant v1.20

Critical need to rapidly and quantitatively measure the chemistry of single cells in their natural state, without extensive sample preparation procedures. Developed at ORNL an innovative single cell droplet ejection-liquid vortex capture mass spectrometry (SCDE-LVC-MS) platform for rapid, in situ molecular characterization of single cells in suspension. This platform provides rapid, quantitative, targeted and/or untargeted mass spectrometric analysis of single cells without extensive sample preparation procedures. Enable real-time untargeted mass spectrometry analysis of chemical constituents of single cells in their native environment. Send a TTL signal via a connected AD/DA board to start mass spectrometry (MS) data acquisition - analyze MS data - classification of analyzed samples (e.g. separate single cell types based on their chemistry) - quantitation of analyzed samples (e.g. quantify lipids in single cells). List of features: external instrument control; screen capture; reporting; real-time MS data (single cell) analysis; classification; quantitation. Specific application: real-time mass spectrometry analysis of chemical constituents of single cells in their native environment. The software starts MS acquisition; then monitors a folder where the Cytena Single Cell Printer saves images of ejected single cells; real-time extracts MS spectra from MS files for a) either classification of single cells, or b) quantitation of (a) chemical constituent(s) of single cells.

Kertesz, Vilmos↗