Search NASA⌕ Search

SEARCH · Search NASA

Results for “software: data analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

Insert Modeling in UNF ST&DARDS

The Used Nuclear Fuel-Storage, Transportation & Disposal Analysis Resource and Data System (UNF-ST&DARDS) is a software tool that integrates a used nuclear fuel (UNF) or spent nuclear fuel (SNF) relational database and key analysis capabilities to simplify and automate numerous UNF management and fuel cycle–related activities. UNF-ST&DARDS is being developed for the US Department of Energy’s Office of Nuclear Energy Spent Fuel and Waste Disposition program. UNF-ST&DARDS provides an integrated framework that uses advanced modeling and simulation to predict the behavior of SNF over the timescales associated with permanent disposal in a geologic repository. After leaving the spent fuel pool, SNF is transferred to dry storage in a dual-purpose canister (DPC). DPCs are considered “dual purpose” because they are designed for both storage and transportation, removing the need to transfer the fuel to a separate transportation cask. However, much research has been conducted investigating the feasibility of directly disposing of DPCs in geologic repositories. Direct disposal of DPCs could reduce worker exposure during repackaging, reducing the amount of low-level waste from the discarded DPCs and potentially saving billions of dollars. Therefore, direct disposal of as-loaded DPCs is desirable if it can be done safely.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Cosmology data analysis challenges and opportunities in the LSST sky survey

Fueled by advances in software, microelectronics, and large optics fabrication, a new type of sky survey will soon begin. In a relentless campaign of 15 second exposures with a 3 gigapixel camera, the Large Synoptic Survey Telescope will cover the sky deeply every week for ten years. LSST will chart billions of remote galaxies, providing multiple probes of the mysterious Dark Matter and Dark Energy. Multiple probes of the effects of dark energy over an unprecedented volume of the universe will allow us to measure how dark energy behaves over time to high precision. Hundreds of petabytes of high dimensional complex data will be mined and compared with Exascale simulations. After reviewing the LSST project, I will describe some of the computational challenges and opportunities.

79 ASTRONOMY AND ASTROPHYSICS↗

Data-intensive management and analysis for scientifc simulations.

Scientific simulations can produce enormous amounts of data, making the analysis of results and management of files a difficult task for scientists. The simulation management and analysis system (Smaash) described here is designed to allow scientists to easily capture, store, organize, monitor, and analyze simulation results. The system is automatic, standardized, and secure. Smaash was built using open-source tools and modularized to be independent of the scientific simulation. The web-based front-end allows the scientist to easily interact with the data, and has proved its usefulness in improving the efficiency of a scientific team's workflow. High performance parallel computing allows scientists to solve complex physical problems through computer simulation. However, the massive amounts of data generated and the complex computing environment can create additional complications. A recent review by Ludaescher et al.(2009) describes how scientific workflows can assist scientists in extracting knowledge from these data-intensive operations by automating components within pipelines. Within the fusion community, Klasky et al.(2008) and colleagues have developed a system that handles the storage management, data movement, metadata generation and management, and a means to analyze the results. In response to scientists needs, a simulation management and analysis system (Smaash) was developed at the University of Chicago and Argonne National Laboratory (USA). Smaash provides an integrated way to monitor simulations and analyze computational results; catalog, store, and retrieve simulations; and prepare output for publications. The system is independent of the particular simulation code, accessible from many HPC and browser-based platforms, and built around open-source software tools. Data security and provenance is considered throughout. The analysis components are hidden behind a web-based front end, enabling scientists to focus on their results and not get bogged down by information overload.

99 GENERAL AND MISCELLANEOUS↗

Parameter Sensitivity Analysis of the SparTen High Performance Sparse Tensor Decomposition Software (Extended Analysis)

Tensor decomposition models play an increasingly important role in modern data science applications. One problem of particular interest is fitting a low-rank Canonical Polyadic (CP) tensor decomposition model when the tensor has sparse structure and the tensor elements are nonnegative count data. SparTen is a high-performance C++ library which computes a low-rank decomposition using different solvers: a first-order quasi-Newton or a second-order damped Newton method, along with the appropriate choice of runtime parameters. Since default parameters in SparTen are tuned to experimental results in prior published work on a single real-world dataset conducted using MATLAB implementations of these methods, it remains unclear if the parameter defaults in SparTen are appropriate for general tensor data. Furthermore, it is unknown how sensitive algorithm convergence is to changes in the input parameter values. This report addresses these unresolved issues with large-scale experimentation on three benchmark tensor data sets. Experiments were conducted on several different CPU architectures and replicated with many initial states to establish generalized profiles of algorithm convergence behavior.

97 MATHEMATICS AND COMPUTING↗

Enabling Data Exchange and Data Integration with the Common Information Model: An Introduction for Power Systems Engineers and Application Developers

The Common Information Model (CIM) is an open-source information model that is used to model an electrical network and the various equipment used on the network. CIM is widely used for data exchange of bulk transmission power systems and is finding increasing use for distribution systems. Use of a non-proprietary information model (such as CIM) that has been agreed upon and adopted by numerous utilities, vendors, and researchers allows significant reduction in the effort and cost of data integration. Likewise, adoption of open data platforms built around the CIM increases available functionalities for managing and optimizing the smart grid of the future. This report is intended as an introduction to CIM for utility engineers, power systems researchers, and application developers, providing a broad view of the CIM and how particular profiles can be adapted for various use cases. Unlike most other CIM introduction documents and the International Electrotechnical Commission (IEC) standards (which are mostly targeted to an audience of data scientists, enterprise database managers, and platform developers), this report is intended for users of traditional power systems analysis software and other readers without any prior experience with canonical information models, data profiles, or UML modeling.

24 POWER TRANSMISSION AND DISTRIBUTION↗

The Data Quality Monitoring Software for the CMS experiment at the LHC: past, present and future

The Data Quality Monitoring software is a central tool in the CMS experiment. It is used in the following key environments: (i) Online, for real-time detector monitoring; (ii) Offline, for the prompt-offline-feedback and final fine-grained data quality analysis and certification; (iii) Validation of all the reconstruction software production releases; (iv) Validation in Monte Carlo productions. Though the basic structure of the Run1 DQM system remains the same for Run2, between the Run1 and Run2 periods, the DQM system underwent substantial upgrades in many areas, not only to adapt to the surrounding infrastructure changes, but also to provide improvements to meet the growing needs of the collaboration with an emphasis on more sophisticated methods for evaluating data quality. We need to cope with the higher-energy and -luminosity proton-proton collision data, as well as the data from various special runs, such as Heavy Ion runs. In this contribution, we will describe the current DQM software, structure and workflow in the different environments. We then discuss the performance and our experiences with the DQM system in Run2. The main technical challenges which we have encountered and the solutions adopted during Run2 will also be discussed, including efficient use of memory in multithreading environments. Finally, we present the prospect of a future DQM upgrade with emphasis on functionality and long-term robustness for LHC Run3.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

simuwatt - A Tablet Based Electronic Auditing Tool

'simuwatt Energy Auditor' (TM) is a new tablet-based electronic auditing tool that is designed to dramatically reduce the time and cost to perform investment-grade audits and improve quality and consistency. The tool uses the U.S. Department of Energy's OpenStudio modeling platform and integrated Building Component Library to automate modeling and analysis. simuwatt's software-guided workflow helps users gather required data, and provides the data in a standard electronic format that is automatically converted to a baseline OpenStudio model for energy analysis. The baseline energy model is calibrated against actual monthly energy use to ASHRAE Standard 14 guidelines. Energy conservation measures from the Building Component Library are then evaluated using OpenStudio's parametric analysis capability. Automated reporting creates audit documents that describe recommended packages of energy conservation measures. The development of this tool was partially funded by the U.S. Department of Defense's Environmental Security Technology Certification Program. As part of this program, the tool is being tested at 13 buildings on 5 Department of Defense sites across the United States. Results of the first simuwatt audit tool demonstration are presented in this paper.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Automating Analysis of Neutron Scattering Time-of-Flight Single Crystal Phonon Data

This article introduces software called Phonon Explorer that implements a data mining workflow for large datasets of the neutron scattering function, S(Q, ω), measured on time-of-flight neutron spectrometers. This systematic approach takes advantage of all useful data contained in the dataset. It includes finding Brillouin zones where specific phonons have the highest scattering intensity, background subtraction, combining statistics in multiple Brillouin zones, and separating closely spaced phonon peaks. Using the software reduces the time needed to determine phonon dispersions, linewidths, and eigenvectors by more than an order of magnitude.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Matched-pair analysis and dosimetric variations of two types of software for interstitial permanent brachytherapy for prostate cancer

The purpose of this study was to determine whether identical dosimetric results could be achieved using different planning software for permanent interstitial brachytherapy for prostate cancer. Data from 492 patients treated with brachytherapy were used for matched-pair analysis. Interplant and Variseed were used as software for ultrasound-based treatment planning. Institution, neoadjuvant hormonal therapy, prostate volume, and source strength were used for factors to match the 2 groups. The study population comprised of 126 patients with treatment planning using Interplant software and 127 matched patients using Variseed software. Dosimetric results were compared between the 2 groups. The Variseed group showed significantly higher values for dose covering 90% of prostate volume (pD90), prostate volume covered by 150% of prescription dose (pV150), and dose covering 30% of the urethra (uD30) compared with the Interplant group. Our results showed that use of different software could lead to different dosimetric results, which might affect the clinical outcomes.

61 RADIATION PROTECTION AND DOSIMETRY↗

Review of Current Software for Analyzing Total X-ray Scattering Data from Liquids

The popularity of the pair distribution function (PDF) analysis of X-ray total scattering data has steadily grown as access to ex situ synchrotron data has expanded. Due to the broadening of the PDF user community, there is a growing demand for software that can be used to extract PDFs and is accessible to non-expert users. While user-friendly options have been developed over the past decade for fast, streamlined data analysis, care must be taken in both processing the data and understanding any limitations, especially in the case of liquids. In this review, the same scattering data are analyzed using different total X-ray scattering software, in order to compare the accuracy of the extracted structure factors and associated pair distribution functions. The goal is to assess the best practices for extracting the most accurate liquid data for each software package. The importance of absolute normalization and the application of the most appropriate corrections are emphasized via quantitative comparisons between liquid sulfur and water. Additionally, an awareness of the competing conventions used to define the PDF in crystallography and liquids/glasses is crucial for both the downstream analyses of the data and a comparison with the previous results in the literature.

Gallington, Leighanne C. (ORCID:0000000203837522)↗

Automated pipeline processing X-ray diffraction data from dynamic compression experiments on the Extreme Conditions Beamline of PETRA III

Presented and discussed here is the implementation of a software solution that provides prompt X-ray diffraction data analysis during fast dynamic compression experiments conducted within the dynamic diamond anvil cell technique. It includes efficient data collection, streaming of data and metadata to a high-performance cluster (HPC), fast azimuthal data integration on the cluster, and tools for controlling the data processing steps and visualizing the data using the DIOPTAS software package. This data processing pipeline is invaluable for a great number of studies. The potential of the pipeline is illustrated with two examples of data collected on ammonia–water mixtures and multiphase mineral assemblies under high pressure. The pipeline is designed to be generic in nature and could be readily adapted to provide rapid feedback for many other X-ray diffraction techniques, e.g. large-volume press studies, in situ stress/strain studies, phase transformation studies, chemical reactions studied with high-resolution diffraction etc.

97 MATHEMATICS AND COMPUTING↗

Spatio-Temporal Analysis of HPC I/O and Connection Data

The HPC system consists of a set of layers of software and hardware for I/O and networking. System logs are helpful resources to understand what is going on in the system. A challenge is that it is non-trivial to analyze the logs maintained in various levels of the stack. Independent analysis might lead to an incomplete conclusion due to the limited coverage of each log. This work takes a comprehensive approach to analysis that incorporates the logs in the multiple layers and components, in order to facilitate the detection of anomalous activities. This research aims to identify and predict potential performance bottlenecks in the HPC system, by capturing the temporal variation patterns from heterogeneous, high-dimensional, and non-linear log data. In this paper, we share our preliminary efforts for spatio-temporal analysis of HPC I/O and connection data, with our initial observations from the analysis of one-week HPC log data sets collected from one of NERSC systems.

Choi, Jinhwan↗

ML for microbiomes

The software provides machine learning analysis and visualization to detect patterns in microbiome data, including topic modeling, probabilistic graphical modeling, conventional machine learning methods, and deep learning. The software is written in python and R, it uses some python and R libraries as well as big open-source libraries like sklearn, networkX, pytorch (python), pgmpy (python), and bnlearn (R). It also has a script to use for MALLET and DTM (open-source packages for topic modeling, written in Java).

Kim, Anastasiia↗

PIPER: Performance Insight for Programmers and Exascale Runtimes: Guiding the Development of the Exascale Software Stack

The PIPER project set out to develop methodologies and software for measurement, analysis, attribution, and presentation of performance data for extreme-scale systems. Goals of the project were to support analysis of massive multi-scale parallelism, heterogeneous architectures, multi-faceted performance concerns, and to support both post-mortem performance analysis to identify program features that contribute to problematic performance and on-line performance analysis to drive adaptation. This final report summarizes the research and development activity at Rice University as part of the PIPER project. Producing a complete suite of performance tools for exascale platforms during the course of this project was impossible since both hardware and software for exascale systems is still a moving target. For that reason, the project focused broadly on the development of new techniques for measurement and analysis of performance on modern parallel architectures, enhancements to HPCToolkit’s software infrastructure to support our research goals or use on sophisticated applications, engaging developers of multithreaded runtimes to explore how support for tools should be integrated into their designs, engaging operating system developers with feature requests for enhanced monitoring support, engaging vendors with requests that they add hardware measure- ment capabilities and software interfaces needed by tools as they design new components of HPC platforms including processors, accelerators and networks, and finally collaborations with partners interested in using HPCToolkit to analyze and tune scalable parallel applications.

97 MATHEMATICS AND COMPUTING↗

Bim-to-fea Conversion Program

The purpose of this program is to enable interoperability between BIM-based architectural design software (i.e., Revit, ArchiCAD, AVEVA E3D) to structural analysis software (i.e., SAP2000). The program takes in BIM building model data via the IFC file format, automatically transforms the architectural coordination entities (structural beams, columns, slabs, walls) to structural analysis entities (i.e., finite element space frames and shells), automatically adjusts the connectivity of the structural analysis entities, and finally exports the structural analysis entities as a structural analysis model contained within a new IFC file. For example, a 3D building in Revit can be exported to an IFC file, run through this BIM-to-FEA program, then the exported IFC can be inputted into SAP2000.

Crowder, Nicholas [Idaho National Laboratory (INL)↗

Multifrequency spectrum analysis using fully digital G Mode-Kelvin probe force microscopy

Since its inception over two decades ago, Kelvin probe force microscopy (KPFM) has become the standard technique for characterizing electrostatic, electrochemical and electronic properties at the nanoscale. In this work, we present a purely digital, software-based approach to KPFM utilizing big data acquisition and analysis methods. General Mode (G-Mode) KPFM, works by capturing the entire photodetector data stream, typically at the sampling rate limit, followed by subsequent de-noising, analysis and compression of the cantilever response. We demonstrate that the G-Mode approach allows simultaneous multi-harmonic detection, combined with on-the-fly transfer function correction required for quantitative CPD mapping. The KPFM approach outlined in this work significantly simplifies the technique by avoiding cumbersome instrumentation optimization steps (i.e. lock in parameters, feedback gains etc.), while also retaining the flexibility to be implemented on any atomic force microscopy platform. We demonstrate the added advantages of G-Mode KPFM by allowing simultaneous mapping of CPD and capacitance gradient (C') channels as well as increased flexibility in data exploration across frequency, time, space, and noise domains. As a result, G-Mode KPFM is particularly suitable for characterizing voltage sensitive materials or for operation in conductive electrolytes, and will be useful for probing electrodynamics in photovoltaics, liquids and ionic conductors.

36 MATERIALS SCIENCE↗

PyRAT (Python Radiography Analysis Tool): Overview [Slides]

PyRAT was developed as a quantitative tool for robustly characterizing objects from radiographs to solve problems such as the hybrid nonlinear inverse problem. The optimization software library that was used is the nonsmooth optimization by MADS algorithm (NOMAD). Some of PyRAT's features are: (1) hybrid nonlinear inverse problem with calculated x-ray spectrum and detector response; (2) optimization based inversion approach with goal of identifying unknown object configurations - MVO problem; (3) using functionalities of Python libraries for radiographic image processing and analysis; (4) using the Tikhonov regularization method of linear inverse problem to recover partial information of object configurations; (5) using a priori knowledge of problem solutions to define feasible region and discrete neighbor for the MVO problem - initial data analysis + material library $\Rightarrow$ a priori knowledge; and (6) using the NOMAD (C++ version) software in the object.

99 GENERAL AND MISCELLANEOUS↗

PROTEUS: Machine Learning Driven Resilience for Extreme-scale Systems

The objective of this project is to design, develop, and evaluate scalable software to enhance resilience, data checkpointing, program restart, and analysis. The proposed tasks are to 1) develop scalable machine learning techniques to learn temporal change patterns in a scalable and in-situ manner, and to minimize data movement and maximize learning locally closest to data; 2) design a concise data representation and indexing mechanism to capture the distribution of changes in data that can guarantee point-wise user-defined tolerable errors while reducing the data storage requirements by an order of magnitude or more; 3) develop data reduction techniques as library modules; 4) exploit local SSD for minimizing data movement in storage hierarchy; 5) develop anomaly detection algorithms that can predict corruptions based on learning of emerging patterns; 6) develop software libraries to be incorporated within widely used data formats and APIs; and 7) evaluate the proposed software using DOE scientific applications. The outcomes of the proposed work are to satisfy many synergistic data reduction and resilience requirements for large-scale data intensive applications executed on extreme-scale computing systems. The developed mechanism for error-bound data approximation is directly applicable to existing scientific applications. Through machine learning from historical events and change distribution, this work will enable anomaly detection for DOE computer facility.

97 MATHEMATICS AND COMPUTING↗