Search NASA⌕ Search

SEARCH · Search NASA

Results for “data analysis software”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44

Enhancing Seismic Calibration Research Through Software Automation and Scientific Information Management

The National Nuclear Security Administration (NNSA) Ground-Based Nuclear Explosion Monitoring Research and Development (GNEMRD) Program at LLNL continues to make significant progress enhancing the process of deriving seismic calibrations and performing scientific integration, analysis, and information management with software automation tools. Our tool efforts address the problematic issues of very large datasets and varied formats encountered during seismic calibration research. New information management and analysis tools have resulted in demonstrated gains in efficiency of producing scientific data products and improved accuracy of derived seismic calibrations. In contrast to previous years, software development work this past year has emphasized development of automation at the data ingestion level. This change reflects a gradually-changing emphasis in our program from processing a few large data sets that result in a single integrated delivery, to processing many different data sets from a variety of sources. The increase in the number of sources had resulted in a large increase in the amount of metadata relative to the final volume of research products. Software developed this year addresses the problems of: (1) Efficient metadata ingestion and conflict resolution; (2) Automated ingestion of bulletin information; (3) Automated ingestion of waveform information from global data centers; and (4) Site Metadata and Response transformation required for certain products. This year, we also made a significant step forward in meeting a long-standing goal of developing and using a waveform correlation framework. Our objective for such a framework is to extract additional calibration data (e.g. mining blasts) and to study the extent to which correlated seismicity can be found in global and regional scale environments.

58 GEOSCIENCES↗

iMicrobe: Tools and data-driven discovery platform for the microbiome sciences

Background: Scientists have amassed a wealth of microbiome datasets, making it possible to study microbes in biotic and abiotic systems on a population or planetary scale; however, this potential has not been fully realized given that the tools, datasets, and computation are available in diverse repositories and locations. To address this challenge, we developed iMicrobe.us, a community-driven microbiome data marketplace and tool exchange for users to integrate their own data and tools with those from the broader community. Findings: The iMicrobe platform brings together analysis tools and microbiome datasets by leveraging National Science Foundation–supported cyberinfrastructure and computing resources from CyVerse, Agave, and XSEDE. The primary purpose of iMicrobe is to provide users with a freely available, web-based platform to (1) maintain and share project data, metadata, and analysis products, (2) search for related public datasets, and (3) use and publish bioinformatics tools that run on highly scalable computing resources. Analysis tools are implemented in containers that encapsulate complex software dependencies and run on freely available XSEDE resources via the Agave API, which can retrieve datasets from the CyVerse Data Store or any web-accessible location (e.g., FTP, HTTP). Conclusions: iMicrobe promotes data integration, sharing, and community-driven tool development by making open source data and tools accessible to the research community in a web-based platform.

59 BASIC BIOLOGICAL SCIENCES↗

Modular Environment for Graph Research and Analysis with a Persistent

The MEGRAPHS software package provides a front-end to graphs and vectors residing on special-purpose computing resources. It allows these data objects to be instantiated, destroyed, and manipulated. A variety of primitives needed for typical graph analyses are provided. An example program illustrating how MEGRAPHS can be used to implement a PageRank computation is included in the distribution.The MEGRAPHS software package is targeted towards developers of graph algorithms. Programmers using MEGRAPHS would write graph analysis programs in terms of high-level graph and vector operations. These computations are transparently executed on the Cray XMT compute nodes.

JANSSEN, CURTIS↗

Modular Environment for Graph Research and Analysis with a Persistent

The MEGRAPHS software package provides a front-end to graphs and vectors residing on special-purpose computing resources. It allows these data objects to be instantiated, destroyed, and manipulated. A variety of primitives needed for typical graph analyses are provided. An example program illustrating how MEGRAPHS can be used to implement a PageRank computation is included in the distribution.The MEGRAPHS software package is targeted towards developers of graph algorithms. Programmers using MEGRAPHS would write graph analysis programs in terms of high-level graph and vector operations. These computations are transparently executed on the Cray XMT compute nodes.

JANSSEN, CURTIS↗

Data preservation at the Fermilab Tevatron

The Fermilab Tevatron collider's data-taking run ended in September 2011, yielding a dataset with rich scientific potential. The CDF and D0 experiments each have approximately 9 PB of collider and simulated data stored on tape. A large computing infrastructure consisting of tape storage, disk cache, and distributed grid computing for physics analysis with the Tevatron data is present at Fermilab. The Fermilab Run II data preservation project intends to keep this analysis capability sustained through the year 2020 and beyond. To achieve this goal, we have implemented a system that utilizes virtualization, automated validation, and migration to new standards in both software and data storage technology and leverages resources available from currently-running experiments at Fermilab. Lastly, these efforts have also provided useful lessons in ensuring long-term data access for numerous experiments, and enable high-quality scientific output for years to come.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Model estimates of dissolved organic carbon, runoff, snowmelt, and snow water equivalent from 1981-2010 across the western Arctic

This dataset contains estimates of dissolved organic carbon (DOC) yield (mg C m-2), runoff (mm day-1), snow water equivalent (SWE, mm day-1), and snowmelt (mm day-1) from a simulation of the Permafrost Water Balance Model (PWBM v4). The simulation effectively quantifies snowpack accumulation and melt, runoff, and DOC leaching, and broadly capture the seasonal cycle in DOC concentration and mass loadings. Daily air temperature, precipitation, and wind speed data from the Modern-Era Retrospective Analysis for Research and Applications (MERRA) were used for meteorological forcings. The model outputs are organized by grid and day of the month in gzipped ASCII text files contained within each archived ZIP file. No special software is required to work with these data. The basin and domain information files are also ASCII text. The gridded estimates are most useful for analyses of the spatial and temporal variations in terrestrial hydrology and leachate DOC concentrations and loadings across parts of the western Arctic. A manuscript describing the data and associated analysis has been accepted for publication in Journal of Geophysical Research - Biogeosciences (Rawlins et al., 2021).

54 ENVIRONMENTAL SCIENCES↗

Source Term Analysis of Xenon (STAX): An effort focused on differentiating man-made isotope production from nuclear explosions via stack monitoring

An overview of the hardware and software developed for the Source Term Analysis of Xenon (STAX) project is presented which includes the data collection from two stack monitoring systems installed at medical isotope production facilities, infrastructure to transfer data to a central repository, and methods for sharing data from the repository with users. STAX is an experiment to collect radioxenon emission data from industrial nuclear facilities with the goal of developing a better understanding of the global radioxenon background and the effect industrial radioxenon releases have on nuclear explosion monitoring. The final goal of this work is to utilize collected data along with atmospheric transport modeling to calculate the contribution of a peak or set of peaks detected by the International Monitoring System (IMS) to provide desired discriminating information to the International Data Centre (IDC) and National Data Centers (NDCs). Types of data received from the STAX equipment are shown and collected data was used for a case study to predict radioxenon concentrations at two IMS stations closest to the Institute for RadioElements (IRE) in Belgium. The initial evaluation of results indicate that the data is very valuable to the nuclear explosion monitoring community.

07 ISOTOPE AND RADIATION SOURCES↗

ZMPY3D: accelerating protein structure volume analysis through vectorized 3D Zernike moments and Python-based GPU integration

Abstract Motivation Volumetric 3D object analyses are being applied in research fields such as structural bioinformatics, biophysics, and structural biology, with potential integration of artificial intelligence/machine learning (AI/ML) techniques. One such method, 3D Zernike moments, has proven valuable in analyzing protein structures (e.g., protein fold classification, protein–protein interaction analysis, and molecular dynamics simulations). Their compactness and efficiency make them amenable to large-scale analyses. Established methods for deriving 3D Zernike moments, however, can be inefficient, particularly when higher order terms are required, hindering broader applications. As the volume of experimental and computationally-predicted protein structure information continues to increase, structural biology has become a “big data” science requiring more efficient analysis tools. Results This application note presents a Python-based software package, ZMPY3D, to accelerate computation of 3D Zernike moments by vectorizing the mathematical formulae and using graphical processing units (GPUs). The package offers popular GPU-supported libraries such as CuPy and TensorFlow together with NumPy implementations, aiming to improve computational efficiency, adaptability, and flexibility in future algorithm development. The ZMPY3D package can be installed via PyPI, and the source code is available from GitHub. Volumetric-based protein 3D structural similarity scores and transform matrix of superposition functionalities have both been implemented, creating a powerful computational tool that will allow the research community to amalgamate 3D Zernike moments with existing AI/ML tools, to advance research and education in protein structure bioinformatics. Availability and implementation ZMPY3D, implemented in Python, is available on GitHub (https://github.com/tawssie/ZMPY3D) and PyPI, released under the GPL License.

Lai, Jhih-Siang (ORCID:0000000156775890)↗

A Rietveld refinement method for angular- and wavelength-dispersive neutron time-of-flight powder diffraction data

This paper introduces a two-dimensional extension of the well established Rietveld refinement method for modeling neutron time-of-flight powder diffraction data. The novel approach takes into account the variation of two parameters, diffraction angle 2θ and wavelength λ, to optimally adapt to the varying resolution function in diffraction experiments. By doing so, the refinement against angular- and wavelength-dispersive data gets rid of common data-reduction steps and also avoids the loss of high-resolution information typically introduced by integration. In a case study using a numerically simulated diffraction pattern of Rh 0.81 Fe 3.19 N taking into account the layout of the future POWTEX instrument, the profile function as parameterized in 2θ and λ is extracted. As a proof-of-concept, the resulting instrument parameterization is then utilized to perform a typical refinement of the angular- and wavelength-dispersive diffraction pattern of CuNCN, yielding excellent residuals within feasible computational efforts. Another proof-of-concept is carried out by applying the same approach to a real neutron diffraction data set of CuNCN obtained from the POWGEN instrument at the Spallation Neutron Source in Oak Ridge. The paper highlights the general importance of the novel approach for data analysis at neutron time-of-flight diffractometers and its possible inclusion within existing Rietveld software packages.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

HiSPoD : a program for high-speed polychromatic X-ray diffraction experiments and data analysis on polycrystalline samples

Here, a high-speed X-ray diffraction technique was recently developed at the 32-ID-B beamline of the Advanced Photon Source for studying highly dynamic, yet non-repeatable and irreversible, materials processes. In experiments, the microstructure evolution in a single material event is probed by recording a series of diffraction patterns with extremely short exposure time and high frame rate. Owing to the limited flux in a short pulse and the polychromatic nature of the incident X-rays, analysis of the diffraction data is challenging. Here, HiSPoD , a stand-alone Matlab-based software for analyzing the polychromatic X-ray diffraction data from polycrystalline samples, is described. With HiSPoD , researchers are able to perform diffraction peak indexing, extraction of one-dimensional intensity profiles by integrating a two-dimensional diffraction pattern, and, more importantly, quantitative numerical simulations to obtain precise sample structure information.

36 MATERIALS SCIENCE↗

Building Efficiency Targeting Tool for Energy Retrofits (BETTER) Application Programing Interface (API) (BETTER API) v1.0

The BETTER API allows advanced users and developers to access BETTER's analytical functionalities via HTTP requests from their own software platform without using the BETTER web-interface. API users prepare the input data and analysis configurations in a JSON format and send it to the web application via an HTTP request. The web application runs the analytical workflow on the back end and returns an HTTP response in JSON format. The user can then decide to render the results or further process it.

Szum, Carolyn↗

PRESSURE-FILM OPEN SOURCE SCANNING AND MAPPING

SF-22-099 Pressure-film Open Source Scanning and Mapping (POSSM) is software that analyses images of pressure-film (scans or photographs). POSSM collects data from that analysis in order to produce a number of visual aides, including pressure maps, histograms, and 3d surface plots. POSSM is designed to be able to analyze an entire folder full of images, exporting numeric data as .csv files and visual graphics as .png files.

Grider, Patrick↗

Finite Element Analysis (FEA) for Water-Foam Fracturing of Granite Rock

In addition to the foam data that were obtained from literature and that were collected from the current study, simulation data was also generated from finite element analysis (FEA) conducted in this study using COMSOL Multiphysics software. The FEA models were built to simulate the experiments conducted at Oak Ridge National Laboratory (ORNL) on cement and granite samples. In these FEA models, temperature was kept at ambient while the pressure profile resembled the loading conditions during the ORNL experiments, where pressure was either monotonically increased or applied cyclically. The cement material was used as a model material and was used to study Von Mises stress and tensile stress distribution for different bore hole length geometry using a parametric sweep with water as fracturing fluid using solid-fluid interaction module. For the granite material, FEA models were developed for stress analysis of cylindrical samples with water or foam fluids. The solid mechanics module in COMSOL was implemented to solve for Von Mises stress and tensile stress. The fluid-structure interaction module was implemented to solve for water-foam interaction on granite cylinder with addition of fluid-loading on structure, i.e., large deformation in solid mechanics with no impact on fluid deformation. Foam was considered as a pseudo single-phase compressible fluid for which material properties were calculated from water and gas (nitrogen) phases. The density of foam is calculated as a function of the densities of water and nitrogen, while viscosity is a function of temperature. Four types of FEA analyses were modelled: 1. Monotonic injection with water 2. Monotonic injection with foam 3. Cyclic injection with water 4. Cyclic injection with foam All the COMSOL files are converted to a zip file which is save in .mph.

15 GEOTHERMAL ENERGY↗

Multiple multiresolution representation of functions and calculus for fast computation

We describe the mathematical representations, data structure and the implementation of the numerical calculus of functions in the software environment multiresolution analysis environment for scientific simulations, MADNESS. In MADNESS, each smooth function is represented using an adaptive pseudo-spectral expansion using the multiwavelet basis to a arbitrary but finite precision. This is an extension of the capabilities of most of the existing net, mesh and spectral based methods where the discretization is based on a single adaptive mesh, or expansions.

99 GENERAL AND MISCELLANEOUS↗

Optimizing Geothermal Drilling: Oil and Gas Technology Transfer

There is a significant amount of financial risk associated with geothermal drilling; however, there are opportunities to improve upon current practices and technologies used. The scope of this drilling operational study included 21 geothermal wells and 21 oil and gas wells. The goal was to determine a 'perfect well' using historical data to compare the best oil and gas well to the best geothermal well. Unfortunately, limitations encountered in the study included missing data (bit records, mud information, etc.), poor data collection, and difficult to ascertain handwriting. An online software database was used to format drilling data to IADC coded daily drilling reports and generate analysis figures. Six major issues have been found in geothermal drilling operations. These problems include lost circulation, rig/equipment selection, cementing, penetration rate, drilling program, and time management. As a result of these issues, geothermal drilling averages 56.4 days longer than drilling comparable oil and gas wells in the wells in this study. Roughly $13.9 million would be lost due to non-productive time in the 21 geothermal wells and only $1.3 million in the oil and gas wells, assuming a cost of $50,000 per day. Comparable events such as drilling the same sized hole, tripping in/out, cementing, and running the same size casing took substantially less time in the oil and gas wells. Geothermal wells were drilled using older and/or less advanced technology to depths less than 10,000 feet, while oil and gas wells reached 12,500 feet faster with purpose built rigs. A new approach is now underway that will optimize drilling programs throughout the drilling industry. It is the use of Mechanical Specific Energy (MSE) as a tool to realize efficient drilling processes. However, a work-flow must also be established in order for there to be an efficient drilling program. Potential improvements for current geothermal operations are: the use of electronic records, real time services, and official glossary terms to describe rig operations, and advanced drilling rigs/technology.

15 GEOTHERMAL ENERGY↗

Reassessment of uncertainties for the PU-MET-INTER-002 benchmark - 14432

Uncertainty for the PU-MET-INTER-002 benchmark of ZPR-6/10 was unusually large for a ZPR assembly and was dominated by the uncertainties in matrix tube pitch and composition uncertainties for plutonium, graphite and stainless steel plates. The original uncertainty analysis for PU-MET-INTER-002 was limited by computer resources, software and the nuclear data available in 2002, all of which have been improved since. An as-built Monte Carlo model of ZPR-6/10 was used to quantify components of the transformation from the detailed model to a simplified RZ benchmark in 2002. Compositional uncertainties were estimated based upon TWODANT calculations of the RZ benchmark model (20 group, S{sub 8} - P{sub 1}). MC{sup 2}-2 was used with END/B-V.2 data to generate homogenized cross section data for TWODANT. The MC{sup 2}-2 calculations did not account for lattice cell spatial heterogeneity which was driven by the manual process required to generate ∼80 modifications to the deterministic model and by the software limitations of MC{sup 2}-2. Improvements to DIF3D-VARIANT, development of the MC{sup 2}-3 and BuildZPRModel codes, and better computer resources make accurate 3D transport calculations of reactivity changes practical today. BuildZPRModel imports the as-built geometry and creates a 'drawer' homogenized DIF3D model where each radial DIF3D mesh is the exact size of a single ZPR matrix tube and drawer. A MC{sup 2}-3 input is constructed for each drawer to produce homogenized cross section data where the spatial cell heterogeneity is captured by solving a 1D MOC transport calculation on the ultrafine energy group level. Collapsing 3D drawers into 1D MC{sup 2}-3 drawer models follows conventional procedures and is done by BuildZPRModel. MCNP6 was used to re-compute relevant geometry components of the uncertainty using ENDF/B-VII.0 data with the as-built model. Changes in the geometry components compared with earlier results are insignificant. DIF3D calculations of the compositional uncertainties were performed using 33, 70, 116, 230, 425, and 703 group energy structures and selectively combined with P{sub 3}-P{sub 7} transport approximations and P{sub 1} and P{sub 3} scattering kernels. 3D diffusion theory calculations were also performed for comparison. Many composition uncertainty components were essentially unchanged with the updated methodology. However, the dominant experimental uncertainty for PU-MET-INTER-002 is the composition of stainless steel. The new calculations reduce the stainless steel uncertainty from ∼115 pcm to ∼70 pcm which significantly reduces the total uncertainty for PU-MET-INTER-002. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

A Scientific Data Processing Framework for Time Series NetCDF Data

ARM Data Integrator (ADI) is a framework to streamline the development of scientific algorithms that analyze time-series NetCDF data, and to improve the content and consistency of the output data products produced by these algorithms. ADI achieves these goals by automating the process of retrieving and preparing data for analysis, supporting the definition of output data products through a graphical interface, and providing a modular, flexible software development architecture. The input data, preprocessing, and output data specifications are defined through a graphical interface and stored in a database. ADI also includes a workflow for data integration, a library of software modules to support the workflow, and a source code generator that produces C, IDL and Python templates. Data preparation support includes automated retrieval of data from input files, merging the retrieved data into appropriately sized chunks, and transformation of the data onto a common coordinate system grid. Through the graphical interface, users can view the details of both their data products and those in the ARM catalog. The variable and attribute definitions of the existing data products can be used to build new output data products. In addition, the rules that make up the ARM archive’s data standards are laid on top of the view of the new data product providing the user with a visual cue indicating where their output violates an archive standard. The necessary configurations are stored in a database that is accessed by the ADI libraries. This paper discusses the ADI framework, its supporting components, and how ADI can significantly decrease the time and cost of implementing scientific algorithms while improving the ability of scientists to disseminate their results.

Atmospheric Science↗

Big Data Analysis of Massive PMU Datasets: A Data Platform Perspective

The discovery of `event signatures' and useful insights from very large historical Phasor Measurement Unit (PMU) datasets is predicated on offline Big Data analysis approaches that rely on the generation of predictive features on a massive scale. This paper presents lessons learned from a data platform perspective towards reducing barriers to adoption of Big Data analytics against a real dataset of almost half a trillion data points drawn from over 400 PMUs distributed across the North American power grid. We demonstrate software abstractions and targeted performance optimizations that can lead to significant productivity gains for power systems researchers seeking to perform offline exploratory temporal analysis and modeling tasks, with a focus on feature generation. We describe how our optimized approach goes beyond a naive application of mainstream Big Data technologies, enabling feature generation tasks, that previously took days or even weeks, to now be completed in just a few hours.

Kumar, Vijay S.↗