Search NASA⌕ Search

SEARCH · Search NASA

Results for “software: data analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44

Modular Environment for Graph Research and Analysis with a Persistent

The MEGRAPHS software package provides a front-end to graphs and vectors residing on special-purpose computing resources. It allows these data objects to be instantiated, destroyed, and manipulated. A variety of primitives needed for typical graph analyses are provided. An example program illustrating how MEGRAPHS can be used to implement a PageRank computation is included in the distribution.The MEGRAPHS software package is targeted towards developers of graph algorithms. Programmers using MEGRAPHS would write graph analysis programs in terms of high-level graph and vector operations. These computations are transparently executed on the Cray XMT compute nodes.

JANSSEN, CURTIS↗

Modular Environment for Graph Research and Analysis with a Persistent

The MEGRAPHS software package provides a front-end to graphs and vectors residing on special-purpose computing resources. It allows these data objects to be instantiated, destroyed, and manipulated. A variety of primitives needed for typical graph analyses are provided. An example program illustrating how MEGRAPHS can be used to implement a PageRank computation is included in the distribution.The MEGRAPHS software package is targeted towards developers of graph algorithms. Programmers using MEGRAPHS would write graph analysis programs in terms of high-level graph and vector operations. These computations are transparently executed on the Cray XMT compute nodes.

JANSSEN, CURTIS↗

Data preservation at the Fermilab Tevatron

The Fermilab Tevatron collider's data-taking run ended in September 2011, yielding a dataset with rich scientific potential. The CDF and D0 experiments each have approximately 9 PB of collider and simulated data stored on tape. A large computing infrastructure consisting of tape storage, disk cache, and distributed grid computing for physics analysis with the Tevatron data is present at Fermilab. The Fermilab Run II data preservation project intends to keep this analysis capability sustained through the year 2020 and beyond. To achieve this goal, we have implemented a system that utilizes virtualization, automated validation, and migration to new standards in both software and data storage technology and leverages resources available from currently-running experiments at Fermilab. Lastly, these efforts have also provided useful lessons in ensuring long-term data access for numerous experiments, and enable high-quality scientific output for years to come.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Model estimates of dissolved organic carbon, runoff, snowmelt, and snow water equivalent from 1981-2010 across the western Arctic

This dataset contains estimates of dissolved organic carbon (DOC) yield (mg C m-2), runoff (mm day-1), snow water equivalent (SWE, mm day-1), and snowmelt (mm day-1) from a simulation of the Permafrost Water Balance Model (PWBM v4). The simulation effectively quantifies snowpack accumulation and melt, runoff, and DOC leaching, and broadly capture the seasonal cycle in DOC concentration and mass loadings. Daily air temperature, precipitation, and wind speed data from the Modern-Era Retrospective Analysis for Research and Applications (MERRA) were used for meteorological forcings. The model outputs are organized by grid and day of the month in gzipped ASCII text files contained within each archived ZIP file. No special software is required to work with these data. The basin and domain information files are also ASCII text. The gridded estimates are most useful for analyses of the spatial and temporal variations in terrestrial hydrology and leachate DOC concentrations and loadings across parts of the western Arctic. A manuscript describing the data and associated analysis has been accepted for publication in Journal of Geophysical Research - Biogeosciences (Rawlins et al., 2021).

54 ENVIRONMENTAL SCIENCES↗

Source Term Analysis of Xenon (STAX): An effort focused on differentiating man-made isotope production from nuclear explosions via stack monitoring

An overview of the hardware and software developed for the Source Term Analysis of Xenon (STAX) project is presented which includes the data collection from two stack monitoring systems installed at medical isotope production facilities, infrastructure to transfer data to a central repository, and methods for sharing data from the repository with users. STAX is an experiment to collect radioxenon emission data from industrial nuclear facilities with the goal of developing a better understanding of the global radioxenon background and the effect industrial radioxenon releases have on nuclear explosion monitoring. The final goal of this work is to utilize collected data along with atmospheric transport modeling to calculate the contribution of a peak or set of peaks detected by the International Monitoring System (IMS) to provide desired discriminating information to the International Data Centre (IDC) and National Data Centers (NDCs). Types of data received from the STAX equipment are shown and collected data was used for a case study to predict radioxenon concentrations at two IMS stations closest to the Institute for RadioElements (IRE) in Belgium. The initial evaluation of results indicate that the data is very valuable to the nuclear explosion monitoring community.

07 ISOTOPE AND RADIATION SOURCES↗

ZMPY3D: accelerating protein structure volume analysis through vectorized 3D Zernike moments and Python-based GPU integration

Abstract Motivation Volumetric 3D object analyses are being applied in research fields such as structural bioinformatics, biophysics, and structural biology, with potential integration of artificial intelligence/machine learning (AI/ML) techniques. One such method, 3D Zernike moments, has proven valuable in analyzing protein structures (e.g., protein fold classification, protein–protein interaction analysis, and molecular dynamics simulations). Their compactness and efficiency make them amenable to large-scale analyses. Established methods for deriving 3D Zernike moments, however, can be inefficient, particularly when higher order terms are required, hindering broader applications. As the volume of experimental and computationally-predicted protein structure information continues to increase, structural biology has become a “big data” science requiring more efficient analysis tools. Results This application note presents a Python-based software package, ZMPY3D, to accelerate computation of 3D Zernike moments by vectorizing the mathematical formulae and using graphical processing units (GPUs). The package offers popular GPU-supported libraries such as CuPy and TensorFlow together with NumPy implementations, aiming to improve computational efficiency, adaptability, and flexibility in future algorithm development. The ZMPY3D package can be installed via PyPI, and the source code is available from GitHub. Volumetric-based protein 3D structural similarity scores and transform matrix of superposition functionalities have both been implemented, creating a powerful computational tool that will allow the research community to amalgamate 3D Zernike moments with existing AI/ML tools, to advance research and education in protein structure bioinformatics. Availability and implementation ZMPY3D, implemented in Python, is available on GitHub (https://github.com/tawssie/ZMPY3D) and PyPI, released under the GPL License.

Lai, Jhih-Siang (ORCID:0000000156775890)↗

A Rietveld refinement method for angular- and wavelength-dispersive neutron time-of-flight powder diffraction data

This paper introduces a two-dimensional extension of the well established Rietveld refinement method for modeling neutron time-of-flight powder diffraction data. The novel approach takes into account the variation of two parameters, diffraction angle 2θ and wavelength λ, to optimally adapt to the varying resolution function in diffraction experiments. By doing so, the refinement against angular- and wavelength-dispersive data gets rid of common data-reduction steps and also avoids the loss of high-resolution information typically introduced by integration. In a case study using a numerically simulated diffraction pattern of Rh 0.81 Fe 3.19 N taking into account the layout of the future POWTEX instrument, the profile function as parameterized in 2θ and λ is extracted. As a proof-of-concept, the resulting instrument parameterization is then utilized to perform a typical refinement of the angular- and wavelength-dispersive diffraction pattern of CuNCN, yielding excellent residuals within feasible computational efforts. Another proof-of-concept is carried out by applying the same approach to a real neutron diffraction data set of CuNCN obtained from the POWGEN instrument at the Spallation Neutron Source in Oak Ridge. The paper highlights the general importance of the novel approach for data analysis at neutron time-of-flight diffractometers and its possible inclusion within existing Rietveld software packages.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

HiSPoD : a program for high-speed polychromatic X-ray diffraction experiments and data analysis on polycrystalline samples

Here, a high-speed X-ray diffraction technique was recently developed at the 32-ID-B beamline of the Advanced Photon Source for studying highly dynamic, yet non-repeatable and irreversible, materials processes. In experiments, the microstructure evolution in a single material event is probed by recording a series of diffraction patterns with extremely short exposure time and high frame rate. Owing to the limited flux in a short pulse and the polychromatic nature of the incident X-rays, analysis of the diffraction data is challenging. Here, HiSPoD , a stand-alone Matlab-based software for analyzing the polychromatic X-ray diffraction data from polycrystalline samples, is described. With HiSPoD , researchers are able to perform diffraction peak indexing, extraction of one-dimensional intensity profiles by integrating a two-dimensional diffraction pattern, and, more importantly, quantitative numerical simulations to obtain precise sample structure information.

36 MATERIALS SCIENCE↗

Building Efficiency Targeting Tool for Energy Retrofits (BETTER) Application Programing Interface (API) (BETTER API) v1.0

The BETTER API allows advanced users and developers to access BETTER's analytical functionalities via HTTP requests from their own software platform without using the BETTER web-interface. API users prepare the input data and analysis configurations in a JSON format and send it to the web application via an HTTP request. The web application runs the analytical workflow on the back end and returns an HTTP response in JSON format. The user can then decide to render the results or further process it.

Szum, Carolyn↗

PRESSURE-FILM OPEN SOURCE SCANNING AND MAPPING

SF-22-099 Pressure-film Open Source Scanning and Mapping (POSSM) is software that analyses images of pressure-film (scans or photographs). POSSM collects data from that analysis in order to produce a number of visual aides, including pressure maps, histograms, and 3d surface plots. POSSM is designed to be able to analyze an entire folder full of images, exporting numeric data as .csv files and visual graphics as .png files.

Grider, Patrick↗

Finite Element Analysis (FEA) for Water-Foam Fracturing of Granite Rock

In addition to the foam data that were obtained from literature and that were collected from the current study, simulation data was also generated from finite element analysis (FEA) conducted in this study using COMSOL Multiphysics software. The FEA models were built to simulate the experiments conducted at Oak Ridge National Laboratory (ORNL) on cement and granite samples. In these FEA models, temperature was kept at ambient while the pressure profile resembled the loading conditions during the ORNL experiments, where pressure was either monotonically increased or applied cyclically. The cement material was used as a model material and was used to study Von Mises stress and tensile stress distribution for different bore hole length geometry using a parametric sweep with water as fracturing fluid using solid-fluid interaction module. For the granite material, FEA models were developed for stress analysis of cylindrical samples with water or foam fluids. The solid mechanics module in COMSOL was implemented to solve for Von Mises stress and tensile stress. The fluid-structure interaction module was implemented to solve for water-foam interaction on granite cylinder with addition of fluid-loading on structure, i.e., large deformation in solid mechanics with no impact on fluid deformation. Foam was considered as a pseudo single-phase compressible fluid for which material properties were calculated from water and gas (nitrogen) phases. The density of foam is calculated as a function of the densities of water and nitrogen, while viscosity is a function of temperature. Four types of FEA analyses were modelled: 1. Monotonic injection with water 2. Monotonic injection with foam 3. Cyclic injection with water 4. Cyclic injection with foam All the COMSOL files are converted to a zip file which is save in .mph.

15 GEOTHERMAL ENERGY↗

Multiple multiresolution representation of functions and calculus for fast computation

We describe the mathematical representations, data structure and the implementation of the numerical calculus of functions in the software environment multiresolution analysis environment for scientific simulations, MADNESS. In MADNESS, each smooth function is represented using an adaptive pseudo-spectral expansion using the multiwavelet basis to a arbitrary but finite precision. This is an extension of the capabilities of most of the existing net, mesh and spectral based methods where the discretization is based on a single adaptive mesh, or expansions.

99 GENERAL AND MISCELLANEOUS↗

Optimizing Geothermal Drilling: Oil and Gas Technology Transfer

There is a significant amount of financial risk associated with geothermal drilling; however, there are opportunities to improve upon current practices and technologies used. The scope of this drilling operational study included 21 geothermal wells and 21 oil and gas wells. The goal was to determine a 'perfect well' using historical data to compare the best oil and gas well to the best geothermal well. Unfortunately, limitations encountered in the study included missing data (bit records, mud information, etc.), poor data collection, and difficult to ascertain handwriting. An online software database was used to format drilling data to IADC coded daily drilling reports and generate analysis figures. Six major issues have been found in geothermal drilling operations. These problems include lost circulation, rig/equipment selection, cementing, penetration rate, drilling program, and time management. As a result of these issues, geothermal drilling averages 56.4 days longer than drilling comparable oil and gas wells in the wells in this study. Roughly $13.9 million would be lost due to non-productive time in the 21 geothermal wells and only $1.3 million in the oil and gas wells, assuming a cost of $50,000 per day. Comparable events such as drilling the same sized hole, tripping in/out, cementing, and running the same size casing took substantially less time in the oil and gas wells. Geothermal wells were drilled using older and/or less advanced technology to depths less than 10,000 feet, while oil and gas wells reached 12,500 feet faster with purpose built rigs. A new approach is now underway that will optimize drilling programs throughout the drilling industry. It is the use of Mechanical Specific Energy (MSE) as a tool to realize efficient drilling processes. However, a work-flow must also be established in order for there to be an efficient drilling program. Potential improvements for current geothermal operations are: the use of electronic records, real time services, and official glossary terms to describe rig operations, and advanced drilling rigs/technology.

15 GEOTHERMAL ENERGY↗

Reassessment of uncertainties for the PU-MET-INTER-002 benchmark - 14432

Uncertainty for the PU-MET-INTER-002 benchmark of ZPR-6/10 was unusually large for a ZPR assembly and was dominated by the uncertainties in matrix tube pitch and composition uncertainties for plutonium, graphite and stainless steel plates. The original uncertainty analysis for PU-MET-INTER-002 was limited by computer resources, software and the nuclear data available in 2002, all of which have been improved since. An as-built Monte Carlo model of ZPR-6/10 was used to quantify components of the transformation from the detailed model to a simplified RZ benchmark in 2002. Compositional uncertainties were estimated based upon TWODANT calculations of the RZ benchmark model (20 group, S{sub 8} - P{sub 1}). MC{sup 2}-2 was used with END/B-V.2 data to generate homogenized cross section data for TWODANT. The MC{sup 2}-2 calculations did not account for lattice cell spatial heterogeneity which was driven by the manual process required to generate ∼80 modifications to the deterministic model and by the software limitations of MC{sup 2}-2. Improvements to DIF3D-VARIANT, development of the MC{sup 2}-3 and BuildZPRModel codes, and better computer resources make accurate 3D transport calculations of reactivity changes practical today. BuildZPRModel imports the as-built geometry and creates a 'drawer' homogenized DIF3D model where each radial DIF3D mesh is the exact size of a single ZPR matrix tube and drawer. A MC{sup 2}-3 input is constructed for each drawer to produce homogenized cross section data where the spatial cell heterogeneity is captured by solving a 1D MOC transport calculation on the ultrafine energy group level. Collapsing 3D drawers into 1D MC{sup 2}-3 drawer models follows conventional procedures and is done by BuildZPRModel. MCNP6 was used to re-compute relevant geometry components of the uncertainty using ENDF/B-VII.0 data with the as-built model. Changes in the geometry components compared with earlier results are insignificant. DIF3D calculations of the compositional uncertainties were performed using 33, 70, 116, 230, 425, and 703 group energy structures and selectively combined with P{sub 3}-P{sub 7} transport approximations and P{sub 1} and P{sub 3} scattering kernels. 3D diffusion theory calculations were also performed for comparison. Many composition uncertainty components were essentially unchanged with the updated methodology. However, the dominant experimental uncertainty for PU-MET-INTER-002 is the composition of stainless steel. The new calculations reduce the stainless steel uncertainty from ∼115 pcm to ∼70 pcm which significantly reduces the total uncertainty for PU-MET-INTER-002. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

A Scientific Data Processing Framework for Time Series NetCDF Data

ARM Data Integrator (ADI) is a framework to streamline the development of scientific algorithms that analyze time-series NetCDF data, and to improve the content and consistency of the output data products produced by these algorithms. ADI achieves these goals by automating the process of retrieving and preparing data for analysis, supporting the definition of output data products through a graphical interface, and providing a modular, flexible software development architecture. The input data, preprocessing, and output data specifications are defined through a graphical interface and stored in a database. ADI also includes a workflow for data integration, a library of software modules to support the workflow, and a source code generator that produces C, IDL and Python templates. Data preparation support includes automated retrieval of data from input files, merging the retrieved data into appropriately sized chunks, and transformation of the data onto a common coordinate system grid. Through the graphical interface, users can view the details of both their data products and those in the ARM catalog. The variable and attribute definitions of the existing data products can be used to build new output data products. In addition, the rules that make up the ARM archive’s data standards are laid on top of the view of the new data product providing the user with a visual cue indicating where their output violates an archive standard. The necessary configurations are stored in a database that is accessed by the ADI libraries. This paper discusses the ADI framework, its supporting components, and how ADI can significantly decrease the time and cost of implementing scientific algorithms while improving the ability of scientists to disseminate their results.

Atmospheric Science↗

Enhancing the Earth System Grid Authentication Infrastructure through Single Sign-On and Autoprovisioning

Climate scientists face an overarching need to efficiently access and manipulate climate model data. Increasingly, researchers must assemble and analyze large datasets that are archived in different formats on disparate platforms and must extract portions of datasets to compute statistical or diagnostic metrics in place. The need for a common virtual environment in which to access both climate model datasets and analysis tools is therefore keenly felt. The software infrastructure to support such an environment must not only provide ready access to climate data but must also facilitate the use of visualization software, diagnostic algorithms, and related resources. To this end, the Earth System Grid Center for Enabling Technologies (ESG-CET) was established in 2006 by the Scientific Discovery through Advanced Computing program of the U.S. Department of Energy through the Office of Advanced Scientific Computing Research and the Office Biological and Environmental Research within the Office of Science. ESG-CET is working to advance climate science by developing computational resources for accessing and managing model data that are physically located in distributed multiplatform archives. In this paper, we discuss recent development and implementation efforts by the Earth System Grid (ESG) concerning its security infrastructure. ESG's requirements are to make user logon as easy as possible and to facilitate the integration of security services and Grid components for both developers and system administrators. To meet that goal, we leverage existing primary authentication mechanisms, deploy a 'lightweight' but secure OpenID WebSSO, deploy a 'lightweight' X.509-PKI, and use autoprovisioning to ease the burden of security configuration management. We are close to completing the associated development and deployment.

54 ENVIRONMENTAL SCIENCES↗

The Integration of Plant Sample Analysis, Laboratory Studies, and Thermodynamic Modeling to Predict Slag-Matte Equilibria in Nickel Sulfide Converting

The Kalgoorlie Nickel Smelter (KNS) produces low Fe, low Cu nickel matte in its Peirce–Smith converter operations. To inform process development in the plant, new fundamental data are required on the effect of CaO in slag on the distribution of arsenic between slag and matte. A combination of plant sample analysis, high-temperature laboratory experiments, and thermodynamic modeling was carried out to identify process conditions in the converter and to investigate the effect of slag composition on the chemical behavior of the system. The high-temperature experiments involved re-equilibration of industrial matte-slag-lime samples at 1498 K (1225 °C) and P(SO{sub 2}) = 0.12 atm on a magnetite/quartz substrate, rapid quenching in water, and direct measurement of phase compositions using electron probe X-ray microanalysis (EPMA) and laser ablation–inductively coupled plasma–mass spectrometry (LA-ICP-MS). A private thermodynamic database for the Ca-Cu-Fe-Mg-Ni-O-S-Si-(As) system was used together with the FactSage software package to assist in the analysis. Thermodynamic predictions combined with plant sample characterization and the present experimental data provide a quantitative basis for the analysis of the effect of CaO fluxing on the slag-matte thermochemistry during nickel sulfide converting, in particular on the spinel liquidus and the distribution of elements between slag and matte as a function of CaO addition.

36 MATERIALS SCIENCE↗

MetaboDirect: an analytical pipeline for the processing of FT-ICR MS-based metabolomic data

Background: Microbiomes are now recognized as the main drivers of ecosystem function ranging from the oceans and soils to humans and bioreactors. However, a grand challenge in microbiome science is to characterize and quantify the chemical currencies of organic matter (i.e., metabolites) that microbes respond to and alter. Critical to this has been the development of Fourier transform ion cyclotron resonance mass spectrometry (FT-ICR MS), which has drastically increased molecular characterization of complex organic matter samples, but challenges users with hundreds of millions of data points where readily available, user-friendly, and customizable software tools are lacking. Results: Here, we build on years of analytical experience with diverse sample types to develop MetaboDirect, an open-source, command-line-based pipeline for the analysis (e.g., chemodiversity analysis, multivariate statistics), visualization (e.g., Van Krevelen diagrams, elemental and molecular class composition plots), and presentation of direct injection high-resolution FT-ICR MS data sets after molecular formula assignment has been performed. When compared to other available FT-ICR MS software, MetaboDirect is superior in that it requires a single line of code to launch a fully automated framework for the generation and visualization of a wide range of plots, with minimal coding experience required. Among the tools evaluated, MetaboDirect is also uniquely able to automatically generate biochemical transformation networks (ab initio) based on mass differences (mass difference network-based approach) that provide an experimental assessment of metabolite connections within a given sample or a complex metabolic system, thereby providing important information about the nature of the samples and the set of microbial reactions or pathways that gave rise to them. Finally, for more experienced users, MetaboDirect allows users to customize plots, outputs, and analyses. Conclusion: Application of MetaboDirect to FT-ICR MS-based metabolomic data sets from a marine phage-bacterial infection experiment and a Sphagnum leachate microbiome incubation experiment showcase the exploration capabilities of the pipeline that will enable the research community to evaluate and interpret their data in greater depth and in less time. It will further advance our knowledge of how microbial communities influence and are influenced by the chemical makeup of the surrounding system. The source code and User’s guide of MetaboDirect are freely available through (https://github.com/Coayala/MetaboDirect) and (https://metabodirect.readthedocs.io/en/latest/), respectively.

54 ENVIRONMENTAL SCIENCES↗