Search NASA⌕ Search

SEARCH · Search NASA

Results for “data analysis software”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,261 records · Page 70

Feature-Identification and Data-Compression Software

A report discusses the continuing development of Windows Interface for Nominal Displacement Selection (WINDS), a computer program for automated analysis of images of the Sun and planets acquired by scientific instruments aboard spacecraft. WINDS is intended to afford capabilities for identification of features, measurement of displacements and velocities, analysis of terrain and of atmospheres, and synthesis of animation sequences of images of terrains and atmospheres from small sets of samples by use of velocity-based interpolation. A major element of WINDS will be a nonlinear correlator capable of tracking small features in complex image sequences. For dynamic image sequences, the correlator will enable compression of data by factors >100. In processing image data, WINDS will take account of such factors as texture in image data, rotation of features during measurement intervals, effects of viewing and solar illumination angles, and vertical structures of atmospheres. WINDS will also take account of positions, aiming directions, and fields of view of cameras to determine three-dimensional feature structures by use of triangulation and stereoscopic analysis techniques.

Jong, Eric De↗

SAS PDF: pair distribution function analysis of nanoparticle assemblies from small-angle scattering data

SASPDF, a method for characterizing the structure of nanoparticle assemblies (NPAs), is presented. The method is an extension of the atomic pair distribution function (PDF) analysis to the small-angle scattering (SAS) regime. The PDFgetS3 software package for computing the PDF from SAS data is also presented. An application of the SASPDF method to characterize structures of representative NPA samples with different levels of structural order is then demonstrated. The SASPDF method quantitatively yields information such as structure, disorder and crystallite sizes of ordered NPA samples. The method was also used to successfully model the data from a disordered NPA sample. The SASPDF method offers the possibility of more quantitative characterizations of NPA structures for a wide class of samples.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

Quantitative analysis of total reflection X-ray fluorescence from finely layered structures using XeRay

Total reflection x-ray fluorescence (TXRF) is a widely applicable experimental technique for studying chemical element distributions across finely layered structures at extremely high sensitivity. To promote and facilitate scientific discovery using TXRF, we developed a MATLAB-based software package with a graphical user interface, named XeRay, for quick, accurate, and intuitive data analysis. XeRay lets the user model any layered system, each layer with its independent chemical composition and thickness, and enables fine-tuned data fitting. The accuracy of XeRay has been tested in the analysis of TXRF data from both air/liquid interface and liquid/liquid interfacial studies and has been compared to literature results. In an air/liquid interface study, Ca 2+ sequestration was measured at a Langmuir monolayer of 1-stearoyl-2-oleoyl-sn-glycero-3-phosphatidic acid (SOPA) on a buffer solution of 1 mM CaCl2 at pH 7.5. Data analysis with XeRay reveals that each 1 nm2 of interfacial area contains 2.38 ± 0.06 Ca 2+ ions, which corresponds to a 1:1 ratio between SOPA headgroups and Ca 2+ ions, consistent with several earlier reports. For the liquid/liquid interface study of Sr 2+ enrichment at the dodecane/surfactant/water interface, analysis using XeRay gives a surface enrichment of Sr 2+ at $68^{+6}_{-5}$ Å 2 per ion, consistent with the result published for the same dataset.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Sandbox for Mac Malware v 1.0

This software is an analyzer for automated sandbox analysis of malware on the OS X operating system. It runs inside an OS X virtual machine to collect data about what happens when a given file is opened or run. As of August 2014, there was no sandbox software for Mac OS X malware, as it requires different methods from those used on the Windows OS (which most sandboxes are written for). This software adds OS X analysis capabilities to an existing open-source sandbox, Cuckoo Sandbox (http://cuckoosandbox.org/), which previously only worked for Windows. The analyzer itself can take many different types of files as input: the traditional Mach-O and FAT executables, .app files, zip files, Python scripts, Java archives, and web pages, as well as PDFs and other documents. While the file is running, the analyzer also simulates rudimentary human interaction with clicks and mouse movements in order to bypass the tests some malware use to see if they are being analyzed. The analyzer outputs several different kinds of data: function call traces, network captures, screenshots, and all created and modified files. This work also includes a static analysis Cuckoo module for Mach-O binary files. It extracts file structures, code library imports and exports, and signatures. This data can be used along with the analyzer results to create signatures for malware.

Walkup, Elizabeth↗

Automating simulator operations

A set of requirements are defined for an operations support system for automating operations in the Space Station Training Facility (SSTF). An operations concept is described based on utilization studies and facility-operations plans with specific attention given to the SSTF components. The Operations Support System (OSS) is designed to have an integrated set of tools for system configuration and realtime data monitoring, analysis, and control. The concept relies on a system configuration tool for connecting and verifying hardware and software components, and a status-and-control monitor is envisaged to collect data. The SSTF OSS is expected to enhance the effectiveness of simulator training by configuring the components for training, monitoring and controlling components, and conducting all operations in real time.

Jacobs, Rebecca J.↗

Correction to Unveiling the Role of Al 2 O 3 in Preventing Surface Reconstruction During High-Voltage Cycling of Lithium-Ion Batteries

A correction to this article was necessary to replace the original Figure 2 with the actual data in the revised Figure 2 shown here. An error was made while preparing the graphs from the neutron diffraction analysis software, and panel a was accidentally inserted into the panel b–d spots, such that all four panels were replicates. Since the original analysis of the data collected was made correctly, the conclusions and key points related to this section and the whole article remain unchanged. The revised goodness factors are slightly different because the refinements were repeated with small changes to the refinement conditions. The corresponding author has obtained approval from all coauthors in the article prior the submission of the Correction. The authors apologize for any inconveniences caused.

25 ENERGY STORAGE↗

Modern Nuclear Data Evaluation with the TALYS Code System

This paper presents a general overview of nuclear data evaluation and its applications as developed at NRG, Petten. Based on concepts such as robustness, reproducibility and automation, modern calculation tools are exploited to produce original nuclear data libraries that meet the current demands on quality and completeness. This requires a system which comprises differential measurements, theory development, nuclear model codes, resonance analysis, evaluation, ENDF formatting, data processing and integral validation in one integrated approach. Software, built around the TALYS code, will be presented in which all these essential nuclear data components are seamlessly integrated. Besides the quality of the basic data and its extensive format testing, a second goal lies in the diversity of processing for different type of users. The implications of this scheme are unprecedented. The most important are: 1. Complete ENDF-6 nuclear data files, in the form of the TENDL library, including covariance matrices, for many isotopes, particles, energies, reaction channels and derived quantities. All isotopic data files are mutually consistent and are supposed to rival those of the major world libraries. 2. More exact uncertainty propagation from basic nuclear physics to applied (reactor) calculations based on a Monte Carlo approach: 'Total' Monte Carlo (TMC), using random nuclear data libraries. 3. Automatic optimization in the form of systematic feedback from integral measurements back to the basic data. This method of work also opens a new way of approaching the analysis of nuclear applications, with consequences in both applied nuclear physics and safety of nuclear installations, and several examples are given here. This applied experience and feedback is integrated in a final step to improve the quality of the nuclear data, to change the users vision and finally to orchestrate their integration into simulation codes.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Numerical Modeling of Self-Pressurization and Pressure Control by Thermodynamic Vent System in a Cryogenic Tank

This paper presents a numerical model of a system-level test bed - the multipurpose hydrogen test bed (MHTB) using Generalized Fluid System Simulation Program (GFSSP). MHTB is representative in size and shape of a fully integrated space transportation vehicle liquid hydrogen (LH2) propellant tank and was tested at Marshall Space Flight Center (MSFC) to generate data for cryogenic storage. GFSSP is a finite volume based network flow analysis software developed at MSFC and used for thermo-fluid analysis of propulsion systems. GFSSP has been used to model the self-pressurization and ullage pressure control by Thermodynamic Vent System (TVS). A TVS typically includes a Joule-Thompson (J-T) expansion device, a two-phase heat exchanger, and a mixing pump and spray to extract thermal energy from the tank without significant loss of liquid propellant. Two GFSSP models (Self-Pressurization & TVS) were separately developed and tested and then integrated to simulate the entire system. Self-Pressurization model consists of multiple ullage nodes, propellant node and solid nodes; it computes the heat transfer through Multi-Layer Insulation blankets and calculates heat and mass transfer between ullage and liquid propellant and ullage and tank wall. TVS model calculates the flow through J-T valve, heat exchanger and spray and vent systems. Two models are integrated by exchanging data through User Subroutines of both models. The integrated models results have been compared with MHTB test data of 50% fill level. Satisfactory comparison was observed between test and numerical predictions.

Majumdar, Alok↗

Measurement and Analysis of Atmospheric Spectral Optical Depths with NASA Ames Airborne Sunphotometers During TARFOX and ACE-2

In accordance with the scope of work of this contract, the following tasks were undertaken and completed during the course of the contract: (1) Participation in the design and development of the 14-channel Ames Airborne Tracking Sunphotometer (AATS-14), including the development and implementation of Visual Basic software for real-time data processing and display and post-acquisition data reduction and analysis. (2) Operation of the six-channel Ames Airborne Tracking Sunphotometer (AATS-6) aboard the University of Washington C-131A during TARFOX and in-field analysis and presentation of data acquired with the AATS-6. (3) Post-mission analysis of data acquired during TARFOX with the AATS-6 and the AATS-14. (4) Pre-TARFOX calibration of the AATS-6 at Mauna Loa Observatory in May 1996, and post-TARFOX calibration of the AATS-6 and AATS- 14 at Zugspitze, Germany in October 1996, including analyses of all data sets. (5) Analysis of AATS-14 airborne calibration data acquired on 17 November 1996 during a late afternoon Pelican flight over the central California coast. (6) Operational training, instrument preparation, field coordination, and analysis of shipboard measurements of aerosol optical depth with the AATS-6 during ACE-2. (7) Coordination of data acquisition with the AATS-14 aboard the Pelican during ACE-2 and in-field preliminary data analysis and presentation. (8) Calibration of the AATS-6 and AATS-14 in April/May 1997 at Mauna Loa prior to ACE-2, and post-mission calibration of the AATS-6 at Mauna Loa in August 1997.

Livingston, John M.↗

DAQ for commissioning and calibration of a multichannel analyzer of scintillation counters

We report the status of the Data Acquisition (DAQ) system for the Coordinate Detector (CDET) module of the Super Bigbite Spectrometer facility at Hall A of Thomas Jefferson Accelerator Facility. Presently, the DAQ is fully assembled and tested with one CDET module. The commissioning of CDET module, that is the goal of the tests presented here, consists essentially in the measures of the amplitude and time-over-threshold of signals from cosmic rays. Hardware checks, the developing of DAQ control and off-line analysis software are ongoing; the module currently seems to work roughly accordingly to expectations. Data presented in this note are still preliminary.

Tortorici, F.↗

Automated Energy-Dispersive X-ray Spectroscopy Analysis for Multi-Modal Few-Shot Learning

Scanning transmission electron microscopy (STEM) is a powerful tool that allows for the atomic-scale analysis of a materials’ structure, chemistry, and defect domains (Akers et al. 2021). The current generation of microscopes generate vast amounts of data, surpassing the limits of effective manual analysis traditionally performed by domain experts (Spurgeon et al. 2021). While recent strides in machine learning have significantly enhanced the processing of large and intricate datasets acquired through electron microscopy, the prevalent use of proprietary software packages for initial data collection poses a challenge. In many cases, these software packages act as a ‘black box’, constraining user functionality and hindering the output of data in a format that is conducive to seamless integration into machine learning models. This work addresses these challenges by adapting HyperSpy, an open-source Python library, for the analysis and quantification of raw energy dispersive spectroscopy (EDS) data acquired through STEM. The modified HyperSpy code successfully facilitates user-defined segmentation of the data, enabling the integration of atomic %, weight %, and raw EDS spectra for each segmented region into an existing few-shot machine learning model. While initial results reveal discrepancies in quantified atomic and weight percentages when compared to proprietary software, ongoing efforts aim to rectify this issue by refining the fit of the HyperSpy model to the EDS spectra. Overall, this research underscores the potential of open-source tools like HyperSpy to enhance the accessibility of analytical tools, fostering a transparent and user-friendly environment for seamlessly incorporating electron microscopy data into machine learning models.

36 MATERIALS SCIENCE↗

System Level Analysis Software Validation with Argonne's THETA Experimental Facility (Final CRADA Report)

Under this CRADA, the Contractor will be generating and collecting sodium-based experimental data with modern instrumentation. The Contractor will work symbiotically with the Participant to generate SAS4A/SASSYS-1 and SAM computational models of the THETA experimental facility for validation of the system-level analysis codes utilized by Oklo, Inc. This effort will be specifically focused on the design basis event space scoped by Chapter 15 of the NRC’s Standard Review Plan (NUREG-0800) with an emphasis on natural circulation and thermal stratification phenomena in a prototypic sodium-cooled fast reactor (SFR).

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Network performance analysis for HPC datacenters (net_perf) v1.0

The software has two main features: (1) identify data movement trends in HPC data centers that use network flow monitoring (2) analyze the performance of individual data flows under the existing data movement management strategy and identify performance bottlenecks that impede timely data availability for science workflows. Its main advantage is that it is tailored for HPC network traffic by considering HPC data movement management intricacies.

Giannakou, Anna↗

Digital tape unit test facility software

Two computer programs are described which are used for the collection and analysis of data from the digital tape unit test facility (DTUTF). The data are the recorded results of skew tests made on magnetic digital tapes which are used on computers as input/output media. The results of each tape test are keypunched onto an 80 column computer card. The format of the card is checked and the card image is stored on a master summary tape via the DTUTF card checking and tape updating system. The master summary tape containing the results of all the tape tests is then used for analysis as input to the DTUTF histogram generating system which produces a histogram of skew vs. date for selected data, followed by some statistical analysis of the data.

Jackson, J. T.↗

Meteor44 Video Meteor Photometry

Meteor44 is a software system developed at MSFC for the calibration and analysis of video meteor data. The dynamic range of the (8bit) video data is extended by approximately 4 magnitudes for both meteors and stellar images using saturation compensation. Camera and lens specific saturation compensation coefficients are derived from artificial variable star laboratory measurements. Saturation compensation significantly increases the number of meteors with measured intensity and improves the estimation of meteoroid mass distribution. Astrometry is automated to determine each image's plate coefficient using appropriate star catalogs. The images are simultaneously intensity calibrated from the contained stars to determine the photon sensitivity and the saturation level referenced above the atmosphere. The camera s spectral response is used to compensate for stellar color index and typical meteor spectra in order to report meteor light curves in traditional visual magnitude units. Recent efforts include improved camera calibration procedures, long focal length 'streak' meteor photometry and two-station track determination. Meteor44 has been used to analyze data from the 2001, 2002 and 2003 MSFC Leonid observational campaigns as well as several lesser showers. The software is interactive and can be demonstrated using data from recent Leonid campaigns.

Swift, Wesley R.↗

Meteor44 Video Meteor Photometry

Meteor44 is a software system developed at MSFC for the calibration and analysis of video meteor data. The dynamic range of the (8bit) video data is extended by approximately 4 magnitudes for both meteors and stellar images using saturation compensation. Camera and lens specific saturation compensation coefficients are derived from artificial variable star laboratory measurements. Saturation compensation significantly increases the number of meteors with measured intensity and improves the estimation of meteoroid mass distribution. Astrometry is automated to determine each image s plate coefficient using appropriate star catalogs. The images are simultaneously intensity calibrated from the contained stars to determine the photon sensitivity and the saturation level referenced above the atmosphere. The camera s spectral response is used to compensate for stellar color index and typical meteor spectra in order to report meteor light curves in traditional visual magnitude units. Recent efforts include improved camera calibration procedures, long focal length "streak" meteor photome&y and two-station track determination. Meteor44 has been used to analyze data from the 2001.2002 and 2003 MSFC Leonid observational campaigns as well as several lesser showers. The software is interactive and can be demonstrated using data from recent Leonid campaigns.

Swift, Wesley R.↗

System and method of managing large data files

Disclosed are systems and software that provide a high-performance, extensible file format and web API for remote data access and a visual interface for data viewing, query, and analysis. The described system can support storage of raw spectroscopic data such as neural recording data, MSI data, metadata, and derived analyses in a single, self-describing format that may be compatible by a large range of analysis software.

Bowen, Benjamin P.↗

Data Locality Enhancement of Dynamic Simulations for Exascale Computing (Final Report)

The development of modern processors exhibits two trends that complicate the optimizations of modern software. The first is the increasing sensitivity of processors' throughput to irregularities in computation. With more processors produced through a massive integration of simple cores, future systems will increasingly favor regular data-level parallel computations, but deviate from the needs of applications with complex patterns. Some evidences are already shown on Graphic Processing Units (GPU): Irregular data accesses (e.g., indirect references A[D[i]]) and conditional branches are limiting many GPU applications' performance at a level an order of magnitude lower than the peak of GPU. The second hardware trend is the growing gap between memory bandwidth and the aggregate speed—that is, the sum of all cores' computing power—of a Chip Multiprocessor (CMP). Despite the capped growth of the peak CPU speed, the aggregate speed of a CMP keeps increasing as more cores get into a single chip. It is expected that by 2018, node concurrency in an exascale system will increase by hundreds of times, whereas, memory bandwidth will expand by only 10 to 20 times. Consequently, data movement and storage is expected to consume more than 70% of the total system power. Bridging this gap is difficult; the complexities of modern CMP memory hierarchy make it even harder: Data cache becomes shared among computing units, and the sharing is often non-uniform—whether two computing units share a cache depends on their proximity and the level of the cache. On the recent IBM Power7 architecture, for instance, four hardware contexts (or SMT threads) in a core share the entire memory hierarchy, all cores in one chip share an on-chip L3 cache, and cores across chips share L3 and main memory through off-chip connections. These two trends complicate the translation of computing power into performance, especially for a program with either intensive data accesses or complex patterns in data accesses or control flow paths. Unfortunately, both attributes present and will persist in a class of important applications. For instance, many scientific simulations deal with a large volume of data. And meanwhile, as most real-world processes are non-uniform and evolving (e.g., the evolution of a galaxy or the process of a drug injection), both the computations and data accesses of these programs tend to be irregular and dynamically changing. Currently, the lack of support to these applications on modern CMP severely limits their performance. On GPU, as our recent study shows and other studies echo, performance enhancement of a factor of integers is possible when memory accesses or control flows are streamlined for a set of GPU applications. On multicore CPU, our studies show that traditional locality enhancement, for being oblivious to the new features of multicore memory hierarchy, may even cause large slowdown to data-intensive dynamic applications. The severity of the issues is expected to worsen as the two hardware trends continue. Some recent studies try to match software with the trends, but in a limited scope or manner. For irregularities on GPU, most studies focus on irregularities analyzable through static analysis (e.g., data accesses in regular loops). Dynamic irregularities are harder to address because the needed analysis and transformations typically have to happen at run time. Some other research resorts to hardware extensions, an actual adoption of which is unclear for the entailed space cost and complexity. For data locality, recent years have seen some exploitations of the new memory hierarchy on multicore for performance, but most of them are on process or thread scheduling, rather than program transformations. Our recent study reveals that program-level transformations may magnify the scheduling benefits by a factor of seven, concluding that program-level transformation should play a central role for data locality enhancement on modern CMP. But research in this direction has been sparse, and most have focused on data layout or cache performance modeling, rather than program transformations to match with the new memory hierarchy features. Overall, it is still an open question how to bridge the gap between dynamic computations and the two prominent properties of modern processors. The goal of this project is to develop a set of techniques and software tools to enhance the matching between memory accesses in dynamic simulations and the prominent features of modern and future CMP, alleviating the memory performance issues for petascale and exascale computing. This report summarizes the discoveries and products produced throughout this project. It includes free launch, a new software approach to overcoming the shortcomings of both methods; coherence-free multiview, an approach that allows multiple views of a single data object to co-exist on GPU memory during a GPU kernel execution; algorithmic optimizations to data analytics problems, especially those that involve lots of distance calculations. Supporting dynamic parallelism is important for GPU to benefit a broad range of applications. There are currently two fundamental ways for programs to exploit dynamic parallelism on GPU: a software-based approach with software-managed worklists, and a hardware-based approach through dynamic subkernel launches. Neither is satisfactory. The former is complicated to program and is often subject to some load imbalance; the latter suffers large runtime overhead. In this work, we propose free launch, a new software approach to overcoming the shortcomings of both methods. It allows programmers to use subkernel launches to express dynamic parallelism. It employs a novel compiler-based code transformation named subkernel launch removal to replace the subkernel launches with the reuse of parent threads. Coupled with an adaptive task assignment mechanism, the transformation reassigns the tasks in the subkernels to the parent threads with a good load balance. The technique requires no hardware extensions, immediately deployable on existing GPUs. It keeps the programming convenience of the subkernel launch-based approach while avoiding its large runtime overhead. Meanwhile, its superior load balancing makes it outperform manual worklist-based techniques by 3X on average. The work was published at the 48th Annual IEEE/ACM International Symposium on Microarchitecture (Micro'2015). A Graphic Processing Unit (GPU) system is typically equipped with many types of memory (e.g., global, constant, texture, shared, cache). Data placement determines what data are placed on which type of memory, essential for GPU memory performance. Prior optimizations of data placement always require a single view of a data object on memory, which limits the optimization effectiveness. In this work, we propose coherence-free multiview, an approach that allows multiple views of a single data object to co-exist on GPU memory during a GPU kernel execution. We demonstrate that under certain conditions, the multiple views can remain incoherent while facilitating enhanced data placement. We present a theorem and some compiler support to ensure the soundness of the usage of coherence-free multiview. We further develop reference-discerning data placement, a new way to enhance data placements on GPU. It enables more flexible data placements by using coherence-free multiview to leverage the slack in coherence requirement of some GPU programs. Experiments on three types of GPU systems show that, with less than 200KB space cost, the new data placement technique can provide a 1.6X average (up to 4.27X) speedup. In addition, we have examined algorithmic optimizations to data analytics problems, especially those that involve lots of distance calculations. Computing distances among data points is an essential part of many important algorithms in data analytics, graph analysis, and other domains. In each of these domains, developers have spent significant manual effort optimizing algorithms, often through novel applications of the triangle equality, in order to minimize the number of distance computations in the algorithms. In this work, we observe that many algorithms across these domains can be generalized as an instance of a generic distance-related abstraction. Based on this abstraction, we derive seven principles for correctly applying the triangular inequality to optimize distance-related algorithms. Guided by the findings, we develop Triangular OPtimizer (TOP), the first software framework that is able to automatically produce optimized algorithms that either matches or outperforms manually designed algorithms for solving distance-related problems. TOP achieves up to 237x speedups and 2.5X on average. The work has been published at the 32nd International Conference on Machine Learning (ICML'15) and the 41st International Conference on Very Large Data Bases (VLDB'15).

42 ENGINEERING↗