Search NASA⌕ Search

SEARCH · Search NASA

Results for “software: data analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38

CMS Analysis and Data Reduction with Apache Spark

Experimental Particle Physics has been at the forefront of analyzing the world's largest datasets for decades. The HEP community was among the first to develop suitable software and computing tools for this task. In recent times, new toolkits and systems for distributed data processing, collectively called "Big Data" technologies have emerged from industry and open source projects to support the analysis of Petabyte and Exabyte datasets in industry. While the principles of data analysis in HEP have not changed (filtering and transforming experiment-specific data formats), these new technologies use different approaches and tools, promising a fresh look at analysis of very large datasets that could potentially reduce the time-to-physics with increased interactivity. Moreover these new tools are typically actively developed by large communities, often profiting of industry resources, and under open source licensing. These factors result in a boost for adoption and maturity of the tools and for the communities supporting them, at the same time helping in reducing the cost of ownership for the end-users. In this talk, we are presenting studies of using Apache Spark for end user data analysis. We are studying the HEP analysis workflow separated into two thrusts: the reduction of centrally produced experiment datasets and the end-analysis up to the publication plot. Studying the first thrust, CMS is working together with CERN openlab and Intel on the CMS Big Data Reduction Facility. The goal is to reduce 1 PB of official CMS data to 1 TB of ntuple output for analysis. We are presenting the progress of this 2-year project with first results of scaling up Spark-based HEP analysis. Studying the second thrust, we are presenting studies on using Apache Spark for a CMS Dark Matter physics search, comparing Spark's feasibility, usability and performance to the ROOT-based analysis.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Gamma-Ray Library and Uncertainty Analysis: Passively Emitted Gamma Rays Used in Safeguards Technology

Non-destructive gamma-ray analysis is a fundamental part of nuclear safeguards, including nuclear energy safeguards technology. Developing safeguards capabilities for nuclear energy will certainly benefit from the advanced use of gamma-ray spectroscopy as well as the ability to model various reactor scenarios. There is currently a wide variety of nuclear data that could be used in computer modeling and gamma-ray spectroscopy analysis. The data can be discrepant (with varying uncertainties), and it may difficult for a modeler or software developer to determine the best nuclear data set for a particular situation. To use gamma-ray spectroscopy to determine the relative isotopic composition of nuclear materials, the gamma-ray energies and the branching ratios or intensities of the gamma-rays emitted from the nuclides in the material must be well known. A variety of computer simulation codes will be used during the development of the nuclear energy safeguards, and, to compare the results of various codes, it will be essential to have all the {gamma}-ray libraries agree. Assessing our nuclear data needs allows us to create a prioritized list of desired measurements, and provides uncertainties for energies and especially for branching intensities. Of interest are actinides, fission products, and activation products, and most particularly mixtures of all of these radioactive isotopes, including mixtures of actinides and other products. Recent work includes the development of new detectors with increased energy resolution, and studies of gamma-rays and their lines used in simulation codes. Because new detectors are being developed, there is an increased need for well known nuclear data for radioactive isotopes of some elements. Safeguards technology should take advantage of all types of gamma-ray detectors, including new super cooled detectors, germanium detectors and cadmium zinc telluride detectors. Mixed isotopes, particularly mixed actinides found in nuclear reactor streams can be especially challenging to identify. The super cooled detectors have a marked improvement in energy resolution, allowing the possibility of deconvolution of mixtures of gamma rays that was unavailable with high purity germanium detectors. Isotopic analysis codes require libraries of gamma rays. In certain situations, isotope identification can be made in the field, sometimes with a short turnaround time, depending on the choice of detector and software analysis package. Sodium iodide and high purity germanium detectors have been successfully used in field scenarios. The newer super cooled detectors offer dramatically increased resolution, but they have lower efficiency and so can require longer collection times. The different peak shapes require software development for the specific detector type and field application. Libraries can be tailored to specific scenarios; by eliminating isotopes that are certainly not present, the analysis time may be shortened and the accuracy may be increased. The intent of this project was to create one accurate library of gamma rays emitted from isotopes of interest to be used as a reliable reference in safeguards work. All simulation and spectroscopy analysis codes can draw upon this best library to improve accuracy and cross-code consistency. Modeling codes may include MCNP and COG. Gamma-ray spectroscopy analysis codes may include MGA, MGAU, U235 and FRAM. The intent is to give developers and users the tools to use in nuclear energy safeguards work. In this project, the library created was limited to a selection of actinide isotopes of immediate interest to reactor technology. These isotopes included {sup 234-238}U, {sup 237}Np, {sup 238-242}Pu, {sup 241,243}Am and {sup 244}Cm. These isotopes were examined, and the best of gamma-ray data, including line energies and relative strengths were selected.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

Soft x-ray scattering facility at the Advanced Light Source with real-time data processing and analysis

We present the development and characterization of a dedicated resonant soft x-ray scattering facility. Capable of operation over a wide energy range, the beamline and endstation are primarily used for scattering from soft matter systems around the carbon K-edge ({approx}285 eV). We describe the specialized design of the instrument and characteristics of the beamline. Operational characteristics of immediate interest to users such as polarization control, degree of higher harmonic spectral contamination, and detector noise are delineated. Of special interest is the development of a higher harmonic rejection system that improves the spectral purity of the x-ray beam. Special software and a user-friendly interface have been implemented to allow real-time data processing and preliminary data analysis simultaneous with data acquisition.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Particle learning for probabilistic deterministic finite automata

The plpdfa software is a product of an LDRD project at LLNL entitked "Adaptive Sampling for Very High Throughput Data Streams" (tracking number 11-ERD-035). This software was developed by a graduate student summer intern, Chris Challis, who worked under project PI Dan Merl furing the summer of 2011. The software the source code is implementing is a statistical analysis technique for clustering and classification of text-valued data. The method had been previously published by the PI in the open literature.

Source record↗

Particle learning for probabilistic deterministic finite automata

The plpdfa software is a product of an LDRD project at LLNL entitked "Adaptive Sampling for Very High Throughput Data Streams" (tracking number 11-ERD-035). This software was developed by a graduate student summer intern, Chris Challis, who worked under project PI Dan Merl furing the summer of 2011. The software the source code is implementing is a statistical analysis technique for clustering and classification of text-valued data. The method had been previously published by the PI in the open literature.

Source record↗

Automated segmentation and analysis of point clouds of pier foundations using Pier Inspection and Evaluation Report (PIER)

Pier foundations are commonly used in locations with unstable soil or where other types of foundations are unsuitable or cost prohibitive. A pier foundation consists of vertical columns to support the structure and elevate it above the ground. Common materials for pier foundations include masonry, concrete, timber, and steel. The methods for accurate placement of pier foundations have remained relatively unchanged for decades. For simple installations, construction chalk lines are used to layout the locations of piers to ensure accurate placement and elevation. For more complex installations, surveying instruments operated by trained professionals are employed to accurately locate piers and assess correct elevation before construction. After installation, another survey may need to be performed to assess the quality of the as-built foundation. However, with the advent of terrestrial laser scanners (TLS), the means now exist for contractors to conduct their own assessments of as-built foundations. The major barrier preventing contractors from performing their own assessments of as-built foundation quality is the segmentation and analysis of point cloud data, a skill that often requires a trained user. The objective of this research is to develop a software tool (PIER: Pier Inspection and Evaluation Report) to enable automated segmentation and analysis of point clouds of pier foundations. In this paper, the automated segmentation and analysis algorithms are detailed. A mockup lay out of pier foundations was built using concrete masonry units, and the algorithms were tested to evaluate performance. Limitations of the current algorithms and future research direction are discussed.

Turki, Amine [ORNL]↗

Data Intensive Architecture for Scalable Cyber Analytics

Cyber analysts are tasked with the identification and mitigation of network exploits and threats. These compromises are difficult to identify due to the characteristics of cyber communication, the volume of traffic, and the duration of possible attack. In this paper, we describe a prototype implementation designed to provide cyber analysts an environment where they can interactively explore a month’s worth of cyber security data. This prototype utilized On-Line Analytical Processing (OLAP) techniques to present a data cube to the analysts. The cube provides a summary of the data, allowing trends to be easily identified as well as the ability to easily pull up the original records comprising an event of interest. The cube was built using SQL Server Analysis Services (SSAS), with the interface to the cube provided by Tableau. This software infrastructure was supported by a novel hardware architecture comprising a Netezza TwinFin® for the underlying data warehouse and a cube server with a FusionIO drive hosting the data cube. We evaluated this environment on a month’s worth of artificial, but realistic, data using multiple queries provided by our cyber analysts. As our results indicate, OLAP technology has progressed to the point where it is in a unique position to provide novel insights to cyber analysts, as long as it is supported by an appropriate data intensive architecture.

Olsen, Bryan K.↗

FRMAC Laboratory Analysis RadResponder Gap Analysis and Web Portal Enhancements

The Federal Radiological Monitoring and Assessment Center (FRMAC) relies on accurate and defensible analytical laboratory data to support its mission. FRMAC Laboratory Analysis personnel are responsible for (1) receiving samples, (2) managing samples, and (3) providing data quality assurance. Currently, the RadResponder software application does not meet all these needs. With some modifications, RadResponder could meet the needs for sample receiving functions, but it does not meet the needs of sample management and data quality assurance functions. The FRMAC Laboratory Analysis team has discussed and reviewed the following options moving forward: Option 1: Make minor revisions to RadResponder to improve sample receiving capability, purchase and configure a commercial laboratory information management system (LIMS) to perform sample management and data quality assurance, and build an interface between RadResponder and the commercial-off-the-shelf LIMS. Option 2: Make major revisions to RadResponder for all FRMAC Laboratory Analysis functions to support required sample management and data quality assurance activities. Option 3: Create a custom-built LIMS system to interface with RadResponder. Note: All three options will require the development of a Laboratory Analysis web portal and will require funding for ongoing maintenance and training. The FRMAC Laboratory Analysis team highly recommends Option 1 as the best and most efficient path forward. Commercial-off-the-shelf LIMS products have been proven successful in the laboratory community for decades. Option 1 leverages these proven technologies and takes advantage of RadResponder's current strengths.

61 RADIATION PROTECTION AND DOSIMETRY↗

Radiometric characterization process for locating radioactivity hold-up and measuring non-uniformly distributed sources - 15342

A novel approach to facility radiometric characterization for non-uniformly distributed radiation sources has been developed by ANTECH and is currently being employed at the Argonne National Laboratory. It is being applied to the measurement of a wide range of objects and the interiors and contents of laboratories and buildings. The integrated non destructive assay measurement process involves the use of a scanning spectroscopic gamma ray camera as well as high purity Germanium detectors with different collimators and hence differing detector fields of view to measure and quantify non-uniformly distributed sources of radioactivity in laboratory equipment, glove boxes, storage tanks, pipework and general laboratory objects and process components. The purpose of the radiometric characterization is to quantify radiation sources and radioactive contamination levels in facilities containing nuclear material and to ensure compliance with facility characterization requirements and for decontamination and decommissioning planning and execution. The integrated measurement process also involves automated data capture and processing software and a database with which both measurement instrument operators and subject matter expert analysts can interact. An appropriate measuring instrument (gamma camera, scintillation detector, high purity Germanium detector system, neutron detector or alpha-beta counter) records the measurement data and the measurement site is recorded in a photograph. All of the data relevant to the measurement (or set of measurements for a particular object) are recorded in the database including measured gamma ray spectra, equipment description and relevant calibration, measurement site photograph and measurement descriptive data. Once data analysis protocols are established for specific geometries and measurement situations they can be applied to the measured data in a partially automated manner, reducing analysis and transcription errors. In addition to measurements and data analysis the process also utilises radiometric modelling computer codes including MicroShield and Monte Carlo Neutrons Photons in order to perform model calculations where appropriate. In a typical measurement, the ANTECH RadSearch spectroscopic gamma camera is utilized to find areas of concentrated activity so that these areas can be measured and calculated separately from areas with diffuse contamination. The use of the gamma camera in scanning mode helps to ensure that the assay does not overestimate the detected radiation source, which is a frequent consequence of using standard far field geometry and attenuation analysis codes that assume uniformity of both density and radioactive source distribution. Once the hot spots are identified, high purity Germanium detector measurements are made using various collimators with wide or narrow fields of view as required. These measurements are then processed through a semi-automatic calculation process assuming an appropriate source configuration as identified by RadSearch. These source configurations include point sources, line sources or surface sources. The Generalized Geometry Hold-up algorithms are employed to determine an estimate of the activity of the various sources that are identified in a measurement. The ANTECH integrated measurement process provides an automated calculation procedure where the analyst can select the source type, geometry and appropriate input data, and then the software calculates the activity by radionuclide for all sources identified in the measurement. The measurement and analysis process is controlled under the ANTECH ISO9001: 2008 Quality Assurance System and managed by a site specific Quality Assurance Plan. Both Argonne National Laboratory and Department of Energy technical reviewers have vetted the Integrated Measurement and Analysis Process. The application of the measurement and analysis process is described and measurement examples are provided. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

GlyQ-IQ: Glycomics Quintavariate-Informed Quantification with High-Performance Computing and GlycoGrid 4D Visualization

Dense LC-MS datasets have convoluted extracted ion chromatograms with multiple chromatographic peaks that cloud the differentiation between intact compounds with their overlapping isotopic distributions, peaks due to insource ion fragmentation, and noise. Making this differentiation is critical in glycomics datasets because chromatographic peaks correspond to different intact glycan structural isomers. The GlyQ-IQ software is targeted chromatography centric software designed for chromatogram and mass spectra data processing and subsequent glycan composition annotation. The targeted analysis approach offers several key advantages to LC-MS data processing and annotation over traditional algorithms. A priori information about the individual target’s elemental composition allows for exact isotope profile modeling for improved feature detection and increased sensitivity by focusing chromatogram generation and peak fitting on the isotopic species in the distribution having the highest intensity and data quality. Glycan target annotation is corroborated by glycan family relationships and in source fragmentation detection. The GlyQ-IQ software is developed in this work (Part 1) and was used to profile N-glycan compositions from human serum LC-MS Datasets. The companion manuscript GlyQ-IQ Part 2 discusses developments in human serum N-glycan sample preparation, glycan isomer separation, and glycan electrospray ionization. A case study is presented to demonstrate how GlyQ-IQ identifies and removes confounding chromatographic peaks from high mannose glycan isomers from human blood serum. In addition, GlyQ-IQ was used to generate a broad N-glycan profile from a high resolution (100K/60K) nESI-LS-MS/MS dataset including CID and HCD fragmentation acquired on a Velos Pro Mass spectrometer. 101 glycan compositions and 353 isomer peaks were detected from a single sample. 99% of the GlyQ-IQ glycan-feature assignments passed manual validation and are backed with high resolution mass spectra and mass accuracies less than 7 ppm.

Environmental Molecular Sciences Laboratory↗

Cross-Cutting Software Solutions in Support of Experimental Analysis Challenges at National Scattering Facilities

Rapid improvements in instrumentation at neutron and light source combined with new capabilities in computing, data analytics, and machine learning offer unprecedented scientific capabilities to address fundamental and applied science questions in a wide area of subjects from quantum materials to biological systems. In order to make these capabilities accessible to the broader scientific community, significant developments are needed related to workflow spanning from experimental control to advanced materials simulations as well as the underpinning scientific software. In this chapter, we explore these needs and recent developments at the Spallation Neutron Source (SNS) at Oak Ridge National Laboratory. A central part of the workflow at the SNS is the data reduction framework Mantid which is developed as a partnership between European and US neutron-scattering facilities.

Proffen, Thomas↗

ParaText : scalable text analysis and visualization.

Automated analysis of unstructured text documents (e.g., web pages, newswire articles, research publications, business reports) is a key capability for solving important problems in areas including decision making, risk assessment, social network analysis, intelligence analysis, scholarly research and others. However, as data sizes continue to grow in these areas, scalable processing, modeling, and semantic analysis of text collections becomes essential. In this paper, we present the ParaText text analysis engine, a distributed memory software framework for processing, modeling, and analyzing collections of unstructured text documents. Results on several document collections using hundreds of processors are presented to illustrate the exibility, extensibility, and scalability of the the entire process of text modeling from raw data ingestion to application analysis.

99 GENERAL AND MISCELLANEOUS↗

Gearbox Reliability Collaborative Phase 3 Gearbox 2 Test

The National Renewable Energy Laboratory (NREL) Gearbox Reliability Collaborative (GRC) was established by the U.S. Department of Energy in 2006; its key goal is to understand the root causes of premature gearbox failures and improve their reliability. The GRC uses a combined gearbox testing, modeling, and analysis approach disseminating data and results to the industry and facilitating improvement of gearbox reliability. This test data describes the tests of GRC gearbox 2 in the National Wind Technology Center dynamometer and documents any modifications to the original test plan. It serves as a guide to interpret the publicly released data sets with brief analyses to illustrate the data. TDMS viewer and Solidworks software required to view data files.

17 WIND ENERGY↗

srlife : A software tool for estimating the life of high temperature concentrating solar receivers. Part II – Ceramic receivers

As Concentrating Solar Power (CSP) technologies aim for higher operating temperatures to enhance efficiency and meet industrial process heat demands, high-temperature metallic materials, including nickel-based superalloys, face challenges in maintaining structural integrity. Advanced ceramics offer a promising alternative due to their superior high-temperature strength. However, accurately assessing the performance of ceramic components requires a fundamentally different approach from that used for metallic components. This Part II of a two-part paper describes the integration of ceramic statistical failure models within srlife – an open-source tool for predicting the life of high-temperature CSP receivers. These models account for the inherent variability in ceramic strength, as well as the effects of subcritical crack growth (SCG) under high temperature cyclic loads. Here, the paper includes an example problem that demonstrate the process of evaluating ceramic receivers using srlife. Part I details the life estimation process for metallic receivers (i.e. creep-fatigue life) along with input and output data structure, thermohydraulic analysis, and structural analysis. The complete tool is available as open-source software at https://github.com/srlife-project/srlife and can be installed via the PyPi package manager (https://pypi.org). By supporting both ceramic and metallic receiver analyses, srlife facilitates fair comparisons between competing metallic and ceramic designs, enabling accurate evaluations of plant efficiency and the economic benefits of ceramic solar receivers and other components.

High temperature ceramic receivers↗

Community Organizations: Changing the Culture in Which Research Software Is Developed and Sustained

Software is the key crosscutting technology that enables advances in mathematics, computer science, and domain-specific science and engineering to achieve robust simulations and analysis for science, engineering, and other research fields. However, software itself has not traditionally received focused attention from research communities; rather, software has evolved organically and inconsistently, with its development largely as by-products of other initiatives. Moreover, challenges in scientific software are expanding due to disruptive changes in computer hardware, increasing scale and complexity of data, and demands for more complex simulations involving multiphysics, multiscale modeling and outer-loop analysis. In recent years, community members have established a range of grass-roots organizations and projects to address these growing technical and social challenges in software productivity, quality, reproducibility, and sustainability. This article provides an overview of such groups and discusses opportunities to leverage their synergistic activities while nurturing work toward emerging software ecosystems.

97 MATHEMATICS AND COMPUTING↗

Performance Debugging and Tuning of Flash-X with Data Analysis Tools

State-of-the-art multiphysics simulations running on large scale leadership computing platforms have many variables contributing to their performance and scaling behavior. We recently encountered an interesting performance anomaly in Flash-X, a multiphysics multicomponent simulation software, when characterizing its performance behavior on several large-scale HPC platforms. The anomaly was tracked down to the interaction between the use of dynamic allocation of scratch data and data locality in the cache hierarchy. In this paper we present the details of unexpected performance variability of Flash-X, its extensive analysis using the performance measurement tool TAU to collect the data and Python data analysis libraries to explore the data, and our insights from this experience. In this process, we discovered and removed or mitigated two additional performance limiting bottlenecks for performance tuning.

Huck, Kevin↗

SU-E-T-105: Development of 3D Dose Verification System for Volumetric Modulated Arc Therapy Using Improved Polyacrylamide-Based Gel Dosimeter

Purpose: The aim of this dosimetric study was to develop 3D dose verification system for volumetric modulated arc therapy (VMAT) using polyacrylamide-based gel (PAGAT) dosimeter improved the sensitivity by magnesium chloride (MgCl{sub 2}). Methods: PAGAT gel containing MgCl{sub 2} as a sensitizer was prepared in this study. Methacrylic-acid-based gel (MAGAT) was also prepared to compare the dosimetric characteristics with PAGAT gel. The cylindrical glass vials (4 cm diameter, 12 cm length) filled with each polymer gel were irradiated with 6 MV photon beam using Novalis Tx linear accelerator (Varian/BrainLAB). The irradiated polymer gel dosimeters were scanned with Signa 1.5 T MRI system (GE), and dose calibration curves were obtained using T{sub 2} relaxation rate (R{sub 2} = 1/T{sub 2}). Dose rate (100-600 MU min{sup −1}) and fractionation (1-8 fractions) were varied. In addition, a cubic acrylic phantom (10 × 10 × 10 cm{sup 3}) filled with improved PAGAT gel inserted into the IMRT phantom (IBA) was irradiated with VMAT (RapidArc). C-shape structure was used for the VMAT planning by the Varian Eclipse treatment planning system (TPS). The dose comparison of TPS and measurements with the polymer gel dosimeter was accomplished by the gamma index analysis, overlaying the dose profiles for a set of data on selected planes using in-house developed software. Results: Dose rate and fractionation dependence of improved PAGAT gel were smaller than MAGAT gel. A high similarity was found by overlaying the dose profiles measured with improved PAGAT gel dosimeter and the TPS dose, and the mean pass rate of the gamma index analysis using 3%/3 mm criteria was achieved 90% on orthogonal planes for VMAT using improved PAGAT gel dosimeter. Conclusion: In-house developed 3D dose verification system using improved polyacrylamide-based gel dosimeter had a potential as an effective tool for VMAT QA.

60 APPLIED LIFE SCIENCES↗

Involving the new generations in Fermilab endeavors

Since 1984 the Italian groups of the Istituto Nazionale di Fisica Nucleare (INFN) and Italian Universities, collaborating with the DOE laboratory of Fermilab (US) have been running a two-month summer training program for Italian university students. While in the first year the program involved only four physics students of the University of Pisa, in the following years it was extended to engineering students. This extension was very successful and the engineering students have been since then extremely well accepted by the Fermilab Technical, Accelerator, and Scientific Computing Division groups. Over the many years of its existence, this program has proven to be the most effective way to engage new students in Fermilab endeavors. Many students have extended their collaboration with Fermilab with their Master’s Thesis and PhD. Since 2004 the program has been supported in part by DOE in the frame of an exchange agreement with INFN. Over its almost 40 years of history, the program has grown in scope and size and has involved more than 550 Italian students from more than 20 Italian Universities, Several Institutes of Research, including ASI and INAF in Italy, and the ISSNAF Foundation in the US, have provided additional financial support. Since the program does not exclude appropriately selected non-Italian students, a handful of students from European and non-European Universities were also accepted over the years. Each intern is supervised by a Fermilab Mentor responsible for performing the training program. Training programs spanned from Tevatron, CMS, Muon (g-2), Mu2e, and Short Baseline Neutrino Experiments and DUNE design and experimental data analysis, development of particle detectors (silicon trackers, calorimeters, drift chambers, neutrino and dark matter detectors), design of electronic and accelerator components, development of infrastructures and software for exascale data handling, research on superconductive elements and on accelerating cavities, and theory of particle accelerators. Since 2010, within an extended program supported by the Italian Space Agency and the Italian National Institute of Astrophysics, a total of 30 students in physics, astrophysics, and engineering have been hosted for two months in the summer at US space science Research Institutes and laboratories. In 2015 the University of Pisa included these programs within its educational programs. Accordingly, Summer School students are enrolled at the University of Pisa for the duration of the internship and are identified and ensured as such. At the end of the internship, the students are required to write summary reports on their achievements. After positive evaluation by a University Examining Board, interns are acknowledged credits for their Diploma Supplement. The program was canceled in 2020 and 2021 due to the pandemic but restarted successfully in 2022. We believe this program can be taken as a model and easily adopted by interested institutions.

99 GENERAL AND MISCELLANEOUS↗