Leveraging Cluster Computing for Large-Scale Data Processing and Automated Analysis for Radiation Portal Monitor Data
Explore the source record for details and available documents.
Smith, Jacob↗
SEARCH · Search NASA
Results for “process data”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Validation of Modern Nuclear Data Processing in SCALE
The nuclear data (ND) community is continuously developing more accurate, diversified, and comprehensive data for radiation transport modeling to support the nuclear science community. As these community efforts progress, it is crucial that ND processing tools like AMPX (used for SCALE [1] ND) also be developed in parallel to incorporate these new data into transport codes and actually deliver those data to end users. AMPX is a mature, well-tested code that was developed by many people at Oak Ridge National Laboratory (ORNL) over the course of the past few decades. A large portion of the AMPX codebase, however, was outdated, difficult to maintain, and incompatible with modern code development tools. Some of the most important parts of the AMPX code have now been replaced with modern C++ code that can be maintained more cost-effectively and can be tested more rigorously.
AMPX↗
A real-time optical data processing device
The design, operation, and structure of the hybrid field effect light valve, a real-time input device for application to coherent optical data processing (CODP), is described. The device consists of a sandwich of thin films that electrically control the optical birefringence of a thin (2 micrometer) liquid crystal layer. It has high resolution (greater than 100 1/mm), contrast ratio (greater than 100:1), speed (10 sec on, 15 sec off) and input sensitivity (about 0.3 ergs/sq cm) in addition to cost and size advantages. Performance data for a laboratory model are presented.
Jacobson, A.↗
MANIPULATE-2020: An Interface Tool for Nuclear Data Processing
This report provides basic background data on the Manipulate-2020 code. This code is used for processing and "manipulation" of nuclear data in support of radiation metrology applications. The code is made available on the open GitHub repository and is available to the general nuclear data community.
73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
Preliminary concept for lunar exploration tracking and data acquisition and data processing systems
The NASA Office of Exploration is evaluating potential scenarios for an ambitious and complex mission to the moon. This paper sumarizes the initial system engineering analyses being performed to identify the communications, data processing, and navigational support required by these case studies. A feasible option for providing tracking and data acquisition using technology available in the 1990s is described.
Hei, Donald, Jr.↗
Fast Data Processing for Hyperspectral Sensors on Small Platforms
Hyperspectral imaging is a very promising technology for nuclear proliferation detection. However, due to size and weight restrictions, small hyperspectral platforms such as satellites and small drones lack the on-board computing resources for accurate, real-time analysis of the enormous flow of data that a continuously operating hyperspectral sensor generates. This severely limits satellite systems, which can collect far more data than what they can telemeter, and hinders the ability of all platforms to adapt their missions on the fly in response to observations. This program addresses the hyperspectral data processing challenge through development of new, fast and accurate algorithms that produce data products in real time. The algorithms circumvent the major computational bottlenecks in existing processing streams, and would be incorporated in lightweight, power-efficient single-board computer systems. The toolkit of fast algorithms will be immediately useful in current and future hyperspectral systems being built by the Government and by private industry, including drone-based systems and satellite constellations that acquire timely global imagery.
45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
Telemetry data processing for the eccentric orbiting geophysical observatory satellite.
Data telemetering to Earth from EGO describing PCM system and special processor for magnetometer data
EGO↗
Data processing in infrared astronomy
Infrared astronomy is often carried out with rocket probes or orbiting satellite telescopes in order to escape the effects of atmospheric absorption. The data returned from such missions is a highly abstracted digital representation of measurements made by analog detectors. The ability to extract infrared-emission information from these data streams depends on a thorough understanding of the information flow from the telescope aperture to the computer center. This paper reviews the primary elements of this end-to-end concept and the impact of each of these elements on the data processing algorithms, including the division between onboard and ground processing for scientific measurements.
Pelzmann, R. F., Jr.↗
The applications of silicon liquid crystal light valves to optical data processing: A review
The applications of the photo-activated, the CCD-addressed, and the variable-grating mode liquid crystal light valves (LCLVs) to optical data processing are described. These applications include image correlation, level slicing, spectral analysis and correlation, bi-spectral image division, and matrix-matrix multiplication.
Efron, U.↗
A Data Processing Pipeline To Extract A Knowledge Graph From Heterogeneous Data For Socio-technical Analysis Of Critical Infrastructure Influence
The code is written in Python and consists of the following pipeline that is implemented in Apache Airflow. This pipeline intends to understand the companies that are directly or indirectly involved with a type of critical infrastructure system at some point in that system's lifecycle. The pipeline takes a configuration file that specifies a list of initial companies to consider, a geographic region of interest, and a set of SEC form types as well as other data sources (e.g. CrunchBase) from which to extract entities and relations. There are four main components to this pipeline as currently implemented: Entity Extraction, Network Construction, Analysis, and Visualization. First, Entity Extraction, is implemented as the `topear-extract_organizations` Apache Airflow workflow. Given an initial query that specifies a geographic region of interest and a time interval, the software will extract CI facilities of interest and organizations that have a direct influence relationship to those facilities (e.g. ownership). During the course of the LDRD, we focused on Electric Vehicle charging stations and this information is available via the Department of Energy (DOE) database on fueling stations maintained by NREL. Within the context of the DOE CESER project, we have focused on Battery Energy Storage Systems (BESS). Second, the Network Extraction component will iteratively construct a social network graph given the set of organizations and people extracted in the previous step. Organizations (and eventually People if desired) are then fed as a query to the `topgear-construct_social_network` Apache Airflow workflow which given a set of initial companies and data sets (e.g. SEC EDGAR form types, OpenCorporates, Crunchbase). This Airflow workflow will iteratively query such data sources to discover relationships with new organizations and people. For example, this module can iteratively query SEC EDGAR for metadata that documents the number of each type of form for the given set of companies and their location. This forms metadata represents a catalog of data sources from SEC EDGAR for the extracted social network knowledge graph. The pipeline then downloads these forms from the website and saves them in a build directory for further processing. These documents are then parsed for entities and relations. Again, we note that in additional to SEC data sources, this step can also pull in information on organizations via API services such as CrunchBase and OpenCorporates or bulk data sources. At the end of this step, the resultant social network, the Critical Infrastructure network, and the edges that encode relationships between organizations and CI facilities, form the Adversarial Socio-Technical Network (ASTN) that informs the analysis. Third, the Analysis component processes these generated ASTN. Previously, that has included the ability to compare prevalence of different vendors for a given infrastructure component type across different regions as well as identify common public and private investors across those vendors. This was demonstrated for EV Charging Stations across several different metropolitan areas within an IEEE PES GridEdge publication. More recently, we have looked at ways to identify infrastructure owners and operators of BESS with the most nameplate capacity across different states as well as other indictors of risk resulting from changes in ownership over time. Finally, the Visualization component consists of an HTML/CSS/JS framework by which users can interact geospatial, operational, and organizational relationships across a given portfolio of Critical Infrastructure facilities. The objective is to provide a library of UI/UX modules that can be repurposed for stakeholder-specific dashboards. All of the modules are related via a common event model that enables UI actions in one view to percolate across the other views.
Weaver, Gabriel [Idaho National Laboratory (INL), ↗
Integrated package of electron cyclotron emission imaging data processing and forward modeling in OMFIT
An Electron Cyclotron Emission Imaging (ECEI) data analysis module has been developed for the OMFIT platform to accommodate the needs of users at the DIII-D tokamak for physics applications. The user can easily access the ECEI spatial observation windows in the plasma that are calculated based on the automatically retrieved hardware setup and available DIII-D equilibria, perform spectral analysis, and make 2D electron temperature fluctuation images. The module provides a powerful data post processing package for extracting important physics parameters from the 2D measurements, including the radial structure and poloidal mode number of Alfven Eigenmodes, as well as the frequency-vs-wavenumber dispersion relationship of broadband MHD. Lastly, the module propagates characterized synthetic fluctuations for the user, so one can perform forward modeling tasks with simple analytical fluctuations.
70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
Instrumentation and data processing for AFTI/F-16 flight testing
The primary objective of the advanced fighter technology integration/F-16 (AFTI/F-16) development program is to demonstrate advanced fighter technologies to improve weapon delivery and aircraft survivability. Instrumentation and data processing for monitoring aircraft operation during flight testing is necessary not only for safety-of-flight considerations but also for rapid evaluation of flight test results. The complexity of the AFTI/F-16 aircraft necessitates an extensive capability to accomplish data goals; this paper describes that capability and the resultant product.
Harney, P.↗
Global Geographic Database in Support of EOS MISR Data Processing
This paper will describe the production of the Ancillary Geographic Product (AGP) in support of the Earth Observing System (EOS) Multi-angle Imaging SpectroRadiometer (MISR) instrument data processing. The AGP is essentially a global database of geographic properties, tailored to the needs of the MISR mission.
ancillary geographic product earth observing syste↗
Intelligent Experiments Through Real-time AI: Fast Data Processing and Autonomous Detector Control for sPHENIX and Future EIC Detectors (Final Report)
The overall vision of this project was to integrate real-time artificial intelligence (AI) directly into the data acquisition and detector-control systems of nuclear physics experiments, including both fast online event selection and an autonomous detector-control feedback loop. The work carried out under the award focused on the fast online event-selection half of that vision: the efficient recording of low-momentum heavy-flavor (HF) hadron decays in proton-proton collisions at the sPHENIX experiment at the Relativistic Heavy Ion Collider (RHIC)—an observable that requires fast tracking and topological trigger selection not previously demonstrated at RHIC, and that is essential for QCD studies at future facilities such as the Electron-Ion Collider (EIC). The autonomous detector-control (GPU-based feedback) component named in the project title remained a design concept and was not implemented under this award. The Massachusetts Institute of Technology (MIT) group led the offline simulation and data processing needed to train the machine-learning (ML) models, the translation of trained models to Field-Programmable Gate Array (FPGA) firmware using the hls4ml framework, and the physics validation of heavy-flavor reconstruction. Over the award period, the team developed and hardware-tested the principal components of an AI-based heavy-flavor trigger on simulated and recorded sPHENIX tracker data: a software Bipartite Graph Attention Network (BiGAT) trigger model reaching > 95% signal efficiency at 99% background rejection; an FPGA-native hit clusterizer matching the offline clustering; smaller networks synthesized to FPGA within the required sub-10 µs latency; and an assembled decoder–clusterizer–inference firmware chain exercised on the FELIX readout board. A complete, fully integrated hardware demonstrator was not finished within the award period. This report documents the project goals, the MIT group’s contributions, the technical accomplishments, and the outlook toward applications at the future EIC ePIC detector.
73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DEEP CELLULAR RECURRENT NEURAL ARCHITECTURE FOR EFFICIENT MULTIDIMENSIONAL TIME-SERIES DATA PROCESSING
Efficient processing of time series data is a fundamental yet challenging problem in pattern recognition. Though recent developments in machine learning and deep learning have enabled remarkable improvements in processing large scale datasets in many application domains, most are designed and regulated to handle inputs that are static in time. Many real-world data, such as in biomedical, surveillance and security, financial, manufacturing and engineering applications, are rarely static in time, and demand models able to recognize patterns in both space and time. Current machine learning (ML) and deep learning (DL) models adapted for time series processing tend to grow in complexity and size to accommodate the additional dimensionality of time. Specifically, the biologically inspired learning based models known as artificial neural networks that have shown extraordinary success in pattern recognition, tend to grow prohibitively large and cumbersome in the presence of large scale multi-dimensional time series biomedical data such as EEG. Consequently, this work aims to develop representative ML and DL models for robust and efficient large scale time series processing. First, we design a novel ML pipeline with efficient feature engineering to process a large scale multi-channel scalp EEG dataset for automated detection of epileptic seizures. With the use of a sophisticated yet computationally efficient time-frequency analysis technique known as harmonic wavelet packet transform and an efficient self-similarity computation based on fractal dimension, we achieve state-of-the-art performance for automated seizure detection in EEG data. Subsequently, we investigate the development of a novel efficient deep recurrent learning model for large scale time series processing. For this, we first study the functionality and training of a biologically inspired neural network architecture known as cellular simultaneous recurrent neural network (CSRN). We obtain a generalization of this network for multiple topological image processing tasks and investigate the learning efficacy of the complex cellular architecture using several state-of-the?art training methods. Finally, we develop a novel deep cellular recurrent neural network (CDRNN) architecture based on the biologically inspired distributed processing used in CSRN for processing time series data. The proposed DCRNN leverages the cellular recurrent architecture to promote extensive weight sharing and efficient, individualized, synchronous processing of multi-source time series data. Experiments on a large scale multi-channel scalp EEG, and a machine fault detection dataset show that the proposed DCRNN offers state-of-the-art recognition performance while using substantially fewer trainable recurrent units.
Vidyaratne, Lasitha S.↗
Independent Orbiter Assessment (IOA): Assessment of the data processing system FMEA/CIL
The results of the Independent Orbiter Assessment (IOA) of the Failure Modes and Effects Analysis (FMEA) and Critical Items List (CIL) are presented. The IOA effort first completed an analysis of the Data Processing System (DPS) hardware, generating draft failure modes and potential critical items. To preserve independence, this analysis was accomplished without reliance upon the results contained within the NASA FMEA/CIL documentation. The IOA results were then compared to the NASA FMEA/CIL baseline with proposed Post 51-L updates included. A resolution of each discrepancy from the comparison is provided through additional analysis as required. The results of that comparison is documented for the Orbiter DPS hardware.
Lowery, H. J.↗
LaRC SmartLab Apps For Instrument Control and Data Processing: Laboratory Environment Monitor
The LaRC SmartLab applications are a series of software tools to greatly enhance researcher efficiency by streamlining and automating workflows. Python scripts and applications are increasingly being used in scientific workflows, including for instrument control and data processing. Interactive Python scripting environments such as JupyterLab provide powerful tools for using Python. In some use cases, the development of standalone applications with dedicated graphical user interfaces can enhance the utility of the code and open it up to more users, including non-programmers. Here, we describe a Python based application for communicating with, and displaying data from, iTHX Temperature, Humidity, and Dew Point probes. We discuss the set up and use of the application as well as its implementation. We also highlight the use of Simulated probes to enable users and developers to familiarize with or debug the application, even when they do not have access to the physical hardware in the laboratory.
LaRC SmartLab↗
Data processing for astronomy missions.
The functions which must be performed to ensure the effective and efficient use of a space astronomical observatory may be separated into three major categories, including mission planning and analysis, mission operations, and data utilization. Each of these functions can be further subdivided. The most suitable locations for conducting the data processing operations in each case must be determined on the basis of criteria which take into account economical and operational factors. An advanced operational concept for an astronomical observatory is discussed.
Ludwig, G. H.↗