Search NASA⌕ Search

SEARCH · Search NASA

Results for “process data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Arrangements for communicating and processing data in a computing system

Systems and methods for reducing data movement in a computer system. The systems and methods use information or knowledge about the structure of an algorithm, operations to be executed at a receiving processing unit, variables or subsets or groups of variables in a distributed algorithm, or other forms of contextual information, for reducing the number of bits transmitted from at least one transmitting processing unit to at least one receiving processing unit or storage device.

Gonzalez, Juan Guillermo↗
DOE OSTI2022

GUC CSU X-Band Precipitation Radar Plan Position Indicator data processed with Corrected Moments in Antenna Coordinates

For the Surface Atmosphere Integrated Field Laboratory (SAIL) campaign, Corrected Moments in Antenna Coordinates (CMAC) is a set of algorithms and code that does corrections to CSU X-Precipitation Radar PPI data. Additionally, CMAC adds calculations of derived snowfall rates to the original data in order to provide precipitation estimates for the campaign.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Initial operation and data processing on a system for real-time evaluation of Thomson scattering signals on the Large Helical Device

A scalable system for real-time analysis of electron temperature and density based on signals from the Thomson scattering diagnostic, initially developed for and installed on the NSTX-U experiment, was recently adapted for the Large Helical Device and operated for the first time during plasma discharges. During its initial operation run, it routinely recorded and processed signals for four spatial points at the laser repetition rate of 30 Hz, well within the system’s rated capability for 60 Hz. We present examples of data collected from this initial run and describe subsequent adaptations to the analysis code to improve the fidelity of the temperature calculations.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Initial operation and data processing on a system for real-time evaluation of Thomson scattering signals on the Large Helical Device

A scalable system for real-time analysis of electron temperature and density based on signals from the Thomson scattering diagnostic, initially developed for and installed on the NSTX-U experiment, was recently adapted for the Large Helical Device (LHD) and operated for the first time during plasma discharges. During its initial operation run, it routinely recorded and processed signals for four spatial points at the laser repetition rate of 30 Hz, well within the system's rated capability for 60 Hz. We present examples of data collected from this initial run and describe subsequent adaptations to the analysis code to improve the fidelity of the temperature calculations.

Thomson scattering, real-time, LHD, plasma diagnos↗
NASA NTRS1984

Summary of shuttle data processing and aerodynamic performance comparisons for the first 11 flights

NASA Space Shuttle aerodynamic and aerothermodynamic research is but one part of the most comprehensive end-to-end flight test program ever undertaken considering: the extensive pre-flight experimental data base development; the multitude of spacecraft and remote measurements taken during entry flight; the complexity of the Orbiter aerodynamic configuration; the variety of flight conditions available across the entire speed regime; and the efforts devoted to flight data reduction throughout the aerospace community. Shuttle entry flights provide a wealth of research quality data, in essence a veritable flying wind tunnel, for use by researchers to verify and improve the operational capability of the Orbiter and provide data for evaluations of experimental facilities as well as computational methods. This final report merely summarizes the major activities conducted by the AMA, Inc. under NASA Contract NAS1-16087 as part of that interesting research. Investigators desiring more detailed information can refer to the glossary of AMA publications attached herein as Appendix A. Section I provides background discussion of software and methodology development to enable Best Estimate Trajectory (BET) generation. Actual products generated are summarized in Section II as tables which completely describe the post-flight products available from the first three-year Shuttle flight history. Summary results are presented in Section III, with longitudinal performance comparisons included as Appendices for each of the flights.

Findlay, J. T.↗
DOE OSTI2025

The real-time data processing and acquisition system for Project 8 Phase II

In Phase II of the Project 8 neutrino mass experiment, electrons from the decays of tritium or 83m Kr are detected via their ≈26 GHz cyclotron radiation while contained within a circular waveguide. The signal from a given electron is characterized as a brief chirp, lasting ≲10 ms and changing in frequency by ≲1 MHz/ms. To detect these signals, the Project 8 collaboration developed a Data Acquisition (DAQ) system tailored to the signal properties. The DAQ is responsible for simultaneously selecting up to three 100 MHz-wide frequency windows to study, detect, and trigger on likely signals from different electron kinetic energies, and for writing the relevant data to disk. Finally, we describe the Phase II DAQ system in detail and address how the system was used for data-taking operations.

Data acquisition↗
NASA NTRS1976

Interactive imaging and data processing

Image processing method is capable of contrast enhancement, noise filtering, and photometric distortion removal in near real time. System uses digital image integration and digital video recorder as image buffer. Each frame of data is entered into memory; registers provide readout of stored TV frame.

Alsberg, H.↗
DOE OSTI2021

Rock Valley Accelerated Weight Drop Seismic Data Processing and Picking of P-wave and S-wave Arrival Times

Rock Valley, in the southern end of the Nevada National Security Site, hosts a fault system that was responsible for a shallow (< 3 km below surface ) magnitude 3.7 earthquake in May 1993. In order to better understand this system, seismic properties of the shallow subsurface need to be better constrained. In April and May of 2021, accelerated weight drop (AWD) active-source seismic data were recorded in order to measure P- and S-wave travel-times for the area. This report describes the processing and phase picking of the recorded seismic waveforms. In total, we picked 7,982 P-wave arrivals at offsets up to ~2500 m, and 4,369 S-wave arrivals at offsets up to ~2200 m. These travel-time picks can be inverted for shallow P-wave and S-wave velocity structure in future studies.

58 GEOSCIENCES↗
DOE OSTI2022

EdgeAI: Machine learning via direct attached accelerator for streaming data processing at high shot rate x-ray free-electron lasers

We present a case for low batch-size inference with the potential for adaptive training of a lean encoder model. We do so in the context of a paradigmatic example of machine learning as applied in data acquisition at high data velocity scientific user facilities such as the Linac Coherent Light Source-II x-ray Free-Electron Laser. We discuss how a low-latency inference model operating at the data acquisition edge can capitalize on the naturally stochastic nature of such sources. We simulate the method of attosecond angular streaking to produce representative results whereby simulated input data reproduce high-resolution ground truth probability distributions. By minimizing the mean-squared error between the decoded output of the latent representation and the ground truth distributions, we ensure that the encoding layers and resulting latent representation maintains full fidelity for any downstream task, be it classification or regression. We present throughput results for data-parallel inference of various batch sizes, some with throughput exceeding 100 k images per second. We also show in situ training below 10 s per epoch for the full encoder–decoder model as would be relevant for streaming and adaptive real-time data production at our nation’s scientific light sources.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

JANA2 Framework for Event Based and Triggerless Data Processing

Development of the second generation JANA2 multi-threaded event processing framework is ongoing through an LDRD initiative grant at Jefferson Lab. The framework is designed to take full advantage of all cores on modern many-core compute nodes. JANA2 efficiently handles both traditional hardware triggered event data and streaming data in online triggerless environments. Development is being done in conjunction with the Electron Ion Collider development. Anticipated to be the next large scale Nuclear Physics facility constructed. The core framework is written in modern C++ but includes an integrated Python interface. The status of development and summary of the more interesting features are presented.

Lawrence, David↗
NASA NTRS2020

Data Processing for High-Contrast Imaging with the James Webb Space Telescope

The James Webb Space Telescope (JWST) will probe circumstellar environments at an unprecedented sensitivity.However, the performance of high-contrast imaging instruments is limited by the residual light from the star at close separations (<2-3”), where the incidence of exoplanets increases rapidly. There is currently no solution to get rid of the residual light down to the photon noise level at those separations, which may prevent some crucial discoveries. JWST’s debut is planned for October 2021 for a baseline mission lifetime of only five years. Thus,it is crucial to find a solution to this problem before its launch. We are further developing and implementing an innovative approach of post-processing built on a Bayesian framework that provides a more robust determination of faint astrophysical structures around a bright source. This approach uses a model of high-contrast imaging instrument that takes advantage of prior information, such as data from wavefront sensing (WFS) operations on JWST, to estimate simultaneously instrumental aberrations and the circumstellar environment. With this approach, our goal is to further improve the contrast gain over the contrast that can be achieved with JWST instruments, starting with NIRCam imaging and coronagraphic imaging. This work will pave the way for the future space-based high-contrast imaging instruments such as the Nancy Grace Roman Space Telescope Coronagraph Instrument (Roman CGI). This technique will be crucial to make the best use of the telemetry data that will be collected during the CGI operations.

Jewell, Jeffrey B.↗
NASA NTRS2002

Application of Reconfigurable Computing Technology to Multi-KiloHertz Micro-Laser Altimeter (MMLA) Data Processing

The Multi-KiloHertz Micro-Laser Altimeter (MMLA) is an aircraft based instrument developed by NASA Goddard Space Flight Center with several potential spaceflight applications. This presentation describes how reconfigurable computing technology was employed to perform MMLA signal extraction in real-time under realistic operating constraints. The MMLA is a "single-photon-counting" airborne laser altimeter that is used to measure land surface features such as topography and vegetation canopy height. This instrument has to date flown a number of times aboard the NASA P3 aircraft acquiring data at a number of sites in the Mid-Atlantic region. This instrument pulses a relatively low-powered laser at a very high rate (10 kHz) and then measures the time-of-flight of discrete returns from the target surface. The instrument then bins these measurements into a two-dimensional array (vertical height vs. horizontal ground track) and selects the most likely signal path through the array. Return data that does not correspond to the selected signal path are classified as noise returns and are then discarded. The MMLA signal extraction algorithm is very compute intensive in that a score must be computed for every possible path through the two dimensional array in order to select the most likely signal path. Given a typical array size with 50 x 6, up to 33 arrays must be processed per second. And for each of these arrays, roughly 12,000 individual paths must be scored. Furthermore, the number of paths increases exponentially with the horizontal size of the array, and linearly with the vertical size. Yet, increasing the horizontal and vertical sizes of the array offer science advantages such as improved range, resolution, and noise rejection. Due to the volume of return data and the compute intensive signal extraction algorithm, the existing PC-based MMLA data system has been unable to perform signal extraction in real-time unless the array is limited in size to one column, This limits the ability of the MMLA to operate in environments with sparse signal returns and a high number of noise return. However, under an IR&D project, an FPGA-based, reconfigurable computing data system has been developed that has been demonstrated to perform real-time signal extraction under realistic operating constraints. This reconfigurable data system is based on the commercially available Firebird Board from Annapolis Microsystems. This PCI board consists of a Xilinx Virtex 2000E FPGA along with 36 MB of SRAM arranged in five separately addressable banks. This board is housed in a rackmount PC with dual 850MHz Pentium processors running the Windows 2000 operating system. This data system performs all signal extraction in hardware on the Firebird, but also runs the existing "software based" signal extraction in tandem for comparison purposes. Using a relatively small amount of the Virtex XCV2000E resources, the reconfigurable data system has demonstrated to improve performance improvement over the existing software based data system by an order of magnitude. Performance could be further improved by employing parallelism. Ground testing and a preliminary engineering test flight aboard the NASA P3 has been performed, during which the reconfigurable data system has been demonstrated to match the results of the existing data system.

Powell, Wesley↗
DOE OSTI2025

Continuing Development of the Nuclear Data Processing Code AMPX [Poster]

The ENDF/B-VIII.1 evaluation library has seen a great growth in the thermal neutron scattering sub-library. The SCALE code system has traditionally approached CE transport by assuming that the CE library on disk represented the fully expanded cumulative probability distributions, conditional on exiting angle and marginal on exiting energy. While this is a complete description of the data, it comes at the potential cost of large amounts of on-disk storage. This approach was strained by several TSL files in ENDF/B-VIII.1, such as graphite, which contained data for a large number of Bragg edges. In the fully expanded probability distributions, this was found to be a disproportionately large fraction of the SCALE CE library.

GNDS↗
NASA NTRS1993

Radio Doppler navigation of interplanetary spacecraft using different data processing modes

Doppler shift measurements derived from closed-loop radio tracking of distant spacecraft by ground stations of the Deep Space Network (DSN) are one of the principal means used for interplanetary navigation. This paper describes an investigation of the navigation accuracy that can be achieved with two-way coherent X-band (7.2 to 8.4 GHz) Doppler phase and frequency data; both theoretical and practical aspects of the two Doppler formulations are addressed. A new filtering strategy is also proposed, which differs from current approaches in that most of the ground system calibration errors affecting the Doppler data are represented as filter parameters, in addition to the spacecraft trajectory parameters. Error covariance computations for application of the proposed filter to a navigation scenario derived from the Mars Observer mission are provided, in order to assess the performance that might be obtained in practice. The results indicate that with a phase formulation of the Doppler data and the new filter, navigation accuracies of 15 km at Mars (0.05 microrad in an angular sense) are possible with the DSN's present X-band Doppler tracking system.

Thurman, S. W.↗
NASA NTRS1999

Data Processing for the Near Earth Asteroid Rendezvous (NEAR), X-ray and Gamma-ray Spectrometer (XGRS) Ground System

An X-ray and Gamma-ray spectrometer (XGRS) is onboard the Near Earth Asteroid Rendezvous (NEAR) spacecraft to determine the elemental composition of the surface of the asteroid 433Eros. The Eros asteroid is highly non-spherical in physical shape and the development of data management and analysis methodologies are in several areas a divergence from traditional remotely sensed geographical information systems techniques. Field of view and asteroid surface geometry must be derived virtually and then combined with real measurements of solar, spectral and instrument calibration information to derive meaningful scientific results. Spatial resolution of planned geochemical maps will be improved from the initial conditions of low statistical significance per integration by repeated surface flyovers and regional spectral accumulation. This paper describes the results of a collaborative effort of design and development of the NEAR XGRS instrument ground system undertaken by participants at the Goddard Space Flight Center, University of Arizona, Cornell University, Applied Physics Laboratory, and Max Plank institute.

McClanahan, Timothy P.↗
NASA NTRS1999

Data Processing for the Near Earth Asteroid Rendezvous (NEAR), X-Ray and Gamma-Ray Spectrometer (XRS) Ground System

An X-ray and Gamma-ray spectrometer (XGRS) is onboard the Near Earth Asteroid Rendezvous (NEAR) spacecraft to determine the elemental composition of the surface of the asteroid 433Eros. The Eros asteroid is highly non-spherical in physical shape and the development of data management and analysis methodologies are in several areas a divergence from traditional remotely sensed geographical information systems techniques. Field of view and asteroid surface geometry must be derived virtually and then combined with real measurements of solar, spectral and instrument calibration information to derive meaningful scientific results. Spatial resolution of planned geochemical maps will be improved from the initial conditions of low statistical significance per integration by repeated surface flyovers and regional spectral accumulation. This paper describes the results of a collaborative effort of design and development of the NEAR XGRS instrument ground system undertaken by participants at the Goddard Space Flight Center, University of Arizona, Cornell University, Applied Physics Laboratory, and Max Plank institute.

McClanahan, Timothy P.↗
DOE OSTI2020

Data Federation Challenges in Remote Near-Real-Time Fusion Experiment Data Processing

Fusion energy experiments and simulations provide critical information needed to plan future fusion reactors. As next-generation devices like ITER move toward long-pulse experiments, analyses, including AI and ML, should be performed in a wide range of time and computing constraints, from near-real-time constraints, between-shot analysis, and to campaign-wide long-term analysis. However, the data volume, velocity, and variety make it extremely challenging for analyses using only local computational resources. Researchers need the ability to compose and execute workflows spanning edge resources to large-scale high-performance computing facilities.We present Delta, a system to address data analysis challenges, including AI/ML, in fusion science, by leveraging the ADIOS I/O library and middleware, to support executing science workflows over the wide area network for near-real-time streaming. We discuss the data federation challenges in performing remote workflows, focusing on on-going research work in (1) managing, reducing, and streaming data to minimize I/O and data movement overheads, (2) decompressing and reorganizing data for analysis, and (3) executing workflows for automated data analysis. We introduce examples for deep-learning based data analysis for the fusion domain and demonstrate how we use Delta to construct end-to-end workflows for a fusion device in Korea, connecting a remote DOE facility in the USA. The capability demonstrated by this project is the basis for improving the state of the art for near-real-time data federation amongst remote facilities.

Choi, Jong Youl↗