Telemetry data processing for the eccentric orbiting geophysical observatory satellite.
Data telemetering to Earth from EGO describing PCM system and special processor for magnetometer data
EGO↗
SEARCH · Search NASA
Results for “Data processing”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Data processing in infrared astronomy
Infrared astronomy is often carried out with rocket probes or orbiting satellite telescopes in order to escape the effects of atmospheric absorption. The data returned from such missions is a highly abstracted digital representation of measurements made by analog detectors. The ability to extract infrared-emission information from these data streams depends on a thorough understanding of the information flow from the telescope aperture to the computer center. This paper reviews the primary elements of this end-to-end concept and the impact of each of these elements on the data processing algorithms, including the division between onboard and ground processing for scientific measurements.
Pelzmann, R. F., Jr.↗
The applications of silicon liquid crystal light valves to optical data processing: A review
The applications of the photo-activated, the CCD-addressed, and the variable-grating mode liquid crystal light valves (LCLVs) to optical data processing are described. These applications include image correlation, level slicing, spectral analysis and correlation, bi-spectral image division, and matrix-matrix multiplication.
Efron, U.↗
A Data Processing Pipeline To Extract A Knowledge Graph From Heterogeneous Data For Socio-technical Analysis Of Critical Infrastructure Influence
The code is written in Python and consists of the following pipeline that is implemented in Apache Airflow. This pipeline intends to understand the companies that are directly or indirectly involved with a type of critical infrastructure system at some point in that system's lifecycle. The pipeline takes a configuration file that specifies a list of initial companies to consider, a geographic region of interest, and a set of SEC form types as well as other data sources (e.g. CrunchBase) from which to extract entities and relations. There are four main components to this pipeline as currently implemented: Entity Extraction, Network Construction, Analysis, and Visualization. First, Entity Extraction, is implemented as the `topear-extract_organizations` Apache Airflow workflow. Given an initial query that specifies a geographic region of interest and a time interval, the software will extract CI facilities of interest and organizations that have a direct influence relationship to those facilities (e.g. ownership). During the course of the LDRD, we focused on Electric Vehicle charging stations and this information is available via the Department of Energy (DOE) database on fueling stations maintained by NREL. Within the context of the DOE CESER project, we have focused on Battery Energy Storage Systems (BESS). Second, the Network Extraction component will iteratively construct a social network graph given the set of organizations and people extracted in the previous step. Organizations (and eventually People if desired) are then fed as a query to the `topgear-construct_social_network` Apache Airflow workflow which given a set of initial companies and data sets (e.g. SEC EDGAR form types, OpenCorporates, Crunchbase). This Airflow workflow will iteratively query such data sources to discover relationships with new organizations and people. For example, this module can iteratively query SEC EDGAR for metadata that documents the number of each type of form for the given set of companies and their location. This forms metadata represents a catalog of data sources from SEC EDGAR for the extracted social network knowledge graph. The pipeline then downloads these forms from the website and saves them in a build directory for further processing. These documents are then parsed for entities and relations. Again, we note that in additional to SEC data sources, this step can also pull in information on organizations via API services such as CrunchBase and OpenCorporates or bulk data sources. At the end of this step, the resultant social network, the Critical Infrastructure network, and the edges that encode relationships between organizations and CI facilities, form the Adversarial Socio-Technical Network (ASTN) that informs the analysis. Third, the Analysis component processes these generated ASTN. Previously, that has included the ability to compare prevalence of different vendors for a given infrastructure component type across different regions as well as identify common public and private investors across those vendors. This was demonstrated for EV Charging Stations across several different metropolitan areas within an IEEE PES GridEdge publication. More recently, we have looked at ways to identify infrastructure owners and operators of BESS with the most nameplate capacity across different states as well as other indictors of risk resulting from changes in ownership over time. Finally, the Visualization component consists of an HTML/CSS/JS framework by which users can interact geospatial, operational, and organizational relationships across a given portfolio of Critical Infrastructure facilities. The objective is to provide a library of UI/UX modules that can be repurposed for stakeholder-specific dashboards. All of the modules are related via a common event model that enables UI actions in one view to percolate across the other views.
Weaver, Gabriel [Idaho National Laboratory (INL), ↗
Instrumentation and data processing for AFTI/F-16 flight testing
The primary objective of the advanced fighter technology integration/F-16 (AFTI/F-16) development program is to demonstrate advanced fighter technologies to improve weapon delivery and aircraft survivability. Instrumentation and data processing for monitoring aircraft operation during flight testing is necessary not only for safety-of-flight considerations but also for rapid evaluation of flight test results. The complexity of the AFTI/F-16 aircraft necessitates an extensive capability to accomplish data goals; this paper describes that capability and the resultant product.
Harney, P.↗
Global Geographic Database in Support of EOS MISR Data Processing
This paper will describe the production of the Ancillary Geographic Product (AGP) in support of the Earth Observing System (EOS) Multi-angle Imaging SpectroRadiometer (MISR) instrument data processing. The AGP is essentially a global database of geographic properties, tailored to the needs of the MISR mission.
ancillary geographic product earth observing syste↗
Intelligent Experiments Through Real-time AI: Fast Data Processing and Autonomous Detector Control for sPHENIX and Future EIC Detectors (Final Report)
The overall vision of this project was to integrate real-time artificial intelligence (AI) directly into the data acquisition and detector-control systems of nuclear physics experiments, including both fast online event selection and an autonomous detector-control feedback loop. The work carried out under the award focused on the fast online event-selection half of that vision: the efficient recording of low-momentum heavy-flavor (HF) hadron decays in proton-proton collisions at the sPHENIX experiment at the Relativistic Heavy Ion Collider (RHIC)—an observable that requires fast tracking and topological trigger selection not previously demonstrated at RHIC, and that is essential for QCD studies at future facilities such as the Electron-Ion Collider (EIC). The autonomous detector-control (GPU-based feedback) component named in the project title remained a design concept and was not implemented under this award. The Massachusetts Institute of Technology (MIT) group led the offline simulation and data processing needed to train the machine-learning (ML) models, the translation of trained models to Field-Programmable Gate Array (FPGA) firmware using the hls4ml framework, and the physics validation of heavy-flavor reconstruction. Over the award period, the team developed and hardware-tested the principal components of an AI-based heavy-flavor trigger on simulated and recorded sPHENIX tracker data: a software Bipartite Graph Attention Network (BiGAT) trigger model reaching > 95% signal efficiency at 99% background rejection; an FPGA-native hit clusterizer matching the offline clustering; smaller networks synthesized to FPGA within the required sub-10 µs latency; and an assembled decoder–clusterizer–inference firmware chain exercised on the FELIX readout board. A complete, fully integrated hardware demonstrator was not finished within the award period. This report documents the project goals, the MIT group’s contributions, the technical accomplishments, and the outlook toward applications at the future EIC ePIC detector.
73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
Independent Orbiter Assessment (IOA): Assessment of the data processing system FMEA/CIL
The results of the Independent Orbiter Assessment (IOA) of the Failure Modes and Effects Analysis (FMEA) and Critical Items List (CIL) are presented. The IOA effort first completed an analysis of the Data Processing System (DPS) hardware, generating draft failure modes and potential critical items. To preserve independence, this analysis was accomplished without reliance upon the results contained within the NASA FMEA/CIL documentation. The IOA results were then compared to the NASA FMEA/CIL baseline with proposed Post 51-L updates included. A resolution of each discrepancy from the comparison is provided through additional analysis as required. The results of that comparison is documented for the Orbiter DPS hardware.
Lowery, H. J.↗
LaRC SmartLab Apps For Instrument Control and Data Processing: Laboratory Environment Monitor
The LaRC SmartLab applications are a series of software tools to greatly enhance researcher efficiency by streamlining and automating workflows. Python scripts and applications are increasingly being used in scientific workflows, including for instrument control and data processing. Interactive Python scripting environments such as JupyterLab provide powerful tools for using Python. In some use cases, the development of standalone applications with dedicated graphical user interfaces can enhance the utility of the code and open it up to more users, including non-programmers. Here, we describe a Python based application for communicating with, and displaying data from, iTHX Temperature, Humidity, and Dew Point probes. We discuss the set up and use of the application as well as its implementation. We also highlight the use of Simulated probes to enable users and developers to familiarize with or debug the application, even when they do not have access to the physical hardware in the laboratory.
LaRC SmartLab↗
Data processing for astronomy missions.
The functions which must be performed to ensure the effective and efficient use of a space astronomical observatory may be separated into three major categories, including mission planning and analysis, mission operations, and data utilization. Each of these functions can be further subdivided. The most suitable locations for conducting the data processing operations in each case must be determined on the basis of criteria which take into account economical and operational factors. An advanced operational concept for an astronomical observatory is discussed.
Ludwig, G. H.↗
Geostationary Imaging FTS (GIFTS) Data Processing: Measurement Simulation and Compression
GIFTS (Geostationary Imaging Fourier Transform Spectrometer), a forerunner of next generation geostationary satellite weather observing systems, will be built to fly on the NASA EO-3 geostationary orbit mission in 2004 to demonstrate the use of large area detector arrays and readouts. Timely high spatial resolution images and quantitative soundings of clouds, water vapor, temperature, and pollutants of the atmosphere for weather prediction and air quality monitoring will be achieved. GIFTS is novel in terms of providing many scientific returns that traditionally can only be achieved by separate advanced imaging and sounding systems. GIFTS' ability to obtain half-hourly high vertical density wind over the full earth disk is revolutionary. However, these new technologies bring forth many challenges for data transmission, archiving, and geophysical data processing. In this paper, we will focus on the aspect of data volume and downlink issues by conducting a GIFTS data compression experiment. We will discuss the scenario of using principal component analysis as a foundation for atmospheric data retrieval and compression of uncalibrated and un-normalized interferograms. The effects of compression on the degradation of the signal and noise reduction in interferogram and spectral domains will be highlighted. A simulation system developed to model the GIFTS instrument measurements is described in detail.
Huang, Hung-Lung↗
Performance Monitoring of Distributed Data Processing Systems
Test and checkout systems are essential components in ensuring safety and reliability of aircraft and related systems for space missions. A variety of systems, developed over several years, are in use at the NASA/KSC. Many of these systems are configured as distributed data processing systems with the functionality spread over several multiprocessor nodes interconnected through networks. To be cost-effective, a system should take the least amount of resource and perform a given testing task in the least amount of time. There are two aspects of performance evaluation: monitoring and benchmarking. While monitoring is valuable to system administrators in operating and maintaining, benchmarking is important in designing and upgrading computer-based systems. These two aspects of performance evaluation are the foci of this project. This paper first discusses various issues related to software, hardware, and hybrid performance monitoring as applicable to distributed systems, and specifically to the TCMS (Test Control and Monitoring System). Next, a comparison of several probing instructions are made to show that the hybrid monitoring technique developed by the NIST (National Institutes for Standards and Technology) is the least intrusive and takes only one-fourth of the time taken by software monitoring probes. In the rest of the paper, issues related to benchmarking a distributed system have been discussed and finally a prescription for developing a micro-benchmark for the TCMS has been provided.
Ojha, Anand K.↗
Central Data Processing System (CDPS) user's manual: Solar heating and cooling program
The software and data base management system required to assess the performance of solar heating and cooling systems installed at multiple sites is presented. The instrumentation data associated with these systems is collected, processed, and presented in a form which supported continuity of performance evaluation across all applications. The CDPS consisted of three major elements: communication interface computer, central data processing computer, and performance evaluation data base. Users of the performance data base were identified, and procedures for operation, and guidelines for software maintenance were outlined. The manual also defined the output capabilities of the CDPS in support of external users of the system.
Source record↗
NASA Ocean Altimeter Pathfinder Project: Data Processing Handbook - Report 1
The NOAA/NASA Pathfinder program was created by the Earth Observing System (EOS) Program Office to determine how satellite-based data sets can be processed and used to study global change. The data sets are designed to be long time-sedes data processed with stable calibration and community consensus algorithms to better assist the research community. The Ocean Altimeter Pathfinder Project involves the reprocessing of all altimeter observations with a consistent set of improved algorithms, based on the results from TOPEX/POSEIDON (T/P), into easy-to-use data sets for the oceanographic community for climate research. This report describes the processing schemes used to produce a consistent data set and two of the products derived f rom these data. Other reports have been produced that: a) describe the validation of these data sets against tide gauge measurements and b) evaluate the statistical properties of the data that are relevant to climate change. The use of satellite altimetry for earth observations was proposed in the early 1960s. The first successful space based radar altimeter experiment was flown on SkyLab in 1974. The first successful satellite radar altimeter was flown aboard the Geos-3 spacecraft between 1975 and 1978. While a useful data set was collected from this mission for geophysical studies, the noise in the radar measured and incomplete global coverage precluded ft from inclusion in the Ocean Altimeter Pathfinder program. This program initiated its analysis with the Seasat mission, which was the first satellite radar altimeter flown for oceanography.
Koblinsky, C. J.↗
Optical data processing and projected applications of the ERTS-1 imagery covering the 1973 Mississippi River Valley floods
Flooding along the Mississippi River and some of its tributaries was imaged by the multispectral scanner (MSS) on the Earth Resources Technology Satellite (ERTS-1) on at least three orbits during the spring of 1973. The ERTS data provided the first opportunity for mapping the regional extent of flooding at the time the imagery was acquired. Special optical data processing techniques were used to produce a variety of multispectral color composites which enhanced floodplain details. One of these, a two-color composite of near infrared bands 6 and 7, was enlarged and registered to 1:250,0OO-scale topographic maps and used as the basis for preparation of flood image maps. Two specially filtered three-color composites of MSS bands 5, 6, and 7 and 4, 5, and 7 were prepared to aid in the interpretation of the data. The extent of the flooding was vividly depicted on a single image by two-color temporal composites produced on the additive-color viewer using band 7 flood data superimposed on pre-flood band 7 images. On May 24, when the floodwaters at St. Louis receded to bankfull stage, imagery was again obtained by ERTS. Analysis of temporal data composites of the pre-flood and post-flood band 7 images indicate that changes in surface reflectance characteristics caused by the flooding can be delineated, thus making it possible to map the overall area flooded without the necessity of a real-time system to track and image the peak flood waves. Regional planning and disaster relief agencies such as the Corps of Engineers, Office of Emergency Preparedness, Soil Conservation Service, interstate river basin commissions and state agencies, as well as private lending and insurance institutions, have indicated strong potential applications for ERTS image-maps of flood-prone areas.
Morris Deutsch↗
LITE data processing
The Lidar In-space Technology Experiment (LITE) was a payload onboard the Space Shuttle Discovery as part of the September 1994 STS-64 mission. LITE successfully made both atmospheric and surface measurements at the 355 nm, 532 nm, and 1064 nm wavelengths [Winker et al., 1996]. At mission completion, nearly 45 Gbytes of data had been obtained. As the data were collected they were organized into three data sets. The largest of these data sets contained the single-shot full resolution digitized lidar signals for all three wavelengths. The other two data sets contained the instrument status data block (ISDB) and the quick look science data (QLSD). ISDB information was generated once per second and contained timing parameters and engineering data related to the health, status, and configuration of the instrument. The QLSD are 100shot averages of the 355 nm and 532 nm lidar signals and were generated at ten second intervals. As the LITE data were generated, they were output to low-rate and high-rate telemetry streams. The low-rate data contained the ISDB and QLSD. The lowrate data were transmitted to the ground by the Shuttle S-band system through the Tracking and Data Relay Satellite System (TDRSS). The high-rate data contained the full resolution digitized lidar signals for all three wavelengths, the ISDB, and QLSD. The high-rate data were transmitted in real time by the Ku-band system through TDRSS downlink to the LITE operations center at the Johnson Space Center (JSC). High-rate data were only obtained when the orbiter and TDRSS telemetry link coincided with the real-time operations of LITE. The low-rate data were backed up by a Shuttle recorder during periods when the telemetry link was unavailable, and the entire lowrate data stream was transferred to the ground over the course of the mission. A total of 53 hours of lowrate data and 45.5 hours of high-rate data were acquired. All of the LITE raw telemetry data have been archived at the NASA Langley Research Center (LaRC), and the LITE high-rate data have been processed to the level 1 data product. This paper describes the data processing steps required to convert the LITE raw, high-rate telemetry data to the LITE level 1 data product.
Powell, Kathleen A.↗
Optical data processing and projected applications of the ERTS-1 imagery covering the 1973 Mississippi River Valley floods
Flooding was detected along the Mississippi River and some of its tributaries by the multispectral scanner (MSS) on the ERTS-1 on at least three orbits during the spring of 1973. The ERTS data provided the first opportunity for mapping the regional extent of flooding. Special optical data processing techniques were used to produce a variety of multispectral color composites enhancing flood-plain details. One of these, a 2-color composite of near infrared bands 6 and 7, was enlarged and registered to 1:250,000-scale topographic maps and used as the basis for preparation of flood image maps. Two specifically filtered 3-color composites of MSS bands 5,6, and 7 and 4, 5, and 7 were prepared.
Deutsch, M.↗
Landsat thematic mapper attitude data processing
The Landsat 4 and 5 satellites carry a new, high resolution, seven band thematic mapper imaging instrument. The spacecraft also carry two types of attitude sensors: a gyroscopic internal reference unit (IRU) which senses angular rate from dc to about 2 Hz, and an AC-coupled angular displacement sensor (ADS) measuring angular deviation above 2 Hz. A description of the derivation of the crossover network used to combine and equalize the IRU and ADS data is made. Also described are the digital data processing algorithms which produce the time history of the satellites' attitude motion including the finite impulse response (FIR) implementation of G and F filters; the resampling (interpolation/decimation) and synchronization of the IRU and ADS data; and the axis rotations required as a result of the on-board sensor locations on three orthogonal axes.
Sehn, G. J.↗