The processing of photoclinometric data
Improved rapid processing methods for handling large amounts of photoclinometric data, and maximizing ratio of work done by computer relative to manual reduction
DATA PROCESSING↗
SEARCH · Search NASA
Results for “Data processing methods”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
The Relative Importance of Random Error and Observation Frequency in Detecting Trends in Upper Tropospheric Water Vapor
Recent published work assessed the amount of time to detect trends in atmospheric water vapor over the coming century. We address the same question and conclude that under the most optimistic scenarios and assuming perfect data (i.e., observations with no measurement uncertainty) the time to detect trends will be at least 12 years at approximately 200 hPa in the upper troposphere. Our times to detect trends are therefore shorter than those recently reported and this difference is affected by data sources used, method of processing the data, geographic location and pressure level in the atmosphere where the analyses were performed. We then consider the question of how instrumental uncertainty plays into the assessment of time to detect trends. We conclude that due to the high natural variability in atmospheric water vapor, the amount of time to detect trends in the upper troposphere is relatively insensitive to instrumental random uncertainty and that it is much more important to increase the frequency of measurement than to decrease the random error in the measurement. This is put in the context of international networks such as the Global Climate Observing System (GCOS) Reference Upper-Air Network (GRUAN) and the Network for the Detection of Atmospheric Composition Change (NDACC) that are tasked with developing time series of climate quality water vapor data.
Whiteman, David N.↗
The NANOGrav 11-year Data Set: High-Precision Timing of 45 Millisecond Pulsars
We present high-precision timing data over time spans of up to 11 years for 45 millisecond pulsars observed as part of the North American Nanohertz Observatory for Gravitational Waves (NANOGrav) project, aimed at detecting and characterizing low-frequency gravitational waves. The pulsars were observed with the Arecibo Observatory and/or the Green Bank Telescope at frequencies ranging from 327 MHz to 2.3 GHz. Most pulsars were observed with approximately monthly cadence, and six high-timing-precision pulsars were observed weekly. All were observed at widely separated frequencies at each observing epoch in order to fit for time-variable dispersion delays. We describe our methods for data processing, time-of-arrival (TOA) calculation, and the implementation of a new, automated method for removing outlier TOAs. We fit a timing model for each pulsar that includes spin, astrometric, and (for binary pulsars) orbital parameters; time-variable dispersion delays; and parameters that quantify pulse-profile evolution with frequency. The timing solutions provide three new parallax measurements, two new Shapiro delay measurements, and two new measurements of significant orbital-period variations. We fit models that characterize sources of noise for each pulsar. We find that 11 pulsars show significant red noise, with generally smaller spectral indices than typically measured for non-recycled pulsars, possibly suggesting a different origin. A companion paper uses these data to constrain the strength of the gravitational-wave background
Arzoumanian, Zaven↗
Method and system for diagnostics of apparatus
Proposed is a method, implemented in software, for estimating fault state of an apparatus outfitted with sensors. At each execution period the method processes sensor data from the apparatus to obtain a set of parity parameters, which are further used for estimating fault state. The estimation method formulates a convex optimization problem for each fault hypothesis and employs a convex solver to compute fault parameter estimates and fault likelihoods for each fault hypothesis. The highest likelihoods and corresponding parameter estimates are transmitted to a display device or an automated decision and control system. The obtained accurate estimate of fault state can be used to improve safety, performance, or maintenance processes for the apparatus.
Gorinevsky, Dimitry↗
Search and dissemination in data processing
Manual retrieval methods were used to complete 54 searches of interest for the General Aviation Newsletter. Subjects of search ranged from television transmission to machine tooling, Apollo moon landings, electronic equipment, and aerodynamics studies.
Gold, C. H.↗
Some probabilistic models and statistical methods in the analysis of telemetry data
Probabilistic models and statistical methods in processing telemetry data with sequence of data and sync words
DATA PROCESSING↗
Evaluation, Analysis, and Application of Internal Strain-Gage Balance Data
Experimental processes, analytical methods, and numerical algorithms are described that may be used to predict the forces and moments of an internal strain–gage balance during a wind tunnel test. First, the control volume model of a strain–gage balance and the concepts of load state, load space, and output space are introduced. These important abstractions provide a better understanding of fundamental characteristics of different balance load prediction approaches. Then, the description of strain–gage balance data and the definition of the primary bridge sensitivity are discussed. Afterwards, basic elements of the calibration of a typical six–component balance are reviewed. Two fundamentally different balance load prediction methods, the processing of check loads, and related topics are also discussed. Three real–world balance data examples are reviewed in great detail to illustrate typical analysis results for a variety of strain–gage balance designs. Finally, important observations are summarized and recommendations are provided. – Additional information and detailed mathematical derivations can be found in the appendices of the document. They include the following topics: balance terminology, definitions of important statistical metrics, balance axis system conventions, balance load transformations, the combined load diagram, electrical output format options, bi–directional output characteristics, determination of the natural zeros, derivation of two balance load prediction methods, description of two tare load iteration algorithms, modeling of balance temperature effects, basics of three–component moment balances, definition of the percent contribution, detection of linear and near–linear dependencies in balance calibration data, a regression model search algorithm, balance interactions, and other related information.
strain-gage balance↗
CropEx Web-Based Agricultural Monitoring and Decision Support
CropEx is a Web-based agricultural Decision Support System (DSS) that monitors changes in crop health over time. It is designed to be used by a wide range of both public and private organizations, including individual producers and regional government offices with a vested interest in tracking vegetation health. The database and data management system automatically retrieve and ingest data for the area of interest. Another stores results of the processing and supports the DSS. The processing engine will allow server-side analysis of imagery with support for image sub-setting and a set of core raster operations for image classification, creation of vegetation indices, and change detection. The system includes the Web-based (CropEx) interface, data ingestion system, server-side processing engine, and a database processing engine. It contains a Web-based interface that has multi-tiered security profiles for multiple users. The interface provides the ability to identify areas of interest to specific users, user profiles, and methods of processing and data types for selected or created areas of interest. A compilation of programs is used to ingest available data into the system, classify that data, profile that data for quality, and make data available for the processing engine immediately upon the data s availability to the system (near real time). The processing engine consists of methods and algorithms used to process the data in a real-time fashion without copying, storing, or moving the raw data. The engine makes results available to the database processing engine for storage and further manipulation. The database processing engine ingests data from the image processing engine, distills those results into numerical indices, and stores each index for an area of interest. This process happens each time new data is ingested and processed for the area of interest, and upon subsequent database entries, the database processing engine qualifies each value for each area of interest and conducts a logical processing of results indicating when and where thresholds are exceeded. Reports are provided at regular, operator-determined intervals that include variances from thresholds and links to view raw data for verification, if necessary. The technology and method of development allow the code base to easily be modified for varied use in the real-time and near-real-time processing environments. In addition, the final product will be demonstrated as a means for rapid draft assessment of imagery.
Harvey. Craig↗
Evaluation, Analysis, and Application of Internal Strain-Gage Balance Data
Experimental processes, analytical methods, and numerical algorithms are described that may be used to predict the forces and moments of an internal strain-gage balance during a wind tunnel test. First, the control volume model of a strain-gage balance and the concepts of load state, load space, and output space are introduced. These important abstractions provide a better understanding of fundamental characteristics of different balance load prediction approaches. Then, the description of strain-gage balance data and the definition of the primary gage sensitivity is discussed. Afterwards, basic elements of the calibration of a typical six-component balance are reviewed. Two fundamentally different balance load prediction methods, the processing of check loads, and related topics are also discussed. Three real-world balance data examples are reviewed in great detail to illustrate typical analysis results for a variety of strain-gage balance designs. Finally, important observations are summarized and recommendations are provided. Additional information and detailed mathematical derivations can be found in the appendices of the document. They include the following topics: balance terminology, definitions of important statistical metrics, balance axis system conventions, balance load transformations, the combined load diagram, electrical output format options, bi-directional gage output characteristics, determination of the natural zeros, derivation of two balance load prediction methods, description of two tare load iteration algorithms, modeling of balance temperature effects, basics of three-component moment balances, definition of the percent contribution, detection of linear and near-linear dependencies in balance calibration data, a regression model term selection algorithm, and other related topics.
wind tunnel test↗
Stratospheric Temperature Trends from Small Rockets Between 1969-1995
Between 1958-1995 a significant number of small meteorological rocketsondes were launched by United States (US) agencies from as many as 30 sites to as few as 3-4 sites in 1995. Stratospheric temperature trends were derived for many of the sites for the period 1969-1995. Similar long-term trends also were derived using rocketsondes launched from sites of the Former Soviet Union (FSU). The advantage of these two particular sets of rocket temperature measurements is the internal consistency of the data. All measurements were made with the same instrument, i.e., Datasonde in the case of the US sites and the M100B in the case of the FSU sites. Data from each instrument type were processed using its unique reduction method. Thus, all data were processed in the same manner including the method of applying corrections (necessary because of thermal heating of the thermistor from the high fall velocities experienced and from radiation effects). Straight-line least squares fit to the data made to monthly-mean measurements gave a downward change of 2-3 K per decade. A more complex fitting algorithm would have resulted in finer results but the straight-line fit was adequate for the analysis presented. Trend data are presented for 50 km, 40 km, and 25 km altitude levels. Trends for the US and FSU sites are quite similar. The 25km (50-hPa) level data are compared with radiosonde temperatures. Temperature trends over the 25-year period is different at each of the sites and not always in the same direction.
Schmidlin, F. J.↗
Waveform resampling with LMN method
In this article, resampling is a common technique applied in digital signal processing. Based on the Fast Fourier Transformation (FFT), we apply an optimization called here the LMN method to achieve fast and robust re-sampling. In addition to performance comparisons with some other popular methods, we illustrate the effectiveness of this LMN method in a particle physics experiment: re-sampling of waveforms from Liquid Argon Time Projection Chambers.
72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
Evaluating the Utility of Satellite Soil Moisture Retrievals over Irrigated Areas and the Ability of Land Data Assimilation Methods to Correct for Unmodeled Processes
Earth's land surface is characterized by tremendous natural heterogeneity and human-engineered modifications, both of which are challenging to represent in land surface models. Satellite remote sensing is often the most practical and effective method to observe the land surface over large geographical areas. Agricultural irrigation is an important human-induced modification to natural land surface processes, as it is pervasive across the world and because of its significant influence on the regional and global water budgets. In this article, irrigation is used as an example of a human-engineered, often unmodeled land surface process, and the utility of satellite soil moisture retrievals over irrigated areas in the continental US is examined. Such retrievals are based on passive or active microwave observations from the Advanced Microwave Scanning Radiometer for the Earth Observing System (AMSR-E), the Advanced Microwave Scanning Radiometer 2 (AMSR2), the Soil Moisture Ocean Salinity (SMOS) mission, WindSat and the Advanced Scatterometer (ASCAT). The analysis suggests that the skill of these retrievals for representing irrigation effects is mixed, with ASCAT-based products somewhat more skillful than SMOS and AMSR2 products. The article then examines the suitability of typical bias correction strategies in current land data assimilation systems when unmodeled processes dominate the bias between the model and the observations. Using a suite of synthetic experiments that includes bias correction strategies such as quantile mapping and trained forward modeling, it is demonstrated that the bias correction practices lead to the exclusion of the signals from unmodeled processes, if these processes are the major source of the biases. It is further shown that new methods are needed to preserve the observational information about unmodeled processes during data assimilation.
land data↗
Evaluation of the Radiometric Integrity of LANDSAT 4 Thematic Mapper Band 6 Data
Probably the most generally accepted method for processing radiometric data from space is to correct the observed radiance or apparent temperature to a surface radiance or temperature value using atmospheric propagation models. As part of NASA's Heat Capacity Mapping Mission (HCMM) experiment the atmospheric propagation models were used in reverse in an attempt to evaluate the post launch radiometric response of the radiometer. Techniques successfully used to radiometrically calibrate the HCMM sensor were extended. The HCMM experiment is described and used as a base for the evaluation of the TM band 6 (infrared) sensor.
Schott, J. R.↗
Hydra: computer vision for data quality monitoring
Hydra, initially developed for Hall-D in 2019, is a system that utilizes computer vision to perform near real time data quality monitoring. Since then, it has been deployed across all experimental halls at Jefferson Lab, with the CLAS12 collaboration in Hall-B being the first outside of GlueX to fully utilize Hydra. The system comprises back end processes that manage the models, their inferences, and the data flow. Finally, the front-end components, accessible via web pages, allow detector experts and shift crews to view and interact with the system.
47 OTHER INSTRUMENTATION↗
Identification of low-momentum muons in the CMS detector using multivariate techniques in proton-proton collisions at $\sqrt{s}$ = 13.6 TeV
“Soft” muons with a transverse momentum below 10 GeV are featured in many processes studied by the CMS experiment, such as decays of heavy-flavor hadrons or rare tau lepton decays. Maximizing the selection efficiency for these muons, while simultaneously suppressing backgrounds from long-lived light-flavor hadron decays, is therefore important for the success of the CMS physics program. Multivariate techniques have been shown to deliver better muon identification performance than traditional selection techniques. To take full advantage of the large data set currently being collected during Run 3 of the CERN LHC, a new multivariate classifier based on a gradient-boosted decision tree has been developed. It offers a significantly improved separation of signal and background muons compared to a similar classifier used for the analysis of the Run 2 data. The performance of the new classifier is evaluated on a data set collected with the CMS detector in 2022 and 2023, corresponding to an integrated luminosity of 62 fb -1 .
72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
Track reconstruction as a service for collider physics
Optimizing charged-particle track reconstruction algorithms is crucial for efficient event reconstruction in Large Hadron Collider (LHC) experiments due to their significant computational demands. Existing track reconstruction algorithms have been adapted to run on massively parallel coprocessors, such as graphics processing units (GPUs), to reduce processing time. Nevertheless, challenges remain in fully harnessing the computational capacity of coprocessors in a scalable and non-disruptive manner. This paper proposes an inference-as-a-service approach for particle tracking in high energy physics experiments. To evaluate the efficacy of this approach, two distinct tracking algorithms are tested: Patatrack, a rule-based algorithm, and Exa.TrkX, a machine learning-based algorithm. The as-a-service implementations show enhanced GPU utilization and can process requests from multiple CPU cores concurrently without increasing per-request latency. The impact of data transfer is minimal and insignificant compared to running on local coprocessors. This approach greatly improves the computational efficiency of charged particle tracking, providing a solution to the computing challenges anticipated in the High-Luminosity LHC era.
46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
Imaging and Segmenting Grains and Subgrains Using Backscattered Electron Techniques
We present two new methods of processing data from backscattered electron signals in a scanning electron microscope to image grains and subgrains. The first combines data from multiple backscattered electron images acquired at different specimen geometries to (1) better reveal grain boundaries in recrystallized microstructures and (2) distinguish between recrystallized and unrecrystallized regions in partially recrystallized microstructures. The second utilizes spherical harmonic transform indexing of electron backscatter diffraction patterns to produce high angular resolution orientation data that enable the characterization of subgrains. Subgrains are produced during high-temperature plastic deformation and have boundary misorientation angles ranging from a few degrees down to a few hundredths of a degree. Here, we also present an algorithm to automatically segment grains from combined backscattered electron image data or grains and subgrains from high angular resolution electron backscatter diffraction data. Together, these new techniques enable rapid measurements of individual grains and subgrains from large populations.
36 MATERIALS SCIENCE↗
Data acquisition and analysis techniques in a brain research institute.
Neurophysiological data treated mathematically by computer-tape recording system in brain research institute
COMPUTER METHOD↗