Search NASA⌕ Search

SEARCH · Search NASA

Results for “data processing steps”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Investigation of correlation classification techniques

A two-step classification algorithm for processing multispectral scanner data was developed and tested. The first step is a single pass clustering algorithm that assigns each pixel, based on its spectral signature, to a particular cluster. The output of that step is a cluster tape in which a single integer is associated with each pixel. The cluster tape is used as the input to the second step, where ground truth information is used to classify each cluster using an iterative method of potentials. Once the clusters have been assigned to classes the cluster tape is read pixel-by-pixel and an output tape is produced in which each pixel is assigned to its proper class. In addition to the digital classification programs, a method of using correlation clustering to process multispectral scanner data in real time by means of an interactive color video display is also described.

Haskell, R. E.↗

Data Transferability and Collection Consistency in Marine Renewable Energy

Concerns about the potential effects of tidal turbines and wave energy devices on the marine environment continue to slow siting and permitting/consenting of single devices and arrays worldwide. While research studies and early results from post-installation monitoring over the past decade have informed interactions between marine renewable energy (MRE) devices, marine animals, and habitats, regulators still demonstrate considerable reluctance to accelerate the permitting/consenting process for devices and arrays. Furthermore, the MRE industry is struggling with the high costs of baseline assessments and post-installation monitoring, as well as long timelines for obtaining permits, which leads to uncertainty and risk related to project financing. Regulators require assessment and monitoring information to allow them to carry out the necessary analyses to describe, permit/consent, and manage the environmental risks associated with new MRE technologies and new uses of ocean space. One way to reduce risks to the industry and the environment and to allow for acceleration of the permitting/consenting process could be to transfer learning, analyses, and data sets from one country to another, among projects, and across jurisdictional boundaries. In addition, data are collected around early-stage MRE devices using many different methods, instruments, and measurement scales. If similar parameters and accessible methods of data collection were used for baseline assessments and post-installation monitoring around all early-stage devices and MRE developments, the results would be more readily comparable. This comparability would lead to a decrease in scientific uncertainty and support a common understanding of the risk of MRE devices to the marine environment. This in turn would facilitate more efficient and shorter permitting/consenting processes, which would decrease the financial risk for MRE project development. As a means of addressing the concept of transferring data (information, learning, analyses, and data sets) among projects and collecting data consistently, Annex IV has developed a data transferability process that has been socialized with the MRE community, which includes regulators, industry, developers, consultants, and researchers. The data transferability process consists of five components: 1. A Data Transferability Framework brings together data sets in an organized fashion, compares the applicability of each data set for use on other projects, and guides the process of data transfer 2. A Data Collection Consistency Table provides preferred measurement methods or processes, reporting units, and the most common methods of analysis or interpretation and use of data 3. A Monitoring Data Sets Discoverability Matrix allows a practitioner to discover data sets based on the approach presented in the Framework 4. Best Management Practices (BMPs) include five BMPs related to data transferability and collection consistency 5. An Implementation Plan presents an approach for implementing and applying the data transferability process. This report documents the background and development of the data transferability process and associated components and summarizes the next steps needed to successfully implement and apply the data transferability process.

16 TIDAL AND WAVE POWER↗

Unification of binary star ephemeris solutions

Time-related binary system characteristics such as orbital period, its rate of change, apsidal motion, and variable light-time delay due to a third body, are measured in two ways that can be mutually complementary. The older way is via eclipse timings, while ephemerides by simultaneous whole light and velocity curve analysis have appeared recently. Each has its advantages, for example, eclipse timings typically cover relatively long time spans while whole curves often have densely packed data within specific intervals and allow access to systemic properties that carry additional timing information. Synthesis of the two information sources can be realized in a one step process that combines several data types, with automated weighting based on their standard deviations. Simultaneous light-velocity-timing solutions treat parameters of apsidal motion and the light-time effect coherently with those of period and period change, allow the phenomena to interact iteratively, and produce parameter standard errors based on the quantity and precision of the curves and timings. The logic and mathematics of the unification algorithm are given, including computation of theoretical conjunction times as needed for generation of eclipse timing residuals. Automated determination of eclipse type, recovery from inaccurate starting ephemerides, and automated data weighting are also covered. Computational examples are given for three timing-related cases—steady period change (XY Bootis), apsidal motion (V526 Sagittarii), and the light-time effect due to a binary's reflex motion in a triple system (AR Aurigae). Solutions for all combinations of radial velocity, light curve, and eclipse timing input show consistent results, with a few minor exceptions.

79 ASTRONOMY AND ASTROPHYSICS↗

Peregrine

The purpose of “Peregrine” is to perform in-situ quality control of the additive manufacturing process in powder bed systems. The software is an AI-based method to automatically detect and map multiple classes of defects present in the top layer of a powder bed system, either after material deposition, i.e. raking, or after printing the layer. Relying on image data or sensing modalities that can be converted into image data, the code allows for: (1) various steps of pre-processing of the data (registration, distortion correction, etc), (2) annotation of training datasets, (3) processing of data inline or offline, (4) creating 3D rendering of the defect map, and (5) implementation of corrective actions if allowed by the manufacturing platform.

Paquit, Vincent C↗

Integration of multi-discipline data processing for earth observing systems

The first steps taken to ensure the controlled evolution of existing facilities toward greater interoperability and sharing of resources among NASA-supported earth science and applications data systems (ESADS) are described. Recommendations made by the various panels during the 1987 ESADS Workshop are presented. The panels were concerned with directories and catalogs, data archives, data manipulation software, computational facilities, data storage media, database management, and networking. Consideration was also given to the tracking and tuning of overall development and management coordination issues.

Kahn, Ralph↗

Registration of the rotation axis in X-ray tomography

There is high demand for efficient, robust and automated routines for tomographic data reduction, particularly for synchrotron data. Registration of the rotation axis in data processing is a critical step affecting the quality of the reconstruction and is not easily implemented with automation. Existing methods for calculating the center of rotation have been reviewed and an improved algorithm to register the rotation axis in tomographic data is presented. The performance of the proposed method is evaluated using synchrotron-based microtomography data on geological samples with and without artificial reduction of the signal-to-noise ratio. The proposed method improves the reconstruction quality by correcting both the tilting error and the translational offset of the rotation axis. The limitation of this promising method is also discussed.

rotation axis↗

Reduction and error analysis of the AVE 2 pilot experiment data

The reduction techniques used to process data from the pilot experiment of the second NASA atmospheric variability experiment (AVE IIP), which was conducted during a 24 hour period beginning at 1200 GMT on May 11, 1974, and ending at 1200 GMT on May 12, 1974 are described. Each step of the data handling process is described through the presentation of computer flow charts, programs, equations, and narrative. An error analysis of the final output is presented, and results of the AVE IIP reduction process are compared with results from the National Weather Service. The AVE IIP sounding data contain more detail than National Weather Service data, but the two data sets may be used together without difficulty.

Fuelberg, H. E.↗

Development and Characterization of Lightweight Durable Composite Conductor for Cables

Sustainable aviation in the form of electrified propulsion is likely to lead to an increase in the electrical assets contained within a single aircraft. As a result, it is desirable to design light weight conductor materials, thus reducing the payload of components like motor windings, low voltage signal cables, and transmission cables for data and power. One approach involves replacing pure Cu wiring with metalized CNT composites. This paper evaluates a framework for modeling overall conductivity and current sharing within such composites. Processing methods and parameters were refined. Select electroplated samples outperformed pure Cu in conductivity and had comparable ultimate tensile strengths. Tensile strengths are expected to improve with an additional densification step during processing. Acoustic emission data was used to predict the failure mechanism of the composite. Theories explaining improved intrinsic conductivity are discussed, with a focus on chemical and mechanical interactions at the Cu-CNT interface. These include Cu infiltration of CNT crevices, CNT oxidation, activity at defects in CNT walls, and the release of carbide-forming metals from CNT walls. Validating any or all these theories will require further work replicating data, collecting electron micrographs and conducting chemical analyses.

Metalized CNT↗

Toward a Common Earth Data Publication Framework

Data publication is an essential activity for all data archives. Each of NASA's twelve Distributed Active Archive Centers (DAACs) have established publication workflows which account for the heterogeneous suite of missions, instruments, data providers, and datasets managed within the Earth Observation System Data and Information System (EOSDIS) program. Some aspects of data publication vary across DAACs: workflows range from manual to automatic, terms used to describe publication elements differ, and systems used to publish and manage data vary. Despite these differences, the DAAC data publication processes are generally the same: obtain the data and related information from data providers, describe the data with metadata and documentation, and release the data for access by the user community. In order to improve consistency and reduce the time required to publish data, we have developed a cross-DAAC initiative called the Common Earthdata Publication Framework (Earthdata Pub). Earthdata Pub seeks to: standardize communications and interactions with data providers; identify and standardize common workflows and steps in the data publication process; and design/implement a front-end system with features that include a common web interface, email & status tracking, and common application programming interfaces (APIs) to communicate with various DAAC-specific software components (services and applications) on the back-end. We will present the latest updates on this effort's progress and future plans.

data publication↗

Preliminary Results on Uncertainty Quantification for Pattern Analytics

This report summarizes preliminary research into uncertainty quantification for pattern analytics within the context of the Pattern Analytics to Support High-Performance Exploitation and Reasoning (PANTHER) project. The primary focus of PANTHER was to make large quantities of remote sensing data searchable by analysts. The work described in this report adds nuance to both the initial data preparation steps and the search process. Search queries are transformed from does the specified pattern exist in the data? to how certain is the system that the returned results match the query? We show example results for both data processing and search, and discuss a number of possible improvements for each.

97 MATHEMATICS AND COMPUTING↗

High spatial resolution imaging of biological tissues using nanospray desorption electrospray ionization mass spectrometry

Mass spectrometry imaging (MSI) enables label-free spatial mapping of hundreds of biomolecules in tissue sections. This capability provides valuable information on tissue heterogeneity that is difficult to obtain using population-averaged assays. Despite substantial developments in both instrumentation and methodology, MSI of tissue samples at single-cell resolution remains challenging. In our research, we describe a protocol for robust imaging of tissue sections with a high (better than 10-μm) spatial resolution using nanospray desorption electrospray ionization (nano-DESI) mass spectrometry, an ambient ionization technique that does not require sample pretreatment before analysis. In this protocol, mouse uterine tissue is used as a model system to illustrate both the workflow and data obtained in these experiments. We provide a detailed description of the nano-DESI MSI platform, fabrication of the nano-DESI and shear force probes, shear force microscopy experiments, spectral acquisition, and data processing. A properly trained researcher (e.g., technician, graduate student, or postdoc) can complete all the steps from probe fabrication to data acquisition and processing within a single day. We further describe a new strategy for acquiring both positive- and negative-mode imaging data in the same experiment. This is achieved by alternating between positive and negative data acquisition modes during consecutive line scans. Using our imaging approach, hundreds of high-quality ion images were obtained from a single uterine section. This protocol enables sensitive and quantitative imaging of lipids and metabolites in heterogeneous tissue sections with high spatial resolution, which is critical to understanding biochemical processes occurring in biological tissues.

59 BASIC BIOLOGICAL SCIENCES↗

DeepAdversaries: examining the robustness of deep learning models for galaxy morphology classification

With increased adoption of supervised deep learning methods for work with cosmological survey data, the assessment of data perturbation effects (that can naturally occur in the data processing and analysis pipelines) and the development of methods that increase model robustness are increasingly important. In the context of morphological classification of galaxies, we study the effects of perturbations in imaging data. In particular, we examine the consequences of using neural networks when training on baseline data and testing on perturbed data. We consider perturbations associated with two primary sources: (a) increased observational noise as represented by higher levels of Poisson noise and (b) data processing noise incurred by steps such as image compression or telescope errors as represented by one-pixel adversarial attacks. We also test the efficacy of domain adaptation techniques in mitigating the perturbation-driven errors. We use classification accuracy, latent space visualizations, and latent space distance to assess model robustness in the face of these perturbations. For deep learning models without domain adaptation, we find that processing pixel-level errors easily flip the classification into an incorrect class and that higher observational noise makes the model trained on low-noise data unable to classify galaxy morphologies. On the other hand, we show that training with domain adaptation improves model robustness and mitigates the effects of these perturbations, improving the classification accuracy up to 23% on data with higher observational noise. Domain adaptation also increases up to a factor of ${\approx}2.3$ the latent space distance between the baseline and the incorrectly classified one-pixel perturbed image, making the model more robust to inadvertent perturbations. Successful development and implementation of methods that increase model robustness in astronomical survey pipelines will help pave the way for many more uses of deep learning for astronomy.

79 ASTRONOMY AND ASTROPHYSICS↗

Methods for communicating data utilizing sessionless dynamic encryption

The present disclosure is directed to methods that provide a secure communication protocol by utilizing one step process of authenticating and encrypting data without having to exchange symmetric keys or needing to renew or re-issue digital identities fundamental to asymmetric encryption methodology.

Choi, Sung Nam↗

Methods for communicating data utilizing sessionless dynamic encryption

The present disclosure is directed to methods that provide a secure communication protocol by utilizing one step process of authenticating and encrypting data without having to exchange symmetric keys or needing to renew or re-issue digital identities fundamental to asymmetric encryption methodology.

Choi, Sung Nam↗

A multi-modal scanning system to digitize CBRNE emergency response scenes

A handheld system developed to digitize a contextual understanding of the scene at a chemical, biological, radiological, nuclear and/or explosives (CBRNE) events is described. The system uses LiDAR and cameras to create a colorized 3D model of the environment, which helps domain experts that are supporting responders in the field. To generate the digitized model, a responder scans any suspicious objects and the surroundings by carrying the system through the scene. The scanning system provides a real-time user interface to inform the user about scanning progress and to indicate any areas that may have been missed either by the LiDAR sensors or the cameras. Currently, the collected data are post-processed on a different device, building a colorized triangular mesh of the encountered scene, with the intention of moving this pipeline to the scanner at a later point. The mesh is sufficiently compressed to be sent over a reduced bandwidth connection to a remote analyst. Furthermore, the system tracks fiducial markers attached to diagnostic equipment that is placed around the suspicious object. The resulting tracking information can be transmitted to remote analysts to further facilitate their supporting efforts. The paper will discuss the system's design, software components, the user interface used for scanning a scene, the necessary procedures for calibration of the sensors, and the processing steps of the resulting data. The discussion will close by evaluating the system's performance on 11 scenes.

Salathe, Marco↗

A multi-modal scanning system to digitize CBRNE emergency response scenes

A handheld system developed to digitize a contextual understanding of the scene at a chemical, biological, radiological, nuclear and/or explosives (CBRNE) events is described. The system uses LiDAR and cameras to create a colorized 3D model of the environment, which helps domain experts that are supporting responders in the field. To generate the digitized model, a responder scans any suspicious objects and the surroundings by carrying the system through the scene. The scanning system provides a real-time user interface to inform the user about scanning progress and to indicate any areas that may have been missed either by the LiDAR sensors or the cameras. Currently, the collected data are post-processed on a different device, building a colorized triangular mesh of the encountered scene, with the intention of moving this pipeline to the scanner at a later point. The mesh is sufficiently compressed to be sent over a reduced bandwidth connection to a remote analyst. Furthermore, the system tracks fiducial markers attached to diagnostic equipment that is placed around the suspicious object. The resulting tracking information can be transmitted to remote analysts to further facilitate their supporting efforts. The paper will discuss the system's design, software components, the user interface used for scanning a scene, the necessary procedures for calibration of the sensors, and the processing steps of the resulting data. The discussion will close by evaluating the system's performance on 11 scenes.

Prins, Nicholas↗

Engineering High Performance Service-Oriented Pipeline Applications with MeDICi

The pipeline software architecture pattern is commonly used in many application domains to structure a software system. A pipeline comprises a sequence of processing steps that progressively transform data to some desired outputs. As pipeline-based systems are required to handle increasingly large volumes of data and provide high throughput services, simple scripting-based technologies that have traditionally been used for constructing pipelines do not scale. In this paper we describe the MeDICI Integration Framework (MIF), which is specifically designed for building flexible, efficient and scalable pipelines that exploit distributed services as elements of the pipeline. We explain the core runtime and development infrastructures that MIF provides, and demonstrate how MIF has been used in two complex applications to improve performance and modifiability.

99 GENERAL AND MISCELLANEOUS↗

DSN Beowulf Cluster-Based VLBI Correlator

The NASA Deep Space Network (DSN) requires a broadband VLBI (very long baseline interferometry) correlator to process data routinely taken as part of the VLBI source Catalogue Maintenance and Enhancement task (CAT M&E) and the Time and Earth Motion Precision Observations task (TEMPO). The data provided by these measurements are a crucial ingredient in the formation of precision deep-space navigation models. In addition, a VLBI correlator is needed to provide support for other VLBI related activities for both internal and external customers. The JPL VLBI Correlator (JVC) was designed, developed, and delivered to the DSN as a successor to the legacy Block II Correlator. The JVC is a full-capability VLBI correlator that uses software processes running on multiple computers to cross-correlate two-antenna broadband noise data. Components of this new system (see Figure 1) consist of Linux PCs integrated into a Beowulf Cluster, an existing Mark5 data storage system, a RAID array, an existing software correlator package (SoftC) originally developed for Delta DOR Navigation processing, and various custom- developed software processes and scripts. Parallel processing on the JVC is achieved by assigning slave nodes of the Beowulf cluster to process separate scans in parallel until all scans have been processed. Due to the single stream sequential playback of the Mark5 data, some ramp-up time is required before all nodes can have access to required scan data. Core functions of each processing step are accomplished using optimized C programs. The coordination and execution of these programs across the cluster is accomplished using Pearl scripts, PostgreSQL commands, and a handful of miscellaneous system utilities. Mark5 data modules are loaded on Mark5 Data systems playback units, one per station. Data processing is started when the operator scans the Mark5 systems and runs a script that reads various configuration files and then creates an experiment-dependent status database used to delegate parallel tasks between nodes and storage areas (see Figure 2). This script forks into three processes: extract, translate, and correlate. Each of these processes iterates on available scan data and updates the status database as the work for each scan is completed. The extract process coordinates and monitors the transfer of data from each of the Mark5s to the Beowulf RAID storage systems. The translate process monitors and executes the data conversion processes on available scan files, and writes the translated files to the slave nodes. The correlate process monitors the execution of SoftC correlation processes on the slave nodes for scans that have completed translation. A comparison of the JVC and the legacy Block II correlator outputs reveals they are well within a formal error, and that the data are comparable with respect to their use in flight navigation. The processing speed of the JVC is improved over the Block II correlator by a factor of 4, largely due to the elimination of the reel-to-reel tape drives used in the Block II correlator.

Rogstad, Stephen P.↗