Search NASA⌕ Search

SEARCH · Search NASA

Results for “data processing methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
NASA NTRS2008

Standardizing Interfaces for External Access to Data and Processing for the NASA Ozone Product Evaluation and Test Element (PEATE)

NASA's traditional science data processing systems have focused on specific missions, and providing data access, processing and services to the funded science teams of those specific missions. Recently NASA has been modifying this stance, changing the focus from Missions to Measurements. Where a specific Mission has a discrete beginning and end, the Measurement considers long term data continuity across multiple missions. Total Column Ozone, a critical measurement of atmospheric composition, has been monitored for'decades on a series of Total Ozone Mapping Spectrometer (TOMS) instruments. Some important European missions also monitor ozone, including the Global Ozone Monitoring Experiment (GOME) and SCIAMACHY. With the U.S.IEuropean cooperative launch of the Dutch Ozone Monitoring Instrument (OMI) on NASA Aura satellite, and the GOME-2 instrumental on MetOp, the ozone monitoring record has been further extended. In conjunction with the U.S. Department of Defense (DoD) and the National Oceanic and Atmospheric Administration (NOAA), NASA is now preparing to evaluate data and algorithms for the next generation Ozone Mapping and Profiler Suite (OMPS) which will launch on the National Polar-orbiting Operational Environmental Satellite System (NPOESS) Preparatory Project (NPP) in 2010. NASA is constructing the Science Data Segment (SDS) which is comprised of several elements to evaluate the various NPP data products and algorithms. The NPP SDS Ozone Product Evaluation and Test Element (PEATE) will build on the heritage of the TOMS and OM1 mission based processing systems. The overall measurement based system that will encompass these efforts is the Atmospheric Composition Processing System (ACPS). We have extended the system to include access to publically available data sets from other instruments where feasible, including non-NASA missions as appropriate. The heritage system was largely monolithic providing a very controlled processing flow from data.ingest of satellite data to the ultimate archive of specific operational data products. The ACPS allows more open access with standard protocols including HTTP, SOAPIXML, RSS and various REST incarnations. External entities can be granted access to various modules within the system, including an extended data archive, metadata searching, production planning and processing. Data access is provided with very fine grained access control. It is possible to easily designate certain datasets as being available to the public, or restricted to groups of researchers, or limited strictly to the originator. This can be used, for example, to release one's best validated data to the public, but restrict the "new version" of data processed with a new, unproven algorithm until it is ready. Similarly, the system can provide access to algorithms, both as modifiable source code (where possible) and fully integrated executable Algorithm Plugin Packages (APPs). This enables researchers to download publically released versions of the processing algorithms and easily reproduce the processing remotely, while interacting with the ACPS. The algorithms can be modified allowing better experimentation and rapid improvement. The modified algorithms can be easily integrated back into the production system for large scale bulk processing to evaluate improvements. The system includes complete provenance tracking of algorithms, data and the entire processing environment. The origin of any data or algorithms is recorded and the entire history of the processing chains are stored such that a researcher can understand the entire data flow. Provenance is captured in a form suitable for the system to guarantee scientific reproducability of any data product it distributes even in cases where the physical data products themselves have been deleted due to space constraints. We are currently working on Semantic Web ontologies for representing the various provenance information. A new web site focusing on consolidating informaon about the measurement, processing system, and data access has been established to encourage interaction with the overall scientific community. We will describe the system, its data processing capabilities, and the methods the community can use to interact with the standard interfaces of the system.

Tilmes, Curt A.↗
NASA NTRS2003

Processing Digital Imagery to Enhance Perceptions of Realism

Multi-scale retinex with color restoration (MSRCR) is a method of processing digital image data based on Edwin Land s retinex (retina + cortex) theory of human color vision. An outgrowth of basic scientific research and its application to NASA s remote-sensing mission, MSRCR is embodied in a general-purpose algorithm that greatly improves the perception of visual realism and the quantity and quality of perceived information in a digitized image. In addition, the MSRCR algorithm includes provisions for automatic corrections to accelerate and facilitate what could otherwise be a tedious image-editing process. The MSRCR algorithm has been, and is expected to continue to be, the basis for development of commercial image-enhancement software designed to extend and refine its capabilities for diverse applications.

Woodell, Glenn A.↗
NASA NTRS2018

A Rain Taxonomy for Degraded Visual Environment Mitigation

This Technical Memorandum (TM) provides a description of a rainfall taxonomy that defines the detailed characteristics of naturally occurring rainfall. The taxonomy is based on raindrop size measurements collected around the globe and encompasses several different climate types. Included in this TM is a description of these rainfall observations, an explanation of methods used to process those data, and resultant metrics comprising the rain taxonomy database. Each of the categories in the rain taxonomy are characterized by a unique set of raindrop sizes that can be used in simulations of electromagnetic wave propagation through a rain medium.

meteorology↗
NASA NTRSDate not supplied

Transitioning TEMPO Data for Air Quality Management Applications at the NASA SPoRT Center

The TEMPO mission has been observing air pollutants every hour during the daytime across its Field of Regard (FoR) covering greater North America since First Light on August 2, 2023. The highly anticipated public release of TEMPO data occurred on May 20, 2024, consisting of level 2 and level 3 trace gas data products of nitrogen dioxide, formaldehyde, and ozone. The NASA SPoRT Center is developing value-added products and tools to support the TEMPO mission and Early Adopters program with special attention on stakeholder from air agencies. One component of our work is focused on evaluating the TEMPO products over stakeholder target areas using Pandora and surface monitor observations to characterize the uncertainties and develop best practices for processing and analyzing TEMPO data. Methods for oversampling TEMPO data to 1 km resolution are being applied over the target areas to resolve fine-scale emission sources and pollutant gradients. Machine learning techniques using TEMPO, surface monitor, and model data to estimate surface-level nitrogen dioxide concentrations are being developed over the target areas. A SPoRT viewer for TEMPO has been launched for providing visualizations of the TEMPO products and an ArcGIS dashboard is being designed for enabling air agency stakeholders to efficiently analyze TEMPO data. Training materials including user guides are being developed to ensure the effective and sustained use of TEMPO data at our stakeholder agencies. One major goal of our TEMPO initiatives at SPoRT is to better enable the inclusion of TEMPO data in air quality management applications such as exceptional event demonstrations through our close engagement with stakeholders. This talk will provide an update on our SPoRT activities and showcase use cases of TEMPO data for monitoring different emission sources including wildland fire smoke.

Air Quality↗
NASA NTRS2011

Engineering and Scientific Applications: Using MatLab(Registered Trademark) for Data Processing and Visualization

MatLab(TradeMark)(MATrix LABoratory) is a numerical computation and simulation tool that is used by thousands Scientists and Engineers in many countries. MatLab does purely numerical calculations, which can be used as a glorified calculator or interpreter programming language; its real strength is in matrix manipulations. Computer algebra functionalities are achieved within the MatLab environment using "symbolic" toolbox. This feature is similar to computer algebra programs, provided by Maple or Mathematica to calculate with mathematical equations using symbolic operations. MatLab in its interpreter programming language form (command interface) is similar with well known programming languages such as C/C++, support data structures and cell arrays to define classes in object oriented programming. As such, MatLab is equipped with most of the essential constructs of a higher programming language. MatLab is packaged with an editor and debugging functionality useful to perform analysis of large MatLab programs and find errors. We believe there are many ways to approach real-world problems; prescribed methods to ensure foregoing solutions are incorporated in design and analysis of data processing and visualization can benefit engineers and scientist in gaining wider insight in actual implementation of their perspective experiments. This presentation will focus on data processing and visualizations aspects of engineering and scientific applications. Specifically, it will discuss methods and techniques to perform intermediate-level data processing covering engineering and scientific problems. MatLab programming techniques including reading various data files formats to produce customized publication-quality graphics, importing engineering and/or scientific data, organizing data in tabular format, exporting data to be used by other software programs such as Microsoft Excel, data presentation and visualization will be discussed.

Sen, Syamal K.↗
NASA NTRS2013

Scatter-Reducing Sounding Filtration Using a Genetic Algorithm and Mean Monthly Standard Deviation

Retrieval algorithms like that used by the Orbiting Carbon Observatory (OCO)-2 mission generate massive quantities of data of varying quality and reliability. A computationally efficient, simple method of labeling problematic datapoints or predicting soundings that will fail is required for basic operation, given that only 6% of the retrieved data may be operationally processed. This method automatically obtains a filter designed to reduce scatter based on a small number of input features. Most machine-learning filter construction algorithms attempt to predict error in the CO2 value. By using a surrogate goal of Mean Monthly STDEV, the goal is to reduce the retrieved CO2 scatter rather than solving the harder problem of reducing CO2 error. This lends itself to improved interpretability and performance. This software reduces the scatter of retrieved CO2 values globally based on a minimum number of input features. It can be used as a prefilter to reduce the number of soundings requested, or as a post-filter to label data quality. The use of the MMS (Mean Monthly Standard deviation) provides a much cleaner, clearer filter than the standard ABS(CO2-truth) metrics previously employed by competitor methods. The software's main strength lies in a clearer (i.e., fewer features required) filter that more efficiently reduces scatter in retrieved CO2 rather than focusing on the more complex (and easily removed) bias issues.

Mandrake, Lukas↗
NASA NTRS2014

A One-Dimensional Global-Scaling Erosive Burning Model Informed by Blowing Wall Turbulence

This paper makes no attempt to comprehensively review erosive burning models or the data collected in pursuit of them; the interested reader could begin with Landsbaum for a historical summary. However, a discussion and comparison to recent work by McDonald and Rettenmaier and Heister will be included, along with data generated by Strand, et. al. Suffice it to say that the search for a way to predict erosive burning in any size motor with formulas cleanly applicable to a typical 1D ballistics analysis has been long thwarted. Some models were based on testing that failed to adequately simulate the solid rocket motor environment. In most cases, no real‐time burn rate measurement was available. Two popular models, even when calibrated to recent motor‐like real‐time burn rate data obtained by Furfaro, were shown by McMillin to be inadequate at modeling erosive burning in the Space Shuttle Reusable Solid Rocket Motor (RSRM), the Space Launch Systems' Five‐Segment RSRM (RSRMV), and the five‐segment Engineering Test Motor (ETM)‐3. Subsequently to the data cited from Strand and Furfaro, additional motors of the same kind as Furfaro's were tested with RSRMV propellant, utilizing 7 segments per motor and 3 throat sizes. By measuring propellant web thickness with ultrasonic gages, the burn rate was determined at cross‐flow Mach numbers up to Mach 0.8. Furthermore, because of the different throat sizes in otherwise identical motors, this provides a unique look at the effect of pressure and base burn rate on the erosive response. Figure 1 shows example of the data pertaining to the high Mach motor, where the port area is initially less than the throat area. The burn rate data was processed using a smoothing method developed to reduce the noise without too severely introducing end effects that limit the range of useful data. Then, an empirical ballistics scheme was used to estimate the flow condition based on the burn rate measurements and pressure measured between each segment.

Kibbey, Timothy P.↗
NASA NTRSDate not supplied

Artemis I Flight Instrumentation Data Quality Assessment and Processing

This paper is in support of the SciTech 2024 Space Launch System Aerosciences Special Sessions being organized by Brent Pomeroy and Jeremy Pinier. On November 16th, 2022, NASA launched the inaugural test flight of the Space Launch System (SLS) carrying the Orion capsule into a high orbit far beyond the Moon. The launch vehicle was instrumented with over three thousand flight instrumentation sensors, which monitored aerodynamic, acoustic, structural, and thermal environments. These data are intended to validate experimental and numerical tools used to predict the design environments which the vehicle experiences during launch and ascent. Prior to launch, tests were performed at the SLS Systems Integration Laboratory (SIL) using flight-like avionics and on the integrated flight hardware of Artemis I at the Vehicle Assembly Building (VAB). The purpose of these tests was to characterize the data acquisition units (DAUs) used to record and telemeter flight data to ground stations in order to assure that flight test objectives can be achieved and to quantify the expected quality of the flight data. In addition, pre-flight assessment and development of tools and methods used to process and disseminate flight data at the Huntsville Operations Support Center (HOSC) were conducted and adjustments made with respect to DAU time-synchronization prior to and after the flight. This paper summarizes these tests and some aspects of the post processing of data are discussed.

Developmental Flight Instrumentation↗
NASA NTRSDate not supplied

Development of Solar Flare and Energetic Particle Prediction Portal (SEP 3 )

Solar activity is a primary factor determining the state of the Earth’s space environment, geomagnetic and ionospheric disturbances, and radiation hazards. In the current state of knowledge, machine learning (ML) methods provide essential tools for processing data, investigating relationships among various physical properties and characteristics, uncovering hidden connections, and predicting hazardous solar events. The primary difficulty in developing and applying modern machine-learning tools in heliophysics is that the essential data are scattered among over a hundred data repositories developed by instrument teams of space missions and ground-based observatories. In addition, statistical and ML methods require long time series of homogeneous measurements. To facilitate ML-ready data preparation and access, we have developed an interactive database of solar flares integrating the most essential datasets (https://solarflare.njit.edu/). The database performs an initial data processing and is automatically updated. In addition, we are developing the Solar Energetic Particle Prediction Portal (SEP3, https://sun.njit.edu/SEP3), which hosts web applications that allow users to retrieve the database records. The Portal has a search page for browsing the events from the most widely used catalogs and a dedicated space to share the most recent achievements of the team. The interactive widget can display soft X-ray and proton flux time series from GOES satellites and the flare records. The data portal has been used to evaluate the forecasts of solar proton events and investigate machine-learning approaches to SEP prediction.

SMD↗
NASA NTRSDate not supplied

Validation of a Probabilistic Continuity Assessment Method for Earth Observation Portfolios

With the increased reliance on spaceborne Earth observation data among the Earth science community and other end users, it is important that efforts are made to promote data continuity for a range of parameters of interest. Continuity gaps may occur between missions measuring like parameters due to mission development delays or early termination and introduce the potential of increased uncertainty for retrieved parameters. To inform portfolio-level decisions for Earth observing missions, Ivanco et al. developed a method that enables the assessment of the probability of continuity gaps for multi-mission architectures and provides a framework to assess this probability in the context of multiple scenarios that represent possible future states of the architecture [Ivanco et al., “A Scenario-Based Approach to Assess Continuity Gaps in Earth Observations,” IEEE Aerospace Conf., 2024]. While this method was previously applied to assess continuity gaps for a specific multi-mission architecture, it had not yet been validated with historical data. This paper outlines the process of validating the probabilistic gap assessment method by utilizing data obtained from past NASA Earth Science mission formulation documents and provides a discussion of the results and takeaways from the validation. Future areas of improvement pertaining to both the modeling and simulation methodologies and underlying assumptions are identified and discussed.

Katharine Burn↗
NASA NTRS2013

Systems and Methods for Radar Data Communication

A radar information processing system is operable to process high bandwidth radar information received from a radar system into low bandwidth radar information that may be communicated to a low bandwidth connection coupled to an electronic flight bag (EFB). An exemplary embodiment receives radar information from a radar system, the radar information communicated from the radar system at a first bandwidth; processes the received radar information into processed radar information, the processed radar information configured for communication over a connection operable at a second bandwidth, the second bandwidth lower than the first bandwidth; and communicates the radar information from a radar system, the radar information communicated from the radar system at a first bandwidth.

Bunch, Brian↗
NASA NTRSDate not supplied

Improving Sim-to-Real Transfer in Vision-Based Robot Navigation Via Instance-Level GAN-Based Data Augmentation

Achieving robust vision-based robotic tasks requires large amounts of data, which are often difficult to obtain in real-world scenarios. Simulators and synthetic data offer a cost-effective alternative, but the visual gap between simulation and reality hinders the performance of models when deployed in real-world environments. In this paper, we present a data augmentation pipeline that integrates a foundation model (Segment Anything Model) with an unsupervised image-to-image translation model (CycleGAN) for instance-level domain transfer from simulation to reality. This pipeline enables the generation of realistic labeled data from synthetic images for training supervised machine learning models in vision-based navigation tasks. We evaluate our approach on real-world data for ego-vehicle pose estimation, a critical autonomous navigation task involving the prediction of cross-track position and heading angle relative to road center line markings. The results of our tests show that our GAN-based data augmentation pipeline significantly outperforms models trained solely on simulation data or on data processed with standard image augmentation methods for sim-to-real transfer, enhancing model robustness and generalizability in real-world scenarios. Our method provides a scalable and flexible data augmentation tool for leveraging large synthetic datasets to enhance vision-based robotic navigation tasks.

artificial intelligence↗
NASA NTRS1971

Automatic processing of multispectral observations

Statistical methods for inventory boundary determination and data compression in automatic processing of multispectral scanner remote sensor earth observations from aircraft and spacecraft

Krause, F. R.↗
NASA NTRS1995

Observational magnetometer calibration with the Hubble Space Telescope's new magnetometers

The two magnetometers recently replaced on the Hubble Space Telescope during the STS-61 Servicing Mission are now being used successfully for Coarse Attitude Determination during spacecraft vehicle safemode recovery operation. The magnetometer alignments relative to the spacecraft's vehicle's reference frame and the magnetic coupling of the sensors to the four magnetic torquer bars were determined. Coarse Attitude determination errors are now reduced to an average of 0.6 deg. Magnetometer Sensing System calibration and Coarse Attitude determination testing with the new calibration parameters is a geometrical problem. Telemetered earth magnetic field data was collected at twenty-six different vehicle attitudes. The spacecraft attitudes selected were distributed as widely apart as possible throughout the Geocentric Inertial Coordinate reference frame. It is also desirable to sample the Earth's magnetic field over as many different locations of the spacecraft's passage over the Earth as possible, within the limitation of the +/- 28.5 deg orbital inclination. A full range of magnetic moment outputs from the torquer bars needs to be sampled, +/- 3600 ampmeters squared, as well as data when the torquer bars have zero current. Graphic utilities were also developed to visually aid in optimizing the data collection process. Finally, a brief discussion of a method for collecting data for future calibrations is suggested.

Broude, Sidney M.↗
NASA NTRS2016

Constructing the 'Best' Reliability Data for the Job - Developing Generic Reliability Data from Alternative Sources Early in a Product's Development Phase

Reliability practitioners advocate getting reliability involved early in a product development process. However, when assigned to estimate or assess the (potential) reliability of a product or system early in the design and development phase, they are faced with lack of reasonable models or methods for useful reliability estimation. Developing specific data is costly and time consuming. Instead, analysts rely on available data to assess reliability. Finding data relevant to the specific use and environment for any project is difficult, if not impossible. Instead, analysts attempt to develop the "best" or composite analog data to support the assessments. Industries, consortia and vendors across many areas have spent decades collecting, analyzing and tabulating fielded item and component reliability performance in terms of observed failures and operational use. This data resource provides a huge compendium of information for potential use, but can also be compartmented by industry, difficult to find out about, access, or manipulate. One method used incorporates processes for reviewing these existing data sources and identifying the available information based on similar equipment, then using that generic data to derive an analog composite. Dissimilarities in equipment descriptions, environment of intended use, quality and even failure modes impact the "best" data incorporated in an analog composite. Once developed, this composite analog data provides a "better" representation of the reliability of the equipment or component. It can be used to support early risk or reliability trade studies, or analytical models to establish the predicted reliability data points. It also establishes a baseline prior that may updated based on test data or observed operational constraints and failures, i.e., using Bayesian techniques. This tutorial presents a descriptive compilation of historical data sources across numerous industries and disciplines, along with examples of contents and data characteristics. It then presents methods for combining failure information from different sources and mathematical use of this data in early reliability estimation and analyses.

Kleinhammer, Roger K.↗
NASA NTRS2011

Engineering and Scientific Applications: Using MatLab(Registered Trademark) for Data Processing and Visualization

MatLab(R) (MATrix LABoratory) is a numerical computation and simulation tool that is used by thousands Scientists and Engineers in many cou ntries. MatLab does purely numerical calculations, which can be used as a glorified calculator or interpreter programming language; its re al strength is in matrix manipulations. Computer algebra functionalities are achieved within the MatLab environment using "symbolic" toolbo x. This feature is similar to computer algebra programs, provided by Maple or Mathematica to calculate with mathematical equations using s ymbolic operations. MatLab in its interpreter programming language fo rm (command interface) is similar with well known programming languag es such as C/C++, support data structures and cell arrays to define c lasses in object oriented programming. As such, MatLab is equipped with most ofthe essential constructs of a higher programming language. M atLab is packaged with an editor and debugging functionality useful t o perform analysis of large MatLab programs and find errors. We belie ve there are many ways to approach real-world problems; prescribed methods to ensure foregoing solutions are incorporated in design and ana lysis of data processing and visualization can benefit engineers and scientist in gaining wider insight in actual implementation of their perspective experiments. This presentation will focus on data processing and visualizations aspects of engineering and scientific applicati ons. Specifically, it will discuss methods and techniques to perform intermediate-level data processing covering engineering and scientifi c problems. MatLab programming techniques including reading various data files formats to produce customized publication-quality graphics, importing engineering and/or scientific data, organizing data in tabu lar format, exporting data to be used by other software programs such as Microsoft Excel, data presentation and visualization will be discussed. The presentation will emphasize creating practIcal scripts (pro grams) that extend the basic features of MatLab TOPICS mclude (1) Ma trix and vector analysis and manipulations (2) Mathematical functions (3) Symbolic calculations & functions (4) Import/export data files (5) Program lOgic and flow control (6) Writing function and passing parameters (7) Test application programs

Sen, Syamal K.↗
NASA NTRS1998

On-Line Robust Modal Stability Prediction using Wavelet Processing

Wavelet analysis for filtering and system identification has been used to improve the estimation of aeroservoelastic stability margins. The conservatism of the robust stability margins is reduced with parametric and nonparametric time- frequency analysis of flight data in the model validation process. Nonparametric wavelet processing of data is used to reduce the effects of external disturbances and unmodeled dynamics. Parametric estimates of modal stability are also extracted using the wavelet transform. Computation of robust stability margins for stability boundary prediction depends on uncertainty descriptions derived from the data for model validation. The F-18 High Alpha Research Vehicle aeroservoelastic flight test data demonstrates improved robust stability prediction by extension of the stability boundary beyond the flight regime. Guidelines and computation times are presented to show the efficiency and practical aspects of these procedures for on-line implementation. Feasibility of the method is shown for processing flight data from time- varying nonstationary test points.

Brenner, Martin J.↗