Search NASA⌕ Search

SEARCH · Search NASA

Results for “data cleaning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

EPCAPE-Dalhousie Field Campaign Report

This project supported the Eastern Pacific Cloud Aerosol Precipitation Experiment (EPCAPE), which aimed to characterize the extent, radiative properties, aerosol interactions, and precipitation of stratocumulus clouds in the Eastern Pacific coastal region of La Jolla, California. Given the frequent anthropogenic aerosols emitted into this region, characterization of this important coastal cloud region and the aerosol impact on the cloud characteristics will improve the understanding of aerosol indirect effects and its representation in global climate models. This specific project deployed the fog droplet monitor (FM-120, Droplet Measurement Technologies) at the Scripps Institution of Oceanography’s Mt. Soledad site from 16 February 2023 to 15 February 2024. This instrument measured droplet number size spectra between 2 and 50 microns, from which droplet number concentration, liquid water content, and effective diameter were calculated. These measurements will be used to characterize the seasonal variability of clouds at Mt. Soledad and investigate differences in cloud properties under regional polluted and clean marine conditions. The collected data will soon be posted as part of the digital collection for EPCAPE data hosted by the University of California, San Diego (Russell et al. 2023).

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1995

Airframe noise prediction evaluation

The objective of this study is to evaluate the accuracy and adequacy of current airframe noise prediction methods using available airframe noise measurements from tests of a narrow body transport (DC-9) and a wide body transport (DC-10) in addition to scale model test data. General features of the airframe noise from these aircraft and models are outlined. The results of the assessment of two airframe prediction methods, Fink's and Munson's methods, against flight test data of these aircraft and scale model wind tunnel test data are presented. These methods were extensively evaluated against measured data from several configurations including clean, slat deployed, landing gear-deployed, flap deployed, and landing configurations of both DC-9 and DC-10. They were also assessed against a limited number of configurations of scale models. The evaluation was conducted in terms of overall sound pressure level (OASPL), tone corrected perceived noise level (PNLT), and one-third-octave band sound pressure level (SPL).

Yamamoto, Kingo J.↗
NASA NTRS1999

The Unit of Lightning

For the past century, scientists have made quantitative measurements of lightning discharges. In the process, they refined the definition of a lightning unit, or basic quantum of lightning, in order to base it on observable parameters. Although many components of a lightning discharge have been identified, lightning usually occur in groups of discharges or pulses that, although complex, can be organized into units of flashes. This unit definition is based mainly on measurements of lightning from electric field, video, and ground flash lightning locating networks. More recent instrumentation with various combinations of high sensitivity, high temporal, or high spatial resolution often measure signals produced by lightning that do not cleanly divide into flashes. The data from these systems indicate the need or a more fundamental unit for lightning. Such a unit would be of benefit for both basic understanding of lightning and comparing lightning information between instruments. Without a common lightning unit definition, intercomparisons are difficult. For an example, the Lightning Detection And Ranging system (LDAR) at Kennedy Space Center (KSC) have detected ,flash' rates as high as 600 per minute while analysis based on the Advanced Ground Based Field Mill network (AGBFM) detect only 33 "flashes" per minute in the same area and time periods. The satellite based Optical Transient Detector (OTD) and Lightning Imaging Sensor (LIS) sometimes see single "flashes" that last longer than 10 seconds. Such long duration flashes are not found in electric field records or ground strike location system data sets. The unit of lightning should be based on the fundamental components of the lightning discharge. This should make the unit as generally applicable as possible. For example, studies of NO(x) production by lightning depend on parameters of the individual lightning channels and not the summary flash characteristics. For such studies, the best unit of lightning may be closer to the classical stroke in the electric field data sets, flash in the LDAR data sets, and group in the OTD/LIS data sets. For this type of study, however, more than just the stroke count information is needed. In this paper, we will outline the current definitions of the unit of lightning and propose new basic definitions for the unit of lightning. Since different instruments detect lightning in different ways and different studies may need almost mutually exclusive aspects of the lightning discharge, there may not be a single definition of the unit of lightning that can be applied to all systems and all studies. However, common components can be found since all instrumentation are detecting aspects of the same phenomenon.

Mach, Douglas M.↗
NASA NTRS2001

Methanol Uptake by Low Temperature Aqueous Sulfuric Acid Solutions

The global methanol budget is currently unbalanced, with source terms significantly larger than the sinks terms. To evaluate possible losses of gaseous methanol to sulfate aerosols, the solubility and reactivity of methanol in aqueous sulfuric acid solutions representative of upper tropospheric and lower stratospheric aerosols is under investigation. Methanol will partition into sulfate aerosols according to its Henry's law solubility. Using standard uptake techniques in a Knudsen cell reactor, we have measured the effective Henry's law coefficient, H*, for cold (196 - 220 K) solutions ranging between 45 and 70 wt % H2SO4. We have found that methanol solubility ranges from approx. 10(exp 5) - 10(exp 7) M/atm for UT/LS conditions. Solubility increases with decreasing temperature and with increasing sulfuric acid content. Although methanol is slightly more soluble than are acetone and formaldehyde, current data indicate that uptake by clean aqueous sulfuric acid particles will not be a significant sink for methanol in the UT/LS. These solubility measurements include uptake due to physical solvation and any rapid equilibria which are established in solution. Reaction between primary alcohols and sulfuric acid does occur, leading to the production of alkyl sulfates. Literature values for the rate of this reaction suggest that formation of CH3OSO3H is not significant over our experimental time scale for solutions below 80 wt % H2SO4. To confirm this directly, results obtained using a complementary equilibrium measurement technique will also be presented.

Iraci, L. T.↗
NASA NTRSDate not supplied

A Study of the Curation Protocol by Sample Analysis Working Team (SAWT) in Martian Moons eXploration (MMX) Project

Japan Aerospace Exploration Agency (JAXA) will launch a spacecraft in 2024 for a sample return mission from Phobos (Martian Moons eXploration: MMX). The major scientific goals of MMX are to constrain (1) the origin of Phobos and Deimos and (2) the evolution of the Mars-moon system [1]. The touchdown operations are planned to be performed twice at different landing sites on the Phobos surface to collect > 10 g of the surface materials [2]. After the return to the Earth, the Phobos samples will be collected from the individual sample canisters and introduced to the clean chamber installed at ISAS (Institute of Space and Astronautical Science). The Sample Analysis Working Team (SAWT) of MMX designed the procedure of Phobos sample analysis mainly conducted by the initial analysis teams [3]. For the next step, the SAWT will define the procedure of the curation process (mostly non-destructive analysis) of the Phobos samples, which will be presented here. The protocols of the Phobos sample curation is illustrated in figure 1. First, the headspace gas from the sample container will be collected during the Quick Analysis phase. The Quick Analysis will be operated by the sampler and curation teams in ISAS/JAXA. The terrestrial leak and contamination from the sampling systems will be tested using a quadrupole mass spectrometer equipped with a gas sampling system. Second, the bulk Phobos sample will be observed in the clean chamber under purified-N2 gas with an ambient condition (Pre-basic Characterization). This phase will be operated by the curation team in ISAS/JAXA and the instrument team of the MMX mission. The consistency between the data from the instruments in the clean chamber and the spacecraft will then be evaluated. Subsequently, the curation will distribute the small amount of Phobos samples to the Initial analysis team of MMX to conduct the "Preliminary Examination". The objectives of the preliminary examination are to provide (1) feedback on the subsequent sample allocation process, (2) preliminary scientific results that will address parts of MMX mission goals, and (3) evaluation of the sampling system and terrestrial alteration on Phobos samples. Because multiple models are proposed for the origin of Phobos [1] (e.g., giant impact, the capture of asteroids), the chemical and mineralogical characteristics of Phobos must be assessed before the allocation of the samples to the individual initial analysis teams. Simultaneously, the curation team in JAXA will observe the individual grains and aliquots of the samples in the clean chamber (Basic Characterization).

R Fukai↗
DOE OSTI2025

Heating effects on jack pine pyrogenic organic matter properties from a pyrocosm study in 2022

This dataset contains data associated with the preprint “Fire removes preexisting pyrogenic organic matter from the ecosystem through the mechanisms of both direct combustion and increasing mineralizability” (Luo et al., 2025b), which is the complementary study to the published paper “Reburning pyrogenic organic matter: a laboratory method for dosing dynamic heat fluxes from above” (Luo et al., 2025a). We designed a full-factorial experiment with different burial depths of jack pine (Pinus banksiana Lamb) pyrogenic organic matter (PyOM) (Surface, 1 cm, and 5 cm) and different heat-flux profiles (High, Low, and Control) to examine how subsequent fires affect the properties of preexisting PyOM. We measured total carbon (C), pH, dissolved organic carbon (DOC), dissolved inorganic carbon (DIC), and mineralized C (as CO₂-C, from a 12-week incubation).We found that high heat flux and/or surface placement resulted in substantial direct C losses through combustion. Intermediate heat exposure produced both combustion losses and increases in DOC and mineralizability, which may have complex long-term implications: an increased dissolved fraction of PyOM may promote downward transport into mineral soils and potentially contribute to deeper, longer-term C storage, but it may also make PyOM more susceptible to microbial decomposition. Under the lowest heat flux and deepest burial, most PyOM was retained, and changes in DOC and C mineralization were minimal. Finally, PyOM pH, an important chemical property, decreased under low-temperature heating but increased under higher temperatures.We uploaded pH data for all samples (“pH_of_all_samples.csv”); pH and temperature-related data (peak temperature and degree hours) for samples in High and Low heat-flux treatments (“pH_vs_peakT_and_degree_hours_only_for_heated_samples.csv”); total C data (“CN_pct_C_stock_C_loss_in_samples.csv”); DOC and DIC data (“doc_dic.csv”); and mineralized C (CO₂-C) data (“CO2-C_all_original.csv”). Additional details can be found in the Methods & Sampling section.All datasets uploaded to ESS-DIVE are clearly labeled, cleaned, and include both raw and derived data, ready for reuse in other analyses. All analysis code and raw datasets are also available on GitHub: https://github.com/MengmengLuo/Fire-removes-preexisting-pyrogenic-organic-matter-from-the-ecosystem.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1980

Conference on Applications of Digital Image Processing to Astronomy, Pasadena, Calif., August 20-22, 1980, Proceedings

The astronomic applications of non-military digital image processing are covered in this conference volume. Systems like CCD's, interactive data analysis facilities, stellar speckle interferometry, sky flux subsystems, guide star systems and various image processing systems are described. Techniques in photometry including filtering, automatic photometry, and image restoration are examined. Digital spectral analyses of galaxies, supernova remnants, stars and other celestial bodies are discussed together with algorithms developed to calibrate, clean up, enhance, and quantitatively analyze data. The techniques of image processing permit astronomers to make much more efficient use of their data for both subjective and quantitative analyses. Future missions, such as the Space Telescope, representing a vast data base are briefly covered.

Elliott, D. A.↗
DOE OSTI2024

Machine Learning (ML) Classifier to Assist Metadata Creation

The Atmospheric Radiation Measurement (ARM) Data Center is responsible for the timely collection, archival, and curation of science data products. These products are freely available through an online data repository. Metadata creation is paramount for scientific users to find and access over seven petabytes of atmospheric science data. The hierarchical metadata structure allows users to search for information at both broad and narrow levels. This project aims to leverage 30 years’ worth of manually created metadata to enable machine predictions of broad-term classifications from narrow-term descriptions. These classification predictions would assist metadata coordinators with their term selections. This paper discusses the cleaning and preprocessing of the training data, the pipeline developed to determine the best model for this task, and the creation of an API metadata classifier for ARM measurement metadata. Our results show that the Linear Support Vector Classification (LinearSVC) algorithm, along with the Term Frequency – Inverse Document Frequency (TF-IDF) vectorizer, is well-suited for our multi-class classification task. Lengthier input training data led to better results, and artificial balancing was unnecessary for this particular use case. This predictive classifier enhances efficiency in metadata creation, as well as supports greater consistency and accuracy in metadata tagging.

Collier, Hannah [ORNL] (ORCID:0000000341284292)↗
NASA NTRS2004

Gas Density Discontinuities in Merging Clusters

In a number of galaxy clusters, Chandra has discovered a new phenomenon, the sharp gas density edges. Depending on the sign of the temperature jump across the edge, these features may either be bow shocks or cold fronts. While the merger origin of the bow shocks is unambiguous, what causes cold fronts is not entirely clear, as they are observed both in mergers and in relaxed clusters. The purpose of the study of A3376, an interesting cluster with density edges, is to understand the origin of cold fronts and to look for possible shocks. This cluster also has a radio halo, and comparison of an X-ray temperature map and radio image may shed light on the nature of the cluster radio halos, which is our secondary goal. The XMM data for A3376 have been obtained, processed and cleaned. Most of the preliminary analysis, including deriving a temperature map, is complete. We also have Chandra data for this cluster, and intend to compare and combine the two datasets. We are well underway toward determining the dynamical state of A3376 and the nature of its gas density discontinuities.

Mushotzky, Richard↗
NASA NTRS2011

Technical Tension Between Achieving Particulate and Molecular Organic Environmental Cleanliness: Data from Astromaterial Curation Laboratories

NASA Johnson Space Center operates clean curation facilities for Apollo lunar, Antarctic meteorite, stratospheric cosmic dust, Stardust comet and Genesis solar wind samples. Each of these collections is curated separately due unique requirements. The purpose of this abstract is to highlight the technical tensions between providing particulate cleanliness and molecular cleanliness, illustrated using data from curation laboratories. Strict control of three components are required for curating samples cleanly: a clean environment; clean containers and tools that touch samples; and use of non-shedding materials of cleanable chemistry and smooth surface finish. This abstract focuses on environmental cleanliness and the technical tension between achieving particulate and molecular cleanliness. An environment in which a sample is manipulated or stored can be a room, an enclosed glovebox (or robotic isolation chamber) or an individual sample container.

Allton, J. H.↗
NASA NTRS1993

User friendly database for Neptune planetary radio astronomy observations

Planetary Radio Astronomy (PRA) data from the Voyager Neptune encounter were cleaned and reformatted in a variety of formats. Most of these formats are new and have been specifically designed to provide easy access and use of the data without the need to understand esoteric characteristics of the PRA instrument or the Voyager spacecraft. Several data sets were submitted to the Planetary Data System (PDS) and have either appeared already on peer reviewed CDROM's or are in the process of being reviewed for inclusion in forthcoming CD-ROM's. Many of the data sets are also available online electronically through computer networks; it is anticipated that as time permits, the PDS will make all the data sets that were a part of this contract available both online and on CD-ROM's.

Evans, David R.↗
NASA NTRS2011

Next-Generation Aura/OMI NO2 and SO2 Products

The measurement of both SO2 and NO2 gases are recognized as an essential component of atmospheric composition missions. We describe current capabilities and limitations of the operational Aura/OMI NO2 and SO2 data that have been used by a large number of researchers. Analyses of the data and validation studies have brought to light a number of areas in which these products can be expanded and improved. Major improvements for new NASA standard (SP) NO2 product include more accurate tropospheric and stratospheric column amounts, along with much improved error estimates and diagnostics. Our approach uses a monthly NO2 climatology based on the NASA Global Modeling Initiative (GMI) chemistry-transport model and takes advantage of OMI data from cloudy scenes to find clean areas where the contribution from the trap NO2 column is relatively small. We then use a new filtering, interpolation and smoothing techniques for separating the stratospheric and tropospheric components of NO2, minimizing the influence of a priori information. The new algorithm greatly improves the structure of stratospheric features relative to the original SP. For the next-generation OMI SO2 product we plan to implement operationally the offline iterative spectral fitting (ISF) algorithm and re-process the OMI Level-2 SO2 dataset using a priori SO2 and aerosol profiles, clouds, and surface reflectivity appropriate for observation conditions. This will improve the ability to detect and quantify weak tropospheric SO2 loadings. The new algorithm is validated using aircraft in-situ data during field campaigns in China (2005 and 2008) and in Maryland (Frostburg, 2010 and DISCOVER-AQ in July 2011). The height of the SO2 plumes will also be estimated for high SO2 loading cases (e.g., volcanic eruptions). The same SO2 algorithm will be applied to the data from OMPS sensor to be launched on NPP satellite later this year. The next-generation NO2 and SO2 products will provide critical information (e.g., averaging kernels) for evaluation of chemistry-transport models, for data assimilation, and to impose top-down constraints on the SO2 and NO2 emission sources.

Krotkov, Nickolay↗
NASA NTRS2014

Development of Genesis Solar Wind Sample Cleanliness Assessment: Initial Report on Sample 60341 Optical Imagery and Elemental Mapping

Since 2005 the Genesis science team has experimented with techniques for removing the contaminant particles and films from the collection surface of the Genesis fragments. A subset of ~40 samples have been designated as "cleaning matrix" samples. These are small samples to which various cleaning approaches are applied and then cleanliness is assessed optically, by TRXRF, SEM, ToF-SIMS, XPS, ellipsometry or other means [1-9]. Most of these sam-ples remain available for allocation, with cleanliness assessment data. This assessment allows evaluation of various cleaning techniques and handling or analytical effects. Cleaning techniques investigated by the Genesis community include acid/base etching, acetate replica peels, ion beam, and CO2 snow jet cleaning [10-16]. JSC provides surface cleaning using UV ozone exposure and ultra-pure water (UPW) [17-20]. The UPW rinse is commonly used to clean samples for handling debris between processing by different researchers. Optical microscopic images of the sample taken before and after UPW cleaning show what has been added or removed during the cleaning process.

Gonzalez, C. P.↗
DOE OSTI2025

Reconstruction framework advancements to support streaming for the ePIC detector at the EIC

The ePIC collaboration adopted the JANA2 framework to manage its reconstruction algorithms. This framework has since evolved substantially in response to ePIC’s needs. There have been three main design drivers: integrating cleanly with the Podio-based data models and other layers of the key4hep stack, enabling external configuration of existing components, and supporting timeframe splitting for streaming readout. The result is a unified component model featuring a new declarative interface for specifying inputs, outputs, parameters, services, and resources. This interface enables the user to instantiate, configure, and wire components via an external file. One critical new addition to the component model is a hierarchical decomposition of data boundaries into levels such as Run, Timeframe, PhysicsEvent, and Subevent. Two new component abstractions, Folder and Unfolder, are introduced in order to traverse this hierarchy, e.g. by splitting or merging. The pre-existing components can now operate at different event levels, and JANA2 will automatically construct the corresponding parallel processing topology. This means that a user may write an algorithm once, and configure it at runtime to operate on timeframes or on physics events. Overall, these changes mean that the user requires less knowledge about the framework internals, obtains greater flexibility with configuration, and gains the ability to reuse the existing abstractions in new streaming contexts.

Brei, Nathan [Thomas Jefferson National Accelerato↗
DOE OSTI2026

Database of virus genomes from ultra-deep sequencing of wastewater

Researchers at University of Missouri have conducted ultra-deep RNA sequencing of viral concentrates from wastewater (1 billion Illumina reads per sample). The resulting dataset spans 321 samples collected weekly from 11 cities between 2023-2025. As part of a tri-lab collaboration, scientists at LLNL and LANL cleaned, assembled, and annotated this metagenomic data, identifying nearly 200,000 viral genomes. Careful data curation resulted in a database containing 21,015 high-quality, near-complete viral genomes from wastewater. This database contains viruses predicted to infect a range of hosts including bacteria (most common viruses), plants (most abundant viruses), and vertebrates (rarest viruses). There are also numerous novel viruses that could not be well identified and whose host(s) are unknown. Just 7% of all genomes in the wastewater virus database had genus-level matches in the public NCBI database, and 17% matched to a recently created metagenomic virus database at that level (metaVR). The database will provide baseline information about viruses in wastewater that may be used to additional identify novel viruses during ongoing monitoring

Allen, Jonathan [Lawrence Livermore National Labor↗
NASA NTRS1976

A study of the toxicology of pyrolysis gases from synthetic polymers

An apparatus and procedure for evaluating the toxicity of pyrolysis gases from synthetic polymers are described. In each test, four Swiss albino mice are exposed in a 5-liter chamber to the gases from materials pyrolyzed at 700 C. The apparatus is simple in design, easy to clean, inexpensive and gives reproducible results. Data on several fluorine-containing and polyamide polymers are presented.

Young, W.↗
NASA NTRS2009

Autonomously Calibrating a Quadrupole Mass Spectrometer

A computer program autonomously manages the calibration of a quadrupole ion mass spectrometer intended for use in monitoring concentrations and changes in concentrations of organic chemicals in the cabin air of the International Space Station. The instrument parameters calibrated include the voltage on a channel electron multiplier, a discriminator threshold, and an ionizer current. Calibration is achieved by analyzing the mass spectrum obtained while sweeping the parameter ranges in a heuristic procedure, developed by mass spectrometer experts, that involves detection of changes in signal trends that humans can easily recognize but cannot necessarily be straightforwardly codified in an algorithm. The procedure includes calculation of signal-to-noise ratios, signal-increase rates, and background-noise-increase rates; finding signal peaks; and identifying peak patterns. The software provides for several recovery-from-error scenarios and error-handling schemes. The software detects trace amounts of contaminant gases in the mass spectrometer and notifies associated command- and-data-handling software to schedule a cleaning. Furthermore, the software autonomously analyzes the mass spectrum to determine whether the parameters of a radio-frequency ramp waveform are set properly so that the peaks of the mass spectrum are at expected locations.

Lee, Seungwon↗
NASA NTRS2013

Robonaut 2 - Preparing for Intra-Vehicular Mobility on the International Space Station

Robonaut 2 (R2) has been undergoing experimental trials on board the International Space Station (ISS) for more than a year. This upper-body anthropomorphic robotic system shown in Figure 1 has been making steady progress after completing its initial checkout. R2 demonstrated free space motion, physically interacted with its human crew mates, manipulated interfaces on its task board and has even used its first tool. This steady growth in capability will lead R2 to its next watershed milestone. Developers are currently testing prototype robotic climbing appendages and a battery backpack in preparation of sending flight versions of both subsystems to the ISS in late 2013. Upon integration of its new components, R2 will be able to go mobile inside the space station with a twofold agenda. First, R2 will learn to maneuver in microgravity in the best possible laboratory for such a task. Second, it will start providing early payback to the ISS program by helping with intra-vehicular (IVA) maintenance tasks. The experience gained inside the ISS will be invaluable in reducing risk when R2 moves to its next stage and is deployed as an extra-vehicular (EVA) tool. Even on its current fixed base stanchion, R2 has already shown its capability of performing several maintenance tasks on the ISS. It has measured the air flow through one of the stations vents and provided previously unavailable real time flow data to ground operators. R2 has cleaned its first handrail, exciting some crew members that perhaps Saturday morning housekeeping on the station may someday become a task they can hand off to their robotic colleague. Other tasks, including using radio frequency identification (RFID) tools for inventory tasks or vacuuming air filters, have also been suggested and will be explored. Once mobile, R2 will take on these tasks and more to free up crew time for more important science and exploration pursuits. In addition to task exploration, research and testing is happening on orbit to prepare for R2 mobility operations. The current vision system in R2 s head is being used to identify and localize IVA handrails throughout the US Lab and ground control software is being updated and integrated in advance of supporting mobility operations.

Badger, Julia↗