Search NASASearch

SEARCH · Search NASA

Results for “data cleaning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Code Description for "Brief Communication: Monitoring snow depth using small, cheap, and easy-to-deploy ground surface temperature sensors"

Temporally continuous snow depth estimates are vital for understanding changing snow patterns and impacts on permafrost in the Arctic. We train a random forest machine learning model to predict snow depth from variability in ground surface temperature. To our knowledge, this is the first time that small ground surface temperature sensors have been used to estimate snow depth. The model performs well at sites where the model was trained and at pan-arctic evaluation sites (RMSE <= 0.15 m). Small temperature sensors are cheap and easy-to-deploy, so this technique enables spatially distributed and temporally continuous snowpack monitoring to an extent previously infeasible. The model is flexible and can be applied to datasets retroactively to retrieve snow depth estimates at additional sites. This code package includes a *.joblib file of the trained random forest model and a *.ipynb file showing how to clean input data, train the random forest model, and apply the model.

Bachand, Claire

Moltensaltpropnet

MoltenSaltPropnet is a physics-informed machine learning framework that aims to predict the thermophysical properties of molten fluoride and chloride salt mixtures, which are crucial for the design and safety of Generation IV molten salt reactors. The code processes data from the Molten-Salt Thermal Properties Database (MSTDB-TP) and the Janz compendium, converting critically evaluated correlations into fast, differentiable surrogate models for density, viscosity, thermal conductivity, and heat capacity across 448 distinct salt systems. The implementation consists of several key components: 1. Data Curation: The code parses and cleans the raw data, normalizing elemental mole fractions and extracting relevant regression coefficients for various thermophysical properties. 2. Feature Engineering: It generates fixed-length numerical descriptors that encapsulate the composition and temperature, incorporating polynomial interaction terms and dimensionality-reduction techniques to optimize model performance. 3. Coefficient Learning: Four different machine learning architectures are employed: a deep residual network (ResNet), a Kolmogorov–Arnold network (KAN), a sparsity-inducing neural network (SNN), and classical regression models. Each model learns to predict coefficients that define the temperature-dependent correlations for the thermophysical properties. 4. Property Reconstruction: The predicted coefficients are used to compute temperature-dependent property values, ensuring positivity and monotonic trends through a composite loss function that enforces physical constraints. 5. User Interface: An open-source web application enables users to filter the database, train task-specific models, and visualize the results, allowing for rapid exploration of candidate salt mixtures. MoltenSaltPropnet bridges the gap between limited experimental data and high-fidelity reactor simulations, providing a powerful tool for researchers in the field of molten salt reactors and advanced nuclear energy systems.

Retamales, Mauricio Eduardo Tano [Idaho National L

Addressing Issues with Working Memory in Video Object Segmentation

Contemporary state-of-the-art video object segmentation (VOS) models compare incoming unannotated images to a history of image-mask relations via affinity or cross-attention to predict object masks. We refer to the internal memory state of the initial image-mask pair and past image-masks as a working memory buffer. While the current state of the art models perform very well on clean video data, their reliance on a working memory of previous frames leaves room for error. Affinity-based algorithms include the inductive bias that there is temporal continuity between consecutive frames. To account for inconsistent camera views of the desired object, working memory models need an algorithmic modification that regulates the memory updates and avoid writing irrelevant frames into working memory. A simple algorithmic change is proposed that can be applied to any existing working memory-based VOS model to improve performance on inconsistent views, such as sudden camera cuts, frame interjections, and extreme context changes. The resulting model performances show significant improvement on video data with these frame interjections over the same model without the algorithmic addition. Our contribution is a simple decision function that determines whether working memory should be updated based on the detection of sudden, extreme changes and the assumption that the object is no longer in frame. By implementing algorithmic changes, such as this, we can increase the real-world applicability of current VOS models.

97 MATHEMATICS AND COMPUTING

Criticality experiments and analysis of molybdenum reflected cylindrical uranyl fluoride water solution reactors

Clean criticality data were obtained from molybdenum-reflected cylindrical uranyl-fluoride-water solution reactors. Using ENDF/B molybdenum cross sections, a nine energy group two-dimensional transport calculation of a reflected reactor configuration predicted criticality to within 7 cents of the experimental value. For these reactors, it was necessary to compute the reflector resonance integral by a detailed transport calculation at the core-reflector interface volume in the energy region of the two dominant resonances of natural molybdenum.

Fieno, D.

Round-Robin approach to data flow optimization

A large data base, circular in structure, was required (for the Voyager Mission to Jupiter/Saturn) with the capability to completely update the data every four hours during high activity periods. The data is stored in key ordered format for retrieval but is not input in key order. Existing access methods for large data bases with rapid data replacement by keys become inefficient as the volume of data being replaced grows. The Round-Robin method was developed to alleviate this problem. The Round-Robin access method allows rapid updating of the data with continuous self cleaning where the oldest data (by key) is deleted and the newest data (by key) is kept regardless of the order of input.

Witt, J.

Effects of long term space environment exposure on optical substrates and coatings (S0050-2)

The experiment consisted of Fused Silica and Ultra Low Expansion (ULE(tm)) glass samples which were either uncoated or had high reflectance silver, antireflectance, or solar rejection coatings. A set of duplicate control samples was manufactured and stored in a controlled environment for comparison purposes. We will present spectral curves for the glass and coatings which define preflight, postflight, and post-cleaning performance. Data on the analysis of the contaminate deposited on the samples and stress measurements in the glass will also be presented. Some results of particular interest are that the contaminate composition varied between different types of samples, and no darkening of the ULE(tm) glass occurred due to the radiation exposure.

Vallimont, John

United States Air Force Wipe Solvent Testing

The Wright-Patterson Air Force Base (WPAFB), as part of the Air Force Material Command, requested that NASA Johnson Space Center (JSC) White Sands Test Facility (WSTF) conduct testing and analyses in support of the United States Air Force Wipe Solvent Development Project. The purpose of the wipe solvent project is to develop an alternative to be used by Air Force flight line and maintenance personnel for the wipe cleaning of oxygen equipment. This report provides material compatibility, liquid oxygen (LOX) mechanical impact, autogenous ignition temperature (AIT), and gauge cleaning test data for some of the currently available solvents that may be used to replace CFC-113 and methyl chloroform. It provides data from previous WSTF test programs sponsored by the Naval Sea Systems Command, the Kennedy Space Center, and other NASA programs for the purpose of assisting WP AFB in identifying the best alternative solvents for validation testing.

Hornung, Steven D.

A Parametric Model of Shoulder Articulation for Virtual Assessment of Space Suit Fit

Shoulder injury is one of the most severe risks that have the potential to impair crewmembers' performance and health in long duration space flight. Overall, 64% of crewmembers experience shoulder pain after extra-vehicular training in a space suit, and 14% of symptomatic crewmembers require surgical repair (Williams & Johnson, 2003). Suboptimal suit fit, in particular at the shoulder region, has been identified as one of the predominant risk factors. However, traditional suit fit assessments and laser scans represent only a single person's data, and thus may not be generalized across wide variations of body shapes and poses. The aim of this work is to develop a software tool based on a statistical analysis of a large dataset of crewmember body shapes. This tool can accurately predict the skin deformation and shape variations for any body size and shoulder pose for a target population, from which the geometry can be exported and evaluated against suit models in commercial CAD software. A preliminary software tool was developed by statistically analyzing 150 body shapes matched with body dimension ranges specified in the Human-Systems Integration Requirements of NASA ("baseline model"). Further, the baseline model was incorporated with shoulder joint articulation ("articulation model"), using additional subjects scanned in a variety of shoulder poses across a pre-specified range of motion. Scan data was cleaned and aligned using body landmarks. The skin deformation patterns were dimensionally reduced and the co-variation with shoulder angles was analyzed. A software tool is currently in development and will be presented in the final proceeding. This tool would allow suit engineers to parametrically generate body shapes in strategically targeted anthropometry dimensions and shoulder poses. This would also enable virtual fit assessments, with which the contact volume and clearance between the suit and body surface can be predictively quantified at reduced time and cost.

Kim, K. Han

Evaluation of Non-Ozone-Depleting-Chemical Cleaning Methods for Space Mechanisms Using a Vacuum Spiral Orbit Rolling Contact Tribometer

Because CFC 113, an ozone depleting chemical (ODC), can no longer be produced, alternative bearing cleaning methods must be studied. The objective of this work was to study the effect of the new cleaning methods on lubricant lifetime using a vacuum bearing simulator (spiral orbit rolling contact tribometer). Four alternative cleaning methods were studied: ultra-violet (UV) ozone, aqueous levigated alumina slurry (ALAS), super critical fluid (SCF) CO2 and aqueous Brulin 815GD. Baseline tests were done using CFC 113. Test conditions were the following: a vacuum of at least 1.3 x 10(exp -6) Pa, 440C steel components, a rotational speed of 10 RPM, a lubricant charge of between 60-75 micrograms, a perfluoropolyalkylether lubricant (Z-25), and a load of 200N (44.6 lbs., a mean Hertzian stress of 1.5 GPa). Normalized lubricant lifetime was determined by dividing the total number of ball orbits by the amount of lubricant. The failure condition was a friction coefficient of 0.38. Post-test XPS analysis was also performed, showing slight variations in post-cleaning surface chemistry. Statistical analysis of the resultant data was conducted and it was determined that the data sets were most directly comparable when subjected to a natural log transformation. The natural log life (NL-Life) data for each cleaning method were reasonably normally (statistically) distributed and yielded standard deviations that were not significantly different among the five cleaning methods investigated. This made comparison of their NL-Life means very straightforward using a Bonferroni multiple comparison of means procedure. This procedure showed that the ALAS, UV-ozone and CFC 113 methods were not statistically significantly different from one another with respect to mean NL-Life. It also found that the SCF CO2 method yielded a significantly higher mean NL-Life than the mean NL-Lives of the ALAS, UV-ozone and CFC 113 methods. It also determined that the aqueous Brulin 815GD method yielded a mean NL-Life that was statistically significantly higher than the mean NL-Lives of each of the other four methods. Baseline tests using CFC 113 cleaned parts yielded a mean NL-Life 3.62 orbits/micro-g. ALAS and UV-ozone yielded similar mean NL-Life (3.31 orbits/mg and 3.33 orbits/micro-g, respectively). SCF CO2, gave a mean NL-Life of 4.08 orbits/mg and aqueous Brulin 8l5GD data yielded the longest mean NL-Life (4.66 orbits/micro-g).

Jansen, Mark J.

Descriptor: High Temporal Resolution Meteorological Data at Oak Ridge Reservation (ORR-HiResMet)

Access to continuous, quality assessed meteorological data is critical for understanding the climatology and atmospheric dynamics of a region. Research facilities like Oak Ridge National Laboratory (ORNL) rely on such data to assess site-specific climatology, model potential emissions, establish safety baselines, and prepare for emergency scenarios. To meet these needs, on-site towers at ORNL collect meteorological data at 15-minute and hourly intervals. However, data measurements from meteorological towers are affected by sensor sensitivity, degradation, lightning strikes, power fluctuations, glitching, and sensor failures, all of which can affect data quality. To address these challenges, we conducted a comprehensive quality assessment and processing of five years of meteorological data collected from ORNL at 15-minute intervals, including measurements of temperature, pressure, humidity, wind, and solar radiation. The time series of each variable was pre-processed and gap-filled using established meteorological data collection and cleaning techniques, i.e., the time series were subjected to structural standardization, data integrity testing, automated and manual outlier detection, and gap-filling. The data product and highly generalizable processing workflow developed in Python Jupyter notebooks are publicly accessible online. As a key contribution of this study, the evaluated 5-year data will be used to train atmospheric dispersion models that simulate dispersion dynamics across the complex ridge-and-valley topography of the Oak Ridge Reservation in East Tennessee.

Steckler, Morgan R. [Oak Ridge National Laboratory

Time Manager Software for a Flight Processor

Data analysis is a process of inspecting, cleaning, transforming, and modeling data to highlight useful information and suggest conclusions. Accurate timestamps and a timeline of vehicle events are needed to analyze flight data. By moving the timekeeping to the flight processor, there is no longer a need for a redundant time source. If each flight processor is initially synchronized to GPS, they can freewheel and maintain a fairly accurate time throughout the flight with no additional GPS time messages received. How ever, additional GPS time messages will ensure an even greater accuracy. When a timestamp is required, a gettime function is called that immediately reads the time-base register.

Zoerne, Roger

ROSAT investigation of flaring and activity on Prox Cen

The objective of this program was to investigate with high sensitivity the low-level flare activity which may underlie coronal heating. This was done. The ROSAT observations of Prox Cen were scheduled for 50 ks spread out from 26 Feb. - 10 Mar. 1992. Unfortunately because of spacecraft problems many of these pointings turned out to contain no useful data or extremely truncated valid data sets. Considerable time was spent trying to determine which of the data would be scientifically useful and which would not. Fortunately, several developments took place to augment the original data in such a way that the scientific goal of advancing the study of flaring and variability was able to be achieved after all. These are as follows: (1) a second round of ROSAT observations was carried out in Feb. 1993 which only came to the attention of the PI in Apr. 1993 when a new data tape arrived; (2) simultaneous IUE observations were requested and obtained; (3) data from the UK WFC are available via the collaboration with Dr. G. Bromage; and (4) the 'cleaned-up' original data set was found to include one major flare and 2 moderate flares. Because of the problems with the original data set, the unexpected acquisition of new data only two months ago, and the availability of IUE and WFC data, an article on Prox Cen for publication is not ready at this time. Such an article is being developed and can be completed as part of ongoing ROSAT research efforts on stellar coronae and flaring.

Haisch, Bernhard

The effects of surface pretreatment and nitrogen tetroxide purification on the corrosion rate of Type 304L stainless steel

Corrosion rates of 304L stainless steel coupons in MON-1 oxidizer have been measured as a function of cleaning procedures employed, surface layer positions, propellant impurity levels, and short-term exposure durations (14 to 90 days). Of special interest was propellant contamination by buildup of soluble iron, which may cause flow decay. Surface treatments employed were combinations of cleaning, pickling, and passivation procedures. Propellants used were MIL-SPEC MON-1 and several types of purified NTO (i.e., low water, low chloride) which may, at a later time, be specified as spacecraft grade. Pretest coupon surface analysis by X-ray photoelectron spectroscopy (XPS-ESCA) has revealed important differences, for the different cleaning procedures, in the make-up of the surface layer, both in composition and state of chemical combination of the elements involved. Comparisons will be made of XPS/ESCA data, for different cleaning procedures, for specimens before and after propellant exposure.

Blue, G. D.

Application of ERTS data to the detection of thin cirrus and clean air turbulence

The author has identified the following significant results. The feasibility of detecting a thin cirrus and clear air turbulence from ERTS-1 MSS data is explored. The result of analyses indicates that a thin cirrus not shown in a conventional meteorological satellite picture can be revealed in ERTS-1 MSS pictures. Is also found that the core of jet stream can be located with high accuracy from ERTS-1 pictures and the possible area of clear air turbulence can be predicted if the data of the quality of ERTS-1 data are available in real time.

Tsuchiya, K.

Automated Detection of Spurious Signals in VLBI Phase Calibration Data

In this memorandum, a set of processing strategies for automatic masking of phase calibration tones is outlined as implemented in the software package PIMA in the task Generate Phase Calibration Mask, or GEPM. The task relies on a robust procedure of cleaning phase calibration data before employing several mathematical strategies designed to selectively identify spurious signals from phase calibration tones. These strategies were derived as more rigorous implementations of heuristics traditionally used by analysts in manually identifying problematic phase calibration data. The task is intended to automate the process of generating a phase calibration mask and in so doing increase the speed and regularity of VLBI analysis. At the outset of the project, a series of goals were identified to evaluate the success of this mask generation. This included the development of an algorithm to identify and mask short-term (defined as less than 10 seconds in length) spurious signals affecting phase calibration data, the development of an algorithm to identify and mask phase calibration tones affected by constant radio-frequency interference, the implementation of a detection scheme for identifying large jumps in phase calibration phase caused by clock breaks, and finally a method of reporting phase calibration health metrics to the user. Processing of over 10 experiments has demonstrated that the final form of the task GEPM as detailed in this technical memorandum satisfies each of these conditions and satisfactorily performs the task of automatic phase calibration data masking, although the wide variety in quality and characteristics of phase calibration data makes a single solution to the problem quite difficult. A series of user inputs have therefore been defined to assist analysts in tailoring automatic masking to specific stations and phase calibration generators. The vast majority of applicable code was written in FORTRAN to increase execution speed and ease of interfacing with the existing code base in PIMA, but a wrapper function in Python was also written to allow for a simpler method of interacting with GEPM and inputting relevant parameters. In addition to this report, thorough documentation was added to the already existing repositories associated with PIMA as a whole.

Geodesy

Experiment M405: Tri-axis flux gate magnetometer

A tri-axis flux-gate magnetometer was used on four Gemini spacecraft for determination of the magnitude and direction of the local geomagnetic field with respect to the spacecraft. Conclusions derived from the data are not only important to the proton-electron spectrometer experiment, but also are of significance to any directional charged particle experiments that may be conducted. Even though the Gemini spacecraft was not clean magnetically, the data could be reduced to a form that supplied directional information on the magnetic field in relation to the spacecraft. Stray fields were the result of spacecraft structure, not the result of current flows that were produced within the spacecraft electrical systems. Efforts were made to reduce spacecraft stray fields and to facilitate the acquisition of more accurate data.

Womack, W. D.

Erasing the Milky Way: New Cleaning Technique Applied to GBT Intensity Mapping Data

We present the first application of a new foreground removal pipeline to the current leading HI intensity mapping dataset, obtained by the Green Bank Telescope (GBT). We study the 15- and 1-h field data of the GBT observations previously presented in Masui et al. (2013) and Switzer et al. (2013), covering about 41 square degrees at 0.6 less than z is less than 1.0, for which cross-correlations may be measured with the galaxy distribution of the WiggleZ Dark Energy Survey. In the presented pipeline, we subtract the Galactic foreground continuum and the point source contamination using an independent component analysis technique (fastica), and develop a Fourier-based optimal estimator to compute the temperature power spectrum of the intensity maps and cross-correlation with the galaxy survey data. We show that fastica is a reliable tool to subtract diffuse and point-source emission through the non-Gaussian nature of their probability distributions. The temperature power spectra of the intensity maps is dominated by instrumental noise on small scales which fastica, as a conservative sub-traction technique of non-Gaussian signals, can not mitigate. However, we determine similar GBT-WiggleZ cross-correlation measurements to those obtained by the Singular Value Decomposition (SVD) method, and confirm that foreground subtraction with fastica is robust against 21cm signal loss, as seen by the converged amplitude of these cross-correlation measurements. We conclude that SVD and fastica are complementary methods to investigate the foregrounds and noise systematics present in intensity mapping datasets.

Wolz, L.

System and Method for Outlier Detection via Estimating Clusters

An efficient method and system for real-time or offline analysis of multivariate sensor data for use in anomaly detection, fault detection, and system health monitoring is provided. Models automatically derived from training data, typically nominal system data acquired from sensors in normally operating conditions or from detailed simulations, are used to identify unusual, out of family data samples (outliers) that indicate possible system failure or degradation. Outliers are determined through analyzing a degree of deviation of current system behavior from the models formed from the nominal system data. The deviation of current system behavior is presented as an easy to interpret numerical score along with a measure of the relative contribution of each system parameter to any off-nominal deviation. The techniques described herein may also be used to "clean" the training data.

Iverson, David J.