Search NASA⌕ Search

SEARCH · Search NASA

Results for “data cleaning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Machine learning-powered data cleaning for LEGEND: a semi-supervised approach using affinity propagation and support vector machines

Neutrinoless double-beta decay ($0\nu\beta\beta$) is a rare nuclear process that, if observed, will provide insight into the nature of neutrinos and help explain the matter-antimatter asymmetry in the Universe. The large enriched germanium experiment for neutrinoless double-beta decay (LEGEND) will operate in two phases to search for $0\nu\beta\beta$. The first (second) stage will employ 200 (1000) kg of High-Purity Germanium (HPGe) enriched in 76 Ge to achieve a half-life sensitivity of 10 27 (10 28 ) years. In this study, we present a semi-supervised data-driven approach to remove non-physical events captured by HPGe detectors powered by a novel artificial intelligence model. We utilize affinity propagation to cluster waveform signals based on their shape and a support vector machine to classify them into different categories. We train, optimize, and test our model on data taken from a natural abundance HPGe detector installed in the Full Chain Test experimental stand at the University of North Carolina at Chapel Hill. We demonstrate that our model yields a maximum sacrifice of physics events of $0.024 ^{+0.004}_{-0.003} \%$ after data cleaning. Our model is being used to accelerate data cleaning development for LEGEND-200 and will serve to improve data cleaning procedures for LEGEND-1000.

artificial intelligence↗
NASA NTRSDate not supplied

Compression of Solar Spectroscopic Observations: a Case Study of MgII k Spectral Line Profiles Observed by NASA’s IRIS Satellite

In this study we extract the deep features and investigate the compression of the MgII k spectral line profiles observed in quiet Sun regions by NASA’s IRIS satellite. The data set of line profiles used for the analysis was obtained on April 20th, 2020, at the center of the solar disc, and contains almost 300,000 individual MgII k line profiles after data cleaning. The data are separated into train and test subsets. The train subset was used to train the autoencoder of the varying embedding layer size. The early stopping criterion was implemented on the test subset to prevent the model from overfitting. Our results indicate that it is possible to compress the spectral line profiles more than 27 times (which corresponds to the reduction of the data dimensionality from 110 to 4) while having a 4DN average reconstruction error, which is comparable to the variations in the line continuum. The mean squared error and the reconstruction error of even statistical moments sharply decrease when the dimensionality of the embedding layer increases from 1 to 4 and almost stop decreasing for higher numbers. The observed occasional improvements in training for values higher than 4 indicate that a better compact embedding may potentially be obtained if other training strategies and longer training times are used. The features learned for the critical four-dimensional case can be interpreted. In particular, three of these four features mainly control the line width, line asymmetry, and line dip formation respectively. The presented results are the first attempt to obtain a compact embedding for spectroscopic line profiles and confirm the value of this approach, in particular for feature extraction, data compression, and denoising.

SMD↗
DOE OSTI2025

2017 Puget Sound Regional Travel Study

# 2017 Puget Sound Regional Travel Study The 2017 Puget Sound Regional Travel Study collected household- and person-level activity and travel pattern information from residents throughout the Puget Sound Regional Council's four-county region in Washington State. It followed the [2014-2015 Puget Sound Regional Travel Study](https://www.nrel.gov/transportation/secure-transportation-data/tsdc-puget-sound-travel-study), starting a planned six-year data collection that includes 2019 and 2021. The multiyear program's goal is to maintain an updated source of household travel behavior data that: - Supports modeling and planning needs - Facilitates trend analysis over time - Allows for regular study design updates to integrate evolving data collection methods and emerging travel behaviors and transportation issues. ## Data Collection Agency The Puget Sound Regional Council conducted the study. ## Methodology The 2017 study featured both the design and administration of a one-day household travel diary (approximately 80% of households before data cleaning) and a seven-day smartphone global positioning system (GPS) diary (approximately 20% of households before data cleaning). It combined data collection methods, including smartphone, online, and telephone. The survey design included several stages to recruit and collect data about households, their members, and their travel behaviors during the assigned travel period. ## Survey Records Survey records include a total of 6,254 participants. ## More Information For more information, see the [survey documentation](https://www.nrel.gov/media/docs/libraries/tsdc/zip/tsdc-2017-puget-sound-travel-study-documentation.zip?sfvrsn=45991f2f_1). ## Transportation Data The data set contains a demographic and socioeconomic composition of 6,254 people from 3,285 households in the Puget Sound regional area, as well as detailed information on the travel behavior of each household for a designated 24-hour period. The survey logged over 508 thousand vehicle miles of travel by participants during 52,492 trips. Transportation data are available as zipped files. [Download Winzip](http://www.winzip.com/downwz.htm).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

2017 Puget Sound Regional Travel Study

# 2017 Puget Sound Regional Travel Study The 2017 Puget Sound Regional Travel Study collected household- and person-level activity and travel pattern information from residents throughout the Puget Sound Regional Council's four-county region in Washington State. It followed the [2014-2015 Puget Sound Regional Travel Study](https://www.nrel.gov/transportation/secure-transportation-data/tsdc-puget-sound-travel-study), starting a planned six-year data collection that includes 2019 and 2021. The multiyear program's goal is to maintain an updated source of household travel behavior data that: - Supports modeling and planning needs - Facilitates trend analysis over time - Allows for regular study design updates to integrate evolving data collection methods and emerging travel behaviors and transportation issues. ## Data Collection Agency The Puget Sound Regional Council conducted the study. ## Methodology The 2017 study featured both the design and administration of a one-day household travel diary (approximately 80% of households before data cleaning) and a seven-day smartphone global positioning system (GPS) diary (approximately 20% of households before data cleaning). It combined data collection methods, including smartphone, online, and telephone. The survey design included several stages to recruit and collect data about households, their members, and their travel behaviors during the assigned travel period. ## Survey Records Survey records include a total of 6,254 participants. ## More Information For more information, see the [survey documentation](https://www.nrel.gov/media/docs/libraries/tsdc/zip/tsdc-2017-puget-sound-travel-study-documentation.zip?sfvrsn=45991f2f_1). ## Transportation Data The data set contains a demographic and socioeconomic composition of 6,254 people from 3,285 households in the Puget Sound regional area, as well as detailed information on the travel behavior of each household for a designated 24-hour period. The survey logged over 508 thousand vehicle miles of travel by participants during 52,492 trips. Transportation data are available as zipped files. [Download Winzip](http://www.winzip.com/downwz.htm).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

2017 Puget Sound Regional Travel Study

# 2017 Puget Sound Regional Travel Study The 2017 Puget Sound Regional Travel Study collected household- and person-level activity and travel pattern information from residents throughout the Puget Sound Regional Council's four-county region in Washington State. It followed the [2014-2015 Puget Sound Regional Travel Study](https://www.nrel.gov/transportation/secure-transportation-data/tsdc-puget-sound-travel-study), starting a planned six-year data collection that includes 2019 and 2021. The multiyear program's goal is to maintain an updated source of household travel behavior data that: - Supports modeling and planning needs - Facilitates trend analysis over time - Allows for regular study design updates to integrate evolving data collection methods and emerging travel behaviors and transportation issues. ## Data Collection Agency The Puget Sound Regional Council conducted the study. ## Methodology The 2017 study featured both the design and administration of a one-day household travel diary (approximately 80% of households before data cleaning) and a seven-day smartphone global positioning system (GPS) diary (approximately 20% of households before data cleaning). It combined data collection methods, including smartphone, online, and telephone. The survey design included several stages to recruit and collect data about households, their members, and their travel behaviors during the assigned travel period. ## Survey Records Survey records include a total of 6,254 participants. ## More Information For more information, see the [survey documentation](https://www.nrel.gov/media/docs/libraries/tsdc/zip/tsdc-2017-puget-sound-travel-study-documentation.zip?sfvrsn=45991f2f_1). ## Transportation Data The data set contains a demographic and socioeconomic composition of 6,254 people from 3,285 households in the Puget Sound regional area, as well as detailed information on the travel behavior of each household for a designated 24-hour period. The survey logged over 508 thousand vehicle miles of travel by participants during 52,492 trips. Transportation data are available as zipped files. [Download Winzip](http://www.winzip.com/downwz.htm).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

2017 Puget Sound Regional Travel Study

# 2017 Puget Sound Regional Travel Study The 2017 Puget Sound Regional Travel Study collected household- and person-level activity and travel pattern information from residents throughout the Puget Sound Regional Council's four-county region in Washington State. It followed the [2014-2015 Puget Sound Regional Travel Study](https://www.nrel.gov/transportation/secure-transportation-data/tsdc-puget-sound-travel-study), starting a planned six-year data collection that includes 2019 and 2021. The multiyear program's goal is to maintain an updated source of household travel behavior data that: - Supports modeling and planning needs - Facilitates trend analysis over time - Allows for regular study design updates to integrate evolving data collection methods and emerging travel behaviors and transportation issues. ## Data Collection Agency The Puget Sound Regional Council conducted the study. ## Methodology The 2017 study featured both the design and administration of a one-day household travel diary (approximately 80% of households before data cleaning) and a seven-day smartphone global positioning system (GPS) diary (approximately 20% of households before data cleaning). It combined data collection methods, including smartphone, online, and telephone. The survey design included several stages to recruit and collect data about households, their members, and their travel behaviors during the assigned travel period. ## Survey Records Survey records include a total of 6,254 participants. ## More Information For more information, see the [survey documentation](https://www.nrel.gov/media/docs/libraries/tsdc/zip/tsdc-2017-puget-sound-travel-study-documentation.zip?sfvrsn=45991f2f_1). ## Transportation Data The data set contains a demographic and socioeconomic composition of 6,254 people from 3,285 households in the Puget Sound regional area, as well as detailed information on the travel behavior of each household for a designated 24-hour period. The survey logged over 508 thousand vehicle miles of travel by participants during 52,492 trips. Transportation data are available as zipped files. [Download Winzip](http://www.winzip.com/downwz.htm).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

2017 Puget Sound Regional Travel Study

# 2017 Puget Sound Regional Travel Study The 2017 Puget Sound Regional Travel Study collected household- and person-level activity and travel pattern information from residents throughout the Puget Sound Regional Council's four-county region in Washington State. It followed the [2014-2015 Puget Sound Regional Travel Study](https://www.nrel.gov/transportation/secure-transportation-data/tsdc-puget-sound-travel-study), starting a planned six-year data collection that includes 2019 and 2021. The multiyear program's goal is to maintain an updated source of household travel behavior data that: - Supports modeling and planning needs - Facilitates trend analysis over time - Allows for regular study design updates to integrate evolving data collection methods and emerging travel behaviors and transportation issues. ## Data Collection Agency The Puget Sound Regional Council conducted the study. ## Methodology The 2017 study featured both the design and administration of a one-day household travel diary (approximately 80% of households before data cleaning) and a seven-day smartphone global positioning system (GPS) diary (approximately 20% of households before data cleaning). It combined data collection methods, including smartphone, online, and telephone. The survey design included several stages to recruit and collect data about households, their members, and their travel behaviors during the assigned travel period. ## Survey Records Survey records include a total of 6,254 participants. ## More Information For more information, see the [survey documentation](https://www.nrel.gov/media/docs/libraries/tsdc/zip/tsdc-2017-puget-sound-travel-study-documentation.zip?sfvrsn=45991f2f_1). ## Transportation Data The data set contains a demographic and socioeconomic composition of 6,254 people from 3,285 households in the Puget Sound regional area, as well as detailed information on the travel behavior of each household for a designated 24-hour period. The survey logged over 508 thousand vehicle miles of travel by participants during 52,492 trips. Transportation data are available as zipped files. [Download Winzip](http://www.winzip.com/downwz.htm).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

2017 Puget Sound Regional Travel Study

# 2017 Puget Sound Regional Travel Study The 2017 Puget Sound Regional Travel Study collected household- and person-level activity and travel pattern information from residents throughout the Puget Sound Regional Council's four-county region in Washington State. It followed the [2014-2015 Puget Sound Regional Travel Study](https://www.nrel.gov/transportation/secure-transportation-data/tsdc-puget-sound-travel-study), starting a planned six-year data collection that includes 2019 and 2021. The multiyear program's goal is to maintain an updated source of household travel behavior data that: - Supports modeling and planning needs - Facilitates trend analysis over time - Allows for regular study design updates to integrate evolving data collection methods and emerging travel behaviors and transportation issues. ## Data Collection Agency The Puget Sound Regional Council conducted the study. ## Methodology The 2017 study featured both the design and administration of a one-day household travel diary (approximately 80% of households before data cleaning) and a seven-day smartphone global positioning system (GPS) diary (approximately 20% of households before data cleaning). It combined data collection methods, including smartphone, online, and telephone. The survey design included several stages to recruit and collect data about households, their members, and their travel behaviors during the assigned travel period. ## Survey Records Survey records include a total of 6,254 participants. ## More Information For more information, see the [survey documentation](https://www.nrel.gov/media/docs/libraries/tsdc/zip/tsdc-2017-puget-sound-travel-study-documentation.zip?sfvrsn=45991f2f_1). ## Transportation Data The data set contains a demographic and socioeconomic composition of 6,254 people from 3,285 households in the Puget Sound regional area, as well as detailed information on the travel behavior of each household for a designated 24-hour period. The survey logged over 508 thousand vehicle miles of travel by participants during 52,492 trips. Transportation data are available as zipped files. [Download Winzip](http://www.winzip.com/downwz.htm).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

2017 Puget Sound Regional Travel Study

# 2017 Puget Sound Regional Travel Study The 2017 Puget Sound Regional Travel Study collected household- and person-level activity and travel pattern information from residents throughout the Puget Sound Regional Council's four-county region in Washington State. It followed the [2014-2015 Puget Sound Regional Travel Study](https://www.nrel.gov/transportation/secure-transportation-data/tsdc-puget-sound-travel-study), starting a planned six-year data collection that includes 2019 and 2021. The multiyear program's goal is to maintain an updated source of household travel behavior data that: - Supports modeling and planning needs - Facilitates trend analysis over time - Allows for regular study design updates to integrate evolving data collection methods and emerging travel behaviors and transportation issues. ## Data Collection Agency The Puget Sound Regional Council conducted the study. ## Methodology The 2017 study featured both the design and administration of a one-day household travel diary (approximately 80% of households before data cleaning) and a seven-day smartphone global positioning system (GPS) diary (approximately 20% of households before data cleaning). It combined data collection methods, including smartphone, online, and telephone. The survey design included several stages to recruit and collect data about households, their members, and their travel behaviors during the assigned travel period. ## Survey Records Survey records include a total of 6,254 participants. ## More Information For more information, see the [survey documentation](https://www.nrel.gov/media/docs/libraries/tsdc/zip/tsdc-2017-puget-sound-travel-study-documentation.zip?sfvrsn=45991f2f_1). ## Transportation Data The data set contains a demographic and socioeconomic composition of 6,254 people from 3,285 households in the Puget Sound regional area, as well as detailed information on the travel behavior of each household for a designated 24-hour period. The survey logged over 508 thousand vehicle miles of travel by participants during 52,492 trips. Transportation data are available as zipped files. [Download Winzip](http://www.winzip.com/downwz.htm).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

2017 Puget Sound Regional Travel Study

# 2017 Puget Sound Regional Travel Study The 2017 Puget Sound Regional Travel Study collected household- and person-level activity and travel pattern information from residents throughout the Puget Sound Regional Council's four-county region in Washington State. It followed the [2014-2015 Puget Sound Regional Travel Study](https://www.nrel.gov/transportation/secure-transportation-data/tsdc-puget-sound-travel-study), starting a planned six-year data collection that includes 2019 and 2021. The multiyear program's goal is to maintain an updated source of household travel behavior data that: - Supports modeling and planning needs - Facilitates trend analysis over time - Allows for regular study design updates to integrate evolving data collection methods and emerging travel behaviors and transportation issues. ## Data Collection Agency The Puget Sound Regional Council conducted the study. ## Methodology The 2017 study featured both the design and administration of a one-day household travel diary (approximately 80% of households before data cleaning) and a seven-day smartphone global positioning system (GPS) diary (approximately 20% of households before data cleaning). It combined data collection methods, including smartphone, online, and telephone. The survey design included several stages to recruit and collect data about households, their members, and their travel behaviors during the assigned travel period. ## Survey Records Survey records include a total of 6,254 participants. ## More Information For more information, see the [survey documentation](https://www.nrel.gov/media/docs/libraries/tsdc/zip/tsdc-2017-puget-sound-travel-study-documentation.zip?sfvrsn=45991f2f_1). ## Transportation Data The data set contains a demographic and socioeconomic composition of 6,254 people from 3,285 households in the Puget Sound regional area, as well as detailed information on the travel behavior of each household for a designated 24-hour period. The survey logged over 508 thousand vehicle miles of travel by participants during 52,492 trips. Transportation data are available as zipped files. [Download Winzip](http://www.winzip.com/downwz.htm).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

2017 Puget Sound Regional Travel Study

# 2017 Puget Sound Regional Travel Study The 2017 Puget Sound Regional Travel Study collected household- and person-level activity and travel pattern information from residents throughout the Puget Sound Regional Council's four-county region in Washington State. It followed the [2014-2015 Puget Sound Regional Travel Study](https://www.nrel.gov/transportation/secure-transportation-data/tsdc-puget-sound-travel-study), starting a planned six-year data collection that includes 2019 and 2021. The multiyear program's goal is to maintain an updated source of household travel behavior data that: - Supports modeling and planning needs - Facilitates trend analysis over time - Allows for regular study design updates to integrate evolving data collection methods and emerging travel behaviors and transportation issues. ## Data Collection Agency The Puget Sound Regional Council conducted the study. ## Methodology The 2017 study featured both the design and administration of a one-day household travel diary (approximately 80% of households before data cleaning) and a seven-day smartphone global positioning system (GPS) diary (approximately 20% of households before data cleaning). It combined data collection methods, including smartphone, online, and telephone. The survey design included several stages to recruit and collect data about households, their members, and their travel behaviors during the assigned travel period. ## Survey Records Survey records include a total of 6,254 participants. ## More Information For more information, see the [survey documentation](https://www.nrel.gov/media/docs/libraries/tsdc/zip/tsdc-2017-puget-sound-travel-study-documentation.zip?sfvrsn=45991f2f_1). ## Transportation Data The data set contains a demographic and socioeconomic composition of 6,254 people from 3,285 households in the Puget Sound regional area, as well as detailed information on the travel behavior of each household for a designated 24-hour period. The survey logged over 508 thousand vehicle miles of travel by participants during 52,492 trips. Transportation data are available as zipped files. [Download Winzip](http://www.winzip.com/downwz.htm).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

2017 Puget Sound Regional Travel Study

# 2017 Puget Sound Regional Travel Study The 2017 Puget Sound Regional Travel Study collected household- and person-level activity and travel pattern information from residents throughout the Puget Sound Regional Council's four-county region in Washington State. It followed the [2014-2015 Puget Sound Regional Travel Study](https://www.nrel.gov/transportation/secure-transportation-data/tsdc-puget-sound-travel-study), starting a planned six-year data collection that includes 2019 and 2021. The multiyear program's goal is to maintain an updated source of household travel behavior data that: - Supports modeling and planning needs - Facilitates trend analysis over time - Allows for regular study design updates to integrate evolving data collection methods and emerging travel behaviors and transportation issues. ## Data Collection Agency The Puget Sound Regional Council conducted the study. ## Methodology The 2017 study featured both the design and administration of a one-day household travel diary (approximately 80% of households before data cleaning) and a seven-day smartphone global positioning system (GPS) diary (approximately 20% of households before data cleaning). It combined data collection methods, including smartphone, online, and telephone. The survey design included several stages to recruit and collect data about households, their members, and their travel behaviors during the assigned travel period. ## Survey Records Survey records include a total of 6,254 participants. ## More Information For more information, see the [survey documentation](https://www.nrel.gov/media/docs/libraries/tsdc/zip/tsdc-2017-puget-sound-travel-study-documentation.zip?sfvrsn=45991f2f_1). ## Transportation Data The data set contains a demographic and socioeconomic composition of 6,254 people from 3,285 households in the Puget Sound regional area, as well as detailed information on the travel behavior of each household for a designated 24-hour period. The survey logged over 508 thousand vehicle miles of travel by participants during 52,492 trips. Transportation data are available as zipped files. [Download Winzip](http://www.winzip.com/downwz.htm).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

2017 Puget Sound Regional Travel Study

# 2017 Puget Sound Regional Travel Study The 2017 Puget Sound Regional Travel Study collected household- and person-level activity and travel pattern information from residents throughout the Puget Sound Regional Council's four-county region in Washington State. It followed the [2014-2015 Puget Sound Regional Travel Study](https://www.nrel.gov/transportation/secure-transportation-data/tsdc-puget-sound-travel-study), starting a planned six-year data collection that includes 2019 and 2021. The multiyear program's goal is to maintain an updated source of household travel behavior data that: - Supports modeling and planning needs - Facilitates trend analysis over time - Allows for regular study design updates to integrate evolving data collection methods and emerging travel behaviors and transportation issues. ## Data Collection Agency The Puget Sound Regional Council conducted the study. ## Methodology The 2017 study featured both the design and administration of a one-day household travel diary (approximately 80% of households before data cleaning) and a seven-day smartphone global positioning system (GPS) diary (approximately 20% of households before data cleaning). It combined data collection methods, including smartphone, online, and telephone. The survey design included several stages to recruit and collect data about households, their members, and their travel behaviors during the assigned travel period. ## Survey Records Survey records include a total of 6,254 participants. ## More Information For more information, see the [survey documentation](https://www.nrel.gov/media/docs/libraries/tsdc/zip/tsdc-2017-puget-sound-travel-study-documentation.zip?sfvrsn=45991f2f_1). ## Transportation Data The data set contains a demographic and socioeconomic composition of 6,254 people from 3,285 households in the Puget Sound regional area, as well as detailed information on the travel behavior of each household for a designated 24-hour period. The survey logged over 508 thousand vehicle miles of travel by participants during 52,492 trips. Transportation data are available as zipped files. [Download Winzip](http://www.winzip.com/downwz.htm).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

Cleaned 5-Minute Resolution Air Quality and Meteorological Data from Nine TCEQ CAMS Sites in Houston, Texas (Nov 2021 – Oct 2022)

These data encompass 5-minute air monitoring and meteorological observations collected in the greater Houston, Texas metropolitan region, at nine (9) Continuous Ambient Monitoring Stations (CAMS) operated by the Texas Commission on Environmental Quality (TCEQ) between November 1, 2021 and October 31, 2022. The CAMS sites (CAMS 1, 8, 35, 45, 148, 403, 405, 410, and 1052) were chosen because their instrumentation includes measurements of PM2.5. These sites also provide continuous multi-parameter air-quality and meteorological measurements. Particulate matter (PM2.5, PM10) was sampled along with several trace gases, including ozone (O3), nitrogen oxides (NO, NO2, NOx), sulfur dioxide (SO2), and carbon monoxide (CO). The data set also contains standard surface meteorological parameters (temperature, humidity, pressure, wind speed, and wind direction). Several sites also include AutoGC-based measurements of volatile organic compounds (VOCs). Air monitoring instruments deployed at the selected sites comprise the following systems: BAM-1020 or TEOM (PM2.5), Thermo Scientific TEI 49i (O3), TEI 42i (NOx), and AutoGCs (VOCs). This data set is similar to the data included within the houairq5mX1.00 datastream, except for a few additional quality control steps. A systematic data cleaning and verification process was performed on the data set to ensure its quality and preparation for analysis. Removal of non-numeric status flags (e.g., [LIM], [QAS], [SPZ], [CAL], [PMA], [AQI], [SPN], [MAL]) was accomplished by employing rule-based string parsing to extract valid numerical values. Missing entries were set to -9999; however, invalid or anomalous values (e.g., 99999) were retained as originally reported by the TCEQ to preserve data provenance. The time sequence was verified for completeness, removal of duplicates, and uniformity at 5-minute intervals. Column labeling was standardized, and corresponding values were assessed for physical plausibility. All timestamps in the data set were reported in Coordinated Universal Time (UTC) as provided by the TCEQ. Further, the latitude and longitude coordinates were added for each CAMS site. A subset of the data (June 1–September 30, 2022) has been used in the following publication: Subba et al. 2025. “Implications of sea breeze circulations on boundary layer aerosols in the southern coastal Texas region.” EGUsphere 2025: 1–49, https://doi.org/10.5194/egusphere-2025-2659.

latitude↗
DOE OSTI2026

Analysis of Slow Spill Data for the Mu2e Experiment

The execution of the Mu2e experiment requires a stable, low-intensity proton beam from the Delivery Ring to produce clean data and protect equipment. This is done by performing a “slow extraction,” which is the gradual contraction of the stable region within the accelerator’s beam pipe. The Delivery Ring is currently unable to perform slow extraction with the stability required by Mu2e. To resolve this, the FAN-C team is training machine learning models with the purpose of replacing the Delivery Ring’s current PID controllers with AI-powered controllers. Training these models requires clean, processed data from slow spills. Over the course of this project, data from previous slow spills were processed and analyzed, and the clean data, graphs, and insights gained from the process were provided to the FAN-C team to assist them in their efforts.

Osborn, Thomas [Purdue U., West Lafayette]↗
NASA NTRS2000

DMSP SSJ4 Data Restoration, Classification, and On-Line Data Access

Compress and clean raw data file for permanent storage We have identified various error conditions/types and developed algorithms to get rid of these errors/noises, including the more complicated noise in the newer data sets. (status = 100% complete). Internet access of compacted raw data. It is now possible to access the raw data via our web site, http://www.jhuapl.edu/Aurora/index.html. The software to read and plot the compacted raw data is also available from the same web site. The users can now download the raw data, read, plot, or manipulate the data as they wish on their own computer. The users are able to access the cleaned data sets. Internet access of the color spectrograms. This task has also been completed. It is now possible to access the spectrograms from the web site mentioned above. Improve the particle precipitation region classification. The algorithm for doing this task has been developed and implemented. As a result, the accuracies improved. Now the web site routinely distributes the results of applying the new algorithm to the cleaned data set. Mark the classification region on the spectrograms. The software to mark the classification region in the spectrograms has been completed. This is also available from our web site.

Wing, Simon↗
NASA NTRS1978

User's guide to the Nimbus-4 backscatter ultraviolet experiment data sets

The first year's data from the Nimbus 4 backscatter ultraviolet (BUV) experiment have been archived in the National Space Science Data Center (NSSDC). Backscattered radiances in the ultraviolet measured by the satellite were used to compute the global total ozone for the period April 1970 - April 1971. The data sets now in the NSSDC are the results obtained by the Ozone Processing Team, which has processed the data with the purpose of determining the best quality of the data. There are four basic sets of data available in the NSSDC representing various stages in processing. The primary data base contains organized and cleaned data in telemetry units. The radiance data has had most of the engineering calibrations performed. The detailed total ozone data is the result of computations to obtain the total ozone; the Compressed Total Ozone data is a convenient condensation of the detailed total ozone. Product data sets are also included.

Lowrey, B. E.↗
DOE OSTI2026

Core Model Proposal #410: Updates to Socioeconomic and Macroeconomic Data, Processing Structure, and Visualization

This Core Model Proposal (CMP) comprehensively restructures and updates the macroeconomic and socioeconomic modules in gcamdata. It includes visualizations of key data inputs, accounting identities, and data flows in the context of GCAM-Macro-KLEM. Major improvements include: (1) updating the Penn World Table (PWT) to version 10 and incorporating a new source, the Global Macro Database (GMD); (2) updating the SSP socioeconomics database from version 3.0.1 to 3.2; (3) introducing SSP-specific differentiation of employment and labor force data; (4) improving data integration between national accounts (from PWT, GMD, and GTAP) and GDP/population data from external sources; and (5) general data cleaning and structural refinements. We document the data sources and key assumptions used throughout the processing. These updates establish the foundation for the forthcoming KLEAM version of GCAM-macro.

97 MATHEMATICS AND COMPUTING↗