Search NASA⌕ Search

SEARCH · Search NASA

Results for “data cleaning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Machine learning-powered data cleaning for LEGEND: a semi-supervised approach using affinity propagation and support vector machines

Neutrinoless double-beta decay ($0\nu\beta\beta$) is a rare nuclear process that, if observed, will provide insight into the nature of neutrinos and help explain the matter-antimatter asymmetry in the Universe. The large enriched germanium experiment for neutrinoless double-beta decay (LEGEND) will operate in two phases to search for $0\nu\beta\beta$. The first (second) stage will employ 200 (1000) kg of High-Purity Germanium (HPGe) enriched in 76 Ge to achieve a half-life sensitivity of 10 27 (10 28 ) years. In this study, we present a semi-supervised data-driven approach to remove non-physical events captured by HPGe detectors powered by a novel artificial intelligence model. We utilize affinity propagation to cluster waveform signals based on their shape and a support vector machine to classify them into different categories. We train, optimize, and test our model on data taken from a natural abundance HPGe detector installed in the Full Chain Test experimental stand at the University of North Carolina at Chapel Hill. We demonstrate that our model yields a maximum sacrifice of physics events of $0.024 ^{+0.004}_{-0.003} \%$ after data cleaning. Our model is being used to accelerate data cleaning development for LEGEND-200 and will serve to improve data cleaning procedures for LEGEND-1000.

artificial intelligence↗
DOE OSTI2020

Data for Post-Access Report: Tidal Energy Resource Characterization and Model Validation via the Assessment of Cost-effective Spatially Distributed Current Measurements from microFloat Swarms

This project evaluated how high-resolution, spatially distributed field data can be used to refine and validate site-scale hydrodynamic simulations of tidal channels. Use of such spatially-distributed field observations or site-scale hydrodynamic simulations will be needed for producing accurate predictions of tidal energy production over larger arrays of tidal turbines. The data contained in this archive includes field observations of water velocity from a series of short surveys in Agate Pass taken on August 20th, 2020 using station-keeping ADCP (acoustic doppler current profiler) measurements, drifting downward-looking ADCPs, and microFloats, gathered by researchers at APL-UW under a previous project. It also includes high-resolution hydrodynamic model runs for the site during that time generated under TEAMER support. An explanatory file (.pdf format) describes the survey and field data structure. Processed data is stored in .mat format. Survey summary: start time, number of floats, water level. microFloat data: - Cleaned data for each float in survey, - Time series of position (lat., lon.), depth (relative to surface), and horizontal velocity (u, v) Drifting ADCP data: - Cleaned data for each drifting ADCP in survey - Time series of position (lat., lon.), sample depth (relative to surface), and observed water velocity (u,v,w) Stationary ADCP data: - Cleaned data for each station-keeping data set in survey - Time series of position (lat., lon.), sample depth (relative to surface), and observed water velocity (u,v,w) FVCOM (Finite Volume Coastal Ocean Model) model outputs: Water level and velocity, as well as derived variables (e.g., power density) from the final refined model simulations for the Agate Pass subdomain. Contained in NetCDF and ASCII files for the duration of August 18th and 20th 2020 field surveys. Additional scripts for processing the data and generating the figures in the report are included.

16 TIDAL AND WAVE POWER↗
DOE OSTI2020

Data Cleaning and Analysis Scripts for Individual Traits in the Dunning-Kruger Effect Study

This code was built to recode and analyze survey data. The recoding script was built in Python while the data analysis script was built in R. The recoding script takes the raw survey data text and converts it to a numeric coding scheme. The data analysis script conducts analyses recommended by the American Psychological Association (APA) for data of this type. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525. SAND2021-3178 O

Sanchez, DanielleNicole↗
NASA NTRSDate not supplied

Compression of Solar Spectroscopic Observations: a Case Study of MgII k Spectral Line Profiles Observed by NASA’s IRIS Satellite

In this study we extract the deep features and investigate the compression of the MgII k spectral line profiles observed in quiet Sun regions by NASA’s IRIS satellite. The data set of line profiles used for the analysis was obtained on April 20th, 2020, at the center of the solar disc, and contains almost 300,000 individual MgII k line profiles after data cleaning. The data are separated into train and test subsets. The train subset was used to train the autoencoder of the varying embedding layer size. The early stopping criterion was implemented on the test subset to prevent the model from overfitting. Our results indicate that it is possible to compress the spectral line profiles more than 27 times (which corresponds to the reduction of the data dimensionality from 110 to 4) while having a 4DN average reconstruction error, which is comparable to the variations in the line continuum. The mean squared error and the reconstruction error of even statistical moments sharply decrease when the dimensionality of the embedding layer increases from 1 to 4 and almost stop decreasing for higher numbers. The observed occasional improvements in training for values higher than 4 indicate that a better compact embedding may potentially be obtained if other training strategies and longer training times are used. The features learned for the critical four-dimensional case can be interpreted. In particular, three of these four features mainly control the line width, line asymmetry, and line dip formation respectively. The presented results are the first attempt to obtain a compact embedding for spectroscopic line profiles and confirm the value of this approach, in particular for feature extraction, data compression, and denoising.

SMD↗
DOE OSTI2025

2017 Puget Sound Regional Travel Study

# 2017 Puget Sound Regional Travel Study The 2017 Puget Sound Regional Travel Study collected household- and person-level activity and travel pattern information from residents throughout the Puget Sound Regional Council's four-county region in Washington State. It followed the [2014-2015 Puget Sound Regional Travel Study](https://www.nrel.gov/transportation/secure-transportation-data/tsdc-puget-sound-travel-study), starting a planned six-year data collection that includes 2019 and 2021. The multiyear program's goal is to maintain an updated source of household travel behavior data that: - Supports modeling and planning needs - Facilitates trend analysis over time - Allows for regular study design updates to integrate evolving data collection methods and emerging travel behaviors and transportation issues. ## Data Collection Agency The Puget Sound Regional Council conducted the study. ## Methodology The 2017 study featured both the design and administration of a one-day household travel diary (approximately 80% of households before data cleaning) and a seven-day smartphone global positioning system (GPS) diary (approximately 20% of households before data cleaning). It combined data collection methods, including smartphone, online, and telephone. The survey design included several stages to recruit and collect data about households, their members, and their travel behaviors during the assigned travel period. ## Survey Records Survey records include a total of 6,254 participants. ## More Information For more information, see the [survey documentation](https://www.nrel.gov/media/docs/libraries/tsdc/zip/tsdc-2017-puget-sound-travel-study-documentation.zip?sfvrsn=45991f2f_1). ## Transportation Data The data set contains a demographic and socioeconomic composition of 6,254 people from 3,285 households in the Puget Sound regional area, as well as detailed information on the travel behavior of each household for a designated 24-hour period. The survey logged over 508 thousand vehicle miles of travel by participants during 52,492 trips. Transportation data are available as zipped files. [Download Winzip](http://www.winzip.com/downwz.htm).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

2017 Puget Sound Regional Travel Study

# 2017 Puget Sound Regional Travel Study The 2017 Puget Sound Regional Travel Study collected household- and person-level activity and travel pattern information from residents throughout the Puget Sound Regional Council's four-county region in Washington State. It followed the [2014-2015 Puget Sound Regional Travel Study](https://www.nrel.gov/transportation/secure-transportation-data/tsdc-puget-sound-travel-study), starting a planned six-year data collection that includes 2019 and 2021. The multiyear program's goal is to maintain an updated source of household travel behavior data that: - Supports modeling and planning needs - Facilitates trend analysis over time - Allows for regular study design updates to integrate evolving data collection methods and emerging travel behaviors and transportation issues. ## Data Collection Agency The Puget Sound Regional Council conducted the study. ## Methodology The 2017 study featured both the design and administration of a one-day household travel diary (approximately 80% of households before data cleaning) and a seven-day smartphone global positioning system (GPS) diary (approximately 20% of households before data cleaning). It combined data collection methods, including smartphone, online, and telephone. The survey design included several stages to recruit and collect data about households, their members, and their travel behaviors during the assigned travel period. ## Survey Records Survey records include a total of 6,254 participants. ## More Information For more information, see the [survey documentation](https://www.nrel.gov/media/docs/libraries/tsdc/zip/tsdc-2017-puget-sound-travel-study-documentation.zip?sfvrsn=45991f2f_1). ## Transportation Data The data set contains a demographic and socioeconomic composition of 6,254 people from 3,285 households in the Puget Sound regional area, as well as detailed information on the travel behavior of each household for a designated 24-hour period. The survey logged over 508 thousand vehicle miles of travel by participants during 52,492 trips. Transportation data are available as zipped files. [Download Winzip](http://www.winzip.com/downwz.htm).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

2017 Puget Sound Regional Travel Study

# 2017 Puget Sound Regional Travel Study The 2017 Puget Sound Regional Travel Study collected household- and person-level activity and travel pattern information from residents throughout the Puget Sound Regional Council's four-county region in Washington State. It followed the [2014-2015 Puget Sound Regional Travel Study](https://www.nrel.gov/transportation/secure-transportation-data/tsdc-puget-sound-travel-study), starting a planned six-year data collection that includes 2019 and 2021. The multiyear program's goal is to maintain an updated source of household travel behavior data that: - Supports modeling and planning needs - Facilitates trend analysis over time - Allows for regular study design updates to integrate evolving data collection methods and emerging travel behaviors and transportation issues. ## Data Collection Agency The Puget Sound Regional Council conducted the study. ## Methodology The 2017 study featured both the design and administration of a one-day household travel diary (approximately 80% of households before data cleaning) and a seven-day smartphone global positioning system (GPS) diary (approximately 20% of households before data cleaning). It combined data collection methods, including smartphone, online, and telephone. The survey design included several stages to recruit and collect data about households, their members, and their travel behaviors during the assigned travel period. ## Survey Records Survey records include a total of 6,254 participants. ## More Information For more information, see the [survey documentation](https://www.nrel.gov/media/docs/libraries/tsdc/zip/tsdc-2017-puget-sound-travel-study-documentation.zip?sfvrsn=45991f2f_1). ## Transportation Data The data set contains a demographic and socioeconomic composition of 6,254 people from 3,285 households in the Puget Sound regional area, as well as detailed information on the travel behavior of each household for a designated 24-hour period. The survey logged over 508 thousand vehicle miles of travel by participants during 52,492 trips. Transportation data are available as zipped files. [Download Winzip](http://www.winzip.com/downwz.htm).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

2017 Puget Sound Regional Travel Study

# 2017 Puget Sound Regional Travel Study The 2017 Puget Sound Regional Travel Study collected household- and person-level activity and travel pattern information from residents throughout the Puget Sound Regional Council's four-county region in Washington State. It followed the [2014-2015 Puget Sound Regional Travel Study](https://www.nrel.gov/transportation/secure-transportation-data/tsdc-puget-sound-travel-study), starting a planned six-year data collection that includes 2019 and 2021. The multiyear program's goal is to maintain an updated source of household travel behavior data that: - Supports modeling and planning needs - Facilitates trend analysis over time - Allows for regular study design updates to integrate evolving data collection methods and emerging travel behaviors and transportation issues. ## Data Collection Agency The Puget Sound Regional Council conducted the study. ## Methodology The 2017 study featured both the design and administration of a one-day household travel diary (approximately 80% of households before data cleaning) and a seven-day smartphone global positioning system (GPS) diary (approximately 20% of households before data cleaning). It combined data collection methods, including smartphone, online, and telephone. The survey design included several stages to recruit and collect data about households, their members, and their travel behaviors during the assigned travel period. ## Survey Records Survey records include a total of 6,254 participants. ## More Information For more information, see the [survey documentation](https://www.nrel.gov/media/docs/libraries/tsdc/zip/tsdc-2017-puget-sound-travel-study-documentation.zip?sfvrsn=45991f2f_1). ## Transportation Data The data set contains a demographic and socioeconomic composition of 6,254 people from 3,285 households in the Puget Sound regional area, as well as detailed information on the travel behavior of each household for a designated 24-hour period. The survey logged over 508 thousand vehicle miles of travel by participants during 52,492 trips. Transportation data are available as zipped files. [Download Winzip](http://www.winzip.com/downwz.htm).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

2017 Puget Sound Regional Travel Study

# 2017 Puget Sound Regional Travel Study The 2017 Puget Sound Regional Travel Study collected household- and person-level activity and travel pattern information from residents throughout the Puget Sound Regional Council's four-county region in Washington State. It followed the [2014-2015 Puget Sound Regional Travel Study](https://www.nrel.gov/transportation/secure-transportation-data/tsdc-puget-sound-travel-study), starting a planned six-year data collection that includes 2019 and 2021. The multiyear program's goal is to maintain an updated source of household travel behavior data that: - Supports modeling and planning needs - Facilitates trend analysis over time - Allows for regular study design updates to integrate evolving data collection methods and emerging travel behaviors and transportation issues. ## Data Collection Agency The Puget Sound Regional Council conducted the study. ## Methodology The 2017 study featured both the design and administration of a one-day household travel diary (approximately 80% of households before data cleaning) and a seven-day smartphone global positioning system (GPS) diary (approximately 20% of households before data cleaning). It combined data collection methods, including smartphone, online, and telephone. The survey design included several stages to recruit and collect data about households, their members, and their travel behaviors during the assigned travel period. ## Survey Records Survey records include a total of 6,254 participants. ## More Information For more information, see the [survey documentation](https://www.nrel.gov/media/docs/libraries/tsdc/zip/tsdc-2017-puget-sound-travel-study-documentation.zip?sfvrsn=45991f2f_1). ## Transportation Data The data set contains a demographic and socioeconomic composition of 6,254 people from 3,285 households in the Puget Sound regional area, as well as detailed information on the travel behavior of each household for a designated 24-hour period. The survey logged over 508 thousand vehicle miles of travel by participants during 52,492 trips. Transportation data are available as zipped files. [Download Winzip](http://www.winzip.com/downwz.htm).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

2017 Puget Sound Regional Travel Study

# 2017 Puget Sound Regional Travel Study The 2017 Puget Sound Regional Travel Study collected household- and person-level activity and travel pattern information from residents throughout the Puget Sound Regional Council's four-county region in Washington State. It followed the [2014-2015 Puget Sound Regional Travel Study](https://www.nrel.gov/transportation/secure-transportation-data/tsdc-puget-sound-travel-study), starting a planned six-year data collection that includes 2019 and 2021. The multiyear program's goal is to maintain an updated source of household travel behavior data that: - Supports modeling and planning needs - Facilitates trend analysis over time - Allows for regular study design updates to integrate evolving data collection methods and emerging travel behaviors and transportation issues. ## Data Collection Agency The Puget Sound Regional Council conducted the study. ## Methodology The 2017 study featured both the design and administration of a one-day household travel diary (approximately 80% of households before data cleaning) and a seven-day smartphone global positioning system (GPS) diary (approximately 20% of households before data cleaning). It combined data collection methods, including smartphone, online, and telephone. The survey design included several stages to recruit and collect data about households, their members, and their travel behaviors during the assigned travel period. ## Survey Records Survey records include a total of 6,254 participants. ## More Information For more information, see the [survey documentation](https://www.nrel.gov/media/docs/libraries/tsdc/zip/tsdc-2017-puget-sound-travel-study-documentation.zip?sfvrsn=45991f2f_1). ## Transportation Data The data set contains a demographic and socioeconomic composition of 6,254 people from 3,285 households in the Puget Sound regional area, as well as detailed information on the travel behavior of each household for a designated 24-hour period. The survey logged over 508 thousand vehicle miles of travel by participants during 52,492 trips. Transportation data are available as zipped files. [Download Winzip](http://www.winzip.com/downwz.htm).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

2017 Puget Sound Regional Travel Study

# 2017 Puget Sound Regional Travel Study The 2017 Puget Sound Regional Travel Study collected household- and person-level activity and travel pattern information from residents throughout the Puget Sound Regional Council's four-county region in Washington State. It followed the [2014-2015 Puget Sound Regional Travel Study](https://www.nrel.gov/transportation/secure-transportation-data/tsdc-puget-sound-travel-study), starting a planned six-year data collection that includes 2019 and 2021. The multiyear program's goal is to maintain an updated source of household travel behavior data that: - Supports modeling and planning needs - Facilitates trend analysis over time - Allows for regular study design updates to integrate evolving data collection methods and emerging travel behaviors and transportation issues. ## Data Collection Agency The Puget Sound Regional Council conducted the study. ## Methodology The 2017 study featured both the design and administration of a one-day household travel diary (approximately 80% of households before data cleaning) and a seven-day smartphone global positioning system (GPS) diary (approximately 20% of households before data cleaning). It combined data collection methods, including smartphone, online, and telephone. The survey design included several stages to recruit and collect data about households, their members, and their travel behaviors during the assigned travel period. ## Survey Records Survey records include a total of 6,254 participants. ## More Information For more information, see the [survey documentation](https://www.nrel.gov/media/docs/libraries/tsdc/zip/tsdc-2017-puget-sound-travel-study-documentation.zip?sfvrsn=45991f2f_1). ## Transportation Data The data set contains a demographic and socioeconomic composition of 6,254 people from 3,285 households in the Puget Sound regional area, as well as detailed information on the travel behavior of each household for a designated 24-hour period. The survey logged over 508 thousand vehicle miles of travel by participants during 52,492 trips. Transportation data are available as zipped files. [Download Winzip](http://www.winzip.com/downwz.htm).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

2017 Puget Sound Regional Travel Study

# 2017 Puget Sound Regional Travel Study The 2017 Puget Sound Regional Travel Study collected household- and person-level activity and travel pattern information from residents throughout the Puget Sound Regional Council's four-county region in Washington State. It followed the [2014-2015 Puget Sound Regional Travel Study](https://www.nrel.gov/transportation/secure-transportation-data/tsdc-puget-sound-travel-study), starting a planned six-year data collection that includes 2019 and 2021. The multiyear program's goal is to maintain an updated source of household travel behavior data that: - Supports modeling and planning needs - Facilitates trend analysis over time - Allows for regular study design updates to integrate evolving data collection methods and emerging travel behaviors and transportation issues. ## Data Collection Agency The Puget Sound Regional Council conducted the study. ## Methodology The 2017 study featured both the design and administration of a one-day household travel diary (approximately 80% of households before data cleaning) and a seven-day smartphone global positioning system (GPS) diary (approximately 20% of households before data cleaning). It combined data collection methods, including smartphone, online, and telephone. The survey design included several stages to recruit and collect data about households, their members, and their travel behaviors during the assigned travel period. ## Survey Records Survey records include a total of 6,254 participants. ## More Information For more information, see the [survey documentation](https://www.nrel.gov/media/docs/libraries/tsdc/zip/tsdc-2017-puget-sound-travel-study-documentation.zip?sfvrsn=45991f2f_1). ## Transportation Data The data set contains a demographic and socioeconomic composition of 6,254 people from 3,285 households in the Puget Sound regional area, as well as detailed information on the travel behavior of each household for a designated 24-hour period. The survey logged over 508 thousand vehicle miles of travel by participants during 52,492 trips. Transportation data are available as zipped files. [Download Winzip](http://www.winzip.com/downwz.htm).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

2017 Puget Sound Regional Travel Study

# 2017 Puget Sound Regional Travel Study The 2017 Puget Sound Regional Travel Study collected household- and person-level activity and travel pattern information from residents throughout the Puget Sound Regional Council's four-county region in Washington State. It followed the [2014-2015 Puget Sound Regional Travel Study](https://www.nrel.gov/transportation/secure-transportation-data/tsdc-puget-sound-travel-study), starting a planned six-year data collection that includes 2019 and 2021. The multiyear program's goal is to maintain an updated source of household travel behavior data that: - Supports modeling and planning needs - Facilitates trend analysis over time - Allows for regular study design updates to integrate evolving data collection methods and emerging travel behaviors and transportation issues. ## Data Collection Agency The Puget Sound Regional Council conducted the study. ## Methodology The 2017 study featured both the design and administration of a one-day household travel diary (approximately 80% of households before data cleaning) and a seven-day smartphone global positioning system (GPS) diary (approximately 20% of households before data cleaning). It combined data collection methods, including smartphone, online, and telephone. The survey design included several stages to recruit and collect data about households, their members, and their travel behaviors during the assigned travel period. ## Survey Records Survey records include a total of 6,254 participants. ## More Information For more information, see the [survey documentation](https://www.nrel.gov/media/docs/libraries/tsdc/zip/tsdc-2017-puget-sound-travel-study-documentation.zip?sfvrsn=45991f2f_1). ## Transportation Data The data set contains a demographic and socioeconomic composition of 6,254 people from 3,285 households in the Puget Sound regional area, as well as detailed information on the travel behavior of each household for a designated 24-hour period. The survey logged over 508 thousand vehicle miles of travel by participants during 52,492 trips. Transportation data are available as zipped files. [Download Winzip](http://www.winzip.com/downwz.htm).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

2017 Puget Sound Regional Travel Study

# 2017 Puget Sound Regional Travel Study The 2017 Puget Sound Regional Travel Study collected household- and person-level activity and travel pattern information from residents throughout the Puget Sound Regional Council's four-county region in Washington State. It followed the [2014-2015 Puget Sound Regional Travel Study](https://www.nrel.gov/transportation/secure-transportation-data/tsdc-puget-sound-travel-study), starting a planned six-year data collection that includes 2019 and 2021. The multiyear program's goal is to maintain an updated source of household travel behavior data that: - Supports modeling and planning needs - Facilitates trend analysis over time - Allows for regular study design updates to integrate evolving data collection methods and emerging travel behaviors and transportation issues. ## Data Collection Agency The Puget Sound Regional Council conducted the study. ## Methodology The 2017 study featured both the design and administration of a one-day household travel diary (approximately 80% of households before data cleaning) and a seven-day smartphone global positioning system (GPS) diary (approximately 20% of households before data cleaning). It combined data collection methods, including smartphone, online, and telephone. The survey design included several stages to recruit and collect data about households, their members, and their travel behaviors during the assigned travel period. ## Survey Records Survey records include a total of 6,254 participants. ## More Information For more information, see the [survey documentation](https://www.nrel.gov/media/docs/libraries/tsdc/zip/tsdc-2017-puget-sound-travel-study-documentation.zip?sfvrsn=45991f2f_1). ## Transportation Data The data set contains a demographic and socioeconomic composition of 6,254 people from 3,285 households in the Puget Sound regional area, as well as detailed information on the travel behavior of each household for a designated 24-hour period. The survey logged over 508 thousand vehicle miles of travel by participants during 52,492 trips. Transportation data are available as zipped files. [Download Winzip](http://www.winzip.com/downwz.htm).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗