Search NASA⌕ Search

SEARCH · Search NASA

Results for “data quality issues”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Provenance–aware workflow for data quality management and improvement for large continuous scientific data streams

Data quality assessment, management and improvement is integral part of any big data intensive scientific research to ensure accurate, reliable and reproducible science discoveries. The task of maintaining the quality of data, however, is non-trivial and pose a challenge for a program like Department of Energy’s Atmospheric Radiation Measurement (ARM) that collects data from hundreds of instruments across the world,and distributes thousands of streaming data products that are continuously growing in near-real-time in an archive 1.7 Petabyte in size and growing. We present a computational data processing workflow to collect the data quality issue via an easy and intuitive web-based portal that allows reporting of any quality issues for any site, facility or instruments at a granularity down to individual variable in the data files. Portal allows instrument specialists and scientists to provide corrective actions in form of symbolic equation. A parallel processing framework applies the data improvement to large volume of data in efficient parallel environment, while optimizing data transfer and file I/O operations. Corrected files are systematically versioned and archived. A provenance tracking module tracks and records any change made to the data during its entire life cycle which are communicated transparently to the scientific users. Developed in Python using open source technologies, software architecture enables efficient and fast management and improvement of data in an operational data center environment.

Kumar, Jitendra↗

Macquarie Island Cloud and Radiation Experiment (MICRE) Field Campaign Report

The U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility, the Australian Antarctic Division (AAD), and the Australian Bureau of Meteorology (BOM) collaborated in deploying a variety of ground instrumentation to Macquarie Island between March 2016 and March 2018. Macquarie Island is located at 54.5° S, 158.9° E and is well situated for studying clouds over the Southern Ocean. The primary objective of the March 2016 to March 2018 deployment, hereafter the Macquarie Island Cloud and Radiation Experiment (MICRE), was to collect observations of surface radiation, cloud, precipitation, and aerosol properties. This report describes the instruments deployed and data sets collected, along with a summary of key data quality issues and information on some value-added products that are being developed to assist scientists in using the data.

54 ENVIRONMENTAL SCIENCES↗

Evaluating the Effects of Missing Values and Mixed Data Types on Social Sequence Clustering Using t-SNE Visualization

© 2019 Association for Computing Machinery. The goal of this work is to investigate the impact of missing values in clustering joint categorical social sequences. Identifying patterns in sociodemographic longitudinal data is important in a number of social science settings. However, performing analytical operations, such as clustering on life course trajectories, is challenging due to the categorical and multidimensional nature of the data, their mixed data types, and corruption by missing and inconsistent values. Data quality issues were investigated previously on single variable sequences. To understand their effects on multivariate sequence analysis, we employ a dataset of mixed data types and missing values, a dissimilarity measure designed for joint categorical sequence data, together with dimensionality reduction methodologies in a systematic design of sequence clustering experiments. Given the categorical nature of our data, we employ an “edit” distance using optimal matching. Because each data record has multiple variables of different types, we investigate the impact of mixing these variables in a single dissimilarity measure. Between variables with binary values and those with multiple nominal values, we find that the ability to overcome missing data problems is more difficult in the nominal domain than in the binary domain. Additionally, alignment of leading missing values can result in systematic biases in dissimilarity matrices and subsequently introduce both artificial clusters and unrealistic interpretations of associated data domains. We demonstrate the usage of t-distributed stochastic neighborhood embedding to visually guide mitigation of such biases by tuning the missing value substitution cost parameter or determining an optimal sequence span.

Lazar, Alina↗

Phasor-Measurement-Unit-Based Data Analytics Using Digital Twin and PhasorAnalytics Software

A major objective of this project was to apply GE’s commercial machine learning and data analytics toolsets to large-scale, real-world, anonymized Phasor Measurement Unit (PMU) datasets in order to extract signatures, correlated and/or causal factors, and precursor patterns associated with significant power system phenomena. The project had a particular emphasis on extraction of insights relevant to asset health monitoring, real-time load modeling and cybersecurity monitoring. Additionally, the team was directed to undertake a comprehensive data quality analysis for the provided datasets and encouraged to estimate the ‘machine-learning readiness’ of the datasets by documenting any major obstacles to the application of commercial machine learning algorithms. To accomplish the aforementioned objectives, the project team’s work centered around the identification of key event signatures and application of the identified event signatures for event detection and event classification. The industry-validated, semi-supervised machine learning strategy employed for event signature identification involved several major tasks, including data-preprocessing, generation of an overabundance of features, normal data identification, normality modeling, and event signature identification through a methodical, quantitative ranking of features in order of relevance to each studied event type. Throughout the project, data quality issues and mitigation techniques were investigated. In this report, insights are provided regarding the readiness of the provided synchrophasor datasets for application of machine learning and data analytics. The methodologies employed for this technical strategy are summarized in this report. With regards to data preprocessing and feature generation, the provided Training and Test Datasets were ingested into GE’s big data environment. Subsequently, the team applied bad data cleansing and data imputation scripts, event detection scripts, and application programming interfaces (APIs) to the datasets for convenient data access. The project team completed development and validation of dozens of physics-based, statistics-based and transformation-based feature functions used for the extraction of over 60 synchrophasor features. Using a new parallel feature generation technology developed on this project, over 60 features have been rapidly generated for the full two years’ worth of Training and Test Dataset data associated with both the Eastern and Western interconnects. Even accommodating for temporal down-sampling inherent to the feature extraction procedure, this parallel feature generation activity resulted in a massive feature set with a storage requirement approximately equal to that of the raw training dataset itself. With regards to normal data identification and normality modeling, a normality model was built using the feature data extracted from the Training Dataset and iteratively refined subsequent to incremental adjustments and expansions of the Training Dataset feature data. With respect to event characterization and signature identification, an event signature identification pipeline was developed and used in conjunction with the normality model to identify over 15 event signatures for key event categories within the Training Dataset. The identified event signatures were used to characterize hundreds of key events in terms of relative severity, duration, and location of the event. An investigation was undertaken to identify correlated and causal factors involved in transformer events. A separate investigation into temporal trends in ring-down analysis results was undertaken to determine possible associations between system dynamics and various other factors such as loading, season or year. To validate the identified event signatures, additional work was undertaken to develop signature-based anomaly detection and classification tools suitable for convenient application to the synchrophasor datasets. The anomaly detection and classification tools, suitable for online application, were then applied to the entirety of the Eastern Interconnect Training and Test Datasets. Performance of the event detection and classification tools was evaluated upon receipt of the Test Dataset event logs (i.e., the labels for events contained in the Test Dataset), and promising results were obtained despite several challenges (documented herein) associated with application of supervised or semi-supervised machine learning methods to large-scale, anonymized datasets. Finally, the detection and classification tools were used to detect, classify, and characterize thousands of new events not included in the original event logs provided by the DOE within both the Training and Test Datasets.

24 POWER TRANSMISSION AND DISTRIBUTION↗

HarDWR - Harmonized Water Rights Records

A dataset within the Harmonized Database of Western U.S. Water Rights (HarDWR). For a detailed description of the database, please see the meta-record v2.0. Changelog v2.0 - Recalculated based on data sourced from WestDAAT - Changed using a Site ID column to identify unique records to using aa combination of Site ID and Allocation ID - Removed the Water Management Area (WMA) column from the harmonized records. The replacement is a separate file which stores the relationship between allocations and WMAs. This allows for allocations to contribute to water right amounts to multiple WMAs during the subsequent cumulative process. - Added a column describing a water rights legal status - Added "Unspecified" was a water source category - Added an acre-foot (AF) column - Added a column for the classification of the right's owner v1.02 - Added a .RData file to the dataset as a convenience for anyone exploring our code. This is an internal file, and the one referenced in analysis scripts as the data objects are already in R data objects. v1.01 - Updated the names of each file with an ID number less than 3 digits to include leading 0s v1.0 - Initial public release Description Here we present an updated database of Western U.S. water right records. This database provides consistent unique identifiers for each water right record, and a consistent categorization scheme that puts each water right record into one of seven broad use categories. These data were instrumental in conducting a study of the multi-sector dynamics of inter-sectoral water allocation changes though water markets (Grogan et al., *in review*). Specifically, the data were formatted for use as input to a process-based hydrologic model, Water Balance Model (WBM), with a water rights module (Grogan et al., *in review*). While this specific study motivated the development of the database presented here, water management in the U.S. West is a rich area of study (e.g., Anderson and Woosly, 2005; Tidwell, 2014; Null and Prudencio, 2016; Carney et al., 2021) so releasing this database publicly with documentation and usage notes will enable other researchers to do further work on water management in the U.S. West. We produced the water rights database presented here in four main steps: (1) data collection, (2) data quality control, (3) data harmonization, and (4) generation of cumulative water rights curves. Each of steps (1)-(3) had to be completed in order to produce (4), the final product that was used in the modeling exercise in Grogan et al. (*in review*). All data in each step is associated with a spatial unit called a Water Management Area (WMA), which is the unit of water right administration utilized by the state in which the right came from. Steps (2) and (3) required use to make assumptions and interpretation, and to remove records from the raw data collection. We describe each of these assumptions and interpretations below so that other researchers can choose to implement alternative assumptions an interpretation as fits their research aims. Motivation for Changing Data Sources The most significant change has been a switch from collecting the raw water rights directly from each state to using the water rights records presented in WestDAAT, a product of the Water Data Exchange (WaDE) Program under the Western States Water Council (WSWC). One of the main reasons for this is that each state of interest is a member of the WSWC, meaning that WaDE is partially funded by these states, as well as many universities. As WestDAAT is also a database with consistent categorization, it has allowed us to spend less time on data collection and quality control and more time on answering research questions. This has included records from water right sources we had previously not known about when creating v1.0 of this database. The only major downside to utilizing the WestDAAT records as our raw data is that further updates are tied to when WestDAAT is updated, as some states update their public water right records daily. However, as our focus is on cumulative water amounts at the regional scale, it is unlikely most records updates would have a significant effect on our results. The structure of WestDAAT led to several important changes to how HarWR is formatted. The most significant change is that WaDE has calculated a field known as `SiteUUID`, which is a unique identifier for the Point of Diversion (POD), or where the water is drawn from. This separate from `AllocationNativeID`, which is the identifier for the allocation of water, or the amount of water associated with the water right. It should be noted that it is possible for a single site to have multiple allocations associated with it and for an allocation to be able to be extracted from multiple sites. The site-allocation structure has allowed us to adapt a more consistent, and hopefully more realistic, approach in organizing the water right records than we had with HarDWR v1.0. This was incredibly helpful as the raw data from many states had multiple water uses within a single field within a single row of their raw data, and it was not always clear if the first water use was the most important, or simply first alphabetically. WestDAAT has already addressed this data quality issue. Furthermore, with v1.0, when there were multiple records with the same water right ID, we selected the largest volume or flow amount and disregarded the rest. As WestDAAT was already a common structure for disparate data formats, we were better able to identify sites with multiple allocations and, perhaps more importantly, allocations with multiple sites. This is particularly helpful when an allocation has sites which cross WMA boundaries, instead of just assigning the full water amount to a single WMA we are now able to divide the amount of water between the number of relevant WMAs. As it is now possible to identify allocations with water used in multiple WMAs, it is no longer practical to store this information within a single column. Instead the stAllocationToWMATab.csv file was created, which is an allocation by WMA matrix containing the percent Place of Use area overlap with each WMA. We then use this percentage to divide the allocation's flow amount between the given WMAs during the cumulation process to hopefully provide more realistic totals of water use in each area. However, not every state provides areas of water use, so like HarDWR v1.0, a hierarchical decision tree was used to assign each allocation to a WMA. First, if a WMA could be identified based on the allocation ID, then that WMA was used; typically, when available, this applied to the entire state and no further steps were needed. Second was the spatial analysis of Place of Use to WMAs. Third was a spatial analysis of the POD locations to WMAs, with the assumption that allocation's POD is within the WMA it should belong to; if an allocation still had multiple WMAs based on its POD locations, then the allocation's flow amount would be divided equally between all WMAs. The fourth, and final, process was to include water allocations which spatially fell outside of the state WMA boundaries. This could be due to several reasons, such as coordinate errors / imprecision in the POD location, imprecision in the WMA boundaries, or rights attached with features, such as a reservoir, which crosses state boundaries. To include these records, we decided for any POD which was within one kilometer of the state's edge would be assigned to the nearest WMA. Other Changes WestDAAT has Allowed In addition to a more nuanced and consistent method of assigning water right's data to WMAs, there are other benefits gained from using the WestDAAT dataset. Among those is a consistent categorization of a water right's legal status. In HarDWR v1.0, legal status was effectively ignored, which led to many valid concerns about the quality of the database related to the amounts of water the rights allowed to be claimed. The main issue was that rights with legal status' such as "application withdrawn", "non-active", or "cancelled" were included within HarDWR v1.0. These, and other water rights status' which were deemed to not be in use have been removed from this version of the database. Another major change has been the addition of the "unspecified water source category. This is water that can come from either surface water or groundwater, or the source of which is unknown. The addition of this source category brings the total number of categories to three. Due to reviewer feedback, we decided to add the acre-foot (AF) column so that the data may be more applicable to a wider audience. We added the ownerClassification column so that the data may be more applicable to a wider audience. File Descriptions The dataset is a series of various files organized by state sub-directories. In addition, each file begins with the state's name, in case the file is separate from its sub-directory for some reason. After the state name is the text which describes the contents of the file. Here is each file described in detail. Note that st is a placeholder for the state's name. stFullRecords_HarmonizedRights.csv: A file of the complete water records for each state. The column headers for each of this type of file are: state - The name of the state to which the allocations belong to. FIPS - The two digit numeric state ID code. siteID - The site location ID for POD locations. A site may have multiple allocations, which are the actual amount of water which can be drawn. In a simplified hypothetical, a farm stead may have an allocation for "irrigation" and an allocation for "domestic" water use, but the water is drawn from the same pumping equipment. It should be noted that many of the site ID appear to have been added by WaDE, and therefore may not be recognized by a given state's water rights database. allocationID - The allocation ID for the water right. For most states this is the water right ID, and what is recommended to use should a right be looked up on a given state's water rights database. The water amounts associated with these IDs tend to be finer scaled than those associated with siteID. It should be noted that some allocations may be extracted from multiple sites, particularly for larger Places of Use. ownerClassification - A classification of the types of owners for water rights. The most common is `Private` which incorporates a wide range of entities. Several classifications would be grouped into a government category, most of which are for the U.S. Federal Government. These allocations could be listed as "Federal", "United States of America", or as the names of any number of federal agencies. The last major grouping of entities is for "Native American"s. priorityDate - The date we use as the water right priority date for our modeling analysis. This is the legal priority date when it is available. However, for some rights, specifically from California and New Mexico, we used a pseudo priority date (e.g. well completion date or start of well drilling date) when a legal priority date was not available. The most questionable dates come from New Mexico, where the only date associated with certain water right records was the date the allocation was recorded in the database. As the allocation record creation tended to be within a few months of the filing of the application of the water right, from manually double checking the water rights, and our analysis focuses on aggregating water rights on the timescale of years, we determined it was acceptable to use such dates to include as many records as possible. primaryBeneficialUse - From the numerous state water use categories, WaDE categorized them into 21 categories WestDAAT. This column is the original WaDE category for the primary water use at the PoD site. allocationBeneficialUse - From the numerous state water use categories, WaDE categorized them into 21 categories for WestDAAT. This column is the original WaDE category

Economics↗

Los Alamos National Laboratory Meteorology Monitoring Program: 2016 Data Completeness/ Quality Report

This report summarizes data completeness by tower and by instrument for 2016 and compares that data with the Los Alamos National Laboratory (LANL) and American National Standards Institute (ANSI) 2015 standards. This report is designed to make data users aware of data completeness and any data quality issues. LANL meteorology monitoring goals include 95% completeness for all measurements. The ANSI 2015 standard requires 90% completeness for all measurements. This report documents instrument/tower issues as they impact data completeness.

58 GEOSCIENCES↗

Los Alamos National Laboratory Meteorology Monitoring Program: 2017 Data Completeness/Quality Report

This report summarizes data completeness by tower and by instrument for 2017 and compares that data with the Los Alamos National Laboratory (LANL) and American National Standards Institute (ANSI) 2015 standards. This report is designed to make data users aware of data completeness and any data quality issues. LANL meteorology monitoring goals include 95% completeness for all measurements. The ANSI 2015 standard requires 90% completeness for all measurements. This report documents instrument/tower issues as they impact data completeness.

54 ENVIRONMENTAL SCIENCES↗

Los Alamos National Laboratory Meteorology Monitoring Program: 2018 Data Completeness/Quality Report

This report summarizes data completeness by tower and by instrument for 2018 and compares that data with the Los Alamos National Laboratory (LANL) and American National Standards Institute (ANSI) 2015 standards. This report is designed to make data users aware of data completeness and any data quality issues. LANL meteorology monitoring goals include 95% completeness for all measurements. The ANSI 2015 standard requires 90% completeness for all measurements. This report documents instrument/tower issues as they impact data completeness.

54 ENVIRONMENTAL SCIENCES↗

Los Alamos National Laboratory Meteorology Monitoring Program: 2019 Data Completeness (Quality Report)

This report summarizes data completeness by tower and by instrument for 2019 and compares that data with the Los Alamos National Laboratory (LANL) and the ANSI/ANS-3.11-2015 standard. This report is designed to make data users aware of data completeness and any data quality issues. LANL meteorology monitoring goals include 95% completeness for all measurements. The ANS 2015 standard requires 90% completeness for all measurements. This report documents instrument/tower issues as they impact data completeness.

54 ENVIRONMENTAL SCIENCES↗

A Multi-Instrument Cloud Condensation Nuclei Spectrum Product (Final Technical Report)

A wealth of observational data exists on the characteristics of atmospheric particulate matter, over multiple years, at the DOE ARM Southern Great Plains (SGP) Central Facility site. This site is located in a region of the country that frequently experiences weather extremes, and that is removed from many local sources of pollution but is affected by transported smoke, dust, and urban emissions. The relationships between particulate matter, cloud formation and evolution, and precipitation are therefore of strong interest, and are being explored via modeling on a variety of scales. These models require as input detailed information on the characteristics of particles capable of serving as the nuclei for cloud formation. Sufficient data exist to be able to put together a picture of the nature of the total aerosol and the cloud condensation nuclei (CCN) subset, and their variability, through merged data products. This study was aimed at exploiting the multiple measurement types at SGP to develop the first such multi-year estimates. Further, the resulting data were analyzed to understand temporal patterns ranging from hourly to seasonal, thereby gaining insights into the particle sources affecting the atmosphere in this region. DOE-funded datasets that were analyzed in this study include total particle number concentrations, submicron aerosol scattering coefficients, dry aerosol size distributions, and more recently, time-resolved submicron aerosol chemical composition. Data are also available for the number concentrations of particles that are activated in a cloud condensation nucleus instrument at a series of setpoint supersaturations, providing direct observations of the number concentrations of “CCN”. This variable is the quantity that is generally desired for inclusion in numerical models that seek to represent and predict the impacts of varying aerosol characteristics on the formation and microphysical properties of clouds. One limitation of the use of direct CCN observations is that they are not available for supersaturations larger than about 1%, which is insufficient for deep convection and may be insufficient even for shallow convection, depending on the nature of the available CCN and the dynamics of the cloud. We developed a data-based approach to representing the full aerosol size spectrum with size-dependent hygroscopicity, and used this to extrapolate CCN spectra beyond the limited measurements. Five years of SGP aerosol data (2009 -2013) were analyzed. As a side product of our work, we identified and communicated several previously-unflagged data quality issues. The resulting merged aerosol distributions, along with fits for seasonal averages, were published and submitted to the ARM archive as a special value-added product (VAP; submitted as a PI product). CCN spectra were computed for the same data period and will similarly be published and submitted to the archive for use by the community. We also note that our methodologies and findings have been discussed at several Joint ARM User Facility/Atmospheric System Research (ASR) Principal Investigators Meetings and that recent ARM/ASR aerosol data reporting strategies have included similar ideas for data merging, indicating that this work has had a lasting impact on ARM aerosol data acquisition and reporting. The proposed work advances the science of the interactions of aerosols, clouds and precipitation, with direct application to improve representation of such interactions for clouds in regional and global climate models. The archived data will continue to serve research studies in the future.

54 ENVIRONMENTAL SCIENCES↗

Robust PCA-Deep Belief Network Surrogate Model for Distribution System Topology Identification with DERs

With the expansion of distribution networks and increased penetration of distributed energy resources (DERs), it is becoming increasingly important to obtain accurate distribution network topology in real-time. In this paper, a robust principal component analysis coupled deep belief network (PCA-DBN) surrogate model is proposed for distribution system topology identification. It integrates the benefits of robust feature extraction from PCA to deal with data quality issues and filter out noise, and the strength of DBN in capturing the nonlinear relationship between voltage amplitudes and the binary states of switchable connections. This also significantly reduces the DBN training complexity without loss of accuracy. It is shown that the widely used standard deviation of voltage drop and the voltage covariance matrix features yield less accuracy as compared to that of the voltage amplitudes in presence of high penetration of DERs and ZIP loads. Comparison results with other alternatives, such as the random forest (RF), multi-output regression (MOR) and the traditional DBN methods demonstrate that the proposed method can achieve a much higher topology identification accuracy while maintaining robustness to missing data and measurement noise under various penetration levels of DERs.

deep belief network↗

Combining Observations and Models: A Review of the CARDAMOM Framework for Data‐Constrained Terrestrial Ecosystem Modeling

The rapid increase in the volume and variety of terrestrial biosphere observations (i.e., remote sensing data and in situ measurements) offers a unique opportunity to derive ecological insights, refine process‐based models, and improve forecasting for decision support. However, despite their potential, ecological observations have primarily been used to benchmark process‐based models, as many past and current models lack the capability to directly integrate observations and their associated uncertainties for parameterization. In contrast, data assimilation frameworks such as the CARbon DAta MOdel fraMework (CARDAMOM) and its suite of process‐based models, known as the Data Assimilation Linked Ecosystem Carbon Model (DALEC), are specifically designed for model‐data fusion. This review, motivated by a recent CARDAMOM community workshop, examines the development and applications of CARDAMOM, with an emphasis on its role in advancing ecosystem process understanding. CARDAMOM employs a Bayesian approach, using a Markov Chain Monte Carlo algorithm to enable data‐driven calibration of DALEC parameters and initial states (i.e., carbon pool sizes) through observation operators. CARDAMOM's unique ability to retrieve localized model process parameters from diverse datasets—ranging from in situ measurements to global satellite observations—makes it a highly flexible tool for analyzing spatially variable ecosystem responses to environmental change. However, assimilating these data also presents challenges, including data quality issues that propagate into model skill, as well as trade‐offs between model complexity, parameter equifinality, and predictive performance. We discuss potential solutions to these challenges, such as reducing parameter equifinality by incorporating new observations. This review also offers community recommendations for incorporating emerging datasets, integrating machine learning techniques, strengthening collaboration with remote sensing, field, and modeling communities, and expanding CARDAMOM's relevance for localized ecosystem monitoring and decision‐making. CARDAMOM enables a deep, mechanistic understanding of terrestrial ecosystem dynamics that cannot be achieved through empirical analyses of observational datasets or weakly constrained models alone.

Bayesian inference↗

A comparison of the power potential for surface- and seabed-deployed tidal turbines in the San Juan Archipelago, Salish Sea, WA

The San Juan archipelago lies along the axis of tidal movement between Straits of Juan de Fuca and Strait of Georgia in the Salish Sea. The amplitude of the tidal exchange produces significant tidal currents between the islands, as well as in Rosario and Haro Straits. These are of interest as a future source of electrical power generation, given the islands’ dependence on electricity supply by a subsea cable from the mainland. Here, we evaluate the tidal current energy potential in this region through a re-analysis of measurements collected by the National Ocean Service (NOS) and a high-resolution numerical model. Given the considerable variations in water depth and vertical velocity profiles across candidate tidal energy sites, we consider the trade-offs between tidal turbines deployed from a floating platform and those anchored to the seabed. Measurement re-analysis indicates several locations that could support tidal current power generation by MW-scale turbines with an acceptable balance between turbine size, rated power, and capacity factor. Even for relatively large (30 m) turbine diameters, surface-deployed turbines would be expected to produce up to 30 % more electricity than the same turbine deployed near the seabed due to vertical shear, with this difference increasing for smaller diameter turbines. A benchmark comparison at the measurement locations with the highest power generation potential shows relatively good model fidelity, though, even with relatively high resolution, time-average power density disagreements of ± 50 % persist throughout the water column. Nonetheless, the simulation identifies several locations with power generation potential more than twice as high as locations in the measurement re-analysis. These sites were either not surveyed by NOS or excluded due to data quality issues. Altogether, these results demonstrate the complimentary of models and measurements for tidal energy site assessment and suggest that tidal currents could be an important source of electricity generation in the San Juan archipelago.

16 TIDAL AND WAVE POWER↗

Detecting outliers in streaming time series data from ARM distributed sensors

The Atmospheric Radiation Measurement (ARM) Data Center at ORNL collects data from a number of permanent and mobile facilities around the globe. The data is then ingested to create high level scientific products. High frequency streaming measurements from sensors and radar instruments at ARM sites require high degree of accuracy to enable rigorous study of atmospheric processes. Outliers in collected data are common due to instrument failure or extreme weather events. Thus, it is critical to identify and flag them. We employed multiple univariate, multivariate and time series techniques for outlier detection methods and studied their effectiveness. First, we examined Pearson correlation coefficient which is used to measure the pairwise correlations between variables. Singular Spectrum Analysis (SSA) was applied to detect outliers by removing the anticipated annual and seasonal cycles from the signal to accentuate anomalies. K-means was applied for multivariate examination of data from collection of sensors to identify any deviation from expected and known patterns and identify abnormal observation. The Pearson correlation coefficient, SSA and K-means methods were later combined together in a framework to detect outliers through a range of checks. We applied the developed method to data from meteorological sensors at ARM Southern Great Plains site and validated against existing database of known data quality issues.

Lu, Yuping↗

Comparing evapotranspiration from Eddy covariance measurements, water budgets, remote sensing, and land surface models over Canada a, b

Here, this study compares six evapotranspiration ET products for Canada's landmass, namely, eddy covariance EC measurements; surface water budget ET; remote sensing ET from MODIS; and land surface model (LSM) ET from the Community Land Model (CLM), the Ecological Assimilation of Land and Climate Observations (EALCO) model, and the Variable Infiltration Capacity model (VIC). The ET climatology over the Canadian landmass is characterized and the advantages and limitations of the datasets are discussed. The EC measurements have limited spatial coverage, making it difficult for model validations at the national scale. Water budget ET has the largest uncertainty because of data quality issues with precipitation in mountainous regions and in the north. MODIS ET shows relatively large uncertainty in cold seasons and sparsely vegetated regions. The LSM products cover the entire landmass and exhibit small differences in ET among them. Annual ET from the LSMs ranges from small negative values to over 600 mm across the landmass, with a countrywide average of 256 ± 15 mm. Seasonally, the countrywide average monthly ET varies from a low of about 3 mm in four winter months (November-February) to 67 ± 7 mm in July. The ET uncertainty is scale dependent. Larger regions tend to have smaller uncertainties because of the offset of positive and negative biases within the region. More observation networks and better quality controls are critical to improving ET estimates. Future techniques should also consider a hybrid approach that integrates strengths of the various ET products to help reduce uncertainties in ET estimation.

54 ENVIRONMENTAL SCIENCES↗

Quality Data Essential for Modeling Water Cycles Effectively

The experimental and observational data is the backbone of effective modeling of all aspects of water cycles. As the computer technology used for these data gathering efforts has improved dramatically in the recent decades, the environmental conditions these instruments are subjected to remain pretty much the same. These measuring instruments are exposed to the sun light, wind, rain, snow and ice; and they are immersed in dirt, water and mud. All of these are damaging to the electronics components used for data gathering, storage, and transmission, which creates many different kinds of data quality issues that affect the quality and reliability of modeling and prediction efforts.

54 ENVIRONMENTAL SCIENCES↗

An Updated Life Cycle Assessment of Utility-Scale Solar Photovoltaic Systems Installed in the United States

Given the high deployment targets for solar photovoltaics (PV) needed to meet U.S. decarbonization goals, and the limited carbon budget remaining to limit global temperature rise, accurate accounting of the energy-use and greenhouse-gas emissions over the life-cycle of PV systems is needed. In the United States, most PV systems are large utility-scale systems which use single-axis trackers and central inverters, which are not commonly examined in existing life-cycle assessment (LCA) literature. In this study, we present a cradle-to-grave LCA of a typical silicon U.S. utility PV (UPV) installation which is consistent with the utility system features documented in the annual NREL PV system cost benchmark reports. We analyze and present results for four main metrics: cumulative energy demand (CED), greenhouse gas (GHG) emissions, energy payback time (EPBT), and carbon payback time (CPBT). We consider six primary manufacturing options: three based on an imported PV module supply chain (comparing low-carbon imports, high-carbon imports, and average imports), and three based on a potential domestic PV module supply chain (comparing low-carbon U.S. regions, high-carbon U.S. regions, and average U.S. regions). These manufacturing options were then paired with installation locations to create six main cases: low-carbon options were installed in Phoenix (Arizona), high-carbon options were installed in Seattle (Washington), and average options were installed in Fredonia (Kansas). These locations were selected to represent a range of irradiance and grid mixes in the United States, in order to illustrate the likely range of EPBTs and CPBTs possible across the United States. For all six cases, a sensitivity analysis for end-of-life (EOL) handling was explored to capture current and future management options: landfilling, partial recycling, and high-quality recycling. For the purposes of this report, the benchmark system was defined to use an average imported supply chain with partial recycling, installed in Fredonia (Kansas). CED results show ratios at or below 0.1 MJ oil-eq /MJgenerated which demonstrates efficient use of primary energy resources (below a 1:1 ratio), and represents a slight improvement over previous results in literature. GHG emissions per kWh range from 10-36 g CO 2 e, which are consistent with or lower than previous results published by NREL and IEA-PVPS. We use a graphical approach for calculating EPBT and CPBT in this report, which improves upon methods typically used in literature by accounting for non-linearity and avoiding data quality issues associated with long-term projections. EPBT was determined to vary from 0.5 to 1.2 years, with a benchmark EPBT of 0.6 years; CPBT was shown to vary from 0.8 to 20 years, with benchmark CPBT of 2.1 years, which is lower than other estimates from recent literature (typically >2 years).

14 SOLAR ENERGY↗

A Conceptual Site Model for Nature and Extent of Contamination in a Riparian-Near Shore Area - 12410

The 100-K decision area is located along the Columbia River and includes source Operable Units (OUs), a groundwater OU, and the adjacent surface water, saturated sediment and aquatic biota. A conceptual site model (CSM) has been developed to evaluate concentrations of non-radiological substances and radionuclides detected in soil, water and sediments in a riparian near-shore area along the Columbia River. The CSM is used to determine if potential transport pathways exist to these media from Hanford Site sources by incorporating information from the physical system, surface hydrology, subsurface hydrogeology, analytical results, and ecological evaluation into the model. Six contaminants of ecological concern, mostly metals and non-radiological inorganics, have been identified in riparian and near-shore media. With few exceptions (notably chromium and hexavalent chromium), there are ambient sources for these constituents in soil, sediment and water that are unrelated to the Hanford Site. While the CSM documented analytical and biological conditions, this paper presents results focused on analytical measurements to document the potential for these contaminants to be related to a release from the Hanford Site. The purpose for preparing this CSM was to address, on a reactor decision area basis, the potential for Hanford Site contaminants in soil or groundwater to migrate to riparian or near-shore areas at concentrations that could be of concern for ecological receptors. This CSM supplements the analysis of River Corridor-wide ecological risks presented in the ecological risk assessment of the RCBRA. The RCBRA identified on a site-wide basis some contaminants of ecological concern that warranted further evaluation. Based on the results of the further evaluation contained in this CSM, with the exception of hexavalent chromium, detected concentrations of contaminants in riparian or near-shore media are not reliably detectable at levels of ecological concern, or are not associated with contamination in soil or groundwater resulting from Hanford Site operations. Therefore, for purposes of alternatives evaluation in the 100-K Feasibility Study, hexavalent chromium in groundwater should be considered the only contaminants of ecological concern. There are uncertainties in this evaluation related to analytical data quality. With the exception of most recently collected analytical data in groundwater, analytical methods had MDLs that were either close to or higher than aquatic criteria; when methods with adequate detection limits are used, the results show that contaminant concentrations are less than aquatic criteria. In many cases where analytical results were higher than aquatic criteria, it was determined that the results were based on unfiltered samples. Unfiltered analytical results are inappropriate for comparison with aquatic criteria; in general, filtered analytical results were less than aquatic criteria. In some cases where concentrations were reported higher than aquatic criteria, further evaluation of the data revealed it was qualified because of the presence of blank contamination. The analytical detection limit considerations and data quality issues further support the conclusion that contaminants concentrations in water were not reliably detected above levels of ecological significance. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗