Search NASA⌕ Search

DOE OSTI · 1666000

Active Learning for Anomaly Detection in Environmental data

Abstract

Due to the growing amount of data from in-situ sensors in environmental monitoring, it becomes necessary to automatically detect anomalous data points. Nowadays, this is mainly performed using supervised machine learning models, which need a fully labelled data set for their training process. However, the process of labelling data is typically cumbersome and, as a result, a hindrance to the adoption of machine learning methods for automated anomaly detection. In this work, we propose to address this challenge by means of active learning. This method consists of querying the domain expert for the labels of only a selected subset of the full data set. We show that this reduces the time and costs associated to labelling while delivering the same or similar anomaly detection performances. Finally, we also show that machine learning models providing a nonlinear classification boundary are to be recommended for anomaly detection in complex environmental data sets.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Russo, Stefania, Lürig, Moritz, Hao, Wenjin, Matthews, Blake, Villez, Kris. 2020-09-15. Active Learning for Anomaly Detection in Environmental data. https://doi.org/10.1016/j.envsoft.2020.104869

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related reports

Water4Energy Step-1 Band-M Ready-to-Train Samples for TVA Weeks-to-Years Prediction, Version 0

AI-ready Band-M (monthly) labelled training pack for the Water4Energy Genesis Task-1 project on weeks-to-years prediction of Tennessee Valley temperature and precipitation. The deposit includes leakage-aware issue-time samples (samples_M_v0.nc; N=486), train-only scalers, issue-time split table, supporting monthly panels, and Python generation scripts to recreate the pack from the companion Tier-1 raw observation collection (https://doi.org/10.13139/ORNLNCCS/3398576). Each sample pairs a 12-month lookback of teleconnection indices and SST box anomalies with TVA-mean ERA5 anomaly targets (t2m, tp, msl) at leads 1–3 months.

54 ENVIRONMENTAL SCIENCES↗

Multi-Angle Snowflake Camera, particle analysis

The c1 level data product for the Mutli-Angle Snowflake Camera contains snowflake fall speeds and particle size, among other analysis for images associated with each hydrometeor.

54 ENVIRONMENTAL SCIENCES↗

Multi-Angle Snowflake Camera, time bins

The c1 level data product for the Mutli-Angle Snowflake Camera contains snowflake fall speeds and particle size, among other analysis for images associated with each hydrometeor.

54 ENVIRONMENTAL SCIENCES↗