Search NASA⌕ Search

SEARCH · Search NASA

Results for “LABELLING”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33

Automated annotation of scientific texts for ML-based keyphrase extraction and validation

Advanced omics technologies and facilities generate a wealth of valuable data daily; however, the data often lack the essential metadata required for researchers to find, curate, and search them effectively. The lack of metadata poses a significant challenge in the utilization of these data sets. Machine learning (ML)–based metadata extraction techniques have emerged as a potentially viable approach to automatically annotating scientific data sets with the metadata necessary for enabling effective search. Text labeling, usually performed manually, plays a crucial role in validating machine-extracted metadata. However, manual labeling is time-consuming and not always feasible; thus, there is a need to develop automated text labeling techniques in order to accelerate the process of scientific innovation. This need is particularly urgent in fields such as environmental genomics and microbiome science, which have historically received less attention in terms of metadata curation and creation of gold-standard text mining data sets. In this paper, we present two novel automated text labeling approaches for the validation of ML-generated metadata for unlabeled texts, with specific applications in environmental genomics. Our techniques show the potential of two new ways to leverage existing information that is only available for select documents within a corpus to validate ML models, which can then be used to describe the remaining documents in the corpus. The first technique exploits relationships between different types of data sources related to the same research study, such as publications and proposals. The second technique takes advantage of domain-specific controlled vocabularies or ontologies. In this paper, we detail applying these approaches in the context of environmental genomics research for ML-generated metadata validation. Our results show that the proposed label assignment approaches can generate both generic and highly specific text labels for the unlabeled texts, with up to 44% of the labels matching with those suggested by a ML keyword extraction algorithm.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Advanced Semi-Supervised Learning with Uncertainty Estimation for Phase Identification in Distribution Systems

The integration of advanced metering infrastructure (AMI) into power distribution networks generates valuable data for tasks such as phase identification; however, the limited and unreliable availability of labeled data in the form of customer phase connectivity presents challenges. To address this issue, we propose a semi-supervised learning (SSL) framework that effectively leverages labeled and unlabeled data. Our approach incorporates self-training, label spreading, and Bayesian neural networks (BNNs) to enhance phase identification with AMI data. Our method uses an ensemble of multilayer perceptron classifiers in a self-training setup, iteratively adding high-confidence pseudo-labels to improve robustness. We also apply label spread to propagate labels based on data similarity, which enhances generalization across diverse distributions. In addition, we employ a BNNs with uncertainty estimation, boosting confidence in predictions and reducing phase identification errors. In our case study, we achieved approximately 98% +/- 0.08 accuracy with uncertainty using minimal and unreliable labeled data from a real U.S. utility, Duquesne Light Company. Our SSL approach, combined with uncertainty estimation, provides an efficient solution for phase identification in AMI data, ultimately improving the reliability of smart grid applications.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Advanced Semi-Supervised Learning With Uncertainty Estimation for Phase Identification in Distribution Systems

The integration of advanced metering infrastructure (AMI) into power distribution networks generates valuable data for tasks such as phase identification; however, the limited and unreliable availability of labeled data in the form of customer phase connectivity presents challenges. To address this issue, we propose a semi-supervised learning (SSL) framework that effectively leverages labeled and unlabeled data. Our approach incorporates self-training, label spreading, and Bayesian neural networks (BNNs) to enhance phase identification with AMI data. Our method uses an ensemble of multilayer perceptron classifiers in a self-training setup, iteratively adding high-confidence pseudo-labels to improve robustness. We also apply label spread to propagate labels based on data similarity, which enhances generalization across diverse distributions. In addition, we employ a BNNs with uncertainty estimation, boosting confidence in predictions and reducing phase identification errors. In our case study, we achieved approximately 98% +/- 0.08 accuracy with uncertainty using minimal and unreliable labeled data from a real U.S. utility, Duquesne Light Company. Our SSL approach, combined with uncertainty estimation, provides an efficient solution for phase identification in AMI data, ultimately improving the reliability of smart grid applications.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Chemical Topography of Efferent Projections from the Median Preoptic Nucleus to Pontine Monoaminergic Cell Groups in the Rat

This study examined efferent output from the median preoptic nucleus (MNPO) to pontine noradrenergic and serotonergic cell groups using an anterograde tracing technique (Phaseolus vulgaris leucoagglutinin, PHA-L) combined with glucose oxidase immunocytochemistry to serotonin (5-HT) or to dopamine-beta-hydroxylase (DBH). Injections of PHA-L into the ventral MNPO resulted in moderate axonal labeling within the region of the B7 and B8 serotonergic groups in the dorsal raphe. PHA-L labeled fibers and punctate processes were observed in close apposition to many of the 5-HT immunoreactive neurons in these regions. In contrast, sparse terminal labeling was found within the B5 group in the raphe pontis nucleus, and only trace fiber labeling observed in the B3 and B6 groups. Efferents from the MNPO also provided moderate innervation to the A6 and A7 noradrenergic groups. PHA-L labeled punctate processes were found most frequently in close apposition to DBH-immunoreactive neurons at mid- to caudal levels of the locus coeruleus. Some labeled axons were also present within the A7 and A5 groups. Additionally, a close apposition between labeled MNPO efferents and 5-HT fibers within the lateral parabrachial nucleus was observed. The results indicate the MNPO provides a topographic innervation of monoaminergic groups in the upper brainstem.

Zardetto-Smith, Andrea M.↗

Chemical Topography of Efferent Projections from the Median Preoptic Nucleus to Pontine Monoaminergic Cell Groups in the Rat

This study examined efferent output from the median preoptic nucleus (MnPO) to pontine noradrenergic and serotonergic cell groups using an anterograde tracing technique (Phaseolus vulgaris leucoagglutinin, PHA-L) combined with glucose oxidase immunocytochemistry to scrotonin (5-HT) or to dopamine-(beta)-hydroxylase (DBH). Injections of PHA-L into the ventral MNPO resulted in moderate axonal labeling within the region of the B7 and B8 serotonergic groups in the dorsal raphe. PHA-L labeled fibers and punctate processes were observed in close apposition to many of the 5-HT immunoreactive neurons in these regions, In contrast, sparse terminal labeling was found within the B5 group in the raphe pontis nucleus, and only trace fiber labeling observed in the B3 and B6 groups. Efferents from the MNPO also provided moderate innervation to the A6 and A7 noradrenergic groups. PHA-L labeled punctate processes were found most frequently in close apposition to DBH-immunorcactive neurons at mid- to caudal levels of the locus coeruleus. Some labeled axons were also present within the A7 and A5 groups. Additionally, a close apposition between labeled MNPO efferents and 5-HT fibers within the lateral parabrachial nucleus was observed, The results indicate the MNPO provides a topographic innerva- tion of monoaminergic groups in the upper brainstem.

Zardetto-Smith, Andrea M.↗

The origin of mesoderm in phoronids

Descriptive studies of phoronid development have concluded that the mesoderm of these animals originates from the endoderm during gastrulation. This interpretation has been tested by labeling one blastomere of 4- through 16-cell embryos and examining the position and germ layers occupied by the labeled clones of cells in the larva. No 2 injections gave rise to identical clones of cells, suggesting that the cleavage program does not generate cells of unique identity and that cell fates are established at later developmental time points. In many cases, a relatively large sector composed of ectodermal cells was labeled. When these labeled cells were adjacent to the mouth or anus of the larva, muscle and mesenchyme cells originated from the labeled clones. Under these circumstances, nerve cells also originated from these labeled sectors. These labeling studies also showed that endodermal cells can give rise to mesodermal and neural cells. These results suggest that nerve and muscle cells are induced to form at ectodermal-endodermal boundaries from both germ layers. These marking experiments also confirmed the observation that nerve cells originate both from the apical organ and the trunk region and show for the first time that the intestine originates by ingression of posterior ectoderm.

NASA Discipline Evolutionary Biology↗

Active Learning with Irrelevant Examples

An improved active learning method has been devised for training data classifiers. One example of a data classifier is the algorithm used by the United States Postal Service since the 1960s to recognize scans of handwritten digits for processing zip codes. Active learning algorithms enable rapid training with minimal investment of time on the part of human experts to provide training examples consisting of correctly classified (labeled) input data. They function by identifying which examples would be most profitable for a human expert to label. The goal is to maximize classifier accuracy while minimizing the number of examples the expert must label. Although there are several well-established methods for active learning, they may not operate well when irrelevant examples are present in the data set. That is, they may select an item for labeling that the expert simply cannot assign to any of the valid classes. In the context of classifying handwritten digits, the irrelevant items may include stray marks, smudges, and mis-scans. Querying the expert about these items results in wasted time or erroneous labels, if the expert is forced to assign the item to one of the valid classes. In contrast, the new algorithm provides a specific mechanism for avoiding querying the irrelevant items. This algorithm has two components: an active learner (which could be a conventional active learning algorithm) and a relevance classifier. The combination of these components yields a method, denoted Relevance Bias, that enables the active learner to avoid querying irrelevant data so as to increase its learning rate and efficiency when irrelevant items are present. The algorithm collects irrelevant data in a set of rejected examples, then trains the relevance classifier to distinguish between labeled (relevant) training examples and the rejected ones. The active learner combines its ranking of the items with the probability that they are relevant to yield a final decision about which item to present to the expert for labeling. Experiments on several data sets have demonstrated that the Relevance Bias approach significantly decreases the number of irrelevant items queried and also accelerates learning speed.

Wagstaff, Kiri↗

Java Image I/O for VICAR, PDS, and ISIS

This library, written in Java, supports input and output of images and metadata (labels) in the VICAR, PDS image, and ISIS-2 and ISIS-3 file formats. Three levels of access exist. The first level comprises the low-level, direct access to the file. This allows an application to read and write specific image tiles, lines, or pixels and to manipulate the label data directly. This layer is analogous to the C-language "VICAR Run-Time Library" (RTL), which is the image I/O library for the (C/C++/Fortran) VICAR image processing system from JPL MIPL (Multimission Image Processing Lab). This low-level library can also be used to read and write labeled, uncompressed images stored in formats similar to VICAR, such as ISIS-2 and -3, and a subset of PDS (image format). The second level of access involves two codecs based on Java Advanced Imaging (JAI) to provide access to VICAR and PDS images in a file-format-independent manner. JAI is supplied by Sun Microsystems as an extension to desktop Java, and has a number of codecs for formats such as GIF, TIFF, JPEG, etc. Although Sun has deprecated the codec mechanism (replaced by IIO), it is still used in many places. The VICAR and PDS codecs allow any program written using the JAI codec spec to use VICAR or PDS images automatically, with no specific knowledge of the VICAR or PDS formats. Support for metadata (labels) is included, but is format-dependent. The PDS codec, when processing PDS images with an embedded VIAR label ("dual-labeled images," such as used for MER), presents the VICAR label in a new way that is compatible with the VICAR codec. The third level of access involves VICAR, PDS, and ISIS Image I/O plugins. The Java core includes an "Image I/O" (IIO) package that is similar in concept to the JAI codec, but is newer and more capable. Applications written to the IIO specification can use any image format for which a plug-in exists, with no specific knowledge of the format itself.

Deen, Robert G.↗

Automated Identification of Molecular Crystals’ Packing Motifs

Packing motifs—patterns in how molecules orient relative to one another in a crystal structure—are an important concept in many subdisciplines of materials science because of correlations observed between specific packing motifs and properties of interest. That said, packing motif data sets have remained small and noisy due to intensive manual labeling processes and insufficient labeling schemes. The most prominent labeling algorithms calculate relative interplanar angles of nearest neighbor molecules to determine the packing motif of a molecular crystal, but this simple approach can fail when neighbors are naively sampled isotropically around the crystal structure. To remedy this issue, here we propose an optimization algorithm, which rotates the molecular crystal structure to find representative molecules that inform the packing motif. We package this algorithm into an automated framework—Autopack—which both optimally rotates the crystal structure and labels the packing motif based on the appropriate neighboring molecules. In this work, we detail the Autopack framework and its performance, which shows improvements compared to previous state-of-the-art labeling methods, providing the first quantitative point of comparison for packing motif labeling algorithms. Furthermore, using Autopack (available at https://ipo.llnl.gov/technologies/software/autopack), we perform the first large-scale study of potential relationships between chemicals’ compositions and packing motifs, which shows that these relationships are more complex than previously hypothesized from studies that used only tens of polycyclic aromatic hydrocarbon molecules. Autopack’s capabilities help pose next steps for crystal engineering research focusing not only on a molecule’s adoption of a specific packing motif but also on new structure–property relationships.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

3D exemplar-based random walks for tooth segmentation from cone-beam computed tomography images

Purpose: Tooth segmentation is an essential step in acquiring patient-specific dental geometries from cone-beam computed tomography (CBCT) images. Tooth segmentation from CBCT images is still a challenging task considering the comparatively low image quality caused by the limited radiation dose, as well as structural ambiguities from intercuspation and nearby alveolar bones. The goal of this paper is to present and discuss the latest accomplishments in semisupervised tooth segmentation with adaptive 3D shape constraints. Methods: The authors propose a 3D exemplar-based random walk method of tooth segmentation from CBCT images. The proposed method integrates semisupervised label propagation and regularization by 3D exemplar registration. To begin with, the pure random walk method is to get an initial segmentation of the teeth, which tends to be erroneous because of the structural ambiguity of CBCT images. And then, as an iterative refinement, the authors conduct a regularization by using 3D exemplar registration, as well as label propagation by random walks with soft constraints, to improve the tooth segmentation. In the first stage of the iteration, 3D exemplars with well-defined topologies are adapted to fit the tooth contours, which are obtained from the random walks based segmentation. The soft constraints on voxel labeling are defined by shape-based foreground dentine probability acquired by the exemplar registration, as well as the appearance-based probability from a support vector machine (SVM) classifier. In the second stage, the labels of the volume-of-interest (VOI) are updated by the random walks with soft constraints. The two stages are optimized iteratively. Instead of the one-shot label propagation in the VOI, an iterative refinement process can achieve a reliable tooth segmentation by virtue of exemplar-based random walks with adaptive soft constraints. Results: The proposed method was applied for tooth segmentation of twenty clinically captured CBCT images. Three metrics, including the Dice similarity coefficient (DSC), the Jaccard similarity coefficient (JSC), and the mean surface deviation (MSD), were used to quantitatively analyze the segmentation of anterior teeth including incisors and canines, premolars, and molars. The segmentation of the anterior teeth achieved a DSC up to 98%, a JSC of 97%, and an MSD of 0.11 mm compared with manual segmentation. For the premolars, the average values of DSC, JSC, and MSD were 98%, 96%, and 0.12 mm, respectively. The proposed method yielded a DSC of 95%, a JSC of 89%, and an MSD of 0.26 mm for molars. Aside from the interactive definition of label priors by the user, automatic tooth segmentation can be achieved in an average of 1.18 min. Conclusions: The proposed technique enables an efficient and reliable tooth segmentation from CBCT images. This study makes it clinically practical to segment teeth from CBCT images, thus facilitating pre- and interoperative uses of dental morphologies in maxillofacial and orthodontic treatments.

60 APPLIED LIFE SCIENCES↗

Isotope ratio-based quantification of carbon assimilation highlights the role of plastidial isoprenoid precursor availability in photosynthesis

Abstract Background We report a method to estimate carbon assimilation based on isotope ratio-mass spectrometry (IRMS) of 13 CO 2 labeled plant tissue. Photosynthetic carbon assimilation is the principal experimental observable which integrates important aspects of primary plant metabolism. It is traditionally measured through gas exchange. Despite its centrality in plant research, gas exchange performs poorly with rosette growth habits typical of Arabidopsis thaliana , mutant lines with limited biomass, and accounts poorly for leaf shading. Results IRMS-based carbon assimilation values from plants labeled at different light intensities were compared to those obtained by gas exchange, and the two methods yielded similar values. Using this method, we observed a strong correlation between 13 C content and labeling time (R 2 = 0.999) for 158 wild-type plants labeled for 6 to 42 min. Plants cultivated under different light regimes showed a linear response with respect to carbon assimilation, varying from 7.38 nmol 13 C mg −1 leaf tissue min −1 at 80 PAR to 19.27 nmol 13 C mg −1 leaf tissue min −1 at 500 PAR. We applied this method to examine the link between inhibition of the 2 C -methyl- d -erythritol-4-phosphate (MEP) pathway and suppression of photosynthesis. A significant decrease in carbon assimilation was observed when metabolic activity in the MEP pathway was compromised by mutation or herbicides targeting the MEP pathway. Mutants affected in MEP pathway genes 1-DEOXY- d -XYLULOSE 5-PHOSPHATE SYNTHASE (DXS) or 1-HYDROXY-2-METHYL-2-(E)-BUTENYL 4-DIPHOSPHATE SYNTHASE (HDS) showed assimilation rates 36% and 61% lower than wild type. Similarly, wild type plants treated with the MEP pathway inhibitors clomazone or fosmidomycin showed reductions of 52% and 43%, respectively, while inhibition of the analogous mevalonic acid pathway, which supplies the same isoprenoid intermediates in the cytosol, did not, suggesting inhibition of photosynthesis was specific to disruption of the MEP pathway. Conclusions This method provides an alternative to gas exchange that offers several advantages: resilience to differences in leaf overlap, measurements based on tissue mass rather than leaf surface area, and compatibility with mutant Arabidopsis lines which are not amenable to gas exchange measurements due to low biomass and limited leaf surface area. It is suitable for screening large numbers of replicates simultaneously as well as post-hoc analysis of previously labeled plant tissue and is complementary to downstream detection of isotopic label in targeted metabolite pools.

2C‑methyl‑d‑erythritol 4‑phosphate pathway↗

A data-centric weak supervised learning for highway traffic incident detection

Using the data from loop detector sensors for near-real-time detection of traffic incidents on highways is crucial to averting major traffic congestion. While recent supervised machine learning methods offer solutions to incident detection by leveraging human-labeled incident data, the false alarm rate is often too high to be used in practice. Specifically, the inconsistency in the human labeling of the incidents significantly affects the performance of supervised learning models. To that end, we focus on a data-centric approach to improve the accuracy and reduce the false alarm rate of traffic incident detection on highways. We develop a weak supervised learning workflow to generate high-quality training labels for the incident data without the ground truth labels, and we use those generated labels in the supervised learning setup for final detection. This approach comprises three stages. First, we introduce a data preprocessing and curation pipeline that processes traffic sensor data to generate high-quality training data through leveraging labeling functions, which can be domain knowledge-related or simple heuristic rules. Second, we evaluate the training data generated by weak supervision using three supervised learning models-random forest, k-nearest neighbors, and a support vector machine ensemble-and long short-term memory classifiers. The results show that the accuracy of all of the models improves significantly after using the training data generated by weak supervision. Third, we develop an online real-time incident detection approach that leverages the model ensemble and the uncertainty quantification while detecting incidents. Finally, we show that our proposed weak supervised learning workflow achieves a high incident detection rate (0.90) and low false alarm rate (0.08).

97 MATHEMATICS AND COMPUTING↗

Water accessibility in a membrane-inserting peptide comparing Overhauser DNP and pulse EPR methods

Water accessibility is a key parameter for the understanding of the structure of biomolecules, especially membrane proteins. Several experimental techniques based on the combination of electron paramagnetic resonance (EPR) spectroscopy with site-directed spin labeling are currently available. Among those, we compare relaxation time measurements and electron spin echo envelope modulation (ESEEM) experiments using pulse EPR with Overhauser dynamic nuclear polarization (DNP) at X-band frequency and a magnetic field of 0.33 T. Overhauser DNP transfers the electron spin polarization to nuclear spins via cross-relaxation. The change in the intensity of the {sup 1}H NMR spectrum of H{sub 2}O at a Larmor frequency of 14 MHz under a continuous-wave microwave irradiation of the nitroxide spin label contains information on the water accessibility of the labeled site. As a model system for a membrane protein, we use the hydrophobic α-helical peptide WALP23 in unilamellar liposomes of DOPC. Water accessibility measurements with all techniques are conducted for eight peptides with different spin label positions and low radical concentrations (10–20 μM). Consistently in all experiments, the water accessibility appears to be very low, even for labels positioned near the end of the helix. The best profile is obtained by Overhauser DNP, which is the only technique that succeeds in discriminating neighboring positions in WALP23. Since the concentration of the spin-labeled peptides varied, we normalized the DNP parameter ϵ, being the relative change of the NMR intensity, by the electron spin concentration, which was determined from a continuous-wave EPR spectrum.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Volumetric imaging of the 3D orientation of cellular structures with a polarized fluorescence light-sheet microscope

Polarized fluorescence microscopy is a valuable tool for measuring molecular orientations in biological samples, but techniques for recovering three-dimensional orientations and positions of fluorescent ensembles are limited. We report a polarized dual-view light-sheet system for determining the diffraction-limited three-dimensional distribution of the orientations and positions of ensembles of fluorescent dipoles that label biological structures. We share a set of visualization, histogram, and profiling tools for interpreting these positions and orientations. We model the distributions based on the polarization-dependent efficiency of excitation and detection of emitted fluorescence, using coarse-grained representations we call orientation distribution functions (ODFs). We apply ODFs to create physics-informed models of image formation with spatio-angular point-spread and transfer functions. We use theory and experiment to conclude that light-sheet tilting is a necessary part of our design for recovering all three-dimensional orientations. We use our system to extend known two-dimensional results to three dimensions in FM1-43-labeled giant unilamellar vesicles, fast-scarlet-labeled cellulose in xylem cells, and phalloidin-labeled actin in U2OS cells. Additionally, we observe phalloidin-labeled actin in mouse fibroblasts grown on grids of labeled nanowires and identify correlations between local actin alignment and global cell-scale orientation, indicating cellular coordination across length scales.

Science & Technology - Other Topics↗

Integrated deep learning framework for unstable event identification and disruption prediction of tokamak plasmas

Abstract The ability to identify underlying disruption precursors is key to disruption avoidance. In this paper, we present an integrated deep learning (DL) based model that combines disruption prediction with the identification of several disruption precursors like rotating modes, locked modes, H-to-L back transitions and radiative collapses. The first part of our study demonstrates that the DL-based unstable event identifier trained on 160 manually labeled DIII-D shots can achieve, on average, 84% event identification rate of various frequent unstable events (like H-L back transition, locked mode, radiative collapse, rotating MHD mode, large sawtooth crash), and the trained identifier can be adapted to label unseen discharges, thus expanding the original manually labeled database. Based on these results, the integrated DL-based framework is developed using a combined database of manually labeled and automatically labeled DIII-D data, and it shows state-of-the-art (AUC = 0.940) disruption prediction and event identification abilities on DIII-D. Through cross-machine numerical disruption prediction studies using this new integrated model and leveraging the C-Mod, DIII-D, and EAST disruption warning databases, we demonstrate the improved cross-machine disruption prediction ability and extended warning time of the new model compared with a baseline predictor. In addition, the trained integrated model shows qualitatively good cross-machine event identification ability. Given a labeled dataset, the strategy presented in this paper, i.e. one that combines a disruption predictor with an event identifier module, can be applied to upgrade any neural network based disruption predictor. The results presented here inform possible development strategies of machine learning based disruption avoidance algorithms for future tokamaks and highlight the importance of building comprehensive databases with unstable event information on current machines.

plasma instabilities↗

Inverse Regression for Extraction of Tumor Site from Cancer Pathology Reports

Pathology reports are the primary source of information for cancer diagnosis of millions of the cancer patients across the United States. Cancer registries label these reports every year. The coded labels incorporate pertinent information such as cancer location, behavior, and histology. This information when combined with clinical information, medical imaging and even genomic information have a great potential to fuel discoveries in cancer research. The coding process is manual and requires many human experts to label the large volume of pathology reports in a timely manner. In this study, we have developed a supervised inverse regression based auto-labeler to automate the task. The experiments were conducted on a set of 942 pathology reports with human expert labels as the ground truth. We observed that the inverse regression based auto-labeler consistently performed better than or comparable to the best performing state-of-the-art method. These results demonstrate the potential of inverse regression for reliable information extraction from the pathology reports.

Dubey, Abhishek↗

Boundary-Aware Adversarial Learning Domain Adaption and Active Learning for Cross-Sensor Building Extraction

The use of convolutional neural networks (CNNs) for building extraction from remote sensing images has been widely studied and many public datasets have been made available for accelerating development of these CNN models. Yet adapting pretrained models at scale in real-world scenarios remains a challenging task. The main barrier is that certain new labels are still needed to compensate for domain shifting between the labeled data and new images that potentially cover new geographic locations or that are from a different sensor. In this article, we propose to add informatively labeled samples from a new image pool under the paradigm of active learning. To select the most useful samples based on model uncertainty, we first tackle the problem of uncalibrated uncertainty estimation due to distribution shifting by adapting feature extractors with boundary-based adversarial learning. Calibrated uncertainty is used as the query criterion in the active learning process, where the most uncertain samples are selected for annotation and included for model retraining. The proposed workflow was tested with three data pairs in which each workflow represents a scenario often encountered in real-world applications, including adapting pretrained models to new images collected with different sensors or to new geographic areas where appearances and types of buildings are very different. Compared to several baselines, including random sampling, temperature scaling (a well-known uncertainty calibration technique), different query strategies, and active domain adaptation methods, the proposed workflow shows that strategically querying a smaller set of samples for labeling achieves comparable or better building extraction performance. The proposed method reduces the number of labeled samples required to achieve sufficient model accuracy, thus significantly reducing hundreds of person-hours for labeled data creation. In addition, we include a few considerations when deploying this workflow in a GPU cluster that can be easily adapted to achieve operational building extraction model retraining.

97 MATHEMATICS AND COMPUTING↗

Automated Shift Detection in Sensor-Based PV Power and Irradiance Time Series: Preprint

PV power and irradiance sensor-based measurements are prone to error, resulting in issues such as abrupt time series data shifts. These shifts, which are usually unintentional, may be caused by software or hardware configuration changes on a PV system, and do not reflect an actual change in overall system performance. Locating these shifts and segmenting the associated time series aids in more accurate future PV analysis. In this research, an offline changepoint detection (CPD) algorithm that automatically detects these abrupt data shifts in sensor-based time series is introduced. Data shift periods in 101 daily PV power and irradiance time series were labeled manually by two solar experts. These data streams represent sensor-based measurements, and display a variety of data shift behaviors. A changepoint detection algorithm was tuned using the 101 labeled data streams, with each model configuration's ability to detect labeled changepoints benchmarked using metrics such as F1-score, recall, and Rand Index. Best performing models on seasonality-corrected data streams include the Pruned Exact Linear (PELT) method, the Binary Segmentation method, and the Bottom-Up method, all scoring an average F1-score of 0.76 or greater at detecting labeled changepoints within a 30-day window for the labeled data sets. To promote further research in this space, we are releasing the labeled data shift sets on U.S. Department of Energy's (DOE) DuraMAT Data Hub, and the associated algorithm in the Python PVAnalytics package.

changepoint detection↗