Search NASA⌕ Search

SEARCH · Search NASA

Results for “pattern detection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2015

Monitoring data transfer latency in CMS computing operations

During the first LHC run, the CMS experiment collected tens of Petabytes of collision and simulated data, which need to be distributed among dozens of computing centres with low latency in order to make efficient use of the resources. While the desired level of throughput has been successfully achieved, it is still common to observe transfer workflows that cannot reach full completion in a timely manner due to a small fraction of stuck files which require operator intervention.For this reason, in 2012 the CMS transfer management system, PhEDEx, was instrumented with a monitoring system to measure file transfer latencies, and to predict the completion time for the transfer of a data set. The operators can detect abnormal patterns in transfer latencies while the transfer is still in progress, and monitor the long-term performance of the transfer infrastructure to plan the data placement strategy.Based on the data collected for one year with the latency monitoring system, we present a study on the different factors that contribute to transfer completion time. As case studies, we analyze several typical CMS transfer workflows, such as distribution of collision event data from CERN or upload of simulated event data from the Tier-2 centres to the archival Tier-1 centres. For each workflow, we present the typical patterns of transfer latencies that have been identified with the latency monitor.We identify the areas in PhEDEx where a development effort can reduce the latency, and we show how we are able to detect stuck transfers which need operator intervention. Lastly, we propose a set of metrics to alert about stuck subscriptions and prompt for manual intervention, with the aim of improving transfer completion times.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

A traffic accident dataset for Chattanooga, Tennessee

This publication presents an annotated accident dataset which fuses traffic data from radar detection sensors, weather condition data, and light condition data with traffic accident data (as illustrated in Fig. 1) in a format that is easy to process using machine learning tools, databases, or data workflows. The purpose of this data is to analyze, predict, and detect traffic patterns when accidents occur. Each file contains a timeseries of traffic speeds, flows, and occupancies at the sensor nearest to the accident, as well as 5 neighboring sensors upstream and downstream. It also contains information about the accident type, date, and time. In addition to the accident data, we provide baseline data for typical traffic patterns during a given time of day. Overall, the dataset contains 6 months of annotated traffic data from November 2020 to April 2021. During this timeframe, and 361 accidents occurred in the monitored area around Chattanooga, Tennessee. This dataset served as the basis for a study on topology-aware automated accident detection for a companion publication [1].

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Assessing complexity and dynamics in epidemics: geographical barriers and facilitators of foot-and-mouth disease dissemination

Introduction: Physical and non-physical processes that occur in nature may influence biological processes, such as dissemination of infectious diseases. However, such processes may be hard to detect when they are complex systems. Because complexity is a dynamic and non-linear interaction among numerous elements and structural levels in which specific effects are not necessarily linked to any one specific element, cause-effect connections are rarely or poorly observed. Methods: To test this hypothesis, the complex and dynamic properties of geo-biological data were explored with high-resolution epidemiological data collected in the 2001 Uruguayan foot-and-mouth disease (FMD) epizootic that mainly affected cattle. County-level data on cases, farm density, road density, river density, and the ratio of road (or river) length/county perimeter were analyzed with an open-ended procedure that identified geographical clustering in the first 11 epidemic weeks. Two questions were asked: (i) do geo-referenced epidemiologic data display complex properties? and (ii) can such properties facilitate or prevent disease dissemination? Results: Emergent patterns were detected when complex data structures were analyzed, which were not observed when variables were assessed individually. Complex properties–including data circularity–were demonstrated. The emergent patterns helped identify 11 counties as ‘disseminators’ or ‘facilitators’ (F) and 264 counties as ‘barriers’ (B) of epidemic spread. In the early epidemic phase, F and B counties differed in terms of road density and FMD case density. Focusing on non-biological, geographical data, a second analysis indicated that complex relationships may identify B-like counties even before epidemics occur. Discussion: Geographical barriers and/or promoters of disease dispersal may precede the introduction of emerging pathogens. If corroborated, the analysis of geo-referenced complexity may support anticipatory epidemiological policies.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Meanders as a scaling motif for understanding of floodplain soil microbiome and biogeochemical potential at the watershed scale

Abstract Background Biogeochemical exports from watersheds are modulated by the activity of microorganisms that function over micron scales. Here, we tested the hypothesis that meander-bound regions share a core microbiome and exhibit patterns of metabolic potential that broadly predict biogeochemical processes in floodplain soils along a river corridor. Results We intensively sampled the microbiomes of floodplain soils located in the upper, middle, and lower reaches of the East River, Colorado. Despite the very high microbial diversity and complexity of the soils, we reconstructed 248 quality draft genomes representative of subspecies. Approximately one third of these bacterial subspecies was detected across all three locations at similar abundance levels, and ~ 15% of species were detected in two consecutive years. Within the meander-bound floodplains, we did not detect systematic patterns of gene abundance based on sampling position relative to the river. However, across meanders, we identified a core floodplain microbiome that is enriched in capacities for aerobic respiration, aerobic CO oxidation, and thiosulfate oxidation with the formation of elemental sulfur. Given this, we conducted a transcriptomic analysis of the middle floodplain. In contrast to predictions made based on the prominence of gene inventories, the most highly transcribed genes were relatively rare amoCAB and nxrAB (for nitrification) genes, followed by genes involved in methanol and formate oxidation, and nitrogen and CO 2 fixation. Within all three meanders, low soil organic carbon correlated with high activity of genes involved in methanol, formate, sulfide, hydrogen, and ammonia oxidation, nitrite oxidoreduction, and nitrate and nitrite reduction. Overall, the results emphasize the importance of sulfur, one-carbon and nitrogen compound metabolism in soils of the riparian corridor. Conclusions The disparity between the scale of a microbial cell and the scale of a watershed currently limits the development of genomically informed predictive models describing watershed biogeochemical function. Meander-bound floodplains appear to serve as scaling motifs that predict aggregate capacities for biogeochemical transformations, providing a foundation for incorporating riparian soil microbiomes in watershed models. Widely represented genetic capacities did not predict in situ activity at one time point, but rather they define a reservoir of biogeochemical potential available as conditions change.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

ARMing the Edge: Designing Edge Computing–Capable Machine Learning Algorithms to Target ARM Doppler Lidar Processing

Abstract There is a need for long-term observations of cloud and precipitation fall speeds in validating and improving rainfall forecasts from climate models. To this end, the U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility Southern Great Plains (SGP) site at Lamont, Oklahoma, hosts five ARM Doppler lidars that can measure cloud and aerosol properties. In particular, the ARM Doppler lidars record Doppler spectra that contain information about the fall speeds of cloud and precipitation particles. However, due to bandwidth and storage constraints, the Doppler spectra are not routinely stored. This calls for the automation of cloud and rain detection in ARM Doppler lidar data so that the spectral data in clouds can be selectively saved and further analyzed. During the ARMing the Edge field experiment, a Waggle node capable of performing machine learning applications in situ was deployed at the ARM SGP site for this purpose. In this paper, we develop and test four algorithms for the Waggle node to automatically classify ARM Doppler lidar data. We demonstrate that supervised learning using a ResNet50-based classifier will classify 97.6% of the clear-air images and 94.7% of cloudy images correctly, outperforming traditional peak detection methods. We also show that a convolutional autoencoder paired with k -means clustering identifies 10 clusters in the ARM Doppler lidar data. Three clusters correspond to mostly clear conditions with scattered high clouds, and seven others correspond to cloudy conditions with varying cloud-base heights.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

An Accurate and Automated Convective Vortex Detection Method for Long-Duration Infrasound Microbarometer Data

Heating of the surficial layer of the atmosphere often generates convective vortices, known as “dust devils” when they entrain visible debris. Convective vortices are common on both Earth and Mars, where they affect the climate via dust loading, contribute to wind erosion, impact the efficiency of photovoltaic systems, and potentially result in injury and property damage. However, long-duration terrestrial convective vortex activity records are rare. We have developed a high-precision and high-recall method to extract convective vortex signatures from infrasound microbarometer data streams. The techniques utilizes a wavelet-based detector to capture potential events and then a template matching system to extract the duration of the vortex. Since permanent and temporary infrasound sensors networks are present throughout the globe (many with open data), our method unlocks a vast new convective vortex dataset without requiring the deployment of specialized instrumentation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Data-driven evaluation of HVAC operation and savings in commercial buildings

Commercial buildings consumed 36% of electricity, or 1.35 trillion kWh, in the United States in 2017, and almost 30% of this energy was wasted. Much of this loss can be attributed to inefficient heating ventilation and air con­ditioning (HVAC) systems. By improving the operational conditions of HVAC, significant savings can be achieved. However, most buildings and building equipment do not use costly sub-meters to monitor and address performance issues, and on-site auditing can be expensive and insufficient. Alternatively in this study, we propose a data-driven method to identify savings opportunities using only whole building meter data and without setting foot in the building. For this purpose, we introduced two algorithms that virtually quantify the value of a thermostat setpoint setback and HVAC rescheduling. Additionally, we developed novel methods for detecting occupancy patterns and quantifying the baseload of the HVAC operation. Using a clustering algorithm, we identified those buildings for which HVAC savings was significant and further categorized the buildings based on their potential for savings. A population study of over 432 commercial buildings demonstrated a median percentage energy savings of 1.6% from a baseload reduction and 2.1% from HVAC rescheduling. Additionally, results indicate that retail buildings have the highest potential for savings among the building types studied.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Learning-based CO 2 concentration prediction: Application to indoor air quality control using demand-controlled ventilation

There have been increasing concerns over the air quality inside buildings as high levels of bio-effluents can cause nausea, dizziness, headaches, and fatigue to the people working in those spaces. First published in 2004 as Standard 62.1, ASHRAE Standard 62.2-2019 requires highly occupied spaces to implement heating, ventilation, and air conditioning (HVAC) that can dilute contaminants produced by occupants. In this regard, occupant-centric ventilation control has been regarded as an effective practice to maintain a satisfactory indoor air quality (IAQ) when dealing with highly variable occupancy environments. However, few established models in current literature and practice consider dynamic occupancy behavior and adaptive IAQ control. To address this gap, a dynamic indoor CO2 model is constructed using machine learning algorithms to forecast CO2concentrations across a range of forecasting horizons. Herein, we tuned and compared six state-of-the-algorithms—including Support Vector Machine, Ada Boost, Random Forest, Gradient Boosting, Logistic Regression, and Multilayer Perceptron. The algorithms’ performances are validated using CO 2 and historical meteorological data collected from a campus classroom with a variable occupancy rate. Simulation results showed that Multilayer Perceptron can strongly predict the volatile CO 2 behavior and also outperforms other algorithms in terms of accuracy. Furthermore, a control strategy capable of modeling and detecting dynamic patterns of CO 2 level is utilized to modulate the ventilation rate in real-time and also reduce the energy consumption. The proposed controller reduced the HVAC fan’s energy consumption by 51.4% and provide ventilation as needed per the ASHRAE standards.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Automated generation of scientific workflow generators with WfChef

Scientific workflow applications have gained significant importance, and their automated and efficient execution on large-scale computing platforms has been the subject of extensive research and development. For these efforts to be successful, a solid experimental methodology is needed to evaluate workflow algorithms and systems. A foundation for this methodology is the availability of realistic workflow instances. Although public repositories provide workflow instances for a few scientific applications, these are limited in scope, and workflow instances are not available for all application scales of interest. To address this limitation, previous work has developed generators of synthetic workflow instances of arbitrary scales. Despite being popular, the implementation of these generators is a manual and labor-intensive process that requires expert application knowledge. As a result, these generators only target a handful of applications, even though there are hundreds of workflow applications in production. Here, we introduce WfChef , a fully automated framework for constructing a synthetic workflow generator for any scientific application. Based on an input set of workflow instances for a particular application, WfChef automatically produces a synthetic workflow generator. To measure the realism of the generated workflows, we define and evaluate several metrics. Using these metrics, we compare the realism of the workflows generated by WfChef generators to that of the workflows generated by the previously available, hand-crafted generators. We find that WfChef generators not only require zero development effort (because they are automatically produced), but also generate workflows that are more realistic than those generated by hand-crafted generators.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Mesoscale Cellular Convection Detection and Classification Using Convolutional Neural Networks: Insights From Long-Term Observations at ARM Eastern North Atlantic Site

Marine boundary layer clouds are crucial in Earth's climate system. They frequently manifest as closed or open cell mesoscale cellular convection (MCC). MCC clouds are challenging to represent accurately in current climate models, highlighting the need for detailed observational data sets and in-depth analyses. This study utilizes over 8 years of observations from the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) User Facility Eastern North Atlantic (ENA) site at Graciosa Island, Azores, to investigate these clouds. We first apply a convolutional neural network with a U-Net architecture to classify open and closed cells, marking the first application of such an approach for automatically detecting MCC patterns from ground-based radar measurements. This method addresses some observational gaps in satellite data related to low temporal resolution, nighttime challenges, and limited vertical structure capture. The analysis of the MCC cases shows clear differences between closed and open MCCs: Closed MCC clouds are characterized by lower cloud tops and bases, shallower cloud geometrical depth, weaker horizontal wind speeds, stronger atmospheric stability, and a more homogeneous liquid water path than open MCCs. Finally, we demonstrate two potential applications of our radar-based MCC classifications: (a) facilitating the investigation of aerosol-cloud interactions and (b) exploring meteorological factors along with MCC's evolution by integrating satellite imagery and back-trajectory analysis. The identified MCC cases offer a valuable resource for the scientific community to study MCC processes further and improve climate model accuracy.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Improving deep learning model performance under parametric constraints for materials informatics applications

Abstract Modern machine learning (ML) and deep learning (DL) techniques using high-dimensional data representations have helped accelerate the materials discovery process by efficiently detecting hidden patterns in existing datasets and linking input representations to output properties for a better understanding of the scientific phenomenon. While a deep neural network comprised of fully connected layers has been widely used for materials property prediction, simply creating a deeper model with a large number of layers often faces with vanishing gradient problem, causing a degradation in the performance, thereby limiting usage. In this paper, we study and propose architectural principles to address the question of improving the performance of model training and inference under fixed parametric constraints. Here, we present a general deep-learning framework based on branched residual learning (BRNet) with fully connected layers that can work with any numerical vector-based representation as input to build accurate models to predict materials properties. We perform model training for materials properties using numerical vectors representing different composition-based attributes of the respective materials and compare the performance of the proposed models against traditional ML and existing DL architectures. We find that the proposed models are significantly more accurate than the ML/DL models for all data sizes by using different composition-based attributes as input. Further, branched learning requires fewer parameters and results in faster model training due to better convergence during the training phase than existing neural networks, thereby efficiently building accurate models for predicting materials properties.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Adaptively coupled phase retrieval in multi-peak Bragg coherent diffraction imaging

Recent advances in Bragg coherent diffraction imaging (BCDI) experimental techniques permit routine measurement of multiple Bragg peaks from a single crystalline grain. The resulting images contain the full lattice distortion vector field which can be differentiated to provide lattice strain and rotation. With the advent of fourth-generation synchrotron light sources, such multi-peak datasets are produced at high rates, facilitating the need for rapid phase retrieval of the multiple peaks and subsequent image analysis. Here we describe and demonstrate a new implementation of a coupled phase retrieval technique for multi-peak BCDI which simultaneously treats each Bragg peak of the dataset and produces a three-dimensional image of the crystal's morphology and lattice distortion field. In addition, this method uses the redundant information contained in the various Bragg diffraction patterns to detect and suppress spurious signal appearing on the detector in a subset of the measurements. Compared with manual data editing, adaptive coupling produces a more consistent phase profile in reciprocal space and sharper surfaces in direct space, with no significant difference in computational cost. These improvements reduce the need for manual preprocessing and enable robust high-throughput analysis of multi-peak BCDI data, supporting near-real-time strain microscopy at modern synchrotron facilities.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Investigation of the Anisotropy of Y-Ba-Cu-O Thin Films With Photoemission Electron Microscopy

Understanding the anisotropy in the electrical properties of YBa2Cu3O7-δ (YBCO) is important for understanding the fundamental mechanism of superconductivity in unconventional superconductors. Additionally it is also essential for achieving uniform and controllable critical currents and resistances in YBCO Josephson junctions. Here, this study correlates work function measurements of different intrinsic regions on YBCO thin films, obtained through PhotoEmission Electron Microscopy (PEEM), with in plane tunneling data and helium ion imaging. YBCO thin films, 40 nm in thickness, were selectively irradiated with 300 keV helium using a Pelletron to investigate the effects of irradiation compared to unirradiated regions. Post-irradiation PEEM images revealed distinct contrasts between irradiated and non-irradiated regions, suggesting a metal-to-insulator transition. In non-irradiated areas, a domain pattern was detected, showing a 25 meV difference in work function, attributed to CuO and BaO rich surface regions. A similar domain structure was observed using high-resolution helium ion imaging; however, the helium ion beam can damage the YBCO, making PEEM a valuable non-destructive alternative. This work highlights the correlation between PEEM measurements and in-plane tunneling properties of YBCO, providing insights into material orientation and its impact on Josephson junction performance. Furthermore, it offers a non-destructive approach to understanding the anisotropy of cuprate materials, its superconducting properties, and the factors affecting Josephson junction performance.

Qu, Rochelle Y. [Univ. of California, Riverside, C↗
DOE OSTI2016

On polarimetric radar signatures of deep convection for model evaluation: columns of specific differential phase observed during MC3E

The representation of deep convection in general circulation models is in part informed by cloud-resolving models (CRMs) that function at higher spatial and temporal resolution; however, recent studies have shown that CRMs often fail at capturing the details of deep convection updrafts. With the goal of providing constraint on CRM simulation of deep convection updrafts, ground-based remote sensing observations are analyzed and statistically correlated for four deep convection events observed during the Midlatitude Continental Convective Clouds Experiment (MC3E). Since positive values of specific differential phase observed above the melting level are associated with deep convection updraft cells, so-called columns are analyzed using two scanning polarimetric radars in Oklahoma: the National Weather Service Vance WSR-88D (KVNX) and the Department of Energy C-band Scanning Atmospheric Radiation Measurement (ARM) Precipitation Radar (C-SAPR). KVNX and C-SAPR volumes and columns are then statistically correlated with vertical winds retrieved via multi-Doppler wind analysis, lightning flash activity derived from the Oklahoma Lightning Mapping Array, and KVNX differential reflectivity . Results indicate strong correlations of volume above the melting level with updraft mass flux, lightning flash activity, and intense rainfall. Analysis of columns reveals signatures of changing updraft properties from one storm event to another as well as during event evolution. Comparison of to shows commonalities in information content of each, as well as potential problems with associated with observational artifacts.

Atm↗
DOE OSTI2017

Hyperspectral Geobotanical Remote Sensing for Monitoring and Verifying CO 2 Containment Final Report CRADA No. TC-2036-02

This collaborative effort was in support of the CO 2 Capture Project (CCP), to develop techniques that integrate overhead images of plant species, plant health, geological formations, soil types, aquatic, and human use spatial patterns for detection and discrimination of any CO 2 releases from underground storage formations. The goal of this work was to demonstrate advanced hyperspectral geobotanical remote sensing methods to assess potential leakage of CO 2 from underground storage. The timeframes and scales relevant to the long-term storage of CO 2 in the subsurface make remote sensing methods attractive. Moreover, it has been shown that individual field measurements of gas composition are subject to variability on extremely small temporal and spatial scales. The ability to verify ultimate reservoir integrity and to place individual surface measurements into context will be crucial to successful long-term monitoring and verification activities. The desired results were to produce a defined and tested procedure that could be easily used for long-term monitoring of possible CO 2 leakage from underground CO 2 sequestration sites. This testing standard will be utilized on behalf of the oil industry.

42 ENGINEERING↗
DOE OSTI2025

Responsible Artificial Intelligence for Insider Threat Mitigation

This report examines the application of artificial intelligence (AI) technologies for insider threat mitigation (ITM) programs in nuclear security facilities. Insider threat detection presents unique challenges due to the subtle and adaptive nature of these threats, the complex signatures involved, and the scarcity of available data for analysis. Traditional human-centered approaches, while essential, face limitations in processing large amounts of data continuously and detecting subtle patterns across multiple systems. AI technologies can potentially address these limitations by providing 24/7 monitoring capabilities, identifying complex patterns that might escape human observation, and offering consistent application of security criteria. However, the deployment of AI in nuclear security contexts introduces significant new risks, including workflow disruption, expanded attack surfaces, potential for misuse, and ethical concerns regarding privacy, fairness, transparency, safety, and security. The high-consequence nature of nuclear security decisions demands careful consideration of these risks and systematic approaches to their mitigation.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2017

Volatile Metabolites Emission by In Vivo Microalgae—An Overlooked Opportunity?

Fragrances and malodors are ubiquitous in the environment, arising from natural and artificial processes, by the generation of volatile organic compounds (VOCs). Although VOCs constitute only a fraction of the metabolites produced by an organism, the detection of VOCs has a broad range of civilian, industrial, military, medical, and national security applications. The VOC metabolic profile of an organism has been referred to as its ‘volatilome’ (or ‘volatome’) and the study of volatilome/volatome is characterized as ‘volatilomics’, a relatively new category in the ‘omics’ arena. There is considerable literature on VOCs extracted destructively from microalgae for applications such as food, natural products chemistry, and biofuels. VOC emissions from living (in vivo) microalgae too are being increasingly appreciated as potential real-time indicators of the organism’s state of health (SoH) along with their contributions to the environment and ecology. This review summarizes VOC emissions from in vivo microalgae; tools and techniques for the collection, storage, transport, detection, and pattern analysis of VOC emissions; linking certain VOCs to biosynthetic/metabolic pathways; and the role of VOCs in microalgae growth, infochemical activities, predator-prey interactions, and general SoH.

Biochemistry & Molecular Biology↗