SEARCH · Search NASA

Results for “patterns in complex systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

All sources NASA NTRS DOE OSTI

DOE OSTI2022

Scalability Testing Approach for Internet of Things for Manufacturing SQL and NoSQL Database Latency and Throughput

The proliferation of low-cost sensors and industrial data solutions has continued to push the frontier of manufacturing technology. Machine learning and other advanced statistical techniques stand to provide tremendous advantages in production capabilities, optimization, monitoring, and efficiency. The tremendous volume of data gathered continues to grow, and the methods for storing the data are critical underpinnings for advancing manufacturing technology. This work aims to investigate the ramifications and design tradeoffs within a decoupled architecture of two prominent database management systems (DBMS): sql and NoSQL. A representative comparison is carried out with Amazon Web Services (AWS) DynamoDB and AWS Aurora MySQL. The technologies and accompanying design constraints are investigated, and a side-by-side comparison is carried out through high-fidelity industrial data simulated load tests using metrics from a major US manufacturer. The results support the use of simulated client load testing for comparing the latency of database management systems as a system scales up from the prototype stage into production. As a result of complex query support, MySQL is favored for higher-order insights, while NoSQL can reduce system latency for known access patterns at the expense of integrated query flexibility. Here, by reviewing this work, a manufacturer can observe that the use of high-fidelity load testing can reveal tradeoffs in IoTfM write/ingestion performance in terms of latency that are not observable through prototype-scale testing of commercially available cloud DB solutions.

AWS↗

DOE OSTI2026

A methodology for domain overlapping coupling of thermal-hydraulic systems

Multi-scale coupling has increasingly drawn attention as a promising approach for modeling thermal systems. Traditional system codes provide fast and robust predictions at the plant scale, while high-fidelity computational fluid dynamics (CFD)-based tools resolve localized flow and heat transfer phenomena with greater accuracy. By combining these complementary strengths, co-simulations enable multi-scale analysis that would otherwise be computationally prohibitive for a standalone CFD code. Here, this work introduces a robust and problem-agnostic domain overlapping (DO) coupling between the system thermal-hydraulic (STH) code System Analysis Module (SAM) and the coarse-mesh CFD code Pronghorn. Both applications belong to the Comprehensive Reactor Analysis Bundle (BlueCRAB) code suite, a code suite in active development at the Idaho National Laboratory (INL), tailored for multi-physics analysis of advanced reactors. Unlike previous approaches, BlueCRAB supports an agnostic interface between codes based on different fidelity, while its coupling formulation can address arbitrary flow geometries with multiple inlets and outlets in coupled components. The implemented method leads to consistent pressure drops, enthalpies, and scalar concentrations between coupled SAM and Pronghorn simulations. The methodology is demonstrated through two verification tests, which ensure the numerical consistency and conservation across the codes, and through one validation test against experimental data. The proposed problems explore different physical aspects inherent to thermal systems, with particular attention given to nuclear reactor analysis. These include buoyancy-driven flows, complex flow patterns, and setups with multiple inlets and outlets, representing challenges in advanced reactor applications.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2020

Clustering-Based Predictive Analytics to Improve Scientific Data Discovery

Given the sheer volume of scientific data archived within the data-intensive projects at the US Department of Energy's Oak Ridge National Laboratory, finding precisely what data we are looking for may not be a trivial task; conversely, we may also miss a more prominent data product. To address such issues, we propose improving the data discovery system and using data analytics methods to comprehend what specific users might be interested in based on their physiological state, search patterns, and past data usage history. This work's primary goal is to prune the complexity, increase the visibility of popular data products, and direct users toward the data that best meet their needs. The proposed algorithm constructs a user profile based on the user's explicit or implicit interactions with the system, such as items they are currently looking at on-site and the key metadata mappings related to the data set. The pattern is then used to build a training data set, which will help find relevant data to recommend to the user.

Devarakonda, Ranjeet↗

DOE OSTI2023

Exploring Multiscale Earth System and Human-Earth System Dynamics in the Puget Sound Region

With its mountain-to-coast hydroclimate, strong influence of Pacific Ocean weather systems and climate patterns, and unique land use history with strong rural-to-urban gradients, the Puget Sound region is a natural laboratory for studying a number of complex processes in, and interactions among, different Earth and human systems. A 1-year scoping study was initiated by the Earth and Environmental Systems Modeling program of the Department of Energy’s Office of Science Biological and Environmental Research. It was intended to elucidate and highlight the rich opportunities Puget Sound offers to advance our understanding of and ability to simulate Earth system changes and human-Earth system interactions. A literature review, multi-day community workshop, and external input were used to develop this scoping study report. The report first summarizes scientific understanding and knowledge gaps associated with major regional systems, including atmosphere and climate, the land surface, coastal and marine processes, and human systems, as well as how these systems are changing over time. It then highlights some of the most notable extreme events in the region, including heat waves, atmospheric rivers, droughts, and wildfires. Finally, key research opportunities for Earth and environmental systems modeling in, above, and around Puget Sound are highlighted.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

PMU Data Quality and Sensor Health Monitoring

Phasor Measurement Units (PMUs) play a critical role in the evolution of the electric power industry by providing high-precision, real-time monitoring of essential power system metrics. However, effectively detecting abnormalities and critical events from PMU data is a complex task, complicated by intricate temporal patterns, a scarcity of labeled data for training algo- rithms, and constraints on online computational power. In this study, we apply TranAD, an innovative algorithm that combines transformer architectures with the refinement of adversarial learning, to both synthetic and real-world PMU datasets for developing a data quality and sensor online health monitoring platform for utilities. Our findings reveal that TranAD not only provides efficient detection and localization but also enhances the detail with which abnormalities are detected, marking a a significant step forward in the field of clean data acquisition processes for power system monitoring

deep neural network, machine learning (ML)↗

DOE OSTI2021

A Deep Learning Modeling Framework to Capture Mixing Patterns in Reactive-Transport Systems

Prediction and control of chemical mixing are vital for many scientific areas such as subsurface reactive transport, climate modeling, combustion, epidemiology, and pharmacology. Due to the complex nature of mixing in heterogeneous and anisotropic media, the mathematical models related to this phenomenon are not analytically tractable. Numerical simulations often provide a viable route to predict chemical mixing accurately. However, contemporary modeling approaches for mixing cannot utilize available spatial-temporal data to improve the accuracy of the future prediction and can be compute-intensive, especially when the spatial domain is large and for long-term temporal predictions. To address this knowledge gap, in this work we will present in this paper a deep learning (DL) modeling framework applied to predict the progress of chemical mixing under fast bimolecular reactions. This framework uses convolutional neural networks (CNN) for capturing spatial patterns and long short-term memory (LSTM) networks for forecasting temporal variations in mixing. By careful design of the framework—placement of non-negative constraint on the weights of the CNN and the selection of activation function, the framework ensures non-negativity of the chemical species at all spatial points and for all times. Our DL-based framework is fast, accurate, and requires minimal data for training. The time needed to obtain a forecast using the model is a fraction (≈ O(-6)) of the time needed to obtain the result using a high-fidelity simulation. To achieve an error of 10% (measured using the infinity norm) for capturing local-scale mixing features such as interfacial mixing, only 24% to 32% of the sequence data for model training is required. To achieve the same level of accuracy for capturing global-scale mixing features, the sequence data required for model training is 64% to 70% of the total spatial-temporal data. Hence, the proposed approach—a fast and accurate way to forecast long-time spatial-temporal mixing patterns in heterogeneous and anisotropic media—will be a valuable tool for modeling reactive-transport in a wide range of applications.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2024

DyG-DPCD: A Distributed Parallel Community Detection Algorithm for Large-Scale Dynamic Graphs

Dynamic (Temporal) graphs capture the valuable evolution of real-world systems, from the continuously evolving patterns of social interactions and genetic pathways to the dynamic fluctuations of economic forces. Detecting communities for such evolving networks poses unique challenges. Detecting and analyzing the evolution of communities within dynamic graphs unlocks valuable insights into the underlying structural and temporal patterns of real-world systems. However, the sheer volume of modern graph data and the inherent complexity of the temporal dimension pose significant challenges to scalable community detection algorithms. Addressing this gap, our work explores the limited landscape of scalable distributed-memory parallel methods specifically designed for dynamic network community detection. We propose a novel parallel algorithm, DyG-DPCD (Dynamic Graph Distributed Parallel Community Detection), to detect communities in dynamic networks using the Message Passing Interface (MPI) framework. We present a vertex-centric approach, allowing us to detect communities through local optimization. Furthermore, we enhance our baseline algorithm by incorporating three heuristics, which improve the algorithm’s performance significantly while maintaining the quality of the solutions. We demonstrate the efficiency of our algorithm by experimenting on several real-world large-scale networks with hundreds of millions of edges spanning diverse domains. Notably, DyG-DPCD achieves speedups between 25× and 30× for large networks that we experimented on using NERSC compute nodes. In conclusion, our algorithm outperforms the STINGER parallel re-agglomeration algorithm by 30×.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

Neutrally-buoyant balloons experiment – EMRTC 2025

This memo announces the successful execution of the neutrally-buoyant balloon experiment (EMRTC 2025), conducted at New Mexico Institute of Mining and Technology’s Energetic Materials Research and Testing Center (EMRTC) in Socorro, NM between April 3 and May 9, 2025. The experiment aimed to build on EMRTC 2022 balloon experiment through testing the effects of lateral and vertical displacement of release locations in a different terrain than EMRTC 2022. EMRTC 2025 employed dual GPS trackers on each balloon to provide both detailed near-source motion tracking in addition to the low-frequency long-distance trackers used in EMRTC 2022. A total of 156 neutrally-buoyant balloons were released over the week of May 5-9, which was approximately 2.5 times the number released in the EMRTC 2022 campaign. The dual tracking system will allow characterizing complex three-dimensional wind structures close to terrain features and diurnal wind patterns to validate wind and plume dispersion models for treaty verification.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2024

The endocannabinoid system in bovine tissues: characterization of transcript abundance in the growing Holstein steer

Abstract Background The endocannabinoid system (ECS) is highly integrated with seemingly all physiological and pathophysiological processes in the body. There is increasing interest in utilizing bioactive plant compounds, for promoting health and improving production in livestock. Given the established interaction between phytochemicals and the ECS, there are many opportunities for identification and development of therapies to address a range of diseases and disorders. However, the ECS has not been thoroughly characterized in cattle, especially in the gastrointestinal tract. The objective of this study was to characterize the distribution and transcriptional abundance of genes associated with the endocannabinoid system in bovine tissues. Methods Tissues including brain, spleen, thyroid, lung, liver, kidney, mesenteric vein, tongue, sublingual mucosa, rumen, omasum, duodenum, jejunum, ileum and colon were collected from 10-mo old Holstein steers (n = 6). Total RNA was extracted and gene expression was measured using absolute quantification real time qPCR. Gene expression of endocannabinoid receptorsCNR1andCNR2, synthesis enzymesDAGLA,DAGLBandNAPEPLD, degradation enzymesMGLLandFAAH, and transient receptor potential vanilloidsTRPV3andTRPV6was measured. Data were analyzed in R using a Kruskal-Wallis followed by a Wilcoxon rank-sum test. Results are reported as the median copy number/20 ng of equivalent cDNA (CN) with interquartile range (IQR). Results The greatest expression ofCNR1andCNR2was in the brain and spleen, respectively. Expression of either receptor was not detected in any gastrointestinal tissues, however there was a tendency (P = 0.095) forCNR2to be expressed above background in rumen. Expression of endocannabinoid synthesis and degradation enzymes varied greatly across tissues. Brain tissue had the greatestDAGLAexpression at 641 CN (IQR 52;P ≤ 0.05).DAGLBwas detected in all tissues, with brain and spleen having the greatest expression (P ≤ 0.05). Expression ofNAPEPLDin the gastrointestinal tract was lowest in tongue and sublingual mucosal. There was no difference in expression ofNAPEPLDbetween hindgut tissues, however these tissues collectively had 592% greater expression than rumen and omasum (P ≤ 0.05). WhileMGLLwas found to be expressed in all tissues, expression ofFAAHwas only above the limit of detection in brain, liver, kidney, jejunum and ileum.TRPV3was expressed above background in tongue, rumen, omasum and colon. Although not different from each other, thyroid and duodenum had the greatest expression ofTRPV6, with 285 (IQR 164) and 563 (IQR 467) CN compared to all other tissues (P < 0.05). Conclusions These data demonstrate the complex distribution and variation of the ECS in bovine tissues. Expression patterns suggest that regulatory functions of this system are tissue dependent, providing initial insight into potential target tissues for manipulation of the ECS.

Veterinary Sciences↗

DOE OSTI2021

Semi-automated Design of Artificial Intelligence Earth Systems Models

Prediction and observation of water cycles at various scales involve not only patterns isolated in space and time, but also modeling of complex spatio-temporal relationships across multiple domains. For instance, evapotranspiration (ET) and leaf area indexes (LAI) are two parameters that are needed to accurately model and understand land-atmosphere processes. Accurate assessments of ET and LAI are critical for understanding hydrological processes, deforestation, crop yield, and irrigation impacts. However, ET estimates for global simulations are available at very coarse spatial resolution. They are usually derived from satellite data based on broad plant functional types (PFTs), which fail to capture fine-scale variations because of changes in vegetation type across the globe. Similarly LAI estimates have typically been derived from vegetation indices at global scales or estimated locally using physical models, both of which suffer from a range of uncertainties that impact model sensitivity. The new era of AI model development for Earth systems (ES) calls for data-driven methods that provide domain scientists with uncertainty-aware estimations of biophysical parameters such as ET and LAI in a generalizable, interpretable, and discoverable manner.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Large Detector Systems in Particle Physics Experiments & the Role Africa Will Play in Detector Technologies of the Future

In this talk, we will give a brief overview of some of the detector technologies deployed in large-scale experiments in particle physic research lab the world and through a specific Micro Pattern Gaseous Detector (MPGD) technologies example, we will discuss challenges associated to these technologies in term of production, assembly, characterization and deployment in complex detector system for the experiments. In the second half of the talk, we will initiate the discussion on the role that African countries could play in the development of detector technologies in the future for application in various field of fundamental and applied science. We will hope to engage the audience to explore initiatives under the African Strategy for Fundamental and Applied Physics (ASFAP) umbrella to encourage African research institutions and universities to invest in detector research and development (R&D) and in infrastructures dedicated aimed at covering all aspects of detector technologies and providing opportunities to generation of bright young African minds to take part in international collaboration of large-scale experiments at facilities such as the Electron Ion Collider (EIC) in the USA or the European Organization for Nuclear Research (CERN) and to contribute to the deployment and operation of detector technologies in future experiments.

Gnanvo, Kondo↗

DOE OSTI2022

Understanding and Leveraging the I/O Patterns of Emerging Machine Learning Analytics

The scientific community is currently experiencing unprecedented amounts of data generated by cutting-edge science facilities. Soon facilities will be producing up to 1 PB/s which will force scientist to use more autonomous techniques to learn from the data. The adoption of machine learning methods, like deep learning techniques, in large-scale workflows comes with a shift in the workflow’s computational and I/O patterns. These changes often include iterative processes and model architecture searches, in which datasets are analyzed multiple times in different formats with different model configurations in order to find accurate, reliable and efficient learning models. This shift in behavior brings changes in I/O patterns at the application level as well at the system level. These changes also bring new challenges for the HPC I/O teams, since these patterns contain more complex I/O workloads. In this paper we discuss the I/O patterns experienced by emerging analytical codes that rely on machine learning algorithms and highlight the challenges in designing efficient I/O transfers for such workflows. We comment on how to leverage the data access patterns in order to fetch in a more efficient way the required input data in the format and order given by the needs of the application and how to optimize the data path between collaborative processes. We will motivate our work and show performance gains with a study case of medical applications.

Gainaru, Ana↗

DOE OSTI2021

Emergence and dynamics of unconfined self-organised vortices in active magnetic roller liquids

Actively driven colloids demonstrate complex out-of-equilibrium dynamics often rivaling self-organized patterns and collective behavior observed in living systems. Recent studies revealed the emergence of steady macroscopic states with multiple interacting vortices in an unconfined environment that emerge from the coupling between microscale particle rotation and translation. Yet, insights into the microscopic behavior during the vortex emergence, growth, and formation of a multi-vortical state remain lacking. Here, we investigate in experiments and simulations how the microscale magnetic roller behavior leads to the emergence of seed vortices, their aggregation or annihilation, and the formation of stable large-scale vortical structures. We reveal that the coupling of roller-induced hydrodynamic flows guides the local self-densifications and self-organization of the micro-rollers into seed vortices. Here, the resulting multi-vortical state is sensitive to the external magnetic field amplitude and allows tuning the rollers' number density in a vortex and its characteristic size.

36 MATERIALS SCIENCE↗

DOE OSTI2024

CHMMPP: A c++ library for constrained Hidden Markov Models

SAND2024-13027O The CHMMPP: A c++ Library for Constrained Hidden Markov Models (HMM) software supports the analysis of multivariate time series data to detect patterns using HMM. Many applications involve the detection and characterization of hidden or latent states in a complex system using observable states and variables. This software supports inference of latent states integrating both an HMM and application-specific constraints that reflect known relationships in hidden states. The CHMMPP software supports application-specific and generic methods for constrained inference. This includes a framework for customized Viterbi methods, constrained inference of hidden states with A* and integer programming methods, and various constraint-informed methods for learning HMM model parameters. CHMMPP focuses on supporting generic methods that enable the agile expression of complex sets of constraints that naturally arise in many real-world applications.

Hart, William↗

DOE OSTI2023

Tuning nonequilibrium phase transitions with inertia

In striking contrast to equilibrium systems, inertia can profoundly alter the structure of active systems. Here, we demonstrate that driven systems can exhibit effective equilibrium-like states with increasing particle inertia, despite rigorously violating the fluctuation–dissipation theorem. Increasing inertia progressively eliminates motility-induced phase separation and restores equilibrium crystallization for active Brownian spheres. This effect appears to be general for a wide class of active systems, including those driven by deterministic time-dependent external fields, whose nonequilibrium patterns ultimately disappear with increasing inertia. The path to this effective equilibrium limit can be complex, with finite inertia sometimes acting to accentuate nonequilibrium transitions. The restoration of near equilibrium statistics can be understood through the conversion of active momentum sources to passive-like stresses. Unlike truly equilibrium systems, the effective temperature is now density dependent, the only remnant of the nonequilibrium dynamics. Further, this density-dependent temperature can in principle introduce departures from equilibrium expectations, particularly in response to strong gradients. Our results provide additional insight into the effective temperature ansatz while revealing a mechanism to tune nonequilibrium phase transitions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2022

Position Papers for the ASCR Workshop on the Management and Storage of Scientific Data

The purpose of this workshop is to identify priority research directions in the area of data management for high-performance and scientific computing above and beyond HPC’s traditional "the parallel file system is the data-management system" model. Supporting the breadth of the DOE mission, including the explosion of AI uses and the growing needs of experimental and observational science, motivates revisiting our assumptions about data management. There are many facets of this topic to explore including: (1) Interfaces for accessing data that resides on traditional persistent storage as well as memory devices; (2) Storage-system architecture design that supports scientific workflows on varied hierarchical storage and networking devices; (3) Devising metadata management infrastructure to support FAIR principles (Findability, Accessibility, Interoperability, and Reusability); (4) Capturing provenance information about scientific data; (5) Utilizing AI to learn I/O patterns of emerging workloads for efficient data management; (6) Providing data management support for AI and complex workflows; and (7) Understanding the overlap between traditional storage systems and I/O (SSIO) efforts and data management. While the program committee has identified these topics as important areas for discussion, we welcome position papers from the community that propose additional topics of interest for discussion at the workshop. The workshop agenda will include breakout sessions for discussing these and selected topic areas to inform priority research directions for data management for high-performance and scientific computing.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Report for the ASCR Workshop on the Management and Storage of Scientific Data

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Resilience Design Patterns: A Structured Approach to Resilience at Extreme Scale (V.2.0)

Reliability is a serious concern for future extreme-scale high-performance computing (HPC) systems. Projections based on the current generation of HPC systems and technology roadmaps suggest the prevalence of very high fault rates in future systems. The errors resulting from these faults will propagate and generate various kinds of failures, which may result in outcomes ranging from result corruptions to catastrophic application crashes. Therefore, the resilience challenge for extreme-scale HPC systems requires coordination between various hardware and software technologies that are capable of handling a broad set of fault models at accelerated fault rates. Also, due to practical limits on power consumption in future HPC systems, they are likely to embrace innovative architectures, increasing the levels of hardware and software complexities. Therefore, the techniques that seek to improve resilience must navigate the complex trade-off space between resilience and the overheads to power consumption and performance. While the HPC community has developed various resilience solutions, application-level techniques as well as system-based solutions, the solution space of HPC resilience techniques remains fragmented. There are no formal methods to integrate the various HPC resilience techniques into composite solutions, nor are there methods to holistically evaluate the adequacy and efficacy of such solutions in terms of their protection coverage, and their performance & power efficiency characteristics. Additionally, few implementations of current resilience solutions are portable to newer architectures and software environments that will be deployed on future systems. We developed a new structured approach to the management of HPC resilience using the concept of resilience-based design patterns. In general, a design pattern is a repeatable solution to a commonly occurring problem. We identified the well-known solutions that are commonly used to deal with faults, errors and failures in HPC systems. In the initial design patterns specification (version 1.0), we described the various solutions, which address specific problems in the design of resilient HPC environments, in the form of patterns. Each pattern describes a problem caused by a fault, error or failure event in an HPC environment, and then describes the core of the solution of the problem in such a way that this solution may be adapted to different systems and implemented at different layers of the system stack. The catalog of these resilience design patterns provides designers with a collection of design elements. To construct complete resilience solutions using combinations of various patterns, we defined a framework that enhances HPC designers' understanding of the important constraints and the opportunities for the design patterns to be implemented and deployed at various layers of the system stack. The design framework is also useful for establishing interfaces and mechanisms to coordinate flexible fault management across hardware and software components, as well as to consider the trade-off between performance, resilience, and power consumption when constructing a solution. The resilience design patterns specification version 1.1 included more detailed explanations of the pattern solutions, the context in which the patterns are applicable, and the implications for hardware or software design. It also provided several additional examples and detailed case studies to demonstrate the use of patterns to build realistic solutions. In version 1.2 of the specification document, we have improved the pattern descriptions, including graphical representations of the pattern components. These improvements are largely based on critical comments, feedback and suggestions received from pattern experts and readers of the previous versions of the specification. The pattern classification has been modified to further clarify the relationships between pattern categories. This version of the specification also introduces a pattern language for resilience design patterns. The pattern language presents the patterns in the catalog as a network, revealing the relations among the resilience patterns. The language provides designers with the means to explore alternative techniques for handling a specific fault model that may have different efficiency and complexity characteristics. Using the pattern language also enables the design and implementation of comprehensive resilience solutions as a set of interconnected resilience patterns that can be instantiated across layers of the system stack. The overall goal of this work is to provide hardware and software designers, as well as the users and operators of HPC systems, a systematic methodology for the design and evaluation of resilience technologies in HPC systems that keep scientific applications running to a correct solution in a timely and cost-efficient manner despite frequent faults, errors, and failures of various types. Version 2.0 expands the resilience design pattern classification and catalog to include self-stabilization patterns and reliability, availability and performance models for each structural pattern.

97 MATHEMATICS AND COMPUTING↗