Search NASA⌕ Search

SEARCH · Search NASA

Results for “emergence of patterns”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS1976

Observation of spatial and temporal variations in X-ray bright point emergence patterns

Observations of X-ray bright points (XBP) over a six-month interval in 1973 show significant variations in both the number density of XBP as a function of heliographic longitude and in the full-sun average number of XBP from one rotation to the next. The observed increases in XBP emergence are estimated to be equivalent to several large active regions emerging per day for several months. The number of XBP emerging at high latitudes varies in phase with the low-latitude variation and reaches a maximum approximately simultaneous with a major outbreak of active regions. The quantity of magnetic flux emerging in the form of XBP at high latitudes alone is estimated to be as large as the contribution from all active regions.

Golub, L.↗
NASA NTRS2019

A Segmentation Algorithm for Characterizing Rise and Fall Segments in Seasonal Cycles: An Application to XCO2 to Estimate Benchmarks and Assess Model Bias

There is more useful information in the time series of satellite-derived column-averaged carbon dioxide (XCO2) than is typically characterized. Often, the entire time series is treated at once without considering detailed features at shorter timescales, such as nonstationary changes in signal characteristics – amplitude, period and phase. In many instances, signals are visually and analytically differentiable from other portions in a time series. Each rise (increasing) and fall (decreasing) segment in the seasonal cycle is visually discernable in a graph of the time series. The rise and fall segments largely result from seasonal differences in terrestrial ecosystem production, which means that the segment's signal characteristics can be used to establish observational benchmarks because the signal characteristics are driven by similar underlying processes. We developed an analytical segmentation algorithm to characterize the rise and fall segments in XCO2 seasonal cycles. We present the algorithm for general application of the segmentation analysis and emphasize here that the segmentation analysis is more generally applicable to cyclic time series. We demonstrate the utility of the algorithm with specific results related to the comparison between satellite- and model-derived XCO2 seasonal cycles (2009–2012) for large bioregions across the globe. We found a seasonal amplitude gradient of 0.74–0.77 ppm for every 10∘ of latitude in the satellite data, with similar gradients for rise and fall segments. This translates to a south–north seasonal amplitude gradient of 8 ppm for XCO2, about half the gradient in seasonal amplitude based on surface site in situ CO2 data (∼19 ppm). The latitudinal gradients in the period of the satellite-derived seasonal cycles were of opposing sign and magnitude (−9 d per 10∘ latitude for fall segments and 10 d per 10∘ latitude for rise segments) and suggest that a specific latitude (∼2∘ N) exists that defines an inversion point for the period asymmetry. Before (after) the point of asymmetry inversion, the periods of rise segments are lesser (greater) than the periods of fall segments; only a single model could reproduce this emergent pattern. The asymmetry in amplitude and the period between rise and fall segments introduces a novel pattern in seasonal cycle analyses, but, while we show these emergent patterns exist in the data, we are still breaking ground in applying the information for science applications. Maybe the most useful application is that the segmentation analysis allowed us to decompose the model biases into their correlated parts of biases in amplitude, period and phase independently for rise and fall segments. We offer an extended discussion on how such information about model biases and the emergent patterns in satellite-derived seasonal cycles can be used to guide future inquiry and model development.

Calle, Leonardo↗
NASA NTRS2019

A Segmentation Algorithm for Characterizing Rise and Fall Segments in Seasonal Cycles: an Application to Xco2 to Estimate Benchmarks and Assess Model Bias

There is more useful information in the time series of satellite-derived column-averaged carbon dioxide (XCO2) than is typically characterized. Often, the entire time series is treated at once without considering detailed features at shorter timescales, such as nonstationary changes in signal characteristics – amplitude, period and phase. In many instances, signals are visually and analytically differentiable from other portions in a time series. Each rise (increasing) and fall (decreasing) segment in the seasonal cycle is visually discernable in a graph of the time series. The rise and fall segments largely result from seasonal differences in terrestrial ecosystem production, which means that the segment's signal characteristics can be used to establish observational benchmarks because the signal characteristics are driven by similar underlying processes. We developed an analytical segmentation algorithm to characterize the rise and fall segments in XCO2 seasonal cycles. We present the algorithm for general application of the segmentation analysis and emphasize here that the segmentation analysis is more generally applicable to cyclic time series. We demonstrate the utility of the algorithm with specific results related to the comparison between satellite- and model-derived XCO2 seasonal cycles (2009–2012) for large bioregions across the globe. We found a seasonal amplitude gradient of 0.74–0.77 ppm for every 10∘ of latitude in the satellite data, with similar gradients for rise and fall segments. This translates to a south–north seasonal amplitude gradient of 8 ppm for XCO2, about half the gradient in seasonal amplitude based on surface site in situ CO2 data (∼19 ppm). The latitudinal gradients in the period of the satellite-derived seasonal cycles were of opposing sign and magnitude (−9 d per 10∘ latitude for fall segments and 10 d per 10∘ latitude for rise segments) and suggest that a specific latitude (∼2∘ N) exists that defines an inversion point for the period asymmetry. Before (after) the point of asymmetry inversion, the periods of rise segments are lesser (greater) than the periods of fall segments; only a single model could reproduce this emergent pattern. The asymmetry in amplitude and the period between rise and fall segments introduces a novel pattern in seasonal cycle analyses, but, while we show these emergent patterns exist in the data, we are still breaking ground in applying the information for science applications. Maybe the most useful application is that the segmentation analysis allowed us to decompose the model biases into their correlated parts of biases in amplitude, period and phase independently for rise and fall segments. We offer an extended discussion on how such information about model biases and the emergent patterns in satellite-derived seasonal cycles can be used to guide future inquiry and model development.

segmentation algorithm↗
DOE OSTI2025

Equilibrium-gated pattern formation: How molecular dissociation thermodynamics drive emergent behavior in dissipative polymeric systems

Emergent patterns in biological systems arise through dissipative processes that balance reaction and transport phenomena, producing highly functional properties from self-regulating mechanisms. Synthetic fabrication, by contrast, often relies on user-controlled, multistep methods that lack the self-organizing capabilities of natural systems. Inspired by nature, we sought chemical systems that integrate strongly coupled reaction and transport phenomena, identifying frontal ring-opening metathesis polymerization (FROMP) as a method capable of creating diverse forms and functions through reactive processing. By employing discrete molecular initiators, FROMP allows precise control of key reaction steps—inhibition, initiation, and propagation. Using an integrated computational and experimental framework, we uncover how near-equilibrium inhibition dynamics, coupled with far-from-equilibrium reaction kinetics, drive pattern formation in frontally polymerized synthetic materials. We propose the concept of equilibrium-gated pattern formation, demonstrating how initiator chemistry can be tuned to achieve programmable macroscale properties. Our study reveals a surprising insight: Emergent behavior in FROMP systems arises from the inhibition-dominated regime of resin composition, expanding prior observations that such behavior is confined to a narrow compositional space near the boundary between front quenching and uniform front propagation. We identify a broader compositional window, far from the quenching regime, where emergent behavior reliably manifests. This expanded design space significantly enhances the operational flexibility of reactive systems and their capacity for self-organization. Furthermore, these insights provide a roadmap for designing bioinspired materials with self-organizing capabilities, unlocking possibilities in synthetic manufacturing.

Architected Polymers↗
DOE OSTI2022

Understanding and Leveraging the I/O Patterns of Emerging Machine Learning Analytics

The scientific community is currently experiencing unprecedented amounts of data generated by cutting-edge science facilities. Soon facilities will be producing up to 1 PB/s which will force scientist to use more autonomous techniques to learn from the data. The adoption of machine learning methods, like deep learning techniques, in large-scale workflows comes with a shift in the workflow’s computational and I/O patterns. These changes often include iterative processes and model architecture searches, in which datasets are analyzed multiple times in different formats with different model configurations in order to find accurate, reliable and efficient learning models. This shift in behavior brings changes in I/O patterns at the application level as well at the system level. These changes also bring new challenges for the HPC I/O teams, since these patterns contain more complex I/O workloads. In this paper we discuss the I/O patterns experienced by emerging analytical codes that rely on machine learning algorithms and highlight the challenges in designing efficient I/O transfers for such workflows. We comment on how to leverage the data access patterns in order to fetch in a more efficient way the required input data in the format and order given by the needs of the application and how to optimize the data path between collaborative processes. We will motivate our work and show performance gains with a study case of medical applications.

Gainaru, Ana↗
DOE OSTI2023

Assessing complexity and dynamics in epidemics: geographical barriers and facilitators of foot-and-mouth disease dissemination

Introduction: Physical and non-physical processes that occur in nature may influence biological processes, such as dissemination of infectious diseases. However, such processes may be hard to detect when they are complex systems. Because complexity is a dynamic and non-linear interaction among numerous elements and structural levels in which specific effects are not necessarily linked to any one specific element, cause-effect connections are rarely or poorly observed. Methods: To test this hypothesis, the complex and dynamic properties of geo-biological data were explored with high-resolution epidemiological data collected in the 2001 Uruguayan foot-and-mouth disease (FMD) epizootic that mainly affected cattle. County-level data on cases, farm density, road density, river density, and the ratio of road (or river) length/county perimeter were analyzed with an open-ended procedure that identified geographical clustering in the first 11 epidemic weeks. Two questions were asked: (i) do geo-referenced epidemiologic data display complex properties? and (ii) can such properties facilitate or prevent disease dissemination? Results: Emergent patterns were detected when complex data structures were analyzed, which were not observed when variables were assessed individually. Complex properties–including data circularity–were demonstrated. The emergent patterns helped identify 11 counties as ‘disseminators’ or ‘facilitators’ (F) and 264 counties as ‘barriers’ (B) of epidemic spread. In the early epidemic phase, F and B counties differed in terms of road density and FMD case density. Focusing on non-biological, geographical data, a second analysis indicated that complex relationships may identify B-like counties even before epidemics occur. Discussion: Geographical barriers and/or promoters of disease dispersal may precede the introduction of emerging pathogens. If corroborated, the analysis of geo-referenced complexity may support anticipatory epidemiological policies.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Ferromagnetic Resonance Modes in the Exchange-Dominated Limit in Cylinders of Finite Length

We analyze the magnetic mode structure of axially magnetized finite-length nanoscopic cylinders in a regime where the exchange interaction dominates, along with simulations of the mode frequencies of the ferrimagnet yttrium iron garnet. For the bulk modes, we find that the frequencies can be represented by an expression given by Herring and Kittel by using wavevector components obtained by fitting the mode patterns emerging from these simulations. In addition to the axial, radial, and azimuthal modes that are present in an infinite cylinder, we find localized “cap modes” that are “trapped” at the top and bottom cylinder faces by the inhomogeneous dipole field emerging from the ends. Semiquantitative explanations are given for some of the modes, in terms of a one-dimensional Schrodinger equation, which is valid in the exchange-dominant case. The assignment of the azimuthal-mode number is carefully discussed, and the frequency splitting of a few pairs of nearly degenerate modes is determined through the beat pattern emerging from them.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
NASA NTRS1999

Emergence of postural patterns as a function of vision and translation frequency

Emergence of postural patterns as a function of vision and translation frequency. We examined the frequency characteristics of human postural coordination and the role of visual information in this coordination. Eight healthy adults maintained balance in stance during sinusoidal support surface translations (12 cm peak to peak) in the anterior-posterior direction at six different frequencies. Changes in kinematic and dynamic measures revealed that both sensory and biomechanical constraints limit postural coordination patterns as a function of translation frequency. At slow frequencies (0.1 and 0.25 Hz), subjects ride the platform (with the eyes open or closed). For fast frequencies (1.0 and 1.25 Hz) with the eyes open, subjects fix their head and upper trunk in space. With the eyes closed, large-amplitude, slow-sway motion of the head and trunk occurred for fast frequencies above 0.5 Hz. Visual information stabilized posture by reducing the variability of the head's position in space and the position of the center of mass (CoM) within the support surface defined by the feet for all but the slowest translation frequencies. When subjects rode the platform, there was little oscillatory joint motion, with muscle activity limited mostly to the ankles. To support the head fixed in space and slow-sway postural patterns, subjects produced stable interjoint hip and ankle joint coordination patterns. This increase in joint motion of the lower body dissipated the energy input by fast translation frequencies and facilitated the control of upper body motion. CoM amplitude decreased with increasing translation frequency, whereas the center of pressure amplitude increased with increasing translation frequency. Our results suggest that visual information was important to maintaining a fixed position of the head and trunk in space, whereas proprioceptive information was sufficient to produce stable coordinative patterns between the support surface and legs. The CNS organizes postural patterns in this balance task as a function of available sensory information, biomechanical constraints, and translation frequency.

NASA Discipline Neuroscience↗
DOE OSTI2025

RE-INTEGRATE EMT Simulation Software: Graph Convolutional Network for Sparse Matrix Pattern Detection

The increasing complexity of power networks, driven by proliferation of inverters, presents analytical challenges that simplified models often fail to capture, necessitating Electromagnetic Transient (EMT) simulations. EMT models are represented as discretized differential-algebraic equations (DAEs), forming a linear system Ax = b that is computationally intensive to solve. Due to inherent sparsity of adjacency matrix A, distinct patterns emerge that, when accurately identified, enable efficient solver selection to minimize computation time. However, identifying ideal pattern is complicated by numerous reordering algorithms and limited structural insights. To address this, we introduce a Graph Convolutional Network (GCN) model for classifying sparse matrix patterns common in power system analysis. The model, achieving 96% test accuracy, is validated using PV plant models of 125 MW capacities connected to New England 39-bus transmission system (TS), and further scaled to a 4,992-bus network with 384 PV plants, yielding 191, 616 × 191, 616 sized A matrix. For all cases, the GCN model accurately identifies the matrix’s intrinsic sparse pattern, demonstrating its potential to enhance solver performance in EMT analysis.

Hossain, Md Rifat [Florida International Universit↗
DOE OSTI2026

A Critical Review of Heliostat Design for Concentrating Solar Thermal Technologies

Heliostat designs have undergone a widespread and eclectic development process, with many unique designs demonstrated. However, recent developments do not show the overall cohort converging toward a globally accepted universal design. Here, this study characterizes heliostats by breaking down and evaluating design traits based on emergent patterns from a comprehensive compilation of known heliostat designs spanning several decades. Four main categories for evaluation emerged: heliostat base, heliostat primary axis, heliostat drive, and facet support. Each of these four categories is further defined by four subtypes so that all heliostats fall into a single subtype within each category. The classified heliostats are ranked, yielding several view slices into the heliostat compilation or a breakdown of heliostats by type. An analysis of the breakdown shows several trends: a scale-up of established designs, new approaches at small to medium scales, and a movement toward greater adoption of linear drives. These trends reflect the most meaningful contributing factors to a proposed trajectory for a new era of heliostat designs striving to meet widely considered cost targets of $\$$50/m 2 or $\$$75/m 2 .

14 SOLAR ENERGY↗
NASA NTRS2005

Loggers and Forest Fragmentation: Behavioral Models of Road Building in the Amazon Basin

Although a large literature now exists on the drivers of tropical deforestation, less is known about its spatial manifestation. This is a critical shortcoming in our knowledge base since the spatial pattern of land-cover change and forest fragmentation, in particular, strongly affect biodiversity. The purpose of this article is to consider emergent patterns of road networks, the initial proximate cause of fragmentation in tropical forest frontiers. Specifically, we address the road-building processes of loggers who are very active in the Amazon landscape. To this end, we develop an explanation of road expansions, using a positive approach combining a theoretical model of economic behavior with geographic information systems (GIs) software in order to mimic the spatial decisions of road builders. We simulate two types of road extensions commonly found in the Amazon basin in a region: showing the fishbone pattern of fragmentation. Although our simulation results are only partially successful, they call attention to the role of multiple agents in the landscape, the importance of legal and institutional constraints on economic behavior, and the power of GIs as a research tool.

Arima, Eugenio Y.↗
NASA NTRS1975

The structure and evolution of coronal holes

Soft X-ray observations of coronal holes are analyzed to determine the structure, temporal evolution, and rotational properties of those features as well as possible mechanisms which may account for their almost rigid rotational characteristics. It is shown that coronal holes are open features with a divergent magnetic-field configuration resulting from a particular large-scale magnetic-field topology. They are apparently formed when the successive emergence and dispersion of active-region fields produce a swath of unipolar field founded by fields of opposite polarity, and they die when large-scale field patterns emerge which significantly distort the original field configuration. Two types of holes are described (compact and elongated), and three possible rotation mechanisms are considered: a rigidly rotating subphotospheric phenomenon, a linking of high and low latitudes by closed field lines, and an interaction between moving coronal material and open field lines.

Timothy, A. F.↗
DOE OSTI2025

3D pattern formation of a protein–membrane suspension

Many essential cellular processes, including cell division and the establishment of cell polarity during embryogenesis, are regulated by pattern-forming proteins. These proteins often need to bind to a substrate, such as the cell membrane, onto which they interact and form two-dimensional (2D) patterns. It is unclear how the membrane’s continuity and dimensionality impact pattern formation. Here, we address this gap using the MinDE system, a prototypical example of pattern-forming membrane proteins. We show that when the lipid substrate is fragmented into submicrometer-sized diffusive liposomes, adenosine triphosphate-driven protein–protein interactions generate three-dimensional (3D) spatially extended patterns, despite the complete loss of membrane continuity. Remarkably, these 3D patterns emerge at scales four orders of magnitude larger than the individual liposomes. By systematically varying protein concentration, liposome size, and density, we observed and characterized a variety of 3D dynamical patterns not seen on continuous 2D membranes, including traveling waves, dynamical spirals, and a coexistence phase. Simulations and linear stability analysis of a coarse-grained model revealed that the physical properties of the dispersed membrane effectively rescale both the protein–membrane binding rates and diffusion, two key parameters governing pattern formation and wavelength selection. These findings highlight the robustness of Min’s pattern-forming ability, suggesting that protein–membrane suspensions could serve as an adaptable template for studying out-of-equilibrium self-organization in 3D, beyond in vivo contexts.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Divergent trait controls on soluble sugars and starch underlie global strategies of tree carbohydrate storage

Nonstructural carbohydrate (NSC) stores buffer tree metabolism, osmotic regulation, and defense, thereby mediating tolerance and survival under climate extremes. Yet, the functional and evolutionary determinants of interspecific variation in NSC remain elusive, limiting understanding and prediction of forest carbon allocation and mortality under global change. Here, we present a cross-species synthesis of NSC concentrations across multiple organs for 281 woody species from 102 mixed forest communities worldwide, where we quantified species-specific deviations from community means to disentangle intrinsic trait effects from environmental and methodological variation. We found phylogenetic signals in NSC deviations, with coniferous gymnosperms and evergreen species consistently maintaining lower stem soluble sugars and starch concentrations than co-occurring angiosperms and deciduous species, respectively. A global pattern emerged where greater stomatal sensitivity to leaf water potential was associated with declines in the relative concentrations of both sugars and starch. In contrast, xylem hydraulic safety traits showed weak and organ-dependent relationships with NSC concentrations. Sugars increased with photosynthetic capacity and declined with wood density, whereas starch showed the reverse pattern, which aligned with the distinct functional-metabolic roles of sugars and starch. By integrating trait-based ecology with a community-centered framework, our study provides global evidence that stomatal regulation, photosynthetic capacity, specific leaf area, and wood density jointly govern interspecific NSC variation, through contrasting effects on sugars and starch. These are among the most broadly measured traits globally, thus the emergent carbohydrate–trait relationships can have broad applications toward understanding and predicting forest growth and survival under climate change.

tropic system↗
NASA NTRS1998

Radiative Ignition and Transition to Spread Investigation (RITSI)

A total of 25 experiments was conducted in the Glovebox Facility on the Third United States Microgravity payload (USMP3) mission to study the behavior of both flaming and smoldering ignition events, the transition from ignition to the flame/smoldering spread, and the flame/smoldering growth pattern in air. Twenty one of the 25 experiments were flaming experiments and the remainder were smoldering experiments. Ignition was initiated by a heated wire across a thermally thin filter paper in the middle of the sample for the two-dimensional configuration and by a focused beam from a halogen/tungsten lamp at the center of the sample for the three-dimensional configuration. The external air flow velocity was varied from 0 cm/s to 6.5 cm/s. The ignition and subsequent flame spread events were recorded by a video camera, a 35 mm camera, and 6 thermocouples (2 in the gas phase and 4 in the sample). The results indicate that non-piloted radiative ignition of the paper by external thermal radiation tends to occur more easily than in normal gravity. In the two-dimensional configuration, the transition from ignition to downstream flame spread never occurred; only the transition to upstream spread took place. In the three-dimensional configuration, a char growth pattern emerged in the shape of a fan, with the ignited area as the center of the fan and the fan spreading in the upstream direction. The internal angle of the fan increased with an increase in external flow velocity (higher flow velocity gave a more opened fan pattern). At an external flow velocity of 5 cm/s, the flame was horseshoe-shaped and the char pattern became an elongated semicircle toward upstream. It appears that the peak upstream flame spread rate was reached at a higher external velocity than for the two-dimensional flame front. Flame spread much faster along open edges of the sample paper than along the sample face, presumably due to there being larger supply of oxygen and energy feedback at the open edges than at the surface. These results indicate the possible importance of the effect of the flame front shape such as the curvature of the flame front on spread rate and flame strength. A complex, unexpected finger-shaped char growth pattern was observed during the smoldering experiment. Higher external flow velocity increased the number of localized smoldering fronts, of the char fingers they left behind, and frequency of bifurcations from the fingers. At present, it is not clear what caused such a complex char growth pattern.

Kashiwagi, Takashi↗
DOE OSTI2023

Combining Agent Based Modeling and System Dynamics to Investigate the Circularity of Plastics

The United States currently produces about 1 million metric ton of ocean plastic pollution annually. One proposed solution to combat plastic waste is a circular economy (CE), which aims to transition from today's take-make-waste linear pattern of production and consumption to a system where the value of resources is maximized over time. Two key methods in industrial ecology are useful in assessing the viability of CE: (1) System Dynamics (SD) and (2) Agent Based Modeling (ABM). In prior work, the plastic life cycle was modeled with SD and ABM. The two models calculate recycling rates and costs in different ways, making it difficult to pinpoint necessary next steps. We integrate the ABM and SD models - linking the emergent patterns from micro-level human decisions to system level processes - which allows a more comprehensive understanding of feedbacks, costs, and environmental impacts. The integrated model is more accurate, and can be used to visualize recycling rates and human health and environmental impacts over time. The difference between the integrated and original SD model prompts a Sobol sensitivity analysis, which is used to understand which behavioral factors most affect plastic recycling patterns. We find that the habitual component is typically the most influential in promoting positive recycling behavior. Additionally, we utilize the combined model to understand and visualize how various behavioral intervention scenarios, like improved access to recycling programs and cart tagging, influence recycling patterns; these results can guide future policy-making.

agent-based modeling↗
DOE OSTI2022

Emerging signals of declining forest resilience under climate change

Forest ecosystems depend on their capacity to withstand and recover from natural and anthropogenic perturbations (that is, their resilience). Experimental evidence of sudden increases in tree mortality is raising concerns about variation in forest resilience, yet little is known about how it is evolving in response to climate change. Here we integrate satellite-based vegetation indices with machine learning to show how forest resilience, quantified in terms of critical slowing down indicators, has changed during the period 2000–2020. We show that tropical, arid and temperate forests are experiencing a significant decline in resilience, probably related to increased water limitations and climate variability. By contrast, boreal forests show divergent local patterns with an average increasing trend in resilience, probably benefiting from warming and CO 2 fertilization, which may outweigh the adverse effects of climate change. These patterns emerge consistently in both managed and intact forests, corroborating the existence of common large-scale climate drivers. Reductions in resilience are statistically linked to abrupt declines in forest primary productivity, occurring in response to slow drifting towards a critical resilience threshold. Approximately 23% of intact undisturbed forests, corresponding to 3.32 Pg C of gross primary productivity, have already reached a critical threshold and are experiencing a further degradation in resilience. Together, these signals reveal a widespread decline in the capacity of forests to withstand perturbation that should be accounted for in the design of land-based mitigation and adaptation plans

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

PROTEUS: Machine Learning Driven Resilience for Extreme-scale Systems

The objective of this project is to design, develop, and evaluate scalable software to enhance resilience, data checkpointing, program restart, and analysis. The proposed tasks are to 1) develop scalable machine learning techniques to learn temporal change patterns in a scalable and in-situ manner, and to minimize data movement and maximize learning locally closest to data; 2) design a concise data representation and indexing mechanism to capture the distribution of changes in data that can guarantee point-wise user-defined tolerable errors while reducing the data storage requirements by an order of magnitude or more; 3) develop data reduction techniques as library modules; 4) exploit local SSD for minimizing data movement in storage hierarchy; 5) develop anomaly detection algorithms that can predict corruptions based on learning of emerging patterns; 6) develop software libraries to be incorporated within widely used data formats and APIs; and 7) evaluate the proposed software using DOE scientific applications. The outcomes of the proposed work are to satisfy many synergistic data reduction and resilience requirements for large-scale data intensive applications executed on extreme-scale computing systems. The developed mechanism for error-bound data approximation is directly applicable to existing scientific applications. Through machine learning from historical events and change distribution, this work will enable anomaly detection for DOE computer facility.

97 MATHEMATICS AND COMPUTING↗