Search NASA⌕ Search

Engineering topics

Liu, Andrea J.

Publications and source records attributed to Liu, Andrea J..

At least 19 records

Machine learning without a processor: Emergent learning in a nonlinear analog network

Standard deep learning algorithms require differentiating large nonlinear networks, a process that is slow and power-hungry. Electronic contrastive local learning networks (CLLNs) offer potentially fast, efficient, and fault-tolerant hardware for analog machine learning, but existing implementations are linear, severely limiting their capabilities. These systems differ significantly from artificial neural networks as well as the brain, so the feasibility and utility of incorporating nonlinear elements have not been explored. Here, we introduce a nonlinear CLLN—an analog electronic network made of self-adjusting nonlinear resistive elements based on transistors. We demonstrate that the system learns tasks unachievable in linear systems, including XOR (exclusive or) and nonlinear regression, without a computer. We find our decentralized system reduces modes of training error in order (mean, slope, curvature), similar to spectral bias in artificial neural networks. The circuitry is robust to damage, retrainable in seconds, and performs learned tasks in microseconds while dissipating only picojoules of energy across each transistor. This suggests enormous potential for fast, low-power computing in edge systems like sensors, robotic controllers, and medical devices, as well as manufacturability at scale for performing and studying emergent learning.

Science & Technology - Other Topics↗

Soft matter roadmap

Soft materials are usually defined as materials made of mesoscopic entities, often self-organised, sensitive to thermal fluctuations and to weak perturbations. Archetypal examples are colloids, polymers, amphiphiles, liquid crystals, foams. The importance of soft materials in everyday commodity products, as well as in technological applications, is enormous, and controlling or improving their properties is the focus of many efforts. From a fundamental perspective, the possibility of manipulating soft material properties, by tuning interactions between constituents and by applying external perturbations, gives rise to an almost unlimited variety in physical properties. Together with the relative ease to observe and characterise them, this renders soft matter systems powerful model systems to investigate statistical physics phenomena, many of them relevant as well to hard condensed matter systems. Understanding the emerging properties from mesoscale constituents still poses enormous challenges, which have stimulated a wealth of new experimental approaches, including the synthesis of new systems with, e.g. tailored self-assembling properties, or novel experimental techniques in imaging, scattering or rheology. Theoretical and numerical methods, and coarse-grained models, have become central to predict physical properties of soft materials, while computational approaches that also use machine learning tools are playing a progressively major role in many investigations. This Roadmap intends to give a broad overview of recent and possible future activities in the field of soft materials, with experts covering various developments and challenges in material synthesis and characterisation, instrumental, simulation and theoretical methods as well as general concepts.

36 MATERIALS SCIENCE↗

Design of functional materials based on new principles of disorder

The main goal of the project for many years was to study and understand the jamming transition and the properties of the marginally jammed state, and to apply that understanding to real systems, including atomic, molecular, metallic and polymeric glasses, colloidal suspensions, granular materials, foams and emulsions, as well as the dynamics of systems driven away from the static jammed state by applying temperature or strain. As we gained greater insight into the jamming problem, we applied it to other big problems that had not previously been recognized as being related to jamming, such as memory formation, metamaterials design and learning.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Demonstration of Decentralized Physics-Driven Learning

In typical artificial neural networks, neurons adjust according to global calculations of a central processor, but in the brain, neurons and synapses self-adjust based on local information. Contrastive learning algorithms have recently been proposed to train physical systems, such as fluidic, mechanical, or electrical networks, to perform machine-learning tasks from local evolution rules. However, to date, such systems have only been implemented in silico due to the engineering challenge of creating elements that autonomously evolve based on their own response to two sets of global boundary conditions. Here, we introduce and implement a physics-driven contrastive learning scheme for a network of variable resistors, using circuitry to locally compare the response of two identical networks subjected to the two different sets of boundary conditions. Using this method, our system effectively trains itself, optimizing its resistance values without the use of a central processor or external information storage. Once the system is trained for a specified allostery, regression, or classification task, the task is subsequently performed rapidly and automatically by the physical imperative to minimize power dissipation in response to the given voltage inputs. Here, we demonstrate that, unlike typical computers, such learning systems are robust to extreme damage (and thus manufacturing defects) due to their decentralized learning. Our twin-network approach is therefore readily scalable to extremely large or nonlinear networks, where its distributed nature will be an enormous advantage; a laboratory network of only 500 edges will already outpace its in silico counterpart.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Transient learning degrees of freedom for introducing function in materials

Significance Many protocols used in material design and training have a common theme: they introduce new degrees of freedom, often by relaxing away existing constraints, and then evolve these degrees of freedom based on a rule that leads the material to a desired state at which point these new degrees of freedom are frozen out. By creating a unifying framework for these protocols, we can now understand that some protocols work better than others because the choice of new degrees of freedom matters. For instance, introducing particle sizes as degrees of freedom to the minimization of a jammed particle packing can lead to a highly stable state, whereas particle stiffnesses do not have nearly the same impact.

36 MATERIALS SCIENCE↗

Correlation of plastic events with local structure in jammed packings across spatial dimensions

Significance Mean-field theories, exact in the limit of infinite spatial dimensions, succeed in describing many features of glasses and amorphous solids in low dimensions, leading to considerable effort to understand how behavior evolves with dimension. Until now, all evidence has supported a picture in which “localized physics,” responsible for deviations from mean-field behavior in low dimensions, fades away with rising dimension. Our work shows that rearrangements, in which particles change relative positions leading to fluid-like response, reveal a different picture of dimensional cross-over. We find that rearrangements, which are localized in two- and three-dimensional systems and correlated with local structure, remain just as correlated with local structure up to five dimensions, suggesting that local structure is important even in high dimensions.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Learning-based approach to plasticity in athermal sheared amorphous packings: Improving softness

The plasticity of amorphous solids undergoing shear is characterized by quasi-localized rearrangements of particles. While many models of plasticity exist, the precise relationship between the plastic dynamics and the structure of a particle’s local environment remains an open question. Previously, machine learning was used to identify a structural predictor of rearrangements called “softness.” Although softness has been shown to predict which particles will rearrange with high accuracy, the method can be difficult to implement in experiments where data are limited and the combinations of descriptors it identifies are often difficult to interpret physically. Here, we address both of these weaknesses, presenting two major improvements to the standard softness method. First, we present a natural representation of each particle’s observed mobility, allowing for the use of statistical models that are both simpler and provide greater accuracy in limited datasets. Second, we employ persistent homology as a systematic means of identifying simple, topologically informed, structural quantities that are easy to interpret and measure experimentally. We test our methods on two-dimensional athermal packings of soft spheres under quasi-static shear. We find that the same structural information that predicts small variations in the response is also predictive of where plastic events will localize. We also find that an excellent accuracy is achieved in athermal sheared packings using simply a particle’s species and the number of nearest neighbor contacts.

36 MATERIALS SCIENCE↗

Periodic training of creeping solids

Significance It is well appreciated that many disordered materials deform their shape irreversibly (plastically) under an external load (e.g., memory foam). Here, we show that this plasticity can be exploited to train materials to develop novel elastic responses by straining them periodically. By applying different periodic strains to a common viscoelastic material, we are able to design a number of different responses. These include a maximally negative Poisson’s ratio, bistable behavior, and nonlocal bond-specific responses. In contrast to computer-aided design, we rely on plasticity to self-organize the system in response to local stresses. This approach shows promise to achieve an unprecedented control over behavior at large strains well beyond the linear-response regime.

36 MATERIALS SCIENCE↗

Effect of directed aging on nonlinear elasticity and memory formation in a material

Disordered solids often change their elastic response as they slowly age. Using experiments and simulations, we study how aging disordered planar networks under an applied stress affects their nonlinear elastic response. We are able to modify dramatically the elastic properties of our systems in the nonlinear regime. Using simulations, we study two models for the microscopic evolution of properties of such a material; the first considers changes in the material strength, while the second considers distortions in the microscopic geometry. Both models capture different aspects of the experiments including the encoding of memories of the aging history of the system and the dramatic effects on the material’s nonlinear elastic properties. Our results demonstrate how aging can be used to create complex elastic behavior in the nonlinear regime.

36 MATERIALS SCIENCE↗

Directed aging, memory, and nature’s greed

Disordered materials are often out of equilibrium and evolve very slowly in a rugged and tortuous energy landscape. This slow evolution, referred to as aging, is deemed undesirable as it often leads to material degradation. However, we show that aging also encodes a memory of the stresses imposed during preparation. Because of inhomogeneous local stresses, the material itself decides how to evolve by modifying stressed regions differently from those under less stress. Because material evolution occurs in response to stresses, aging can be “directed” to produce sought-after responses and unusual functionalities that do not inherently exist. Aging obeys a natural “greedy algorithm” as, at each instant, the material simply follows the path of most rapid and accessible relaxation. Our experiments and simulations illustrate directed aging in examples in which the material’s elasticity transforms as desired because of an imposed deformation.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Limits of multifunctionality in tunable networks

Nature is rife with networks that are functionally optimized to propagate inputs to perform specific tasks. Whether via genetic evolution or dynamic adaptation, many networks create functionality by locally tuning interactions between nodes. Here we explore this behavior in two contexts: strain propagation in mechanical networks and pressure redistribution in flow networks. By adding and removing links, we are able to optimize both types of networks to perform specific functions. We define a single function as a tuned response of a single “target” link when another, predetermined part of the network is activated. Using network structures generated via such optimization, we investigate how many simultaneous functions such networks can be programed to fulfill. We find that both flow and mechanical networks display qualitatively similar phase transitions in the number of targets that can be tuned, along with the same robust finite-size scaling behavior. We discuss how these properties can be understood in the context of constraint–satisfaction problems.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Machine learning determination of atomic dynamics at grain boundaries

In polycrystalline materials, grain boundaries are sites of enhanced atomic motion, but the complexity of the atomic structures within a grain boundary network makes it difficult to link the structure and atomic dynamics. Here, we use a machine learning technique to establish a connection between local structure and dynamics of these materials. Following previous work on bulk glassy materials, we define a purely structural quantity (softness) that captures the propensity of an atom to rearrange. This approach correctly identifies crystalline regions, stacking faults, and twin boundaries as having low likelihood of atomic rearrangements while finding a large variability within high-energy grain boundaries. As has been found in glasses, the probability that atoms of a given softness will rearrange is nearly Arrhenius. This indicates a well-defined energy barrier as well as a well-defined prefactor for the Arrhenius form for atoms of a given softness. The decrease in the prefactor for low-softness atoms indicates that variations in entropy exhibit a dominant influence on the atomic dynamics in grain boundaries.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Two Diverging Length Scales in the Structure of Jammed Packings

Here, at densities higher than the jamming transition for athermal, frictionless repulsive spheres we find two distinct length scales, both of which diverge as a power law as the transition is approached. The first, ξ Z , is associated with the two-point correlation function for the number of contacts on two particles as a function of the particle separation. Additionally, the second, ξ f , is associated with contact-number fluctuations in subsystems of different sizes. On scales below ξ f , the fluctuations are highly suppressed, similar to the phenomenon of hyperuniformity usually associated with density fluctuations. The exponents for the divergence of ξ Z and ξ f are different and appear to be different in two and three dimensions.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Linking microscopic and macroscopic response in disordered solids

The modulus of a rigid network of harmonic springs depends on the sum of the energies in each of the bonds due to an applied distortion such as compression in the case of the bulk modulus or shear in the case of the shear modulus. Yet, the distortion need not be global. Here we introduce a local modulus, L i , associated with changing the equilibrium length of a single bond, i , in the network. We show that L i is useful for understanding many aspects of the mechanical response of the entire system. It allows an efficient computation of how the removal of any bond changes the global properties such as the bulk and shear moduli. Additionally, it allows a prediction of the distribution of these changes and clarifies why the changes of these two moduli due to removal of a bond are uncorrelated; these are the essential ingredients necessary for the efficient manipulation of network properties by bond removal.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Auxetic metamaterials from disordered networks

Recent theoretical work suggests that systematic pruning of disordered networks consisting of nodes connected by springs can lead to materials that exhibit a host of unusual mechanical properties. In particular, global properties such as Poisson's ratio or local responses related to deformation can be precisely altered. Tunable mechanical responses would be useful in areas ranging from impact mitigation to robotics and, more generally, for creation of metamaterials with engineered properties. However, experimental attempts to create auxetic materials based on pruningbased theoretical ideas have not been successful. In this study, we introduce a more realistic model of the networks, which incorporates angle-bending forces and the appropriate experimental boundary conditions. A sequential pruning strategy of select bonds in this model is then devised and implemented that enables engineering of specific mechanical behaviors upon deformation, both in the linear and in the nonlinear regimes. In particular, it is shown that Poisson's ratio can be tuned to arbitrary values. The model and concepts discussed here are validated by preparing physical realizations of the networks designed in this manner, which are produced by laser cutting 2D sheets and are found to behave as predicted. Furthermore, by relying on optimization algorithms, we exploit the networks' susceptibility to tuning to design networks that possess a distribution of stiffer and more compliant bonds and whose auxetic behavior is even greater than that of homogeneous networks. Finally, taken together, the findings reported here serve to establish that pruned networks represent a promising platform for the creation of unique mechanical metamaterials.

36 MATERIALS SCIENCE↗

Instabilities of Jammed Packings of Frictionless Spheres Under Load

In this work, we consider the contribution to the density of vibrational states and the distribution of energy barrier heights of incipient instabilities in a glass modeled by a jammed packing of spheres. On approaching an instability, the frequency of a normal mode and the height of the energy barrier to cross into a new ground state both vanish. These instabilities produce a contribution to the density of vibrational states that scales as ω 3 at low frequencies ω, and a contribution to the distribution of energy barriers ΔH that scales as ΔH -1/3 at low barrier heights.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Disconnecting structure and dynamics in glassy thin films

Nanometrically thin glassy films depart strikingly from the behavior of their bulk counterparts. We investigate whether the dynamical differences between a bulk and thin film polymeric glass former can be understood by differences in local microscopic structure. Machine learning methods have shown that local structure can serve as the foundation for successful, predictive models of particle rearrangement dynamics in bulk systems. By contrast, in thin glassy films, we find that particles at the center of the film and those near the surface are structurally indistinguishable despite exhibiting very different dynamics. Next, we show that structure-independent processes, already present in bulk systems and demonstrably different from simple facilitated dynamics, are crucial for understanding glassy dynamics in thin films. Our analysis suggests a picture of glassy dynamics in which two dynamical processes coexist, with relative strengths that depend on the distance from an interface. Here, one of these processes depends on local structure and is unchanged throughout most of the film, while the other is purely Arrhenius, does not depend on local structure, and is strongly enhanced near the free surface of a film.

36 MATERIALS SCIENCE↗