Oracle-RLAIF: An Improved Multi-Modal Fine-Tuning Framework through Reinforcement Learning from Ranking Feedback
Explore the source record for details and available documents.
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Composite laminates were produced by RTM using similar glass and flax fabrics and both vitrimer epoxy and aerospace-grade epoxy, both formulated for liquid molding. Tensile and flexural properties were measured and compared, revealing that the vitrimer composites exhibited equivalent performance in flexural strength and tensile modulus, but slightly lower performance in tensile strength relative to reference epoxy composites. In general, glass–fiber composites outperformed flax–fiber composites in tension. However, both glass and flax–fiber composites yielded roughly equivalent flexural strength and tensile modulus-to-weight ratios. Flax fabrics were recovered from composites by matrix dissolution, and a second-life laminate showed full retention of the mechanical properties relative to those produced from fresh flax. Finally, a demonstration of re-forming was undertaken, showing that simple press-forming can be used to modify the composite shape. However, re-forming to a flat configuration resulted in local fiber damage and a decrease in mechanical properties. An alternative forming method was demonstrated that resulted in less fiber damage, indicating that further refinements might lead to a viable forming and re-forming process.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
The fruit fly Drosophila melanogaster has been a valuable model for investigating the genetic and neural bases that underlie learning and memory. Early and most current studies use basic behavior conditioning protocols to study learning in controlled laboratory settings. More recently, the ability to transgenically manipulate many of the brain neurons in the fruit fly with exquisite specificity, and the recent knowledge of the synaptic ‘connectome’ of the fruit fly brain, makes these animals almost unique as a comprehensive model for studies of learning, memory and motivated behavior. In fact, the connectome has revealed many types of new connections that had until now been overlooked. Within this context, the thesis of this proposal is that studies of learning and memory will be greatly enhanced by using more sophisticated means for evaluating memory representations, such as have been developed in vertebrates, and combining those studies with information from the connectome guided by computational modelling. We propose to push beyond the boundaries of existing conditioning protocols for fruit flies to investigate more complex memory representations. In particular, we will investigate the function of reinforcement pathways in relation to the absence of expected reinforcement. More specifically, we propose a series of experiments designed to investigate the memory representations in fruit flies when an expected consequence of a Conditioned Stimulus (CS) fails to occur. Although studies have evaluated how this failure can establish extinction memory for the CS, our studies will go beyond studying extinction. Specifically, we predict that in Drosophila when a CS is associated with a failed expectation of an appetitive food reinforcement it will acquire aversive value, and vice versa for a failed expectation of an aversive reinforcer. We combine these studies with manipulations of reinforcement pathways in the CNS inspired from the connectome, iteratively knitted in with established computational models. Intellectual Merit: The concept of reinforcement expectation and incentive contrast have been influential in the development of studies of associative learning in mammals. These questions are particularly challenging to answer in vertebrates because they require exquisite cellular, temporal, and genetic specificity of experimental manipulations. The recent development of work with identified neurons and their connectomes makes the larval and adult fly brains ripe as models for pushing our understanding of neural bases for these higher- order conditioning phenomena. Broader Impacts: Public health: These analyses and the conceptual framework of prediction error processing underlying them have a profound impact on our understanding of reinforcement-related behavior in humans, including monetary rewards and the mnemonic consequences of traumatic experiences, and for pathologies of the dopamine reinforcement system. Educational: This project will provide interdisciplinary training for postdoctoral researchers, Ph.D. and undergraduate students. The PIs will act as co-supervisors or mentors of students working in the different labs via face-to-face and internet-based technologies. We will also work with ASU’s award-winning Ask- A-Biologist program. This is an online science program designed to enrich the learning experiences of students of all ages and to provide classroom material for use by K-12 teachers. We will develop an extension of a game developed under a prior NSF award, and the new game will include modules to teach K-12 students about how insects learn. We will also integrate into the AAB site a program developed by a collaborator (B Gerber) at the Leibniz Institut für Neurobiologie, Magdeburg, and now in use in schools in Germany, to teach K-12 students how to train animals using the fruit fly larval learning paradigm. Underrepresented groups: All PIs will work with their university offices of Academic Diversity and Equal Opportunity for reaching underrepresented students.
Here, this study reports techno-economic and life cycle analyses to evaluate the economic and environmental impacts of mechanically recycled PE/PP blends in the presence of rheology modifiers. Additionally, fiber-reinforced composites derived from the compatibilized blends were prepared and evaluated for their performance compared with virgin plastics. Results suggest that compatibilized PE/PP blends exhibit a 70% lower selling price compared to virgin PE. Furthermore, these blends achieved a 74% reduction in greenhouse gas emissions or climate change impact compared to the virgin counterpart. Fiber-reinforced composites from compatibilized PE/PP blends demonstrated improved or comparable mechanical properties relative to composites made from virgin PE/PP blends. Based on their favorable cost and environmental impact, along with performance comparable to virgin composites, compatibilized PP/PE composites made from post-consumer plastics can find applications in large-scale composite manufacturing.
Influence maximization (IM) is a combinatorial problem of identifying a subset of seed nodes in a network (graph), which when activated, provide a maximal spread of influence in the network for a given diffusion model and a budget for seed set size. IM has numerous applications such as viral marketing, epidemic control, sensor placement and other network-related tasks. However, its practical uses are limited due to the computational complexity of current algorithms. Recently, deep reinforcement learning has been leveraged to solve IM in order to ease the computational burden. However, there are serious limitations in current approaches, including narrow IM formulation that only consider influence via spread and ignore self-activation, low scalability to large graphs, and lack of generalizability across graph families leading to a large running time for every test network. In this work, we address these limitations through a unique approach that involves: (1) Formulating a generic IM problem as a Markov decision process that handles both intrinsic and influence activations; (2)incorporating generalizability via meta-learning across graph families. There are previous works that combine deep reinforcement learning with graph neural network, but this work solves a more realistic IM problem and incorporates generalizability across graphs via meta reinforcement learning. Extensive experiments are carried out in various standard networks to validate performance of the proposed Graph Meta Reinforcement learning (GraMeR) framework. Finally, the results indicate that GraMeR is multiple orders faster and generic than conventional approaches when applied on small to medium scale graphs.
Biobased reinforcements for poly(lactic acid) (PLA) are needed for more additive manufacturing applications requiring higher strength and sustainability. Flax nanofibrils (FNFs) produced through mechanical refining were explored as a lower energy alternative to cellulose nanofibril (CNF) reinforcements. To compatibilize the FNFs for the PLA matrix, a grafting-through surfactant free emulsion polymerization (SFEP) was performed to functionalize the FNF surface with poly(methyl methacrylate) (PMMA). FNFs produced using different refining energy were functionalized under varying solid contents in suspension. Polymerizations performed at 0.7 wt% FNFs in water yielded the highest degree of PMMA functionality. These optimal conditions were scaled up and the PMMA modified FNFs melt compounded into PLA yielding a 12% increase in tensile strength and 92% increase in the modulus of elasticity as compared to the original PLA. Interestingly, the FNFs with the lowest refining energy yielded the strongest composites using these methods, surpassing the higher refining energy CNF reinforcements. This increase was attributed to improved dispersion of the FNF reinforcements in the PLA matrix that was enabled by the PMMA coating on the FNF surface preventing interfibrillar adhesion and aggregation within the PLA matrix.
An analysis was performed to determine whether a hydrogen jet flame impinging on a tunnel ceiling composed of multiple prestressed steel reinforced concrete box beams could result in permanent damage to the tunnel. The lower layer of the concrete box beam was modeled to determine whether heat reaches the steel reinforcing bars and whether spalling could occur. Heat transfer analysis shows that the temperature remains constant at the location of the steel reinforcing bars after 1.3 minutes of impingement and reaches a maximum of 130°C after 5 minutes. However, assuming a constant impingement for 5 minutes is an over estimation due the existing fire model which includes conservative assumptions. Explosive spalling may occur at a thin layer (~0.05 in. at 50 seconds, 0.1 in. at 5 minutes) at the bottom surface of the concrete box beam, but the steel reinforcing bars will not be exposed to the hydrogen flame.
In the polymeric material industry, thermosets and related composites have played a substantial role in the production of rubber and plastics. One important subset of these is thermoset composites with carbon reinforcement. The incorporation of carbon fillers and fibers gives polymeric materials improved electrical and mechanical properties, among other benefits. However, the covalently crosslinked network of thermosets presents significant challenges for recycling and reprocessing because of its intractable nature. The introduction of vitrimer materials opens a new avenue to produce biodegradable and recyclable thermosets. Carbon-reinforced vitrimer composites are pursued for high-performance, long-lasting materials with attractive physical properties, the ability to be recycled and processed, and other features that respond uniquely to stimuli. The development of carbon-reinforced vitrimer composites over the last few years is summarized in this article. First, an overview of vitrimers and the methods used to prepare carbon fiber-reinforced vitrimer composites is provided. Because of the vitrimer nature of such composites, reprocessing, healing, and recycling are viable ways to greatly extend their service life; these approaches are thoroughly explained and summarized. The conclusion is our prediction for developing carbon-based vitrimer composites.
Solid tritium breeder materials must first and foremost have sufficiently high concentrations of lithium to enable a plant-scale tritium breeding ratio greater than 1:1. However, in addition to lithium content, such breeder materials must also meet other performance metrics including high tritium release rates, thermal conductivities, and irradiation damage tolerance. Perhaps most importantly, tritium breeders must maintain their mechanical integrity during reactor operation so as to avoid degradation which can jeopardize the functionality of the tritium breeder blanket module, which in most designs takes the form of a pebble bed geometry. Unfortunately, the mechanical robustness of most lithium-bearing ceramics under investigation for fusion applications is often inversely related to the lithium atom density. For example, a material such as lithium oxide (Li2O), which has one of the highest lithium atom densities, has a much lower mechanical splitting strength than lithium metatitanate (Li2TiO3), though Li2TiO3 has less than half the lithium atom density of Li2O. This work seeks to provide an alternative to monolithic ceramic tritium breeders, in the form of metal-reinforced composite tritium breeders. Specifically, composite tritium breeders have been synthesized combining Li2O with various ferrous metal reinforcements via electric field assisted sintering (EFAS), also known as spark plasma sintering (SPS). As the metal reinforcement content is increased, metallic networks are observed, via electron microscopy and X-ray computed tomography, to form throughout the composite material. Through destructive mechanical testing, even dilute metal reinforcement loading enables drastic mechanical strength improvements over pure Li2O while higher loadings give rise to quasi-ductile behavior and higher ultimate strengths than Li2TiO3 – while still maintaining a higher density of lithium atoms than Li2TiO3 and many other breeder candidates. In addition to microstructural characterization and mechanical testing, thermal property measurements and hydrogen permeability testing are underway to further assess the suitability of such composites for fusion reactor applications.
Bi₂Sr₂CaCu₂O8−x (Bi-2212) multi-filament round wire is a high-temperature superconductor (HTS) capable of carrying high transport currents, which makes it suitable for high-field magnet applications. However, its weak Ag–Mg sheath leaves it vulnerable to mechanical stress, posing challenges for high-field magnet design. To better understand and improve mechanical stress management in Bi-2212 winding packs, we conducted an experimental study evaluating the axial stress–strain behavior of five winding pack configurations with varying insulation materials, reinforcement strategies, and construction quality. Using uniaxial tensile testing at 77 K, we measured Young’s modulus and Poisson’s ratio for each composition. Our results show that pure alumina braid insulation and co-wind reinforcements significantly enhance stiffness compared to aluminosilicate braids, with more than 2.5 times increased winding pack Young’s modulus. Rule of mixtures analysis further quantified the contribution of non-wire composite components to overall stiffness. These findings highlight the critical role of insulation material selection and reinforcement design in optimizing Bi-2212 coil performance under stress, providing a foundation for improved mechanical models and more reliable high-field HTS magnet designs.
Cellulose nanofibers (CNFs) have been widely studied for their reinforcing potential in high-performance composites. While there are numerous publications on CNF-reinforced composites in a variety of polymer matrices, few have considered the recyclability of such thermoplastic composites and whether the incorporation of CNFs deteriorates or improves their performance upon reprocessing. In this study, two thermoplastic resins, poly(lactic acid) (PLA), and glycol-modified polyethylene terephthalate (PETg), were prepared with CNF reinforcement and thermomechanically recycled to investigate the effect of CNF inclusion on the composite properties after reprocessing as well as their effect on the composites’ number of useful life cycles. Additionally, changes in mechanical, thermal, rheological, molecular, and microstructural properties of the composites and/or base resins were monitored as a function of cycle numbers. As is typical, the polymers’ molecular weight and mechanical performance deteriorated with continued processing. However, the addition of spray dried CNF was found to better maintain the mechanical performance of both polymers throughout multiple recycling steps as compared to neat samples. For example, the tensile strength of PETg with 20 wt% CNF after 6 processing cycles was found to exceed that of virgin neat PETg, and higher loadings of CNF were found to preserve a higher yield strength during multiple rounds of reprocessing compared to PETg composites with lower CNF loadings. Ultimately this study indicates that the addition of CNF to some thermoplastic materials can increase both their sustainability by offsetting the use of high-embodied energy resins and their circularity by enabling performance retention over more use cycles.