Search NASA⌕ Search

SEARCH · Search NASA

Results for “Transformational”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Effect of Ni2+, Zn2+, and Co2+ on green rust transformation to magnetite

In this study, we investigated Ni2+, Zn2+, and Co2+ mineralogical incorporation and its effect on green rust transformation to magnetite. Mineral transformation experiments were conducted by heating green rust suspensions at 85 °C in the presence of Ni2+, Zn2+, or Co2+ under strict anoxic conditions. Transmission electron microscopy and powder X-ray diffraction showed the conversion of hexagonal green rust platelets to fine grained cubic magnetite crystals. The addition of Ni2+, Zn2+, and Co2+ resulted in faster rates of mineral transformation. The conversion of green rust to magnetite was concurrent to significant increases in metal uptake, demonstrating a strong affinity for metal sorption/ co-precipitation by magnetite. Dissolution ratio curves showed that Ni2+, Zn2+, and Co2+ cations were incorporated into the mineral structure during magnetite crystal growth. The results indicate that the transformation of green rust to magnetite is accelerated by metal impurities, and that magnetite is a highly effective scavenger of trace metals during mineral transformation. The implications for using diagenetic magnetite from green rust precursors as paleoproxies of Precambrian ocean chemistry are discussed.

Hydrosulfate green rust↗

Towards an Aviation Large Language Model by Fine-tuning and Evaluating Transformers

In the aviation domain, there are many applications for machine learning and artificial intelligence tools that utilize natural language. For example, there is a desire to know the commonalities in written safety reports such as voluntary post incidents reports or aerial wildfire operations reports to better understand the risks present. Another use-case is the possibility of extracting airspace procedures and constraints currently written in documents such as Letters of Agreement. These applications can benefit from the use of state-of-the-art natural language processing techniques when adapted to the language/phraseology specific to the aviation domain. This paper evaluates the viability of adaptation of NLP tools to the aviation domain by fine-tuning transformer based models using aviation data sets. In 2018, a novel language model based on neural units (also called transformers) was created and became known as “Bidirectional Encoder Representations from Transformers” or BERT. This architecture combined with large amounts of English training data and innovative semi-supervised training tasks set the standard for what would later emerge as Large Language Models. The performance of these models was further improved by hyperparameter tuning and refinement of the semi-supervised training task and resulted in “Robustly Optimized BERT Pre-training Approach through hyperparameter tuning” or RoBERTa models. These pre-trained Large Language Models proved to be useful for a wide variety of natural language processing tasks such as text classification and question answering through a process called fine-tuning. The transformer architecture with pre-trained weights served as the basis with the last few layers replaced with layers fine-tuned to perform a new task e.g., a layer that provides a label for the entire input text. This process of fine-tuning can also be used to adapt the models to new domains; e.g., BioBERT started with the pre-trained BERT model and was completed by additional fine-tuning and training on biomedical documents. Transformer-based architectures can also be used to create rich representations of text called embeddings which can serve as the input to other machine learning models. This allows simpler algorithms such as logistic regression to use context-rich representations of the text while still remaining quick to train and evaluate. In the world of aviation, there is a growing demand for natural language processing and understanding but the domain presents unique challenges. Due to the technical content (and specialized language) of most aviation documents, fine-tuning pre-trained Large Language Models to specific tasks has not met the benchmark on natural language processing tasks set by simpler models trained from scratch on the data. To address this deficiency, this paper evaluates the improvements from fine-tuning a Large Language Model on a large set of aviation documents using the original semi-supervised training tasks before performing specific natural language tasks. In fine-tuning, a domain-specific dataset is used on the original training task but with the pre-trained Large Language Model instead of starting from a random initialization. This approach allows the model to be adapted to the specific domain language without discarding the information gained from training on general English data. This paper utilized two major dataset types to train and assess the RoBERTa fine-tuning performance. The first are 7,057 Letters of Agreement which are Federal Aviation Administration (FAA) documents that formalize airspace operations across the national airspace system. They contain many examples of ‘aviation English’ using domain specific terminology and phrasing which serves as a representative basis to perform the semi-supervised fine-tuning. The second type is the 494 document classification labels to be used for evaluation. This down-stream evaluation aims to show the performance of the fine-tuned model, better understand how much data is needed for an effective fine-tuning, and how fine-tuning can be adapted for different applications in-the domain. After semi-supervised training, evaluation begins by encoding the documents for classification using the fine-tuned RoBERTa model. Then a logistic regression classifier is trained to label the document type and compared against our ground truth labels. This currently leads to a 82.8% accuracy on 10-fold cross validation showing improvement over baseline RoBERTa which achieved 81.0%. We plan to measure the improvements on additional tasks and it is expected that these improvements will lead to more robust models that can tackle the natural language processing challenges present in aviation datasets.

ATM↗

Sub-microsecond Transformers for Jet Tagging on FPGAs

We present the first sub-microsecond transformer implementation on an FPGA achieving competitive performance for state-of-the-art high-energy physics benchmarks. Transformers have shown exceptional performance on multiple tasks in modern machine learning applications, including jet tagging at the CERN Large Hadron Collider (LHC). However, their computational complexity prohibits use in real-time applications, such as the hardware trigger system of the collider experiments up until now. In this work, we demonstrate the first application of transformers for jet tagging on FPGAs, achieving $\mathcal{O}(100)$ nanosecond latency with superior performance compared to alternative baseline models. We leverage high-granularity quantization and distributed arithmetic optimization to fit the entire transformer model on a single FPGA, achieving the required throughput and latency. Furthermore, we add multi-head attention and linear attention support to hls4ml, making our work accessible to the broader fast machine learning community. This work advances the next-generation trigger systems for the High Luminosity LHC, enabling the use of transformers for real-time applications in high-energy physics and beyond.

Laatu, Lauri [Imperial Coll., London]↗

Dynamic Nanoscale Spatial Heterogeneity in a Perovskite-to-Brownmillerite Topotactic Phase Transformation

Phase transitions are omnipresent in modern condensed matter physics and its applications. In solids, first-order phase transformations typically occur by nucleation and growth under nonequilibrium conditions. Under constant external conditions, e.g., constant annealing temperature and pressure, the nucleation and growth dynamics are often thought of as spatially and temporally independent. Here, in situ Bragg X-ray photon correlation spectroscopy (XPCS) reveals nanoscale spatial and dynamical heterogeneity in the perovskite-to-brownmillerite topotactic phase transformation in La 0.7 Sr 0.3 CoO 3 thin films annealed under constant reducing conditions over a time span of multiple hours. Specifically, a time scale associated with domain growth remains stable, with a corresponding domain wall speed of v d = 6 ± 0.5 × 10 –4 nm/s (2 ± 0.2 nm/h), while a slower time scale, associated with temperature-driven depinning of domains, leads to accelerating dynamics with time scales following an aging power law with exponent −2.2 ± 0.5. This experiment demonstrates that Bragg XPCS is a powerful tool to study nanoscale dynamics in structural phase transformations, with the ability to extract quantitative average values related to nanodomain motion in situ. Furthermore, the results are relevant for phase engineering of phase-change devices, as they show that nanoscale dynamics, linked to domain and domain-wall motion, can continuously evolve and speed up with time, even hours after the initiation of the phase transformation, with potential repercussions on electrical performance.

X-ray photon correlation spectroscopy↗

Atomic Dynamics of Multi‐Interfacial Migration and Transformations

Redox-induced interconversions of metal oxidation states typically result in multiple phase boundaries that separate chemically and structurally distinct oxides and suboxides. Directly probing such multi-interfacial reactions is challenging because of the difficulty in simultaneously resolving the multiple reaction fronts at the atomic scale. Using the example of CuO reduction in H 2 gas, a reaction pathway of CuO → monoclinic m-Cu 4 O 3 → Cu 2 O is demonstrated and identifies interfacial reaction fronts at the atomic scale, where the Cu 2 O/m-Cu 4 O 3 interface shows a diffuse-type interfacial transformation; while the lateral flow of interfacial ledges appears to control the m-Cu 4 O 3 /CuO transformation. Together with atomistic modeling, it is shown that such a multi-interface transformation results from the surface-reaction-induced formation of oxygen vacancies that diffuse into deeper atomic layers, thereby resulting in the formation of the lower oxides of Cu 2 O and m-Cu 4 O 3 , and activate the interfacial transformations. In conclusion, these results demonstrate the lively dynamics at the reaction fronts of the multiple interfaces and have substantial implications for controlling the microstructure and interphase boundaries by coupling the interplay between the surface reaction dynamics and the resulting mass transport and phase evolution in the subsurface and bulk.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Applications of Solid-State Transformers for Electric Power Grid HEMP/GMD Resilience

A high-altitude electromagnetic pulse (HEMP) or geomagnetic disturbance (GMD) can disrupt power grids by inducing low-frequency common-mode (CM) currents. When these currents flow through grounded transformers, they can bias the magnetic core, driving it into saturation and reducing performance or damaging equipment. This work presents a solid-state transformer (SST) to replace vulnerable assets and improve grid resilience. The paper reviews half-cycle saturation in conventional transformers, then describes an SST architecture that neutralizes and redirects CM currents during HEMP/GMD events. A prototype SST is built and validated, demonstrating stable CM-disturbance operation and protection of nearby transformers. Finally, large-scale simulations show how coordinated SST deployment mitigates CM disturbances and strengthens overall grid resilience.

four-leg inverter↗

Testing of a 15 kA Superconducting Transformer

Here, the manufacturing of superconducting magnets for High Energy Physics (HEP) and Fusion Energy Sciences (FES) applications requires high-current conductors to generate stronger magnetic fields without increasing the inductance of the magnet. Increased inductance is undesirable due to the associated AC losses, which reduce the temperature margin; and the quench protection also becomes complicated. Testing high-current conductors with a direct current (DC) room temperature power supply is unfeasible for two primary reasons: 1) the limited capacity to supply large currents, and 2) the significant heat load losses at the current leads. A superconducting transformer offers a solution to both challenges. A 50-kA superconducting transformer is planned for manufacturing and commissioning at Brookhaven National Laboratory as part of its user facility upgrade. This transformer will facilitate the testing of superconducting cables, conductors, joints, and insert coils under high magnetic field conditions (10 T) and with currents up to 50-kA. To evaluate the manufacturing process and validate the theoretical models, the magnet division has developed and tested a 15-kA prototype transformer. A control loop has been implemented to ensure precise current delivery to the sample. This paper presents the coil design, manufacturing, and experimental results from the cold tests.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Synchro-Waveform-Based Event Identification Using Multi-Task Time-Frequency Transform Networks

Influenced by the transient dynamics and reduced inertia characteristics of high-penetration renewable energy systems, power system events frequently exhibit distinct characteristics such as high-frequency components including wide-band oscillations and hyper-harmonics. This makes standard systems face challenges including significant latency and reduced accuracy due to limited data resolution. However, current methods face significant limitations, including insufficient pattern capture ability, low noise immunity, limited feature learning, and restricted localization capabilities, thereby hindering real-time performance. To tackle this issue, this paper proposed a novel synchro-waveform-based event identification approach via a Multi-task Time-frequency Transform Network (MTTNet). Initially, a Time-frequency Transform Block (TTB) is developed to extract both local and global information. The TTB leverages both Fourier and S-transforms to derive comprehensive time-frequency information from synchro-waveforms. Subsequently, a multi-task learning strategy is employed to identify the type and distinguish localization of events. Integrating the TTB and multi-task learning, the MTTNet is designed for synchro-waveform-based event identification, incorporating an adaptive weighting strategy and simplified computation for the S-transform. Two different datasets, comprising simulated and actual synchro-waveforms, are collected from the IEEE 123 bus system and a real-world high-penetration renewable energy system using a universal grid analyzer. Extensive experiments on various conditions are carried out. In conclusion, results demonstrated that the MTTNet consistently surpasses both basic and advanced baselines, with maximum improvements of 13.24% and 9.86%, respectively, while reducing the calculation burden by 15-19 times to achieve real-time event identification.

Event identification↗

Computational Analysis and Optimized Modeling of Geomagnetically Induced Currents in Power Transformers

In this project we aim to better understand the effect of geomagnetically induced currents (GIC) on power transformers. Expanding upon our previous work focused on producing a methodology for accuracy-enhanced computation of GIC signatures (i.e., time-domain current magnitude variation for the event duration) from a combination of physics-based and data-driven computational tools, we propose the use of these GIC signatures as inputs for a physically-detailed and optimized model of the power transformer to investigate how GIC determination and transformer modeling influence the evaluation of GIC effects on the transformer operation, as well as in its interaction with the power grid.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Transformers and Long Short-Term Memory Transfer Learning for GenIV Reactor Temperature Time Series Forecasting

Automated monitoring of the coolant temperature can enable autonomous operation of generation IV reactors (GenIV), thus reducing their operating and maintenance costs. Automation can be accomplished with machine learning (ML) models trained on historical sensor data. However, the performance of ML usually depends on the availability of large amount of training data, which is difficult to obtain for GenIV, as this technology is still under development. We propose the use of transfer learning (TL), which involves utilizing knowledge across different domains, to compensate for this lack of training data. TL can be used to create pre-trained ML models with data from small-scale research facilities, which can then be fine-tuned to monitor GenIV reactors. In this work, we develop pre-trained Transformer and long short-term memory (LSTM) networks by training them on temperature measurements from thermal hydraulic flow loops operating with water and Galinstan fluids at room temperature at Argonne National Laboratory. The pre-trained models are then fine-tuned and re-trained with minimal additional data to perform predictions of the time series of high temperature measurements obtained from the Engineering Test Unit (ETU) at Kairos Power. The performance of the LSTM and Transformer networks is investigated by varying the size of the lookback window and forecast horizon. The results of this study show that LSTM networks have lower prediction errors than Transformers, but LSTM errors increase more rapidly with increasing lookback window size and forecast horizon compared to the Transformer errors.

LSTM↗

U.S. Distribution Transformer Demand Phase III - Key Drivers and Managing Demand [Slides]

This presentation demonstrates a significant analysis, on forecasting the demand for distribution transformers. The analysis is conducted for the United States, estimating the initial in-service capacity of these assets, and forecasting demand for these assets through 2050 with several sensitivities conducted. It examines not only demand for these assets, but importantly, how utility planning practices can impact the demand for theses assets in time. Under load growth scenarios, whether utilities practice like-for-like replacement strategies as failures occur, or whether they practice proactive up-sizing, anticipating electric load growth, can have major impacts on future demand. It also examines several other growth factors, such as the increasing demand for step-up transformers, which share many of the same characteristics as distribution transformers, and the demand for specific transformers for large project growth from data centers.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Quantization Distortion in Block Transform-Compressed Data

The popular JPEG image compression standard is an example of a block transform-based compression scheme; the image is systematically subdivided into block that are individually transformed, quantized, and encoded. The compression is achieved by quantizing the transformed data, reducing the data entropy and thus facilitating efficient encoding. A generic block transform model is introduced.

block transform-compressed data quantization image↗

Two Dimensional Symmetric Correlation Functions of the S Operator and Two Dimensional Fourier Transforms: Considering the Line Coupling for P and R Lines of Linear Molecules

The refinement of the Robert-Bonamy (RB) formalism by considering the line coupling for isotropic Raman Q lines of linear molecules developed in our previous study [Q. Ma, C. Boulet, and R. H. Tipping, J. Chem. Phys. 139, 034305 (2013)] has been extended to infrared P and R lines. In these calculations, the main task is to derive diagonal and off-diagonal matrix elements of the Liouville operator iS1 − S2 introduced in the formalism. When one considers the line coupling for isotropic Raman Q lines where their initial and final rotational quantum numbers are identical, the derivations of off-diagonal elements do not require extra correlation functions of the ^S operator and their Fourier transforms except for those used in deriving diagonal elements. In contrast, the derivations for infrared P and R lines become more difficult because they require a lot of new correlation functions and their Fourier transforms. By introducing two dimensional correlation functions labeled by two tensor ranks and making variable changes to become even functions, the derivations only require the latters' two dimensional Fourier transforms evaluated at two modulation frequencies characterizing the averaged energy gap and the frequency detuning between the two coupled transitions. With the coordinate representation, it is easy to accurately derive these two dimensional correlation functions. Meanwhile, by using the sampling theory one is able to effectively evaluate their two dimensional Fourier transforms. Thus, the obstacles in considering the line coupling for P and R lines have been overcome. Numerical calculations have been carried out for the half-widths of both the isotropic Raman Q lines and the infrared P and R lines of C2H2 broadened by N2. In comparison with values derived from the RB formalism, new calculated values are significantly reduced and become closer to measurements.

infrared radiation↗

NASA’s Four-Layer Cake: Systematic Approach for Developing a Digital Transformation Tactical Plan for Organizations

With the current industry movement to “digitally transform” there is much fervor to do something, to change in some way, to do things differently and digitally; however, the last decade has shown that most organizations do not know where to start or abandon transformation efforts. And often the approaches taken fall in the realm of “low-hanging fruit” or “easy wins” which rarely result in the foundational change needed. NASA was no different in the early years of its digital transformation and this drove the development of what eventually became known as the “Four-Layer Cake”. The Four-Layer Cake provides the critical approach for determining the core areas for investment to gain the greatest return without having to boil the ocean or hope that the low-hanging fruit will provide the foundational elements for a domain’s transformation.

Digital engineering↗

FLEXIBLE POWER TRANSFORMERS TO IMPROVE RESILIENCY OF TRANSMISSION NETWORKS

For decades, transformer flexibility of operation has been limited to adjustable voltage ratio and, in some cases, several ratings with staged cooling. Transformers reconnectable to multiple voltage ratings have been primarily applied as emergency replacements. Other versions of “flexible transformers” were developed for continuous, long-term operation at specific sites, with application limited to large utilities. A new technology that supports today’s power systems adaptability requirements has been developed to provide not only voltage and power rating flexibility, but also an adjustable short-circuit impedance. This last, unique feature allows for a closer match to actual system operational requirements and could be used in the future to enhance resiliency and improve dynamic control of electrical grids. While the solution’s fundamentals have already been introduced in several technical forums, the intention of this article is to focus on the potential benefits of this new type of transformer and share the deployment experience of a full-scale prototype that has been in operation in a major U.S. utility since 2021

flexible transformer, resilient grid, variable lea↗

Distribution Transformer Demand: Understanding Demand Segmentation, Drivers, and Management Through 2050

The National Renewable Energy Laboratory (NREL) has been working closely with the U.S. Department of Energy's Office of Electricity (OE) to understand the critical drivers and potential means of managing distribution transformer demand through 2050. This effort has consulted with utility representative organizations and transformer manufacturers to understand the problem, characterized the in-service assets, and modeled future demand. Distribution transformers, or service transformers, range from 10 to 5,000 kilovolt-amperes (kVA), have a high-side voltage of less than 34.5 kilovolts, and have step-down power delivery for customer end use. This research will help the manufacturing sector understand production requirements and better inform utility strategies for managing their demand.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Phase Transformations Driving Biaxial Stress Reduction During Wake-Up of Ferroelectric Hafnium Zirconium Oxide Thin Films

Biaxial stress is identified to play an important role in the polar orthorhombic phase stability in hafnium oxide-based ferroelectric thin films. However, the stress state during various stages of wake-up has not yet been quantified. In this work, the stress evolution with field cycling in hafnium zirconium oxide capacitors is evaluated. The remanent polarization of a 20 nm thick hafnium zirconium oxide thin film increases from 9.80 to 15.0 µC cm –2 following 10 6 field cycles. This increase in remanent polarization is accompanied by a decrease in relative permittivity that indicates that a phase transformation has occurred. The presence of a phase transformation is supported by nano-Fourier transform infrared spectroscopy measurements and scanning transmission electron microscopy that show an increase in ferroelectric phase content following wake-up. The stress of individual devices field cycled between pristine and 10 6 cycles is quantified using the sin 2 (ψ) technique, and the biaxial stress is observed to decrease from 4.3 ± 0.2 to 3.2 ± 0.3 GPa. The decrease in stress is attributed, in part, to a phase transformation from the antipolar Pbca phase to the ferroelectric Pca2 1 phase. This work provides new insight into the mechanisms controlling and/or accompanying polarization wake-up in hafnium oxide-based ferroelectrics.

36 MATERIALS SCIENCE↗

Utilizing Single-Crystalline Transformations for Precise Atom Placement in Multicomponent Cluster-Based Coordination Networks

The assembly of cluster or superatom building-blocks into extended solids has revolutionized materials design, enabling the synthesis of modular semiconductors with well-defined structures and tunable electronic, magnetic or optical properties. This strategy has recently advanced the synthesis of complex metal oxides with multifunctional or emergent behaviors, but precise atom placement of multiple elements with similar chemistries or preferred coordination environments remains a significant challenge. Here, in this study, we present a strategy for synthesizing polyoxometalate (POM)-based coordination networks with up to three different cations in precisely defined positions. Our approach leverages a single-crystal-to-single-crystal (SCSC) transformation in which the spatial placement of cations is governed by their availability at distinct stages of crystallization and transformation. Specifically, [ZP 5 W 30 O 110 ] (15-n)- (Z = Na + , K + , Ca 2+ , Ag + , Bi 3+ , Y 3+ , any Ln 3+ , Th 4+ ) is coordinatively assembled with various bridging metal cations (Y 3+ , any Ln 3+ , Th 4+ ). By using the encapsulated cation (Z) to "label" the POM, we track the phase-transformation and confirm the retention of single crystallinity. The integrated use of POM labeling and SCSC transformation enables rational control over cation distribution and establishes a versatile strategy for constructing multicomponent materials with high compositional and spatial precision.

Chen, Linfeng [Univ. of California, San Diego, CA ↗