Search NASA⌕ Search

SEARCH · Search NASA

Results for “transformer models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Understanding the deformation behavior of the γ rich transformative Fe 38.5 Mn 20 Co 20 Cr 15 Si 5 Cu 1.5 complex concentrated alloy using in situ synchrotron diffraction

In situ tensile testing coupled with synchrotron x-ray diffraction was used to study the deformation behavior of metastability-engineered Fe 38.5 Mn 20 Co 20 Cr 15 Si 5 Cu 1.5 complex concentrated alloy. Monitoring the evolution of phase fraction and strain hardening response allowed the determination of true critical stress for the onset of the transformation-induced plasticity (TRIP) to be ∼375 MPa, preceded by slip starting at ∼255 MPa. In situ EBSD was used to validate the critical stress for transformation at the microstructure level and observe slip traces to confirm prior slip activity before the transformation. Further, a modeling framework based on stacking fault energy (SFE) was developed to predict the critical stress for transformation. Modeling suggested the SFE of the alloy to fall nearly 15 mJ/m 2 , which agrees well with SFE values calculated using synchrotron peak shifting (12 mJ/m 2 ) and thermodynamic calculation (11 mJ/m 2 ). As a result of γ-fcc to ε-hcp phase transformation, new {0002} ε planes emerged parallel to unaligned {111} γ planes with the tensile loading following S-N orientation relationship. Such selective emergence of new diffraction rings corresponding to ε phase is understood based on the reorientation of γ crystals with reference to tensile axis. In conclusion, this approach can be extended to effectively design alloys based on critical stress required for activating different deformation mechanisms to further push the limits of the strength-ductility envelope.

Complex concentrated alloy↗
NASA NTRS2024

Recommendations on Evidence and Process for Certification of Learning-enabled Components in Aerospace Systems

This report primarily identifies a collection of relevant and necessary evidence for assurance of machine learnt components (MLCs)—also known as learning-enabled components—integrated into aircraft systems, and gives preliminary suggestions on the elements of a certification process that invoke the identified evidence. The main focus is on feedforward neural networks that are static and trained offline through supervised learning. A brief background on the generic elements of the lifecycle of an MLC is given to contextualize the assurance considerations and, consequently, the evidence that is relevant and necessary to support certification. At the level of an MLC, those considerations relate to: (i) the consistency and correctness of MLC contributions to system functions in the context of a validated functional intent; and (ii) the absence of MLC contributions to aircraft-level failure conditions. At an ML model level, confidence in model and data properties contribute to assurance of the containing MLC, in particular: (a) generalizability and robustness of models, in the presence of inputs not previously seen during training, disturbances to inputs, and unexpected inputs; and (b) valid data, i.e., data that are at least representative, relevant, complete, and accurate. Evidence for the above span the elements of the ML lifecycle, and includes, at a minimum, lifecycle artifacts that pertain to: (1) properties of requirements capturing functional intent, safety constraints, and aspects of the intended use and operating environment; (2) model performance, model complexity and design, and algorithm choice; (3) achievement of required performance at the levels of a trained model during model development, a trained model after model development is complete, and a trained model that is transformed into an executable equivalent; (4) model implementation aspects necessary for transforming a trained model into the executable equivalent; (5) integration of the executable trained model into the containing MLC, and eventually the larger system; and, (6) lastly, the verification and validation (V&V) of each of the above. Such V&V lifecycle artifacts themselves include: aspects of coverage, e.g., of various levels of requirements by the input space of the model and the data; traceability (where applicable); application of formal methods for property specification, analysis, and checking. Examples of evidence generation methods and tools further ground the discussion on what constitutes evidence, and the contribution to assurance during certification. The identified assurance considerations and supporting evidence is not a comprehensive set. Additionally, neither what should be considered as sufficient evidence relative to the assigned criticality of an MLC, nor how criticality ought to be determined and adjusted, have been considered in this report. However, suggestions are made for potential activities of the ML lifecycle that are aimed at providing confidence that an MLC can be relied upon when integrated into its containing (aircraft) system. Those activities are proposed as candidate elements of a certification process for MLCs. The main purpose of this report to inform regulatory guidance and consensus standards that may be used to meet the safety intent of the applicable regulations.

Aviation safety↗
DOE OSTI2025

Comprehensive Database of Environmental Mitigations Extracted from FERC-Licensed Hydropower Projects Using Artificial Intelligence Techniques, 1998-2023

This dataset provides a comprehensive inventory of environmental mitigation measures required by Federal Energy Regulatory Commission (FERC) licensed hydropower facilities from 461 licenses that were issued from 1998 to 2023. These licenses constitute 446 of the 1015 FERC projects that were active at the end of 2023. 17,612 mentions of environmental mitigations were identified and categorized in 128 unique categories. Mitigations were identified using a Natural Language Processing (NLP) approach, specifically with a Bidirectional Encoder Representations from Transformer (BERT) model. Model-derived results were then reviewed and updated by a subject matter expert as needed. This dataset introduces important enhancements to previous efforts to inventory environmental mitigations, such as including associated license text for each mitigation, tracking the number of instances a mitigation was identified within a license, and providing improved location information. These enhancements significantly expand the dataset's utility, offering greater analytical capabilities and ensuring reproducibility. The dataset is downloadable as a zip file containing the metadata and dataset files.

Ruggles, Thomas [Oak Ridge National Laboratory (OR↗
NASA NTRS1981

Photolysis of CH4-NH3 mixtures and PH3 as models for the photochemical transformations on the primitive earth and Jupiter

Methane, ammonia and phosphine are some of the possible constituents of the atmospheres of the Jovian planets and their satellites. Photolysis of NH3 in the presence of CH4 at 185 nm in the temperature range of 25 C to -100 C results in the decomposition of CH4. The reaction is inhibited by added H2 or SF6. These findings are consistent with the reaction of hot hydrogen atoms with CH4 to give the CH3 radical. P2H4 is the initial product formed by the photolysis of PH3 at 206 nm. Kinetic studies established that it is the intermediate in the formation of P4 from PH3. The potential significance of these reactions to the atmospheric photochemistry of the Jovian planets and moons is discussed.

Ferris, J. P.↗
NASA NTRS1990

Model checking for linear temporal logic: An efficient implementation

This report provides evidence to support the claim that model checking for linear temporal logic (LTL) is practically efficient. Two implementations of a linear temporal logic model checker is described. One is based on transforming the model checking problem into a satisfiability problem; the other checks an LTL formula for a finite model by computing the cross-product of the finite state transition graph of the program with a structure containing all possible models for the property. An experiment was done with a set of mutual exclusion algorithms and tested safety and liveness under fairness for these algorithms.

Sherman, Rivi↗
NASA NTRS1994

Turbulence models for compressible boundary layers

It is shown that to satisfy the general accepted compressible law of the wall derived from the Van Driest transformation, turbulence modeling coefficients must actually be functions of density gradients. The transformed velocity profiles obtained by using standard turbulence model constants have too small a value of the effective von Karman constant kappa in the log-law region (inner layer). Thus, if the model is otherwise accurate, the wake component is overpredicted and the predicted skin friction is lower than the expected value.

Huang, P. G.↗
NASA NTRSDate not supplied

Language Model For Earth Science: Exploring Potential Downstream Applications As Well As Current Challenges

The use of deep learning techniques to build transformer language models such as SciBERT and GPT3 have transformed the natural language technology (NLT) landscape. These new NLTs are being used in speech to text and vice versa, auto-mated text classification, sentiment analysis, topic modeling, text summarization, and cognitive assistants. While Earth science has no shortage of unstructured data such as journal and conference papers, little efforts have focused on harnessing NLTs for knowledge extraction and supporting the scientific process. This paper surveys the use of language models in different science. BERT-E, a new Earth science-specific language model, is presented. BERT-E is generated using a transfer learning solution. A language model that has already been trained for general Science (SciBERT) is fine-tuned using abstracts and full text extracted from various Earth science-related articles. A downstream keywords classification application is used for evaluation, and the use of BERT-E shows improved performance. The need to develop a robust set of benchmarks in evaluating the language model such as BERT-E is discussed. Finally, example applications are presented to inspire additional ideas for applications using domain-specific language models.

R Ramachandran↗
NASA NTRS1984

Inversion of vegetation canopy reflectance models for estimating agronomic variables. II - Use of angle transforms and error analysis as illustrated by Suits' model

The technique for inverting a vegetation canopy reflectance model described earlier (Goel and Strebel, 1983) is investigated further. The novel concept of an 'angle transform' is introduced. This concept allows the formation of functions of reflectances at different view zenith and azimuth angles, which are either sensitive or insensitive to a certain agronomic parameter. A proper combination of these functions can allow determination of all the important agronomic and spectral parameters from measured canopy reflectance data. The technique is demonstrated using Suits' (1972) model for homogeneous canopies. It is shown that leaf area index, leaf reflectance and transmittance, and average leaf angle all can be determined from the canopy reflectance at a set of selected view zenith and azimuth angles. A sensitivity analysis of the calculated values to the errors in the data is also carried out. Guidelines are formulated for the number and types of observations required to obtain the values of a particular canopy variable to within a given degree of accuracy for a given level of error in the measurement of canopy reflectance.

Goel, N. S.↗
DOE OSTI2025

On the effectiveness of neural operators at zero-shot weather downscaling

Machine-learning (ML) methods have shown great potential for weather downscaling. These data-driven approaches provide a more efficient alternative for producing high-resolution weather datasets and forecasts compared to physics-based numerical simulations. Neural operators, which learn solution operators for a family of partial differential equations, have shown great success in scientific ML applications involving physics-driven datasets. Neural operators are grid-resolution-invariant and are often evaluated on higher grid resolutions than they are trained on, i.e., zero-shot super-resolution. Given their promising zero-shot super-resolution performance on dynamical systems emulation, we present a critical investigation of their zero-shot weather downscaling capabilities, which is when models are tasked with producing high-resolution outputs using higher upsampling factors than are seen during training. To this end, we create two realistic downscaling experiments with challenging upsampling factors (e.g., 8x and 15x) across data from different simulations: the European Centre for Medium-Range Weather Forecasts Reanalysis version 5 (ERA5) and the Wind Integration National Dataset Toolkit. While neural operator-based downscaling models perform better than interpolation and a simple convolutional baseline, we show the surprising performance of an approach that combines a powerful transformer-based model with parameter-free interpolation at zero-shot weather downscaling. We find that this Swin-Transformer-based approach mostly outperforms models with neural operator layers in terms of average error metrics, whereas an Enhanced Super-Resolution Generative Adversarial Network-based approach is better than most models in terms of capturing the physics of the ground truth data. We suggest their use in future work as strong baselines.

17 WIND ENERGY↗
DOE OSTI2026

PyJMAK: An Open-Source Python Toolkit for Modeling Solid-State Metallurgical Phase Transformations

Accurate prediction of metallurgical phase transformations is an essential basis for autonomous optimization and rapid part qualification. Several methods can be used to estimate the evolution of phase fractions such as JMAK kinetics-based models, phase-field models, thermodynamic models, and data-driven machine learning models. Thermodynamic and phase-field-based methodologies solve multiphysics equations requiring numerous calibration parameters and significant computational resources. As a result, the computation domain is limited to a point or on order of micron-meters. The data-driven models rely on large datasets from experiments and simulations. While the JMAK model only provides information about phase fraction evolution, it can predict this evolution in near real-time using thermal history and thermodynamic data without restriction on the domain. JMAK models have been popularly used by researchers to model phase transformations occuring during additive manufacturing or over arbitrary temperature profiles. Commercial proprietary software such as Abaqus and Ansys or closed-source in-house implementations offer the ability to model JMAK based kinetics to predict phase transformation. However, these software packages are not open-source or freely available for use and development in conjunction with manufacturing machines, sensors, and machine learning algorithms. In addition, the use of the model is restricted by a license token. In contrast, given temperature profiles at multiple points in the domain, this Python-based PyJMAK model can compute phase evolution in parallel due to its stand-alone modular, voxel-based structure, and it can be executed on high-performance computing resources without any license restrictions.

Prabhune, Bhagya [Oak Ridge National Laboratory (O↗
NASA NTRS2023

SafeAeroBERT: Towards a Safety-Informed Aerospace-Specific Language Model

As aviation systems continue to operate with high traffic, large amounts of documents containing safety-relevant data continue to be generated via reporting systems such as the ASRS. Advanced natural language processing techniques, specifically pre-trained language models, have shown great success in domain-specific applications; however, the text in aviation safety reports is inundated with jargon and thus not fully utilized by general pre-trained models. In this research, we work towards developing a safety-informed aerospace-specific language model by pre-training a Bidirectional Encoder Representations from Transformer (BERT) model on reports from the Aviation Safety Reporting System and the National Transportation Safety Board. The resulting model, called SafeAeroBERT, is fine-tuned for the specific task of document classification, and can be further tuned for named-entity recognition, relation detection, information retrieval, and summarization. Results from the classification task are compared between SafeAeroBERT, the base BERT, and SciBERT models and show SafeAeroBERT outperforms the general BERT and SciBERT on classifying reports about human factors, aircraft, and procedure. SafeAeroBERT can be used on custom tasks, not limited to document classification, and is intended to aid an intelligent knowledge manager for safety report repositories.

Aviation↗
NASA NTRSDate not supplied

SafeAeroBERT: Towards a Safety-Informed Aerospace-Specific Language Model

As aviation systems continue to operate with high traffic, large amounts of documents containing safety-relevant data continue to be generated via reporting systems such as the Aviation Safety Reporting System (ASRS). Advanced natural language processing techniques, specifically pre-trained language models, have shown great success in domain-specific applications; however, the text in aviation safety reports is inundated with jargon and thus not fully utilized by general pre-trained models. In this research, we work towards developing a safety-informed aerospace-specific language model by pre-training a Bidirectional Encoder Representations from Transformer (BERT) model on reports from the Aviation Safety Reporting System and the National Transportation Safety Board. The resulting model, called SafeAeroBERT, is fine-tuned for the specific task of document classification, and can be further tuned for named-entity recognition, relation detection, information retrieval, and summarization. Results from the classification task are compared between SafeAeroBERT, the base BERT, and SciBERT models and show SafeAeroBERT outperforms the general BERT and SciBERT on classifying reports about weather and procedure. SafeAeroBERT can be used on custom tasks, not limited to document classification, and is intended to aid an intelligent knowledge manager for safety report repositories.

Aviation↗
NASA NTRS2020

Assimilation of SMAP and ASCAT Soil Moisture Retrievals into the JULES Land Surface Model Using the Local Ensemble Transform Kalman Filter

A land data assimilation system is developed to merge satellite soil moisture retrievals into the Joint U.K. Land Environment Simulator (JULES) land surface model (LSM) using the Local Ensemble Transform Kalman Filter (LETKF). The system assimilates microwave soil moisture retrievals from the Soil Moisture Active Passive (SMAP) radiometer and the Advanced Scatterometer (ASCAT) after bias correction based on cumulative distribution function fitting. The soil moisture assimilation estimates are evaluated with ground-based soil moisture measurements over the continental U.S. for five consecutive warm seasons (May–September of 2015–2019). The result shows that both SMAP and ASCAT retrievals improve the accuracy of soil moisture estimates. Especially, the SMAP single-sensor assimilation experiment shows the best performance with the increase of temporal anomaly correlation by ΔR ~ 0.05 for surface soil moisture and ΔR ~ 0.03 for root-zone soil moisture compared with the LSM simulation without satellite data assimilation. SMAP assimilation is more skillful than ASCAT assimilation primarily because of the greater skill of the assimilated SMAP retrievals compared to the ASCAT retrievals. The skill improvement also depends significantly on the region; the higher skill improvement in the western U.S. compared to the eastern U.S. is explained by the Kalman gain in the two experiments. Additionally, the regional skill differences in the single-sensor assimilation experiments are attributed to the number of assimilated observations. Finally, the soil moisture assimilation estimates provide more realistic land surface information than model-only simulations for the 2015 and the 2016 western U.S. droughts, suggesting the advantage of using satellite soil moisture retrievals in the current drought monitoring system.

SMAP↗
NASA NTRS1975

On Similarity Transformation and Geodetic Network Distortions Based on Doppler Satellite Observations

Models used in geodesy to transform two sets of coordinates are studied and distortions in geodetic networks are investigated. Commonly used transformation models are first reviewed and most of them are interpreted. Differences between various models are discussed. Pitfalls in partial solutions are then considered. It is shown that only as many chords and/or directional elements can be used in the computation as are needed to completely determine the size or shape of the polyhedron implied in the set of Cartesian coordinates. Each additional element causes the normal matrix to be singular provided that all correlations between the chords are used. A number of tables and maps indicating distortions in the NAD 27, Precise Traverse M-R '72, AUS, and SAD 69 geodetic datums are also included. The residuals of the coordinates are scanned for systematic patterns after transforming each geodetic system to the NWL9D Doppler system. Also, an attempt is made to show scale distortions in the NAD 27.

Leick, Alfred↗
NASA NTRS1979

Synthesis of a control model for a liquid nitrogen cooled, closed circuit, cryogenic nitrogen wind tunnel and its validation

The details of the efforts to synthesize a control-compatible multivariable model of a liquid nitrogen cooled, gaseous nitrogen operated, closed circuit, cryogenic pressure tunnel are presented. The synthesized model was transformed into a real-time cryogenic tunnel simulator, and this model is validated by comparing the model responses to the actual tunnel responses of the 0.3 m transonic cryogenic tunnel, using the quasi-steady-state and the transient responses of the model and the tunnel. The global nature of the simple, explicit, lumped multivariable model of a closed circuit cryogenic tunnel is demonstrated.

Balakrishna, S.↗