Search NASASearch

SEARCH · Search NASA

Results for “embedding model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

A Priori Analysis of a Compressible Flamelet Model using RANS Data for a Dual-Mode Scramjet Combustor

In an effort to make large eddy simulation of hydrocarbon-fueled scramjet combustors more computationally accessible using realistic chemical reaction mechanisms, a compressible flamelet/progress variable (FPV) model was proposed that extends current FPV model formulations to high-speed, compressible flows. Development of this model relied on observations garnered from an a priori analysis of the Reynolds-Averaged Navier-Stokes (RANS) data obtained for the Hypersonic International Flight Research and Experimentation (HI-FiRE) dual-mode scramjet combustor. The RANS data were obtained using a reduced chemical mechanism for the combustion of a JP-7 surrogate and were validated using avail- able experimental data. These RANS data were then post-processed to obtain, in an a priori fashion, the scalar fields corresponding to an FPV-based modeling approach. In the current work, in addition to the proposed compressible flamelet model, a standard incompressible FPV model was also considered. Several candidate progress variables were investigated for their ability to recover static temperature and major and minor product species. The effects of pressure and temperature on the tabulated progress variable source term were characterized, and model coupling terms embedded in the Reynolds- averaged Navier-Stokes equations were studied. Finally, results for the novel compressible flamelet/progress variable model were presented to demonstrate the improvement attained by modeling the effects of pressure and flamelet boundary conditions on the combustion.

Quinlan, Jesse R.

Modeling Co2 Flow Through Faulted/Fractured Reservoirs Using Tedfm in Corner-Point Grids

Interest in underground CO2 storage has increased significantly over the last decade, driven by growing concern about global warming and rising levels of greenhouse gases in the atmosphere. Given that CO2 accounts for 80% of these greenhouse gases, carbon capture, utilization, and storage (CCUS) is considered one of the most direct approaches to achieving the net-zero carbon target. Although CO2 storage in deep saline aquifers and depleted gas reservoirs has been studied extensively, most studies use commercial simulators that model faults/fractures by simply modifying the transmissibility in the direction perpendicular to the fault surfaces. This work shows that this simplistic approach ignores the accelerated flow in the directions parallel to the fault plane, leading to significantly higher leakage along the fault surface. To accurately model CO2 flow in faulted reservoirs, we present the first transient embedded discrete-fracture model for corner-point grids (tEDFM-CPG). By comparing the tEDFM-CPG results with high-resolution reference solutions, we show that this approach is accurate and efficient at predicting CO2 flow in faulted/fractured reservoirs. In conclusion, this work presents the use of mixed reality (MR) to efficiently observe CO2 gas migration in the interior of these corner-point grid systems.

02 PETROLEUM

Fusion Model for Metagenomics

This work highlights the use of an embeddings approach that can encode multiple features and create efficient contextualization of profiled metagenomes derived from microbiome samples using computer vision models and image representations of the abundance profiles. The model's embeddings can be used to cluster existing samples based on multiple conditions and interpretations, and new embeddings can be quickly created for new samples and fitted to existing clusters to characterize them. This has practical applications for unknown, unlabeled microbiome samples. The model's embeddings can be used to cluster existing samples based on multiple conditions and interpretations, and new embeddings can be quickly created for new samples and fitted to existing clusters to characterize them. This has practical applications for unknown, unlabeled microbiome samples.

Valdes, CamiloA [Lawrence Livermore National Labor

Impacts of Control, Penetration, and Distribution of Embedded Storage Network in Bulk Power System

The current shift in generation mix from fossil fuel plants towards variable and intermittent renewable energy sources is poised to create a future grid with reduced physical inertia and mismatch between generation and demand. Embedded storage, which is a concept of a coordinated network of storage units sited at the interface between the transmission and distribution system, is proposed as a mechanism to provide a buffer between generation and demand. This paper proposes an automated framework to model and integrate embedded storage in large-scale power systems with industry-grade grid-following (GFL) and grid-forming (GFM) control technologies. More importantly, the developed framework is used to explore the impacts of embedded storage control, penetration, location, and capacity in providing fast frequency response to the grid under contingency events such as generator trips and faults. The framework and study are conducted using the transient-stability simulation tool PSS/E and a realistic model of the Puerto Rico grid as a chosen test system. The simulation results show that GFL and GFM embedded storage, distributed throughout the system, with sufficient penetration and capacity, can effectively improve primary frequency response of the system under the studied contingency events.

Battery Energy Storage, embedded storage, grid-for

Modeling actions and operations to support mission preparation

This paper describes two linked technology development projects to support Space Shuttle ground operations personnel, both during mission preparation analysis and related analyses in missions. The Space Propulsion Robust Analysis Tool (SPRAT) will provide intelligent support and automation for mission analysis setup, interpretation, reporting and documentation. SPRAT models the actions taken by flight support personnel during mission preparation and uses this model to generate an action plan. CONFIG will provide intelligent automation for procedure analyses and failure impact analyses, by simulating the interactions between operations and systems with embedded failures. CONFIG models the actions taken by crew during space vehicle malfunctions and simulates how the planned action sequences in procedures affect a device model. Jointly the SPRAT and CONFIG projects provide an opportunity to investigate how the nature of a task affects the representation of actions, and to determine a more general action representation supporting a broad range of tasks. This paper describes the problems in representing actions for mission preparation and their relation to planning and scheduling.

Malin, Jane T.

Automated Analysis of Stateflow Models

Stateflow is a widely used modeling framework for embedded and cyber physical systems where control software interacts with physical processes. In this work, we present a framework a fully automated safety verification technique for Stateflow models. Our approach is two-folded: (i) we faithfully compile Stateflow models into hierarchical state machines, and (ii) we use automated logic-based verification engine to decide the validity of safety properties. The starting point of our approach is a denotational semantics of State flow. We propose a compilation process using continuation-passing style (CPS) denotational semantics. Our compilation technique preserves the structural and modal behavior of the system. The overall approach is implemented as an open source toolbox that can be integrated into the existing Mathworks Simulink Stateflow modeling framework. We present preliminary experimental evaluations that illustrate the effectiveness of our approach in code generation and safety verification of industrial scale Stateflow models.

Stateflow

HAPPA: A Modular Platform for HPC Application Resilience Analysis with LLMs Embedded

High-performance computing (HPC) systems are increasingly vulnerable to soft errors, which pose significant challenges in maintaining computational accuracy and reliability. Predicting the resilience of HPC applications to these errors is crucial for robust code protection and detailed resilience analysis. In this study, we present HAppA, a modular platform designed for HPC Application Resilience Analysis. Embedding Large Language Models (LLMs), HAppA addresses understanding the context information of long code sequences typical in HPC applications. HAppA implements a novel code representation module that chunks the code into fixed-size segments and aggregates the embeddings of these segments. Three aggregation methods have been explored: MeanPooling, MaxPooling, and LSTM-based techniques. We built a DAtaset for REsilience analysis using Fault Injection (FI), named DARE. Using our DARE dataset, HAppA is trained for regression prediction tasks. Our evaluation results demonstrate the predictive accuracy of HAppA compared to other models, particularly noting that the LSTM-based aggregation method -- HAppA-LSTM -- achieves a mean squared error (MSE) of 0.078 for SDC prediction, surpassing the existing state-of-the-art PARIS model, which recorded an MSE of 0.1172. Additionally, HAppA with the KeyBERT model extracts a list of keywords representing the source code. A comprehensive importance analysis of these keywords further elucidates the code patterns contributing to the error rate. These findings highlight the effectiveness of HAppA in analyzing the resilience of HPC applications and establish a new benchmark for predictive accuracy in resilience.

Jiang, Hailong [Kent State University]

The embedded young stars in the Taurus-Auriga molecular cloud. II - Models for scattered light images

We describe NIR imaging observations of embedded young stars in the Taurus-Auriga molecular cloud. We find a large range in J-K and H-K colors for these class I sources. The bluest objects have colors similar to the reddest T Tauri stars in the cloud; redder objects lie slightly above the reddening line for standard ISM dust and have apparent K extinctions of up to 5 mag. Most of these sources also show extended NIR emission on scales of 10-20 arcsec which corresponds to linear sizes of 1500-3000 AU. The NIR colors and nebular morphologies for this sample and the magnitude of linear polarization in several sources suggest scattered light produces most of the NIR emission in these objects. We present modeling results that suggest mass infall rates that agree with predictions for cold clouds and are generally consistent with rates estimated from radiative equilibrium models. For reasonable dust grain parameters, the range of colors and extinctions require flattened density distributions with polar cavities evacuated by bipolar outflows. These results support the idea that infall and outflow occur simultaneously in deeply embedded bipolar outflow sources. The data also indicate fairly large centrifugal radii and large inclinations to the rotational axis for a typical source.

Kenyon, Scott J.

Comparison of cloud fields from atmospheric general circulation model, in situ and satellite measurements

This paper focuses on the comparison of cloud amounts derived from an atmospheric general circulation model (AGCM), Satellite-observed clouds, and Ground-based cloud observations. Unlike Earth Radiation Budget Experiment (ERBE)-type comparisons it does not mix potential errors in the cloud amount with those in the radiation code embedded in the model. Long term cloud climatologies were used to compare global cloud amounts and regional seasonal cycles. The AGCM successfully reproduced the signatures of the warm pool and North Pacific seasonal cycle cloudiness but failed in the low stratus region off the coast of South America, a known problem for AGCMs. The data sets also reproduced the anomaly signature associated with El Nino in the warm pool region, but the model amounts were lower. Global results had a similar success rate, with the model generally producing lower total cloud compared to the satellite and in situ measurements. To compare cloud vertical distributions the cloud height may need to be validated using the corresponding radiation fields. Unfortunately there were also some large discrepancies between the two observed cloud data sets. While tremendously improved over the last decade the character of the observed cloud data sets, must be substantially enhanced before they will be useful in validating AGCMs by any but the crudest levels of comparison.

Haskins, Robert D.

Simulation and Scaling of the Turbulent Vertical Heat Transport and Deep-Cycle Turbulence Across the Equatorial Pacific Cold Tongue

Microstructure observations in the Pacific cold tongue reveal that strong turbulence often penetrates into the thermocline producing hundreds of W/m2 of downward heat transport during nighttime and early morning. However, virtually all observations of this deep-cycle turbulence (DCT) are from 0◦N,140◦W. Here, a hierarchy of ocean process simulations including submesoscale-permitting regional models and turbulence-permitting large eddy simulations (LES) embedded in a regional model provide insight into DCT at and beyond 0◦N,140◦W. A regional hindcast quantifies the spatio-temporal variability of subsurface turbulent heat fluxes throughout the cold tongue from 1999-2016. Climatologically, the mean heat flux is strongest (∼100W/m2) within2◦ of the equator. The heat flux is slightly (∼10 W/m2) stronger in the northern than southern hemisphere throughout the cold tongue. The seasonal cycle of the heat flux, which is not everywhere aligned with the surface flux, ranges from 150 W/m2 near the equator to 30 W/m2 and 10 W/m2 at 4◦N and S respectively. Aseasonal variability of turbulent heat fluxes is logarithmically distributed and temporally uncorrelated with surface heat fluxes. The aseasonal variability of turbulence is highlighted in 34-day LES of Boreal autumn at 0◦N and 3◦N,140◦W. Intense DCT occurs frequently above the undercurrent at 0◦N and intermittently at 3◦N. Daily-mean heat fluxes scale with the bulk vertical shear and the wind stress, which together explain ∼90% of the daily variance across both LES. Observational validation of the scaling at 0◦N,140◦W is encouraging, but observations beyond 0◦N,140◦W can facilitate needed refinement of mixing parameterization in ocean models.

Simulation

DNABERT-S: pioneering species differentiation with species-aware DNA embeddings

SUMMARY: We introduce DNABERT-S, a tailored genome model that develops species-aware embeddings to naturally cluster and segregate DNA sequences of different species in the embedding space. Differentiating species from genomic sequences (i.e. DNA and RNA) is vital yet challenging, since many real-world species remain uncharacterized, lacking known genomes for reference. Embedding-based methods are therefore used to differentiate species in an unsupervised manner. DNABERT-S builds upon a pre-trained genome foundation model named DNABERT-2. To encourage effective embeddings to error-prone long-read DNA sequences, we introduce Manifold Instance Mixup (MI-Mix), a contrastive objective that mixes the hidden representations of DNA sequences at randomly selected layers and trains the model to recognize and differentiate these mixed proportions at the output layer. We further enhance it with the proposed Curriculum Contrastive Learning (C2LR) strategy. Empirical results on 28 diverse datasets show DNABERT-S's effectiveness, especially in realistic label-scarce scenarios. For example, it identifies twice more species from a mixture of unlabeled genomic sequences, doubles the Adjusted Rand Index (ARI) in species clustering, and outperforms the top baseline's performance in 10-shot species classification with just a 2-shot training. AVAILABILITY AND IMPLEMENTATION: Model, codes, and data are publically available at https://github.com/MAGICS-LAB/DNABERT_S.

Zhou, Zhihan

Accurate electromagnetic modeling of terahertz detectors

Twin slot antennas coupled to superconducting devices have been developed over the years as single pixel detectors in the terahertz (THz) frequency range for space-based and astronomy applications. Used either for mixing or direct detection, they have been object of several investigations, and are currently being developed for several missions funded or co-funded by NASA. Although they have shown promising performance in terms of noise and sensitivity, so far they have usually also shown a considerable disagreement in terms of performance between calculations and measurements, especially when considering center frequency and bandwidth. In this paper we present a thorough and accurate electromagnetic model of complete detector and we compare the results of calculations with measurements. Starting from a model of the embedding circuit, the effect of all the other elements in the detector in the coupled power have been analyzed. An extensive variety of measured and calculated data, as presented in this paper, demonstrates the effectiveness and reliability of the electromagnetic model at frequencies between 600 GHz and 2.5THz.

Hot Electron Bolometer (HEB)

Effects of Adiabatic Heating on the High Strain Rate Deformation of Polymer Matrix Composites

Polymer matrix composites (PMCs) are increasingly being used in aerospace structures that are expected to experience complex dynamic loading conditions throughout their lifetime. As such, a detailed understanding of the high strain rate behavior of the constituents, particularly the strain rate, temperature, and pressure dependent polymer matrix, is paramount. In this paper, preliminary efforts in modeling experimentally observed temperature rises due to plastic deformation in PMCs subjected to dynamic loading are presented. To this end, an existing isothermal viscoplastic polymer constitutive formulation is extended to model adiabatic conditions by incorporating temperature dependent elastic properties and modifying the components of the inelastic strain rate tensor to explicitly depend on temperature. It is demonstrated that the modified polymer constitutive model is capable of capturing strain rate and temperature dependent yield as well as thermal softening associated with the conversion of plastic work to heat at high rates of strain. The modified constitutive model is then embedded within a strength of materials based micromechanics framework to investigate the manifestation of matrix thermal softening, due to the conversion of plastic work to heat, on the high strain rate response of a T700Epon 862 (T700E862) unidirectional composite. Adiabatic model predictions for high strain rate composite longitudinal tensile, transverse tensile, and in-plane shear loading are presented. Results show a substantial deviation from isothermal conditions; significant thermal softening is observed for matrix dominated deformation modes (transverse tension and in-plane shear), highlighting the importance of accounting for the conversion of plastic work to heat in the polymer matrix in the high strain rate analysis of PMC structures.

polymer matrix composites

Computationally Efficient Modeling and Data Assimilation of Near-Surface Variability

Near-surface (< 20m) ocean exhibits high variability due to coupled interactions, for e.g., with the atmosphere, sea ice, land, etc. Here we focus on atmospheric heat and momentum (wind) forcing, which are known to cause diurnal variability within the mixed layer. Only recently with a combination of sufficiently high vertical/horizontal resolution (75L, 1/4deg) and sub-daily atmospheric forcing fields, ocean models are starting to resolve this diurnal variability. However, the computation expense of such a high vertical resolution is burdensome in the context of coupled modeling and data assimilation. An alternative approach is to parameterize this diurnal variability with a prognostic model, that is embedded into the ocean model.In the first part of this presentation, we will demonstrate results with the above two approaches, by comparing them to profiles of near-surface temperature and salinity. In the context of data assimilation and reanalysis, this modeling capability opens the door to re-examine and perhaps improve specification of background (or, ensemble) error characteristics. The second half of this talk will focus on illustrating diurnally varying errors within an ensemble DA, and possible approaches to improve localization (horizontal/vertical) to extract maximum possible observational information content from in-situ and satellite observations of sea surface temperature.

Akella, Santha

Extended Magnetohydrodynamics with Embedded Particle-in-Cell Simulation of Ganymede's Magnetosphere

We have recently developed a new modeling capability to embed the implicit particle-in-cell (PIC) model iPIC3D into the Block-Adaptive-Tree-Solarwind-Roe-Upwind-Scheme magnetohydrodynamic (MHD) model. The MHD with embedded PIC domains (MHO-EPIC) algorithm Is a two-way coupled kinetic-fluid model. As one of the very first applications of the MHD-EPIC algorithm, we simulate the Interaction between Jupiter's magnetospherlc plasma and Ganymede's magnetosphere. We compare the MHO-EPIC simulations with pure Hall MHD simulations and compare both model results with Galileo observations to assess the Importance of kinetic effects In controlling the configuration and dynamics of Ganymede's magnetosphere. We find that the Hall MHD and MHO-EPIC solutions are qualitatively similar, but there are significant quantitative differences. In particular. the density and pressure inside the magnetosphere show different distributions. For our baseline grid resolution the PIC solution is more dynamic than the Hall MHD simulation and it compares significantly better with the Galileo magnetic measurements than the Hall MHD solution. The power spectra of the observed and simulated magnetic field fluctuations agree extremely well for the MHD-EPIC model. The MHO-EPIC simulation also produced a few flux transfer events (FTEs) that have magnetic signatures very similar to an observed event. The simulation shows that the FTEs often exhibit complex 3-0 structures with their orientations changing substantially between the equatorial plane and the Galileo trajectory, which explains the magnetic signatures observed during the magnetopause crossings. The computational cost of the MHO-EPIC simulation was only about 4 times more than that of the Hall MHD simulation.

Toth, Gabor

Natural Language Processing Analysis of Notices to Airmen for Air Traffic Management Optimization

With new emerging technologies in the field of NLP, we explore their applications to digitize and analyze heritage Air Traffic Management (ATM) documents for planning and optimizing airspace operations. Specifically, this research focuses on harvesting semi-structured or un-structured information contained in Notices to Airmen (NOTAMs). Using NLP and other advanced data analytics, we will construct a data-driven framework which facilitates finding language patterns and the use of pretrained language models for classification and extraction of useful airspace constraints and restrictions. These may lead to tools that assist airspace users in understanding the constraints more efficiently, contributing to better route planning and safer execution. This paper explores three workflows entailing different NLP tasks. First, unsupervised techniques like word embedding and topic modeling are used for pattern finding and document classification. Second, a dataset is created by extracting information from the semi-structured NOTAM format as metadata for categorizing, visualizing, and extracting key entities driving NOTAM content. Third, modern pre-built deep learning based transformer models such as BERT, RoBERTa, and XLNet are evaluated on the question answering task, an even more robust approach to information extraction, as well as their respective fine-tuning tasks. In this work we include various performance metrics for the trained models to evaluate both accuracy and precision and we show that the models can be generalized for their respective tasks. The research work developed shows promise in uncovering trends in digital NOTAMs in the NAS and also offers a new framework for digitizing and inferring insights from free-form legacy NOTAMs, that are yet to be digitized.

Natural Language Processing

Natural Language Processing (NLP) Analysis of NOTAMs for Air Traffic Management Optimization

With new emerging technologies in the field of NLP, we explore their applications to digitize and analyze heritage Air Traffic Management (ATM) documents for planning and optimizing airspace operations. Specifically, this research focuses on harvesting semi-structured or un-structured information contained in Notices to Airmen (NOTAMs). Using NLP and other advanced data analytics, we will construct a data-driven framework which facilitates finding language patterns and the use of pretrained language models for classification and extraction of useful airspace constraints and restrictions. These may lead to tools that assist airspace users in understanding the constraints more efficiently, contributing to better route planning and safer execution. This paper explores three workflows entailing different NLP tasks. First, unsupervised techniques like word embedding and topic modeling are used for pattern finding and document classification. Second, a dataset is created by extracting information from the semi-structured NOTAM format as metadata for categorizing, visualizing, and extracting key entities driving NOTAM content. Third, modern pre-built deep learning based transformer models such as BERT, RoBERTa, and XLNet are evaluated on the question answering task, an even more robust approach to information extraction, as well as their respective fine-tuning tasks. In this work we include various performance metrics for the trained models to evaluate both accuracy and precision and we show that the models can be generalized for their respective tasks. The research work developed shows promise in uncovering trends in digital NOTAMs in the NAS and also offers a new framework for digitizing and inferring insights from free-form legacy NOTAMs, that are yet to be digitized. Video is an mp4 download, with a play time of 9 min 35 secs.

Natural Language Processing

Tropical Pacific Ocean response to observed winds in a layered general circulation model

The effect of forcing by monthly wind-stress variability is assessed with respect to the behavior of an isopycnic coordinate general circulation model. The isopycnic model incorporates an embedded mixed layer, and the equations are given for the interior layers, the surface mixed layer, and the atmospheric forcing. The anomalous variability of several variables is examined in a simulation using data from 1970-1985 with specific attention given to the anomalous response related to the 1982-1983 ENSO. The model fields describing sea-surface temperature (SST), sea level, and currents are found to be comparable to those reported from observational campaigns. Anomalous values of SST compare best with observed data when averaged over large spatial regions, and the amplitudes of the mean horizontal currents and anomalous zonal currents are comparable except with respect to amplitude data. The present study permits the simulation of basin-scale tropical Pacific mixed-layer depth and the mean vertical velocity field.

Miller, Arthur J.