Search NASA⌕ Search

SEARCH · Search NASA

Results for “Language model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44

Generalized multifractality at spin quantum Hall transition

Generalized multifractality characterizes scaling of eigenstate observables at Anderson-localization critical points. We explore generalized multifractality in 2D systems, with the main focus on the spin quantum Hall (SQH) transition in superconductors of symmetry class C. Relations and differences with the conventional integer quantum Hall (IQH) transition are also studied. Using the field-theoretical formalism of non-linear sigma-model, we derive the pure-scaling operators representing generalizing multifractality and then “translate” them to the language of eigenstate observables. Performing numerical simulations on network models for SQH and IQH transitions, we confirm the analytical predictions for scaling observables and determine the corresponding exponents. Remarkably, the generalized-multifractality exponents at the SQH critical point strongly violate the generalized parabolicity of the spectrum, which implies violation of the local conformal invariance at this critical point.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Domain-specific text embedding model for accelerator physics

Accelerator physics presents unique challenges for natural language processing (NLP) due to its specialized terminology and complex concepts. A key component in overcoming these challenges is the development of robust text embedding models that transform textual data into dense vector representations, facilitating efficient information retrieval and semantic understanding. In this work, we introduce AccPhysBERT, a sentence embedding model fine-tuned specifically for accelerator physics. Our model demonstrates superior performance across a range of downstream NLP tasks, surpassing existing models in capturing the domain-specific nuances of the field. We further showcase its practical applications, including semantic paper-reviewer matching and integration into retrieval-augmented generation systems, highlighting its potential to enhance information retrieval and knowledge discovery in accelerator physics. Published by the American Physical Society 2025

Hellert, Thorsten (ORCID:0000000227970926)↗

Unsupervised multimodal fusion of in-process sensor data for advanced manufacturing process monitoring

Effective monitoring of manufacturing processes is crucial for maintaining product quality and operational efficiency. Modern manufacturing environments often generate vast amounts of complementary multimodal data, including visual imagery from various perspectives and resolutions, hyperspectral data, and machine health monitoring information such as actuator positions, accelerometer readings, and temperature measurements. However, fusing and interpreting this complex, high-dimensional data presents significant challenges, particularly when labeled datasets are unavailable or impractical to obtain. This paper presents a novel approach to multimodal sensor data fusion in manufacturing processes, inspired by the Contrastive Language-Image Pre-training (CLIP) model. We leverage contrastive learning techniques to correlate different data modalities without the need for labeled data, overcoming limitations of traditional supervised machine learning methods in manufacturing contexts. Our proposed method demonstrates the ability to handle and learn encoders for five distinct modalities: visual imagery, audio signals, laser position (x and y coordinates), and laser power measurements. By compressing these high-dimensional datasets into low-dimensional representational spaces, our approach facilitates downstream tasks such as process control, anomaly detection, and quality assurance. The unsupervised nature of our method makes it broadly applicable across various manufacturing domains, where large volumes of unlabeled sensor data are common. We evaluate the effectiveness of our approach through a series of experiments, demonstrating its potential to enhance process monitoring capabilities in advanced manufacturing systems. This research contributes to the field of smart manufacturing by providing a flexible, scalable framework for multimodal data fusion that can adapt to diverse manufacturing environments and sensor configurations. The proposed method paves the way for more robust, data-driven decision-making in complex manufacturing processes.

Contrastive Learning↗

Quantitative principles of microbial metabolism shared across scales

Metabolism is the complex network of chemical reactions occurring within every cell and organism, maintaining life, mediating ecosystem processes and affecting Earth’s climate. Experiments and models of microbial metabolism often focus on one specific scale, overlooking the connectivity between molecules, cells and ecosystems. Here we highlight quantitative metabolic principles that exhibit commonalities across scales, which we argue could help to achieve an integrated perspective on microbial life. Mass, electron and energy balance provide quantitative constraints on their flow within metabolic networks, organisms and ecosystems, shaping how each responds to its environment. The mechanisms underlying these flows, such as enzyme–substrate interactions, often involve encounter and handling stages that are represented by equations similar to those for cells and resources, or predators and prey. Here we propose that these formal similarities reflect shared principles and discuss how their investigation through experiments and models may contribute to a common language for studying microbial metabolism across scales.

59 BASIC BIOLOGICAL SCIENCES↗

Modeling and control of nuclear–renewable integrated energy systems: Dynamic system model for green electricity and hydrogen production

The need for decarbonization and diversification of energy resources has led to the development of integrated energy systems (IESs), where multiple resources supply more than one energy sector. Here, one such IES with small modular nuclear reactors and renewables (wind and solar) as generating resources, catering to the demand of the electric grid while producing hydrogen for industries, is modeled in this paper. The physics-based component models are represented using the Modelica language and interconnected to form the IES. The control and coordination of the overall system are ensured by designing a suitable control architecture composed of individual subsystem-level controls and supervisory control. The dynamic performance and the load-following capability of the IES are evaluated, while satisfying the safe operational limits of the components. Different configurations and modes of IES operation are considered, where the adaptability of the control system in the presence of varying demands and renewable generations is validated. The simulation results indicate that hydrogen as a flexible load facilitates the supply of varying grid demand. Additionally, the renewables are also accommodated into the IES owing to the flexibility of the balance of plant associated with the nuclear reactors.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Neural Architecture Search Benchmarks: Insights and Survey

Neural Architecture Search (NAS), a promising and fast-moving research field, aims to automate the architectural design of Deep Neural Networks (DNNs) to achieve better performance on the given task and dataset. NAS methods have been very successful in discovering efficient models for various Computer Vision, Natural Language Processing, etc. The major obstacles to the advancement of NAS techniques are the demand for large computation resources and fair evaluation of various search methods. The differences in training pipeline and setting make it challenging to compare the efficiency of two NAS algorithms. A large number of NAS Benchmarks to simulate the architecture evaluation in seconds have been released over the last few years to ease the computation burden of training neural networks and can aid in the unbiased assessment of different search methods. This paper provides an extensive review of several publicly available NAS Benchmarks in the literature. We provide technical details and a deeper understanding of each benchmark and point out future directions.

97 MATHEMATICS AND COMPUTING↗

Lamellar: A Rust-based Asynchronous Tasking and PGAS Runtime for High Performance Computing

Cybersecurity is one of the largest concerns in modern computing, impacting and dictating how governments, private corporations, and individuals interact with and live in an increasingly digital world. The NSA has recently released a memo [ 1] on “Software Memory Safety” where they highlight that both Microsoft and Google have stated around 70% of software vulnerabilities were due to memory safety issues. Although languages such as C and C++ provide freedom and flexibility with memory management, guaran- teeing safety falls mostly on the developer. The NSA recommends using “memory safe” languages whenever possible. In this paper we introduce Lamellar, an asynchronous tasking and PGAS HPC runtime written in Rust, one such "memory safe" language. We describe the entire Lamellar stack, from network interfaces to high- level abstractions such as distributed LamellarArrays and Active Messages. We conclude by showing comparable performance to legacy PGAS runtimes (e.g. OpenSHMEM) on a subset of the BALE kernel suite while maintaining strong memory safety principles.

HPC Software Systems, Rust Programming Language, P↗

Global distribution, formation and fate of mineral‐associated soil organic matter under a changing climate: A trait‐based perspective

Abstract Soil organic matter (SOM) is the largest actively cycling reservoir of terrestrial carbon (C), and the majority of SOM in Earth's mineral soils (~65%) is mineral‐associated organic matter (MAOM). Thus, the formation and fate of MAOM can exert substantial influence on the global C cycle. To predict future changes to Earth's climate, it is critical to mechanistically understand the processes by which MAOM is formed and decomposed, and to accurately represent this process‐based understanding in biogeochemical and Earth system models. In this review, we use a trait‐based framework to synthesize the interacting roles of plants, soil micro‐organisms, and the mineral matrix in regulating MAOM formation and decomposition. Our proposed framework differentiates between plant and microbial traits that influence total OM inputs to the soil (‘feedstock traits’) versus traits that influence the proportion of OM inputs that are ultimately incorporated into MAOM (‘MAOM formation traits’). We discuss how these feedstock and MAOM formation traits may be altered by warming, altered precipitation and elevated carbon dioxide. At a planetary scale, these feedstock and MAOM formation traits help shape the distribution of MAOM across Earth's biomes, and modulate biome‐specific responses of MAOM to climate change. We leverage a global synthesis of MAOM measurements to provide estimates of the total amount of MAOM‐C globally (~840–1540 Pg C; 34%–51% of total terrestrial organic C), and its distribution across Earth's biomes. We show that MAOM‐C concentration is highest in temperate forests and grasslands, and lowest in shrublands and savannas. Grasslands and croplands have the highest proportion of soil organic carbon (SOC) in the MAOM fraction (i.e. the MAOM‐C:SOC ratio), while boreal forests and tundra have the lowest MAOM‐C:SOC ratio. Drawing on our trait framework, we then review experimental data and posit the effects of climate change on MAOM pools in different biomes. We conclude by discussing how MAOM is integrated into soil C models, and how feedstock and MAOM formation traits may be included in these models. We also summarize the projected fate of MAOM under climate change scenarios (Representative Concentration Pathways 4.5 and 8.5) and discuss key model uncertainties. Read the free Plain Language Summary for this article on the Journal blog.

54 ENVIRONMENTAL SCIENCES↗

Anomalous electroweak physics unraveled via evidential deep learning

The ever-growing ecosystem of beyond standard model (BSM) calculations and parametrizations has motivated the development of systematic methods for making quantitative cross-comparisons over the wide range of possible models, especially with controllable uncertainties. In this setting, the language of uncertainty quantification (UQ) furnishes useful metrics for assessing statistical overlaps and discrepancies among BSM and related models. In this study, we leverage recent machine learning (ML) developments in evidential deep learning (EDL) for UQ to separate data (aleatoric) and knowledge (epistemic) uncertainties in a model-discrimination setting. We construct several potentially BSM-motivated scenarios for the anomalous electroweak interaction (AEWI) of neutrinos with nucleons in deep inelastic scattering ( v DIS). These scenarios are then quantitatively mapped, as a demonstration, alongside Monte Carlo replicas of the CT18 PDFs used to calculate the $\varDelta \chi ^{2}$ statistic for a typical multi-GeV v DIS experiment, CDHSW. Our framework effectively highlights areas of model agreement and provides a classification of out-of-distribution (OOD) samples. By offering the opportunity to quantitatively understand model overlaps, the approach presented in this work can help facilitate efficient BSM model exploration and exclusion for future New Physics searches.

AI↗

PySolate : A Python‐Based Thresholding Tool to Denoise or Designal Seismic Waveforms Based on the Continuous Wavelet Transform

PySolate is a Python‐based toolset that implements the continuous wavelet transform and nonlinear thresholding operations to denoise or designal seismic data, following Langston and Mousavi (2019). This filtering approach can remove microseismic noise to isolate intermediate‐period seismic signals that are key to enabling full‐waveform modeling and analysis of smaller‐magnitude regional events. This approach is best for the application to signals with frequency or time separation of signal and noise, in contrast to Fourier analysis, which is effective when signal and noise are separated in frequency. We demonstrate the Python toolset using the six announced Democratic People’s Republic of Korea declared nuclear tests, showing the effectiveness of isolating the seismic signal compared to standard bandpass filtering. In conclusion, we also demonstrate the ease of using the toolset with any Python processing tools.

Asia↗

Evaluating Deception Detection Model Robustness To Linguistic Variation

With the increasing use of automated, machine learning-driven tools and the downstream impact that algorithmic judgements can have, it is critical to develop models that are robust to evolving or manipulated inputs. Evaluating the reliability of multimodal models across linguistic variations to understand model susceptibility to intentional linguistic adversarial attacks as well as natural linguistic variations is essential in this pursuit. We present extensive analysis of model robustness and susceptibility to linguistic variations in the setting of deceptive news detection, a difficult classification task that is an increasingly important problem to solve with the impact of misinformation spread online. We evaluate the effectiveness of incorporating adversarial defense strategies and measure model susceptibility to state-of-the-art adversarial attacks using two types of linguistic attacks — character and word perturbations. We consider two multiclass prediction tasks — a 3-way classification of tweets as trustworthy, propaganda, or disinformation; and a 4-way classification as clickbait, hoax, satire, or conspiracy — and compare the performance of three embeddings that have been state-of-the-art for several NLP tasks — GloVe, ELMo, and BERT — to highlight consistent trends in susceptibility, high confidence misclassifications, and high impact failures. We find that character or mixed ensemble models are the most effective defense mechanisms and that character perturbations are a more effective attack than word perturbations for deception classification.

adversarial evaluation↗

OpenOA: An Open-Source Codebase For Operational Analysis of Wind Farms

OpenOA is an open source framework for operational data analysis of wind energy plants, implemented in the Python programming language. OpenOA provides a common data model, high level analysis workflows, and low-level convenience functions that engineers, analysts, and researchers in the wind energy industry can use to facilitate analytics workflows on operational data sets. OpenOA contains documentation, worked out examples in Jupyter notebooks, and a corresponding example dataset from the Engie Renewable’s La Haute Borne Dataset.

17 WIND ENERGY↗

CaveMan Enterprise version 1.0 Software Validation and Verification.

The U.S. Department of Energy Strategic Petroleum Reserve stores crude oil in caverns solution-mined in salt domes along the Gulf Coast of Louisiana and Texas. The CaveMan software program has been used since the late 1990s as one tool to analyze pressure mea- surements monitored at each cavern. The purpose of this monitoring is to catch potential cavern integrity issues as soon as possible. The CaveMan software was written in Microsoft Visual Basic, and embedded in a Microsoft Excel workbook; this method of running the CaveMan software is no longer sustainable. As such, a new version called CaveMan Enter- prise has been developed. CaveMan Enterprise version 1.0 does not have any changes to the CaveMan numerical models. CaveMan Enterprise represents, instead, a change from desktop-managed work- books to an enterprise framework, moving data management into coordinated databases and porting the numerical modeling codes into the Python programming language. This document provides a report of the code validation and verification testing.

Hart, David↗

Integration of Data Analytics with Plant System Health Program

This report summarizes the R&D activities of the Plant Health Management (PHM) project during fiscal year 2020 (FY20). This project focuses on the development of methods that integrate component health data and propagate such information at the system level to evaluate system sources of risk. This project development lives in cooperation with the Risk Informed Asset Management (RIAM) project. The RIAM project, in fact, uses the reliability models and data generated by the PHM project to optimize plant operations (e.g., maintenance/replacement schedule, optimal maintenance posture). This year’s activities for the PHM project focused mainly on the development of two classes of models. The first one includes a series of component reliability models which include aging, testing and maintenance. The second class includes a series of system reliability models which focus on the secondary side of exiting U.S. reactors. These models are based on fault tree logic structures such that they can be used by existing plant PRA software. We also started to focus on the management of health data and we tackled this issue in two directions. The first one focuses on the integration of monitor data with simulation models to assess component health. This approach is moving from a classical data based to a model+data based approach with the goal of improving higher component health information. The second direction focuses on linking equipment reliability data (e.g., maintenance/failure reports, component monitoring data) directly to system reliability models using a safety margin based language rather than a probability based language. The main advantage of a safety margin based language is that it can provide to system engineers more tangible information on system/component health and how it propagates to the system level.

97 MATHEMATICS AND COMPUTING↗

ZEM: Integrated Framework for Real-Time Data and Model Analyses for Robust Environmental Management Decision Making - 16438

Typically environmental management (EM) problems require analysis of large and complex data sets originating from concurrent data streams with different data collection frequencies and pedigree. These big data sets require on-the-fly analysis, assimilation and integration into a series of models with different complexity for various types of model-based analyses. This is needed to provide fast iterative model analyses based on the latest available data to guide decision-making. Furthermore, the data and model are associated with uncertainties. The uncertainties are probabilistic (e.g. measurement errors) and non-probabilistic (unknowns, e.g. alternative conceptual models characterizing site conditions). To address all of these issues, we have developed an integrated framework for real-time data and model analyses for environmental decision-making called ZEM. The framework allows for seamless and on-the-fly integration of data and modeling results for robust and scientifically-defensible decision-making applying advanced decision analyses tools such as Bayesian-Information-Gap Decision Theory (BIG-DT). The framework also includes advanced methods for optimization that are capable of dealing with a large number of unknown model parameters, and surrogate (reduced order) modeling capabilities based on support vector regression techniques. The framework is predominantly coded in Julia, a state-of-the-art high-performance programing language (http://julialang.org) and incorporates the MADS computational tools (Model Analysis and Decision Support; http://mads.lanl.gov). We demonstrate the application of ZEM for data and model analyses at the LANL Chromium site. The ZEM framework will be released as open-source code and can be applied to any environmental management site. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Evaluation of PGAS communication paradigms with geometric multigrid

Partitioned Global Address Space (PGAS) languages and one-sided communication enable application developers to select the communication paradigm that balances the performance needs of applications with the productivity desires of programmers. In this paper, we evaluate three different one-sided communication paradigms in the context of geometric multigrid using the miniGMG benchmark. Although miniGMG's static, regular,and predictable communication does not exploit the ultimate potential of PGAS models, multigrid solvers appear in many contemporary applications and represent one of the most important communication patterns. We use UPC++, a PGAS extension of C++, as the vehicle for our evaluation, though our work is applicable to any of the existing PGAS languages and models. We compare performance with the highly tuned MPI baseline, and the results indicate that the most promising approach towards achieving performance and ease of programming is to use high-level abstractions, such as the multidimensional arrays provided by UPC++, that hide data aggregation and messaging in the runtime library.

Shan, H↗

Customized open source renewable energy models validated through PHIL lab experiments

Energy models for power systems require ongoing updates to reflect advancements in equipment technology and the increasing complexity of power electronic devices. This study utilizes a Power Hardware-in-the-Loop (PHIL) experimental setup to validate custom photovoltaic (PV) inverter models, aiming to enhance and expedite the development of advanced renewable energy models. The research compares the performance of a physical inverter with generic Renewable Energy Source (RES) models recommended by the Western Electricity Coordinating Council (WECC). As inverter-based renewable energy sources become more prevalent in modern electrical grids, it is crucial that dynamic models accurately represent their real-world behavior. Accurate models improve our understanding of these energy resources and their interactions with the grid. The proposed model enhancements are designed to better reflect real inverter performance, based on insights from PHIL experiments. These models are developed using the open source Modelica language and the OpenIPSL Modelica Library, allowing integration across various simulation tools without re-implementation. The paper concludes with a thorough assessment, comparing the enhanced models with PHIL experiments on a real PV inverter in a controlled laboratory setting. As a result, the study provides the enhanced WECC RES models and validation data as open source resources, facilitating further research and development.

Modelica↗

Performance on HPC Platforms Is Possible Without C++

Computing at large scales has become extremely challenging due to increasing heterogeneity in both hardware and software. More and more scientific workflows must tackle a range of scales and use machine learning and AI intertwined with more traditional numerical modeling methods, placing more demands on computational platforms. These constraints indicate a need to fundamentally rethink the way computational science is done and the tools that are needed to enable these complex workflows. The current set of C++-based solutions may not suffice, and relying exclusively upon C++ may not be the best option, especially because several newer languages and boutique solutions offer more robust design features to tackle the challenges of heterogeneity. In June 2023, we held a mini symposium that explored the use of newer languages and heterogeneity solutions that are not tied to C++ and that offer options beyond template metaprogramming and Parallel. For for performance and portability. In conclusion, we describe some of the presentations and discussion from the mini symposium in this article.

97 MATHEMATICS AND COMPUTING↗