Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model reduction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

Interpreting and Accelerating Transformers for Jet Tagging

Attention-based transformers are ubiquitous in machine learning applications from natural language processing to computer vision. In high energy physics, one central application is to classify collimated particle showers in colliders based on the particle of origin, known as jet tagging. In this work, we study the interpretatbility and prospects for acceleration of Particle Transformer (ParT), a state-of-the-art model, leverages particle-level attention to improve jet-tagging performance. We analyzing ParT's attention maps and particle-pair correlations in the eta-phi plane, revealing intriguing features, such as a binary attention pattern that identifies critical substructure in jets. These insights enhance our understanding of the model's internal workings and learning process and hint at ways to improve its efficiency. Along these lines, we also explore low-rank attention, attention alternatives, and dynamic quantization to accelerate transformers for jet tagging. With quantization, we achieve a 50% reduction in model size and a 10% increase in inference speed without compromising accuracy. These combined efforts enhance both the performance and the interpretability of transformers in high-energy physics, opening avenues for more efficient and physics-driven model designs.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Understanding and Estimating Error Propagation in Neural Networks for Scientific Data Analysis

Neural networks are increasingly integrated into scientific discovery, where input data reduction and model quantization play a key role in accelerating inference. However, understanding and mitigating the impact of these techniques on output error is critical for ensuring reliable results, particularly in tasks demanding high numerical precision. This paper introduces a comprehensive framework for optimizing neural network inference in scientific computing by combining data reduction and weight quantization while maintaining error-controlled outcomes. We develop theoretical analyses to bound error propagation under these reductions and propose a framework that balances computational performance with error constraints. Evaluation on real-world learning-based combustion simulations and satellite image classification demonstrates that our derived error bounds accurately predict observed errors while enabling significant computational speedup under our framework. This work highlights the potential for further leveraging advancements in modern lossy compression algorithms and hardware accelerators that support lower-precision formats.

He, Weiming [New Jersey Institute of Technology]↗

PV Performance Modeling and Stakeholder Engagement (Final Technical Report)

This core capability project’s objective is to increase the value of photovoltaic (PV) performance models by improving their functionality, demonstrating, and quantifying their validity, and offering a wide range of stakeholder engagement opportunities. In FY22-24, we developed new and improved modeling algorithms and functions to represent PV performance more accurately in a variety of environments and conditions. The “Model parameter toolkit” was developed and includes functions to translate between different module temperature models, incidence angle modifier models, and single-diode models. A new modeling capability named “PV Atlas” was also developed leveraging Sandia’s High Performance Computing resources. This capability allows us to investigate several questions and provide climate-specific best practices and geographic data files; all these are hosted on an interactive website on Sandia’s GitHub and can be used for training, system optimization, or to provide best practices for uncertainty reduction. For model validation, we published high-quality PV performance, and weather data; these data are well documented, filtered, and processed for quality and include examples on how to run PV simulations. We also developed well documented, standardized methods for validating PV models and ran independent model validation and 2 blind modeling intercomparisons engaging with 49 organizations from 17 countries. We co-led and contributed to a growing, well documented and maintained suite of open-source functions for PV modeling (i.e., the pvlib-python) and we outreached to the PV modeling stakeholders via the PVPMC workshops and web resources. In addition, this project supported US representation and leadership for the International Energy Agency (IEA) PVPS Task 13; specifically, members of our team led and supported 3 subtasks on: 1) Best practices for the optimization of bifacial photovoltaic tracking, 2) Extreme weather events and their multiple impact on PV power plants: Risks, failure mechanisms and mitigation strategies, and 3) Best practice guidelines for the use of economic and technical Key Performance Indicators (KPIs). This project resulted in the publications of 14 peer reviewed journal papers, 37 conference presentations, 6 SAND reports, 5 public datasets and 6 new webpages on the PVPMC website. It supported the release of 13 pvlib-python versions where 28 enhancements were from this PV Performance Modeling project. We co-organized 5 PVPMC workshops in FY22-24 with the participation of 214 unique institutions and around 700 participants. The PVPMC website was redesigned, and its reliability was improved; it receives over 50,000 visitors/year from 202 unique countries.

14 SOLAR ENERGY↗

Impact of a dynamic grid mix and climate on operational carbon emissions modeling for different building typologies and climate zones

Calculating operational carbon emissions through a building’s lifecycle is complex due to the dynamic nature of influencing factors such as climate and energy grid mix. This paper introduces a novel methodology for modeling 30-year operational carbon impacts of buildings and applies this method to mid-rise office and residential typologies across various US climate zones. The method accounts for these temporal variabilities using new and scarcely cited data sources. Key findings indicate that future changes in the climate, while impactful, play a relatively modest role in operational carbon emissions compared to significant reductions with modeling scenarios using the projected decarbonization of the electricity grid. Here, the study also finds that using annual, month-hourly, or hourly grid emission factors have a minimal impact on carbon accounting, except in certain climates and program types where emission patterns do not align with a building’s energy consumption. Warmer climates like Miami, Florida and Tucson, Arizona, which rely heavily on cooling, demonstrate larger variations in carbon emissions when using higher temporal resolution emission factors. Ultimately, this study underscores the critical role of grid decarbonization in reducing long-term emissions and the importance of incorporating this variable in life cycle assessment (LCA) modeling.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Factors That Influence Variability in Stress-Drop Measurements Using Spectral Decomposition and Spectral-Ratio Methods for the 2019 Ridgecrest Earthquake Sequence

Stress drop is a fundamental parameter related to earthquake source physics, but is hard to measure accurately. To better understand how different factors influence stress-drop measurements, we compare two different methods using the Ridgecrest stress-drop validation data set: spectral decomposition (SD) and spectral ratio (SR), each with different processing options. Here, we also examine the influence of spectral complexity on source parameter measurement. Applying the SD method, we find that frequency bandwidth and time-window length could influence spectral magnitude calibration, while depth-dependent attenuation is important to correctly map stress-drop variations. For the SR method, we find that the selected source model has limited influence on the measurements; however, the Boatwright model tends to produce smaller standard deviation and larger magnitude dependence than the Brune model. Variance reduction threshold, frequency bandwidth, and time-window length, if chosen within an appropriate parameter range, have limited influence on source parameter measurement. For both methods, wave type, attenuation correction, and spectral complexity strongly influence the result. The scale factor that quantifies the magnitude dependence of stress drop show large variations with different processing options, and earthquakes with complex source spectra deviating from the Brune-type source models tend to have larger scale factor than earthquakes without complexity. Based on these detailed comparisons, we make a few specific suggestions for data processing workflows that could help future studies of source parameters and interpretations.

58 GEOSCIENCES↗

Modeling to Improve the Risk Reduction Process for Command File Errors

The Jet Propulsion Laboratory has learned that even innocuous errors in the spacecraft command process can have significantly detrimental effects on a space mission. Consequently, such Command File Errors (CFE), regardless of their effect on the spacecraft, are treated as significant events for which a root cause is identified and corrected. A CFE during space mission operations is often the symptom of imbalance or inadequacy within the system that encompasses the hardware and software used for command generation as well as the human experts and processes involved in this endeavor. As we move into an era of increased collaboration with other NASA centers and commercial partners, these systems become more and more complex. Consequently, the ability to thoroughly model and analyze CFEs formally in order to reduce the risk they pose is increasingly important. In this paper, we summarize the results of applying modeling techniques previously developed to the DAWN flight project. The original models were built with the input of subject matter experts from several flight projects. We have now customized these models to address specific questions for the DAWN flight project and formulating use cases to address their unique mission needs. The goal of this effort is to enhance the project's ability to meet commanding reliability requirements for operations and to assist them in managing their Command File Errors.

spacecraft↗

Chemical Reaction and Flow Modeling in Fullerene and Nanotube Production

The development of processes to produce fullerenes and carbon nanotubes has largely been empirical. Fullerenes were first discovered in the soot produced by laser ablation of graphite [1]and then in the soot of electric arc evaporated carbon. Techniques and conditions for producing larger and larger quantities of fullerenes depended mainly on trial and error empirical variations of these processes, with attempts to scale them up by using larger electrodes and targets and higher power. Various concepts of how fullerenes and carbon nanotubes were formed were put forth, but very little was done based on chemical kinetics of the reactions. This was mainly due to the complex mixture of species and complex nature of conditions in the reactors. Temperatures in the reactors varied from several thousand degrees Kelvin down to near room temperature. There are hundreds of species possible, ranging from atomic carbon to large clusters of carbonaceous soot, and metallic catalyst atoms to metal clusters, to complexes of metals and carbon. Most of the chemical kinetics of the reactions and the thermodynamic properties of clusters and complexes have only been approximated. In addition, flow conditions in the reactors are transient or unsteady, and three dimensional, with steep spatial gradients of temperature and species concentrations. All these factors make computational simulations of reactors very complex and challenging. This article addresses the development of the chemical reaction involved in fullerene production and extends this to production of carbon nanotubes by the laser ablation/oven process and by the electric arc evaporation process. In addition, the high-pressure carbon monoxide (HiPco) process is discussed. The article is in several parts. The first one addresses the thermochemical aspects of modeling; and considers the development of chemical rate equations, estimates of reaction rates, and thermodynamic properties where they are available. The second part addresses modeling of the arc process for fullerene and carbon nanotube production using O-D, 1-D and 2-D fluid flow models. The third part addresses simulations of the pulsed laser ablation process using time-dependent techniques in 2-D, and a steady state 2-D simulation of a continuous laser ablation process. The fourth part addresses steady state modeling in O-D and 2-D of the HiPco process. In each of the simulations, there is a variety of simplifications that are made that enable one to concentrate on one aspect or another of the process. There are simplifications that can be made to the chemical reaction models , e.g. reduction in number of species by lumping some of them together in a representative species. Other simulations are carried out by eliminating the chemistry altogether in order to concentrate on the fluid dynamics. When solving problems with a large number of species in more than one spatial dimension, it is almost imperative that the problem be decoupled by solving for the fluid dynamics to find the fluid motion and temperature history of "particles" of fluid moving through a reactor. Then one can solve the chemical rate equations with complex chemistry following the temperature and pressure history. One difficulty is that often mixing with an ambient gas is involved. Therefore, one needs to take dilution and mixing into account. This changes the ratio of carbon species to background gas. Commercially available codes may have no provision for including dilution as part of the input. One must the write special solvers for including dilution in decoupled problems. The article addresses both ful1erene production and single-walled carbon nanotube (SWNT) production. There are at least two schemes or concepts of SWNT growth. This article will only address growth in the gas phase by carbon and catalyst cluster growth and SW T formation by the addition of carbon. There are other models that conceive of SWNT growth as a phase separation process from clusters me up carbon and metal catalyst, with the carbon precipitating from the cluster as it cools. We will not deal with that concept in this article. Further research is needed to determine the rates at which these composite clusters form, evaporate, and segregate.

Scott, Carl D.↗

Air oxidation of hydrazine. 1. Reaction kinetics on natural kaolinites, halloysites, and model substituent layers with varying iron and titanium oxide and O- center contents

Air oxidation of hydrazine was studied by using a group of kaolinites, halloysites, and substituent oxides as models for the tetrahedral and octahedral sheets. The rate was found to be linear with oxygen. The stoichiometry showed that oxygen was the primary oxidant and that dinitrogen was the only important nitrogen-containing product. The rates on kaolinites were strongly inhibited by water. Those on three-dimensional silica and gibbsite appeared not to be. That on a supposedly layered silica formed from a natural kaolinite by acid leaching showed transitional behavior--slowed relative to that expected from a second-order reaction relative to that on the gibbsite and silica but faster than those on the kaolinites. The most striking result of the reaction was the marked increase in the rate of reaction of a constant amount of hydrazine as the amount of clay was increased. The increase was apparent (in spite of the water inhibition at high conversions) over a 2 order of magnitude variation of the clay weight. The weight dependence was taken to indicate that the role of the clay is very important, that the number of reactive centers is very small, or that they may be deactivated over the course of the reaction. In contrast to the strong dependence on overall amount of clay, the variation of amounts of putative oxidizing centers, such as structural Fe(III), admixed TiO2 or Fe2O3, or O- centers, did not result in alteration of the rate commensurate with the degree of variation of the entity in question. Surface iron does play some role, however, as samples that were pretreated with a reducing agent were less active as catalysts than the parent material. These results were taken to indicate either that the various centers interact to such a degree that they cannot be considered independently or that the reaction might proceed by way of surface complexation, rather than single electron transfers.

NASA Discipline Number 52-20↗

Forest residue harvest optimization: spanning the bridge between plant biology and biorefinery performance

Forestry residues have immense potential as alternative feedstocks to petroleum, yet their inherent complexity remains a major challenge to widespread use. Pairing the temporal rhythms of plant biology with biorefinery performance is critical to industrial-scale biorefinery development. Here, we provide the first report of a techno-economic analysis (TEA) and life cycle assessment (LCA) for a model integrated reductive catalytic fractionation (RCF)–molten salt hydrolysis process for forestry residues varying in tree part, species, and phenophase. All forestry residues resulted in net-negative greenhouse gas (GHG) emissions vs. comparable petroleum feedstocks, with GHG emissions potentially reduced >4.0× through composition-based feedstock selection (e.g., harvesting American beech bark in spring vs. summer). Moreover, American beech twigs/branchlets and bark in leafed and emergence phenophases, respectively, had 7.9× lower predicted phenolic minimum selling prices (MSPs) vs. other feedstocks and MSPs within the current global phenolic market range. Hemicellulose content and RCF yield emerged as key parameters impacting GHG emissions and biorefinery revenue, identifying hardwood twigs/branchlets in the leafed phenophase as optimal biofeedstocks. Biorefinery expenses were dominated by purchased equipment, raw materials, and utility costs, highlighting essential areas for future study. Notably, RCF reactor pressures drove 85–90% of equipment costs, but sensitivity analysis revealed that decreasing the pressure 20% could reduce the phenol MSP 4-fold. Structural carbohydrate dynamics were also investigated using a two-step acid hydrolysis method to resolve tissue- and species-level patterns in biomass composition throughout the year to enable harvest optimization based on TEA/LCA findings. Ultimately, elucidating the impact of biofeedstock dynamics on biorefinery performance enables harvest optimization, informed engineering design, and progress towards an expanded bioeconomy.

Shapiro, Alison J. [University of Delaware, Newark↗

Event Detection and Classification Using Machine Learning Applied to PMU Data for the Western US Power System

Smart grid technology enhances our comprehension and reliability of the power grid, leveraging Phasor Measurement Unit (PMU) data—time-synchronized, high-frequency measurements gathered across the US power grid. This paper employs machine learning techniques to effectively analyze the vast PMU data in Wide Area Monitoring Systems (WAMS) for power grid event detection and classification. Analyzing several months of real-world PMU data, the paper focuses on machine learning for fast, precise event detection and classification, corroborated by utility event logs. Practical challenges like feature extraction, dimensionality reduction, and model selection are addressed. A novel feature yielding improved results is discovered, and a supplementary algorithm for detecting small power grid faults is developed. The final algorithm is validated using a month-long real PMU data set, demonstrating its capability in accurately identifying power grid events in near real-time.

machine learning, event detection, PMU↗

Efficiency of ML Anomaly Detection Triggers for Emerging Jets

Novel machine learning-based anomaly detection Level 1 (L1) triggers are currently under development at CMS, namely AXOL1TL and CICADA. The former employs a variational autoencoder, while the latter utilizes a convolutional autoencoder. These triggers aim to balance rate reduction with model independence, enabling the selection of potentially significant events that might be overlooked by traditional triggers relying on basic kinematic variable selections. Consequently, they have the potential to enhance signals indicative of physics beyond the Standard Model, such as those associated with emerging jets. Such signals are predicted by models featuring a composite dark sector where long-lived particles decay into Standard Model jets with displaced tracks and numerous vertices. This study evaluates the efficiency of these anomaly detection triggers in selecting events with emerging jets produced via the s-channel production of two dark quarks.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

EFIT‐AI: Machine Learning and Artificial Intelligence Assisted Equilibrium Reconstruction for Tokamak Experiments and Burning Plasmas (Final Report)

The EFIT-AI project is creating a modern advanced equilibrium reconstruction code suitable for tokamak experiments of burning plasmas. EFIT [1,2] was the first and is the most extensively used equilibrium reconstruction code in the world. This project builds on the production-level experience and adds key elements as follows. 1. A Model Order Reduction (MOR) version of the two-dimensional (2D) Grad-Shafranov equation solver (EFIT-MORNN) using physics-informed neural networks. 2. Improved optimization and data analysis capabilities using a Bayesian framework enhanced with machine learning. 3. A MOR version of the three-dimensional (3D) perturbed equilibrium reconstruction tool.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

CMIP7 data request: land and land ice priorities and opportunities

The Land and Land Ice Theme in the Coupled Model Intercomparison Project Phase 7 (CMIP7) represents the current understanding of physical processes in land surface ecosystems, hydrology, cryosphere, and their physical interactions with other Earth system components. Simulations from Earth system models (ESMs) could provide crucial information for assessing planetary safety, such as critical tipping elements, and be used to inform climate risks for improving climate impact assessments and policy decisions. This paper presents a collaborative effort to identify scientific opportunities in the Land and Land Ice Theme of the CMIP7 Data Request. The proposed opportunities build upon advances in ESMs, including new freshwater system and land ice processes being included in CMIP7, as well as the scientific community's demand for high-frequency and sub-grid-scale land surface outputs. In total, 25 variable groups that contain 716 variables have been identified to be potentially available to the broad scientific audience for performing analysis in land–atmosphere coupling, hydrological processes and freshwater systems, glacier and ice sheet mass balance and their influence on the sea levels, land use, and plant phenology. Key reflections from this data request effort include advocacy for closer engagement between the user community and modeling groups, reduction in the technical barriers to tracking existing parameters and defining new variables, and more streamlined variable management. These will be essential to enhance the usability and reliability of CMIP7 outputs for climate and Earth system research and applications to a broad audience that relies on the CMIP7 endeavor.

Li, Yue [Univ. of California, Los Angeles, CA (Uni↗

Simulation of flight test conditions in the Langley pilot transonic cryogenic tunnel

The theory and advantages of the cryogenic tunnel concept are briefly reviewed. The unique ability to vary temperature independently of pressure and Mach number allows, in addition to large reductions in model loads and tunnel power, the independent determination of Reynolds number, Mach number, and aeroelastic effects on the aerodynamic characteristics of the model. Various combinations of Reynolds number and dynamic pressure are established to represent accurately flight variations of aeroelastic deformation with altitude changes. The consequences of the thermal and caloric imperfections of the test gas under cryogenic conditions were examined and found to be insignificant for operating pressures up to 5 atm. The characteristics of the Langley pilot transonic cryogenic tunnel are described and the results of initial tunnel operation are presented. Tests of a two-dimensional airfoil at a Mach number of 0.85 show identical pressure distributions for a chord Reynolds number of 8,600,000 obtained first at a stagnation pressure of 4.91 atm at a stagnation temperature of 322.0 K and then at a stagnation pressure of 1.19 atm at a stagnation temperature of 116.5 K.

Kilgore, R. A.↗

Applications systems verification and transfer project. Volume 6: Operational applications of satellite snow-cover observations NOAA/NESS support study

Geostationary and polar orbiting satellite data from the National Oceanic and Atmospheric Administration were used to operationally provide field hydrologists with basin snowcover percentages for inclusion in runoff models. Data reduction is accomplished thru the use of optical rectification devices and electronic color density slicers. Over two thousand satellite-derived snow maps covering 30 different basins in the western United States were provided to users. Plans for improving snowmapping techniques on computer interactive systems and by all-digital analysis are presented. A description of the newest generation of NOAA polar orbiters, TIROS-N, and its potential for snowmapping is reviewed. Snowcover percentages for all basins determined between November 1974 and July 1978 are presented in tabular format.

Schneider, S. R.↗

Algorithms for real-time flutter identification

The work reported here addresses the important algorithm issues necessary to achieve a real-time flutter monitoring system; namely, the guidelines for choosing appropriate model forms, reduction of the parameter convergence transient, handling multiple modes, the effect of overparameterization, and estimate accuracy predictions, both online and for experiment design. An approach for efficiently computing continuous-time flutter parameter Cramer-Rao estimate error bounds has been developed. This enables a convincing comparison of theoretical and simulation results, as well as off-line studies in preparation for a flight test. Theoretical predictions, simulation and flight test results from the NASA/Dryden Drones for Aerodynamic and Structural Test (DAST) Program are compared.

Walker, R. A.↗

Real-time flutter analysis

The important algorithm issues necessary to achieve a real time flutter monitoring system; namely, the guidelines for choosing appropriate model forms, reduction of the parameter convergence transient, handling multiple modes, the effect of over parameterization, and estimate accuracy predictions, both online and for experiment design are addressed. An approach for efficiently computing continuous-time flutter parameter Cramer-Rao estimate error bounds were developed. This enables a convincing comparison of theoretical and simulation results, as well as offline studies in preparation for a flight test. Theoretical predictions, simulation and flight test results from the NASA Drones for Aerodynamic and Structural Test (DAST) Program are compared.

Walker, R.↗