Search NASA⌕ Search

SEARCH · Search NASA

Results for “Distributed training”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26

Genomic prediction of regional-scale performance in switchgrass ( Panicum virgatum ) by accounting for genotype-by-environment variation and yield surrogate traits

Switchgrass is a potential crop for bioenergy or carbon capture schemes, but further yield improvements through selective breeding are needed to encourage commercialization. To identify promising switchgrass germplasm for future breeding efforts, we conducted multisite and multitrait genomic prediction with a diversity panel of 630 genotypes from 4 switchgrass subpopulations (Gulf, Midwest, Coastal, and Texas), which were measured for spaced plant biomass yield across 10 sites. Our study focused on the use of genomic prediction to share information among traits and environments. Specifically, we evaluated the predictive ability of cross-validation (CV) schemes using only genetic data and the training set (cross-validation 1: CV1), a subset of the sites (cross-validation 2: CV2), and/or with 2 yield surrogates (flowering time and fall plant height). We found that genotype-by-environment interactions were largely due to the north–south distribution of sites. The genetic correlations between the yield surrogates and the biomass yield were generally positive (mean height r = 0.85; mean flowering time r = 0.45) and did not vary due to subpopulation or growing region (North, Middle, or South). Genomic prediction models had CV predictive abilities of –0.02 for individuals using only genetic data (CV1), but 0.55, 0.69, 0.76, 0.81, and 0.84 for individuals with biomass performance data from 1, 2, 3, 4, and 5 sites included in the training data (CV2), respectively. To simulate a resource-limited breeding program, we determined the predictive ability of models provided with the following: 1 site observation of flowering time (0.39); 1 site observation of flowering time and fall height (0.51); 1 site observation of fall height (0.52); 1 site observation of biomass (0.55); and 5 site observations of biomass yield (0.84). The ability to share information at a regional scale is very encouraging, but further research is required to accurately translate spaced plant biomass to commercial-scale sward biomass performance.

09 BIOMASS FUELS↗

Representing Complex Systems as Graphs for Debugging and Predictive Maintenance-Preliminary Thoughts

Representing complex systems as graphs enables use of mathematical tools to identify faults or predict failures. Graph nodes correspond to individual modules or subsystems, and edges link coupled system parts. ‘Probes’ measure the node outputs, monitoring the system health for unexpected behavior. Assuming one cannot probe every point, within a system, the fault correlates to a region—not necessarily the specific location. Bayesian networks trained to understand fault patterns can accurately identify the source. The diagnostic tool described aides debugging by pinpointing system failure causes. For predictive maintenance, probe data develop probability distribution functions describing subsystem mean time to failure. Unit lifetime can be estimated through these probability distributions. Two approaches include using Bayesian classifiers to infer the system failure source and developing maintenance schedules by treating systems as collections of random variables. When failure behavior does not follow a closed form function, use of similarity models is proposed.

97 MATHEMATICS AND COMPUTING↗

Reliability model for planetary gear

A reliability model is presented for planetary gear trains in which the ring gear is fixed, the Sun gear is the input, and the planet arm is the output. The input and output shafts are coaxial and the input and output torques are assumed to be coaxial with these shafts. Thrust and side loading are neglected. This type of gear train is commonly used in main rotor transmissions for helicopters and in other applications which require high reductions in speed. The reliability model is based on the Weibull distribution of the individual reliabilities of the transmission components. The transmission's basic dynamic capacity is defined as the input torque which may be applied for one million input rotations of the Sun gear. Load and life are related by a power law. The load life exponent and basic dynamic capacity are developed as functions of the component capacities.

Savage, M.↗

Resource-Adaptive Federated Text Generation with Differential Privacy

In cross-silo federated learning (FL), sensitive text datasets remain confined to local organizations due to privacy regulations, making repeated training for each downstream task both communication-intensive and privacy-demanding. A promising alternative is to generate differentially private (DP) synthetic datasets that approximate the global distribution and can be reused across tasks. However, pretrained large language models (LLMs) often fail under domain shift, and federated finetuning is hindered by computational heterogeneity: only resource-rich clients can update the model, while weaker clients are excluded, amplifying data skew and the adverse effects of DP noise. We propose a flexible participation framework that adapts to client capacities. Strong clients perform DP federated finetuning, while weak clients contribute through a lightweight DP voting mechanism that refines synthetic text. To ensure the synthetic data mirrors the global dataset, we apply control codes (e.g., labels, topics, metadata) that represent each client’s data proportions and constrain voting to semantically coherent subsets. This two-phase approach requires only a single round of communication for weak clients and integrates contributions from all participants. Experiments show that our framework improves distribution alignment and downstream robustness under DP and heterogeneity.

Wang, Jiayi [ORNL]↗

Overview of the LaNCETS Flight Experiment and CFD Analysis. Supplemental Movies

This presentation focuses on nearfield airborne pressure signatures from the Lift and Nozzle Change Effect on Tail Shocks (LaNCETS) flight test experiment. The primary motivation for nearfield probing in the supersonic regime is to measure the shock structure of aircraft in an ongoing effort to overcome the overland sonic boom barrier for commercial supersonic transportation. LaNCETS provides the opportunity to investigate lift distribution and engine plume effects. During Phase 1 flight testing an F-15B was used to probe the F-15 LaNCETS aircraft in order to validate CFD and pre-flight prediction tools. A total of 29 probings were taken at 40,000 ft. altitude at Machs 1.2, 1.4 and 1.6. LaNCETS Phase 1 flight data are presented as a detailed pressure signature superimposed over a picture of the LaNCETS aircraft. The attenuation of the Inlet-Canard shocks with distance as well as its forward propagation and the coalescence of the noseboom shock are illustrated. A detailed CFD study on a simplified LaNCETS aircraft jet nozzle was performed providing the ability to more accurately capture the shocks from the propulsion system and emphasizing how under- and over-expanding the nozzle affects the existence of shock trains inside the jet plume. With Phase 1 being a success preparations are being made to move forward to Phase 2. Phase 2 will fly similar flight conditions, but this time changing the aircraft's lift distribution by biasing the canard positions, and changing the plume shape by under- and over-expanding the nozzle. Nearfield probing will again be completed in the same manner as in Phase 1. An additional presentation focuses on LaNCETS CFD solution methodology. Discussions highlight grid preprocessing, grid shearing and stretching, flow solving and contour plots. Efforts are underway to better capture the flow features via grid modification and flow solution methodology, which will help to achieve better agreement with flight data. An included CD-ROM provides animations of the nearfield probing procedure and of real data from one of the probings integrated with GPS positional and velocity data. An additional in-flight video from the rear seat of the probing aircraft is also provided.

Cliatt, Larry J., II↗

Boosted decision tree reweighting of simulated neutrino interactions for O ( 1 ) GeV neutrino cross-section measurements

This paper illustrates a generic method for multidimensional reweighting of O ( 1 ) GeV neutrino interaction Monte Carlo samples. The reweighting is based on a boosted decision tree algorithm trained on high-dimensional space in detector final-state observables. This enables one generator’s events to be reweighted so that its reconstructed particle content and kinematics distributions, as well as detector efficiency, match those of a target model. The approach establishes an efficient way to reuse legacy Monte Carlo data, avoiding regeneration. As an example, we test its use in a measurement of transverse kinematic imbalance of the μ - and proton in charged-current quasielastic like ν μ events from the MINERvA experiment.

Lin, Z. [Rochester U.] (ORCID:0009000188903698)↗

PV-Finder: ML Based Algorithm for Primary Vertex Identification

he CMS detector at the High-Luminosity Large Hadron Collider (HL-LHC) will operate in challenging conditions with expected pile-up of up to 200 collisions per bunch crossing, necessitating the development of a more resilient primary vertex (PV) reconstruction method to ensure the integrity of data analysis and the efficiency of the CMS triggering system. This contribution describes preliminary studies on a new ML based PV-Finder method for PV identification. The method is based on a model trained using Kernel Density Estimations (KDEs) derived from the positions of reconstructed tracks at the beamline, incorporating uncertainties from track parameters. It also utilizes target histograms, modeled as Gaussian distributions centered on the actual ground truth values of specific primary vertices.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Effect of current on spectrum of breaking waves in water of finite depth

This paper presents an approximate method to compute the mean value, the mean square value and the spectrum of waves in water of finite depth taking into account the effect of wave breaking with or without the presence of current. It is assumed that there exists a linear and Gaussian ideal wave train whose spectrum is first obtained using the wave energy flux balance equation without considering wave breaking. The Miche wave breaking criterion for waves in finite water depth is used to limit the wave elevation and establish an expression for the breaking wave elevation in terms of the elevation and its second time derivative of the ideal waves. Simple expressions for the mean value, the mean square value and the spectrum are obtained. These results are applied to the case in which a deep water unidirectional wave train, propagating normally towards a straight shoreline over gently varying sea bottom of parallel and straight contours, encounters an adverse steady current whose velocity is assumed to be uniformly distributed with depth. Numerical results are obtained and presented in graphical form.

Tung, C. C.↗

Spatial and Temporal Analysis of Global Landslide Reporting Using a Decade of the Global Landslide Catalog

Rainfall-triggered landslides can result in devastating loss of life and property damage and are a growing concern from local to global scale. NASA’s Global Landslide Catalog (GLC) compiles a record of rainfall-triggered landslide events from media reports, academic articles, and existing databases at global scale. The database consists of all types of mass movement events that are triggered by rainfall and represents a minimum number of events occurring between 2007 – 2018. The research presented here evaluates global patterns in landslide reporting from events in the GLC. The evaluation includes an analysis of the spatial and temporal distribution of global landslide events and associated casualties and comparisons with other landslide inventories. This database has been used to estimate landslide hotspots, evaluate geographic patterns in landslides, and train and validate landslide models from local to global scales. The most notable landslide hotspots are in the Pacific Northwest of North America, High Mountain Asia, and the Philippines. Additionally, the relationship between country GDP and income status with landslide occurrence was determined to have a positive correlation between economic status and landslide reporting. The GLC also indicates a reporting bias towards English-speaking countries. The general goal of this research is to assess the decade of global landslide reports from the GLC and show how this database can be used for rainfall-triggered landslide research.

Global Landslide Catalog↗

Development of a Portable, Ground-based Ozone Lidar Instrument for Tropospheric Ozone Research and Educational Training

The objective of this research project is to develop a portable, eye-safe, ground-based ozone lidar instrument specialized for ozone differential absorption lidar (DIAL) measurements in the troposphere. This research project directly supports the goal of NASA's Earth Science Enterprise to understand the distribution and budget of tropospheric ozone (objective 1.5 of the Earth Science Strategic Enterprise Plan, 1998-2002). It can participate in ground validation experiments for TES, a tropospheric ozone satellite mission due to be launched in 2002. It can also be utilized for correlative ground measurements in future GTE (Global Tropospheric Experiment) and space-based ozone lidar missions, such as ORACLE. Multiple ground-based ozone lidar systems would improve the data obtained through current ozone-sonde networks. This prototype instrument could to serve as the basic unit for these and other future monitoring projects requiring multi-instrument networks, such as that proposed for the Global Tropospheric Ozone Project (GTOP). GTOP is currently being formulated by a scientific panel of the International Global Atmospheric Chemistry Project to meet its goal to better understand the processes that control the global distribution of tropospheric ozone. In order for the lidar to be widely deployed in networks, it must be fairly easy to use and maintain as well as being cost-competitive with a ground station launching ozonesondes several times a day. A second 2-year grant to continue this effort with students participating in ground tests and system improvements has been awarded by the Office of Equal Employment Opportunities (OEOP). This project also supports existing NASA lidar missions through its development of advanced, compact lidar technology. Innovations in both transmitters and receivers have been made in this project. Finally, this system could be modified in the future to probe more deeply into the stratosphere. This could be accomplished by increasing the emitted energy or optimizing the wavelengths for this purpose. In addition to NASA, this system has applications to the EPA, NOAA, and the DOD. An AFOSR grant has been awarded based on the results of this effort to fund advanced transmitter development at medium (20-40 mJ) energies. A second proposal to the DOD with a letter of support from Air Force Research Laboratory, has been submitted to extend this uv laser technology to 100 mJ levels. Thus, this project has enabled students and faculty at Hampton University to begin to develop research efforts in support of the mission of the DOD. This instrument will be based at Hampton University (HU) to meet our educational goal to train students in lidar technology as well as atmospheric ozone data analysis and interpretation. It will be also available for off-site measurement campaigns and will serve as a test bed for further instrument development. Later development beyond this grant to extend the scientific usefulness of the instrument may include incorporation of an aerosol channel and upgrading the laser to make stratospheric ozone measurements. Seven undergraduates, three graduate students, and one postdoctoral. researcher (formerly an HU student) have been active participants in this research effort.

Chyba, Thomas↗

Neural Network‐Based Methods for Ocean Surface Wave Measurement Using Submarine Distributed Acoustic Sensing (DAS)

Two new data-driven models for estimating ocean surface waves from distributed acoustic sensing (DAS) submarine cable strain rate are developed using supervised machine learning on a 10-day data set collected offshore of Oliktok Point, Alaska. The new models were trained on target data from seafloor pressure moorings at three sites spaced evenly along 27.1 km of cable and were benchmarked against an empirical transfer function method previously used to estimate waves from DAS. A model which uses convolutional neural networks to transform 2-km frequency-wavenumber strain spectra to seafloor pressure spectra outperforms the benchmark in wave height prediction (RMSE of 0.15 vs. 0.41 m) and period prediction (0.29 vs. 0.37 s) when evaluated on a held-out test data set. When applied to a DAS data set collected on the same cable 2 years prior, the CNN-based model maintained similar significant wave height performance (RMSE = 0.23 m) relative to available satellite altimetry data. A two-hidden-layer, fully connected neural network which transforms 1-D strain spectra to seafloor pressure spectra also outperforms the benchmark in wave height prediction (RMSE of 0.19 vs. 0.41 m), but does not generalize as well to the prior data. Regression-based machine learning is useful for estimating waves from DAS data when the pressure-strain relationship varies temporally and spatially across different wave conditions. Models can be applied to DAS data to measure waves with higher spatial resolution and longer temporal coverage than traditional methods, which often measure waves only at a single point.

Davis, Jacob R. [Univ. of Washington, Seattle, WA ↗

All-optical phase conjugation using diffractive wavefront processing

Abstract Optical phase conjugation (OPC) is a nonlinear technique used for counteracting wavefront distortions, with applications ranging from imaging to beam focusing. Here, we present a diffractive wavefront processor to approximate all-optical phase conjugation. Leveraging deep learning, a set of diffractive layers was optimized to all-optically process an arbitrary phase-aberrated input field, producing an output field with a phase distribution that is the conjugate of the input wave. We experimentally validated this wavefront processor by 3D-fabricating diffractive layers and performing OPC on phase distortions never seen during training. Employing terahertz radiation, our diffractive processor successfully performed OPC through a shallow volume that axially spans tens of wavelengths. We also created a diffractive phase-conjugate mirror by combining deep learning-optimized diffractive layers with a standard mirror. Given its compact, passive and multi-wavelength nature, this diffractive wavefront processor can be used for various applications, e.g., turbidity suppression and aberration correction across different spectral bands.

42 ENGINEERING↗

ARM-IRL: Adaptive Resilience Metric Quantification Using Inverse Reinforcement Learning

The resilience of safety-critical systems is gaining importance due to the rise in cyber and physical threats, especially within critical infrastructure. Traditional static resilience metrics may not capture dynamic system states, leading to inaccurate assessments and ineffective responses to cyber threats. This work aims to develop a data-driven, adaptive method for resilience metric learning. We propose a data-driven approach using inverse reinforcement learning (IRL) to learn a single, adaptive resilience metric. The method infers a reward function from expert control actions. Unlike previous approaches using static weights or fuzzy logic, this work applies adversarial inverse reinforcement learning (AIRL), training a generator and discriminator in parallel to learn the reward structure and derive an optimal policy. The proposed approach is evaluated on multiple scenarios: optimal communication network rerouting, power distribution network reconfiguration, and cyber–physical restoration of critical loads using the IEEE 123-bus system. The adaptive, learned resilience metric enables faster critical load restoration in comparison to conventional RL approaches.

97 MATHEMATICS AND COMPUTING↗

Winter QPF Sensitivities to Snow Parameterizations and Comparisons to NASA CloudSat Observations

Steady increases in computing power have allowed for numerical weather prediction models to be initialized and run at high spatial resolution, permitting a transition from larger scale parameterizations of the effects of clouds and precipitation to the simulation of specific microphysical processes and hydrometeor size distributions. Although still relatively coarse in comparison to true cloud resolving models, these high resolution forecasts (on the order of 4 km or less) have demonstrated value in the prediction of severe storm mode and evolution and are being explored for use in winter weather events . Several single-moment bulk water microphysics schemes are available within the latest release of the Weather Research and Forecast (WRF) model suite, including the NASA Goddard Cumulus Ensemble, which incorporate some assumptions in the size distribution of a small number of hydrometeor classes in order to predict their evolution, advection and precipitation within the forecast domain. Although many of these schemes produce similar forecasts of events on the synoptic scale, there are often significant details regarding precipitation and cloud cover, as well as the distribution of water mass among the constituent hydrometeor classes. Unfortunately, validating data for cloud resolving model simulations are sparse. Field campaigns require in-cloud measurements of hydrometeors from aircraft in coordination with extensive and coincident ground based measurements. Radar remote sensing is utilized to detect the spatial coverage and structure of precipitation. Here, two radar systems characterize the structure of winter precipitation for comparison to equivalent features within a forecast model: a 3 GHz, Weather Surveillance Radar-1988 Doppler (WSR-88D) based in Omaha, Nebraska, and the 94 GHz NASA CloudSat Cloud Profiling Radar, a spaceborne instrument and member of the afternoon or "A-Train" of polar orbiting satellites tasked with cataloguing global cloud characteristics. Each system provides a unique perspective. The WSR-88D operates in a surveillance mode, sampling cloud volumes of Rayleigh scatterers where reflectivity is proportional to the sixth moment of the size distribution of equivalent spheres. The CloudSat radar provides enhanced sensitivity to smaller cloud ice crystals aloft, as well as consistent vertical profiles along each orbit. However, CloudSat reflectivity signatures are complicated somewhat by resonant Mie scattering effects and significant attenuation in the presence of cloud or rain water. Here, both radar systems are applied to a case of light to moderate snowfall within the warm frontal zone of a cold season, synoptic scale storm. Radars allow for an evaluation of the accuracy of a single-moment scheme in replicating precipitation structures, based on the bulk statistical properties of precipitation as suggested by reflectivity signatures.

Molthan, Andrew↗

Ion Distribution and Cation Exchange at Mica–Electrolyte Interfaces Probed with Deep Potential Molecular Dynamics

Here, we investigate the Stern layer structure and cation exchange mechanism at muscovite mica-electrolyte interfaces using nanosecond timescale molecular dynamics simulations based on deep neural network interatomic potentials trained on Density Functional Theory (DFT) data. Focusing on mica with exposed surface K + interfaced with aqueous NaCl and mica with surface Na + interfaced with KCl solution, we find that K + remains predominantly in inner-sphere configurations, while Na + exhibits notable populations in outer-sphere states. Most importantly, our simulations show that contact with an electrolyte solution results in the co-adsorption of multiple cation species, making the mica surface locally overcharged and thus reshaping the cation speciation in a manner that enhances the tendency of neighboring surface cations to desorb. These findings are consistent with recent experimental observations that co-adsorption of different cation species induces changes in cation speciation and slow kinetics of cation exchange at the muscovite-water interface, providing a basis for their detailed understanding.

36 MATERIALS SCIENCE↗

HARMONY: Large-Scale Architecture Search for Efficient Hybrid Language Models

As large language models scale to trillions of parameters, their computational and memory requirements present critical challenges for efficient training and deployment. While Mixture of Experts (MoE) architectures enable efficient scaling through sparse parameter activation, and state-space models like Mamba offer linear-time complexity, principled methods for combining these paradigms remain undeveloped. We introduce HARMONY (Hybrid Architecture Research for Mamba, Optimized with Neural efficiencY), a multi-objective evolutionary neural architecture search framework for discovering efficient hybrid language models that integrate Transformer attention mechanisms, Mixture-of-Experts routing, and Mamba state-space components. Through large-scale distributed search using 16,384 MI250X GPUs on the Frontier supercomputer, HARMONY explores a comprehensive design space encompassing six attention variants (MHA, MQA, GQA, MLA, SWA, and Mamba-2), variable MoE configurations with both routed and shared experts, and extensive Mamba hyperparameters. Our framework discovers heterogeneous architectures that balance training performance with computational efficiency through multi-objective optimization incorporating latency penalties and fitness-based selection. Analysis of discovered architectures reveals that optimal hybrid designs favor heterogeneous component mixing rather than homogeneous patterns, with Mamba-2 and Multi-Head Latent Attention (MLA) emerging as preferred mechanisms. Discovered architectures demonstrate superior training efficiency: our best configuration achieves a final perplexity of 1.0874 with 2.38B parameters while processing 4,320 tokens/second, outperforming significantly larger manually designed models. Full-scale evaluation shows HARMONY's top architectures achieve better loss trajectories than equivalently-sized models using state-of-the-art configurations including Mixtral, Jamba, and Samba. Additionally, we demonstrate 91% weak scaling efficiency when training discovered 36B-parameter models across 1,024 GPUs. HARMONY is released as an open framework with comprehensive tools for building and training hybrid models using expert-data-pipeline parallelism, democratizing access to automated architecture design for next-generation language models.

Herron, Emily [ORNL] (ORCID:0000000273008172)↗

Surrogate Model for Distribution Networks Influenced by Weather

Here, we propose a method for generating reduced representations of time series and for constructing low dimensional surrogate models for time dependent calculations of power and voltage in distribution networks. We employ Fourier polynomials. The surrogate model strategy is aimed at reducing the computational cost of time dependent simulations, albeit, at the expense of fidelity. The reduced representation is achieved by identifying a small and most consequential subset of degrees of freedom. In power and voltage distribution networks dynamics that are heavily influenced by strong cyclic weather events, e.g., the hourly, diurnal and seasonal cycles, the weather/climate time series spectrum exposes these most energetic components. Once the degrees of freedom are identified their amplitudes are optimized using training data. The key challenge in using spectral methods in power network surrogates is addressing the computation of quotients. For this we propose a numerically-stable deconvolution strategy.

Weather events↗

Fourier-MIONet: Fourier-enhanced multiple-input neural operators for multiphase modeling of geological carbon sequestration

Geologic carbon sequestration (GCS) is a safety-critical technology that aims to reduce the amount of carbon dioxide in the atmosphere, which also places high demands on reliability. Multiphase flow in porous media is essential to understand CO 2 migration and pressure fields in the subsurface associated with GCS. However, numerical simulation for such problems in 4D is computationally challenging and expensive, due to the multiphysics and multiscale nature of the highly nonlinear governing partial differential equations (PDEs). It prevents us from considering multiple subsurface scenarios and conducting real-time optimization. Here, we develop a Fourier-enhanced multiple-input neural operator (Fourier-MIONet) to learn the solution operator of the problem of multiphase flow in porous media. Fourier-MIONet utilizes the recently developed framework of the multiple-input deep neural operators (MIONet) and incorporates the Fourier neural operator (FNO) in the network architecture. Once Fourier-MIONet is trained, it can predict the evolution of saturation and pressure of the multiphase flow under various reservoir conditions, such as permeability and porosity heterogeneity, anisotropy, injection configurations, and multiphase flow properties. Compared to the enhanced FNO (U-FNO), the proposed Fourier-MIONet has 90% fewer unknown parameters, and it can be trained in significantly less time (about 3.5 times faster) with much lower CPU memory (<15%) and GPU memory (<35%) requirements, to achieve similar prediction accuracy. In addition to the lower computational cost, Fourier-MIONet can be trained with only 6 snapshots of time to predict the PDE solutions for 30 years. Furthermore, we observed that Fourier-MIONet can maintain good accuracy when predicting out-of-distribution (OOD) data. The excellent generalizability of Fourier-MIONet is enabled by its adherence to the physical principle that the solution to a PDE is continuous over time. Furthermore, the developed Fourier-MIONet makes it possible to solve the long-time evolution of geological carbon sequestration in a large-scale three-dimensional space accurately and efficiently.

97 MATHEMATICS AND COMPUTING↗