Search NASASearch

SEARCH · Search NASA

Results for “Ulysses”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

Sequence length scaling in vision transformers for scientific images on frontier

Vision Transformers (ViTs) are pivotal for foundational models in scientific imagery, including Earth science applications, due to their capability to process large sequence lengths. While transformers for text have inspired scaling sequence lengths in ViTs, adapting these for ViTs introduces unique challenges. We develop distributed sequence parallelism for ViTs, enabling them to handle up to 1M tokens. Our approach, leveraging DeepSpeed-Ulysses and Long-Sequence-Segmentation with model sharding, is the first to apply sequence parallelism in ViT training, achieving a 94% batch scaling efficiency on 2,048 AMD-MI250X GPUs. Evaluating sequence parallelism in ViTs, particularly in models up to 10B parameters, highlighted substantial bottlenecks. We countered these with hybrid sequence, pipeline, and flash attention strategies, to scale beyond single GPU memory limits. Our method significantly enhances climate modeling accuracy by 20% in temperature predictions, marking the first training of a vision transformer model to convergence with a sequence length of 188K tokens, using full self-attention.

Tsaris, Aristeidis (aris) [ORNL] (ORCID:0000000277

Nuclear Safety [Vol. 32, No. 4, October-December 1991]

Nuclear Safety is a review journal that covers significant developments in the field of nuclear safety. Its scope includes the analysis and control of hazards associated with nuclear energy, operations involving fissionable materials, and the products of nuclear fission and their effects on the environment. Primary emphasis is on safety in reactor design, construction, and operation; however, the safety aspects of the entire fuel cycle, including fuel fabrication, spent-fuel processing, nuclear waste disposal, handling of radioisotopes, and environmental effects of these operations, are also treated. Table of Contents for this issue follows. GENERAL SAFETY CONSIDERATIONS: 477 Report on the International Symposium on the Use of Probabilistic Safety Assessment for Operational Safety—PSA '91, S. Chakraborty and M. Khatib-Rahbar; 488 Good Relationships Are Pivotal in Nuclear Data Bases, A. S. Heger and B. V. Koen; 494 Technical Note: The Interagency Nuclear Safety Review Panel's Evaluation of the Ulysses Space Mission, J. A. Sholtis, Jr., D. A. Huff, L. B. Gray, N. P. Klug, and R. O. Winchester; ACCIDENT ANALYSIS: 502 The Severe Accident Analysis Program for the Savannah River Nuclear Production Reactors, M. L. Hyder; CONTROL AND INSTRUMENTATION: 511 A Framework for Selecting Suitable Control Technologies for Nuclear Power Plant Systems, R. A. Kisner; DESIGN FEATURES: 521 Containments for Gas-Cooled Power Reactors History and Status, P.W. Williams; ENVIRONMENTAL EFFECTS: 537 Indoor Radon: A Natural Risk, N. H. Harley and J.H. Harley; On the Importance of the Atmospheric Parameters in the Fission Products Distribution of a Severe Reactor Accident, M. C. Barla and A. R. Bayulken; Book Review: Health Effects of Exposure to Low Levels of Ionizing Radiation BEIR V, C. R. Richmond; WASTE AND SPENT FUEL MANAGEMENT: 555 Activities Related to Waste and Spent Fuel Management, M. D. Muhlheim and E. G. Silver OPERATING EXPERIENCES: 567 Effects of Component Aging on the Westhinghouse Control Rod Drive System, K. Sullivan and W. Gunther; 577 Reactor Shutdown Experience, Compiled by J. W. Cletcher, 580 Selected Safety-Related Events, Compiled by G. A. Murphy; 582 Operating U 8 Power Reactors, Compiled by M. D. Muhlheim and E. G. Silver, RECENT DEVELOPMENTS: 596 General Administrative Activities, Compiled by M. D. Muhlheim and E. G. Silver; 610 Reports, Standards, and Safety Guides, D. S. Queener; 614 Proposed Rule Changes as of June 30, 1991; ANNOUNCEMENTS: 520 Workshop on PC PRAISE: A Probabilistic Fracture Mechanics Personal Computer Code for Nuclear Power Plant Piping Reliability Assessment; 536 Fifth Workshop on Nuclear Power Plant Containment Integrity; 624 New OECD "International Information System on Occupational Exposure (ISOE)"; 625 Harvard School of Public Health Announces Short Courses; 625 Eighth Power Plant Dynamics, Control and Testing Symposium; 626 Second Training Course on Off-Site Emergency Planning and Response for Nuclear Accidents; 618 The Authors; 622 Reviewers of Nuclear Safety, Vol 32.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS

Nuclear Safety [Vol. 32, No. 4, October-December 1991]

Nuclear Safety is a review journal that covers significant developments in the field of nuclear safety. Its scope includes the analysis and control of hazards associated with nuclear energy, operations involving fissionable materials, and the products of nuclear fission and their effects on the environment. Primary emphasis is on safety in reactor design, construction, and operation; however, the safety aspects of the entire fuel cycle, including fuel fabrication, spent-fuel processing, nuclear waste disposal, handling of radioisotopes, and environmental effects of these operations, are also treated. Table of Contents for this issue follows. GENERAL SAFETY CONSIDERATIONS: 477 Report on the International Symposium on the Use of Probabilistic Safety Assessment for Operational Safety—PSA '91, S. Chakraborty and M. Khatib-Rahbar; 488 Good Relationships Are Pivotal in Nuclear Data Bases, A. S. Heger and B. V. Koen; 494 Technical Note: The Interagency Nuclear Safety Review Panel's Evaluation of the Ulysses Space Mission, J. A. Sholtis, Jr., D. A. Huff, L. B. Gray, N. P. Klug, and R. O. Winchester; ACCIDENT ANALYSIS: 502 The Severe Accident Analysis Program for the Savannah River Nuclear Production Reactors, M. L. Hyder; CONTROL AND INSTRUMENTATION: 511 A Framework for Selecting Suitable Control Technologies for Nuclear Power Plant Systems, R. A. Kisner; DESIGN FEATURES: 521 Containments for Gas-Cooled Power Reactors History and Status, P.W. Williams; ENVIRONMENTAL EFFECTS: 537 Indoor Radon: A Natural Risk, N. H. Harley and J.H. Harley; On the Importance of the Atmospheric Parameters in the Fission Products Distribution of a Severe Reactor Accident, M. C. Barla and A. R. Bayulken; Book Review: Health Effects of Exposure to Low Levels of Ionizing Radiation BEIR V, C. R. Richmond; WASTE AND SPENT FUEL MANAGEMENT: 555 Activities Related to Waste and Spent Fuel Management, M. D. Muhlheim and E. G. Silver OPERATING EXPERIENCES: 567 Effects of Component Aging on the Westhinghouse Control Rod Drive System, K. Sullivan and W. Gunther; 577 Reactor Shutdown Experience, Compiled by J. W. Cletcher, 580 Selected Safety-Related Events, Compiled by G. A. Murphy; 582 Operating U 8 Power Reactors, Compiled by M. D. Muhlheim and E. G. Silver, RECENT DEVELOPMENTS: 596 General Administrative Activities, Compiled by M. D. Muhlheim and E. G. Silver; 610 Reports, Standards, and Safety Guides, D. S. Queener; 614 Proposed Rule Changes as of June 30, 1991; ANNOUNCEMENTS: 520 Workshop on PC PRAISE: A Probabilistic Fracture Mechanics Personal Computer Code for Nuclear Power Plant Piping Reliability Assessment; 536 Fifth Workshop on Nuclear Power Plant Containment Integrity; 624 New OECD "International Information System on Occupational Exposure (ISOE)"; 625 Harvard School of Public Health Announces Short Courses; 625 Eighth Power Plant Dynamics, Control and Testing Symposium; 626 Second Training Course on Off-Site Emergency Planning and Response for Nuclear Accidents; 618 The Authors; 622 Reviewers of Nuclear Safety, Vol 32.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS

Metal-to-Ceramic Joining Methods to Support Development of Advanced Ceramic-Based CSP Components

The National Renewable Energy Laboratory, Missouri University of Science and Technology (MS&T), Massachusetts Institute of Technology (MIT), and Colorado School of Mines (CSM) collaborated to design, develop, and test a material concept at bench scale which will be used to achieve a ceramic-to-metal (C2M) joint between a selected metal HTF loop material and a selected ceramic material used by the Gen3 CSP technology pathway. The final joint assembly will need to possess sufficient mechanical properties to withstand static high-temperature (650 degrees-700 degrees C) and high-pressure (20 MPa) and thermal cycling (between 650 degrees C and 100 degrees C) conditions. The material concept consists of three key components: (1) a ceramic matrix composite (CMC) that serves as a compliant transition material aiming to mitigate the stresses due to the mismatch of coefficient of thermal expansion (CTE) from a direct ceramic-to-metal joint, (2) a metal-end joint utilizing a multi-principal element alloy (MPEA) with changing percentage of particle loading to bond the candidate metal to the CMC, and (3) a ceramic-end joint utilizing a glass ceramic to bond the candidate ceramic to the CMC.

14 SOLAR ENERGY