Precision Cascade: A novel algorithm for multi-precision extreme compression
Explore the source record for details and available documents.
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Using NVIDIA graphics processing units (GPUs) equipped with Tensor Cores has enabled the significant acceleration of general matrix multiplication (GEMM) for applications in machine learning (ML) and artificial intelligence (AI) and in high-performance computing (HPC) generally. The use of such power-efficient, specialized accelerators can provide a performance increase between 8 × and 20 ×, albeit with a loss in precision. However, a high level of precision is required in many large scientific and HPC applications, and computing in single or double precision is still necessary for many of these applications to maintain accuracy. Fortunately, mixed-precision methods can be employed to maintain a higher level of numerical precision while also taking advantage of the performance increases from computing with lower-precision AI cores. With this in mind, we extend the state of the art by using NVIDIA’s new TF32 framework. This new framework not only burdens some constraints of the previous frameworks, such as costly 32 16-bit castings but also provides an equivalent precision and performance by using a much simpler approach. We also propose a new framework called TF64 that attempts double-precision arithmetic with low-precision Tensor Cores. Although this framework does not exist yet, we validated the correctness of this idea and achieved an equivalent of 64-bit precision on 32-bit hardware.
The precise estimation of Rate Of Change Of Frequencies (ROCOFs) in a generation trip event can be helpful on power system inertia estimation, fast system response, and accurate event capturing. However, the ROCOF estimations from the existing Synchronized Measurement Devices (SMDs) are usually simply calculated by the finite difference between two adjacent frequency measurement points. The ineluctable noises, disturbances, and spikes from real-world frequency measurements can bring large dynamics to the ROCOF estimation and thus can result in an inaccurate estimation of the initial ROCOF. This issue becomes more serious when the target power grid has low inertia, and a large amount of distributed energy sources are deployed. To address this issue, a precise ROCOF estimation algorithm is designed based on least square method with flexible window size. In addition, a median filter is also designed and applied on the frequency measurements before using the proposed algorithm. The window size and thresholds in the proposed algorithm are determined with historical event data analysis. The proposed algorithm is deployed in a low cost, flexible, and distribution level universal grid analyzer (UGA) platform. In conclusion, multiple experiments are conducted in both a laboratory and the Hawaiian Islands to verify the effectiveness of the proposed algorithm.
Graphics Processing Units (GPUs), the dominantly adopted accelerators in HPC systems, are susceptible to transient hardware fault. New generation of GPUs feature mixed-precision architectures such as NVIDIA Tensor Cores to accelerate matrix multiplications. While being widely adapted, how would they behave under transient hardware faults remain unclear. In this study, we conduct a large-scale fault injection experiments on GEMM kernels implemented with different floating-point data types on the V100 and A100 Tensor Cores, and show distinct error resilience characteristics for the GEMMS with different formats. In the future, we plan to explore this space by building precision-aware floating-point fault tolerance techniques for applications such as DNNs that exercise low-precision computations.
With the advent of a new generation of cosmological experiments that will provide high-precision measurements of the cosmic microwave background (CMB) and galaxies in the large-scale structure, it is pertinent to examine the potential of performing a joint analysis of multiple cosmological probes. In this paper, we study the cosmological information content contained in the one-loop power spectra and tree bispectra of galaxies cross-correlated with CMB lensing. We use the FFTLog method to compute angular correlations in spherical harmonic space, applicable for wide angles that can be accessed by forthcoming galaxy surveys. Here, we find that adding the bispectra and cross-correlations with CMB lensing offers a significant improvement in parameter constraints, including those on the total neutrino mass, M ν , and local non-Gaussianity amplitude, ƒ NL . In particular, our results suggest that the combination of the Vera C. Rubin Observatory's Legacy Survey of Space and Time (LSST) and CMB-S4 will be able to achieve σ(M ν )=42 meV from galaxy and CMB lensing correlations, and σ(M ν )=12 meV when further combined with the CMB temperature and polarization data, without any prior on the optical depth.
The PICOSEC Micromegas (MM) detector is a precise timing gaseous detector consisting of a Cherenkov radiator combined with a photocathode and a MM amplifying structure. A 100-channel PICOSEC MM prototype with 10 × 10 cm 2 active area equipped with a Cesium Iodide (CsI) photocathode demonstrated a time resolution below σ = 18 ps. The objective of this work is to improve the PICOSEC MM detector robustness aspects, i.e. integration of resistive MM and carbon-based photocathodes, while maintaining good time resolution. The PICOSEC MM prototypes have been tested in laboratory conditions and successfully characterised with 150 GeV/c muon beams at the CERN SPS H4 beam line. The excellent timing performance below σ = 20 ps for an individual pad obtained with the 10 × 10 cm 2 area resistive PICOSEC MM of 20 MΩ/$\square$ showed no significant time resolution degradation as a result of adding a resistive layer. A single-pad prototype equipped with a 12 nm thick Boron Carbide (B 4 C) photocathode presented a time resolution below σ = 35 ps, opening up new possibilities for detectors with robust photocathodes. The results made the concept more suitable for the experiments in need of robust detectors with good time resolution.
Here, we theoretically investigate the feasibility of applying spin squeezing to a light pulse atom interferometer in the presence of large momentum transfer using off resonant Raman transitions, in order to enhance the sensitivity of accelerometry close to the Heisenberg limit. We also show how to implement this scheme in a dual-species atom interferometer for a precision test of the equivalence principle by measuring the Eötvös parameter, and to identify the spin squeezing protocol that is best suited for such an experiment. For a space borne platform in low Earth orbit, such a scheme may eventually enable the measurement of the Eötvös parameter with a sensitivity of the order of 10 -20 within 150 days when 10 5 atoms are employed in each cycle of the experiment.
The attachment of dopant precursor molecules to depassivated areas of hydrogen-terminated silicon templated with a scanning tunneling microscope (STM) has been used to create electronic devices with sub-nanometer precision, typically for quantum physics demonstrations, and to dope silicon past the solid-solubility limit, with potential applications in microelectronics and plasmonics. However, this process, which we call atomic precision advanced manufacturing (APAM), currently lacks the throughput required to develop sophisticated applications because there is no proven scalable hydrogen lithography pathway. Here, we demonstrate and characterize an APAM device workflow where STM lithography has been replaced with photolithography. An ultraviolet laser is shown to locally heat silicon controllably above the temperature required for hydrogen depassivation. STM images indicate a narrow range of laser energy density where hydrogen has been depassivated, and the surface remains well-ordered. A model for photothermal heating of silicon predicts a local temperature which is consistent with atomic-scale STM images of the photo-patterned regions. Finally, a simple device made by exposing photo-depassivated silicon to phosphine is found to have a carrier density and mobility similar to that produced by similar devices patterned by STM.
Abstract not provided
Abstract not provided
Molecules containing heavy radioactive nuclei are predicted to be extremely sensitive to violations of the fundamental symmetries of nature. The nuclear octupole deformation of certain radium isotopes massively boosts the sensitivity of radium monofluoride molecules to symmetry-violating nuclear properties. Moreover, these molecules are predicted to be laser coolable. In this article, we report measurements of the rovibronic structure of radium monofluoride molecules, which allow the determination of their laser cooling scheme. We demonstrate an improvement in resolution of more than two orders of magnitude compared to the state of the art. Our developments allowed measurements of minuscule amounts of hot molecules, with only a few hundred per second produced in a particular rotational state. The combined precision and sensitivity achieved in this work offer opportunities for studies of radioactive molecules of interest in fundamental physics, chemistry and astrophysics.
Abstract not provided
Not provided.
Over the last year, the ECP xSDK-multiprecision effort has made tremendous progress in developing and deploying new mixed precision technology and customizing the algorithms for the hardware deployed in the ECP flagship supercomputers. The effort also has succeeded in creating a cross-laboratory community of scientists interested in mixed precision technology and now working together in deploying this technology for ECP applications. In this report, we highlight some of the most promising and impactful achievements of the last year. Among the highlights we present are: Mixed precision IR using a dense LU factorization and achieving a 1.8× speedup on Spock; results and strategies for mixed precision IR using a sparse LU factorization; a mixed precision eigenvalue solver; Mixed Precision GMRES-IR being deployed in Trilinos, and achieving a speedup of 1.4× over standard GMRES; compressed Basis (CB) GMRES being deployed in Ginkgo and achieving an average 1.4× speedup over standard GMRES; preparing hypre for mixed precision execution; mixed precision sparse approximate inverse preconditioners achieving an average speedup of 1.2×; and detailed description of the memory accessor separating the arithmetic precision from the memory precision, and enabling memory-bound low precision BLAS 1/2 operations to increase the accuracy by using high precision in the computations without degrading the performance. We emphasize that many of the highlights presented here have also been submitted to peer-reviewed journals or established conferences, and are under peer-review or have already been published.