Search NASA⌕ Search

Engineering topics

Sauter, Nicholas K.

Publications and source records attributed to Sauter, Nicholas K..

At least 19 records

ExaFEL: extreme-scale real-time data processing for X-ray free electron laser science

ExaFEL is an HPC-capable X-ray Free Electron Laser (XFEL) data analysis software suite for both Serial Femtosecond Crystallography (SFX) and Single Particle Imaging (SPI) developed in collaboration with the Linac Coherent Lightsource (LCLS), Lawrence Berkeley National Laboratory (LBNL) and Los Alamos National Laboratory. ExaFEL supports real-time data analysis via a cross-facility workflow spanning LCLS and HPC centers such as NERSC and OLCF. Our work therefore constitutes initial path-finding for the US Department of Energy's (DOE) Integrated Research Infrastructure (IRI) program. We present the ExaFEL team's 7 years of experience in developing real-time XFEL data analysis software for the DOE's exascale supercomputers. We present our experiences and lessons learned with the Perlmutter and Frontier supercomputers. Furthermore we outline essential data center services (and the implications for institutional policy) required for real-time data analysis. Finally we summarize our software and performance engineering approaches and our experiences with NERSC's Perlmutter and OLCF's Frontier systems. This work is intended to be a practical blueprint for similar efforts in integrating exascale compute resources into other cross-facility workflows.

59 BASIC BIOLOGICAL SCIENCES↗

Laue-DIALS: Open-source software for polychromatic x-ray diffraction data

Most x-ray sources are inherently polychromatic. Polychromatic (“pink”) x-rays provide an efficient way to conduct diffraction experiments as many more photons can be used and large regions of reciprocal space can be probed without sample rotation during exposure—ideal conditions for time-resolved applications. Analysis of such data is complicated, however, causing most x-ray facilities to discard >99% of x-ray photons to obtain monochromatic data. Key challenges in analyzing polychromatic diffraction data include lattice searching, indexing and wavelength assignment, correction of measured intensities for wavelength-dependent effects, and deconvolution of harmonics. We recently described an algorithm, Careless, that can perform harmonic deconvolution and correct measured intensities for variation in wavelength when presented with integrated diffraction intensities and assigned wavelengths. Here, we present Laue-DIALS, an open-source software pipeline that indexes and integrates polychromatic diffraction data. Laue-DIALS is based on the dxtbx toolbox, which supports the DIALS software commonly used to process monochromatic data. As such, Laue-DIALS provides many of the same advantages: an open-source, modular, and extensible architecture, providing a robust basis for future development. We present benchmark results showing that Laue-DIALS, together with Careless, provides a suitable approach to the analysis of polychromatic diffraction data, including for time-resolved applications.

97 MATHEMATICS AND COMPUTING↗

3D Nanocrystallography and the Imperfect Molecular Lattice

Crystallographic analysis relies on the scattering of quanta from arrays of atoms that populate a repeating lattice. While large crystals built of lattices that appear ideal are sought after by crystallographers, imperfections are the norm for molecular crystals. Additionally, advanced X-ray and electron diffraction techniques, used for crystallography, have opened the possibility of interrogating micro- and nanoscale crystals, with edges only millions or even thousands of molecules long. These crystals exist in a size regime that approximates the lower bounds for traditional models of crystal nonuniformity and imperfection. Accordingly, data generated by diffraction from both X-rays and electrons show increased complexity and are more challenging to conventionally model. New approaches in serial crystallography and spatially resolved electron diffraction mapping are changing this paradigm by better accounting for variability within and between crystals. The intersection of these methods presents an opportunity for a more comprehensive understanding of the structure and properties of nanocrystalline materials.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Changes in an enzyme ensemble during catalysis observed by high-resolution XFEL crystallography

Enzymes populate ensembles of structures necessary for catalysis that are difficult to experimentally characterize. We use time-resolved mix-and-inject serial crystallography at an x-ray free electron laser to observe catalysis in a designed mutant isocyanide hydratase (ICH) enzyme that enhances sampling of important minor conformations. The active site exists in a mixture of conformations, and formation of the thioimidate intermediate selects for catalytically competent substates. The influence of cysteine ionization on the ICH ensemble is validated by determining structures of the enzyme at multiple pH values. Large molecular dynamics simulations in crystallo and time-resolved electron density maps show that Asp 17 ionizes during catalysis and causes conformational changes that propagate across the dimer, permitting water to enter the active site for intermediate hydrolysis. ICH exhibits a tight coupling between ionization of active site residues and catalysis-activated protein motions, exemplifying a mechanism of electrostatic control of enzyme dynamics.

59 BASIC BIOLOGICAL SCIENCES↗

Real‐time XFEL data analysis at SLAC and NERSC: A trial run of nascent exascale experimental data analysis

X‐ray scattering experiments using free electron lasers (XFELs) are a powerful tool to determine the molecular structure and function of unknown samples (such as COVID‐19 viral proteins). XFEL experiments are a challenge to computing in two ways: (i) due to the high cost of running XFELs, a fast turnaround time from data acquisition to data analysis is essential to make informed decisions on experimental protocols; (ii) data‐collection rates are growing exponentially, requiring new scalable algorithms. Here we report our experiences analyzing data from two experiments at the Linac Coherent Light Source (LCLS) during September 2020. Raw data were analyzed on NERSC's Cori XC40 system, using the Superfacility paradigm: our workflow automatically moves raw data between LCLS and NERSC, where it is analyzed using the software package CCTBX. We achieved real time data analysis with a turnaround time from data acquisition to full molecular reconstruction in as little as 10 min—sufficient time for the experiment's operators to make informed decisions. By hosting the data analysis on Cori, and by automating LCLS‐NERSC interoperability, we achieved a data analysis rate which matches the data acquisition rate. Completing data analysis within 10 min is a first for XFEL experiments and an important milestone if we are to keep up with data‐collection trends.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Engineering Supramolecular Hybrid Architectures with Directional Organofluorine Bonds

Understanding how chemical modifications alter the atomic‐scale organization of materials is of fundamental importance in materials engineering and the target of considerable efforts in computational prediction. Incorporating covalent and noncovalent interactions in designing crystals while “piggybacking” on the driving force of molecular self‐assembly has augmented efforts to understand the emergence of complex structures using directed synthesis. In this work, microcrystalline powders of the silver 2‐, 3‐, and 4‐fluorobenzenethiolates are prepared and their structures are resolved by small‐molecule serial femtosecond X‐ray crystallography. These three compounds enable the emergence and role of supramolecular synthons in the crystal structures of 3D metal‐organic chalcogenolates to be examined. The unique divergence in their optoelectronic, morphological, and structural behaviors is assessed. The extent of CHF interactions and their influence on the structure and the observed trends in the thermal stability of the crystals are quantified through theoretical calculations and thermogravimetric analysis.

Kotei, Patience A.↗

In Situ Structural Observation of a Substrate- and Peroxide-Bound High-Spin Ferric-Hydroperoxo Intermediate in the P450 Enzyme CYP121

The P450 enzyme CYP121 from Mycobacterium tuberculosis catalyzes a carbon–carbon (C–C) bond coupling cyclization of the dityrosine substrate containing a diketopiperazine ring, cyclo(l-tyrosine-l-tyrosine) (cYY). An unusual high-spin (S = 5/2) ferric intermediate maximizes its population in less than 5 ms in the rapid freeze-quenching study of CYP121 during the shunt reaction with peracetic acid or hydrogen peroxide in acetic acid solution. Here, we show that this intermediate can also be observed in the crystalline state by EPR spectroscopy. By developing an on-demand-rapid-mixing method for time-resolved serial femtosecond crystallography with X-ray free-electron laser (tr-SFX-XFEL) technology covering the millisecond time domain and without freezing, we structurally monitored the reaction in situ at room temperature. After a 200 ms peracetic acid reaction with the cocrystallized enzyme–substrate microcrystal slurry, a ferric-hydroperoxo intermediate is observed, and its structure is determined at 1.85 Å resolution. The structure shows a hydroperoxyl ligand between the heme and the native substrate, cYY. The oxygen atoms of the hydroperoxo are 2.5 and 3.2 Å from the iron ion. The end-on binding ligand adopts a near-side-on geometry and is weakly associated with the iron ion, causing the unusual high-spin state. This compound 0 intermediate, spectroscopically and structurally observed during the catalytic shunt pathway, reveals a unique binding mode that deviates from the end-on compound 0 intermediates in other heme enzymes. The hydroperoxyl ligand is only 2.9 Å from the bound cYY, suggesting an active oxidant role of the intermediate for direct substrate oxidation in the nonhydroxylation C–C bond coupling chemistry.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Accelerating x-ray tracing for exascale systems using Kokkos

The upcoming exascale computing systems Frontier and Aurora will draw much of their computing power from GPU accelerators. The hardware for these systems will be provided by AMD and Intel, respectively, each supporting their own GPU programming model. The challenge for applications that harness one of these exascale systems will be to avoid lock-in and to preserve performance portability. We report here on our results of using Kokkos to accelerate a real-world application on NERSC's Perlmutter Phase 1 (using NVIDIA A100 accelerators) and Crusher, the testbed system for OLCF's Frontier (using AMD MI250X). By porting to Kokkos, we successfully ran the same X-ray tracing code on both systems and achieved speed-ups between 13 % and 66 % compared to the original CUDA code. Finally, these results are a highly encouraging demonstration of using Kokkos to accelerate production science code.

97 MATHEMATICS AND COMPUTING↗

Structure of a ribonucleotide reductase R2 protein radical

Aerobic ribonucleotide reductases (RNRs) initiate synthesis of DNA building blocks by generating a free radical within the R2 subunit; the radical is subsequently shuttled to the catalytic R1 subunit through proton-coupled electron transfer (PCET). Here we present a high-resolution room temperature structure of the class Ie R2 protein radical captured by x-ray free electron laser serial femtosecond crystallography. The structure reveals conformational reorganization to shield the radical and connect it to the translocation path, with structural changes propagating to the surface where the protein interacts with the catalytic R1 subunit. Restructuring of the hydrogen bond network, including a notably short O–O interaction of 2.41 angstroms, likely tunes and gates the radical during PCET. These structural results help explain radical handling and mobilization in RNR and have general implications for radical transfer in proteins.

59 BASIC BIOLOGICAL SCIENCES↗

Mapping protein dynamics at high spatial resolution with temperature-jump X-ray crystallography

Understanding and controlling protein motion at atomic resolution is a hallmark challenge for structural biologists and protein engineers because conformational dynamics are essential for complex functions such as enzyme catalysis and allosteric regulation. Time-resolved crystallography offers a window into protein motions, yet without a universal perturbation to initiate conformational changes the method has been limited in scope. Here we couple a solvent-based temperature jump with time-resolved crystallography to visualize structural motions in lysozyme, a dynamic enzyme. We observed widespread atomic vibrations on the nanosecond timescale, which evolve on the submillisecond timescale into localized structural fluctuations that are coupled to the active site. An orthogonal perturbation to the enzyme, inhibitor binding, altered these dynamics by blocking key motions that allow energy to dissipate from vibrations into functional movements linked to the catalytic cycle. Because temperature jump is a universal method for perturbing molecular motion, the method demonstrated here is broadly applicable for studying protein dynamics.

59 BASIC BIOLOGICAL SCIENCES↗

XFEL Microcrystallography of Self-Assembling Silver n -Alkanethiolates

New synthetic hybrid materials and their increasing complexity have placed growing demands on crystal growth for single-crystal X-ray diffraction analysis. Unfortunately, not all chemical systems are conducive to the isolation of single crystals for traditional characterization. Here, small-molecule serial femtosecond crystallography (smSFX) at atomic resolution (0.833 Å) is employed to characterize microcrystalline silver n-alkanethiolates with various alkyl chain lengths at X-ray free electron laser facilities, resolving long-standing controversies regarding the atomic connectivity and odd–even effects of layer stacking. smSFX provides high-quality crystal structures directly from the powder of the true unknowns, a capability that is particularly useful for systems having notoriously small or defective crystals. We present crystal structures of silver n-butanethiolate (C4), silver n-hexanethiolate (C6), and silver n-nonanethiolate (C9). We show that an odd–even effect originates from the orientation of the terminal methyl group and its role in packing efficiency. We also propose a secondary odd–even effect involving multiple mosaic blocks in the crystals containing even-numbered chains, identified by selected-area electron diffraction measurements. Finally, we conclude with a discussion of the merits of the synthetic preparation for the preparation of microdiffraction specimens and compare the long-range order in these crystals to that of self-assembled monolayers.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Structural evidence for intermediates during O 2 formation in photosystem II

In natural photosynthesis, the light-driven splitting of water into electrons, protons and molecular oxygen forms the first step of the solar-to-chemical energy conversion process. The reaction takes place in photosystem II, where the Mn 4 CaO 5 cluster first stores four oxidizing equivalents, the S 0 to S 4 intermediate states in the Kok cycle, sequentially generated by photochemical charge separations in the reaction center and then catalyzes the O–O bond formation chemistry. Here, we report room temperature snapshots by serial femtosecond X-ray crystallography to provide structural insights into the final reaction step of Kok’s photosynthetic water oxidation cycle, the S 3 →[S 4 ]→S 0 transition where O 2 is formed and Kok’s water oxidation clock is reset. Our data reveal a complex sequence of events, which occur over micro- to milliseconds, comprising changes at the Mn 4 CaO 5 cluster, its ligands and water pathways as well as controlled proton release through the hydrogen-bonding network of the Cl1 channel. Importantly, the extra O atom O x , which was introduced as a bridging ligand between Ca and Mn1 during the S 2 →S 3 transition disappears or relocates in parallel with Y z reduction starting at approximately 700 μs after the third flash. The onset of O 2 evolution, as indicated by the shortening of the Mn1–Mn4 distance, occurs at around 1,200 μs, signifying the presence of a reduced intermediate, possibly a bound peroxide.

59 BASIC BIOLOGICAL SCIENCES↗

A machine learning pipeline for membrane segmentation of cryo-electron tomograms

We describe how to use several machine learning techniques organized in a learning pipeline to segment and identify cell membrane structures from cryo electron tomograms. These tomograms are difficult to analyze with traditional segmentation tools. The learning pipeline in our approach starts from supervised learning via a special convolutional neural network trained with simulated data. It continues with semi-supervised reinforcement learning and/or a region merging technique that tries to piece together disconnected components belonging to the same membrane structure. A parametric or non-parametric fitting procedure is then used to enhance the segmentation results and quantify uncertainties in the fitting. Domain knowledge is used in generating the training data for the neural network and in guiding the fitting procedure through the use of appropriately chosen priors and constraints. We demonstrate that the approach proposed here works well for extracting membrane surfaces in two real tomogram datasets.

97 MATHEMATICS AND COMPUTING↗

Capturing the sequence of events during the water oxidation reaction in photosynthesis using XFELs

Ever since the discovery that Mn was required for oxygen evolution in plants by Pirson in 1937 and the period-four oscillation in flash-induced oxygen evolution by Joliot and Kok in the 1970s, understanding of this process has advanced enormously using state-of-the-art methods. The most recent in this series of innovative techniques was the introduction of X-ray free-electron lasers (XFELs) a decade ago, which led to another quantum leap in the understanding in this field, by enabling operando X-ray structural and X-ray spectroscopy studies at room temperature. This review summarizes the current understanding of the structure of Photosystem II (PS II) and its catalytic centre, the Mn 4 CaO 5 complex, in the intermediate S i ( i = 0-4)-states of the Kok cycle, obtained using XFELs.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Redox-controlled reorganization and flavin strain within the ribonucleotide reductase R2b–NrdI complex monitored by serial femtosecond crystallography

Redox reactions are central to biochemistry and are both controlled by and induce protein structural changes. Here, we describe structural rearrangements and crosstalk within the Bacillus cereus ribonucleotide reductase R2b–NrdI complex, a di-metal carboxylate-flavoprotein system, as part of the mechanism generating the essential catalytic free radical of the enzyme. Femtosecond crystallography at an X-ray free electron laser was utilized to obtain structures at room temperature in defined redox states without suffering photoreduction. Together with density functional theory calculations, we show that the flavin is under steric strain in the R2b–NrdI protein complex, likely tuning its redox properties to promote superoxide generation. Moreover, a binding site in close vicinity to the expected flavin O 2 interaction site is observed to be controlled by the redox state of the flavin and linked to the channel proposed to funnel the produced superoxide species from NrdI to the di-manganese site in protein R2b. These specific features are coupled to further structural changes around the R2b–NrdI interaction surface. The mechanistic implications for the control of reactive oxygen species and radical generation in protein R2b are discussed

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Room temperature XFEL crystallography reveals asymmetry in the vicinity of the two phylloquinones in photosystem I.

Photosystem I (PS I) has a symmetric structure with two highly similar branches of pigments at the center that are involved in electron transfer, but shows very different efficiency along the two branches. We have determined the structure of cyanobacterial PS I at room temperature (RT) using femtosecond X-ray pulses from an X-ray free electron laser (XFEL) that shows a clear expansion of the entire protein complex in the direction of the membrane plane, when compared to previous cryogenic structures. This trend was observed by complementary datasets taken at multiple XFEL beamlines. In the RT structure of PS I, we also observe conformational differences between the two branches in the reaction center around the secondary electron acceptors A 1A and A 1B . The π-stacked Phe residues are rotated with a more parallel orientation in the A-branch and an almost perpendicular confirmation in the B-branch, and the symmetry breaking PsaB-Trp673 is tilted and further away from A 1A . These changes increase the asymmetry between the branches and may provide insights into the preferential directionality of electron transfer.

59 BASIC BIOLOGICAL SCIENCES↗