Search NASA⌕ Search

Engineering topics

Huang, Xin

Publications and source records attributed to Huang, Xin.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

An Efficient Checkpointing System for Large Machine Learning Model Training

As machine learning models increase in size and complexity rapidly, the cost of checkpointing in ML training became a bottleneck in storage and performance (time). For example, the latest GPT-4 model has massive parameters at the scale of 1.76 trillion. It is highly time and storage consuming to frequently writes the model to checkpoints with more than 1 trillion floating point values to storage. This work aims to understand and attempt to mitigate this problem. First, we characterize the checkpointing interface in a collection of representative large machine learning/language models with respect to storage consumption and performance overhead. Second, we propose the two optimizations: i) A periodic cleaning strategy that periodically cleans up outdated checkpoints to reduce the storage burden; ii) A data staging optimization that coordinates checkpoints between local and shared file systems for performance improvement.

machine learning, artificial intelligence↗
DOE OSTI2024

Benchmarking Variables for Checkpointing in HPC Applications

Checkpoint/Restart (C/R) is a widely used fault tolerance mechanism in converged systems of cloud, edge, and HPC. However, users often rely on their experience to determine which variables to checkpoint, as there is currently no benchmark that can provide a reference. This can result in checkpointing redundant or even incorrect variables. To address this issue, we propose a benchmark suite that includes critical variables for checkpointing, which have been manually identified, and a method for identifying those critical variables, with 20 representative HPC applications. Our method involves analyzing data dependency between variables to identify critical variables analytically. We verify the identified variables' correctness with a widely used C/R library FTI by an ablation study. With our benchmark suite and data dependency analysis, HPC practitioners now have a reference for identifying checkpointing variables and better knowledge of what kind of variables to checkpoint.

Fu, Xiang↗
DOE OSTI2024

Fire–precipitation interactions amplify the quasi-biennial variability in fires over southern Mexico and Central America

Fires have great ecological, social, and economic impact. However, fire prediction and management remain challenges due to a limited understanding of their roles in the Earth system. Fires over southern Mexico and Central America (SMCA) are a good example of this, greatly impacting local air quality and regional climate. Here we report that the spring peak (April–May) of fire activities in this region has a distinct quasi-biennial signal based on multiple satellite datasets measuring different fire characteristics. The variability is initially driven by quasi-biennial variations in precipitation. Composite analysis indicates that strong fire years correspond to suppressed ascending motion and weakened precipitation over the SMCA. The anomalous precipitation over the SMCA is further found to be mostly related to the East Pacific–North Pacific (EP-NP) pattern 2 months prior to the fire season. The positive phase of the EP-NP leads to enhanced precipitation over the eastern US but suppressed precipitation over the SMCA, similar to the spatial pattern of precipitation differences between strong and weak fire years. Meanwhile, the quasi-biennial signals in precipitation and fires appear to be amplified by their interactions through a positive feedback loop at short timescales. Model simulations show that in strong fire years, more aerosol particles are released and transported downstream over the Gulf of Mexico and the eastern US, where suspended light-absorbing aerosols warm the atmosphere and cause the ascending motion of the air aloft. Subsequently, a compensating downward motion is formed over the region of the fire source and ultimately suppresses precipitation and intensifies fires. Statistical analysis shows the different durations of the two-way interaction, where the fire suppression effect of precipitation lasts for more than 20 d, while fire leads to a decrease in precipitation at shorter timescales (3–5 d). This study demonstrates the importance of fire–climate interactions in shaping the fire activities on an interannual scale and highlights how precipitation–fire interactions at short timescales contribute to the interannual variability in both fire and precipitation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Randomly Layered Superstructure of In 2 O 3 Truncated Nano-Octahedra and Its High-Pressure Behavior

This study outlines the synthesis and characterization of a unique superlattice composed of vertex-truncated indium oxide (In 2 O 3 ) nano-octahedra, along with an exploration of its response to high-pressure conditions. Here, using a bright-field transmission electron microscope (BF-TEM), we determined an average circumradius of 15.2 nm for these octahedral building blocks. The resilience and response of the superlattice to pressure variations, peaking at 18.01 GPa, were examined by employing synchrotron-based Wide-Angle X-ray Scattering (WAXS) and Small-Angle X-ray Scattering (SAXS) techniques. The WAXS data revealed no phase transitions, reinforcing the stability of the 2D superlattice comprised of random layers in alignment with a 2D p31m symmetry. Notably, the SAXS data unveiled a pressure-induced, irreversible octahedron translation and ligand interaction occurring within the random layer. Through our examination of these pressure-sensitive behaviors, we identified a distinctive translation model inherent to octahedra and observed modulation in the superlattice cell parameter induced by pressure. This research signifies a noteworthy progression in deciphering the intricate behaviors of 2D superlattices under high-pressure conditions.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Regime-Dependence of Nocturnal Nitrate Formation via N 2 O 5 Hydrolysis and Its Implication for Mitigating Nitrate Pollution

The heterogeneous hydrolysis of dinitrogen pentoxide (N 2 O 5 ) is an important pathway in nitrate formation; however, its formation rate and relative contribution to total particulate nitrate (pNO 3 - ) are highly variable. Here we report that nocturnal pNO 3 - formation via N 2 O 5 hydrolysis is dependent on the regime defined by the ratio of NO 2 to O 3 . Nocturnal pNO 3 - formation via N 2 O 5 hydrolysis is suppressed in an O 3 -limited regime but enhanced in a NO 2 -limited regime. The results have crucial implications for effective control of nitrate pollution in the future. An exclusive decrease in NO 2 will decrease nocturnal pNO 3 - formation in a NO 2 -limited regime but may be less effective or even increase nocturnal pNO 3 - formation in an O 3 -limited regime.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Understanding uncertainties in projections of western North Pacific tropical cyclogenesis

Reliable projections of tropical cyclone (TC) activities in the western North Pacific (WNP) are crucial for climate policy-making in densely-populated coastal Asia. Existing projections, however, exhibit considerable uncertainties with unclear sources. Here, based on future projections by the latest Coupled Model Intercomparison Project Phase 6 climate models, we identify a new and prevailing source of uncertainty arising from different TC identification schemes. Notable differences in projections of detected TCs and empirical genesis potential indices are found to be caused by inconsistent changes in dynamic and thermodynamic environmental factors affecting TC formations. While model uncertainty holds the secondary importance, we show large potential in reducing it through improved model simulations of present-day TC characteristics. Internal variability noticeably impacts near-term projections of the WNP tropical cyclogenesis, while the relative contribution of scenario uncertainty remains small. Our findings provide valuable insights into model development and TC projections, thereby aiding in adaptation decisions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Substantially positive contributions of new particle formation to cloud condensation nuclei under low supersaturation in China based on numerical model improvements

New particle formation (NPF) and subsequent particle growth are important sources of condensation nuclei (CN) and cloud condensation nuclei (CCN). While many observations have shown positive contributions of NPF to CCN at low supersaturation, negative NPF contributions were often simulated in polluted environments. Using the observations in a coastal city of Qingdao, Beijing, and Gucheng in north China, we thoroughly evaluate the simulated number concentrations of CN and CCN using an NPF-explicit parameterization embedded in the WRF-Chem model. For CN, the initial simulation shows large biases of particle number concentrations at 10–40 and 40–100 nm. By adjusting the process of gas–particle partitioning, including the mass accommodation coefficient (MAC) of sulfuric acid, the phase changes in primary organic aerosol emissions, and the condensational amount of nitric acid, the improvement of the particle growth process yields substantially reduced overestimation of CN. Regarding CCN, secondary organic aerosol (SOA) formed from the oxidation of semi-volatile and intermediate-volatility organic compounds (S/IVOCs) is called SI-SOA, the yield of which is an important contributor. At default settings, the SI-SOA yield is too high without considering the differences in precursor oxidation rates. Lowering the SI-SOA yield under linear H 2 SO 4 nucleation scheme results in much-improved CCN simulations compared to observations. On the basis of the bias-corrected model, we find substantially positive contributions of NPF to CCN at low supersaturation (~ 0.2 %) over broad areas of China, primarily due to competing effects of increasing particle hygroscopicity, a result of reductions in SI-SOA amount, surpassing that of particle size decreases. The bias-corrected model is robustly applicable to other schemes, such as the quadratic H 2 SO 4 nucleation scheme, in terms of CN and CCN, though the dependence of CCN on SI-SOA yield is diminished likely due to changes in particle composition. This study highlights potentially much larger NPF contributions to CCN on a regional and even global basis.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

An adaptive synchronous extraction (ASE) method for estimating intensity and footprint of surface urban heat islands: A case study of 254 North American cities

The urban heat island (UHI) effect has attracted great attention due to its potential impacts on rapidly growing urban areas. Using remotely sensed estimates of land surface temperature (LST), a large number of studies have focused on the surface UHI (SUHI) effect, which can be characterized by its two fundamental properties: intensity and footprint. The SUHI intensity reflects the LST difference between the urban area and the background reference area (BRA), and the SUHI footprint indicates the spatial extent influenced by the heat island. Currently, numerous methods have been developed to estimate the SUHI intensity and footprint, but are still greatly challenged by three main issues. Namely, the discrepancy in BRA selection criterion brings great uncertainty to the estimated SUHI intensity, the estimation of SUHI footprint is largely constrained by the predefined models, and the quantification of SUHI effect is potentially influenced by several confounding factors. Here, we proposed an adaptive synchronous extraction (ASE) method, which is capable of adaptively selecting the most optimal BRA while removing the influence of confounding factors, and achieving synchronous estimation of SUHI intensity and footprint. We applied the ASE method to 254 North American cities and conducted an in-depth comparative analysis to discuss its applicability and benefits. The main results include: (1) The ASE method avoids the limitations of existing methods in BRA selection and model presetting, and shows resilience to parameter variations. This makes the ASE method highly applicable to quantify the SUHI intensity and footprint in cities with various thermal characteristics. (2) The ASE method can better highlight the spatial, seasonal and day-night contrasts in the estimated SUHI intensity. This superiority is particularly evident when comparing it to methods based on the equal-area buffer or the simplified urban-extent algorithm. (3) Confounding factors pose non-negligible impacts on the quantification of the SUHI effect. Typically, ignoring the influence of topographic relief or missing LST data can lead to an overall overestimation of the SUHI intensity, while not removing surrounding urban areas will cause some underestimation of the SUHI intensity. In conclusion, overall, the proposed ASE method provides a new generalizable tool for quantifying the SUHI effect, which has great potentials for future studies and urban climate assessments.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Unified theoretical framework for black carbon mixing state allows greater accuracy of climate effect estimation

Black carbon (BC) plays an important role in the climate system because of its strong warming effect, yet the magnitude of this effect is highly uncertain owing to the complex mixing state of aerosols. Here we build a unified theoretical framework to describe BC’s mixing states, linking dynamic processes to BC coating thickness distribution, and show its self-similarity for sites in diverse environments. The size distribution of BC-containing particles is found to follow a universal law and is independent of BC core size. A new mixing state module is established based on this finding and successfully applied in global and regional models, which increases the accuracy of aerosol climate effect estimations. Our theoretical framework links observations with model simulations in both mixing state description and light absorption quantification.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Operando studies reveal active Cu nanograins for CO 2 electroreduction

Carbon dioxide electroreduction facilitates the sustainable synthesis of fuels and chemicals. Although Cu enables CO 2 -to-multicarbon product (C 2+ ) conversion, the nature of the active sites under operating conditions remains elusive. Importantly, identifying active sites of high-performance Cu nanocatalysts necessitates nanoscale, time-resolved operando techniques. Here, we present a comprehensive investigation of the structural dynamics during the life cycle of Cu nanocatalysts. A 7 nm Cu nanoparticle ensemble evolves into metallic Cu nanograins during electrolysis before complete oxidation to single-crystal Cu 2 O nanocubes following post-electrolysis air exposure. Operando analytical and four-dimensional electrochemical liquid-cell scanning transmission electron microscopy shows the presence of metallic Cu nanograins under CO 2 reduction conditions. Correlated high-energy-resolution time-resolved X-ray spectroscopy suggests that metallic Cu, rich in nanograin boundaries, supports undercoordinated active sites for C–C coupling. Quantitative structure–activity correlation shows that a higher fraction of metallic Cu nanograins leads to higher C 2+ selectivity. A 7 nm Cu nanoparticle ensemble, with a unity fraction of active Cu nanograins, exhibits sixfold higher C 2+ selectivity than the 18 nm counterpart with one-third of active Cu nanograins. Importantly, the correlation of multimodal operando techniques serves as a powerful platform to advance our fundamental understanding of the complex structural evolution of nanocatalysts under electrochemical conditions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Microbe-iron interactions control lignin decomposition in soil

Lignin decomposition is critically linked to terrestrial carbon (C) cycle due to the enormous C mass of lignin and its importance in controlling overall rates of litter decomposition. Interactions between lignin and iron (Fe) minerals have been increasingly recognized as key mediators of lignin decomposition in experimental studies. However, we still lack a quantitative understanding of how Fe minerals interact with microbes to control lignin decomposition. Here, we leveraged experimental results from an incubation of Fe-rich soil, in which lignin decomposition rates were measured at aerobic conditions after four levels of pre-treated O2 availability, to examine microbe-Fe (MiFe) interactions in lignin decomposition with a MiFe model. We quantified how Fe redox cycling interacted with microbial activities to control lignin decomposition via data-model integration. Our results showed that the MiFe model with time-dependent growth and mortality functions better represented CO2 release from lignin decomposition (R2 ranging from 0.96 to 0.97) than models assuming either first-order or Michaelis-Menten kinetics. Reduction of Fe(III) to Fe(II) after pre-treatments with lower O2 availability stimu-lated the Fenton reaction to break down macro-molecular lignin into small molecules available to microbes. The small molecules of lignin and necromass bounded with oxidized Fe and were protected from decomposition. After 1-year incubation, the model implied that most of C stabilized with Fe minerals was derived from small molecular lignin C. Our quantitative analysis of microbe-Fe interactions sheds new light on lignin decomposition and preservation and helps improve model prediction of soil C persistence under global change.

Liao, Cuijuan↗
DOE OSTI2022

Electrocatalysis in Alkaline Media and Alkaline Membrane-Based Energy Technologies

Hydrogen energy-based electrochemical energy conversion technologies offer the promise of enabling a transition of the global energy landscape from fossil fuels to renewable energy. Here, we present a comprehensive review of the fundamentals of electrocatalysis in alkaline media and applications in alkaline-based energy technologies, particularly alkaline fuel cells and water electrolyzers. Anion exchange (alkaline) membrane fuel cells (AEMFCs) enable the use of nonprecious electrocatalysts for the sluggish oxygen reduction reaction (ORR), relative to proton exchange membrane fuel cells (PEMFCs), which require Pt-based electrocatalysts. However, the hydrogen oxidation reaction (HOR) kinetics is significantly slower in alkaline media than in acidic media. Understanding these phenomena requires applying theoretical and experimental methods to unravel molecular-level thermodynamics and kinetics of hydrogen and oxygen electrocatalysis and, particularly, the proton-coupled electron transfer (PCET) process that takes place in a proton-deficient alkaline media. Extensive electrochemical and spectroscopic studies, on single-crystal Pt and metal oxides, have contributed to the development of activity descriptors, as well as the identification of the nature of active sites, and the rate-determining steps of the HOR and ORR. Among these, the structure and reactivity of interfacial water serve as key potential and pH-dependent kinetic factors that are helping elucidate the origins of the HOR and ORR activity differences in acids and bases. Additionally, deliberately modulating and controlling catalyst-support interactions have provided valuable insights for enhancing catalyst accessibility and durability during operation. The design and synthesis of highly conductive and durable alkaline membranes/ionomers have enabled AEMFCs to reach initial performance metrics equal to or higher than those of PEMFCs. We emphasize the importance of using membrane electrode assemblies (MEAs) to integrate the often separately pursued/optimized electrocatalyst/support and membranes/ionomer components. Operando/in situ methods, at multiscales, and ab initio simulations provide a mechanistic understanding of electron, ion, and mass transport at catalyst/ionomer/membrane interfaces and the necessary guidance to achieve fuel cell operation in air over thousands of hours. We hope that this Review will serve as a roadmap for advancing the scientific understanding of the fundamental factors governing electrochemical energy conversion in alkaline media with the ultimate goal of achieving ultralow Pt or precious-metal-free high-performance and durable alkaline fuel cells and related technologies.

30 DIRECT ENERGY CONVERSION↗
DOE OSTI2021

Aerosol-boundary-layer-monsoon interactions amplify semi-direct effect of biomass smoke on low cloud formation in Southeast Asia

Low clouds play a key role in the Earth-atmosphere energy balance and influence agricultural production and solar-power generation. Smoke aloft has been found to enhance marine stratocumulus through aerosol-cloud interactions, but its role in regions with strong human activities and complex monsoon circulation remains unclear. Here we show that biomass burning aerosols aloft strongly increase the low cloud coverage over both land and ocean in subtropical southeastern Asia. The degree of this enhancement and its spatial extent are comparable to that in the Southeast Atlantic, even though the total biomass burning emissions in Southeast Asia are only one-fifth of those in Southern Africa. We find that a synergetic effect of aerosol-cloud-boundary layer interaction with the monsoon is the main reason for the strong semi-direct effect and enhanced low cloud formation in southeastern Asia.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

A model-independent data assimilation (MIDA) module and its applications in ecology

Abstract. Models are an important tool to predict Earth system dynamics. An accurate prediction of future states of ecosystems depends on not only model structures but also parameterizations. Model parameters can be constrained by data assimilation. However, applications of data assimilation to ecology are restricted by highly technical requirements such as model-dependent coding. To alleviate this technical burden, we developed a model-independent data assimilation (MIDA) module. MIDA works in three steps including data preparation, execution of data assimilation, and visualization. The first step prepares prior ranges of parameter values, a defined number of iterations, and directory paths to access files of observations and models. The execution step calibrates parameter values to best fit the observations and estimates the parameter posterior distributions. The final step automatically visualizes the calibration performance and posterior distributions. MIDA is model independent, and modelers can use MIDA for an accurate and efficient data assimilation in a simple and interactive way without modification of their original models. We applied MIDA to four types of ecological models: the data assimilation linked ecosystem carbon (DALEC) model, a surrogate-based energy exascale earth system model: the land component (ELM), nine phenological models and a stand-alone biome ecological strategy simulator (BiomeE). The applications indicate that MIDA can effectively solve data assimilation problems for different ecological models. Additionally, the easy implementation and model-independent feature of MIDA breaks the technical barrier of applications of data–model fusion in ecology. MIDA facilitates the assimilation of various observations into models for uncertainty reduction in ecological modeling and forecasting.

58 GEOSCIENCES↗