SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
This report is a joint piece by PNNL and NREL describing two similar projects and complementary approaches to improving the representation of hydropower in production cost models.
While wind energy production loss due to unavailability, environmental impacts, curtailment, and other causes has been studied and characterized at the utility-scale wind farm level, observation-based characterization of project loss is lacking for distributed wind energy, particularly for projects involving small wind turbines. Contemporary tools and research that support pre-construction distributed wind energy characterization present a wide range of default loss factors to convert gross energy estimates to net: 7-18%. We hypothesize that we can use generation observations from operational distributed wind projects to develop more accurate representations of loss. Using a density-based filtering technique on distributed wind power generation timeseries, we determine periods of typical performance and use them with regression algorithms in a measure-correlate-predict fashion to simulate what the generation would have been during periods of atypical or unreported performance. From there, the actual versus predicted generation leads to the establishment of observation-informed loss factors (median = 17%) for small, single turbine installation distributed wind projects.
This technical report summarizes the achievements during the project period. The general goal of the project is to enhance the representation of atmospheric deep convection in the DOE global climate model E3SM. By implementing a stochastic convection scheme into E3SM, we improved the simulation of precipitation intensity and frequency. As a result, it has a profound impact on the simulation of other fields in the model, including aerosol scavenging by precipitation and aerosol radiative effects. We also implemented a convective cloud microphysics scheme into E3SMv2 to represent more accurately the interaction between convection and grid-scale clouds. An extensive analysis of model simulations as part of the Next Generation Development (NGD) convection scheme assessment project found that including the convective microphysics scheme improved the simulation of Madden-Julian oscillations (MJO) in the model. To make convective parameterization schemes more scale-aware as the GCM resolution increases, we analyzed the output from cloud-resolving model (CRM) simulations of both organized and unorganized convection by coarse-graining the CRM data to different GCM resolutions. Using a novel approach to modify the convective closure, we demonstrated that the convection scheme used in E3SM (ZM scheme) can be made scale-aware.
This Incubator project has defined and developed a representation of an active hybrid mooring (AHM) system in Simulink to assess whether the speed and accuracy of AHM is sufficient to warrant further investigation in a larger project. We first built a representative mooring system for the VolturnUS-S 15MW floating offshore wind turbine (FOWT) in 1,000-meter water depth to provide baseline loads and displacements needed in the AHM system, with the results showing off-the-shelf actuators would be practical. We then defined model configurations for the numerical and physical substructures, using standalone MoorDyn v2 with a novel input strategy and chained hydraulic actuators represented in Simulink Simscape, respectively. The remainder of the project has focused on verifying the existing models for speed and accuracy against OpenFAST simulations, increasing their complexity to enable six degree of freedom (6DOF) operation, and connecting the numerical and physical substructures into a single holistic model. The verification phase of the project has shown promising results, though further refinement is needed to resolve accuracy discrepancies and for robust performance across a wider range of metocean conditions. The numerical model we developed is computationally stable and operates faster than real time using a time step of 0.01 seconds or shorter, indicating the model is likely fast enough for our AHM design to operate successfully. Additionally, the Simscape model of a hydraulic actuator operates with less than 0.3% relative error when actuating mooring loads from an OpenFAST simulation of the VolturnUS-S 1,000-meter mooring system. The aforementined refinements will be performed in the next year as a Continuing Incubator, with key remaining tasks include programming the predictor-corrector loop to minimize movement error, testing against more complex nonlinear wave cases, and expanding to enable loads from connected shared mooring lines.
Abstract The complexity of growing spatiotemporal resolution of climate simulations produces a variety of climate patterns under different projection scenarios. This paper proposes a new data-driven climate classification workflow via an unsupervised deep learning technique that can dimensionally reduce the vast volume of spatiotemporal numerical climate projection data into a compact representation. We aim to identify distinct zones that capture multiple climate variables as well as their future changes under different climate change scenarios. Our approach leverages convolutional autoencoders combined with k -means clustering (standard autoencoder) and online clustering based on the Sinkhorn–Knopp algorithm (clustering autoencoder) across the conterminous United States (CONUS) to capture unique climate patterns in a data-driven fashion from the Geophysical Fluid Dynamics Laboratory Earth System Model with GOLD component (GFDL-ESM2G). The developed approach compresses 70 years of GFDL-ESM2G simulation at 0.125° spatial resolution across the CONUS under multiple warming scenarios to a lower-dimensional space by a factor of 660 000 and then tested on 150 years of GFDL-ESM2G simulation data. The results show that five climate clusters capture physically reasonable and spatially stable climatological patterns matched to known climate classes defined by human experts. Results also show that using a clustering autoencoder can reduce the computational time for clustering by up to 9.2 times when compared to using a standard autoencoder. Our five unique climate patterns resulting from the deep learning–based clustering of the lower-dimensional space thereby enable us to provide insights on hydrometeorology and its spatial heterogeneity across the conterminous United States immediately without downloading large climate datasets. Significance Statement This paper presents a data-driven climate classification approach using unsupervised deep learning to dimensionally reduce climate model outputs and to identify distinct climate regions for their future changes. Our approach compresses climate information for 70 years of Geophysical Fluid Dynamics Laboratory Earth System Model data across the conterminous United States (CONUS) at 0.125° spatial resolution. The results reveal that five climate clusters capture reasonable and stable climatological patterns matched to known climate patterns. The embedded clustering process in deep learning provides ×9.2 times faster execution than the k -means clustering technique. These results give us insight about climate spatial patterns and heterogeneity of hydrological patterns across the conterminous United States without downloading large climate datasets.
The goal of this project was test how different representations of state uncertainty impact human decision making. Across a series of experiments, we sought to answer fundamental questions about human cognitive biases and how they are impacted by visual and numerical information. The results of these experiments identify problems and pitfalls to avoid when for presenting algorithmic outputs that include state uncertainty to human decision makers. Our findings also point to important areas for future research that will enable system designers to minimize biases in human interpretation for the outputs of artificial intelligence, machine learning, and other advanced analytic systems.
Our project aimed to guide the representations of peatland hydrology and water-carbon feedbacks within Earth System Models, by improving process understanding and developing parsimonious models that elucidate the effects of hydroclimatic variability and spatial heterogeneity. Our research questions centered on the three key drivers of peatland hydrology: (1) seasonal and interannual hydroclimatic fluctuations, (2) spatial heterogeneity of peatland microtopography, and (3) hydrological connectivity across landscape units within a peatland watershed. Our analyses and model testing used existing long-term datasets within the Marcell Experimental Forest (MEF), with new data collected whenever necessary. To date, we have demonstrated the strong influence of water table elevations on the temperature sensitivity of CH 4 emissions, using a newly developed eddy covariance dataset spanning eleven years at MEF. Specifically, higher water tables dampen the increase in CH 4 emissions in the spring as well as their decrease in the fall, resulting in hysteresis. These results imply that any hydroclimatological changes in peatlands that shift seasonal water availability from winter to summer will increase annual CH 4 emissions, even if soil temperature remains unchanged. To further investigate water table elevation change within the peatland microtopography, we installed automated water table gauges across four bog-forest transects (the “lagg”) in two peatland watersheds at MEF, which are hotspots of intense biogeochemical activity. These measurements will give us new information about the extent of lagg expansion and contraction during snowmelt and high intensity rainfall events, as well as the directionality of water and nutrient flow into the bog from the surrounding forests. Finally, we investigated the hydrological connectivity across the peatland watershed complex during early spring – a critical period where water table is elevated from snowmelt – using extended hydrological records from MEF (e.g., snow and frost depths, water table elevations, streamflow). The importance of thermal and wintertime processes within the Energy Exascale Earth System Model (E3SM) was determined through sensitivity analyses. Results from data analyses show that (i) streamflow has decreased over decades likely due to increased evapotranspiration rates (despite no detectable trends in precipitation), (ii) spring streamflow generation is controlled by a sequence of fill-and-spill pathways from the snowpack to the stream through peatland water stores, and (iii) frost depth is a key explanatory variable for the timing and magnitude of streamflow. These results suggest that frost plays an important role in connecting surface water storage in peatlands to stream outlets, and that the hydrological connectivity across the peatland watershed complex can mediate the sensitivity of hydrological responses to climate variations.
Sonification algorithms convert information to audible representations. The 2025 Seed Money project “Exploring Electromagnetic Signals through Sonification” seeks to create machine-learning based methods to convert electromagnetic signals to sound for human interpretation. However, as a precursor to ML-based methods, some heuristic methods have been investigated in preparation for the seed project. This report covers some example methods, applied to the “Flaming Moes” dataset of unintended radiative emissions (URE), with some simple metrics to study the device discrimination properties of the sonification as well as the “pleasantness” of the methods.
During the first phase of the project (2018/05-2021/05), we proved the hypothesis that, without tuning, high vertical resolution improves the representation of unresolved, parameterized low altitude clouds such as stratocumulus clouds in global climate models. We evaluated the effectiveness of the newly developed computational framework, Framework for Improvement by Vertical Enhancement (FIVE) by implementing it into E3SM. FIVE aims to improve representation of the target cloud, low level cloud for this project, with use of a locally high vertical resolution for computation of selected processes. FIVE was assessed via direct comparison among E3SM, E3SM-FIVE, and satellite data as well as a newly developed ensemble artificial neural network methodology. We demonstrated that E3SM-FIVE remarkably improves marine stratocumulus representation. To advance the FIVE methodology, we took a first step toward the adaptive vertical grid in the FIVE method by modifying the E3SM single column model. For future application of FIVE to the global storm resolving model with a few km horizontal grid resolution, we developed the vertical-meridional two-dimensional (2D) Hadley circulation model, which allows one to run simulations with much higher vertical resolution and significantly longer duration than current three-dimensional global storm resolving model. During the second phase of the project (2021/05-2023/11; period for this technical report), we sought a way to appropriately transform FIVE to a regionalized version of FIVE, which allows one to select locations with/without FIVE. In parallel, we demonstrated that E3SM-FIVE with a 25-km mesh significantly reduced the bias associated with coastal stratocumulus. Furthermore, we showed that the same improvement was able to be obtained with the use of both the Regional Refined Model (RRM) targeted to one of the stratocumulus regions with 25-km resolution and FIVE. We explored a new implementation strategy of FIVE with our 2D Hadley circulation model. In parallel we applied the 2D Hadley circulation model to study the double intertropical convergence zone bias with storm resolving model resolution and aerosol-cloud interactions within the Hadley circulation with near large eddy simulation resolution. Last, we have been investigating Arctic mixed-phase stratocumulus clouds with large eddy simulations in order to improve their representation in global models. During the course of the entire project, 6 journal articles were published, and 3 manuscripts are currently in preparation. We gave a total of 30 presentations at various domestic and international conferences. In addition we gave 6 seminar talks at universities and a national laboratory. E3SM- FIVE is available as a branch of E3SM.
A columnar data representation is known to be an efficient way for data storage, specifically in cases when the analysis is often done based only on a small fragment of the available data structures. A data representation like Apache Parquet is a step forward from a columnar representation, which splits data horizontally to allow for easy parallelization of data analysis. Based on the general idea of columnar data storage, working on the [LDRD Project], we have developed a striped data representation, which, we believe, is better suited to the needs of High Energy Physics data analysis. A traditional columnar approach allows for efficient data analysis of complex structures. While keeping all the benefits of columnar data representations, the striped mechanism goes further by enabling easy parallelization of computations without requiring special hardware. We will present an implementation and some performance characteristics of such a data representation mechanism using a distributed no-SQL database or a local file system, unified under the same API and data representation model. The representation is efficient and at the same time simple so that it allows for a common data model and APIs for wide range of underlying storage mechanisms such as distributed no-SQL databases and local file systems. Striped storage adopts Numpy arrays as its basic data representation format, which makes it easy and efficient to use in Python applications. The Striped Data Server is a web service, which allows to hide the server implementation details from the end user, easily exposes data to WAN users, and allows to utilize well known and developed data caching solutions to further increase data access efficiency. We are considering the Striped Data Server as the core of an enterprise scale data analysis platform for High Energy Physics and similar areas of data processing. We have been testing this architecture with a 2TB dataset from a CMS dark matter search and plan to expand it to multiple 100 TB or even PB scale. We will present the striped format, Striped Data Server architecture and performance test results.
Over the course of this project, we have successfully carried out proposed studies and reported our findings in leading peer-reviewed journals and national/international conferences. So far, we have published 7 peer-reviewed articles reporting these findings and contributed to 1 additional peer-reviewed article. One additional manuscript resulting from this project is currently under review. We have made 22 presentations at national and international conferences about the results from this project. We have also given 3 presentations at the E3SM all-hands or PI meetings to update the E3SM community on our results.
Reliable climate predictions are important for making robust decisions in response to the changing climate. This project aims to reduce mis-modeling uncertainties arising from the representation of the land-atmosphere coupling in the Energy Exascale Earth System Model (E3SM) by using a machine learning approach. This approach will use an encoder-decoder architecture to represent the information that is developed in the land model and given to the atmosphere model. The simulated data will be taken from the E3SM simulation. However, the incorporation of observed data into the simulated dataset reduces mis-modeling uncertainties.
Liquid argon time projection chambers (LArTPCs) offer millimeter-scale 3D images of particle trajectories, enabling precision studies of neutrino oscillation, detection of supernova and solar neutrinos, searches for exotic dark matter, and proton decay. Current approaches utilize supervised machine learning models, requiring extensive simulations of particle physics and detector response that can introduce bias. Self-supervised learning (SSL), a machine learning approach that learns useful representations of unlabeled data from the data itself, has significantly advanced how large datasets are utilized for representation learning; however, its potential for applications to sensory data in high precision particle physics experiments remains largely unexplored. We introduce the Point-based liquid argon masked autoencoder (PoLAr-MAE), a self-supervised framework that learns physically meaningful representations directly from unlabeled LArTPC images. PoLAr-MAE achieves remarkable data efficiency for a point-level segmentation task, outperforming fully supervised methods in low data regimes. Linear classifiers on model outputs demonstrate robust performance across multiple downstream tasks. Our results position sensor-level SSL as a practical foundation model strategy for LArTPCs.
These 20-meter spatial resolution gridded products provide per-pixel fractional cover (%) of Next Generation Ecosystem Experiments (NGEE) Arctic Plant Functional Types (PFTs) Tier 3 across Alaska, north of the boreal treeline. The products were developed for the NGEE Arctic project, which is improving Arctic vegetation representation and parameterization of the E3SM Land Model. This dataset includes 8 files containing fractional cover for NGEE Tier 3 PFTs (https://data.ess-dive.lbl.gov/view/doi:10.15485/2529470): (1) bryophytes; (2) lichens; (3) non-vascular plants, i.e., the sum of lichens and bryophytes; (4) deciduous shrubs, (5) evergreen shrubs, (6) forbs, (7) graminoids, and a non-PFT class, (8) litter. Each pixel contains the percent cover (expressed as a fraction of total ground cover) that was predicted by random-forest regression models. The random-forest models were trained on cover data collected at 978 plots from 2010 to 2021, of which are archived in the Pan-Arctic Vegetation Cover (PAVC) database (https://data.ess-dive.lbl.gov/datasets/doi:10.15485/2483557). The plot cover was linked to 20-meter spatial resolution, satellite-derived predictor variables: Sentinel-2 spectra and Sentinel-1 polarizations averaged over the 2019 growing season, as well as topographical features derived from ArcticDEM. Then, spatio-temporally anomalous plot data that introduced large variability to the regression outcomes were dropped using the Cook’s distance outlier detection method, and the models were re-created using high-quality plots and their associated satellite derived explanatory variables per each PFT. The correlations between plot-observed and satellite-derived fractional cover for all PFTs were well correlated (R2 = 0.69–0.95 and 0.5 for litter) and had low RMSE bias (0.02–0.11). This research was performed as a part of the NGEE Arctic project. The NGEE Arctic project was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research.
Abstract We propose coupling a physics-based reduction framework with a suited response decomposition technique to derive a component-oriented reduction (COR) approach, which is suitable for assembly systems featuring localized nonlinearities. Dependencies on influencing parameters are injected into the reduced-order model (ROM), thus ensuring robustness and validity over a domain of parametric inputs, while capturing nonlinear effects. The implemented approach employs individual component modes to capture localized features while additionally relying on reduced modes of a global nature to approximate the system’s dynamics accurately. The global modes are derived from a linear monolithic system, defined as a result of a coordinate separation scheme, which permits the proposed COR-ROM to naturally couple the response between linear and nonlinear subdomains. The derived low-order representation utilizes a proper orthogonal decomposition projection and is additionally reinforced with the inclusion of a hyper-reduction technique to capture the underlying high-fidelity model response while providing accelerated computations. The resulting approach is exemplified in the synthetic case studies of a four-story shear frame with multiple nonlinear regions driven by hysteresis and a large-scale kingpin connection featuring plasticity.
The phylum Actinobacteria includes important human pathogens like Mycobacterium tuberculosis and Corynebacterium diphtheriae and renowned producers of secondary metabolites of commercial interest, yet only a small part of its diversity is represented by sequenced genomes. Here, we present 824 actinobacterial isolate genomes in the context of a phylum-wide analysis of 6,700 genomes including public isolates and metagenome-assembled genomes (MAGs). We estimate that only 30%–50% of projected actinobacterial phylogenetic diversity possesses genomic representation via isolates and MAGs. A comparison of gene functions reveals novel determinants of host-microbe interaction as well as environment-specific adaptations such as potential antimicrobial peptides. We identify plasmids and prophages across isolates and uncover extensive prophage diversity structured mainly by host taxonomy. Analysis of >80,000 biosynthetic gene clusters reveals that horizontal gene transfer and gene loss shape secondary metabolite repertoire across taxa. Our observations illustrate the essential role of and need for high-quality isolate genome sequences.
Abstract The ability of deep learning methods to perform classification and regression tasks relies heavily on their capacity to uncover manifolds in high-dimensional data spaces and project them into low-dimensional representation spaces. In this study, we investigate the structure and character of the manifolds generated by classical variational autoencoder (VAE) approaches and deep kernel learning (DKL). In the former case, the structure of the latent space is determined by the properties of the input data alone, while in the latter, the latent manifold forms as a result of an active learning process that balances the data distribution and target functionalities. We show that DKL with active learning can produce a more compact and smooth latent space which is more conducive to optimization compared to previously reported methods, such as the VAE. We demonstrate this behavior using a simple cards dataset and extend it to the optimization of domain-generated trajectories in physical systems. Our findings suggest that latent manifolds constructed through active learning have a more beneficial structure for optimization problems, especially in feature-rich target-poor scenarios that are common in domain sciences, such as materials synthesis, energy storage, and molecular discovery. The Jupyter Notebooks that encapsulate the complete analysis accompany the article.
Recent advances in both theoretical and computational methods have enabled large-scale, precision calculations of the properties of atomic nuclei. With the growing complexity of modern nuclear theory, however, also comes the need for novel methods to perform systematic studies and quantify the uncertainties of models when confronted with experimental data. Here, this study presents an application of such an approach, the reduced basis method, to substantially lower computational costs by constructing a significantly smaller Hamiltonian subspace informed by previous solutions. Our method shows comparable efficiency and accuracy to other dimensionality reduction techniques on an artificial three-body bound system while providing a richer representation of physical information in its projection and training subspace. This methodological advancement can be applied in other contexts and has the potential to greatly improve our ability to systematically explore theoretical models and thus enhance our understanding of the fundamental properties of nuclear systems.