Search NASA⌕ Search

SEARCH · Search NASA

Results for “Open data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Deep Generative Models that Solve PDEs: Distributed Computing for Training Large Data-Free Models

Recent progress in scientific machine learning (SciML) has opened up the possibility of training novel neural network architectures that solve complex partial differential equations (PDEs). Several (nearly data free) approaches have been recently reported that successfully solve PDEs, with examples including deep feed forward networks, generative networks, and deep encoder-decoder networks. However, practical adoption of these approaches is limited by the difficulty in training these models, especially to make predictions at large output resolutions (≥1024×1024). Here we report on a software framework for data parallel distributed deep learning that resolves the twin challenges of training these large SciML models - training in reasonable time as well as distributing the storage requirements. Our framework provides several out of the box functionality including (a) loss integrity independent of number of processes, (b) synchronized batch normalization, and (c) distributed higher-order optimization methods. We show excellent scalability of this framework on both cloud as well as HPC clusters, and report on the interplay between bandwidth, network topology and bare metal vs cloud. We deploy this approach to train generative models of sizes hitherto not possible, showing that neural PDE solvers can be viably trained for practical applications. We also demonstrate that distributed higher-order optimization methods are 2-3× faster than stochastic gradient-based methods and provide minimal convergence drift with higher batch-size.

PDEs↗
DOE OSTI2022

Explainable Bayesian Neural Network for Probabilistic Transient Stability Analysis Considering Wind Energy

While several data-driven models have been developed for transient stability assessment, how to consider the uncertainties from load and renewable generations and provide interpretation of data-driven assessment results are still open. This paper proposes an explainable Bayesian Neural Network (BNN) for probabilistic transient stability assessment (TSA). By extracting the uncertainties from loads and wind farms, the BNN model can make a reliable prediction and quantify the prediction uncertainties. We also develop the Gradient Shap algorithm to make the global and local explanations for the probabilistic TSA model, a significant advantage over existing black-box data-driven methods. Numerical results on the modified IEEE 39-bus system show that the proposed method outperforms the existing methods in terms of prediction accuracy and uncertainty quantification capabilities. The explainability of the proposed method allows system operators to design preventive controls for enhancing system stability.

Bayesian Neural Network↗
DOE OSTI2021

Accelerated, scalable and reproducible AI-driven gravitational wave detection

The development of reusable artificial intelligence (AI) models for wider use and rigorous validation by the community promises to unlock new opportunities in multi-messenger astrophysics. Here we develop a workflow that connects the Data and Learning Hub for Science, a repository for publishing AI models, with the Hardware-Accelerated Learning (HAL) cluster, using funcX as a universal distributed computing service. Using this workflow, an ensemble of four openly available AI models can be run on HAL to process an entire month's worth (August 2017) of advanced Laser Interferometer Gravitational-Wave Observatory data in just seven minutes, identifying all four binary black hole mergers previously identified in this dataset and reporting no misclassifications. This approach combines advances in AI, distributed computing and scientific data infrastructure to open new pathways to conduct reproducible, accelerated, data-driven discovery. By combining a repository for artificial intelligence models and a supercomputing cluster, an entire month's worth of advanced LIGO data is analysed in just 7 min, finding all binary black hole mergers previously identified in this dataset and reporting no misclassifications.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Motion Tracking Above and Below Water Dataset

This data set includes one trial of above and under water motion tracking measurements from a Qualysis motion tracking system. The Qualisys native .qtm file can be opened by the Qualisys Track Manager software. Data from this file has been exported to a tab separated value (.tsv) file which is a generic ASCII file format that can be read by a text editor, MATLAB, Excel, etc... Also exported is a native MATLAB formatted file (.mat) which can be loaded directly into MATLAB. The trial is from a three body wave energy converter device, using the underwater system for the central nacelle data, and above water system for the fore and aft floats.

16 TIDAL AND WAVE POWER↗
DOE OSTI2023

Snekmer: a scalable pipeline for protein sequence fingerprinting based on amino acid recoding

Abstract Motivation The vast expansion of sequence data generated from single organisms and microbiomes has precipitated the need for faster and more sensitive methods to assess evolutionary and functional relationships between proteins. Representing proteins as sets of short peptide sequences (kmers) has been used for rapid, accurate classification of proteins into functional categories; however, this approach employs an exact-match methodology and thus may be limited in terms of sensitivity and coverage. We have previously used similarity groupings, based on the chemical properties of amino acids, to form reduced character sets and recode proteins. This amino acid recoding (AAR) approach simplifies the construction of protein representations in the form of kmer vectors, which can link sequences with distant sequence similarity and provide accurate classification of problematic protein families. Results Here, we describe Snekmer, a software tool for recoding proteins into AAR kmer vectors and performing either (i) construction of supervised classification models trained on input protein families or (ii) clustering for de novo determination of protein families. We provide examples of the operation of the tool against a set of nitrogen cycling families originally collected using both standard hidden Markov models and a larger set of proteins from Uniprot and demonstrate that our method accurately differentiates these sequences in both operation modes. Availability and implementation Snekmer is written in Python using Snakemake. Code and data used in this article, along with tutorial notebooks, are available at http://github.com/PNNL-CompBio/Snekmer under an open-source BSD-3 license. Supplementary information Supplementary data are available at Bioinformatics Advances online.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Cosmology intertwined: A review of the particle physics, astrophysics, and cosmology associated with the cosmological tensions and anomalies

The standard Λ Cold Dark Matter (ΛCDM) cosmological model provides a good description of a wide range of astrophysical and cosmological data. However, there are a few big open questions that make the standard model look like an approximation to a more realistic scenario yet to be found. In this paper, we list a few important goals that need to be addressed in the next decade, taking into account the current discordances between the different cosmological probes, such as the disagreement in the value of the Hubble constant H 0 , the σ 8 – S 8 tension, and other less statistically significant anomalies. While these discordances can still be in part the result of systematic errors, their persistence after several years of accurate analysis strongly hints at cracks in the standard cosmological scenario and the necessity for new physics or generalisations beyond the standard model. In this paper, we focus on the 5.0 σ tension between the Planck CMB estimate of the Hubble constant H 0 and the SH0ES collaboration measurements. After showing the H 0 evaluations made from different teams using different methods and geometric calibrations, we list a few interesting new physics models that could alleviate this tension and discuss how the next decade's experiments will be crucial. Moreover, we focus on the tension of the Planck CMB data with weak lensing measurements and redshift surveys, about the value of the matter energy density Ω m , and the amplitude or rate of the growth of structure ( σ 8 , f σ 8 ). We list a few interesting models proposed for alleviating this tension, and we discuss the importance of trying to fit a full array of data with a single model and not just one parameter at a time. Additionally, we present a wide range of other less discussed anomalies at a statistical significance level lower than the H 0 – S 8 tensions which may also constitute hints towards new physics, and we discuss possible generic theoretical approaches that can collectively explain the non-standard nature of these signals. Finally, we give an overview of upgraded experiments and next-generation space missions and facilities on Earth that will be of crucial importance to address all these open questions.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2026

GenomeDepot: data management system for microbial comparative genomics

Summary GenomeDepot is an open-source web-based platform for annotation, management, and comparative analysis of microbial genomic sequences and associated data including ortholog families, protein domains, operons, regulatory interactions, strain taxonomy, and sample metadata. GenomeDepot supports rapid creation of websites for user-defined genome collections that include bioinformatic tools for interactive genome browsing, Basic Local Alignment Search Tool (BLAST) search, annotation search, comparative genomic neighborhood visualization, and sequence download. Gene function annotations are generated by a customizable annotation pipeline. The pipeline runs annotation tools in Conda environments and can be easily extended with additional user-specified tools. Availability and implementation GenomeDepot is open source and distributed under the GNU General Public License via GitHub (https://github.com/aekazakov/genome-depot). GenomeDepot is implemented in Python and was tested in Ubuntu Linux. Full installation instructions and documentation are available at https://aekazakov.github.io/genome-depot/. GenomeDepot demo server is freely accessible at https://iseq.lbl.gov/demogd/.

Kazakov, Alexey [Lawrence Berkeley National Labora↗
DOE OSTI2022

Learning Latent Interactions for Event Identification via Graph Neural Networks and PMU Data

Phasor measurement units (PMUs) are being widely installed on power systems, providing a unique opportunity to enhance wide-area situational awareness. One essential application is the use of PMU data for real-time event identification. However, how to take full advantage of all PMU data in event identification is still an open problem. Thus, we propose a novel method that performs event identification by mining interaction graphs among different PMUs. The proposed interaction graph inference method follows an entirely data-driven manner without knowing the physical topology. Moreover, unlike previous works that treat interactive learning and event identification as two different stages, our method learns interactions jointly with the identification task, thereby improving the accuracy of graph learning and ensuring seamless integration between the two stages. Moreover, to capture multi-scale event patterns, a dilated inception-based method is investigated to perform feature extraction of PMU data. To test the proposed data-driven approach, a large real-world dataset from tens of PMU sources and the corresponding event logs have been utilized in this work. We report numerical results validate that our method has higher classification accuracy compared to previous methods.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Using Atmospheric Inverse Modelling of Methane Budgets with Copernicus Land Water and Wetness Data to Detect Land Use-Related Emissions

Climate change mitigation requires countries to report their annual greenhouse gas (GHG) emissions and sinks, including those from land use, land use change, and forestry (LULUCF). In Finland, the LULUCF sector plays a crucial role in achieving net-zero GHG emissions, as the sector is expected to be a net sink. However, accurate estimates of LULUCF-related GHG emissions, such as methane (CH 4 ), remain challenging. We estimated LULUCF-related CH 4 emissions in Finland in 2013–2020 by combining national land cover and remote-sensed surface wetness data with CH 4 emissions estimated by an inversion model. According to our inversion model, most of Finland’s CH 4 emissions were attributed to natural sources such as open pristine peatlands. However, our research indicated that forests with thin tree cover surrounding open peatlands may also be a significant source of CH 4 . Unlike open pristine peatlands and pristine peatlands with thin tree cover, surrounding transient forests are included in the Finnish GHG inventory if they meet the criteria used for forest land. The current Finnish national GHG inventory may therefore underestimate CH 4 emissions from forested organic soils surrounding open peatlands, although more precise methods and data are needed to verify this. Given the potential impact on net GHG emissions, CH 4 emissions from transitional forests on organic soils should be further investigated. Furthermore, the results demonstrate the potential of combining atmospheric inversion modelling of GHGs with diverse data sources and highlight the need for methods to more easily combine atmospheric inversions with national GHG inventories.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Generic and ML Workloads in an HPC Datacenter: Node Energy, Job Failures, and Node-Job Analysis

HPC datacenters offer a backbone to the modern digital society. Increasingly, they run Machine Learning (ML) jobs next to generic, compute-intensive workloads, supporting science, business, and other decision-making processes. However, understanding how ML jobs impact the operation of HPC datacenters, relative to generic jobs, remains desirable but understudied. In this work, we leverage long-term operational data, collected from a national-scale production HPC datacenter, and statistically compare how ML and generic jobs can impact the performance, failures, resource utilization, and energy consumption of HPC datacenters. Our study provides key insights, e.g., ML-related power usage causes GPU nodes to run into temperature limitations, median/mean runtime and failure rates are higher for ML jobs than for generic jobs, both ML and generic jobs exhibit highly variable arrival processes and resource demands, significant amounts of energy are spent on unsuccessfully terminating jobs, and concurrent jobs tend to terminate in the same state. We open-source our cleaned-up data traces on Zenodo (https://doi. org/10.5281/zenodo.13685426), and provide our analysis toolkit as software hosted on GitHub (https://github.com/atlarge-research/2024-icpads-hpc-workload-characterization). This study offers multiple benefits for data center administrators, who can improve operational efficiency, and for researchers, who can further improve system designs, scheduling techniques, etc.

crossanalysis↗
DOE OSTI2026

Location Identifiers, Metadata, and Map for Field Measurements at the East-Taylor Watershed Community Observatory, Colorado, USA (Version 3.3)

This dataset contains identifiers, metadata, and a map of the locations where field measurements have been conducted at the East-Taylor Watershed Community Observatory located in the Upper Colorado River Basin, United States. This is version 3.3 of the dataset and replaces the prior version 3.2 (see below for details on changes between the versions). Dataset description: The East River-Taylor Watershed is the primary field site of the Watershed Function Scientific Focus Area (WFSFA) and the Rocky Mountain Biological Laboratory. Researchers from several institutions generate highly diverse hydrological, biogeochemical, climate, vegetation, geological, remote sensing, and model data at the East-Taylor Watershed in collaboration with the WFSFA. Thus, the purpose of this dataset is to maintain an inventory of the field locations and instrumentation to provide information on the field activities in the East-Taylor Watershed and coordinate data collected across different locations, researchers, and institutions. The dataset contains (1) a README file with information on the various files, (2) three csv files describing the metadata collected for each surface point location, plot and region registered with the WFSFA, (3) csv files with metadata and contact information for each surface point location registered with the WFSFA, (4) a csv file with with metadata and contact information for plots, (5) a csv file with metadata for geographic regions and sub-regions within the watershed, (6) a compiled xlsx file with all the data and metadata which can be opened in Microsoft Excel, (7) a kml map of the locations plotted in the watershed which can be opened in Google Earth, (8) a jpg image of the kml map which can be viewed in any photo viewer, and (9) a zipped file with the registration templates used by the SFA team to collect location metadata. The zipped template file contains two csv files with the blank templates (point and plot), two csv files with instructions for filling out the location templates, and one compiled xlsx file with the instructions and blank templates together. Additionally, the templates in the xlsx include drop down validation for any controlled metadata fields. Persistent location identifiers (Location_ID) are determined by the WFSFA data management team and are used to track data and samples across locations. Dataset uses: This location metadata is used to update the Watershed SFA’s publicly accessible Field Information Portal (an interactive field sampling metadata exploration tool; https://wfsfa-data.lbl.gov/watershed/), the kml map file included in this dataset, and other data management tools internal to the Watershed SFA team. Version Information: The latest version of this dataset publication is version 3.3. This version contains 167 new point locations, 1 new plot, and 2 new geographic regions. Overall, there are a total of 1439 point locations, 75 plots, and 54 geographic regions. Additionally, the kml map of locations and image now includes two boundaries (Upper Ohio Creek (UO) and Carbon Creek (CA)) outside of the East River watershed (USGS HUC-10) and accompanying stream network that represents areas of focus. Refer to methods for further details on the version history. This dataset will be updated on a periodic basis with new measurement location information. Researchers interested in having their East-Taylor Watershed measurement locations added to this list should reach out to the WFSFA data management team at wfsfa-data@googlegroups.com. Acknowledgments: Please cite this dataset if using any of the location metadata in other publications or derived products. If using the location metadata for the 2018 NEON hyperspectral campaign, additionally cite Chadwick et al. (2020). doi:10.15485/1618130. This work was supported by the Watershed Function Science Focus Area at Lawrence Berkeley National Laboratory funded by the US Department of Energy, Office of Science, Biological and Environmental Research under Contract No. DE-AC02-05CH11231. Part of this work was performed at SLAC Accelerator Laboratory funded by the US Department of Energy, Office of Science, Biological and Environmental Research under Contract No. DE-AC02-76SF00515.

2018 NEON and 2025 CHESS Campaigns↗
DOE OSTI2022

The Open Cluster Chemical Abundances and Mapping Survey. VI. Galactic Chemical Gradient Analysis from APOGEE DR17

The goal of the Open Cluster Chemical Abundances and Mapping (OCCAM) survey is to constrain key Galactic dynamic and chemical evolution parameters by the construction and analysis of a large, comprehensive, uniform data set of infrared spectra for stars in hundreds of open clusters. This sixth contribution from the OCCAM survey presents analysis of SDSS/APOGEE Data Release 17 (DR17) results for a sample of stars in 150 open clusters, 94 of which we designate to be "high-quality" based on the appearance of their color–magnitude diagram. We find the APOGEE DR17-derived [Fe/H] values to be in good agreement with those from previous high-resolution spectroscopic open cluster abundance studies. Using a subset of the high-quality sample, the Galactic abundance gradients were measured for 16 chemical elements, including [Fe/H], for both Galactocentric radius ($R$ GC ) and guiding center radius ($R$ guide ). We find an overall Galactic [Fe/H] versus RGC gradient of -0.073 ± 0.002 dex kpc -1 over the range of 6 > $R$ GC < 11.5 kpc, and a similar gradient is found for [Fe/H] versus $R$ guide . Significant Galactic abundance gradients are also noted for O, Mg, S, Ca, Mn, Na, Al, K, and Ce. Our large sample additionally allows us to explore the evolution of the gradients in four age bins for the remaining 15 elements.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Developing Flexible, Networked Lighting Control Systems That Reliably Save Energy in California Buildings

An important strategy to meet California's ambitious energy efficiency goals is to use innovative wireless communications, embedded sensors, data analytics and controls to significantly reduce lighting energy use in commercial buildings. This project developed a suite of networked lighting solutions to further this goal. The technologies include a platform for low-cost sensing, distributed intelligence and communications, the “PermaMote,” which is a self-powered sensor and controller for lighting applications. The project team also developed a task ambient daylighting system that integrates sensors with data-driven daylighting control using an open communication interface, called the “Readings-At-Desk” (RAD) system. To address the problem of building occupants being confused about how to operate traditional lighting control systems, the research team created content that could be the basis for a user interface standard for lighting controls. Finally, to address the difficulty of ensuring that advanced lighting control systems actually deliver their promised energy savings, the project team developed a new method for evaluating and specifying lighting systems’ performance. The research team validated these technologies in the laboratory, showing significant lighting energy savings, up to 73% for the PermaMote sensor system from occupancy control and daylight dimming features, compared to the same light source (LED replacement lamps) operated via simple on/off scheduling. The project team also developed a proposed standard lighting data model and user interface elements, which were contributed to the ANSI Lighting Systems Committee (C137) for standardization. Existing data models are incomplete and inconsistent, whereas the lighting-specific data model developed here is clear and comprehensive, to serve as a starting point for creating common, universally agreed upon semantic definitions of key lighting parameters, to promote interoperability. For the task on verifiable performance of lighting systems, the project team developed a more effective metric for capturing the actual energy impact of a lighting system over time — the energy usage intensity (kWh/ft2/year). Three commercial lighting systems were tested in FLEXLAB® using this new metric, and the tests show a wide range in the accuracy of the self-reported energy-use metric, from 0.5% to 28% error compared to direct measurement of lighting energy using dedicated submeters. Overall, the project team estimates that these advanced technologies can reduce California office lighting energy use by 20% (above and beyond normal advanced lighting controls mandated by Title 24), resulting in about 1,600 GWh/year in savings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Advances in building data management for building performance standards using the SEED platform

Reducing energy consumption and greenhouse gas emissions in the built environment is a critical step in achieving emission goals to mitigate climate change impacts. Local, federal, and international jurisdictions are deploying several methods to reduce energy and emissions such as voluntary and mandatory benchmarking and building performance standards, requiring building owners to reach energy and emission targets. Jurisdictions leveraging benchmarking and building performance standards require knowledge of the buildings covered; which is a large task due to staffing constraints, limited information on building characteristics and tax parcel data, and the need for advanced data management techniques to align datasets. This paper describes an open-source platform's recent advances to create consistent taxonomies, identify erroneous data, enable auditability, and track building performance. The paper concludes with two use cases on how the platform has been used by jurisdictions.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Annual Technology Baseline: ATB-calc Open Source Tools [Slides]

The Annual Technology Baseline (ATB) team will introduce the new open-source Python tools for processing and interacting with electricity ATB data and provide helpful user demonstrations, including how to: extract data from the ATB workbook and calculate levelized cost of electricity (LCOE) in Python; programmatically interact with and modify ATB data; and use the tools to modify the tax credit assumptions of the ATB to account for bonus credits from the Inflation Reduction Act of 2022.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2022

Development of an Open-source Alloy Selection and Lifetime Assessment Tool for Structural Components in CSP

Lack of sufficient data on high temperature mechanical and corrosion behavior of structural materials is a huge barrier in the technological maturity of current and future Concentrating Solar Power (CSP) technologies. Rapid development and selection of materials cannot be achieved by expensive and time-consuming acquisition of experimental data. The goal of the proposed work is development of an open-source alloy selection and lifetime prediction tool that will integrate validated physics-based models to describe influence of temperature, alloy composition, environment and component geometry (thickness) on mechanical and corrosion behavior of Ni and Fe-based alloys employed in molten salts/sCO 2 heat exchangers. This one-year project leveraged the extensive dataset on the creep\corrosion behavior of candidate materials generated at ORNL through past projects and input from current collaborations with industrial partners. Based on previous experience and the feedback provided by industry (Brayton Energy and Echogen), three candidate materials of interest, Ni-based alloys 740H, 282 and 625 and application-specific operating conditions (max. temperature of 730 °C and stress of 150 MPa) were identified for the heat exchanger. An extensive corrosion and creep dataset was assimilated for the relevant operating conditions and was supported by detailed characterization of about 100 metallographic cross-sections. The corrosion dataset consisted of scanning electron microscopy images (secondary electron and backscatter electron), measured concentration profiles of alloying elements using energy dispersive X-ray spectroscopy (EDS), widths of denuded zones (dissolution of strengthening phases) and depths of attack in molten KCl-MgCl 2 mixtures using image analyses. The creep dataset comprised of creep rupture data and creep strain curves (for 740H and 282). Coupled thermodynamic-kinetic microstructure-based models were employed to predict the stress-corrosion induced compositional and phase evolutions in the alloy during operation under the identified operating conditions. Reduced order models were developed from advanced physics-based models and were integrated in a user-friendly alloy selection tool. The corrosion model was able to predict the time to a critical Cr concentration at the oxide/alloy interface (chemical lifetime) within ±10% (1 standard deviation) of typical statistical variation in corrosion tests and EDS measurement errors (±0.5 wt%). The initial scope of the project was limited to predict creep rupture times (Larson-Miller parameter). Based on the input provided by industry, the mechanical lifetime of the heat exchanger is governed by accumulated creep strains (2%) rather than creep rupture. To be able to predict the times to specific creep strains, a more extensive creep model development was undertaken largely beyond the initial scope of the project. The continuum damage mechanics creep model was able to predict times to 2% creep strain, t 2% with an accuracy of ±500h. Ultimately, a screening protocol for SiC was generated to demonstrate the pathway for integration of one of the currently immature materials from a commercial adoption standpoint in the current material evaluation tool. The modeling tool developed here is accessible to the science community and stakeholders and lays the foundation for methods that will enable a rapid evaluation of optimum materials for CSP applications and reliable prediction of material degradation thereby considerably reducing operational costs, improving reliability and increasing overhaul intervals. However, the complete potential of such a tool to include a wider range of materials and test conditions can only be realized with a more concentrated combined experimental-characterization-computation effort.

14 SOLAR ENERGY↗