Search NASA⌕ Search

SEARCH · Search NASA

Results for “public data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

RTN-117: Image Calibration and Instrument Signal Removal for the First Year of the LSST

The NSF-DOE Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST) requires calibration products that provide uniform, stable, and accurate photometric and astrometric performance across the 3.2 gigapixel focal plane and throughout the 10-year survey. This paper details the algorithms and workflows used to produce instrument calibrations and remove instrumental artifacts for Data Preview 2 (DP2)---the first end-to-end processing demonstration using on-sky data with the LSST Camera (LSSTCam). We describe the verification, acceptance, and certification framework used to assess calibration quality and quantify residual systematics. We show baseline metrics on calibrated science images to evaluate the robustness of the calibration and instrument signature removal (ISR) data processing pipelines for DP2. Finally, we summarize the known limitations observed in DP2 production and outline expected algorithmic improvements for the first public LSST data release (Data Release~1, DR1).

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

EXSCLAIM!

Due to recent improvements in image resolution and acquisition speed, materials microscopy is experiencing an explosion of published imaging data. The standard publication format, while sufficient for traditional data ingestion scenarios where a select number of images can be critically examined and curated manually, is not conducive tolarge-scale data aggregation or analysis, hindering data sharing and reuse. Most images in publications are presented as components of a larger figure with their explicit context buried in the main body or caption text, so even if aggregated, collections of images with weak or no digitized contextual labels have limited value. To solve the problem of curating labeled microscopy data from literature, we introduce the EXSCLAIM! Python toolkit for the automatic EXtraction, Separation, and Caption-based natural Language Annotation of IMages from scientific literature. The software is implemented through a three part pipeline: the JournalScraper, which searches the web and downloads figures and captions based on a user provided query, the CaptionDistributor, which separates caption text based on the subfigure each portion of the caption refers to, and the FigueSeparator, which separates figures into component subfigures and extracts other visual information. Also included is a Django user interface for exploring the resulting dataset.

CHAN, MARIA↗
DOE OSTI2024

Statistical Performance of Forced Oscillation Detectors in the Presence of Missing Measurements

In bulk power systems, measurement-based monitoring for large oscillations can help maintain system reliability. One of the challenges encountered in a recent field demonstration was the unavailability of measurements due to underlying measurement quality or communication problems. During the demonstration, the oscillation detector ignored a measurement location if even 10 seconds of data was missing. To extend the detector's ability to operate in these conditions, this paper evaluates the impact of three methods for addressing missing data. The strengths and weaknesses of each approach are evaluated using theoretical expressions for the probability of detection along with results from simulated data and publicly available field measurements. Based on these results, a suitable approach is identified that can extend the oscillation detector's performance when large segments of data are missing.

Follum, James D.↗
DOE OSTI2020

The ASHRAE Great Energy Predictor III competition: Overview and results

In late 2019, ASHRAE hosted the Great Energy Predictor III (GEPIII) machine learning competition on the Kaggle platform. This launch marked the third energy prediction competition from ASHRAE and the first since the mid-1990s. In this updated version, the competitors were provided with over 20 million points of training data from 2,380 energy meters collected for 1,448 buildings from 16 sources. This competition’s overall objective was to find the most accurate modeling solutions for the prediction of over 41 million private and public test data points. Furthermore, the competition had 4,370 participants, split across 3,614 teams from 94 countries who submitted 39,403 predictions. In addition to the top five winning workflows, the competitors publicly shared 415 reproducible online machine learning workflow examples (notebooks), including over 40 additional, full solutions. This paper gives a high-level overview of the competition preparation and dataset, competitors and their discussions, machine learning workflows and models generated, winners and their submissions, discussion of lessons learned, and competition outputs and next steps. The most popular and accurate machine learning workflows used large ensembles of mostly gradient boosting tree models, such as LightGBM. Similar to the first predictor competition, preprocessing of the data sets emerged as a key differentiator.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Pretraining Billion-Scale Geospatial Foundational Models on Frontier

As AI workloads increase in scope, generalization capability becomes challenging for small task-specific models and their demand for large amounts of labeled training samples increases. On the contrary, Foundation Models (FMs) are trained with internet-scale unlabeled data via self-supervised learning and have been shown to adapt to various tasks with minimal fine-tuning. Although large FMs have demonstrated significant impact in natural language processing and computer vision, efforts toward FMs for geospatial applications have been restricted to smaller size models, as pretraining larger models requires very large computing resources equipped with state-of-the-art hardware accelerators. Current satellite constellations collect 100+TBs of data a day, resulting in images that are billions of pixels and multimodal in nature. Such geospatial data poses unique challenges opening up new opportunities to develop FMs. We investigate billion scale FMs and HPC training profiles for geospatial applications by pretraining on publicly available data. We studied from end-to-end the performance and impact in the solution by scaling the model size. Our larger 3B parameter size model achieves up to 30% improvement in top1 scene classification accuracy when comparing a 100M parameter model. Moreover, we detail performance experiments on the Frontier supercomputer, America's first exascale system, where we study different model and data parallel approaches using PyTorch's Fully Sharded Data Parallel library. Specifically, we study variants of the Vision Transformer architecture (ViT), conducting performance analysis for ViT models with size up to 15B parameters. By discussing throughput and performance bottlenecks under different parallelism configurations, we offer insights on how to leverage such leadership-class HPC resources when developing large models for geospatial imagery applications.

Tsaris, Aristeidis (aris)↗
DOE OSTI2026

Automated Vehicle Feasibility Study

This study collected automated vehicle (AV) performance data on public roadways in Athens, Ohio. The route for the study contained a combination of roads with different functional classifications, conditions, annual average daily traffic, and ownership responsibilities for maintenance and repair. Preparation for the public road deployment was done in a controlled environment at Transportation Research Center’s SMARTCenter, a dedicated AV test facility in East Liberty, Ohio. Researchers analyzed data and extracted insights relevant for both AV developers and infrastructure owners and operators. The study found that rural environments offer a unique set of roadway features such as hills and curves, which can challenge the driving behavior of an AV. Rural regions can also contain a large number of low-traffic gravel roads that lack pavement markings, which appear to be a crucial infrastructure element for operation of current generation AVs. Similarly, the presence of well-maintained lane lines along curves can influence the AV’s roadway departure tendencies. The study found that curvature-related behavior of an AV is also influenced by driving speed on the roadway segment. Such findings were consistent regardless of the time of day along the route or season of data collection. However, commentary about AV performance in active adverse weather cannot be made, as this is still an area of active research.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2020

Reproducibility and Replication of Experimental Particle Physics Results

Recently, much attention has been focused on the replicability of scientific results, causing scientists, statisticians, and journal editors to examine closely their methodologies and publishing criteria. Experimental particle physicists have been aware of the precursors of non-replicable research for many decades and have many safeguards to ensure that the published results are as reliable as possible. The experiments require large investments of time and effort to design, construct, and operate. Large collaborations produce and check the results, and many papers are signed by more than three thousand authors. This paper gives an introduction to what experimental particle physics is and to some of the tools that are used to analyze the data. It describes the procedures used to ensure that results can be computationally reproduced, both by collaborators and by non-collaborators. It describes the status of publicly available data sets and analysis tools that aid in reproduction and recasting of experimental results. It also describes methods particle physicists use to maximize the reliability of the results, which increases the probability that they can be replicated by other collaborations or even the same collaborations with more data and new personnel. Examples of results that were later found to be false are given, both with failed replication attempts and one with alarmingly successful replications. While some of the characteristics of particle physics experiments are unique, many of the procedures and techniques can be and are used in other fields.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

Data from Rossi-α and Pulsed Neutron Prompt Neutron Time Decay Measurements at the Oak Ridge Critical Experiments Facility

This report briefly describes the prompt neutron decay measurements by the Rossi-α and pulsed neutron methods performed at the Oak Ridge Critical Experiments Facility. It briefly describes the measurement equipment, the type of data, and how to access the actual data from the Laboratory Records Department at Oak Ridge National Laboratory and the International Nuclear Criticality Safety Benchmark Evaluation Program at Idaho National Laboratory. Most of the data was acquired between 1960 and 1975 with weapons-grade enriched uranium metal assemblies. It also includes measurement of these types performed at Los Alamos National Laboratory by Oak Ridge National Laboratory with the JEZEBEL and FLATTOP criticality assemblies and other plutonium metal parts. The purpose of this report is to support future mining of the data for publication of additional information that can be used to verify calculational methods and nuclear cross sections. Present calculational methods can be used to directly calculate the measured data.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

The DECADE cosmic shear project I: A new weak lensing shape catalog of 107 million galaxies

We present the Dark Energy Camera All Data Everywhere (DECADE) weak lensing dataset: a catalog of 107 million galaxies observed by the Dark Energy Camera (DECam) in the northern Galactic cap. This catalog was assembled from public DECam data including survey and standard observing programs. These data were consistently processed with the Dark Energy Survey Data Management pipeline as part of the DECADE campaign and serve as the basis of the DECam Local Volume Exploration survey (DELVE) Early Data Release 3 (EDR3). We apply the Metacalibration measurement algorithm to generate and calibrate galaxy shapes. After cuts, the resulting cosmology-ready galaxy shape catalog covers a region of $5,\!412 \,\,{\rm deg}^2$ with an effective number density of $4.59\,\, {\rm arcmin}^{-2}$. The coadd images used to derive this data have a median limiting magnitude of $r = 23.6$, $i = 23.2$, and $z = 22.6$, estimated at ${\rm S/N} = 10$ in a 2 arcsecond aperture. We present a suite of detailed studies to characterize the catalog, measure any residual systematic biases, and verify that the catalog is suitable for cosmology analyses. In parallel, we build an image simulation pipeline to characterize the remaining multiplicative shear bias in this catalog, which we measure to be $m = (-2.454 \pm 0.124) \times10^{-2}$ for the full sample. Despite the significantly inhomogeneous nature of the data set, due to it being an amalgamation of various observing programs, we find the resulting catalog has sufficient quality to yield competitive cosmological constraints.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

A data engineering approach for sustainable chemical end-of-life management

The presence of chemicals causing significant adverse human health and environmental effects during end-of-life (EoL) stages is a challenge for implementing sustainable management efforts and transitioning towards a safer circular life cycle. Conducting chemical risk evaluation and exposure assessment of potential EoL scenarios can help understand the chemical EoL management chain for its safer utilization in a circular life-cycle environment. However, the first step is to track the chemical flows, estimate releases, and potential exposure pathways. Hence, this work proposes an EoL data engineering approach to perform chemical flow analysis and screening to support risk evaluation and exposure assessment for designing a safer circular life cycle of chemicals. This work uses publicly-available data to identify potential post-recycling scenarios (e.g., industrial processing/use operations), estimate inter-industry chemical transfers, and exposure pathways to chemicals of interest. Furthermore, a case study demonstration shows how the data engineering framework identifies, estimates, and tracks chemical flow transfers from EoL stage facilities (e.g., recycling and recovery) to upstream chemical life cycle stage facilities (e.g., manufacturing). Also, the proposed framework considers current regulatory constraints on closing the recycling loop operations and provides a range of values for the flow allocated to post-recycling uses associated with occupational exposure and fugitive air releases from EoL operations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Dishwashers in the Residential Sector: A Survey of Product Characteristics, Usage, and Consumer Preferences

Data on consumer purchasing decisions, usage, and behaviors relating to residential appliances help to inform technical and economic analyses related to the energy and water used by those appliances, including dishwashers. Existing publicly available data for dishwashers include two regularly conducted national surveys that describe dishwasher ownership and usage. The United States (US) Department of Energy’s (DOE) Energy Information Administration’s Residential Energy Consumption Survey (RECS) records the presence of a dishwasher in the home, the numbers of times per week the dishwasher is operated, and the dishwasher age, along with household demographic characteristics. The US Census Bureau’s American Housing Survey (AHS) also records the presence of a dishwasher in the home along with household demographic characteristics.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

Concentration-Discharge Relationships in the Six Largest Arctic Rivers, 2003-2019

This dataset provides the results of the analysis of the relationship of dissolved analyte concentrations and river discharges in the six largest Arctic rivers across the global panarctic region (see Figure 1 in documentation file *.pdf). Long-term measurements of dissolved analyte concentrations and river discharge have been collected for each of the Kolyma, Lena, Mackenzie, Ob, Yenisey, and Yukon rivers by the Arctic Great Rivers Observatory (ArcticGRO) project from ~2003-present (Shiklomanov, 2021). The relationship of dissolved analyte concentrations and discharges in each river was characterized by statistical analysis of the slope of the log(concentration) vs log(discharge) (b), the coefficient of variation ratio (CVc/CVq), the 2.5% and 97.5% confidence intervals of b, and assigning a chemostatic, flushing, diluting, or non-systematic behavior category according to Koger (2018). The summary of these analyses for all six rivers is provided in one .csv file. The concentrations of 20 dissolved analytes and discharge measurement data for the individual Kolyma, Lena, Mackenzie, Ob, Yenisey, and Yukon rivers are also provided with this dataset. There are seven *.csv files; one for each river plus the statistical summary. These public ArcticGRO data at "https://www.arcticgreatrivers.org" (Shiklomanov, 2021) were downloaded on Feb 13, 2020, but each river has different measurement dates over the sampling and analysis period. The ArcticGRO metadata document (*.pdf) downloaded on Feb 13, 2020 is also included in this dataset. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Development and Preliminary Analysis of a U.S. Geothermal Heat Pump Installation Database

This paper seeks to addresses the significant gap in the literature regarding the installation and adoption of geothermal heat pump (GHP) systems in the United States. While the "2021 U.S. Geothermal Power Production and District Heating Market Report" published by the National Renewable Energy Laboratory (NREL) focused on direct-use geothermal district heating systems, it did not include an analysis of GHP installations (Robins et al. 2021). To bridge this gap, NREL has compiled a novel database currently containing 70,470 records of GHP installations, primarily sourced from state well permits and small-scale studies. Our methodology emphasizes the collection, cleaning, and standardization of data, addressing challenges such as inconsistent reporting formats and privacy concerns. Despite limitations in data on capacity, costs, and performance, our preliminary geospatial analysis reveals insights into the distribution of GHP systems across urban and rural areas and climate zones. The paper highlights the importance of publicly accessible data for advancing GHP technology adoption with a discussion of existing data sources and their limitations, advocating for improved collaboration between NREL and industry stakeholders.

data collection↗
DOE OSTI2023

Georectified polygon database of ground-mounted large-scale solar photovoltaic sites in the United States.

Over 4,400 large-scale solar photovoltaic (LSPV) facilities operate in the United States as of December 2021, representing more than 60 gigawatts of electric energy capacity. Of these, over 3,900 are ground-mounted LSPV facilities with capacities of 1 megawatt direct current (MW dc ) or more. Ground-mounted LSPV installations continue increasing, with more than 400 projects appearing online in 2021 alone; however, a comprehensive, publicly available georectified dataset including spatial footprints of these facilities is lacking. The United States Large-Scale Solar Photovoltaic Database (USPVDB) was developed to fill this gap. Using US Energy Information Administration (EIA) data, locations of 3,699 LSPV facilities were verified using high-resolution aerial imagery, polygons were digitized around panel arrays, and attributes were appended. Quality assurance and control were achieved via team peer review and comparison to other US PV datasets. Data are publicly available via an interactive web application and multiple downloadable formats, including: comma-separated value (CSV), application programming interface (API), and GIS shapefile and GeoJSON.

14 SOLAR ENERGY↗
DOE OSTI2023

A database of hourly wind speed and modeled generation for US wind plants based on three meteorological models

Abstract In 2022, wind generation accounted for ~10% of total electricity generation in the United States. As wind energy accounts for a greater portion of total energy, understanding geographic and temporal variation in wind generation is key to many planning, operational, and research questions. However, in-situ observations of wind speed are expensive to make and rarely shared publicly. Meteorological models are commonly used to estimate wind speeds, but vary in quality and are often challenging to access and interpret. The Plant-Level US multi-model WIND and generation (PLUSWIND) data repository helps to address these challenges. PLUSWIND provides wind speeds and estimated generation on an hourly basis at almost all wind plants across the contiguous United States from 2018–2021. The repository contains wind speeds and generation based on three different meteorological models: ERA5, MERRA2, and HRRR. Data are publicly accessible in simple csv files. Modeled generation is compared to regional and plant records, which highlights model biases and errors and how they differ by model, across regions, and across time frames.

17 WIND ENERGY↗
DOE OSTI2026

Emergency Radiation Dose Rate Monitoring During Prolonged Armed Conflict

The 2022 Russian full-scale invasion of Ukraine has introduced unprecedented challenges for the nuclear power generation and radiological safety communities, including occupation and disturbance of highly-contaminated areas, occupation of a nuclear power plant, and strikes near and within boundaries of nuclear sites. The war has necessitated the implementation of a supplementary dose rate sensor network to provide resilient measurement data for public protection and leadership awareness. This paper discusses the implementation of such a system, the factors determining what equipment is best suited for the purpose, and practical factors regarding deployment of the system and data management. The crucial factors for operating a supplementary dose rate sensing network are backup power and communications options for dose rate sensors to make the network resilient to the effects of military operations. The most important implementation factor is to plan for extended operations beyond those typically considered for emergency response given the unpredictable nature of warfare.

resilience↗
DOE OSTI2024

Impact Study of Thunderstorms on the US Power Grid Using Publicly Available Datasets

This work analyzes the impact of thunderstorms on the US power grid based on publicly available data. Since thunderstorms can bring lightning, heavy precipitation, and wind storms, analyzing their impact on the power system provides a combined correlation of lightning strikes, floods, and wind storms on power outages. This paper leverages publicly available thunderstorm datasets from the National Weather Service (NWS) and power outage datasets from Oak Ridge National Laboratory’s Environment for Analysis of Geo-Located Energy Information (EAGLE-I) to study the correlation between thunderstorms and power outages. This work is analyzing the patterns of thunderstorms from 2013-2022, which shows that the thunderstorms are not slowing down and will seem to continue their impact on human life in the future. This work also analyzes the monthly and yearly pattern of the impact of thunderstorms on power systems at the national, state, and county level.

Bhusal, Narayan↗