Search NASA⌕ Search

SEARCH · Search NASA

Results for “data lakes”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Tsdat: An Open-Source Data Standardization Framework for Marine Energy and Beyond: Preprint

Many organizations are tasked with the collection and processing of large quantities of data from various measurement devices. Data reported from these sources are often not interoperable with datasets and software used by analysts and other organizations in the same field, introducing barriers for collaboration on large-scale projects. This poses a particular problem for cross-device comparisons and machine learning applications. To address these challenges, the open source Time-Series Data Pipelines (Tsdat) software was developed by a joint collaboration between Pacific Northwest National Laboratory, the National Renewable Energy Laboratory, and Sandia National Laboratories to facilitate collaboration and accelerate advancements in the Marine Energy domain through the development of an open-source ecosystem of tools. This paper will describe the Tsdat software and the data standards within which the framework operates. A beta version of the framework has been released and is currently being used by several projects in marine energy, wind energy, and building energy systems.

big data↗
DOE OSTI2023

An Update on the Geothermal Data Repository's Data Standards and Pipelines: Geospatial Data and Distributed Acoustic Sensing Data: Preprint

The Department of Energy's (DOE) Geothermal Data Repository (GDR) team has implemented data standards and automated data pipelines for the following data types: 1) drilling data, 2) geospatial datasets, and 3) DAS data. An additional data pipeline is proposed for stimulation data. These data standards and pipelines are intended to improve the real-world applicability of geothermal machine learning outputs through improving the quality of data. More specifically, through standardizing high-value datasets, the GDR is reducing project-specific data curation requirements, allowing more time to be spent on actual research. By automating this process, the burden of standardization is taken off of the user, overall increasing the availability of standardized data. This paper provides an update on the GDR's transition toward data standardization through automated data pipelines and calls for feedback from the community on how we can improve this process.

cloud-optimized↗
DOE OSTI2023

An Update on the Geothermal Data Repository's Data Standards and Pipelines: Geospatial Data and Distributed Acoustic Sensing Data

The Department of Energy's (DOE) Geothermal Data Repository (GDR) team has implemented data standards and automated data pipelines for the following data types: 1) drilling data, 2) geospatial datasets, and 3) DAS data. An additional data pipeline is proposed for stimulation data. These data standards and pipelines are intended to improve the real-world applicability of geothermal machine learning outputs through improving the quality of data. More specifically, through standardizing high-value datasets, the GDR is reducing project-specific data curation requirements, allowing more time to be spent on actual research. By automating this process, the burden of standardization is taken off of the user, overall increasing the availability of standardized data. This paper provides an update on the GDR's transition toward data standardization through automated data pipelines and calls for feedback from the community on how we can improve this process.

cloud-optimized↗
DOE OSTI2023

An Update on the Geothermal Data Repository's Data Standards and Pipelines: Geospatial Data and Distributed Acoustic Sensing Data

The Department of Energy's (DOE) Geothermal Data Repository (GDR) team has implemented or is currently implementing data standards and automated data pipelines for the following geothermal data types: 1) drilling data, 2) geospatial datasets, and 3) Distributed Acoustic Sensing (DAS) data. These data standards and pipelines are intended to improve the real-world applicability of geothermal machine learning outputs through improving the quality of data. More specifically, through standardizing high-value datasets, the GDR is reducing project-specific data curation requirements, allowing more time to be spent on actual research. By automating this process, the burden of standardization is taken off of the user, overall increasing the availability of standardized data. This paper provides an update on the GDR's transition toward data standardization through automated data pipelines and calls for feedback from the community on how the GDR team can improve this process.

cloud-optimized↗
DOE OSTI2025

Influence of Lake Ice Biases in Reanalysis Data on Downscaled Climate Simulations over the Great Lakes Region

This data package contains observation-based and model-simulated datasets (all provided in NetCDF format) for evaluating how wintertime lake-ice representation affects regional weather and climate over the Laurentian Great Lakes (freshwater lake ecosystem) during the high–ice-cover winter of 2009. The observational component includes: (1) Stage IV gridded precipitation at 4 km, hourly resolution for January–February 2009 over the Great Lakes region (radar–gauge multisensor precipitation analyses); (2) Great Lakes Surface Environmental Analysis (GLSEA) satellite-derived lake-ice coverage at 1.3 km, daily resolution for the 2009 winter months, providing ice coverage over Lakes Superior, Michigan, Huron, Erie, and Ontario; and (3) in situ measurements at the Standard Rock site on Lake Superior from the Great Lakes Evaporation Network (GLEN) at hourly resolution, including near-surface atmospheric variables and sensible and latent heat fluxes (air–lake exchange) at a fixed point location. The modeling component provides corresponding fields from two simulations, both archived at 4 km, hourly resolution: a standalone Weather Research Forecasting model (WRF) run driven by the European Centre for Medium-Range Weather Forecasts (ECMWF) Reanalysis 5 (ERA5), and a two-way coupled model using WRF and the Finite Volume Community Ocean Model (WRF-FVCOM, a 3-D hydrodynamic lake model). These outputs include variables relevant to air–lake interaction and lake-effect processes (e.g., near-surface temperature, humidity, wind, precipitation, and surface turbulent fluxes), enabling direct comparison with the observational datasets. Users can analyze and visualize these NetCDF files with common tools such as Python (e.g., xarray, netCDF4, numpy, pandas), NCO/CDO, Panoply, or ncview; NetCDF variables can also be converted to other formats (e.g., CSV, GeoTIFF) using these utilities.

EARTH SCIENCE > ATMOSPHERE > ATMOSPHERIC TEMPERATU↗
DOE OSTI2024

Approximation of ice phenology of Maine lakes using Aqua MODIS surface temperature data

Studies of lake ice phenology have historically relied on limited in situ data. Relatively few observations exist for ice out and fewer still for ice in, both of which are necessary to determine the temporal extent of ice cover. Satellite data provide an opportunity to better document patterns of ice phenology across landscapes and relate them to the climatological drivers behind changing ice phenology. We developed a model, the Cumulative Sum Method (CSM), that uses daytime and nighttime surface temperature observations from the Moderate Resolution Imaging Spectroradiometer (MODIS) sensor on board the Earth-observing Aqua satellite to approximate ice in (the onset of ice cover) and ice out from training datasets of 13 and 58 Maine lakes, respectively, during the 2002/2003 through 2017/2018 ice seasons. Ice in was signaled by reaching a threshold of cumulative negative degrees following the first day of the season below 0°C. Ice out was signaled by reaching a threshold of cumulative positive degrees following the first day of the year above 0°C. The comparison of observed and remotely sensed ice-in dates showed relative agreement with a correlation coefficient of 0.71 and a mean absolute error (MAE) of 9.8 days. Ice-out approximations had a correlation coefficient of 0.67 and an MAE of 8.8 days. Lakes smaller in surface area and nearer the Atlantic coast had the greatest error in approximation. Application of the CSM to 20 additional lakes in Maine produced a comparable ice-out MAE of 8.9 days. Ice-out model performance was weaker for the warmest years; there was a larger MAE of 12.0 days when the model was applied to the years 2019–2023 for the original 58 lakes. The development of this model, which utilizes daily satellite data, demonstrates the promise of remote sensing for quantifying ice phenology over short, temporal scales, and wider geographic regions than can be observed in situ, and allows exploration of the influence of surface temperature patterns on the process and timing of ice in and ice out.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2008

In-Flight Validation of Mid and Thermal Infrared Remotely Sensed Data Using the Lake Tahoe and Salton Sea Automated Validation Sites

The presentation includes an introduction, Lake Tahoe site layout and measurements, Salton Sea site layout and measurements, field instrument calibration and cross-calculations, data reduction methodology and error budgets, and example results for MODIS. Summary and conclusions are: 1) Lake Tahoe CA/NV automated validation site was established in 1999 to assess radiometric accuracy of satellite and airborne mid and thermal infrared data and products. Water surface temperatures range from 4-25C.2) Salton Sea CA automated validation site was established in 2008 to broaden range of available water surface temperatures and atmospheric water vapor test cases. Water surface temperatures range from 15-35C. 3) Sites provide all information necessary for validation every 2 mins (bulk temperature, skin temperature, air temperature, wind speed, wind direction, net radiation, relative humidity). 4) Sites have been used to validate mid and thermal infrared data and products from: ASTER, AATSR, ATSR2, MODIS-Terra, MODIS-Aqua, Landsat 5, Landsat 7, MTI, TES, MASTER, MAS. 5) Approximately 10 years of data available to help validate AVHRR.

Lake Tahoe↗
NASA NTRS1979

Improvements in lake water budget computations using Landsat data

A supervised multispectral classification was performed on Landsat data for Lake Okeechobee's extensive littoral zone to provide two types of information. First, the acreage of a given plant species as measured by satellite was combined with a more accurate transpiration rate to give a better estimate of evapotranspiration from the littoral zone. Second, the surface area coupled by plant communities was used to develop a better estimate of the water surface as a function of lake stage. Based on this information, more detailed representations of evapotranspiration and total water surface (and hence total lake volume) were provided to the water balance budget model for lake volume predictions. The model results based on information derived from satellite demonstrated a 94 percent reduction in cumulative lake stage error and a 70 percent reduction in the maximum deviation of the lake stage.

Gervin, J. C.↗
NASA NTRS1994

Analysis of ERS 1 synthetic aperture radar data of frozen lakes in northern Montana and implications for climate studies

Lakes that freeze each winter are good indicators of regional climate change if key parameters, such as freeze-up and breakup date and maximum ice thickness, are measured over a decade-scale time frame. Synthetic aperture radar (SAR) satellite data have proven to be especially useful for measurement of climatologically significant parameters characteristic of frozen lakes. In this paper, five lakes in Glacier National Park, Montana, have been studied both in the field and using Earth Remote-Sensing Satellite (ERS) 1 SAR data during the 1992-1993 winter. The lakes are characterized by clear ice, sometimes with tubular or rounded bubbles, and often with a layer of snow ice on top of the clear ice. They are also often snow covered. Freeze-up is detected quite easily using ERS 1 SAR data as soon as a thin layer of ice forms. The effect of snow ice on the backscatter is thought to be significant but is, as yet, undetermined. On the five lakes studied, relative backscatter was found to increase with ice thickness until a maximum was reached in February. Breakup, an often ill-defined occurrence, is difficult to detect because surface water causes the SAR signal to be absorbed, thus masking the ice below. Comparison of the bubble structure of thaw lakes in northern Alaska with lakes in northern Montana has shown that the ice structure is quite different, and this difference may contribute to differential SAR signature evolution in the lakes of the two areas.

Hall, Dorothy K.↗
NASA NTRS1976

Utilization of satellite data for inventorying prairie ponds and lakes

ERTS-1 data were used in mapping open surface water features in the glaciated prairies. Emphasis was placed on the recognition of these features based upon water's uniquely low radiance in a single near-infrared waveband. On the basis of these results, thematic maps and statistics relating to open surface water were obtained. In a related effort, the added information content of multiple spectral wavebands was used for discriminating surface water at a level of detail finer than the virtual resolution of the data. The basic theory of this technique and some preliminary results are described.

Work, E. A., Jr.↗
NASA NTRS1975

Turbidity in extreme western Lake Superior

Data were obtained from ERTS images for western Lake Superior for 1972-74. Data examination showed that for easterly winds the turbidity originating along the Wisconsin shore and the resuspension areas are transported northward then out along a N.E. path where it disperses, and often, for large storms, contaminates the Duluth water intake. Contaminants such as dredging fines anywhere along these paths would likewise find their way to the intake areas in concentrations comparable to the relative red clay concentration.

Sydor, M.↗
DOE OSTI2024

Substantial and overlooked greenhouse gas emissions from deep Arctic lake sediment - supporting data and code

This data package contains data, descriptions, and code-based analyses that were used to support conclusions drawn in “Substantial and overlooked greenhouse gas emissions from deep Arctic lake sediment”, by Freitas et al. (2025) (https://doi.org/10.1038/s41561-024-01614-y). The study evaluated greenhouse gas production along a deep sediment core (20 m) taken in 2018 from below Goldstream Lake, a field site approximately 15 km north of Fairbanks, Alaska.The file “ESSDive_NFreitas_2024_flmd.csv” includes an overview of all other csv files in this data package, namely: sediment descriptions (depth and type of sediment), sediment characterizations (bulk density, gravimetric water content, total carbon, etc.), calculated respiration and temperature sensitivity values associated with year-long incubations of the sediment core, and the R code used to process the dataset. Additional details regarding the content of these files and how the calculations were performed are described in the Methods section of this archive. The “data_dictionary_ESSDive_NFreitas_2024_dd.csv” is a data dictionary for all files included in the data package. Each row in the data dictionary represents a column name in a given file. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).Data package updates- August 2024: Title was updated, R code now includes a process for calculating potential production across the whole sediment column, the "sediment_column_production_potentials_ESSDive_NFreitas_2024.csv" is the associated data output file, and the file level metadata and data dictionaries were updated to reflect the contents of the additional csv file.- October 2024: Title was updated, and a statement was added to Step 2 of the Methods that describes that samples were collected (and exported) in a responsible manner and in accordance with relevant permits and local laws.- January 2025: Updated the associated manuscript details in the Abstract (manuscript title, publication date, DOI link) and in the Related References section (full citation).

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1976

A computer analysis of ERTS data of the Lake Gregory area of South Australia with particular emphasis on its role in terrain classification for engineering

A digital computer and multivariate statistical techniques were used to analyze 4-band multispectral data. A representation of the original data for each of the four bands allows a certain degree of terrain interpretation; however, variations in appearance of sites within and between bands, without additional criteria for deciding which representation should be preferred, create difficulties for classification. Investigation of the video data groups produced by principal components analysis and cluster analysis techniques shows that effective correlations with classifications of terrain produced by conventional methods could be carried out. The analyses also highlighted underlying relationships between the various elements. The approach used allows large areas (185 cm by 185 cm) to be classified into fundamental units within a matter of hours and can be applied to those parts of the Earth where facilities for conventional studies are poor or lacking.

Lodwick, G. D.↗
NASA NTRS2011

Forecasting Lake-Effect Snow in the Great Lakes Using NASA Satllite Data

This slide presentation reviews the forecast of the lake effect snow in the Great Lakes region using models and infrared estimates of Great Lake Surface Temperatures (GLSTs) from the MModerate Resolution Imaging Spectroradiometer (MODIS) instrument on Terra and Aqua satellites, and other satellite data. This study analyzes Lake Erie and Lake Ontario which produce storm total snowfall ranged from 8-18 inches off of Lake Ontario and 10-12 inches off of Lake Erie for the areas downwind.

Cipullo, Michelle↗
NASA NTRS1974

Automatic classification of eutrophication of inland lakes from spacecraft data

The author has identified the following significant results. Spacecraft data and computer techniques can be used to rapidly map and store onto digital tapes watershed land use information. Software is now available by which this land use information can be rapidly and economically extracted from the tapes and related to coliform counts and other lake contaminants (e.g. phosphorus). These tools are basic elements for determining those land use factors and sources of nutrients that accelerate eutrophication in lakes and reservoirs.

Rogers, R. H.↗
NASA NTRS1981

Statewide lake classification utilizing LANDSAT imagery for the state of Wisconsin

A cooperative program between the Wisconsin Department of Natural Resources and the University of Wisconsin-Madison resulted in the assessment of the trophic condition of approximately 3,000 significant inland lakes in Wisconsin. The feasibility of using both photographic and digital representations of LANDSAT multispectral scanner data for lake classification was investigated. The result was the development of a nearly automated system which, with minimal human interaction, locates and extracts the lake data, then corrects the data for atmospheric effects, and finally classifies all the significant lakes in the state as to trophic condition.

Martin, R. H.↗
NASA NTRS1972

The use of ERTS-1 satellite data in Great Lakes mesometeorological studies

The author has identified the following significant results. In the original proposal, it was hoped that ERTS could, with its extremely high resolution and multispectral capability, detect many meteorological phenomena occurring at the low end of the mesoscale motion spectrum (1 - 100 km). This included convective cloud phenomena, internal wave patterns, air pollution, snow squalls, etc. For meteorologists, ERTS-1 has more than lived up to initial hopes. First-look inspection of images has produced a large number of truly remarkable finds. Some of the most significant are: (1) Images of Lake Ontario during late summer have revealed several extremely good examples of lake breeze frontal cloud patterns. (2) Detection of suspended particulates from Chicago-Gary industrial complex in the 50,000 to 150,000 tons/year category. (3) Inadvertant weather modification due to anthropogenic condensation and ice nuclei from urban areas.

Lyons, W. A.↗