Search NASA⌕ Search

SEARCH · Search NASA

Results for “data resolution”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Global urban growth between 1870 and 2100 from integrated high resolution mapped data and urban dynamic modeling

Long term, global records of urban extent can help evaluate environmental impacts of anthropogenic activities. Remotely sensed observations can provide insights into historical urban dynamics, but only during the satellite era. Here, we develop a 1 km resolution global dataset of annual urban dynamics between 1870 and 2100 using an urban cellular automata model trained on satellite observations of urban extent between 1992 and 2013. Hindcast (1870–1990) and projected (2020–2100) urban dynamics under the five Shared Socioeconomic Pathways (SSPs) were modeled. We find that global urban growth under SSP5, the fossil-fuelled development scenario, was largest with a greater than 40-fold increase in urban extent since 1870. The high resolution dataset captures grid level urban sprawl over 200 years, which can provide insights into the urbanization life cycle of cities and help assess long-term environmental impacts of urbanization and human–environment interactions at a global scale.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Super-Resolution Approaches in Three-Dimensions for Classification and Screening of Commercial-Off-The-Shelf Components

X-ray computed tomography is generally a primary step in characterization of defective electronic components, but is generally too slow to screen large lots of components. Super-resolution imaging approaches, in which higher-resolution data is inferred from lower-resolution images, have the potential to substantially reduce collection times for data volumes accessible via x-ray computed tomography. Here we seek to advance existing two-dimensional super-resolution approaches directly to three-dimensional computed tomography data. Multiple scan resolutions over a half order of magnitude of resolution were collected for four classes of commercial electronic components to serve as training data for a deep-learning, super-resolution network. A modular python framework for three-dimensional super-resolution of computed tomography data has been developed and trained over multiple classes of electronic components. Initial training and testing demonstrate the vast promise for these approaches, which have the potential for more than an order of magnitude reduction in collection time for electronic component screening.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Integrating very-high-resolution UAS data and airborne imaging spectroscopy to map the fractional composition of Arctic plant functional types in Western Alaska

Widespread changes in vegetation cover and composition are driving strong impacts on Arctic ecosystem functioning and global climate feedbacks. An accurate characterization of tundra vegetation composition is required to understand how the Arctic will respond to future climate change. However, quantifying tundra vegetation composition over large areas is challenging as commonly-used satellite observations are too coarse, spatially and spectrally, to differentiate low-lying tundra vegetation types. Recent airborne and spaceborne imaging spectroscopy platforms provide better data to characterize vegetation composition. Yet, our ability to characterize vegetation composition with imaging spectroscopy remains largely unexplored in the Arctic, particularly due to a lack of ground observations needed to train and test classification models. To address this problem, we collected very-high-resolution (VHR, ~5 cm) unoccupied aerial system (UAS) imagery at three low-Arctic tundra sites located on the Seward Peninsula, western Alaska. In this paper, we examine the feasibility of integrating imagery from the UAS and the hyperspectral Airborne Visible/Infrared Imaging Spectrometer, Next Generation (AVIRIS-NG) airborne instrument to map the fractional composition of 12 key Arctic plant functional types (PFTs). To this end, we first mapped the 12 PFTs from our VHR UAS imagery using random forest classification. We then used these UAS-derived PFT maps as ground truth to develop partial least squares regression (PLSR) models to predict the fractional cover (FCover) of each PFT from AVIRIS-NG imagery. Further, we evaluated the performance of our PLSR models using reserved UAS samples, as well as by mapping PFT FCover and dominant PFT for large tundra landscapes. Our results show that 1) Arctic PFTs can be effectively mapped using VHR UAS imagery, with overall accuracy between 86% and 92%, 2) when the UAS mapped PFTs were used to inform PLSR scaling models, the FCover of the 12 PFTs could be effectively estimated from AVIRIS-NG imagery with a mean absolute error (MAE) <0.13, and 3) our PLSR models outperformed traditional, fully constrained least-squares (FCLS) linear mixture analysis and produced high-quality, spatially contiguous PFT FCover and PFT maps that captured vegetation spatial patterns with similar accuracy to those developed from UAS imagery. The developed PLSR models have the potential to be broadly applied for quantifying vegetation composition with AVIRIS-NG images to help monitor tundra vegetation dynamics and improve process-based modeling of tundra ecosystems.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Machine learning changes the rules for flux limiters

Learning to integrate non-linear equations from highly resolved direct numerical simulations has seen recent interest for reducing the computational load for fluid simulations. Here, we focus on determining a flux-limiter for shock capturing methods. Focusing on flux limiters provides a specific plug-and-play component for existing numerical methods. Since their introduction, an array of flux limiters has been designed. Using the coarse-grained Burgers' equation, we show that flux-limiters may be rank-ordered in terms of their log-error relative to high-resolution data. We then develop a theory to find an optimal flux-limiter and present flux-limiters that outperform others tested for integrating Burgers' equation on lattices with [Formula: see text], and 2x, 3x, 4x, and 8x coarse-grainings. We train a continuous piecewise linear limiter by minimizing the mean-squared misfit to six-grid point segments of high-resolution data, averaged over all segments. While flux limiters are generally designed to have an output of φ(r) = 1 at a flux ratio of r = 1, our limiters are not bound by this rule and yet produce a smaller error than standard limiters. Here we find that our machine learned limiters have distinctive features that may provide new rules-of-thumb for the development of improved limiters. Additionally, we use our theory to learn flux-limiters that outperform standard limiters across a range of values (as opposed to at a specific fixed value) of coarse-graining, number of discretized bins, and diffusion parameter. This demonstrates the ability to produce flux limiters that should be more broadly useful than standard limiters for general applications.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

Enhancing trap and fault seal analyses by integrating observations from HR3D seismic data with well logs and conventional 3D seismic data, Texas inner shelf

An understanding of trap and fault seal quality is critical for assessing hydrocarbon prospectivity. To achieve this, modern analytical techniques leverage well data and conventional industry-standard 3D seismic data to evaluate the trap, and any faults displacing the reservoir and top seal intervals. Above all, geological interpretation provides the framework of trap and fault seal analyses, but can be hindered by the data resolution, quality and acquisition style of the conventional seismic data. Furthermore, limiting the analysis to only the petroleum system at depth may lead to erroneous perceptions because interpreting overburden features, such as shallow faults or gas chimneys, can provide valuable observations with respect to container performance, and can to help validate trap and fault seal predictions. Here, a supplement to conventional 3D data are high-resolution 3D seismic (HR3D) data, which provide detailed images of the overburden geology. This study utilizes an HR3D seismic volume in the San Luis Pass area of the Texas inner shelf, where shallow fault tips and a sizeable gas chimney are interpreted over an unsuccessful hydrocarbon prospect. Static post-drill fault seal and trap analyses suggest that the primary fault displacing the structural closure could have withheld columns of gas c. 100 m high, but disagree with our HR3D seismic interpretations and dry-well analyses. From our results, we hypothesize that tertiary gas migration through fault conduits reduced the hydrocarbon column in the prospective Early Miocene reservoir, and may have resulted from continued movement along the intersecting faults. Overall, this study reinforces the importance of understanding the overburden geology and geohistory of faulted prospects, and demonstrates the utility of pre-drill HR3D acquisition when conducting trap and fault seal analyses.

3D seismic↗
DOE OSTI2022

Fog particle concentrations

ngVIPS metadata and caveats: Column 1: Time, seconds after midnight UTC of beginning of time period. (60 sec values) Column 2: Relative concentration. Notes: Concentration values are observed values and assume ~4.0 m/s wind speed. (#/cm^3) Caveats: Observed particles with a very few exceptions were on the order of a few pixels (less than 10 microns). The size differential was insufficient to determine a particle size distribution. As the temperatures were relatively warm (and it can be 10C warmer inside the instrument) it is anticipated that some solid ice particles could have melted and some smaller liquid drops could have evaporated. A cyclic nature to the high resolution data was observed and determined to be caused by a focus issue. Each 60 second period included ~25 images. Particles are collected on a glass disk, but the disk isn't perfectly centered causing small particles to be slightly out of focus during part of the rotation. For that reason, we chose to report the average of the five highest values in a time period rather the average of all values. Higher resolution can be made available upon request, but a conversation with the PI would be important to fully understand the planned usage and if the higher resolution data were to be useful for the task. Please contact instrument PI, Carl Schmitt (naturalsystemsresearch@gmail.com) with any questions about these data.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Short-Term Groundwater Level Fluctuations Drive Subsurface Redox Variability

As global change processes modify the extent and functions of terrestrial-aquatic interfaces, the variability of critical and dynamic transitional zones between wetlands and uplands increases. However, it is still unclear how fluctuating water levels at these dynamic boundaries alter groundwater biogeochemical cycling. Here, we used high-temporal resolution data along gradients from wetlands to uplands and during fluctuating water levels at freshwater coastal areas to capture spatiotemporal patterns of groundwater redox potential (E h ). We observed that topography influences groundwater E h that is higher in uplands than wetlands; however, the high variability within TAI zones challenged the establishment of distinct redox zonation. Declining water levels generally decreased E h , but most locations exhibited significant E h variability, which is associated with rare instances of short-term water level fluctuations introducing oxygen. The E h -oxygen relationship showed distinct hysteresis patterns, reflecting redox poising capacity at higher E h , maintaining more oxidizing states longer than dissolved oxygen presence. Surprisingly, we observed more frequent oxidizing states in transitional areas and wetlands than in uplands. We infer that occasional oxygen entering specific wetland-upland boundaries acts as critical biogeochemical control points. Finally, high-resolution data can capture such rare yet significant biogeochemical instances, supporting redox-informed models and advancing the predictability of climate change feedback.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Deep convolutional neural networks for multi-scale time-series classification and application to tokamak disruption prediction using raw, high temporal resolution diagnostic data

In this paper we discuss recent advances in deep convolutional neural networks (CNN) for sequence learning, which allow identifying long-range, multi-scale phenomena in long sequences, such as those found in fusion plasmas. We point out several benefits of these deep CNN architectures, such as not requiring experts such as physicists to hand-craft input data features, the ability to capture longer range dependencies compared to the more common sequence neural networks (recurrent neural networks like long short-term memory (LSTM) networks), and the comparative computational efficiency. We apply this neural network architecture to the popular problem of disruption prediction in fusion energy tokamaks, utilizing raw data from a single diagnostic, the Electron Cyclotron Emission imaging (ECEi) diagnostic from the DIII-D tokamak. Initial results trained on a large ECEi dataset show promise, achieving an F 1 -score of ~91% on individual time-slices using only the ECEi data. This indicates the ECEi diagnostic by itself can be sensitive to a number of pre-disruption markers useful for predicting disruptions on timescales not only for mitigation but also avoidance. Future opportunities for utilizing these deep CNN architectures with fusion data are outlined, including impact of recent upgrades to the ECEi diagnostic.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

US wildfire potential: a historical view and future projection using high-resolution climate data

Abstract Recent wildfires in the western United States have led to substantial economic losses and social stresses. There is a great concern that the new climatic state may further increase the intensity, duration, and frequency of wildfires. To examine temporal and spatial features of historical wildfire trends and future changes, a common fire index, the Keetch–Byram Drought Index (KBDI), is calculated over the contiguous United States (CONUS) and Alaska. We introduce an efficient initialization method and calculate 36 years (1982–2017) of historical KBDI at 4 km using a high-quality observational dataset. KBDIs are also calculated at 12 km using regional climate models and extended into the mid- and late-21st century. Based on the observational data, annual mean (and 95th percentile) KBDI over forested regions in the southwestern and northwestern CONUS has risen since 1982 at a rate of 5.2 (4.0) and 2.9 (3.3) per year, respectively, indicating a persistent drying trend fostering fire activities; the number of days exceeding the top 5% historical KBDI has increased by 16 and 25 d in the 36 years. Multiple regional climate model simulations project increasing wildfire potential and longer fire seasons over broader areas based on the estimated KBDI for the mid- and late-21st century. By the end of the century, most of the CONUS would experience about 90–189 more days per year exceeding the historical local maximum KBDI; areas with high KBDI (>600), whose occurrence correlates with large burned area, are projected to broaden by nearly 60 times in the southern CONUS. While both temperature and precipitation contribute to future KBDI changes, warming is the main driver of more frequent, intense and wide-spread extreme wildfires indicated by high KBDIs in future projections.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Descriptor: High Temporal Resolution Meteorological Data at Oak Ridge Reservation (ORR-HiResMet)

Access to continuous, quality assessed meteorological data is critical for understanding the climatology and atmospheric dynamics of a region. Research facilities like Oak Ridge National Laboratory (ORNL) rely on such data to assess site-specific climatology, model potential emissions, establish safety baselines, and prepare for emergency scenarios. To meet these needs, on-site towers at ORNL collect meteorological data at 15-minute and hourly intervals. However, data measurements from meteorological towers are affected by sensor sensitivity, degradation, lightning strikes, power fluctuations, glitching, and sensor failures, all of which can affect data quality. To address these challenges, we conducted a comprehensive quality assessment and processing of five years of meteorological data collected from ORNL at 15-minute intervals, including measurements of temperature, pressure, humidity, wind, and solar radiation. The time series of each variable was pre-processed and gap-filled using established meteorological data collection and cleaning techniques, i.e., the time series were subjected to structural standardization, data integrity testing, automated and manual outlier detection, and gap-filling. The data product and highly generalizable processing workflow developed in Python Jupyter notebooks are publicly accessible online. As a key contribution of this study, the evaluated 5-year data will be used to train atmospheric dispersion models that simulate dispersion dynamics across the complex ridge-and-valley topography of the Oak Ridge Reservation in East Tennessee.

Steckler, Morgan R. [Oak Ridge National Laboratory↗
DOE OSTI2019

DeepClimGAN: A High-Resolution Climate Data Generator

Earth system models (ESMs), which simulate the physics and chemistry of the global atmosphere, land, and ocean, are often used to generate future projections of climate change scenarios. These models are far too computationally inten- sive to run repeatedly, but limited sets of runs are insufficient for some important applications, like adequately sampling distribution tails to characterize extreme events. As a com- promise, emulators are substantially less expensive but may not have all of the complexity of an ESM. Here we demon- strate the use of a conditional generative adversarial network (GAN) to act as an ESM emulator. In doing so, we gain the ability to produce daily weather data that is consistent with what ESM might output over any chosen scenario. In particular, the GAN is aimed at representing a joint proba- bility distribution over space, time, and climate variables, enabling the study of correlated extreme events, such as floods, droughts, or heatwaves.

Extreme events, Machine Learning, deep learning↗
DOE OSTI2022

Improving Simulations of Vegetation Dynamics over the Tibetan Plateau: Role of Atmospheric Forcing Data and Spatial Resolution

The efficacy of vegetation dynamics simulations in offline land surface models (LSMs) largely depends on the quality and spatial resolution of meteorological forcing data. In this study, the Princeton Global Meteorological Forcing Data (PMFD) and the high spatial resolution and upscaled China Meteorological Forcing Data (CMFD) were used to drive the Simplified Simple Biosphere model version 4/Top-down Representation of Interactive Foliage and Flora Including Dynamics (SSiB4/TRIFFID) and investigate how meteorological forcing datasets with different spatial resolutions affect simulations over the Tibetan Plateau (TP), a region with complex topography and sparse observations. By comparing the monthly Leaf Area Index (LAI) and Gross Primary Production (GPP) against observations, we found that SSiB4/TRIFFID driven by upscaled CMFD improved the performance in simulating the spatial distributions of LAI and GPP over the TP, reducing RMSEs by 24.3% and 20.5%, respectively. The multi-year averaged GPP decreased from 364.68 gC m –2 yr –1 to 241.21 gC m –2 yr –1 with the percentage bias dropping from 50.2% to –1.7%. When using the high spatial resolution CMFD, the RMSEs of the spatial distributions of LAI and GPP simulations were further reduced by 7.5% and 9.5%, respectively. This study highlights the importance of more realistic and high-resolution forcing data in simulating vegetation growth and carbon exchange between the atmosphere and biosphere over the TP.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

AMM: Adaptive Multilinear Meshes

Adaptive representations are increasingly indispensable for reducing the in-memory and on-disk footprints of large-scale data. Usual solutions are designed broadly along two themes: reducing data precision, e.g., through compression, or adapting data resolution, e.g., using spatial hierarchies. Additionally, recent research suggests that combining the two approaches, i.e., adapting both resolution and precision simultaneously, can offer significant gains over using them individually. However, there currently exist no practical solutions to creating and evaluating such representations at scale. In this work, we present a new resolution-precision-adaptive representation to support hybrid data reduction schemes and offer an interface to existing tools and algorithms. Through novelties in spatial hierarchy, our representation, Adaptive Multilinear Meshes (AMM), provides considerable reduction in the mesh size. AMM creates a piecewise multilinear representation of uniformly sampled scalar data and can selectively relax or enforce constraints on conformity, continuity, and coverage, delivering a flexible adaptive representation. AMM also supports representing the function using mixed-precision values to further the achievable gains in data reduction. We describe a practical approach to creating AMM incrementally using arbitrary orderings of data and demonstrate AMM on six types of resolution and precision datastreams. By interfacing with state-of-the-art rendering tools through VTK, we demonstrate the practical and computational advantages of our representation for visualization techniques. With an open-source release of our tool to create AMM, we make such evaluation of data reduction accessible to the community, which we hope will foster new opportunities and future data reduction schemes.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

Data-driven Identification of Occupant Thermostat-Behavior Dynamics

Building occupant behavior drives significant differences in building energy use, even in automated buildings. Users’ distrust in the automation causes them to override settings. This results in responses that fail to satisfy both the occupants’ and/or the building automation’s objectives. The transition toward grid-interactive efficient buildings will make this evermore important as complex building control systems optimize not only for comfort, but also changing electricity costs. This paper presents a data-driven approach to study thermal comfort behavior dynamics which are not captured by standard steady-state comfort models such as predicted mean vote. The proposed model captures the time it takes for a user to override a thermostat setpoint change as a function of the manual setpoint change magnitude. The model was trained with the ecobee Donate Your Data dataset of 5 min. resolution data from 27,764 smart thermostats and occupancy sensors. The resulting population-level model shows that, on average, a 2°F override will occur after ~30 mins. and an 8°F override will occur in only ~15 mins., indicating the magnitude of discomfort as a key driver to the swiftness of an override. Such models could improve demand response programs through personalized controls.

Kane, Michael↗
DOE OSTI2025

Raw ERCOT 60-Day SCED Disclosure Reports

This dataset contains ERCOT plant-level wind power production data at a 15-minute time resolution. Data at ERCOT are called 60-Day SCED Disclosure Report; data product number NP3-965-ER. Raw data are in local time. DST is handled as "skip hour" (12a, 1a, 3a,...) in spring, "extra hour" (12a, 1a, 2a, 2a, 3a,...) in fall.

17 WIND ENERGY↗