Search NASA⌕ Search

SEARCH · Search NASA

Results for “data resolution”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36

Sensor Data Management, Validation, Correction, and Provenance for Building Technologies

Oak Ridge National Laboratory (ORNL) conducts research on technologies that use a wide range of sensors to develop and characterize building energy performance. The management of high-resolution sensor data, analysis, and tracing lineage of such activities is challenging. Missing or corrupt data due to sensor failure, fouling, drifting, calibration error, or data logger failure is another issue. This paper focuses on sensor data management, validation, correction, and provenance to combat these issues, ensuring complete and accurate sensor datasets for building technologies applications and research. The design and development of two integrated software products are discussed: Sensor Data Validation and Correction (SensorDVC) and the Provenance Data Management System (ProvDMS) platform.

Data management↗

Desmearing small-angle scattering data by central moment expansions of instrument resolution

This study introduces an enhanced numerical technique tailored specifically for refining 1D small-angle scattering (SAS) intensity profiles affected by smearing. Our primary objective is to address the resolution blurring commonly encountered in SAS data, particularly in systems with clearly defined correlation peaks whose spread aligns with the width of the resolution function at corresponding Q positions. Unlike previous approaches that expanded the SAS intensity using central moment expansion, the new method focuses on expanding the resolution function itself, thus eliminating artificial oscillations observed in smeared spectra due to limitations inherent in our earlier algorithm. This method is straightforward to implement, computationally efficient and consistently performs well in numerical benchmarking. To illustrate its effectiveness, we present a case study of a lamellar phase characterized by distinct peaks in its small-angle neutron scattering intensities.

central moment expansions↗

GeoAI: spatially explicit artificial intelligence techniques for geographic knowledge discovery and beyond

Recent progress in Artificial Intelligence (AI) techniques, the large-scale availability of high-quality data, as well as advances in both hardware and software to efficiently process these data, are transforming a range of fields from computer vision and natural language processing to autonomous driving and healthcare. For example, the availability of high-resolution geographic data and high-performance computing techniques together with deep learning fuel progress in fast and accurate object detection. Recent examples of GeoAI work include the detections of terrain features and densely-distributed building footprints, information extraction from scanned historical maps, semantic classification (e.g. LiDAR point clouds), novel methods for spatial interpolation, and advances in traffic forecasting. Similarly, machine learning and natural language processing are facilitating the extraction of geographic information from unstructured (textual) data, such as news articles and Wikipedia as well as the matching of natural features in multiple gazetteers.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

DISPERSION OF MAGNETIC FIELDS IN MOLECULAR CLOUDS. III

We apply our technique on the dispersion of magnetic fields in molecular clouds to high spatial resolution Submillimeter Array polarization data obtained for Orion KL in OMC-1, IRAS 16293, and NGC 1333 IRAS 4A. We show how one can take advantage of such high-resolution data to characterize the magnetized turbulence power spectrum in the inertial and dissipation ranges. For Orion KL we determine that in the inertial range the spectrum can be approximately fitted with a power law k{sup -(2.9{+-}0.9)} and we report a value of 9.9 mpc for {lambda}{sub AD}, the high spatial frequency cutoff presumably due to turbulent ambipolar diffusion. For the same parameters we have {approx}k{sup -(1.4{+-}0.4)} and a tentative value of {lambda}{sub AD} {approx_equal} 2.2 mpc for NGC 1333 IRAS 4A, and {approx}k{sup -(1.8{+-}0.3)} with an upper limit of {lambda}{sub AD} {approx}< 1.8 mpc for IRAS 16293. We also discuss the application of the technique to interferometry measurements and the effects of the inherent spatial filtering process on the interpretation of the results.

79 ASTRONOMY AND ASTROPHYSICS↗

2D Polyhedral Template Matching for Atomic Resolution Microscopy

SAND2024-13879O The 2D Polyhedral Template Matching for Atomic Resolution Microscopy is a suite of functions for analyzing atomic resolution electron microscopy images using the 2D polyhedral template matching (2D-PTM) method. This software analyzes atomic resolution microscopy data from electron microscopic imaging or scanning probe microscopies. The primary application is for identifying different crystal phases, crystal orientations, and defect structures obtained in such atomic resolution images. Written in MATLAB and starting from an atomic resolution image, the code identifies the positions of atomic intensity peaks. It then matches predefined structural templates to the local atomic environments. Outputs include the local structural identification, the template scaling factor and rotation angle, root-mean-squared deviation (RMSD), and centrosymmetry parameter.

Medlin, Douglas↗

Optimal spectral resolution for solids and liquids using FT and other infrared spectrometers: How much resolution do you really need?

In this study we investigate the possibility of using spectral resolutions for infrared measurements of solids and liquids that are not powers of two, e.g. are not at 1, 2, 4, 8, or 16 cm-1 resolution. In almost all reported literature of the last fifty years the resolution used to record for a Fourier transform infrared spectrum has been a power of two. This stems from the fact that 1) the Cooley-Tukey algorithm used to compute such a transform was constructed to use only powers of two and was also driven by 2) the fact that the computing horsepower required to compute the Fourier transform increases as N?log?_2 (N), where N is the number of points in the interferogram (spectrum). For typical spectra, however, the CPU time is no longer a consideration. Our study is based on both liquid and solid spectra, all of which were recorded at 2 cm-1 resolution. There were at total of 70 solids spectra representing 2,472 spectral peaks and 61 liquids spectra (1,765 spectral peaks), each peak being inspected for being singlet / multiplet in nature. Of the 1,765 liquid bands examined, only 27 had widths less than 5 cm-1. Of the 2,472 solid bands examined, only 39 peaks have widths less than 5 cm-1. For liquids, the mean peak width is 24.7 cm-1 but the median peak width is 13.7 cm-1, and, similarly, for solids, the mean peak width is 22.2 cm-1 but the median peak width is 11.2 cm-1. In both cases, solids and liquids, a skewed peak widths distribution was observed, the peak of the distribution representing narrower bands in the 7 to 9 cm-1 FWHM range but displaying a long tail to the very broad bands, with some displaying spectral widths of 100 cm-1 or more. Because one of the most important criteria for successful instrumental design in IR spectroscopy is the spectral resolution, the data were further analyzed showing that a value to resolve 95% of all bands is 5.7 cm-1 for liquids and 5.3 cm-1 for solids; such a resolution would capture the native linewidth (no instrumental broadening) of 95% of all the solids and liquid bands, respectively. Based on the present results we suggest that, when accounting only for intrinsic linewidths an optimized resolution of 6.0 cm-1 will capture 91% of all condensed-phase bands for IR detection of chemical, mineral, and biological materials.

Forland, Brenda M.↗

Improving the estimate of higher-order moments from lidar observations near the top of the convective boundary layer

Abstract. Ground-based lidar data have proven extremely useful for profiling the convective boundary layer (CBL). Many groups have derived higher-order moments (e.g., variance, skewness, fluxes) from high-temporal-resolution lidar data using an autocovariance approach. However, these analyses are highly uncertain near the CBL top when the depth of the CBL (zi) is changing during the analysis period. This is because the autocovariance approach is usually applied to constant height levels and the character of the eddies is changing on either side of the changing CBL top. Here, a new approach is presented wherein the autocovariance analysis is performed on a normalized height grid, with a temporally smoothed zi. Output from a large eddy simulation model demonstrates that deriving higher-order moments from time series on a normalized height grid has better agreement with the slab-averaged quantities than the moments derived from the original height grid.

Rosenberger, Tessa E. (ORCID:0000000333205873)↗

Molecular-Resolution Electron Imaging of Defects and Dynamics at the Ice-Water Interface

Water crystallization into hexagonal ice (type I h ) is one of the most critical processes relevant to the Earth’s environment and human activities. However, despite recent breakthroughs in imaging non-equilibrium condensed ice structures, the ice-water interface has never been imaged at a molecular resolution. This is primarily due to the low stability of the hydrogen bonds in ice under high-resolution microscopy conditions and a lack of methods to prepare compatible samples. Here, this presentation describes the first molecular-resolution imaging of ice crystallized from liquid water and the ice-water interface using high-resolution transmission electron microscopy (HRTEM). By encapsulating deionized (DI) water between two amorphous carbon (a-C) TEM grids and subsequently freezing it with liquid N 2 on a cryo sample stage, we generated two types of ice: non-equilibrium, condensed ice from the atmosphere and encapsulated ice from the DI water (Fig. 1A). Condensed ice usually shows irregular, spherulitic shapes (Fig. 1B). Selected area electron diffraction (SAED) shows that they are a mixture of cubic and hexagonal crystals (Fig. 1C). On the contrary, encapsulated ice forms thin films that contain large-area single-crystalline regions of hexagonal ice oriented along the [0001] zone axis (Fig. 1D). Differential electron energy-loss spectroscopy (EELS) confirmed the high purity of the encapsulated ice free from organic contaminations that are common in other encapsulation methods for HRTEM such as graphene liquid cells. These single-crystalline areas are robust under the electron beam up to ~100 e/Å 2 s. Aberration-corrected HRTEM imaging in these areas achieved a line resolution of ~1.3 Å (Fig. 1E and F). This platform allows us to study near-equilibrium ice structures and dynamics at an unprecedented spatial resolution (Fig. 2). For example, we discovered subdomain-rich regions near the defective crystal edges despite the structure appearing single-crystalline according to diffraction criteria. These subdomains connect via low-angle grain boundaries with flat energy landscapes as a function of tilt angles (according to simulations), showing the high tolerance of ice to defect structures. When we tuned the sample temperature and electron flux rate, we observed radiolysis-controlled bubble generation and dissolution in ice single crystals near a steady state of bubble dynamics. Furthermore, rich beam-induced melting and recrystallization dynamics were observed at the ice-water interface with lattice resolution. These data represent the first observation of the ice-water phase transformation at the sub-nanometer level. In summary, the methods developed in this work enabled molecular-resolution observations of ice and the ice-water interface and shed light on the microstructures and phase transformation pathways. Finer control on the temperature, electron irradiation profile, and imaging detector could eventually lead to real-time observation of ice nucleation in water and address long-standing questions in the nucleation pathways.

74 ATOMIC AND MOLECULAR PHYSICS↗

Fundamental physics with ESPRESSO: a new determination of the D/H ratio towards PKS1937-101

ABSTRACT Primordial abundances of light elements are sensitive to the physics of the early Universe and can directly constrain cosmological quantities, such as the baryon-to-photon ratio $\eta _{10}$, the baryon density, and the number of neutrino families. Deuterium is especially suited for these studies: its primordial abundance is sensitive and monotonically dependent on $\eta _{10}$, allowing an independent measurement of the cosmic baryon density that can be compared, for instance, against the Planck satellite data. The primordial deuterium abundance can be measured in high H i column density absorption systems towards distant quasars. We report here a new measurement, based on high-resolution ESPRESSO data, of the primordial D i abundance of a system at redshift $z \sim 3.572$, towards PKS1937-101. Using only ESPRESSO data, we find a D /H ratio of $2.638\pm 10^{-5}$, while including the available UVES data improves the precision, leading to a ratio of $2.608 \pm 10^{-5}$. The results of this analysis agree with those of the most precise existing measurements. We find that the relatively low column density of this system ($\log {N_{\rm H_I}/ {\rm cm}^{-2}}\sim 18$) introduces modelling uncertainties, which become the main contributor to the error budget.

Guarneri, Francesco (ORCID:0000000347409762)↗

Smart-DS: Synthetic Models for Advanced, Realistic Testing: Distribution Systems and Scenarios

The National Renewable Energy Laboratory (NREL) in collaboration with Massachusetts Institute of Technology (MIT), Universidad Pontificia Comillas (Comillas-IIT, Spain) and GE Grid Solutions, is working on an ARPA-E GRID DATA project, titled Smart-DS, to create: 1) High-quality, realistic, synthetic distribution network models, and 2) Advanced tools for automated scenario generation based on high-resolution weather data and generation growth projections. Through these advancements, the Smart-DS project is envisioned to accelerate the development, testing, and adoption of advanced algorithms, approaches, and technologies for sustainable and resilient electric power systems, especially in the realm of U.S. distribution systems. This talk will present the goals and overall approach of the Smart-DS project, including the process of creating the synthetic distribution datasets using reference network model (RNM) and the comprehensive validation process to ensure network realism, feasibility, and applicability to advanced use cases. The talk will provide demonstrations of early versions of synthetic models, along with the lessons learnt from expert engagements to enhance future iterations. Finally, the scenario generation framework, its development plans, and co-ordination with GRID DATA repository teams to house these datasets for public access will also be discussed.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Progress Towards a Predictive Eagle Behavior and Risk Modeling Framework: Overview and Recent Validation Efforts

This presentation summarizes progress to date of the U.S. Department of Energy project, "Development of a computational framework for modeling golden eagles (Aquila chrysaetos) near wind farms," which focuses on stochastic behavioral modeling of soaring raptors across landscape, facility, and turbine spatiotemporal scales. This publicly available, open-source modeling framework includes behavioral models based on three different underlying principles: energy minimization at landscape scale, behavioral heuristics at landscape-facility scale, and data-driven behaviors at the facility-micro-scale. We will briefly overview the key advancements in the behavioral modeling state of the art, which leverages multiple high-resolution telemetry data sources combined with high-fidelity atmospheric flow modeling insights. We then present preliminary results from a validation study in Altamont, California. This new study involves a novel application of the Stochastic Soaring Raptor Simulator (SSRS), in a new geographic locale, to understand facility scale eagle movement patterns over time scales representative of a wind project's lifetime. For this desktop analysis (that does not depend on any high-performance computing resources), SSRS simultaneously considers a variety of wind conditions and eagle approach vectors toward a project site of interest. This work demonstrates the integration of publicly available landscape-scale atmospheric datasets, our recently improved engineering updraft models (see presentation from Thedin et al.), and our energy minimization behavioral models within the SSRS framework. While we only present results from a single behavioral model, the integration of these three modeling components forms the foundation for our more sophisticated behavioral models (see presentations from Brandes et al., Sandhu et al.) that are under active development. Results are presented in the form of presence maps, which may be applied to estimate risk to wildlife, augment ground survey data, inform wind-plant operations, or incorporated into wind-plant designs.

agent-based modeling↗

Expanded Understanding of the Western Antarctic Peninsula Sea‐Ice Environment Through Local and Regional Observations at Palmer Station

Abstract The Western Antarctic Peninsula (WAP) has been experiencing rapid regional warming since at least the 1950s, however, the impacts of this warming at the local scale are variable and nuanced. Previous studies that have linked sea‐ice variability to biogeochemical cycles and food web dynamics often combine local‐scale biogeochemical data with coarse‐resolution regional satellite sea‐ice data, which may not adequately capture local sea‐ice conditions. In this study, we analyzed local‐scale in situ sea‐ice observations collected as part of a 28‐year record (1992–2020) from the Palmer Long‐Term Ecological Research site at Anvers Island, mid‐WAP, in conjunction with isotopically‐derived sea‐ice meltwater (SIM) fractions and satellite‐derived sea‐ice motion and concentration, to quantify the variability and long‐term trends in local sea‐ice behavior. In situ sea ice observations at Palmer Station displayed higher variability than satellite observations and showed no significant declines over this time, despite region‐wide declines identified in prior studies. Higher spring SIM fractions were attributed to strong northward sea‐ice motion throughout the winter. Applying these local‐scale sea‐ice insights to similarly scaled stratification and chlorophyll‐ a measurements, we found that a longer‐lasting, more consistent sea‐ice pack led to greater water column stratification following the spring sea‐ice retreat. Greater sea‐ice persistence and stronger stratification led to larger peaks in chlorophyll‐ a , though sea‐ice metrics did not explain the positive temporal trends in either stratification strength or chlorophyll‐ a . Through this study, we identify how local sea‐ice observations and meltwater data can enhance satellite data to build an understanding of the intricate connections between ice, water column dynamics, and phytoplankton.

Goodell, E.↗

Machine Learning Classification Strategy to Improve Streamflow Estimates in Diverse River Basins in the Colorado River Basin

Streamflow in the Colorado River Basin (CRB) is significantly altered by human activities including land use/cover alterations, reservoir operation, irrigation, and water exports. Climate is also highly varied across the CRB which contains snowpack-dominated watersheds and arid, precipitation-dominated basins. Recently, machine learning methods have improved the generalizability and accuracy of streamflow models. Previous successes with LSTM modeling have primarily focused on unimpacted basins, and few studies have included human impacted systems in either regional or single-basin modeling. We demonstrate that the diverse hydrological behavior of river basins in the CRB are too difficult to model with a single, regional model. We propose a method to delineate catchments into categories based on the level of predictability, hydrological characteristics, and the level of human influence. Lastly, we model streamflow in each category with climate and anthropogenic proxy data sets and use feature importance methods to assess whether model performance improves with additional relevant data. Overall, land use cover data at a low temporal resolution was not sufficient to capture the irregular patterns of reservoir releases, demonstrating the importance of having high-resolution reservoir release data sets at a global scale. On the other hand, the classification approach reduced the complexity of the data and has the potential to improve streamflow forecasts in human-altered regions.

54 ENVIRONMENTAL SCIENCES↗

Improving Progressive Retrieval for HPC Scientific Data using Deep Neural Network

As the disparity between compute and I/O on high-performance computing systems has continued to widen, it has become increasingly difficult to perform post-hoc data analytics on full-resolution scientific simulation data due to the high I/O cost. Error-bounded data decomposition and progressive data retrieval framework has recently been developed to address such a challenge by performing data decomposition before storage and reading only part of the decomposed data when necessary. However, the performance of the progressive retrieval framework has been suffering from the over-pessimistic error control theory, such that the achieved maximum error of recomposed data is significantly lower than the required error. Therefore, more data than required is fetched for recomposition, incurring additional I/O overhead. In order to tackle this issue, we propose a DNN-based progressive retrieval framework that can better identify the minimum amount of data to be retrieved. Our contributions are as follows: 1) We provide an in-depth investigation of the recently developed progressive retrieval framework; 2) We propose two designs of prediction models (named D-MGARD and E-MGARD) to estimate the amount of retrieved data size based on error bounds. 3) We evaluate our proposed solutions using scientific datasets generated by real-world simulations from two domains. Evaluation results demonstrate the effectiveness of our solution in accurately predicting the amount of retrieval data size, as well as the advantages of our solution over the traditional approach to reducing the I/O overhead. Based on our evaluation, our solution is shown to read significantly less data (5% - 40% with D-MGARD, 20% - 80% with E-MGARD).

Wang, Jinzhen↗

Quantitative 3D petrography using X-ray tomography 2: Combining information at various resolutions

X-ray tomography is a nondestructive technique that can be used to study rocks and other materials in three dimensions over a wide range of sizes. Samples that range from decimeters to micrometers in size can be analyzed, and micrometer- to centimeter-sized crystals, vesicles, and other particles can be identified and quantified. In many applications, quantification of a large spectrum of sizes is important, but this cannot be easily accomplished using a single tomogram due to a common trade-off between sample size and image resolution. This problem can be circumvented by combining tomograms acquired for a single sample at a variety of resolutions. We have successfully applied this method to obtain crystal size distributions (CSDs) for magnetite, pyroxene + biotite, and quartz + feldspar in Bishop Tuff pumice. Five cylinders of systematically varying size (1-10 mm diameter and height) were analyzed from each of five pumice clasts. Cylinder size is inversely proportional to image resolution, such that resolution ranges from 2.5 to 17 {micro}m/voxel with increasing sample size. This allows quantification of crystals 10-1000 {micro}m in size. We obtained CSDs for each phase in each sample by combining information from all resolutions, each size bin containing data from the resolution that best characterizes crystals of that size. CSDs for magnetite and pyroxene + biotite in late-erupted Bishop pumice obtained using this method are fractal, but do not seem to result from crystal fragmentation. CSDs for quartz + feldspar reveal a population of abundant crystals <35 {micro}m in size, and a population of crystals >50 {micro}m in size, which will be the focus of a separate publication.

58 GEOSCIENCES↗

WFIP3 - BARG site - NREL Profiling Lidar (Windcube v2.1) / Raw Data

This dataset contains raw data from NREL's profiling lidar (Windcube v2.1) at the WFIP3 BARG site. Two data types are included here: 1) STA files, which have 10-minute average data, and 2) RTD files, which have real time data, at about 1 Hz resolution. Note: these data have NOT been corrected for the motion of the barge.

17 WIND ENERGY↗

HSRL Liquid cloud base height (nsaC1)

Liquid layers in clouds affect their microphysical processes, as well as the surface energy budget. Studies focusing on these and other areas of research are often in need of skillful estimation of liquid-bearing cloud-layer boundaries. The bases of these layers are predominantly determined by ground-based lidar instruments. Most studies requiring liquid cloud base height (LCBH) information use either fixed lidar depolarization and/or backscatter cross-section thresholds or cloud base height data products that do not distinguish between ice and liquid, all of which might introduce inconsistencies and errors in the resolved LCBH. This data set contains LCBH data at 1-min temoporal resolution based on an explicit LCBH detection algorithm, which uses the high-spectral-resolution lidar (HSRL) data. Examination of this algorithm in multiple cases and scenarios during numerous days and first-order comparison with microwave-radiometer data show satisfactory results.

54 ENVIRONMENTAL SCIENCES↗

HSRL Liquid cloud base height

Liquid layers in clouds affect their microphysical processes, as well as the surface energy budget. Studies focusing on these and other areas of research are often in need of skillful estimation of liquid-bearing cloud-layer boundaries. The bases of these layers are predominantly determined by ground-based lidar instruments. Most studies requiring liquid cloud base height (LCBH) information use either fixed lidar depolarization and/or backscatter cross-section thresholds or cloud base height data products that do not distinguish between ice and liquid, all of which might introduce inconsistencies and errors in the resolved LCBH. This data set contains LCBH data at 1-min temoporal resolution based on an explicit LCBH detection algorithm, which uses the high-spectral-resolution lidar (HSRL) data. Examination of this algorithm in multiple cases and scenarios during numerous days and first-order comparison with microwave radiometer data show satisfactory results.

54 ENVIRONMENTAL SCIENCES↗