Search NASA⌕ Search

SEARCH · Search NASA

Results for “Large data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Towards operational atmospheric correction of airborne hyperspectral imaging spectroscopy: Algorithm evaluation, key parameter analysis, and machine learning emulators

Atmospheric correction of airborne hyperspectral imaging spectroscopy (AHIS) to obtain high-quality surface reflectance is the prerequisite for remote sensing applications. Over the last decades, different atmospheric correction methods have been developed based on radiative transfer models (RTMs), however, the relative performances of different algorithms are unclear. Automated operational atmospheric correction methods to process large-volume AHIS data in a high-accurate and high-throughput manner are still lacking. Therefore, this study proposed an operational atmospheric correction pipeline for deriving surface reflectance from AHIS data. To ensure the accuracy and efficiency of the pipeline, we focused on three specific aspects: (1) selecting a suitable RTM for the development of atmospheric lookup tables (LUTs) by comparing the commercial MODerate resolution atmospheric TRANsmission (MODTRAN) and open-sourced Library for Radiative TRANsfer (LibRadTRAN) models, where the widely-used software, Atmospheric/Topographic Correction for Airborne Imagery (ATCOR), was used as benchmarks; (2) identifying key atmospheric correction parameters and determining suitable sources for parameter retrievals including AHIS, Moderate Resolution Imaging Spectroradiometer (MODIS), and AErosol RObotic NETwork (AERONET); and (3) testing the performance of using machine learning emulators to speed up the RTM-based atmospheric correction. Results indicate that (1) atmospheric correction based on MODTRAN LUTs can produce surface reflectance accurately with mean absolute errors < 0.05 and cosine similarities > 0.98 compared to field measurements, which is comparable to the software ATCOR and slightly outperforms the LibRadTRAN LUTs; (2) sobol global sensitivity analysis demonstrates that in the atmospheric correction, visibility and water vapor are two key parameters that can be accurately derived from AHIS in contrast to MODIS or AERONET data; and (3) Random Forest emulators can produce accurate estimations of surface reflectance with mean absolute errors < 0.03 and cosine similarities > 0.98 for higher processing efficiency and determine a suitable set of wavelengths for retrieving atmospheric visibility and water vapor. In conclusion, the proposed atmospheric correction pipeline also improved the four-stream radiative transfer theory for airborne applications by considering adjacent effects from airborne surrounding pixels and can also be applied for atmospheric correction of hyperspectral data from spaceborne missions.

47 OTHER INSTRUMENTATION↗
DOE OSTI2026

Physical properties and anisotropic magnetism of EuBi 2

We report the synthesis of EuBi 2 single crystals and their magnetic and electronic properties. Plate-like crystals were grown in excess bismuth, and X-ray diffraction data confirm the previously reported tetragonal space group, I 4 1 /amd (No. 141). A Néel temperature of T N = 18.6 K was determined from the specific heat data, and corresponding anomalies occur in the magnetization and resistivity. We only observe one magnetic transition in zero magnetic field. The magnetization data above 70 K are well described by a Curie-Weiss model with a Weiss temperature of Θ CW ≈ −35 K and an effective moment near that of the expected spin-only moment of Eu 2+ (S = 7/2). Isothermal magnetization measurements reveal field-induced transitions for H||[100], including a hysteretic spin-flop centered at 10.1 T and a change in slope at 12 T and 2 K. However, while the isothermal magnetization for H||[110] displays nonlinear behavior, discrete metamagnetic transitions are not observed for H||[110] or H||[001], indicating significant magnetic anisotropy. The magnetization does not saturate by 13.5 T for any orientation. EuBi 2 is metallic and our crystals possess an in-plane residual resistivity ratio of ⍴300 K/⍴2 K ≈ 40. Single crystal neutron diffraction data reveal a large magnetic unit cell and non-trivial antiferromagnetic ordering. These results demonstrate that strong antiferromagnetic coupling drives complex magnetism in EuBi 2 .

36 MATERIALS SCIENCE↗
DOE OSTI2020

Radiation-hard miniature optical engine with high bandwidth

Future silicon trackers will be operated in an intense radiation environment and require large volumes of data to be transmitted off detector. In addition, the optical modules must be of low mass in order to limit multiple scattering and nuclear interactions that would degrade the overall performance of the detector. Here, we present a miniature optical engine that satisfies these constraints. The optical engine consists of an ASIC driving a VCSEL (Vertical Cavity Surface Emitting Laser) array in an optical package. Two ASICs are designed to operate a 12-channel VCSEL array at 1.28 or 5.12 Gb/s per channel, which yields a total data rate of up to 60 Gb/s. The core transistors are fabricated in a 65 nm CMOS process which enhance the radiation-hardness. Each channel contains equalizer (CTLE) and clock-data recovery circuits (CDR) so that the ASIC can restore the highly distorted electrical signal after propagating through several meters of cables of small diameter. The equalizer, CDR, and VCSEL driver are configured via a digital I 2 C chip interface with triple redundant memory to mitigate single event upset (SEU) effects. The bias and modulation currents are controlled by a digital-to-analog converter (DAC). We present the design of the circuit together with the results of the simulations and preliminary measurements.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Simultaneous reweighting of Transverse Momentum Dependent distributions

The Bayesian reweighting procedure is extended to the case of multiple independent extractions of transverse momentum dependent parton distributions (TMDs). By exploiting the data on transverse single spin asymmetries, A N , for inclusive pion production in polarized proton-proton collisions measured at RHIC, we perform a simultaneous reweighting of the quark Sivers, transversity and Collins TMD functions extracted from semi-inclusive deep inelastic scattering (SIDIS) and annihilation into hadron pairs. The impact of the implementation of the Soffer bound, as well as the differences between older and newer e + e - data, are investigated. The agreement with A N data at large-x F values, a kinematical region complementary to those explored in SIDIS measurements, is enhanced, improving the knowledge of the polarized quark TMDs in the large-x region.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2026

Toward an event-level analysis of hadron structure using differential programming

Reconstructing the internal properties of hadrons in terms of fundamental quark and gluon de- grees of freedom is a central goal in nuclear and particle physics. This effort lies at the core of major experimental programs, such as the Jefferson Lab 12 GeV program and the upcoming Electron-Ion Collider. A primary challenge is the inherent inverse problem: converting large-scale observational data from collision events into the fundamental QCD-defined densities that characterize the micro- scopic structure of hadronic systems. Recent advances in AI and machine learning have opened new avenues for addressing this challenge using deep learning techniques. A particularly promising direction is the integration of complex theoretical calculations and experimental simulations into a unified framework capable of reconstructing these densities directly from event-level information. In this document, we introduce a key algorithm called LOITS, which enables differentiable program- ming within such a framework, facilitating the use of AI/ML techniques to solve the inverse problem of QCF reconstruction at the event level.

Braga, Kevin [College of William and Mary, William↗
DOE OSTI2019

Short-term traffic state prediction from latent structures: Accuracy vs. efficiency

Recently, deep learning models have shown promising performances in many research areas, including traffic states prediction, due to their ability to model complex nonlinear relationships. However, deep learning models also have drawbacks that make them less preferable for certain short-term traffic prediction applications. For example, they require a large amount of data for model training, which is also computationally expensive. Moreover, deep learning models lack interpretability of the results. This paper develops a short-term traffic states forecasting algorithm based on partial least square (PLS) to help enhance real-time decision-making and build better insights into traffic data. The proposed model is capable of predicting short-term traffic states accurately and efficiently by capturing dominant spatiotemporal features and day-to-day variations from collinear and correlated traffic data. Three case studies are developed to demonstrate the proposed model in short-term traffic prediction applications.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2020

Exhaustive Product Analysis of Three Benzene Discharges by Microwave Spectroscopy

Using chirped and cavity microwave spectroscopies, automated double resonance, new high-speed fitting and deep learning algorithms, and large databases of computed structures, the discharge products of benzene alone, or in combination with molecular oxygen or nitrogen, have been exhaustively characterized between 6.5 and 26 GHz. In total, more than 3300 spectral features were observed; 89% of these, accounting for 97% of the total intensity, have now been assigned to 152 distinct chemical species and 60 of their variants (i.e., isotopic species and vibrationally excited states). Roughly 50 of the products are entirely new or poorly characterized at high resolution, including many heavier by mass than the precursor benzene. These findings provide direct evidence for a rich architecture of two- and three-dimensional carbon and indicate that benzene growth, particularly the formation of ring–chain molecules, occurs facilely under our experimental conditions. The present analysis also illustrates the utility of microwave spectroscopy as a precision tool for complex mixture analysis, irrespective of whether the rotational spectrum of a product species is known a priori or not. From this large quantity of data, for example, it is possible to determine with confidence the relative abundances of different product masses, but more importantly the relative abundances of different isomers with the same mass. We review the complementary nature of this type of analysis to traditional mass spectrometry.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Exploring the Effects of Node Topology, Connectivity, and Metal Identity on the Binding of Nerve Agents and Their Hydrolysis Products in Metal–Organic Frameworks

Recent studies have shown that metal–organic frameworks (MOFs) built from hexanuclear M(IV) oxide cluster nodes are effective catalysts for nerve agent hydrolysis, where the properties of the active sites on the nodes can strongly influence the reaction energetics. The connectivity and metal identity of these M6 nodes can be easily tuned, offering extensive opportunities for computational screening to predict promising new materials. Thus, we used density functional theory (DFT) to examine the effects of node topology, connectivity, and metal identity on the binding energies of multiple nerve agents and their corresponding hydrolysis products. By computing an optimization metric based on the relative binding strengths of key hydrolysis reaction species (water, agent, and bidentate-bound products), we predicted optimal M6 nodes for hydrolyzing specific nerve agent and simulant molecules, where our results are in qualitative agreement with observed experimental trends. This analysis highlighted the notion that no single metal or node topology is optimal for all possible organophosphates, suggesting that MOFs should be selected based on the agent of interest. Using the large amount of data generated from our DFT calculations, we then derived quantitative structure–activity relationship (QSAR) models to help explain the complex trends observed in the binding energies. Through linear regression, we identified the most important descriptors for describing the binding of nerve agents and their hydrolysis products to M6 nodes. These results suggested that both molecular and node properties, including both structural and chemical features, collectively contribute to the binding energetics. By performing a thorough statistical analysis, we showed that our QSAR models are capable of making quantitatively accurate binding energy predictions for nerve agents and their hydrolysis products in a wide variety of M(IV)-MOFs. In conclusion, the insights gained herein can be used to guide future experiments for the synthesis of MOFs with enhanced catalytic activity for organophosphate hydrolysis.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Machine Learning Correlation of Electron Micrographs and ToF-SIMS for the Analysis of Organic Biomarkers in Mudstone

The spatial distribution of organics in geological samples can be used to determine when and how these organics were incorporated into the host rock. Mass spectrometry (MS) imaging can rapidly collect a large amount of data, but ions produced are mixed without discrimination, resulting in complex mass spectra that can be difficult to interpret. Here, we apply unsupervised and supervised machine learning (ML) to help interpret spectra from time-of-flight-secondary ion mass spectrometry (ToF-SIMS) of an organic-carbon-rich mudstone of the Middle Jurassic of England (UK). It was previously shown that the presence of sterane molecular biomarkers in this sample can be detected via ToF-SIMS (Pasterski, M. J. et al., Astrobiology 2023, 23, 936). We use unsupervised ML on scanning electron microscopy–electron dispersive spectroscopy (SEM-EDS) measurements to define compositional categories based on differences in elemental abundances. We then test the ability of four ML algorithms─k-nearest neighbors (KNN), recursive partitioning and regressive trees (RPART), eXtreme gradient boost (XGBoost), and random forest (RF)─to classify the ToF-SIM spectra using (1) the categories assigned via SEM-EDS, (2) organic and inorganic labels assigned via SEM-EDS, and (3) the presence or absence of detectable steranes in ToF-SIMS spectra. In terms of predictive accuracy and balanced accuracy, KNN was the best performing model and RPART the worst. The feature importance, or the specific features of the ToF-SIM spectra used by the models to make classifications, cannot be determined for KNN, preventing posthoc model interpretation. Nevertheless, the feature importance extracted from the other models was useful for interpreting spectra. In conclusion, we determined that some of the organic ions used to classify biomarker containing spectra may be fragment ions derived from kerogen which is abundant in this mudstone sample.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

A Retrospective of Findings From the FORTE Satellite Mission

We revisit the findings from the FORTE satellite program (1997–2004), which collected optical imaging of lightning as well as optical and radio frequency time series waveforms globally from low-earth-orbit. These include surveys of the earth's radio frequency anthropogenic noise environment; earth surface reflectivity at radio frequencies; a scheme for classifying lightning discharge types on the basis of their very high frequency time domain power envelope; insights into the polarization and radiation pattern characteristics of different lightning types, with implications for the underlying discharge processes; and estimates of cloud optical properties based on the statistics of scattered light. Most significantly, FORTE was uniquely suited to capture large samples of data from the rare discharge known as “narrow bipolar events,” enabling detailed examination of their basic characteristics and confirming that they appear to result from fundamentally distinct physical processes compared to other lightning. In particular, despite representing huge charge transfer they evidently produce little-to-no light output.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Enhance Low Level Temperature and Moisture Profiles Through Combining NUCAPS, ABI Observations, and RTMA Analysis

Thermodynamic information from low levels in the atmosphere is crucial for operational weather forecasts and meteorological researchers. The NOAA Unique Combined Atmospheric Processing System (NUCAPS) sounding products have been proven beneficial to fill the data gap between synoptic radiosonde observations (RAOBs). However, compared with the upper troposphere, the accuracy of NUCAPS soundings in the low levels still needs improvement. In this study, a deep neural network (DNN) is applied to fuse multiple data sources to enhance the NUCAPS temperature and moisture profiles in the lower atmosphere. The network is developed by combining satellite observations, including NUCAPS sounding retrievals and high resolution geostationary satellite observations from the Advanced Baseline Imager, and surface analysis from the Real-Time Mesoscale Analysis (RTMA) as inputs, while collocated soundings from ECMWF re-analysis version 5 are used as the benchmark for the training. The performance of the model is evaluated by using the independent testing data set, data from a different year, as well as collocated RAOBs, showing improvement to the temperature and moisture profiles by reducing the root-mean-squared-error (RMSE) by more than 30% in the lower atmosphere (from 700 hPa to surface) in both clear sky and partially cloudy conditions. A convective event from June 18, 2017 is presented to illustrate the application of the enhanced low level soundings on high impact weather events. The enhanced soundings from fused data capture the large surface-based convective available potential energy structures in the preconvection environment, which is very useful for severe storm nowcasting and forecasting applications.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Predicting Characteristics of the Water Cycle From Scaling Relationships

Over multi-decadal time scales, assuming that changes in subsurface water storage are negligible, the continental precipitative water flux, P, can be divided into two principal components, Q (run-off, including soil infiltration and groundwater recharge) and ET (evapotranspiration). Taking into account a broadly applied Budyko's phenomenology to describe the relationship of ET/P as a function of PET/P, where PET is the potential evapotranspiration, we propose a theoretical framework for predicting characteristics of the water cycle from scaling relationships. In this framework, the ecosystem net primary productivity is expressed in terms of soil formation and vegetation growth, which is mathematically optimized with respect to the water partitioning, generating directly the value ET/P. Here, the mathematical optimization is based on the general ecological principle that dominant ecosystems tend to be those that, for any given conditions, maximize conversion of atmospheric carbon to biomass. It is shown that application of the results of mathematical optimization to water-limited ecosystems is possible by applying the optimization only to a vegetation covered portion of the surface. For energy-limited ecosystems, the optimization can be applied only to a portion of the precipitation equal to PET, assuming that the remaining P simply runs off. We use theoretical and actual values of plant root fractal dimensionalities, d f , to predict ranges of ET/P as a function of PET/P for 0 ≤ PET/P ≤ 1 and compare with annual and multi-decadal means of ET/P. By comparing the developed approach with a large amount of data collected from the literature, we demonstrate its successful applications to both water- and energy-limited systems.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

A Greening Future Elevates Flash Drought Risk in Northern Mid‐to‐High Latitudes

Flash droughts have become a growing concern, as they can emerge rapidly and increase the risk of crop failure. Although past studies have investigated the meteorological drivers and future changes of flash drought, why flash drought is more frequent over humid and vegetated regions remains underexplored. This study delves further into the mechanism by which vegetation regulates flash drought and its future change using observations from multiple data sets and large ensemble simulations from three Earth system models. On an interannual timescale, both observations and simulations show robust increases in flash drought frequency and a higher flash-to-sub-seasonal drought ratio during spring or antecedent conditions with dense vegetation, supporting the important role of vegetation in flash drought occurrence, especially in the northern mid-to-high latitudes. In the latter regions, the large ensemble simulations show robust increases in flash drought (e.g., 67% and 46% increases in Eastern U.S. and North Asia in 2050–2100 relative to 1950–2000 under the high emission scenario), where the growing season is lengthening. Although greening might suggest reduced drought stress, it drives precipitation-soil moisture-evapotranspiration decoupling by increasing evapotranspiration partitioning to transpiration. As transpiration can access deep soil water through the plant root system, its increased portion can weaken the constraints of concurrent precipitation on evapotranspiration, thus accelerating soil moisture depletion under high evaporative demand, driving a slow-to-rapid drought transition. How vegetation regulates flash drought by regulating surface moisture budget is supported by observations and simulations. Although warming supports early planting, agriculture may increasingly be threatened by surging flash drought risk.

Drought↗
DOE OSTI2021

Automated discovery of a robust interatomic potential for aluminum

Machine learning, trained on quantum mechanics (QM) calculations, is a powerful tool for modeling potential energy surfaces. A critical factor is the quality and diversity of the training dataset. Here we present a highly automated approach to dataset construction and demonstrate the method by building a potential for elemental aluminum (ANI-Al). In our active learning scheme, the ML potential under development is used to drive non-equilibrium molecular dynamics simulations with time-varying applied temperatures. Whenever a configuration is reached for which the ML uncertainty is large, new QM data is collected. The ML model is periodically retrained on all available QM data. The final ANI-Al potential makes very accurate predictions of radial distribution function in melt, liquid-solid coexistence curve, and crystal properties such as defect energies and barriers. We perform a 1.3M atom shock simulation and show that ANI-Al force predictions shine in their agreement with new reference DFT calculations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Demonstration of an AI-driven workflow for autonomous high-resolution scanning microscopy

Abstract Modern scanning microscopes can image materials with up to sub-atomic spatial and sub-picosecond time resolutions, but these capabilities come with large volumes of data, which can be difficult to store and analyze. We report the Fast Autonomous Scanning Toolkit (FAST) that addresses this challenge by combining a neural network, route optimization, and efficient hardware controls to enable a self-driving experiment that actively identifies and measures a sparse but representative data subset in lieu of the full dataset. FAST requires no prior information about the sample, is computationally efficient, and uses generic hardware controls with minimal experiment-specific wrapping. We test FAST in simulations and a dark-field X-ray microscopy experiment of a WSe 2 film. Our studies show that a FAST scan of <25% is sufficient to accurately image and analyze the sample. FAST is easy to adapt for any scanning microscope; its broad adoption will empower general multi-level studies of materials evolution with respect to time, temperature, or other parameters.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Machine learning the microscopic form of nematic order in twisted double-bilayer graphene

Modern scanning probe techniques, such as scanning tunneling microscopy, provide access to a large amount of data encoding the underlying physics of quantum matter. In this work, we show how convolutional neural networks can be used to learn effective theoretical models from scanning tunneling microscopy data on correlated moiré superlattices. Moiré systems are particularly well suited for this task as their increased lattice constant provides access to intra-unit-cell physics, while their tunability allows for the collection of high-dimensional data sets from a single sample. Using electronic nematic order in twisted double-bilayer graphene as an example, we show that incorporating correlations between the local density of states at different energies allows convolutional neural networks not only to learn the microscopic nematic order parameter, but also to distinguish it from heterostrain. These results demonstrate that neural networks are a powerful method for investigating the microscopic details of correlated phenomena in moiré systems and beyond.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2024

Improved machine learning algorithm for predicting ground state properties

Finding the ground state of a quantum many-body system is a fundamental problem in quantum physics. In this work, we give a classical machine learning (ML) algorithm for predicting ground state properties with an inductive bias encoding geometric locality. The proposed ML model can efficiently predict ground state properties of an n-qubit gapped local Hamiltonian after learning from only $\mathcal{O}$(log(n)) data about other Hamiltonians in the same quantum phase of matter. This improves substantially upon previous results that require $\mathcal{O}$(n c ) data for a large constant c. Furthermore, the training and prediction time of the proposed ML model scale as $\mathcal{O}$(n log n) in the number of qubits n. Numerical experiments on physical systems with up to 45 qubits confirm the favorable scaling in predicting ground state properties using a small training dataset.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2021

Exposing structural variations in SARS-CoV-2 evolution

The mutation of SARS-CoV-2 influences viral function as residue replacements affect both physiochemical properties and folding conformations. Although a large amount of data on SARS-CoV-2 is available, the investigation of how viral functions change in response to mutations is hampered by a lack of effective structural analysis. Here, we exploit the advances of protein structure fingerprint technology to study the folding conformational changes induced by mutations. With integration of both protein sequences and folding conformations, the structures are aligned for SARS-CoV to SARS-CoV-2, including Alpha variant (lineage B.1.1.7) and Delta variant (lineage B.1.617.2). The results showed that the virus evolution with change in mutational positions and physicochemical properties increased the affinity between spike protein and ACE2, which plays a critical role in coronavirus entry into human cells. Additionally, these structural variations impact vaccine effectiveness and drug function over the course of SARS-CoV-2 evolution. The analysis of structural variations revealed how the coronavirus has gradually evolved in both structure and function and how the SARS-CoV-2 variants have contributed to more severe acute disease worldwide.

59 BASIC BIOLOGICAL SCIENCES↗