Search NASA⌕ Search

SEARCH · Search NASA

Results for “Large data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,045 records · Page 58
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

BASS XXXII: Studying the Nuclear Millimeter-wave Continuum Emission of AGNs with ALMA at Scales ≲100–200 pc

To understand the origin of nuclear (≲100 pc) millimeter-wave (mm-wave) continuum emission in active galactic nuclei (AGNs), we systematically analyzed subarcsecond resolution Band-6 (211–275 GHz) Atacama Large Millimeter/submillimeter Array data of 98 nearby AGNs (z < 0.05) from the 70 month Swift/BAT catalog. The sample, almost unbiased for obscured systems, provides the largest number of AGNs to date with high mm-wave spatial resolution sampling (~1–200 pc), and spans broad ranges of 14–150 keV luminosity {$40\lt \mathrm{log}[{L}_{14-150}/(\mathrm{erg}\,{{\rm{s}}}^{-1})]\lt 45$}, black hole mass $[5\lt \mathrm{log}({M}_{\mathrm{BH}}/{M}_{\odot })\lt 10$], and Eddington ratio ($-4\lt \mathrm{log}{\lambda }_{\mathrm{Edd}}\lt 2$). We find a significant correlation between 1.3 mm (230 GHz) and 14–150 keV luminosities. Its scatter is ≈0.36 dex, and the mm-wave emission may serve as a good proxy of the AGN luminosity, free of dust extinction up to N H ~ 10 26 cm –2 . While the mm-wave emission could be self-absorbed synchrotron radiation around the X-ray corona according to past works, we also discuss different possible origins of the mm-wave emission: AGN-related dust emission, outflow-driven shocks, and a small-scale (<200 pc) jet. The dust emission is unlikely to be dominant, as the mm-wave slope is generally flatter than expected. Also, due to no increase in the mm-wave luminosity with the Eddington ratio, a radiation-driven outflow model is possibly not the common mechanism. Furthermore, we find independence of the mm-wave luminosity on indicators of the inclination angle from the polar axis of the nuclear structure, which is inconsistent with a jet model whose luminosity depends only on the angle.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Latent Stochastic Differential Equations for Modeling Quasar Variability and Inferring Black Hole Properties

Quasars are bright and unobscured active galactic nuclei (AGN) thought to be powered by the accretion of matter around supermassive black holes at the centers of galaxies. The temporal variability of a quasar’s brightness contains valuable information about its physical properties. The UV/optical variability is thought to be a stochastic process, often represented as a damped random walk described by a stochastic differential equation (SDE). Upcoming wide-field telescopes such as the Rubin Observatory Legacy Survey of Space and Time (LSST) are expected to observe tens of millions of AGN in multiple filters over a ten year period, so there is a need for efficient and automated modeling techniques that can handle the large volume of data. Latent SDEs are machine learning models well suited for modeling quasar variability, as they can explicitly capture the underlying stochastic dynamics. In this work, we adapt latent SDEs to jointly reconstruct multivariate quasar light curves and infer their physical properties such as the black hole mass, inclination angle, and temperature slope. Our model is trained on realistic simulations of LSST ten year quasar light curves, and we demonstrate its ability to reconstruct quasar light curves even in the presence of long seasonal gaps and irregular sampling across different bands, outperforming a multioutput Gaussian process regression baseline. Our method has the potential to provide a deeper understanding of the physical properties of quasars and is applicable to a wide range of other multivariate time series with missing data and irregular sampling.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Fast and Flexible Inference Framework for Continuum Reverberation Mapping Using Simulation-based Inference with Deep Learning

Continuum reverberation mapping (CRM) of active galactic nuclei (AGN) monitors multiwavelength variability signatures to constrain accretion disk structure and supermassive black hole (SMBH) properties. The upcoming Vera Rubin Observatory’s Legacy Survey of Space and Time will survey tens of millions of AGN over the next decade, with thousands of AGN monitored with almost daily cadence in the deep drilling fields. However, existing CRM methodologies often require long computation time and are not designed to handle such large amounts of data. In this paper, we present a fast and flexible inference framework for CRM using simulation-based inference (SBI) with deep learning to estimate SMBH properties from AGN light curves. We use a long short-term memory summary network to reduce the high dimensionality of the light curve data and then use a neural density estimator to estimate the posterior of SMBH parameters. Using simulated light curves, we find SBI can produce more accurate SMBH parameter estimation with 10 3 –10 5 times speed up in inference efficiency compared to traditional methods. The SBI framework is particularly suitable for wide-field CRM surveys as the light curves will have identical observing patterns, which can be incorporated into the SBI simulation. We explore the performance of our SBI model on light curves with irregular-sampled, realistic observing cadence and alternative variability characteristics to demonstrate the flexibility and limitation of the SBI framework.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Joint Modeling of Quasar Variability and Accretion Disk Reprocessing Using Latent Stochastic Differential Equations

Quasars are bright active galactic nuclei powered by the accretion of matter around supermassive black holes at the center of galaxies. Their stochastic brightness variability depends on the physical properties of the accretion disk and black hole. The upcoming Rubin Observatory Legacy Survey of Space and Time (LSST) is expected to observe tens of millions of quasars, so there is a need for efficient techniques like machine learning that can handle the large volume of data. Quasar variability is believed to be driven by an X-ray corona, which is reprocessed by the accretion disk and emitted as UV/optical variability. We are the first to introduce an auto-differentiable simulation of the accretion disk and reprocessing. We use the simulation as a direct component of our neural network to jointly model the driving variability and reprocessing, trained with supervised learning on simulated LSST-like 10 yr quasar light curves. We encode the light curves using a transformer encoder, and the driving variability is reconstructed using latent stochastic differential equations, a physically motivated generative deep learning method that can model continuous-time stochastic dynamics. By embedding the physical processes of the driving signal and reprocessing into our network, we achieve a model that is more robust and interpretable. We demonstrate that our model outperforms a Gaussian process regression baseline and can infer accretion disk parameters and time delays between wave bands, even for out-of-distribution driving signals. Our approach provides a powerful framework that can be adapted to solve other inverse problems in multivariate time series.

Fagin, Joshua [City Univ. of New York (CUNY), NY (↗
DOE OSTI2023

Improving the representation of shallow cumulus convection with the simplified-higher-order-closure–mass-flux (SHOC+MF v1.0) approach

Abstract. Parameterized boundary layer turbulence and moist convection remain some of the largest sources of uncertainty in general circulation models. High-resolution climate modeling aims to reduce that uncertainty by explicitly attempting to resolve deep moist convective motions. An example of such a model is the Simple Cloud-Resolving E3SM Atmosphere Model (SCREAM) with a target global resolution of 3.25 km, allowing for a more accurate representation of complex mesoscale deep convective dynamics. Yet, small-scale planetary boundary layer turbulence and shallow convection still need to be parameterized, which in SCREAM is accomplished through the turbulent-kinetic-energy-based (TKE-based) simplified higher-order closure (SHOC) – a simplified version of the assumed-double-Gaussian-PDF (probability density function) higher-order-closure method. In this paper, we implement a stochastic-multiplume mass-flux (MF) parameterization of dry and shallow convection in SCREAM to go beyond the limitations of double-Gaussian-PDF closures and couple it to SHOC (SHOC+MF). The new parameterization implemented in a single-column model type version of SCREAM produces results for two shallow cumulus convection cases (marine and continental shallow convection) that agree well with the reference data from large-eddy simulations, thus improving the general representation of the thermodynamic quantities and their turbulent fluxes as well as cloud macrophysics in the model. Furthermore, SHOC+MF parameterization shows weak sensitivity to the vertical grid resolution and model time step.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Assessing boundary condition and parametric uncertainty in numerical-weather-prediction-modeled, long-term offshore wind speed through machine learning and analog ensemble

To accurately plan and manage wind power plants, not only does the time-varying wind resource at the site of interest need to be assessed but also the uncertainty connected to this estimate. Numerical weather prediction (NWP) models at the mesoscale represent a valuable way to characterize the wind resource offshore, given the challenges connected with measuring hub-height wind speed. The boundary condition and parametric uncertainty associated with modeled wind speed is often estimated by running a model ensemble. However, creating an NWP ensemble of long-term wind resource data over a large region represents a computational challenge. Here, we propose two approaches to temporally extrapolate wind speed boundary condition and parametric uncertainty using a more convenient setup in which a mesoscale ensemble is run over a short-term period (1 year), and only a single model covers the desired long-term period (20 year). We quantify hub-height wind speed boundary condition and parametric uncertainty from the short-term model ensemble as its normalized across-ensemble standard deviation. Then, we develop and apply a gradient-boosting model and an analog ensemble approach to temporally extrapolate such uncertainty to the full 20-year period, for which only a single model run is available. As a test case, we consider offshore wind resource characterization in the California Outer Continental Shelf. Both of the proposed approaches provide accurate estimates of the long-term wind speed boundary condition and parametric uncertainty across the region (R 2 >0.75), with the gradient-boosting model slightly outperforming the analog ensemble in terms of bias and centered root-mean-square error. At the three offshore wind energy lease areas in the region, we find a long-term median hourly uncertainty between 10 % and 14 % of the mean hub-height wind speed values. Finally, we assess the physical variability in the uncertainty estimates. In general, we find that the wind speed uncertainty increases closer to land. Also, neutral conditions have smaller uncertainty than the stable and unstable cases, and the modeled wind speed in winter has less boundary condition and parametric sensitivity than summer.

17 WIND ENERGY↗
DOE OSTI2023

Evolution of eddy viscosity in the wake of a wind turbine

The eddy viscosity hypothesis is a popular method in wind turbine wake modeling for estimating turbulent Reynolds stresses. We document the downstream evolution of eddy viscosity in the wake of a wind turbine from experimental and large-eddy-simulation data. Wake eddy viscosity is isolated from its surroundings by subtracting the inflow profile, and the driving forces are identified in each wake region. Eddy viscosity varies in response to changes in turbine geometry and nacelle misalignment with larger turbines generating stronger velocity gradients and shear stresses. We propose a model for eddy viscosity based on a Rayleigh distribution. Model parameters are obtained from scaling the eddy viscosity hypothesis and demonstrate satisfactory agreement with the reference data. The model is implemented in the curled wake formulation in the FLOw Redirection and Induction in Steady State (FLORIS) framework and assessed through comparisons with the previous formulation. Our approach produced more accurate flow field estimates with lower total error for the majority of cases.

17 WIND ENERGY↗
DOE OSTI2023

Grand challenges in the digitalisation of wind energy

The availability of large amounts of data is starting to impact how the wind energy community works. From turbine design to plant layout, construction, commissioning, and maintenance and operations, new processes and business models are springing up. This is the process of digitalisation, and it promises improved efficiency and greater insight, ultimately leading to increased energy capture and significant savings for wind plant operators, thus reducing the levelised cost of energy. Digitalisation is also impacting research, where it is both easing and speeding up collaboration, as well as making research results more accessible. This is the basis for innovations that can be taken up by end users. But digitalisation faces barriers. This paper uses a literature survey and the results from an expert elicitation to identify three common industry-wide barriers to the digitalisation of wind energy. Comparison with other networked industries and past and ongoing initiatives to foster digitalisation show that these barriers can only be overcome by wide-reaching strategic efforts, and so we see these as “grand challenges” in the digitalisation of wind energy. They are, first, creating FAIR data frameworks; secondly, connecting people and data to foster innovation; and finally, enabling collaboration and competition between organisations. The grand challenges in the digitalisation of wind energy thus include a mix of technical, cultural, and business aspects that will need collaboration between businesses, academia, and government to solve. Working to mitigate them is the beginning of a dynamic process that will position wind energy as an essential part of a global clean energy future.

17 WIND ENERGY↗
DOE OSTI2022

First Global Extraction of the Worm-gear TMD g 1 T

In these proceedings, we report on the first simultaneous extraction of the worm-gear function g 1 T , one of the eight leading-twist TMDs. The study analyzes COMPASS, HERMES and JLab semi-inclusive deep-inelastic scattering data using Monte Carlotechniques. We also provide a comparison of g 1 T obtained from this experimental data with a large N c analysis, the Wandzura–Wilczek-type approximation, and lattice QCD.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2019

VRP-based Model for Lane Marking Assessment with MRU Vehicle

Evaluation of lane marking conditions has advanced from visual and/or manual inspections, which can be unsafe and time-consuming, to mobile assessments using vehicle-mounted devices that allow transportation agencies to collect retroreflectivity data at a large scale in a safer and efficient manner. However, cost-effectively routing and operating these mobile retroreflectivity units (MRUs) at a large scale can be a unique challenge. This study proposes a vehicle routing problem (VRP) based model to optimize the routing of MRUs. The model takes into account the additional costs of daily and weekly operations of MRUs, such as remounting the device and traveling between tasks.

Lin, Yu-Chun↗
DOE OSTI2020

Uncovering Access, Reuse, and Sharing Characteristics of I/O-Intensive Files on Large-Scale Production HPC Systems

Large-scale high-performance computing (HPC) applications running on supercomputers produce large amounts of data routinely and store it in files on multi-PB shared parallel storage systems. Unfortunately, storage community has a limited understanding of the access and reuse patterns of these files. This paper investigates the access and reuse patterns of I/O-intensive files on a production-scale supercomputer.

Patel, Tirthak↗
DOE OSTI2019

A Lifeline-Based Approach for Work Requesting and Parallel Particle Advection

Particle advection, a fundamental building block for many flow visualization algorithms, is very difficult to parallelize efficiently. That said, work requesting is a promising technique to improve parallel performance for particle advection. With this work, we introduce a new work requesting-based method which uses the Lifeline scheduling method. To evaluate the impact of this new algorithm, we ran 92 experiments, running at concurrencies as high as 8192 cores, data sets as large as 17 billion cells, and as many as 16 million particles, comparing against other work requesting scheduling methods. Overall, our results show that Lifeline has significantly less idle time than other approaches, since it reduces the number of failed attempts to request work.

Pugmire, Dave↗
DOE OSTI2019

Summary Report on Synthetic Time History Development and Deployment

This report summarizes research work performed at the Colorado School of Mines (CSM) and George Washington University (GWU) in support of the DOE Office of Nuclear Energy Integrated Energy Systems (IES) program. In particular, the work focuses on improving and strengthening two fundamental steps in the mathematical and computational framework that is currently being developed to optimize the economic performance of Integrated Energy Systems. One of the innovative approaches taken by the IES program is that, rather than optimizing the system for a specific year or week or day, the optimization is performed using stochastic synthetic data. Synthetic data is generated by training artificial intelligence (AI) using available but limited data sets. The synthetic data should possess the same patterns as the original set and the same statistical properties, but never repeat the same set of values exactly. The work from CSM focuses on this first step; namely, investigating a methodology to determine the quality of the synthetic data and the right settings for properly training the AI. Once a large set of trustworthy data can be generated the problem of stochastic optimization can be tackled. The optimal IES configuration is highly dependent on the rare high peaks or deep depths of the net demand (grid electricity demand less variable renewable energy [VRE] production). Using an unbiased random sampling of the synthetic data, these extremes are very difficult to generate and therefore the optimization can be unrepresentative and inaccurate. GWU has started an approach to increase the likelihood of generating these rare events with the proper associated probabilistic weight. Both of these projects represent a step forward in achieving the capability to properly size the IESs and to properly capture the value that these systems can provide to the grid by absorbing volatility of net demand without disproportionately increasing the cost of maintaining grid reliability.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2020

Parallel Particle Advection Bake-Off for Scientific Visualization Workloads

There are multiple algorithms for parallelizing particle advection for scientific visualization workloads. While many previous studies have contributed to the understanding of individual algorithms, our study aims to provide a holistic understanding of how algorithms perform relative to each other on various workloads. To accomplish this, we consider four popular parallelization algorithms and run a “bake-off” study (i.e., an empirical study) to identify the best matches for each. The study includes 216 tests, going to a concurrency of up to 8192 cores and considering data sets as large as 34 billion cells with 300 million particles. Overall, our study informs three important research questions: (1) which parallelization algorithms perform best for a given workload?, (2) why?, and (3) what are the unsolved problems in parallel particle advection? In terms of findings, we find that the seeding box is the most important factor in choosing the best algorithm, and also that there is a significant opportunity for improvement in execution time, scalability, and efficiency.

Pugmire, Dave↗
DOE OSTI2023

Design and Operation of a Multi-Bed Catalytic Micro-Reactor for the Study of Co-Processing of Bio-Oils with VGO

An industry wide shift from fossil-based fuel to renewable fuel sources including biomass, municipal waste, and plastics will require new process monitoring methods to minimize transitional risks including off specification product formation and catalyst deactivation. This project aims to provide a machine learning based process monitoring tool composed of online, slipstream mass spectra for use in biomass refineries and co-processing in existing refineries allowing operators to monitor product qualities and adjust process conditions accordingly. In order to maximize the robustness of the tool, large volumes of data must be collected to fine tune model parameters which consists of both micro and pilot scale mass spectral data. Micro-scale data is collected with a multi-tube micro-reactor housing up to six catalysts in horizontal beds, coupled with a molecular beam mass spectrometer. A pyrolizer equipped with an auto-sampler streamlines the micro-scale data collection process. This type of pyrolizer/micro-reactor configuration does not exist on the market, and therefore had to be created for the purposes of this project. The design and commissioning of this reactor will be presented in detail. This reactor set-up is highly flexible and increases throughput of analysis. For catalyst testing, each bed can be individually selected simply by turning valves. For catalyst reduction and regeneration, simultaneous flow through all six beds is used. The reproducibility of the system was first assessed with whole biomass pyrolysis along with pyrolysis of calibration standards. Initial work on this system evaluated two FCC catalysts, equilibrium catalyst (E-cat), and a proprietary catalyst from Johnson Matthey specifically design for co-processing of bio-oil with vacuum gas oil (VGO). This work used model compounds and VGO which illuminated differences in products produced by the catalysts.

biomass↗
DOE OSTI2024

Machine Learning for DUNE Supernova Trigger

One of the major scientific goals of the Deep Underground Neutrino Experiment (DUNE) is to detect and measure the neutrino flux from galactic core-collapse supernovae. These neutrinos, which exist in the low energy range of up to a few tens of MeV and are responsible for carrying away over 99% of the gravitational binding energy of the supernova, provide an opportunity to study the end of life evolution of massive stars, as well as unique properties and interactions of neutrinos. Because galactic supernovae are expected to occur only on the timespan of every few decades, it is crucial that DUNE is able to detect supernova neutrino interactions when they occur. However, detecting these supernova interactions requires sifting through a large amount of data, and DUNE detectors require a trigger to signal when supernova neutrino events occur. Machine learning provides a potential approach to creating this trigger. This project generates ADC and ground truth images of neutrino interactions in a LArTPC detector as simulated by the Model of Argon Reaction Low Energy Yields (MARLEY) to be used for machine learning. The eventual goal of this work is to facilitate DUNE s detection of supernova neutrino interactions by building a machine learning pipeline to train the trigger algorithm.

Damish, Stephanie↗
DOE OSTI2024

Machine Learning for DUNE Supernova Trigger

One of the major scientific goals of the Deep Underground Neutrino Experiment (DUNE) is to detect and measure the neutrino flux originating from galactic core-collapse supernovae. These neutrinos provide an opportunity to study the end of life evolution of massive stars, and reveal information about the structure of core-collapse that is not visible in observations of the electromagnetic spectrum. Because of the rarity of these events, it is crucial that DUNE is able to detect supernova neutrino interactions when they occur. However, this will require sifting through a large quantity of data, motivating the development of a trigger algorithm to identify significant events and discard irrelevant data. Machine learning provides a potential approach to building this trigger. This project generates ADC and ground truth images of simulated neutrino interactions in a LArTPC detector to be used for machine learning, and uses them to train a sparse Convolutional Neural Network (C NN). The performance of this model when applied to the task of pixel classification based on interaction type is examined. This project found that the sparse CNN approach has the potential to have high accuracy in pixel classification, meaning it may be highly relevant to the development of a supernova neutrino trigger for the DUNE far detector.

Damish, S.↗