Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data Intensive Science”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

CROCUS Urban Canyons - Space Science and Engineering Center (SPARC) Doppler lidar data

This is the netCDF format output from the Halo Photonics Streamline XR Doppler lidar that was deployed next to the Space Science and Engineering Center (SPARC) trailer at the University of Illnois-Chicago greenhouse parking lot during CROCUS Urban Canyons. The purpose of collecting this dataset is to provide vertical and horizontal wind profiles for studying the characteristics of turbulence over the urban canyon of Chicago. This data contains the radial velocity, intensity, and backscatter from the vertical profile, range height indicator, and sector scans that were performed over both Intensive Operating Period 1 and 2 of CROCUS Urban Canyons. There are four different types of files: * The Range Height Indicator (RHI) files contain scans that are along a constant azimuth, spanning the entire hemisphere of elevation values above the surface. * The Velocity Azimuth Display (VAD) files contain the raw radial velocity data from the 6-beam, 60 degree scans. * The User1 files contain stacked Plan Position Indicator scans over a 45 degree quadrant over downtown Chicago. * The Stare files contain vertically pointing scans. These are standard netCDF files that can be opened using xarray. The VAD scans can be processed from their raw radial velocities to horizontal wind speeds with the Atmospheric data Community Toolkit (https://arm-doe.github.io/ACT/).

EARTH SCIENCE > ATMOSPHERE > ATMOSPHERIC WINDS↗
DOE OSTI2015

Pulsed laser generation of ultrasound in a metal plate between the melting and ablation thresholds

The generation of ultrasound in a metal plate exposed to nanosecond pulsed laser heating, sufficient to cause melting but not ablation, is treated. Consideration is given to the spatial and temporal profiles of the laser pulse, penetration of the laser beam into the sample, the evolution of the melt pool, and thermal conduction in the melt and surrounding solid. The excitation of the ultrasound takes place over a few nanoseconds, and occurs predominantly within the thermal diffusion length of a micron or so beneath the surface. Because of this, the output of the thermal simulations can be represented as axially symmetric transient radial and normal surface force distributions. The epicentral displacement response at the opposite surface to these forces is obtained by two methods, the one based on the elastodynamic Green’s functions for plate geometry determined by the Cagniard generalized ray method, and the other using a finite element numerical method. The two approaches are in very close agreement. Numerical simulations are reported of the epicentral displacement response of a 3.12mm thick tungsten plate irradiated with a 4 ns pulsed laser beam with Gaussian spatial profile, at intensities below and above the melt threshold. Comparison is made between results obtained using available temperature dependent thermophysical data, and room temperature materials constants except near the melting point.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Flat-histogram extrapolation as a useful tool in the age of big data

In this work, we review recent work by the authors to revisit the concept of extrapolating thermodynamic properties of classical systems using statistical mechanical principles. Specifically, we discuss how the combination of these principles with biased sampling techniques enables the prediction of free energy landscapes and other detailed information, such as structural properties, of the system in question. Remarkably accurate estimates of physical properties across a broad range of conditions have been achieved using this approach, greatly reducing the number of simulations needed to explore a given system's behaviour. While approximate, these extrapolations significantly amplify the amount of reasonably accurate information that can be extracted from simulations enabling a small set of them to feed data-intensive regression algorithms such as neural networks. Thus, this extrapolation methodology represents a useful tool for performing tasks such as high-throughput screening of physical properties, optimising force field parameters, exploring equilibrium phase behaviour, and enabling theory-guided data science for these systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2014

Predictions for microlensing planetary events from core accretion theory

We conduct the first microlensing simulation in the context of a planet formation model. The planet population is taken from the Ida and Lin core accretion model for 0.3 M {sub ☉} stars. With 6690 microlensing events, we find that for a simplified Korea Microlensing Telescopes Network (KMTNet), the fraction of planetary events is 2.9%, out of which 5.5% show multiple-planet signatures. The numbers of super-Earths, super-Neptunes, and super-Jupiters detected are expected to be almost equal. Our simulation shows that high-magnification events and massive planets are favored by planet detections, which is consistent with previous expectation. However, we notice that extremely high-magnification events are less sensitive to planets, which is possibly because the 10 minute sampling of KMTNet is not intensive enough to capture the subtle anomalies that occur near the peak. This suggests that while KMTNet observations can be systematically analyzed without reference to any follow-up data, follow-up observations will be essential in extracting the full science potential of very high magnification events. The uniformly high-cadence observations expected for KMTNet also result in ∼55% of all detected planets not being caustic crossing, and more low-mass planets even down to Mars mass being detected via planetary caustics. We also find that the distributions of orbital inclinations and planet mass ratios in multiple-planet events agree with the intrinsic distributions.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Atmospheric Ion Composition, SGP, April-May 2023

These files contain select ion count rates measured by an atmospheric pressure interface time-of-flight mass spectrometer (APi-ToF) at the Atmospheric Radiation Measurement Southern Great Plains site from April 28, 2023 to May 31, 2023. Files are in ICARTT format. The APi-ToF measures the chemical composition of naturally charged ions using mass spectrometry. Due to the nature of the measurements, time-series data are non-quantitative. This dataset contains time-series information for the ions that are typically the most intense ions observed.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

COURAGE S7 TBS AIRBORNE SONIC WIND AND TURBULENCE DATA

These data were collected with airborne wind instrumentation booms onboard the TBS at CoURAGE S7 during February 2025. The data include 60 Hz wind speed, component wind speed, wind direction, TKE, TI, and altitude measurements.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

BNF M1 TBS AIRBORNE SONIC WIND AND TURBULENCE DATA

These data were collected with airborne wind instrumentation booms onboard the TBS at BNF M1. The data include 60 Hz wind speed, component wind speed, wind direction, TKE, TI, and altitude measurements.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Raw Lidar and Camera Data Synchronized with Precipitation and Present Weather Data

As part of the sensor characterization task of the SMART 2.0 project, this dataset includes raw data from three spinning lidars ([Ouster OS2-128](https://ouster.com/products/scanning-lidar/os2-sensor/), [Velodyne Puck (VLP-16)](https://velodynelidar.com/products/puck/), and [Velodyne Ultra Puck (VLP-32)](https://velodynelidar.com/products/ultra-puck/)), one camera ([Mako G-319](https://www.alliedvision.com/en/camera-selector/detail/mako/g-319/)), and one present weather sensor ([Vaisala FD-70](https://www.vaisala.com/en/products/weather-environmental-sensors/forward-scatter-fd70)). All data were synchronized, with the log start time indicated in the file name (HHMMSS). The data can be filtered by date, log time (HHMMSS), sensor, frame ID, and weather classification. These data were gathered statically at the Argonne Testbed for Multiscale Observational Science (ATMOS). Two target stop signs were placed in view of the sensors to contribute a target for comparing sensor data under different conditions. The weather data for each day are stored in netCDF “.nc” files. The lidar data contain the X, Y, Z, intensity, reflectivity, and ring from Ouster OS2-128 rev6, Velodyne VLP-16, and Velodyne VLP-32 lidars. ![raw lidar image](LiDAR_pointcloud_ATMOS.png)

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2013

Modern Computational Techniques for the HMMER Sequence Analysis

This paper focuses on the latest research and critical reviews on modern computing architectures, software and hardware accelerated algorithms for bioinformatics data analysis with an emphasis on one of the most important sequence analysis applications—hidden Markov models (HMM). We show the detailed performance comparison of sequence analysis tools on various computing platforms recently developed in the bioinformatics society. The characteristics of the sequence analysis, such as data and compute-intensive natures, make it very attractive to optimize and parallelize by using both traditional software approach and innovated hardware acceleration technologies.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2019

Real-Time Analysis and Signal Optimization for Charge Detection Mass Spectrometry

Charge detection mass spectrometry (CDMS) is an important tool for measuring mass distributions for high mass samples and heterogeneous mixtures. In CDMS, single ions are trapped and their m/z and charge are measured simultaneously. As a single particle technique, the average signal must be optimized to maximize the number of single ion trapping events. If the average signal is too small, most of the trapping events will be empty, and if the average signal is too large, most of the trapping events will contain multiple ions. In recent embodiments, the time domain signal from the trapped ion is analyzed by fast Fourier transforms. The analysis time is much longer that the data collection time which precludes real-time optimization of the experimental conditions. In this paper, we describe the implementation of CDMS with real-time analysis. Processing the data in real time allows the average signal intensities to be dynamically optimized to maximize the number of single ion trapping events. Real-time analysis also allows the experimental settings to be optimized in a timely manner to target specific mass regimes to maximize the useful information content of the measurements. .

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

Distributed non-negative matrix factorization with determination of the number of latent features

The holistic analysis and understanding of the latent (that is, not directly observable) variables and patterns buried in large datasets is crucial for data-driven science, decision making and emergency response. Such exploratory analyses require devising unsupervised learning methods for data mining and extraction of the latent features, and non-negative matrix factorization (NMF) is one of the prominent such methods. NMF is based on compute-intense non-convex constrained minimization, which, for large datasets requires fast and distributed algorithms. However, current parallel implementations of NMF fail to estimate the number of latent features. In practice, identifying these features is both difficult and significant for pattern recognition and latent feature analysis, especially for large dense matrices. Here, we introduce a distributed NMF algorithm coupled with distributed custom clustering followed by a stability analysis on dense data, which we call DnMFk, to determine the number of latent variables. The results on synthetic data and the classical Swimmer data set demonstrate the accuracy of model determination while scaling nearly linearly across multiple processors for large data. Further, we employ DnMFk to determine the number of hidden features from a terabyte matrix.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

In situ observations of reacting Al/Fe 2 O 3 thermite: Relating dynamic particle size to macroscopic burn time

Time-resolved x-ray imaging is used to capture high-resolution images of the Al/Fe 2 O 3 thermite reaction as it proceeds in an extended burn tube. The observed thermite reaction products are generally large, multi-phase composite particles. Image processing algorithms are developed to extract a continuous record of composite particle size as a function of time and distance from the ignition point. Small particles are observed immediately after ignition, followed by a rapid increase in particle size and a gradual decline toward late times. Correlating the dynamic particle size with visible light emission from the reaction, we propose a two-stage mechanism where the combination of early ignition and delayed expansion causes the material closest to the ignition point to undergo substantial coalescence before it begins moving down the tube. We also identify two mechanisms that may contribute to particle size refinement at late times, both based on the collapse of large gas bubbles that are observed preferentially in particles at earlier times. A new approach to extracting burn times from luminous intensity data is explored, and we find that a more nuanced analysis of burn time and luminous intensity may help to improve reactivity assessments when data from in situ studies is unavailable.

36 MATERIALS SCIENCE↗
DOE OSTI2020

PAL Experimental Report Form

We constructed the first simultaneous dark- and bright-field X-ray microscope in this experiment, coupling it to simultaneous measurements of the wide-angle Xray diffraction, and the XFEL pulse intensity and energy spectrum on each shot. This experiment established proof of concept for this new advanced measurement technique and demonstrated DFXM at an XFEL for the first time. Within this complex experiment, we also acquired data that advanced our research goals within materials science and mathematics. These included: A preliminary study of how local effects reduce the X-ray damage threshold in diamond; A preliminary study of how X-ray radiation imparts heat into materials based on irreversible phase transitions that occur in boric acid with increasing temperature (based on hydration); A study of X-ray radiation damage from ultrafast thermal cycling and nonthermal melting in bismuth selenide; We also began developing software to automate alignment of compound refractive lenses (CRLs) using stochastic Nelder-Mead optimization methods. This work will expedite and improve the accuracy of alignments for many future experiments using CRLs.

36 MATERIALS SCIENCE↗
DOE OSTI2018

Cyber-Infrastructure for Data-Intensive Geospatial Computing

With the recent advent of heterogeneous High-performance Computing (HPC) to handle EO “Big Data” workloads, there is a need for a unified Cyber-infrastructure (CI) platform that can bridge the best of many HPC worlds. In this chapter, we discuss such a CI platform being developed at Geographic Information Science and Technology (GIST) group using novel and innovative techniques, and emerging technologies that are scalable to large-scale supercomputers. The CI platform utilizes a wide variety of computing such as GPGPU, distributed, real-time and cluster computing, which are being brought together architecturally to enable data-driven analysis, scientific understanding of earth system models, and research collaboration. This development addresses the need for close integration of EO and other geospatial information in the face of growing volumes of the data, and facilitates spatio-temporal analysis of disparate and dynamic data streams. Horizontal scalability and linear throughput are supported in the heart of the platform itself. It is being used to support very broad application areas, ranging from high-resolution settlement mapping, national bioenergy infrastructure to urban information and mobility systems. The platform provides spatio-temporal decision support capabilities in planning, policy and operational missions for US federal agencies. Also, the platform is designed to be functionally and technologically sustainable for continued support of the US energy and environment mission for the coming decades.

Karthik, Rajasekar↗
DOE OSTI2016

A statistical approach for isolating fossil fuel emissions in atmospheric inverse problems

We study independent verification and quantification of fossil fuel (FF) emissions that constitutes a considerable scientific challenge. By coupling atmospheric observations of CO 2 with models of atmospheric transport, inverse models offer the possibility of overcoming this challenge. However, disaggregating the biospheric and FF flux components of terrestrial fluxes from CO 2 concentration measurements has proven to be difficult, due to observational and modeling limitations. In this study, we propose a statistical inverse modeling scheme for disaggregating winter time fluxes on the basis of their unique error covariances and covariates, where these covariances and covariates are representative of the underlying processes affecting FF and biospheric fluxes. The application of the method is demonstrated with one synthetic and two real data prototypical inversions by using in situ CO 2 measurements over North America. Also, inversions are performed only for the month of January, as predominance of biospheric CO 2 signal relative to FF CO 2 signal and observational limitations preclude disaggregation of the fluxes in other months. The quality of disaggregation is assessed primarily through examination of a posteriori covariance between disaggregated FF and biospheric fluxes at regional scales. Findings indicate that the proposed method is able to robustly disaggregate fluxes regionally at monthly temporal resolution with a posteriori cross covariance lower than 0.15 µmol m -2 s -1 between FF and biospheric fluxes. Error covariance models and covariates based on temporally varying FF inventory data provide a more robust disaggregation over static proxies (e.g., nightlight intensity and population density). However, the synthetic data case study shows that disaggregation is possible even in absence of detailed temporally varying FF inventory data.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Accelerating the rate of discovery: toward high-repetition-rate HED science

As high-intensity short-pulse lasers that can operate at high-repetition-rate (HRR) (>10 H z ) come online around the world, the high energy density (HED) science they enable will experience a radical paradigm shift. The >10 3 increase in shot rate over today's shot-per-hour drivers translates into dramatically faster data acquisition, more experiments, and the ability to exploit machine learning, and thus the potential to significantly accelerate the advancement of HED science. A wide range of HED experiments, from opacity investigations to secondary source generation to plasma nuclear physics, will benefit from the increased statistics, precision, and exploration of phase space. Besides increasing the rate at which scientific experiments can be performed, HRR also allows for the rapid delivery of optimal experiments supported by simulations and modeling augmented by close coupling to empirical data. To fully realize such an HRR framework, numerous subsystems must be developed and brought together, including feedback laser control loops, high-throughput targetry and diagnostics, cognitive simulation, enhanced HED codes, and advanced data analytics. This paper describes the vision for an integrated HRR laser experimental HED system and outlines some of the major considerations and challenges for realizing it.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2017

Management, Analysis, and Visualization of Experimental and Observational Data – The Convergence of Data and Computing

Scientific user facilities—particle accelerators, telescopes, colliders, supercomputers, light sources, sequencing facilities, and more—operated by the U.S. Department of Energy (DOE) Office of Science (SC) generate ever increasing volumes of data at unprecedented rates from experiments, observations, and simulations. At the same time there is a growing community of experimentalists that require real-time data analysis feedback, to enable them to steer their complex experimental instruments to optimized scientific outcomes and new discoveries. Recent efforts in DOE-SC have focused on articulating the data-centric challenges and opportunities facing these science communities. Key challenges include difficulties coping with data size, rate, and complexity in the context of both real-time and post-experiment data analysis and interpretation. Solutions will require algorithmic and mathematical advances, as well as hardware and software infrastructures that adequately support data-intensive scientific workloads. This paper presents the summary findings of a workshop held by DOE-SC in September 2015, convened to identify the major challenges and the research that is needed to meet those challenges.

Bethel, E. Wes↗