Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data Intensive Science”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

SITCOMTN-154: Initial studies of photometric redshifts with LSSTComCam from DP1

This technote holds reports based on the first analyses of the Data Preview 1 (DP1) data by the Science Unit for photometric redshifts. Although photometric redshifts are not an official DP1 data product, the "Photo-z Science Unit" generated photo-z estimates for every galaxy in DP1 using the available multi-band imaging on a best-effort basis. This work included developing training and test datasets by matching DP1 data to high-quality reference redshifts obtained with spectroscopy, Grism data, and multi-band photometry. The Science Unit used the RAIL software package to make photometric redshift estimates using eight different algorithms, developed simple scientific performance metrics, used those metrics to explore how the performance of the algorithms varied with configuration changes, derived more optimized configurations of the algorithms and tested the performance of those configurations. This work, the resulting data products and expected data distribution mechanism are all described there.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

ARM Data for Examining the Ice-Nucleating Particles from SGP Part II (ExINP-SGP II) X-Ray Diffraction

Knowledge of airborne particulate matter (PM), especially the particles that have supermicron diameters, is key for understanding ice-nucleating particles (INPs). Supported by the Atmospheric Radiation Measurement (ARM) user facility, we sampled PM and surface soil materials at the Southern Great Plains observatory (SGP; 36° 36′ 18″ N, 97° 29′ 6″ W) to systematically compare the INP abundance and ice nucleation efficiency of different SGP samples (i.e., airborne versus surface materials). The field campaign, named Examing INP from SGP II (ExINP-SGP II), was conducted from 20 January to 20 April, 2021. Our data analysis products include (1) physical surface sorption characterization data (i.e., BET, pore volume) of two sets of samples -- SGP Soil and USDA, (2) X-ray diffraction spectra for the same two samples, (3) immersion freezing assay-based ice nucleation active mass density data as a function of freezing temperature for both ambient and surface samples, and (4) time-series data of ambient meteorological conditions, concentration particle counter-derived aerosol particle concentration, and aerosol particle sizer measurement during ExINP-SGP II.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Leveraging unlabeled SEM datasets with self-supervised learning for enhanced particle segmentation

Scanning Electron Microscopes (SEMs) are widely used in experimental science laboratories, often requiring cumbersome and repetitive user analysis. Automating SEM image analysis processes is highly desirable to address this challenge. In particle sample analysis, Machine Learning (ML) has emerged as the most effective approach for particle segmentation. However, the time-intensive process of manually annotating thousands of SEM images limits the applicability of supervised learning approaches. Self-Supervised Learning (SSL) offers a promising alternative by enabling knowledge extraction from raw, unlabeled data. This study presents a framework for evaluating SSL techniques in SEM image analysis, focusing on novel methods leveraging the ConvNeXtV2 architecture for particle detection. A dataset comprising 25,000 SEM images is curated to benchmark these proposed SSL methods. The results demonstrate that ConvNeXtV2 models, with varying parameter counts, consistently outperform other techniques in particle detection across different length scales, achieving up to a 34% reduction in relative error compared to established SSL methods. Furthermore, an ablation study explores the relationship between dataset size and SSL performance, providing actionable insights for practitioners regarding model selection and resource efficiency. This research advances the integration of SSL into autonomous analysis pipelines and supports its application in accelerating materials science discovery.

Rettenberger, Luca↗
DOE OSTI2017

Building near-real-time processing pipelines with the spark-MPI platform

Advances in detectors and computational technologies provide new opportunities for applied research and the fundamental sciences. Concurrently, dramatic increases in the three V's (Volume, Velocity, and Variety) of experimental data and the scale of computational tasks produced the demand for new real-time processing systems at experimental facilities. Recently, this demand was addressed by the Spark-MPI approach connecting the Spark data-intensive platform with the MPI high-performance framework. In contrast with existing data management and analytics systems, Spark introduced a new middleware based on resilient distributed datasets (RDDs), which decoupled various data sources from high-level processing algorithms. The RDD middleware significantly advanced the scope of data-intensive applications, spreading from SQL queries to machine learning to graph processing. Spark-MPI further extended the Spark ecosystem with the MPI applications using the Process Management Interface. The paper explores this integrated platform within the context of online ptychographic and tomographic reconstruction pipelines.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Where and When Does Solar Plus Storage Make Sense for Commercial Buildings?

As the capital cost of battery energy storage systems (BESS) declines, opportunities for commercial buildings to achieve net savings through peak demand management and energy arbitrage are emerging. National Renewable Energy Laboratory researchers modeled energy storage project economics - with and without accompanying solar photovoltaic systems - using local utility rates, ASHRAE climate zones, and solar intensity data to identify regions where these systems deliver life cycle savings now and in future cost scenarios.

battery energy storage systems↗
DOE OSTI2021

Fine-root traits from common tree species in Puerto Rico before and after Hurricane María (2017-2018)

This dataset is a compilation of root trait measurements from common tree species in the Luquillo Experimental Forest in Puerto Rico taken in February 2017 (before Hurricane María), and in February 2018 (after the hurricane). This dataset is being used on a publication called "Tradeoffs in phosphorus acquisition strategies of five tree species in a tropical forest of Puerto Rico", where we describe belowground P-acquisition strategies of five common tree species (two pioneers and three non-pioneers) growing in the lowland tropical wet forests of Puerto Rico. Additionally, we used the unique opportunity of two consecutive hurricanes that passed over the island (Irma and Maria) to compare root traits before and after the hurricanes to determine which traits were the most responsive and whether such disturbance affected root trait relationships and trade-offs. For this, we sampled trees from EV1, SB2, and NGEE Tropics' plots EVV and EVR in 2017 (before hurricanes) and 2018 (after hurricanes). Morphological fine-root traits include root length, diameter, and SRL. Root architectural traits includes root branching ratio and intensity. Root physiological trait measured includes phosphatase activity, and root microbial association trait measured includes percentage mycorrhizal colonization. Chemistry data includes root phosphorus concentration, soil available, and organic phosphorus.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Semi-Automated, Object-Based Tomography of Dislocation Structures

The characterization of the three-dimensional arrangement of dislocations is important for many analyses in materials science. Dislocation tomography in transmission electron microscopy is conventionally accomplished through intensity-based reconstruction algorithms. Although such methods work successfully, a disadvantage is that they require many images to be collected over a large tilt range. Here, we present an alternative, semi-automated object-based approach that reduces the data collection requirements by drawing on the prior knowledge that dislocations are line objects. Our approach consists of three steps: (1) initial extraction of dislocation line objects from the individual frames, (2) alignment and matching of these objects across the frames in the tilt series, and (3) tomographic reconstruction to determine the full three-dimensional configuration of the dislocations. Drawing on innovations in graph theory, we employ a node-line segment representation for the dislocation lines and a novel arc-length mapping scheme to relate the dislocations to each other across the images in the tilt series. We demonstrate the method for a dataset collected from a dislocation network imaged by diffraction-contrast scanning transmission electron microscopy. Based on these results and a detailed uncertainty analysis for the algorithm, we discuss opportunities for optimizing data collection and further automating the method.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

NEON AOP Survey of Upper East River CO Watersheds: Waveform LiDAR Binary Data

The waveform Light Detection and Ranging (LiDAR) data in this package were generated through a National Ecological Observatory Network Airborne Observation Platform (NEON AOP) acquisition over watersheds of interest surrounding Crested Butte, Colorado. The remote sensing imagery acquired by the NEON AOP supports an interdisciplinary project on hydrology, biogeochemistry, and ecosystem functioning in a snow-dominated headwater environment. These waveform LiDAR data enable spatially continuous estimation of vegetation structure parameters to facilitate analyses of the major environmental drivers of structural and compositional variability. The package contains 97 compressed file archives in 7-zip (.7z) format, each corresponding to one acquisition flightpath. Within each .7z archive is a set of constituent files describing properties of the LiDAR waveforms, such as return intensity, geolocation, outgoing pulse and other behavior of the sensor and signals. Once downloaded, the files must first be unzipped using the widely distributed command-line software utility 7z, using the command '7z x \[filename\].7z \[target_directory\]'. All files within the .7z archives can be opened in IDL, MatLab, or the open-source R statistical computing environment. Further details about the data package are in the attached user guide (neon_aop_crbu_waveformlidar_userguide.pdf). This work was supported by the Watershed Function Science Focus Area at Lawrence Berkeley National Laboratory funded by the US Department of Energy, Office of Science, Biological and Environmental Research under Contract No. DE-AC02-05CH11231.

2018 NEON and 2025 CHESS Campaigns↗
DOE OSTI2016

Planck 2015 results: VII. High Frequency Instrument data processing: Time-ordered information and beams

The Planck High Frequency Instrument (HFI) has observed the full sky at six frequencies (100, 143, 217, 353, 545, and 857 GHz) in intensity and at four frequencies in linear polarization (100, 143, 217, and 353 GHz). In order to obtain sky maps, the time-ordered information (TOI) containing the detector and pointing samples must be processed and the angular response must be assessed. The full mission TOI is included in the Planck 2015 release. This study describes the HFI TOI and beam processing for the 2015 release. HFI calibration and map making are described in a companion paper. The main pipeline has been modified since the last release (2013 nominal mission in intensity only), by including a correction for the nonlinearity of the warm readout and by improving the model of the bolometer time response. The beam processing is an essential tool that derives the angular response used in all the Planck science papers and we report an improvement in the effective beam window function uncertainty of more than a factor of 10 relative to the2013 release. Noise correlations introduced by pipeline filtering function are assessed using dedicated simulations. Finally, angular cross-power spectra using data sets that are decorrelated in time are immune to the main systematic effects.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2013

Feature-based analysis of large-scale spatio-temporal sensor data on hybrid architectures

The analysis of large sensor datasets for structural and functional features has applications in many domains, including weather and climate modeling, characterization of subsurface reservoirs, and biomedicine. The vast amount of data obtained from state-of-the-art sensors and the computational cost of analysis operations create a barrier to such analyses. In this paper, we describe middleware system support to take advantage of large clusters of hybrid CPU–GPU nodes to address the data and compute-intensive requirements of feature-based analyses of large spatio-temporal datasets.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2018

The Emerging Technology of Quantum Computing

Quantum computers will have unique abilities for certain types of problems, such as breaking codes. That’s why national security agencies are intensely interested. These computers will also be able to search massive databases at unparalleled speed, which is why major corporations interested in artificial intelligence are also interested and are pursuing several different approaches to building practical data processing devices. What underlies these efforts is several decades of research—supported by the Basic Energy Sciences (BES) office of DOE—on materials that exhibit multiple quantum states.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2021

A study of real-world micrograph data quality and machine learning model robustness

Abstract Machine-learning (ML) techniques hold the potential of enabling efficient quantitative micrograph analysis, but the robustness of ML models with respect to real-world micrograph quality variations has not been carefully evaluated. We collected thousands of scanning electron microscopy (SEM) micrographs for molecular solid materials, in which image pixel intensities vary due to both the microstructure content and microscope instrument conditions. We then built ML models to predict the ultimate compressive strength (UCS) of consolidated molecular solids, by encoding micrographs with different image feature descriptors and training a random forest regressor, and by training an end-to-end deep-learning (DL) model. Results show that instrument-induced pixel intensity signals can affect ML model predictions in a consistently negative way. As a remedy, we explored intensity normalization techniques. It is seen that intensity normalization helps to improve micrograph data quality and ML model robustness, but microscope-induced intensity variations can be difficult to eliminate.

36 MATERIALS SCIENCE↗
DOE OSTI2017

Evaluation of the Component of Bias of X-Ray Microanalysis Related to Surface Relief of the Specimen

A semiempirical approach to the a priori evaluation of the effect of the surface relief on the results of X-ray spectral analysis of binary compounds is proposed. Dimensionless parameter k characterizing the effect of the relief on the intensity of intrinsic X-ray radiation is determined using the experimental data obtained for reference monocrystal specimens GaAs with known geometrical parameters of the relief.

36 MATERIALS SCIENCE↗
DOE OSTI2015

Seasonal modulations of the underground cosmic-ray muon energy

The parameters of the seasonal modulations in the intensity of muons and cosmogenic neutrons generated by them at a mean muon energy of 280 GeV have been determined in the LVD (Large Volume Detector) experiment. The modulations of muons and neutrons are caused by a temperature effect, the seasonal temperature and density variations of the upper atmospheric layers. The analysis performed here leads to the conclusion that the variations in the mean energy of the muon flux are the main source of underground cosmogenic neutron variations, because the energy of muons is more sensitive to the temperature effect than their intensity. The parameters of the seasonal modulations in the mean energy of muons and the flux of cosmogenic neutrons at the LVD depth have been determined from the data obtained over seven years of LVD operation.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

Bridging Land-Surface Fluxes and Aerosol Concentrations to Triggering Convective Rainfall

During the period August 24-28, 2016, a delayed component the GO-Amazon Project, we launched nine altitude-controlled free balloons (CMET). Smaller than typical rawinsondes, CMET are equipped with altitude control, global communication via Iridium satellite, and aspirated sensors. The aims of our effort were to examine the interactions among convective boundary layer and dual river breeze circulations near the confluence of the Tapajos and Amazon Rivers in the eastern Basin. The week-long field campaign was timed to examine the reestablishment of the breeze circulations shortly after the passage of a strong instability line on August 22. Nine CMET were launched at the Curua-Una hydroelectric dam (2.8S; 54.3W), timed to encounter the Tapajos river breeze front by late afternoon. Soundings were made to establish the thickness of interface between the easterly trade and westerly Tapajos breeze circulation. Careful use of sounding strategies allowed these free balloons to track along the northerly channeled flow in the lowest 300 m above the River. Following the river encounter, balloons tracked to the west, sounding to describe the diurnal course of boundary layer in the forest west of the Tapajos River. The longest flight traveled more than 770 km over three days and twice rested overnight in the rain forest canopy. Ancillary data from surface climate and flux stations as well as the Santarem radiosonde, satellite images will be used to illustrate how the breeze circulations are seen near the surface and how they were disrupted by larger-scale events. Comparisons with HYSPLIT trajectories illustrate how sensitive real trajectories are to the refraction that the encounter with the breeze effects. A second effort was intensive analyses of data from the eddy flux tower at the Tapajós National Forest near Santarém Pará Brazil, with special emphasis on the role of clouds and canopy presence on light absorbance and photosynthetic activity.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Status of the Mu2e experiment at Fermilab

The Mu2e experiment at Fermilab aims to measure the charged-lepton flavour violating (CLFV) neutrino-less conversion of a negative muon into an electron in the field of a nucleus with an unprecedented single event sensitivity of 3x10^{-17}. This document illustrates the physics motivation and design of the experiment.In the current schedule Mu2e is expected to start taking data in 2025 with a reduced average beam intensity for about two years (Run 1). After a shut down for the upgrade of Fermilab accelerator complex, data taking will restart at full beam intensity (Run 2). A detailed update of the expected experiment sensitivity for Mu2e Run 1 is presented, together with an estimate of the final Mu2e sensitivity.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2025

Neutron powder diffraction, Mossbauer Spectroscopy and Optical Spectroscopy to study magnetic and nuclear lattices in Fe-based oxychlorides Ca2FeO3Cl, Sr2FeO3Cl and Sr3Fe2O5Cl2

Data for Neutron Diffraction, Mossbauer Spectoscopy and Optical Spectroscopy are contained on all three samples (Ca2FeO3Cl, Sr2FeO3Cl, and Sr3Fe2O5Cl2). Mossbauer data are in the folder "MossbauerSpectroscopy". This contains details of files and examples to read the data. The Optical Spectroscopy are in the folder "AbsorptionData", this contains one file with explanatory headers. The neutron diffraction data are in the "NeutronDiffractionData" folder. The data was collected on the HB-2A powder diffractometer at HFIR. The autoreduced files are corrected using a vanadium standard and are in arbitrary intensity units. The RawData folder contains the uncorrected data with metadata for motor positions and temperature. All measurements were collected with a constant neuton wavelength of 2.41 Angstrom. An excel spreadsheet "NeutronDiffractionData_IPTS-29118_summary" contains details for each scan. Sr3Fe2O5Cl2 data were collected at only room temperature. Ca2FeO3Cl and Sr2FeO3Cl data were collected at 4K and room temperature. The autoreduced .dat fileformat is three columns corresponding to: Two-theta, Intensity and Intensity_error.

fe-based oxychlorides↗
DOE OSTI2016

Beam-induced and cosmic-ray backgrounds observed in the ATLAS detector during the LHC 2012 proton-proton running period

This paper discusses various observations on beam-induced and cosmic-ray backgrounds in the ATLAS detector during the LHC 2012 proton-proton run. Building on published results based on 2011 data, the correlations between background and residual pressure of the beam vacuum are revisited. Ghost charge evolution over 2012 and its role for backgrounds are evaluated. New methods to monitor ghost charge with beam-gas rates are presented and observations of LHC abort gap population by ghost charge are discussed in detail. Fake jets from colliding bunches and from ghost charge are analysed with improved methods, showing that ghost charge in individual radio-frequency buckets of the LHC can be resolved. Some results of two short periods of dedicated cosmic-ray background data-taking are shown; in particular cosmic-ray muon induced fake jet rates are compared to Monte Carlo simulations and to the fake jet rates from beam background. A thorough analysis of a particular LHC fill, where abnormally high background was observed, is presented. Correlations between backgrounds and beam intensity losses in special fills with very high β* are studied.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗