Search NASA⌕ Search

SEARCH · Search NASA

Results for “data reduction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

200-IA-1 Operable Unit Human Health Risk and Kd Screen

The purpose of this environmental calculation file (ECF) is to provide the following: Document the data processing and data reduction steps taken to prepare the 200-IA-1 Operable Unit (OU) data set that will be used to calculate the sample-specific screening level human health risk evaluation; Document the data processing and data reduction steps taken to prepare the 200-IA-1 OU data set that will be used to identify analytes that could potentially impact groundwater in the future beneath the 200-IA-1 OU representative waste sites; Document the assumptions, equations, and methodologies used to calculate the screening levels for human health cancer risks and noncancer hazards for each representative waste site assigned to the 200-IA-1 OU. Individual measured soil concentrations from 0 to 4.6 m (15 ft) below ground surface (bgs) (shallow vadose zone) are used to calculate the total excess lifetime cancer risk (ELCR) and hazard index (HI) for the outdoor worker scenario to determine if there is a basis for remedial action. Individual measured soil concentrations from the ground surface to the groundwater table are used for the distribution coefficient (Kd) screen to identify analytes that could potentially impact groundwater in the future beneath the 200-IA-1 OU representative waste sites. This ECF supports DOE/RL-2020-51, 200-IA-1 OU Focused Feasibility Study, under the Comprehensive Environmental Response, Compensation, and Liability Act of 1980 (CERCLA). A risk characterization based upon the evaluation of the health risk estimates developed in this ECF will be presented in the focused feasibility study report.

63 RADIATION, THERMAL, AND OTHER ENVIRON. POLLUTAN↗

Performance of the Gemini Planet Imager Non-redundant Mask and Spectroscopy of Two Close-separation Binaries: HR 2690 and HD 142527

The Gemini Planet Imager (GPI) contains a 10-hole non-redundant mask (NRM), enabling interferometric resolution in complement to its coronagraphic capabilities. The NRM operates both in spectroscopic (integral field spectrograph, henceforth IFS) and polarimetric configurations. NRM observations were taken between 2013 and 2016 to characterize its performance. Most observations were taken in spectroscopic mode, with the goal of obtaining precise astrometry and spectroscopy of faint companions to bright stars. We find a clear correlation between residual wavefront error measured by the adaptive optic system and the contrast sensitivity by comparing phase errors in observations of the same source, taken on different dates. We find a typical 5σ contrast sensitivity of (2–3) × 10 –3 at $~λ/D$. We explore the accuracy of spectral extraction of secondary components of binary systems by recovering the signal from a simulated source injected into several data sets. We outline data reduction procedures unique to GPI's IFS and describe a newly public data pipeline used for the presented analyses. We demonstrate recovery of astrometry and spectroscopy of two known companions to HR 2690 and HD 142527. NRM+polarimetry observations achieve differential visibility precision of σ ~ 0.4% in the best case. We discuss its limitations on Gemini-S/GPI for resolving inner regions of protoplanetary disks and prospects for future upgrades. We summarize lessons learned in observing with NRM in spectroscopic and polarimetric modes.

79 ASTRONOMY AND ASTROPHYSICS↗

First Cosmology Results using Supernovae Ia from the Dark Energy Survey: Survey Overview, Performance, and Supernova Spectroscopy

We present details on the observing strategy, data-processing techniques, and spectroscopic targeting algorithms for the first three years of operation for the Dark Energy Survey Supernova Program (DES-SN). This five-year program using the Dark Energy Camera mounted on the 4 m Blanco telescope in Chile was designed to discover and follow supernovae (SNe) Ia over a wide redshift range (0.05 < z < 1.2) to measure the equation-of-state parameter of dark energy. We describe the SN program in full: strategy, observations, data reduction, spectroscopic follow-up observations, and classification. From three seasons of data, we have discovered 12,015 likely SNe, 308 of which have been spectroscopically confirmed, including 251 SNe Ia over a redshift range of 0.017 < z < 0.85. We determine the effective spectroscopic selection function for our sample and use it to investigate the redshift-dependent bias on the distance moduli of SNe Ia we have classified. The data presented here are used for the first cosmology analysis by DES-SN (“DES-SN3YR”), the results of which are given in Dark Energy Survey Collaboration et al. The 489 spectra that are used to define the DES-SN3YR sample are publicly available at https://des.ncsa.illinois.edu/releases/sn.

79 ASTRONOMY AND ASTROPHYSICS↗

Adaptive Methods for Radial Basis Functions

Radial basis functions (RBFs) are a powerful tool for constructing high-order accurate reduced representations of scattered data in arbitrary dimension and on manifolds. We present a method of constructing data approximations in which we utilize a functional tail to capture a global background profile and a RBF neural network (NN) to capture the smaller-scale features. In the RBF NN the RBF centers, matrix shape parameters were selected adaptively for each RBF. We also utilized a geodesic notion of distance on the manifold on which the data lies, e.g., the spherical geodesic for data on the sphere. Although each of these ideas have been been investigated separately in previous works, their combination into a single algorithm is novel. We defined a machine learning problem in which these properties are learned to minimize the data reduction error. We demonstrate the algorithm for applications of scattered data reduction in the plane and on the sphere.

97 MATHEMATICS AND COMPUTING↗

PESSTO: survey description and products from the first data release by the Public ESO Spectroscopic Survey of Transient Objects

Context. The Public European Southern Observatory Spectroscopic Survey of Transient Objects (PESSTO) began as a public spectroscopic survey in April 2012. PESSTO classifies transients from publicly available sources and wide-field surveys, and selects science targets for detailed spectroscopic and photometric follow-up. PESSTO runs for nine months of the year, January - April and August - December inclusive, and typically has allocations of 10 nights per month. Aims. We describe the data reduction strategy and data products that are publicly available through the ESO archive as the Spectroscopic Survey data release 1 (SSDR1). Methods. PESSTO uses the New Technology Telescope with the instruments EFOSC2 and SOFI to provide optical and NIR spectroscopy and imaging. We target supernovae and optical transients brighter than 20.5m for classification. Science targets are selected for follow-up based on the PESSTO science goal of extending knowledge of the extremes of the supernova population. We use standard EFOSC2 set-ups providing spectra with resolutions of 13-18 Å between 3345-9995 Å. A subset of the brighter science targets are selected for SOFI spectroscopy with the blue and red grisms (0.935-2.53 μm and resolutions 23-33 Å) and imaging with broadband JHKs filters. Results. This first data release (SSDR1) contains flux calibrated spectra from the first year (April 2012-2013). A total of 221 confirmed supernovae were classified, and we released calibrated optical spectra and classifications publicly within 24 h of the data being taken (via WISeREP). The data in SSDR1 replace those released spectra. They have more reliable and quantifiable flux calibrations, correction for telluric absorption, and are made available in standard ESO Phase 3 formats. We estimate the absolute accuracy of the flux calibrations for EFOSC2 across the whole survey in SSDR1 to be typically ~15%, although a number of spectra will have less reliable absolute flux calibration because of weather and slit losses. Acquisition images for each spectrum are available which, in principle, can allow the user to refine the absolute flux calibration. The standard NIR reduction process does not produce high accuracy absolute spectrophotometry but synthetic photometry with accompanying JHKs imaging can improve this. Whenever possible, reduced SOFI images are provided to allow this. Conclusions. Future data releases will focus on improving the automated flux calibration of the data products. The rapid turnaround between discovery and classification and access to reliable pipeline processed data products has allowed early science papers in the first few months of the survey.

79 ASTRONOMY AND ASTROPHYSICS↗

Classical and quantum compression for edge computing: the ubiquitous data dimensionality reduction

Edge computing aims to address the challenges associated with communicating and transferring large amounts of data generated remotely to a data center in a timely and efficient manner. A central pillar of edge computing is local (i.e., at- or near-source) data processing capability so that data transfer to a data center for processing can be minimized. Data compression at the edge is therefore a natural component of edge workflows. Here we present a survey of data compression algorithms with a focus on edge computing. Not all compression algorithms can accommodate the data type heterogeneity, tight processing and communication time constraints, or energy efficiency requirement characteristics of edge computing. We discuss specific examples of compression algorithms that are being explored in the context of edge computing. We end our review with a brief survey of emerging quantum compression techniques that are of importance in quantum information processing, including the proposed concept of quantum edge computing.

97 MATHEMATICS AND COMPUTING↗

Replication Data for: Reduction of Oxidized Pd/Ag(111) Surfaces by H2: Sensitivity to PdO Island Size and Dispersion

The data underlying this published work have been made publicly available in this repository as part of the IMASC Data Management Plan. This work was supported as part of the Integrated Mesoscale Architectures for Sustainable Catalysis (IMASC), an Energy Frontier Research Center funded by the U.S. Department of Energy, Office of Science, Basic Energy Sciences under Award # DE-SC0012573.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Quality-Aware Data Management for Large Scale Scientific Applications

Increasingly larger scale simulations are generating an unprecedented amount of output data, causing researchers to explore new `data staging' methods that buffer, use, and/or reduce such data online rather than simply pushing it to disk. Leveraging the capabilities of data staging, this study explores the potential for data reduction via online data compression, first using general compression techniques and then proposing use-specific methods that permit users to define simple data queries that cause only the data identified by those queries to be emitted. Using online methods for code generation and deployment, with such dynamic data queries, end users can precisely identify the quality of information (QoI) of their output data, by explicitly determining what data may be lost vs. retained, in contrast to general-purpose lossy compression methods that do not provide such levels of control. The paper also describes the key elements of a quality-aware data management system (QADMS) for high-end machines enabled by this approach. Initial experimental results demonstrate that QADMS can effectively reduce data movement cost and improve the QoS while meeting the QoI constraint stated by users.

Computer Science↗

The VLT LEGA-C spectroscopic survey: The physics of galaxies at a lookback time of 7 Gyr

The Large Early Galaxy Census (LEGA-C) is a Public Spectroscopic Survey of ∼3200 K-band selected galaxies at redshifts z = 0.6 − 1.0 with stellar masses M{sub ∗}>10{sup 10} M{sub ⊙}, conducted with VIMOS on ESO’s Very Large Telescope. The survey is embedded in the COSMOS field (R.A. = 10h00; decl. = +2 deg). The 20 hr long integrations produce high-signal-to-noise ratio continuum spectra that reveal ages, metallicities and velocity dispersions of the stellar populations. LEGA-C’s unique combination of sample size and depth will enable us for the first time to map the stellar content at large lookback time, across galaxies of different types and star formation activity. Observations started in 2014 December and are planned to be completed by mid 2018, with early data releases of the spectra and value-added products. In this paper we present the science case, the observing strategy, an overview of the data reduction process and data products, and a first look at the relationship between galaxy structure and spectral properties, as it existed 7 Gyr ago.

79 ASTRONOMY AND ASTROPHYSICS↗

Data Release 1 of the Dark Energy Spectroscopic Instrument

In 2021 May the Dark Energy Spectroscopic Instrument (DESI) collaboration began a 5 yr spectroscopic redshift survey to produce a detailed map of the evolving three-dimensional structure of the Universe between z = 0 and z ≈ 4. DESI’s principal scientific objectives are to place precise constraints on the equation of state of dark energy, the gravitationally driven growth of large-scale structure, and the sum of the neutrino masses, and to explore the observational signatures of primordial inflation. We present DESI DR1, which consists of all data acquired during the first 13 months of the DESI main survey, as well as a uniform reprocessing of the DESI Survey Validation data, which were previously made public in the DESI Early Data Release. The DR1 main survey includes high-confidence redshifts for 18.7M objects, of which 13.1M are spectroscopically classified as galaxies, 1.6M as quasars, and 4M as stars, making DR1 the largest sample of extragalactic redshifts ever assembled. We summarize the DR1 observations, the spectroscopic data-reduction pipeline and data products, large-scale structure catalogs, value-added catalogs, and describe how to access and interact with the data. In addition to fulfilling its core cosmological objectives with unprecedented precision, we expect DR1 to enable a wide range of transformational astrophysical studies and discoveries.

79 ASTRONOMY AND ASTROPHYSICS↗

Quality-Aware Data Management for Large Scale Scientific Applications

Increasingly larger scale simulations are generating an unprecedented amount of output data, causing researchers to explore new data staging methods that buffer, use, and/or reduce such data online rather than simply pushing it to disk. Leveraging the capabilities of data staging, this study explores the potential for data reduction via online data compression, first using general compression techniques and then proposing usespecific methods that permit users to define simple data queries that cause only the data identified by those queries to be emitted. Using online methods for code generation and deployment, with such dynamic data queries, end users can precisely identify the quality of information (QoI) of their output data, by explicitly determining what data may be lost vs. retained, in contrast to general-purpose lossy compression methods that do not provide such levels of control. The paper also describes the key elements of a quality-aware data management system (QADMS) for highend machines enabled by this approach. Initial experimental results demonstrate that QADMS can effectively reduce data movement cost and improve the QoS while meeting the QoI constraint stated by users.

Zou, Hongbo↗

Automatic Classification of Biological Targets in a Tidal Channel Using a Multibeam Sonar

Multibeam sonars are widely used for environmental monitoring of fauna at marine renewable energy sites. However, they can rapidly accrue vast volumes of data, which poses a challenge for data processing. Here, using data from a deployment in a tidal channel with peak currents of 1–2 m s –1 , we demonstrate the data-reduction benefits of real-time automatic classification of targets detected and tracked in multibeam sonar data. First, we evaluate classification capabilities for three machine learning algorithms: random forests, support vector machines, and k-nearest neighbors. For each algorithm, a hill-climbing search optimizes a set of hand-engineered attributes that describe tracked targets. Here, the random forest algorithm is found to be most effective—in postprocessing, discriminating between biological and nonbiological targets with a recall rate of 0.97 and a precision of 0.60. In addition, 89% of biological targets are correctly classified as either seals, diving birds, fish schools, or small targets. Model dependence on the volume of training data is evaluated. Second, a real-time implementation of the model is shown to distinguish between biological targets and nonbiological targets with nearly the same performance as in postprocessing. From this, we make general recommendations for implementing real-time classification of biological targets in multibeam sonar data and the transferability of trained models.

16 TIDAL AND WAVE POWER↗

Data-parallel Python for High Energy Physics Analyses

In this paper, we explore features available in Python which are useful for data reduction tasks in High Energy Physics (HEP). Highlevel abstractions in Python are convenient for implementing data reduction tasks. However, in order for such abstractions to be practical, the efficiency of their performance must also be high. Because the data sets we process are typically large, we care about both I/O performance and in-memory processing speed. In particular, we evaluate the use of data-parallel programming, using MPI and numpy, to process a large experimental data set (42 TiB) stored in an HDF5 file. We measure the speed of processing of the data, distinguishing between the time spent reading data and the time spent processing the data in memory, and demonstrate the scalability of both, using up to 1200 KNL nodes (76800 cores) on Cori at NERSC

Paterno, Marc↗

Integrating ORNL’s HPC and Neutron Facilities with a Performance-Portable CPU/GPU Ecosystem

We explore the development of a performance-portable CPU/GPU ecosystem to integrate two of the US Department of Energy’s (DOE’s) largest scientific instruments, the Oak Ridge Leadership Computing facility and the Spallation Neutron Source (SNS), both of which are housed at Oak Ridge National Laboratory. We select a relevant data reduction workflow use-case to obtain the differential scattering cross-section from data collected by SNS’s CORELLI and TOPAZ instruments. We compare the current CPU-only production implementation using the Garnet Python multiprocess package based on the Mantid C++ framework against our proposed CPU/GPU implementation that uses the LLVM-based, just-in-time Julia scientific language and the JACC.jl performance-portable package. Two proxy apps were developed: (i) an app for extracting relevant Mantid kernels (MDNorm) in C++ and (ii) the Julia MiniVATES.jl miniapp. We present performance results for NVIDIA A100 and AMD MI100 GPUs and AMD EPYC 7513 and 7662 CPUs. The results provide insights for future generations of data reduction software that can embrace performance portability for an integrated research infrastructure across DOE’s experimental and computational facilities.

Hahn, Steven↗

New analysis indicates no thermal inversion in the atmosphere of HD 209458b

An important focus of exoplanet research is the determination of the atmospheric temperature structure of strongly irradiated gas giant planets, or hot Jupiters. HD 209458b is the prototypical exoplanet for atmospheric thermal inversions, but this assertion does not take into account recently obtained data or newer data reduction techniques. We reexamine this claim by investigating all publicly available Spitzer Space Telescope secondary-eclipse photometric data of HD 209458b and performing a self-consistent analysis. We employ data reduction techniques that minimize stellar centroid variations, apply sophisticated models to known Spitzer systematics, and account for time-correlated noise in the data. We derive new secondary-eclipse depths of 0.119% ± 0.007%, 0.123% ± 0.006%, 0.134% ± 0.035%, and 0.215% ± 0.008% in the 3.6, 4.5, 5.8, and 8.0 μm bandpasses, respectively. We feed these results into a Bayesian atmospheric retrieval analysis and determine that it is unnecessary to invoke a thermal inversion to explain our secondary-eclipse depths. The data are well fitted by a temperature model that decreases monotonically between pressure levels of 1 and 0.01 bars. We conclude that there is no evidence for a thermal inversion in the atmosphere of HD 209458b.

79 ASTRONOMY AND ASTROPHYSICS↗

NSIDC Data Center: Energy Reduction Strategies

The Green Data Center Project was a successful effort to significantly reduce the energy use of the National Snow and Ice Data Center (NSIDC). Through a full retrofit of a traditional air conditioning system, the cooling energy required to meet the data center’s constant load has been reduced by over 70% for summer months and over 90% for cooler winter months. This significant reduction is achievable through the use of airside economization and a new indirect evaporative cooling cycle. One of the goals of this project was to create awareness of simple and effective energy reduction strategies for data centers. Although this particular project was able to maximize the positive effects of airside economization and indirect evaporative cooling because of its geographic location, similar strategies may also be relevant for many other sites and data centers in the United States.

NSIDC, Data, Energy, Reduction, Strategies↗