Search NASA⌕ Search

SEARCH · Search NASA

Results for “reduction data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Combined $\mathrm{APOGEE}$-$\mathrm{GALAH}$ stellar catalogues using the Cannon

APOGEE and GALAH are two high resolution multi-object spectroscopic surveys that provide fundamental stellar parameters and multiple elemental abundance estimates for about half a million stars in the Milky Way. Both surveys observe in different wavelength regimes and use different data reduction pipelines leading to significant offsets and trends in stellar parameters and abundances for the common stars observed in both surveys. Such systematic differences/offsets in stellar parameters and abundances make it difficult to effectively utilize them to investigate Galactic abundance trends in spite of the unique advantage provided by their complementary sky coverage and different Milky Way components they observe. Hence, we use the Cannon data-driven method selecting a training set of 4418 common stars observed by both surveys. This enables the construction of two catalogues, one with the APOGEE-scaled and the other with the GALAH-scaled stellar parameters. Using repeat observations in APOGEE and GALAH, we find high precision in metallicity (~0.02–0.4 dex) and alpha abundances (~0.02–0.03 dex) for spectra with good signal-to-noise ratio (SNR >; 80 for APOGEE and SNR > 40 for GALAH). We use open and globular clusters to validate our parameter estimates and find small scatter in metallicity (0.06 dex) and alpha abundances (0.03 dex) in APOGEE-scaled case. The final catalogues have been cross-matched with the Gaia EDR3 catalogue to enable their use to carry out detailed chemo-dynamic studies of the Milky Way from perspectives of APOGEE and GALAH.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

tobac v1.5: introducing fast 3D tracking, splits and mergers, and other enhancements for identifying and analysing meteorological phenomena

There is a continuously increasing need for reliable feature detection and tracking tools based on objective analysis principles for use with meteorological data. Many tools have been developed over the previous 2 decades that attempt to address this need but most have limitations on the type of data they can be used with, feature computational and/or memory expenses that make them unwieldy with larger datasets, or require some form of data reduction prior to use that limits the tool's utility. The Tracking and Object-Based Analysis of Clouds (tobac) Python package is a modular, open-source tool that improves on the overall generality and utility of past tools. A number of scientific improvements (three spatial dimensions, splits and mergers of features, an internal spectral filtering tool) and procedural enhancements (increased computational efficiency, internal regridding of data, and treatments for periodic boundary conditions) have been included in tobac as a part of the tobac v1.5 update. These improvements have made tobac one of the most robust, powerful, and flexible identification and tracking tools in our field to date and expand its potential use in other fields. Future plans for tobac v2 are also discussed.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Deep Hierarchical Super Resolution for Scientific Data

We present a novel technique for hierarchical super resolution (SR) with neural networks (NNs), which upscales volumetric data represented with an octree data structure to a high-resolution uniform gridwith minimal seam artifacts on octree node boundaries. Our method uses existing state-of-the-art SR models and adds flexibility to upscale input data with varying levels of detail across the domain, instead of only uniform grid data that are supported in previous approaches.The key is to use a hierarchy of SR NNs, each trained to perform 2x SR between two levels of detail, with a hierarchical SR algorithm that minimizes seam artifacts by starting from the coarsest level of detail and working up.We show that our hierarchical approach outperforms baseline interpolation and hierarchical upscaling methods, and demonstrate the usefulness of our proposed approach across three use cases including data reduction using hierarchical downsampling+SR instead of uniform downsampling+SR, computation savings for hierarchical finite-time Lyapunov exponent field calculation, and super-resolving low-resolution simulation results for a high-resolution approximation visualization.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Room Temperature Quasi-static Characterization and Constitutive Model Parametrization of Flexible Polyurethane Foams of Different Densities Loaded in Different Orientations

This report describes the efforts to characterize and model General Plastics TF6070 and EF4000 flexible polyurethane foams under room temperature, large deformation quasi-static cyclic mechanical loading conditions. Densities from three to fifteen pound per cubic foot (PCF) are examined, which correspond to relative densities of approximately 4 to 20%. These foams are open cell structured and flexible at room temperature with a glass transition transition less than -30°C, and they fully recover their original shape when unloaded (at room temperature). Uniaxial compression tests were conducted with accompanying lateral image series for Digital Image Correlation (DIC) analysis with the goal of extracting transverse strain responses. Due to difficulties with DIC analysis at large strains, lateral strains were instead extracted for each test via edge tracking. The experimental results exhibit a nonlinear elastic response and anisotropic material behavior (particularly for the lower densities). Some hysteresis is observed that is different between the first and subsequent cycles of deformation indicating both a small degree of permanent damage (reduced stiffness during reloading) and viscoelasticity. These inelastic mechanisms are not considered in the modeling and calibration in this report. This work considers only the rate independent, room temperature foam behavior. Individual foam densities were calibrated for loading in two directions, parallel and perpendicular to the foam bubble rise direction, since the mechanical behavior is different in these two directions. The Flex Foam constitutive model was used for all parameterizations despite the fact that the model is isotropic. A review of the constitutive model is given as well as necessary data reduction procedures to parameterize it for each foam density and orientation are discussed. Finally, two different parameterizations are developed that take the undeformed foam density as an input that span all densities considered. These two parameterized models represent foams loaded in the rise and transverse directions respectively. We summarize the assumptions and limitations of the parameterizations provided in this report to guide analysis choices with them. All parameterizations presented herein have the following traits, room temperature, rate independent, damage-free, and non-dissipative . Isotropy (even if they are representing anisotropic data). Supplied Sierra Solid Mechanics Flex Foam Model Inputs are in units: pounds, inches, Celsius, and seconds

36 MATERIALS SCIENCE↗
DOE OSTI2026

Machine Learning on Heterogeneous, Edge, and Quantum Hardware for Particle Physics (ML-HEQUPP)

The next generation of particle physics experiments will face a new era of challenges in data acquisition, due to unprecedented data rates and volumes along with extreme environments and operational constraints. Harnessing this data for scientific discovery demands real-time inference and decision-making, intelligent data reduction, and efficient processing architectures beyond current capabilities. Crucial to the success of this experimental paradigm are several emerging technologies, such as artificial intelligence and machine learning (AI/ML) and silicon microelectronics, and the advent of quantum algorithms and processing. Their intersection includes areas of research such as low-power and low-latency devices for edge computing, heterogeneous accelerator systems, reconfigurable hardware, novel codesign and synthesis strategies, readout for cryogenic or high-radiation environments, and analog computing. This white paper presents a community-driven vision to identify and prioritize research and development opportunities in hardware-based ML systems and corresponding physics applications, contributing towards a successful transition to the new data frontier of fundamental science.

Gonski, Julia [SLAC]↗
DOE OSTI2020

The Sixth Data Release of the Radial Velocity Experiment (RAVE). I. Survey Description, Spectra, and Radial Velocities

The Radial Velocity Experiment (Rave) is a magnitude-limited (9 < I < 12) spectroscopic survey of Galactic stars randomly selected in Earth’s southern hemisphere. The Rave medium-resolution spectra (R ~ 7500) cover the Ca-triplet region (8410–8795 Å). The sixth and final data release (DR6) is based on 518,387 observations of 451,783 unique stars. Rave observations were taken between 2003 April 12 and 2013 April 4. Here we present the genesis, setup, and data reduction of Rave as well as wavelength-calibrated and flux-normalized spectra and error spectra for all observations in Rave DR6. Furthermore, we present derived spectral classification and radial velocities for the Rave targets, complemented by cross-matches with Gaia DR2 and other relevant catalogs. A comparison between internal error estimates, variances derived from stars with more than one observing epoch, and a comparison with radial velocities of Gaia DR2 reveals consistently that 68% of the objects have a velocity accuracy better than 1.4 km s{sup –1}, while 95% of the objects have radial velocities better than 4.0 km s{sup –1}. Stellar atmospheric parameters, abundances and distances are presented in a subsequent publication. The data can be accessed via the Rave website (http://rave-survey.org) or the Vizier database.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

waveSZ: A Hardware-Algorithm Co-Design of Efficient Lossy Compression for Scientific Data

Error-bounded lossy compression is critical to the success of extreme-scale scientific research because of ever-increasing volumes of data produced by today's high-performance computing (HPC) applications. Not only can error-controlled lossy compressors significantly reduce the I/O and storage burden but they can retain high data fidelity for post analysis. Existing state-of-the-art lossy compressors, however, generally suffer from relatively low compression and decompression throughput (up to hundreds of megabytes per second on a single CPU core), which considerably restrict the adoption of lossy compression by many HPC applications especially those with a fairly high data production rate. In this paper, we propose a highly efficient lossy compression approach based on field programmable gate arrays (FPGAs) under the state-of-the-art lossy compression model SZ. Our contributions are fourfold. (1) We adopt a wavefront memory layout to alleviate the data dependency during the prediction for higher-dimensional predictors, such as the Lorenzo predictor. (2) We propose a co-design framework named WAVESZ based on the wavefront memory layout and the characteristics of SZ algorithm and carefully implement it by using high-level synthesis. (3) We propose a hardware-algorithm co-optimization method to improve the performance. (4) We evaluate our proposed WAVESZ on three real-world HPC simulation datasets from the Scientific Data Reduction Benchmarks and compare it with other state-of-the-art methods on both CPUs and FPGAs. Experiments show that our WAVESZ can improve SZ's compression throughput by 6.9x similar to 8.7x over the production version running on a state-of-the-art CPU and improve the compression ratio and throughput by 2.1x and 5.8x on average, respectively, respectively, compared with the state-of-the-art FPGA design.

Compression Ratio↗
DOE OSTI2025

A 28 nm multiply-accumulate ASIC architecture for on-chip data compression in MHz frame rate X-ray and electron pixel detectors

Modern X-ray detector systems urgently require compact, efficient, and fast data compression schemes to handle the transmission of big data from pixel arrays, enabling frame rates in the MHz regime. Here, in this work, a data compression ASIC that implements a streaming fixed-length lossy compression scheme is introduced and analyzed, proving the feasibility and benefits of on-chip compression. The compression scheme utilizes a vector matrix product logic, which performs a number of floating-point multiplications, additions, and accumulations. The logic is verified, synthesized, and shown to fit in the area resource available for the X-ray detector under study, which comprises 192 × 168 pixels each of 12-bit width, and having a total area of 20 mm× 20 mm, about 2 mm× 20 mm of which are available for the digital logic. Several system architectures, precisions, and compression ratios ranging from 100 to 250 were analyzed to pave the way for on-chip fixed-length compression (e.g., principal component analysis, singular value decomposition) and data reduction (e.g., azimuthal integration) for X-ray and electron detectors.

Data compression↗
DOE OSTI2020

Revised astrometric calibration of the Gemini Planet Imager

We present a revision to the astrometric calibration of the Gemini Planet Imager (GPI), an instrument designed to achieve the high contrast at small angular separations necessary to image substellar and planetary-mass companions around nearby, young stars. We identified several issues with the GPI data reduction pipeline (DRP) that significantly affected the determination of the angle of north in reduced GPI images. As well as introducing a small error in position angle measurements for targets observed at small zenith distances, this error led to a significant error in the previous astrometric calibration that has affected all subsequent astrometric measurements. We present a detailed description of these issues and how they were corrected. We reduced GPI observations of calibration binaries taken periodically since the instrument was commissioned in 2014 using an updated version of the DRP. These measurements were compared to observations obtained with the NIRC2 instrument on Keck II, an instrument with an excellent astrometric calibration, allowing us to derive an updated plate scale and north offset angle for GPI. This revised astrometric calibration should be used to calibrate all measurements obtained with GPI for the purposes of precision astrometry.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Hypergraph Analytics of Domain Name System Relationships

We report on the use of novel mathematical methods in hypergraph analytice over a large quantity of DNS data. Hypergraphs generalize graphs, as used in network science, to better model complex multiway relations in cyber data. Specifically, casting DNS data from Georgia Tech's ActiveDNS repository as hypergraphs allows us to fully represent the interactions between {\em collections} of domains and IP addresses. To facilitate large-scale analytics, we fielded an analytical pipeline of two capabilities. HyperNetX (HNX) is a Python package for the exploration and visualization of hypergraphs, acting as a frontend. For the backend, the Chapel HyperGraph Library (CHGL) is a library for high performance hypergraph analytics written in the exascale programming language Chapel. CHGL was used to process gigascale DNS data, performing compute-intensive calculations for data reduction and segmentation. Identified portions are then sent to HNX for both exploratory analysis and knowledge discovery targeting known tactics, techniques, and procedures.

Joslyn, Cliff A.↗
DOE OSTI2022

Mapping structural heterogeneity at the nanoscale with scanning nano-structure electron microscopy (SNEM)

Here, in this work, we explore the use of scanning electron diffraction (also known as 4D-STEM) coupled with electron atomic pair distribution function analysis (ePDF) to understand the local order (structure and chemistry) as a function of position in a complex multicomponent system, a hot rolled, Ni-encapsulated, Zr 65 Cu 17.5 Ni 10 Al 7.5 bulk metallic glass (BMG), with a spatial resolution of 3 nm. We show that it is possible to gain insight into the chemistry and chemical clustering/ordering tendency in different regions of the sample, including in the vicinity of nano-scale crystallites that are identified from virtual dark field images and in heavily deformed regions at the edge of the BMG. In addition to simpler analysis, unsupervised machine learning was used to extract partial PDFs from the material, modeled as a quasi-binary alloy, and map them in space. These maps allowed key insights not only into the local average composition, as validated by EELS, but also a unique insight into chemical short-range ordering tendencies in different regions of the sample during formation. The experiments are straightforward and rapid and, unlike spectroscopic measurements, don’t require energy filters on the instrument. We spatially map different quantities of interest (QoI’s), defined as scalars that can be computed directly from positions and widths of ePDF peaks or parameters refined from fits to the patterns. We developed a flexible and rapid data reduction and analysis software framework that allows experimenters to rapidly explore images of the sample on the basis of different QoI’s. The power and flexibility of this approach are explored and described in detail. Because of the fact that we are getting spatially resolved images of the nanoscale structure obtained from ePDFs we call this approach scanning nano-structure electron microscopy (SNEM), and we believe that it will be powerful and useful extension of current 4D-STEM methods.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Detailed in situ ATR-FTIR spectroscopy study of the early stages of C-S-H formation during hydration of monoclinic C3S

The early stages of tricalcium silicate hydration has been studied by in situ ATR-FTIR spectroscopy. A method for data reduction based on background correction and subtraction of spectra of pure components is presented, which makes it possible to describe the kinetic evolution of the calcium silicate hydrate phase upon hydration with great detail. The results obtained are in full agreement with recently reported, detailed solid-state NMR spectroscopy measurements. As ATR-FTIR spectroscopy does not require any isotope enrichment in order to increase the signal intensities and is a widely available technique, we suggest that our study opens up an avenue towards detailed in situ characterization of hydrating cementitious systems and hydrating systems in general.

36 MATERIALS SCIENCE↗
DOE OSTI2026

ClassNMSW- a real-time classification approach for non-recycled municipal solid waste using hyperspectral imaging

Real-time classification of non-recycled municipal solid waste (NMSW) is essential for efficient valorization. This study introduces ClassNMSW, a comprehensive framework for classifying 22 NMSW subclasses under industrial constraints by using hyperspectral imaging (HSI). A primary innovation of this work is the development of a variance-controlled spectral extraction algorithm. Unlike traditional methods that rely on simple averaging, this approach systematically investigates the extent of pixel extraction to minimize the loss of critical chemical information while maximizing data reduction thus ensuring high spectral fidelity with low computational cost. The approach developed in this work integrates automated, computer-vision-based background removal, eliminating the need for the manual thresholding common in current literature. To resolve ambiguities among chemically similar subclasses, a tiered classification and multi-camera fusion strategy (NIR17 and NIR22) is implemented. Results demonstrate that ClassNMSW achieves an object-wise weighted accuracy of 98.70% for single-sensor configurations and 100% under sensor fusion. A novel rolling-window strategy satisfies desired end-to-end latency of <2 s, satisfying the strict deterministic requirements of high-speed industrial sorting environments. The ClassNMSW framework provides a scalable foundation for advancing circularity and resource recovery in large-scale waste valorization operations.

99 - GENERAL AND MISCELLANEOUS↗
DOE OSTI2022

Wire-coil insert optimization for high-heat-load/flux synchrotron components

Many synchrotron components require high levels of internal-flow, forced-convection heat transfer to minimize surface temperatures, thermal gradients, and thermally induced stress on high-power beam-interacting surfaces. Wire-coil inserts, physically similar to a common spring, are mechanically fitted inside of component cooling passages to optimize heat transfer performance. They are routinely used in Advanced Photon Source (APS) front end and beamline high-heat-load/flux components to significantly enhance convection heat transfer-up to 400% compared to plain open passages. This has the additional benefit of greatly reducing coolant flow requirements for these components. Using several cooling passage sizes, five different wire sizes, and a range of pitch values, an experimental investigation conducted at the APS has determined the average heat transfer coefficient and resulting pressure loss as a function of water flow rate for 65 different wire-coil inserts. Data from this study have been non-dimensionalized and generalized to yield relationships that can be used to determine the heat transfer performance and resulting pressure loss for any given wire-coil insert that may be used at the APS. Through data reduction, the wire-coil insert characteristic dimensions have also been optimized to yield the highest heat transfer enhancement while minimizing the coolant flow requirements. These generalized expressions for wirecoil inserts will be presented, and they can be used by scientists and engineers during the component design process to evaluate achievable heat transfer performance and associated pressure loss, aiding in the establishment of optimized operating parameters and cooling passage flow distribution schemes.

43 PARTICLE ACCELERATORS↗
DOE OSTI2025

Investigating Quantum Materials with Half-Polarized Diffraction and magnetic PDF analysis at the HB-2A Neutron Powder Diffractometer

Local magnetic ordering and anisotropy is often central to the emergent behavior and subsequent functional properties in quantum materials and beyond. Neutron powder diffraction provides a straightforward yet extremely powerful technique for quantitative measurements of microscopic magnetic properties. The HB-2A powder diffractometer located at the High Flux Isotope Reactor in ORNL is traditionally utilized for long-range magnetic structure determination. Recently these capabilities have been extended to include methods aimed at accessing local magnetism: Half- polarized neutron powder diffraction (pNPD) and magnetic pair distribution function (mPDF) analysis. These two distinct techniques are possible on HB-2A due to the versatility of the instrument’s reciprocal space coverage, resolution and novel ultra-low temperature multi-sample changers that operate down to dilution refrigerator temperatures. This provides unique capabilities not found on any powder diffraction instrument and is particularly well suited to investigations of magnetic quantum materials. The development and implementation of these techniques will be discussed with a series of science case examples ranging from geometric frustrated magnets to magnetic metal-organic frameworks. Data reduction and analysis tools will be presented that enable the extraction of the local site susceptibility tensor and local spin-spin correlations in real space. Finally, potential combinations of these techniques in the form of half-polarized magnetic pair distribution function (pmPDF) analysis will be considered. Looking forward, HB-2A is undergoing a detector upgrade that will be in the user program by 2026. This will offer an order of magnitude increase in count rates to further aid the development of these often low signal measurements and provide new scientific capabilities.

Neutron Scattering↗
DOE OSTI2025

Bayesian inference of anisotropic 2D small-angle scattering from sparse measurement

Here, we present a Bayesian inference framework for reconstructing anisotropic two-dimensional small-angle scattering (2D SAS) patterns from sparse, noisy, or partially missing data. The method combines a symmetry-aware angular basis with radial Gaussian process priors to enable accurate, training-free interpolation and denoising. Computational benchmarks demonstrate reliable recovery of both isotropic and high-order anisotropic features under severe data reduction. Experimental validations on stretched polymers, sheared wormlike micelles, and carbon fibers show improved fidelity and resolution compared to raw measurements, achieving comparable accuracy with up to 50-fold fewer detected neutrons. This approach enables quantitative structural analysis under low-flux, time-limited, or single-shot conditions, extending the applicability of 2D SAS techniques to compact neutron sources and mechanically driven soft matter systems undergoing transient structural changes.

Tung, Chi-Huan [Oak Ridge National Laboratory (ORN↗
DOE OSTI2025

Simulations of Heat Transfer Using Tight-Fitting Twisted Tape Inserts for First Wall Cooling in Molten Salt Breeder Blankets

One of the major components in fusion energy systems is the fusion blanket, which has a vacuum vessel to contain the plasma. As part of the fusion blanket/vacuum vessel, the first wall and plasma-facing components require sufficient cooling to prevent material degradation during operation from the superheated plasma. Most fusion blanket concepts involve first wall and divertor coolant channels with heat transfer enhancements (HTEs) that are intended to withstand the incident high heat fluxes of 1 to 5 MW/m 2 . Twisted tape inserts are a proposed HTE that have been investigated previously for first wall cooling and monoblock divertor cooling channels and in other nonfusion heat transfer components. By inserting twisted tapes into straight pipes, the amount of turbulence in the system can be increased at lower Reynolds numbers by swirling the flow. This results in better heat transfer characteristics with marginal increases in frictional pressure losses. In particular, simulations of high-Prandtl-number fluids such as the proposed molten salt FLiBe in twisted tapes, which is prototypic to liquid immersion blankets, have not been previously explored. Here, in this study, we simulate various Prandtl numbers in pipes with twisted tape inserts using large eddy simulations to determine the effects of increasing Prandtl numbers on heat transfer performance. The quantities of particular interest are the Nusselt number and the friction factor, which were recovered using data reduction techniques to determine impacts on heat transfer and pressure losses. This work serves as a starting point for determining the feasibility of twisted tape inserts for liquid immersion blanket concepts.

LES↗
DOE OSTI2025

The Simons Observatory: science goals and forecasts for the enhanced Large Aperture Telescope

We describe updated scientific goals for the wide-field, millimeter-wave survey that will be produced by the Simons Observatory (SO). Significant upgrades to the 6-meter SO Large Aperture Telescope (LAT) are expected to be complete by 2028, and will include a doubled mapping speed with 30,000 new detectors and an automated data reduction pipeline. In addition, a new photovoltaic array will supply most of the observatory's power. The LAT survey will cover about 60% of the sky at a regular observing cadence, with five times the angular resolution and ten times the map depth of the Planck satellite. The science goals are to: (1) determine the physical conditions in the early universe and constrain the existence of new light particles; (2) measure the integrated distribution of mass, electron pressure, and electron momentum in the late-time universe, and, in combination with optical surveys, determine the neutrino mass and the effects of dark energy via tomographic measurements of the growth of structure at redshifts z ≲ 3; (3) measure the distribution of electron density and pressure around galaxy groups and clusters, and calibrate the effects of energy input from galaxy formation on the surrounding environment; (4) produce a sample of more than 30,000 galaxy clusters, and more than 100,000 extragalactic millimeter sources, including regularly sampled AGN light-curves, to study these sources and their emission physics; (5) measure the polarized emission from magnetically aligned dust grains in our Galaxy, to study the properties of dust and the role of magnetic fields in star formation; (6) constrain asteroid regoliths, search for Trans-Neptunian Objects, and either detect or eliminate large portions of the phase space in the search for Planet 9; and (7) provide a powerful new window into the transient universe on time scales of minutes to years, concurrent with observations from the Vera C. Rubin Observatory of overlapping sky.

79 ASTRONOMY AND ASTROPHYSICS↗