Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data reduction methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

Advanced Metal Separation (AMS) via Marangoni Effect-driven Separation

For practical, economical, and sustainable human missions to the Moon, processing of lunar regolith and metal oxides is necessary for localized production of oxygen (O2) and metals that can be repurposed as rocket propellant, life support O2, and in-space manufactured parts. The primary candidates for in-situ resource utilization (ISRU) regolith processing are carbothermic reductions and molten regolith electrolysis (MRE) which both produce oxygen and a reduced, deoxygenated metallic slag. A metal separation technique is still required to capture and purify metals from the deoxygenated slag for reuse in areas such as metallic part fabrication, structural or design frameworks, and metal catalyst production. The Marangoni Effect is best explained as mass transfer along an interface driven by surface tension gradients induced by temperature and concentration differences. Due to the temperature gradients, molten metal can be transported in this fashion to create thin films. This method can transport molten metal in the absence of gravity or mechanical motion and greatly increases the available surface area for a vacuum fractional separation process. In this study, a novel vacuum furnace induces the Marangoni Effect to fractionally decompose and separate valuable metals (e.g., aluminum) from thin films of molten metal via vacuum distillation. The proposed work will examine lunar regolith, metal-based recycling feedstocks, and metallic slags produced from the carbothermal reduction of regolith. Data and observations from this study could produce a simple yet effective method of refining lunar derived metals by taking advantage of the high vacuum environment present on the lunar surface.

ISRU↗

Integrated Component-based Data Acquisition Systems for Aerospace Test Facilities

The Multi-Instrument Integrated Data Acquisition System (MIIDAS), developed by the NASA Langley Research Center, uses commercial off the shelf (COTS) products, integrated with custom software, to provide a broad range of capabilities at a low cost throughout the system s entire life cycle. MIIDAS combines data acquisition capabilities with online and post-test data reduction computations. COTS products lower purchase and maintenance costs by reducing the level of effort required to meet system requirements. Object-oriented methods are used to enhance modularity, encourage reusability, and to promote adaptability, reducing software development costs. Using only COTS products and custom software supported on multiple platforms reduces the cost of porting the system to other platforms. The post-test data reduction capabilities of MIIDAS have been installed at four aerospace testing facilities at NASA Langley Research Center. The systems installed at these facilities provide a common user interface, reducing the training time required for personnel that work across multiple facilities. The techniques employed by MIIDAS enable NASA to build a system with a lower initial purchase price and reduced sustaining maintenance costs. With MIIDAS, NASA has built a highly flexible next generation data acquisition and reduction system for aerospace test facilities that meets customer expectations.

Ross, Richard W.↗

HIGH-CONTRAST STELLAR OBSERVATIONS WITHIN THE DIFFRACTION LIMIT AT THE PALOMAR HALE TELESCOPE

We report on high-accuracy high-resolution (<20 mas) stellar observations obtained with the Palomar Fiber Nuller (PFN), a near-infrared ({approx_equal}2.2 {mu}m) interferometric coronagraph installed at the Palomar Hale telescope. The PFN uses destructive interference between two elliptical (3 m Multiplication-Sign 1.5 m) sub-apertures of the primary to reach high dynamic range inside the diffraction limit of the full telescope. In order to validate the PFN's instrumental approach and its data reduction strategy, based on the newly developed 'Null Self-Calibration' (NSC) method, we observed a sample of eight well-characterized bright giants and supergiants. The quantity measured is the source astrophysical null depth, or equivalently the object's visibility at the PFN 3.2 m interferometric baseline. For the bare stars {alpha} Boo, {alpha} Her, {beta} And, and {alpha} Aur, PFN measurements are in excellent agreement with previous stellar photosphere measurements from long baseline interferometry. For the mass-losing stars {beta} Peg, {alpha} Ori, {rho} Per, and {chi} Cyg, circumstellar emission and/or asymmetries are detected. Overall, these early observations demonstrate the PFN's ability to measure astrophysical null depths below 10{sup -2} (limited by stellar diameters), with 1 {sigma} uncertainties as low as a few 10{sup -4}. Such visibility accuracy is unmatched at this spatial resolution in the near-infrared and translates into a contrast better than 10{sup -3} within the diffraction limit. With further improvements anticipated in 2011/2012, a state-of-the-art infrared science camera and a new extreme adaptive optics system, the PFN should provide a unique tool for the detection of hot debris disks and young self-luminous sub-stellar companions in the immediate vicinity of nearby stars.

79 ASTRONOMY AND ASTROPHYSICS↗

Scalable training of graph convolutional neural networks for fast and accurate predictions of HOMO-LUMO gap in molecules

Abstract Graph Convolutional Neural Network (GCNN) is a popular class of deep learning (DL) models in material science to predict material properties from the graph representation of molecular structures. Training an accurate and comprehensive GCNN surrogate for molecular design requires large-scale graph datasets and is usually a time-consuming process. Recent advances in GPUs and distributed computing open a path to reduce the computational cost for GCNN training effectively. However, efficient utilization of high performance computing (HPC) resources for training requires simultaneously optimizing large-scale data management and scalable stochastic batched optimization techniques. In this work, we focus on building GCNN models on HPC systems to predict material properties of millions of molecules. We use HydraGNN, our in-house library for large-scale GCNN training, leveraging distributed data parallelism in PyTorch. We use ADIOS, a high-performance data management framework for efficient storage and reading of large molecular graph data. We perform parallel training on two open-source large-scale graph datasets to build a GCNN predictor for an important quantum property known as the HOMO-LUMO gap. We measure the scalability, accuracy, and convergence of our approach on two DOE supercomputers: the Summit supercomputer at the Oak Ridge Leadership Computing Facility (OLCF) and the Perlmutter system at the National Energy Research Scientific Computing Center (NERSC). We present our experimental results with HydraGNN showing (i) reduction of data loading time up to 4.2 times compared with a conventional method and (ii) linear scaling performance for training up to 1024 GPUs on both Summit and Perlmutter.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

The figure of Mars and its effect on radar-ranging.

Formulae are given which indicate the errors made in computing the radar-range to a planet when one assumes the planet to have a spherical surface, centered at the center of mass. These formulae are evaluated for Mars, using an ellipsoidal fit of the martian surface obtained from the occultation measurements of the Mariner 9 spacecraft. The secularlike part of the errors amounts to about 4 km in range over the past 3 oppositions, due mainly to the flattening of 0.006 and to a 3 km southerly displacement of the center of figure from the center of mass. The method of solution is given in the appendix along with a method for applying the ellipsoidal model to the reduction of radar-range data.

Standish, E. M., Jr.↗

Initial OSSE Sky Survey Observation: Deep Survey in the Virgo Region

The OSSE Virgo survey covered about 1% of the sky, using eight weeks of observing time on the Compton Gamma Ray Observatory, and was performed in conjunction with the EGRET and COMPTEL instruments on CGRO. A fundamental aspect of the survey was the development of data reduction techniques for the scanning data from the OSSE detectors. A direct algebraic approach for spatially deconvolving the data was developed. For the survey work, no background observations isolated from the survey region were acquired, unlike normal discrete source observations. The survey, reduction method covers the mapped region with a grid of pixels, and estimates the flux from each pixel by least-squares agreement with the data, assuming positivity constraints. This technique has led to the detection of compact sources at hard X-ray energies within the Virgo region, and the OSSE survey studies have been extended to the south galactic pole and north Ecliptic pole, with similar analysis techniques.

Cameron, Robert↗

Mitigating the Impacts of Measurement Error in the Quesst Mission Community Noise Study

Beginning in 2025, the NASA Quesst mission will conduct a series of community response tests involving flyovers of the X-59 aircraft at select localities across the United States. Several waves of a longitudinal survey will be administered over approximately one month of testing in order to capture perceptual responses to low-amplitude sonic booms, or “sonic thumps”. Simultaneously, noise exposure levels will be estimated by fusing model-based predictions with measurements taken from a sparse network of monitors in the region. As one of the aims of the study is to produce a dose-response curve, a regression model relating perceptual response to noise exposure levels, it is important to acknowledge the potential attenuation bias that results from measurement error in the estimated noise exposure levels. In this presentation we review and compare several methods for dealing with measurement error in generalized linear mixed models. The methods are demonstrated on simulated data and real data collected during past NASA risk reduction studies.

measurement error↗

FedOSAA: Improving Federated Learning with One-Step Anderson Acceleration

Federated learning (FL) is a distributed machine learning approach that enables multiple local clients and a central server to collaboratively train a model while keeping the data on their own devices. First-order methods, particularly those incorporating variance reduction techniques, are the most widely used FL algorithms due to their simple implementation and stable performance. However, these methods tend to be slow and require a large number of communication rounds to reach the global minimizer. We propose FedOSAA, a novel approach that preserves the simplicity of first-order methods while achieving the rapid convergence typically associated with second-order methods. Our approach applies one Anderson acceleration (AA) step following classical local updates based on first-order methods with variance reduction, such as FedSVRG and SCAFFOLD, during local training. This AA step is able to leverage curvature information from the history points and gives a new update that approximates the Newton-GMRES direction, thereby significantly improving the convergence. We establish a local linear convergence rate to the global minimizer of FedOSAA for smooth and strongly convex loss functions. Numerical comparisons show that FedOSAA substantially improves the communication and computation efficiency of the original first-order methods, achieving performance comparable to second-order methods like GIANT.

Feng, Xue [University of California, Davis]↗

Geostatistical interpolation of streambed hydrologic attributes with addition of left censored data and anisotropy

Spatial geostatistical interpolation of point measurements of streambed attributes in the hyporheic zone may be constrained by the streambed anisotropy, and data density and spatial distribution may significantly impact the results. Spatial clustering and low spatial data density can be caused by bedrock outcropping at the streambed limiting installation of in-stream piezometers. This study examines parameter error variability of the geostatistical interpolation using anisotropic interpolation methods and increasing the data density by adding left censored values (i.e., data below measurement limit) to locations where measurements were limited by exposed bedrock lining the streambed. The reduction in relative standard error of the interpolation was determined for the spatial distributions of streambed attributes including hydraulic conductivity, seepage flux, and mercury solute flux measured in two different years along a study reach in East Fork Poplar Creek, Tennessee, USA. Here, two methods to impute the left censored values were compared including the conventional half the detection limit substitution method, and the Stochastic Approximation of Expectation-Maximization (SAEM) algorithm, which both had comparable results. Imputing left censored data increased the data density to recommended ranges, reduced data clustering, increased the spatial dependence for some attributes, and reduced the standard error for each of the three attributes. For the reach considered herein, addition of the left censored values resulted in a larger error reduction than the consideration of anisotropy within the interpolation, which confirms the benefit of data addition to increase data density within data-limited river corridors.

58 GEOSCIENCES↗

Super-resolution energy spectra from neutron direct-geometry spectrometers

Neutron direct-geometry time-of-flight chopper spectroscopy is instrumental in studying fundamental excitations of vibrational and/or magnetic origin. We report here that techniques in super-resolution optical imagery (which is in real-space) can be adapted to enhance resolution and reduce noise for a neutron spectroscopy (an instrument for mapping excitations in reciprocal space). The procedure to reconstruct super-resolution energy spectra of phonon density of states relies on a realization of multiframe registration, accurate determination of the energy-dependent point spread function, asymmetric nature of instrument resolution broadening, and iterative reconstructions. Applying these methods to phonon density of states data for a graphite sample demonstrates contrast enhancement, noise reduction, and ~5-fold improvement over nominal energy resolution. The data were collected at three different incident energies measured at the wide angular-range chopper spectrometer at the Spallation Neutron Source.

47 OTHER INSTRUMENTATION↗

Testing the improved method for calculating the radiation heat generation at the periphery of the BOR-60 reactor core

The application of the improved method for calculating the radiation heat generation in the elements of an experimental device located at the periphery of the BOR-60 reactor core results in a significant reduction in the discrepancies between the calculated and the experimental data. This allows us to conclude that the improved method has an advantage over the one used earlier.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Unsupervised classification for region of interest in X-ray ptychography

X-ray ptychography offers high-resolution imaging of large areas at a high computational cost due to the large volume of data provided. To address the cost issue, we propose a physics-informed unsupervised classification algorithm that is performed prior to reconstruction and removes data outside the region of interest (RoI) based on the multimodal features present in the diffraction patterns. The preprocessing time for the proposed method is inconsequential in contrast to the resource-intensive reconstruction process, leading to an impressive reduction in the data workload to a mere 20% of the initial dataset. This capability consequently reduces computational time dramatically while preserving reconstruction quality. Through further segmentation of the diffraction patterns, our proposed approach can also detect features that are smaller than beam size and correctly classify them as within the RoI.

97 MATHEMATICS AND COMPUTING↗

Scalable edge clustering of dynamic graphs via weighted line graphs

Timestamped relational datasets consisting of records (or connections) between pairs of entities are ubiquitous in network science. For applications like peer-to-peer communication, email, various social network interactions, and computer network security, it is useful to organize these records into groups based on how and when they are occurring. Weighted line graphs offer a natural way to model how records are related in such datasets but for large real-world graph topologies, building and utilizing the line graph is prohibitively expensive. Here, we present the framework to cluster the edges of a dynamic graph via the associated line graph that contains two major contributions. The first is a method to work with the line graph implicitly and the second is a distributed scale implementation of an agglomerative hierarchical graph clustering algorithm. We outline a novel hierarchical dynamic graph edge clustering approach that efficiently breaks massive relational datasets into small sets of edges containing events at various timescales. This is in stark contrast to traditional graph clustering algorithms that prioritize highly connected (clique-like) community structures. Our approach relies on constructing a sufficient subgraph of a weighted line graph and applying a hierarchical agglomerative clustering. This approach is related to scalable techniques from spatial clustering, nonlinear-dimension reduction, topological data analysis, and draws particular inspiration from HDBSCAN. As an edge clustering, this method yields an overlapping node clustering. Our algorithm is parallelizable and we demonstrate efficient clustering of a billion-scale, real-world dynamic graph into small edge sets that correlate in topology and time. The entire clustering process for a graph with tens of billions of edges takes just a few minutes of run time on 256 nodes of a distributed compute environment. We argue how the output of the edge clustering is useful for a multitude of data visualization and powerful machine learning tasks, both involving the original massive dynamic graph data and metadata associated with the nodes and edges. Finally, we describe how this approach can be extended to dynamic hypergraphs and dynamic graphs/hypergraphs with unstructured data living on vertices and edges.

Data Analysis↗

Analysis of Rig Parameter Data Using Drilling Process Modeling Constraints, Volume 5: Utah FORGE Well 16B(78)-32

Drill rig parameter measurements are routinely used during deep well construction to monitor and guide drilling conditions for improved performance and reduced costs. While insightful into the drilling process, these measurements are of reduced value without a standard to aid in data evaluation and decision making. In the main body of this work (Volume 1), a method is demonstrated whereby rock reduction model constraints are used to interpret drilling response parameters; the method could be applied in real-time to improve decision-making in the field and to further discern technology performance during post-drilling evaluations. Drilling parameters are evaluated using laboratory-validated rock reduction models for predicting the phenomenological response of drag bits (Detournay and Defourny, 1992) in computational algorithms. The method presented has applicability to development of advanced analytics on future geothermal wells using real-time electronic data recording for improved performance and reduced drilling costs. A drilling cost model is also used to show the tradeoff between rate of penetration and bit life and the influence on interval drilling costs. Details of the bit specifications and performance are cataloged in an independent volume, documented under separate cover, for each of the four wells, and include Volume 2: Utah FORGE 16A(78)-32; Volume 3: Utah FORGE 56-32; Volume 4: Utah FORGE 78B-32 and Volume 5: Utah FORGE 16B(78)-32.

15 GEOTHERMAL ENERGY↗

Analysis of Rig Parameter Data Using Drilling Process Modeling Constraints, Volume 4: Utah FORGE Well 78B-32

Drill rig parameter measurements are routinely used during deep well construction to monitor and guide drilling conditions for improved performance and reduced costs. While insightful into the drilling process, these measurements are of reduced value without a standard to aid in data evaluation and decision making. In the main body of this work (Volume 1), a method is demonstrated whereby rock reduction model constraints are used to interpret drilling response parameters; the method could be applied in real-time to improve decision-making in the field and to further discern technology performance during post-drilling evaluations. Drilling parameters are evaluated using laboratory-validated rock reduction models for predicting the phenomenological response of drag bits (Detournay and Defourny, 1992) in computational algorithms. The method presented has applicability to development of advanced analytics on future geothermal wells using real-time electronic data recording for improved performance and reduced drilling costs. A drilling cost model is also used to show the tradeoff between rate of penetration and bit life and the influence on interval drilling costs. Details of the bit specifications and performance are cataloged in an independent volume, documented under separate cover, for each of the four wells, and include Volume 2: Utah FORGE 16A(78)-32; Volume 3: Utah FORGE 56-32; Volume 4: Utah FORGE 78B-32 and Volume 5: Utah FORGE 16B(78)-32.

15 GEOTHERMAL ENERGY↗

Analysis of Rig Parameter Data Using Drilling Process Modeling Constraints, Volume 3: Utah FORGE Well 56-32

Drill rig parameter measurements are routinely used during deep well construction to monitor and guide drilling conditions for improved performance and reduced costs. While insightful into the drilling process, these measurements are of reduced value without a standard to aid in data evaluation and decision making. In the main body of this work (Volume 1), a method is demonstrated whereby rock reduction model constraints are used to interpret drilling response parameters; the method could be applied in real-time to improve decision-making in the field and to further discern technology performance during post-drilling evaluations. Drilling parameters are evaluated using laboratory-validated rock reduction models for predicting the phenomenological response of drag bits (Detournay and Defourny, 1992) in computational algorithms. The method presented has applicability to development of advanced analytics on future geothermal wells using real-time electronic data recording for improved performance and reduced drilling costs. A drilling cost model is also used to show the tradeoff between rate of penetration and bit life and the influence on interval drilling costs. Details of the bit specifications and performance are cataloged in an independent volume, documented under separate cover, for each of the four wells, and include Volume 2: Utah FORGE 16A(78)-32; Volume 3: Utah FORGE 56-32; Volume 4: Utah FORGE 78B-32 and Volume 5: Utah FORGE 16B(78)-32.

15 GEOTHERMAL ENERGY↗