Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data reduction methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

PRE-DISCOVERY OBSERVATIONS OF CoRoT-1b AND CoRoT-2b WITH THE BEST SURVEY

The Berlin Exoplanet Search Telescope (BEST) wide-angle telescope installed at the Observatoire de Haute-Provence and operated in remote control from Berlin by the Institut fuer Planetenforschung, DLR, has observed the CoRoT target fields prior to the mission. The resulting archive of stellar photometric light curves is used to search for deep transit events announced during CoRoT's alarm mode to aid in fast photometric confirmation of these events. The 'initial run' field of CoRoT (IRa01) was observed with BEST in 2006 November and December for 12 nights. The first 'long run' field (LRc01) was observed from 2005 June to September for 35 nights. After standard CCD data reduction, aperture photometry has been performed using the ISIS image subtraction method. About 30,000 light curves were obtained in each field. Transits of the first detected planets by the CoRoT mission, CoRoT-1b and CoRoT-2b, were found in archived data of the BEST survey and their light curves are presented here. Such detections provide useful information at the early stage of the organization of follow-up observations of satellite alarm-mode planet candidates. In addition, no period change was found over {approx}4 years between the first BEST observation and last available transit observations.

79 ASTRONOMY AND ASTROPHYSICS↗

Quantifying impact reduction due to avoidance, minimization and restoration for a natural gas pipeline in the Peruvian Andes

We present monitoring methods and quantitative biodiversity data to document components of the mitigation hierarchy. We estimated avoidance, minimization, restoration and impact reduction in quality hectares for the 25 m wide right of way of a 408 km natural gas buried pipeline that crosses 14 Ecological Landscape Units (ELUs) in the tropical Andes of Peru. We found that applying the mitigation hierarchy as part of a comprehensive biodiversity action plan substantially reduced impacts on biodiversity in all habitats studied. Avoidance and right of way minimization contributed to significant impact reduction. We quantified impact reduction during construction and operation on the right of way of the pipeline over a five-year period and found that restoration was the greatest contributor to reducing impacts. We documented that most ELUs have a positive restoration trajectory. We also documented how monitoring over large scale spatial scales, in combination with site-specific monitoring, generated data for management to determine restoration priorities and impact mitigation. A biodiversity action plan that incorporated the mitigation hierarchy and a science-based biodiversity monitoring and assessment program contributed to biodiversity management of the project and played an important role in minimizing and managing impacts. - Highlights: •Quantitative data for mitigation hierarchy components are presented. •Application of the mitigation hierarchy reduced impacts on biodiversity. •A biodiversity monitoring program provided data to reduce impacts.

03 NATURAL GAS↗

Shape restricted additive hazards models: Monotone, unimodal, and U‐shape hazard functions

We consider estimation of the semiparametric additive hazards model with an unspecified baseline hazard function where the effect of a continuous covariate has a specific shape but otherwise unspecified. Such estimation is particularly useful for a unimodal hazard function, where the hazard is monotone increasing and monotone decreasing with an unknown mode. A popular approach of the proportional hazards model is limited in such setting due to the complicated structure of the partial likelihood. Our model defines a quadratic loss function, and its simple structure allows a global Hessian matrix that does not involve parameters. Thus, once the global Hessian matrix is computed, a standard quadratic programming method can be applicable by profiling all possible locations of the mode. However, the quadratic programming method may be inefficient to handle a large global Hessian matrix in the profiling algorithm due to a large dimensionality, where the dimension of the global Hessian matrix and number of hypothetical modes are the same order as the sample size. We propose the quadratic pool adjacent violators algorithm to reduce computational costs. The proposed algorithm is extended to the model with a time‐dependent covariate with monotone or U‐shape hazard function. In simulation studies, our proposed method improves computational speed compared to the quadratic programming method, with bias and mean square error reductions. We analyze data from a recent cardiovascular study.

Mathematical & Computational Biology↗

Ringwoodite growth rates from olivine with ~75 ppmw H 2 O: Metastable olivine must be nearly anhydrous to exist in the mantle transition zone

It has been previously demonstrated that as little as 300 ppmw H 2 O increases wadsleyite and ringwoodite growth rates to magnitudes that are inconsistent with the metastable olivine hypothesis. To further test this hypothesis, we present new ringwoodite growth rate measurements from olivine with ~75 ppmw H 2 O at 18 GPa and 700, 900, and 1100 °C. These growth rates are nearly identical to those from olivine with ~300 ppmw H 2 O, and significantly higher than those from nominally anhydrous olivine. We infer that transformation of olivine with 75-300 ppmw H 2 O is primarily enhanced by hydrolytic weakening of reaction rims, which reduces the elastic strain-energy barrier to growth. We present a new method for fitting nonlinear nominally anhydrous data, to demonstrate that reduction of growth rates by elastic strain energy is an additional requirement for metastable olivine. In conclusion, based on previous thermokinetic modeling, these enhanced growth rates are inconsistent with the persistence of metastable olivine wedges into the mantle transition zone. Metastable persistence of olivine into the mantle transition-zone would therefore require < 75 ppmw H 2 O.

58 GEOSCIENCES↗

Towards scanning nanostructure X-ray microscopy

This article demonstrates spatial mapping of the local and nanoscale structure of thin film objects using spatially resolved pair distribution function (PDF) analysis of synchrotron X-ray diffraction data. This is exemplified in a lab-on-chip combinatorial array of sample spots containing catalytically interesting nanoparticles deposited from liquid precursors using an ink-jet liquid-handling system. A software implementation is presented of the whole protocol, including an approach for automated data acquisition and analysis using the atomic PDF method. The protocol software can handle semi-automated data reduction, normalization and modeling, with user-defined recipes generating a comprehensive collection of metadata and analysis results. By slicing the collection using included functions, it is possible to build images of different contrast features chosen by the user, giving insights into different aspects of the local structure.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Quantifying Year-to-Year Variations in Solar Panel Soiling from PV Energy-Production Data

We present a method for quantifying solar panel soiling loss from PV energy-production data and show how it can be used to quantify year-to-year variations in soiling loss. Cleaning events are automatically detected, eliminating the need for precipitation data or assumptions about cleaning. The method also calculates the reduction of energy yield due to soiling, not just a soiling rate. We apply the method annually and also to multi-year datasets. We find significant year-to-year variation in soiling loss, a result with important implications for site planning and financing. The method presented here can leverage existing datasets of daily energy yield to quantify annual and total soiling risk without the need for new hardware and serves as a supplement to standard plant planning practices.

14 SOLAR ENERGY↗

Towards Effective Clustering Techniques for the Analysis of Electric Power Grids

Clustering is an important data analysis technique with numerous applications in the analysis of electric power grids. Standard clustering techniques are oblivious to the rich structural and dynamic information available for power grids. Therefore, by exploiting the inherent topological and electrical structure in the power grid data, we propose new methods for clustering with applications to model reduction, locational marginal pricing, phasor measurement unit (PMU or synchrophasor) placement, and power system protection. We focus our attention on model reduction for analysis based on time-series information from synchrophasor measurement devices, and spectral techniques for clustering. By comparing different clustering techniques on two instances of realistic power grids we show that the solutions are related and therefore one could leverage that relationship for a computational advantage. Thus, by contrasting different clustering techniques we make a case for exploiting structure inherent in the data with implications for several domains including power systems.

clustering, k-means, power grid, graphs↗

Grassmannian Diffusion Maps--Based Dimension Reduction and Classification for High-Dimensional Data

This work introduces the Grassmannian diffusion maps (GDMaps), a novel nonlinear dimensionality reduction technique that defines the affinity between points through their representation as low-dimensional subspaces corresponding to points on the Grassmann manifold. Here, the method is designed for applications, such as image recognition and data-based classification of constrained high-dimensional data where each data point itself is a high-dimensional object (i.e., a large matrix) that can be compactly represented in a lower-dimensional subspace. The GDMaps is composed of two stages. The first is a pointwise linear dimensionality reduction wherein each high-dimensional object is mapped onto the Grassmann manifold representing the low-dimensional subspace on which it resides. The second stage is a multipoint nonlinear kernel-based dimension reduction using diffusion maps to identify the subspace structure of the points on the Grassmann manifold. To this end, an appropriate Grassmannian kernel is used to construct the transition matrix of a random walk on a graph connecting points on the Grassmann manifold. Spectral analysis of the transition matrix yields low-dimensional Grassmannian diffusion coordinates embedding the data into a low-dimensional reproducing kernel Hilbert space. Further, a novel data classification/recognition technique is developed based on the construction of an overcomplete dictionary of reduced dimension whose atoms are given by the Grassmannian diffusion coordinates. Three examples are considered. First, a "toy" example shows that the GDMaps can identify an appropriate parametrization of structured points on the unit sphere. The second example demonstrates the ability of the GDMaps to revealing the intrinsic subspace structure of high-dimensional random field data. In the last ex- ample, a face recognition problem is solved considering face images subject to varying illumination conditions, changes in face expressions, and occurrence of occlusions. The technique presented high recognition rates (i.e., 95% in the best case) using a fraction of the data required by conventional methods.

42 ENGINEERING↗

Maximizing efficiency of dataset compression for machine learning potentials with information theory

Machine learning interatomic potentials (MLIPs) balance high accuracy and lower costs compared to density functional theory calculations, but their performance often depends on the size and diversity of training datasets. Large datasets improve model accuracy and generalization but are computationally expensive to produce and train on, while smaller datasets risk discarding rare but important atomic environments and compromising MLIP accuracy/reliability. Here, we develop an information-theoretical framework to quantify the efficiency of dataset compression methods and propose an algorithm that maximizes this efficiency. By framing atomistic dataset compression as an instance of the minimum set cover (MSC) problem over atom-centered environments, our method identifies the smallest subset of structures that contains as much information as possible from the original dataset while pruning redundant information. The approach is extensively demonstrated on the GAP-20 and TM23 datasets and validated on 64 varied datasets from the ColabFit repository. Across all cases, MSC consistently retains outliers, preserves dataset diversity, and reproduces the long-tail distributions of forces even at high compression rates, outperforming other subsampling methods. Furthermore, MLIPs trained on MSC-compressed datasets exhibit reduced error for out-of-distribution data even in low-data regimes. We explain these results using an outlier analysis and show that such quantitative conclusions could not be achieved with conventional dimensionality reduction methods. The algorithm is implemented in the open-source QUESTS package and can be used for several tasks in atomistic modeling, from data subsampling, outlier detection, and training improved MLIPs at a lower cost.

36 MATERIALS SCIENCE↗

THE SIMPLE SURVEY: OBSERVATIONS, REDUCTION, AND CATALOG

We present the Spitzer IRAC/MUSYC Public Legacy Survey in the Extended CDF-South (SIMPLE), which consists of deep IRAC observations covering the {approx}1600 arcmin{sup 2} area surrounding GOODS-S. The limiting magnitudes of the SIMPLE IRAC mosaics typically are 23.8, 23.6, 21.9, and 21.7, at 3.6 {mu}m, 4.5 {mu}m, 5.8 {mu}m, and 8.0 {mu}m, respectively (5{sigma} total point source magnitudes in AB). The SIMPLE IRAC images are combined with the 10' x 15' GOODS IRAC mosaics in the center. We give detailed descriptions of the observations, data reduction, and properties of the final images, as well as the detection and photometry methods used to build a catalog. Using published optical and near-infrared data from the Multiwavelength Survey by Yale-Chile (MUSYC), we construct an IRAC-selected catalog, containing photometry in UBVRIz'JHK, [3.6 {mu}m], [4.5 {mu}m], [5.8 {mu}m], and [8.0 {mu}m]. The catalog contains 43,782 sources with S/N >5 at 3.6 {mu}m, 19,993 of which have 13-band photometry. We compare this catalog to the publicly available MUSYC and FIREWORKS catalogs and discuss the differences. Using a high signal-to-noise sub-sample of 3391 sources with ([3.6] + [4.5])/2 < 21.2, we investigate the star formation rate history of massive galaxies out to z {approx} 1.8. We find that at z {approx} 1.8 at least 30% {+-} 7% of the most massive galaxies (M{sub *} >10{sup 11} M{sub sun}) are passively evolving, in agreement with earlier results from surveys covering less area.

79 ASTRONOMY AND ASTROPHYSICS↗

Computational Bayesian Framework for Quantification and Reduction of Predictive Uncertainty in Subsurface Environmental Modeling

Subsurface environmental systems are open and complex, in which intricate hydrologic, microbiologic, and geochemical processes occur and interact at multiple scales. Understanding and predicting system responses to natural forces (e.g., climate changes) and human activities (e.g., contaminant remediation and CO 2 sequestration) is indispensable for managing water resources, cleaning subsurface contamination at many sites of the Department of Energy (DOE), and providing expert analysis to inform policy-making on long-term stewardship of nuclear waste disposal and CO 2 storage sites. Groundwater reactive transport modeling is necessary for understanding and predicting the complex subsurface environmental system. However, as complex systems are never completely predictable, model predictions of the subsurface system are inherently uncertain, and uncertainty is one of the greatest obstacles in simulating the subsurface environment. Quantifying predictive uncertainty of the complex system is critical to test model predictive power, support decision-making, and guide experimental design and data collection for uncertainty reduction. This project tackled two major obstacles to efficient and effective quantification and reduction of predictive uncertainty in simulating the complex subsurface environment. One obstacle is that existing methods of uncertainty quantification are too fragmented and incomplete for understanding and predicting the complex subsurface environment as a whole. The other obstacle is that existing methods of uncertainty quantification are computationally demanding and may not be applicable to groundwater reactive transport modeling that is always computationally expensive. The above two obstacles to uncertainty quantification directly affect the design of data collection schemes for uncertainty reduction. In this project, we developed a comprehensive Bayesian framework to remove the first obstacle. The second obstacle was tackled by using the sparse grid methods, which were originally developed and analyzed for numerical integration in the field of applied mathematics. We integrated the sparse grid methods into the Bayesian framework seamlessly, which led to a sparse-grid-based method of Bayesian uncertainty analysis. The developed computational Bayesian framework has been applied to a number of subsurface environmental problems through collaborating with scientists at the Pacific Northwest National Laboratory and Oak Ridge National Laboratory. The applications demonstrated that the computational Bayesian framework is general and compatible with any models and numerical codes of subsurface modeling. It is thus can be applied to gain insights for subsurface environmental modeling. This project helped the PI achieve his career goal to advance the state-of-the-art computational methods in uncertainty quantification for subsurface environmental modeling. This project supported two doctoral students, two master students, and one post-doc. The two doctoral students, after their graduation, worked as post-docs at the Pacific Northwest National Laboratory and the Oak Ridge National Laboratory. The project produced a total of 29 journal articles (four under review), one book chapter, and a number of conference proceedings and abstracts.

54 ENVIRONMENTAL SCIENCES↗

Effectiveness of fat grafting in scar reduction: A systematic review and meta‐analysis

Abstract Background Scar brings great physical and mental pain to patients. Fat grafting may be a new and simple way to treat scar. This review aimed to systematically evaluate the correlation between fat grafting and scar reduction. Methods The author searched Chinese and English literature databases such as CNKI, Wanfang Data, Cqvip, Pubmed, Web of Science, Embase, CBM, etc. for articles published in the period from 2011 to 2021 about the randomized controlled trials (RCTs) to assess the effect of fat grating on scar reduction, and then performed meta‐analysis with Review Manager 5.4. Results A total of nine articles were included in the assessment of the effect of fat grafting on scar reduction, with meta‐analysis suggesting statistical significance (OR = 5.63, 95% CI: 3.01–10.53, p < 0.01). There was statistical significance in the difference observed between the simple fat grating group ( p = 0.004) and the group of existing therapies combined with fat grafting ( p < 0.0001). Conclusion Fat grafting may be a good method for scar treatment, especially when it's combined with other therapies. Still, due to the limitations of included RCTs, more large‐scale high‐quality RCTs must be carried out before solid conclusions can be drawn.

Zhang, Xiaoyuan↗

Preventing Data Ambiguity in Infectious Diseases with Four-Dimensional and Personalized Evaluations

Background Diagnostic errors can occur, in infectious diseases, when anti-microbial immune responses involve several temporal scales. When responses span from nanosecond to week and larger temporal scales, any pre-selected temporal scale is likely to miss some (faster or slower) responses. Hoping to prevent diagnostic errors, a pilot study was conducted to evaluate a four-dimensional (4D) method that captures the complexity and dynamics of infectious diseases. Methods Leukocyte-microbial-temporal data were explored in canine and human (bacterial and/or viral) infections, with: (i) a non-structured approach, which measures leukocytes or microbes in isolation; and (ii) a structured method that assesses numerous combinations of interacting variables. Four alternatives of the structured method were tested: (i) a noise reduction oriented version, which generates a single (one data point-wide) line of observations; (ii) a version that measures complex, three-dimensional (3D) data interactions; (iii) a non-numerical version that displays temporal data directionality (arrows that connect pairs of consecutive observations); and (iv) a full 4D (single line-, complexity-, directionality based) version. Results In all studies, the non-structured approach revealed non-interpretable (ambiguous) data: observations numerically similar expressed different biological conditions, such as recovery and lack of recovery from infections. Ambiguity was also found when the data were structured as single lines. In contrast, two or more data subsets were distinguished and ambiguity was avoided when the data were structured as complex, 3D, single lines and, in addition, temporal data directionality was determined. The 4D method detected, even within one day, changes in immune profiles that occurred after antibiotics were prescribed. Conclusions Infectious disease data may be ambiguous. Four-dimensional methods may prevent ambiguity, providing earlier, in vivo, dynamic, complex, and personalized information that facilitates both diagnostics and selection or evaluation of anti-microbial therapies.

59 BASIC BIOLOGICAL SCIENCES↗

Process-Structure Linkages Using a Data Science Approach: Application to Simulated Additive Manufacturing Data

A novel data science workflow is developed and demonstrated to extract process-structure linkages (i.e., reduced-order model) for microstructure evolution problems when the final microstructure depends on (simulation or experimental) processing parameters. Our workflow consists of four main steps: data pre-processing, microstructure quantification, dimensionality reduction, and extraction/validation of process-structure linkages. These methods that can be employed within each step vary based on the type and amount of available data. In this paper, this data-driven workflow is applied to a set of synthetic additive manufacturing microstructures obtained using the Potts-kinetic Monte Carlo (kMC) approach. Additive manufacturing techniques inherently produce complex microstructures that can vary significantly with processing conditions. Using the developed workflow, a low-dimensional data-driven model was established to correlate process parameters with the predicted final microstructure. In addition, the modular workflows developed and presented in this work facilitate easy dissemination and curation by the broader community.

36 MATERIALS SCIENCE↗

Infrared and radar fusion detection method based on heterogeneous data preprocessing

The difficulty in infrared and radar fusion target detection lies in the pre-processing steps such as sample reduction and feature reduction of heterogeneous sensors. For the problem of data volume redundancy, HVS sample reduction is proposed to reduce the amount of data in the infrared data set. Infrared and radar joint feature vectors are constructed through nearest neighbor data association. For the problem of feature redundancy, a weighted mutual information feature selection method based on prior information is proposed according to the difference of feature sources. The fusion data set is then used for classification. The experiments show that the HVS-based sample reduction and the prior weighted feature selection achieved a higher detection probability and a shorter detection time, and improved the robustness in the case of large differences between the training set and the test set.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

EM Algorithm for Mapping Quantitative Trait Loci in Multivalent Tetraploids

Multivalent tetraploids that include many plant species, such as potato, sugarcane, and rose, are of paramount importance to agricultural production and biological research. Quantitative trait locus (QTL) mapping in multivalent tetraploids is challenged by their unique cytogenetic properties, such as double reduction. We develop a statistical method for mapping multivalent tetraploid QTLs by considering these cytogenetic properties. This method is built in the mixture model-based framework and implemented with the EM algorithm. The method allows the simultaneous estimation of QTL positions, QTL effects, the chromosomal pairing factor, and the degree of double reduction as well as the assessment of the estimation precision of these parameters. We used simulated data to examine the statistical properties of the method and validate its utilization. The new method and its software will provide a useful tool for QTL mapping in multivalent tetraploids that undergo double reduction.

59 BASIC BIOLOGICAL SCIENCES↗

POWTEX visits POWGEN

The high-intensity time-of-flight (TOF) neutron diffractometer POWTEX for powder and texture analysis is currently being built prior to operation in the eastern guide hall of the research reactor FRM II at Garching close to Munich, Germany. Because of the world-wide 3 He crisis in 2009, the authors promptly initiated the development of 3 He-free detector alternatives that are tailor-made for the requirements of large-area diffractometers. Herein is reported the 2017 enterprise to operate one mounting unit of the final POWTEX detector on the neutron powder diffractometer POWGEN at the Spallation Neutron Source located at Oak Ridge National Laboratory, USA. As a result, presented here are the first angular- and wavelength-dependent data from the POWTEX detector, unfortunately damaged by a 50 g shock but still operating, as well as the efforts made both to characterize the transport damage and to successfully recalibrate the voxel positions in order to yield nonetheless reliable measurements. Also described is the current data reduction process using the PowderReduceP2D algorithm implemented in Mantid [Arnold et al. (2014). Nucl. Instrum. Methods Phys. Res. A , 764 , 156–166]. The final part of the data treatment chain, namely a novel multi-dimensional refinement using a modified version of the GSAS-II software suite [Toby & Von Dreele (2013). J. Appl. Cryst. 46 , 544–549], is compared with a standard data treatment of the same event data conventionally reduced as TOF diffraction patterns and refined with the unmodified version of GSAS-II . This involves both determining the instrumental resolution parameters using POWGEN's powdered diamond standard sample and the refinement of a friendly-user sample, BaZn(NCN) 2 . Although each structural parameter on its own looks similar upon comparing the conventional (1D) and multi-dimensional (2D) treatments, also in terms of precision, a closer view shows small but possibly significant differences. For example, the somewhat suspicious proximity of the a and b lattice parameters of BaZn(NCN) 2 crystallizing in Pbca as resulting from the 1D refinement (0.008 Å) is five times less pronounced in the 2D refinement (0.038 Å). Similar features are found when comparing bond lengths and bond angles, e.g. the two N—C—N units are less differently bent in the 1D results (173 and 175°) than in the 2D results (167 and 173°). The results are of importance not only for POWTEX but also for other neutron TOF diffractometers with large-area detectors, like POWGEN at the SNS or the future DREAM beamline at the European Spallation Source.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Quality-Aware Data Management for Large Scale Scientific Applications

Increasingly larger scale simulations are generating an unprecedented amount of output data, causing researchers to explore new `data staging' methods that buffer, use, and/or reduce such data online rather than simply pushing it to disk. Leveraging the capabilities of data staging, this study explores the potential for data reduction via online data compression, first using general compression techniques and then proposing use-specific methods that permit users to define simple data queries that cause only the data identified by those queries to be emitted. Using online methods for code generation and deployment, with such dynamic data queries, end users can precisely identify the quality of information (QoI) of their output data, by explicitly determining what data may be lost vs. retained, in contrast to general-purpose lossy compression methods that do not provide such levels of control. The paper also describes the key elements of a quality-aware data management system (QADMS) for high-end machines enabled by this approach. Initial experimental results demonstrate that QADMS can effectively reduce data movement cost and improve the QoS while meeting the QoI constraint stated by users.

Computer Science↗