SEARCH · Search NASA

Results for “Small Data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

All sources NASA NTRS DOE OSTI

DOE OSTI2021

Improving Performance of Tape Restore Request Scheduling in the Storage System dCache

Given the anticipated increase in the amount of scientific data, it is widely accepted that primarily disk based storage will become prohibitively expensive. Tape based storage, on the other hand, provides a viable and affordable solution for the ever increasing demand for storage space. Coupled with a disk caching layer that temporarily holds a small fraction of the total data volume to allow for low latency access, it turns tape based systems into active archival storage (write once, read many) that imposes additional demands on data flow optimization compared to traditional backup setups (write once, read never). In order to preserve the lifetime of tapes and minimize the inherently higher access latency, different tape usage strategies are being evaluated. As an important disk storage system for scientific data that transparently handles tape access, dCache is making efforts to evaluate its recall optimization potential and is introducing a proof-of-concept, high-level stage request scheduling component within its SRM implementation.

Morschel, Lea↗

DOE OSTI2023

Improving an Acoustic Vehicle Detector Using an Iterative Self-Supervision Procedure

In many non-canonical data science scenarios, obtaining, detecting, attributing, and annotating enough high-quality training data is the primary barrier to developing highly effective models. Moreover, in many problems that are not sufficiently defined or constrained, manually developing a training dataset can often overlook interesting phenomena that should be included. To this end, we have developed and demonstrated an iterative self-supervised learning procedure, whereby models are successfully trained and applied to new data to extract new training examples that are added to the corpus of training data. Successive generations of classifiers are then trained on this augmented corpus. Using low-frequency acoustic data collected by a network of infrasound sensors deployed around the High Flux Isotope Reactor and Radiochemical Engineering Development Center at Oak Ridge National Laboratory, we test the viability of our proposed approach to develop a powerful classifier with the goal of identifying vehicles from continuously streamed data and differentiating these from other sources of noise such as tools, people, airplanes, and wind. Using a small collection of exhaustively manually labeled data, we test several implementation details of the procedure and demonstrate its success regardless of the fidelity of the initial model used to seed the iterative procedure. Finally, we demonstrate the method’s ability to update a model to accommodate changes in the data-generating distribution encountered during long-term persistent data collection.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2020

Status and Trends in the Voluntary Market (2019 Data)

Green power refers to renewable electricity voluntarily purchased by retail electricity customers. Renewable energy sources for green power include solar, wind, biomass, geothermal, and small-scale hydropower. This report summarizes data on the various ways in which voluntary purchasers - including residential, commercial, and institutional customers - purchase green power. We summarize key historic trends in U.S. voluntary green power markets and the current status of green power sales through seven products: utility green pricing programs, utility renewable contracts, competitive suppliers, unbundled renewable energy certificates, community choice aggregations, power purchase agreements, and community solar.

42 ENGINEERING↗

DOE OSTI2021

Status and Trends in the Voluntary Market (2020 Data)

community choice aggregation↗

DOE OSTI2022

Status and Trends in the Voluntary Market (2021 Data)

Green power refers to renewable electricity voluntarily purchased by retail electricity customers. Renewable energy sources for green power include solar, wind, biomass, geothermal, and small-scale hydropower. This report summarizes data on the various ways in which voluntary purchasers including residential, commercial, and institutional customers purchase green power. We summarize key historic trends in U.S. voluntary green power markets and the current status of green power sales through seven products: utility green pricing programs, utility renewable contracts, competitive suppliers, unbundled renewable energy certificates, community choice aggregations, and power purchase agreements. It includes discussion of how the voluntary market may impact the grid.

ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2022

Dark Energy Survey year 3 results: Constraints on cosmological parameters and galaxy-bias models from galaxy clustering and galaxy-galaxy lensing using the redMaGiC sample

We constrain cosmological parameters and galaxy-bias parameters using the combination of galaxy clustering and galaxy-galaxy lensing measurements from the Dark Energy Survey (DES) year-3 data. We describe our modeling framework and choice of scales analyzed, validating their robustness to theoretical uncertainties in small-scale clustering by analyzing simulated data. Using a linear galaxy-bias model and redMaGiC galaxy sample, we obtain 10% constraints on the matter density of the Universe. Here, we also implement a nonlinear galaxy-bias model to probe smaller scales that includes parametrization based on hybrid perturbation theory and find that it leads to a 17% gain in cosmological constraining power. We perform robustness tests of our methodology pipeline and demonstrate stability of the constraints to changes in the theory model. Using the redMaGiC galaxy sample as foreground lens galaxies and adopting the best-fitting cosmological parameters from DES year-1 data, we find the galaxy clustering and galaxy-galaxy lensing measurements to exhibit significant signals akin to decorrelation between galaxies and mass on large scales, which is not expected in any current models. This likely systematic measurement error biases our constraints on galaxy bias and the S 8 parameter. We find that a scale-, redshift- and sky-area-independent phenomenological decorrelation parameter can effectively capture this inconsistency between the galaxy clustering and galaxy-galaxy lensing. We trace the source of this correlation to a color-dependent photometric issue and minimize its impact on our result by changing the selection criteria of redMaGiC galaxies. Using this new sample, our constraints on the S 8 parameter are consistent with previous studies and we find a small shift in the Ω m constraints compared to the fiducial redMaGiC sample. We infer the constraints on the mean host-halo mass of the redMaGiC galaxies in this new sample from the large-scale bias constraints, finding the galaxies occupy halos of mass approximately 1.6 × 10 13 M ⊙ /h.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2021

Thermal WIMPs and the scale of new physics: global fits of Dirac dark matter effective field theories

We assess the status of a wide class of WIMP dark matter (DM) models in light of the latest experimental results using the global fitting framework GAMBIT. We perform a global analysis of effective field theory (EFT) operators describing the interactions between a gauge-singlet Dirac fermion and the Standard Model quarks, the gluons and the photon. In this bottom-up approach, we simultaneously vary the coefficients of 14 such operators up to dimension 7, along with the DM mass, the scale of new physics and several nuisance parameters. Our likelihood functions include the latest data from Planck, direct and indirect detection experiments, and the LHC. For DM masses below 100 GeV, we find that it is impossible to satisfy all constraints simultaneously while maintaining EFT validity at LHC energies. For new physics scales around 1 TeV, our results are influenced by several small excesses in the LHC data and depend on the prescription that we adopt to ensure EFT validity. Furthermore, we find large regions of viable parameter space where the EFT is valid and the relic density can be reproduced, implying that WIMPs can still account for the DM of the universe while being consistent with the latest data.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2021

Spin-lattice dynamics of surface vs core magnetization in Fe nanoparticles

Magnetization of clusters is often simulated using atomistic spin dynamics for a fixed lattice. Coupled spinlattice dynamics simulations of the magnetization of nanoparticles have up to now neglected the change in the size of the atomic magnetic moments near surfaces. We show that the introduction of variable magnetic moments leads to a better description of experimental data for the magnetization of small Fe nanoparticles. To this end we divide atoms into a surface-near shell and a core with bulk properties. Here, it is demonstrated that both the magnitude of the shell magnetic moment and the exchange interactions need to be modified to obtain a fair representation of the experimental data. This allows for a reasonable description of the average magnetic moment versus cluster size, and also the cluster magnetization versus temperature.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2026

High-Mileage Courier Fleet Vehicle On-Road Logger Data

This dataset describes the performance and fuel efficiency of AVTA test vehicles operating in commercial courier fleets the Phoenix, AZ metro area between 2010 and 2016. Aftermarket data loggers were installed in two to four vehicles of each of 30+ distinct year/make/models (see reference ["INL Advanced Vehicle Testing Activity: On-road Logger and Laboratory Battery Pack Testing Vehicle List"](https://avt.inl.gov/sites/default/files/pdf/reports/DatasetVehicleList.pdf) for full list of vehicles). Loggers recorded vehicle operation as they were driven up to 160,000 miles in up to three years of fleet testing. Parameters were logged at 1-second intervals, including - vehicle speed, - engine and/or electric motor speed, - fuel and/or electricity consumption, and - ambient temperature. This dataset includes both raw second-by-second data and trip-level metrics. This dataset is shared by API; a small sample of the vehicle and logger data has been extracted and is also available for download.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2022

Improved Data Interpretation through Identification of Time Series Periodicity Changes

Analysis and interpretation of time series data is easiest when the data values occur at uniform intervals in time, but actual data may have differing data sampling frequencies, such as monthly and daily readings. Applying data analysis techniques, such as smoothing, to such a data set may not give a representative result between time segments. The ability to automatically distinguish time segments of differing data frequency would provide a means for applying data analysis independently to each segment, though a suitable blending at segment boundaries would be required. A method for detecting frequency changes was developed and applied to Gaussian and median smoothing of hydraulic head data from groundwater wells at the U.S. Department of Energy Hanford Site in southeastern Washington state. The process identifies time segments of high-frequency (daily) or low-frequency (greater than daily) data using adjusted-bandwidth Gaussian kernel density estimation and a threshold value, which are further refined to address small blocks of low-frequency data within larger blocks of high-frequency data. User-selectable levels of smoothing are then applied independently to the time segments prior to combining the segment results for a single smoothed data set. This time segment identification approach provides effective low- and high-frequency data separation, which provides a method to apply data analysis independently to each time segment.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Dark Energy Survey Year 3 Results: Constraints on cosmological parameters and galaxy bias models from galaxy clustering and galaxy-galaxy lensing using the redMaGiC sample

We constrain cosmological parameters and galaxy-bias parameters using the combination of galaxy clustering and galaxy-galaxy lensing measurements from the Dark Energy Survey Year-3 data. We describe our modeling framework and choice of scales analyzed, validating their robustness to theoretical uncertainties in small-scale clustering by analyzing simulated data. Using a linear galaxy bias model and redMaGiC galaxy sample, we obtain constraints on the matter content of the universe to be $\Omega_{\rm m} = 0.325^{+0.033}_{-0.034}$. We also implement a non-linear galaxy bias model to probe smaller scales that includes parameterizations based on hybrid perturbation theory, and find that it leads to a 17% gain in cosmological constraining power. Using the redMaGiC galaxy sample as foreground lens galaxies, we find the galaxy clustering and galaxy-galaxy lensing measurements to exhibit significant signals akin to decorrelation between galaxies and mass on large scales, which is not expected in any current models. This likely systematic measurement error biases our constraints on galaxy bias and the $S_8$ parameter. We find that a scale-, redshift- and sky-area-independent phenomenological decorrelation parameter can effectively capture this inconsistency between the galaxy clustering and galaxy-galaxy lensing. We perform robustness tests of our methodology pipeline and demonstrate stability of the constraints to changes in the theory model. After accounting for this decorrelation, we infer the constraints on the mean host halo mass of the redMaGiC galaxies from the large-scale bias constraints, finding the galaxies occupy halos of mass approximately $1.5 \times 10^{13} M_{\odot}/h$.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2020

Pattern-matching indexing of Laue and monochromatic serial crystallography data for applications in materials science

Serial crystallography data can be challenging to index, as each frame is processed individually, rather than being processed as a whole like in conventional X-ray single-crystal crystallography. An algorithm has been developed to index still diffraction patterns arising from small-unit-cell samples. The algorithm is based on the matching of reciprocal-lattice vector pairs, as developed for Laue microdiffraction data indexing, combined with three-dimensional pattern matching using a nearest-neighbors approach. As a result, large-bandpass data (e.g. 5–24 keV energy range) and monochromatic data can be processed, the main requirement being prior knowledge of the unit cell. Furthermore, angles calculated in the vicinity of a few theoretical and experimental reciprocal-lattice vectors are compared, and only vectors with the highest number of common angles are selected as candidates to obtain the orientation matrix. Global matching on the entire pattern is then checked. Four indexing options are available, two for the ranking of the theoretical reciprocal-lattice vectors and two for reducing the number of possible candidates. Furthermore, the algorithm has been used to index several data sets collected under different experimental conditions on a series of model samples. Additionally, knowing the crystallographic structure of the sample and using this information to rank the theoretical reflections based on the structure factors helps the indexing of large-bandpass data for the largest-unit-cell samples. For small-bandpass data, shortening the candidate list to determine the orientation matrix should be based on matching pairs of reciprocal-lattice vectors instead of triplet matching.

36 MATERIALS SCIENCE↗

DOE OSTI2021

Gauge R & R studies for angular measurements

Angular measurements lie on the circumference of a circle and have different characteristics than standard scalar measurements. For applications involving angular data, treating the measured values as scalars can lead to misinterpretation of results if its wrap-around nature is not taken into account. In this article, we propose a variance components wrapped normal model for angular measurements that is analogous to the standard normal model for continuous measurements. This model allows decomposition of contributions to the overall variance to be separated and compared to understand the drivers of the spread of the data. In this work, we analyze gauge R & R study data using Bayesian methods and illustrate the use of this wrapped normal model with simulated and real data. We also performed a small simulation study in considering the design of gauge R & R studies with angular measurements.

42 ENGINEERING↗

DOE OSTI2023

Uniform-in-phase-space data selection with iterative normalizing flows

Improvements in computational and experimental capabilities are rapidly increasing the amount of scientific data that are routinely generated. In applications that are constrained by memory and computational intensity, excessively large datasets may hinder scientific discovery, making data reduction a critical component of data-driven methods. Datasets are growing in two directions: the number of data points and their dimensionality. Whereas dimension reduction typically aims at describing each data sample on lower-dimensional space, the focus here is on reducing the number of data points. A strategy is proposed to select data points such that they uniformly span the phase-space of the data. The algorithm proposed relies on estimating the probability map of the data and using it to construct an acceptance probability. An iterative method is used to accurately estimate the probability of the rare data points when only a small subset of the dataset is used to construct the probability map. Instead of binning the phase-space to estimate the probability map, its functional form is approximated with a normalizing flow. Therefore, the method naturally extends to high-dimensional datasets. The proposed framework is demonstrated as a viable pathway to enable data-efficient machine learning when abundant data are available.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

National population mapping from sparse survey data: A hierarchical Bayesian modeling framework to account for uncertainty

Population estimates are critical for government services, development projects, and public health campaigns. Such data are typically obtained through a national population and housing census. However, population estimates can quickly become inaccurate in localized areas, particularly where migration or displacement has occurred. Some conflict-affected and resource-poor countries have not conducted a census in over 10 y. We developed a hierarchical Bayesian model to estimate population numbers in small areas based on enumeration data from sample areas and nationwide information about administrative boundaries, building locations, settlement types, and other factors related to population density. We demonstrated this model by estimating population sizes in every 10- m grid cell in Nigeria with national coverage. These gridded population estimates and areal population totals derived from them are accompanied by estimates of uncertainty based on Bayesian posterior probabilities. The model had an overall error rate of 67 people per hectare (mean of absolute residuals) or 43% (using scaled residuals) for predictions in out-of-sample survey areas (approximately 3 ha each), with increased precision expected for aggregated population totals in larger areas. This statistical approach represents a significant step toward estimating populations at high resolution with national coverage in the absence of a complete and recent census, while also providing reliable estimates of uncertainty to support informed decision making.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2023

The Association Between Baseline Hepatic or Renal Function and Clinical Outcomes for Patients With Non–Small Cell Lung Cancer Treated With a PD –1/PD– L1 Blocking Antibody Using Real–World and Trial Data

Clinical trials have demonstrated the benefit of PD-1/PD-L1 blocking antibodies for the treatment of patients with advanced non-small cell lung cancer (NSCLC) in defined patient populations that often exclude patients with moderate or severe hepatic or renal impairment. We assessed the association between overall survival (OS) and baseline organ function in patients with advanced NSCLC treated with PD-1/PD-L1 blocking antibodies in real-world data (RWD; patient-level data from electronic health records) and pooled clinical trial data submitted to the US Food and Drug Administration (FDA). The Kaplan–Meier estimator was used to estimate OS in different subgroups based on organ function. Unadjusted and adjusted Cox proportional hazards models were used to estimate the association between OS and organ function. In this hypothesis-generating study, baseline renal impairment did not appear to be associated with OS, while patients with baseline liver impairment had shorter OS. RWD provided information on a broader range of renal and hepatic function than was evaluated in clinical trials and hold promise to complement trial data in better understanding populations not represented in clinical trials.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2021

Modeling of the Molten Salt Reactor Experiment with SCALE

A SCALE model was developed for the Molten Salt Reactor Experiment (MSRE) benchmark that was recently added to the International Handbook of Evaluated Reactor Physics Benchmark Experiments. This SCALE model served as a basis for criticality calculations and nuclear data sensitivity and uncertainty analyses with the Monte Carlo code Shift and the TSUNAMI computational capabilities in the SCALE code system. The focus of this work is the assessment of the impact of nuclear data on the calculated eigenvalue results in support of the discussion of differences between the calculated and the experimental eigenvalue result. The differences in the eigenvalues obtained using the ENDF/B-VII.0, ENDF/B-VII.1, and ENDF/B-VIII.0 nuclear data libraries cover a relatively small range of ~230 pcm. Since eigenvalue sensitivity of the MSRE is dominated by the neutron multiplicity and neutron capture of 235 U and elastic scattering in graphite, relevant changes in the ENDF/B libraries for nuclear reactions (such as carbon capture) that caused large differences in other graphite-moderated systems did not have a significant impact. Propagation of nuclear data uncertainty results in an eigenvalue uncertainty of ~700 pcm with the major contributors being 235 U neutron multiplicity, graphite elastic scattering, and 7Li neutron capture. All calculations resulted in large differences of ~2000 pcm in eigenvalue compared to the benchmark experimental value. Several potential contributors to this difference—including uncertainties and gaps in the knowledge of the material, geometry, and nuclear data—were identified. Simplified models of the full MSRE core were developed, and similarity assessments were conduced with the full MSRE core model. It was found that simplified models can serve as adequate surrogates of the full-core model such that they can be used for performing selected nuclear data performance assessments with a lower computational burden.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2021

Improve Learning from Crowds via Generative Augmentation

Crowdsourcing provides an efficient label collection schema for supervised machine learning. However, to control annotation cost, each instance in the crowdsourced data is typically annotated by a small number of annotators. This creates a sparsity issue and limits the quality of machine learning models trained on such data. In this paper, we study how to handle sparsity in crowdsourced data using data augmentation. Specifically, we propose to directly learn a classifier by augmenting the raw sparse annotations. We implement two principles of high-quality augmentation using Generative Adversarial Networks: 1) the generated annotations should follow the distribution of authentic ones, which is measured by a discriminator; 2) the generated annotations should have high mutual information with the ground-truth labels, which is measured by an auxiliary network. Extensive experiments and comparisons against an array of state-of-the-art learning from crowds methods on three real-world datasets proved the effectiveness of our data augmentation framework. It shows the potential of our algorithm for low-budget crowdsourcing in general.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗