Search NASA⌕ Search

SEARCH · Search NASA

Results for “missing data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32

Deep-learning methods for contrast enhancement and artifact reduction in cryo-electron tomography: a systematic analysis of the state of the art and proposed improvements

Cryo-electron tomography (cryo-ET) has emerged as the preferred technique for visualizing the organization of macromolecular complexes in situ and resolving their structures at subnanometre resolution [Tegunov et al. (2021)View full citation, Nat. Methods, 18, 186–193]. Despite improvements in data quality as a result of advances in detector technology, microscope stability and stage precision, the analysis and interpretation of tomograms remains challenging due to a low signal-to-noise ratio and reconstruction artifacts stemming from experimental constraints in specimen tilt during data collection resulting in a missing wedge in the Fourier space. Recently, self-supervised deep-learning methods have been proposed for contrast enhancement and reduction of resolution anisotropy in reconstructed tomograms. Here, we evaluate several state-of-the-art deep-learning methods which aim to improve the interpretability of cryo-ET reconstructions, with a focus on their performance on downstream tasks of template matching, sub­tomogram averaging and segmentation. We propose new training architectures and a loss function based on Fourier shell correlation that show improved performance over the standard U-Net with L1/L2 losses. We demonstrate our analysis on four diverse experimental datasets: purified 80S ribosomes, in situ Chlamydomonas reinhardtii, immature HIV-1 virus-like particles and INS-1E cells.

contrast enhancement↗

Search for pair-produced vector-like top and bottom partners in events with large missing transverse momentum in $pp$ collisions with the ATLAS detector

A search for pair-produced vector-like quarks using events with exactly one lepton ($e$ or $μ$), at least four jets including at least one $b$-tagged jet, and large missing transverse momentum is presented. Data from proton–proton collisions at a centre-of-mass energy of $\sqrt{s}$ = 13 TeV, recorded by the ATLAS detector at the LHC from 2015 to 2018 and corresponding to an integrated luminosity of 139 fb –1 , are analysed. Vector-like partners $T$ and $B$ of the top and bottom quarks are considered, as is a vector-like $X$ with charge +5/3, assuming their decay into a $W$, $Z$, or Higgs boson and a third-generation quark. No significant deviations from the Standard Model expectation are observed. Upper limits on the production cross-section of $T$ and $B$ quark pairs as a function of their mass are derived for various decay branching ratio scenarios. The strongest lower limits on the masses are 1.59 assuming mass-degenerate vector-like quarks and branching ratios corresponding to the weak-isospin doublet model, and 1.47 TeV (1.46 TeV) for exclusive $T$→$Zt$ ($B/X$→$Wt$) decays. In addition, lower limits on the $T$ and $B$ quark masses are derived for all possible branching ratios.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Glass Refraction Distortion Object Detection via Abstract Features

Glass reflection and refraction lead to missing and distorted object feature data, affecting the accuracy of object detection. In order to solve the above problems, this paper proposed a glass refraction distortion object detection via abstract features. The number of parameters of the algorithm is reduced by introducing skip connections and expansion modules with different expansion rates. The abstract feature information of the object is extracted by binary cross-entropy loss. Meanwhile, the abstract feature distance between the object domain and source domain is reduced by a loss function, which improves the accuracy of object detection under glass interference. To verify the effectiveness of the algorithm in this paper, the GRI dataset is produced and made public on GitHub. The algorithm of this paper is compared with the current state-of-the-art Deep Face, VGG Face, TBE-CNN, DA-GAN, PEN-3D, LMZMPM, and the average detection accuracy of our algorithm is 92.57% at the highest, and the number of parameters is only 5.13 M.

Cai, Lei↗

Generalized Bayesian Framework for Evaluation of Integral Benchmark Experiments

A recently published generalized Bayesian optimization framework has provided a way to retract any or all of the three common assumptions underlying the conventional Generalized Linear Least Squares (GLLS) optimization method based on the concepts introduced in Ref. [2]. These assumptions are: 1. Perfection: The model used for data evaluation and the prior probability distribution function (PDF) of generalized data are perfect. 2. Normality: The prior and posterior PDF are normal. 3. Linearity: The model is linear. In this work we outline how the framework in [1] could be directly adopted for improved evaluation of nuclear criticality integral benchmark experiments (IBEs) by: 1. Removing the first assumption alone by utilizing the concept of imperfections introduced in [1] to enable evaluation in the presence of discrepancies between the data and model or of missing covariance information by a GLLS method that will be seen as a generalization of the conventional GLLS method employed by the TSURFER code, and by 2. Removing the remaining two assumptions by implementing a Markov Chain Monte Carlo method for computation of the posterior PDF in the SAMPLER code, where TSURFER and SAMPLER are the uncertainty quantification (UQ) codes for IBEs in the SCALE code system based on the GLLS and the stochastic method, respectively. The graphic in Figure 1 categorizes the methods discussed in terms of the assumptions that they employ to determine posterior PDFs.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Gap-filled methane and carbon dioxide fluxes across two ecosystem states at the US-OWC AmeriFlux site (2015−2016, 2020−2022)

This dataset contains gap-filled measurements of methane flux (FCH4), net ecosystem CO2 exchange (NEE) partitioned into gross primary productivity (GPP) and ecosystem respiration (RE), as well as latent heat flux (LE) from a Great Lakes coastal freshwater wetland at the US-OWC AmeriFlux site. The dataset covers the peak growing seasons (June−September) of 2015−2016, dominated by Typha spp., and 2020−2022, characterized by floating-leaved species (lotus and water lily). These data were generated to investigate how rising water levels and vegetation shifts influence CH4 and CO2 fluxes across two distinct ecosystem states in this wetland. The dataset, provided in CSV format, includes half-hourly gap-filled flux data from June to September for 2015, 2016, 2020, 2021, and 2022. The gap-filled data refers to measurements where missing values due to instrument issues or quality control were filled using artificial neural networks (ANNs).

54 ENVIRONMENTAL SCIENCES↗

Mathematical Morphological Filtering with a Self-Adaptive Reconstruction Technique and Application to Local Seismic Data

Recorded seismic data are generally contaminated by noise from different sources, which masks the signals of interest. In the seismology community, frequency filtering (FF) is the standard method for noise suppression. However, when the signal of interest and noise share the same frequency band, the latter cannot be filtered out without infringing on the former. We implemented a noise suppression approach based on the mathematical morphology theorem. The method involves compound operations of dilation and erosion using structuring elements of varying lengths and decomposes an input noisy waveform into several time functions with differing characteristics. Further, the filtered waveform is constructed from the time functions using a self-adaptive reconstruction technique. Application to a data set of >4700 local waveforms suggests that the implemented mathematical morphological filtering (MMF) approach is efficient for data with low signal-to-noise ratio (SNR) and significantly outperforms FF in that SNR range. For most of the dataset, FF, machine learning (ML) denoising, and continuous wavelet transform (CWT) thresholding result in higher SNR values compared with the MMF method. However, for ~42% of the waveforms, MMF outperforms FF, and the SNR gain achieved with MMF is as large as ~23 dB. Compared to ML denoising and CWT thresholding, this proportion drops to only ~10%–14%. Our results suggests that in an operational setting, MMF cannot replace the other noise suppression methods; however, signal detection can be improved if MMF is used to supplement them in some scenarios. MMF could help detect signals in problematic low-SNR data, which are currently being missed particularly when using FF alone.

58 GEOSCIENCES↗

Solar Avoided Cost Solution SunShot 6 Final Report

The core objectives of this project were two separate but integrated products, collectively providing game-changing Avoided Cost capabilities. The first was a kit of avoided cost tools and data that any solar provider can use a-lacarte or as a whole. It’s open and easily accessible nature allows the rapid and accurate calculation of avoided cost in whatever context and software that make sense (“Typical and Avoided Cost Tools”). This kit includes a dataset of typical energy rates, costs and usage that can be used for solar prospecting, lead generation and any situation where data about an opportunity is missing or imperfect. The second is a web application and related APIs specifically built for solar providers to radically streamline their lead-to-sale process (“Solar Provider Module”). The typical and Avoided Cost tools are built directly into this, and allow for solar providers to track their opportunities, collaborate with their installers and financiers, and close more sales faster.

14 SOLAR ENERGY↗

Search for New Bosons in Gluon-Gluon and Vector Boson Fusion Processes at the LHC and Development of Silicon Module Assembly Techniques for the CMS High Granularity Calorimeter

A search for heavy resonances decaying to a pair of vectors bosons is presented which utilizes events in which a hadronically decaying Z or W boson is identified using jet substructure techniques and large missing transverse momentum is found. Data analyzed were recorded by the Compact Muon Solenoid experiment at the CERN Large Hadron Collider in 2016, 2017, and 2018, and correspond to 137 fb$^{-1}$ . The events are categorized as having arisen from Vector Boson Fusion process or not, and are characterized by their transverse mass distribution. The standard model backgrounds are estimated based on observed yields in control regions. No excess of events above the expected SM background are observed and limits are placed on the production cross section of Radion (spin-0), Wprime (spin-1) and Bulk graviton (spin2) particles. In adiditon, the high luminosity LHC and the CMS HGCAL upgrade are also presented. The assembly techniques and various tests for the Silicon module and the cassette are discussed.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

A WISE CENSUS OF YOUNG STELLAR OBJECTS IN CANIS MAJOR

With the Wide-field Infrared Survey Explorer (WISE), we searched for young stellar objects (YSOs) in a 100 deg{sup 2} region centered on the lightly studied Canis Major star-forming region. Applying stringent magnitude cuts to exclude the majority of extragalactic contaminants, we find 144 Class I candidates and 335 Class II candidates. The sensitivity to Class II candidates is limited by their faintness at the distance to Canis Major (assumed as 1000 pc). More than half the candidates (53%) are found in 16 groups of more than four members, including four groups with more than 25 members each. The ratio of Class II to Class I objects, N {sub II}/ N {sub I}, varies from 0.4 to 8.3 in just the largest four groups. We compare our results to those obtainable with combined Two Micron All Sky Survey and post-cryogenic Spitzer Space Telescope data; the latter approach recovers missing Class II sources. Via a comparison to protostars characterized with the Herschel Space Observatory , we propose new WISE color criteria for flat-spectrum and Class 0 protostars, finding 80 and 7 of these, respectively. The distribution of YSOs in CMa OB1 is consistent with supernova-induced star formation, although the diverse N {sub II}/ N {sub I} ratios are unexpected if this parameter traces age and the YSOs are due to the same supernova. Less massive clouds feature larger N {sub II}/ N {sub I} ratios, suggesting that initial conditions play a role in determining this quantity.

79 ASTRONOMY AND ASTROPHYSICS↗

NGEE Arctic Plant Traits: Shrub Transects, Kougarok Road Mile Marker 64, Seward Peninsula, Alaska, 2016-2017

Transect data is from point center quarter (PCQ) surveys for shrub density performed in July 2016 at the Kougarok site and in July 2017 at the Kougarok, Teller, and Council sites. For each sample point along the transects, moving averages for shrub density and shrub basal area are provided along with GPS coordinates. Average shrub height and active layer depth are recorded for each sample point as well. Target shrub species differ across the transects: some surveys targeted a mixture of tall shrub species while others targeted specific species. In 2017 insect damage was also quantified. The dataset contains two *.csv data files and one *.pdf. Missing Values are represented by "NA". The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗

Studies of W W and W Z production at CDF

Diboson production in p{bar p} collisions at 1.96 TeV are studied in samples of {approx} 3-6 fb{sup -1} of data using leptons, jets and missing E{sub T}. Fully leptonic decays as well as semi-leptonic decays are measured since it is important to investigate various signatures as associated production of Higgs bosons is topologically similar. Measured production cross sections are in good agreement with Standard Model predictions and the limits on the anomalous triple gauge boson couplings are competitive with the ones measured by experiments at the LEP.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Predicting 3D Motions from Single-Camera Optical Test Data

In a typical optical test, a stereo camera pair is required to measure the three-dimensional motion of a test article; one camera typically only measures motions in the image plane of the camera, and measurements in the out-of-plane direction are missing. Finite element expansion techniques provide a path to estimate responses from a test at unmeasured degrees of freedom. Treating the case of a single camera as a measurement with unmeasured degrees of freedom, a finite element model is used to expand to the missing third dimension of the image data, allowing a full-field, three-dimensional measurement to be obtained from a set of images from a single camera. The key to this technique relies on the mapping of finite element deformations to image deformations, creating a set of mode shape images that are used to filter the response in the image into modal responses. These modal responses are then applied to the finite element model to estimate physical responses at all finite element model degrees of freedom. The mapping from finite element model to image is achieved using synthetic images produced by a rendering software. Finally, the technique is applied first to a synthetic deformation image, and then is validated using an experimental set of images.

47 OTHER INSTRUMENTATION↗

Extended calculations with spectroscopic accuracy: Energy levels and transition properties for the fluorine-like isoelectronic sequence with Z = 24–30

We have performed extensive multiconfiguration Dirac–Hartree–Fock calculations and second-order many-body perturbation calculations for F-like ions with Z = 24–30. Energy levels and transition rates for electric dipole (E1), electric-quadrupole (E2), electric-octupole (E3), magnetic dipole (M1), and magnetic-quadrupole (M2) transitions, as well as radiative lifetimes, are provided for the lowest 200 levels belonging to the 1s{sup 2}2s{sup 2}2p{sup 5}, 1s{sup 2}2s2p{sup 6}, 1s{sup 2}2s{sup 2}2p{sup 4}3l, 1s{sup 2}2s2p{sup 5}3l, 1s{sup 2}2p{sup 6}3l, and 1s{sup 2}2s{sup 2}2p{sup 4}4l configurations of each ion. The results from the two sets of calculations are in excellent agreement. Extensive comparisons are also made with other theoretical results and observed data from the CHIANTI and NIST databases. The present energies and wavelengths are believed to be accurate enough to aid line identifications involving the n = 3 and n = 4 configurations, for which observations are largely missing. The calculated wavelengths and transition data will be useful in the modeling and diagnostics of astrophysical and fusion plasmas.

74 ATOMIC AND MOLECULAR PHYSICS↗

Observed and Imputed Volumetric Soil Water Content Timeseries for the New Mexico Elevation Gradient

Reliable soil water content (SWC) data are essential for understanding dryland ecosystem dynamics, but high-frequency SWC sensors often fail, creating gaps in critical datasets. To address this, we developed a Bayesian mixture model that imputes missing SWC using both linear interpolation and an ecosystem water balance model (SOILWAT2), tested across six AmeriFlux eddy covariance tower sites in the New Mexico Elevation Gradient, demonstrating its effectiveness in reconstructing SWC patterns while providing insights into the factors driving SWC variability. Daily volumetric soil water content (SWC) data are provided as csv-formatted spreadsheets for the six AmeriFlux sites (US-Seg, US-Ses, US-Wjs, US-Mpi, US-Vcp, and US-Vcs). For each site there is an observed SWC file (site_SWC_gapfill.csv) and a file that contains imputed SWC (imputed_SWC_site.csv). The observed SWC files contain temperature corrected sensor values, tower precipitation data, as well as outputs from SOILWAT2 simulations that were used to impute SWC. The imputed files contain the original observed SWC values and the imputed missing SWC values. When SWC was missing from the original data, the missing value was imputed based on the Bayesian imputation mixture model. The posterior mean of all imputed values is reported as "mean_X". When the observed SWC was NOT missing, mean_X = observed SWC value (original data). The standard deviation, 2.5th percentile and the 97.5th percentile for the imputed values are also reported in the imputed files. There are readme text files for each file type explaining the contents of each column.

54 ENVIRONMENTAL SCIENCES↗

NEMESIS: Exoplanet Transit Survey of Nearby M-dwarfs in TESS FFIs. I

In this work, we present an analysis of 33,054 M-dwarf stars, located within 100 parsecs, via the Transiting Exoplanet Survey Satellite (TESS) full-frame images (FFIs) of observed sectors 1–5. We present a new pipeline called NEMESIS, developed to extract detrended photometry, and to perform transit searches of single-sector data in TESS FFIs. As many M-dwarfs are faint, and are not observed with a two-minute cadence by TESS, FFI transit surveys can provide an empirical validation of how many planets are missed, using the 30-minute cadence data. In this work, we detect 183 threshold crossing events, and present 29 candidate planets for sectors 1–5, 24 of which are new detections. Our sample contains orbital periods ranging from 1.25 to 6.84 days, and planetary radii from 1.26 to 5.31 R {sub ⊕}. With the addition of our new planet candidate detections, along with detections previously observed in sectors 1–5, we calculate an integrated occurrence rate of 2.49 ± 1.58 planets per star, for the period range ∈ [1, 9] days, and planet radius range ∈ [0.5,11] R {sub ⊕}. We project an estimated yield of 122 ± 11 transit detections of nearby M-dwarfs. Of our new candidates, 23 have signal-to-noise ratios >7, transmission spectroscopy metrics >38, and emission spectroscopy metrics >10. We present all of our data products for our planet candidates via the Filtergraph data visualization service, located at https://filtergraph.com/NEMESIS.

47 OTHER INSTRUMENTATION↗

Community Requirements Meta-Analysis: Characterizing Needs and Opportunities for HPDF

This High Performance Data Facility (HPDF) Project is creating a new scientific user facility to provide advanced infrastructure for data-intensive science, supporting the DOE’s Office of Science (SC) community. HPDF’s mission is to enable and accelerate scientific discovery by delivering state-of-the-art data management infrastructure, capabilities, and tools. This meta-analysis examines the needs of the breadth of the SC community, captured in publicly available community reports or mission documents. The meta-analysis identifies and provides initial characterization of fifteen core requirements for the HPDF Project team to consider during the conceptual design phase. The fifteen requirements illustrate how scientific work among SC communities requires modern, seamless user experiences across the ASCR Ecosystem to advance the use of large volumes of heterogeneous data. The scientific community requires support for the missing middle of compute between local and HPC to interactively and collaboratively use growing datasets. Data producers and end users will benefit from enhanced data catalogs and portals that improve data access through advanced search of well curated data. The fifteen requirements are examined here organized across five themes for discussion. Examples in each theme illustrate the array of scientific needs that convey the important role that the fully realized and operational High Performance Data Facility will be able to play as an integral part of the evolving ASCR Ecosystem. Our amalgamated data tables from ESnet reports demonstrate ranges to the volumes of data HPDF must be concerned with, but limitations are inherent to this meta-analysis (see Key Challenges & Limitations). Feedback and validation of these requirements along with additional details and emergent community requirements will be gathered through user research and design activities.

97 MATHEMATICS AND COMPUTING↗

Smisc - A collection of miscellaneous functions

A collection of functions for statistical computing and data manipulation. These include routines for rapidly aggregating heterogeneous matrices, manipulating file names, loading R objects, sourcing multiple R files, formatting datetimes, multi-core parallel computing, stream editing, specialized plotting, etc. Smisc-package A collection of miscellaneous functions allMissing Identifies missing rows or columns in a data frame or matrix as.numericSilent Silent wrapper for coercing a vector to numeric comboList Produces all possible combinations of a set of linear model predictors cumMax Computes the maximum of the vector up to the current index cumsumNA Computes the cummulative sum of a vector without propogating NAs d2binom Probability functions for the sum of two independent binomials dataIn A flexible way to import data into R. dbb The Beta-Binomial Distribution df2list Row-wise conversion of a data frame to a list dfplapply Parallelized single row processing of a data frame dframeEquiv Examines the equivalence of two dataframes or matrices dkbinom Probability functions for the sum of k independent binomials factor2character Converts all factor variables in a dataframe to character variables findDepMat Identify linearly dependent rows or columns in a matrix formatDT Converts date or datetime strings into alternate formats getExtension Filename manipulations: remove the extension or path, extract the extension or path getPath Filename manipulations: remove the extension or path, extract the extension or path grabLast Filename manipulations: remove the extension or path, extract the extension or path ifelse1 Non-vectorized version of ifelse integ Simple numerical integration routine interactionPlot Two-way Interaction Plot with Error Bar linearMap Linear mapping of a numerical vector or scalar list2df Convert a list to a data frame loadObject Loads and returns the object(s) in an ".Rdata" file more Display the contents of a file to the R terminal movAvg2 Calculate the moving average using a 2-sided window openDevice Opens a graphics device based on the filename extension p2binom Probability functions for the sum of two independent binomials padZero Pad a vector of numbers with zeros parseJob Parses a collection of elements into (almost) equal sized groups pbb The Beta-Binomial Distribution pcbinom A continuous version of the binomial cdf pkbinom Probability functions for the sum of k independent binomials plapply Simple parallelization of lapply plotFun Plot one or more functions on a single plot PowerData An example of power data pvar Prints the name and value of one or more objects qbb The Beta-Binomial Distribution rbb And numerous others (space limits reporting).

Landon Sego, PNNL↗