Search NASA⌕ Search

SEARCH · Search NASA

Results for “missing data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

A Visual Analytics Framework for Reviewing Streaming Performance Data

Understanding and tuning the performance of extreme-scale parallel computing systems demands a streaming approach due to the computational cost of applying offline algorithms to vast amounts of performance log data. Analyzing large streaming data is challenging because the rate of receiving data and limited time to comprehend data make it difficult for the analysts to sufficiently examine the data without missing important changes or patterns. To support streaming data analysis, we introduce a visual analytic framework comprising of three modules: data management, analysis, and interactive visualization. The data management module collects various computing and communication performance metrics from the monitored system using streaming data processing techniques and feeds the data to the other two modules. The analysis module automatically identifies important changes and patterns at the required latency. In particular, we introduce a set of online and progressive analysis methods for not only controlling the computational costs but also helping analysts better follow the critical aspects of the analysis results. Finally, the interactive visualization module provides the analysts with a coherent view of the changes and patterns in the continuously captured performance data. Through a multi-faceted case study on performance analysis of parallel discrete-event simulation, we demonstrate the effectiveness of our framework for identifying bottlenecks and locating outliers.

Human-centered computing↗

Performance of the CMS missing transverse momentum reconstruction in pp data at $\sqrt{s}$ = 8 TeV

The performance of missing transverse energy reconstruction algorithms is presented by our team using√s=8 TeV proton-proton (pp) data collected with the CMS detector. Events with anomalous missing transverse energy are studied, and the performance of algorithms used to identify and remove these events is presented. The scale and resolution for missing transverse energy, including the effects of multiple pp interactions (pileup), are measured using events with an identified Z boson or isolated photon, and are found to be well described by the simulation. Novel missing transverse energy reconstruction algorithms developed specifically to mitigate the effects of large numbers of pileup interactions on the missing transverse energy resolution are presented. These algorithms significantly reduce the dependence of the missing transverse energy resolution on pileup interactions. Furthermore, an algorithm that provides an estimate of the significance of the missing transverse energy is presented, which is used to estimate the compatibility of the reconstructed missing transverse energy with a zero nominal value.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Probing Few-Body Nuclear Dynamics via H 3 and He 3 ( e , e ' p ) pn Cross-Section Measurements

Here, we report the first measurement of the (e, e' p) three-body breakup reaction cross sections in helium-3 ( 3 He) and tritium ( 3 H) at large momentum transfer ($\langle{Q^2}\rangle$ ≈ 1.9 (GeV/c) 2 ) and x B > 1 kinematics, where the cross section should be sensitive to quasielastic (QE) scattering from single nucleons. The data cover missing momenta 40 ≤ p miss ≤ 500 MeV/c that, in the QE limit with no rescattering, equals the initial momentum of the probed nucleon. The measured cross sections are compared with state-of-the-art ab-initio calculations. Overall good agreement, within ±20%, is observed between data and calculations for the full p miss range for 3 H and for 100 ≤ p miss ≤ 350 MeV/c for 3 He. Including the effects of rescattering of the outgoing nucleon improves agreement with the data at p miss > 250 MeV/c and suggests contributions from charge-exchange (SCX) rescattering. The isoscalar sum of 3 He plus 3 H, which is largely insensitive to SCX, is described by calculations to within the accuracy of the data over the entire pmiss range. This validates current models of the ground state of the three-nucleon system up to very high initial nucleon momenta of 500 MeV/c.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Quality control of solar radiation data within the RMIB solar measurements network

Assessment of the solar resource is based upon measured data, where available. However, with any measurement there exist errors. Consequently, solar radiation data do not exhibit necessarily the same reliability and it often happens that users face time series of measurements containing questionable values though preliminary technical control has been done before the data release. To overcome such a situation, a major effort has been undertaken at the Royal Meteorological Institute of Belgium (RMIB) to develop procedures and software for performing post-measurement quality control of solar data from the radiometric stations of our in situ solar monitoring network. Moreover, because solar energy applications usually need continuous time series of solar radiation data, additional procedures have also been established to fill missing values (data initially lacking or removed via quality checks). (author)

14 SOLAR ENERGY↗

AGC-4 Experiment Irradiation Monitoring Data Qualification Interim Report

The Graphite Technology Development Program is running a series of six experiments to quantify the effects of irradiation on nuclear grade graphite. The fourth experiment, Advanced Graphite Creep 4 (AGC 4), began with Advanced Test Reactor (ATR) cycle 157D on May 30, 2015, and has been irradiated for two cycles. The capsule was removed from the reactor after ATR cycle 158A, which ended on January 2, 2016, due to interference with another experiment. Irradiation will resume when the interfering experiment is removed from the reactor. This report documents qualification of AGC 4 experiment irradiation monitoring data for use by the Advanced Reactor Technologies (ART) Technology Development Office (TDO) Program for research and development activities required to design and license the first HTR nuclear plant. Qualified data meet the requirements for use as described in the experiment planning and quality assurance documents. Failed data do not meet the requirements and provide no useable information. Trend data may not meet all requirements, but still provide some useable information. Use of Trend data requires assessment of how any deficiencies affect a particular use of the data. All thermocouples (TCs) have functioned throughout the AGC-4 experiment. All temperature data are Qualified for use by the ART TDO Program. Argon, helium, and total gas flow data were within expected ranges and are Qualified for use by the ART TDO Program. Discharge gas line moisture values were consistently low during cycle 157D. At the start of cycle 158A, gas moisture briefly spiked to over 600 ppmv and then declined throughout the cycle. Moisture values are within the measurement range of the instrument and are Qualified for use by the ART TDO Program. Graphite creep specimens were subjected to one of three loads, 393, 491, or 589 lbf. For a brief period during cycle 157D between 12:19 on June 2, 2015 and 08:23 on June 11, 2015 the load cells were wired incorrectly resulting in missing stack load data. Missing stack loads were estimated from measured ram pressures using regression equations developed from the existing data from cycle 157D. Estimated stack loads during this period are considered to be an accurate representation of actual load applied to the stacks. These loads deviate slightly from the planned loads. This deviation does not prevent the data from being Qualified for use, but must be taken into account when analyzing the effect of load on creep. Stack displacement increased consistently throughout the first two cycles with total displacement ranging from 0.4 to 0.8 in. During ATR outages, a set of pneumatic rams raised the stacks of graphite creep specimens to ensure the specimens were not stuck within the test train. This stack raising was performed twice. All stacks were raised successfully each time. The load and displacement data are Qualified for use by the ART TDO Program.

36 MATERIALS SCIENCE↗

Estimation of missing values in solar radiation data using piecewise interpolation methods: Case study at Penang city

The solar radiation values have been composed by automatic weather station using the device that namely pyranometer. The device is functions to records all the radiation values that have been dispersed, and these data are very useful for it experimental works and solar device’s development. In addition, for modeling and designing on solar radiation system application is needed for complete data observation. Unfortunately, lack for obtained the complete solar radiation data frequently occur due to several technical problems, which mainly contributed by monitoring device. Into encountering this matter, estimation missing values in an effort to substitute absent values with imputed data. This paper aimed to evaluate several piecewise interpolation techniques likes linear, splines, cubic, and nearest neighbor into dealing missing values in hourly solar radiation data. Then, proposed an extendable work into investigating the potential used of cubic Bezier technique and cubic Said-ball method as estimator tools. As result, methods for cubic Bezier and Said-ball perform the best compare to another piecewise imputation technique.

14 SOLAR ENERGY↗

Denoising Autoencoder for Reconstructing Sensor Observation Data and Predicting Evapotranspiration: Noisy and Missing Values Repair and Uncertainty Quantification

Abstract Machine learning (ML) methods applied in scientific research often deal with interrelated features in high‐dimensional data. Reducing data noise and redundancy is needed to increase prediction accuracy and efficiency especially when dealing with data from field sensors. We explored an unsupervised learning method, the denoising autoencoder (DAE), to extract the underlying data structure from noisy raw data in the context of predicting hydrologic quantities from multiple field sensors. These sensors have intrinsic instrumental noise and occasional malfunctions that cause missing values. Our DAE neural network reconstructed meteorological sensor data containing noise and missing values to predict evapotranspiration in a mountainous watershed. The DAE reconstructed the sensor variables with a mean coefficient of determination value of 0.77 across 15 dimensions representing individual sensors. It reduced variance and bias uncertainties compared to a classical autoencoder model. The reconstruction quality varied across dimensions depending on their cross‐correlation and alignment with the underlying data structure. Uncertainties arising from the model structure were overall higher than those resulting from data corruption. We attached the DAE structure to a downstream ET‐prediction neural network in three formats and achieved reasonably accurate ET predictions . The use of the DAE notably reduced variance uncertainty in ET prediction. However, excessive variance reduction may be accompanied by an increase in bias due to the intrinsic bias‐variance tradeoff. Our method of evaluating and reducing uncertainties in aggregated data from different sources can be used to improve predictive models, process understanding, and uncertainty quantification for better water resource management. Plain Language Summary We present a machine learning method, namely the denoising autoencoder, which reduces the effects of data noise and missing values typically present in scientific data sets collected through sensor measurements. This method selects the most relevant information from noisy raw data collected by the instruments and fills in missing values. To demonstrate the effectiveness of our method, we applied it to predict evapotranspiration, a hydrologic variable that represents the water moved from the land surface to the atmosphere through a combination of evaporation and plant water use (transpiration). We also used a random sampling technique (the Monte Carlo method) to compare the uncertainty in the predictions when using the raw and noisy data versus the reconstructed data. The denoising process produced more accurate predictions of evapotranspiration with less uncertainty. Improved predictions of evapotranspiration can lead to a better understanding and accounting of water budgets. This ML approach is broadly suitable for a wide variety of applications that involve noisy sensor data with missing values. Key Points We used a denoising autoencoder (DAE) neural network to reduce noise in meteorological and soil sensor observations by on average We used Monte Carlo sampling to estimate the bias and variance of all model outputs, including uncertainty sources from data and the model We attached the DAE component to a downstream neural network to predict ET with the variance reduced by , compared to that without the DAE

denoising autoencoder↗

Using gap-filled MAIAC AOD and WRF-Chem to estimate daily PM 2.5 concentrations at 1 km resolution in the Eastern United States

To link short-term exposures of air pollutants to health outcomes, scientists must use high temporal and spatial resolution estimates of PM 2.5 concentrations. We develop a daily PM 2.5 product at 1 × 1 km 2 spatial resolution across the eastern United States (east of 90° W) with the aid of 1 × 1 km 2 MAIAC aerosol optical depth (AOD) data, 36 × 36 km 2 WRF-Chem output, 1 × 1 km 2 land-use type from the National Land Cover Database, and 0.125° × 0.125° ERA-Interim re-analysis meteorology. A gap-filling technique is applied to MAIAC AOD data to construct robust daily estimates of AOD when the satellite data are missing (e.g., areas obstructed by clouds or snow cover). The input data are incorporated into a multiple-linear regression model trained to surface observations of PM 2.5 from the EPA Air Quality System (AQS) monitoring network. The model generates a high-fidelity estimate (r 2 = 0.75 using a 10-fold random cross-validation) of daily PM 2.5 throughout the eastern United States. Of the inputs to the statistical model, WRF-Chem output (r 2 = 0.66) is the most important contributor to the skill of the model. MAIAC AOD is also a strong contributor (r 2 = 0.52). Daily PM 2.5 output from our statistical model can be easily integrated into county-level epidemiological studies. The novelty of this project is that we are able to simulate PM 2.5 in a computationally efficient manner that is constrained to ground monitors, satellite data, and chemical transport model output at high spatial resolution (1 × 1 km 2 ) without sacrificing the temporal resolution (daily) or spatial coverage (>2,000,000 km 2 ).

47 OTHER INSTRUMENTATION↗

Leveraging Application Data Constraints to Optimize Database-Backed Web Applications

Exploiting the relationships among data is a classical query optimization technique. As persistent data is increasingly being created and maintained programmatically, prior work that infers data relationships from data statistics misses an important opportunity. We present Coco, the first tool that identifies data relationships by analyzing database-backed applications. Once identified, Coco leverages the constraints to optimize the application's physical design and query execution. Instead of developing a fixed set of predefined rewriting rules, Coco employs an enumerate-test-verify technique to automatically exploit the discovered data constraints to improve query execution. Each resulting rewrite is provably equivalent to the original query. Using 14 real-world web applications, our experiments show that Coco can discover numerous data constraints from code analysis and improve real-world application performance significantly.

Computer Science↗

MPS dose reconstruction for internal emitters: some site-specific issues and approaches

Background: As part of the Million Person Study (MPS), dose reconstructions for internal emitters have been performed for several U.S. facilities where large quantities of radionuclides were handled. The main challenges and dominant sources of potential error in retrospective dose estimates for internally exposed workers have been found to vary from site to site. Here in this paper, we discuss some important issues encountered in dose reconstructions performed for selected MPS sites and the approaches used to address those issues. The focus is on some foundational components of retrospective dose assessments that have received little attention in the literature. Methods: The discussion is built around illustrative exposure data and dose reconstructions for workers at selected facilities addressed in the MPS. Related findings at some non-MPS sites are also discussed. Results: Each of the following items has been found to be a major source of potential error in reconstructed tissue doses for some MPS sites: identification of all dosimetrically important internal emitters; the time pattern of intake; the mode(s) of intake; reliability of bioassay measurements; application of surrogate (coworker) information in lieu of, or in conjunction with, worker-specific monitoring data; the chemical and physical forms of inhaled radionuclide; and the relation of air monitoring data to actual intake. Conclusions: (1) Much of the dose reconstruction effort for internal emitters should be devoted to development of best feasible exposure scenarios. (2) Coworker data should be used to assign exposure scenarios or dose estimates to workers with missing exposure data only if there is compelling evidence of similar coworker exposure. (3) Bioassay data for some radionuclides and periods of operation at MPS sites are of questionable reliability due to sizable uncertainties associated with contamination, recovery, or background issues. (4) Dose estimates derived solely from air monitoring data should be treated as highly uncertain values in the absence of site-specific information demonstrating that the data are reasonably predictive of intake. (5) For intakes known or assumed to be via inhalation, the uncertainty in lung dose typically is much greater than the uncertainty in dose to systemic tissues, when dose estimates are based on urinary excretion data. (6) The lung dose estimate often can be improved through development of site-specific respiratory absorption parameter values. (7) There is generally insufficient site-specific information to justify development of site-specific systemic models.

61 RADIATION PROTECTION AND DOSIMETRY↗

An Approach for Setting Priorities for Experimental Studies in Support of Safety Assessments - 19393

Many experiments have been conducted, in both academia and industry, to support the understanding of the disposal of radioactive waste. For the disposal of low-level radioactive waste (LLW) into radioactive waste repositories, it is important to develop an approach to tackle which datasets are able to directly underpin safety assessments, and what future research experiments could address the gaps in this understanding. In this paper, we present an approach to identify which future experiments should be considered to underpin safety assessments for disposals of LLW in a near-surface repository. The approach involves 6-steps: define the disposal problem (e.g. the disposal of LLW in engineered vaults); determine what key processes may affect the disposal of the waste; establish the assumptions underpinning the key processes; determine how sensitive the key process parameters are to variation; determine whether key data are available and assess the quality of that data with respect to the disposal problem; and determine attributes for experiments needed to supply missing key data. We show, in this paper, how this approach can be used to develop a better understanding of C-14 gas generation, under varying degrees of groundwater saturation, for the disposal of LLW into engineered vaults, in the near-surface. Furthermore, we have developed an approach that identifies the types of experiments and their attributes to aid researchers to help select appropriate types of experiments to underpin safety assessments. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Efficient species identification for Pacific salmon genetic monitoring programs

Abstract Genetic monitoring of Pacific salmon in the Columbia River basin provides crucial information to fisheries managers that is otherwise challenging to obtain using traditional methods. Monitoring programs such as genetic stock identification (GSI) and parentage‐based tagging (PBT) involve genotyping tens of thousands of individuals annually. Although rare, these large sample collections inevitably include misidentified species, which exhibit low genotyping success on species‐specific Genotyping‐in‐Thousands by sequencing (GT‐seq) panels. For laboratories involved in large‐scale genotyping efforts, diagnosing non‐target species and reassigning them to the appropriate monitoring program can be costly and time‐consuming. To address this problem, we identified 19 primer pairs that exhibit consistent cross‐species amplification among salmonids and contain 51 species informative variants. These genetic markers reliably discriminate among 11 salmonid species and two subspecies of Cutthroat Trout and have been included in species‐specific GT‐seq panels for Chinook Salmon, Coho Salmon, Sockeye Salmon, and Rainbow Trout commonly used for Pacific salmon genetic monitoring. The majority of species‐informative amplicons (16) were newly identified from the four existing GT‐seq panels, thus demonstrating a low‐cost approach to species identification when using targeted sequencing methods. A species‐calling script was developed that is tailored for routine GT‐seq genotyping pipelines and automates the identification of non‐target species. Following extensive testing with empirical and simulated data, we demonstrated that the genetic markers and accompanying script accurately identified species and are robust to missing genotypic data and low‐frequency, shared polymorphisms among species. Finally, we used these tools to identify Coho Salmon incidentally caught in the Columbia River Chinook Salmon sport fishery and used PBT to determine their hatchery of origin. These molecular and computing resources provide a valuable tool for Pacific salmon conservation in the Columbia River basin and demonstrate a cost‐effective approach to species identification for genetic monitoring programs.

Robinson, Zachary L.↗

Physical-chemical evaluation of hydraulic fracturing chemicals in the context of produced water treatment

Produced water is a significant waste stream that can be treated and reused; however, the removal of production chemicals—such as those added in hydraulic fracturing—must be addressed. One motivation for treating and reusing produced water is that current disposal methods—typically consisting of deep well injection and percolation in infiltration pits—are being limited. Furthermore, oil and gas production often occurs in arid regions where there is demand for new water sources. Here in this paper, hydraulic fracturing chemical additive data from California are used as a case study where physical-chemical and biodegradation data are summarized and used to screen for appropriate produced water treatment technologies. The data indicate that hydraulic fracturing chemicals are largely treatable; however, data are missing for 24 of the 193 chemical additives identified. More than one-third of organic chemicals have data indicating biodegradability, suggesting biological treatment would be effective. Adsorption-based methods and partitioning of chemicals into oil for subsequent separation is expected to be effective for approximately one-third of chemicals. Volatilization-based treatment methods (e.g. air stripping) will only be effective for approximately 10% of chemicals. Reverse osmosis is a good catch-all with over 70% of organic chemicals expected to be removed efficiently. Other technologies such as electrocoagulation and advanced oxidation are promising but lack demonstration. Chemicals of most concern due to prevalence, toxicity, and lack of data include propargyl alcohol, 2-mercaptoethyl alcohol, tetrakis hydroxymethyl-phosphonium sulfate, thioglycolic acid, 2-bromo-3-nitrilopropionamide, formaldehyde polymers, polymers of acrylic acid, quaternary ammonium compounds, and surfactants (e.g. ethoxylated alcohols). Future studies should examine the fate of hydraulic fracturing chemicals in produced water treatment trains to demonstrate removal and clarify interactions between upstream and downstream processes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

WE-EF-207-08: Improve Cone Beam CT Using a Synchronized Moving Grid, An Inter-Projection Sensor Fusion and a Probability Total Variation Reconstruction

Purpose: To present a cone beam computed tomography (CBCT) system, which uses a synchronized moving grid (SMOG) to reduce and correct scatter, an inter-projection sensor fusion (IPSF) algorithm to estimate the missing information blocked by the grid, and a probability total variation (pTV) algorithm to reconstruct the CBCT image. Methods: A prototype SMOG-equipped CBCT system was developed, and was used to acquire gridded projections with complimentary grid patterns in two neighboring projections. Scatter was reduced by the grid, and the remaining scatter was corrected by measuring it under the grid. An IPSF algorithm was used to estimate the missing information in a projection from data in its 2 neighboring projections. Feldkamp-Davis-Kress (FDK) algorithm was used to reconstruct the initial CBCT image using projections after IPSF processing for pTV. A probability map was generated depending on the confidence of estimation in IPSF for the regions of missing data and penumbra. pTV was finally used to reconstruct the CBCT image for a Catphan, and was compared to conventional CBCT image without using SMOG, images without using IPSF (SMOG + FDK and SMOG + mask-TV), and image without using pTV (SMOG + IPSF + FDK). Results: The conventional CBCT without using SMOG shows apparent scatter-induced cup artifacts. The approaches with SMOG but without IPSF show severe (SMOG + FDK) or additional (SMOG + TV) artifacts, possibly due to using projections of missing data. The 2 approaches with SMOG + IPSF removes the cup artifacts, and the pTV approach is superior than the FDK by substantially reducing the noise. Using the SMOG also reduces half of the imaging dose. Conclusion: The proposed technique is promising in improving CBCT image quality while reducing imaging dose.

60 APPLIED LIFE SCIENCES↗