Search NASA⌕ Search

SEARCH · Search NASA

Results for “missing data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

WE-EF-207-09: Single-Scan Dual-Energy CT Using Primary Modulation

Purpose: Compared with conventional CT, dual energy CT (DECT) provides better material differentiation but requires projection data with two different effective x-ray spectra. Current DECT scanners use either a two-scan setting or costly imaging components, which are not feasible or available on open-gantry cone-beam CT systems. We propose a hardware-based method which utilizes primary modulation to enable single-scan DECT on a conventional CT scanner. The CT imaging geometry of primary modulation is identical to that used in our previous method for scatter removal, making it possible for future combination with effective scatter correction on the same CT scanner. Methods: We insert an attenuation sheet with a spatially-varying pattern - primary modulator-between the x-ray source and the imaged object. During the CT scan, the modulator selectively hardens the x-ray beam at specific detector locations. Thus, the proposed method simultaneously acquires high and low energy data. High and low energy CT images are then reconstructed from projections with missing data via an iterative CT reconstruction algorithm with gradient weighting. Proof-of-concept studies are performed using a copper modulator on a cone-beam CT system. Results: Our preliminary results on the Catphan(c) 600 phantom indicate that the proposed method for single-scan DECT is able to successfully generate high-quality high and low energy CT images and distinguish different materials through basis material decomposition. By applying correction algorithms and using all of the acquired projection data, we can reconstruct a single CT image of comparable image quality to conventional CT images, i.e., without primary modulation. Conclusion: This work shows great promise in using a primary modulator to perform high-quality single-scan DECT imaging. Future studies will test method performance on anthropomorphic phantoms and perform quantitative analyses on image qualities and DECT decomposition accuracy. We will use simulations to optimize the modulator material and geometry parameters.

60 APPLIED LIFE SCIENCES↗

Single-frame far-field diffractive imaging with randomized illumination

We introduce a single-frame diffractive imaging method called randomized probe imaging (RPI). In RPI, a sample is illuminated by a structured probe field containing speckles smaller than the sample’s typical feature size. Quantitative amplitude and phase images are then reconstructed from the resulting far-field diffraction pattern. The experimental geometry of RPI is straightforward to implement, requires no near-field optics, and is applicable to extended samples. When the resulting data are analyzed with a complimentary algorithm, reliable reconstructions which are robust to missing data are achieved. To realize these benefits, a resolution limit associated with the numerical aperture of the probe-forming optics is imposed. RPI therefore offers an attractive modality for quantitative X-ray phase imaging when temporal resolution and reliability are critical but spatial resolution in the tens of nanometers is sufficient. We discuss the method, introduce a reconstruction algorithm, and present two proof-of-concept experiments: one using visible light, and one using soft X-rays.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

Monitoring Earth's Ecosystems

Partnered with Goddard Space Flight Center, Sensit Technologies Inc. developed a third-generation Portable Apparatus for Rapid Acquisitions of Bidirectional Observations of Land and Atmosphere, or PARABOLA III for short. Now commercially available, PARABOLA III is designed to measure the reflected signature of a variety of Earth surface types, from rangeland vegetation to ice and snow. It can rapidly acquire data for almost the complete sky and ground-looking hemispheres, with no missing data and sufficient dynamic range to measure direct solar radiance. The instrument was actively used in the Boreal Ecosystem- Atmosphere Study which provided useful information in designing a Multi-angle Imaging SpectroRadiometer, a small satellite being built by the Jet Propulsion Laboratory that will measure sunlight reflected by the Earth into space.

Source record↗

Atmospheric Radiation Measurement Climate Research Facility Operations Quarterly Report April 1-June 30, 2017

Individual datastreams from instrumentation at the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) Climate Research Facility fixed and mobile research observatories (sites) are collected and routed to the ARM Data Center (ADC). The Data Management Facility (DMF), a component of the ADC, executes datastream processing in near-real time. Processed data are then delivered approximately daily to the ARM Data Archive, also a component of the ADC, where they are made freely available to the research community. For each instrument, ARM calculates the ratio of the actual number of processed data records received daily at the ARM Data Archive to the expected number of data records. DOE requires national user facilities to report time-based operating data. The requirements involve: Actual hours of operation (ACTUAL)—24 hours per day, 91 days or 2184 hours for this quarter Estimated maximum operation or uptime target (TARGET) Variance (VARIANCE), which is equal to (1–[ACTUAL/TARGET]) TARGET and VARIANCE numbers account for unplanned downtime. Differences in TARGET performance reflect the complexity of local logistics and the frequency of extreme weather events. It is impractical to measure TARGET for each instrument or datastream. Data availability reported here refers to the average of the individual, continuous datastreams received by the ARM Data Archive. Therefore, data availability is directly related to individual instrument uptime expressed in hours. Data not at the ARM Data Archive are caused by downtime (scheduled or unplanned) of the individual instruments. Missing data caused by scheduled downtime are not included in the metrics. Thus, the average percentage of data in the ARM Data Archive represents the average percentage of the time the instruments were operating for the quarter.

Aerosol↗

Atmospheric Radiation Measurement Climate Research Facility Operations Quarterly Report January 1-March 31, 2017

Individual datastreams from instrumentation at the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) Climate Research Facility fixed and mobile research observatories (sites) are collected and routed to the ARM Data Center (ADC). The Data Management Facility (DMF), a component of the ADC, executes datastream processing in near-real time. Processed data are then delivered approximately daily to the ARM Data Archive, also a component of the ADC, where they are made freely available to the research community. For each instrument, ARM calculates the ratio of the actual number of processed data records received daily at the ARM Data Archive to the expected number of data records. DOE requires national user facilities to report time-based operating data. The requirements involve: Actual hours of operation (ACTUAL)—24 hours per day, 90 days or 2160 hours for this quarter Estimated maximum operation or uptime target (TARGET) Variance (VARIANCE), which is equal to (1–[ACTUAL/TARGET]) TARGET and VARIANCE numbers account for unplanned downtime. Differences in TARGET performance reflect the complexity of local logistics and the frequency of extreme weather events. It is impractical to measure TARGET for each instrument or datastream. Data availability reported here refers to the average of the individual, continuous datastreams received by the ARM Data Archive. Therefore, data availability is directly related to individual instrument uptime expressed in hours. Data not at the ARM Data Archive are caused by downtime (scheduled or unplanned) of the individual instruments. Missing data caused by scheduled downtime are not included in the metrics. Thus, the average percentage of data in the ARM Data Archive represents the average percentage of the time the instruments were operating for the quarter.

Eastern North Atlantic, Southern Great Plains, Nor↗

Atmospheric Radiation Measurement Climate Research Facility Operations Quarterly Report July 1-September 30, 2016

Individual datastreams from instrumentation at the Atmospheric Radiation Measurement (ARM) Climate Research Facility fixed and mobile research sites are collected and routed to the Data Management Facility (DMF) for processing in near-real time. Instrument and processed data are then delivered approximately daily to the ARM Data Archive, where they are made freely available to the research community. For each instrument, ARM calculates the ratio of the actual number of processed data records received daily at the ARM Data Archive to the expected number of data records. The results are tabulated by 1) individual datastream, site, and month for the current year, and 2) site and fiscal year dating back to 1998. The U.S. Department of Energy requires national user facilities to report time-based operating data. The requirements involve the: Actual hours of operation (ACTUAL) – 24 hours per day, 92 days or 2208 hours for this quarter Estimated maximum operation or uptime target (TARGET) Variance (VARIANCE), which is equal to (1 – [ACTUAL/TARGET]) TARGET and VARIANCE numbers account for unplanned downtime. Differences in TARGET performance reflect the complexity of local logistics and the frequency of extreme weather events. It is impractical to measure TARGET for each instrument or datastream. Data availability reported here refers to the average of the individual, continuous datastreams received by the ARM Data Archive. Therefore, data availability is directly related to individual instrument uptime expressed in hours. Data not at the ARM Data Archive are caused by downtime (scheduled or unplanned) of the individual instruments. Missing data caused by scheduled downtime are not included in the metrics. Thus, the average percentage of data in the ARM Data Archive represents the average percentage of the time the instruments were operating for the quarter.

Southern Great Plains, North Slope of Alaska, East↗

Atmospheric Radiation Measurement Climate Research Facility Operations Quarterly Report April 1-June 30, 2016

Individual datastreams from instrumentation at the Atmospheric Radiation Measurement (ARM) Climate Research Facility fixed and mobile research sites are collected and routed to the Data Management Facility (DMF) for processing in near-real time. Instrument and processed data are then delivered approximately daily to the ARM Data Archive, where they are made freely available to the research community. For each instrument, ARM calculates the ratio of the actual number of processed data records received daily at the ARM Data Archive to the expected number of data records. The results are tabulated by 1) individual datastream, site, and month for the current year, and 2) site and fiscal year dating back to 1998. The U.S. Department of Energy requires national user facilities to report time-based operating data. The requirements involve the: Actual hours of operation (ACTUAL) – 24 hours per day, 91 days or 2184 hours for this quarter Estimated maximum operation or uptime target (TARGET) Variance (VARIANCE), which is equal to (1 – [ACTUAL/TARGET]) TARGET and VARIANCE numbers account for unplanned downtime. Differences in TARGET performance reflect the complexity of local logistics and the frequency of extreme weather events. It is impractical to measure TARGET for each instrument or datastream. Data availability reported here refers to the average of the individual, continuous datastreams received by the ARM Data Archive. Therefore, data availability is directly related to individual instrument uptime expressed in hours. Data not at the ARM Data Archive are caused by downtime (scheduled or unplanned) of the individual instruments. Missing data caused by scheduled downtime are not included in the metrics. Thus, the average percentage of data in the ARM Data Archive represents the average percentage of the time the instruments were operating for the quarter.

North Slope of Alaska, Eastern North Atlantic, Sou↗

Preliminary Long-term Safety Assessment for the Planned LLW Disposal Facility at Al-Tuwaitha, Iraq - 18142

Before 1991, Iraq had a significant nuclear program which encompassed ten nuclear sites spread out across the country. The largest nuclear site was located at the Al-Tuwaitha site near Baghdad where 18 nuclear facilities were concentrated. During the first Gulf War in 1991, all sites suffered significant damage from bombing and subsequent looting. Currently, the Ministry of Science and Technology is responsible for the ten heavily damaged nuclear sites and for the management of radioactive waste in Iraq in general. The task of decommissioning the damaged nuclear facilities and managing the resulting waste is being supported by the International Atomic Energy Agency (IAEA), the European Commission (EC), and the United States (US). In the framework of its Instrument for Nuclear Safety Cooperation (INSC), the EC has launched a cooperation project to support the planned construction of an engineered repository for short-lived low- and intermediate level waste for the safe disposal of radioactive waste resulting from the decommissioning activities, as well as for waste from the continuing use of radioisotopes in medicine and the oil and gas industry in the country. The main objectives of this project, which was awarded to a Consortium led by NUKEM Technologies Engineering Services GmbH and joined by DBE Technology GmbH of Germany and JAVYS a.s. of Slovakia, are the development of an initial conceptual level basic design and preliminary safety assessment report (PSAR) and the subsequent detailed engineering design and supporting pre-construction safety assessment report (PCSAR). The current paper focuses on the development of the PSAR. Special focus is given to the long-term calculations and difficulties associated with the limited data base in regard to site characterization as well as the expected inventory for the future repository. Because of the ongoing security concerns in Iraq, the Ministry of Science and Technology had already selected the Al-Tuwaitha Site as the best suited location for the planned surface repository at the start of the project. Although some site characterization work had already been carried out prior to the start of the project, certain data for modelling the geology and hydrology of the site are still lacking. Missing data have been compensated by conservative assumptions and the assessment of alternative scenarios. Consequently, for the development of the simplified GoldSim{sup R} computer model used to carry out the long-term calculations supporting the PSAR, existing site information was used and, as appropriate, amended or replaced by conservative assumptions. Due to the nature of the waste, data on the expected inventory are associated with large uncertainties. Although certain estimates related to the future volume of the waste exist, little to no information is available on the expected radionuclide vector and respective activities. Therefore, the long-term calculations were carried out for a generic inventory including a broad range of radionuclides that are to be expected as being important considering the kind of waste to be disposed of in the facility. Based on the results of these calculations, the maximum total capacity of the facility was estimated and converted into activity limits for individual radionuclides that will be integrated into the existing general WAC for the facility. Compliance with these WAC will then guarantee the safety of the repository in regard to potential radionuclide releases via the groundwater pathway. In parallel to the determination of activity limits for the WAC, long-term calculations were carried using different estimates for the expected total activity to determine the general suitability of the proposed technical solution of the repository for receiving the total amount of Iraqi radioactive waste principally acceptable for surface disposal. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

A Scalable Multi-Modal Framework for High-Fidelity Distributed Human Mobility Simulations

The development of data-driven models for human mobility in urban settings requires access to substantial and diverse real-world data. However, existing historical data often presents challenges such as limited volume, variety, and veracity, as well as missing data and privacy preservation concerns. Also, urban mobility modeling is inherently time-variant, complex, and multi-modal, encompassing everything from individual walking and running to private road travel and large-scale public transportation. These challenges call for innovative solutions to overcome data limitations and compute needs to model mobility behaviors accurately. To address these challenges, we propose a distributed, co-simulation-based architecture DURMOSim that integrates real-world data with scalable, high-fidelity simulations, demonstrating distributed co-simulation feasibility with existing mobility models. DURMOSim underpins a modular integration that would enable using any available mobility simulators for greater extensibility and scalability in performing various urban scenarios. In this paper, we present the design, implementation, and performance evaluation of DURMOSim, highlighting its capability to model population-scale mobility patterns. Our initial results show its ability to dynamically synchronize multiple simulation models at runtime with negligible computational overhead. We believe DURMOSim could be a robust tool for advancing urban mobility research and intelligent transportation systems.

Yoginath, Srikanth [ORNL] (ORCID:0000000184236050)↗

Nuclide Inventory Benchmark for BWR Spent Nuclear Fuel: Challenges in Evaluation of Modeling Data Assumptions and Uncertainties

This work discusses challenges and approaches to uncertainty analyses associated with the development of a nuclide inventory benchmark for fuel irradiated in a boiling water reactor. The benchmark under consideration is being developed based on experimental data from the SFCOMPO international database. The focus herein is on how to address missing data in fuel design and operating conditions that are important for adequately simulating the time-dependent changes in fuel during irradiation in the reactor. The effects of modeling assumptions and uncertainties in modeling parameters on the calculated nuclide inventory were analyzed and quantified through computational models developed using capabilities in the SCALE code system. Particular attention was given to the impact of the power history and water coolant density on the calculated nuclide inventory, as well as to the effect of geometry modeling considerations not usually addressed in a nuclide inventory benchmark. These considerations include gap closure, channel bow, and channel corner radius, which do not usually apply to regular reactor operation but are relevant for assessing impacts of potential anomalous operating scenarios.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

A Dynamic Landsat Derived Normalized Difference Vegetation Index (NDVI) Product for the Conterminous United States

Satellite derived vegetation indices (VIs) are broadly used in ecological research, ecosystem modeling, and land surface monitoring. The Normalized Difference Vegetation Index (NDVI), perhaps the most utilized VI, has countless applications across ecology, forestry, agriculture, wildlife, biodiversity, and other disciplines. Calculating satellite derived NDVI is not always straight-forward, however, as satellite remote sensing datasets are inherently noisy due to cloud and atmospheric contamination, data processing failures, and instrument malfunction. Readily available NDVI products that account for these complexities are generally at coarse resolution; high resolution NDVI datasets are not conveniently accessible and developing them often presents numerous technical and methodological challenges. Here, we address this deficiency by producing a Landsat derived, high resolution (30 m), long-term (30+ years) NDVI dataset for the conterminous United States. We use Google Earth Engine, a planetary-scale cloud-based geospatial analysis platform, for processing the Landsat data and distributing the final dataset. We use a climatology driven approach to fill missing data and validate the dataset with established remote sensing products at multiple scales. We provide access to the composites through a simple web application, allowing users to customize key parameters appropriate for their application, question, and region of interest.

42 ENGINEERING↗

Informal Statistics Help Desk

Back by popular demand, the JSC Biostatistics Laboratory and LSAH statisticians are offering an opportunity to discuss your statistical challenges and needs. Take the opportunity to meet the individuals offering expert statistical support to the JSC community. Join us for an informal conversation about any questions you may have encountered with issues of experimental design, analysis, or data visualization. Get answers to common questions about sample size, repeated measures, statistical assumptions, missing data, multiple testing, time-to-event data, and when to trust the results of your analyses.

Young, M.↗

LDRD final report : leveraging multi-way linkages on heterogeneous data.

This report is a summary of the accomplishments of the 'Leveraging Multi-way Linkages on Heterogeneous Data' which ran from FY08 through FY10. The goal was to investigate scalable and robust methods for multi-way data analysis. We developed a new optimization-based method called CPOPT for fitting a particular type of tensor factorization to data; CPOPT was compared against existing methods and found to be more accurate than any faster method and faster than any equally accurate method. We extended this method to computing tensor factorizations for problems with incomplete data; our results show that you can recover scientifically meaningfully factorizations with large amounts of missing data (50% or more). The project has involved 5 members of the technical staff, 2 postdocs, and 1 summer intern. It has resulted in a total of 13 publications, 2 software releases, and over 30 presentations. Several follow-on projects have already begun, with more potential projects in development.

97 MATHEMATICS AND COMPUTING↗

Snow Depth and Density at End-of-Winter for NGEE Areas A, B, C and D, Utqiagvik (Barrow), Alaska, 2012-2014

End-of-winter snow depth and average snow density from area A, B, C and D, which include 1000's of point depth measurement located between ~20 and ~50 cm apart. The data was originally provided in excel workbooks, these files have been preserved within the zip Original_Files. The files were transformed for archiving with images pulled out into jpegs and data preserved as csv files. Some functions, features, and formatting was lost during the transformation. Missing data was defined with blank cells. Additional documentation can be found in files labelled with readme.csv and information.csv file endings.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research.The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗

A Probabilistic Approach of Incorporating Safety and Reliability in System Designs for a Manned Mission to Mars

Conceptual stages in mission design often lack the input of quantitative safety and reliability assessments, simply because failure rates or other data are not yet available for systems that have not yet been designed. Absence of such data should not, however, prevent the development of a quantitative risk models with placeholders for missing data. Functions (that is, actions the systems must perform) in mission design will eventually require system probabilities of success, and there could be much learned from surrogate data, adequately bounded in uncertainty, used in a large event tree model of a complex mission.

Railsback, Jan W.↗

Automated Discovery and Modeling of Sequential Patterns Preceding Events of Interest

The integration of emerging data manipulation technologies has enabled a paradigm shift in practitioners' abilities to understand and anticipate events of interest in complex systems. Example events of interest include outbreaks of socio-political violence in nation-states. Rather than relying on human-centric modeling efforts that are limited by the availability of SMEs, automated data processing technologies has enabled the development of innovative automated complex system modeling and predictive analysis technologies. We introduce one such emerging modeling technology - the sequential pattern methodology. We have applied the sequential pattern methodology to automatically identify patterns of observed behavior that precede outbreaks of socio-political violence such as riots, rebellions and coups in nation-states. The sequential pattern methodology is a groundbreaking approach to automated complex system model discovery because it generates easily interpretable patterns based on direct observations of sampled factor data for a deeper understanding of societal behaviors that is tolerant of observation noise and missing data. The discovered patterns are simple to interpret and mimic human's identifications of observed trends in temporal data. Discovered patterns also provide an automated forecasting ability: we discuss an example of using discovered patterns coupled with a rich data environment to forecast various types of socio-political violence in nation-states.

Rohloff, Kurt↗

Scalable Hyper-parameter Estimation for Gaussian Process Based Time Series Analysis

Gaussian process (GP) is increasingly becoming popular as a kernel machine learning tool for non-parametric data analysis. Recently, GP has been applied to model non-linear dependencies in time series data. GP based analysis can be used to solve problems of time series prediction, forecasting, missing data imputation, change point detection, anomaly detection, etc. But the use of GP to handle massive scientific time series data sets has been limited, owing to its expensive computational complexity. The primary bottleneck is the handling of the covariance matrix whose size is quadratic in the length of the time series. In this paper we propose a scalable method that exploit the special structure of the covariance matrix for hyper-parameter estimation in GP based learning. The proposed method allows estimation of hyper parameters associated with GP in quadratic time, which is an order of magnitude improvement over standard methods with cubic complexity. Moreover, the proposed method does not require explicit computation of the covariance matrix and hence has memory requirement linear to the length of the time series as opposed to the quadratic memory requirement of standard methods. To further improve the computational complexity of the proposed method, we provide a parallel version to concurrently estimate the log likelihood for a set of time series which is the key step in the hyper-parameter estimation. Performance results on a multi-core system show that our proposed method provides significant speedups as high as 1000, even when running in serial mode, while maintaining a small memory footprint. The parallel version exploits the natural parallelization potential of the serial algorithm and is shown to perform significantly better than the serial faster algorithm, with speedups as high as 10.

Chandola, Varun↗

Data mining the missing ordered phases of Li/Na metal oxides

Data-driven discovery of Li-ion and Na-ion battery materials has been pioneered by generic materials data platforms such as the Materials Project. After decades of progress, it is timely to ask whether there remain underexplored compositional spaces. Here, in this work, we present a systematic data-mining effort to uncover missing ordered binary, ternary and quaternary Li/Na-containing metal oxides using high-throughput density functional theory (DFT). Building on 19,120 stable and metastable oxides entries from the Materials Project, we performed 13,245 additional calculations through isovalent substitutions of known ground states, experimentally reported compounds, and specific prototype structures. Our study identifies 36 new ground states within the GGA/GGA + U convex hull and 45 within the r 2 SCAN convex hull. Additionally, we identified 840 metastable compounds from GGA/GGA + U and 979 from r 2 SCAN that are absent in the present Materials Project databases. Moreover, we have tripled the metastable materials in compositional spaces with a molar ratio of cation/anion >1, highlighting the overlooked opportunities in this compositional space.

25 ENERGY STORAGE↗