Search NASA⌕ Search

SEARCH · Search NASA

Results for “data aggregation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Spatial Data Management System (SDMS)

The Spatial Data Management System (SDMS) is a testbed for retrieval and display of spatially related material. SDMS permits the linkage of large graphical display objects with detail displays and explanations of its smaller components. SDMS combines UNIX workstations, MIT's X Window system, TCP/IP and WAIS information retrieval technology to prototype a means of associating aggregate data linked via spatial orientation. SDMS capitalizes upon and extends previous accomplishments of the Software Technology Branch in the area of Virtual Reality and Automated Library Systems.

Hutchison, Mark W.↗

DOE 2012 Occupational Radiation Exposure October 2013

The U.S. Department of Energy (DOE) Office of Analysis within the Office of Health, Safety and Security (HSS) publishes the annual DOE Occupational Radiation Exposure Report to provide an overview of the status of radiation protection practices at DOE (including the National Nuclear Security Administration [NNSA]). The DOE 2012 Occupational Radiation Exposure Report provides an evaluation of DOE-wide performance regarding compliance with Title 10, Code of Federal Regulations (C.F.R.), Part 835, Occupational Radiation Protection dose limits and as low as reasonably achievable (ALARA) process requirements. In addition, the report provides data to DOE organizations responsible for developing policies for protection of individuals from the adverse health effects of radiation. The report provides a summary and an analysis of occupational radiation exposure information from the monitoring of individuals involved in DOE activities. Over the past 5-year period, the occupational radiation exposure information is analyzed in terms of aggregate data, dose to individuals, and dose by site. As an indicator of the overall amount of radiation dose received during the conduct of operations at DOE, the report includes information on collective total effective dose (TED). The TED is comprised of the effective dose (ED) from external sources, which includes neutron and photon radiation, and the internal committed effective dose (CED), which results from the intake of radioactive material into the body. The collective ED from photon exposure decreased by 23% between 2011 and 2012, while the neutron dose increased by 5%. The internal dose components of the collective TED decreased by 7%. Over the past 5-year period, 99.99% of the individuals receiving measurable TED have received doses below the 2 roentgen equivalent in man (rems) (20 millisievert [mSv]) TED administrative control level (ACL), which is well below the DOE regulatory limit of 5 rems (50 mSv) TED annually. The occupational radiation exposure records show that in 2012, DOE facilities continued to comply with DOE dose limits and ACLs and worked to minimize exposure to individuals. The DOE collective TED decreased 17.1% from 2011 to 2012. The collective TED decreased at three of the five sites with the largest collective TED. u Idaho Site – Collective dose reductions were achieved as a result of continuing improvements at the Advanced Mixed Waste Treatment Project (AMWTP) through the planning of drum movements that reduced the number of times a container is handled; placement of waste containers that created highradiation areas in a centralized location; and increased worker awareness of high-dose rate areas. In addition, Idaho had the largest decrease in the total number of workers with measurable TED (1,143 fewer workers). u Hanford Site (Hanford) – An overall reduction of decontamination and decommissioning (D&D) activities at the Plutonium Finishing Plant (PFP) and Transuranic (TRU) retrieval activities resulted in collective dose reductions. u Savannah River Site (SRS) – Reductions were achieved through ALARA initiatives employed site wide. The Solid Waste Management Facility used extended specialty tools, cameras and lead shield walls to facilitate removal of drums. These tools and techniques reduce exposure time through improved efficiency, increase distance from the source of radiation by remote monitoring, shield the workers to lower the dose rate, and reduce the potential for contamination and release of material through repacking of waste. Overall, from 2011 to 2012, there was a 19% decrease in the number of workers with measurable dose. Furthermore, due to a slight decrease in both the DOE workforce (7%) and monitored workers (10%), the ratio of workers with measurable doses to monitored workers decreased to 13%. Another primary indicator of the level of radiation exposure covered in this report is the average measurable dose, which normalizes the collective dose over the population of workers who actually received a measurable dose. The average measurable TED increased by 3% from 2011 to 2012. Additional analyses show that the dose distribution in 2012 was similar to the distribution in 2011. In 2012, 13% of the monitored workers received a measurable TED and the average measurable TED, 0.069 rem, was less than 2% of the DOE limit. From 2011 to 2012, the collective TED and the number of individuals with measurable TED decreased 17.1% and 19%, respectively. These decreases were mainly due to an overall reduction of D&D activities at the PFP and TRU retrieval activities at Hanford; a 78% decrease in the number of targeted waste drums that were processed at the Idaho Site’s Accelerated Retrieval Project (ARP) from 5,566 drums in 2011 to a total of 1,211 drums processed in 2012; and ALARA initiatives employed site wide at SRS. In addition, the decreases were the result of decreased American Recovery and Reinvestment Act (ARRA) activities and continuing D&D, particularly at the DOE sites that comprise the majority of DOE collective dose. Over the past 5 years, the size of the monitored workforce has remained at a fairly stable level (within 12%), while the collective dose has varied up to 37%. No reported doses exceeded the DOE occupational limit of 5 rems TED in 2012 and no reported doses exceeded the DOE ACL of 2 rems TED.

61 RADIATION PROTECTION AND DOSIMETRY↗

DOE 2012 occupational radiation exposure

The U.S. Department of Energy (DOE) Office of Analysis within the Office of Health, Safety and Security (HSS) publishes the annual DOE Occupational Radiation Exposure Report to provide an overview of the status of radiation protection practices at DOE (including the National Nuclear Security Administration [NNSA]). The DOE 2012 Occupational Radiation Exposure Report provides an evaluation of DOE-wide performance regarding compliance with Title 10, Code of Federal Regulations (C.F.R.), Part 835, Occupational Radiation Protection dose limits and as low as reasonably achievable (ALARA) process requirements. In addition, the report provides data to DOE organizations responsible for developing policies for protection of individuals from the adverse health effects of radiation. The report provides a summary and an analysis of occupational radiation exposure information from the monitoring of individuals involved in DOE activities. Over the past 5-year period, the occupational radiation exposure information is analyzed in terms of aggregate data, dose to individuals, and dose by site.

Source record↗

Development of a Visual Inspection Checklist for Evaluation of Fielded PV Module Condition (Presentation)

A visual inspection checklist for the evaluation of fielded photovoltaic (PV) modules has been developed to facilitate collection of data describing the field performance of PV modules. The proposed inspection checklist consists of 14 sections, each documenting the appearance or properties of a part of the module. This tool has been evaluated through the inspection of over 60 PV modules producedby more than 20 manufacturers and fielded at two different sites for varying periods of time. Aggregated data from a single data collection tool such as this checklist has the potential to enable longitudinal studies of module condition over time, technology evolution, and field location for the enhancement of module reliability models.

14 SOLAR ENERGY↗

DOE 2013 occupational radiation exposure

The Office of Analysis within the U.S. Department of Energy (DOE) Office of Environment, Health, Safety and Security (EHSS) publishes the annual DOE Occupational Radiation Exposure Report to provide an overview of the status of radiation protection practices at DOE (including the National Nuclear Security Administration [NNSA]). The DOE 2013 Occupational Radiation Exposure Report provides an evaluation of DOE-wide performance regarding compliance with Title 10, Code of Federal Regulations (C.F.R.), Part 835, Occupational Radiation Protection dose limits and as low as reasonably achievable (ALARA) process requirements. In addition, the report provides data to DOE organizations responsible for developing policies for protection of individuals from the adverse health effects of radiation. The report provides a summary and an analysis of occupational radiation exposure information from the monitoring of individuals involved in DOE activities. Over the past five-year period, the occupational radiation exposure information has been analyzed in terms of aggregate data, dose to individuals, and dose by site.

Source record↗

Direct Data Distribution From Low-Earth Orbit

NASA Lewis Research Center (LeRC) is developing the space and ground segment technologies necessary to demonstrate a direct data distribution (1)3) system for use in space-to-ground communication links from spacecraft in low-Earth orbit (LEO) to strategically located tracking ground terminals. The key space segment technologies include a K-band (19 GHz) MMIC-based transmit phased array antenna, and a multichannel bandwidth- and power-efficient digital encoder/modulate with an aggregate data rate of 622 Mb/s. Along with small (1.8 meter), low-cost tracking terminals on the ground, the D3 system enables affordable distribution of data to the end user or archive facility through interoperability with commercial terrestrial telecommunications networks. The D3 system is applicable to both government and commercial science and communications spacecraft in LEO. The features and benefits of the D3 system concept are described. Starting with typical orbital characteristics, a set of baseline requirements for representative applications is developed, including requirements for onboard storage and tracking terminals, and sample link budgets are presented. Characteristics of the transmit array antenna and digital encoder/modulator are described. The architecture and components of the tracking terminal are described, including technologies for the next generation terminal. Candidate flights of opportunity for risk mitigation and space demonstration of the D3 features are identified.

Budinger, James M.↗

Denoising Autoencoder for Reconstructing Sensor Observation Data and Predicting Evapotranspiration: Noisy and Missing Values Repair and Uncertainty Quantification

Abstract Machine learning (ML) methods applied in scientific research often deal with interrelated features in high‐dimensional data. Reducing data noise and redundancy is needed to increase prediction accuracy and efficiency especially when dealing with data from field sensors. We explored an unsupervised learning method, the denoising autoencoder (DAE), to extract the underlying data structure from noisy raw data in the context of predicting hydrologic quantities from multiple field sensors. These sensors have intrinsic instrumental noise and occasional malfunctions that cause missing values. Our DAE neural network reconstructed meteorological sensor data containing noise and missing values to predict evapotranspiration in a mountainous watershed. The DAE reconstructed the sensor variables with a mean coefficient of determination value of 0.77 across 15 dimensions representing individual sensors. It reduced variance and bias uncertainties compared to a classical autoencoder model. The reconstruction quality varied across dimensions depending on their cross‐correlation and alignment with the underlying data structure. Uncertainties arising from the model structure were overall higher than those resulting from data corruption. We attached the DAE structure to a downstream ET‐prediction neural network in three formats and achieved reasonably accurate ET predictions . The use of the DAE notably reduced variance uncertainty in ET prediction. However, excessive variance reduction may be accompanied by an increase in bias due to the intrinsic bias‐variance tradeoff. Our method of evaluating and reducing uncertainties in aggregated data from different sources can be used to improve predictive models, process understanding, and uncertainty quantification for better water resource management. Plain Language Summary We present a machine learning method, namely the denoising autoencoder, which reduces the effects of data noise and missing values typically present in scientific data sets collected through sensor measurements. This method selects the most relevant information from noisy raw data collected by the instruments and fills in missing values. To demonstrate the effectiveness of our method, we applied it to predict evapotranspiration, a hydrologic variable that represents the water moved from the land surface to the atmosphere through a combination of evaporation and plant water use (transpiration). We also used a random sampling technique (the Monte Carlo method) to compare the uncertainty in the predictions when using the raw and noisy data versus the reconstructed data. The denoising process produced more accurate predictions of evapotranspiration with less uncertainty. Improved predictions of evapotranspiration can lead to a better understanding and accounting of water budgets. This ML approach is broadly suitable for a wide variety of applications that involve noisy sensor data with missing values. Key Points We used a denoising autoencoder (DAE) neural network to reduce noise in meteorological and soil sensor observations by on average We used Monte Carlo sampling to estimate the bias and variance of all model outputs, including uncertainty sources from data and the model We attached the DAE component to a downstream neural network to predict ET with the variance reduced by , compared to that without the DAE

denoising autoencoder↗

Minimond

minomond is a simple software package built to unobtrrusively collect large amounts of trending data on computer systems, and send that data to one or more external trending data aggregation services. The goal is to enable ongoing recording of many metrics from many nodes in order to identify historical patterns and provide historical visibility into systems problems. minimond is intended to replace large collections of ad hoc scripts that are commonly used for this purpose. minomond is built with an emphasis on simplicity and extensibility, and is intended to supplement, not replace, other availability and trending data monitoring systems.

Pezzaglia, Larry↗

Digital archives, big data and image-based culturomics for social impact assessment: Opportunities and challenges

Social impact assessment (SIA) is well-established but uses conventional approaches that have become less effective in recent decades, particularly in relation to declining survey response rates and a lack of youth engagement. Images from digital archives and social media sources are poised to advance the research and practice of SIA by transcending text-based methods with insights into changing landscapes, and human engagement with them. This viewpoint describes progress, challenges and cautions toward the development of such tools (defined as culturomics), using hydroelectricity cases to illustrate potential approaches. These tools build on foundational work in a range of disciplines, including the humanities and computer science. We describe necessary advances in machine learning, image digitization, and data aggregation and visualization techniques, as well as ways to ensure that such tools are carefully tested, applied and interpreted. Challenges include the automation, acquisition and management of datasets, and using these tools appropriately and equitably. Critically, culturomics of any kind must not be used as a replacement for engagement with people, but as complementary to inclusive stakeholder engagement. - Highlights: •Image-based digital archives and social media present opportunities for new SIA tools. •Application-ready big data approaches are emerging across many fields. •SIA scholars, practitioners and stakeholders should engage with culturomics. •Challenges include automation, digitization, interpretation and justice. •Culturomics of any kind must not replace engagement with people.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Improving the LandScan USA Non-Obligate Population Estimate (NOPE)

Where do people go when they have nowhere to be? Nonobligate activities are a significant part of our social and cultural lives, but there are no existing large scale data which characterize spatial variability in population allocation for these activities. As large scale population estimates have ever-finer resolutions, gaps in our ability to estimate this population segment have an increasingly large impact on high resolution population estimates. In this paper, we demonstrate an improved method for estimating the spatial allocation of the non-obligate population - people who are not at work, school, or in another residential institution. This method builds upon on anonymized and aggregate data on visits to public places, allocating the non-obligate population proportionally to worker population while accounting for the estimated ratio of visitors to workers in public places.

Brelsford, Christa↗

Hierarchical Spatio-temporal Visual Analysis of Cluster Evolution in Electrocorticography Data

Here, we present ECoG ClusterFlow, a novel interactive visual analysis tool for the exploration of high-resolution Electrocorticography (ECoG) data. Our system detects and visualizes dynamic high-level structures, such as communities, using the time-varying spatial connectivity network derived from the high-resolution ECoG data. ECoG ClusterFlow provides a multi-scale visualization of the spatio-temporal patterns underlying the time-varying communities using two views: 1) an overview summarizing the evolution of clusters over time and 2) a hierarchical glyph-based technique that uses data aggregation and small multiples techniques to visualize the propagation of clusters in their spatial domain. ECoG ClusterFlow makes it possible 1) to compare the spatio-temporal evolution patterns across various time intervals, 2) to compare the temporal information at varying levels of granularity, and 3) to investigate the evolution of spatial patterns without occluding the spatial context information. Lastly, we present case studies done in collaboration with neuroscientists on our team for both simulated and real epileptic seizure data aimed at evaluating the effectiveness of our approach.

60 APPLIED LIFE SCIENCES↗

Autonomous management of a recursive area hierarchy for large scale wireless sensor networks using multiple parents

Large scale wireless sensor networks have been proposed for applications ranging from anomaly detection in an environment to vehicle tracking. Many of these applications require the networks to be distributed across a large geographic area while supporting three to five year network lifetimes. In order to support these requirements large scale wireless sensor networks of duty-cycled devices need a method of efficient and effective autonomous configuration/maintenance. This method should gracefully handle the synchronization tasks duty-cycled networks. Further, an effective configuration solution needs to recognize that in-network data aggregation and analysis presents significant benefits to wireless sensor network and should configure the network in a way such that said higher level functions benefit from the logically imposed structure. NOA, the proposed configuration and maintenance protocol, provides a multi-parent hierarchical logical structure for the network that reduces the synchronization workload. It also provides higher level functions with significant inherent benefits such as but not limited to: removing network divisions that are created by single-parent hierarchies, guarantees for when data will be compared in the hierarchy, and redundancies for communication as well as in-network data aggregation/analysis/storage.

47 OTHER INSTRUMENTATION↗

Multi-Decadal Pathfinder Data Sets of Global Land Biophysical Variables from AVHRR and MODIS and their Use in GCM Studies of Biogeophysics and Biogeochemistry

The problem of how the scale, or spatial resolution, of reflectance data impacts retrievals of vegetation leaf area index (LAI) and fraction absorbed photosynthetically active radiation (PAR) has been investigated. We define the goal of scaling as the process by which it is established that LAI and FPAR values derived from coarse resolution sensor data equal the arithmetic average of values derived independently from fine resolution sensor data. The increasing probability of land cover mixtures with decreasing resolution is defined as heterogeneity, which is a key concept in scaling studies. The effect of pixel heterogeneity on spectral reflectances and LAI/FPAR retrievals is investigated with 1 km Advanced Very High Resolution Radiometer (AVHRR) data aggregated to different coarse spatial resolutions. It is shown that LAI retrieval errors at coarse resolution are inversely related to the proportion of the dominant land cover in such pixel. Further, large errors in LAI retrievals are incurred when forests are minority biomes in non-forest pixels compared to when forest biomes are mixed with one another, and vice-versa. A physically based technique for scaling with explicit spatial resolution dependent radiative transfer formulation is developed. The successful application of this theory to scaling LAI retrievals from AVHRR data of different resolutions is demonstrated

Myneni, Ranga↗

Multiscale and Multivariate Transportation System Visualization for Shopping District Traffic and Regional Traffic

In this paper, we present a suite of visualization techniques for sensor-based transportation system data at different scales to facilitate the exploration of interconnected traffic dynamics at intersections and highways. Additionally, these techniques are designed for analyzing multivariate traffic data from radar-based highway sensors and camera-based intersection sensors recording turn movements and vehicle speed, in the Chattanooga Metropolitan Area, with the capability of (a) revealing multiscale mobility patterns using different levels of data aggregation (e.g., individual sensor for microscale, multiple sensors along a corridor for mesoscale, and a larger number of sensors across the region for macroscale visualization) at different intervals (e.g., 5-min intervals, time of day, full day, and day-of-the-week), and (b) exploring the spatial variation of multiple traffic-related variables (e.g., volumes, speeds, turn movements, and traffic light colors) provided by the sensors. We close with a case study to demonstrate the effectiveness of our multiscale and multivariate visualization techniques. At microscale, we focused on intersection data from a shopping district around Shallowford Road in East Chattanooga. For mesoscale visualization, we studied the Shallowford Road corridor and an adjacent stretch of I-75. At macroscale, we included highway data from the Chattanooga Metropolitan Area. All visualizations were integrated into a web-based situational awareness tool to promote user access and interaction. At a minimum, each visualization provides the option for selecting dates for real-time (depending on sensor availability) and historical data, and additional information on hovering, though most provide more detailed information, including different views of the selected data, or interactive highlights.

33 ADVANCED PROPULSION SYSTEMS↗

Robust Period Estimation Using Mutual Information for Multiband Light Curves in the Synoptic Survey Era

The Large Synoptic Survey Telescope (LSST) will produce an unprecedented amount of light curves using six optical bands. Robust and efficient methods that can aggregate data from multidimensional sparsely sampled time-series are needed. Here, we present a new method for light curve period estimation based on quadratic mutual information (QMI). The presented method does not assume a particular model for the light curve nor its underlying probability density and it is robust to non-Gaussian noise and outliers. By combining the QMI from several bands the true period can be estimated even when no single-band QMI yields the period. Period recovery performance as a function of average magnitude and sample size is measured using 30,000 synthetic multiband light curves of RR Lyrae and Cepheid variables generated by the LSST Operations and Catalog simulators. The results show that aggregating information from several bands is highly beneficial in LSST sparsely sampled time-series, obtaining an absolute increase in period recovery rate up to 50%. We also show that the QMI is more robust to noise and light curve length (sample size) than the multiband generalizations of the Lomb–Scargle and AoV periodograms, recovering the true period in 10%–30% more cases than its competitors. A python package with efficient Cython implementations of the QMI and other methods is provided.

79 ASTRONOMY AND ASTROPHYSICS↗

An Intriguing Convex Break in the EGRET SED of Mrk 421

Based upon analysis of the entire EGRET data from Mrk 421, it is found that the time-averaged spectra are inconsistent with the predictions of current theoretical models that have had success in describing simultaneous X-ray/TeV observations, and suggest additional components in the GeV band, as well as complex time variability. Current theoretical pictures explain the GeV emission as comptonization of the synchrotron photons in the jet, and predict hard spectra that should join smoothly with the TeV emission. Our analysis shows that the situation is more complex. The spectrum ranges from hard to soft during individual epochs, and shows a convext break in the aggregated data. We also present the mission-averaged EGRET spectrum for PKS 2155-304, which shows a similar (but not as pronounced) convex curvature. We discuss a series of possible explanations for the 10(exp 22) - 10(exp 23) HZ declining part of the EGRET nu F(sub nu), spectrum for Mrk 421, and suggest that it is synchrotron emission from the high energy tail of the electron population that produces the X-rays during the highest X-ray states. Such multi-MeV photons are produced by electrons accelerated close to the limit of diffusive shock acceleration. Simultaneous GLAST and X-ray observations of high X-ray states will address the issue of the convex curvature in the future.

Nandikotkur, Giridhar↗

HDF5 in the exascale era: Delivering efficient and scalable parallel I/O for exascale applications

Accurately modeling real-world systems requires scientific applications at exascale to generate massive amounts of data and manage data storage efficiently. However, parallel input and output (I/O) faces challenges due to new application workflows and the state-of-the-art memory, interconnect, and storage architectures considered in exascale designs. The storage hierarchy has expanded with node-local persistent memory, solid-state storage, and traditional disk and tape-based storage, thus requiring efficiency at each layer and much more efficient data movement among these layers. This paper discusses how the ExaHDF5 project improved the I/O performance and data management for exascale architectures by enhancing HDF5, a widely used parallel I/O library. The team developed an Asynchronous I/O Virtual Object Layer (VOL) connector that allowed overlapping I/O with computation. They also created a Cache VOL to complement asynchronous I/O by incorporating fast storage layers, such as burst buffer and node-local storage, into the parallel I/O workflow through caching and staging data. Additionally, the team enabled data aggregation and I/O at the node level by using a Subfiling Virtual File Driver (VFD). To demonstrate superior I/O performance with HDF5 at exascale, the ExaHDF5 team collaborated with several exascale applications. In this paper, we show I/O performance improvements for three applications: Cabana (a particle-based simulation library), EQSIM (a regional earthquake simulation software), and E3SM (a climate system modeling library).

Asynchronous I/Ol↗

Prototype hardware design and testing of the global common module for the global trigger subsystem of the ATLAS phase-II upgrade

We report the High-Luminosity Large Hadron Collider (HL-LHC) will deliver more than ten times the integrated luminosity of the previous runs combined. Meeting its stricter throughput requirements poses new challenges to the Trigger and Data Acquisition (TDAQ) systems of the LHC experiments. Introduced in the framework of the ATLAS experiment’s HL upgrade, the Global Trigger (GT) is a new subsystem which will perform offline-like algorithms on full-granularity calorimeter data. The implementation of the GT’s functionality is firmware-focused and is composed of three layers: multiplexing (or data aggregating), global event processing, and demultiplexing interface to the central trigger processor. Each layer will be composed of several, similar nodes, hosted on replicas of identical hardware, the Global Common Module (GCM), an ATCA front board which is designed to be adopted throughout the entire GT subsystem. This article proceeds from the TWEPP 2021 conference and presents the GCM hardware design, performed in 2020, and focuses on some key results of its extensive testing performed in 2021.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗