Big Data Enhancement to the Integrated Environmental Quality Sensing System
Explore the source record for details and available documents.
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
In an environment characterized by decreasing budgets, limited system development time, and user needs for increased capabilities, the Mission Operations Division (MOD) at the National Aeronautics and Space Administration Goddard Space Flight Center initiated a new, cost-effective concept in developing its spacecraft ground data systems: the Mission Operations Center (MOC). In the MOC approach, key components are integrated into a comprehensive and cohesive spacecraft planning, monitoring, command, and control system with a single, state-of-the-art graphical user interface. The MOD is currently implementing MOC's, which feature a common, reusable, and extendable system architecture, to support the X-Ray Timing Explorer (XTE), Tropical Rainfall Measuring Mission (TRMM), and Advanced Composition Explorer (ACE) missions. As a result of the MOC approach, mission operations are integrated, and users can, with a single system, perform real-time health and safety monitoring, real-time command and control, real-time attitude processing, real-time and predictive graphical spacecraft monitoring, trend analysis, mission planning and scheduling, command generation and management, network scheduling, guide star selection, and (using an expert system) spacecraft monitoring and fault isolation. The MOD is also implementing its test and training simulators under the new MOC management structure. This paper describes the MOC concept, the management approaches used in developing MOC systems, the technologies employed and the development process improvement initiatives applied in implementing MOC systems, and the expected benefits to both the user and the mission project in using the MOC approach.
In the past several decades, numerous experiments have been performed worldwide to support reactor operations, measurements, design, and nuclear safety. Those experiments represent an extensive international investment in infrastructure, expertise, and cost, representing significantly valuable resources of data supporting past, current, and future research activities. Those valuable assets represent the basis for recording, development, and validation of our nuclear methods and integral nuclear data [1]. The loss of these experimental data, which has occurred all too much in the recent years, is tragic. The high cost to repeat many of these measurements can be prohibitive, if not impossible, to surmount. Two international projects were developed, and are under the direction of the Organisation for Co-operation and Development Nuclear Energy Agency (OECD NEA) to address the challenges of not just data preservation, but evaluation of the data to determine its merit for modern and future use. The International Criticality Safety Benchmark Evaluation Project (ICSBEP) was established to identify and verify comprehensive critical benchmark data sets; evaluate the data, including quantification of biases and uncertainties; compile the data and calculations in a standardized format; and formally document the effort into a single source of verified benchmark data [2]. Similarly, the International Reactor Physics Experiment Evaluation Project (IRPhEP) was established to preserve integral reactor physics experimental data, including separate or special effects data for nuclear energy and technology applications [3]. Annually, contributors from around the world continue to collaborate in the evaluation and review of select benchmark experiments for preservation and dissemination. The extensively peer-reviewed integral benchmark data can then be utilized to support nuclear design and safety analysts to validate the analytical tools, methods, and data needed for next-generation reactor design, safety analysis requirements, and all other front- and back-end activities contributing to the overall nuclear fuel cycle where quality neutronics calculations are paramount.
In its current state, the distribution system is incapable of handling small to moderate amounts of photovoltaic (PV) penetration. This is because it was initially designed for handling passive loads which, at the level of a substation, have low variability and are forecastable with high accuracy. It has been an open loop system with little monitoring and control. With the addition of PV energy sources, the overall scenario will change dramatically due to (1) two way power flow on network; and (2) high aggregate variability. Additionally, changes on the consumption side lead to a number of smart loads, Electric Vehicles (EVs), and Demand Response. These fundamental changes in the characteristics of the generation and consumption of power will lead to a number of practical engineering problems which must be overcome to allow increased penetration of Distributed PV. Solving the unique engineering challenges which arise at moderate levels of PV penetration requires closed loop integration of data from (1) PV sources; (2) customer load data from smart meters; (3) EV charging data; and (4) local and line mounted precision instruments. These data are not traditionally used by utilities in operations since they are ”non-SCADA” and the current grid does not require such levels of control. To integrate this data and provide real time intelligence from these non-SCADA data, we created the Visualization and Analytics of Distribution Systems with Deep Penetration of Distributed Energy Resources (VADER) platform. VADER is a collection of analytics enabled by integration of massive and heterogeneous data streams for granular real-time monitoring, visualization and control of Distributed Energy Resources (DER) in distribution networks. VADER analytics enable utilities to have greater visibility into distributed energy resources. We built several batch- and stream-analytics in VADER which help operators better understand the impact of distributed energy resources on the grid.
Accurate degradation modeling is essential for predicting photovoltaic (PV) module performance, estimating longevity and informing design decisions. With degradation rates varying significantly by location, geospatial analysis is critical for PV and broader applications, such as agrivoltaics, weathering and environmental data analysis. This work presents PVDeg, an open-source tool designed for geospatial degradation analysis. PVDeg integrates meteorological data from global sources, including the National Solar Radiation Database (NSRDB) and Photovoltaic Geographical Information System (PVGIS), with degradation models. The toolkit enables users to customize geospatial workflows by integrating weather data, material parameters, and user-defined Python functions. It facilitates accelerated downloads of NSRDB and PVGIS datasets and optimizes geospatial point selection to preserve data density in regions of interest. Additionally, PVDeg provides a local database for storage and spatial queries, supporting large-scale analyses without the need for high-performance computing (HPC) resources. PVDeg provides a foundational workflow that extends its utility beyond PV applications, enabling researchers to analyze geospatial processes across discipline.
An image base information system (IBIS) is utilized to integrate Landsat and census data for the purpose of mapping urban land and updating urbanized-area outer lines. IBIS is a subset of the video image communication and retrieval digital image processing system developed at JPL. IBIS is used to analyze three urban areas: Orlando, Florida; Seattle, Washington; and Boston, Massachusetts. In all three applications the primary objective is to map the expansion of urban land cover in the urban fringe. Pertinent tabular reports are produced.
Typical users of the International Criticality Safety Evaluation Project (ICSBEP) Handbook have specific criteria to which they desire to find matching experiments. Depending on the application, those criteria may consist of any combination of physical or chemical characteristics and/or various neutronic parameters. The ICSBEP Handbook contains a structured format helping the user narrow the search for experiments of interest. However, with nearly 4300 different experimental configurations and the ever increasing addition of experimental data, the necessity to perform multiple criteria searches have rendered these features insufficient. As a result, a relational database was created with information extracted from the ICSBEP Handbook. A users’ interface was designed by OECD and DOE to allow the interrogation of this database. The database and the corresponding users’ interface are referred to as DICE. DICE currently offers the capability to perform multiple criteria searches that go beyond simple fuel, physical form and spectra and includes expanded general information, fuel form, moderator/coolant, neutron-absorbing material, cladding, reflector, separator, geometry, benchmark results, spectra, and neutron balance parameters. DICE also includes the capability to display graphical representations of neutron spectra, detailed neutron balance, sensitivity coefficients for capture, fission, elastic scattering, inelastic scattering, nu-bar and mu-bar, as well as several other features.
Innumerable experiments have been performed worldwide to support criticality safety activities. Those experiments represent significant investments in cost, expertise, and infrastructure; as such, they represent valuable assets as the basis for recording, development, and validation of methods and nuclear data vital for modern and future criticality safety needs. Preservation and evaluation of these experimental data as benchmarks serves to provide for the best interest of the nuclear criticality safety community. High-quality integral benchmark experiments have always been a priority. There is ever growing interest in developing integral benchmark data to increasingly quantify and reduce calculational uncertainties to meet the demands of future criticality safety needs supporting next generation reactors and advanced fuel cycle concepts. The importance of drawing upon existing benchmark data is becoming more apparent because of dwindling availability of critical facilities worldwide and the high cost of performing new experiments. Integral benchmark data from the International Handbook of Evaluated Criticality Safety Benchmark Experiments (ICSBEP Handbook) and the International Handbook of Reactor Physics Benchmark Experiments (IRPhEP Handbook) are widely utilized. Significant benchmark data have been added to those two handbooks since the last Nuclear Criticality Safety Division Topical Meeting in Wilmington, North Carolina (September-October 2013). This paper highlights those additions. The 2016 edition of the ICSBEP Handbook now includes data for 570 evaluations containing benchmark specifications for 4913 critical, subcritical, or near-critical configurations, representing contributions from over 20 countries. There are a total of seven criticality-alarm-placement/shielding evaluations containing a total of 45 benchmark configurations, and eight fundamental physics benchmark evaluations containing a total of 215 measurements relevant to criticality safety applications. The IRPhEP Handbook now includes data from 151 experimental series (representing 50 reactor facilities) and also represents contributions from over 20 countries. Of the 151 benchmarks, five are draft contributions. Both the ICSBEP and IRPhEP are collaborative efforts that involve numerous scientists, engineers, and administrative support personnel worldwide. Continued contribution to these handbooks is expected to further provide the high-quality benchmark data necessary to compliment criticality safety activities going forward. (authors)
Innumerable experiments have been performed worldwide to support criticality safety activities. Those experiments represent significant investments in cost, expertise, and infrastructure; as such, they represent valuable assets as the basis for recording, development, and validation of methods and nuclear data vital for modern and future criticality safety needs. Preservation and evaluation of these experimental data as benchmarks serves to provide for the best interest of the nuclear criticality safety community. High-quality integral benchmark experiments have always been a priority. There is ever growing interest in developing integral benchmark data to increasingly quantify and reduce calculational uncertainties to meet the demands of future criticality safety needs supporting next generation reactors and advanced fuel cycle concepts. The importance of drawing upon existing benchmark data is becoming more apparent be-cause of dwindling availability of critical facilities worldwide and the high cost of per-forming new experiments. Integral benchmark data from the International Handbook of Evaluated Criticality Safety Benchmark Experiments (ICSBEP Handbook) and the International Handbook of Reactor Physics Benchmark Experiments (IRPhEP Handbook) are widely utilized. Significant benchmark data have been added to those two handbooks since the last Nuclear Criticality Safety Division Topical Meeting in Wilmingt on, North Carolina (September-October 2013). This paper highlights those additions. The 2016 edition of the ICSBEP Handbook now includes data for 570 evaluations containing benchmark specifications for 4,913 critical, subcritical, or near-critical configurations, representing contributions from over 20 countries. There are a total of 7 criticality-alarm-placement/shielding evaluations containing a total of 45 benchmark configurations, and 8 fundamental physics benchmark evaluations containing a total of 215 measurements relevant to criticality safety applications. The IRPhEP Handbook now includes data from 151 experimental series (representing 50 reactor facilities) and also represents contributions from over 20 countries. Of the 151 benchmarks, five are draft contributions. Both the ICSBEP and IRPhEP are collaborative efforts that involve numerous scientists, engineers, and administrative support personnel worldwide. Continued contribution to these handbooks is expected to further provide the high-quality benchmark data necessary to compliment criticality safety activities going forward.
Abstract Objective We describe a detailed solution for maintaining high-capacity, data-intensive network flows (eg, 10, 40, 100 Gbps+) in a scientific, medical context while still adhering to security and privacy laws and regulations. Materials and Methods High-end networking, packet-filter firewalls, network intrusion-detection systems. Results We describe a “Medical Science DMZ” concept as an option for secure, high-volume transport of large, sensitive datasets between research institutions over national research networks, and give 3 detailed descriptions of implemented Medical Science DMZs. Discussion The exponentially increasing amounts of “omics” data, high-quality imaging, and other rapidly growing clinical datasets have resulted in the rise of biomedical research “Big Data.” The storage, analysis, and network resources required to process these data and integrate them into patient diagnoses and treatments have grown to scales that strain the capabilities of academic health centers. Some data are not generated locally and cannot be sustained locally, and shared data repositories such as those provided by the National Library of Medicine, the National Cancer Institute, and international partners such as the European Bioinformatics Institute are rapidly growing. The ability to store and compute using these data must therefore be addressed by a combination of local, national, and industry resources that exchange large datasets. Maintaining data-intensive flows that comply with the Health Insurance Portability and Accountability Act (HIPAA) and other regulations presents a new challenge for biomedical research. We describe a strategy that marries performance and security by borrowing from and redefining the concept of a Science DMZ, a framework that is used in physical sciences and engineering research to manage high-capacity data flows. Conclusion By implementing a Medical Science DMZ architecture, biomedical researchers can leverage the scale provided by high-performance computer and cloud storage facilities and national high-speed research networks while preserving privacy and meeting regulatory requirements.
Unconstrained physics spaces between two or more nuclear data observables in a library occur when their values can be simultaneously adjusted without violating the uncertainties in either differential information or simulations of relevant integral experiments. Differential data are often too imprecise to fully bound all nuclear data observables of interest for application simulations. Integral data are simulated with combinations of nuclear data so that an error in one observable may be hidden by a counterbalancing error in another. In this manner compensating errors may lurk within nuclear data libraries and these errors have the potential to undermine the predictive power of neutron transport simulations, particularly in situations where there is no conclusive validation experiment that resembles the application of interest. The EUCLID project (Experiments Underpinned by Computational Learning for Improvements in Nuclear Data) developed a preliminary workflow to identify these unconstrained physics spaces by bringing together results from a large collection of integral experiments with their simulated counter-parts as well as differential information that have a one-to-one correspondence to nuclear data. This wealth of information is processed by machine learning tools for subsequent refinement by human experts. Here, we show how the EUCLID work-flow is executed by applying it first to 239 Pu and then to 9 Be nuclear data in ENDF/B-VIII.0.
Neutron crystallography offers enormous potential to complement structures from X-ray crystallography by clarifying the positions of low-Z elements, namely hydrogen. Macromolecular neutron crystallography, however, remains limited, in part owing to the challenge of integrating peak shapes from pulsed-source experiments. To advance existing software, this article demonstrates the use of machine learning to refine peak locations, predict peak shapes and yield more accurate integrated intensities when applied to whole data sets from a protein crystal. The artificial neural network, based on the U-Net architecture commonly used for image segmentation, is trained using about 100 000 simulated training peaks derived from strong peaks. After 100 training epochs (a round of training over the whole data set broken into smaller batches), training converges and achieves a Dice coefficient of around 65%, in contrast to just 15% for negative control data sets. Integrating whole peak sets using the neural network yields improved intensity statistics compared with other integration methods, including k-nearest neighbours. These results demonstrate, for the first time, that neural networks can learn peak shapes and be used to integrate Bragg peaks. In conclusion, it is expected that integration using neural networks can be further developed to increase the quality of neutron, electron and X-ray crystallography data.
Modern computers are constantly faced with the challenge of processing ever-growing quantities of data that span a wide range of modalities. Of particular relevance to national security interests is the ability to integrate multimodal data for the purpose of fast decision making. The brain is a biological system that is specialized for high performance at this task, suggesting that understanding the mechanisms by which neural circuits integrate multimodal data may lead to improved man-made detection systems. This research focused on understanding these neural algorithms, and specifically tested the hypothesis that hippocampal neurons multiplex information from two different input streams. Specifically, we compare the spiking behavior of a computational model of hippocampal circuitry with neurophysiological data recorded from rodent hippocampus.
Abstract The integrated luminosities of data samples collected in the BESIII experiment in 2016–2017 at center-of-mass energies between 4.19 and 4.28 GeV are measured with a precision better than 1% by analyzing large-angle Bhabha scattering events. The integrated luminosities of old datasets collected in 2010–2014 are updated by considering corrections related to detector performance, offsetting the effect of newly discovered readout errors in the electromagnetic calorimeter, which can haphazardly occur.
The massive, complex datasets generated by scientific simulations on next-generation computer architectures at extreme scale pose new challenges for data management and scientific understanding. A critical element in meeting these new challenges is in situ data analysis where information is reduced and analyzed as close to the point of generation as possible, for example, at run time or as the data stream to longer term storage. This milestone will demonstrate in situ data analysis in xRAGE, an ASC Eulerian Radiation Hydrodynamics code. We will work with the Eulerian Applications Project to identify target problems that will exercise physics of interest to the program, and we will work closely with users to maximize the achieved usability and productivity improvements. We will investigate enhancements to the in situ process that enable and improve techniques of data reduction and data triage in addition to improving in situ performance by using portable acceleration technology. We will report on their viability and performance in xRAGE or another ASC code. These products will provide ASC IC developers with reference codes and tools that will benefit DSW by advancing the technology for predictive science at extreme scales.
Integration of large and diverse biological data sets is a daunting problem facing systems biology researchers. Exploring the complex issues of data validation, integration, and representation, we present a systematic approach for the management and analysis of large biological data sets based on data warehouses. Our system has been implemented in the Bioverse, a framework combining diverse protein information from a variety of knowledge areas such as molecular interactions, pathway localization, protein structure, and protein function.
In recent years, sophisticated mathematical techniques have been successfully applied to the field of remote sensing to produce significant advances in applications such as registration, integration and fusion of remotely sensed data. Registration, integration and fusion of multiple source imagery are the most important issues when dealing with Earth Science remote sensing data where information from multiple sensors, exhibiting various resolutions, must be integrated. Issues ranging from different sensor geometries, different spectral responses, differing illumination conditions, different seasons, and various amounts of noise need to be dealt with when designing an image registration, integration or fusion method. This tutorial will first define the problems and challenges associated with these applications and then will review some mathematical techniques that have been successfully utilized to solve them. In particular, we will cover topics on geometric multiscale representations, redundant representations and fusion frames, graph operators, diffusion wavelets, as well as spatial-spectral and operator-based data fusion. All the algorithms will be illustrated using remotely sensed data, with an emphasis on current and operational instruments.
Abstract Motivation Precision medicine leverages patient-specific multimodal data to improve prevention, diagnosis, prognosis, and treatment of diseases. Advancing precision medicine requires the non-trivial integration of complex, heterogeneous, and potentially high-dimensional data sources, such as multi-omics and clinical data. In the literature, several approaches have been proposed to manage missing data, but are usually limited to the recovery of subsets of features for a subset of patients. A largely overlooked problem is the integration of multiple sources of data when one or more of them are completely missing for a subset of patients, a relatively common condition in clinical practice. Results We propose miss-Similarity Network Fusion (miss-SNF), a novel general-purpose data integration approach designed to manage completely missing data in the context of patient similarity networks. miss-SNF integrates incomplete unimodal patient similarity networks by leveraging a non-linear message-passing strategy borrowed from the SNF algorithm. miss-SNF is able to recover missing patient similarities and is “task agnostic”, in the sense that can integrate partial data for both unsupervised and supervised prediction tasks. Experimental analyses on nine cancer datasets from The Cancer Genome Atlas (TCGA) demonstrate that miss-SNF achieves state-of-the-art results in recovering similarities and in identifying patients subgroups enriched in clinically relevant variables and having differential survival. Moreover, amputation experiments show that miss-SNF supervised prediction of cancer clinical outcomes and Alzheimer’s disease diagnosis with completely missing data achieves results comparable to those obtained when all the data are available. Availability and implementation miss-SNF code, implemented in R, is available at https://github.com/AnacletoLAB/missSNF.