Evaluation of Sensor and Environmental Factors Impacting the Use of Multiple Sensor Data for Time-Series Applications
Explore the source record for details and available documents.
Rajagopalan Rengarajan↗
SEARCH · Search NASA
Results for “Multiple data”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Quota management in dCache or making a perfectly normal file system normal
dCache (https://dcache.org) is a highly scalable storage system providing location-independent access to data. The data are stored across multiple data servers as complete files presented to the end-user via a single-rooted namespace. From its inception, dCache has been designed as a caching disk buffer to a tertiary tape storage system with the assumption that the latter has virtually unlimited capacity. dCache can also be configured as a disk-only storage system with no tape backend. Owing to the idea that a tape resource is infinite, or purely physically limited by budget considerations, the system has never provided for any restrictions on how much data can be stored on tape. Likewise, in the disk-only configuration, the capacity of the system is only limited by the aggregate disk capacity of the data servers. In a multi-user environment, however, this has become problematic. This presentation will describe the design and implementation of a user- and group-based quota system, that allows to manage tape and disk space allocations, as part of dCache namespace.
72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
Power System Feature-Based Event Classification by Means of Multiple PMU Data
Abstract—Phasor Measurement Units (PMUs) provide time synchronized measurements across the power grid, enabling data driven event detection and classification for enhanced system monitoring and situational awareness. However, variations in event duration, spatial extent, and severity, along with coincident events, pose challenges for conventional classification models that require fixed-size inputs. This paper presents a feature-based framework that aggregates diverse attributes from all available PMUs for each event into a fixed-length vector, facilitating the application of standard machine learning classifiers, including Random Forest, XGBoost, and Multilayer Perceptron. A probabilistic post-processing scheme is further introduced to enable multi-label classification in the presence of overlapping events. Experiments using real-world PMU data demonstrate that the Random Forest model achieves 95% accuracy, while the proposed post-processing method yields an additional 3% improvement.
Nematirad, Reza↗
Hydraulic fracture characterization by integrating multidisciplinary data from the Hydraulic Fracturing Test Site 2 (HFTS-2)
Various technologies have traditionally been used to monitor and describe hydraulic fractures from different perspectives. This work demonstrates the value of data integration for hydraulic fracture characterization when multiple data resources are available. The Hydraulic Fracturing Test Site 2 (HFTS 2) is a hydraulic fracturing research project in the Delaware Basin with multiple surveillance techniques including fiber optics sensing, microseismic, pressure/temperature gauges, etc. We integrated the multidisciplinary data from the HFTS-2 to characterize hydraulic fractures. The integrated data revealed interesting fracture propagation features including layering, vertical propagation affected by pore pressure gradient, and different microseismic activities due to difference in-situ conditions. Furthermore, these findings can be insightful for understanding hydraulic fracture propagation. The comparison among multiple surveillance data also helps us to evaluate the roles of various surveillance technologies and provides us experience to make informative decisions depending on different monitoring objectives.
58 GEOSCIENCES↗
Sensing Electrical Networks Securely & Economically (SENSE)
The growing adoption of distributed energy resources (DERs) like battery energy storage systems and roof top solar/PV and the rapid penetration of electric vehicles (EVs), the electric grid is undergoing a major transformation with elevated stress on legacy grid assets. Despite a lot of expenditure to address these challenges, both in dollars and manpower, utilities have not been able to receive the value that was promised. The gains have been most visible at the transmission and substation level, especially where the main objective was improving operational and economic efficiency for the utility. Improving visibility and control at a few select points enhances the existing and established paradigm of centralized command and control. With changing load patterns, load types and the overall transition to an “active grid”, the centralized control and coordination paradigm gets challenged. To address the challenges, a new architecture and mechanism is needed, one that supports decentralized control and decision making, extracting value streams at the grid edge, particularly as the changes are fueled by transitions occurring in the distribution system. To address this, a communications and data processing platform, “GAMMA” was developed and demonstrated through the project. At the heart of the platform, are distributed, intelligent edge nodes with sensing and compute capabilities, that can record and analyze information locally. They are embedded in sensors and actuators specific to different distribution system applications. Phase 1 of the project focused on developing novel sensor technology that can be used for monitoring utility pole top distribution transformers. The sensors were designed with the objective of being low-cost, communicating with the GAMMA cloud using novel “delay-tolerant” networking using Bluetooth and a secure mobile application. They were non-intrusive in nature so that they can be installed quickly in the field, resulting in overall low cost of deployment and operations. Following the successful completion of Phase 1, the team manufactured 100 units for a field demonstration in Phase 2. The field demonstration was carried out on two real feeder systems with the local utility partner. In total, 100 sensors were installed and operated over a period of 6 months in the state of Georgia. The platform is operational end to end, with the cloud infrastructure deployed on a distributed, serverless environment that can serve multiple data streams, an analytics engine and a portal to securely view the data from multiple assets. The data collected through the GAMMA Mobile Phone app showcased the viability of the novel delay tolerant networking architecture, and the data processing algorithms developed through the course of the project, were successful in extracting important information about the overall network, improving the utility’s visibility and situational awareness in the distribution feeder.
24 POWER TRANSMISSION AND DISTRIBUTION↗
The Sensor Dilemma in Intelligent Transportation Systems
Intelligent Transportation Systems (ITS) are at the forefront in advancing the way we interact and perceive with the transportation network. This revolution is fueled by the significant advancement in sensor perception technologies such as Radar, LiDAR and Video Imaging which are the most popular modalities for ITS. Real-time perception data from these sensors allows intelligent infrastructure side decision making to improve the energy, efficiency and safety at traffic intersections. As traffic departments across the United States are transitioning from traditional loop detectors / emulators and embracing newer technologies, they are often left with a dilemma in choosing a sensor technology for infrastructure-based perception which is reliable, inexpensive, easy to setup and has robust performance in varying weather conditions. However, choosing a sensor which checks all boxes is not straightforward as every sensor type has unique benefits and drawbacks. Radar is excellent at detecting long range vehicles and weather resistance but lacks high resolution. LiDAR is expensive and weather-sensitive, while cameras provide rich visual data at a low cost but are constrained by lighting and visibility. This study examines Radar, LiDAR and camera sensors capabilities to ascertain whether any of these qualifies as the "best" sensor for ITS perception. Through this evaluation, we hope to draw attention to the necessity of National Renewable Energy Laboratory's (NREL) Infrastructure Perception and Control (IPC) framework which presents a multi-sensor track data fusion engine to assimilate multiple data streams in order to provide robust and reliable perception. While no single sensor can meet all the demands of ITS, a hybrid approach combining multiple sensor modalities like Radar, LiDAR and cameras, offers the most robust solution for enhancing the safety and efficiency in intelligent transportation systems.
33 ADVANCED PROPULSION SYSTEMS↗
Evaluation and comparison of ERTS measurements of major crops and soil associations for selected test sites in the central United States
The author has identified the following significant results. Multispectral scanner data obtained by ERTS-1 over six test sites in the Central United States were analyzed and interpreted. ERTS-1 data for some of the test sites were geometrically corrected and temporally overlayed. Computer-implemented pattern recognition techniques were used in the analysis of all multispectral data. These techniques were used to evaluate ERTS-1 data as a tool for soil survey. Geology maps and land use inventories were prepared by digital analysis of multispectral data. Identification and mapping of crop species and rangelands were achieved throught the analysis of 1972 and 1973 ERTS-1 data. Multiple dates of ERTS-1 data were examined to determine the variation with time of the areal extent of surface water resources on the Southern Great Plain.
Baumgardner, M. F.↗
A flexible CAMAC based data system for Space Shuttle scientific instruments
An effort has been made within NASA to produce a low-cost modular system for implementation of Shuttle payloads based on the CAMAC standards for packaging and data transfer. A key element of such a modular system is a means for controlling the data system, collecting and processing the data for transmission to the ground, and issuing commands to the instrument either from the ground or based on the data collected. A description is presented of such a means based on a network of digital processors and CAMAC crate controllers, which allows for the implementation of instruments ranging from those requiring only a single CAMAC crate of functional modules and no data processing to ones requiring multiple crates and multiple data processors.
Ehrmann, C. H.↗
The NASA Ocean Data System at the Jet Propulsion Laboratory
Global change studies require satellite oceanographic observations archived in an active data center. This paper describes the activities of an experimental active oceanographic data archive center specializing in distribution of high-level oceanographic data products produced by research oceanographers from satellite altimeter, scatterometer, and microwave and infrared radiometer measurements. Methods to encourage data sharing practices were developed. Services initiated to help oceanographers conduct research more effectively included rapid delivery of data, reprocessing data sets, subsetting of large data sets, and distribution of multiple data sets on a single medium.
Halpern, David↗
Short-Arc Analysis of Intersatellite Tracking Data in a Gravity Mapping Mission
A technique for the analysis of low-low intersatellite range-rate data in a gravity mapping mission is explored. The technique is based on standard tracking data analysis for orbit determination but uses a spherical coordinate representation of the 12 epoch state parameters describing the baseline between the two satellites. This representation of the state parameters is exploited to allow the intersatellite range-rate analysis to benefit from information provided by other tracking data types without large simultaneous multiple data type solutions. The technique appears especially valuable for estimating gravity from short arcs (e.g., less than 15 minutes) of data. Gravity recovery simulations which use short arcs are compared with those using arcs a day in length. For a high-inclination orbit, the short-arc analysis recovers low-order gravity coefficients remarkably well, although higher order terms, especially sectorial terms, are less accurate. Simulations suggest that either long or short arcs of GRACE data are likely to improve parts of the geopotential spectrum by orders of magnitude.
Rowlands, David D.↗
Liftoff and Transition Database Generation for Launch Vehicles Using Data-Fusion-Based Modeling
A data fusion technique for merging multiple data sources with differing fidelity and resolution was developed to support the production of aerodynamic line load databases for the Liftoff and Transition (LOT) flight phase of the Space Launch System (SLS). The technique uses a reduced order model based on a high-fidelity line load data set from Computational Fluid Dynamics (CFD) to predict solutions for a much larger solution space. Even higher-fidelity force and moment information (from wind-tunnel tests) is then used to adjust the model. The adjustment uses constrained optimization through the method of Lagrange multipliers in order to minimize the deviation of the line load distribution from the spatially-dense CFD solution, while ensuring that the integrated force and moment values match those observed in physical wind tunnel measurements. Though the wind-tunnel data are operationally-dense (available at many flow conditions), they are spatially coarse (as only the overall forces and moments are available). Conversely, CFD for such complex configurations is expensive, and thus operationally sparse. Data fusion techniques are necessary to make the most efficient use of available information, delivering accurate results within time and resource constraints.
Wignall, T. J.↗
An Overview of Future NASA Missions, Concepts, and Technologies Related to Imaging of the World's Land Areas
In the near term NASA is entering into the peak activity period of the Earth Observing System (EOS). The EOS AM-1 /"Terra" spacecraft is nearing launch and operation to be followed soon by the New Millennium Program (NMP) Earth Observing (EO-1) mission. Other missions related to land imaging and studies include EOS PM-1 mission, the Earth System Sciences Program (ESSP) Vegetation Canopy Lidar (VCL) mission, the EOS/IceSat mission. These missions involve clear advances in technologies and observational capability including improvements in multispectral imaging and other observing strategies, for example, "formation flying". Plans are underway to define the next era of EOS missions, commonly called "EOS Follow-on" or EOS II. The programmatic planning includes concepts that represent advances over the present Landsat-7 mission that concomitantly recognize the advances being made in land imaging within the private sector. The National Polar Orbiting Environmental Satellite Series (NPOESS) Preparatory Project (NPP) is an effort that will help to transition EOS medium resolution (herein meaning spatial resolutions near 500 meters), multispectral measurement capabilities such as represented by the EOS Moderate Resolution Imaging Spectroradiometer (MODIS) into the NPOESS operational series of satellites. Developments in Synthetic Aperture Radar (SAR) and passive microwave land observing capabilities are also proceeding. Beyond these efforts the Earth Science Enterprise Technology Strategy is embarking efforts to advance technologies in several basic areas: instruments, flight systems and operational capability, and information systems. In the case of instruments architectures will be examined that offer significant reductions in mass, volume, power and observational flexibility. For flight systems and operational capability, formation flying including calibration and data fusion, systems operation autonomy, and mechanical and electronic innovations that can reduce spacecraft and subsystem resource requirements. The efforts in information systems will include better approaches for linking multiple data sets, extracting and visualizing information, and improvements in collecting, compressing, transmitting, processing, distributing and archiving data from multiple platforms. Overall concepts such as sensor webs, constellations of observing systems, and rapid and tailored data availability and delivery to multiple users comprise and notions Earth Science Vision for the future.
Salomonson, Vincent V.↗
Flow Analysis Tool White Paper
Faster networks are continually being built to accommodate larger data transfers. While it is intuitive to think that implementing faster networks will result in higher throughput rates, this is often not the case. There are many elements involved in data transfer, many of which are beyond the scope of the network itself. Although networks may get bigger and support faster technologies, the presence of other legacy components, such as older application software or kernel parameters, can often cause bottlenecks. Engineers must be able to identify when data flows are reaching a bottleneck that is not imposed by the network and then troubleshoot it using the tools available to them. The current best practice is to collect as much information as possible on the network traffic flows so that analysis is quick and easy. Unfortunately, no single method of collecting this information can sufficiently capture the whole endto- end picture. This becomes even more of a hurdle when large, multi-user systems are involved. In order to capture all the necessary information, multiple data sources are required. This paper presents a method for developing a flow analysis tool to effectively collect network flow data from multiple sources and provide that information to engineers in a clear, concise way for analysis. The purpose of this method is to collect enough information to quickly (and automatically) identify poorly performing flows along with the cause of the problem. The method involves the development of a set of database tables that can be populated with flow data from multiple sources, along with an easyto- use, web-based front-end interface to help network engineers access, organize, analyze, and manage all the information.
Boscia, Nichole K.↗
Open Source Next Generation Visualization Software for Interplanetary Missions
Mission control is evolving quickly, driven by the requirements of new missions, and enabled by modern computing capabilities. Distributed operations, access to data anywhere, data visualization for spacecraft analysis that spans multiple data sources, flexible reconfiguration to support multiple missions, and operator use cases, are driving the need for new capabilities. NASA's Advanced Multi-Mission Operations System (AMMOS), Ames Research Center (ARC) and the Jet Propulsion Laboratory (JPL) are collaborating to build a new generation of mission operations software for visualization, to enable mission control anywhere, on the desktop, tablet and phone. The software is built on an open source platform that is open for contributions (http://nasa.github.io/openmct).
software engineering↗
A Spectral Fingerprinting Method for Deriving Consistent Climate Data Records from Multiple Satellite IR Sounders
Deriving Climate Data Records (CDRs) from multiple IR sounders such AIRS on Aqua, CrIS on S-NPP, NOAA20 and JPSS-2, IASI on Metop A, B, and C requires from current operational products are challenging due to different radiative transfer models and retireavl algorithms used for processing level 2 data. We developed a Climate Fingerprinting Sounder Product (ClimFiSP) algorithm, which uses a single set of radiative kernels a robust spectral fingerprinting method to performs retrievals using spatiotemporally averaged L1 hyperspectral radiances directly. The ClimFiSP algorithm provides accurate data fusion CDR products from multiple satellite sensors. We have applied this method to both AIRS and CrIS (on SNPP and on NOAA 20) data and generated two decades climate data records for atmospheric temperature, water vapor, cloud, trace gases, and surface skin temperature. We plan to add IASI to the CDR data set in the future. The ClimFiSP is being transitioned to NASA GES DISC data center for public access.
Xu Liu↗
A distributed data base management facility for the CAD/CAM environment
Current/PAD research in the area of distributed data base management considers facilities for supporting CAD/CAM data management in a heterogeneous network of computers encompassing multiple data base managers supporting a variety of data models. These facilities include coordinated execution of multiple DBMSs to provide for administration of and access to data distributed across them.
Balza, R. M.↗
Uncertainty-Informed Volume Visualization using Implicit Neural Representation
The increasing adoption of Deep Neural Networks (DNNs) has led to their application in many challenging scientific visualization tasks. While advanced DNNs offer impressive generalization capabilities, understanding factors such as model prediction quality, robustness, and uncertainty is crucial. These insights can enable domain scientists to make informed decisions about their data. However, DNNs inherently lack ability to estimate prediction uncertainty, necessitating new research to construct robust uncertainty-aware visualization techniques tailored for various visualization tasks. In this work, we propose uncertainty-aware implicit neural representations to model scalar field data sets effectively and comprehensively study the efficacy and benefits of estimated uncertainty information for volume visualization tasks. We evaluate the effectiveness of two principled deep uncertainty estimation techniques: (1) Deep Ensemble and (2) Monte Carlo Dropout (MC-Dropout). These techniques enable uncertainty-informed volume visualization in scalar field data sets. Our extensive exploration across multiple data sets demonstrates that uncertainty-aware models produce informative volume visualization results. Moreover, integrating prediction uncertainty enhances the trustworthiness of our DNN model, making it suitable for robustly analyzing and visualizing real-world scientific volumetric data sets.
Saklani, Shanu↗
Data Fusion to Enhance Quality Control and Analysis with Instruments at the Marine and Coastal Research Laboratory
Deploying environmental monitoring instruments in the marine environment can be challenging, facing challenges around device survivability, biofouling and corrosion, and consistent data collection. This project explores the use of data fusion – the process of integrating multiple data sources to produce more consistent, accurate, and useful information – to build a consistent long-term monitoring system at the Marine and Coastal Research Laboratory (MCRL) in Sequim, Washington. Unused instruments that had been acquired from past projects were inventoried and deployments planned on the MCRL pier and floating dock. A total of 8 instruments were deployed including a tide gauge, hydrophone, acoustic Doppler current profiler (ADCP), photosynthetically active radiation (PAR) sensors, meteorological station, and three water quality sensors. Deployments were planned to be well-protected around the pier structure and a maintenance schedule was created for cleaning and recalibration. An automated data pipeline was created to aggregate data on edge computers that push data to Amazon Web Services (AWS) cloud storage every 15 minutes, performing automated quality control and data transformations using the Time Series Data Analytical Toolkit (TSDAT). Continued efforts are underway to maintain this system into the future, take a data-driven approach to maintenance scheduling, improve the reliability of the system, and share the data with a variety of end-users.
54 ENVIRONMENTAL SCIENCES↗