REMOTE SENSOR SECURITY THROUGH ENCODED COMPUTATION AND CRYPTOGRAPHIC SIGNATURES
Ph.D. Thesis: REMOTE SENSOR SECURITY THROUGH ENCODED COMPUTATION AND CRYPTOGRAPHIC SIGNATURES
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Ph.D. Thesis: REMOTE SENSOR SECURITY THROUGH ENCODED COMPUTATION AND CRYPTOGRAPHIC SIGNATURES
This research focuses on developing algorithms for nuclear non-proliferation detection using remote sensor modeling. To improve the performance of classification models, we implemented a data pipeline with feature extraction. This pipeline takes raw data and transforms it into smaller data points called features that still describe the model. Improving this classification works towards the departments of energy’s missions of ensuring American’s security and prosperity by creating technology that addresses nuclear challenges. To conduct this analysis, we used the Python programming language and some key packages, including tsfresh and TSFEL. Originally tsfresh was selected because it has the most statistical features out of all the packages. Later TSFEL was incorporated due to the additional features it can extract from data, such as temporal and spectral. However, feature extraction becomes challenging in the presence of missing values. In this case, two additional Python packages were added to our workflow, NumPy and pandas, allowing for the feature extraction process to handle unknown values. Our data pipeline was tested on data collected from a simulation that describes the process state of a physical example. The results show the pipeline’s capability to consume and extract a total 17 features from tabular data. Future work includes producing classifications using decision tree-based models such as XGBoost and improving data collection by analyzing feature importance.
Model improvement efforts involve an evaluation of changes in model skill in response to changes in model physics and parameterization. When using wind measurements from various remote sensors to determine model forecast accuracy, it is important to understand the effects of measurement-uncertainty differences among the sensors resulting from differences in the methods of measurement, the vertical and temporal resolution of the measurements, and the spatial variability of these differences. Here we quantify instrument measurement variability in 80-m wind speed during WFIP2 and its impact on the calculated errors and the change in error from one model version to another. Here the model versions tested involved updates in model physics from HRRRv1 to HRRRv4, and reductions in grid interval from 3 km to 750 m. Model errors were found to be 2–3 m s –1 . Differences in errors as determined by various instruments at each site amounted to about 10% of this value, or 0.2–0.3 m s –1 . Changes in model skill due to physics or grid-resolution updates also differed depending on the instrument used to determine the errors; most of the instrument-to-instrument differences were ~0.1 m s –1 , but some reached 0.3 m s –1 . All instruments at a given site mostly showed consistency in the sign of the change in error. In two examples, though, the sign changed, illustrating a consequence of differences in measurements: errors determined using one instrument may show improvement in model skill, whereas errors determined using another instrument may indicate degradation. This possibility underscores the importance of having accurate measurements to determine the model error.
Abstract. Thermodynamic profiles in the planetary boundary layer (PBL) are important observations for a range of atmospheric research and operational needs. These profiles can be retrieved from passively sensed spectral infrared (IR) or microwave (MW) radiance observations or can be more directly measured by active remote sensors such as water vapor differential absorption lidars (DIALs). This paper explores the synergy of combining ground-based IR, MW, and DIAL observations using an optimal-estimation retrieval framework, quantifying the reduction in the uncertainty in the retrieved profiles and the increase in information content as additional observations are added to IR-only and MW-only retrievals. This study uses ground-based observations collected during the Perdigão field campaign in central Portugal in 2017 and during the DIAL demonstration campaign at the Atmospheric Radiation Measurement Southern Great Plains site in 2017. The results show that the information content in both temperature and water vapor is higher for the IR instrument relative to the MW instrument (thereby resulting in smaller uncertainties) and that the combined IR + MW retrieval is very similar to the IR-only retrieval below 1.5 km. However, including the partial profile of water vapor observed by the DIAL increases the information content in the combined IR + DIAL and MW + DIAL water vapor retrievals substantially, with the exact impact vertically depending on the characteristics of the DIAL instrument itself. Furthermore, there is a slight increase in the information content in the retrieved temperature profile using the IR + DIAL relative to the IR-only; this was not observed in the MW + DIAL retrieval.
Abstract. Given the importance of constraining cloud droplet number concentrations (Nd) in low-level clouds, we explore two methods for retrieving Nd from surface-based remote sensing that emphasize the information content in lidar measurements. Because Nd is the zeroth moment of the droplet size distribution (DSD), and all remote sensing approaches respond to DSD moments that are at least 2 orders of magnitude greater than the zeroth moment, deriving Nd from remote sensing measurements has significant uncertainty. At minimum, such algorithms require the extrapolation of information from two other measurements that respond to different moments of the DSD. Lidar, for instance, is sensitive to the second moment (cross-sectional area) of the DSD, while other measures from microwave sensors respond to higher-order moments. We develop methods using a simple lidar forward model that demonstrates that the depth to the maximum in lidar-attenuated backscatter (Rmax) is strongly sensitive to Nd when some measure of the liquid water content vertical profile is given or assumed. Knowledge of Rmax to within 5 m can constrain Nd to within several tens of percent. However, operational lidar networks provide vertical resolutions of > 15 m, making a direct calculation of Nd from Rmax very uncertain. Therefore, we develop a Bayesian optimal estimation algorithm that brings additional information to the inversion such as lidar-derived extinction and radar reflectivity near the cloud top. This statistical approach provides reasonable characterizations of Nd and effective radius (re) to within approximately a factor of 2 and 30 %, respectively. By comparing surface-derived cloud properties with MODIS satellite and aircraft data collected during the MARCUS and CAPRICORN II campaigns, we demonstrate the utility of the methodology.
Entrainment is a crucial component of the atmospheric boundary layer (BL) moisture and heat budget. While usually thought of as only entrainment flux, entrainment within the mixed layer budget equation is really composed of two terms: the flux of a property across the boundary separating the BL from the free troposphere and the change in the concentration of a property as the depth of the BL changes. In a recent study, Wakefield et al. (2023) used ground-based remote-sensing observations to estimate entrainment flux as the residual of a mixing diagram framework that was applied to the daytime convective boundary layer. This present work uses large-eddy simulation (LES) to examine how well this residual assumption for entrainment fluxes alone compares to the actual sum of those two entrainment terms derived from spatial averages of the LES output. We highlight the importance of the second entrainment term in closing the mixed layer budget and show that the residual assumption does not represent entrainment flux only but rather a total entrainment term when the boundary layer depth is changing.
Abstract This study investigates the occurrence of mixed‐phase clouds (MPC, i.e., cloud layers containing both liquid and ice water at sub‐freezing temperatures) over the Southern Ocean (SO) using space‐ and surface‐based lidar and radar observations. The occurrence of supercooled clouds is dominated by geometrically thin (<1 km) layers that rarely contain ice. We diagnose layers that are geometrically thicker than 1 km to contain ice ~65% and ~4% of the time from below by surface remote sensors and from above by orbiting remote sensors, respectively. We examine the discrepancy in MPC occurrence statistics as diagnosed from below and above the cloud layer. From above, we find that MPC occurrence has a gradient associated with the Antarctic Polar Front near 55°S with a rare occurrence of satellite‐derived MPC south of that latitude. In contrast, surface sensors find ice in 33% of supercooled liquid water layers. We infer using observing system simulation experiments and data analysis that space‐based lidar cannot identify the occurrence of MPC except when secondary ice‐forming processes operate in convection that is, sufficiently strong to loft ice crystals to cloud tops. We conclude that the CALIPSO phase statistics of MPC have a severe low bias in MPC occurrence. Based on surface‐based statistics in the SO, we present a parameterization of the frequency of MPC as a function of cloud top temperature that differs substantially from that used in recent climate model simulations.
In real-time remote sensing application, frames of data are continuously flowing into the processing system. The capability of detecting objects of interest and tracking them as they move is crucial to many critical surveillance and monitoring missions. Detecting small objects using remote sensors is an ongoing, challenging problem. Since object(s) are located far away from the sensor, the target’s Signal-to-Noise-Ratio (SNR) is low. The Limit of Detection (LOD) for remote sensors is bounded by what is observable on each image frame. In this paper, we present a new method, a “Multi-frame Moving Object Detection System (MMODS)”, to detect small, low SNR objects that are beyond what a human can observe in a single video frame. This is demonstrated by using simulated data where our technology-detected objects are as small as one pixel with a targeted SNR, close to 1:1. We also demonstrate a similar improvement using live data collected with a remote camera. The MMODS technology fills a major technology gap in remote sensing surveillance applications for small target detection. Our method does not require prior knowledge about the environment, pre-labeled targets, or training data to effectively detect and track slow- and fast-moving targets, regardless of the size or the distance.
Big Data in the area of Remote Sensing has been growing rapidly. Remote sensors are used in surveillance, security, traffic, environmental monitoring, and autonomous sensing. Real-time detection of small moving targets using a remote sensor is an ongoing, challenging problem. Since the object is located far away from the sensor, the object often appears too small. The object’s signal-to-noise-ratio (SNR) is often very low. Occurrences such as camera motion, moving backgrounds (e.g., rustling leaves), low contrast and resolution of foreground objects makes it difficult to segment out the targeted moving objects of interest. Due to the limited appearance of the target, it is tough to obtain the target’s characteristics such as its shape and texture. Without these characteristics, filtering out false detections can be a difficult task. Detecting these targets, would often require the detector to operate under a low detection threshold. However, lowering the detection threshold could lead to an increase of false alarms. In this paper, the author will introduce a new method that improves the probability to detect low SNR objects, while decreasing the number of false alarms as compared to using the traditional baseline detection technique.
On-site wastewater treatment plants (OSTs) are usually unattended, so failures often remain undetected and lead to prolonged periods of reduced performance. To stabilize the performance of unattended plants, soft sensors could expose faults and failures to the operator. In a previous study, we developed soft sensors and showed that soft sensors with data from unmaintained physical sensors can be as accurate as soft sensors with data from maintained ones. The monitored variables were pH and dissolved oxygen (DO), and soft sensors were used to predict nitrification performance. In the present study, we use synthetic data and monitor three plants to test these soft sensors. We find that a long solids retention time and a moderate aeration rate improve the pH soft-sensor accuracy and that the aeration regime is the main operational parameter affecting the accuracy of the DO soft sensor. We demonstrate that integrated design of monitoring and control is necessary to achieve robustness when extrapolating from one OST to another in the absence of plant-specific fine-tuning. Additionally, we provide a unique labeled dataset for further feature and data-driven soft-sensor development. Our benchmarking results indicate that it is feasible to monitor OSTs with unmaintained sensors and without plant-specific tuning of the developed soft sensors. This is expected to drastically reduce monitoring costs for OST-based sanitation systems.
Leak rates of methane (CH 4 ) from the natural gas supply chain result in lost profit from unsold product, public safety and property concerns due to potential explosion hazards, and a potentially large source of economic damages from legal liabilities. Yet large measurement challenges exist in identifying and quantifying CH 4 leak rates along the vast number and type of components in the natural gas supply chain. This is particularly true of the “midstream” components involved in the gathering, processing, compression, transmission, and storage of natural gas. This project developed and deployed new advances in chirped laser dispersion spectroscopy (CLaDS) to detect methane leaks from pipelines, compressor stations, and other midstream infrastructure from a remote position (standoff detection). The system was deployed from a van to measure fugitive methane leaks from a local compressor station as a proof-of-concept. The technique was validated through mobile laboratory measurements with in-situ sensors as well as controlled releases of methane. The system also mapped a plume from a controlled release of methane by tracking a small unmanned aerial system (sUAS) that carried a corner cube retroreflector which reflected the beam back to the instrument. The drone-based system quantified a leak rate to within 30% of the actual rate and localized the emission location within 5 m of the actual release location at standoff distances of 25-45 m. This sUAS-reflector tracking approach has benefits for mapping leak locations remotely using small drones flying around a facility. Benefits of a commercial sensor with these capabilities include reductions of leaks for pipeline operators (more profit), earlier detection of leaks to avoid catastrophic explosion hazards for public health and to mitigate property damage, and reduced methane emissions to the atmosphere (improving air quality).
The mathematical algorithm to derive geophysical information from remote sensing observations is called a retrieval. The mathematics of many retrieval problems are ill-posed, and thus a priori information is used to help constrain the derived geophysical variable to realistic values. One quantity of interest, therefore, is the information content of the observation. Perfect information content in the observation would be achieved if the retrieval were able to capture any perturbation in the desired geophysical variable with the proper magnitude. Many new data products can be derived by combining geophysical variables retrieved from multiple different remote sensors. This paper explores, for the first time, how to derive the information content of these derived products. The approach uses traditional error propagation techniques to derive the uncertainty of the derived field twice, both when the observations are used in the retrieval and also when only the a priori information from each remote sensor is propagated. These two uncertainties are then used to provide an estimate of the information content of the derived geophysical variable. This study demonstrates how to propagate the uncertainties from six different instruments to provide the information content for water vapor and temperature advection. A multi-month analysis demonstrates that, in a mean sense, the information content for temperature advection is nearly unity for all heights below 700 m while, the information content for water vapor advection is somewhat more variable but still larger than 0.6 in the convective boundary layer.
Land-atmosphere carbon exchange is known to be extremely heterogeneous in arctic ice-wedge polygonal tundra regions. In this study, a Kalman filter-based method was developed to estimate the spatio-temporal dynamics of daytime average net ecosystem exchange (NEEday) at 0.5-m resolution over a 550 m by 700 m study site. We integrated multi-scale, multi-type datasets, including normalized difference vegetation indices (NDVIs) obtained from a novel automated mobile sensor system (or tram system) and a greenness index map obtained from airborne imagery. We took advantage of the significant correlations between NDVI and NEEday identified based on flux chamber measurements. The weighted average of the estimated NEEday within the flux-tower footprint agreed with the flux tower data in term of its seasonal dynamics. We then evaluated the spatial variability of the growing season average NEEday, as a function of polygon geomorphic classes; i.e., the combination of polygon types—which are known to present different degradation stages associated with permafrost thaw—and microtopographic features (i.e., troughs, centers and rims). Our study suggests the importance of considering microtopographic features and their spatial coverage in computing spatially aggregated carbon exchange.
A remote sensor system comprising a laser transmitter that emits a pulse of broadband laser illumination comprising a plurality of wavelengths and a receiver configured to detect laser illumination backscatter. The sensor system further includes a computing system configured to determine a plurality of species number densities along a travel path of the laser illumination. Determining the plurality of species number densities includes determining a first number density of a first species based on a first set of optical transmission values from the backscatter data for a first subset of wavelengths of the plurality of wavelengths and a first attenuation cross-section of the first species. Additional species are determined based on additional sets of optical transmission values from the backscatter data for additional subsets of wavelengths of the plurality of wavelengths and additional cross-sections of additional species.
Tardigrade is an effort to create small, passive remote sensor for material detection and identification. The microbolometer based sensor design uses custom bandpass filter bands combined with tuned thermal expansion materials in a ruggedized lens housing to provide passive mechanical correction for optical changes across a wide temperature range. This requires developing computational tools to model and predict thermal performance of meta-materials composed of multiple structured base materials and void-space, along with matching and developing 3D print technology to demonstrate the housing. Current efforts in the project are in 3 areas: material design algorithm development (transitioning into full 3D material design space), multi-material additive manufacturing process exploration, and sensor/optics design and engineering.
Over the last 15 years, compressive sensing techniques have been developed which have the potential to greatly reduce the amount of data collected by systems while preserving the amount of information obtained. A cost of this efficiency is that a computationally-intensive optimization routine must be used to put the sensed data into a form that a person can interpret. At the same time, machine learning techniques have experienced tremendous growth as well. Machines have demonstrated the ability learn how to effectively perform tasks such as detection and classification at speeds much faster than humanly possible. Our goal in this project was to study the feasibility of using compressive sensing systems "at the edge." That is, how can compressive sensing sensors be deployed such that information is created at the remote sensor rather than sending raw data to a central processing location? Studies were performed to analyze whether machine learning could be done on the compressively sensed data in its raw form. If a machine is performing the task, is it possible to do so without putting the data into a human interpretable form? We show that this is possible for some systems, in particular a compressive sensing snapshot imaging spectrometer. Machine learning tasks were demonstrated to be more effective and more robust to noise when the machine learning algorithm worked on data in its raw form. This system is shown to outperform a traditional spectrometer. Techniques for reducing the complexity of the reconstruction routine were also analyzed. Techniques for such as data regularization, deep neural networks, and matrix completion were studied and shown to have benefits over traditional reconstruction techniques. In this project we showed that compressive sensing sensors are indeed feasible at the edge. As always, sensors and algorithms must be carefully tuned to work in the constrained environment. In this project we developed tools and techniques to enable those analyses.
This paper reviews the current state of high‐resolution remotely sensed soil moisture (SM) and evapotranspiration (ET) products and modeling, and the coupling relationship between SM and ET. SM downscaling approaches for satellite passive microwave products leverage advances in artificial intelligence and high‐resolution remote sensing using visible, near‐infrared, thermal‐infrared, and synthetic aperture radar sensors. Remotely sensed ET continues to advance in spatiotemporal resolutions from MODIS to ECOSTRESS to Hydrosat and beyond. These advances enable a new understanding of bio‐geo‐physical controls and coupled feedback mechanisms between SM and ET reflecting the land cover and land use at field scale (3–30 m, daily). Still, the state‐of‐the‐science products have their challenges and limitations, which we detail across data, retrieval algorithms, and applications. We describe the roles of these data in advancing 10 application areas: drought assessment, food security, precision agriculture, soil salinization, wildfire modeling, dust monitoring, flood forecasting, urban water, energy, and ecosystem management, ecohydrology, and biodiversity conservation. We discuss that future scientific advancement should focus on developing open‐access, high‐resolution (3–30 m), sub‐daily SM and ET products, enabling the evaluation of hydrological processes at finer scales and revolutionizing the societal applications in data‐limited regions of the world, especially the Global South for socio‐economic development.
Advanced scientific applications require coupling distributed sensor networks with centralized high-performance computing facilities. Citrus Under Protective Screening (CUPS) exemplifies this need in digital agriculture, where citrus research facilities are instrumented with numerous sensors monitoring environmental conditions and detecting protective screening damage. CUPS demands access to computational fluid dynamics codes for modeling environmental conditions and guiding real-time interventions like water application or robotic repairs. These computing domains have contrasting properties: sensor networks provide low-performance, limited-capacity, unreliable data access, while high-performance facilities offer enormous computing power through high-latency batch processing. Private 5G networks present novel capabilities addressing this challenge by providing low latency, high throughput, and reliability necessary for near-real-time coupling of edge sensor networks with HPC simulations. This work presents xGFabric, an end-to-end system coupling sensor networks with HPC facilities through Private 5G networks. The prototype connects remote sensors via 5G network slicing to HPC systems, enabling real-time digital agriculture simulation.