Search NASA⌕ Search

SEARCH · Search NASA

Results for “sensor data validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,135 records · Page 63

Mars2020 Entry, Descent, and Landing Instrumentation (MEDLI2): Science Objectives and Instrument Requirements

NASAs exploration and technology roadmaps call for capability advancements in Mars entry, descent, and landing (EDL) systems to enable increased landed mass, a higher landing precision, and a wider planetary access. It is also recognized that these ambitious EDL performance goals must be met while maintaining a low mission risk in order to pave the way for future human missions. As NASA is engaged in developing new EDL systems and technologies via testing at Earth, instrumentation of existing Mars missions is providing valuable engineering data for performance improvement, risk reduction, and an improved definition of entry loads and environment. The most notable recent example is the Mars Entry, Descent and Landing Instrument (MEDLI) suite hosted by Mars Science Laboratory for its entry in Aug 2012. The MEDLI suite provided a comprehensive dataset for Mars entry aerodynamics, aerothermodynamics and thermal protection system (TPS) performance. MEDLI data has since been used for unprecedented reconstruction of aerodynamic drag, vehicle attitude, in-situ atmospheric density, aerothermal heating, and transition to turbulence, in-depth TPS performance and TPS ablation. [1,2] In addition to validating predictive models, MEDLI data has demonstrated extra margin available in the MSL forebody TPS, which can potentially be used to reduce vehicle parasitic mass. The presentation will introduce a follow-on MEDLI instrumentation suite (called MEDLI2) that is being developed for Mars-2020 mission. MEDLI2 has an enhanced scope that includes backshell instrumentation, a wider forebody coverage, and instruments that specifically target supersonic aerodynamics. Similar to MEDLI, MEDLI2 uses thermal plugs with embedded thermocouples and ports through the TPS to measure surface pressure. MEDLI2, however, also includes heat flux sensors in the backshell and a low range pressure transducer to measure afterbody pressure.

Aerothermodynamics↗

Dry in-pile fracture test (DRIFT) for separate-effects validation of ceramic fuel fracture models

Fracture is an important component of nuclear fuel behavior, and significant efforts have been invested into developing fuel performance models that are capable of accurately representing fracture. Usable data on the process of fracture propagation in nuclear fuel under realistic service conditions are very limited. To address this need, a series of separate-effects experiments were developed and performed at Idaho National Laboratory's Transient Reactor Test (TREAT) facility. These experiments employ a heat sink to radially remove heat from the fuel in a manner that approximates the effect of coolant in an operating light-water reactor (LWR). The test holder for these experiments is known as the Dry In-pile Fracture Test (DRIFT). A series of experiments employing DRIFT and TREAT were performed to provide data on the extent and nature of fracture in fresh fuel at various points during a ramp to full power. Novel aspects of these experiments include the way they employ a heat sink to replicate steady-state LWR conditions, as well as the use of fiber optic sensors for in-reactor thermal instrumentation. Details on the development of this experiment, experimental conditions, and resulting data (including in situ thermal measurements and post-irradiation imaging of fracture) are provided in this work. LWR-equivalent powers ranging from 10 to 25 kW/m were tested using this apparatus. Cracking was visible at all power levels, with increasing cracking extent as the power level increased, although there was little difference in the cracking between the two highest-power tests, which had LWR-equivalent powers of 20 and 25 kW/m.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Validation of Special Sensor Microwave Imager monthly-mean wind speed from July 1987 to December 1989

Since July 1987, the Remote Sensing Systems (Santa Rosa, California) routinely computes from first principles the wind speed from Special Sensor Microwave Imager (SSM/I) measurements of the intensity of microwave radiation emitted at the ocean surface. The accuracy of monthly-mean SSM/I wind speeds is determined by comparisons with moored-buoy wind measurements, which were recorded by four different institutions at 44 sites in the Atlantic and Pacific Oceans during July 1987 to December 1989. All results for 1988 were virtually identical with 1989. The range of monthly mean moored-buoy wind speeds was 2-10 m/s. The rms difference of 697 monthly-mean matchups of the composite 1988 and 1989 data set was 1.2 m/s. The rms differences were smaller in the equatorial zone and higher in middle latitudes, in accord with the monthly standard deviation. At middle latitudes, the time series of rms differences displayed an annual cycle. In the equatorial zone, the agreement between SSM/I and in situ data was better in regions with a lesser amount of clouds, and vice versa. For SSM/I monthly standard deviations of 1-2, 2-3, and 3-4 m/s, the average absolute values of the monthly-mean difference between SSM/I and moored-buoy wind speeds were 0.6, 0.9, and 1.4 m/s, respectively.

Halpern, David↗

Atmospheric Boundary Layer Sensors for Application in a Wake Vortex Advisory System

Remote sensing of the atmospheric boundary layer has advanced in recent years with the development of commercial off-the-shelf (COTS) radar, sodar, and lidar wind profiling technology. Radio acoustic sounding systems for vertical temperature profiles of high temporal scales (when compared to routine balloon soundings- (radiosondes) have also become increasingly available as COTS capabilities. Aircraft observations during landing and departures are another source of available boundary layer data. This report provides an updated assessment of available sensors, their performance specifications and rough order of magnitude costs for a potential future aircraft Wake Vortex Avoidance System (WakeVAS). Future capabilities are also discussed. Vertical profiles of wind, temperature, and turbulence are anticipated to be needed at airports in any dynamic wake avoidance system. Temporal and spatial resolution are dependent on the selection of approach and departure corridors to be protected. Recommendations are made for potential configurations of near-term sensor technologies and for testing some of the sensor systems in order to validate performance in field environments with adequate groundtruth.

Zak, J. Allen↗

Real-Time Integrity Monitoring of Stored Geo-Spatial Data Using Forward-Looking Remote Sensing Technology

Terrain Awareness and Warning Systems (TAWS) and Synthetic Vision Systems (SVS) provide pilots with displays of stored geo-spatial data (e.g. terrain, obstacles, and/or features). As comprehensive validation is impractical, these databases typically have no quantifiable level of integrity. This lack of a quantifiable integrity level is one of the constraints that has limited certification and operational approval of TAWS/SVS to "advisory-only" systems for civil aviation. Previous work demonstrated the feasibility of using a real-time monitor to bound database integrity by using downward-looking remote sensing technology (i.e. radar altimeters). This paper describes an extension of the integrity monitor concept to include a forward-looking sensor to cover additional classes of terrain database faults and to reduce the exposure time associated with integrity threats. An operational concept is presented that combines established feature extraction techniques with a statistical assessment of similarity measures between the sensed and stored features using principles from classical detection theory. Finally, an implementation is presented that uses existing commercial-off-the-shelf weather radar sensor technology.

Young, Steven D.↗

Further Development of Ko Displacement Theory for Deformed Shape Predictions of Nonuniform Aerospace Structures

The Ko displacement theory previously formulated for deformed shape predictions of nonuniform beam structures is further developed mathematically. The further-developed displacement equations are expressed explicitly in terms of geometrical parameters of the beam and bending strains at equally spaced strain-sensing stations along the multiplexed fiber-optic sensor line installed on the bottom surface of the beam. The bending strain data can then be input into the displacement equations for calculations of local slopes, deflections, and cross-sectional twist angles for generating the overall deformed shapes of the nonuniform beam. The further-developed displacement theory can also be applied to the deformed shape predictions of nonuniform two-point supported beams, nonuniform panels, nonuniform aircraft wings and fuselages, and so forth. The high degree of accuracy of the further-developed displacement theory for nonuniform beams is validated by finite-element analysis of various nonuniform beam structures. Such structures include tapered tubular beams, depth-tapered unswept and swept wing boxes, width-tapered wing boxes, and double-tapered wing boxes, all under combined bending and torsional loads. The Ko displacement theory, combined with the fiber-optic strain-sensing system, provide a powerful tool for in-flight deformed shape monitoring of unmanned aerospace vehicles by ground-based pilots to maintain safe flights.

Ko, William L.↗

Australian Soil Moisture Field Experiments in Support of Soil Moisture Satellite Observations

Large-scale field campaigns provide the critical fink between our understanding retrieval algorithms developed at the point scale, and algorithms suitable for satellite applications at vastly larger pixel scales. Retrievals of land parameters must deal with the substantial sub-pixel heterogeneity that is present in most regions. This is particularly the case for soil moisture remote sensing, because of the long microwave wavelengths (L-band) that are optimal. Yet, airborne L-band imagers have generally been large, heavy, and required heavy-lift aircraft resources that are expensive and difficult to schedule. Indeed, US soil moisture campaigns, have been constrained by these factors, and European campaigns have used non-imagers due to instrument and aircraft size constraints. Despite these factors, these campaigns established that large-scale soil moisture remote sensing was possible, laying the groundwork for satellite missions. Starting in 2005, a series of airborne field campaigns have been conducted in Australia: to improve our understanding of soil moisture remote sensing at large scales over heterogeneous areas. These field data have been used to test and refine retrieval algorithms for soil moisture satellite missions, and most recently with the launch of the European Space Agency's Soil Moisture Ocean Salinity (SMOS) mission, to provide validation measurements over a multi-pixel area. The campaigns to date have included a preparatory campaign in 2005, two National Airborne Field Experiments (NAFE), (2005 and 2006), two campaigns to the Simpson Desert (2008 and 2009), and one Australian Airborne Cal/val Experiment for SMOS (AACES), just concluded in the austral spring of 2010. The primary airborne sensor for each campaign has been the Polarimetric L-band Microwave Radiometer (PLMR), a 6-beam pushbroom imager that is small enough to be compatible with light aircraft, greatly facilitating the execution of the series of campaigns, and a key to their success. An L-band imaging radar is being added to the complement to provide simultaneous active-passive L-band observations, for algorithm development activities in support of NASA's upcoming Soil Moisture Active Passive (.S"M) mission. This paper will describe the campaigns, their objectives, their datasets, and some of the unique advantages of working with small/light sensors and aircraft. We will also review the main scientific findings, including improvements to the SMOS retrieval algorithm enabled by NAFE observations and the evaluation of the Simpson Desert as a calibration target for L-band satellite missions. Plans for upcoming campaigns will also be discussed.

Kim, Edward↗

A Methodology to Assess the Impact of Optical and Electronic Crosstalk in a New Generation of Sensors Using Heritage Sensors

Electronic and optical crosstalk are radiometric challenges that often exist in the focal plane design in many sensors Such as MODIS. A methodology is described to assess the impact due to optical and electronic crosstalk on the measured radiance, and thereafter, the retrieval of geophysical products using MODIS Level I data sets. Based on a postulated set of electronic and optical crosstalk coefficients, and a set of MODIS scenes, we have simulated a system signal contamination on any detector on a focal plane when another detector on that focal plane is stimulated with a geophysical signal. The original MODIS scenes and the crosstalk impacted scenes can be used with validated geophysical algorithms to derive the final data products. Products contaminated with crosstalk are then compared to those without contamination to assess the impact magnitude and location, and will allow us to separate Out-Of-Band (OOB) leaks from hand-to-hand optical crosstalk, and identify potential failures to meet climate research requirements.

Oudrari, Hassan↗

Experimental validation of a high voltage pulse measurement method.

This report describes X-cut lithium niobate s (LiNbO3) utilization for voltage sensing by monitoring the acoustic wave propagation changes through LiNbO3 resulting from applied voltage. Direct current (DC), alternating current (AC) and pulsed voltage signals were applied to the crystal. Voltage induced shift in acoustic wave propagation time scaled quadratically for DC and AC voltages and linearly for pulsed voltages. The measured values ranged from 10 - 273 ps and 189 ps 2 ns for DC and non-DC voltages, respectively. Data suggests LiNbO3 has a frequency sensitive response to voltage. If voltage source error is eliminated through physical modeling from the uncertainty budget, the sensor s U95 estimated combined uncertainty could decrease to ~0.025% for DC, AC, and pulsed voltage measurements.

Cular, Stefan↗

Validation of the Version 1 NOAA/NASA Pathfinder Sea Surface Temperature Data Set

A high-resolution, global satellite-derived sea surface temperature (SST) data set called Pathfinder, from the Advanced Very High Resolution Radiometer (AVHRR) aboard the NOAA Polar Orbiters, is available from the Jet Propulsion Laboratory Physical Oceanography Distributed Active Archive Center (JPL PO.DAAC). Suitable for research as well as education, the Pathfinder SST data set is a result of a collaboration between the National Oceanographic and Atmospheric Administration (NOAA), the National Aeronautics and Space Administration (NASA) and investigators at several universities. NOAA and NASA are the sponsors of the Pathfinder Program, which takes advantage of currently archived Earth science data from satellites. Where necessary, satellite sensors have been intercalibrated, algorithms improved and processing procedures revised, in order to produce long time-series, global measurements of ocean, land and atmospheric properties necessary for climate research. Many Pathfinder data sets are available to researchers now, nearly a decade before the first launch of NASA's Earth Observing System (EOS). The lessons learned from the Pathfinder programs will facilitate the processing and management of terabytes of data from EOS. The Oceans component of Pathfinder has undertaken to reprocess all Global Area Coverage (GAC) data acquired by the 5-channel AVHRRs since 1981. The resultant data products are consistent and stably calibrated [Rao, 1993a, Rao, 1993b, Brown et al., 1993], Earth-gridded SST fields at a variety of spatial and temporal resolutions.

Smith, Elizabeth A.↗

On the Use of Deep Convective Clouds to Calibrate AVHRR Data

Remote sensing of cloud and radiation properties from National Oceanic and Atmospheric Administration (NOAA) Advanced Very High Resolution Radiometer (AVHRR) satellites requires constant monitoring of the visible sensors. NOAA satellites do not have onboard visible calibration and need to be calibrated vicariously in order to determine the calibration and the degradation rate. Deep convective clouds are extremely bright and cold, are at the tropopause, have nearly a Lambertian reflectance, and provide predictable albedos. The use of deep convective clouds as calibration targets is developed into a calibration technique and applied to NOAA-16 and NOAA-17. The technique computes the relative gain drift over the life-span of the satellite. This technique is validated by comparing the gain drifts derived from inter-calibration of coincident AVHRR and Moderate-Resolution Imaging Spectroradiometer (MODIS) radiances. A ray-matched technique, which uses collocated, coincident, and co-angled pixel satellite radiance pairs is used to intercalibrate MODIS and AVHRR. The deep convective cloud calibration technique was found to be independent of solar zenith angle, by using well calibrated Visible Infrared Scanner (VIRS) radiances onboard the Tropical Rainfall Measuring Mission (TRMM) satellite, which precesses through all solar zenith angles in 23 days.

Doelling, David R.↗

Analysis of Smart Composite Structures Including Debonding

Smart composite structures with distributed sensors and actuators have the capability to actively respond to a changing environment while offering significant weight savings and additional passive controllability through ply tailoring. Piezoelectric sensing and actuation of composite laminates is the most promising concept due to the static and dynamic control capabilities. Essential to the implementation of these smart composites are the development of accurate and efficient modeling techniques and experimental validation. This research addresses each of these important topics. A refined higher order theory is developed to model composite structures with surface bonded or embedded piezoelectric transducers. These transducers are used as both sensors and actuators for closed loop control. The theory accurately captures the transverse shear deformation through the thickness of the smart composite laminate while satisfying stress free boundary conditions on the free surfaces. The theory is extended to include the effect of debonding at the actuator-laminate interface. The developed analytical model is implemented using the finite element method utilizing an induced strain approach for computational efficiency. This allows general laminate geometries and boundary conditions to be analyzed. The state space control equations are developed to allow flexibility in the design of the control system. Circuit concepts are also discussed. Static and dynamic results of smart composite structures, obtained using the higher order theory, are correlated with available analytical data. Comparisons, including debonded laminates, are also made with a general purpose finite element code and available experimental data. Overall, very good agreement is observed. Convergence of the finite element implementation of the higher order theory is shown with exact solutions. Additional results demonstrate the utility of the developed theory to study piezoelectric actuation of composite laminates with pre-existing debonding. Significant changes in the modes shapes and reductions in the control authority result due to partially debonded actuators. An experimental investigation addresses practical issues, such as circuit design and implementation, associated with piezoelectric sensing and actuation of composite laminates. Composite specimens with piezoelectric transducers were designed, constructed and tested to validate the higher order theory. These specimens were tested with various stacking sequences, debonding lengths and gains for both open and closed loop cases. Frequency changes of 15% and damping on the order of more than 20% of critical damping, via closed loop control, was achieved. Correlation with the higher order theory is very good. Debonding is shown to adversely affect the open and closed loop frequencies, damping ratios, settling time and control authority.

Chattopadhyay, Aditi↗

Food Quality and Phytoplankton Community Composition in San Francisco Bay using Imaging Spectroscopy Data from the California HyspIRI Airborne Campaign

The San Francisco Bay (SFB) is the largest estuary on the west coast of the United States. It is an important transition zone between marine, freshwater, and inland terrestrial watersheds. The SFB is an important region for the cycling of nutrients and pollutants and it supports nurseries of ecologically and commercially important fisheries, including some threatened species. Phytoplankton community structure influences food web dynamics, and the taxonomy of the phytoplankton may be more important in determining primary food quality than environmental factors. As such, estimating food quality from phytoplankton community composition can be a robust tool to understand trophic transfer of energy. Recent work explores phytoplankton food quality in SFB through the use of microscopy and phytoplankton chemotaxonomy to evaluate how changes in phytoplankton composition may have influenced the recent trophic collapse of pelagic fishes in the northern part of the SFB. The objective of this study is to determine if the approach can also be applied to imaging spectroscopy data in order to quantify phytoplankton food quality from space. Imaging spectroscopy data of SFB from the Airborne VisibleInfrared Imaging Spectrometer (AVIRIS) was collected during the Hyperspectral Infrared (HyspIRI) Airborne Campaign in California (2013 2015) and used in this study. Estimates of ocean chlorophyll and phytoplankton community structure were determined using standard ocean chlorophyll algorithms and the PHYtoplankton Detection with Optics (PHYDOTax) algorithms. These were validated using in situ observations of phytoplankton composition using microscopic cell counts and phytoplankton chemotaxonomy from the US Geological Surveys ship surveys of the SFB. The findings from this study may inform the use of future high spectral resolution satellite sensors with the spatial resolution appropriate for coastal systems (e.g., HyspIRI) to assess food quality from space.

HyspIRI↗

Automated Assembly Progress Monitoring in Modular Construction Factories Using Computer Vision-Based Instance Segmentation

Modular construction has recently gained interest as a transformative construction method. In this method, a large portion of the construction is performed inside factories, where processes are fast-paced and interdependent; therefore, any deviation from the schedule can delay the production. Such deviations are frequent in modular factories due to the labor-intensive nature of the tasks. This propagation of delays can be mitigated by continuously monitoring each process; however, current manual monitoring methods are laborious, and recently proposed contact sensor-based methods are intrusive to the work. In addition, recent computer vision-based monitoring methods inside factories are limited to detection algorithms that fail to provide the pixel-level accuracy required for assembly progress monitoring in highly occluded factory scenes, and they require a large number of manual annotations. Therefore, this paper proposes a method to monitor the installation of subassemblies in modular construction factories using mask R-CNN instance segmentation and improves the data efficiency of the model using a copy-paste augmentation method. This method was validated on the CCTV videos captured from a modular construction factory in the US, resulting in a 9% mAP improvement in segmentation.

computer vision↗

Uniform and Half‐Space Models for Magnetic Dipole Sources in a Conducting Medium: I. Theory and Results

Underground nuclear events result in electromagnetic signals near the event location. Of particular interest, because its signal can be potentially enhanced by the use of large cavities to decouple the seismic signal, is the generation of an EMP signal within the nuclear detonation (NUDET) cavity, from the formation of a bubble in the local magnetic field. This mechanism is equivalent to a buried time varying magnetic dipole. In order to model such signals Los Alamos National Laboratory is developing a detailed model for the propagation of RF signals from buried sources to nearby sensors, with a focus on sources that are magnetic dipole in character. In order to validate this code, models for simple geometries involving magnetic dipole sources have been implemented. These models represent the fields from vertical and horizontal dipoles in cylindrical coordinates, either in a uniform linear isotropic electrical medium, or in a space consisting of two half spaces interfacing at the plane z=0, with the upper half space having the electrical properties of free space and the lower half space having arbitrary linear conductivity and electrical permittivity. While primarily intended for the validation of the more detailed model, the shorter turnaround time of these models facilitates the study of the general properties of geomagnetic bubble signals. This report summarizes the theory and example results for those models. The use of the model for model validation is illustrated with the near and surface fields for dipoles with Gaussian time dependence. Also examined are the surface fields expected for the geomagnetic bubble predicted by the numerical model of Kovalenko et al for a 1 kt nuclear detonation. The model of Kovalenko et al was also rescaled to allow comparison with Zablocki’s electric field observations for Bilby, Event III, and Event V. While the rescaled Kovalenko et al model had approximately the right time scale for the duration of the main peak, and a slower fall than rise also in qualitative agreement with the observations, the predicted signals had very different polarizations, were too low by more than an order of magnitude, and had less temporal structure. A simple comparison with the vertical B field data of Sweeney, where the detailed event geometries and yields are classified, but the sensor range and bounds on the yields are given, suggest that the scaled Kovalenko et al model gives too small a peak field compared to observations for that data set as well, except perhaps for the Borate event. A companion report will give a detailed discussion of the implementation and code.

58 GEOSCIENCES↗

PRIMED for the Future: Purposing Raw Intake for Machine Learning-Enabled Detection (Final Report)

The COVID-19 pandemic demonstrated how a novel, elusive, and diffuse biological threat can engender uncertainty and misinformation, and it underscored the need for flexible analytical modalities agnostic to the identity of biological material. Yet even before the pandemic, recognition of the limitations of the current, list-based approach, which focuses on known pathogens and biotoxins, and of the importance of agent-agnostic biodetection was growing within the biosecurity community. In a 2018 report on “Biodefense in the Age of Synthetic Biology,” for example, the National Academy of Sciences stated that “an overreliance on the Select Agent List is a systematic weakness affecting many aspects of the United States’ current biodefense mitigation capability”. More recently, a group of biodefense researchers proposed the identification and adoption of “bioagent-agnostic signatures (BASs)” as a way of detecting and characterizing not only existing agents but also novel ones, an approach they believe will “enable a more flexible and resilient biodefense posture”. Indeed, the future of biodetection requires us to begin developing novel analytics that can identify anomalies and/or characteristics that indicate a potential threat, whether known or unknown, without looking for a specific signature that has been identified previously. To assess potential threats more rapidly, it is critical to develop agnostic artificial intelligence (AI)/machine learning (ML) systems that can be employed for real-time assessment of the nature and source of a perturbation. Such systems should be multi scale and multi-dimensional, integrating sensor data from a range of biological, chemical, and physical application spaces. Emerging deep learning (DL) models demonstrate exceptional promise for identification of discriminatory features within multi-dimensional datasets. DL models have the capacity to recognize and encode highly complex patterns in a wide range of input data modalities, including images, text, and biological/chemical/physical spectra. As such, they can execute a wide range of assessments and determinations that have traditionally required a human operator. The promise of advances in DL is apparent in the realm of human health and medicine. DL models have been validated for evaluating a variety of clinical threats to human health in a range of contexts, including infection and cancer, and they demonstrated improved performance in predicting stroke relative to human neurologists in some categories of data. Continuously evolving advances in AI/ML are expected to support more efficient evaluation of raw sequence, spectroscopy, and spectrometry data. For instance, recent advances and deployment of large language models (LLM) such as Generative Pre training Transformer (GPT) and Bidirectional Encoder Representations from Transformers (BERT) have already motivated application of these models for biological function prediction. As frameworks such as LLMs become larger and more complex in their representations, their capacity to serve as pre-trained models that can be fine-tuned for biological/biodetection purposes will similarly be amplified. While existing and emerging AI/ML have found broad applicability and use cases in the clinical sciences, development for environmental evaluation and biodetection has been limited. Functionalizing such capabilities for this purpose requires an understanding of the existing technical landscape and how the respective tools and algorithms are currently being employed. This landscape awareness then allows an assessment of the current practical capabilities of existing models and the anticipated requirements and development efforts that will be needed to adapt available algorithms for biodetection applications relevant to DHS. Leveraging expertise in biodetection, ML, and operational biodetection, the effort described in this report is comprised of a systematic landscape assessment (Subtask 2.1), comparative evaluation (Subtask 2.2), and formulation of a value proposition (Subtask 2.3) for the prospect of ML-enabled, agnostic biodetection from raw, or minimally-processed, datasets.

59 BASIC BIOLOGICAL SCIENCES↗

Piloted Well Clear Performance Evaluation of Detect and Avoid Systems with Suggestive Guidance

Regulations to establish operational and performance requirements for unmanned aircraft systems (UAS) are being developed by a consortium of government, industry and academic institutions (RTCA, 2013). Those requirements will apply to the new detect-and-avoid (DAA) systems and other equipment necessary to integrate UAS with the United States (U.S) National Airspace System (NAS) and will be determined according to their contribution to the overall safety case. That safety case requires demonstration that DAA-equipped UAS collectively operating in the NAS meet an airspace safety threshold (AST). Several key gaps must be closed in order to link equipment requirements to an airspace safety case. Foremost among these is calculation of the systems risk ratio, the degree to which a particular system mitigates violation of an aircraft separation standard (FAA, 2013). The risk ratio of a DAA system, in combination with risk ratios of other collision mitigation mechanisms, will determine the overall safety of the airspace measured in terms of the number of collisions per flight hour. It is not known what the effectiveness is of a pilot-in-the-loop DAA system or even what parameters of the DAA system most improve the pilots ability to maintain separation. The relationship between the DAA system design and the overall effectiveness of the DAA system that includes the pilot, expressed as a risk ratio, must be determined before DAA operational and performance requirements can be finalized. Much research has been devoted to integrating UAS into non-segregated airspace (Dalamagkidis, 2009, Ostwald, 2007, Gillian, 2012, Hesselink, 2011, Santiago, 2015, Rorie 2015 and 2016). Several traffic displays intended for use as part of a DAA system have gone through human-in-the-loop simulation and flight-testing. Most of these evaluations were part of development programs to produce a deployable system, so it is unclear how to generalize particular aspects of those designs to general requirements for future traffic displays (Calhoun, 2014). Other displays have undergone testing to collect data that may generalize to new displays, but have not been evaluated in the context of the development of an overall safety case for UAS equipped with DAA systems in the NAS (Bell, 2012). Other research efforts focus on DAA surveillance performance and separation standards. Together with this work, they are expected to facilitate validation of the airspace safety case (Park, 2014 and Johnson, 2015). The contribution of the present work is to quantify the effectiveness of the pilot-automation system to remain well clear as a function of display features and surveillance sensor error. This quantification will help enable selection of a minimum set of DAA design features that meets the AST, a set that may not be unique for all UAS platforms. A second objective is to collect and analyze pilot performance parameters that will improve the modeling of overall DAA system performance in non-human-in-the-loop simulations. Simulating the DAA-equipped UAS in such batch experiments will allow investigation of a much larger number of encounters than is possible in human simulations. This capability is necessary to demonstrate that a particular set of DAA requirements meets the AST under all foreseeable operational conditions.

detect and avoid↗

LOFTID Heat Flux Gauge Calibration: What is Truth?

The Low-Earth Orbit Flight Test of an Inflatable Decelerator (LOFTID) is a demonstration of Hypersonic Inflatable Aerodynamic Decelerator (HIAD) technology, which may enable the delivery of heavy payloads to Mars, Venus, and Titan, as well as return to Earth. Unlike rigid aeroshells that are constrained by the size of the rocket’s shroud, inflatable aeroshells can be deployed to a much larger scale, thus allowing a spacecraft to begin its deceleration earlier and experience less heating. On LOFTID, there will be 4 total heat flux gauges (HFG) with a range of 70 W/cm2 and 1 radiometer with a range of 3 W/cm2, arranged as shown in Fig. 1. Both the radiometer and total HFGs are Schmidt-Boelter gauges purchased from an external vendor. Radiative calibrations were performed in-house at NASA Ames’ Sensors and TPS Advanced Research Laboratories (STAR Labs) before and after environmental testing to investigate how the testing affected the sensors' response. Additional rounds of radiative calibration at STAR Labs were also performed in order to investigate the large uncertainties associated with these tests. For example, a survey of multiple calibration facilities concluded that the uncertainty within a given facility was +/-3% [1]. An additional NIST study that calibrated heat flux gauges at 7 different facilities also found the variation in calibration coefficients to be up to ~3% within a given facility, but up to 15% between facilities, suggesting systematic differences between test setups [2]. Finally, the response of heat flux gauges to radiative versus convective heat flux has shown to differ by up to 20% [3],[4]. Because the heat flux gauges on LOFTID will predominantly experience convective heat flux during flight, a convective calibration study was performed at Boeing's Large-Core Arc Tunnel (LCAT) facility. Radiative Calibration Procedure The calibrations performed at STAR Labs utilize a quartz lamp bank (QLB) that provides a maximum heat flux of 50 W/cm2, which bounds the expected LOFTID flight environment. The calibration involves exposing a water-cooled Gardon gauge (reference) and then the unit-under-test (UUT) to 5 different heat fluxes multiple times for 10 seconds each, and then calculating a linear fit. The test setup is shown in Fig. 2. The total HFGs were calibrated at STAR Labs 3 times, denoted as STAR 1 (before environmental testing), STAR 2 (after protoflight vibration and thermal-vacuum testing), and STAR 3 (no change from previous test). All 8 flight-lot total HFGs showed a decrease in full-scale output from STAR 1 to STAR 2 by between 0.5% and 10. The first portion of this investigation was to determine whether the change could be due to differences in temperature between the two calibration runs. A typical linear fit to the calibration data was performed using Eq. 1 where q’ is the heat flux in W/cm2, c is the calibration coefficient, and mV is the sensor output. To account for temperature, the data were fit to a nonlinear function that included both the sensor output (mV) and the temperature from the thermocouple embedded inside the HFG near the surface (T): q'=mV/(c1* T + c0}. The residuals between the fits and the actual data points were calculated for every point, and proven to be much smaller for the temperature-compensated fits than for the linear fits for all sensors. An example is shown in Fig. 3. When the temperature-compensated fits from STAR 1 were applied to the STAR 2 data, the residuals did not improve, suggesting that the change in sensitivity between these two calibration runs was not due to temperature. A third round of calibration (STAR 3) was conducted to further address the temperature dependence of the total HFGs, and the resulting sensitivities matched closely to STAR 2 (within 2%). Temperature-compensated calibration curves were once again fit to the data. In this case, when the temperature-compensated fits from STAR 3 were applied to STAR 2 data, the residuals between the fits and STAR 2 data were much lower than the residuals due to the linear fits. This suggests that the changes seen between STAR 1 and STAR 2 were likely due to actual changes in the sensors caused by the environmental testing between the two calibrations. A modification of the original calibration process, in which the UUT was exposed to each heat flux for just 3 seconds (instead of 10) to reduce the temperature increase during the test, was additionally performed on several of the HFGs. In general, the sensitivities were 1-1.5% lower than from the 10-second tests, but the temperatures were also significantly lower. When the temperature-compensated fits from the 10-second tests were applied to the 3-second test data, the residuals were greatly improved than when just using the linear fits, further suggesting that the temperature-compensated fits may lead to better accuracy than the linear fits in flight. Convective Calibration The second portion of this study was to create a mapping between the radiative and convective calibration coefficients. The majority of the heating during flight will be convective, so it is important to understand how the HFG response differs under these conditions. However, there are no standardized methods for convective calibration [5]. Because the TPS aerothermal response models were validated at LCAT, the same facility was chosen for convective calibration of two of the total HFGs (Fig. 4). Preliminary results showed that the full-scale output was 3% and 8% higher in convective heat flux as compared to radiative heat flux. However, tunnel variation may have contributed to noise and uncertainty in the measurements, and more testing and analysis remains to be done. Scope of Presentation The presentation will include an overview of the changes seen in HFG calibration before and after environmental testing, differences between radiative and convective calibrations, the modeling work done to aid in understanding the sensor response to varying environments, and recommended future work.

H S Alpert↗