Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25
All sourcesNASA NTRSDOE OSTI
NASA NTRS2012

Evaluating Three Active Thermal Architectures for Exploration Missions

Mass and cost are typically the two biggest challenges facing space craft designers. Active thermal control systems for crewed space-craft are typically among the more massive and costly systems on the vehicle. A study was completed evaluating three different thermal control system architectures to evaluate overall performance, mass and cost for a typical exploration mission profile. The architectures that were evaluated were 1 - a two-loop system using an internal liquid loop interfacing with an external liquid loop and flow loop with flow through radiators; 2 - a-single loop architecture with flow through radiators utilizing a regenerative heat exchanger and heater; and 3 - a single-loop architecture with heat pipe radiators. Environmental conditions, calculated for a given lunar exploration mission, and mission heat load profiles, generated based on previous Orion time lines, were evalauated through the phases of the on orbit mission. Performance for each of the architectures was evaluated along with the resultant mass of each system. Recommendations include adding a thermal topping system to lunar missions due to the extreme hot environments encountered in near-lunar approaches.

Cross, Cynthia D.↗
NASA NTRS2013

Evaluation of Ceramic Matrix Composite Technology for Aircraft Turbine Engine Applications

The goals of the NASA Environmentally Responsible Aviation (ERA) Project are to reduce the NO(x) emissions, fuel burn, and noise from turbine engines. In order to help meet these goals, commercially-produced ceramic matrix composite (CMC) components and environmental barrier coatings (EBCs) are being evaluated as parts and panels. The components include a CMC combustor liner, a CMC high pressure turbine vane, and a CMC exhaust nozzle as well as advanced EBCs that are tailored to the operating conditions of the CMC combustor and vane. The CMC combustor (w/EBC) could provide 2700 F temperature capability with less component cooling requirements to allow for more efficient combustion and reductions in NOx emissions. The CMC vane (w/EBC) will also have temperature capability up to 2700 F and allow for reduced fuel burn. The CMC mixer nozzle will offer reduced weight and improved mixing efficiency to provide reduced fuel burn. The main objectives are to evaluate the manufacturability of the complex-shaped components and to evaluate their performance under simulated engine operating conditions. Progress in CMC component fabrication, evaluation, and testing is presented in which the goal is to advance from the proof of concept validation (TRL 3) to a system/subsystem or prototype demonstration in a relevant environment (TRL 6).

Halbig, Michael C.↗
NASA NTRS2007

KSC Vertical Launch Site Evaluation

RS&H was tasked to evaluate the potential available launch sites for a combined two user launch pad. The Launch sites were to be contained entirely within current Kennedy Space Center property lines. The user launch vehicles to be used for evaluation are in the one million pounds of first stage thrust range. Additionally a second evaluation criterion was added early on in the study. A single user launch site was to be evaluated for a two million pound first stage thrust vehicle. Both scenarios were to be included in the report. To provide fidelity to the study criteria, a specific launch vehicle in the one million pound thrust range was chosen as a guide post or straw-man launch vehicle. The RpK K-1 vehicle is a current Commercial Orbital Transportation System (COTS), contract awardee along with the SpaceX Falcon 9 vehicle. SpaceX, at the time of writing, is planning to launch COTS and possibly other payloads from Cx-40 on Cape Canaveral Air Force Station property. RpK has yet to declare a specific launch site as their east coast US launch location. As such it was deemed appropriate that RpK's vehicle requirements be used as conceptual criteria. For the purposes of this study those criteria were marginally generalized to make them less specifiC.

Phillips, Lynne V.↗
NASA NTRS2014

Evaluation of the Sensor Data Record from the Nadir Instruments of the Ozone Mapping Profiler Suite (OMPS)

This paper evaluates the first 15 months of the Ozone Mapping and Profiler Suite (OMPS) Sensor Data Record (SDR) acquired by the nadir sensors and processed by the National Oceanic and Atmospheric Administration Interface Data Processing Segment. The evaluation consists of an inter-comparison with a similar satellite instrument, an analysis using a radiative transfer model, and an assessment of product stability. This is in addition to the evaluation of sensor calibration and the Environment Data Record product that are also reported in this Special Issue. All these are parts of synergetic effort to provide comprehensive assessment at every level of the products to ensure its quality. It is found that the OMPS nadir SDR quality is satisfactory for the current Provisional maturity. Methods used in the evaluation are being further refined, developed, and expanded, in collaboration with international community through the Global Space-based Inter-Calibration System, to support the upcoming long-term monitoring.

validation↗
NASA NTRS2015

Evaluation of the 7-km GEOS-5 Nature Run

This report documents an evaluation by the Global Modeling and Assimilation Office (GMAO) of a two-year 7-km-resolution non-hydrostatic global mesoscale simulation produced with the Goddard Earth Observing System (GEOS-5) atmospheric general circulation model. The simulation was produced as a Nature Run for conducting observing system simulation experiments (OSSEs). Generation of the GEOS-5 Nature Run (G5NR) was motivated in part by the desire of the OSSE community for an improved high-resolution sequel to an existing Nature Run produced by the European Centre for Medium-Range Weather Forecasts (ECMWF), which has served the community for several years. The intended use of the G5NR in this context is for generating simulated observations to test proposed observing system designs regarding new instruments and their deployments. Because NASA's interest in OSSEs extends beyond traditional weather forecasting applications, the G5NR includes, in addition to standard meteorological components, a suite of aerosol types and several trace gas concentrations, with emissions downscaled to 10 km using ancillary information such as power plant location, population density and night-light information. The evaluation exercise described here involved more than twenty-five GMAO scientists investigating various aspects of the G5NR performance, including time mean temperature and wind fields, energy spectra, precipitation and the hydrological cycle, the representation of waves, tropical cyclones and midlatitude storms, land and ocean surface characteristics, the representation and forcing effects of clouds and radiation, dynamics of the stratosphere and mesosphere, and the representation of aerosols and trace gases. Comparisons are made with observational data sets when possible, as well as with reanalyses and other long model simulations. The evaluation is broad in scope, as it is meant to assess the overall realism of basic aspects of the G5NR deemed relevant to the conduct of OSSEs. However, because of the relatively short record and other practical considerations, these comparisons cannot provide a definitive, statistically sound assessment of all model deficiencies, or guarantee the G5NR's suitability for all OSSE applications. Differences between the observed and simulated behavior also must be judged in the context of basic internal atmospheric variability which can introduce variations that are not necessarily controlled by the prescribed sea surface temperatures used in generating the G5NR. The results show that the G5NR performs well as measured by the majority of metrics applied in this evaluation. Particular benefits derived from the 7-km resolution of G5NR include realistic representations of extreme weather events in both the tropics and extratropics including tropical cyclones, Nor'easters and mesoscale convective complexes; improved representation of the diurnal cycle of precipitation over land; well-resolved surface-atmosphere interactions such as katabatic wind flows over Antarctica and Greenland; and resolution of orographically generated gravity waves that propagate into the upper atmosphere and influence the large scale circulation. Obvious deficiencies in the G5NR include a "splitting" of the inter-tropical convergence zone, which leads to a weaker-than-observed Hadley circulation and related deficiencies in the depiction of stationary wave patterns. Also, while the G5NR captures global cloud features and radiative effects well in general, close comparison with observations reveals higher-than-observed cloud brightness, likely due to an overabundance of cloud condensate; less distinct cloud minima in subtropical subsidence zones, consistent with a weak Hadley circualtion; and too few near-coastal marine stratocumulus clouds.

GEOS-5↗
NASA NTRS2015

Multi-Level Experimental and Analytical Evaluation of Two Composite Energy Absorbers

Two composite energy absorbers were developed and evaluated at NASA Langley Research Center through multi-level testing and simulation performed under the Transport Rotorcraft Airframe Crash Testbed (TRACT) research program. A conical-shaped energy absorber, designated the conusoid, was evaluated that consisted of four layers of hybrid carbon-Kevlar plain weave fabric oriented at [+45 deg/-45 deg/-45 deg/+45 deg] with respect to the vertical, or crush, direction. A sinusoidal-shaped energy absorber, designated the sinusoid, was developed that consisted of hybrid carbon-Kevlar plain weave fabric face sheets, two layers for each face sheet oriented at +/-45deg with respect to the vertical direction and a closed-cell ELFOAM P200 polyisocyanurate (2.0-lb/cu ft) foam core. The design goal for the energy absorbers was to achieve average floor-level accelerations of between 25- and 40-g during the full-scale crash test of a retrofitted CH-46E helicopter airframe, designated TRACT 2. Variations in both designs were assessed through dynamic crush testing of component specimens. Once the designs were finalized, subfloor beams of each configuration were fabricated and retrofitted into a barrel section of a CH-46E helicopter. A vertical drop test of the barrel section was conducted onto concrete to evaluate the performance of the energy absorbers prior to retrofit into TRACT 2. The retrofitted airframe was crash tested under combined forward and vertical velocity conditions onto soil, which is characterized as a sand/clay mixture. Finite element models were developed of all test articles and simulations were performed using LS-DYNA, a commercial nonlinear explicit transient dynamic finite element code. Test-analysis results are presented for each energy absorber as comparisons of time-history responses, as well as predicted and experimental structural deformations and progressive damage under impact loading for each evaluation level.

Jackson, Karen E.↗
NASA NTRS2014

Introducing Multisensor Satellite Radiance-Based Evaluation for Regional Earth System Modeling

Earth System modeling has become more complex, and its evaluation using satellite data has also become more difficult due to model and data diversity. Therefore, the fundamental methodology of using satellite direct measurements with instrumental simulators should be addressed especially for modeling community members lacking a solid background of radiative transfer and scattering theory. This manuscript introduces principles of multisatellite, multisensor radiance-based evaluation methods for a fully coupled regional Earth System model: NASA-Unified Weather Research and Forecasting (NU-WRF) model. We use a NU-WRF case study simulation over West Africa as an example of evaluating aerosol-cloud-precipitation-land processes with various satellite observations. NU-WRF-simulated geophysical parameters are converted to the satellite-observable raw radiance and backscatter under nearly consistent physics assumptions via the multisensor satellite simulator, the Goddard Satellite Data Simulator Unit. We present varied examples of simple yet robust methods that characterize forecast errors and model physics biases through the spatial and statistical interpretation of various satellite raw signals: infrared brightness temperature (Tb) for surface skin temperature and cloud top temperature, microwave Tb for precipitation ice and surface flooding, and radar and lidar backscatter for aerosol-cloud profiling simultaneously. Because raw satellite signals integrate many sources of geophysical information, we demonstrate user-defined thresholds and a simple statistical process to facilitate evaluations, including the infrared-microwave-based cloud types and lidar/radar-based profile classifications.

Planetary Boundary Layer↗
NASA NTRS2016

Evaluation of Synthetic Vision Display Concepts for Improved Awareness in Unusual Attitude Recovery Scenarios

A recent study conducted by the Commercial Aviation Safety Team (CAST) determined 40 percent of all fixed-wing fatal accidents, between 2001 and 2011, were caused by Loss-of-Control (LOC) in flight (National Transportation Safety Board, 2015). Based on their findings, CAST recommended manufacturers develop and implement virtual day-visual meteorological conditions (VMC) display systems, such as synthetic vision or equivalent systems (CAST, 2016). In a 2015 simulation study conducted at NASA Langley Research Center (LaRC), researchers gathered to test and evaluate virtual day-VMC displays under realistic flight operation scenarios capable of inducing reduced attention states in pilots. Each display concept was evaluated to determine its efficacy to improve attitude awareness. During the experiment, Evaluation Pilots (EPs) were shown the following three display concepts on the Primary Flight Display (PFD): Baseline, Synthetic Vision (SV) with color gradient, and SV with texture. The baseline configuration was a standard, conventional 'blue over brown' display. Experiment scenarios were simulated over water to evaluate Unusual Attitude (UA) recovery over 'featureless terrain' environments. Thus, the SV with color gradient configuration presented a 'blue over blue' display with a linear blue color progression, to differentiate attitude changes between sky and ocean. The SV with texture configuration presented a 'blue over blue' display with a black checkerboard texture atop a synthetic ocean. These displays were paired with a Background Attitude Indicator (BAI) concept. The BAI was presented across all four Head-Down Displays (HDDs), displaying a wide field-of-view blue-over-blue attitude indicator. The BAI aligned with the PFD and showed through the background of the navigation displays with opaque transparency. Each EP participated in a two-part experiment series with a total seventy-five trial runs: Part I included a set of twenty-five Unusual Attitude Recovery (UAR) scenarios; Part II included a set of fifty Attitude Memory Recall Tasks (AMRT). At the conclusion of each trial, EPs were asked to complete a set post-run questionnaires. Quantitative results showed that there were no significant statistical effects on UA recovery times when utilizing SV with or without the presence of a BAI. Qualitative results show the SV displays (color, texture) with BAI On are most preferred for both UA recognition and recovery when compared with the baseline display. When only comparing SV display concepts, EPs performed better when using the SV with texture, BAI On, than any other display configuration. This is an interesting find considering most EPs noted their preference towards the SV with color gradient when the BAI was on.

Nicholas, Stephanie↗
NASA NTRS2016

Evaluation of Mid-Size Male Hybrid III Models for use in Spaceflight Occupant Protection Analysis

In an effort to improve occupant safety during dynamic phases of spaceflight, the National Aeronautics and Space Administration (NASA) has worked to develop occupant protection standards for future crewed spacecraft. One key aspect of these standards is the identification of injury mechanisms through anthropometric test devices (ATDs). Within this analysis, both physical and computational ATD evaluations are required to reasonably encompass the vast range of loading conditions any spaceflight crew may encounter. In this study the accuracy of publically available mid-size male HIII ATD finite element (FE) models are evaluated within applicable loading conditions against extensive sled testing performed on their physical counterparts. Methods: A series of sled tests were performed at the Wright Patterson Air force Base (WPAFB) employing variations of magnitude, duration, and impact direction to encompass the dynamic loading range for expected spaceflight. FE simulations were developed to the specifications of the test setup and driven using measured acceleration profiles. Both fast and detailed FE models of the mid-size male HIII were ran to quantify differences in their accuracy and thus assess the applicability of each within this field. Results: Preliminary results identify the dependence of model accuracy on loading direction, magnitude, and rate. Additionally the accuracy of individual response metrics are shown to vary across each model within evaluated test conditions. Causes for model inaccuracy are identified based on the observed relationships. Discussion: Computational modeling provides an essential component to ATD injury metric evaluation used to ensure the safety of future spaceflight occupants. The assessment of current ATD models lays the groundwork for how these models can be used appropriately in the future. Identification of limitations and possible paths for improvement aid in the development of these effective analysis tools.

Putnam, Jacob B.↗
NASA NTRS2015

Evaluation of Volatile Species in Green Monopropellant Project

NASA is interested in green monopropellants to replace hydrazine in reaction control systems (RCSs). Some current NASA programs require reduced vapor pressure and low toxicity monopropellant (green) and superior performance (specific impulse and density) formulations. Earlier vapor phase studies of a candidate green monopropellant at the NASA White Sands Test Facility (WSTF) showed the presence of a volatile species that warranted further investigation. The purpose of this study was to further characterize the volatile species and to evaluate it. The evaluation was with respect to whether the volatile species was an impurity or how it is formed, and to use that information to examine whether its presence as an impurity can be eliminated during formulation. The evaluation also considered whether formation of the volatile impurity could be prevented while not compromising the propellant. To reduce variables associated with evaluation of the propellant formulation as a whole, a precursor to one of the individual components in the propellant formulation was subjected to a NASA Standard 6001B Flammability, Off-gassing, and Compatibility Requirements and Test Procedures "Determination of Off-gassed Products (Test 7)". Testing took place in the NASA WSTF Molecular Desorption and Analysis Laboratory. One gram of the precursor was placed in a flask within a specimen container. After thermal conditioning for 72 +/- 1 h at 50 +/- 3 deg C (122 +/- 5 deg F), the atmosphere inside the specimen container was analyzed for off-gassed compounds by cryotrap gas chromatography-mass spectrometry (GC-MS) and fixed sample loop GC-flame ionization detection (GC-FID). The specimen container used was glass to minimize potential catalytic surfaces. The identification of compounds was difficult due to the complexity of the vapor phase concentrations and overlapping chromatographic peaks and mass spectra. However, eleven compounds were specifically identified and five compounds or classes of compounds were reported as unidentified. Quantitation of most of the compounds, including unidentified compounds, was as methane. Quantitating compounds or classes of compounds that were detected but for which specific calibration is not established as methane is in accordance with the Test 7 standard protocol. The thermal decomposition temperature of the precursor was significantly higher than the test temperature. Based on thermal decomposition temperature and on an examination of the structure and chemistry of the identified volatile species, the presence of the volatile species appears to be chemically reasonable with respect to the propellant formulation and is at this time attributed to impurities. Further examination of the overall propellant formulation process (including the individual components' synthesis processes) and process quality control (including purity of reagents and possible decomposition reactions) is indicated.

Greene, Benjamin↗
NASA NTRS2017

Global Gridded Crop Model Evaluation: Benchmarking, Skills, Deficiencies and Implications.

Crop models are increasingly used to simulate crop yields at the global scale, but so far there is no general framework on how to assess model performance. Here we evaluate the simulation results of 14 global gridded crop modeling groups that have contributed historic crop yield simulations for maize, wheat, rice and soybean to the Global Gridded Crop Model Intercomparison (GGCMI) of the Agricultural Model Intercomparison and Improvement Project (AgMIP). Simulation results are compared to reference data at global, national and grid cell scales and we evaluate model performance with respect to time series correlation, spatial correlation and mean bias. We find that global gridded crop models (GGCMs) show mixed skill in reproducing time series correlations or spatial patterns at the different spatial scales. Generally, maize, wheat and soybean simulations of many GGCMs are capable of reproducing larger parts of observed temporal variability (time series correlation coefficients (r) of up to 0.888 for maize, 0.673 for wheat and 0.643 for soybean at the global scale) but rice yield variability cannot be well reproduced by most models. Yield variability can be well reproduced for most major producing countries by many GGCMs and for all countries by at least some. A comparison with gridded yield data and a statistical analysis of the effects of weather variability on yield variability shows that the ensemble of GGCMs can explain more of the yield variability than an ensemble of regression models for maize and soybean, but not for wheat and rice. We identify future research needs in global gridded crop modeling and for all individual crop modeling groups. In the absence of a purely observation-based benchmark for model evaluation, we propose that the best performing crop model per crop and region establishes the benchmark for all others, and modelers are encouraged to investigate how crop model performance can be increased. We make our evaluation system accessible to all crop modelers so that other modeling groups can also test their model performance against the reference data and the GGCMI benchmark.

wheat↗
NASA NTRS2016

Evaluation of Mid-Size Male Hybrid III Models for use in Spaceflight Occupant Protection Analysis

Introduction: In an effort to improve occupant safety during dynamic phases of spaceflight, the National Aeronautics and Space Administration (NASA) has worked to develop occupant protection standards for future crewed spacecraft. One key aspect of these standards is the identification of injury mechanisms through anthropometric test devices (ATDs). Within this analysis, both physical and computational ATD evaluations are required to reasonably encompass the vast range of loading conditions any spaceflight crew may encounter. In this study the accuracy of publically available mid-size male HIII ATD finite element (FE) models are evaluated within applicable loading conditions against extensive sled testing performed on their physical counterparts. Methods: A series of sled tests were performed at the Wright Patterson Air force Base (WPAFB) employing variations of magnitude, duration, and impact direction to encompass the dynamic loading range for expected spaceflight. FE simulations were developed to the specifications of the test setup and driven using measured acceleration profiles. Both fast and detailed FE models of the mid-size male HIII were ran to quantify differences in their accuracy and thus assess the applicability of each within this field. Results: Preliminary results identify the dependence of model accuracy on loading direction, magnitude, and rate. Additionally the accuracy of individual response metrics are shown to vary across each model within evaluated test conditions. Causes for model inaccuracy are identified based on the observed relationships. Discussion: Computational modeling provides an essential component to ATD injury metric evaluation used to ensure the safety of future spaceflight occupants. The assessment of current ATD models lays the groundwork for how these models can be used appropriately in the future. Identification of limitations and possible paths for improvement aid in the development of these effective analysis tools.

Putnam, J.↗
NASA NTRS2017

Assessment of Intralaminar Progressive Damage and Failure Analysis Using an Efficient Evaluation Framework

Reducing the timeline for development and certification for composite structures has been a long standing objective of the aerospace industry. This timeline can be further exacerbated when attempting to integrate new fiber-reinforced composite materials due to the large number of testing required at every level of design. computational progressive damage and failure analysis (PDFA) attempts to mitigate this effect; however, new PDFA methods have been slow to be adopted in industry since material model evaluation techniques have not been fully defined. This study presents an efficient evaluation framework which uses a piecewise verification and validation (V&V) approach for PDFA methods. Specifically, the framework is applied to evaluate PDFA research codes within the context of intralaminar damage. Methods are incrementally taken through various V&V exercises specifically tailored to study PDFA intralaminar damage modeling capability. Finally, methods are evaluated against a defined set of success criteria to highlight successes and limitations.

Hyder, Imran↗
NASA NTRS2018

NEPP Evaluation of Automotive Grade Tantalum Chip Capacitors

Automotive grade tantalum (Ta) chip capacitors are available at lower cost with smaller physical size and higher volumetric efficiency compared to military/space grade capacitors. Designers of high reliability aerospace and military systems would like to take advantage of these attributes while maintaining the high standards for long-term reliable operation they are accustomed to when selecting military-qualified established reliability tantalum chip capacitors (e.g., MIL-PRF-55365). The objective for this evaluation was to assess the long-term performance of off-the-shelf automotive grade Ta chip capacitors (i.e., manufacturer self-qualified per AEC Q-200). Two (2) lots of case size D manganese dioxide (MnO2) cathode Ta chip capacitors from 1 manufacturer were evaluated. The evaluation consisted of construction analysis, basic electrical parameter characterization, extended long-term (2000 hours) life testing and some accelerated stress testing. Tests and acceptance criteria were based upon manufacturer datasheets and the Automotive Electronics Council's AEC Q-200 qualification specification for passive electronic components. As-received a few capacitors were marginally above the specified tolerance for capacitance and ESR. X-ray inspection found that the anodes for some devices may not be properly aligned within the molded encapsulation leaving less than 1 mil thickness of the encapsulation. This evaluation found that the long-term life performance of automotive grade Ta chip capacitors is generally within specification limits suggesting these capacitors may be suitable for some space applications.

Automotive↗
NASA NTRS2019

Stress Corrosion Evaluation of Elgiloy Alloy for the ISS ECLSS — Universal Waste Management System

Elgiloy® alloy (UNS R30003)—a spring material per AMS 5876D (reference 1)—is one among several alloys recently evaluated for stress corrosion cracking resistance in support of the International Space Station (ISS) Environmental Control and Life Support System (ECLSS). Elgiloy was evaluated particularly for its expected use in the Universal Waste Management System (described in references 2 and 3). Data for other alloys previously evaluated were reported in references 4 and 5. Materials included in reference 4 are Inconel 625, Hastelloy® C276, commercially pure titanium, titanium with 6% aluminum and 4% vanadium (Ti6Al4V), extra-low interstitial Ti6Al4V, and Cronidur 30. The results for Nitinol 60 are in reference 5. During the water recovery process, the metallic components fabricated from these materials are exposed to acidic solutions used for waste treatment. The purpose of the current and previous stress corrosion evaluations is to determine if these materials have adequate stress corrosion resistance.

Torres, Pablo D.↗
NASA NTRS2020

Application of Remote Sensing for Ex-Ante Decision Support and Evaluating Impact

Deforestation is an environmental stressor that dramatically threatens biodiversity while having adverse, deep-rooted socioeconomic impacts. Interventions to address deforestation require considerable long-term investments; therefore, assessing their impact is crucial. The UN Convention on Biological Diversity encourages establishing Protected Areas (PAs) as a strategy to conserve biodiversity, secure ecosystem services, support local livelihoods, and reduce climate change impacts. The Global Environment Facility (GEF) has supported the conservation and management of PAs, yet site accessibility and data availability present challenges in assessing PAs using traditional evaluation methods. We present a novel application of satellite Earth observations for evaluating the effectiveness and impact of PAs as a deforestation mitigation strategy. Geospatial analysis and ecological forecasting methodologies provide an efficient way to quantify land cover change, estimate above-ground carbon stock, and evaluate ecosystem services provided by the PAs ex-ante. We demonstrate the value of a geospatial approach through evaluation of GEF-supported PAs in Kenya.

Remote sensing↗
NASA NTRS2020

An AeroCom–AeroSat study: intercomparison of satellite AOD datasets for aerosol model evaluation

To better understand and characterize current uncertainties in the important observational constraint of climate models of aerosol optical depth (AOD), we evaluate and intercompare 14 satellite products, representing nine different retrieval algorithm families using observations from five different sensors on six different platforms. The satellite products (super-observations consisting of 1°×1° daily aggregated retrievals drawn from the years 2006, 2008 and 2010) are evaluated with AErosol RObotic NETwork (AERONET) and Maritime Aerosol Network (MAN) data. Results show that different products exhibit different regionally varying biases (both under- and overestimates) that may reach ±50 %, although a typical bias would be 15 %–25 % (depending on the product). In addition to these biases, the products exhibit random errors that can be 1.6 to 3 times as large. Most products show similar performance, although there are a few exceptions with either larger biases or larger random errors. The intercomparison of satellite products extends this analysis and provides spatial context to it. In particular, we show that aggregated satellite AOD agrees much better than the spatial coverage (often driven by cloud masks) within the 1°×1° grid cells. Up to ∼50 % of the difference between satellite AOD is attributed to cloud contamination. The diversity in AOD products shows clear spatial patterns and varies from 10 % (parts of the ocean) to 100 % (central Asia and Australia). More importantly, we show that the diversity may be used as an indication of AOD uncertainty, at least for the better performing products. This provides modellers with a global map of expected AOD uncertainty in satellite products, allows assessment of products away from AERONET sites, can provide guidance for future AERONET locations and offers suggestions for product improvements. We account for statistical and sampling noise in our analyses. Sampling noise, variations due to the evaluation of different subsets of the data, causes important changes in error metrics. The consequences of this noise term for product evaluation are discussed.

Aerosol↗
NASA NTRS2021

Precipitable water vapor over oceans from the Maritime Aerosol Network: Evaluation of global models and satellite products under clear sky conditions

We present results from an evaluation of precipitable water vapor (W) over remote oceanic areas as derived from global reanalysis models and from satellites against observations from the Maritime Aerosol Network (MAN) for cloudless skies during the period of 2004–2017. They cover polar, mid latitude and tropical oceanic regions and represent a first effort to use MAN observations for such evaluation. The global reanalysis model products evaluated in this study are from the Modern-Era Retrospective analysis for Research and Applications Version 2 (MERRA-2), the European Centre for Medium-Range Weather Forecasts (ECMWF) Interim Reanalysis (ERA I), and the Climate Forecast System Reanalysis (CFSR) model. The satellite products evaluated are from the Moderate Resolution Imaging Spectroradiometer (MODIS), the Polarization and Directionality of the Earth's Reflectances (POLDER), the Global Ozone Monitoring Experiment (GOME-2), the Scanning Imaging Absorption Spectrometer for Atmospheric Chartography (SCIAMACHY), and the Atmospheric Infra-red Sounder (AIRS). Satellite retrievals of W are based on the attenuation of solar reflected light by water vapor absorption bands, except those from AIRS that rely on brightness temperature measurements. A very good agreement is observed between the model estimates and MAN, with mean differences of ~5% and standard deviations of ~15%. These results are within the uncertainties associated with the models and the measurements, indicating the skill of the reanalysis models to estimate W over oceans under clear sky conditions. Mean differences of W between the satellite and MAN products are ~11, 6.7, 12, −7, and 3% for MODIS, POLDER, GOME-2, SCIAMACHY and AIRS respectively, while their standard deviations are 31, 29, 28, 20 and 17%. These differences reveal the need to address inconsistencies among different satellite sensors and ground-based measurements to reduce the uncertainties associated with the retrievals.

Daniel Pérez-Ramírez↗