Search NASA⌕ Search

SEARCH · Search NASA

Results for “Validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40

Aerosol Models from the AERONET Database: Application to Surface Reflectance Validation Satellite Data

Aerosols play a critical role in radiative transfer within the atmosphere, and they have a significant impact on climate change. In this paper, we propose and implement a framework for developing an aerosol model using their microphysical properties. Such microphysical properties as the size distribution, the complex refractive index, and the percentage of sphericity are derived from the global AERosol RObotic NETwork (AERONET). These measurements, however, are typically retrieved when almucantar measurement procedures are performed (i.e., early mornings and late afternoons with clear sky) and might not have a temporal correspondence to a satellite overpass time, so a valid validation of satellite-derived products cannot be carried out. To address this problem of temporal inconsistency of satellite and ground-based measurements, we developed an approach to retrieve these microphysical properties (and the corresponding aerosol model) using the optical thickness at 440 nm, τ440, and the Ångström coefficient between 440 and 870 nm, α440–870. Such aerosol models were developed for 851 AERONET sites within the last 28 years. Obtained results suggest that empirically microphysical properties can be retrieved with uncertainties of up to 23 %. An exception is the imaginary part of the refractive index ni, for which the derived uncertainties reach up to 38 %. These specific parametric models of aerosol can be used for the studies when retrieval of microphysical properties is required as well as validation of satellite-derived products over land. Specifically, we demonstrate the usefulness of the aerosol models to validate surface reflectance records over land derived from optical remote sensing sensors. We then quantify the propagation of uncertainties in the surface reflectance due to uncertainties with the aerosol model retrieval that is used as a reference from radiative transfer simulations. Results indicate that individual aerosol microphysical properties can impact uncertainties in surface reflectance retrievals between 3.5 × 10(exp -5) to 1 × 10(exp -3) (in reflectance units). The overall impact of microphysical properties combined yields an overall uncertainty in surface reflectance <0.004 (in reflectance units). That corresponds, for example, to 1 to 3 % of the retrieved surface reflectance in the red spectral band (620–670 nm) by the Moderate Resolution Imaging Spectroradiometer (MODIS) instrument. These uncertainty values are well below the specification (0.005 + 0.05ρ; ρ is the retrieved surface reflectance) used for the MODIS atmospheric correction.

Jean-Claude Roger↗

Validation of CrIS Ozone and Carbon Oxide Products from CrIS Single-Field-of-View Retrievals

Single Field-of-view Sounder Atmospheric Products (SiFSAP) from Cross-track Infrared Sounder (CrIS) on S-NPP have been developed at NASA Langley Research center, and recently a significant improvement in its trace gases products has been made. These products are derived based on the Principal Component (PC)-based Radiative Transfer Model (PCRTM) and an optimal estimation retrieval method (PCRTM-RA). Use of the PCRTM in this method allows for fast and accurate calculations for thousands of spectral channels under clear and cloudy sky conditions. The use of principal component to compress information from all spectral channels into the PC domain enables to reduce the observational noise and use the information from all hyperspectral infrared channels. The retrieval is made on PC-domain, and temperature, water vapor, trace gases, cloud and surface parameters are retrieved simultaneously. This presentation will present some validation to the SiFSAP ozone (O3) and carbon monoxide (CO) products. Since the SiFSAP has a spatial resolution of about 14 km at nadir, which is better than most global weather and climate models and enables to make process-oriented analysis of the transport of these gases, this study will focus on validation of CO and O3 products under some extreme weather and/or climate events, such as CO emission and transport from large biomass burning, and O3 variation impacted by fire emission, stratospheric intrusion, and tropical cyclones. Data used in our validation include CO and O3 from NASA aircraft campaigns, plus other satellite products such as CO and O3 from AIRS, IASI and TROPOMI, MOPPIT CO and OMPS O3. Some comparison of SiFSAP O3 with the O3 from the fifth-generation ECMWF reanalysis (ERA5) data the NASA Modern-Era Retrospective Analysis for Research and Applications, Version 2 (MERRA-2) will also present. Such a validation not only helps to quantify the performance of the retrievals in these extreme conditions, but also displays the capability of satellite observation to capture the fine-scale spatial pattern of CO and O3 variation.

Xiaozhen Xiong↗

Slosh-Induced Ullage Collapse Validation by Computational Fluid Dynamics and Application to In-space Propellant Dynamics

Ullage collapse predictions made using Computational Fluid Dynamics (CFD) were validated then made for an in-space cryogenic propellant unsettling application. Ullage collapse is the decrease in propellant tank pressure due to cooling of the ullage gas, which can be significant for cryogenic propulsion systems. Vehicles may be developed that are robust to temperature and pressure changes caused by heat leaks, e.g., propellant tanks with high maximum operation pressures, technologies yielding active thermal conditioning, and systems with ample pressurant for conditioning. These methods are robust because additional mass, cost, and complexity are used to address cryogenic fluid management (CFM). As vehicles are optimized for increased payload capacity, tracking of events such as ullage collapse and self-pressurization in tanks will become increasingly important for propellant inventory calculations. Some ullage collapse events can be studied through ground experimentation, but propellant unsettling in and around in-space coast mission phases must be studied in the absence of an acceleration field. Computational Fluid Dynamics is a powerful tool to address this need, enabling prediction of complex physics prior to flight. Validation of the chosen CFD tool and modeling methodology was done using data from a previously conducted subscale slosh-induced ullage collapse ground test performed in part by the Japan Aerospace Exploration Agency (JAXA). A small tank was partially filled with liquid nitrogen and pressurized with gaseous nitrogen at various temperatures. The tank was oscillated laterally to induce high amplitude slosh dynamics resulting in wave breakup. Successful qualitative validation of slosh wave dynamics and quantitative validation of ullage collapse promoted confidence in extending ullage collapse predictions to a flight application. Mechanisms of ullage collapse caused by main engine cutoff while in-space were identified. Both slosh dynamics leading to engine shutdown and body dynamics following shutdown were shown to contribute to propellant unsettling and ullage collapse.

J M Brodnick↗

Validations of Satellite Ozone Profiles in Austral Spring Using Ozonesonde Measurements in the Jang Bogo Station, Antarctica

Using ozonesonde measurements from 2015 to 2018 at the Jang Bogo station located in the southeastern Antarctic region, we evaluate ozone profiles retrieved from the three satellite measurements that are widely used: Ozone Monitoring Instrument (OMI), Microwave Limb Sounder (MLS), and Ozone Mapping Profiler Suite (OMPS) data. For the fair validation, ozonesonde profiles are smoothed using the weighting function of each satellite retrieval algorithm (i.e., convolution process). Compared with limb-viewing MLS and OMPS ozone profiles, the OMI ozone profiles are relatively less qualified: coarser vertical resolution and larger inter-annual variation. Nevertheless, our validation reveals that the quality of all three satellite ozone profiles looks comparable; In general, difference from ozonesonde profile is ∼1 ppm absolutely, and −20 to 30% relatively at maximum. This quantitative range well corresponds to previous work, meaning that our new validation confirms the reliability of satellite ozone profiles in the southeastern Antarctic region where the measurement data for the validation were not enough. Another interesting feature is the role of a priori ozone profile; Nadir-viewing OMI satellite can have qualified ozone profiles by a proper assumption of a priori ozone profile. Since the performance of limb-viewing ozone profiles is better, however, the careful usage of nadir-viewing ozone profile is still required. We think that the simultaneous usage of multiple satellite ozone profiles can contribute to better understanding of Antarctic ozone characteristics.

Antarctica↗

A Multi-Year Effort to Forward the Validation of Solar Energetic Particle Prediction Models

To enable a consistent and quantitative understanding of solar energetic particle (SEP) model performance, a generalized, automated validation infrastructure, called SPHINX, is being developed by the NASA Space Radiation Analysis Group (SRAG) in close collaboration with the NASA Community Coordinated Modeling Center (CCMC), NASA Moon to Mars Space Weather Analysis Office (M2M), NOAA Space Weather Prediction Center (SWPC), and the Royal Belgian Institute for Space Aeronomy (BIRA-IASB). SPHINX is being developed to evaluate the SEP Scoreboards (https://ccmc.gsfc.nasa.gov/scoreboards/sep/), which are being used by SRAG to support space radiation operations for Mission Control. SPHINX is also being developed through a series of community challenges, which have defined a list of challenge events and a prescribed set of rules of participation. The participation of the research community has enabled the generalization of the infrastructure to validate all the types of outputs being produced by SEP models and fully exercised the framework. The most recent challenge includes 30 SEP events and 33 non-event (quiet) periods and was supported by two dedicated SEPVAL working meetings, one in the US and one in Europe (https://ccmc.gsfc.nasa.gov/community-workshops/ccmc-sepval-2023/). Here, we describe SPHINX and its interactive user interface, SPHINX-VIVID, which will eventually be made available for public use. We present selected results, outcomes, and lessons learned from the SEPVAL working meetings and validation results of the SEP Scoreboards from 2019 to present. These efforts aim to define a set of community standards for SEP model validation and describe the current state-of-the-art of SEP model performance.

Kathryn Whitman↗

A CFD Validation Study using Artemis 1 Orbital Slosh Test Data

Advancements in liquid propellant management science and technologies are key to increasing safety, decreasing cost, and increasing payload mass of NASA space missions. Liquid propellant usually comprises a large portion of the total mass of launch vehicles and spacecraft, so predicting and controlling the motion of it are important. Computational fluid dynamics (CFD) programs are critical to predicting slosh dynamics, but CFD programs require experimental validation with physically relevant test data before the results can be trusted. Low-gravity slosh test data is lacking, and most of what exists is inadequate for CFD validation. A potential slosh risk for Orion, and the lack of validated low-gravity slosh models, led to performing on-orbit slosh tests during the Artemis 1 mission to assess the impacts of slosh on the guidance, navigation, and control of Orion. This work details the validation of a coupled slosh-motion CFD model using the Orion orbital slosh test data set.

CFD↗

A CFD Validation Study Using Artemis 1 Orbital Slosh Test Data

Advancements in liquid propellant management science and technologies are key to increasing safety, decreasing cost, and increasing payload mass of NASA space missions. Liquid propellant usually comprises a large portion of the total mass of launch vehicles and spacecraft, so predicting and controlling the motion of it are important. Computational fluid dynamics (CFD) programs are critical to predicting slosh dynamics, but CFD programs require experimental validation with physically relevant test data before the results can be trusted. Low-gravity slosh test data is lacking, and most of what exists is inadequate for CFD validation. A potential slosh risk for Orion, and the lack of validated low-gravity slosh models, led to performing on-orbit slosh tests during the Artemis 1 mission to assess the impacts of slosh on the guidance, navigation, and control of Orion. This work details the validation of a coupled slosh-motion CFD model using the Orion orbital slosh test data set.

CFD↗

Numerical Uncertainty Estimation for Stochastic Particle-in-Cell Simulations Applied to Verification and Validation.

Systematic veri cation and validation (V&V) is necessary to establish the credibility for high consequence simulations. In this paper, we focus on a radiation-induced plasma experimental validation exercise for simulations which uses both numerical error estimation and input parameter uncertainty quanti cation to provide a direct comparison between Particle-In-Cell (PIC) plasma simulations and experiments. This approach demonstrates how careful validation can uncover missing physics in the simulation. Three di erent validation examples are shown; a vacuum space charge limited cavity, a gas lled space charge limited cavity, and a vacuum non space charge limited cavity. Two of the example are picked to show the importance of error estimation in uncovering inaccuracy/incomplete simulation models. We also report on a newly-developed numerical error estimation approach, StREEQ, which is a notable improvement to past approaches. In the StREEQ approach, a multi- tting scheme based on L 1 , L 2 , and L$\infty$ error norms and alternate weightings is used to propagate uncertainties in the relative importance of outliers and coarse/re ned discretization levels. Bootstrap sampling is used to represent the stochasticity in the response data. The resulting method appears to robustly and conservatively predict the fully-converged response within estimated numerical error bounds for stochastic simulations. The StREEQ approach is demonstrated on two related prototype electron diode problems, and preliminary results are reported for a radiation-induced plasma simulation.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

NUISANCE-GENIE Validation and Sample Additions

aThe objective for this project was to use MINERvA data to tune the simulation models in order to obtain the precision needed for current and future neutrino experiments. In order to do this, the current models need to be validated and then improved. $\#10146$; Validation was done by recreating figures that have been used in previous publications $\#61553$; This was done by comparing data from the detector and the simulation model (GENIE) $\#10146$; Additionally, a newer version of GENIE was compared to the GENIE used for the publications to validate the new version as well as to note any improvements Another objective was to add new samples into the NUISANCE framework, which was used to compare data from the detector and simulation models. $\#10146$; Specifically, the added sample was the two dimensional histogram of the double differential cross section as a function of the transversal and z-direction momentum for Numu and Numubar $\#61553$; Was also used for validation

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Calibration and Validation of NRC Fuel Performance Models

Pacific Northwest National Laboratory maintains steady-state and transient fuel performance codes for the U.S Nuclear Regulatory Commission (NRC). The NRC uses these codes in performing confirmatory calculations of licensee fuel performance codes and safety analysis methods during the review and approval of these codes and methods. The NRC also uses these codes to perform calculations to direct regulatory research and to assist in the development of new regulations and regulatory guides. Because of the safety-related uses for these codes, it is critically important that the codes are capable of accurately modeling modern fuel and operations and that the models and code predictions are well validated using data collected from conditions relevant to in-reactor conditions. FRAPCON and FRAPTRAN have an extensive database of separate effects data used to validate individual material property and fuel performance models and an integral effects database used to assess the overall code prediction within the full range of fuel operations. The key code predictions that are of regulatory interest as they relate to various specified acceptable design limits are; fuel and cladding temperature, rod internal pressure, cladding hoop strain, cladding corrosion and hydriding, and fission gas release. To assess the ability of the code to accurately predict these values, the integral assessment database consists of measurements of fuel centerline temperature, fission gas release, void volume, cladding corrosion, and cladding hoop strain. This paper will discuss the activities that are performed to ensure that FRAPCON and FRAPTRAN represent the state of the industry and will describe the separate effect and integral effect databases that are used to validate the models and are continually being expanded to ensure validation over the full range of fuel operations.

Geelhood, Kenneth J.↗

VALIDATION OF KENO V.A AND KENO-VI IN SCALE 6.3 BETA 3 USING ENDF/B-VII.1 AND ENDF/B-VIII LIBRARIES

In early 2019, internal beta releases of SCALE 6.3 were identified for internal users, as well as a limited number of external users, to apply when testing key features. Recently developed AMPX-formatted libraries based on ENDF/B-VIII have also been generated for use in internal testing. In this effort, a criticality safety validation was performed using nuclear data libraries based on the ENDF/B-VII.1 and ENDF/B-VIII releases to quantify the changes caused by code development and to identify differences caused by the new nuclear data. As with past validations, the primary suite of experiments used is the Verified, Archived Library of Inputs and Data (VALID) maintained in the Reactor and Nuclear Systems Division at Oak Ridge National Laboratory. The VALID suite contains a total of 618 individual configurations, including systems with fast, thermal, mixed, and intermediate neutron spectra. Fissile species include a range of uranium enrichments, plutonium, mixtures of uranium and plutonium, and 233U. Metal, solution, and compound, mostly in pin array fissile forms, are included in the suite. The results presented here include the 252-group general purpose multigroup library based on ENDF/B-VII.1 and the continuous-energy libraries based on ENDF/B-VII.1 and ENDF/B-VIII.

Marshall, William (B.J.)↗

Initial Application of TSUNAMI for Validation of Advanced Fuel Systems

A number of advanced reactor concepts and accident-tolerant fuels (ATFs) are under development or in the initial stages of deployment and testing in the nuclear power industry. Many of these concepts incorporate chemical or material forms that have not traditionally been used in the nuclear industry and may present challenges for nuclear criticality safety validation. Sensitivity/uncertainty methods are ideally suited for assessing the applicability of existing critical experiments to these potentially challenging applications. This paper presents two case studies recently completed at Oak Ridge National Laboratory (ORNL) which investigated the use of the TSUNAMI tools within the SCALE code system to perform such assessments.Many advanced reactor concepts include uranium enrichments above 5 wt% 235U but below the 20 wt% limit of low-enriched uranium (LEU). This material, referred to as high assay LEU (HA-LEU), poses difficulties across the entire infrastructure of nuclear power, including enrichment, transportation, fabrication, and storage. A potentially representative transportation package was selected to perform a criticality safety validation assessment for UF6 containing HA-LEU. Sensitivity data were generated using the TSUNAMI-3D sequence, and an assessment of the applicability of a range of critical experiments was performed using the TSUNAMI-IP tool. The critical experiments were drawn from the set of available sensitivity data files distributed with the International Criticality Safety Benchmark Evaluation Project (ICSBEP) Handbook. The results indicate that a sufficient number of available experiments may be available to perform validations for these systems.Many different cladding materials and fuel dopants are included in ATFs to mitigate the consequences of a loss of coolant accident. Some of these systems have already been fabricated and introduced as lead test assemblies in commercial reactors, while others are still being developed. Several concepts were considered for pressurized-water reactors (PWRs) and boiling-water reactors (BWRs) in comparison to the current Zircaloy and UO2 fuel system. In most of these cases, the ATF materials did not significantly impact the number of applicable experiments for validation. Some fuel and cladding materials were identified, however, which may reduce the number of available experiments and which will increase the nuclear data–induced uncertainty in neutron multiplication.

Marshall, William (B.J.)↗

Empirical Validation of Building Energy Modeling using Flexible Research Platform

Recently, efforts have been made to provide reliable empirical data for ANSI/ASHRAE Standard 140, Standard Method of Test for the Evaluation of Building Energy Analysis Computer Programs, to enable improved accuracy of building energy model (BEM) engines and improved characterization of their accuracy. The motivation for this effort is that the use of reliable empirical validation data sets in the evaluation of building energy modeling tools will lead to more consistent and validated simulation engines across all software vendors. This would expedite the use of building energy modeling in designing new buildings and retrofitting existing buildings, which delivers more energy efficient buildings.As part of a three-year multi-lab empirical validation project sponsored by U.S. DOE, this research project generated cooling season test plans by reviewing ASHRAE Standard 140, and the tests were performed based on the test plan. Finally, the experimental data sets were compared with the EnergyPlus model to demonstrate the validation procedure.

Im, Piljae↗

Advancements in Validation of TSLs through Inelastic Neutron Scattering and Transmission Measurements [Abstract]

Historically, the free gas approximation has been used to treat the thermal scattering of neutrons with energies below a few electron-volts (eV) in unevaluated materials. However, this method inadequately reproduces neutron scattering at these energies. Until recently, only a limited number of materials had available thermal scattering law (TSL) files/libraries in the ENDF nuclear data libraries in this energy range. With advancements in atomistic modeling techniques, such as molecular dynamics, ab-initio molecular dynamics, and density functional theory, TSL libraries have become available for many more materials. This is particularly relevant due to the rising interest in several advanced reactor systems that require novel moderator and reflector materials. While quasi-integral and integral benchmarks have been designed to validate historically important moderator materials (such as light water and polyethylene), there is currently a lack of standard validation methods for TSLs, especially when multiple conflicting TSLs exist. To address this issue, the Oak Ridge National Lab Nuclear Data group has been working on utilizing inelastic neutron scattering (INS) measurements combined with transmission (i.e., total cross section) measurements to evaluate and validate TSLs for different materials. We plan to demonstrate how this method has worked on materials such as polyethylene, lucite, and polystyrene. In addition, we will compare the newly created libraries to ENDF libraries for these materials and explain why integral benchmarks should not be used for validation when multiple TSLs exist.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Preliminary critical experiments validation of a lattice physic code LATC - 14415

Core and System Integrated Engine for design and analysis (COSINE) is an integrated nuclear engineering code package, which is being developed by State Nuclear Power Software Development Center (SNPSDC) in China. A lattice physics code named LATC is included in COSINE.LATC is a 2D, steady-state code for modeling PWR fuel. A WIMS-D 69 group micro library based on ENDF/B-VI is used and there are two transportation methods in LATC, such as two steps method (collision probability method for cell homogenization, discrete coordinate method for assembly homogenization) and one step method (MOC). The UO{sub 2} fuel assembly, which may contain guide tubes, burnable poisons such as Integral Fuel Burnable Absorbers (IFBA) / Wet Annular Burnable Absorbers (WABA)/ Pyrexes or control rods etc, can be calculated in LATC. LATC provides the required cross-section data for the core physics simulator analysis code in COSINE. In order to evaluate the quality of the LATC, a strategy of validation is researched and applied to the LATC. Firstly, a validation requirement analysis is performed, and the corresponding critical experiments are collected, and then a critical experimental matrix considering the variety of fuel enrichments, fuel pitch and water to uranium ratio is generated. Finally, a comparison of results between LATC using collision probability and discrete coordinate method and critical experiments are made to make sure that the code works well. According to the validation strategy discussed above, the preliminary validation is carried out and critical experiments are calculated according to the critical experimental matrix and results from LATC code are compared with reference results. The result shows that the calculated results agree well with critical experiments, and do not indicate any significant trends with respect to the various conditions considered. (authors)

42 ENGINEERING↗

Results of an In-Field Validation Exercise in Support of Wide-Area Environmental Sampling

The National Nuclear Security Administration’s (NNSA) Office of Nonproliferation and Arms Control (NA-24) is evaluating Wide-Area Environmental Sampling (WAES) as an additional safeguards verification tool for the International Atomic Energy Agency to detect undeclared nuclear activities. The NNSA is evaluating strategies for conducting a generic WAES campaign, the cost of a WAES campaign, and the effect of technological advancements that have occurred since the last major WAES review in 1999. Until now, the NNSA effort has focused on tabletop exercises (TTXs) in which high-performance computing allows for advanced modeling and simulation efforts to be applied to the WAES question. Although the modeling and simulations used in the TTXs are extremely valuable, field campaigns are still needed to validate the assumptions that underpin the models and the modeling process itself. During a 7 week period beginning in May 2023 and ending in June 2023, which included 4 weeks of active field collections, a multilaboratory team conducted its first in-field validation exercise. Prior to the in-field exercise, abbreviated TTXs were conducted to estimate the performance of all collection systems to be used during the field test. These TTXs guided the selection of materials to be released and the placement of the collection system. Based on these determinations, materials were procured to use in the field test, and an injection/release system was designed, built, and installed at the test facility. Background samples were collected during weeks one and four, and environmental collections against active releases were conducted during weeks two and three. The goals of this validation exercise included a demonstration of (1) the ability to provide controlled releases of particulates of surrogate materials, (2) the fielding and operation of collection systems (including deposition and active air collectors), and (3) the flexibility to revise equipment and campaign plans in the field. This paper presents the results and preliminary conclusions for this initial validation test. Based on these results, subsequent field campaigns are anticipated and will include the addition of other released materials.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Validation of the DESI DR2 Ly$α$ forest full-shape analysis

We present the validation of the Dark Energy Spectroscopic Instrument (DESI) Data Release 2 (DR2) Lyman-$α$ (Ly$α$) forest full-shape analysis. This analysis combines three-dimensional Ly$α$ forest auto-correlations and cross-correlations with quasars to extract information from both the baryon acoustic oscillation (BAO) feature and the broadband clustering signal, with primary emphasis on the Alcock-Paczynski (AP) measurement. Compared to the DESI DR1 analysis, the DR2 validation uses substantially larger and more realistic mock datasets, including CoLoRe 2LPT and AbacusSummit Ly$α$ forest simulations. The modeling framework is also improved through analytic marginalization over small scales ($<10$$h^{-1}$Mpc) and the impact of ultraviolet background fluctuations. The validation program was completed prior to unblinding and defines quantitative requirements for the cosmological parameters of interest, which are evaluated using hundreds of mock realizations. We further test the analysis through independent fits to the auto- and cross-correlations, multiple catalog splits, and a broad suite of analysis and modeling variations applied to both mocks and blinded observational data. We find that the BAO and AP parameters satisfy all validation requirements and remain stable across all tests. In contrast, mock studies reveal a significant bias in the inferred growth-rate parameter $fσ_8$, leading us to exclude this measurement from the final analysis. The consistency across mocks, data splits, and robustness tests demonstrates that the DR2 Ly$α$ full-shape analysis provides a reliable and substantially improved broadband AP measurement over previous Ly$α$ forest studies.

Herbold, M. [Chicago U., KICP; Ohio State U.] (ORC↗

Systematic Validation of Ensemble Cloud-Process Simulations using Polarimetric Radar Observations and Simulator over the NASA Wallops Flight Facility

The BiLateral Operational Storm-Scale Observation and Modeling (BLOSSOM) project was initiated to establish a long-term supersite to improve understanding of cloud physical states and processes as well as to support satellite and climate model programs over the WFF site via a bilateral approach of storm-scale observations and process modeling. This study highlights a noble systematic validation framework of the BLOSSOM ensemble cloud-process simulations through mixed-phase, light-rain, and deep-convective precipitation cases. The framework consists of creating a domain-shifted ensemble of large-scale forcing datasets, and configuring and performing cloud-process simulations with three different bulk microphysics schemes. Validation uses NASA S-band dual-POLarimetric radar (NPOL) observations in the form of statistical composites and skill scores via a polarimetric radar simulator and newly developed CfRad Data tool (CfRAD). While the simulations capture the overall structures of the reflectivity composites, polarimetric signals are still poorly simulated, mainly due to a lack of representation of ice microphysics diversity in shapes, orientation distributions, and their complex mixtures. Despite the limitation, this new ensemble-based validation framework demonstrates that 1) no particular forcing or microphysics scheme outperforms the rest and 2) the skill scores of coarse- and fine-resolution ensemble simulations with different domain-shifted forcing and microphysics schemes are highly correlated with each other with no clear improvement. On the other hand, this suggests that coarse-resolution ensemble simulations are relevant for selecting the best meteorological forcing and microphysics scheme before conducting computationally demanding large eddy simulations (LESs) in support of aircraft and satellite instrument development as well as cloud-precipitation-convection parameterizations.

54 ENVIRONMENTAL SCIENCES↗