Search NASA⌕ Search

SEARCH · Search NASA

Results for “Quality models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

A single-point modeling approach for the intercomparison and evaluation of ozone dry deposition across chemical transport models (Activity 2 of AQMEII4)

A primary sink of air pollutants and their precursors is dry deposition. Dry deposition estimates differ across chemical transport models, yet an understanding of the model spread is incomplete. Here, we introduce Activity 2 of the Air Quality Model Evaluation International Initiative Phase 4 (AQMEII4). We examine 18 dry deposition schemes from regional and global chemical transport models as well as standalone models used for impact assessments or process understanding. We configure the schemes as single-point models at eight Northern Hemisphere locations with observed ozone fluxes. Single-point models are driven by a common set of site-specific meteorological and environmental conditions. Five of eight sites have at least 3 years and up to 12 years of ozone fluxes. The interquartile range across models in multiyear mean ozone deposition velocities ranges from a factor of 1.2 to 1.9 annually across sites and tends to be highest during winter compared with summer. No model is within 50 % of observed multiyear averages across all sites and seasons, but some models perform well for some sites and seasons. For the first time, we demonstrate how contributions from depositional pathways vary across models. Models can disagree with respect to relative contributions from the pathways, even when they predict similar deposition velocities, or agree with respect to the relative contributions but predict different deposition velocities. Both stomatal and nonstomatal uptake contribute to the large model spread across sites. Our findings are the beginning of results from AQMEII4 Activity 2, which brings scientists who model air quality and dry deposition together with scientists who measure ozone fluxes to evaluate and improve dry deposition schemes in the chemical transport models used for research, planning, and regulatory purposes.

54 ENVIRONMENTAL SCIENCES↗

A Single-Point Modeling Approach for the Intercomparison and Evaluation of Ozone Dry Deposition Across Chemical Transport Models (Activity 2 of AQMEII4)

A primary sink of air pollutants and their precursors is dry deposition. Dry deposition estimates differ across chemical transport models, yet an understanding of the model spread is incomplete. Here, we introduce Activity 2 of the Air Quality Model Evaluation International Initiative Phase 4 (AQMEII4). We examine 18 dry deposition schemes from regional and global chemical transport models as well as standalone models used for impact assessments or process understanding. We configure the schemes as single-point models at eight Northern Hemisphere locations with observed ozone fluxes. Single-point models are driven by a common set of site-specific meteorological and environmental conditions. Five of eight sites have at least 3 years and up to 12 years of ozone fluxes. The interquartile range across models in multiyear mean ozone deposition velocities ranges from a factor of 1.2 to 1.9 annually across sites and tends to be highest during winter compared with summer. No model is within 50 % of observed multiyear averages across all sites and seasons, but some models perform well for some sites and seasons. For the first time, we demonstrate how contributions from depositional pathways vary across models. Models can disagree with respect to relative contributions from the pathways, even when they predict similar deposition velocities, or agree with respect to the relative contributions but predict different deposition velocities. Both stomatal and nonstomatal uptake contribute to the large model spread across sites. Our findings are the beginning of results from AQMEII4 Activity 2, which brings scientists who model air quality and dry deposition together with scientists who measure ozone fluxes to evaluate and improve dry deposition schemes in the chemical transport models used for research, planning, and regulatory purposes.

Dry deposition↗

NRAP-Open-IAM Multisegmented Wellbore Reduced-Order Model: Improvement and Quality Assurance

The multisegmented wellbore model (MSW) semi-analytically estimates the amount of CO 2 and brine leakage from a leaking legacy well by segmenting it into intervals to simulate site-specific stratigraphic and hydrogeologic properties. The model is a component of the National Risk Assessment Partnership Open-Source Integrated Assessment Model (NRAP-Open-IAM), which was developed to perform risk assessment for geologic CO 2 storage. The new wellbore leakage model, which uses deep learning networks for a caprock segment, was developed to enhance the analytical MSW. The model was trained and validated using a synthetic data set of Subsurface Transport Over Multiple Phases (STOMP) multiphase flow simulations from various geological, well attribute, and operational conditions to ensure its quality. The results demonstrate that the model is more accurate than the existing model in predicting the transport of two-phase fluids (brine and injected CO 2 ) through the well. This report provides a detailed explanation of the model development and quality assurance.

58 GEOSCIENCES↗

Quantifying the reductions in mortality from air-pollution by cancelling new coal power plants

Deep decarbonization paths to the 1.5°C or 2°C temperature stabilization futures require a rapid reduction in conventional coal-fired power plants, but countries are currently building 223 GW of new coal power capacity and plan to build 377 GW more in the next decade. Coal-fired plants are also a major contributor to air pollution related health impacts. Here, we couple an integrated human-earth system model (GCAM) with an air quality model (TM5-FASST) to examine regional health co-benefits from cancelling new coal-fired plants worldwide. Additionally, we find that cancelling all new proposed projects would decrease air pollution related premature mortality between 101,388 - 213,205 deaths (2-5%) in 2030, and 213,414 - 373,054 (5-8%) in 2050, globally, but heavily concentrated in developing Asia. Furthermore, we estimate that strengthening the climate target from 2°C to 1.5°C would avoid 326,351 additional mortalities in 2030, of which 251,011 (75%) are attributable to the incremental coal plant shutdown.

63 RADIATION, THERMAL, AND OTHER ENVIRON. POLLUTAN↗

Modeling SARS-CoV-2 proteins in the CASP-commons experiment

Critical Assessment of Structure Prediction (CASP) is an organization aimed at advancing the state of the art in computing protein structure from sequence. In the spring of 2020, CASP launched a community project to compute the structures of the most structurally challenging proteins coded for in the SARS-CoV-2 genome. Forty-seven research groups submitted over 3000 three-dimensional models and 700 sets of accuracy estimates on 10 proteins. The resulting models were released to the public. CASP community members also worked together to provide estimates of local and global accuracy and identify structure-based domain boundaries for some proteins. Subsequently, two of these structures (ORF3a and ORF8) have been solved experimentally, allowing assessment of both model quality and the accuracy estimates. Models from the AlphaFold2 group were found to have good agreement with the experimental structures, with main chain GDT_TS accuracy scores ranging from 63 (a correct topology) to 87 (competitive with experiment).

59 BASIC BIOLOGICAL SCIENCES↗

Health co-benefits and mitigation costs as per the Paris Agreement under different technological pathways for energy supply

This study assesses the reductions in air pollution emissions and subsequent beneficial health effects from different global mitigation pathways consistent with the 2 °C stabilization objective of the Paris Agreement. We use an integrated modelling framework, demonstrating the need for models with an appropriate level of technology detail for an accurate co-benefit assessment. The framework combines an integrated assessment model (GCAM) with an air quality model (TM5-FASST) to obtain estimates of premature mortality and then assesses their economic cost. The results show that significant co-benefits can be found for a range of technological options, such as introducing a limitation on bioenergy, carbon capture and storage (CCS) or nuclear power. Cumulative premature mortality may be reduced by 17–23% by 2020–2050 compared to the baseline, depending on the scenarios. However, the ratio of health co-benefits to mitigation costs varies substantially, ranging from 1.45 when a bioenergy limitation is set to 2.19 when all technologies are available. As for regional disaggregation, some regions, such as India and China, obtain far greater co-benefits than others.

54 ENVIRONMENTAL SCIENCES↗

Improving AlphaFold2-based protein tertiary structure prediction with MULTICOM in CASP15

Since the 14th Critical Assessment of Techniques for Protein Structure Prediction (CASP14), AlphaFold2 has become the standard method for protein tertiary structure prediction. One remaining challenge is to further improve its prediction. We developed a new version of the MULTICOM system to sample diverse multiple sequence alignments (MSAs) and structural templates to improve the input for AlphaFold2 to generate structural models. The models are then ranked by both the pairwise model similarity and AlphaFold2 self-reported model quality score. The top ranked models are refined by a novel structure alignment-based refinement method powered by Foldseek. Moreover, for a monomer target that is a subunit of a protein assembly (complex), MULTICOM integrates tertiary and quaternary structure predictions to account for tertiary structural changes induced by protein-protein interaction. The system participated in the tertiary structure prediction in 2022 CASP15 experiment. Our server predictor MULTICOM_refine ranked 3rd among 47 CASP15 server predictors and our human predictor MULTICOM ranked 7th among all 132 human and server predictors. The average GDT-TS score and TM-score of the first structural models that MULTICOM_refine predicted for 94 CASP15 domains are ~0.80 and ~0.92, 9.6% and 8.2% higher than ~0.73 and 0.85 of the standard AlphaFold2 predictor respectively.

59 BASIC BIOLOGICAL SCIENCES↗

U-Surf: a global 1 km spatially continuous urban surface property dataset for kilometer-scale urban-resolving Earth system modeling

High-resolution urban climate modeling has faced substantial challenges due to the absence of a globally consistent, spatially continuous, and accurate dataset to represent the spatial heterogeneity of urban surfaces and their biophysical properties. This deficiency has long obstructed the development of urban-resolving Earth system models (ESMs) and ultra-high-resolution urban climate modeling, over large domains. Here, we present U-Surf, a first-of-its-kind 1 km resolution present-day (circa 2020) global continuous urban surface parameter dataset. Using the urban canopy model (UCM) in the Community Earth System Model as a base model for satisfying dataset requirements, U-Surf leverages the latest advances in remote sensing, machine learning, and cloud computing to provide the most relevant urban surface biophysical parameters, including radiative, morphological, and thermal properties, for UCMs at the facet and canopy level. Generated using a systematically unified workflow, U-Surf ensures internal consistency among key parameters, making it the first globally coherent urban canopy surface dataset. U-Surf significantly improves the representation of the urban land heterogeneity both within and across cities globally; provides essential, high-fidelity surface biophysical constraints to urban-resolving ESMs; enables detailed city-to-city comparisons across the globe; and supports next-generation kilometer-resolution Earth system modeling across scales. U-Surf parameters can be easily converted or adapted to various types of UCMs, such as those embedded in weather and regional climate models, as well as air quality models. The fundamental urban surface constraints provided by U-Surf can also be used as features for machine learning models and can have other broad-scale applications for socioeconomic, public health, and urban planning contexts. We expect U-Surf to advance the research frontier of urban system science, climate-sensitive urban design, and coupled human–Earth systems in the future. The dataset is publicly available at https://doi.org/10.5281/zenodo.11247598 (Cheng et al., 2024).

Cheng, Yifan [Univ. of Illinois at Urbana-Champaig↗

Satellite Data of Atmospheric Pollution for U.S. Air Quality Applications: Examples of Applications, Summary of Data End-user Resources, Answers to Faqs, and Common Mistakes to Avoid

Satellite data of atmospheric pollutants are becoming more widely used in the decision-making and environmental management activities of public, private sector and non-profit organizations. They are employed for estimating emissions, tracking pollutant plumes, supporting air quality forecasting activities, providing evidence for "exceptional event" declarations, monitoring regional long-term trends, and evaluating air quality model output. However, many air quality managers are not taking full advantage of the data for these applications nor has the full potential of satellite data for air quality applications been realized. A key barrier is the inherent difficulties associated with accessing, processing, and properly interpreting observational data. A degree of technical skill is required on the part of the data end-user, which is often problematic for air quality agencies with limited resources. Therefore, we 1) review the primary uses of satellite data for air quality applications, 2) provide some background information on satellite capabilities for measuring pollutants, 3) discuss the many resources available to the end-user for accessing, processing, and visualizing the data, and 4) provide answers to common questions in plain language.

remote sensing↗

Satellite Data of Atmospheric Pollution for U.S. Air Quality Applications: Examples of Applications, Summary of Data End-User Resources, Answers to FAQs, and Common Mistakes to Avoid

Satellite data of atmospheric pollutants are becoming more widely used in the decision-making and environmental management activities of public, private sector and non-profit organizations. They are employed for estimating emissions, tracking pollutant plumes, supporting air quality forecasting activities, providing evidence for "exceptional event" declarations, monitoring regional long-term trends, and evaluating air quality model output. However, many air quality managers are not taking full advantage of the data for these applications nor has the full potential of satellite data for air quality applications been realized. A key barrier is the inherent difficulties associated with accessing, processing, and properly interpreting observational data. A degree of technical skill is required on the part of the data end-user, which is often problematic for air quality agencies with limited resources. Therefore, we 1) review the primary uses of satellite data for air quality applications, 2) provide some background information on satellite capabilities for measuring pollutants, 3) discuss the many resources available to the end-user for accessing, processing, and visualizing the data, and 4) provide answers to common questions in plain language.

Duncan, Bryan↗

Predictive Indicators of the Performance of Large Language Models

In several mission contexts, it is desirable to estimate the performance of large language models (LLMs) on tasks that we cannot run directly. In light of published “scaling laws” our hypothesis is that some tasks should be consistently more challenging than others based on characteristics of the task. The goal of this project was to begin quantifying how much information about LLM performance can be gained from the features of a model and a task. Two of our statistical models struggled to converge. Pass/fail test results may provide limited information for inference beyond model quality and task difficulty, but we see no evidence at this time for significant feature interaction effect sizes, arguing for simple models. Future work extending the models to capitalize on perplexity of ground truth answers is suggested. This project also introduces “Depth of Knowledge Variant Testing” as a strategy for more finely assessing language models on open domain question and answer tasks. We developed sets of questions that ask a language model to produce similar information while demonstrating increasing depth of knowledge, and also relabeled existing Q&A test questions with their depth of knowledge. Our results suggest further consideration of Bloom’s taxonomy and further refinement of prompts to properly elicit information at varying depths. In the course of this work, we set up a basic infrastructure for standardizing tasks and testing many language models on these tasks. In addition to testing the predictive quality of model features and performance across test suites, with this project we have introduced two new task features to contextualize each test question: the Dewey Classification main category of information covered, and the Bloom’s taxonomy level that corresponds to the depth of knowledge probed by the question. Splits across these and other features produced over five hundred task subtypes with distinct feature vectors, which we tested on half a dozen models.

97 MATHEMATICS AND COMPUTING↗

A Numerical Study of Hypoxia in Chesapeake Bay Using an Unstructured Grid Model: Validation and Sensitivity to Bathymetry Representation

A three-dimensional unstructured-grid hydrodynamic and water quality model (Semi-implicit Cross-scale Hydroscience Intergrated System Model-Integrated Compartment Model) is applied successfully for Chesapeake Bay. The model is validated with observations of salinity, chlorophyll-a, dissolved oxygen, nutrients, and phytoplankton productions from the year 1991 to 1995 for the mainstem and some major tributaries, based on multiple model skill scores. Model experiments are conducted to test the importance of having (1) an accurate representation of bathymetry to correctly predict hypoxia and other processes and (2) a high-resolution model grid for tributaries to correctly simulate water quality variables. Further, comparison with the model experiment results with bathymetry smoothing indicates that bathymetry smoothing, as commonly used for many systems, changes the stratification and lateral circulation pattern, resulting in more salt intrusion into shallow water regions, and an increase in the freshwater age. Consequently, a model with bathymetry smoothing can lead to an unrealistic prediction of the distribution of hypoxia and phytoplankton production. Local grid refinement shows significant improvement of model simulations on local stratification and water quality variables. Overall, the use of high-resolution unstructured grid model leads to a faithful representation of the complex geometry, and thus a seamless cross-scale capability for simulating water quality processes in the Bay including tributaries and tidal creeks.

54 ENVIRONMENTAL SCIENCES↗

Impact of Bay-Breeze Circulations on Surface Air Quality and Boundary Layer Export

Meteorological and air-quality model simulations are analyzed alongside observations to investigate the role of the Chesapeake Bay breeze on surface air quality, pollutant transport, and boundary layer venting. A case study was conducted to understand why a particular day was the only one during an 11-day ship-based field campaign on which surface ozone was not elevated in concentration over the Chesapeake Bay relative to the closest upwind site and why high ozone concentrations were observed aloft by in situ aircraft observations. Results show that southerly winds during the overnight and early-morning hours prevented the advection of air pollutants from the Washington, D.C., and Baltimore, Maryland, metropolitan areas over the surface waters of the bay. A strong and prolonged bay breeze developed during the late morning and early afternoon along the western coastline of the bay. The strength and duration of the bay breeze allowed pollutants to converge, resulting in high concentrations locally near the bay-breeze front within the Baltimore metropolitan area, where they were then lofted to the top of the planetary boundary layer (PBL). Near the top of the PBL, these pollutants were horizontally advected to a region with lower PBL heights, resulting in pollution transport out of the boundary layer and into the free troposphere. This elevated layer of air pollution aloft was transported downwind into New England by early the following morning where it likely mixed down to the surface, affecting air quality as the boundary layer grew.

bay breeze↗

Implementing Model-Check for Employee and Management Satisfaction

This presentation will discuss methods to which ModelCheck can be implemented to not only improve model quality, but also satisfy both employees and management through different sets of quality checks. This approach allows a standard set of modeling practices to be upheld throughout a company, with minimal interaction required by the end user. The presenter will demonstrate how to create multiple ModelCheck standards, preventing users from evading the system, and how it can improve the quality of drawings and models.

Jones, Corey↗

Regional-Scale Modeling Parameterizations for Secondary Organic Aerosol Formation from Isoprene Epoxydiols: Experimentally Based Evaluation and Optimization

Isoprene is an abundant volatile organic compound emitted from broadleaf forests. Under low nitric oxide concentrations, isoprene is photochemically oxidized to form gas-phase isoprene epoxydiols (IEPOX). In the presence of acidified sulfate aerosols, IEPOX enhances the secondary organic aerosol (SOA) formation. Predictions of IEPOX-SOA in regional-scale models, e.g., the Community Multiscale Air Quality Model (CMAQ), are uncertain due to homogeneous aerosol assumptions, underpredictions of water uptake (hygroscopicity), and aerosol surface area. Here, we used experimental measurements of IEPOX-SOA tracers, 2-methyltetrols (2-MT) and 2-methyltetrol sulfates (2-MTS), formed at initial IEPOX-to-inorganic sulfate ratios ranging from 1–10.5, at ∼50% relative humidity to constrain key IEPOX-SOA parameters: phase separation, organic shell diffusivity (D org ), acidity, hygroscopic growth, mass accommodation, and kinetics. The base CMAQ parametrization overpredicted experimental IEPOX-SOA with an average normalized mean bias (NMB average ) of 1.63. CMAQ with phase separation underpredicted IEPOX-SOA (NMB average = −0.71). Using the phase-separated model, CMAQ model performance was optimized (NMB average = 0.077) with an increased D org = 2 × 10 –16 m 2 s –1 and increased rate constants (k 2-MT = 1 × 10 –3 M 2 s –1 , k 2-MTS = 8.83 × 10 –3 M 2 s –1 ). The optimized model explicitly accounted for hygroscopic growth by utilizing experimentally derived growth rates, improving aerosol surface area predictions. Our model highlights the importance of the aerosol mixing state (homogeneous versus phase-separated), aerosol size dynamics, and hygroscopic growth in modeling heterogeneous reactive uptake of IEPOX.

aerosols↗

Dry Deposition Methods Based on Turbulence Kinetic Energy: 1. Evaluation of Various Resistances and Sensitivity Studies Using a Single‐Point Model

Different functions are used to account for turbulence strength in the atmospheric boundary layer for different stability regimes. These functions are one of the sources for differences among different atmospheric models' predictions and associated biases. Also, turbulence strength is underrepresented in some of the resistance formulations. Here, to address these issues with dry deposition, firstly we take advantage of three‐dimensional (3‐D) turbulence information in estimating resistances by proposing and validating a 3‐D turbulence velocity scale that is relevant for different stability regimes of boundary layer. Secondly, we hypothesize and validate that friction velocity measured by 3‐D sonic anemometer can be effectively replaced by the new turbulence velocity scale multiplied by the von Karman constant. Finally, we (a) present a set of resistance formulations for ozone (O 3 ) based on the 3‐D turbulence velocity scale; (b) intercompare estimations of such resistances with those obtained using existing formulations; and, (c) evaluate simulated O 3 fluxes using a single‐point dry deposition model against long‐term observations of O 3 fluxes at the Harvard Forest (MA) site. Results indicate that the new resistance formulations work very well in simulating surface latent heat and O 3 fluxes when compared to respective existing formulations and measurements at a decadal time scale. Findings from this research may help to improve the capability of dry deposition schemes for better estimation of dry deposition fluxes and create opportunities for the development of a community dry deposition model for use in regional/global air quality models.

54 ENVIRONMENTAL SCIENCES↗

Partitioning the LIS/OTD Lightning Climatological Dataset into Separate Ground and Cloud Flash Distributions

Presently, it is not well understood how to best model nitrogen oxides (NOx) emissions from lightning because lightning is highly variable. Peak current, channel length, channel altitude, stroke multiplicity, and the number of flashes that occur in a particular region (i.e., flash density) all influence the amount of lightning NOx produced. Moreover, these 5 variables are not the same for ground and cloud flashes; e.g., cloud flashes normally have lower peak currents, higher altitudes, and higher flash densities than ground flashes [see (Koshak, 2009) for additional details]. Because the existing satellite observations of lightning (Fig. 1) from the Lightning Imaging Sensor/Optical Transient Detector (LIS/OTD) do not distinguish between ground and cloud fashes, which produce different amounts of NOx, it is very difficult to accurately account for the regional/global production of lightning NOx. Hence, the ability to partition the LIS/OTD lightning climatology into separate ground and cloud flash distributions would substantially benefit the atmospheric chemistry modeling community. NOx indirectly influences climate because it controls the concentration of ozone and hydroxyl radicals in the atmosphere. The importance of lightning-produced NOx is empasized throughout the scientific literature (see for example, Huntrieser et al. 1998). In fact, lightning is the most important NOx source in the upper troposphere with a global production rate estimated to vary between 2 and 20 Tg (N)yr(sup -1) (Lee et al., 1997), with more recent estimates of about 6 Tg(N)yr(sup -1) (Martin et al., 2007). In order to make accurate predictions, global chemistry/climate models (as well as regional air quality modells) must more accurately account for the effects of lightning NOx. In particular, the NASA Goddard Institute for Space Studies (GISS) Model E (Schmidt et al., 2005) and the GEOS-CHEM global chemical transport model (Bey et al., 2001) would each benefit from a partitioning of the LIS/OTD lightning climatology. In this study, we introduce a new technique for retrieving the ground flash fraction in a set of N lightning observed from space and that occur within a specific latitude/longitude bin. The method is briefly described and applied to CONUS lightning that have already been partitioned into ground and cloud flashes using independent ground-based observations, in order to assess the accuracy of the retrieval method. The retrieval errors are encouragingly small.

Koshak, W. J.↗

Modeling, Monitoring and Fault Diagnosis of Spacecraft Air Contaminants

Progress and results in the development of an integrated air quality modeling, monitoring, fault detection, and isolation system are presented. The focus was on development of distributed models of the air contaminants transport, the study of air quality monitoring techniques based on the model of transport process and on-line contaminant concentration measurements, and sensor placement. Different approaches to the modeling of spacecraft air contamination are discussed, and a three-dimensional distributed parameter air contaminant dispersion model applicable to both laminar and turbulent transport is proposed. A two-dimensional approximation of a full scale transport model is also proposed based on the spatial averaging of the three dimensional model over the least important space coordinate. A computer implementation of the transport model is considered and a detailed development of two- and three-dimensional models illustrated by contaminant transport simulation results is presented. The use of a well established Kalman filtering approach is suggested as a method for generating on-line contaminant concentration estimates based on both real time measurements and the model of contaminant transport process. It is shown that high computational requirements of the traditional Kalman filter can render difficult its real-time implementation for high-dimensional transport model and a novel implicit Kalman filtering algorithm is proposed which is shown to lead to an order of magnitude faster computer implementation in the case of air quality monitoring.

Ramirez, W. Fred↗