Search NASA⌕ Search

SEARCH · Search NASA

Results for “simulation evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

Transactive Energy Rationing in Islanded Electric Power Systems

Extreme weather events, many of which are climate change related, are occurring with increasing frequency and intensity and causing catastrophic outages. One of the major modern-day concerns of utilities is dealing with such extreme outages and consequently, its repercussions on the lives of people in society and social aspects. Traditionally, operators have been using rolling blackouts as a contingency plan to serve critical loads during such events when electricity supply is scarce. However, such blackouts practices are executed on a last-minute mandatory basis, depriving customers having low-capacity high priority loads (i.e. refrigeration, water, telecommunication, etc) that should also be serviced if at all possible. Historically, policymakers have often adopted quota-based regulatory actions or rationing for other commodities (such as gasoline, butter, sugar) to handle scarcity situations. Motivated from such quota based systems, our contribution presented in this work is an alternative transactive rationing mechanism that would provide some minimum level of service to all of the customers and serve the critical loads using market-based control during such scarcity-based contingencies. This is in contrast to the state-of-art TE mechanisms that allocate resources to customers solely based on their willingness-to-pay. The effectiveness of the proposed mechanism is demonstrated through simulation-based evaluation on two real-life use cases having feeder-level and microgrid-level configurations respectively. The simulation results clearly demonstrate the capability of the rationing scheme to serve customers’ high-priority loads through prolonged outages even during extreme scarcity scenarios.

42 ENGINEERING↗

MPAS-Analysis

MPAS-Analysis is a software package designed to process and analyze output data of the Model for Prediction Across Scales (MPAS) Ocean, Sea-Ice and Land-Ice model components. It is built primarily on the python language, with remapping of model unstructured-grid fields onto regular grids performed through the ESMF package, and with the computation of climatologies performed through the NCO package. The main purpose of MPAS-Analysis is to analyze the MPAS simulations in terms of ocean and ice metrics, in comparison with available observations, and therefore provide an accurate model evaluation and simulation assessment.

Veneziani, Milena↗

Multipurpose system simulator

Multipurpose System Simulator (MPSS) evaluates relative performance of competitive computer systems and isolates areas for enhancement in existing or proposed systems. Model can simulate multiple central-processing-unit (CPU) interactive systems.

Packard, C. A.↗

Modeling strength data for CREW CHIEF

The Air Force has developed CREW CHIEF, a computer-aided design (CAD) tool for simulating and evaluating aircraft maintenance to determine if the required activities are feasible. CREW CHIEF gives the designer the ability to simulate maintenance activities with respect to reach, accessibility, strength, hand tool operation, and materials handling. While developing the CREW CHIEF, extensive research was performed to describe workers strength capabilities for using hand tools and manual handling of objects. More than 100,000 strength measures were collected and modeled for CREW CHIEF. These measures involved both male and female subjects in the 12 maintenance postures included in CREW CHIEF. The data collection and modeling effort are described.

Mcdaniel, Joe W.↗

Benchmarking GOCART-2G in the Goddard Earth Observing System (GEOS)

The Goddard Chemistry Aerosol Radiation and Transport (GOCART) model, which controls the sources sinks and chemistry within the Goddard Earth Observing System, recently underwent a major refactoring and update to the representation of physical processes. The code refactoring increases flexibility such multiple instances of an aerosol species can be run and interact with radiation and cloud microphysics, in addition to the output of multiple wavelength aerosol optical properties in support of data assimilation. From a science perspective, a new radiatively active tracer, brown carbon, was added to distinguish smoke from other sources of organic aerosol thereby improving optical properties entering the radiative calculations. A four-year benchmark simulation was evaluated using in situ and space borne measurements to develop a baseline and prioritize future development. A comparison of simulated aerosol optical depth between GOCART-2G and MODIS retrievals indicates the model captures the overall spatial pattern and seasonal cycle of aerosol optical depth but overestimates aerosol extinction over dusty regions and underestimates aerosol extinction over northern hemisphere boreal forests, requiring further tuning of emissions. This MODIS-based analysis is corroborated by comparisons to MISR and selected AERONET stations. Despite the underestimate of aerosol optical depth in biomass burning regions in GEOS, there is an overestimate in the surface mass of organic carbon in the United States, especially during the summer months.

Allison Collow↗

Benchmarking GOCART-2G in the Goddard Earth Observing System (GEOS)

The Goddard Chemistry Aerosol Radiation and Transport (GOCART) model, which controls the sources sinks and chemistry within the Goddard Earth Observing System, recently underwent a major refactoring and update to the representation of physical processes. This paper serves to document code changes that were included in GOCART 2nd Generation (GOCART-2G) and establishes a benchmark simulation that is to be used for future development of the system. The code refactoring increases flexibility such multiple instances of an aerosol species can be run and interact with radiation and cloud microphysics, in addition to the output of multiple wavelength aerosol optical properties in support of data assimilation. From a science perspective, a new radiatively active tracer, brown carbon, was added to distinguish smoke from other sources of organic aerosol thereby improving optical properties entering the radiative calculations. A four-year benchmark simulation was evaluated using in situ and space borne measurements to develop a baseline and prioritize future development. A comparison of simulated aerosol optical depth between GOCART-2G and MODIS retrievals indicates the model captures the overall spatial pattern and seasonal cycle of aerosol optical depth but overestimates aerosol extinction over dusty regions and underestimates aerosol extinction over northern hemisphere boreal forests, requiring further tuning of emissions. This MODIS-based analysis is corroborated by comparisons to MISR and selected AERONET stations. Despite the underestimate of aerosol optical depth in biomass burning regions in GEOS, there is an overestimate in the surface mass of organic carbon in the United States, especially during the summer months.

Allison B Collow↗

RACORO continental boundary layer cloud investigations. 2. Large-eddy simulations of cumulus clouds and evaluation with in-situ and ground-based observations

A 60-hour case study of continental boundary layer cumulus clouds is examined using two large-eddy simulation (LES) models. The case is based on observations obtained during the RACORO Campaign (Routine Atmospheric Radiation Measurement [ARM] Aerial Facility [AAF] Clouds with Low Optical Water Depths [CLOWD] Optical Radiative Observations) at the ARM Climate Research Facility's Southern Great Plains site. The LES models are driven by continuous large-scale and surface forcings, and are constrained by multi-modal and temporally varying aerosol number size distribution profiles derived from aircraft observations. We compare simulated cloud macrophysical and microphysical properties with ground-based remote sensing and aircraft observations. The LES simulations capture the observed transitions of the evolving cumulus-topped boundary layers during the three daytime periods, and generally reproduce variations of droplet number concentration with liquid water content (LWC), corresponding to the gradient between the cloud centers and cloud edges at given heights. The observed LWC values fall within the range of simulated values; the observed droplet number concentrations are commonly higher than simulated, but differences remain on par with potential estimation errors in the aircraft measurements. Sensitivity studies examine the influences of bin microphysics versus bulk microphysics, aerosol advection, supersaturation treatment, and aerosol hygroscopicity. Simulated macrophysical cloud properties are found to be insensitive in this non-precipitating case, but microphysical properties are especially sensitive to bulk microphysics supersaturation treatment and aerosol hygroscopicity.

54 ENVIRONMENTAL SCIENCES↗

Large-scale features and evaluation of the PMIP4-CMIP6 midHolocene simulations

The mid-Holocene (6000 years ago) is a standard time period for the evaluation of the simulated response of global climate models using palaeoclimate reconstructions. The latest mid-Holocene simulations are a palaeoclimate entry card for the Palaeoclimate Model Intercomparison Project (PMIP4) component of the current phase of the Coupled Model Intercomparison Project (CMIP6) – hereafter referred to as PMIP4-CMIP6. Here we provide an initial analysis and evaluation of the results of the experiment for the mid-Holocene. We show that state-of-the-art models produce climate changes that are broadly consistent with theory and observations, including increased summer warming of the Northern Hemisphere and associated shifts in tropical rainfall. Many features of the PMIP4-CMIP6 simulations were present in the previous generation (PMIP3-CMIP5) of simulations. The PMIP4-CMIP6 ensemble for the mid-Holocene has a global mean temperature change of −0.3 K, which is −0.2 K cooler than the PMIP3-CMIP5 simulations predominantly as a result of the prescription of realistic greenhouse gas concentrations in PMIP4-CMIP6. Biases in the magnitude and the sign of regional responses identified in PMIP3-CMIP5, such as the amplification of the northern African monsoon, precipitation changes over Europe, and simulated aridity in mid-Eurasia, are still present in the PMIP4-CMIP6 simulations. Despite these issues, PMIP4-CMIP6 and the mid-Holocene provide an opportunity both for quantitative evaluation and derivation of emergent constraints on the hydrological cycle, feedback strength, and potentially climate sensitivity.

mid-Holocene simulations↗

Performance Evaluation of Data-Enhanced Hierarchical Control for Grid Operations

This paper presents a hardware-in-the-loop (HIL) simulation to evaluate the performance of voltage regulation of Data-Enhanced Hierarchical Control (DEHC). This DEHC uses an advanced distribution management system (ADMS) for grid operations to control legacy and grid-edge devices and coordinate with distributed energy management systems (DERMS) to manage high penetrations of photovoltaics (PV) on a utility distribution system. The HIL platform provides realistic laboratory testing, including accurate modeling (legacy devices, grid-edge devices, and PV) of the real-world distribution system from a utility partner, a real controller (ADMS), software controller DERMS, hardware grid-edge devices, and standard communications protocols. The test results demonstrate functionalities of the integrated platform and the performance of voltage regulation of the coordinated control systems. Based on laboratory testing, the utility can set up the same grid-automation system to manage DERs, legacy devices, and grid-edge devices to achieve their system-level control and operation objectives (e.g., voltage regulation), thus de-risking potential issues such as instability for field deployment.

41 EE - Solar Energy Technologies Office (EE-4S)↗

Evaluation of the Barracuda Software Package for Simulating Bubble Motion in Vibrating Liquid-Filled Containers

The commercial software package Barracuda, developed by CPFD Software for simulating particle-laden fluid flows, is evaluated as a means to simulate the motion of bubbles in vibrating liquid-filled containers. Demonstration simulations of bubbles rising due to buoyancy forces in a cylinder filled with silicone oil and angled at 0, 30, 45, and 60 degrees from the vertical were performed by CPFD Software. The results of these simulations are discussed, and the capabilities of Barracuda for simulating bubble motion are assessed. It was determined that at present Barracuda does not meet the needs of the desired application. Further developments that would enable its use for this application are highlighted.

42 ENGINEERING↗

Warm-phase microphysical evolution in large-eddy simulations of tropical cumulus congestus: evaluating drop size distribution evolution using polarimetry retrievals, in situ measurements, and a thermal-based framework

Owing to uncertainties in convective microphysics processes, improving parameterizations in Earth system models (ESMs) can benefit from observationally constrained cases suitable for scaling between cloud-resolving models and ESMs. We propose a benchmark large-eddy simulation (LES) cumulus congestus case study from the NASA Cloud, Aerosol, and Monsoon Processes Philippines Experiment (CAMP 2 Ex) for evaluating and improving ESMs in single-column model (SCM) mode. We seek observational constraints using novel polarimetric retrievals and in situ cloud microphysics measurements. Simulations using bulk and bin microphysics initialized with observed aerosol profiles are compared to cloud-top retrievals of cloud droplet effective radius (R eff ), effective variance (ν eff ), and number concentration (N d ) from the airborne Research Scanning Polarimeter (RSP). Both schemes reproduce characteristics of cloud-top N d and R eff that increase and decrease with altitude, respectively. Cloud-top N d is low-biased relative to RSP retrievals in both schemes, potentially due to limitations in both simulations and retrieval assumptions. Cloud-top R eff is low-biased in the bulk scheme but reasonably reproduced by the bin scheme. Profiles of N d and R eff are sensitive to the collision–coalescence process and the vertical variation in aerosol size distribution. Comparison of simulated and in situ droplet size distributions (DSDs) shows that, to first order, integrated moments are always sensitive to sizes < ~ 30 µm and can also be sensitive to larger sizes if the DSDs are sufficiently broad, with implications for the assumed maximum observed size retrieved by the RSP. The bin scheme captures the observed extended tail of the DSD, while the bulk scheme is unable to due to parametric constraints. Differences in expected relationships between in situ measurements of cloud cores and cloud-top retrievals by RSP demonstrate difficulty in constraining well the case presented herein. Finally, a thermal-tracking framework demonstrates that the dilution of N d throughout a thermal's lifetime is heavily determined by collision–coalescence and the height-varying aerosol distribution and that, in the absence of these, the impact of entrainment on diluting N d is largely offset by secondary activation. Implications for evaluating warm-phase convective microphysics schemes in ESMs and translating results for use on global, space-based polarimetry platforms are discussed.

Stanford, McKenna Wallace [Columbia Univ., New Yor↗

Collision prediction software for radiotherapy treatments

Purpose: This work presents a method of collision predictions for external beam radiotherapy using surface imaging. The present methodology focuses on collision prediction during treatment simulation to evaluate the clearance of a patient’s treatment position and allow for its modification if necessary. Methods: A Kinect camera (Microsoft, Redmond, WA) is used to scan the patient and immobilization devices in the treatment position at the simulator. The surface is reconstructed using the SKANECT software (Occipital, Inc., San Francisco, CA). The treatment isocenter is marked using simulated orthogonal lasers projected on the surface scan. The point cloud of this surface is then shifted to isocenter and converted from Cartesian to cylindrical coordinates. A slab models the treatment couch. A cylinder with a radius equal to the normal distance from isocenter to the collimator plate, and a height defined by the collimator diameter is used to estimate collisions. Points within the cylinder clear through a full gantry rotation with the treatment couch at 0° , while points outside of it collide. The angles of collision are reported. This methodology was experimentally verified using a mannequin positioned in an alpha cradle with both arms up. A planning CT scan of the mannequin was performed, two isocenters were marked in PINNACLE, and this information was exported to AlignRT (VisionRT, London, UK)—a surface imaging system for patient positioning. This was used to ensure accurate positioning of the mannequin in the treatment room, when available. Collision calculations were performed for the two treatment isocenters and the results compared to the collisions detected the room. The accuracy of the Kinect-Skanect surface was evaluated by comparing it to the external surface of the planning CT scan. Results: Experimental verification results showed that the predicted angles of collision matched those recorded in the room within 0.5°, in most cases (largest deviation −1.2°). The accuracy study for the Kinect-Skanect surface showed an average discrepancy between the CT external contour and the surface scan of 2.2 mm. Conclusions: This methodology provides fast and reliable collision predictions using surface imaging. The use of the Kinect-Skanect system allows for a comprehensive modeling of the patient topography including all the relevant anatomy and immobilization devices that may lead to collisions. The use of this tool at the treatment simulation stage may allow therapists to evaluate the clearance of a patient’s treatment position and optimize it before the planning CT scan is performed. This can allow for safer treatments for the patients due to better collision predictions and improved clinical workflow by minimizing replanning and resimulations due to unforeseen clearance issues.

60 APPLIED LIFE SCIENCES↗

Advancing cloud lifecycle representation in numerical models using innovative analysis methods that bridge arm observations over a breadth of scales

From its location on the subtropics-midlatitude boundary, the Azores is influenced by both the subtropical high pressure and the midlatitude baroclinic storm regimes, and therefore experiences a wide range of cloud structures, from fair-weather scenes to stratocumulus sheets to deep convective systems. This project combined three types of data sets to study cloud variability in the Azores: a satellite analysis of cloud regimes, a reanalysis characterization of storminess, and a 19-month field campaign that occurred on Graciosa Island. Combined analysis of the three data sets provides a detailed picture of cloud variability and the respective dynamic influences, with emphasis on low clouds that constitute a major uncertainty source in climate model simulations. The satellite cloud regime analysis shows that the Azores cloud distribution is similar to the mean global distribution and can therefore be used to evaluate cloud simulation in global models. Regime analysis of low clouds shows that stratocumulus decks occur under the influence of the Azores high-pressure system, while shallow cumulus clouds are sustained by cold-air outbreaks, as revealed by their preference for post-frontal environments and northwesterly flows. An evaluation of CMIP5 climate model cloud regimes over the Azores shows that all models severely underpredict shallow cumulus clouds, while most models also underpredict the occurrence of stratocumulus cloud decks. It is demonstrated that carefully selected case studies can be related through regime analysis to climatological cloud distributions, and a methodology is suggested utilizing process-resolving model simulations of individual cases to better understand cloud-dynamics interactions and attempt to explain and correct climate model cloud deficiencies.

58 GEOSCIENCES↗

Substantially positive contributions of new particle formation to cloud condensation nuclei under low supersaturation in China based on numerical model improvements

New particle formation (NPF) and subsequent particle growth are important sources of condensation nuclei (CN) and cloud condensation nuclei (CCN). While many observations have shown positive contributions of NPF to CCN at low supersaturation, negative NPF contributions were often simulated in polluted environments. Using the observations in a coastal city of Qingdao, Beijing, and Gucheng in north China, we thoroughly evaluate the simulated number concentrations of CN and CCN using an NPF-explicit parameterization embedded in the WRF-Chem model. For CN, the initial simulation shows large biases of particle number concentrations at 10–40 and 40–100 nm. By adjusting the process of gas–particle partitioning, including the mass accommodation coefficient (MAC) of sulfuric acid, the phase changes in primary organic aerosol emissions, and the condensational amount of nitric acid, the improvement of the particle growth process yields substantially reduced overestimation of CN. Regarding CCN, secondary organic aerosol (SOA) formed from the oxidation of semi-volatile and intermediate-volatility organic compounds (S/IVOCs) is called SI-SOA, the yield of which is an important contributor. At default settings, the SI-SOA yield is too high without considering the differences in precursor oxidation rates. Lowering the SI-SOA yield under linear H 2 SO 4 nucleation scheme results in much-improved CCN simulations compared to observations. On the basis of the bias-corrected model, we find substantially positive contributions of NPF to CCN at low supersaturation (~ 0.2 %) over broad areas of China, primarily due to competing effects of increasing particle hygroscopicity, a result of reductions in SI-SOA amount, surpassing that of particle size decreases. The bias-corrected model is robustly applicable to other schemes, such as the quadratic H 2 SO 4 nucleation scheme, in terms of CN and CCN, though the dependence of CCN on SI-SOA yield is diminished likely due to changes in particle composition. This study highlights potentially much larger NPF contributions to CCN on a regional and even global basis.

54 ENVIRONMENTAL SCIENCES↗

pystorms: A simulation sandbox for the development and evaluation of stormwater control algorithms

Advances in cyber–physical technologies have enabled real-time sensing and adaptive control of stormwater infrastructure. These smart stormwater systems allow for inexpensive, minimally-invasive stormwater control interventions in lieu of new construction. Importantly, however promising the area of smart stormwater control, there still remain barriers – for experts and novices alike – to access shared tools and methods for investigating, developing, and contributing to it. In an effort to make smart stormwater control research more methodical and accessible, we present pystorms, an open-source Python-based simulation sandbox that facilitates the quantitative evaluation and comparison of control strategies. pystorms consists of a collection of real world-inspired smart stormwater control scenarios on which any number of control strategies can be applied and tested via an accompanying Python programming interface and coupled stormwater simulator. pystorms provides a framework for the rigorous and efficient evaluation of smart stormwater control methodologies across diverse watersheds with only a few lines of code.

54 ENVIRONMENTAL SCIENCES↗

A hierarchical evaluation framework for assessing climate simulations relevant to the energy-water-land nexus (Final Report)

The overarching goal was to construct a hierarchy of new and well-tested metrics and analysis tools that support both fundamental and use-inspired research. Motivating this goal was a convergence of needs from climate scientists and stakeholders alike for a systematic, robust framework of model evaluation and diagnosis to provide scientific insights, inform model development, support best practices for the use of climate model outputs, and facilitate communication of climate information in the evolving landscapes of multi-model, multi-resolution, and large ensemble simulations that generate terabytes of data for any single climate run. Steps toward attaining these goals benefited from expertise and established capability of the project team, which included leadership of the North American Regional Climate Change Assessment Program (NARCCAP) and the Coordinated Regional Downscaling Experiment (CORDEX), development of hierarchical model evaluation approaches, and successful research in the analysis and diagnosis of climate model skill, as well as the understanding and modeling of regional climate processes in North America. As part of the overarching goal, the project worked to disseminate a suite of methodologies, algorithms, and software components that the wider community can employ to advance climate science and applications. With rigorous demonstration, the evaluation framework and the mix of standard and high risk / high reward approaches helped form the basis for future development of a computationally enabled user-friendly system for community use.

17 WIND ENERGY↗