Search NASA⌕ Search

SEARCH · Search NASA

Results for “simulation evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,639 records · Page 91
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Evaluating Connected and Automated Vehicles in Co-Simulation Environment of Traffic Microsimulation and Vehicle Dynamics

Connected and automated vehicles (CAVs) have the potential to improve many aspects of the current transportation systems such as safety, mobility, and energy efficiency. In order to evaluate the benefits and impacts of a CAV, the CAV control algorithm is typically implemented on vehicles simulated in a traffic microsimulation environment. However, traffic microsimulation usually lacks detailed vehicle and powertrain dynamics, making it challenging to fully understand how a CAV control algorithm will perform and respond on an actual vehicle. Whether the same benefits measured in the simulation will also be observed in real-world remains an open question. One potential approach to fill in this gap is to conduct a co-simulation of traffic microsimulation with detailed vehicle and powertrain dynamics models, often developed in MATLAB Simulink. However, current microsimulation tools such as VISSIM and SUMO do not have a ready-to-use interface for co-simulation with vehicle dynamics and Simulink. Also, even if such an interface exists, it will be tool-specific, making it challenging to shift from one tool to another or test CAV controls in different tools. There are needs for tool-agnostic co-simulation as different microsimulation tools have their pros and cons, and researchers often need to use different tools based on the purposes of the simulation, project needs, and applications. In this work, Flexible Interface for X-in-the-loop Simulation (FIXS) is developed that can support the co-simulation of microsimulation, CAV control algorithm, and vehicle dynamics model in Simulink. Enabled by the FIXS, the benefit and performance of a CAV control algorithm can be better understood with the consideration of vehicle responses and dynamics. The connection to VISSIM and SUMO is handled internally by the interface, and users can easily switch tools by changing a configuration file. The co-simulation capability is demonstrated for a VISSIM eco-approach and departure CAV scenario and a SUMO cooperative merging scenario for both a passenger CAV and a class 8 heavy-duty connected and automated trucks.

Shao, Yunli↗
DOE OSTI2024

Mesoscale Convective Systems Represented in High Resolution E3SMv2 and Impact of New Cloud and Convection Parameterizations

Mesoscale convective systems (MCSs) play an important role in modulating the global hydrological cycle, general circulation, and radiative energy budget. In this study, we evaluate MCS simulations in the second version of U.S. Department of Energy (DOE) Energy Exascale Earth System Model (E3SMv2). E3SMv2 atmosphere model (EAMv2) is run at the uniform 0.25? horizontal resolution. We track MCSs consistently in the model and observations using the PyFLEXTRKR algorithm, which defines MCS based on both cloud-top brightness temperature (Tb) and surface precipitation. Results from using Tb only to define MCS, commonly used in previous studies, are also discussed. Furthermore, sensitivity experiments are performed to examine the impact of new cloud and convection parameterizations developed for EAMv3 on simulated MCSs. Our results show that EAMv2 simulated MCS precipitation is largely underestimated in the tropics and contiguous United States. This is mainly attributed to the underestimated precipitation intensity in EAMv2. In contrast, the simulated MCS frequency becomes more comparable to observations if MCSs are defined only based on cloud-top Tb. The Tb-based MCS tracking method, however, includes many cloud systems with very weak precipitation which conflicts with the MCS definition. This result illustrates the importance of accounting for precipitation in evaluating simulated MCSs. We also find that the new physics parameterizations help increase the relative contribution of convective precipitation to total precipitation in the tropics, but the simulated MCS properties are generally not improved. This suggests that simulating MCSs will remain a challenge for the next version of E3SM.

Zhang, Meng↗
DOE OSTI2020

On the use of adjoints in the inversion of observed quasi-static deformation

An adjoint-based conjugate gradient algorithm provides an efficient means for imaging sources of deformation within the Earth, such as volume stresses associated with fluid flow in aquifers and reservoirs. For time intervals over which the overburden deforms elastically, one can calculate the gradient elements for a single model update using just two numerical simulations. The first is a forward run that is used to compute the residuals associated with the given iteration. The second simulation is to evaluate the application of the adjoint operator to the residuals. In this adjoint calculation, the residual displacements are applied as sources at the measurement locations, driving the deformation in the simulation. The volume stress on the source grid blocks, in response to the residual displacements, provide the gradient components. We apply this technique to satellite-based interferometric synthetic aperture radar (InSAR) line-of-sight displacements that were observed over an oil reservoir in California’s Central Valley. Furthermore, we find that the adjoint-based gradient estimates, requiring 18 CPU seconds, agree with conventional numerical calculations that take over 3700 CPU seconds to compute. Conjugate gradient algorithms utilizing the conventional approach and adjoint-based gradient computations give roughly the same reductions in misfit and similar final estimates of reservoir volume change.

58 GEOSCIENCES↗
DOE OSTI2023

Neural Architecture Search Benchmarks: Insights and Survey

Neural Architecture Search (NAS), a promising and fast-moving research field, aims to automate the architectural design of Deep Neural Networks (DNNs) to achieve better performance on the given task and dataset. NAS methods have been very successful in discovering efficient models for various Computer Vision, Natural Language Processing, etc. The major obstacles to the advancement of NAS techniques are the demand for large computation resources and fair evaluation of various search methods. The differences in training pipeline and setting make it challenging to compare the efficiency of two NAS algorithms. A large number of NAS Benchmarks to simulate the architecture evaluation in seconds have been released over the last few years to ease the computation burden of training neural networks and can aid in the unbiased assessment of different search methods. This paper provides an extensive review of several publicly available NAS Benchmarks in the literature. We provide technical details and a deeper understanding of each benchmark and point out future directions.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2015

TU-AB-303-11: Predict Parotids Deformation Applying SIS Epidemiological Model in H&N Adaptive RT

Purpose: The aim is to investigate the use of epidemiological models to predict morphological variations in patients undergoing radiation therapy (RT). The susceptible-infected-susceptible (SIS) deterministic model was applied to simulate warping within a focused region of interest (ROI). Hypothesis is to consider each voxel like a single subject of the whole sample and to treat displacement vector fields like an infection. Methods: Using Raystation hybrid deformation algorithms and automatic re-contouring based on mesh grid, we post-processed 360 MVCT images of 12 H&N patients treated with Tomotherapy. Study focused on parotid glands, identified by literature and previous analysis, as ROI more susceptible to warping in H&N region. Susceptible (S) and infectious (I) cases were identified in voxels with inter-fraction movement respectively under and over a set threshold. IronPython scripting allowed to export positions and displacement data of surface voxels for every fraction. A MATLAB homemade toolbox was developed to model the SIS. Results: SIS model was validated simulating organ motion on QUASAR phantom. Applying model in patients, within a [0–1cm] range, a single voxel movement of 0.4cm was selected as displacement threshold. SIS indexes were evaluated by MATLAB simulations. Dynamic time warping algorithm was used to assess matching between model and parotids behavior days of treatments. The best fit of the model was obtained with contact rate of 7.89±0.94 and recovery rate of 2.36±0.21. Conclusion: SIS model can follow daily structures evolutions, making possible to compare warping conditions and highlighting challenges due to abnormal variation and set-up errors. By epidemiology approach, organ motion could be assessed and predicted not in terms of average of the whole ROI, but in a voxel-by-voxel deterministic trend. Identifying anatomical region subjected to variations, would be possible to focus clinic controls within a cohort of pre-selected patients eligible for adaptive RT. The research is partially co-funded by the Italian Research Grant: Dose warping methods for IGRT and Adaptive RT: dose accumulation based on organ motion and anatomical variations of the patients during radiation therapy treatments,MoH (GR-2010-2318757) and Tecnologie Avanzate S.r.l.(Italy)

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Modeling and Simulation of MC-Small Design

In order to design a lightweight, highly portable neutron multiplicity counter for use in higher risk regions by mobile field teams, a redesign of the MC-15 is being performed, with the goal of producing a detector below 30 lbs for ease of transport. To achieve this, multiple MCNP® simulations were run, evaluating the number and positioning of the He-3 tubes in the detector as well as the amount of high-density polyethylene (HDPE) surrounding the tubes. Based on these simulations, the proposed redesign of the MC-15 (aka MC-Small) possesses 11 tubes and is 13 in wide, 3.21 in thick and 13 in tall. Including the changes to the positioning of the tubes and the removal of HDPE from less sensitive regions of the detectors (i.e. bases of tubes, back of detector), this resulted in an efficiency of 0.56% when measuring a bare Cf-252 source 19.69 in away, only 28% less efficient (relatively) than the MC-15 while weighing 18 lbs, 12 lbs less than the weight of the MC-15.

42 ENGINEERING↗
NASA NTRS1966

Antenna simulator permits preinstallation system checkout

Antenna simulator provides for evaluation checkout of corporate feeds, monopulse sum-and-difference networks, etc., in a shielded environment prior to system checkout on an antenna pattern range. This technique is useful wherever simulation of monopulse antenna element characteristics is desired for checkout of ancillary equipment in a controlled environment.

Elia, A. D.↗
NASA NTRS2010

Comparing Global Atmospheric CO2 Flux and Transport Models with Remote Sensing (and Other) Observations

We report recent progress derived from comparison of global CO2 flux and transport models with new remote sensing and other sources of CO2 data including those from satellite. The overall objective of this activity is to improve the process models that represent our understanding of the workings of the atmospheric carbon cycle. Model estimates of CO2 surface flux and atmospheric transport processes are required for initial constraints on inverse analyses, to connect atmospheric observations to the location of surface sources and sinks, to provide the basic framework for carbon data assimilation, and ultimately for future projections of carbon-climate interactions. Models can also be used to test consistency within and between CO2 data sets under varying geophysical states. Here we focus on simulated CO2 fluxes from terrestrial vegetation and atmospheric transport mutually constrained by analyzed meteorological fields from the Goddard Modeling and Assimilation Office for the period 2000 through 2009. Use of assimilated meteorological data enables direct model comparison to observations across a wide range of scales of variability. The biospheric fluxes are produced by the CASA model at 1x1 degrees on a monthly mean basis, modulated hourly with analyzed temperature and sunlight. Both physiological and biomass burning fluxes are derived using satellite observations of vegetation, burned area (as in GFED-3), and analyzed meteorology. For the purposes of comparison to CO2 data, fossil fuel and ocean fluxes are also included in the transport simulations. In this presentation we evaluate the model's ability to simulate CO2 flux and mixing ratio variability in comparison to remote sensing observations from TCCON, GOSAT, and AIRS as well as relevant in situ observations. Examples of the influence of key process representations are shown from both forward and inverse model comparisons. We find that the model can resolve much of the synoptic, seasonal, and interannual variability in the observations, although reasons for persistent discrepancies in northern hemisphere vegetation uptake are examined. At this time, we do not find any serious shortcomings in the model transport representation, but this is still the subject of close scrutiny. In general, the fidelity of these simulations leads us to anticipate incorporation of real-time, highly resolved remote sensing and other observations into quantitative analyses that will reduce uncertainty in CO2 fluxes and revolutionize our understanding of the key processes controlling atmospheric CO2 and its evolution with time.

Kawa, S. R.↗
NASA NTRS2018

NASA GMAO GEOS S2S Prediction System: Metrics, Post-Processing and Products

In this presentation we present an overview of the GMAO Sub-Seasonal and Seasonal Prediction System, current users and products, and methods for validation and evaluation of the system. Methods for evaluation include baseline evaluations metrics, the ability to simulate key modes of variability, and evaluation of new development areas.

Molod, Andrea M.↗
NASA NTRSDate not supplied

Scale resolving simulations of the NASA Juncture Flow Model using the LAVA solver

Two distinct simulation methodologies: Delayed Detached Eddy Simulation (DDES) and stress based Wall-modelled Large Eddy Simulation (WMLES) are evaluated using structured overset curvilinear grids for the NASA juncture flow model. While both methodologies are shown to mitigate the primary shortcomings of steady state Reynolds Averaged Navier Stokes(RANS) simulations, several unresolved aspects are identified. Strong sensitivity to RANS-typegrid refinement is observed in the DDES with a substantial deterioration of the solution quality with increasing spatial resolution associated with deficiencies in the shielding function. Mean profiles for attached boundary layers on the fuselage show spurious inflections suggesting modelled stress depletion on finer grids. Lower numerical dissipation in terms of spatial discretization and time step size is seen to improve the solution quality, and the advantage of using RC and QCR2000 corrections in the underlying RANS closure is demonstrated for DDES on RANS-type meshes. Equilibrium Wall-Modelled LES used grids that resolved the tripping dots over the fuselage nose and the wing leading edge, consistent with the experiment setup. These simulations resulted in a cost-competitive approach compared to DDES on RANS-type grids. Although the agreement between WMLES predictions of first and second order single point statistics with experimental measurements is promising, a fundamental shortcoming is noted in terms of an overshoot in streamwise momentum in corner regions of the wing-fuselage juncture. This excess momentum subsequently delays the onset of separation,thereby resulting in an underprediction in length of the separation bubble. Some quantitative sensitivity to numerical discretization is observed; lowering of numerical dissipation shows better agreement with the experiment.

T^3↗
NASA NTRS1997

An Ecosystem Simulation Model for Methane Production and Emission from Wetlands

Previous experimental studies suggest that methane emission from wetland is influenced by multiple interactive pathways of gas production and transport through soil and sediment layers to the atmosphere. The objective of this study is to evaluate a new simulation model of methane production and emission in wetland soils that was developed initially to help identify key processes that regulate methanogenesis and net flux of CH4 to the air, but which is designed ultimately for regional simulation using remotely sensed inputs for land cover characteristics. The foundation for these computer simulations is based on a well-documented model (CASA) of ecosystem production and carbon cycling in the terrestrial blaspheme. Modifications to represent flooded wetland soils and anaerobic decomposition include three new sub-models for: (1) layered soil temperature and water table depth (WTD) as a function of daily climate drivers, (2) CH4 production within the anoxic soil layer as a function of WTD and CO2 production under poorly drained conditions, and (3) CH4 gaseous transport pathways (molecular diffusion, ebullition, and plant vascular transport) as a function of WTD and ecosystem type. The model was applied and tested using climate and ecological data to characterize tundra wetland sites near Fairbanks, Alaska studied previously by Whalen and Reeburgh. Comparison of model predictions to measurements of soil temperature and thaw depth, water-table depth, and CH4 emissions over a two year period suggest that inter-site differences in soil physical conditions and methane fluxes could be reproduced accurately for selected periods. Day-to-day comparison of predicted emissions to measured CH4 flux rates reveals good agreement during the early part of the thaw season, but the model tends to underestimate production of CH4 during the months of July and August in both test years. Important seasonal effects, including that of falling WTD during these periods, are apparently overlooked in the model formulation. Nevertheless, reasonably close agreement was achieved between the model's mean daily and seasonal estimates of CH4 flux and observed emission rates for northern wetland ecosystems. Several features of the model are identified as crucial to more accurate prediction of wetland methane emission, including the capacity to incorporate influences of localized topographic and hydrologic features on site-specific soil temperature and WTD dynamics, and mechanistic simulation of methane emission transport pathways from within the soil profile.

Potter, C. S.↗
DOE OSTI2024

Atomistic, macromolecular model of the Populus secondary cell wall informed by solid-state NMR

Plant secondary cell walls (SCWs) are composed of a heterogeneous interplay of three major biopolymers: cellulose, hemicelluloses, and lignin. Details regarding specific intermolecular interactions and higher-order architecture of the SCW superstructure remain ambiguous. Here, we use solid-state nuclear magnetic resonance (ssNMR) measurements to infer refined details about the structural configuration, intermolecular interactions, and relative proximity of all three major biopolymers within air-dried Populus wood. To enhance the utility of these findings and enable evaluation of hypotheses in a physics-based environment in silico, the NMR observables are articulated into an atomistic, macromolecular model for biopolymer assemblies within the plant SCW. Through molecular dynamics simulation, we quantitatively evaluate several variations of atomistic models to determine structural details that are corroborated by ssNMR measurements.

09 BIOMASS FUELS↗
NASA NTRS1984

Free-jet acoustic investigation of high-radius-ratio coannular plug nozzles

The experimental and analytical results of a scale model simulated flight acoustic exploratory investigation of high radius ratio coannular plug nozzles with inverted velocity and temperature profiles are summarized. Six coannular plug nozzle configurations and a baseline convergent conical nozzle were tested for simulated flight acoustic evaluation. The nozzles were tested over a range of test conditions that are typical of a Variable Cycle Engine for application to advanced high speed aircraft. It was found that in simulate flight, the high radius ratio coannular plug nozzles maintain their jet noise and shock noise reduction features previously observed in static testing. The presence of nozzle bypass struts will not significantly affect the acousticn noise reduction features of a General Electric type nozzle design. A unique coannular plug nozzle flight acoustic spectral prediction method was identified and found to predict the measured results quite well. Special laser velocimeter and acoustic measurements were performed which have given new insights into the jet and shock noise reduction mechanisms of coannular plug nozzles with regard to identifying further benificial research efforts.

Knott, P. R.↗
DOE OSTI2021

Assessing the representation of the Australian carbon cycle in global vegetation models

Australia plays an important role in the global terrestrial carbon cycle on inter-annual timescales. While the Australian continent is included in global assessments of the carbon cycle such as the global carbon budget, the performance of dynamic global vegetation models (DGVMs) over Australia has rarely been evaluated. We assessed simulations of net biome production (NBP) and the carbon stored in vegetation between 1901 to 2018 from 13 DGVMs (TRENDY v8 ensemble). We focused our analysis on Australia's short-term (inter-annual) and long-term (decadal to centennial) terrestrial carbon dynamics. The TRENDY models simulated differing magnitudes of NBP on inter-annual timescales, and these differences resulted in significant differences in long-term vegetation carbon accumulation (–4.7 to 9.5 Pg C). We compared the TRENDY ensemble to several satellite-derived datasets and showed that the spread in the models' simulated carbon storage resulted from varying changes in carbon residence time rather than differences in net carbon uptake. Differences in simulated long-term accumulated NBP between models were mostly due to model responses to land-use change. The DGVMs also simulated different sensitivities to atmospheric carbon dioxide (CO 2 ) concentration, although notably, the models with nutrient cycles did not simulate the smallest NBP response to CO 2 . Our results suggest that a change in the climate forcing did not have a large impact on the carbon cycle on long timescales. However, the inter-annual variability in precipitation drives the year-to-year variability in NBP. We analysed the impact of key modes of climate variability, including the El Niño–Southern Oscillation (ENSO) and the Indian Ocean Dipole (IOD), on NBP. While the DGVMs agreed on sign of the response of NBP to El Niño and La Niña and to positive and negative IOD events, the magnitude of inter-annual variability in NBP differed strongly between models. In addition, we find that differences in the timing of simulated phenology and fire dynamics are associated with differences in simulated or prescribed vegetation cover and process representation. We further find model disagreement in simulated vegetation carbon, phenology, and apparent carbon residence time, indicating that the models have different types and coverage of vegetation across Australia (whether prescribed or emergent). Our study highlights the need to evaluate parameter assumptions and the key processes that drive vegetation dynamics, such as phenology, mortality, and fire, in an Australian context to reduce uncertainty across models.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1979

Computed voltage distributions around solar electric propulsion spacecraft

The NASA Charging Analyzer Program is used to conduct preliminary computations of the voltage distributions around such large spacecraft in geomagnetic substorm environments at geosynchronous altitudes. Both a standard operating voltage (+ or - 150 volts on solar arrays) and direct-drive (+1200 volts on arrays) configurations are considered. Thruster-off simulations are computed for both operating voltage configurations while the effect of simulated thruster-on conditions are evaluated only for direct-drive configuration. These simulated thruster-on conditions are evaluated only for direct-drive configuration. These simulated thruster operations appear to alleviate surface charging.

Stevens, N. J.↗
DOE OSTI2021

Analysis of secondary organic aerosol simulation bias in the Community Earth System Model (CESM2.1)

Organic aerosol (OA) has been considered as one of the most important uncertainties in climate modeling due to the complexity in presenting its chemical production and depletion mechanisms. To better understand the capability of climate models and probe into the associated uncertainties in simulating OA, we evaluate the Community Earth System Model version 2.1 (CESM2.1) configured with the Community Atmosphere Model version 6 (CAM6) with comprehensive tropospheric and stratospheric chemistry representation (CAM6-Chem) through a long-term simulation (1988–2019) with observations collected from multiple datasets in the United States. We find that CESM generally reproduces the interannual variation and seasonal cycle of OA mass concentration at surface layer with a correlation of 0.40 compared to ground observations and systematically overestimates (69%) in summer and underestimates (-19%) in winter. Through a series of sensitivity simulations, we reveal that modeling bias is primarily related to the dominant fraction of monoterpene-formed secondary organic aerosol (SOA), and a strong positive correlation of 0.67 is found between monoterpene emission and modeling bias in the eastern US during summer. In terms of vertical profile, the model prominently underestimates OA and monoterpene concentrations by 37%–99% and 82%–99%, respectively, in the upper air (>500 m) as validated against aircraft observations. Our study suggests that the current volatility basis set (VBS) scheme applied in CESM might be parameterized with monoterpene SOA yields that are too high, which subsequently results in strong SOA production near the emission source area. We also find that the model has difficulty in reproducing the decreasing trend of surface OA in the southeastern US probably because of employing pure gas VBS to represent isoprene SOA which is in reality mainly formed through multiphase chemistry; thus, the influence of aerosol acidity and sulfate particle change on isoprene SOA formation has not been fully considered in the model. This study reveals the urgent need to improve the SOA modeling in climate models.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Surrogate modeling of Cellular-Potts agent-based models as a segmentation task using the U-Net neural network architecture

The Cellular-Potts model is a powerful and ubiquitous framework for developing computational models for simulating complex multicellular biological systems. Cellular-Potts models (CPMs) are often computationally expensive due to the explicit modeling of interactions among large numbers of individual model agents and diffusive fields described by partial differential equations (PDEs). In this work, we develop a convolutional neural network (CNN) surrogate model using a U-Net architecture that accounts for periodic boundary conditions. We use this model to accelerate the evaluation of a mechanistic CPM previously used to investigate in vitro vasculogenesis. The surrogate model was trained to predict 100 computational steps ahead (Monte-Carlo steps, MCS), accelerating simulation evaluations by a factor of 562 times compared to single-core CPM code execution on CPU. Over short timescales of up to 3 recursive evaluations, or 300 MCS, our model captures the emergent behaviors demonstrated by the original Cellular-Potts model such as vessel sprouting, extension and anastomosis, and contraction of vascular lacunae. This approach demonstrates the potential for deep learning to serve as a step toward efficient surrogate models for CPM simulations, enabling faster evaluation of computationally expensive CPM simulations of biological processes.

97 MATHEMATICS AND COMPUTING↗