Search NASA⌕ Search

SEARCH · Search NASA

Results for “simulation evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,351 records · Page 75
All sourcesNASA NTRSDOE OSTI
NASA NTRS1996

Evaluation of Subgrid-Scale Models for Large Eddy Simulation of Compressible Flows

The objective of this project was to evaluate and develop subgrid-scale (SGS) turbulence models for large eddy simulations (LES) of compressible flows. During the first phase of the project results from LES using the dynamic SGS model were compared to those of direct numerical simulations (DNS) of compressible homogeneous turbulence. The second phase of the project involved implementing the dynamic SGS model in a NASA code for simulating supersonic flow over a flat-plate. The model has been successfully coded and a series of simulations has been completed. One of the major findings of the work is that numerical errors associated with the finite differencing scheme used in the code can overwhelm the SGS model and adversely affect the LES results. Attached to this overview are three submitted papers: 'Evaluation of the Dynamic Model for Simulations of Compressible Decaying Isotropic Turbulence'; 'The effect of the formulation of nonlinear terms on aliasing errors in spectral methods'; and 'Large-Eddy Simulation of a Spatially Evolving Compressible Boundary Layer Flow'.

Blaisdell, Gregory A.↗
NASA NTRS2018

Evaluation of MERRA-2-Based Ozone Profile Simulations with the Global Ozonesonde Network

Chemical transport model (CTM) hindcasts of ozone (O3) are useful for filling in observational gaps and providing context for observed O3 variability and trends. We use global networks of ozonesonde stations to evaluate the O3 profiles in two simulations running versions of the NASA Global Modeling Initiative (GMI) chemical mechanism. Both simulations are tied to the NASA Modern-Era Retrospective analysis for Research and Applications, Version 2 (MERRA-2) meteorological reanalysis: 1) The GMI CTM, and 2) The MERRA-2 GMI Replay (M2 GMI). Both simulations start in 1980, and are compared against >50,000 ozonesonde profiles from 37 global stations from the tropics to the poles. The comparisons allow us to evaluate how the Replay technique affects modeled O3 distribution, how an updated chemical mechanism in the GMI CTM affects simulated tropospheric O3 amounts, and how observed O3 distributions compare to the full set of model output. In general, M2 GMI O3 is ~10% higher than in the GMI CTM, and shows global near-surface and tropical upper troposphere/lower stratosphere (UT/LS) high biases. The updated chemical mechanism in the GMI CTM reduces these high biases. Both simulations show similar negative biases in tropical free-tropospheric O3, especially during typical biomass burning seasons. The simulations are highly-correlated with ozonesonde measurements, particularly in the UT/LS (r > 0.8), showing the ability of MERRA-2 to capture tropopause height variations. Both simulations show improved correlations with ozonesonde data and smaller O3 biases in recent years. We expect to use the sonde/model comparisons to diagnose causes of disagreement and to gauge the feasibility of calculating multidecadal O3 trends from the model output.

Stauffer, Ryan↗
NASA NTRS2018

Evaluation of MERRA-2-Based Ozone Profile Simulations with the Global Ozonesonde Network

Chemical transport model (CTM) hindcasts of ozone (O3) are useful for filling in observational gaps and providing context for observed O3 variability and trends. We use global networks of ozonesonde stations to evaluate the O3 profiles in two simulations running versions of the NASA Global Modeling Initiative (GMI) chemical mechanism. Both simulations are tied to the NASA Modern-Era Retrospective analysis for Research and Applications, Version 2 (MERRA-2) meteorological reanalysis: 1) The GMI CTM, and 2) The MERRA-2 GMI Replay (M2 GMI). Both simulations start in 1980, and are compared against >50,000 ozonesonde profiles from 37 global stations from the tropics to the poles. The comparisons allow us to evaluate how the Replay technique affects modeled O3 distribution, how an updated chemical mechanism in the GMI CTM affects simulated tropospheric O3 amounts, and how observed O3 distributions compare to the full set of model output. In general, M2 GMI O3 is ~10% higher than in the GMI CTM, and shows global near-surface and tropical upper troposphere/lower stratosphere (UT/LS) high biases. The updated chemical mechanism in the GMI CTM reduces these high biases. Both simulations show similar negative biases in tropical free-tropospheric O3, especially during typical biomass burning seasons. The simulations are highly-correlated with ozonesonde measurements, particularly in the UT/LS (r > 0.8), showing the ability of MERRA-2 to capture tropopause height variations. Both simulations show improved correlations with ozonesonde data and smaller O3 biases in recent years. We expect to use the sonde/model comparisons to diagnose causes of disagreement and to gauge the feasibility of calculating multidecadal O3 trends from the model output.

Stauffer, Ryan M.↗
DOE OSTI2018

Spatial distribution of melt-season cloud radiative effects over Greenland: Evaluating satellite observations, reanalyses, and model simulations against in situ measurements

Arctic clouds can profoundly influence surface radiation and thus surface melt. Over Greenland, these cloud radiative effects (CRE) vary greatly with the diverse topography. To investigate the ability of assorted platforms to reproduce heterogeneous CRE, we evaluate CRE spatial distributions from a satellite product, reanalyses, and a global climate model against estimates from 21 automatic weather stations (AWS). Net CRE estimated from AWS generally decreases with elevation, forming a “warm center” distribution. CRE areal averages from the five large–scale data sets we analyze are all around 10 W/m 2 . Modern–Era Retrospective Analysis for Research and Applications version 2 (MERRA–2), ERA–Interim, and Clouds and the Earth's Radiant Energy System (CERES) CRE estimates agree with AWS and reproduce the warm center distribution. However, the National Center for Atmospheric Research Arctic System Reanalysis (ASR) and the Community Earth System Model Large ENSemble Community Project (LENS) show strong warming in the south and northwest, forming a warm L–shape distribution. Discrepancies are mainly caused by longwave CRE in the accumulation zone. MERRA–2, ERA–Interim, and CERES successfully reproduce cloud fraction and its dominant positive influence on longwave CRE in this region. On the other hand, longwave CRE from ASR and LENS correlates strongly with ice water path instead of with cloud fraction or liquid water path. Moreover, ASR overestimates cloud fraction and LENS underestimates liquid water path substantially, both with limited spatial variability. MERRA–2 best captures the observed interstation changes, captures most of the observed cloud–radiation physics, and largely reproduces both albedo and cloud properties. Furthermore, the warm center CRE spatial distribution indicates that clouds enhance surface melt in the higher accumulation zone and reduce surface melt in the lower ablation zone.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2018

Coarse-Grained Hydrodynamics from Correlation Functions

This paper will describe a formalism for using correlation functions between different grid cells as the basis for determining coarse-grained hydrodynamic equations for modeling the behavior of mesoscopic fluid systems. Configurations from a molecular dynamics simulation or other atomistic simulation are projected onto basis functions representing grid cells in a continuum hydrodynamic simulation. Equilibrium correlation functions between different grid cells are evaluated from the molecular simulation and used to determine the evolution operator for the coarse-grained hydrodynamic system. The formalism is demonstrated on a discrete particle simulation of diffusion with a spatially dependent diffusion coefficient. Correlation functions are calculated from the particle simulation and the spatially varying diffusion coefficient is recovered using a fitting procedure.

HPC↗
NASA NTRS2001

Hybrid Modeling for Scenario-Based Evaluation of Failure Effects in Advanced Hardware-Software Designs

This paper describes an incremental scenario-based simulation approach to evaluation of intelligent software for control and management of hardware systems. A hybrid continuous/discrete event simulation of the hardware dynamically interacts with the intelligent software in operations scenarios. Embedded anomalous conditions and failures in simulated hardware can lead to emergent software behavior and identification of missing or faulty software or hardware requirements. An approach is described for extending simulation-based automated incremental failure modes and effects analysis, to support concurrent evaluation of intelligent software and the hardware controlled by the software

Malin, Jane T.↗
DOE OSTI2022

Model-Based Framework to Optimize Charger Station Deployment for Battery Electric Vehicles

The development of battery electric vehicles (BEVs) is accelerating due to their environmental advantages over gasoline and diesel-powered vehicles, including a decrease in air pollution and an increase in energy efficiency. The deployment of charging infrastructure will need to increase to keep pace with demand, especially for large commercial vehicles for which few public chargers currently exist. In this paper, a new flexible framework is proposed for optimizing the placement of charging stations for BEVs, within which different physical models and optimization techniques may be used. Furthermore, a set of metrics is suggested to help enforce complex constraints and facilitate direct comparison between different optimization techniques. Unlike many existing charger placement techniques, the proposed method directly considers the historical driving patterns on a vehicle-by-vehicle basis, using transparent models to assess impacts of candidate charger placements, thus improving the explainability of the results. In the developed framework, modeled BEVs are first generated along the road network to mimic historical traffic data and are simulated traveling along a given route according to a simplified vehicle model. During the simulation, the charger placement problem is initially relaxed to allow vehicles to charge at any node along the road network, and vehicle states are tracked to assess areas of high charging demand. Charging stations are then placed based on the results of the relaxed simulation, and suggested placements are evaluated via road network simulation with fixed charger locations. This proposed framework is applied to a sample problem of placing charging stations along five major highway corridors for Class 8 over-the-road electric trucks. A novel mixed integer programming (MIP) formulation is proposed to optimize charger placements based upon the expected charging demand. Constraints were imposed on the final placement results to limit expected wait times at each station and ensure a minimum threshold of trucking routes are viable for BEVs. The results demonstrate the flexibility and potential effectiveness of the developed model-based framework for scalable charger station deployment.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
NASA NTRS1981

Evaluation of emergency-locator-transmitter performance in real and simulated crash tests

Emergency locator transmitter (ELT) activation problems were investigated by testing a sampling of ELT units in actual airplane crashes and in a special test apparatus which simulated longitudinal crash pulses with superimposed local structural resonances. Probable causes of excessive false alarms and nonactivations of ELT's during crash situations were determined and solutions to the current operational and technical problems were obtained. The results, which considered placement, mounting, and activation of ELT's under simulated crash impacts, and an evaluation of the sensitivity of ELT impact switches to orientation and to local structural vibrations are discussed.

Carden, H. D.↗
NASA NTRS1984

General specifications for the development of a PC-based simulator of the NASA RECON system

The general specifications for the design and implementation of an IBM PC/XT-based simulator of the NASA RECON system, including record designs, file structure designs, command language analysis, program design issues, error recovery considerations, and usage monitoring facilities are discussed. Once implemented, such a simulator will be utilized to evaluate the effectiveness of simulated information system access in addition to actual system usage as part of the total educational programs being developed within the NASA contract.

Dominick, Wayne D.↗
NASA NTRS2005

Environmental impact analysis with the airspace concept evaluation system

The National Aeronautics and Space Administration (NASA) Ames Research Center has developed the Airspace Concept Evaluation System (ACES), which is a fast-time simulation tool for evaluating Air Traffic Management (ATM) systems. This paper describes linking a capability to ACES which can analyze the environmental impact of proposed future ATM systems. This provides the ability to quickly evaluate metrics associated with environmental impacts of aviation for inclusion in multi-dimensional cost-benefit analysis of concepts for evolution of the National Airspace System (NAS) over the next several decades. The methodology used here may be summarized as follows: 1) Standard Federal Aviation Administration (FAA) noise and emissions-inventory models, the Noise Impact Routing System (NIRS) and the Emissions and Dispersion Modeling System (EDMS), respectively, are linked to ACES simulation outputs; 2) appropriate modifications are made to ACES outputs to incorporate all information needed by the environmental models (e.g., specific airframe and engine data); 3) noise and emissions calculations are performed for all traffic and airports in the study area for each of several scenarios, as simulated by ACES; and 4) impacts of future scenarios are compared to the current NAS baseline scenario. This paper also provides the results of initial end-to-end, proof-of-concept runs of the integrated ACES and environmental-modeling capability. These preliminary results demonstrate that if no growth is likely to be impeded by significant environmental impacts that could negatively affect communities throughout the nation.

Augustine, Stephen↗
NASA NTRS1997

An Application fo the Virtual Spacecraft Concept in Evaluation of the Mars Pathfinder Lander Low Gain Antenna

This paper describes a simulation designed to evaluate a communications link between the Earth and the Mars Pathfinder Lander module as it descends under a parachute through the Martian atmosphere toward the planet's surface. The link includes a transmitter and a low gain antenna on the spacecraft and a receiving antenna and receiver on the Earth as well as a simulation of the dynamics of the spacecraft.

virtual spacecraft spacecraft simulation TRAMEL co↗
NASA NTRS2000

An Evaluation of the High Level Architecture (HLA) as a Framework for NASA Modeling and Simulation

The High Level Architecture (HLA) is a current US Department of Defense and an industry (IEEE-1516) standard architecture for modeling and simulations. It provides a framework and set of functional rules and common interfaces for integrating separate and disparate simulators into a larger simulation. The goal of the HLA is to reduce software costs by facilitating the reuse of simulation components and by providing a runtime infrastructure to manage the simulations. In order to evaluate the applicability of the HLA as a technology for NASA space mission simulations, a Simulations Group at Goddard Space Flight Center (GSFC) conducted a study of the HLA and developed a simple prototype HLA-compliant space mission simulator. This paper summarizes the prototyping effort and discusses the potential usefulness of the HLA in the design and planning of future NASA space missions with a focus on risk mitigation and cost reduction.

Reid, Michael R.↗
DOE OSTI2023

Physics-informed machine learning for fault-leakage reduced-order modeling

Geologic carbon storage (GCS) is a promising technology for mitigating CO 2 emissions. The overall success of GCS depends on safe operations that are informed by risk assessment and have proper mitigation plans in place. Performing quantitative probabilistic risk assessment for a GCS site using traditional reservoir simulators can be challenging due to the high computational costs. To overcome this challenge, the US Department of Energy’s National Risk Assessment Partnership (NRAP) project has developed an integrated assessment modeling approach that utilizes computationally efficient reduced-order models (ROM) for simulating various parts of a GCS storage site to quantify uncertainty. Here, in this study, we develop a reduced-order model for fault leakage risk assessment. We use a deep learning approach to build the reduced-order model. We perform a sensitivity analysis and find that the deep learning model yields high accuracy with a much smaller computational cost than full-physics simulation. We also evaluate the performance of the model in scenarios where simulations are not possible to run, providing analysis not previously performed in fault-leakage ROM analyses. Based on a sensitivity analysis of the model, we suggest a simplified conceptual model for fault leakage and site monitoring.

58 GEOSCIENCES↗
DOE OSTI2019

Reward-Based Participant Management for Crowdsourcing Rainfall Monitoring: An Agent-Based Model Simulation

Crowdsourcing incorporates common citizens as rich sources of data and is promising for environmental monitoring. Here, we propose and test the idea of incorporating incentives to crowdsourcing management for rainfall monitoring. In particular, we model the allocation of incentives (quantitatively measurable and limited rewards) among crowdsourcing participants for a theoretical rainfall monitoring case. For this purpose, we develop an integrated model comprising a reward allocation component to represent the decision-making process of a central manager, an agent-based model to simulate the interactions between the manager and participants, and a rainfall simulation model to evaluate the effectiveness of various reward allocation policies. We simulate six reward allocation policies of varying levels of administrative cost, and consideration of participant and rainfall spatial heterogeneities. The findings indicate the performance of each policy to improve with the reward budget and their spatial uniformity. Among the six policies tested, we discover that the participant density weighted maximum participation policy yields the most accurate estimation of rainfall intensity due to its more explicit consideration of the spatial distribution of participants; however, this policy associates with a high administrative cost. This highlights the trade-off between performance and cost in designing effective reward allocation policies. This paper provides a physical and behavior simulation modeling tool to study the feasibility and complexity of reward-based participant management for crowdsourcing rainfall monitoring. The proposed crowdsourcing method is beneficial for a wide range of applications that require rainfall data with fine resolution, such as storm water management and water availability and biomass assessment for food and energy crops.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2019

Pan-YANG/RA-ABM

Crowd-sourcing incorporates common citizens as rich sources of data and is promising for environmental monitoring. In this paper, we propose and test the idea of incorporating incentives to crowd-sourcing management for rainfall monitoring. Specifically, we modeled the allocation of incentives (quantitatively measurable and limited rewards) among crowd-sourcing participants for a theoretical rainfall monitoring case. For this purpose, we developed an integrated model comprising a reward allocation component to represent the decision‐making process of a central manager, an agent‐based model to simulate the interactions between the manager and participants, and a rainfall simulation model to evaluate the effectiveness of various reward allocation policies. We simulated six reward allocation policies of varying levels of administrative cost, and consideration of participant and rainfall spatial heterogeneities. The results suggest the performance of each policy to improve with the reward budget and their spatial uniformity. Among the six policies tested, we found that the participant density weighted maximum participation policy yields the most accurate estimation of rainfall intensity due to its more explicit consideration of the spatial distribution of participants; however, this policy associates with a high administrative cost. This highlights the trade‐off between performance and cost in designing effective reward allocation policies. This paper provides a physical and behavior simulation modeling tool to study the feasibility and complexity of reward‐based participant management for crowd-sourcing rainfall monitoring. The proposed crowd-sourcing method is beneficial for a wide range of applications that require rainfall data with fine resolution, such as stormwater management and water availability and biomass assessment for food and energy crops.

Yang, Pan↗
NASA NTRS2020

GISS Model E2.2: A Climate Model Optimized for the Middle Atmosphere. Part 2: Validation of Large-Scale Transport and Evaluation of Climate Response

Here we examine the large‐scale transport characteristics of the new ``Middle Atmosphere" NASA Goddard Institute for Space Studies climate model (E2.2). First we evaluate the stratospheric transport circulation in historical atmosphere‐only simulations integrated with interactive trace gas and aerosol chemistry. Compared to lower vertical resolution model versions, E2.2 exhibits improved tropical ascent and older stratospheric mean ages that are more consistent with observed values. In the troposphere, poleward transport to the Arctic and interhemispheric mean ages in E2.2 are comparable to models participating in the Chemistry Climate Modeling Initiative. In addition to validating E2.2 we also assess its ``transport sensitivity" using the coupled atmosphere‐ocean abrupt 4xCO2 and transient 1%CO2 simulations submitted to the Coupled Model Intercomparison Project, Phase 6, along with a 2xCO2 simulation used to evaluate the linearity of the transport circulation's response to increased CO2. We show that decreases (increases) in a stratospheric mean age (idealized surface loss) tracer scale linearly with increased lower stratospheric upwelling, which also increases linearly with warming tropical sea surface temperatures (SSTs). Abrupt 2xCO2 and 4xCO2 experiments constrained with (fixed) pre‐industrial SSTs are also used to quantify the relative importance of rapid adjustments versus SST feedbacks to the transport circulation responses in the model. Finally, sensitivity experiments are presented to illustrate the impact of changes in the convective parameterization on stratospheric transport.

GISS Model E2.2↗
DOE OSTI2016

SU-F-J-40: Evaluation of Sensitivity of the Automatic Matching Between Cone-Beam CT Image and Simulation CT Image in TrueBeam 2.0 Imaging System 6DoF Considering Different Uncertainty Sources

Purpose: To estimate the sensitivity of TrueBeam 2.0 Imaging System 6DoF automatic matching tool through the acquisition of cone-beam CT images in different phantoms applying submillimeter translations and rotations of tenths of a degree and registered with image simulation CT. Methods: To evaluate overall system-wide image, we consider two uncertainties source; First, the uncertainty of the manual phantom displacement (ε-m). This uncertainty is calculated by a digital caliper (0.01 mm) for vertical (Vrt), lateral (Lat) and longitudinal (Lng). A digital inclinometer (0.01°) for the pitch and roll and the own phantom scale to evaluate the coordinate rotation (Rtn). The second uncertainty is the displacement detected by the algorithm system of matching (σ-d) that we obtain from the standard deviations of the different measurements. We use three different phantoms. The BrainLab Radiosurgery system for supporting masks with an anthropomorphic dummy adapted to allow displacements of 0.1 mm in Vrt, Lat and Lng dimensions and rotations of 0.1° in Pitch dimension. For the analysis of the Rtn and Roll dimensions we use two homemade phantoms (RinoRot and RinoRoll, La Fe Hospital, Valencia, Spain) that allow rotations of 0.3°. Results: In the case of manual displacement of 0.10 ± 0.03 mm in the translations, the system detect 0.10 ± 0.07 mm, 0.12 ± 0.07 mm and 0.13 ± 0.07 mm (mean ± SD) in Lat, Vrt and Lng respectively. In the case of rotational dimension, manual displacement of 0.3 ± 0.1° was detected with 0.19 ± 0.06°, 0.29 ± 0.03° and 0.27 ± 0.06° in Pitch, Roll and Rtn. Conclusion: We conclude that the sensitivity of the automatic matching system is within 0.10 mm in translations and 0.3° in rotations. These values are under the own sensitivity of the software.

60 APPLIED LIFE SCIENCES↗