Search NASA⌕ Search

SEARCH · Search NASA

Results for “simulation evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,369 records · Page 76
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Macrovoid resolved simulations of transport through HPRO relevant membrane geometries

Modeling the transport properties such as diffusivity and permeability of high pressure reverse osmosis (HPRO) membranes is critical for the selection and manufacture of membranes suitable for operation under high pressure. These properties can be significantly affected by the changes in heterogeneous pore structures due to compaction. Here, the modeling platform presented in this work resolves the two scale porosity in HPRO relevant membranes. A synthetic membrane geometry is constructed based on available experimental visualizations of pore structures. The simulations directly capture the flow channeling that results from a combination of material properties and geometric features of the macrovoids. A parametric study is presented to account for the transition of flow characteristics from a material governed regime to a macrovoid governed regime. Permeability of the membrane is evaluated using the simulation data and compared with an existing model that scales with the square of tortuosity over a range of material properties. The model is found to perform well under a narrow range of tortuosity while deviating from the calculated permeabilities at extreme conditions. The effective permeability of the membrane is found to vary by at least two orders of magnitude between the two flow regimes. It is also observed that tortuosity is a bounded property with its upper limit determined by the macrovoid geometry. Consequently, the tortuosity based correlations fail near a flow regime that is mainly governed by the macrovoids. The modeled permeability can be more than an order of magnitude smaller than the simulation result. A new model based on flux-weighted porosity of a membrane is introduced and its correlation with tortuosity is studied. The model agrees with the simulated data as, in addition to tortuosity, it also accounts for the flux partition within and outside the flow channels. Such correlations enable extending the existing understanding of flow characteristics to enhance predictability of porous media models.

42 ENGINEERING↗
NASA NTRS2005

Preliminary Dynamic Feasibility and Analysis of a Spherical, Wind-Driven (Tumbleweed), Martian Rover

The process and findings are presented from a preliminary feasibility study examining the dynamics characteristics of a spherical wind-driven (or Tumbleweed) rover, which is intended for exploration of the Martian surface. The results of an initial feasibility study involving several worst-case mobility situations that a Tumbleweed rover might encounter on the surface of Mars are discussed. Additional topics include the evaluation of several commercially available analysis software packages that were examined as possible platforms for the development of a Monte Carlo Tumbleweed mission simulation tool. This evaluation lead to the development of the Mars Tumbleweed Monte Carlo Simulator (or Tumbleweed Simulator) using the Vortex physics software package from CM-Labs, Inc. Discussions regarding the development and evaluation of the Tumbleweed Simulator, as well as the results of a preliminary analysis using the tool are also presented. Finally, a brief conclusions section is presented.

Flick, John J.↗
DOE OSTI2016

Evaluation of the Community Land Model simulated carbon and water fluxes against observations over ChinaFLUX sites

The Community Land Model (CLM) is an advanced process-based land surface model that simulates carbon, nitrogen, water vapor and energy exchanges between terrestrial ecosystems and the atmosphere at various spatial and temporal scales. We use observed carbon and water fluxes from five representative Chinese Terrestrial Ecosystem Flux Research Network (ChinaFLUX) eddy covariance tower sites to systematically evaluate the new version CLM4.5 and old version CLM4.0, and to generate insights that may inform future model developments. CLM4.5 underestimates the annual carbon sink at three forest sites and one alpine grassland site but overestimates the carbon sink of a semi-arid grassland site. The annual carbon sink underestimation for the deciduous-dominated forest site results from underestimated daytime carbon sequestration during summer and overestimated nighttime carbon emission during spring and autumn. Compared to CLM4.0, the bias of annual gross primary production (GPP) is reduced by 24% and 28% in CLM4.5 at two subtropical forest sites. However, CLM4.5 still presents a large positive bias in annual GPP. The improvement in net ecosystem exchange (NEE) is limited, although soil respiration bias decreases by 16%–43% at three forest sites. CLM4.5 simulates lower soil water content in the dry season than CLM4.0 at two grassland sites. Drier soils produce a significant drop in the leaf area index and in GPP and an increase in respiration for CLM4.5. The new fire parameterization approach in CLM4.5 causes excessive burning at the Changbaishan forest site, resulting in an unexpected underestimation of NEE, vegetation carbon, and soil organic carbon by 46%, 95%, and 87%, respectively. Altogether, our study reveals significant improvements achieved by CLM4.5 compared to CLM4.0, and suggests further developments on the parameterization of seasonal GPP and respiration, which will require a more effective representation of seasonal water conditions and the partitioning of net radiation between sensible and heat fluxes.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1979

Evaluation of candidate metals in a simulated space shuttle main engine environment for application as turbine blade dampers

The high-pressure pumps for the space shuttle main engine are driven by combustion products which are 50 percent H2 and 50 percent H2O (by weight). The Haynes alloy 188, used in the dampers, experienced erosion. The erosion producing characteristics of wet H2 were evaluated using a controlled environment produced by a ballistic compressor. Four candidate materials were evaluated: H-188, A-286, Pt/Rh and Rh. Rh was clearly the most erosion resistant. Comparisons with AISI 4340 and Fe specimens of known uniformity indicate that metallurgical defects in the candidate materials are primary contributors to the higher than usual erosion.

Caveny, L. H.↗
DOE OSTI2015

Improving the Accuracy of PCMI Simulations with More Realistic Geometry and Material Models

Assessment of fuel performance codes is an endeavour that requires re-evaluation as new simulation capabilities become available. BISON, the finite element-based fuel performance code in development at Idaho National Laboratory, has been used to simulate a variety of experiments. Calculations from these simulations are compared to experimental measurements for the purpose of evaluating the progress of code development. One such experiment, from the Risø 3 Fission Gas Project, provides measurements of fission gas release and clad diameter. A subset of the Risø3 Fission Gas Project, which is referred to here, consisted of a base-irradiation period of a full-length fuel rod in the Quad-Cities-1 BWR. The base irradiation test was followed by a “bump test”, in which a sub-section of the original rod was subjected to a strongly non-uniform axial power profile. The bump test took place in Risø test reactor DR3 in a water-cooled HP1 rig under BWR conditions. This experiment was chosen because it allows for an evaluation of several aspects of BISON, including fully coupled thermo-mechanics, contact, and several nonlinear material models. A summary of simulation results and comparison to the experiment data has been published previously, however, this paper shows new results with recently added features to BISON. These new features include representing the pellets as discrete entities rather than a smeared column, including primary creep in the clad creep model, and the coupling of fuel gaseous swelling to fission gas release. Comparing to previous results, the addition of theses features has narrowed the gap between BISON calculations and experimental measurements for final clad diameter and fission gas release.

99 GENERAL AND MISCELLANEOUS↗
NASA NTRS2011

Fast Simulators for Satellite Cloud Optical Centroid Pressure Retrievals, 1. Evaluation of OMI Cloud Retrievals

We have developed a relatively simple scheme for simulating retrieved cloud optical centroid pressures (OCP) from satellite solar backscatter observations. We have compared simulator results with those from more detailed retrieval simulators that more fully account for the complex radiative transfer in a cloudy atmosphere. We used this fast simulator to conduct a comprehensive evaluation of cloud OCPs from the two OMI algorithms using collocated data from CloudSat and Aqua MODIS, a unique situation afforded by the A-train formation of satellites. We find that both OMI algorithms perform reasonably well and that the two algorithms agree better with each other than either does with the collocated CloudSat data. This indicates that patchy snow/ice, cloud 3D, and aerosol effects not simulated with the CloudSat data are affecting both algorithms similarly. We note that the collocation with CloudSat occurs mainly on the East side of OMI's swath. Therefore, we are not able to address cross-track biases in OMI cloud OCP retrievals. Our fast simulator may also be used to simulate cloud OCP from output generated by general circulation models (GCM) with appropriate account of cloud overlap. We have implemented such a scheme and plan to compare OMI data with GCM output in the near future.

Joiner, J.↗
DOE OSTI2020

Towards Off-policy Evaluation as a Prerequisite for Real-world Reinforcement Learning in Building Control

We present an initial study of off-policy evaluation (OPE), a problem prerequisite to real-world reinforcement learning (RL), in the context of building control. OPE is the problem of estimating a policy's performance without running it on the actual system, using historical data from the existing controller. It enables the control engineers to ensure a new, pretrained policy satisfies the performance requirements and safety constraints of a real-world system, prior to interacting with it. While many methods have been developed for OPE, no study has evaluated which ones are suitable for building operational data, which are generated by deterministic policies and have limited coverage of the state-action space. After reviewing existing works and their assumptions, we adopted the approximate model (AM) method. Furthermore, we used bootstrapping to quantify uncertainty and correct for bias. In a simulation study, we evaluated the proposed approach on 10 policies pretrained with imitation learning. On average, the AM method estimated the energy and comfort costs with 1.84% and 14.1% error, respectively.

Chen, B↗
NASA NTRS1991

Evaluating the design of satellite scanning radiometers for earth radiation budget measurements with system simulations. Part 1: Instantaneous estimates

A set of system simulations was performed to evaluate candidate scanner configurations to fly as a part of the Earth Radiation Budget Instrument (ERBI) on the polar platforms during the 1990's. The simulation is considered of instantaneous sampling (without diurnal averaging) of the longwave and shortwave fluxes at the top of the atmosphere (TOA). After measurement and subsequent inversion to the TOA, the measured fluxes were compared to the reference fluxes for 2.5 deg lat/long resolution targets. The reference fluxes at this resolution are obtained by integrating over the 25 x 25 = 625 grid elements in each target. The differences between each of these two resultant spatially averaged sets of target measurements (errors) are taken and then statistically summarized. Five instruments are considered: (1) the Conically Scanning Radiometer (CSR); (2) the ERBE Cross Track Scanner; (3) the Nimbus-7 Biaxial Scanner; (4) the Clouds and Earth's Radiant Energy System Instrument (CERES-1); and (5) the Active Cavity Array (ACA). Identical studies of instantaneous error were completed for many days, two seasons, and several satellite equator crossing longitudes. The longwave flux errors were found to have the same space and time characteristics as for the shortwave fluxes, but the errors are only about 25 pct. of the shortwave errors.

Stowe, Larry↗
DOE OSTI2016

Evaluation of air–soil temperature relationships simulated by land surfacemodels during winter across the permafrost region

A realistic simulation of snow cover and its thermal properties are important for accurate modelling of permafrost. We analyse simulated relationships between air and near-surface (20 cm) soil temperatures in the Northern Hemisphere permafrost region during winter, with a particular focus on snow insulation effects in nine land surface models, and compare them with observations from 268 Russian stations. There are large cross-model differences in the simulated differences between near-surface soil and air temperatures (Δ T ; 3 to 14 °C), in the sensitivity of soil-to-air temperature (0.13 to 0.96 °C -1 ), and in the relationship between Δ$T$ and snow depth. The observed relationship between Δ$T$ and snow depth can be used as a metric to evaluate the effects of each model's representation of snow insulation, hence guide improvements to the model's conceptual structure and process parameterisations. Models with better performance apply multilayer snow schemes and consider complex snow processes. Some models show poor performance in representing snow insulation due to underestimation of snow depth and/or overestimation of snow conductivity. Generally, models identified as most acceptable with respect to snow insulation simulate reasonable areas of near-surface permafrost (13.19 to 15.77 million km 2 ). However, there is not a simple relationship between the sophistication of the snow insulation in the acceptable models and the simulated area of Northern Hemisphere near-surface permafrost, because several other factors, such as soil depth used in the models, the treatment of soil organic matter content, hydrology and vegetation cover, also affect the simulated permafrost distribution.

58 GEOSCIENCES↗
DOE OSTI2021

Dynamic Human-in-the-Loop Simulated Nuclear Power Plant Thermal Dispatch System Demonstration and Evaluation Study

An Idaho National Laboratory research team performed a human-in-the-loop study with two formerly licensed retired operators to evaluate thermal power dispatch operations supported by the modified GSE Systems GPWR plant simulator. Virtual representations of the analog control panels were presented on touch-screen bays configured to mimic the control room layout in the newly renovated Human Systems Simulation Laboratory. The operators performed 15 scenarios covering normal evolutions to transition the plant from full turbine operation to joint turbine and thermal power dispatch operations in addition to transient response scenarios induced with simulated faults to evaluate the impact of thermal power dispatch system on operator and plant responses. A prototype human-system interface (HSI) was developed and displayed in tandem with the virtual analog panels to support the operators executing the procedurally drive evolutions and transient responses. An interdisciplinary team of operations experts, nuclear engineers, and human factors experts observed the operators performing the scenarios to evaluate the operations. Only a preliminary analysis of the results has been performed. The full analysis will be shared in a milestone report scheduled for release at the end of September; however, some high-level conclusions were readily available. Two high level findings for the system design were captured in the study. The manual control supported by the HSI to transition from standard operations to thermal power dispatch operation imposed a considerable amount of workload on the operators due to tedious manual valve manipulations and system monitoring required to verify their intended effect. An additional operator would be required in the control room to support the daily evolution. Automatic control for the transition was deemed a requirement for plant adoption without imposing additional staffing costs. The second finding was the necessity for an automatic thermal power dispatch system trip isolation function linked to a turbine and reactor trip signal. The operators completed scenarios with automatic isolation functionality and manually required actuation of the thermal power dispatch system. The operator response was sufficiently slower in the manual trip condition, such that operators were unable to manually actuate key post trip safety functions an indicate a degraded control capability that should be avoided. With an automatic trip signal little to no impact of the thermal power dispatch system was identified on the primary plant response and therefore the system could be readily and safely adopted. Together these two findings represent the need to support the adoption of thermal power dispatch capability into existing operations by leveraging automation to augment any additional operator tasking required to control and monitor an additional system beyond existing operations.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2015

Comparison of film measurements and Monte Carlo simulations of dose delivered with very high-energy electron beams in a polystyrene phantom

Purpose: To measure radiation dose in a water-equivalent medium from very high-energy electron (VHEE) beams and make comparisons to Monte Carlo (MC) simulation results. Methods: Dose in a polystyrene phantom delivered by an experimental VHEE beam line was measured with Gafchromic films for three 50 MeV and two 70 MeV Gaussian beams of 4.0–6.9 mm FWHM and compared to corresponding MC-simulated dose distributions. MC dose in the polystyrene phantom was calculated with the EGSnrc/BEAMnrc and DOSXYZnrc codes based on the experimental setup. Additionally, the effect of 2% beam energy measurement uncertainty and possible non-zero beam angular spread on MC dose distributions was evaluated. Results: MC simulated percentage depth dose (PDD) curves agreed with measurements within 4% for all beam sizes at both 50 and 70 MeV VHEE beams. Central axis PDD at 8 cm depth ranged from 14% to 19% for the 5.4–6.9 mm 50 MeV beams and it ranged from 14% to 18% for the 4.0–4.5 mm 70 MeV beams. MC simulated relative beam profiles of regularly shaped Gaussian beams evaluated at depths of 0.64 to 7.46 cm agreed with measurements to within 5%. A 2% beam energy uncertainty and 0.286° beam angular spread corresponded to a maximum 3.0% and 3.8% difference in depth dose curves of the 50 and 70 MeV electron beams, respectively. Absolute dose differences between MC simulations and film measurements of regularly shaped Gaussian beams were between 10% and 42%. Conclusions: The authors demonstrate that relative dose distributions for VHEE beams of 50–70 MeV can be measured with Gafchromic films and modeled with Monte Carlo simulations to an accuracy of 5%. The reported absolute dose differences likely caused by imperfect beam steering and subsequent charge loss revealed the importance of accurate VHEE beam control and diagnostics.

07 ISOTOPE AND RADIATION SOURCES↗
DOE OSTI2018

An Evaluation of Marine Boundary Layer Cloud Property Simulations in the Community Atmosphere Model Using Satellite Observations: Conventional Subgrid Parameterization versus CLUBB

This paper presents a satellite-observation-based evaluation of the marine boundary layer (MBL) cloud properties from two Community Atmosphere Model, version 5 (CAM5), simulations, one with the standard parameterization schemes (CAM5–Base) and the other with the Cloud Layers Unified by Binormals scheme (CAM5–CLUBB). When comparing the direct model outputs, the authors find that CAM5–CLUBB produces more MBL clouds, a smoother transition from stratocumulus to cumulus, and a tighter correlation between in-cloud water and cloud fraction than CAM5–Base. In the model-to-observation comparison using the COSP satellite simulators, the authors find that both simulations capture the main features and spatial patterns of the observed cloud fraction from MODIS and shortwave cloud radiative forcing (SWCF) from CERES. However, CAM5–CLUBB suffers more than CAM5–Base from a problem that can be best summarized as “undetectable” clouds (i.e., a significant fraction of simulated MBL clouds are thinner than the MODIS detection threshold). This issue leads to a smaller COSP–MODIS cloud fraction and a weaker SWCF in CAM5–CLUBB than the observations and also CAM5–Base in the tropical descending regions. Finally, the authors compare modeled radar reflectivity with CloudSat observations and find that both simulations, especially CAM5–CLUBB, suffer from an excessive drizzle problem. Further analysis reveals that the subgrid precipitation enhancement factors in CAM5–CLUBB are unrealistically large, which makes MBL clouds precipitate too excessively, and in turn results in too many undetectable thin clouds.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1977

Effects of Simulated Flight on Fan Noise Suppression

Attenuation properties of three treated fan inlets were evaluated. Tunnel flow simulated the inflow clean-up effect on source noise observed in flight and allowed observation of the blade passage frequency tone cut-off phenomenon. Acoustic data consisted of isolated inlet noise measured in the far field at two fixed positions and with traverses at four frequencies. Attenuation and source noise properties with and without flight simulation are compared and discussed. Averaged attenuation properties showed relative agreement of the inlets with their design intent, however, tunnel flow significantly affected the attenuation spectra.

Heidmann, M. F.↗
NASA NTRS2003

Evaluation of a Second-Order Accurate Navier-Stokes Code for Detached Eddy Simulation Past a Circular Cylinder

We evaluate the applicability of a production computational fluid dynamics code for conducting detached eddy simulation for unsteady flows. A second-order accurate Navier-Stokes code developed at NASA Langley Research Center, known as TLNS3D, is used for these simulations. We focus our attention on high Reynolds number flow (Re = 5 x 10(sup 4) - 1.4 x 10(sup 5)) past a circular cylinder to simulate flows with large-scale separations. We consider two types of flow situations: one in which the flow at the separation point is laminar, and the other in which the flow is already turbulent when it detaches from the surface of the cylinder. Solutions are presented for two- and three-dimensional calculations using both the unsteady Reynolds-averaged Navier-Stokes paradigm and the detached eddy simulation treatment. All calculations use the standard Spalart-Allmaras turbulence model as the base model.

Vatsa, Veer N.↗
NASA NTRS2012

Desktop Modeling and Simulation: Parsimonious, yet Effective Discrete-Event Simulation Analysis

This paper evaluates how quickly students can be trained to construct useful discrete-event simulation models using Excel The typical supply chain used by many large national retailers is described, and an Excel-based simulation model is constructed of it The set of programming and simulation skills required for development of that model are then determined we conclude that six hours of training are required to teach the skills to MBA students . The simulation presented here contains all fundamental functionallty of a simulation model, and so our result holds for any discrete-event simulation model. We argue therefore that Industry workers with the same technical skill set as students having completed one year in an MBA program can be quickly trained to construct simulation models. This result gives credence to the efficacy of Desktop Modeling and Simulation whereby simulation analyses can be quickly developed, run, and analyzed with widely available software, namely Excel.

Bradley, James R.↗
NASA NTRS1991

Test and evaluation of the generalized gate logic system simulator

The results of the initial testing of the Generalized Gate Level Logic Simulator (GGLOSS) are discussed. The simulator is a special purpose fault simulator designed to assist in the analysis of the effects of random hardware failures on fault tolerant digital computer systems. The testing of the simulator covers two main areas. First, the simulation results are compared with data obtained by monitoring the behavior of hardware. The circuit used for these comparisons is an incomplete microprocessor design based upon the MIL-STD-1750A Instruction Set Architecture. In the second area of testing, current simulation results are compared with experimental data obtained using precursors of the current tool. In each case, a portion of the earlier experiment is confirmed. The new results are then viewed from a different perspective in order to evaluate the usefulness of this simulation strategy.

Miner, Paul S.↗
DOE OSTI2020

Size dependence in chord characteristics from simulated and observed continental shallow cumulus

Abstract. In this study we compare long-term Doppler and Raman lidar observations against a full month of large eddy simulations of continental shallow cumulus clouds. The goal is to evaluate if the simulations can reproduce the mean observed vertical velocity and moisture structure of cumulus clouds and their associated subcloud circulations, as well as to establish if these properties depend on the size of the cloud. We propose methods to compare continuous chords of cloud detected from Doppler and Raman lidars with equivalent chords derived from 1D and 3D model output. While the individual chords are highly variable, composites of thousands of observed and millions of simulated chords contain a clear signal. We find that the simulations underestimate cloud size and fraction but successfully reproduce the observed structure of vertical velocity and moisture perturbations. There is a clear scaling of vertical velocity and moisture anomalies below the chords with chord size, but the moisture anomalies are only 1 %–2 % higher than the horizontal mean values. The differences between the observations and simulations are smaller than the difference in sampling the modeled chords in time or space. The shape of the vertical velocity and moisture anomalies from cloud chords sampled spatially from 3D model snapshots is almost perfectly symmetric. In contrast, the chords sampled temporally from the lidar observations and 1D model output have a marked asymmetry, with stronger updrafts and higher moisture anomalies occurring earlier on.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1983

Simulation study of traffic-sensor noise effects on utilization of traffic situation display for self-spacing task

The effect of traffic sensor noise on the ability of a pilot to perform an intrail spacing task was determined. The tests were conducted in a fixed base cockpit simulator configured as a current generation transport aircraft, with an electronic traffic display provided in the weather radarscope location. The true positions of the traffic were perturbed in both relative range and azimuth by random errors to simulate traffic sensor noise associated with an onboard sensor. The evaluation task involved simulated instrument approaches into a terminal area while maintaining self separation on a lead aircraft. Separation performance data and pilot subjective ratings and comments were obtained. The results of the separation data indicate that displayed traffic position errors, having standard deviation values up to 0.3-n.mi. range and 8 deg azimuth, had negligible effect on the spacing performance achieved by the pilots. Speed profiles of the lead aircraft, display of the lead aircraft groundspeed, and individual pilot techniques were found to significantly affect the mean spacing performance.

Williams, D. H.↗