Search NASA⌕ Search

SEARCH · Search NASA

Results for “simulation evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Comparison of multiobjective optimization methods for the $\mathrm{LCLS-II}$ photoinjector

Particle accelerators are among some of the largest science experiments in the world and can consist of thousands of components with a wide variety of input ranges. These systems can easily become unwieldy optimization problems during design and operations studies. Starting in the early 2000s, searching for better beam dynamics configurations became synonymous with heuristic optimization methods in the accelerator physics community. Genetic algorithms and particle swarm optimization are currently the most widely used. These algorithms can take thousands of simulation evaluations to find optimal solutions for one machine prototype. For large facilities such as the Linac Coherent Light Source (LCLS) and others, this equates to a limited exploration of many possible design configurations. In this paper, the LCLS-II photoinjector is optimized with three optimization algorithms. All optimizations were started from both a uniform random and Latin hypercube sample. In all cases, the optimizations started from Latin hypercube samples outperformed optimizations started from uniform samples. All three algorithms were able to optimize the photoinjector, with the model-based methods approximating the Pareto front in fewer simulation evaluations. This work, in combination with previous optimization observations, indicates objective penalties have a strong impact on the efficiency of such methods. In general, we recommend heuristic methods for initial optimizations and model-based methods when information about the objective space is available.

43 PARTICLE ACCELERATORS↗
NASA NTRSDate not supplied

Monte Carlo Simulations for Evaluating the Accuracy of GLM Detection Efficiency and False Alarm Rate Retrievals

The performance of the Geostationary Lightning Mapper has been evaluated through comparison with other satellite lightning sensors and ground-based networks. However, because the performance of these reference sensors is both imperfect and imperfectly known, the true performance of GLM can only be estimated through such a process. In particular, GLM performance metrics such as detection efficiency (DE) and false alarm rate (FAR) retrieved through comparison with reference networks are affected by those networks’ own DE, FAR, and spatiotemporal accuracy, as well as the selected flash matching criteria. This study presents follow-on results from an ongoing analysis that uses a Monte Carlo simulation-based inversion technique to quantify the effect on retrieved GLM performance of a reasonable range of reference network DE, FAR, spatiotemporal accuracy, and the associated geographic patterns of each. These results help quantify and bound the actual performance of GLM and the attendant uncertainties when comparing GLM to imperfect reference networks.

Katrina Virts↗
NASA NTRS2010

Three-Body Abrasion Testing Using Lunar Dust Simulants to Evaluate Surface System Materials

Numerous unexpected operational issues relating to the abrasive nature of lunar dust, such as scratched visors and spacesuit pressure seal leaks, were encountered during the Apollo missions. To avoid reoccurrence of these unexpected detrimental equipment problems on future missions to the Moon, a series of two- and three-body abrasion tests were developed and conducted in order to begin rigorously characterizing the effect of lunar dust abrasiveness on candidate surface system materials. Two-body scratch tests were initially performed to examine fundamental interactions of a single particle on a flat surface. These simple and robust tests were used to establish standardized measurement techniques for quantifying controlled volumetric wear. Subsequent efforts described in the paper involved three-body abrasion testing designed to be more representative of actual lunar interactions. For these tests, a new tribotester was developed to expose samples to a variety of industrial abrasives and lunar simulants. The work discussed in this paper describes the three-body hardware setup consisting of a rotating rubber wheel that applies a load on a specimen as a loose abrasive is fed into the system. The test methodology is based on ASTM International (ASTM) B611, except it does not mix water with the abrasive. All tests were run under identical conditions. Abraded material specimens included poly(methyl methacrylate) (PMMA), hardened 1045 steel, 6061-T6 aluminum (Al) and 1018 steel. Abrasives included lunar mare simulant JSC- 1A-F (nominal size distribution), sieved JSC-1A-F (<25 m particle diameter), lunar highland simulant NU-LHT-2M, alumina (average diameter of 50 m used per ASTM G76), and silica (50/70 mesh used per ASTM G65). The measured mass loss from each specimen was converted using standard densities to determine total wear volume in cm3. Abrasion was dominated by the alumina and the simulants were only similar to the silica (i.e., sand) on the softer materials of aluminum and PMMA. The nominal JSC- 1A-F consistently showed more abrasion wear than the sieved version of the simulant. The lunar dust displayed abrasivity to all of the test materials, which are likely to be used in lunar landing equipment. Based on this test experience and pilot results obtained, recommendations are made for systematic abrasion testing of candidate materials intended for use in lunar exploration systems and in other environments with similar dust challenges.

Kobrick, Ryan L.↗
DOE OSTI2023

Evaluating the Simulation of CONUS Precipitation by Storm Type in E3SM

Abstract Conventional low‐resolution (LR) climate models, including the Energy Exascale Earth System Model (E3SMv1), have well‐known biases in simulating the frequency, intensity, and timing of precipitation. Approaches to next‐generation E3SM, whether the high‐resolution (HR) or multiscale modeling framework (MMF) configuration, improve the simulation of the intensity and frequency of precipitation, but regional and seasonal deficiencies still exist. Here we apply a methodology to assess the contribution of tropical cyclones (TCs), extratropical cyclones (ETCs), and mesoscale convective systems (MCSs) to simulated precipitation in E3SMv1‐HR and E3SMv1‐MMF relative to E3SMv1‐LR. Across the United States, E3SMv1‐MMF provides the best simulation in terms of precipitation accumulation, frequency and intensity from MCSs and TCs compared to E3SMv1‐LR and E3SMv1‐HR. All E3SMv1 configurations overestimate precipitation amounts from and the frequency of ETCs over CONUS, with conventional E3SMv1‐LR providing the best simulation compared to observations despite limitations in precipitation intensity within these events.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Yield degradation mechanisms for two-shock capsules evaluated through simulations

An investigation of twenty two-shock campaign indirectly driven capsules on the National Ignition Facility was conducted using the xRAGE computer code. The two-shock platform was developed to look at the sensitivity of fuel–ablator mix with shock timing, asymmetry, surface roughness, and convergence on roughly ignition size scale capsules. This platform used CH/CD (plastic/deuterated plastic) shell capsules that were about 685-μm outer radius and filled with D2 or hydrogen-tritium (HT) gas. The experimental radius and velocity vs time, neutron yield, burn averaged ion temperature (Tion), burn width, and self-emission image size were compared to one-dimensional (1D) and two-dimensional (2D) simulations. Our 2D simulations suggest that the mixing of glass from the fill tube was the dominant source of impurity in the gas region of the capsule during burn, along with fuel–ablator mix. The mass of glass mixed in is about 5–10 ng. Our 2D simulations capture most of the yield trends from different degradation mechanisms, and they match the observed burn width and Tion measurements. Our 2D models match all the available data to within 2.5 times the normalized experimental error for 19 of 20 capsules.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

Evaluation of simulations of near-surface variables using the regional climate model CCLM for the MOSAiC winter period

The ship-based experiment MOSAiC 2019/2020 was carried out during a full year in the Arctic and yielded an excellent data set to test the parameterizations of ocean/sea-ice/atmosphere interaction processes in regional climate models (RCMs). In the present paper, near-surface data during MOSAiC are used for the verification of the RCM COnsortium for Small-scale MOdel–Climate Limited area Mode (COSMO-CLM or CCLM). CCLM is used in a forecast mode (nested in ERA5) for the whole Arctic with 15 km resolution and is run with different configurations of sea ice data. These include the standard sea ice concentration taken from passive microwave data with around 6 km resolution, sea ice concentration from Moderate Resolution Imaging Spectroradiometer (MODIS) thermal infrared data and MODIS sea ice lead fraction data for the winter period. CCLM simulations show a good agreement with the measurements. Relatively large negative biases for temperature occur for November and December, which are likely associated with a too large ice thickness used by CCLM. The consideration of sea ice leads in the sub-grid parameterization in CCLM yields improved results for the near-surface temperature. ERA5 data show a large warm bias of about 2.5°C and an underestimation of the temperature variability.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2016

Evaluation of Simulated Marine Aerosol Production Using the WaveWatchIII Prognostic Wave Model Coupled to the Community Atmosphere Model within the Community Earth System Model

Primary marine aerosol (PMA) is emitted into the atmosphere via breaking wind waves on the ocean surface. Most parameterizations of PMA emissions use 10-meter wind speed as a proxy for wave action. This investigation coupled the 3 rd generation prognostic WAVEWATCH-III wind-wave model within a coupled Earth system model (ESM) to drive PMA production using wave energy dissipation rate – analogous to whitecapping – in place of 10-meter wind speed. The wind speed parameterization did not capture basin-scale variability in relations between wind and wave fields. Overall, the wave parameterization did not improve comparison between simulated versus measured AOD or Na + , thus highlighting large remaining uncertainties in model physics. Results confirm the efficacy of prognostic wind-wave models for air-sea exchange studies coupled with laboratory- and field-based characterizations of the primary physical drivers of PMA production. No discernible correlations were evident between simulated PMA fields and observed chlorophyll or sea surface temperature.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1976

A system for automatic evaluation of simulation software

Within the field of computer software, simulation and verification are complementary processes. Simulation methods can be used to verify software by performing variable range analysis. More general verification procedures, such as those described in this paper, can be implicitly, viewed as attempts at modeling the end-product software. From software requirement methodology, each component of the verification system has some element of simulation to it. Conversely, general verification procedures can be used to analyze simulation software. A dynamic analyzer is described which can be used to obtain properly scaled variables for an analog simulation, which is first digitally simulated. In a similar way, it is thought that the other system components and indeed the whole system itself have the potential of being effectively used in a simulation environment.

Ryan, J. P.↗
NASA NTRS1984

An evaluation of simulated Thematic Mapper data and Landsat MSS data for discriminating suburban and regional land use and land cover

An airborne multispectral scanner, operating in the same spectral channels as the Landsat Thematic Mapper (TM), was used in a region east of Denver, CO, for a simulation test performed in the framework of using TM to discriminate the level I and level II classes. It is noted that at the 30-m spatial resolution of the Thematic Mapper Simulator (TMS) the overall discrimination for such classes as commercial/industrial land, rangeland, irrigated sod, irrigated alfalfa, and irrigated pasture was superior to that of the Landsat Multispectral Scanner, primarily due to four added spectral bands. For residential and other spectrally heterogeneous classes, however, the higher resolution of TMS resulted in increased variability within the class and a larger spectral overlap.

Toll, D. L.↗
NASA NTRS1988

Shuttle rendezvous radar performance evaluation and simulation

The US Space Shuttle's Ku-band system was specifically designed for communications and tracking functions which are required during on-orbit operations with other spacecraft. Operating modes permit search and acquisition to be accomplished by computer designation or under manual control by the astronaut. Ku-band system data channels drive on-board dedicated displays and are incorporated into state vector updates by Shuttle guidance and navigation computers. Radar-cross-section estimates were used in computer simulations to predict the range at which radar detection and acquisition can be expected. Validity of the simulationi model and the radar design and performance were verified by flight tests on the White Sands test range. It is concluded that results of the testing established confidence in the capability of the system to provide the relative position and rate information which is needed for Shuttle work involving other spacecraft.

Griffin, John W.↗