Search NASA⌕ Search

SEARCH · Search NASA

Results for “simulation evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27
All sourcesNASA NTRSDOE OSTI
NASA NTRS2022

Evaluation and Improvement of System-of-Systems Resilience in a Simulation of Wildfire Emergency Response

Because of the increasing threat that wildfires pose, there is interest in leveraging new technologies to improve firefighting. Specifically, Unmanned Aerial Systems (UAS) and UAS Traffic Management (UTM) promise to improve firefighters’ situational awareness, coordination, communications, safety, and strategy. While these technologies could be beneficial, there has been little formal investigation into how much benefit would occur and whether these benefits would outweigh hazards introduced by these systems. To better understand the impacts of these technologies, this paper presents a high-level dynamic simulation for evaluating wildfire response performance and resilience incorporating fire propagation, surveillance and communication, response planning, and the resulting mitigation actions. This simulation is then used to study the impact of communications and surveillance improvement, considering (1) the effect on fire containment and ground crew injuries and (2) the effect of introduced and existing disruptive fault scenarios. Simulating this model over a large number of scenarios finds that these changes can improve containment and reduce ground crew injuries. While these improvements generalize over both existing and introduced single-fault scenarios and thus result in a more resilient system, they could be negated if the introduced communications infrastructure is prone to full-scale outages.

modeling↗
NASA NTRS2017

Initial Data Analysis Results for ATD-2 ISAS HITL Simulation

To evaluate the operational procedures and information requirements for the core functional capabilities of the ATD-2 project, such as tactical surface metering tool, APREQ-CFR procedure, and data element exchanges between ramp and tower, human-in-the-loop (HITL) simulations were performed in March, 2017. This presentation shows the initial data analysis results from the HITL simulations. With respect to the different runway configurations and metering values in tactical surface scheduler, various airport performance metrics were analyzed and compared. These metrics include gate holding time, taxi-out in time, runway throughput, queue size and wait time in queue, and TMI flight compliance. In addition to the metering value, other factors affecting the airport performance in the HITL simulation, including run duration, runway changes, and TMI constraints, are also discussed.

HITL simulation↗
DOE OSTI2019

Evaluating Optimization Strategies for Engine Simulations Using Machine Learning Emulators

This work evaluates different optimization algorithms for computational fluid dynamics (CFD) simulations of engine combustion. Due to the computational expense of CFD simulations, emulators built with machine learning algorithms were used as surrogates for the optimizers. Two types of emulators were used: a Gaussian process (GP) and a weighted variety of machine learning methods called SuperLearner (SL). The emulators were trained using a dataset of 2048 CFD simulations that were run concurrently on a supercomputer. The design of experiments (DOE) for the CFD runs was obtained by perturbing nine input parameters using a Monte-Carlo method. The CFD simulations were of a heavy duty engine running with a low octane gasoline-like fuel at a partially premixed compression ignition mode. Ten optimization algorithms were tested, including types typically used in research applications. Each optimizer was allowed 800 function evaluations and was randomly tested 100 times. The optimizers were evaluated for the median, minimum, and maximum merits obtained in the 100 attempts. Some optimizers required more sequential evaluations, thereby resulting in longer wall clock times to reach an optimum. The best performing optimization methods were particle swarm optimization (PSO), differential evolution (DE), GENOUD (an evolutionary algorithm), and micro-genetic algorithm (GA). These methods found a high median optimum as well as a reasonable minimum optimum of the 100 trials. Moreover, all of these methods were able to operate with less than 100 successive iterations, which reduced the wall clock time required in practice. Two methods were found to be effective but required a much larger number of successive iterations: the DIRECT and MALSCHAINS algorithms. A random search method that completed in a single iteration performed poorly in finding optimum designs but was included to illustrate the limitation of highly concurrent search methods. The last three methods, Nelder–Mead, bound optimization by quadratic approximation (BOBYQA), and constrained optimization by linear approximation (COBYLA), did not perform as well.

Probst, Daniel M.↗
DOE OSTI2022

An Evaluation of Co-Simulation for Modeling Coupled Natural Gas and Electricity Networks

Reliance on natural gas for power generation has increased the coupling between gas and power networks. While this coupling can bring operational and economic benefits, it can also yield challenges, as the constraints in one system can impact the other. Co-simulation can capture the constraints and interactions between these systems, but so far, there has been limited comparison of co-simulation results to those of an integrated model. In this work, we develop a new co-simulation framework using the HELICS platform and the SAInt tool for modeling transient gas and AC optimal power flow. We evaluate this co-simulation framework against a fully integrated version of the SAInt power and gas simulators, thus providing a benchmarking of the co-simulation approach. We compare results across the two approaches for two test networks and a network representing the Belgian power and gas networks, testing both normal operating conditions and cases with compressor disruptions. In each of the cases tested, we find nearly identical results from the two approaches across various metrics of interest, such as nodal pressure, gas flow rates, and active power generation. This alignment suggests that co-simulation can yield comparable results to fully integrated models for modeling coupled gas and electricity networks.

03 NATURAL GAS↗
DOE OSTI2019

Evaluation of NCAR CAM5 simulated marine boundary layer cloud properties using a combination of satellite and surface observations

Marine boundary layer (MBL) clouds are a strong modulator of Earth’s radiative energy budget. The feedback of MBL clouds in a changing climate remains one of the largest uncertainties in our understanding of climate sensitivity, and recent studies have also suggested that radiative feedbacks related to MBL clouds may play an important role in low-frequency climate variabilities such as the Atlantic multidecadal oscillation. Despite their importance in the climate system, simulating MBL clouds in Earth system models (ESMs) has proved to be extremely challenging. The overarching objective of this proposal is to evaluate the MBL cloud simulation skills of the CAM5 with different cloud parameterization schemes through systematic comparison with both ground- and satellite based cloud observations. In particular, we seek to understand the advantages and limitations of the newly developed subgrid cloud parameterization scheme CLUBB (Cloud Layers Unified By Binormals) for simulation MBL clouds through comparisons of CAM5-CLUBB simulations with ARM (CAP-MBL campaign data) and satellite observations, as well as the “conventional” CAM5 and a CAM5 with the so-called super-parameterization (i.e., CAM5-MMF). In the rest of this report, we will briefly highlight our major research achievements.

58 GEOSCIENCES↗
DOE OSTI2017

The atmospheric hydrologic cycle in the ACME v0.3 model

We examine the global water cycle characteristics in the Accelerated Climate Modeling for Energy v0.3 model (a close relative to version 5.3 of the Community Atmosphere Model) in atmosphere-only simulations spanning the years 1980–2005. We evaluate the simulations using a broad range of observational and reanalysis datasets, examine how the simulations change when the horizontal resolution is increased from 1° to 0.25, and compare the simulations against models participating in the the Atmosphere Model Intercomparison Project of the 5th Coupled Model Intercomparison Project (CMIP5). Particular effort has been made to evaluate the model using the best available observational estimates and verifying model biases with additional datasets when differences are known to exist among the observations. Regardless of resolution, the model exhibits several biases: global-mean precipitation, evaporation, and precipitable water are too high, light precipitation occurs too frequently, and the atmospheric residence time of water is too short. Many of these biases are shared by the multi-model mean climate of models participating in CMIP5. The reasons behind regional biases in precipitation are discussed by examining how different fields, such as local evaporation and transport of water vapor, contribute to the bias. Although increasing the horizontal resolution does not drastically change the water cycle, it does lead to a few differences: an increase in global mean precipitation rate, an increase in the fraction of total precipitation that falls over land, more frequent heavy precipitation (>30 mm day -1 ), and a decrease in precipitable water. One of the most notable changes is the shift of precipitation produced by the convective parameterization to that produced by the large-scale microphysics parameterization. We analyze how changes in moisture and circulation with resolution contribute to this shift in the precipitation partitioning. Because changing horizontal resolution requires some re-tuning, the effect of that tuning was evaluated by performing an additional simulation at 1 but using the tunings from the 0.25 simulation. In conclusion, the evaluation shows that the more frequent heavy precipitation, the decrease in precipitable water, and the shift from convective to large-scale precipitation are predominantly due to resolution changes, while tuning changes have a major influence on the global mean precipitation and the land/ ocean partitioning of precipitation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2016

SU-F-T-50: Evaluation of Monte Carlo Simulations Performance for Pediatric Brachytherapy Dosimetry

Purpose: Pediatric tumors are generally treated with multi-modal procedures. Brachytherapy can be used with pediatric tumors, especially given that in this patient population low toxicity on normal tissues is critical as is the suppression of the probability for late malignancies. Our goal is to validate the GATE toolkit on realistic brachytherapy applications, and evaluate brachytherapy plans on pediatrics for accurate dosimetry on sensitive and critical organs of interest. Methods: The GATE Monte Carlo (MC) toolkit was used. Two High Dose Rate (HDR) 192Ir brachytherapy sources were simulated (Nucletron mHDR-v1 and Varian VS2000), and fully validated using the AAPM and ESTRO protocols. A realistic brachytherapy plan was also simulated using the XCAT anthropomorphic computational model .The simulated data were compared to the clinical dose points. Finally, a 14 years old girl with vaginal rhabdomyosarcoma was modelled based on clinical procedures for the calculation of the absorbed dose per organ. Results: The MC simulations resulted in accurate dosimetry in terms of dose rate constant (Λ), radial dose gL(r) and anisotropy function F(r,θ) for both sources.The simulations were executed using ∼1010 number of primaries resulting in statistical uncertainties lower than 2%.The differences between the theoretical values and the simulated ones ranged from 0.01% up to 3.3%, with the largest discrepancy (6%) being observed in the dose rate constant calculation.The simulated DVH using an adult female XCAT model was also compared to a clinical one resulting in differences smaller than 5%. Finally, a realistic pediatric brachytherapy simulation was performed to evaluate the absorbed dose per organ and to calculate DVH with respect to heterogeneities of the human anatomy. Conclusion: GATE is a reliable tool for brachytherapy simulations both for source modeling and for dosimetry in anthropomorphic voxelized models. Our project aims to evaluate a variety of pediatric brachytherapy schemes using a population of pediatric phantoms for several pathological cases. This study is part of a project that has received funding from the European Union Horizon2020 research and innovation programme under the MarieSklodowska-Curiegrantagreement.No691203.The results published in this study reflect only the authors view and the Research Executive Agency (REA) and the European Commission is not responsible for any use that may be madeof the information it contains.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

A Fast Reactor Irradiation Experiment Design in the ATR

Modern modeling techniques were used to investigate a proposed method for fast neutron irradiations in an existing thermal-spectrum reactor, the Advanced Test Reactor (ATR). This method builds upon pre-existing ideas, where fast flux is increased by surrounding the specimens with fissionable “booster fuel” but diverges from historical approaches by using an already developed fuel element design used in the Belgian Reactor 2 (BR2) as the booster fuel while leveraging modern 3-D modeling and simulation techniques. Design evaluations and neutronics simulations were performed to evaluate the performance of a BR2 fuel element irradiated in an ATR flux trap with test pins in the central channel of the BR2 fuel element. These efforts have yielded promising results. Adding a BR2 fuel element in the northeast (NE) flux trap of ATR was predicted to result in a 150% increase to the incident fast neutron flux with a fast (>0.1 MeV) to thermal (<0.625 eV) neutron flux ratio ranging from approximately 50 to 150, dependent on the material used for thermal neutron filtering and volume of moderator within the central channel of the BR2 element. The predicted annual fast neutron fluence (>0.1 MeV) ranges from 7.9 × 1021 to 9.1 × 1021 n/cm2. Given the relatively large fast to thermal neutron flux ratio, the calculated radial power profiles within 4.3 mm outer diameter U10Zr fueled specimens irradiated within the BR2 booster fuel element are adequate representations of those within fast neutron reactors. The predicted radial power profiles are not flat, but they are more prototypic than those seen in advanced fuels tests which began in ATR in 2003. Another distinct advantage of this experiment design is that full-scale test pins can be irradiated to augment the ongoing series of reduced scale advanced fuels tests. The proposed experiment design irradiated within a BR2 fuel element in a flux trap of ATR offers an improved alternative to the current testing of advanced reactor fuels in ATR. Selected results from this design evaluation are presented.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2018

(GO) 2 -SIM: a GCM-oriented ground-observation forward-simulator framework for objective evaluation of cloud and precipitation phase

General circulation model (GCM) evaluation using ground-based observations is complicated by inconsistencies in hydrometeor and phase definitions. Here we describe (GO) 2 -SIM, a forward simulator designed for objective hydrometeor-phase evaluation, and assess its performance over the North Slope of Alaska using a 1-year GCM simulation. For uncertainty assessment, 18 empirical relationships are used to convert model grid-average hydrometeor (liquid and ice, cloud, and precipitation) water contents to zenith polarimetric micropulse lidar and Ka-band Doppler radar measurements, producing an ensemble of 576 forward-simulation realizations. Sensor limitations are represented in forward space to objectively remove from consideration model grid cells with undetectable hydrometeor mixing ratios, some of which may correspond to numerical noise. Phase classification in forward space is complicated by the inability of sensors to measure ice and liquid signals distinctly. However, signatures exist in lidar–radar space such that thresholds on observables can be objectively estimated and related to hydrometeor phase. The proposed phase-classification technique leads to misclassification in fewer than 8 % of hydrometeor-containing grid cells. Such misclassifications arise because, while the radar is capable of detecting mixed-phase conditions, it can mistake water- for ice-dominated layers. However, applying the same classification algorithm to forward-simulated and observed fields should generate hydrometeor-phase statistics with similar uncertainty. Alternatively, choosing to disregard how sensors define hydrometeor phase leads to frequency of occurrence discrepancies of up to 40 %. So, while hydrometeor-phase maps determined in forward space are very different from model reality they capture the information sensors can provide and thereby enable objective model evaluation.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2018

(GO)2-SIM: a GCM-Oriented Ground-Observation Forward-Simulator Framework for Objective Evaluation of Cloud and Precipitation Phase

General circulation model (GCM) evaluation using ground-based observations is complicated by inconsistencies in hydrometeor and phase definitions. Here we describe (GO)2-SIM, a forward simulator designed for objective hydrometeor-phase evaluation, and assess its performance over the North Slope of Alaska using a 1-year GCM simulation. For uncertainty assessment, 18 empirical relationships are used to convert model grid-average hydrometeor (liquid and ice, cloud, and precipitation) water contents to zenith polarimetric micropulse lidar and Ka-band Doppler radar measurements, producing an ensemble of 576 forward-simulation realizations. Sensor limitations are represented in forward space to objectively remove from consideration model grid cells with undetectable hydrometeor mixing ratios, some of which may correspond to numerical noise.Phase classification in forward space is complicated by the inability of sensors to measure ice and liquid signals distinctly. However, signatures exist in lidar–radar space such that thresholds on observables can be objectively estimated and related to hydrometeor phase. The proposed phase-classification technique leads to misclassification in fewer than 8% of hydrometeor-containing grid cells. Such misclassifications arise because, while the radar is capable of detecting mixed-phase conditions, it can mistake water- for ice-dominated layers. However, applying the same classification algorithm to forward-simulated and observed fields should generate hydrometeor-phase statistics with similar uncertainty. Alternatively, choosing to disregard how sensors define hydrometeor phase leads to frequency of occurrence discrepancies of up to 40%. So, while hydrometeor-phase maps determined in forward space are very different from model "reality" they capture the information sensors can provide and thereby enable objective model evaluation.

Lamer, K.↗
NASA NTRS1977

Evaluation of an F100 multivariable control using a real-time engine simulation

The control evaluated has been designed for the F100-PW-100 turbofan engine. The F100 engine represents the current state-of-the-art in aircraft gas turbine technology. The control makes use of a multivariable, linear quadratic regulator. The evaluation procedure employed utilized a real-time hybrid computer simulation of the F100 engine and an implementation of the control logic on the NASA LeRC digital computer/controller. The results of the evaluation indicated that the control logic and its implementation will be capable of controlling the engine throughout its operating range.

Szuch, J. R.↗
NASA NTRS1994

A graphical workstation based part-task flight simulator for preliminary rapid evaluation of advanced displays

Advances in avionics and display technology are significantly changing the cockpit environment in current transport aircraft. The MIT Aeronautical Systems Lab (ASL) developed a part-task flight simulator specifically to study the effects of these new technologies on flight crew situational awareness and performance. The simulator is based on a commercially-available graphics workstation, and can be rapidly reconfigured to meet the varying demands of experimental studies. The simulator was successfully used to evaluate graphical microbursts alerting displays, electronic instrument approach plates, terrain awareness and alerting displays, and ATC routing amendment delivery through digital datalinks.

Wanke, Craig↗
NASA NTRS1992

Simulators for corporate pilot training and evaluation

Corporate aviation relies heavily on simulation to meet training and evaluation requirements. It appreciates the savings in fuel, money, noise, and time, and the added safety it provides. Also, simulation provides opportunities to experience many emergencies that cannot be safely practiced in the aircraft. There is a need to focus on the advantages of simulator training over aircraft training and to provide appropriate changes in the regulations to allow the community to make it possible for users to take full advantage of simulation.

Treichel, Curt↗
DOE OSTI2016

SU-F-I-53: Coded Aperture Coherent Scatter Spectral Imaging of the Breast: A Monte Carlo Evaluation of Absorbed Dose

Purpose: Coherent scatter based imaging has shown improved contrast and molecular specificity over conventional digital mammography however the biological risks have not been quantified due to a lack of accurate information on absorbed dose. This study intends to characterize the dose distribution and average glandular dose from coded aperture coherent scatter spectral imaging of the breast. The dose deposited in the breast from this new diagnostic imaging modality has not yet been quantitatively evaluated. Here, various digitized anthropomorphic phantoms are tested in a Monte Carlo simulation to evaluate the absorbed dose distribution and average glandular dose using clinically feasible scan protocols. Methods: Geant4 Monte Carlo radiation transport simulation software is used to replicate the coded aperture coherent scatter spectral imaging system. Energy sensitive, photon counting detectors are used to characterize the x-ray beam spectra for various imaging protocols. This input spectra is cross-validated with the results from XSPECT, a commercially available application that yields x-ray tube specific spectra for the operating parameters employed. XSPECT is also used to determine the appropriate number of photons emitted per mAs of tube current at a given kVp tube potential. With the implementation of the XCAT digital anthropomorphic breast phantom library, a variety of breast sizes with differing anatomical structure are evaluated. Simulations were performed with and without compression of the breast for dose comparison. Results: Through the Monte Carlo evaluation of a diverse population of breast types imaged under real-world scan conditions, a clinically relevant average glandular dose for this new imaging modality is extrapolated. Conclusion: With access to the physical coherent scatter imaging system used in the simulation, the results of this Monte Carlo study may be used to directly influence the future development of the modality to keep breast dose to a minimum while still maintaining clinically viable image quality.

60 APPLIED LIFE SCIENCES↗
NASA NTRS1992

Simulation and flight test evaluation of head-up-display guidance for Harrier approach transitions

Position and speed guidance displays for STOVL aircraft curved, decelerating approaches to hover and vertical landing have been evaluated for their effectiveness in reducing pilot workload and improving performance. The NASA V/STOL Systems Research Aircraft, a modified YAV-8B Harrier prototype, was used to evaluate the displays in flight, while the NASA Ames Vertical Motion Simulator was used to extend the flight test results to instrument meteorological conditions (IMC) and to examine performance in various conditions of wind and turbulence. The simulation data showed close correlation with the flight test data, and both demonstrated the feasibility of the displays. With the exception of the hover task in zero visibility, which was Level-3, averaged Cooper-Harper handling qualities ratings given during simulation were Level-2 for both the approach task and the hover task in all conditions. During flight tests in calm and clear conditions, the displays also gave rise to Level-2 handling qualities ratings. Pilot opinion showed that the guidance displays would be useful in visual flight, especially at night, as well as in IMC.

Dorr, D. W.↗
NASA NTRS1994

Simulation and flight test evaluation of head-up-display guidance for harrier approach transitions

Position and speed guidance displays for STOVL aircraft curved, decelerating approaches to hover and vertical landing have been evaluated for their effectiveness in reducing pilot workload and improving performance. The NASA V/STOL Systems Research Aircraft, a modified YAV-8B Harrier prototype, was used to evaluate the displays in flight, whereas the NASA Ames Vertical Motion Simulator was used to extend the flight test results to instrument meteorological conditions (IMC) and to examine performance in various conditions of wind and turbulence. The simulation data showed close correlation with the flight test data, and both demonstrated the feasibility of the displays. With the exception of the hover task in zero visibility, which was level-3, averaged Copper-Harper handling qualities ratings given during simulation were level-2 for both the approach task and the hover task in all conditions. During flight tests in calm and clear conditions, the displays also gave rise to level-2 handling qualities ratings. Pilot opinion showed that the guidance displays would be useful in visual flight, especially at night, as well as in IMC.

HARRIER APPROACH↗
NASA NTRS2019

Status of NASA Research on Projectile Shape Effects-Impact Simulations

Numerical evaluation of a Whipple shield has yielded a ballistic model for cylindrical projectiles. A numerical model of a Whipple shield covered with a thermal-blanket that is representative of operational shields has been developed using CTH: The shield model has been evaluated against existing test data; The projectile model has been developed from preexisting models for graphite-epoxy materials. The model has been used to identify projectile characteristics at the ballistic limit for spherical and cylindrical projectiles; Considered normal impacts of the shield at 7 kilometers per second; Varied the angle between the axis-of-symmetry and velocity vector; Varied the length to the diameter ratio over a broad range. The results have been consolidated into a generalized model that can be adapted to existing spherical models

Miller, J.↗