Search NASA⌕ Search

SEARCH · Search NASA

Results for “simulation evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39
All sourcesNASA NTRSDOE OSTI
NASA NTRS2013

Evaluation of GEOS-5 Sulfur Dioxide Simulations During the Frostburg, MD 2010 Field Campaign.

Sulfur dioxide (SO2) is a major atmospheric pollutant with a strong anthropogenic component mostly produced by the combustion of fossil fuel and other industrial activities. As a precursor of sulfate aerosols that affect climate, air quality, and human health, this gas needs to be monitored on a global scale. Global climate and chemistry models including aerosol processes along with their radiative effects are important tools for climate and air quality research. Validation of these models against in-situ and satellite measurements is essential to ascertain the credibility of these models and to guide model improvements. In this study the Goddard Chemistry, Aerosol, Radiation, and Transport (GOCART) module running on-line inside the Goddard Earth Observing System version 5 (GEOS-5) model is used to simulate aerosol and SO2 concentrations. Data taken in November 2010 over Frostburg, Maryland during an SO2 field campaign involving ground instrumentation and aircraft are used to evaluate GEOS-5 simulated SO2 concentrations. Preliminary data analysis indicated the model overestimated surface SO2 concentration, which motivated the examination of mixing processes in the model and the specification of SO2 anthropogenic emission rates. As a result of this analysis, a revision of anthropogenic emission inventories in GEOS-5 was implemented, and the vertical placement of SO2 sources was updated. Results show that these revisions improve the model agreement with observations locally and in regions outside the area of this field campaign. In particular, we use the ground-based measurements collected by the United States Environmental Protection Agency (US EPA) for the year 2010 to evaluate the revised model simulations over North America.

Air Quality Campaign↗
DOE OSTI2021

Physics-Informed Machine Learning Models for Predicting the Progress of Reactive-Mixing

This paper presents a physics-informed machine learning (ML) framework to construct reduced-order models (ROMs) for reactive-transport quantities of interest (QoIs) based on high-fidelity numerical simu-lations. QoIs include species decay, product yield, and degree of mixing. The ROMs for QoIs are applied to quantify and understand how the chemical species evolve over time. First, high-resolution datasets for constructing ROMs are generated by solving anisotropic reaction-di?usion equations using a non-negative finite element formulation for di?erent input parameters. The reactive-mixing model input parameters are: time-scale associated with flipping of velocity, spatial-scale controlling small/large vortex structures of velocity, perturbation parameter of the vortex-based velocity, anisotropic dispersion strength/contrast, and molecular diffusion. Second, random forests, F-test, and mutual information criterion are used to evaluate the importance of model inputs/features with respect to QoIs. We observed that anisotropic dispersion strength/contrast is the most important feature and time-scale associated with flipping of velocity is the least important feature. Third, Support Vector Machines (SVM) and Support Vector Regression (SVR) are used to construct ROMs based on the model inputs. The constructed SVR-ROMs are then used to predict scaling of QoIs. We also present estimates and inequalities on the QoIs, which inform that the species decay, mix, and produce in an exponential fashion. These inequalities also inform that a radial basis function is the most suitable kernel for the SVM/SVR models for QoIs. It is observed that R2-score for SVR-ROMs on unseen data is greater than 0.9, implying that the SVR-ROMs are able to predict the reaction-diffusion system state reasonably well. Finally, in terms of the computational cost, the proposed SVM-ROMs are O(107) times faster than running a high-fidelity finite element simulation for evaluating QoIs. This makes the proposed ML-based ROMs attractive for reactive-transport sensing and real-time monitoring applications as they are significantly faster yet reasonably accurate.

Mudunuru, Maruti K.↗
DOE OSTI2022

Sensitivity of Cloud-Radiative Effects to Cloud Fraction Parametrizations in Tropical, Mid-Latitude and Arctic Kilometre-Scale Simulations

The Regional Atmosphere (RA) configuration of the Met Office Unified Model currently requires different cloud fraction parametrizations (CFP) for tropical and midlatitude simulations. To explore the scope for unification of these two RA configurations, this paper presents a detailed evaluation of simulations over tropical, midlatitude and arctic domains, with two different diagnostic CFPs, a prognostic CFP, and no CFP at all. Furthermore, a novel, hybrid approach was used that treats liquid cloud diagnostically and ice cloud prognostically. Using observations from three U.S. Department of Energy Atmospheric Radiation Measurement supersites, it is shown that none of these CFPs stands out as superior over all domains. Over the frequently overcast Arctic, the all-or-nothing approach best captures the cloud radiative properties. Conversely, CFPs are of benefit in regions with frequent partial cloudiness, such as the midlatitudes and the tropics. However, their improved cloud radiative properties often hide an error compensation. All models underestimate overcast, low-base cloud with small water paths in convective environments. In addition, mid-latitude overcast, low-base, optically thick clouds in the morning, possibly associated with overnight convection, are frequently too broken. Diagnostic schemes compensate for these errors by producing spurious, scattered afternoon cloud, which could be due to a correct cloud response to too eager convective initiation. Winter clouds over the midlatitudes are improved when liquid cloud is represented diagnostically with a bimodal saturation-departure PDF, without error compensation. While it is difficult to unify the RA across the globe around a single CFP scheme, the newly proposed Hybrid scheme performs reasonably well for cloud cover across all regions. It also exhibits SW biases that are smaller than most other configurations and is less affected by excessive liquid water paths and compensating errors than fully diagnostic schemes. Surface precipitation is fairly insensitive to the CFP in the simulations shown here.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1975

Performance of a catalytic reactor at simulated gas turbine combustor operating conditions

The performance of a catalytic reactor 12 cm in diameter and 17 cm long was evaluated at simulated gas turbine combustor operating conditions using premixed propane and air. Inlet temperatures of 600 and 800 K, pressures of 3 and 6 atm, and reference velocities of 9 to 30 m/s were tested. Data were taken for equivalence ratios as high as 0.43. The operating range was limited on the low-temperature side by very poor efficiency; the minimum exit temperature for good performance ranged from 1400 to 1600 K depending on inlet conditions. As exit temperatures were raised above this minimum, emissions of unburned hydrocarbons decreased, carbon monoxide emissions became generally less than 1 g CO/kg fuel, and nitrogen oxides were less than about 0.1 g NO2/kg fuel.

Anderson, D. N.↗
DOE OSTI2016

An assessment of coupling algorithms for nuclear reactor core physics simulations

This paper evaluates the performance of multiphysics coupling algorithms applied to a light water nuclear reactor core simulation. The simulation couples the k-eigenvalue form of the neutron transport equation with heat conduction and subchannel flow equations. We compare Picard iteration (block Gauss–Seidel) to Anderson acceleration and multiple variants of preconditioned Jacobian-free Newton–Krylov (JFNK). The performance of the methods are evaluated over a range of energy group structures and core power levels. A novel physics-based approximation to a Jacobian-vector product has been developed to mitigate the impact of expensive on-line cross section processing steps. Numerical simulations demonstrating the efficiency of JFNK and Anderson acceleration relative to standard Picard iteration are performed on a 3D model of a nuclear fuel assembly. Both criticality (k-eigenvalue) and critical boron search problems are considered.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

Development of a simplified calibrated building simulation model of a supermarket for proposed ECMs and control strategies impact evaluation

Calibrated building energy simulation is an important pathway to more energy-efficient buildings, but the information requirements of some approaches to this problem are significant. This is particularly true for supermarkets and other so-called “big-box” retail stores. Another characteristic of supermarkets is the significant interaction between Heating Ventilating and Air Conditioning (HVAC) and refrigeration systems in these buildings. These buildings could contain a wide variety of systems and a degree of load diversity that makes calibrated modeling a challenge. This paper describes a simplified approach that uses OpenStudio and EnergyPlus to combine known building parameters with “typical” parameters, resulting in a simplified building that is amenable to calibration. This approach was applied to a big-box store located in Nashville, Tennessee, and a calibrated model was obtained that was used to study potential energy conservation measures. Further, the paper also explores the capabilities of whole-building energy modeling tools, such as EnergyPlus, for modeling the HVAC controls and sequences and their impact evaluation. Although some measures are precluded by the model simplicity, several measures were found to improve the efficiency of the model and demonstrate that the simplified modeling approach is effective. Practical Application: This paper introduces a hybrid approach of building energy model calibration using limited information available from the actual building in combination with characteristics of a “typical” building of the same type. This hybrid approach would also be applicable for other building types than discussed in this paper to calibrate the building energy model using limited information from the actual building.

42 ENGINEERING↗
NASA NTRS2004

Evaluating the Credibility of Transport Processes in Simulations of Ozone Recovery using the Global Modeling Initiative Three-dimensional Model

The Global Modeling Initiative (GMI) has integrated two 36-year simulations of an ozone recovery scenario with an offline chemistry and tra nsport model using two different meteorological inputs. Physically ba sed diagnostics, derived from satellite and aircraft data sets, are d escribed and then used to evaluate the realism of temperature and transport processes in the simulations. Processes evaluated include barri er formation in the subtropics and polar regions, and extratropical w ave-driven transport. Some diagnostics are especially relevant to sim ulation of lower stratospheric ozone, but most are applicable to any stratospheric simulation. The global temperature evaluation, which is relevant to gas phase chemical reactions, showed that both sets of me teorological fields have near climatological values at all latitudes and seasons at 30 hPa and below. Both simulations showed weakness in upper stratospheric wave driving. The simulation using input from a g eneral circulation model (GMI(GCM)) showed a very good residual circulation in the tropics and Northern Hemisphere. The simulation with inp ut from a data assimilation system (GMI(DAS)) performed better in the midlatitudes than it did at high latitudes. Neither simulation forms a realistic barrier at the vortex edge, leading to uncertainty in the fate of ozone-depleted vortex air. Overall, tracer transport in the offline GML(GCM) has greater fidelity throughout the stratosphere tha n it does in the GMI(DAS)

Strahan, Susan E.↗
DOE OSTI2026

Event-Driven Neuromorphic Accelerator (Caspian)

Software repository for the Caspian neuromorphic system. In order to deploy small, low-power spiking neural networks at the edge, there needs to be 1) an FPGA design for an event simulator to evaluate these neural networks as well as 2) a high-performance cycle-accurate simulator for training these spiking neural networks. This software package solves these problems by providing the Caspian simulator and the µCaspian hardware design in SystemVerilog.

Mitchell, JohnParker [Microsoft Corporation, Redmo↗
NASA NTRS1972

STADAN and data relay satellite simulation (emphasis on the scheduler)

A set of computer programs was developed which can be used to simulate the operation of NASA's Satellite Tracking and Data Acquisition Network (STADAN). The simulation consists of two major modules, a computerized algorithmic satellite scheduler (CASS) and a generalized evaluation model simulator (GEMS). CASS generates in-view time intervals of satellites over ground stations, and using these candidate passes, produces a schedule of service times for specific satellites to be serviced by specific ground stations in an attempt to fulfill certain inputted service requirements. GEMS than examines how well STADAN fulfills this schedule in terms of the availability and dependability of different (inputted) complements of equipment at the ground stations. The simulation was modified to allow for the introduction of one or more tracking and data relay satellites, which can serve as orbital receiving and command stations.

Kerne, B.↗
NASA NTRS1981

Resolution requirements for a soil moisture imaging radar

Image simulation techniques were employed to establish the relationship between spatial resolution and the accuracy of soil moisture estimated by an imaging radar. A spaceborne synthetic aperture radar at an orbital altitude of 600 km, operating at 4.5 GHz with HH polarization configuration and covering a ground swath width of 143 km corresponding to an angle of incidence range extending between 7-22 degrees relative to the vertical, provided the images simulated by a 17.7 km x 19.3 km test site. The role of resolution was evaluated by simulating various sets of images with resolutions ranging from 20 m x 20 m to 1 km x 1 km. Each simulated image was subjected to a soil moisture prediction algorithm whose input is limited to the image intensity level. Results show that the 1 km x 1 km resolution provides the best prediction accuracy for most soil moisture distributions except for drought-like conditions for which the 100 m x 100 m resolution is found to be preferred. In general it was found that the soil moisture of about 90% of the pixels is predicted with an error of + or - 20% of field capacity or less.

Dobson, C.↗
DOE OSTI2017

A Proposed Path Forward for Standardization - 17131

Incorporation of a standardized canister system into the commercial waste management system represents an opportunity to develop an integrated approach to storage, transportation, and disposal issues. However, regardless of timing and method, deployment of such a system would have the potential to cause significant system-wide impacts. The current inventory of commercial spent nuclear fuel dry storage systems is diverse and increasing. In addition, the currently loaded systems are large-capacity systems (up to 37 pressurized water reactor assemblies or 89 boiling water reactor assemblies) that are now able to accommodate large (greater than 45 kilowatts) amounts of heat during storage, with the potential to accommodate fairly high heat loads (∼32 kilowatts) for transportation as well. A standardized canister system designed with disposition in mind would likely be significantly smaller than the current systems and have dramatically lower heat limit maximums. Over the past few years, the Department of Energy (DOE) Office of Nuclear Energy Fuel Cycle Technologies Nuclear Fuels Storage and Transportation Planning Project (NFST) has performed a number of system analyses using logistic simulations to evaluate the impacts of incorporating these smaller canisters into the commercial waste management system. These simulations predict the amount of resources (e.g., staff, canisters/casks, rail-cars, facilities), the size of facilities, and the timing of operations, as well as provide rough order-of-magnitude cost estimates. In addition to system analyses, DOE funded efforts by EnergySolutions to develop a generic design of a small-capacity standardized canister system and investigate innovative operational approaches to minimize the at-reactor operational impacts of loading such smaller canisters. A result of EnergySolutions' work was the development of a 'canister-in-carrier' concept that would allow for loading, storing, transporting, and potentially disposing of groups of small canisters at the same time. With the inclusion of this new concept, the most recent system analyses show that incorporating standardized canister systems into the commercial waste management system has the potential for some system-wide cost reductions in addition to the flexibility that smaller canisters would provide to the system. Based on these analyses, the authors of this paper recommend that DOE fund (1) a demonstration of the ability to weld up to four small canisters at the same time to confirm the feasibility and practicality of the canister-in-carrier concept and (2) the development of a more detailed conceptual design for future applications for Certificates of Compliance, if standardized canisters were incorporated into the commercial waste management system. This paper documents both the results of the latest assessment of standardized canister concepts including the canister-in-carrier concept and the authors' recommendations. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2015

Battery Storage Evaluation Tool, version 1.x

The battery storage evaluation tool developed at Pacific Northwest National Laboratory is used to run a one-year simulation to evaluate the benefits of battery storage for multiple grid applications, including energy arbitrage, balancing service, capacity value, distribution system equipment deferral, and outage mitigation. This tool is based on the optimal control strategies to capture multiple services from a single energy storage device. In this control strategy, at each hour, a lookahead optimization is first formulated and solved to determine the battery base operating point. The minute-by-minute simulation is then performed to simulate the actual battery operation.

Wu, Di↗
DOE OSTI2021

Using radar observations to evaluate 3-D radar echo structure simulated by the Energy Exascale Earth System Model (E3SM) version 1

Abstract. The Energy Exascale Earth System Model (E3SM) developed by the Department of Energy has a goal of addressing challenges in understanding the global water cycle. Success depends on correct simulation of cloud and precipitation elements. However, lack of appropriate evaluation metrics has hindered the accurate representation of these elements in general circulation models. We derive metrics from the three-dimensional data of the ground-based Next-Generation Radar (NEXRAD) network over the US to evaluate both horizontal and vertical structures of precipitation elements. We coarsened the resolution of the radar observations to be consistent with the model resolution and improved the coupling of the Cloud Feedback Model Intercomparison Project Observation Simulator Package (COSP) and E3SM Atmospheric Model Version 1 (EAMv1) to obtain the best possible model output for comparison with the observations. Three warm seasons (2014–2016) of EAMv1 simulations of 3-D radar reflectivity features at an hourly scale are evaluated. A general agreement in domain-mean radar reflectivity intensity is found between EAMv1 and NEXRAD below 4 km altitude; however, the model underestimates reflectivity over the central US, which suggests that the model does not capture the mesoscale convective systems that produce much of the precipitation in that region. The shape of the model-estimated histogram of subgrid-scale reflectivity is improved by correcting the microphysical assumptions in COSP. Different from previous studies that evaluated modeled cloud top height, we find the model severely underestimates radar reflectivity at upper levels – the simulated echo top height is about 5 km lower than in observations – and this result is not changed by tuning any single physics parameter. For more accurate model evaluation, a higher-order consistency between the COSP and the host model is warranted in future studies.

58 GEOSCIENCES↗
DOE OSTI2021

Evaluation of CMIP6 models in simulating the statistics of extreme precipitation over Eastern Africa

We report the Eastern Africa region experiences frequent extreme precipitation events that can cause destruction of property and environment, and loss of lives. Thus, there is a need to understand how these events may change in the future and how well the global climate models that are used to make projections can simulate precipitation extremes in this region before they can be used in downscaling or flood and drought impact assessment studies. In this work, we evaluated the ability of sixteen Coupled Model Intercomparison Project Phase 6 (CMIP6) models to simulate present-day precipitation extremes over the Eastern Africa region during the two rainy seasons (March–May and September–November). We used nine extreme precipitation indices (including seven (one) indices of wet (dry) extremes) defined by the Expert Team on Climate Change Detection and Indices. The CMIP6 models were evaluated against two gridded observation datasets: Global Precipitation Climatology Project One-Degree Daily Dataset and Tropical Rainfall Measuring Mission Multi-satellite Precipitation Analysis 3B42. Three model performance metrics (percentage bias, normalized root-mean-square error, and pattern correlation coefficient) were employed to further assess the strengths and weakness of the models. Our results show that the multi-model ensemble mean generally provides a better representation of observed precipitation and related extremes compared to individual models when considering all metrics and seasons. Several consistent biases are evident across CMIP6 models, which tend to overestimate the total-wet day precipitation and consecutive wet days, and underestimate very wet days and maximum 5-day precipitation in both seasons. Furthermore, no single model consistently performs best, model performance varies with the season and index under consideration and is generally independent of horizontal resolution.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2019

Evaluation and Validation Approaches for Simulation of Social Behavior: Challenges and Opportunities

While models of social systems have grown in scope to represent increasingly complex phenomena, efforts to validate these models against observations suffer from a number of challenges that include the lack of shared approaches, the use of single-dimensional evaluation criteria, and the difficulty in evaluating causal mechanisms. Moreover, current evaluation approaches suffer from sensitivity of the existing measurements to initial conditions and model assumptions, and failure to account for uncertainty. These effects lead to the lack of generalizability to new contexts, inability to replicate the validation approach for new models, and difficulties in interpretation of validation results. These challenges can be addressed by building a set of diverse and robust evaluation metrics and by developing best practices for comparative, reproducible validation of varied social simulation approaches against real-world data. Herein, we outline several best practices for data-drive model validation, such as defining evaluation strategies consistent with the intended use case and defining broad comparison criteria to highlight both model strengths and weaknesses. Leveraging common validation practices will enable robust analysis of simulation performance across diverse social scenarios and modeling approaches.

Saldanha, Emily G.↗
NASA NTRS1972

Flight investigation of the roll requirements for transport airplanes in the landing approach

An in-flight evaluation of transport roll characteristics in the landing approach was made with a general purpose airborne simulator. The evaluation task consisted of an instrument approach with a visual correction for a (200-foot) lateral offset. Pilot evaluations and ratings were obtained for approaches made at 140 knots and 180 knots indicated airspeed with variations of wheel characteristics, maximum roll rate, and roll time constant.

Holleman, E. C.↗
NASA NTRS1993

Health maintenance facility system effectiveness testing

The Medical Simulations Working Group conducted a series of medical simulations to evaluate the proposed Health Maintenance Facility (HMF) Preliminary Design Review (PDR) configuration. The goal of these simulations was to test the system effectiveness of the HMF PDR configurations. The objectives of the medical simulations are to (1) ensure fulfillment of requirements with this HMF design, (2) demonstrate the conformance of the system to human engineering design criteria, and (3) determine whether undesirable design or procedural features were introduced into the design. The simulations consisted of performing 6 different medical scenarios with the HMF mockup in the KRUG laboratory. The scenarios included representative medical procedures and used a broad spectrum of HMF equipment and supplies. Scripts were written and simulations performed by medical simulations working group members under observation from others. Data were collected by means of questionnaires, debriefings, and videotapes. Results were extracted and listed in the individual reports. Specific issues and recommendations from each simulation were compiled into the individual reports. General issues regarding the PDR design of the HMF are outlined in the summary report.

Lloyd, Charles W.↗