Search NASA⌕ Search

SEARCH · Search NASA

Results for “simulation evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,495 records · Page 83

Taking climate model evaluation to the next level

We report that earth system models are complex and represent a large number of processes, resulting in a persistent spread across climate projections for a given future scenario. Owing to different model performances against observations and the lack of independence among models, there is now evidence that giving equal weight to each available model projection is suboptimal. This Perspective discusses newly developed tools that facilitate a more rapid and comprehensive evaluation of model simulations with observations, process-based emergent constraints that are a promising way to focus evaluation on the observations most relevant to climate projections, and advanced methods for model weighting. Lastly, these approaches are needed to distill the most credible information on regional climate changes, impacts, and risks for stakeholders and policy-makers.

54 ENVIRONMENTAL SCIENCES↗

Creation of a Weather Drivers Test Suite for Inclusion in ASHRAE Standard 140

Weather conditions are an important boundary condition for building performance simulation (BPS) calculations. For existing test cases in ASHRAE Standard 140 "Method of Test for Evaluating Building Performance Simulation Software" (ANSI/ASHRAE 2020), it was assumed that the software being tested could adequately read and interpret the weather data in the provided standard weather files. As differences between the programs have been reduced and as more programs have shifted to sub-hourly time steps this assumption has become more stretched. To address these concerns a new test suite testing a program's ability to read and interpret the data from a standard weather file was developed. The purpose of the test suite is to test the use of the typical data used from standard weather files.

54 ENVIRONMENTAL SCIENCES↗

Computer-generated animation for analysis and design

The development of computer-generated animation techniques was reviewed and some examples of the current state of the art were described. A number of ways in which computer-generated animation can be used were examined in relation to the suitability for the engineering task at hand. The examples described are primarily concerned with attempting to combine two different types of simulation: that of superposition of an engineering design on the surrounding real world, and an evaluation of this simulation both from an engineering design and an aesthetic point of view.

Feeser, L. J.↗

Precision Attitude Determination System (PADS) system design and analysis: Single-axis gimbal star tracker

The feasibility is evaluated of an evolutionary development for use of a single-axis gimbal star tracker from prior two-axis gimbal star tracker based system applications. Detailed evaluation of the star tracker gimbal encoder is considered. A brief system description is given including the aspects of tracker evolution and encoder evaluation. System analysis includes evaluation of star availability and mounting constraints for the geosynchronous orbit application, and a covariance simulation analysis to evaluate performance potential. Star availability and covariance analysis digital computer programs are included.

Source record↗

Active Control Technology Experience with the Space Shuttle in the Landing Regime

The shuttle program took on the challenge of providing a manual landing capability for an operational vehicle returning from orbit. Some complex challenges were encountered in developing the longitudinal flying qualities required to land the orbiter manually in an operational environmental. Approach and landing test flights indicated a tendency for pilot-induced oscillation near landing. Changes in the operational procedures reduced the difficulty of the landing task, and an adaptive stick filter was incorporated to reduce the severity of any pilot-induced oscillatory motions. Fixed-base, moving-base, and in-flight simulations were used for the evaluations, and in general, flight simulation was the only reliable means of assessing the low-speed longitudinal flying qualities problems. Overall, the orbiter control system and operational procedures have produced a good capability for routinely performing precise landings in a large, unpowered vehicle with a low lift-to-drag ratio.

Powers, B. G.↗

Low-speed longitudinal orbiter qualities

The shuttle program took on the challenge of providing a manual landing capability for an operational vehicle returning from orbit. Some complex challenges were encountered in developing the longitudinal flying qualities required to land the orbiter manually in an operational environment. Approach and landing test flights indicated a tendency for pilot-induced oscillation near landing. Changes in the operational procedures reduced the difficulty of the landing task, and an adaptive stick filter was incorporated to reduce the severity of any pilot-induced oscillatory motions. Fixed-base, movingbase, and in-flight simulations were used for the evaluations, and in general, flight simulation was the only reliable means of assessing the low-speed longitudinal flying qualities problems. Overall, the orbiter control system and operational procedures have produced a good capability to routinely perform precise landings with a large, unpowered vehicle with a low lift-to-drag ratio.

Powers, B. G.↗

Active control technology experience with the Space Shuttle in the landing regime

The shuttle program took on the challenge of providing a manual landing capability for an operational vehicle returning from orbit. Some complex challenges were encountered in developing the longitudinal flying qualities required to land the orbiter manually in an operational environment. Approach and landing test flights indicated a tendency for pilot-induced oscillation near landing. Changes in the operational procedures reduced the difficulty of the landing task, and an adaptive stick filter was incorporated to reduce the severity of any pilot-induced oscillatory motions. Fixed-base, moving-base, and in-flight simulations were used for the evaluations, and in general, flight simulation has been the only reliable means of assessing the low-speed longitudinal flying qualities problems. Overall, the orbiter control system and operational procedures have produced a good capability for routinely performing precise landings in a large, unpowered vehicle with a low lift-to-drag ratio.

Powers, B. G.↗

Test vs. simulation

The following topics are presented in tabular form: (1) simulation capability assessments (no propulsion system test); (2) advanced vehicle simulation capability assessment; (3) systems tests identified events; (4) main propulsion test article (MPTA) testing evaluation; (5) Saturn 5, 1B, and 1 testing evaluation. Special vehicle simulation issues that are propulsion related are briefly addressed.

Wood, Charles C.↗

Probabilistic Analysis of Solid Oxide Fuel Cell Based Hybrid Gas Turbine System

The emergence of fuel cell systems and hybrid fuel cell systems requires the evolution of analysis strategies for evaluating thermodynamic performance. A gas turbine thermodynamic cycle integrated with a fuel cell was computationally simulated and probabilistically evaluated in view of the several uncertainties in the thermodynamic performance parameters. Cumulative distribution functions and sensitivity factors were computed for the overall thermal efficiency and net specific power output due to the uncertainties in the thermodynamic random variables. These results can be used to quickly identify the most critical design variables in order to optimize the design and make it cost effective. The analysis leads to the selection of criteria for gas turbine performance.

Gorla, Rama S. R.↗

Taking Climate Model Evaluation to the Next Level

Earth system models are complex and represent a large number of processes, resulting in a persistent spread across climate projections for a given future scenario. Owing to different model performances against observations and the lack of independence among models, there is now evidence that giving equal weight to each available model projection is suboptimal. This Perspective discusses newly developed tools that facilitate a more rapid and comprehensive evaluation of model simulations with observations, process-based emergent constraints that are a promising way to focus evaluation on the observations most relevant to climate projections, and advanced methods for model weighting. These approaches are needed to distil the most credible information on regional climate changes, impacts, and risks for stakeholders and policy-makers.

Eyring, Veronika↗

Distribution Systems Planning and Analysis Framework for Indian Feeders - Partnership with BSES/BRPL

Integration of distributed energy resources (DER) such as photovoltaics, electric vehicles (EVs) and battery energy storage systems (BESS) is expected to rapidly increase in distribution systems in India. These grid edge resources can have adverse impacts on the grid and can provide additional revenue streams as well. To mitigate these impacts distribution planning and analysis is required. So this paper presents a framework which can be used to complete all steps involved in distribution planning and analysis. This framework uses data in the same format as is readily available with Indian utilities and processes it to generate detailed feeder models and loading profiles. This framework already includes multiple DER use cases such as peak shaving for BESS and EV demand modelling and can be easily extended to simulate a number of additional use cases. All of these use cases can be simulated in parallel for multi-year time series simulations using an integrated command line interface. A suit of grid readiness metrics are then evaluated for each simulation to determine required network upgrades and associated costs.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Distribution Systems Planning and Analysis Framework for Indian Feeders: Preprint

Integration of distributed energy resources (DER) such as photovoltaics, electric vehicles (EVs) and battery energy storage systems (BESS) is expected to rapidly increase in distribution systems in India. These grid edge resources can have adverse impacts on the grid and can provide additional revenue streams as well. To mitigate these impacts distribution planning and analysis is required. So this paper presents a framework which can be used to complete all steps involved in distribution planning and analysis. This framework uses data in the same format as is readily available with Indian utilities and processes it to generate detailed feeder models and loading profiles. This framework already includes multiple DER use cases such as peak shaving for BESS and EV demand modelling and can be easily extended to simulate a number of additional use cases. All of these use cases can be simulated in parallel for multi-year time series simulations using an integrated command line interface. A suit of grid readiness metrics are then evaluated for each simulation to determine required network upgrades and associated costs.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Approaches for Autonomous Peer to Peer Communication: For Resilient Community Microgrids

The final phase of the Islandable Communications task of the SECURE project consisted of integrating the islandable communications network into a microgrid simulation at NREL. Initially integration was planned for a microgrid implemented as a mix of simulation and physical hardware. As the project evolved, the microgrid became fully simulated. The simulation environment was structured to break out the communication paths that would pass over a communication network in a field demonstration. The Islandable Communication network was integrated into the simulation environment, allowing both a commercial cellular carrier and a Private LTE network to be evaluated. The microgrid simulation showed differences in performance and behavior when operating over the wireless networks (compared to operating over wired Ethernet in the lab). These differences point to further research opportunities to better understand how microgrid communication carried over real-world or impaired networks affects the microgrid system behavior.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A COMPARATIVE STUDY OF DENSITY FIELD ESTIMATION FOR GALAXIES: NEW INSIGHTS INTO THE EVOLUTION OF GALAXIES WITH ENVIRONMENT IN COSMOS OUT TO z ∼ 3

It is well-known that a galaxy’s environment has a fundamental influence in shaping its properties. We study the environmental effects on galaxy evolution, with an emphasis on the environment defined as the local number density of galaxies. The density field is estimated with different estimators (weighted adaptive kernel smoothing, 10th and 5th nearest neighbors, Voronoi and Delaunay tessellation) for a K{sub s} < 24 sample of ∼190,000 galaxies in the COSMOS field at 0.1 < z < 3.1. The performance of each estimator is evaluated with extensive simulations. We show that overall there is a good agreement between the estimated density fields using different methods over ∼2 dex in overdensity values. However, our simulations show that adaptive kernel and Voronoi tessellation outperform other methods. Using the Voronoi tessellation method, we assign surface densities to a mass complete sample of quiescent and star-forming galaxies out to z ∼ 3. We show that at a fixed stellar mass, the median color of quiescent galaxies does not depend on their host environment out to z ∼ 3. We find that the number and stellar mass density of massive (>10{sup 11} M{sub ⊙}) star-forming galaxies have not significantly changed since z ∼ 3, regardless of their environment. However, for massive quiescent systems at lower redshifts (z ≲ 1.3), we find a significant evolution in the number and stellar mass densities in denser environments compared to lower density regions. Our results suggest that the relation between stellar mass and local density is more fundamental than the color–density relation and that environment plays a significant role in quenching star-formation activity in galaxies at z ≲ 1.

79 ASTRONOMY AND ASTROPHYSICS↗

Earth System Model Aerosol–Cloud Diagnostics (ESMAC Diags) package, version 2: assessing aerosols, clouds, and aerosol–cloud interactions via field campaign and long-term observations

Abstract. Poor representations of aerosols, clouds, and aerosol–cloud interactions (ACIs) in Earth system models (ESMs) have long been the largest uncertainties in predicting global climate change. Huge efforts have been made to improve the representation of these processes in ESMs, and the key to these efforts is the evaluation of ESM simulations with observations. Most well-established ESM diagnostics packages focus on the climatological features; however, they lack process-level understanding and representations of aerosols, clouds, and ACIs. In this study, we developed the Earth System Model Aerosol–Cloud Diagnostics (ESMAC Diags) package to facilitate the routine evaluation of aerosols, clouds, and ACIs simulated the Energy Exascale Earth System Model (E3SM) from the US Department of Energy (DOE). This paper documents its version 2 functionality (ESMAC Diags v2), which has substantial updates compared with version 1 (Tang et al., 2022a). The simulated aerosol and cloud properties have been extensively compared with in situ and remote-sensing measurements from aircraft, ship, surface, and satellite platforms in ESMAC Diags v2. It currently includes six field campaigns and two permanent sites covering four geographical regions: the eastern North Atlantic, the central US, the northeastern Pacific, and the Southern Ocean. These regions produce frequent liquid- or mixed-phase clouds, with extensive measurements available from the DOE Atmospheric Radiation Measurement user facility and other agencies. ESMAC Diags v2 generates various types of single-variable and multivariable diagnostics, including percentiles, histograms, joint histograms, and heatmaps, to evaluate the model representation of aerosols, clouds, and ACIs. Select examples highlighting the capabilities of ESMAC Diags are shown using E3SM version 2 (E3SMv2). In general, E3SMv2 can reasonably reproduce many observed aerosol and cloud properties, with biases in some variables such as aerosol particle and cloud droplet sizes and number concentrations. The coupling of aerosol and cloud number concentrations may be too strong in E3SMv2, possibly indicating a bias in processes that control aerosol activation. Furthermore, the liquid water path response to a perturbed cloud droplet number concentration behaves differently in E3SMv2 and observations, which warrants further study to improve the cloud microphysics parameterizations in E3SMv2.

54 ENVIRONMENTAL SCIENCES↗

A Versatile Simulated Data Transport Layer for in Situ Workflows Performance Evaluation

In situ processing does not only allow scientific applications to face the explosion in data volume and velocity but also to address the time constraints of many simulation-analysis workflows by providing scientists with early insights about their applications at runtime. Multiple frameworks implement the concept of a data transport layer (DTL) to enable such in situ workflows. These tools are very versatile, directly or indirectly access the data generated on the same node, another node of the same compute cluster, or a completely distinct node, and allow data publishers and subscribers to run on the same computing resources or not. This versatility puts on researchers the onus of taking key decisions related to resource allocation and how to transport data to ensure the most efficient execution of their in situ workflows. However, domain scientists and workflow practitioners lack the appropriate tools to assess the respective performance of particular design and deployment options. In this paper we introduce a versatile simulated DTL designed to provide researchers with insights on the respective performance of different execution scenarios of in situ workflows. This open-source, standalone library builds on the SimGrid toolkit and can be linked to any SimGrid-based simulator. It facilitates the evaluation of the performance behavior, at scale, of different data transport configurations and the study of the effects of resource allocation strategies. We demonstrate the scalability, versatility, and accuracy of this simulated DTL by reproducing the execution of two synthetic benchmarks and of a real-world in situ workflow composed of an MPI application and a parallel data analysis. Results of simulations run on a single core show that the proposed library can simulate the interactions of tens of thousands of simulated processes deployed on two interconnected commodity clusters in a few seconds, and the execution by a thousand simulated processes of an in situ workflow in less than three minutes.

Suter, Fred [ORNL] (ORCID:0000000319021955)↗