Search NASA⌕ Search

SEARCH · Search NASA

Results for “simulation evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
NASA NTRS2008

Application of the NASA A-Train to Evaluate Clouds Simulated by the Weather Research and Forecast Model

The CloudSat Mission, part of the NASA A-Train, is providing the first global survey of cloud profiles and cloud physical properties, observing seasonal and geographical variations that are pertinent to evaluating the way clouds are parameterized in weather and climate forecast models. CloudSat measures the vertical structure of clouds and precipitation from space through the Cloud Profiling Radar (CPR), a 94 GHz nadir-looking radar measuring the power backscattered by clouds as a function of distance from the radar. One of the goals of the CloudSat mission is to evaluate the representation of clouds in forecast models, thereby contributing to improved predictions of weather, climate and the cloud-climate feedback problem. This paper highlights potential limitations in cloud microphysical schemes currently employed in the Weather Research and Forecast (WRF) modeling system. The horizontal and vertical structure of explicitly simulated cloud fields produced by the WRF model at 4-km resolution are being evaluated using CloudSat observations in concert with products derived from MODIS and AIRS. A radiative transfer model is used to produce simulated profiles of radar reflectivity given WRF input profiles of hydrometeor mixing ratios and ambient atmospheric conditions. The preliminary results presented in the paper will compare simulated and observed reflectivity fields corresponding to horizontal and vertical cloud structures associated with midlatitude cyclone events.

Molthan, Andrew L.↗
DOE OSTI2022

Advanced Terrestrial Simulator (ATS) evaluation dataset at 7 catchments across the continental United States

This dataset comprises of the input files and other files required for Advanced Terrestrial Simulator (ATS) simulations at 7 catchments across the continental United States. ATS is an integrated surface-subsurface hydrology model. We include Jupyter notebooks (within scripts folder) for individual catchments showing information (including data sources, river network, soil, geology, landuse types etc.) on preparing the machine readable input files. ATS observation output files are provided in the output folder. Figures and analyses (.xlsx sheets) are also provided. The catchments include, Taylor River Upstream (Colorado); (b) Cossatot River (Arkansas); (c) Panther Creek (Alabama); (d) Little Tennessee River (North Carolina and Georgia); (e) Mayo River (Virginia); (f) Flat Brook (New Jersey); (g) Neversink River headwaters (New York). Readme files are provided inside the directories providing more details. Files types include: .xml, .h5, .xlsx, .png, .ipynb, .py, .nc, .txt. All of the files types can be accessed by open source software, details on software requirements are following: .xml (any text editors including notepad and textedit), .h5 (in python using hdf libraries), .xlsx (WPS Office Spreadsheets, OpenOffice Calc, LibreOffice Calc, Microsoft Office etc.), .png (any image viewer), .ipynb (Jupyter notebook), .py (any text editors including notepad and textedit), .nc (using python or other open source software).

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2016

B33C-0612: Evaluation of Simulated Biospheric Carbon Dioxide Fluxes and Atmospheric Concentrations Using Global in Situ Observations

Atmospheric mixing ratios of carbon dioxide (CO2) are largely controlled by anthropogenic emission sources and biospheric sources/sinks. Global biospheric fluxes of CO2 are controlled by complex processes facilitating the exchange of carbon between terrestrial ecosystems and the atmosphere. These processes which play a key role in these terrestrial ecosystem-atmosphere carbon exchanges are currently not fully understood, resulting in large uncertainties in the quantification of biospheric CO2 fluxes. Current models with these inherent deficiencies have difficulties simulating the global carbon cycle with high accuracy. We are developing a new modeling platform, GEOS-Chem-CASA by integrating the year-specific NASA-CASA (National Aeronautics and Space Administration - Carnegie Ames Stanford Approach) biosphere model with the GEOS-Chem (Goddard Earth Observation System-Chemistry) chemical transport model to improve the simulation of atmosphere-terrestrial ecosystem carbon exchange. We use NASA-CASA to explicitly represent the exchange of CO2 between terrestrial ecosystem and atmosphere by replacing the baseline GEOS-Chem land net CO2 flux and forest biomass burning CO2 emissions. We will present the estimation and evaluation of these "bottom-up" land CO2 fluxes, simulated atmospheric mixing ratios, and forest disturbance changes over the last decade. In addition, we will present our initial comparison of atmospheric column-mean dry air mole fraction of CO2 predicted by the model and those retrieved from NASA's OCO-2 (Orbiting Carbon Observatory-2) satellite instrument and model-predicted surface CO2 mixing ratios with global in situ observations. This evaluation is the first step necessary for our future work planned to constrain the estimates of biospheric carbon fluxes through "top-down" inverse modeling, which will improve our understanding of the processes controlling atmosphere-terrestrial ecosystem greenhouse gas exchanges, especially over regions which lack in situ observations.

in situ observations↗
NASA NTRS1984

A comparative evaluation of simulated SPOT, Thematic Mapper, and simulated Thematic Mapper data in a western ecozone

Spectral information content was quantitatively measured for simulated SPOT, Thematic Mapper, and simulated Thematic Mapper data acquired over Santa Cruz County, California. Two techniques were employed: spectral separability summarized through optimal wave band evaluation, and histogram cluster analysis. Using data from the three sources it is shown that three spectral bands can provide separability nearly as high as six bands provide, if the three bands are optimally chosen for the cover type. Analysis of the Santa Cruz scene emphasizes the importance of TM bands 1 and 5 in particular. The three bands of the SPOT scanner are shown to provide sufficient separability for cover types within the study area. The higher spatial resolution data (20 meters) provided by SPOT contain more distinct distributions than data from the other sources studied. Techniques should be developed to exploit this additional information.

Buis, J. S.↗
NASA NTRS1983

Simulation and evaluation of the Sh-2F helicopter in a shipboard environment using the interchangeable cab system

The operation of the SH-2F helicopter from the decks of small ships in adverse weather was simulated using a large amplitude vertical motion simulator, a wide angle computer generated imagery visual system, and an interchangeable cab (ICAB). The simulation facility, the mathematical programs, and the validation method used to ensure simulation fidelity are described. The results show the simulator to be a useful tool in simulating the ship-landing problem. Characteristics of the ICAB system and ways in which the simulation can be improved are presented.

Paulk, C. H., Jr.↗
NASA NTRS1992

Visual cues in flight simulation - An evaluation of stereo effectiveness

The purpose of the present study was to quantify the effects of visual scene information on precision hovering tasks under biocular and stereo viewing conditions in a rotorcraft helmet-mounted display simulator. Four NASA test pilots performed a series of precision hover maneuvers in the context of three different scene contents, two ground textures, and three levels of control configuration difficulty. The results revealed that vertical position variability was greatest when vertical cues were absent, and that patterned ground texture aided hover stability only when other position-reference cues were absent from the scene. The stereo viewing condition showed no uniform advantages over the biocular condition. The results are discussed in terms of their implications for simulator design and qualification.

Johnson, Walter W.↗
NASA NTRS2000

A simulator for evaluating methods for the detection of lesion-deficit associations

Although much has been learned about the functional organization of the human brain through lesion-deficit analysis, the variety of statistical and image-processing methods developed for this purpose precludes a closed-form analysis of the statistical power of these systems. Therefore, we developed a lesion-deficit simulator (LDS), which generates artificial subjects, each of which consists of a set of functional deficits, and a brain image with lesions; the deficits and lesions conform to predefined distributions. We used probability distributions to model the number, sizes, and spatial distribution of lesions, to model the structure-function associations, and to model registration error. We used the LDS to evaluate, as examples, the effects of the complexities and strengths of lesion-deficit associations, and of registration error, on the power of lesion-deficit analysis. We measured the numbers of recovered associations from these simulated data, as a function of the number of subjects analyzed, the strengths and number of associations in the statistical model, the number of structures associated with a particular function, and the prior probabilities of structures being abnormal. The number of subjects required to recover the simulated lesion-deficit associations was found to have an inverse relationship to the strength of associations, and to the smallest probability in the structure-function model. The number of structures associated with a particular function (i.e., the complexity of associations) had a much greater effect on the performance of the analysis method than did the total number of associations. We also found that registration error of 5 mm or less reduces the number of associations discovered by approximately 13% compared to perfect registration. The LDS provides a flexible framework for evaluating many aspects of lesion-deficit analysis.

NASA Program Biomedical Research and Countermeasur↗
DOE OSTI2020

Evaluation of simulated soil carbon dynamics in Arctic-Boreal ecosystems

Given the magnitude of soil carbon stocks in northern ecosystems, and the vulnerability of these stocks to climate warming, land surface models must accurately represent soil carbon dynamics in these regions. We evaluate soil carbon stocks and turnover rates, and the relationship between soil carbon loss with soil temperature and moisture, from an ensemble of eleven global land surface models. We focus on the region of NASA's Arctic-Boreal vulnerability experiment (ABoVE) in North America to inform data collection and model development efforts. Models exhibit an order of magnitude difference in estimates of current total soil carbon stocks, generally under- or overestimating the size of current soil carbon stocks by greater than 50 PgC. We find that a model's soil carbon stock at steady-state in 1901 is the prime driver of its soil carbon stock a hundred years later—overwhelming the effect of environmental forcing factors like climate. The greatest divergence between modeled and observed soil carbon stocks is in regions dominated by peat and permafrost soils, suggesting that models are failing to capture the frozen soil carbon dynamics of permafrost regions. Using a set of functional benchmarks to test the simulated relationship of soil respiration to both soil temperature and moisture, we find that although models capture the observed shape of the soil moisture response of respiration, almost half of the models examined show temperature sensitivities, or Q10 values, that are half of observed. Significantly, models that perform better against observational constraints of respiration or carbon stock size do not necessarily perform well in terms of their functional response to key climatic factors like changing temperature. This suggests that models may be arriving at the right result, but for the wrong reason. The results of this work can help to bridge the gap between data and models by both pointing to the need to constrain initial carbon pool sizes, as well as highlighting the importance of incorporating functional benchmarks into ongoing, mechanistic modeling activities such as those included in ABoVE.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1980

Simulation and evaluation of latent heat thermal energy storage

The relative value of thermal energy storage (TES) for heat pump storage (heating and cooling) as a function of storage temperature, mode of storage (hotside or coldside), geographic locations, and utility time of use rate structures were derived. Computer models used to simulate the performance of a number of TES/heat pump configurations are described. The models are based on existing performance data of heat pump components, available building thermal load computational procedures, and generalized TES subsystem design. Life cycle costs computed for each site, configuration, and rate structure are discussed.

Sigmon, T. W.↗
DOE OSTI2019

Evaluating the simulated mean soil carbon transit times by Earth system models using observations

One known bias in current Earth system models (ESMs) is the underestimation of global mean soil carbon (C) transit time ( τ soil ), which quantifies the age of the C atoms at the time they leave the soil. However, it remains unclear where such underestimations are located globally. Here, we constructed a global database of measured τ soil across 187 sites to evaluate results from 12 ESMs. The observations showed that the estimated τ soil was dramatically shorter from the soil incubation studies in the laboratory environment (median = 4 years; interquartile range = 1 to 25 years) than that derived from field in situ measurements (31; 5 to 84 years) with shifts in stable isotopic C( 13 C ) or the stock-over-flux approach. In comparison with the field observations, the multi-model ensemble simulated a shorter median (19 years) anda smaller spatial variation (6 to 29 years) of τ soil across the same site locations. We then found a significant and negative linear correlation between the in situ measured τ soil and mean annual air temperature. The underestimations of modeled τ soil are mainly located in cold and dry biomes, especially tundra and desert.Furthermore, we showed that one ESM (i.e., CESM) has improved its τ soil estimate by incorporation of the soil vertical profile. These findings indicate that the spatial variation of τ soil is a useful benchmark for ESMs, and we recommend more observations and modeling efforts on soil C dynamics in regions limited by temperature and moisture.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRSDate not supplied

In-Depth Analysis of Subject Functional Performance and Subjective Feedback Data for Evaluating Argos Simulation Quality

Mechanical offloading systems such as the Active Response Gravity Offload System (ARGOS) at NASA Johnson Space Center (JSC) are used to simulate various partial gravity environments. ARGOS offloads pressurized suited subjects through a gimbaling pivot point system attached to a volumetric Portable Life Support System (PLSS). The pivot point can be configured to multiple locations with respect to the human-suit system center of gravity (CG). Previous work has tested and documented the interaction between different pivot point locations and measured CG. Observations indicated that small changes in pivot point location substantially affect the stability and functional performance (simulation quality) of a subject. This led to the development of a standardized gimbal assessment protocol to assess the functional performance of a pressurized suited subject as a function of the pivot point location, using the data obtained from a variety of planetary suit mobility tasks. As a result, an expansive repository of CG-related task metrics was generated from numerous ARGOS spacesuit test events, for different gimbal configurations and different test subjects. Based on the evaluation metrics and observed trends, several pivot point locations were iteratively identified to determine an “appropriate/optimal” configuration. This study thus describes the in-depth analysis of the CG evaluation metrics to better quantify trends and determine if specific factors are strongly associated with appropriate/optimal configurations. Quantitative and qualitative variables relating to subject task performance, subjective feedback, and anthropometry will be evaluated via probabilistic methods. The results from this study are expected to improve our understanding of optimal ARGOS gimbal settings, which will better inform the gimbal configuration identification process and improve simulation quality for extravehicular activity (EVA) training.

Joseph Yao↗
DOE OSTI2022

Non-equilibrium molecular dynamics simulation to evaluate the effect of confinement on fluid flow in silica nanopores

The flow of fluids in nano-confinement has applications in separations, water purification, medical systems and in the recovery of fluids in petroleum systems. It is believed that fluids do not obey continuum laws when flowing in nanopores (or in confinement). This paper attempts to shed light on various nano confinement effects such as fluid-wall interactions, pore size and molecular geometry, using molecular dynamic simulation. Here, water, hexane, and methanol flow behaviors were simulated for pore diameters ranging from 1 to 8 nm. In addition to the density analysis of the confined fluids, the fluid flows in saturated nanopores were simulated by the sectional flow method. Water and methanol molecules were completely stabilized in the 1 nm pore. Hexane molecules could not enter the 1 nm pore, due to geometric considerations. For the 2 – 8 nm pores, all fluids showed reduced flow rate compared to the Hagen–Poiseuille flow, due to an interfacial molecular layer stabilized at the pore surface. Flow reduction observed in these studies is contrary to significant flow enhancements observed for fluid flow in carbon nanotubes of similar dimensions. Water flow showed almost constant stick length for all the pore sizes. Methanol flow had the largest stick length. Hexane flow was reduced because of overcrowding of molecules at the pore surface. The effect of confinement diminished with an increase in pore diameter.

42 ENGINEERING↗
DOE OSTI2024

Method for Coupled Electromagnetic and Circuit Simulations to Evaluate Surge Arrester Performance in Protecting Equipment Against E1 HEMP

Surge arrester behavioral modeling for realistic systems embedded in an E1 high-altitude electromagnetic pulse environment inherently encompasses three interconnected complications: (1) the need to account for signal propagation across two domains, electromagnetics and electrical; (2) the need to include both linear and nonlinear circuit components in the analysis; and (3) the need to understand that the over-current and over-voltage mitigation performance is dependent not only on the properties of the surge arrester and protected load but also on the topology of the overall electrical network. This study presents a framework to address these challenges in a systematic manner to consider the effectiveness of protective measures for a common class of equipment in power generation facilities. Full-wave simulations were carried out to derive circuit-domain (i.e., lumped element–based) equivalent models for the excitation waveform and the physical components of the system. Then, these equivalent models were imported to a circuit solver and combined with a high-frequency surge arrester model to evaluate mitigation performance. The methodology outlined is general enough such that it can be applied for other electromagnetic interference problems that involve E2/E3 HEMP or microwave emissions.

42 ENGINEERING↗
NASA NTRS2011

Piloted Simulation to Evaluate the Utility of a Real Time Envelope Protection System for Mitigating In-Flight Icing Hazards

The utility of the Icing Contamination Envelope Protection (ICEPro) system for mitigating a potentially hazardous icing condition was evaluated by 29 pilots using the NASA Ice Contamination Effects Flight Training Device (ICEFTD). ICEPro provides real time envelope protection cues and alerting messages on pilot displays. The pilots participating in this test were divided into two groups; a control group using baseline displays without ICEPro, and an experimental group using ICEPro driven display cueing. Each group flew identical precision approach and missed approach procedures with a simulated failure case icing condition. Pilot performance, workload, and survey questionnaires were collected for both groups of pilots. Results showed that real time assessment cues were effective in reducing the number of potentially hazardous upset events and in lessening exposure to loss of control following an incipient upset condition. Pilot workload with the added ICEPro displays was not measurably affected, but pilot opinion surveys showed that real time cueing greatly improved their situation awareness of a hazardous aircraft state.

Ranaudo, Richard J.↗
DOE OSTI2025

Evaluation of E3SM Simulated Aerosols and Aerosol‐Cloud Interactions Across GCM and Convection‐Permitting Scales

This paper introduces an Earth system modeling testbed for predicting aerosols and aerosol‐cloud interactions (ACIs) at convection‐permitting scales. Using the Energy Exascale Earth System Model (E3SM) version 2 with a four‐mode Modal Aerosol Module, we conduct simulations at 3.25 km resolution on a regionally refined mesh (RRM) across four regions with distinct aerosol and cloud regimes. Results are compared with the standard 100 km E3SM configuration and evaluated against satellite, aircraft, and ground‐based observations. We find that increasing model resolution improves heavy precipitation simulation but amplifies positive bias in light drizzle at coarse resolution. These resolution‐induced changes affect cloud and aerosol properties to varying degrees across regions. Generally, cloud cover and liquid water path (LWP) show better agreement with satellite retrievals at 3.25 km, though surface‐based comparisons suggest otherwise. Aerosol composition remains poorly represented at both resolutions. The RRM increases Aitken mode aerosol number concentrations via enhanced new particle formation. However, accumulation mode aerosols are decreased at higher resolution as aerosol removals become more efficient. This partially contributes to fewer cloud condensation nuclei (CCN) and lower cloud droplet number concentrations (N d ), which produces larger model biases in some scenarios. These findings suggest that solely increasing horizontal resolution to kilometer scales is insufficient to broadly improve aerosol and cloud predictions without concurrent advancements in physical and chemical process representations. Nonetheless, the RRM moderately improves key ACI relationships such as CCN‐N d correlation, reflecting enhanced aerosol activation representation. The LWP‐N d relationship is also better captured by RRM, suggesting a better characterization of LWP adjustment.

Huang, Meng [Pacific Northwest National Laboratory↗
NASA NTRS1976

Computer simulation and evaluation of edge detection algorithms and their application to automatic path selection

The construction of an autonomous roving vehicle requires the development of complex data-acquisition and processing systems, which determine the path along which the vehicle travels. Thus, a vehicle must possess algorithms which can (1) reliably detect obstacles by processing sensor data, (2) maintain a constantly updated model of its surroundings, and (3) direct its immediate actions to further a long range plan. The first function consisted of obstacle recognition. Obstacles may be identified by the use of edge detection techniques. Therefore, the Kalman Filter was implemented as part of a large scale computer simulation of the Mars Rover. The second function consisted of modeling the environment. The obstacle must be reconstructed from its edges, and the vast amount of data must be organized in a readily retrievable form. Therefore, a Terrain Modeller was developed which assembled and maintained a rectangular grid map of the planet. The third function consisted of directing the vehicle's actions.

Longendorfer, B. A.↗
DOE OSTI2020

Simulating and Evaluating Atmospheric River-Induced Precipitation Extremes Along the U.S. Pacific Coast: Case Studies From 1980–2017

Atmospheric rivers (ARs) are responsible for a majority of extreme precipitation and floodevents along the U.S. West Coast. To better understand the present-day characteristics of AR-relatedprecipitation extremes, a selection of nine most intense historical AR events during 1980–2017 is simulatedusing a dynamical downscaling modeling framework based on the Weather Research and ForecastingModel. We find that the chosen framework and Weather Research and Forecasting Model configurationreproduces both large-scale atmospheric features—including parent synoptic-scale cyclones—as well asthe filamentary corridors of integrated vapor transport associated with the ARs themselves. The accuracyof simulated extreme precipitation maxima, relative to in situ and interpolated gridded observations,improves notably with increasing model resolution, with improvements as large as 40–60% for fine scale(3 km) relative to coarse-scale (27 km) simulations. A separate set of simulations using smoothedtopography suggests that much of these gains stem from the improved representation of complex terrain.Additionally, using the 12 December 1995 storm in Northern California as an example, we demonstratethat only the highest-resolution simulations resolve important fine-scale features—such as localizedorographically forced vertical motion and powerful near hurricane-force boundary layer winds. Given thedemonstrated ability of a targeted dynamical downscaling framework to capture both local extremeprecipitation and key fine-scale characteristics of the most intense ARs in the historical record, we arguethat such a configuration may be highly conducive to understanding AR-related extremes and associatedchanges in a warming climate

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2016

Testbed and Simulation-based Evaluation of Privacy-preserving Algorithms for Smart Grid AMI Networks

Although smart meters are deployed in a lot of countries as a result of aiming to make the power grid more resilient and efficient, the data collection process from smart meters in Smart Grid (SG) has still challenges that relate to consumer privacy. Referred to as Advanced Metering Infrastructure (AMI), the data collected and transmitted through this AMI can leak sensitive information about the consumers if it is sent as plaintext. While a number of solutions have been proposed in the past, the deployment of these solutions in real-life was not possible since the actual AMIs were not accessible to researchers. Therefore, a lot of solutions relied on simulations which may not be able to capture the performance of these solutions. In this paper, we pick a widely used homomorphic-based aggregation and implement it in a realistic testbed so that it can be compared with a simulation-based solution. Specifically, we develop a system that provides privacy with the Paillier cryptosystem and twofactor authentication with ECDSA and OpenSSL certificates. In order to test the system, an IEEE 802.11s-based SG AMI network testbed is constructed with Beaglebone Black boards that imitate the behavior of smart meters. The same network is also simulated in widely used ns-3. The results showed that ns-3 simulation and testbed results are parallel in most cases and the proposed system can perform effectively. However, there are still many differences that need to be taken into account in deploying real systems.

97 MATHEMATICS AND COMPUTING↗