Search NASA⌕ Search

SEARCH · Search NASA

Results for “simulation evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 775 records · Page 43
All sourcesNASA NTRSDOE OSTI
NASA NTRS2012

Framework for Architecture Trade Study Using MBSE and Performance Simulation

Increasing complexity in modern systems as well as cost and schedule constraints require a new paradigm of system engineering to fulfill stakeholder needs. Challenges facing efficient trade studies include poor tool interoperability, lack of simulation coordination (design parameters) and requirements flowdown. A recent trend toward Model Based System Engineering (MBSE) includes flexible architecture definition, program documentation, requirements traceability and system engineering reuse. As a new domain MBSE still lacks governing standards and commonly accepted frameworks. This paper proposes a framework for efficient architecture definition using MBSE in conjunction with Domain Specific simulation to evaluate trade studies. A general framework is provided followed with a specific example including a method for designing a trade study, defining candidate architectures, planning simulations to fulfill requirements and finally a weighted decision analysis to optimize system objectives.

Ryan, Jessica↗
DOE OSTI2022

Evaluation of Turbulence and Dispersion in Multiscale Atmospheric Simulations over Complex Urban Terrain during the Joint Urban 2003 Field Campaign

Abstract This paper evaluates the representation of turbulence and its effect on transport and dispersion within multiscale and microscale-only simulations in an urban environment. These simulations, run using the Weather Research and Forecasting Model with the addition of an immersed boundary method, predict transport and mixing during a controlled tracer release from the Joint Urban 2003 field campaign in Oklahoma City, Oklahoma. This work extends the results of a recent study through analysis of turbulence kinetic energy and turbulence spectra and their role in accurately simulating wind speed, direction, and tracer concentration. The significance and role of surface heat fluxes and use of the cell perturbation method in the numerical simulation setup are also examined. Our previous study detailed the model development necessary for our multiscale simulations, examined model skill at predicting wind speeds and tracer concentrations, and demonstrated that dynamic downscaling from mesoscale to microscale through a sequence of nested simulations can improve predictions of transport and dispersion relative to a microscale-only simulation forced by idealized meteorology. Here, predictions are compared with observations to assess qualitative agreement and statistical model skill at predicting wind speed, wind direction, tracer concentration, and turbulent kinetic energy at locations throughout the city. We also investigate the scale distribution of turbulence and the associated impact on model skill, particularly for predictions of transport and dispersion. Our results show that downscaled large-scale turbulence, which is unique to the multiscale simulations, significantly improves predictions of tracer concentrations in this complex urban environment. Significance Statement Simulations of atmospheric transport and mixing in urban environments have many applications, including pollution modeling for urban planning or informing emergency response following a hazardous release. These applications include phenomena with spatial scales spanning from millimeters to kilometers. Most simulations resolve flow only within the urban area of interest, omitting larger scales of turbulence and regional influences. This study examines a method that resolves both the small and large-scale flow features. We evaluate simulation accuracy by comparing predictions with observations from an experiment involving the release of a tracer gas in Oklahoma City, Oklahoma, with emphasis on correctly modeling turbulent fluctuations. Our results demonstrate the importance of resolving large-scale flow features when predicting transport and dispersion in urban environments.

42 ENGINEERING↗
DOE OSTI2016

Trans-Pacific transport and evolution of aerosols: Evaluation of quasi-global WRF-Chem simulation with multiple observations

A fully coupled meteorology-chemistry model (WRF-Chem, the Weather Research and Forecasting model coupled with chemistry) has been configured to conduct quasi-global simulation for 5 years (2010–2014) and evaluated with multiple observation data sets for the first time. The evaluation focuses on the simulation over the trans-Pacific transport region using various reanalysis and observational data sets for meteorological fields and aerosol properties. The simulation generally captures the overall spatial and seasonal variability of satellite retrieved aerosol optical depth (AOD) and absorbing AOD (AAOD) over the Pacific that is determined by the outflow of pollutants and dust and the emissions of marine aerosols. The assessment of simulated extinction Ångström exponent (EAE) indicates that the model generally reproduces the variability of aerosol size distributions as seen by satellites. In addition, the vertical profile of aerosol extinction and its seasonality over the Pacific are also well simulated. The difference between the simulation and satellite retrievals can be mainly attributed to model biases in estimating marine aerosol emissions as well as the satellite sampling and retrieval uncertainties. Compared with the surface measurements over the western USA, the model reasonably simulates the observed magnitude and seasonality of dust, sulfate, and nitrate surface concentrations, but significantly underestimates the peak surface concentrations of carbonaceous aerosol likely due to model biases in the spatial and temporal variability of biomass burning emissions and secondary organic aerosol (SOA) production. A sensitivity simulation shows that the trans-Pacific transported dust, sulfate, and nitrate can make significant contribution to surface concentrations over the rural areas of the western USA, while the peaks of carbonaceous aerosol surface concentrations are dominated by the North American emissions. Both the retrievals and simulation show small interannual variability of aerosol characteristics for 2010–2014 averaged over three Pacific sub-regions. Furthermore, the evaluation in this study demonstrates that the WRF-Chem quasi-global simulation can be used for investigating trans-Pacific transport of aerosols and providing reasonable inflow chemical boundaries for the western USA, allowing one to further understand the impact of transported pollutants on the regional air quality and climate with high-resolution nested regional modeling.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1974

Design analysis and computer-aided performance evaluation of shuttle orbiter electrical power system. Volume 2: SYSTID user's guide

The manual for the use of the computer program SYSTID under the Univac operating system is presented. The computer program is used in the simulation and evaluation of the space shuttle orbiter electric power supply. The models described in the handbook are those which were available in the original versions of SYSTID. The subjects discussed are: (1) program description, (2) input language, (3) node typing, (4) problem submission, and (5) basic and power system SYSTID libraries.

Source record↗
DOE OSTI2018

Tuyere: Enabling Scalable Memory Workloads for System Exploration

Memory technologies are under active development. Meanwhile, workloads on contemporary computing systems are increasing rapidly in size and diversity. Such dynamics in hardware and software further widen the gap between memory system design and performance evaluation. In this work, we propose a data-centric abstraction of high-performance computing applications for fast exploration of new memory technologies. We also provide a framework that uses a formal modeling language to describe the abstraction, automatically translates abstractions into memory traffic, and directly interfaces with cycle-accurate simulators. We evaluated the framework using 20 workloads and validated the memory traffic profile, the simulation results, and the relative memory changes of four memory technologies. Our results show that the data-centric abstraction can accurately capture application behavior adaptable to different input problems and can expedite system exploration.

Peng, Ivy Bo↗
DOE OSTI2020

Design for Additive Manufacturing: Exploring Remelt Strategies to Tailor Density and Microstructure

The potential advantages of AM (e.g. weight reduction, novel geometries) are well understood within a systems context. However, adoption of AM at the system level has been slow due to the relative uncertainty in the final material properties, which leaves capabilities and/or performance gains unrealized. Utilizing remelt strategies it may be possible to expand the available process window to provide densities and microstructures beyond what is capable with standard scan strategies. This work explored remelting strategies for 316L stainless steel to tailor grain size and increase density. Twelve scan strategies were explored experimentally and computationally to understand the limitations of remelt strategies and the robustness of the current simulation package. Results show tailoring of grain size, density, and texture is achievable through remelting and several key lessons learned were made to improve the texture evaluation through simulation.

36 MATERIALS SCIENCE↗
NASA NTRS2012

Development of Carbon Dioxide Removal Systems for Advanced Exploration Systems

"NASA's Advanced Exploration Systems (AES) program is pioneering new approaches for rapidly developing prototype systems, demonstrating key capabilities, and validating operational concepts for future human missions beyond Earth orbit" (NASA 2012). These forays beyond the confines of earth's gravity will place unprecedented demands on launch systems. They must not only blast out of earth's gravity well as during the Apollo moon missions, but also launch the supplies needed to sustain a crew over longer periods for exploration missions beyond earth's moon. Thus all spacecraft systems, including those for the separation of metabolic carbon dioxide and water from a crewed vehicle, must be minimized with respect to mass, power, and volume. Emphasis is also placed on system robustness both to minimize replacement parts and ensure crew safety when a quick return to earth is not possible. Current efforts are focused on improving the current state-of-the-art systems utilizing fixed beds of sorbent pellets by seeking more robust pelletized sorbents, evaluating structured sorbents, and examining alternate bed configurations to improve system efficiency and reliability. These development efforts combine testing of sub-scale systems and multi-physics computer simulations to evaluate candidate approaches, select the best performing options, and optimize the configuration of the selected approach, which is then implemented in a full-scale integrated atmosphere revitalization test. This paper describes the carbon dioxide (CO2) removal hardware design and sorbent screening and characterization effort in support of the Atmosphere Resource Recovery and Environmental Monitoring (ARREM) project within the AES program. A companion paper discusses development of atmosphere revitalization models and simulations for this project.

Knox, James C.↗
DOE OSTI2022

Simulation-guided analysis of resonant soft X-ray scattering for determining the microstructure of triblock copolymers

Resonant soft X-ray scattering (RSoXS) probes structure with chemical sensitivity that is useful for determining the morphology of multiblock copolymers. However, the hyperspectral scattering data produced by this technique can be challenging to interpret. Here, in this study, we use computational scattering simulations to extract the microstructure of a model triblock copolymer from the energy-dependent scattering from RSoXS. An ABC triblock terpolymer formed from poly(4-methylcaprolactone) (P4MCL), poly(2,2,2-trifluoroethylacrylate) (PTFEA), and poly (dodecylacrylate) (PDDA), P4MCL-block-PTFEA-block-PDDA, was synthesized as the model triblock system. Through quantitative evaluation of simulated scattering data from a physics-informed set of candidate structure models against experimental RSoXS data, we find the best agreement with hexagonally packed core–shell cylinders. This result is also consistent with electron-density reconstruction from hard X-ray scattering data evaluated against electron-density maps generated with the same model set. These results demonstrate the utility of simulation-guided scattering analysis to study complex microstructures that are challenging to image by microscopy.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

ENSO Diversity and the Simulation of Its Teleconnections to Winter Precipitation Extremes Over the US in High Resolution Earth System Models

Abstract Accounting for the diversity in El Niño Southern Oscillation (ENSO)'s spatial pattern, with the novel ENSO longitudinal index (ELI), we evaluate the simulation of its teleconnections to US winter precipitation extremes by seven global high‐resolution (HR) Earth System Models (ESM). Six (four) HR ESMs simulate the observed increase in precipitation extremes over Southwest US (Southeast US) during ELI‐defined El Niño events better than their low‐resolution counterparts, which are low‐biased. The stronger ENSO‐dependence over the Southwest US and Southeast US in those models is associated with an improved simulation of moisture flux into the regions and/or storm track activity there. HR ESMs, however, generally overestimate the increase in precipitation extremes over the Pacific‐Northwest during La Niña events. Model bias there is associated with bias in moisture transport into the region during La Niña events, which is amplified by the enhanced vertical mass fluxes in HR.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1989

Performance evaluations of oxidation-resistant carbon-carbon composites in simulated hypersonic vehicle environments

An evaluation is made of the oxidation-protection requirements of carbon-carbon composite (CCC) structural components in a hypersonic vehicle aerothermodynamic environment, where maximum test temperatures in air are of the order of 2800 F, and pressures range from 0.03 to 1.0 atm. The specimens were exposed to high humidity between tests. Attention was given to the effects of coating composition and thickness, and of substrate architecture and surface preparation, on the oxidation resistance of CCCs. Both surface preparation and coating chemistry have a profound effect on coating adherence and longevity.

Barrett, D. M.↗
DOE OSTI2021

Dynamic Building Load Control to Facilitate High Penetration of Solar Photovoltaic Generation (Final Technical Report)

Solar photovoltaic (PV) resources are the most common form of distributed generation in residential and commercial customer premises within electric distribution networks. A higher penetration of PV generation in distribution circuits will impose challenges on maintaining service voltages within the range of industry standards, power quality, and power flow. Buildings consume 74% of the electricity produced in the United States, and a significant portion of the building load is dispatchable, making them responsive to electrical grid needs. Oak Ridge National Laboratory—in collaboration with Southern Company; the University of Tennessee, Knoxville; and the Georgia Institute of Technology—is examining the PV integration issues in distribution-level electrical grids and developing integrated demand-side control and communication systems to enable responsive loads. The proposed responsive loads mechanism performs renewable generation following to increase the penetration of solar PV within each feeder. The specific objectives of this project are to (1) examine distribution-level PV integration scenarios to understand requirements, (2) undertake an end-to-end simulation-based design of a distributed control strategy of loads geographically near the PV generation asset to minimize the effect on the distribution feeder, (3) deploy and demonstrate the control technology developed in partnership with utilities, and (4) perform a scalability analysis at the utility scale. This 3-year integrated project aims to develop, demonstrate, and validate demand-side control technology to enable increased the penetration of renewables while mitigating challenges that arise due to their intermittency. Activities in Budget Period (BP) 1 focused on a literature review and the formal design of a control system for integrating local distribution with generation and loads. The team used modeling and simulation to evaluate the impact of varying buildings loads, variable PV generation, and power flow dynamics on the distribution circuit. The dynamic models developed in BP 1 were used in BP 2 to develop a model-based control design and a test bed. The test bed has enabled the simulation-based testing and comparison of different control designs and formulations applied to different configurations of the distribution grid, PVs, and building loads. The control approaches developed in BP 2 were implemented in BP 3 in the form of hardware deployed at the Central Baptist Church (CBC) in Knoxville, Tennessee, for testing and evaluation. The outcome of this project was the development and demonstration of open-source, low-cost, low-touch sensing and control retrofits to distributed PV generation and building loads that, in a coordinated fashion, provide the load-shaping response needed to integrate high levels of renewable penetration. This research addresses the target metrics by dynamically controlling a load with solar generation variability to minimize the extent of two-way power flow, enhance reliability, facilitate high PV penetration (>100% of peak load in a line segment), and generate scalable software and hardware solutions adaptable to any penetration levels. The research and development activities are focused and designed to be impactful within the relevant 2020 targets time frame.An accurate open-source integration simulation framework for end-to-end control design was developed and deployed at the CBC facility for testing and evaluation. This final report provides a detailed review of the technical results achieved during this 3-year integrated project. A novel spectral analysis of PV data is demonstrated to derive the requirements of the control design. A detailed simulation-based analysis of PV integration at increasing penetration levels is presented using 1 year of PV data to demonstrate the impact on the distribution circuits. Two different control strategies were developed and demonstrated via simulation to track variable PV generation with adaptive load dispatch. The report concludes with a summary of accomplishments and recommendations for a path forward.

14 SOLAR ENERGY↗
DOE OSTI2021

Error Characteristics and Scale Dependence of Current Satellite Precipitation Estimates Products in Hydrological Modeling

Satellite precipitation estimates (SPEs) are promising alternatives to gauge observations for hydrological applications (e.g., streamflow simulation), especially in remote areas with sparse observation networks. However, the existing SPEs products are still biased due to imperfections in retrieval algorithms, data sources and post-processing, which makes the effective use of SPEs a challenge, especially at different spatial and temporal scales. In this study, we used a distributed hydrological model to evaluate the simulated discharge from eight quasi-global SPEs at different spatial scales and explored their potential scale effects of SPEs on a cascade of basins ranging from approximately 100 to 130,000 km 2 . The results indicate that, regardless of the difference in the accuracy of various SPEs, there is indeed a scale effect in their application in discharge simulation. Specifically, when the catchment area is larger than 20,000 km2, the overall performance of discharge simulation emerges an ascending trend with the increase of catchment area due to the river routing and spatial averaging. Whereas below 20,000 km 2 , the discharge simulation capability of the SPEs is more randomized and relies heavily on local precipitation accuracy. Our study also highlights the need to evaluate SPEs or other precipitation products (e.g., merge product or reanalysis data) not only at the limited station scale, but also at a finer scale depending on the practical application requirements. Here we have verified that the existing SPEs are scale-dependent in hydrological simulation, and they are not enough to be directly used in very fine scale distributed hydrological simulations (e.g., flash flood). More advanced retrieval algorithms, data sources and bias correction methods are needed to further improve the overall quality of SPEs.

DTVGM↗
DOE OSTI2024

Bimodality in simulated precipitation frequency distributions and its relationship with convective parameterizations

Abstract Bimodality in precipitation frequency distributions is often evident in atmospheric models, but rarely in observations. This study i) proposes a metric to objectively quantify the bimodality in precipitation distributions, ii) evaluates model simulations contributed to the Coupled Model Intercomparison Project (CMIP) phase 5 (CMIP5), phase 6 (CMIP6), and the DYnamics of the Atmospheric general circulation Modeled On Non-hydrostatic Domains (DYAMOND) project by comparing them to satellite-based and reanalysis precipitation products, and iii) investigates possible origins of bimodal precipitation distributions. Our results reveal that about 83% (20 out of 24) of CMIP5 and 70% (21 out of 30) of CMIP6 models used in this study exhibit bimodal distributions. The few DYAMOND models that use a deep convective parameterization also show bimodal distributions, while most DYAMOND models do not. Predictably, the bimodality originates from the separation of precipitation process between resolved grid-scale and parameterized subgrid-scale. However, in a larger number of models bimodality arises from the parameterized subgrid-scale convective precipitation alone.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Measuring the robustness of predictive probability for early stopping in two-group comparisons

We report physical experiments are often expensive and time-consuming. Test engineers must certify the compatibility of aircraft and their weapon systems before they can be deployed in the field, but the testing required is time consuming, expensive, and resource limited. Adopting Bayesian adaptive designs is a promising way to borrow from the successes seen in the clinical trials domain. The use of predictive probability (PP) to stop testing early and make faster decisions is particularly appealing given the aforementioned constraints. Given the high-consequence nature of the tests performed in the national security space, a strong understanding of new methods is required before being deployed. Although PP has been thoroughly studied for binary data, there is less work with continuous data, where many reliability studies are interested in certifying the specification limits of components. A simulation study evaluating the robustness of this approach indicates early stopping based on PP is reasonably robust to minor assumption violations, especially when only a few interim analyses are conducted. The simulation study also compares PP to conditional power, showing its relative strengths and weaknesses. A post-hoc analysis exploring whether release requirements of a weapon system from an aircraft are within specification with desired reliability resulted in stopping the experiment early and saving 33% of the experimental runs.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1992

Flight Testing and Simulation of an F-15 Airplane Using Throttles for Flight Control

Flight tests and simulation studies using the throttles of an F-15 airplane for emergency flight control have been conducted at the NASA Dryden Flight Research Facility. The airplane and the simulation are capable of extended up-and-away flight, using only throttles for flightpath control. Initial simulation results showed that runway landings using manual throttles only control were difficult, but possible with practice. Manual approaches flown in the airplane were much more difficult, indicating a significant discrepancy between flight and simulation. Analysis of flight data and development of improved simulation models that resolve the discrepancy are discussed. An augmented throttles-only control system that controls bank angle and flightpath with appropriate feedback parameters has also been developed, evaluated in simulations, and is planned for flight in the F-15.

Flight Testing↗