SEARCH · Search NASA
Results for “simulation evaluation”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
SRNL Report on Vendor Solicitation and Selective Ion-Electrode Testing
Effective operation of the Hanford Tank Waste Treatment and Immobilization Plant (WTP) will require information collected from sampling and/or monitoring to maintain environmental compliance, product quality, and operating efficiency. The U.S. Department of Energy (DOE) – Office of River Protection (ORP) recognizes the potential long-term benefit of developing real-time, in-line monitoring (RTIM) at the WTP to improve the current strategy of collecting tens of thousands of samples and analyzing them. In-line monitoring can decrease processing time associated with waiting for sample analysis, reduce workers’ exposure to radiation and chemical hazards, decrease secondary waste volumes, potentially improve product quality, and provide production support and enhance overall operational control. The Assistant Manager, WTP chartered an Integrated Technical Team (ITT), which includes personnel from the Savannah River National Laboratory (SRNL), Bechtel National, Inc., and DOE-ORP, to evaluate the capability and potential benefits of replacing routine sample collection requirements with real-time, in-line monitoring. The initial focus of the ITT is the Direct Feed Low Activity Waste (DFLAW) Program. This work scope is being performed in multiple phases. Phase 1 is Requirements and Opportunities Analysis, Phase 2 is Applications and Benefits Determination, and Phase 3 is Qualification and Demonstration. Phase 1 included 6 tasks and was completed by SRNL in 2017. The tasks in Phase 1 were: (1) determining the functional requirements for determining analytes and properties of streams, (2) determining the technical basis for process control, (3) determining the sampling points within the Low Activity Waste (LAW) facility and Effluent Management Facility (EMF), (4) data quality and management, (5) process control challenges, and (6) preparing a Preliminary Analysis Plan. DOE-ORP was briefed on the findings from the Phase 1 tasks and requested that Phase 2 work focus on establishing a basis for a materials balance approach that minimized process sampling. The Phase 2 work scope contains tasks to evaluate a materials balance only approach as well as continuing scoping evaluations for instruments that could be used for RTIM. The Phase 2 work scope was completed by both SRNL and Pacific Northwest National Laboratory (PNNL). The tasks performed in Phase 2 were: 1. Overall program administration and technical oversight 2. Evaluation of a Material Balance Approach, a. Evaluation of uncertainty of this approach compared to uncertainty of current methods b. Evaluation of automating the material balance within the framework of existing control software, c. Development of the methodology to obtain and evaluate data during cold commissioning to support a material balance approach, and d. Development of a framework to utilize during presentation of the revised approach to stakeholders and regulators. 3. Screening Evaluations of Instruments to Supplement the Material Balance Approach, a. AP-105 melter condensate evaluations, and b. Screening testing with simulants. 4. Evaluation of the current DFLAW feed qualification program to identify analytes that could be eliminated, a. Inorganic analytes, b. Radionuclides, and c. Organic analytes. This report describes the results of Task 3b, Screening testing with simulants. The Savannah River National Laboratory requested demonstrations of commercially available analytical instruments by the vendors or laboratory demonstration. The techniques tested included: Raman spectroscopy, Infrared spectroscopy (IR), laser induced breakdown spectroscopy (LIBS), X-Ray Fluorescence Spectroscopy (XRF), and ion-selective electrochemical probes. Additionally, the instrumentation would need to be durable enough to withstand the environment of the plant, preferably with little to no maintenance. The insertion point of the instrument would be dependent upon the instrumentation.
Airspace Concept Evaluation System (ACES), Concept Simulations using Communication, Navigation and Surveillance (CNS) System Models
Project Objectives include: a) CNS Model Development; b Design/Integration of baseline set of CNS Models into ACES; c) Implement Enhanced Simulation Capabilities in ACES; d) Design and Integration of Enhanced (2nd set) CNS Models; and e) Continue with CNS Model Integration/Concept evaluations.
The importance of considering sub-grid cloud variability when using satellite observations to evaluate the cloud and precipitation simulations in climate models
Abstract. Satellite cloud observations have become an indispensable tool for evaluating general circulation models (GCMs). To facilitate the satellite and GCM comparisons, the CFMIP (Cloud Feedback Model Inter-comparison Project) Observation Simulator Package (COSP) has been developed and is now increasingly used in GCM evaluations. Real-world clouds and precipitation can have significant sub-grid variations, which, however, are often ignored or oversimplified in the COSP simulation. In this study, we use COSP cloud simulations from the Super-Parameterized Community Atmosphere Model (SPCAM5) and satellite observations from the Moderate Resolution Imaging Spectroradiometer (MODIS) and CloudSat to demonstrate the importance of considering the sub-grid variability of cloud and precipitation when using the COSP to evaluate GCM simulations. We carry out two sensitivity tests: SPCAM5 COSP and SPCAM5-Homogeneous COSP. In the SPCAM5 COSP run, the sub-grid cloud and precipitation properties from the embedded cloud-resolving model (CRM) of SPCAM5 are used to drive the COSP simulation, while in the SPCAM5-Homogeneous COSP run only grid-mean cloud and precipitation properties (i.e., no sub-grid variations) are given to the COSP. We find that the warm rain signatures in the SPCAM5 COSP run agree with the MODIS and CloudSat observations quite well. In contrast, the SPCAM5-Homogeneous COSP run which ignores the sub-grid cloud variations substantially overestimates the radar reflectivity and probability of precipitation compared to the satellite observations, as well as the results from the SPCAM5 COSP run. The significant differences between the two COSP runs demonstrate that it is important to take into account the sub-grid variations of cloud and precipitation when using COSP to evaluate the GCM to avoid confusing and misleading results.
Evaluation of a multi-scale WRF-CAM5 simulation during the 2010 East Asian Summer Monsoon
The Weather Research and Forecasting model with Chemistry (WRF-Chem) with the physics package of the Community Atmosphere Model Version 5 (CAM5) has been applied at multiple scales over Eastern China (EC) and the Yangtze River Delta (YRD) to evaluate how increased horizontal resolution with physics designed for a coarser resolution climate model impacts aerosols and clouds, and the resulting precipitation characteristics and performance during the 2010 East Asian Summer Monsoon (EASM). Despite large underpredictions in surface aerosol concentrations and aerosol optical depth, there is good spatial agreement with surface observations of chemical predictions, and increasing spatial resolution tends to improve performance. Model bias and normalized root mean square values for precipitation predictions are relatively small, but there are significant differences when comparing modeled and observed probability density functions for precipitation in EC and YRD. Increasing model horizontal resolution tends to reduce model bias and error for precipitation predictions. The surface and column aerosol loading is maximized between about 32N and 42N in early to mid-May during the 2010 EASM, and then shifts north while decreasing in magnitude during July and August. Changing model resolution moderately changes the spatiotemporal relationships between aerosols, cloud properties, and precipitation during the EASM, thus demonstrating the importance of model grid resolution in simulating EASM circulation and rainfall patterns over EC and the YRD. Results from this work demonstrate the capability and limitations in the aerosol, cloud, and precipitation representation of WRF-CAM5 for regional-scale applications down to relatively fine horizontal resolutions. Further WRF-CAM5 model development and application in this area is needed.
Investigation of Asymmetric Thrust Detection with Demonstration in a Real-Time Simulation Testbed
The purpose of this effort is to develop, demonstrate, and evaluate three asymmetric thrust detection approaches to aid in the reduction of asymmetric thrust-induced aviation accidents. This paper presents the results from that effort and their evaluation in simulation studies, including those from a real-time flight simulation testbed. Asymmetric thrust is recognized as a contributing factor in several Propulsion System Malfunction plus Inappropriate Crew Response (PSM+ICR) aviation accidents. As an improvement over the state-of-the-art, providing annunciation of asymmetric thrust to alert the crew may hold safety benefits. For this, the reliable detection and confirmation of asymmetric thrust conditions is required. For this work, three asymmetric thrust detection methods are presented along with their results obtained through simulation studies. Representative asymmetric thrust conditions are modeled in simulation based on failure scenarios similar to those reported in aviation incident and accident descriptions. These simulated asymmetric thrust scenarios, combined with actual aircraft operational flight data, are then used to conduct a sensitivity study regarding the detection capabilities of the three methods. Additional evaluation results are presented based on pilot-in-the-loop simulation studies conducted in the NASA Glenn Research Center (GRC) flight simulation testbed. Data obtained from this flight simulation facility are used to further evaluate the effectiveness and accuracy of the asymmetric thrust detection approaches. Generally, the asymmetric thrust conditions are correctly detected and confirmed.
Investigation of Asymmetric Thrust Detection with Demonstration in a Real-Time Simulation Testbed
The purpose of this effort is to develop, demonstrate, and evaluate three asymmetric thrust detection approaches to aid in the reduction of asymmetric thrust-induced aviation accidents. This paper presents the results from that effort and their evaluation in simulation studies, including those from a real-time flight simulation testbed. Asymmetric thrust is recognized as a contributing factor in several Propulsion System Malfunction plus Inappropriate Crew Response (PSM+ICR) aviation accidents. As an improvement over the state-of-the-art, providing annunciation of asymmetric thrust to alert the crew may hold safety benefits. For this, the reliable detection and confirmation of asymmetric thrust conditions is required. For this work, three asymmetric thrust detection methods are presented along with their results obtained through simulation studies. Representative asymmetric thrust conditions are modeled in simulation based on failure scenarios similar to those reported in aviation incident and accident descriptions. These simulated asymmetric thrust scenarios, combined with actual aircraft operational flight data, are then used to conduct a sensitivity study regarding the detection capabilities of the three methods. Additional evaluation results are presented based on pilot-in-the-loop simulation studies conducted in the NASA Glenn Research Center (GRC) flight simulation testbed. Data obtained from this flight simulation facility are used to further evaluate the effectiveness and accuracy of the asymmetric thrust detection approaches. Generally, the asymmetric thrust conditions are correctly detected and confirmed.
Investigation of Asymmetric Thrust Detection with Demonstration in a Real-Time Simulation Testbed
The purpose of this effort is to develop, demonstrate, and evaluate three asymmetric thrust detection approaches to aid in the reduction of asymmetric thrust-induced aviation accidents. This paper presents the results from that effort and their evaluation in simulation studies, including those from a real-time flight simulation testbed. Asymmetric thrust is recognized as a contributing factor in several Propulsion System Malfunction plus Inappropriate Crew Response (PSM+ICR) aviation accidents. As an improvement over the state-of-the-art, providing annunciation of asymmetric thrust to alert the crew may hold safety benefits. For this, the reliable detection and confirmation of asymmetric thrust conditions is required. For this work, three asymmetric thrust detection methods are presented along with their results obtained through simulation studies. Representative asymmetric thrust conditions are modeled in simulation based on failure scenarios similar to those reported in aviation incident and accident descriptions. These simulated asymmetric thrust scenarios, combined with actual aircraft operational flight data, are then used to conduct a sensitivity study regarding the detection capabilities of the three methods. Additional evaluation results are presented based on pilot-in-the-loop simulation studies conducted in the NASA Glenn Research Center (GRC) flight simulation testbed. Data obtained from this flight simulation facility are used to further evaluate the effectiveness and accuracy of the asymmetric thrust detection approaches. Generally, the asymmetric thrust conditions are correctly detected and confirmed.
Voltage Regulation Performance Evaluation of Distributed Energy Resource Management via Advanced Hardware-in-the-Loop Simulation
This paper evaluates the performance of coordinated control across advanced distribution management systems (ADMS), distributed energy resources (DERs), and distributed energy resource management systems (DERMS) using an advanced hardware-in-the-loop (HIL) platform. This platform provides a realistic laboratory testing environment, including accurate dynamic modeling of a real-world distribution system from a utility partner, real controllers (ADMS and DERMS), physical power hardware (DERs), and standard communications protocols. One grid service—voltage regulation—is evaluated to show the performance of the coordinated grid automation system. The testing results demonstrate that the coordinated DERMS and ADMS system can effectively regulate system voltages within target operation limits using DERs. The realistic laboratory HIL testing results give utilities confidence in adopting the grid automation systems to manage DERs to achieve system-level control and operation objectives (e.g., voltage regulation). This helps utilities mitigate potential risks (e.g., instability) prior to field deployment.
Assessment of Storm-Associated Precipitation and Its Extremes Using Observational Data Sets and Climate Model Short-Range Hindcasts
Heavy precipitation, often associated with weather phenomena such as tropical cyclones, extratropical cyclones (ETCs), atmospheric rivers (ARs), and mesoscale convective systems (MCSs), can cause significant socio-economic loss. Here, in this study, we apply atmospheric feature trackers to quantify the contributions of these storm types in observational data sets and climate model short-range hindcasts. We generate a global hourly storm data set at 0.25° spatial resolution covering 2006–2020, based on the tracking results from TempestExtremes and Python FLEXible object TRacKeR. Our analyses show that these four storm types account for 67% of global annual mean precipitation and 82% of top 1% precipitation extremes, with MCSs mainly over the tropics, and ARs and ETCs over the midlatitudes. The percentage of precipitation contributions from these storms also show strong seasonality over many geographical locations. We further apply the tracking results to the Energy Exascale Earth System Model (E3SM) short-range hindcasts and evaluate how well these storms are simulated. The evaluation show that E3SM, with ∼1° resolution, significantly underestimates storm-associated precipitation totals and extremes, especially for MCSs in the tropics. Our analysis also suggests that model fails to capture the correct mean diurnal phases and amplitude of MCS precipitation. This phenomenon-based approach provides a better understanding of precipitation characteristics and can lead to enhanced model evaluation by revealing underlying problems in model physics related to precipitation processes associated with the heavy-precipitating storms.
Deep Learning–Assisted Multiobjective Optimization of Geological CO 2 Storage Performance under Geomechanical Risks
In geological CO 2 storage, designing the optimal well control strategy for CO 2 injection to maximize CO 2 storage while minimizing the associated geomechanical risks is not trivial. This challenge arises due to pressure buildup, CO 2 plume migration, the highly nonlinear nature of geomechanical responses to rock-fluid interaction, and the high computational cost associated with coupled flow and geomechanics simulations. In this paper, we introduce a novel optimization framework to address these challenges. The optimization problem is formulated as follows: maximize total CO 2 storage while minimizing geomechanical risks by adjusting the injection schedules within bounded constraints. The geomechanical risks are primarily driven by injection-induced pressure build-up, which is characterized by ground displacement and the induced microseismicity. We used the Fourier neural operator (FNO)-based deep learning model to construct surrogate models, replacing the time-consuming coupled flow and geomechanics simulations for evaluating the aforementioned objective functions. The developed surrogate models have been incorporated into a multiobjective optimization framework through a genetic algorithm to reduce the computational burden. The proposed optimization framework reduces the computational cost from approximately 2,400 hours, when using objective function evaluations based on physics-based simulations, to around 20 minutes. A set of Pareto-optimal solutions of the proposed workflow yields nontrivial optimal decisions, reducing the microseismicity potential and the vertical displacement. This Pareto front highlights the optimal trade-offs between CO 2 storage amount, safety, and ground displacement, emphasizing the need for careful optimization and management of injection strategies to achieve a balanced outcome. The novelty of this work is twofold. First, we demonstrate the importance of incorporating the minimization of the geomechanical risks as objective functions into the CO 2 storage optimization workflow to mitigate the potential risk of induced microseismicity and ground displacement. Second, we leverage the FNO-based surrogate models to optimize a real-field CO 2 storage operation.
Virtual Refrigerant Charge Sensing Method for Next-Generation Refrigerant in Residential Heat Pumps
The charge level of refrigerant in heat pump systems significantly affects their operational performance. Virtual refrigerant charge (VRC) sensing technology has been well-established for traditional refrigerants (HFCs and HCFCs) for its low cost compared to physical sensors. However, other than traditional refrigerants, HFOs are increasingly used in next-generation heat pumps; whether these conventional VRC sensing methods remain applicable for heat pump systems utilizing next-generation refrigerants requires further investigation. To address these issues, this study develops a low-cost VRC sensing method for next-generation refrigerant heat pumps used in residential buildings. The developed algorithm is evaluated by using simulation models to evaluate the accuracy, considering an R454B heat pump with a nominal heating capacity of 51K Btu/hr (14.95 kW) as an example, and compared with those of the two reference VRC sensing algorithms. Though the developed VRC sensing algorithm and the two reference methods can accurately predict the charge level for the R454B heat pump system (with mean absolute percentage error for various cooling and heating conditions less than 7%), the developed VRC sensing algorithm uses fewer sensors and improves the overall accuracy for heating conditions by 7.1%, and the accuracy for undercharge cooling conditions 14.2%, compared with a mainstream algorithm. This technology will complement physical leakage detectors, and promote the adoption of next-generation heat pump systems, along with reducing wasted energy and maintenance costs.
Evaluation of lateral-directional handling qualities of piloted reentry vehicles utilizing a fixed base simulation
Flight simulator to evaluate lateral-directional handling qualities of piloted reentry vehicles
Modeling of the coupled magnetospheric and neutral wind dynamos
This report summarizes the progress made in the first year of NASA Grant No. NAGW-3508 entitled 'Modeling of the Coupled Magnetospheric and Neutral Wind Dynamos.' The approach taken has been to impose magnetospheric boundary conditions with either pure voltage or current characteristics and solve the neutral wind dynamo equation under these conditions. The imposed boundary conditions determine whether the neutral wind dynamo will contribute to the high-latitude current system or the electric potential. The semi-annual technical report, dated December 15, 1993, provides further detail describing the scientific and numerical approach of the project. The numerical development has progressed and the dynamo solution for the case when the magnetosphere acts as a voltage source has been evaluated completely using spectral techniques. The simulation provides the field-aligned current distribution at high latitudes due to the neutral wind dynamo. A number of geophysical conditions can be simulated to evaluate the importance of the neutral wind dynamo contribution to the field-aligned current system. On average, field-aligned currents generated by the neutral wind dynamo contributed as much as 30 percent to the large-scale field-aligned current system driven by the magnetosphere. A term analysis of the high-latitude neutral wind dynamo equation describing the field aligned current distribution has also been developed to illustrate the important contributing factors involved in the process. The case describing the neutral dynamo response for a magnetosphere acting as a pure current generator requires the existing spectral code to be extended to a pseudo-spectral method and is currently under development.
Using Vision System Technologies to Enable Operational Improvements for Low Visibility Approach and Landing Operations
Flight deck-based vision systems, such as Synthetic and Enhanced Vision System (SEVS) technologies, have the potential to provide additional margins of safety for aircrew performance and enable the implementation of operational improvements for low visibility surface, arrival, and departure operations in the terminal environment with equivalent efficiency to visual operations. To achieve this potential, research is required for effective technology development and implementation based upon human factors design and regulatory guidance. This research supports the introduction and use of Synthetic Vision Systems and Enhanced Flight Vision Systems (SVS/EFVS) as advanced cockpit vision technologies in Next Generation Air Transportation System (NextGen) operations. Twelve air transport-rated crews participated in a motion-base simulation experiment to evaluate the use of SVS/EFVS in NextGen low visibility approach and landing operations. Three monochromatic, collimated head-up display (HUD) concepts (conventional HUD, SVS HUD, and EFVS HUD) and two color head-down primary flight display (PFD) concepts (conventional PFD, SVS PFD) were evaluated in a simulated NextGen Chicago O'Hare terminal environment. Additionally, the instrument approach type (no offset, 3 degree offset, 15 degree offset) was experimentally varied to test the efficacy of the HUD concepts for offset approach operations. The data showed that touchdown landing performance were excellent regardless of SEVS concept or type of offset instrument approach being flown. Subjective assessments of mental workload and situation awareness indicated that making offset approaches in low visibility conditions with an EFVS HUD or SVS HUD may be feasible.
Influence of Vegetation on Simulation of the Water Balance and Hydrological Response to El Niño–Southern Oscillation in Western Tropical South America
Land surface models (LSMs) rely on vegetation parameters for use in hydrological and energy balance analysis, monitoring, and forecasting. This study examines the influence that vegetation representation in the Noah-Multiparameterization (Noah-MP) LSM has on hydrological simulations across the diverse climate zones of western tropical South America (WTSA), with specific consideration of hydrological variability associated with El Niño–Southern Oscillation (ENSO). The influence of model representation of vegetation on simulated hydrology is evaluated through three simulation experiments that use 1) satellite-derived constant MODIS; 2) satellite-derived time-varying MODIS; and 3) the Noah-MP dynamic leaf model. We find substantial differences in vegetation fields between these simulations, with the Noah-MP dynamic leaf model diverging significantly from satellite-derived vegetation fields in many ecoregions. Impacts on simulated hydrology were, however, found to be modest across climate zones, except for select extreme events. Also, although impacts on hydrology under ENSO-induced variability were small, we find that the Noah-MP dynamic leaf model simulates a positive relationship between rainfall and vegetation in humid ecoregions of WTSA, where satellite observations may indicate the opposite. The relatively small sensitivity of simulated hydrology to vegetation scheme suggests that the performance of hydrological monitoring and forecasting in WTSA that uses Noah-MP is largely unaffected by the choice of vegetation scheme, such that using a simple climatological default is generally no worse than adopting more complicated options. The presence of some differences between the time-varying and constant MODIS simulations for hydrologic extremes, however, indicates that time-varying MODIS configuration might be more suitable for hydrological hazards applications.
Preliminary Dynamic Modeling of the Quarter-Scale Distributed Electric Propulsion Aircraft
This paper describes the early-stage modeling of a quarter-scale distributed electric propulsion aircraft, based on the SUbsonic Single Aft eNgine (SUSAN) Electrofan, a transformative concept aircraft for which a model exists. The full-scale 180 passenger SUSAN concept has a single turbofan engine in the tail that both produces thrust and provides electrical power to 16 electric fans distributed across the wings utilizing a series/parallel hybrid architecture. The quarter-scale version would have an internal combustion piston engine to provide power to 17 electric fans–16 on the wings, one in the tail–in a series hybrid configuration, and no vertical or horizontal stabilizers. It would also have a reduced flight envelope in terms of both altitude and speed. The initial modeling approach is to scale down the original airframe model to capture the dynamic behavior of a much smaller aircraft, albeit with an empennage. The original powertrain model is then replaced with one representing the physical components of that of the quarter-scale vehicle. This powertrain model is suitable for control design and analysis, and the fully integrated, although preliminary, aircraft model allows flight simulator testing and evaluation. Results from simulations are presented.
Preliminary Dynamic Modeling of the Quarter-Scale Distributed Electric Propulsion Aircraft
This presentation describes the early-stage modeling of a quarter-scale distributed electric propulsion aircraft, based on the SUbsonic Single Aft eNgine (SUSAN) Electrofan, a transformative concept aircraft for which a model exists. The full-scale 180 passenger SUSAN concept has a single turbofan engine in the tail that both produces thrust and provides electrical power to 16 electric fans distributed across the wings utilizing a series/parallel hybrid architecture. The quarter-scale version would have an internal combustion piston engine to provide power to 17 electric fans–16 on the wings, one in the tail–in a series hybrid configuration, and no vertical or horizontal stabilizers. It would also have a reduced flight envelope in terms of both altitude and speed. The initial modeling approach is to scale down the original airframe model to capture the dynamic behavior of a much smaller aircraft, albeit with an empennage. The original powertrain model is then replaced with one representing the physical components of that of the quarter-scale vehicle. This powertrain model is suitable for control design and analysis, and the fully integrated, although preliminary, aircraft model allows flight simulator testing and evaluation. Results from simulations are presented.