Search NASA⌕ Search

SEARCH · Search NASA

Results for “simulation test bed”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

What can simulation test beds teach us about social science? Results of the ground truth program

The ground truth program used simulations as test beds for social science research methods. The simulations had known ground truth and were capable of producing large amounts of data. This allowed research teams to run experiments and ask questions of these simulations similar to social scientists studying real-world systems, and enabled robust evaluation of their causal inference, prediction, and prescription capabilities. We tested three hypotheses about research effectiveness using data from the ground truth program, specifically looking at the influence of complexity, causal understanding, and data collection on performance. We found some evidence that system complexity and causal understanding influenced research performance, but no evidence that data availability contributed. The ground truth program may be the first robust coupling of simulation test beds with an experimental framework capable of teasing out factors that determine the success of social science research.

97 MATHEMATICS AND COMPUTING↗

A high-fidelity building performance simulation test bed for the development and evaluation of advanced controls

We present an open-source building performance simulation test bed, the Advanced Controls Test Bed (ACTB), that interfaces high-fidelity Spawn of EnergyPlus building models, with advanced controllers implemented in Python. Additionally, the ACTB leverages the Building Optimization Testing and Alfalfa platforms for managing simulations, providing an external clock, a representational state transfer (REST) application programming interface (API), and key performance indicators for evaluating the effectiveness of control strategies. The REST API allows the development of external controllers programmed in languages such as Python, which provides flexibility and a rich choice of scientific libraries for designing control sequences. We present three test cases based on the U.S. Department of Energy's Reference Small Office Building to demonstrate the ACTB's capabilities: (a) rule-based controls compliant with ASHRAE Guideline 36 control sequences; (b) an economic model predictive control implemented using do-mpc; and (c) a deep Q-network reinforcement learning agent implemented using OpenAI Gym.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

The Ground Truth Program: Simulations as Test Beds for Social Science Research Methods.

Social systems are uniquely complex and difficult to study, but understanding them is vital to solving the world’s problems. The Ground Truth program developed a new way of testing the research methods that attempt to understand and leverage the Human Domain and its associated complexities. The program developed simulations of social systems as virtual world test beds. Not only were these simulations able to produce data on future states of the system under various circumstances and scenarios, but their causal ground truth was also explicitly known. Research teams studied these virtual worlds, facilitating deep validation of causal inference, prediction, and prescription methods. The Ground Truth program model provides a way to test and validate research methods to an extent previously impossible, and to study the intricacies and interactions of different components of research.

97 MATHEMATICS AND COMPUTING↗

R and DE Robotic Sensor Intern Team: Sensor Suite Mock Up Testing

Assess sensor suite performance: - Mounted on crawler typical to what would be used in tunnel; - In test bed simulating the tunnel environment. The SuperDroid fiber tethered LT-F crawler is a general-purpose surveillance robot that our team has refurbished as a testing platform for the sensor suite. This crawler was selected because its dimensions are similar to the actual crawler that will be deployed in the field. Crawler preparation included: - Communicating with vendor to resolve software and platform issues; - Configuring a laptop with the crawler control software; - Reconfiguration of communication protocol between computer and crawler; - Resolution of control board checksum errors; - Installation of a mounting fixture on the base; - In progress: addition of lighting needed for total darkness. A solution for hosting the selected sensors onto a single unit that could function standalone or be mounted on the crawler was needed. Sensor mount requirements included: - Host Lidar, panospheric cameras and IMU sensors; - Cable management for rotating Lidar; - House on-board crawler computer; - Method for affixing to crawler; - Robust and vibration proof. The Lidar sensor required a sturdy mount that ensured the axis of rotation be centered with the LiDAR's desired laser path and included a slender profile in order to not block the scanning FOV. The mounting plate holds two 180-degree cameras on either side and the servo on the center. The servo mount is located so the axis of rotation is in the center of the plate. The mount features a set of guides that hold the wires and ensure they wrap around the spool area properly. The sensor box design features thick walls for added strength, holes for mounting the sensor suite to the crawler, notches on the bottom for the different components and holes for cable routing and management. The sensor mounts were designed using CREO and printed in the R and DE Additive Manufacturing Lab. To test the performance of the sensor suite for our application it was desired to design and build a test bed simulating the H-Canyon tunnel environment. Requirements included: - Dimensions similar to the tunnel; - Wall surfaces simulating the eroded tunnel walls; - Complete darkness; - Even and uneven crawler path; - Ability to change the tunnel width to simulate erosion. The HCAEX tunnel changes in height and includes several bends ranging from approximately 30 to 80 degrees, for that reason a test bed capable of easily being changed was needed. The final design includes two sections that can be connected to provide a 16' tunnel or placed at an angle to create a tunnel bend. The test bed features caster wheels for easy movement and has a sliding inner wall that enables tunnel width to be controlled. In order to simulate the tunnel walls without adding a lot of weight to the test bed, sheets of faux stone are to be used on the inner walls. To create a completely dark tunnel, 100% black-out film will be draped over the tunnel structure. Carpet remnants in the lab will enable folds to be introduced in the floor to generate uneven surface data.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

A Test Bed for Self-regulating Distribution Systems: Modeling Intergrated Renewable Energy and Demand Response in the GridLAB-D/MATLAB Environment

This paper discusses the development of a simulation test bed permitting the study of integrated renewable energy generators and controlled distributed heat pumps operating within distribution systems. The test bed is demonstrated in this paper by addressing the important issue of the self-regulating effect of consumer-owned air-source heat pumps on the variability induced by wind power integration, particularly when coupled with increased access to demand response realized through a centralized load control strategy.

Wang, Dan↗

Co-Simulation Platform For Characterizing Cyber Attacks in Cyber Physical Systems

Smart grid is a complex cyber physical system containing a numerous and variety of sources, devices, controllers and loads. Communication/Information infrastructure is the backbone of the smart grid system where different grid components are connected with each other through this structure. Therefore, the drawbacks of the information technology related issues are also becoming a part of the smart grid. Further, smart grid is also vulnerable to the grid related disturbances. For such a dynamic system, disturbance and intrusion detection is a paramount issue. This paper presents a Simulink and OPNET based co-simulated test bed to carry out a cyber-intrusion in a cyber-network for modern power systems and smart grid. The effect of the cyber intrusion on the physical power system is also presented. The IEEE 30 bus power system model is used to demonstrate the effectiveness of the simulated testbed. The experiments were performed by disturbing the circuit breakers reclosing time through a cyber-attack in the cyber network. Different disturbance situations in the proposed test system are considered and the results indicate the effectiveness of the proposed co-simulated scheme.

cyber attack characterization↗

Explaining and predicting human behavior and social dynamics in simulated virtual worlds: reproducibility, generalizability, and robustness of causal discovery methods

Ground Truth program was designed to evaluate social science modeling approaches using simulation test beds with ground truth intentionally and systematically embedded to understand and model complex Human Domain systems and their dynamics Lazer et al. (Science 369:1060–1062, 2020). Our multidisciplinary team of data scientists, statisticians, experts in Artificial Intelligence (AI) and visual analytics had a unique role on the program to investigate accuracy, reproducibility, generalizability, and robustness of the state-of-the-art (SOTA) causal structure learning approaches applied to fully observed and sampled simulated data across virtual worlds. In addition, we analyzed the feasibility of using machine learning models to predict future social behavior with and without causal knowledge explicitly embedded. In this paper, we first present our causal modeling approach to discover the causal structure of four virtual worlds produced by the simulation teams—Urban Life, Financial Governance, Disaster and Geopolitical Conflict. Our approach adapts the state-of-the-art causal discovery (including ensemble models), machine learning, data analytics, and visualization techniques to allow a human-machine team to reverse-engineer the true causal relations from sampled and fully observed data. We next present our reproducibility analysis of two research methods team’s performance using a range of causal discovery models applied to both sampled and fully observed data, and analyze their effectiveness and limitations. We further investigate the generalizability and robustness to sampling of the SOTA causal discovery approaches on additional simulated datasets with known ground truth. Our results reveal the limitations of existing causal modeling approaches when applied to large-scale, noisy, high-dimensional data with unobserved variables and unknown relationships between them. We show that the SOTA causal models explored in our experiments are not designed to take advantage from vasts amounts of data and have difficulty recovering ground truth when latent confounders are present; they do not generalize well across simulation scenarios and are not robust to sampling; they are vulnerable to data and modeling assumptions, and therefore, the results are hard to reproduce. Finally, when we outline lessons learned and provide recommendations to improve models for causal discovery and prediction of human social behavior from observational data, we highlight the importance of learning data to knowledge representations or transformations to improve causal discovery and describe the benefit of causal feature selection for predictive and prescriptive modeling.

97 MATHEMATICS AND COMPUTING↗

R and DE Robotic Sensor Intern Team: Remote 3D Mapping Overview

The Department of Energy (DOE) nuclear complex includes many hazardous and challenging environments that must be inspected remotely and routinely for structural integrity evaluation and long-term planning purposes. The H-Canyon Air Exhaust (HCAEX) Tunnel biannual inspection is an example of such an environment. Presently inspections are performed by teleoperated robotic crawlers provide low resolution video feedback to the structural engineers. Advanced sensors such as Lidar and panospheric hi-res cameras have the potential to provide additional valuable data in future inspections. UT-Austin Lidar work in support of an H-Canyon deployment began with the DOE EM sponsored H-Canyon Integrated Research Project. The R and DE Robotic Sensor intern team includes two of the UT-Austin Masters students working on Lidar development to facilitate the pulling of university developed solutions to the field. The goal of this project is to develop a suite of sensors that could be used to gather advanced data in future HCAEX tunnel inspections. Of particular interest is the ability to map the tunnel walls at an accuracy that will allow for the comparison of two scans performed at different time periods to estimate the concrete erosion rate. Additionally, the development of the 3D point cloud in the GPS denied environment is the first step in being able to collect and overlay other 3D data such as radiation mapping. Project specific goals include: - Design and develop 3D mapping sensor suite. Merge Lidar point cloud with high res camera images Incorporate Inertial Measurement Unit (IMU) to assist with positioning. - Develop sensor software and user GUI Sensor data collection and integration software User GUI for reach back system. - Test solution on crawler in tunnel test bed Use crawler base similar to H-Canyon planned crawler Design and build test bed simulating tunnel conditions. To facilitate rapid sensor integration, software coding and user GUI development, the Robot Operating System (ROS) was employed as the development platform. ROS is a set of open source software libraries and tools that assist with the building of robot applications. ROS includes drivers for many sensors, state-of-the-art algorithms, and powerful developer tools. Sensors selected for the summer intern solution included assessment as to whether they possessed ROS drivers and associated sample code. Additionally, the ROS 3D Robot Visualizer (rviz) tool has been employed.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Using Qualified On-Site Nuclear Power Plant Simulators in Human Factors Validations of Control Room Upgrades

Existing commercial nuclear power plants (NPPs) are valuable assets in the infrastructure portfolio of the United States (U.S.) because they safely and reliably generate about 1/5th of all the electricity used. The instrumentation and control (I&C) systems in commercial NPPs are the ‘eyes and ears' of the operator, allowing operators to maintain situation awareness, thereby allowing the plant to operate safely and efficiently for all phases of operation. Because the I&C systems in NPPs are still mostly based on analog technologies, which are reliable but not especially cost-effective, upgrading the existing I&C in com-mercial NPPs to new digital I&C is very important. Furthermore, simulators and simulation are critical human factors engineering tools for this I&C modernization work. NPP control room simulators are essential test beds to simulate normal, abnormal, and emergency operations that allow human factors researchers to safely and realistically evaluate early design phase prototypes of the upgraded digital I&C, and validate final as-built digital I&C systems that have been modernized deployed in NPPs. This paper describes research performed using qualified on-site NPP simulators to perform human factors validations of digital I&C control room upgrades.

99 GENERAL AND MISCELLANEOUS↗

Extension of Virtual Test Bed Advanced Modeling and Simulation Capabilities for Fusion Energy

The National Reactor Innovation Center (NRIC) was established to accelerate the deployment of novel reactor concepts. This is achieved by providing physical and virtual spaces for building and testing reactor experiments. The Virtual Test Bed (VTB) represents the virtual counterpart to the physical test beds. It is a collaboration with the Department of Energy’s (DOE) Nuclear Energy Advanced Modeling and Simulation (NEAMS) program with the mission to accelerate the deployment of advanced reactors by facilitating the adoption of advanced modeling and simulation (M&S) tools developed by the DOE. This mission has been carried out by the VTB since 2020 by hosting and featuring dozens of advanced fission nuclear reactor models developed by national laboratories and academia. The charter of the NRIC’s definition of advanced reactors also includes fusion nuclear reactors. As the tools developed by the NEAMS program are increasingly used for modeling fusion energy devices, there is an increasing need to host fusion reactor models on the VTB repository. The VTB will be extended in 2024 to support fusion energy modeling and simulation.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Sustain: An experimental test bed for building energy simulation

Current building energy simulation technology requires extensive labor, time and expertise to create building energy models, substantial computational time for accurate simulations, and generates data in formats that make results difficult to interpret. These deficiencies can be ameliorated using modern graphical user interfaces and algorithms which take advantage of modern computer architectures and display capabilities. This paper describes a novel test bed environment which offers an interactive graphical interface, provides access to simulation modules that run at accelerated computational speeds, and presents new graphic visualization methods for the interpretation of simulation results. Its modular structure makes it suitable for use in early stage building design, for use as a research platform for the investigation of new simulation methods, and for use as a tool for teaching concepts of sustainable design. Improvements in the accuracy and execution speed of many of the simulation modules are based on the modification of advanced computer graphics rendering algorithms. Significant performance improvements are illustrated in several computationally expensive energy simulation modules.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Development of Laboratory Testbeds Simulating Real-World Greenhouse Gas Emissions [Slides]

In this presentation, I discussed the development of laboratory test beds that simulate field greenhouse gas emissions. Field experiments are used to test new landscape management practices that could reduce greenhouse gas emissions. However, field experiments are very expensive and time consuming. Laboratory experiments are generally more cost efficient and timesaving. There are methods that can be used to make these laboratory tests more closely replicate natural systems for the improvement of agricultural lands used in biofuel and food production. The goal of this project is to develop a laboratory testbed that will mimic field greenhouse gas emissions. To achieve this goal, we used soil cores taken from agricultural and marginal lands, then attached fiberglass wicks to improve the drainage system in the core to simulate a more natural hydraulic system. The combination of using native soils and fiberglass wicks should demonstrate similar greenhouse gas emissions between the lab and the field. Our preliminary results suggest that the carbon dioxide and nitrous oxide flux from the agricultural land site were comparable to the greenhouse soil cores equipped with the drainage wicks. The data suggests that laboratory testbeds can be used to mimic field greenhouse gas emissions if parameters, such as soil water content are in a set range.

54 ENVIRONMENTAL SCIENCES↗

Incentive-Based Control and Coordination of Distributed Energy Resources. Final Report

The rapid growth of low-inertia renewable energy resources represents an immense opportunity for the U.S. to minimize its carbon footprint, while presenting a challenge for system operators as traditional “spinning” generation resources are displaced. This transformation requires solutions to robustly and cost-effectively manage dynamic changes on the grid while ensuring quality of service. There is growing recognition that distributed energy resources (DERs – loads, distributed generation, storage, electric vehicles, etc.) represent a great potential to perform this function. This report details a scalable hierarchical control strategy for coordinating thousands of heterogeneous DERs in order to provide three ancillary gird services: 1) frequency response, a rapid (within 2 seconds) service used to maintain the grid at 60 Hz; 2) regulation response, a larger response used to balance on-going differences in supply and demand on the grid; and, 3) ramping reserve, used to bring on capacity to replace lost generation. The developed control architecture consists of 1) a Distribution Reliability Coordinator (DRC), 2) aggregator controllers, and finally, 3) DER controllers. The DRC coordinates all the flexible loads and distributed energy resources on the distribution system and bids the aggregate flexibility into the wholesale market. The DRC also performs resource allocation (deciding how the flexible devices on the distribution system will be dispatched) to meet the requirements for each of the three ancillary services. The aggregators control a collection of devices that are geographically co-located and provide a platform to aggregate their flexibility and mitigate uncertainty associated with a single flexible load by managing a large aggregation of similar loads (so that any stochastic effects average out). Finally, DER controllers (for example, thermostats for air conditioners, chargers for electric vehicles) adjust the power consumption of individual devices to ensure accurate and reliable delivery of the requested grid services. Evaluation and validation of this approach was conducted with a mixture of simulation and hardware testing for a range of DERs in residential (air conditioners and water heaters), commercial HVAC (ventilation fans and central chiller plants), and micro-grids (battery energy storage, solar PV etc.). This culminated in DER hardware and simulation models operating in conjunction with grid simulations as part of a large scale federated test-bed demonstration. Simulations of over 10,000 controllable residential devices (a combination of air conditioners, water heaters, batteries, and electric vehicles) demonstrated that this advanced control approach could simultaneously meet all three grid services. Furthermore, hardware-in-the-loop testing was performed with operational micro-grid and commercial building HVAC equipment. The micro-grid equipment (representing PV, battery storage, and back-up generators) demonstrated the ability to meet all frequency response requirements (except ramping time). The commercial building HVAC ventilation equipment successfully provided the regulating response service. An Industry Advisory Board (IAB) was formed and engaged throughout the project to get feed-back on project risks and potential commercialization barriers. Their input was invaluable in identify key risks stemming from regulatory and market access challenges, financial risks from under-performance, and competitive threats from utility-scale solutions such as integrated storage. A phased commercialization plan was developed that addresses continued risk reduction (value proposition refinement and performance uncertainty assessments), piloting through field demonstrations with key stakeholders, and finally, deployment as an emerging standard for DER control.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Using an Advanced Distribution Management System Test Bed to Evaluate the Impact of Model Quality on Volt/VAR Optimization: Preprint

In this paper, we present a test bed for evaluating existing and future advanced distribution management system (ADMS) applications in a realistic laboratory setting, including other utility management systems and field equipment. We present an example of using it to evaluate the impact of the ADMS network model quality on a Volt/VAR optimization (VVO) application. The test bed integrates a commercial ADMS with a real-time simulation model of a utility distribution feeder. Representative power and controller hardware are integrated through hardware-in-the-loop (HIL) techniques. The performance of the ADMS VVO application is also evaluated for different levels of measurement density. Initial results indicate that a higher model quality achieves the highest possible energy savings while avoiding voltage violations, whereas a lower model quality results in increased energy savings but at the expense of more voltage violations.

ADMS↗

Recovery Act: Advanced Interaction, Computation, and Visualization Tools for Sustainable Building Design

Current building energy simulation technology requires excessive labor, time and expertise to create building energy models, excessive computational time for accurate simulations and difficulties with the interpretation of the results. These deficiencies can be ameliorated using modern graphical user interfaces and algorithms which take advantage of modern computer architectures and display capabilities. To prove this hypothesis, we developed an experimental test bed for building energy simulation. This novel test bed environment offers an easy-to-use interactive graphical interface, provides access to innovative simulation modules that run at accelerated computational speeds, and presents new graphics visualization methods to interpret simulation results. Our system offers the promise of dramatic ease of use in comparison with currently available building energy simulation tools. Its modular structure makes it suitable for early stage building design, as a research platform for the investigation of new simulation methods, and as a tool for teaching concepts of sustainable design. Improvements in the accuracy and execution speed of many of the simulation modules are based on the modification of advanced computer graphics rendering algorithms. Significant performance improvements are demonstrated in several computationally expensive energy simulation modules. The incorporation of these modern graphical techniques should advance the state of the art in the domain of whole building energy analysis and building performance simulation, particularly at the conceptual design stage when decisions have the greatest impact. More importantly, these better simulation tools will enable the transition from prescriptive to performative energy codes, resulting in better, more efficient designs for our future built environment.

99 GENERAL AND MISCELLANEOUS↗

Sustain

Current building energy simulation technology requires excessive labor, time and expertise to create building energy models, excessive computational time for accurate simulations and difficulties with the interpretation of the results. These deficiencies can be ameliorated using modern graphical user interfaces and algorithms which take advantage of modern computer architectures and display capabilities. To prove this hypothesis, we developed an experimental test bed for building energy simulation. This novel test bed environment offers an easy-to-use interactive graphical interface, provides access to innovative simulation modules that run at accelerated computational speeds, and presents new graphics visualization methods to interpret simulation results. Our system offers the promise of dramatic ease of use in comparison with currently available building energy simulation tools. Its modular structure makes it suitable for early stage building design, as a research platform for the investigation of new simulation methods, and as a tool for teaching concepts of sustainable design. Improvements in the accuracy and execution speed of many of the simulation modules are based on the modification of advanced computer graphics rendering algorithms. Significant performance improvements are demonstrated in several computationally expensive energy simulation modules. The incorporation of these modern graphical techniques should advance the state of the art in the domain of whole building energy analysis and building performance simulation, particularly at the conceptual design stage when decisions have the greatest impact. More importantly, these better simulation tools will enable the transition from prescriptive to performative energy codes, resulting in better, more efficient designs for our future built environment.

Source record↗