Search NASA⌕ Search

SEARCH · Search NASA

Results for “simulation evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,333 records · Page 74
All sourcesNASA NTRSDOE OSTI
NASA NTRS2014

Evaluating the Dominant Components of Warming in Pliocene Climate Simulations

The Pliocene Model Intercomparison Project (PlioMIP) is the first coordinated climate model comparison for a warmer palaeoclimate with atmospheric CO2 significantly higher than pre-industrial concentrations. The simulations of the mid-Pliocene warm period show global warming of between 1.8 and 3.6 C above pre-industrial surface air temperatures, with significant polar amplification. Here we perform energy balance calculations on all eight of the coupled ocean-atmosphere simulations within PlioMIP Experiment 2 to evaluate the causes of the increased temperatures and differences between the models. In the tropics simulated warming is dominated by greenhouse gas increases, with the cloud component of planetary albedo enhancing the warming in most of the models, but by widely varying amounts. The responses to mid-Pliocene climate forcing in the Northern Hemisphere midlatitudes are substantially different between the climate models, with the only consistent response being a warming due to increased greenhouse gases. In the high latitudes all the energy balance components become important, but the dominant warming influence comes from the clear sky albedo, only partially offset by the increases in the cooling impact of cloud albedo. This demonstrates the importance of specified ice sheet and high latitude vegetation boundary conditions and simulated sea ice and snow albedo feedbacks. The largest components in the overall uncertainty are associated with clouds in the tropics and polar clear sky albedo, particularly in sea ice regions. These simulations show that albedo feedbacks, particularly those of sea ice and ice sheets, provide the most significant enhancements to high latitude warming in the Pliocene.

climate models↗
NASA NTRS1988

A simulation-based fault injection experiment to evaluate self-test diagnostics for a fault-tolerant computer

The design and results of a fault injection experiment conducted in the Airlab facility at NASA-Langley using a logic network simulator are described. An attempt was made to determine the effectiveness of the diagnostic self-test sequences used to detect failures in the communicator/interstage (C/I) of a fault-tolerant processor (FTP). Identification of the undetected faults in the C/I Status Register logic resulted in changes in the diagnostic test sequences implemented for the FTP.

Baker, Robert L.↗
DOE OSTI2024

Remaining Life Prediction of SNF Storage Canisters Exposed to CISCC Environments

• DOE Standardized SNF Storage Canisters o DOE designed standard spent nuclear fuel (SNF) storage canisters for storage of DOE SNF. o DOE canisters are significantly different from commercial MultiPurpose Canisters (MPC) in size. o MPC canisters are large, a height = 15.8 ft, OD = 68”, WT = 0.5”. o DOE canisters are small with 18” / 24” diameter, 10’ / 15’ length. • Integrity Evaluation of DOE versus MPC Canisters o Many investigations have been performed for MPC canisters. o Limit investigations were performed for DOE standard canisters. Most were done at Idaho National Lab (INL). o DOE has sponsored integrity studies to evaluate weld integrity using drop tests and FEA simulations. o No evaluation on CISCC/service life of DOE canister in literature. o MPC canister: 4 axial welds, 1 center girth weld, 2 closing welds.

ZHU, Xiankui↗
DOE OSTI2015

Using field observations to inform thermal hydrology models of permafrost dynamics with ATS (v0.83)

Climate change is profoundly transforming the carbon-rich Arctic tundra landscape, potentially moving it from a carbon sink to a carbon source by increasing the thickness of soil that thaws on a seasonal basis. Thus, the modeling capability and precise parameterizations of the physical characteristics needed to estimate projected active layer thickness (ALT) are limited in Earth system models (ESMs). In particular, discrepancies in spatial scale between field measurements and Earth system models challenge validation and parameterization of hydrothermal models. A recently developed surface–subsurface model for permafrost thermal hydrology, the Advanced Terrestrial Simulator (ATS), is used in combination with field measurements to achieve the goals of constructing a process-rich model based on plausible parameters and to identify fine-scale controls of ALT in ice-wedge polygon tundra in Barrow, Alaska. An iterative model refinement procedure that cycles between borehole temperature and snow cover measurements and simulations functions to evaluate and parameterize different model processes necessary to simulate freeze–thaw processes and ALT formation. After model refinement and calibration, reasonable matches between simulated and measured soil temperatures are obtained, with the largest errors occurring during early summer above ice wedges (e.g., troughs). The results suggest that properly constructed and calibrated one-dimensional thermal hydrology models have the potential to provide reasonable representation of the subsurface thermal response and can be used to infer model input parameters and process representations. The models for soil thermal conductivity and snow distribution were found to be the most sensitive process representations. However, information on lateral flow and snowpack evolution might be needed to constrain model representations of surface hydrology and snow depth.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2015

Using field observations to inform thermal hydrology models of permafrost dynamics with ATS (v0.83)

Climate change is profoundly transforming the carbon-rich Arctic tundra landscape, potentially moving it from a carbon sink to a carbon source by increasing the thickness of soil that thaws on a seasonal basis. However, the modeling capability and precise parameterizations of the physical characteristics needed to estimate projected active layer thickness (ALT) are limited in Earth System Models (ESMs). In particular, discrepancies in spatial scale between field measurements and Earth System Models challenge validation and parameterization of hydrothermal models. A recently developed surface/subsurface model for permafrost thermal hydrology, the Advanced Terrestrial Simulator (ATS), is used in combination with field measurements to calibrate and identify fine scale controls of ALT in ice wedge polygon tundra in Barrow, Alaska. An iterative model refinement procedure that cycles between borehole temperature and snow cover measurements and simulations functions to evaluate and parameterize different model processes necessary to simulate freeze/thaw processes and ALT formation. After model refinement and calibration, reasonable matches between simulated and measured soil temperatures are obtained, with the largest errors occurring during early summer above ice wedges (e.g. troughs). The results suggest that properly constructed and calibrated one-dimensional thermal hydrology models have the potential to provide reasonable representation of the subsurface thermal response and can be used to infer model input parameters and process representations. The models for soil thermal conductivity and snow distribution were found to be the most sensitive process representations. However, information on lateral flow and snowpack evolution might be needed to constrain model representations of surface hydrology and snow depth.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1992

The adult literacy evaluator: An intelligent computer-aided training system for diagnosing adult illiterates

An important part of NASA's mission involves the secondary application of its technologies in the public and private sectors. One current application being developed is The Adult Literacy Evaluator, a simulation-based diagnostic tool designed to assess the operant literacy abilities of adults having difficulties in learning to read and write. Using ICAT system technology in addition to speech recognition, closed-captioned television (CCTV), live video and other state-of-the art graphics and storage capabilities, this project attempts to overcome the negative effects of adult literacy assessment by allowing the client to interact with an intelligent computer system which simulates real-life literacy activities and materials and which measures literacy performance in the actual context of its use. The specific objectives of the project are as follows: (1) To develop a simulation-based diagnostic tool to assess adults' prior knowledge about reading and writing processes in actual contexts of application; (2) to provide a profile of readers' strengths and weaknesses; and (3) to suggest instructional strategies and materials which can be used as a beginning point for remediation. In the first and developmental phase of the project, descriptions of literacy events and environments are being written and functional literacy documents analyzed for their components. Examples of literacy events and situations being considered included interactions with environmental print (e.g., billboards, street signs, commercial marquees, storefront logos, etc.), functional literacy materials (e.g., newspapers, magazines, telephone books, bills, receipts, etc.) and employment related communication (i.e., job descriptions, application forms, technical manuals, memorandums, newsletters, etc.). Each of these situations and materials is being analyzed for its literacy requirements in terms of written display (i.e., knowledge of printed forms and conventions), meaning demands (i.e., comprehension and word knowledge) and social situation. From these descriptions, scripts are being generated which define the interaction between the student, an on-screen guide and the simulated literacy environment. The proposed outcome of the Evaluator is a diagnostic profile which will present broad classifications of literacy behaviors across the major areas of metacognitive abilities, word recognition, vocabulary knowledge, comprehension and writing. From these classifications, suggestions for materials and strategies for instruction with which to begin corrective action will be made. The focus of the Literacy Evaluator will be essentially to provide an expert diagnosis and an interpretation of that assessment which then can be used by a human tutor to further design and individualize a remedial program as needed through the use of an authoring system.

Yaden, David B., Jr.↗
NASA NTRS2008

General Purpose Heat Source Simulator

The General Purpose Heat Source (GPHS) project seeks to combine the development of an electrically heated, single GPHS module simulator with the evaluation of potential nuclear surface power systems. The simulator is designed to match the form, fit, and function of actual GPHS modules which normally generate heat through the radioactive decay of Pu238. The use of electrically heated modules rather than modules containing Pu238 facilitates the testing of the subsystems and systems without sacrificing the quantity and quality of the test data gathered. Current GPHS activities are centered on developing robust heater designs with sizes and weights which closely match those of actual Pu238 fueled GPHS blocks. Designs are being pursued which will allow operation up to 1100 C.

Emrich, William J., Jr.↗
NASA NTRS2014

EMU Suit Performance Simulation

Introduction: Designing a planetary suit is very complex and often requires difficult trade‐offs between performance, cost, mass, and system complexity. To verify that new suit designs meet requirements, full prototypes must be built and tested with human subjects. However, numerous design iterations will occur before the hardware meets those requirements. Traditional draw‐prototype‐test paradigms for research and development are prohibitively expensive with today's shrinking Government budgets. Personnel at NASA are developing modern simulation techniques that focus on a human‐centric design paradigm. These new techniques make use of virtual prototype simulations and fully adjustable physical prototypes of suit hardware. This is extremely advantageous and enables comprehensive design down‐selections to be made early in the design process. Objectives: The primary objective was to test modern simulation techniques for evaluating the human performance component of two EMU suit concepts, pivoted and planar style hard upper torso (HUT). Methods: This project simulated variations in EVA suit shoulder joint design and subject anthropometry and then measured the differences in shoulder mobility caused by the modifications. These estimations were compared to human‐in‐the‐loop test data gathered during past suited testing using four subjects (two large males, two small females). Results: Results demonstrated that EVA suit modeling and simulation are feasible design tools for evaluating and optimizing suit design based on simulated performance. The suit simulation model was found to be advantageous in its ability to visually represent complex motions and volumetric reach zones in three dimensions, giving designers a faster and deeper comprehension of suit component performance vs. human performance. Suit models were able to discern differing movement capabilities between EMU HUT configurations, generic suit fit concerns, and specific suit fit concerns for crewmembers based on individual anthropometry

Cowley, Matthew S.↗
NASA NTRS2019

A Tactical Scheduler for Surface Metering Under Minimum Departure Interval Restrictions

Minimum Departure Interval (MDI) and Miles-In-Trail (MIT) are common traffic management tools. They both require minimum separation between departures to meet specific traffic conditions. The MDI restriction is a time separation requirement between departures, usually on the same Standard Instrument Departure (SID), whereas the MIT restriction is a distance separation requirement between aircraft, including but not limited to departure flights, to meet specific criteria associated with flight path or destination. At Incheon International Airport (IATA code: ICN) in South Korea, MDIs are imposed on 92% of departure flights. They involve specific criteria including not only having identical SID, but also satisfying other conditions, imposed on the flight path and destination. To address complicated MDI constraints, Korea Aerospace Research Institute (KARI) has been developing and improving a tactical scheduler for surface metering at ICN to provide appropriate target times for pushbacks and takeoffs for departure flights under MDIs. This paper describes the MDI requirements at ICN, the development of a heuristic scheduling algorithm to work with the MDI restrictions, and the performance evaluation of the algorithm through fast-time simulations. The performance evaluation results indicate that the proposed heuristic algorithm can provide the surface metering schedules that comply with the MDI restrictions without significant performance degradation.

DMAN (Departure Management)↗
NASA NTRSDate not supplied

Credible Practice of Models and Simulations for Healthcare

As computational models penetrate clinical care and drive healthcare policy decisions, there is increasing need to communicate that model creation and testing follows reasonable credible practice. Although verification and validation have been generally accepted as significant components of a model’s credibility, they cannot be assumed to equate to a holistic credible practice, which includes activities that can impact comprehension and in-depth examination inherent in the development and reuse of the models. This presentation introduces the Ten Rules for credible practice of modeling and simulation in healthcare developed from a comparative multidisciplinary analysis and practitioner survey. These rules establish a unified conceptual framework for modeling and simulation design, implementation, evaluation, dissemination and usage across the modeling and simulation life-cycle. Although some of these are common sense guidelines, many are often missed or misconstrued, even by seasoned practitioners.

credibility↗
NASA NTRS1991

An evaluation of strategic behaviors in a high fidelity simulated flight task - Comparing primary performance to a figure of merit

The usual method of evaluating flight performance during a simulation is to collect as many primary performance measurements as possible. Then analyze all the measurements to find one sensitive to the manipulations imposed on the pilot during the scenario. Although this method can be useful, it is usually unreliable from one study to another. A simulation was conducted to test an integrated figure of merit (FOM) constructed using a standardized procedure. Pilots flew two full-mission scenarios in an instrument trainer with three degrees of motion freedom. The primary performance measurements selected assessed the pilot's performance in accuracy, smoothness, and activity. The results suggest that the integrated FOMs performed comparably to the primary performance measurements in determining which flight imposed the higher demands on the pilot. The standardized construction process allow adjustments to the FOM, so it can be used in different applications.

Bortolussi, Michael R.↗
DOE OSTI2024

Initial Development of Fusion Magnet Simulation Capabilities for Performance and Safety Evaluation Using the MOOSE Framework

Fusion energy holds the promise of being a transformative technology as a carbon-neutral, sustainable source of energy. Whole device modeling and the development of fusion digital twins will be increasingly important for emerging fusion device concepts at both national laboratories and within the commercial fusion industry. However, meeting the challenge of whole device modeling of fusion energy devices requires robust, multiphysics, multiscale modeling and simulation technologies capable of running on large-scale supercomputers. Detailed analysis of individual systems at-scale is also required to ensure safe and efficient operation as well as provide the safety basis for future device designs and licensing activities. In a tokamak, toroidal and poloidal magnets confine and shape the fusion plasma to promote the fusion reaction. High plasma temperatures and high magnetic field requirements in modern design concepts (leading to high amounts of energy stored within each magnet) impose electrical, thermal, and mechanical loads on the magnet components, which in turn impacts the safety considerations of the magnet and their supporting systems. Idaho National Laboratory (INL) has a history of working in this space, including development and benchmarking of the Magnetic System Circuitry Analysis Program (MSCAP) and Magnet Arcing (MAGARC) codes to study magnet quench events; notably, MAGARC was used to study quenching during the ITER Engineering Design Activity. However, these legacy codes and capabilities are not parallel and scalable, and new tools are required for future advances in this area, which leads to the INL-developed Multiphysics Object-Oriented Simulation Environment (MOOSE) framework. Developed originally for fission reactor systems under United States Department of Energy, Office of Nuclear Energy modeling and simulation programs, the MOOSE framework has been well-suited to multiscale, multiphysics modeling and simulation needs for nuclear systems. The framework is open-source, well-tested, under continuous development and deployment, and developed to a Nuclear Quality Assurance, Level 1 software quality standard. MOOSE has also been used in the fusion space previously in several projects: INL’s Tritium Migration Analysis Program, Version 8 (TMAP8) for tritium migration, UK Atomic Energy Authority’s A Unified Resource for OpenMC (fusion) Reactor Applications (AURORA) code for fusion thermo-mechanical and neutronics analysis, and Argonne National Laboratory’s Cardinal for high-fidelity computational fluid dynamics and neutronics. However, to model superconducting magnets, several MOOSE enhancements are required: additions to the current MOOSE electromagnetic capabilities, new material libraries for superconductors of interest (such as YBCO), as well as fusion-specific models for thermo-mechanics. This talk will discuss initial development activities to build these capabilities in MOOSE, focusing on initial validation and benchmarking activities. Proposed coupling workflows and future work to support the simulation of fusion magnets and magnet structural assemblies for performance and safety evaluation in MOOSE will also be discussed.

70 - PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

Evaluation of Force Fields for Molecular Dynamics Simulations of Platinum in Bulk and Nanoparticle Forms

Here, understanding the size- and shape-dependent properties of platinum nanoparticles is critical for enabling the design of nanoparticle-based applications with optimal and potentially tunable functionality. Toward this goal, we evaluated nine different empirical potentials with the purpose of accurately modeling faceted platinum nanoparticles using molecular dynamics simulation. First, the potentials were evaluated by computing bulk and surface properties - surface energy, lattice constant, stiffness constants, and the equation of state - and comparing these to prior experimental measurements and quantum mechanics calculations. Then, the potentials were assessed in terms of the stability of cubic and icosahedral nanoparticles with faces in the {100} and {111} planes, respectively. Although none of the force fields predicts all the evaluated properties with perfect accuracy, one potential - the embedded atom method formalism with a specific parameter set - was identified as best able to model platinum in both bulk and nanoparticle forms.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS1967

Onboard operations for rendezvous

An overall plan for onboard rendezvous operations for the Gemini missions was developed in parallel with the mission plan. The purpose of this plan was to make optimum use of crew time in orbit to maximize the probability of a successful rendezvous. The evolution of the plan began with a preliminary time line of events based upon the known guidance-equipment requirements and upon the estimated crew timing. A preliminary set of flight charts was developed to aid the crew with primary and backup procedures and to establish a backup guidance capability. These charts, which consisted of a few simple graphs and tabulation sheets, enabled the crew to calculate accurate solutions for the terminal maneuvers even with an inoperative guidance-equipment component. As such, the charts significantly contributed to the probability of mission success. Following the development of the charts, an engineering evaluation was conducted on a realistic man-in-the-loop simulation. During this evaluation, the procedures and charts were subjected to the expected equipment errors and trajectory dispersions, and revisions were made as necessary to improve effectiveness. The resulting plan was presented to the flight crew; the charts were evaluated during a period of training on the simulator. The crew spent several weeks training on both the primary procedures and on the various failure modes.

structural integrity↗
DOE OSTI2018

Model Evaluation Report for LNG Dispersion on Fire Dynamics Simulator Version 6.5.3

This report is an assessment of the computational fluid dynamics (CFD) code Fire Dynamics Simulator (FDS), version 6.5.3, using the Model Evaluation Protocol (MEP) for Liquefied Natural Gas (LNG). The MEP consists of model validation and a scientific assessment that encompasses model information and model verification activities. Model validation entails comparison against various field and wind-tunnel trials for LNG and other dense gases with and without obstructions. The results indicate that FDS is generally over-predictive for most of the field scale dense gas releases and cases involving obstructions without requiring a safety factor of 2, however, since there are uncertainties in extrapolating to accident scales a safety factor of 2 (1/2 LFL criteria) may be appropriate. The results of this scientific assessment and prior verification efforts demonstrate the soundness of the numerical techniques and robustness of FDS. The validation results indicate that FDS is suitable for modeling dense gas dispersion with and without obstructions.

03 NATURAL GAS↗
NASA NTRS2022

Chapter 10 - Remote Sensing Measurements of Aerosol Properties

Satellite instruments have proven especially capable at monitoring the quantity of airborne particles in columns of atmosphere, globally. This chapter describes the principles of satellite measurements and retrieval algorithms, and surveys current instruments and their capabilities. We outline the issues associated with retrieval algorithms, such as surface characterization and aerosol proximity to clouds, and the challenges with interpretation of the results. The relationship between measured aerosol properties and climate-relevant aerosol properties simulated in models is outlined, as well as how measurements are used to evaluate models. Most space-based aerosol instruments are passive sensors that measure reflected sunlight at multiple wavelengths, some at multiple viewing angles. A few are active sensors that send out their own laser light and measure the returned signal. Except when clouds are present, the excess amount of light scattered back to space, beyond that expected from the surface and atmospheric gas, is attributed to aerosol. Satellite measurements are used in many ways in aerosol research. They often provide the only method for monitoring hazardous phenomena such as major wildfire and volcanic eruption plumes, especially in remote areas. Stable, long-term, near-global-scale satellite data records make it possible to identify regional and global aerosol trends. Aerosol radiative effects on climate can be quantified on a near-global scale and used to estimate the strength of aerosol–radiation and aerosol–cloud interactions as well as to evaluate climate model simulations of these interactions. Aerosol-type mapping from satellite imagery is helpful for source attribution, model validation, and to constrain particle light-absorption properties that are essential for radiative forcing calculations. The range of aerosol properties retrieved from satellite observations has grown considerably since the first global estimates of aerosol optical depth (τ a) over ocean were made in the late 1970s. Methods for retrieving particle size and light-absorption properties were explored in the 1990s using multispectral, multi-angle observations, and polarization in visible and near-infrared wavelengths. Sensitivity to particle light absorption, primarily from black or brown carbon content, improved with the inclusion of UV channels, and sensitivity to very thin aerosol layers in the upper troposphere and lower stratosphere was advanced with the use of limb-sounding instruments and active sensors. There are limitations to every measurement technique, including satellite aerosol remote sensing. For wide-swath, passive instruments, aerosol retrievals near clouds can present substantial challenges as far as 15 km away due to cloud-scattered light contaminating the signal. In nearly all cases, retrievals over bright snow and ice surfaces are precluded because surface reflectance uncertainties can overwhelm the aerosol signal. Similarly, meteorological cloud is identified and masked out where possible. Data from passive sensors also lack vertical resolution except those that view toward the limb or where multi-angle imagery is acquired over plumes from wildfires, erupting volcanoes, and wind-blown dust. Yet, passive sensors provide vastly more coverage than the active instruments that mitigate these issues. Particle microphysical information is qualitative from all remote sensing techniques, relying on proxies to infer particle composition, hygroscopicity, and the amount of light-absorbing material. Further, particles smaller than about 200 nm diameter cannot be distinguished from atmospheric gas molecules with remote sensing, which hinders studies of cloud condensation nuclei and their effects on clouds. Most satellite instruments dedicated to aerosol observations are in low-Earth, near-polar, sun-synchronous orbits, which means they cross the equator at the same local time each day. Most are set on cycles that repeat approximately every 16 days, which makes it difficult to monitor aerosol evolution locally. Geostationary satellites make it possible to observe changes occurring from minutes to hours over regions up to 8000 km in size, but lack coverage of high latitudes, and often provide more limited constraints on aerosol properties. Ground-truth data are vital for satellite aerosol-retrieval validation. The AErosol RObotic NETwork (AERONET) of sun photometers was created in 1993 and has become an established global network of over 350 instruments for validating satellite measurements. The network, as well as global networks of ground-based lidars, solar flux radiometers and other sun photometers, are widely used for evaluating global satellite retrievals and model simulations. NASA's Earth Observing System (EOS) program beginning in 1999 led to improvements in reliability, spatial resolution, and spectral resolution (and hence, to improved particle size discrimination and light absorption properties). Satellite payloads include advanced broad-swath and multi-angle imagers, along with the first space-based active sensor focused largely on long-term aerosol monitoring. Since about 2002, Europe's SENTINEL and operational meteorological satellite fleets are also providing sustained aerosol observations, with planned continuation until at least 2030. Satellite remote sensing instruments offer valuable data for evaluating aerosol representations in global climate models. They have been used to assess aerosol optical and physical properties, trends and distributions, and are applied increasingly as direct model constraints in data assimilation to create global aerosol reanalysis products. Aerosol optical depth is the most common quantity adopted for routine model evaluation, including multiwavelength data to loosely constrain particle-size distributions. These evaluations of multiple models have revealed general biases in their regional aerosol amounts and seasonal patterns of transport and removal. Although satellite measurements have near-global coverage, substantial errors can be introduced into the model observation comparison unless attention is paid to spatial and temporal collocation, cloud screening, subgrid-scale variability, and measurement uncertainties that vary with retrieval conditions.

aerosol properties↗
DOE OSTI2024

Assessment of Electric Grid Transmission System Simulator for Human Factors Research

Over the past decades, various technologies have been developed for electric grid operations to support clean energy, meet rising electricity demands, and address infrastructure concerns. However, the human factors aspect is often overlooked during rapid integration. Questions persist about how these technologies impact human performance. Simulators play a critical role in supporting investigation of human factors design concepts and conducting comprehensive usability testing to evaluate human performance and assess human reliability. This paper aims to address human factors research simulator requirements and conduct a comparative study of six different simulators. A detailed evaluation reveals that the evaluated simulators lack the ability to customize user interfaces. Additionally, their user interface designs do not fulfill the basic human factors design principles, potentially leading to increased response variability and reduced statistical power when conducting controlled experimental research. In the future, it is essential to develop scripting tools to integrate customizable user interfaces and simulation models, ensuring meeting research requirements.

Li, Ruixuan↗