Search NASA⌕ Search

SEARCH · Search NASA

Results for “User evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Remote evaluation of remote console information retrieval system (NASA/RECON)

The technique is described for NASA user evaluation. It consists of sending out an evaluation form with each literature search. The results are presented which are derived from a compilation of user responses. In an eleven-month period in which evaluation forms went out with 3,001 searches, 33.6% of the forms were completed and returned. The returns showed that 88.5% of the respondents found the searches suitable to their needs, 81% learned of valuable new references from the searches, and 93.5% received the searches in time to meet their needs. The significance of relevance or precision ratio in relation to user satisfaction is discussed, and an extrapolation from user responses resulted in a relevance ratio of 49.3%. Some of the general comments found in the responses are analyzed as indicators of what the users expected from the information retrieval service.

Coles, V. L.↗

Review of ride quality technology needs of industry and user groups

A broad survey of ride quality technology state-of-the-art and a review of user evaluation of this technology were conducted. During the study 17 users of ride quality technology in 10 organizations representing land, marine and air passenger transportation modes were interviewed. Interim results and conclusions of this effort are reported.

Mckenzie, J. R.↗

A methodology for evaluation of an interactive multispectral image processing system

Because of the considerable cost of an interactive multispectral image processing system, an evaluation of a prospective system should be performed to ascertain if it will be acceptable to the anticipated users. Evaluation of a developmental system indicated that the important system elements include documentation, user friendliness, image processing capabilities, and system services. The criteria and evaluation procedures for these elements are described herein. The following factors contributed to the success of the evaluation of the developmental system: (1) careful review of documentation prior to program development, (2) construction and testing of macromodules representing typical processing scenarios, (3) availability of other image processing systems for referral and verification, and (4) use of testing personnel with an applications perspective and experience with other systems. This evaluation was done in addition to and independently of program testing by the software developers of the system.

Kovalick, William M.↗

CO2 Handling & Electrolyzer Efficiency Scaling Evaluator

CHEESE is an interactive dashboard tool for estimating the performance and material requirements of carbon dioxide electrolysis systems. It helps users evaluate how electrode area, current density, product selectivity, gas flow, cell voltage, and the number of cells in a stack affect system operation. The dashboard provides simple and advanced modes so it can be used for both quick estimates and more detailed engineering analysis. Users can estimate product output, carbon dioxide use, electrical power, electrode area, gas and liquid flow rates, energy efficiency, material cost per test, and the effect of scaling from a single cell to a multi cell stack. It also includes tools for examining carbon balance, equipment durability, component replacement, and changes in performance over time. This is intended to help both academia and industry researchers who are either getting into CO2 electrolysis on lab-scale or are trying to establish a larger footprint. CHEESE presents results through tables, charts, and simplified cell and stack diagrams. It is intended to support research planning, experimental design, comparison of operating conditions, and early stage scale up studies.

Prajapati, Aditya [Lawrence Livermore National Lab↗

Propulsion Diagnostic Method Evaluation Strategy (ProDiMES) User's Guide

This report is a User's Guide for the Propulsion Diagnostic Method Evaluation Strategy (ProDiMES). ProDiMES is a standard benchmarking problem and a set of evaluation metrics to enable the comparison of candidate aircraft engine gas path diagnostic methods. This Matlab (The Mathworks, Inc.) based software tool enables users to independently develop and evaluate diagnostic methods. Additionally, a set of blind test case data is also distributed as part of the software. This will enable the side-by-side comparison of diagnostic approaches developed by multiple users. The Users Guide describes the various components of ProDiMES, and provides instructions for the installation and operation of the tool.

Simon, Donald L.↗

Interactive analysis and evaluation of ERTS data for regional planning and urban development: A Los Angeles Basin case study

The progression endemic to the ERTS Data Use Experiment SR 124 in data quality, analysis sophistication and applications responsiveness is reviewed. The roles of the variety of ERTS products, including the supporting underflight aircraft imagery at various scales, are discussed in the context of this investigation. The versatility of interpretation techniques and outputs developed and implemented via the General Electric Multispectral Information Extraction Systems is described and exemplified by both system-expository and applications-explanatory products. The wide-ranging and in-depth applications studied in the course of this experiment can be characterized as community-oriented and agency-directed. In the former, generic category, which is primarily data-contextual, problems analyzed dealt with agricultural systems, surface water bodies, snow cover, brush fire burns, forestry, grass growth, parks - golf courses - cemeteries, dust storms, grading sites, geological features and coastal water structure. The ERTS MSS band selectivity and measurements thresholds were of primary interest here. The agency-directed application areas have been user-evaluational in nature. Beginning with overall urbanized regional analysis of land cover density-development intensity, residential areas were analyzed for ascertaining if housing types could be aggregated with any degree of reliability.

Raje, S.↗

Developing a Dashboard Interface to Display Assessment of Hazards and Risks to sUAS Flights

The Supplemental Data Services Provider-Consolidated Dashboard (SDSP-CD) is a graphical user interface (GUI) that displays the results of predictive tools in a single location. It is intended to be used in the preflight planning phase of an operation to allow users to proactively assess predicted flight hazards off-line; expanding an operator’s overall situational awareness of a flight plan and providing an opportunity for decision making and assessing the associated risks prior to flight. Hazard data and risk predictions are informative but can be complex to read and understand. However, presented visually and in relation to flight parameters (such as flight path), the nature and significance of hazards become much more evident. The SDSP-Consolidation Dashboard interface was designed to offer a means to present the results of hazard services in an easy to-use format. Two usability studies were run to explore what features might make a suite of hazard assessment services easy to use, and to assess the SDSP-CD interface. The first study evaluated the presentation of information on the GUI and the second evaluated users’ ability to understand and use the information. The studies gathered valuable information about how users approach a hazard assessment task and interpret information from the interface. Many suggestions were given for improving the interface’s information display, to allow users to more quickly understand and interpret the information being presented.

UAV display↗

Developing a Dashboard Interface to Display Assessment of Hazards and Risks to sUAS Flights

The Supplemental Data Services Provider-Consolidated Dashboard (SDSP-CD) is a graphical user interface (GUI) that displays the results of predictive tools in a single location. It is intended to be used in the prefight planning phase of an operation to allow users to proactively assess predicted flight hazards off-line; expanding an operator’s overall situational awareness of a flight plan and providing an opportunity for decision making and assessing the associated risks prior to flight. Hazard data and risk predictions are informative but can be complex to read and understand. However, presented visually and in relation to flight parameters (such as flight path), the nature and significance of hazards become much more evident. The SDSP-Consolidation Dashboard interface was designed to offer a means to present the results of hazard services in an easy to-use format. Two usability studies were run to explore what features might make a suite of hazard assessment services easy to use, and to assess the SDSP-CD interface. The first study evaluated the presentation of information on the GUI and the second evaluated users’ ability to understand and use the information. The studies gathered valuable information about how users approach a hazard assessment task and interpret information from the interface. Many suggestions were given for improving the interface’s information display, to allow users to more quickly understand and interpret the information being presented

UAV display↗

Developing Digital Twin Visualizations: A Methodology and Case Study on Chemical Separation Processing

As advances in digital engineering continue to push the technological boundaries, digital twin (DT) visualizations for diagnostics and safeguards advancement become much more feasible and practical. DTs generate large and complex data streams that require effective user interfaces to provide monitoring and diagnostic capabilities. Unfortunately, while these frameworks exist, there is not much research on the systematic documentation of human–computer interaction (HCI) for DT visualization. This work presents a dual-mode visualization methodology (two dimensional [2D] graphical user interface dashboard and 3D mixed reality) designed to support diagnostic tasks in DT systems and building on a validated framework and applying established HCI principles. The methodology is demonstrated through a case study of aqueous processing at Idaho National Laboratory, using experimental data from the chemical solvent extraction runs. Our interfaces display real-time alerts and monitoring to inform users of safeguards anomalies. The interfaces use immersive 3D mixed-reality visualization for further system and experiment investigation. This work demonstrates how the systematic application of HCI principles can inform DT visualization design for diagnostic and safeguards applications. While formal user evaluation studies remain as future work, this paper documents the systematic design methodology and demonstrates a proof-of-concept implementation.

3D visualization↗

“Which Projections Do I Use?” Strategies for Climate Model Ensemble Subset Selection Based on Regional Stakeholder Needs

Climate model (or earth system model) projections are increasingly used for climate adaptation planning and impact assessments. As part of this process, many end‐users evaluate a subset of downscaled climate projections without being aware of the implications of downscaling methodology for statistics or event outcomes. Approaches for determining a subset of global climate models to use often focus on values from the raw models, rather than from their downscaled counterparts, in other words assuming that the statistical distribution of the multi‐model ensemble does not change post downscaling. This study demonstrates that a downscaled ensemble will typically retain the change distribution as a raw ensemble, but individual models can differ dramatically post‐downscaling. We recommend that subset‐selection methods account for this possibility and that decision‐relevant downscaled climate projections provide proper descriptions of fitness‐for‐purpose and essential caveats, so that non‐specialists can interpret the results with an appropriate level of confidence.

54 ENVIRONMENTAL SCIENCES↗

Community Public Mobility Using On-Demand, Low-Speed Electric Vehicles: A Case Study in Downtown St. Louis, Missouri

Legacy fixed route transit systems designed to serve commuters struggle to provide efficient and effective service for short neighborhood trips and for population groups unable to access and egress transit stops using active modes (e.g., elderly, disabled). Neighborhood on-demand transit (ODT) services using low-speed electric vehicles (LSEV) are an innovative technological solution that can help fill this gap in service (e.g., short, high-frequency trips) for diverse populations and trip types. This study evaluated user characteristics and travel behavior for a neighborhood ODT service (using LSEVs) in downtown St. Louis, Missouri using responses from a community survey (n=244), ridership data, and vehicle trajectory information. A comparative analysis between neighborhood ODT, fixed route transit, and transportation network companies (TNC) was also conducted from the perspectives of total travel time, cost, and greenhouse gas emissions. Ultimately, the goal of the analysis was to motivate and inform holistic public mobility systems where different services are optimized to meet specific community needs. Findings indicate that the neighborhood ODT was effective at reaching diverse populations (elderly (20%), lower income (27%), and households with limited access to private vehicles (34%)). ODT reduced total travel time by 32% compared to fixed route transit, produced 2.4 - 4.3 times less greenhouse gas emissions per passenger mile (compared to transit and TNCs), and was more affordable (free to users) than alternative options ($1 for transit, $10-12 for TNCs). Overall satisfaction rates were high, with 80% of respondents rating the service a 4 or 5 out of 5.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Central Atlantic regional ecological test site: A prototype regional environment information system

The author has identified the following significant results. Prior to the actual testing of data from ERTS-1, the principal scientific results to date are the establishment of a model or design for a regional land use information system based on remote sensor data and a firm establishment of the RB-57 type high altitude aircraft data base as an important tool in land use mapping. Preliminary user evaluations of the resulting land use data have been favorable, and one of the states, Maryland, has adopted the USGS-GAP land use system as a first step towards mapping their entire state. The State is funding an extension (to the west) of the part of Maryland not covered by CARETS (Central Atlantic Regional Ecological Test Site), using the GAP land use classification and mapping procedures.

Alexander, R. H.↗

AgRISTARS: Renewable resources inventory. Land information support system implementation plan and schedule

The planning and scheduling of the use of remote sensing and computer technology to support the land management planning effort at the national forests level are outlined. The task planning and system capability development were reviewed. A user evaluation is presented along with technological transfer methodology. A land management planning pilot test of the San Juan National Forest is discussed.

Yao, S. S.↗

Development of a fully automated fluid resupply interface system

The results of a cooperative effort to develop fluid components and systems that facilitate on-orbit servicing are discussed. The evolution from manual couplings to semi-automatic dual line interfaces to fully automatic multi-line resupply interfaces is traced. Hardware designs are presented in the context of solutions to requirements. Test data and user evaluations are reviewed.

Cardin, J. M.↗

A human factors approach to range scheduling for satellite control

Range scheduling for satellite control presents a classical problem: supervisory control of a large-scale dynamic system, with unwieldy amounts of interrelated data used as inputs to the decision process. Increased automation of the task, with the appropriate human-computer interface, is highly desirable. The development and user evaluation of a semi-automated network range scheduling system is described. The system incorporates a synergistic human-computer interface consisting of a large screen color display, voice input/output, a 'sonic pen' pointing device, a touchscreen color CRT, and a standard keyboard. From a human factors standpoint, this development represents the first major improvement in almost 30 years to the satellite control network scheduling task.

Wright, Cameron H. G.↗

MiniSODAR(TradeMark) Evaluation

This report describes results of the AMU's Instrumentation and Measurement task for evaluation of the Doppler miniSODAR(TradeMark) System (DmSS). The DmSS is an acoustic wind profiler providing high resolution data to a height of approx. 410 ft. The Boeing Company installed a DmSS near Space Launch Complex 37 in mid-2002 as a substitute for a tall wind tower and plans to use DmSS data for the analysis and forecasting of winds during ground and launch operations. Peak wind speed data are of particular importance to Launch Weather Officers of the 45th Weather Squadron for evaluating user Launch Commit Criteria. The AMU performed a comparative analysis of wind data between the DmSS and nearby wind towers from August 2002 to July 2003. The DmSS vertical profile of average wind speed showed good agreement with the wind towers. However, the DMSS peak wind speeds were higher, on average, than the wind tower peak wind speeds by about 25%. A statistical model of an idealized Doppler profiler was developed and it predicted that average wind speeds would be well determined but peak wind speeds would be over-estimated due to an under-specification of vertical velocity variations in the atmosphere over the Profiler.

Short, David A.↗

D-Side: A Facility and Workforce Planning Group Multi-criteria Decision Support System for Johnson Space Center

"To understand and protect our home planet, to explore the universe and search for life, and to inspire the next generation of explorers" is NASA's mission. The Systems Management Office at Johnson Space Center (JSC) is searching for methods to effectively manage the Center's resources to meet NASA's mission. D-Side is a group multi-criteria decision support system (GMDSS) developed to support facility decisions at JSC. D-Side uses a series of sequential and structured processes to plot facilities in a three-dimensional (3-D) graph on the basis of each facility alignment with NASA's mission and goals, the extent to which other facilities are dependent on the facility, and the dollar value of capital investments that have been postponed at the facility relative to the facility replacement value. A similarity factor rank orders facilities based on their Euclidean distance from Ideal and Nadir points. These similarity factors are then used to allocate capital improvement resources across facilities. We also present a parallel model that can be used to support decisions concerning allocation of human resources investments across workforce units. Finally, we present results from a pilot study where 12 experienced facility managers from NASA used D-Side and the organization's current approach to rank order and allocate funds for capital improvement across 20 facilities. Users evaluated D-Side favorably in terms of ease of use, the quality of the decision-making process, decision quality, and overall value-added. Their evaluations of D-Side were significantly more favorable than their evaluations of the current approach. Keywords: NASA, Multi-Criteria Decision Making, Decision Support System, AHP, Euclidean Distance, 3-D Modeling, Facility Planning, Workforce Planning.

Tavana, Madjid↗

Hybridized Agile Software Development of Flight Control Team Tools for International Space Station's Payload Operations Integration Center

Ground systems operations at the National Aeronautics and Space Administration's (NASA) Payload Operations and Integration Center (POIC) at Marshall Space Flight Center (MSFC) recently increased via a High Operations Tempo (HOT) initiative, in order to support more science activities with a fourth crew member on the International Space Station (ISS). The Flight Control Team's (FCT) need to support this increasing pace of payload science operations was the impetus for creating a series of new tools. While their need was clear, the full scope and user experience for each tool was not as well-understood, thus establishing a fixed set of initial requirements was not feasible. A hybridized Agile Software Development (ASD) paradigm was created to take advantage of this uncertainty, plan for it, permit the exploration of novel concepts, and also facilitate a rapid and flexible response to inevitably changing requirements. The POIC's hybridized ASD approach places preeminent focus on providing customer value through the delivery of high quality, customer-focused solutions in short timeframes. This has been successfully achieved through creating unprecedented modes of cooperation and collaboration between operations and software development teams, frequent user evaluations of the software with well-defined feedback mechanisms, increased human factors involvement, and a dedication to successful outcomes by the whole of the POIC. Since space science operations and software development are not typically so closely linked, this paper discusses an approach that offers an optimal way to provide an increased return on investment and a faster time-to-completion than traditional software development paradigms, while aiming at delivering high quality products and customer-driven value.

Albers, Cerese M.↗