SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Introduction to User Experience: principles, user research, and incorporating user feedback. Defining user experience and how to improve the control system by incorporating user experience processes and methods.
Current trends in the spacecraft mission operations area (spacecraft & mission complexity, project duration, required flexibility are requiring a breakthrough for what concerns philosophy, organization, and support tools. A major evolution is related to space operations 'informationalization', i.e adding to existing operations support & data processing systems a new generation of tools based on advanced information technologies (object-oriented programming, artificial intelligence, data bases, hypertext) that automate, at least partially, operations tasks that used be performed manually (mission & project planning/scheduling, operations procedures elaboration & execution, data analysis & failure diagnosis). All the major facets of this 'informationalization' are addressed at MATRA MARCONI SPACE, operational applications were fielded and generic products are becoming available. These various applications have generated a significant feedback from the users (at ESA, CNES, ARIANESPACE, MATRA MARCONI SPACE), which is now allowing us to precisely measure how the deployment of this new generation of tools, that we called OPSWARE, can 'reengineer' current spacecraft mission operations philosophy, how it can make space operations faster, better, and cheaper. This paper can be considered as an update of the keynote address 'Knowledge-Based Systems for Spacecraft Control' presented during the first 'Ground Data Systems for Spacecraft Control' conference in Darmstadt, June 1990, with a special emphasis on these last two years users feedback.
The NASA Earth Observation System Data and Information System (EOSDIS) has been operating since 1994 and is serving a global user community with well-managed Earth science data in a variety of scientific disciplines. EOSDIS processes, archives and distributes data and information products resulting from spaceborne and airborne instruments as well as in situ measurements from field campaigns. The Earth Science Data and Information System (ESDIS) Project at the NASA Goddard Space Flight Center manages EOSDIS with its 12 Distributed Active Archive Centers (DAACs) located across the United States. During the entire life of EOSDIS, the ESDIS Project and the DAACs have deployed many different mechanisms for user feedback, which have proven extremely valuable to their evolution and performance in their service to user communities. Some of the inputs from our user groups have resulted in fundamental changes in the architecture, design and operations of EOSDIS, while others have provided novel ideas for incremental changes. The EOSDIS DAACs have User Working Groups (UWGs) that represent broad user communities in the Earth science disciplines served by the DAACs. The UWGs meet periodically to assess and provide feedback on dataset and service priorities. As regular users of the data and services of the DAAC and experts in the scientific disciplines, the UWG members provide valuable inputs for planning and prioritizing the services, as well as addition of new datasets, for the benefit of the community. The EOSDIS is evaluated annually through an independently administered survey of its users resulting in the American Customer Satisfaction Index (ACSI). The survey provides an ACSI score as well as free-text suggestions from users, which are also helpful in making specific system improvements. In addition, each of the DAACs has a user services group that address on-going requests for help and other comments from users. The ESDIS Project has established a mechanism through the "earthdata" website (http://earthdata.nasa.gov) for users to provide feedback of any kind and these questions/comments are routed to the appropriate individuals in the Project or the DAACs. These various forms of receiving user feedback and responding to them continue to be extremely valuable in evolving and sustaining our Earth Science repository.
Since August 1994, The National Aeronautics and Space Administration's (NASA's) Earth Observation System Data and Information System (EOSDIS) has been serving a global community of over 3 million users with Earth science data in a variety of disciplines. During the entire life of EOSDIS, various mechanisms for user feedback have been extremely important and valuable to its evolution and proven performance. Some inputs from user groups have resulted in fundamental changes in the architecture, design and operations of EOSDIS, while others have provided ideas for incremental changes. The purpose of this paper is to share this experience and the benefits that have resulted from the user feedback.In early to mid-1990s, the EOSDIS Advisory Panel (a.k.a. Data Panel) provided significant inputs for the architecture and design of EOSDIS resulting in NASA's establishment of a set of Distributed Active Archive Centers (DAACs) and development of a "working prototype with operating elements" called Version 0 EOSDIS, which went into operation in August 1994. The Data Panel also participated in many of the requirement and design reviews and influenced the design of EOSDIS through their comments.In 1995, the U.S. National Research Council's Committee on Global Change Research conducted a review of the U.S. Global Change Research Program and NASA's Mission to Planet Earth/EOS, including the plans for EOSDIS. One of this committee's recommendations was that the "Responsibility for product generation and publication and for user services should be transferred to a federation of partners selected through a competitive process open to all". In response, NASA initiated an experiment with a "self-governing" federation called the Working Prototype ESIP (WP-ESIP) Federation. This federation, with support from NASA, NOAA and USGS, has now grown into the Earth Science Information Partners (ESIP) with over 140 member organizations.The EOSDIS DAACs' User Working Groups (UWGs) represent broad user communities served by the respective DAACs. As regular users of the DAACs and experts in their scientific disciplines, the UWG members provide valuable inputs for planning and prioritizing the services as well as addition of new datasets for the benefit of the community.
This study presents the results of Physical Model user interviews conducted with 12 people who have International Atomic Energy Agency (IAEA) safeguards experience. The goal of this report is to provide additional context for policy makers when prioritizing the needs of the IAEA regarding support for enhancements to the Physical Model. The interviews covered the general usability of the Physical Model, its effectiveness as a technical reference, and the scope and utility of the Physical Model's indicators and content. The key conclusions from these interviews are as follows: 1) The Physical Model is difficult to find and not well advertised. 2) The Physical Model can be difficult to use due to its format, which makes searching for information difficult, and lack of visual content. Therefore, the Physical Model should be supported in multiple formats (print, PDF, web) to maximize its usability for different stakeholders. 3) The scope of the Physical Model's content and indicators is likely sufficient, and translating indicators into other languages is unlikely to be worth the effort. 4) Despite its inefficiencies and other issues, the Physical Model in its current form is a vital (albeit under-utilized) resource for key stakeholders. 5) Despite its broad use case the Physical Model is not a catch-all tool and force-fitting the Physical Model into functions for which it has not been designed for would likely diminish its value. 6) It can be difficult to disentangle challenges related to the Physical Model and its usability from broader challenges at the Agency, such as general issues with communication and coordination. Based on these conclusions and considering the results of past studies on the Physical Model funded by NA-241, the analysis team developed a list of recommendations and associated actions for IAEA consideration. These recommendations are prioritized based on the assessed level of difficulty for the IAEA to implement a recommendation, emphasizing low hanging fruit then building to more ambitious changes to the Physical Model's format and content.
Retrieving specific information from large amounts of documentation is not an easy task. It could be facilitated if information relevant in the current problem solving context could be automatically supplied to the user. As a first step towards this goal, we have developed an intelligent hypertext system called CID (Computer Integrated Documentation). Besides providing an hypertext interface for browsing large documents, the CID system automatically acquires and reuses the context in which previous searches were appropriate. This mechanism utilizes on-line user information requirements and relevance feedback either to reinforce current indexing in case of success or to generate new knowledge in case of failure. Thus, the user continually augments and refines the intelligence of the retrieval system. This allows the CID system to provide helpful responses, based on previous usage of the documentation, and to improve its performance over time. We successfully tested the CID system with users of the Space Station Freedom requirements documents. We are currently extending CID to other application domains (Space Shuttle operations documents, airplane maintenance manuals, and on-line training). We are also exploring the potential commercialization of this technique.
"The 2017-2027 Decadal Survey for Earth Science and Applications from Space stated that NASA's Earth Science with planned implementation of applications provides sustained earth observations for societal benefits [1]. The Decadal Survey indicated that data latency is invaluable for time-sensitive applications including disaster risk reduction, wildland fire carbon emissions quantification, real-time measurements of the state of the hydrologic systems and many more. Data latency refers to the time between earth observation and data products available to users. During the past 13 years, NASA's Land, Atmosphere Near Real-Time Capability for Earth Observing Systems (LANCE) continues to provide free access to earth observation products that are made available much quicker than routine processing allows. The latency of most LANCE data products is Near Real-time (NRT) which is defined as less than three hours from satellite observations [2]. LANCE is managed by the Earth Science Data and Information System (ESDIS) Project at NASA Goddard Space Flight Center [3], and a User Working Group (UWG) is responsible for providing guidance to LANCE. LANCE data are used by direct users and brokers who add value to the data [4]. NASA Earth Applied Sciences Program (ASP) is one of the primary users of LANCE, which collaborates with partner organizations and provides support to scientists to solve problems in applications of earth observations. ASP promotes the use of LANCE NRT data products to demonstrate applications in decision making, facilitates end-user feedback to the science team to improve data products, and provides information on future demands for research. LANCE supports applications that need a rapid response including detecting wildland fires and volcanic eruptions, tracking smoke, ash and dust plumes, monitoring air quality and tracking extreme weather events such as hurricanes, landslides, and floods. To gather feedback regarding the availability, accessibility and actionability of NASA's NRT data products for societal benefit, three surveys and a few discussions with experts involved in the topic within ASP were conducted from the perspective of users. Feedback has been collected from users who are interested in using low latency NASA data within application communities of agriculture, disasters, water resources, health and air quality, ecological conservation, wildland fires and capacity building. Analysis-ready NRT data products in a variety of formats have been mentioned many times in the collected feedback, especially for applied users with little to no experience using research-grade earth observation products. Users prefer to have products that can be easily integrated into their existing workflows and take their analysis to the data. HDF5 is a commonly used data format for research, but typically requires some conversion to a more friendly format for applications and regular use in decision-making. Users prefer the GeoTIFF data format that can be directly ingested into a GIS mapping software and platform for data analysis and visualization. For example, LANCE’s fire, flood, SO2 and Black Marble Nighttime Blue/Yellow Composite data products have been integrated into NASA Disasters Mapping Portal, which is an GIS-based open data portal, for users in the disaster management community. There are 291 LANCE NRT layers available through GIBS and Worldview, where users can download a snapshot in GeoTIFF format. Operational users expect data to be processed as close to the user as possible. The collected feedback indicates that LANCE fire products within 3 hours latency would meet the needs of the wildland fire community. The ideal latency for volcanic application is 10-15 minutes. Users in Volcanic Ash Advisory Centers (VAAC) reported that the first forecast volcanic product should be issued within 75 minutes from the volcano eruption [5]. Overall, for disaster applications, data latency within 3 hours is useful while latency greater than 12 hours is not timely enough for operational use. Capacity building and training are critical for users to be able to access, interpret and use data products and tools for their decision making, especially for applied users with limited experience using earth observation products. LANCE data products have been used in a number of capacity building projects domestically and internationally [6]. As LANCE continues to bring new products into the system, users request training to utilize LANCE new and upcoming data products and capabilities in their applications. Due to the limitation of bandwidth and downstream flow paths, users in some developing countries need tools to select and download data for a specific area of interest instead of bulk downloads. The collected feedback also shows the lack of available SAR satellite low latency data products. The advantages of SAR to monitor conditions and changes on the ground through darkness, clouds, volcanic ash, and other atmospheric conditions, are appealing to low latency users. For example, terabytes of low latency but cloudy optical images are not helpful in rapidly identifying the extent of flood or fire impacts. LANCE could be complemented with low latency measurements via the upcoming NASA-ISRO Synthetic Aperture Radar (NISAR) mission [7]. Requests for higher spatial resolution products are expressed. A user from the wildland fire management community reported that products with 30-m spatial resolution could be used to detect small fires. The 30-m Landsat OLI fire data is now part of NASA’s Fire Information for Resource Management System (FIRMS) US/Canada [8]. Within the open and free NASA resources, LANCE disseminates NRT data products in a manner that allows them to be accessible and understandable to both scientific and applied users. In many application areas, latency plays an important or even decisive role where low latency earth observations help people to observe areas of interest, detect and track changes in the environment and make timely decisions. NASA’s Earth Applied Sciences Program promotes the use of LANCE NRT products and builds a bridge between application users and research teams. The collected feedback indicates data latency within 3 hours is useful for most of the applications, and shows the needs of user-friendly, analysis-ready products, and requests training on LANCE’s new and upcoming data products. User feedback has been provided to LANCE UWG for guidance and recommendations, and for translating findings into something actionable.
An essential factor for remote sensing data products in impacting decision making is latency, or the time between earth observation and data are available to users. In many applications areas, latency plays an important or even decisive role where low latency earth observations help people to make timely, data-based decisions. Within the open and free NASA resources, NASA’s Land, Atmosphere Near real-time Capability for Earth Observing System (EOS) (LANCE) supports users interested in monitoring a wide variety of natural and man-made phenomena using near real-time (NRT) data products that are made available much quicker than routine processing allows. The combination of all available LANCE satellite products provides global coverage at multiple times per day, which makes it possible to meet user needs in various areas of applications including water resources, agriculture, air quality, wildland fire and many other disasters monitoring and management. As one of the prime users of LANCE, NASA’s Earth Science Applied Sciences Program promotes the use of LANCE data products to demonstrate applications in decision making and facilitates the end-user feedback to the science team to improve data products. One of the most critical applications that we expect data to be processed as close to the user as possible is wildland file response and management. User feedback indicates that LANCE NRT fire data products within 3 hours latency would meet the needs of the wildland fire community. Other examples of earth science application areas for which low latency is particularly important include detecting volcanic eruptions, early warning of disasters, tracking extreme weather events, and monitoring air quality.
Rapid and effective to information in large electronic documentation systems can be facilitated if information relevant in an individual user's content can be automatically supplied to this user. However most of this knowledge on contextual relevance is not found within the contents of documents, it is rather established incrementally by users during information access. We propose a new model for interactively learning contextual relevance during information retrieval, and incrementally adapting retrieved information to individual user profiles. The model, called a relevance network, records the relevance of references based on user feedback for specific queries and user profiles. It also generalizes such knowledge to later derive relevant references for similar queries and profiles. The relevance network lets users filter information by context of relevance. Compared to other approaches, it does not require any prior knowledge nor training. More importantly, our approach to adaptivity is user-centered. It facilitates acceptance and understanding by users by giving them shared control over the adaptation without disturbing their primary task. Users easily control when to adapt and when to use the adapted system. Lastly, the model is independent of the particular application used to access information, and supports sharing of adaptations among users.
The use of unmanned aircraft systems (UAS) to support disaster management is becoming more widespread. Uninhibited by many of the operational constraints imposed on crewed aircraft, UAS have the potential to augment the aerial response in a number of ways, including supporting situation awareness, thereby accelerating disaster management efforts. The intent of the Scalable Traffic management for Emergency Response Operations (STEReO) activity is to build an ecosystem that will allow small UAS (sUAS) operations to fly safely in the airspace during disaster management events. The first step toward this goal is to develop a small, single-user tool (the UASP-kit) that will enhance an sUAS pilot’s situation awareness of the airspace. User needs for the functions and features of this tool were collected during a walkthrough over multiple days with subject matter experts from the US Forest Service. A prototype of the UASP-kit was then taken on an extended demonstration to multiple users, who were able to interact with it. User feedback was largely positive and users discussed the information they needed to support situation awareness in context. The demonstration also highlighted features that were unintuitive to use, and functions that need to be modified to make the kit more user-friendly and robust.
The use of unmanned aircraft systems (UAS) to support disaster management is becoming more widespread. Uninhibited by many of the operational constraints imposed on crewed aircraft, UAS have the potential to augment the aerial response in a number of ways, including supporting situation awareness, thereby accelerating disaster management efforts. The intent of the Scalable Traffic management for Emergency Response Operations (STEReO) activity is to build an ecosystem that will allow small UAS (sUAS) operations to fly safely in the airspace during disaster management events. The first step toward this goal is to develop a small, single-user tool (the UASP-kit) that will enhance an sUAS pilot’s situation awareness of the airspace. User needs for the functions and features of this tool were collected during a walkthrough over multiple days with subject matter experts from the US Forest Service. A prototype of the UASP-kit was then taken on an extended demonstration to multiple users, who were able to interact with it. User feedback was largely positive and users discussed the information they needed to support situation awareness in context. The demonstration also highlighted features that were unintuitive to use, and functions that need to be modified to make the kit more user-friendly and robust.
User Engineering is a new System Engineering perspective responsible for defining and maintaining the user view of the system. Its elements are a process to guide the project and customer, a multidisciplinary team including hard and soft sciences, rapid prototyping tools to build user interfaces quickly and modify them frequently at low cost, and a prototyping center for involving users and designers in an iterative way. The main consideration is reducing the risk that the end user will not or cannot effectively use the system. The process begins with user analysis to produce cognitive and work style models, and task analysis to produce user work functions and scenarios. These become major drivers of the human computer interface design which is presented and reviewed as an interactive prototype by users. Feedback is rapid and productive, and user effectiveness can be measured and observed before the system is built and fielded. Requirements are derived via the prototype and baselined early to serve as an input to the architecture and software design.
Marine renewable energy (i.e., wave, tidal or ocean current, thermal gradient, and salinity gradient) or MRE can revolutionize ocean observing capabilities. Five use cases representing a range of ocean observing platforms were developed based on end-user feedback. Drawing from these use cases, common needs or functional requirements were developed to help guide the integration of MRE power delivery for ocean observation structures and functions. The functional requirements were determined from descriptions of the use cases, specifications of hardware that are used or closely associated with existing ocean observation platforms, and direct feedback from ocean observation sensor/platform developers and users. Twenty types of functional requirements were identified, including those associated with power and energy use; physical system requirements; temperature and depth; electrical, acoustic, and motion interference; and reliability. Each set of functional requirements is illustrated as features of the use cases. By defining functional requirements for MRE technology integration in ocean observing platforms, and focusing on end-user requirements, barriers to developing MRE-driven ocean observation missions can be reduced.
The Earthdata Search Client has undergone multiple rounds of usability testing during 2017 and the user feedback received has resulted in an enhanced user interface. This session will showcase the new Earthdata Search Client user interface and provide hands-on experience for participants to learn how to search, visualize and download data in the desired format.
Marine renewable energy (i.e., wave, tidal or ocean current, thermal gradient, and salinity gradient) or MRE can revolutionize ocean observing capabilities. Five use cases representing a range of ocean observing platforms were developed based on end-user feedback. Drawing from these use cases, common needs or functional requirements were developed to help guide the integration of MRE power delivery for ocean observation structures and functions. The functional requirements were determined from descriptions of the use cases, specifications of hardware that are used or closely associated with existing ocean observation platforms, and direct feedback from ocean observation sensor/platform developers and users. Twenty types of functional requirements were identified, including those associated with power and energy use; physical system requirements; temperature and depth; electrical, acoustic, and motion interference; and reliability. Each set of functional requirements is illustrated as features of the use cases. By defining functional requirements for MRE technology integration in ocean observing platforms, and focusing on end-user requirements, barriers to developing MRE-driven ocean observation missions can be reduced.
In an effort to upgrade and provide a unified and improved instrument control and data acquisition system for the Oak Ridge National Laboratory (ORNL) small-angle neutron scattering (SANS) instrument suite—biological small-angle neutron scattering instrument (Bio-SANS), the extended q-range small-angle neutron scattering diffractometer (EQ-SANS), the general-purpose small-angle neutron scattering diffractometer (GP-SANS)—beamline scientists and developers teamed up and worked closely together to design and develop a new system. We began with an in-depth analysis of user needs and requirements, covering all perspectives of control and data acquisition based on previous usage data and user feedback. Our design and implementation were guided by the principles from the latest user experience and design research and based on effective practices from our previous projects. In this article, we share details of our design process as well as prominent features of the new instrument control and data acquisition system. The new system provides a sophisticated Q-Range Planner to help scientists and users plan and execute instrument configurations easily and efficiently. The system also provides different user operation interfaces, such as wizard-type tool Panel Scan, a Scripting Tool based on Python Language, and Table Scan, all of which are tailored to different user needs. The new system further captures all the metadata to enable post-experiment data reduction and possibly automatic reduction and provides users with enhanced live displays and additional feedback at the run time. We hope our results will serve as a good example for developing a user-friendly instrument control and data acquisition system at large user facilities.
The technology described in this paper was designed to reduce latency to user interactions in immersive virtual reality environments. It is also ideally suited to telerobotic applications such as interaction with remote robotic manipulators in space or in deep sea operations. in such circumstances the significant latency is observed response to user stimulus which is due to communications delays, and the disturbing jerkiness due to low and unpredictable frame rates on compressed video user feedback or computationally limited virtual worlds, can be masked by our techniques. The user is provided with highly responsive visual feedback independent of communication or computational delays in providing physical video feedback or in rendering virtual world images. Virtual and physical environments can be combined seamlessly using these techniques.