Search NASA⌕ Search

SEARCH · Search NASA

Results for “semantic interaction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2019

TexTonic: Interactive Visualization for Exploration and discovery of Very Large Text Collections

TexTonic is a visual analytic system for interactive exploration of very large unstructured text collections. TexTonic visualizes hierarchical clusters of representative terms, snippets, and documents in a single, multi-scale spatial layout. Exploration is supported by interacting with the visualization and directly manipulating the terms in the visualization using semantic interactions. These semantic interactions steer the underlying analytic model by translating user interactions within the visualization to contextual updates to the supporting data model. The combination of semantic interactions and information visualization at multiple levels of the data hierarchy helps users manage information overload so that they can more effectively explore very large text collections. In this paper we describe TexTonic’s data processing and analytic pipeline, user interface and interaction design principles, and the results of a user study conducted mid-development with experienced data analysts. We also discuss the implications TexTonic could have on visual exploration and discovery tasks

human centered computing, Visual analytics, Inform↗
DOE OSTI2015

Mixed Initiative Visual Analytics Using Task-Driven Recommendations

Visual data analysis is composed of a collection of cognitive actions and tasks to decompose, internalize, and recombine data to produce knowledge and insight. Visual analytic tools provide interactive visual interfaces to data to support tasks involved in discovery and sensemaking, including forming hypotheses, asking questions, and evaluating and organizing evidence. Myriad analytic models can be incorporated into visual analytic systems, at the cost of increasing complexity in the analytic discourse between user and system. Techniques exist to increase the usability of interacting with such analytic models, such as inferring data models from user interactions to steer the underlying models of the system via semantic interaction, shielding users from having to do so explicitly. Such approaches are often also referred to as mixed-initiative systems. Researchers studying the sensemaking process have called for development of tools that facilitate analytic sensemaking through a combination of human and automated activities. However, design guidelines do not exist for mixed-initiative visual analytic systems to support iterative sensemaking. In this paper, we present a candidate set of design guidelines and introduce the Active Data Environment (ADE) prototype, a spatial workspace supporting the analytic process via task recommendations invoked by inferences on user interactions within the workspace. ADE recommends data and relationships based on a task model, enabling users to co-reason with the system about their data in a single, spatial workspace. This paper provides an illustrative use case, a technical description of ADE, and a discussion of the strengths and limitations of the approach.

active data↗
NASA NTRS2013

V and V of Lexical, Syntactic and Semantic Properties for Interactive Systems Through Model Checking of Formal Description of Dialog

During early phases of the development of an interactive system, future system properties are identified (through interaction with end users in the brainstorming and prototyping phase of the application, or by other stakehold-ers) imposing requirements on the final system. They can be specific to the application under development or generic to all applications such as usability principles. Instances of specific properties include visibility of the aircraft altitude, speed… in the cockpit and the continuous possibility of disengaging the autopilot in whatever state the aircraft is. Instances of generic properties include availability of undo (for undoable functions) and availability of a progression bar for functions lasting more than four seconds. While behavioral models of interactive systems using formal description techniques provide complete and unambiguous descriptions of states and state changes, it does not provide explicit representation of the absence or presence of properties. Assessing that the system that has been built is the right system remains a challenge usually met through extensive use and acceptance tests. By the explicit representation of properties and the availability of tools to support checking these properties, it becomes possible to provide developers with means for systematic exploration of the behavioral models and assessment of the presence or absence of these properties. This paper proposes the synergistic use two tools for checking both generic and specific properties of interactive applications: Petshop and Java PathFinder. Petshop is dedicated to the description of interactive system behavior. Java PathFinder is dedicated to the runtime verification of Java applications and as an extension dedicated to User Interfaces. This approach is exemplified on a safety critical application in the area of interactive cockpits for large civil aircrafts.

human-computer interface↗
DOE OSTI2022

Robust High-Throughput Phenotyping with Deep Segmentation Enabled by a Web-Based Annotator

The abilities of plant biologists and breeders to characterize the genetic basis of physiological traits are limited by their abilities to obtain quantitative data representing precise details of trait variation, and particularly to collect this data at a high-throughput scale with low cost. Although deep learning methods have demonstrated unprecedented potential to automate plant phenotyping, these methods commonly rely on large training sets that can be time-consuming to generate. Intelligent algorithms have therefore been proposed to enhance the productivity of these annotations and reduce human efforts. We propose a high-throughput phenotyping system which features a Graphical User Interface (GUI) and a novel interactive segmentation algorithm: Semantic-Guided Interactive Object Segmentation (SGIOS). By providing a user-friendly interface and intelligent assistance with annotation, this system offers potential to streamline and accelerate the generation of training sets, reducing the effort required by the user. Our evaluation shows that our proposed SGIOS model requires fewer user inputs compared to the state-of-art models for interactive segmentation. As a case study of the use of the GUI applied for genetic discovery in plants, we present an example of results from a preliminary genome-wide association study (GWAS) of in planta regeneration in Populus trichocarpa (poplar). We further demonstrate that the inclusion of a semantic prior map with SGIOS can accelerate the training process for future GWAS, using a sample of a dataset extracted from a poplar GWAS of in vitro regeneration. The capabilities of our phenotyping system surpass those of unassisted humans to rapidly and precisely phenotype our traits of interest. The scalability of this system enables large-scale phenomic screens that would otherwise be time-prohibitive, thereby providing increased power for GWAS, mutant screens, and other studies relying on large sample sizes to characterize the genetic basis of trait variation. Our user-friendly system can be used by researchers lacking a computational background, thus helping to democratize the use of deep segmentation as a tool for plant phenotyping.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

VizBrick: A GUI-based Interactive Tool for Authoring Semantic Metadata for Building Datasets

Brick ontology is a unified semantic metadata schema to address the stand-ardization problem of buildings' physical, logical, and virtual assets and the relationships between them. Creating a Brick model for a building dataset means that the dataset's contents are semantically described using the standard terms defined in the Brick ontology. It will enable the benefits of data standardization, without having to recollect or reorganize the data and opens the possibility of automation leveraging the machine readability of the semantic metadata. The problem is that authoring Brick models for building datasets often requires knowledge of semantic technology (e.g., on-tology declarations and RDF syntax) and leads to repeated manual trial and error processes, which can be time-consuming and challenging to do with-out an interactive visual representation of the data. We developed VizBrick, a tool with a graphical user interface that can assist users in creating Brick models visually and interactively without having to understand the Re-source Description Framework (RDF) syntax. VizBrick provides handy ca-pabilities such as keyword search for easy find of relevant brick concepts and relations to their data columns and automatic suggestions of concept mapping. In this demonstration, we present a use-case of VizBrick to show-case how a Brick model can be created for a real-world building dataset.

Lee, Sangkeun (Matt)↗
DOE OSTI2014

Toward Usable Interactive Analytics: Coupling Cognition and Computation

Interactive analytics provide users a myriad of computational means to aid in extracting meaningful information from large and complex datasets. Much prior work focuses either on advancing the capabilities of machine-centric approaches by the data mining and machine learning communities, or human-driven methods by the visualization and CHI communities. However, these methods do not yet support a true human-machine symbiotic relationship where users and machines work together collaboratively and adapt to each other to advance an interactive analytic process. In this paper we discuss some of the inherent issues, outlining what we believe are the steps toward usable interactive analytics that will ultimately increase the effectiveness for both humans and computers to produce insights.

semantic interaction↗
NASA NTRS2001

Grasping objects by their handles: a necessary interaction between cognition and action

Research has illustrated dissociations between "cognitive" and "action" systems, suggesting that different representations may underlie phenomenal experience and visuomotor behavior. However, these systems also interact. The present studies show a necessary interaction when semantic processing of an object is required for an appropriate action. Experiment 1 demonstrated that a semantic task interfered with grasping objects appropriately by their handles, but a visuospatial task did not. Experiment 2 assessed performance on a visuomotor task that had no semantic component and showed a reversal of the effects of the concurrent tasks. In Experiment 3, variations on concurrent word tasks suggested that retrieval of semantic information was necessary for appropriate grasping. In all, without semantic processing, the visuomotor system can direct the effective grasp of an object, but not in a manner that is appropriate for its use.

NASA Center ARC↗
DOE OSTI2017

Analysis in Motion Initiative – Human Machine Intelligence

As computers and machines become more pervasive in our everyday lives, we are looking for ways for humans and machines to work more intelligently together. How can we help machines understand their users so the team can do smarter things together? The Analysis in Motion Initiative is advancing the science of human machine intelligence — creating human-machine teams that work better together to make correct, useful, and timely interpretations of data.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Semantic Interoperability to Enable Smart, Grid-Interactive Efficient Buildings

Achieving a widespread transition to grid-interactive, efficient buildings (GEBs) depends critically on there being sufficient interoperability among connected building systems. While many critical elements already exist at the technical interoperability level (TCP/IP, BACnet, etc.), a lack of interoperability in the semantic level hinders streamlined integration of interdependent applications. Semantics refers to expressing information about “things” in a way that can be consistently understood by applications. Key components of formalized semantics include identifying what a “thing” is (its “type”), defining general information about that “thing” (its characteristics or properties), and defining the appropriate relationships of that “thing” to other “things” (its function or role in a larger system). Although this might seem initially trivial, the success of smart building applications is highly dependent on maintaining consistent notions of the “things” being self-descriptive. Without semantic interoperability, it is technically difficult, labor-intensive, and cost-prohibitive to enable three key objectives of GEBs: optimizing performance, identifying faults, and delivering grid services. Industry, academia, and standards bodies have invested effort in developing information models to facilitate semantic interoperability, however, they have not been widely adopted across the U.S. commercial building portfolio. This paper will present a pathway to drive semantic interoperability through a three-pronged approach to be led by the DOE Building Technologies Office in partnership with NIST and multiple national laboratories comprising: 1) industry engagement and coordination across existing efforts; 2) a semantic interoperability standard that empowers building owners to identify and require interoperable attributes when procuring equipment and applications; 3) tools to assist in implementation and a test framework that can verify compliance of products with semantic interoperability specifications. This strategic approach is designed to accelerate the timeline for adoption of semantic interoperability standards. The intent is to reduce soft costs associated with implementing advanced controls, fault detection and diagnostics, and other smart building technologies as a necessary step in achieving an energy efficient smart grid future.

semantic interoperability, Semantic modeling, inte↗
DOE OSTI2020

Semantic Interoperability to Enable Smart, Grid-Interactive Efficient Buildings

Achieving a widespread transition to grid-interactive, efficient buildings (GEBs) depends critically on there being sufficient interoperability among connected building systems. While many critical elements already exist at the technical interoperability level (TCP/IP, BACnet, etc.), a lack of interoperability in the semantic level hinders streamlined integration of interdependent applications. Semantics refers to expressing information about “things” in a way that can be consistently understood by applications. Key components of formalized semantics include identifying what a “thing” is (its “type”), defining general information about that “thing” (its characteristics or properties), and defining the appropriate relationships of that “thing” to other “things” (its function or role in a larger system). Although this might seem initially trivial, the success of smart building applications is highly dependent on maintaining consistent self-descriptive notions of the “things”. Without semantic interoperability, it is technically difficult, labor-intensive, and cost-prohibitive to enable three key objectives of GEBs: optimizing performance, automatically identifying and diagnosing faults, and delivering grid services. Industry, academia, and standards bodies have invested effort in developing information models to facilitate semantic interoperability, however, they have not been widely adopted across the U.S. commercial building portfolio. This paper will present a pathway to drive semantic interoperability through a three-pronged approach to be led by the DOE Building Technologies Office in partnership with NIST and multiple national laboratories comprising: 1) industry engagement and coordination across existing efforts; 2) a semantic interoperability standard that empowers building owners to identify and require interoperable attributes when procuring equipment and applications; 3) tools to assist in implementation and a test framework to verify compliance of products with semantic interoperability specifications. This approach is designed to accelerate the timeline for adoption of semantic interoperability specifications. The intent is to reduce soft costs associated with implementing advanced controls, fault detection and diagnostics, and other smart building technologies and use cases as a necessary step in achieving an energy efficient smart grid future.

Bergmann, Harry↗
DOE OSTI2020

Semantic Interoperability to Enable Smart, Grid-Interactive Efficient Buildings

Achieving a widespread transition to grid-interactive, efficient buildings (GEBs) depends critically on there being sufficient interoperability among connected building systems. While many critical elements already exist at the technical interoperability level (TCP/IP, BACnet, etc.), a lack of interoperability in the semantic level hinders streamlined integration of interdependent applications. Semantics refers to expressing information about “things” in a way that can be consistently understood by applications. Key components of formalized semantics include identifying what a “thing” is (its “type”), defining general information about that “thing” (its characteristics or properties), and defining the appropriate relationships of that “thing” to other “things” (its function or role in a larger system). Although this might seem initially trivial, the success of smart building applications is highly dependent on maintaining consistent self-descriptive notions of the “things”. Without semantic interoperability, it is technically difficult, labor-intensive, and cost-prohibitive to enable three key objectives of GEBs: optimizing performance, automatically identifying and diagnosing faults, and delivering grid services. Industry, academia, and standards bodies have invested effort in developing information models to facilitate semantic interoperability, however, they have not been widely adopted across the U.S. commercial building portfolio. This paper will present a pathway to drive semantic interoperability through a three-pronged approach to be led by the DOE Building Technologies Office in partnership with NIST and multiple national laboratories comprising: 1) industry engagement and coordination across existing efforts; 2) a semantic interoperability standard that empowers building owners to identify and require interoperable attributes when procuring equipment and applications; 3) tools to assist in implementation and a test framework to verify compliance of products with semantic interoperability specifications. This approach is designed to accelerate the timeline for adoption of semantic interoperability specifications. The intent is to reduce soft costs associated with implementing advanced controls, fault detection and diagnostics, and other smart building technologies and use cases as a necessary step in achieving an energy efficient smart grid future.

30 DIRECT ENERGY CONVERSION↗
DOE OSTI2018

Device Access Abstractions for Resilient Information Architecture Platform for Smart Grid

An open application platform distributes the intelligence and control capability to local endpoints (or nodes) reducing total network traffic, improving speed of local actions by avoiding latency, and improving reliability by reducing dependencies on numerous devices and communication interfaces. The platform must be multi-tasking and able to host multiple applications running simultaneously. Given such a system, the core functions of power grid control systems include grid state determination, low level control, fault intelligence and reconfiguration, outage intelligence, power quality measurement, remote asset monitoring, configuration management, power and energy management (including local distributed energy resources, such as wind, solar and energy storage) can be eventually distributed. However, making this move requires extensive regression testing of systems to prove out new technologies, such as phasor measurement units (PMU). Additionally, as the complexity of the systems increase with the inclusion of new functionality (especially at the distribution and consumer levels), hidden coupling issues becomes a challenge with possible N-way interactions known and not known by device and application developers. Therefore, it is very important to provide core abstractions that ensure uniform operational semantics across such interactions. Here in this paper, we describe the pattern for abstracting device interactions we have developed for the RIAPS platform in the context of a microgrid control application we have developed.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS1986

Rational's experience using Ada for very large systems

The experience using the Rational Environment has confirmed the advantages forseen when the project was started. Interactive syntatic and semantic information makes a tremendous difference in the ease of constructing programs and making changes to them. The ability to follow semantic references makes it easier to understand exisiting programs and the impact of changes. The integrated debugger makes it much easier to find bugs and test fixes quickly. Taken together, these facilites have helped greatly in reducing the impact of ongoing maintenance of the ability to produce a new code. Similar improvements are anticipated as the same level of integration and interactivity are achieved for configuration management and version control. The environment has also proven useful in introducing personnel to the project and existing personnel to new parts of the system. Personnel benefit from the assistance with syntax and semantics; everyone benefits from the ability to traverse and understand the structure of unfamiliar software. It is often possible for someone completely unfamiliar with a body of code to use these facilities, to understand it well enough to successfully with a body of code to use these facilities to understand it well enough to successfully diagnose and fix bugs in a matter of minutes.

Archer, James E., Jr.↗
DOE OSTI2023

Visual Brick model authoring tool for building metadata standardization

In this study, the Brick ontology is a unified semantic metadata standard for building assets and their relationships, serving as a key enabler for effective interoperability and automation of building systems and analytics. However, creating a Brick model, in other words, standard semantic metadata based on the Brick ontology for a building dataset, can be a complex task. This paper presents two case studies of the creation of Brick models for real-world residential and commercial building datasets, highlighting the challenges during the Brick model creation process. Additionally, the paper introduces VizBrick, an interactive authoring tool for creating semantic building metadata. VizBrick facilitates the creation of Brick models by providing an intuitive visual interface and interactive capabilities, such as keyword search, automatic mapping suggestions, and recommendations. The use of VizBrick is shown to significantly reduce the time and effort required during the Brick model creation process.

42 ENGINEERING↗
NASA NTRS2003

Developing Visualization Techniques for Semantics-based Information Networks

Information systems incorporating complex network structured information spaces with a semantic underpinning - such as hypermedia networks, semantic networks, topic maps, and concept maps - are being deployed to solve some of NASA s critical information management problems. This paper describes some of the human interaction and navigation problems associated with complex semantic information spaces and describes a set of new visual interface approaches to address these problems. A key strategy is to leverage semantic knowledge represented within these information spaces to construct abstractions and views that will be meaningful to the human user. Human-computer interaction methodologies will guide the development and evaluation of these approaches, which will benefit deployed NASA systems and also apply to information systems based on the emerging Semantic Web.

Keller, Richard M.↗
DOE OSTI2026

Bridging Control and Deployment: A Cross-Layer Analysis of Scalable Building Cluster Control

Building cluster control has emerged as a promising approach for enabling flexible and coordinated operation of distributed building systems, yet its transition from pilot demonstrations to routine grid-interactive operation remains limited. This paper argues that this gap cannot be explained by control algorithms alone. Instead, it arises from interacting barriers in communication infrastructure, data and semantic interoperability, uncertainty management, stakeholder participation, market design, and policy support. Accordingly, the paper reviews both technical and non-technical barriers to building cluster control. Technical challenges include heterogeneous devices and protocols, communication latency and reliability, distributed decision-making, and uncertainty propagation across aggregated loads. Non-technical barriers include user participation, stakeholder coordination, incentive allocation, and data governance. Existing solution approaches are synthesized, including semantic interoperability frameworks, edge and hierarchical communication architectures, distributed and transactive control strategies, uncertainty-aware optimization, policy mechanisms, and market reforms. Based on this analysis, two research directions are identified: testing infrastructures that can evaluate control performance under realistic multi-building conditions, and abstraction methods that allow building clusters to interact with other energy sectors through standardized flexibility representations. Overall, the paper provides a structured review of how building cluster control can move from isolated demonstrations toward reproducible, market-compatible, and grid-relevant implementation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗