Search NASA⌕ Search

DOE OSTI · 978530

Mining for Emerging Technologies within Text Streams and Documents

Abstract

Text streams, collections of documents or messages that are generated and observed over time, are ubiquitous. Our research and development is targeted at developing algorithms to find and characterize changes in topic within text streams. To date, this research has demonstrated the ability to detect and describe 1) short duration, atypical events and 2) the emergence of longer term shifts in topical content. This technology has been applied to pre-defined temporally ordered document collections but is also suitable for application to near real-time textual data streams. The underlying event and emergence detection algorithms have been interfaced to an event detection software user interface named SURPRISE. This software provides an interactive graphical user interface and tools for manipulating and correlating the terms and scores identified by the algorithms. Additionally, SURPRISE has been interfaced with the IN-SPIRE text analytics tool to enable an analyst to evaluate the surprising or emerging terms via a visualization of the entire document collection. IN-SPIRE assists in the exploration of related topics, events and views currently based on single term events. The focus of this research is to contribute to detecting, and preventing, strategic surprise.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Engel, David W, Whitney, Paul D, Calapristi, Augustin J, Brockman, Fred J. 2009-02-10. Mining for Emerging Technologies within Text Streams and Documents. https://www.osti.gov/biblio/978530

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related reports

Fire Protection Design

The purpose of this project is to design the demolition and installation of a deluge valve swap from a DV-5 to a DV-5A valve.

99 GENERAL AND MISCELLANEOUS↗