Thursday, July 29

Recorded Future: Trend and event spotting from real-time news data

Yesterday Wired featured an article, Google, CIA Invest in ‘Future’ of Web Monitoring. The article stretches the truth a bit when it says that Google is doing business with the CIA. The link is tenuous, that both companies are interested in predictive analytics on news and real-time data. The subject of the article is a small Cambridge based company, Recorded Future. From the article's description,
Recorded Future strips from web pages the people, places and activities they mention. The company examines when and where these events happened (“spatial and temporal analysis”) and the tone of the document (“sentiment analysis”)... Recorded Future maintains an index with more than 100 million events, hosted on Amazon.com servers.
For a more detailed look at what the company is doing, take a look at the white paper published on the company blog, A whitepaper on temporal analytics. You can also read the Predictive Signals blog by Bill Ladd, the Chief Analytic Officer at Recorded Future.

Recorded Future is not alone in this field. For example, the Living Knowledge Project is also working on future prediction of news events from web data.

The people working in this field should be aware of the wealth of previous research analyzing event data in news. For example, the DARPA TIDES program on Topic Detection and Tracking (TDT). See James Allan's book, Topic Detection and Tracking for an overview. You can also look at some of Victor Lavrenko's work, specifically on TDT and AEnalyst for financial market prediction from news.

1 comment:

  1. You have a broken link on the white paper on temporal analytics.

    ReplyDelete