1. FINANCIAL MEDIA METRICS MONITORING,
ANALYZE MORE THAN 20 MILLION BLOGS, 5 MILLION FORUM POSTS,
AND 30,000 ONLINE NEWS SOURCES,
SOCIAL NETWORKS AND MICROBLOGS
COLLAB WORDSENSE

2. Agenda
Product Features
Architecture Overview
Software Design
– HBase Schema Design
– UI Functional Mapping
Demo
Conclusions and Usage
Q&A

3. YOU
ARE YOU INTERESTED ?
User Profile
Message
News + Finance

4. Business Goal
To help customers analyze trend of interesting
words and train the word to the system to
make sense of words which being talked
within the social network
“Making sense of words to make
better knowledge”

5. WordSense will tell you…
What are people talking about? What are the
key conversations?
When did these conversations happen? Was
there a lot of activity?
Where did these conversations happen? Was
there a lot of activity?

6. • User Profile
• Search Engine
• Dashboard
– To Summarize the analyzed data
– Reports in the difference formats
– Tag Cloud
– Graph
– GeoMap
• WordSense Monitoring
Product Features

7. Hadoop/HBASE
Bot
UI
Architecture Overview
MessageHistoryStat
User Profile

8. HBase Integration - Processing
Message
Daily
Quartz
M/R
HBase
HDFS Map/Reduce
Hadoop/HBase
Schedule 1 minute
Word
Stat
Geo
Mention
Bot

9. HBASE schema design
ROW_KEY
• [TimestampHour|MessageID]
COLUMN FAMILIES
• MessageDetail
– [MessageBody] [Value]
– [MsgDatetimeUTC] [Value]
• User
– [Name] [Value]
– [Location] [Value]
• Twitter
– [Source] [Value]
– [Path] [Value]
HBASE Word Stat Schema
ROW_KEY
• [Word|TimestampHour]
COLUMN FAMILIES
• Value Count
HBASE Message Schema
HBASE Geo Mention Schema
ROW_KEY
• [Word|Geo]
COLUMN FAMILIES
• Value Count

10. UI FUNCTIONAL MAPPING

11. Login with LINKEDIN
Home: Search Feature

12. Users can group several similar keywords into a unified
query, called a WordSense.
Search Dashboard: WordSense Trend

13. Users can search for multiple keywords, and compare
search results against each other.
Search Dashboard: Multiple Keywords Trend

14. WordSense will get the stock historical data from Yahoo
Finance, if the keyword can be interpreted as stock data.
Search Dashboard: Stocks Trend

15. Users can see the word statistics based on
Location base with GeoMap format.
Search Dashboard: Location Trend

16. Users can see changes in the trending keywords over time, as an
animated Time Cloud, by clicking Play button.
WordSense Monitoring: Time Cloud

17. DEMOhttp://10.90.115.174:8088/CollabWordSense

18. Software Comparison
http://www.google.co.uk/trends/

19. Usage in Collaboration
Value added features such as
• Potentially a “Query as a Service” on Thomson
Reuters data
• Trends, Stock, or What’s Hot people are talking
about in communication network.

20. Team member
Chaiwat Ratanaprateepporn (Product Manager)
Pasin Junchusri (Group Leader)
Sunpawet Somsin
Sombat Wongsrisupphakul
Worakarn Isaratham
Prachnan Srianan
Thanagrit Praprutthiphong
Suchart Chayangsu
Patipon Joradon
Kanokon Benjariyaporn
Witsanu Angklomkleaw
Thamrongtawal Hashim
Vipada Jhetson

21. Q&A
Contacts:
• pasin.junchusri@gmail.com