CrowdSourcing- Location based Quries

1. Crowdsourcing
For Location-based Queries
“We are better than Me & We are smarter than Me”
Presented by
Ms. Archana Khandade
Guided by
Prof. N N Dharashive

2. Crowdsourcing is the act of taking a job
traditionally performed by a designated agent
(usually an employee) and outsourcing it to
an undefined, generally large group of people
in the form of an open call
- Jeff Howe (2006)

3. Why Now?
Human Trends :
-Anyone can take two seconds to
hit a Like button, 10 seconds to
respond to a text message, or 30
seconds to post a Tweet.
-The Way We Work
Technology Trends:
- Artificial intelligence (machine learning)
Convergence of People and Technology:
- people and machines can work far better with each other

4. Typology of Crowdsourcing
Applications
1. The Knowledge Discovery and Management
Approach

Organization tasks crowd with finding and collecting information
into a common location and format

Example : seeclickfix.com
2. The Broadcast Search Approach

Organization tasks crowd with solving empirical problems

Example : innocentive.com
3. The Peer-Vetted Creative Production Approach


Organization tasks crowd with creating and selecting creative
ideas
Example : threadless.com
4. Distributed Human Intelligence Tasking


Organization tasks crowd with analyzing large amounts of
information
Example : mturk.com

5. Crowdsourcing

6. How Crowdsourcing HELP?
Location-based Queries
-As per the study found that “ We found that 63% of the queries
were non-factual, while only 37% of them were factual ”
Question Answering Systems
- Google answered 78% of the factual questions
and only 29% of the non-factual questions
Crowdsourcing and Collaboration
- To find the most appropriate person to answer the question

7. System Backbones :
twitter
•
•
•
Real time information sharing
580 million active users world-wide
Averages of 340 million tweets are
sent everyday globally
foursquare
•
Share and save the places you visit
• Over 40 million people worldwide
• Over 4.5 billion check-ins, with millions
more every day

8. System Architecture

9. System Components
1. Question Collector
Question Format :
[question keyword][text][location keyword][?]
Example :
[Anyone][have dinner suggestions while in][San
Francisco][?]
2. Validator (for questions)
Boston
Buffalo
Chicago
Dallas
Houston
Food
Home/Work/Other
Los Angeles
Miami
Nightlife
Parks & Outdoors
Shops
New York
San Francisco
Travel
Cities & Location Types
(Categories) in Foursquare
Example :
@usernameA:Arts&Entertainment,C:College&Education,F:Food,H
:Home/Work/Other,N:Nightlife,P:Parks&Outdoors,
S:Shops,T:Travel
@username 1: inappropriate, 2:can be asked, 3: good question
@username [Question]
N2
College & Education
Las Vegas
- extra level of filtering
- forward to moderators over Twitter for ranking of questions
Reply :
Arts &
Entertainment
Rank
Meaning
1
Inappropriate
2
Can be asked
3
Good Question
Ranking Levels for Questions

10. System Components (Cont..)
3. Asker
- forwards validated questions to people identified as most
appropriate to answer those questions
Example :
@username Please help our research project by answering the
following question. For more info visit [website link]
@username [Question]
3. Answer Collector
- constantly polls our Twitter account for any received
answers to the questions asked
- answers that contain inappropriate words are filtered out by
employing a set of blacklisted words

11. System Components
5. Validation (for answers)
- Similar to the validation step in Validation (for
questions)
- Forward to moderators over Twitter for ranking of
Answers
6. Forwarder
Rank
Meaning
1
Inappropriate
2
Can be forwarded
3
Good Answer
Ranking Levels for
Answers
- Forwards the answers which have ranking level of either 2 (can be forwarded)
or 3 (Good Answer) back to the Twitter users
Example :
@asker Our crowd-sourced question answering system found the
following answer to your question contributed by @answerer
@asker [Question]
@asker [Answer]

12. Experiments
 Question Rates :
- Approximately 75% of them as inappropriate to ask
 Answer Finding Rate :
-Our system answered 75% of questions compared to Google’s
47% answer rate on same questions
-Our system answered 75% of both the factual and the nonfactual questions
- Google answered 78% of the factual questions and only 29%
of the non-factual questions

13. Experiments (cont..)
65
60
60
55
50
FourSquare Reply Percentage
100
90
80
70
60
50
40
30
20
10
0
50
45
Can be Ased
Good Question
Random Reply Percentage
90
80
70
60
50
40
40
40
20
50 50
40
20
10
Reply Percentage based on
Question Ranking(%)
60
40
20
50
50
20
40
30
10
0
Question Rank:2
Answer Rank :1
70
Question Rank:3
Answer Rank :2
Answer Rank :3
Question Ranks vs. Answer Ranks
10

14. Experiments
PC/Lapt
op
20%
Evening
29%
Afternoon
33%
Morning
19%
Mobile
80%
Night
19%
Response Intervals
Client Types
120
100
80
60
40
20
0
1m
2m
5m
10m
30m
2h
4h
8h
12h
18h
Maximum Respoanse Time
1d
2d
4d
5d

15. Conclusion
• Our findings indicate that even without an incentive
structure, we could answer 75% of the questions &
Foursquare users provide better answers than randomly
selected users from the same cities
• Crowdsourcing = Collective
intelligence, Depending on the nature of a problem & the
type of input needed from a crowd any number of new media
tools could be designed
• Crowdsourcing can be used to make governance more
efficient and inclusive, to search for difficult scientific
solutions, to craft better public policy

16. “We are better than Me & We are smarter than Me”