SlideShare ist ein Scribd-Unternehmen logo
1 von 28
Downloaden Sie, um offline zu lesen
Houdini
                              On Demand Labor API




                 Easy Mechanical Turk Integration
                 with Houdini
                   Philly AWS December Meetup




                   Date: December 13, 2010
                   By: Chris Conley and Jameson Detweiler




      12/13/2010
Tuesday, December 14, 2010
Houdini                           Easy Mechanical Turk Integration with Houdini
                       On Demand Labor API                                        Philly AWS December Meetup




                                             Mechanical Turk

            • Marketplace for work
            • ~ 500k workers
            • Accessible via API




      12/13/2010
Tuesday, December 14, 2010
Houdini                                       Easy Mechanical Turk Integration with Houdini
                       On Demand Labor API                                                    Philly AWS December Meetup




                                             Task Examples
             •      Moderation - images, comments, reviews, video

             •      Categorization - products, best image, tagging

             •      Ads - moderation, keywords

             •      Audio Transcription / Video Captioning

             •      Cleanup - proofreading, contact reconciliation, review editing

             •      PDF/Image/Handwriting to Text

             •      Research - contact info, document search




      12/13/2010
Tuesday, December 14, 2010
Houdini                          Easy Mechanical Turk Integration with Houdini
                       On Demand Labor API                                       Philly AWS December Meetup




                                             Turk Overview
              • Workers and Requesters
              • HITs
              • Questions
              • Assignments
              • Qualifications
              • Notifications
              • Blocking Workers


      12/13/2010
Tuesday, December 14, 2010
Houdini                        Easy Mechanical Turk Integration with Houdini
                       On Demand Labor API                                     Philly AWS December Meetup




                                             Worker View




      12/13/2010
Tuesday, December 14, 2010
Houdini                           Easy Mechanical Turk Integration with Houdini
                       On Demand Labor API                                        Philly AWS December Meetup




                                             Creating HITs

                     WYSIWYG                              API
             • Easy                                 • More Flexible
             • Great for testing                    • But Complicated
               the waters
                                                    • Programmatic
             • No integration                         Integration


      12/13/2010
Tuesday, December 14, 2010
Houdini                         Easy Mechanical Turk Integration with Houdini
                       On Demand Labor API                                      Philly AWS December Meetup




                                             WYSIWYG




      12/13/2010
Tuesday, December 14, 2010
Houdini                         Easy Mechanical Turk Integration with Houdini
                       On Demand Labor API                                      Philly AWS December Meetup




                                             WYSIWYG




      12/13/2010
Tuesday, December 14, 2010
Houdini                                      Easy Mechanical Turk Integration with Houdini
                       On Demand Labor API                                                   Philly AWS December Meetup




                                                   API




                      http://docs.amazonwebservices.com/AWSMturkAPI/2008-08-02/index.html




      12/13/2010
Tuesday, December 14, 2010
Houdini                          Easy Mechanical Turk Integration with Houdini
                       On Demand Labor API                                       Philly AWS December Meetup




                                             HIT Questions
           • XML
           • External Question




      12/13/2010
Tuesday, December 14, 2010
Houdini                             Easy Mechanical Turk Integration with Houdini
                       On Demand Labor API                                          Philly AWS December Meetup




                                             Turk API Libraries

                   • ruby-aws http://rubyforge.org/projects/ruby-aws/
                   • rTurk https://github.com/mdp/rturk
                   • Turkee https://github.com/aantix/turkee




      12/13/2010
Tuesday, December 14, 2010
Houdini                       Easy Mechanical Turk Integration with Houdini
                       On Demand Labor API                                    Philly AWS December Meetup




                                      Questions about Turk?




      12/13/2010
Tuesday, December 14, 2010
Houdini                         Easy Mechanical Turk Integration with Houdini
                       On Demand Labor API                                      Philly AWS December Meetup




                                             Houdini
                                                • Simple
                                                • Qualified results
                                                • Automatic
                                                • Trusted Workers



      12/13/2010
Tuesday, December 14, 2010
Houdini                             Easy Mechanical Turk Integration with Houdini
                       On Demand Labor API                                          Philly AWS December Meetup




                                             Houdini APIs
                             Generic                   Optimized

                   • Simple                        • Image Moderation
                   • Exact                         • Ad Moderation
                   • Multi-answer                  • Data Reconciliation
                                                   • Data Extraction
                                                   • ...
      12/13/2010
Tuesday, December 14, 2010
Houdini                        Easy Mechanical Turk Integration with Houdini
                       On Demand Labor API                                     Philly AWS December Meetup




                                             Simple API

                   • One answer per task
                   • Cheap
                   • Image Moderation, Low profile content




      12/13/2010
Tuesday, December 14, 2010
Houdini                            Easy Mechanical Turk Integration with Houdini
                       On Demand Labor API                                         Philly AWS December Meetup




                                             Simple API Example




      12/13/2010
Tuesday, December 14, 2010
Houdini                           Easy Mechanical Turk Integration with Houdini
                       On Demand Labor API                                        Philly AWS December Meetup




                                             Exact API
                   • Multiple workers
                   • Ensures all answers match
                   • Returns the “final answer”
                   • If not, escalated to trusted worker group
                   • More expensive than Simple
                   • Image Moderation, Data Harvesting, etc

      12/13/2010
Tuesday, December 14, 2010
Houdini                            Easy Mechanical Turk Integration with Houdini
                       On Demand Labor API                                         Philly AWS December Meetup




                                             Exact API Example




      12/13/2010
Tuesday, December 14, 2010
Houdini                           Easy Mechanical Turk Integration with Houdini
                       On Demand Labor API                                        Philly AWS December Meetup




                                             Multi-answer API

                   • Ask multiple turkers same question
                   • All answers are returned
                   • Surveys, feedback, answer qualification
                     on your end




      12/13/2010
Tuesday, December 14, 2010
Houdini                     Easy Mechanical Turk Integration with Houdini
                       On Demand Labor API                                  Philly AWS December Meetup




                                     Image Moderation API

                   • No need to build form_html
                   • Just send the image url
                   • Optionally send custom instructions
                     and possible responses



      12/13/2010
Tuesday, December 14, 2010
Houdini               Easy Mechanical Turk Integration with Houdini
                       On Demand Labor API                            Philly AWS December Meetup




                             Image Moderation Example




      12/13/2010
Tuesday, December 14, 2010
Houdini                                                     Easy Mechanical Turk Integration with Houdini
                       On Demand Labor API                                                                  Philly AWS December Meetup




                              Image Moderation Demo
                                             Source: https://github.com/chrisconley/cat_or_not




      12/13/2010
Tuesday, December 14, 2010
Houdini                         Easy Mechanical Turk Integration with Houdini
                       On Demand Labor API                                      Philly AWS December Meetup




                                             Admin Console
                   • Review Work
                   • Perform “Trusted” tasks
                   • Worker Insights: Avg Completion Time,
                     # of workers
                   • Remove bad performing workers from
                     specic task groups


      12/13/2010
Tuesday, December 14, 2010
Houdini                           Easy Mechanical Turk Integration with Houdini
                       On Demand Labor API                                        Philly AWS December Meetup




                                             Getting Started
                   • Get an API Key - http://houdiniapi.com/sign-up/
                   • Tunnlr - http://tunnlr.com
                   • Sandbox - http://houdini-sandbox.heroku.com




      12/13/2010
Tuesday, December 14, 2010
Houdini                             Easy Mechanical Turk Integration with Houdini
                       On Demand Labor API                                          Philly AWS December Meetup




                                              Pricing Example

                                   Monthly Fee         Images Per Month
                                             $20               200

                                             $99              1500




      12/13/2010
Tuesday, December 14, 2010
Houdini                           Easy Mechanical Turk Integration with Houdini
                       On Demand Labor API                                        Philly AWS December Meetup




                                             Other Solutions

                   • Crowdflower
                   • Microtask
                   • CrowdCloud




      12/13/2010
Tuesday, December 14, 2010
Houdini                                                               Easy Mechanical Turk Integration with Houdini
                       On Demand Labor API                                                                            Philly AWS December Meetup




                                                        Resources

                      Houdini Docs:
                                http://houdiniapi.com/documentation


                      Mturk Docs:
                                http://docs.amazonwebservices.com/AWSMturkAPI/2008-08-02/index.html




      12/13/2010
Tuesday, December 14, 2010
Houdini                                                 Easy Mechanical Turk Integration with Houdini
                       On Demand Labor API                                                              Philly AWS December Meetup




                                             Thanks!
                                                 Chris Conley         Jameson Detweiler
                                             chris@houdiniapi.com   jameson@houdiniapi.com
                                                @chrisconley              @jaymstr




      12/13/2010
Tuesday, December 14, 2010

Weitere ähnliche Inhalte

KĂźrzlich hochgeladen

IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
Enterprise Knowledge
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
giselly40
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
Enterprise Knowledge
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 

KĂźrzlich hochgeladen (20)

08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 

Empfohlen

How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental Health
ThinkNow
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
Kurio // The Social Media Age(ncy)
 

Empfohlen (20)

2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot
 
Everything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTEverything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPT
 
Product Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsProduct Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage Engineerings
 
How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental Health
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
 
Skeleton Culture Code
Skeleton Culture CodeSkeleton Culture Code
Skeleton Culture Code
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 

Easy Mechanical Turk Integration with Houdini

  • 1. Houdini On Demand Labor API Easy Mechanical Turk Integration with Houdini Philly AWS December Meetup Date: December 13, 2010 By: Chris Conley and Jameson Detweiler 12/13/2010 Tuesday, December 14, 2010
  • 2. Houdini Easy Mechanical Turk Integration with Houdini On Demand Labor API Philly AWS December Meetup Mechanical Turk • Marketplace for work • ~ 500k workers • Accessible via API 12/13/2010 Tuesday, December 14, 2010
  • 3. Houdini Easy Mechanical Turk Integration with Houdini On Demand Labor API Philly AWS December Meetup Task Examples • Moderation - images, comments, reviews, video • Categorization - products, best image, tagging • Ads - moderation, keywords • Audio Transcription / Video Captioning • Cleanup - proofreading, contact reconciliation, review editing • PDF/Image/Handwriting to Text • Research - contact info, document search 12/13/2010 Tuesday, December 14, 2010
  • 4. Houdini Easy Mechanical Turk Integration with Houdini On Demand Labor API Philly AWS December Meetup Turk Overview • Workers and Requesters • HITs • Questions • Assignments • Qualications • Notications • Blocking Workers 12/13/2010 Tuesday, December 14, 2010
  • 5. Houdini Easy Mechanical Turk Integration with Houdini On Demand Labor API Philly AWS December Meetup Worker View 12/13/2010 Tuesday, December 14, 2010
  • 6. Houdini Easy Mechanical Turk Integration with Houdini On Demand Labor API Philly AWS December Meetup Creating HITs WYSIWYG API • Easy • More Flexible • Great for testing • But Complicated the waters • Programmatic • No integration Integration 12/13/2010 Tuesday, December 14, 2010
  • 7. Houdini Easy Mechanical Turk Integration with Houdini On Demand Labor API Philly AWS December Meetup WYSIWYG 12/13/2010 Tuesday, December 14, 2010
  • 8. Houdini Easy Mechanical Turk Integration with Houdini On Demand Labor API Philly AWS December Meetup WYSIWYG 12/13/2010 Tuesday, December 14, 2010
  • 9. Houdini Easy Mechanical Turk Integration with Houdini On Demand Labor API Philly AWS December Meetup API http://docs.amazonwebservices.com/AWSMturkAPI/2008-08-02/index.html 12/13/2010 Tuesday, December 14, 2010
  • 10. Houdini Easy Mechanical Turk Integration with Houdini On Demand Labor API Philly AWS December Meetup HIT Questions • XML • External Question 12/13/2010 Tuesday, December 14, 2010
  • 11. Houdini Easy Mechanical Turk Integration with Houdini On Demand Labor API Philly AWS December Meetup Turk API Libraries • ruby-aws http://rubyforge.org/projects/ruby-aws/ • rTurk https://github.com/mdp/rturk • Turkee https://github.com/aantix/turkee 12/13/2010 Tuesday, December 14, 2010
  • 12. Houdini Easy Mechanical Turk Integration with Houdini On Demand Labor API Philly AWS December Meetup Questions about Turk? 12/13/2010 Tuesday, December 14, 2010
  • 13. Houdini Easy Mechanical Turk Integration with Houdini On Demand Labor API Philly AWS December Meetup Houdini • Simple • Qualied results • Automatic • Trusted Workers 12/13/2010 Tuesday, December 14, 2010
  • 14. Houdini Easy Mechanical Turk Integration with Houdini On Demand Labor API Philly AWS December Meetup Houdini APIs Generic Optimized • Simple • Image Moderation • Exact • Ad Moderation • Multi-answer • Data Reconciliation • Data Extraction • ... 12/13/2010 Tuesday, December 14, 2010
  • 15. Houdini Easy Mechanical Turk Integration with Houdini On Demand Labor API Philly AWS December Meetup Simple API • One answer per task • Cheap • Image Moderation, Low prole content 12/13/2010 Tuesday, December 14, 2010
  • 16. Houdini Easy Mechanical Turk Integration with Houdini On Demand Labor API Philly AWS December Meetup Simple API Example 12/13/2010 Tuesday, December 14, 2010
  • 17. Houdini Easy Mechanical Turk Integration with Houdini On Demand Labor API Philly AWS December Meetup Exact API • Multiple workers • Ensures all answers match • Returns the “final answer” • If not, escalated to trusted worker group • More expensive than Simple • Image Moderation, Data Harvesting, etc 12/13/2010 Tuesday, December 14, 2010
  • 18. Houdini Easy Mechanical Turk Integration with Houdini On Demand Labor API Philly AWS December Meetup Exact API Example 12/13/2010 Tuesday, December 14, 2010
  • 19. Houdini Easy Mechanical Turk Integration with Houdini On Demand Labor API Philly AWS December Meetup Multi-answer API • Ask multiple turkers same question • All answers are returned • Surveys, feedback, answer qualication on your end 12/13/2010 Tuesday, December 14, 2010
  • 20. Houdini Easy Mechanical Turk Integration with Houdini On Demand Labor API Philly AWS December Meetup Image Moderation API • No need to build form_html • Just send the image url • Optionally send custom instructions and possible responses 12/13/2010 Tuesday, December 14, 2010
  • 21. Houdini Easy Mechanical Turk Integration with Houdini On Demand Labor API Philly AWS December Meetup Image Moderation Example 12/13/2010 Tuesday, December 14, 2010
  • 22. Houdini Easy Mechanical Turk Integration with Houdini On Demand Labor API Philly AWS December Meetup Image Moderation Demo Source: https://github.com/chrisconley/cat_or_not 12/13/2010 Tuesday, December 14, 2010
  • 23. Houdini Easy Mechanical Turk Integration with Houdini On Demand Labor API Philly AWS December Meetup Admin Console • Review Work • Perform “Trusted” tasks • Worker Insights: Avg Completion Time, # of workers • Remove bad performing workers from specic task groups 12/13/2010 Tuesday, December 14, 2010
  • 24. Houdini Easy Mechanical Turk Integration with Houdini On Demand Labor API Philly AWS December Meetup Getting Started • Get an API Key - http://houdiniapi.com/sign-up/ • Tunnlr - http://tunnlr.com • Sandbox - http://houdini-sandbox.heroku.com 12/13/2010 Tuesday, December 14, 2010
  • 25. Houdini Easy Mechanical Turk Integration with Houdini On Demand Labor API Philly AWS December Meetup Pricing Example Monthly Fee Images Per Month $20 200 $99 1500 12/13/2010 Tuesday, December 14, 2010
  • 26. Houdini Easy Mechanical Turk Integration with Houdini On Demand Labor API Philly AWS December Meetup Other Solutions • Crowdflower • Microtask • CrowdCloud 12/13/2010 Tuesday, December 14, 2010
  • 27. Houdini Easy Mechanical Turk Integration with Houdini On Demand Labor API Philly AWS December Meetup Resources Houdini Docs: http://houdiniapi.com/documentation Mturk Docs: http://docs.amazonwebservices.com/AWSMturkAPI/2008-08-02/index.html 12/13/2010 Tuesday, December 14, 2010
  • 28. Houdini Easy Mechanical Turk Integration with Houdini On Demand Labor API Philly AWS December Meetup Thanks! Chris Conley Jameson Detweiler chris@houdiniapi.com jameson@houdiniapi.com @chrisconley @jaymstr 12/13/2010 Tuesday, December 14, 2010