1. About this course, assignments and course
projects
Hello and welcome to "Practical Crowdsourcing for Machine Learning"!
In this course we will be looking at the main concepts ofthis technologyand learn how to setup projects for data
collection.Here's a shortoverview of course content and assignments.
Communication
For any questions regarding the course,join this channel in our Slack community.
Videos
Lectures will cover the basics ofcrowdsourcing methodology.There will be four modules (weeks) and each module
will cover one big step of launching crowdsourcing projects.Lectures are mostlyabouttheory.
In each firstlesson ofeach week you will find lecture notes.Use them to make your own notes.
CSATalks is a series ofshortvideos that will provide a deep dive into practice.Several engineers who work with
crowdsourcing everyday will share their advice on how to apply crowdsourcing techniques.In the final module you'll
hear their stories aboutdata labeling pipelines theyhave designed.
Assignments
There will be two kinds of assignments:weeklyquizzes and a course project.
Quizzes are...well,quizzes :) They are graded and these grades contribute to the final result.
Course project is a real crowdsourcing projectthat each studentwill develop throughoutthe course and launch during
Week 5. Each week you will focus on a certain aspectof developing a project – the very same aspectthatwill be
discussed in thatweek's lectures.
Each week you can develop a part of your course project.Each module is accompanied bya step-by-step instruction
for designing this part.You can follow these instructions and adaptthem to your project. These steps will notbe
graded during the course – you will only receive a final grade after setting up your projectand labeling your dataset.
During Week 5 you will receive a datasetthat should be labeled in the projectyou have been developing.Bringing
back labels for this data is the final assessment.We will compare your labels to ground truth datasets and calculate
their quality. Grades for the course projects will be based on the datasetquality and will add up to the final result.
You may launch the project on any crowdsourcing platform you choose.