E-commerce product classification with deep learning

1. ProductPredictrWhat is Lynks shipping ?
Christopher Clive Bonnett

3. Plaid button-front shirt
Tommy Hilfiger striped
shirt, bow-tie print
Image Text Label
Clothing >> Women >> Top
Clothing >> Kids >> Top

4. Unbalanced Classes
Classes
Counts

5. Convolution
(Computer
Vision)
Image
Text
=
{
Predicted classification
The Algorithm
}Neural
Network

6. Convolutional Neural Net
Computationally Expensive
Data hungry
Leverage pre-trained
convolutional part
(Transfer learning)
VGG

7. Transfer learning
Keep fixed
Image
Text-Bag of words
Predicted classification
=
{
Trained
{ Trained
}
The Algorithm

8. Classification Accuracy
Image
85%

9. Classification Accuracy
Text
86%
Image
85%

10. Classification Accuracy
Image
85%
Image + Text
93%
Text
86%

11. Classification Accuracy
Image + Text
93%
Image + Text +
fine tuning
94%

12. Blog: cbonnett.github.iohttp://bit.do/DarkEnerySurvey

13. Fine tuning
Allow weights in the last 2
convolutional-layer to be adjusted
+1%

14. blake cotton oxford shirt
Clothing >> Men >> TopClothing >> Kids >> Top
True Class Assigned Class

15. True Class Assigned Class
long lost cross back tank
Clothing >> Women >> Top Clothing >> Women >> Dress

16. Member of training data
In the training class
Not in training class

17. Member of training data
In the training class
Not in training class