Jon Goldhill from Zanran talks about running a search engine on AWS

1. Zanran - a tale 1

2. people Jon Goldhill Yves Dassas MBA from London Business School Started telecom information business in 1987 PhD in electrochemistry Started voice processing business in 1995 Built international telephony business together 2

3. 3

4. 4

5. 5

6. 6 ..While in early beta, this is a pretty exciting place for a data junkie. www.clearhonestdata.com 12 May 2011 Is Zanran Any Good? Short answer: For some queries, yes, Zanran is quite good. Almost scarily so, actually. http://SearchEngineLand.com 12 May 2011 I don't usually post on non-patent or other IP matters, but I'm making an exception for a valuable search engine that should be used when it's data rather than words that you are looking for.... Steve van Dulken’s blog on Patents and IP, 13 Aug 2011

7. 7 How did we get here?

8. Image classification (filtering) 8

9. Difficult! 9

10. 10 Started fundraising, January 2008 Gave up on fundraising, May 2008 But... introduction to AWS user

12. Very limited in scale

13. Familiar

14. Expensive – machines and space

15. Committing

16. Cheap to experiment

17. Scaleable

19. 13 Zanran back end – batch processing Crawl the internet Stage 1 Stage 2 Stage 3 Stage 4 new PDF, Excel, etc Amazon RDS Image processing Is this a graph? Text extraction Find a title + other useful text index Solr 2

20. 14 scale Crawling Image processing Text extraction Re-indexing 10 small instances 300 small instances 20 small instances 1 extra large instance

21. 15 reliability Solr: 6 months RDS: 19 months S3: 100m+ files stored

22. Benefits from using Amazon scaleability – from 3 to 303 servers scaleability – from 7 to 17GB RAM flexibility – Solr development servers ‘ecosystem’ – RightScale, forums lower capital and operations costs 16

23. office dog not present today 17