摘星

手可摘星辰——摘星霜天搜索与算法技术 - 引擎开发组 03/08/11

爬虫面临的问题与瓶颈 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],03/08/11

摘星 SCRAPY+MYSQL+RADIS+WEBKIT ,[object Object],03/08/11

Webkit 介绍 ,[object Object],[object Object],[object Object],03/08/11

Scrapy 介绍 ,[object Object],[object Object],[object Object],[object Object],03/08/11

摘星架构 03/08/11 Scrapy Scrapy Scrapy Scrapy Scrapy WebkitServer MySQL DB Scrapy OfflineServer Redis server Redis server Schdule Django Internet

摘星 Redis 存储架构 03/08/11

摘星 OfflineServer 03/08/11 Field_list Scrapy MySQL DB Field_set OfflineServer TFS OCR

摘星 WebkitServer 03/08/11 WebkitServer browser browser browser browser browser http://127.0.0.1:9090/ s?url=xxxxx

Redis 介绍 ,[object Object],[object Object],[object Object],[object Object],[object Object],03/08/11

摘星链接库存储 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],03/08/11

摘星链接库存储 ,[object Object],[object Object],[object Object],[object Object],[object Object],03/08/11

摘星一期调度策略 03/08/11 key detail_finish_set list_finish_set list_refresh_url_candidate_list detail_refresh_url_candidate_list candidate_detail candidate_list url_store

摘星二期调度策略 03/08/11 list_finish_set list_refresh_url_candidate_list list_new_url_candidate_list url_store module

淘宝摘星前端页面 120.0.28.114 03/08/11

小小展望与总结 03/08/11

Thank you for listening~ 小敏 Email ： [email_address] 03/08/11

摘星

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (20)

Andere mochten auch

Andere mochten auch (12)

Ähnlich wie 摘星

Ähnlich wie 摘星 (20)

摘星

Hinweis der Redaktion