开发者

Can i use Distributed Database for a crawler?

开发者 https://www.devze.com 2023-01-10 21:38 出处:网络
can i use a distributed DB for my WebCrawler,what al开发者_开发知识库l are the available Open Source Distributed Databases?? can i use MySQL as my distributed DB? how amount of data can be stored?Mong

can i use a distributed DB for my WebCrawler,what al开发者_开发知识库l are the available Open Source Distributed Databases?? can i use MySQL as my distributed DB? how amount of data can be stored?


MongoDb might be right for you. It allows sharding and replication.


As said earlier in a comment: use Sphinx (for instance).

0

精彩评论

暂无评论...
验证码 换一张
取 消