开发者

How to Analyze and Query big chunks of data

开发者 https://www.devze.com 2023-02-04 18:07 出处:网络
I need to: 1. Analyze big files of http logs I\'m thinking in using mapreduce but I\'m not sure where to host it. Shall I use App Engine Mapper or EC2+MapReduce or simply use it in my VPS?

I need to:

1. Analyze big files of http logs

  • I'm thinking in using mapreduce but I'm not sure where to host it. Shall I use App Engine Mapper or EC2+MapReduce or simply use it in my VPS?
  • Other suggestions besides MapReduce?

2.Save and query the results

  • After analyzing all the data I need to save it and present to the user in the best possible way. How should I save the results? Is MongoDB a good solution for this?开发者_Go百科

Thanks.

Regards.


Have you seen BigQuery? It looks like exactly what you need.

0

精彩评论

暂无评论...
验证码 换一张
取 消