开发者

Does Cassandra uses Heap memory to store blooms filter ,and how much space does it consumes for 100GB of data?

开发者 https://www.devze.com 2023-04-07 18:34 出处:网络
I come to know that cassandra uses blooms filter for perfor开发者_运维技巧mance ,and it stores these filter data into physical-memory.

I come to know that cassandra uses blooms filter for perfor开发者_运维技巧mance ,and it stores these filter data into physical-memory.

1)Where does cassandra stores this filters?(in heap memory ?)

2)How much memory do these filters consumes?


When running, the Bloom filters must be held in memory, since their whole purpose is to avoid disk IO.

However, each filter is saved to disk with the other files that make up each SSTable - see http://wiki.apache.org/cassandra/ArchitectureSSTable

The filters are typically a very small fraction of the data size, though the actual ratio seems to vary quite a bit. On the test node I have handy here, the biggest filter I can find is 3.3MB, which is for 1GB of data. For another 1.3GB data file, however, the filter is just 93KB...

If you are running Cassandra, you can check the size of your filters yourself by looking in the data directory for files named *-Filter.db

0

精彩评论

暂无评论...
验证码 换一张
取 消