Quantcast
Channel: StackExchange Replication Questions
Viewing all articles
Browse latest Browse all 17268

What is the Relationship between HDFS Block Size and Network Replication Traffic?

$
0
0

Our HBase cluster has a significant amount of network traffic relative to the amount of data we believe we are writing to it via OpenTSDB.

Relayed Bytes to OpenTSDB:

enter image description here

Network Throughput in Bytes (Y Axis is SI units, so not base2):

enter image description here

We use Cloudera, so the block is 128MB, would changing it to 64MB reduce network replication traffic? Are there other consequences to consider?


Viewing all articles
Browse latest Browse all 17268

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>