Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

If you really know how many variables are at play in a "typical" Hadoop cluster (including which components to use & what use cases are most important to you) it is easy to see where there aren't too many node sizing guides published out there.  That said, I'll go out on a limb and offer my personal sizing guide for worker nodes.

Spec out your worker nodes with multiples of the following logical building block.

1 Hard Drive (1-4TB in size)  –  2 CPU Cores  –  10 GB of RAM

With that approach, here are some typical worker node configurations based on these variables.

...