How to configure VeloxDFS

Installing VeloxDFS is quite a challenge, yet configure it is not far from easy.

VeloxDFS relies on configuration files _".eclipse.json"_ to obtains its setups. There are several variables that need to be used in order to make Velox work.

Where to write `.eclipse.json` file

It depends whether you want to have a system wide configuration file or not. Velox will give priority to the ~/.eclipse.json than to the system wide /etc/eclipse.json.

Essential variables and their meanings:

Network settings

"network" : {
"ports" : {
  "internal" : 8318,             # Port used internally in Velox
  "client"   : 8319,             # Port used between client and Velox
  "mapreduce"   : 8321           # Port used for Mapreduce engine (Only for VeloxMR) 
},

"iface"          : "eth0",       # Interface name
"nodes"          : [             # List of nodes to run VeloxDFS
  "172.20.1.40",
  "172.20.1.41",
  ...
  "172.20.1.47",
  "172.20.1.48",
  "172.20.1.49"
],
"serialization"   : "binary"    # Either binary or xml (use xml for debugging)
},

File system settings

"filesystem" : {
  "block"  : 2000,      # Size of block (in Bytes)
  "buffer" : 512,       # Size of file buffers (in Bytes)
  "replica" : 3         # Number of replicas per block
},

"path" : {
  "scratch"      : "/scratch/vicente/storage",   # Where to save blocks
  "metadata"     : "/scratch/vicente/"           # Where to save metadata file
},

Logger settings

"log" : {
  "type" : "LOG_LOCAL6",    # Log type for rsyslog (One per user)
  "name" : "ECLIPSE",       
  "mask" : "info"           # Log messages above this log level
},