Plasma GitLab Archive
Projects Blog Knowledge

Module Mapred_config

module Mapred_config: sig .. end
Configuration of mapred servers

class type mapred_config = object .. end
val extract_config : Netplex_types.config_file -> mapred_config
Config section must look like:

         netplex {
           ...
           namenodes {
             clustername = "cluster1";
             node { addr = "hostname:port" };
             node { addr = "hostname:port" };
             ...
             root = "/nfsmounts/cluster1";    (* optional *)
           };
           file {
             root = "/";
           };
           mapred {
             node { addr = "hostname" };
             node { addr = "hostname" };
             ...
             port = 1234;
             tmpdir = "/somewhere";
             users = "john hans sue";
           }
        }
      

If PlasmaFS is disabled, the namenodes section must look like:

           namenodes {
             disabled = true;
           }
      

val test_config : clustername:string ->
nodes:string list ->
?buffer_size:int -> ?sort_size:int -> unit -> mapred_config
val executable_version : unit -> string
Returns an MD5 sum of the running executable
This web site is published by Informatikbüro Gerd Stolpmann
Powered by Caml