Module Mapred_config

module Mapred_config: sig .. end

Configuration of mapred servers

class type mapred_config = object .. end

val extract_config : Netplex_types.config_file -> mapred_config

Config section must look like:

         netplex {
           ...
           namenodes {
             clustername = "cluster1";
             node { addr = "hostname:port" };
             node { addr = "hostname:port" };
             ...
             root = "/nfsmounts/cluster1";    (* optional *)
           };
           file {
             root = "/";
           };
           mapred {
             node { addr = "hostname" };
             node { addr = "hostname" };
             ...
             port = 1234;
             tmpdir = "/somewhere";
             users = "john hans sue";
           }
        }

If PlasmaFS is disabled, the namenodes section must look like:

           namenodes {
             disabled = true;
           }

val test_config : clustername:string ->
       nodes:string list ->
       ?buffer_size:int -> ?sort_size:int -> unit -> mapred_config

val executable_version : unit -> string

Returns an MD5 sum of the running executable

This web site is published by Informatikbüro Gerd Stolpmann

Plasma	GitLab	Archive
Projects	Blog	Knowledge