Module Mapred_taskfiles

module Mapred_taskfiles: sig .. end

Copy files to and from the task nodes

class type taskfile_manager = object .. end

val scp_taskfile_manager : Mapred_config.mapred_config ->
       Mapred_def.mapred_job_config -> taskfile_manager

A taskfile manager that uses scp to copy file to remote nodes.

The local_directory is set to mr_task_tmpdir/job_id_"local".

The log_directory is set to mr_task_tmpdir/job_id_"log".

val ssh_cmd : string -> string -> string

ssh_cmd host cmd: Generates a shell command that runs cmd on host

val scp_to_cmd : string list -> string -> string -> string

scp_to_cmd localfiles host dest: Generates a shell command that copies localfiles to host into the destination dest

This web site is published by Informatikbüro Gerd Stolpmann

Plasma	GitLab	Archive
Projects	Blog	Knowledge