Plasma GitLab Archive
Projects Blog Knowledge

Module Mapred_taskfiles


module Mapred_taskfiles: sig .. end
Copy files to and from the task nodes

class type taskfile_manager = object .. end
val scp_taskfile_manager : Mapred_config.mapred_config ->
Mapred_def.mapred_job_config -> taskfile_manager
A taskfile manager that uses scp to copy file to remote nodes.

The local_directory is set to mr_task_tmpdir/job_id_"local".

The log_directory is set to mr_task_tmpdir/job_id_"log".

val ssh_cmd : string -> string -> string
ssh_cmd host cmd: Generates a shell command that runs cmd on host
val scp_to_cmd : string list -> string -> string -> string
scp_to_cmd localfiles host dest: Generates a shell command that copies localfiles to host into the destination dest
This web site is published by Informatikbüro Gerd Stolpmann
Powered by Caml