cardgames
The source code for cardgames can be found in
examples/mapred-toolkit.
omake cardgamescardgames.conf
$ ./cardgames testdata -games 10000000 plasma::/games1
This takes a few minutes. The output file in /games1 has a size of
around 1.6 GB.
Because we start the distributed variant of the job, we need the task servers:
$ ./cardgames start_task_servers
Servers started
$ ./cardgames distrib -p 8 plasma::/games1 plasma::/avg1
--------------------------------------------------------
Job name: mr_2d54575f16ce135813dd711cc57bb73e
Job ID: mr_2d54575f16ce135813dd711cc57bb73e
Mapred_fs input dir: plasma::/games1
Mapred_fs output dir: plasma::/avg1
Mapred_fs work dir: plasma::/avg1/_work
Mapred_fs log dir: plasma::/avg1/_log
Number task nodes: 1
Task server dir: /tmp/mapred
--------------------------------------------------------
Checking...
Planning...
Pre-start hook...
Starting...
Checking executable versions
Starting job
Tasks: runnable=6 running=0 finished=0 total=6 complete=false
Load: I/O=0.000000 CPU=0.000000
Submitted task Map 0 #000000 to 192.168.5.10
Submitted task Map 1 #000001 to 192.168.5.10
Submitted task Map 2 #000002 to 192.168.5.10
Submitted task Map 3 #000003 to 192.168.5.10
Submitted task Map 4 #000004 to 192.168.5.10
Submitted task Map 5 #000005 to 192.168.5.10
Job can be interrupted with CTRL-C!
Finished task Map 4 #000004
Tasks: runnable=17 running=5 finished=1 total=31 complete=false
Load: I/O=4.000000 CPU=1.000000
Submitted task Sort 0 #000006 to 192.168.5.10
Submitted task Sort 1 #000007 to 192.168.5.10
Submitted task Sort 2 #000008 to 192.168.5.10
Finished task Map 5 #000005
Tasks: runnable=31 running=7 finished=2 total=56 complete=false
Load: I/O=3.500000 CPU=3.500000
Submitted task Sort 3 #000009 to 192.168.5.10
Finished task Map 3 #000003
Tasks: runnable=47 running=7 finished=3 total=81 complete=false
Load: I/O=2.800000 CPU=4.200000
Submitted task Sort 4 #000010 to 192.168.5.10
Finished task Sort 0 #000006
Tasks: runnable=46 running=7 finished=4 total=81 complete=false
Load: I/O=2.800000 CPU=4.200000
Submitted task Sort 5 #000011 to 192.168.5.10
Finished task Map 1 #000001
Tasks: runnable=62 running=7 finished=5 total=115 complete=false
Load: I/O=2.100000 CPU=4.900000
Submitted task Sort 6 #000012 to 192.168.5.10
Finished task Map 2 #000002
Tasks: runnable=78 running=7 finished=6 total=140 complete=false
Load: I/O=1.400000 CPU=5.600000
Submitted task Sort 7 #000013 to 192.168.5.10
Finished task Sort 1 #000007
Tasks: runnable=77 running=7 finished=7 total=140 complete=false
Load: I/O=1.400000 CPU=5.600000
Submitted task Sort 8 #000014 to 192.168.5.10
Finished task Sort 2 #000008
Tasks: runnable=76 running=7 finished=8 total=140 complete=false
Load: I/O=1.400000 CPU=5.600000
Submitted task Sort 9 #000015 to 192.168.5.10
Finished task Map 0 #000000
Tasks: runnable=92 running=7 finished=9 total=186 complete=true
Load: I/O=0.700000 CPU=6.300000
Submitted task Sort 100 #000016 to 192.168.5.10
Finished task Sort 3 #000009
Tasks: runnable=92 running=7 finished=10 total=186 complete=true
Load: I/O=0.700000 CPU=6.300000
Submitted task Shuffle s0-3/p0-7 #000017 to 192.168.5.10
Finished task Sort 5 #000011
Tasks: runnable=91 running=7 finished=11 total=186 complete=true
Load: I/O=1.300000 CPU=5.700000
Submitted task Sort 101 #000018 to 192.168.5.10
Finished task Sort 6 #000012
Tasks: runnable=90 running=7 finished=12 total=186 complete=true
Load: I/O=1.300000 CPU=5.700000
Submitted task Sort 10 #000019 to 192.168.5.10
Finished task Sort 4 #000010
Tasks: runnable=89 running=7 finished=13 total=186 complete=true
Load: I/O=1.300000 CPU=5.700000
Submitted task Sort 11 #000020 to 192.168.5.10
Finished task Sort 7 #000013
Tasks: runnable=89 running=7 finished=14 total=186 complete=true
Load: I/O=1.300000 CPU=5.700000
Submitted task Shuffle s4-7/p0-7 #000021 to 192.168.5.10
Finished task Sort 9 #000015
Tasks: runnable=88 running=7 finished=15 total=186 complete=true
Load: I/O=1.900000 CPU=5.100000
Submitted task Sort 12 #000022 to 192.168.5.10
Finished task Sort 8 #000014
Tasks: runnable=87 running=7 finished=16 total=186 complete=true
Load: I/O=1.900000 CPU=5.100000
Submitted task Sort 13 #000023 to 192.168.5.10
Finished task Sort 100 #000016
Tasks: runnable=86 running=7 finished=17 total=186 complete=true
Load: I/O=1.900000 CPU=5.100000
Submitted task Sort 14 #000024 to 192.168.5.10
Finished task Sort 101 #000018
Tasks: runnable=86 running=7 finished=18 total=186 complete=true
Load: I/O=1.900000 CPU=5.100000
Submitted task Shuffle s100-101/p0-7 #000025 to 192.168.5.10
Finished task Sort 10 #000019
Tasks: runnable=85 running=7 finished=19 total=186 complete=true
Load: I/O=2.500000 CPU=4.500000
Submitted task Sort 15 #000026 to 192.168.5.10
Finished task Shuffle s0-3/p0-7 #000017
Tasks: runnable=84 running=7 finished=20 total=186 complete=true
Load: I/O=1.900000 CPU=5.100000
Submitted task Sort 16 #000027 to 192.168.5.10
Finished task Sort 11 #000020
Tasks: runnable=84 running=7 finished=21 total=186 complete=true
Load: I/O=1.900000 CPU=5.100000
Submitted task Shuffle s8-11/p0-7 #000028 to 192.168.5.10
Finished task Sort 12 #000022
Tasks: runnable=83 running=7 finished=22 total=186 complete=true
Load: I/O=2.500000 CPU=4.500000
Submitted task Sort 17 #000029 to 192.168.5.10
Finished task Sort 13 #000023
Tasks: runnable=82 running=7 finished=23 total=186 complete=true
Load: I/O=2.500000 CPU=4.500000
Submitted task Sort 18 #000030 to 192.168.5.10
Finished task Sort 14 #000024
Tasks: runnable=81 running=7 finished=24 total=186 complete=true
Load: I/O=2.500000 CPU=4.500000
Submitted task Sort 19 #000031 to 192.168.5.10
Finished task Sort 17 #000029
Tasks: runnable=80 running=7 finished=25 total=186 complete=true
Load: I/O=2.500000 CPU=4.500000
Submitted task Sort 20 #000032 to 192.168.5.10
Finished task Shuffle s4-7/p0-7 #000021
Tasks: runnable=79 running=7 finished=26 total=186 complete=true
Load: I/O=1.900000 CPU=5.100000
Submitted task Sort 21 #000033 to 192.168.5.10
Finished task Shuffle s100-101/p0-7 #000025
Tasks: runnable=78 running=7 finished=27 total=186 complete=true
Load: I/O=1.300000 CPU=5.700000
Submitted task Sort 22 #000034 to 192.168.5.10
Finished task Sort 16 #000027
Tasks: runnable=77 running=7 finished=28 total=186 complete=true
Load: I/O=1.300000 CPU=5.700000
Submitted task Sort 23 #000035 to 192.168.5.10
Finished task Sort 15 #000026
Tasks: runnable=77 running=7 finished=29 total=186 complete=true
Load: I/O=1.300000 CPU=5.700000
Submitted task Shuffle s12-15/p0-7 #000036 to 192.168.5.10
Finished task Sort 18 #000030
Tasks: runnable=76 running=7 finished=30 total=186 complete=true
Load: I/O=1.900000 CPU=5.100000
Submitted task Sort 24 #000037 to 192.168.5.10
Finished task Shuffle s8-11/p0-7 #000028
Tasks: runnable=75 running=7 finished=31 total=186 complete=true
Load: I/O=1.300000 CPU=5.700000
Submitted task Sort 25 #000038 to 192.168.5.10
Finished task Sort 20 #000032
Tasks: runnable=74 running=7 finished=33 total=186 complete=true
Load: I/O=1.300000 CPU=5.700000
Submitted task Shuffle s16-19/p0-7 #000040 to 192.168.5.10
Finished task Sort 21 #000033
Tasks: runnable=73 running=7 finished=34 total=186 complete=true
Load: I/O=1.900000 CPU=5.100000
Submitted task Sort 27 #000041 to 192.168.5.10
Finished task Sort 22 #000034
Tasks: runnable=72 running=7 finished=35 total=186 complete=true
Load: I/O=1.900000 CPU=5.100000
Submitted task Sort 28 #000042 to 192.168.5.10
Finished task Sort 23 #000035
Tasks: runnable=72 running=7 finished=36 total=186 complete=true
Load: I/O=1.900000 CPU=5.100000
Submitted task Shuffle s20-23/p0-7 #000043 to 192.168.5.10
Finished task Sort 24 #000037
Tasks: runnable=71 running=7 finished=37 total=186 complete=true
Load: I/O=2.500000 CPU=4.500000
Submitted task Sort 29 #000044 to 192.168.5.10
Finished task Sort 25 #000038
Tasks: runnable=70 running=7 finished=38 total=186 complete=true
Load: I/O=2.500000 CPU=4.500000
Submitted task Sort 30 #000045 to 192.168.5.10
Finished task Shuffle s12-15/p0-7 #000036
Tasks: runnable=73 running=7 finished=39 total=186 complete=true
Load: I/O=1.900000 CPU=5.100000
Submitted task Shuffle s0-15/p0-1 #000046 to 192.168.5.10
Finished task Sort 26 #000039
Tasks: runnable=72 running=7 finished=40 total=186 complete=true
Load: I/O=2.500000 CPU=4.500000
Submitted task Shuffle s0-15/p2-3 #000047 to 192.168.5.10
Finished task Sort 27 #000041
Tasks: runnable=72 running=7 finished=41 total=186 complete=true
Load: I/O=3.100000 CPU=3.900000
Submitted task Shuffle s24-27/p0-7 #000048 to 192.168.5.10
Finished task Sort 28 #000042
Tasks: runnable=71 running=7 finished=42 total=186 complete=true
Load: I/O=3.700000 CPU=3.300000
Submitted task Shuffle s0-15/p4-5 #000049 to 192.168.5.10
Finished task Shuffle s16-19/p0-7 #000040
Tasks: runnable=70 running=7 finished=43 total=186 complete=true
Load: I/O=3.700000 CPU=3.300000
Submitted task Shuffle s0-15/p6-7 #000050 to 192.168.5.10
Finished task Shuffle s20-23/p0-7 #000043
Tasks: runnable=69 running=7 finished=44 total=186 complete=true
Load: I/O=3.700000 CPU=3.300000
Submitted task Sort 31 #000051 to 192.168.5.10
Finished task Sort 30 #000045
Tasks: runnable=68 running=7 finished=45 total=186 complete=true
Load: I/O=3.700000 CPU=3.300000
Submitted task Sort 32 #000052 to 192.168.5.10
Finished task Sort 29 #000044
Tasks: runnable=67 running=7 finished=46 total=186 complete=true
Load: I/O=3.700000 CPU=3.300000
Submitted task Sort 33 #000053 to 192.168.5.10
Finished task Shuffle s0-15/p0-1 #000046
Tasks: runnable=66 running=7 finished=47 total=186 complete=true
Load: I/O=3.100000 CPU=3.900000
Submitted task Sort 34 #000054 to 192.168.5.10
Finished task Shuffle s0-15/p2-3 #000047
Tasks: runnable=65 running=7 finished=48 total=186 complete=true
Load: I/O=2.500000 CPU=4.500000
Submitted task Sort 35 #000055 to 192.168.5.10
Finished task Shuffle s0-15/p4-5 #000049
Tasks: runnable=64 running=7 finished=49 total=186 complete=true
Load: I/O=1.900000 CPU=5.100000
Submitted task Sort 36 #000056 to 192.168.5.10
Finished task Shuffle s0-15/p6-7 #000050
Tasks: runnable=63 running=7 finished=50 total=186 complete=true
Load: I/O=1.300000 CPU=5.700000
Submitted task Sort 37 #000057 to 192.168.5.10
Finished task Sort 31 #000051
Tasks: runnable=63 running=7 finished=51 total=186 complete=true
Load: I/O=1.300000 CPU=5.700000
Submitted task Shuffle s28-31/p0-7 #000058 to 192.168.5.10
Finished task Shuffle s24-27/p0-7 #000048
Tasks: runnable=62 running=7 finished=52 total=186 complete=true
Load: I/O=1.300000 CPU=5.700000
Submitted task Sort 38 #000059 to 192.168.5.10
Finished task Sort 33 #000053
Tasks: runnable=61 running=7 finished=53 total=186 complete=true
Load: I/O=1.300000 CPU=5.700000
Submitted task Sort 39 #000060 to 192.168.5.10
Finished task Sort 32 #000052
Tasks: runnable=60 running=7 finished=54 total=186 complete=true
Load: I/O=1.300000 CPU=5.700000
Submitted task Sort 40 #000061 to 192.168.5.10
Finished task Sort 34 #000054
Tasks: runnable=59 running=7 finished=55 total=186 complete=true
Load: I/O=1.300000 CPU=5.700000
Submitted task Sort 41 #000062 to 192.168.5.10
Finished task Sort 35 #000055
Tasks: runnable=59 running=7 finished=56 total=186 complete=true
Load: I/O=1.300000 CPU=5.700000
Submitted task Shuffle s32-35/p0-7 #000063 to 192.168.5.10
Finished task Sort 36 #000056
Tasks: runnable=58 running=7 finished=57 total=186 complete=true
Load: I/O=1.900000 CPU=5.100000
Submitted task Sort 42 #000064 to 192.168.5.10
Finished task Sort 37 #000057
Tasks: runnable=57 running=7 finished=58 total=186 complete=true
Load: I/O=1.900000 CPU=5.100000
Submitted task Sort 43 #000065 to 192.168.5.10
Finished task Sort 38 #000059
Tasks: runnable=56 running=7 finished=59 total=186 complete=true
Load: I/O=1.900000 CPU=5.100000
Submitted task Sort 44 #000066 to 192.168.5.10
Finished task Sort 40 #000061
Tasks: runnable=55 running=7 finished=60 total=186 complete=true
Load: I/O=1.900000 CPU=5.100000
Submitted task Sort 45 #000067 to 192.168.5.10
Finished task Sort 39 #000060
Tasks: runnable=55 running=7 finished=61 total=186 complete=true
Load: I/O=1.900000 CPU=5.100000
Submitted task Shuffle s36-39/p0-7 #000068 to 192.168.5.10
Finished task Sort 41 #000062
Tasks: runnable=54 running=7 finished=62 total=186 complete=true
Load: I/O=2.500000 CPU=4.500000
Submitted task Sort 46 #000069 to 192.168.5.10
Finished task Shuffle s28-31/p0-7 #000058
Tasks: runnable=57 running=7 finished=63 total=186 complete=true
Load: I/O=1.900000 CPU=5.100000
Submitted task Shuffle s16-31/p0-1 #000070 to 192.168.5.10
Finished task Sort 42 #000064
Tasks: runnable=56 running=7 finished=64 total=186 complete=true
Load: I/O=2.500000 CPU=4.500000
Submitted task Shuffle s16-31/p2-3 #000071 to 192.168.5.10
Finished task Shuffle s32-35/p0-7 #000063
Tasks: runnable=55 running=7 finished=65 total=186 complete=true
Load: I/O=2.500000 CPU=4.500000
Submitted task Shuffle s16-31/p4-5 #000072 to 192.168.5.10
Finished task Sort 45 #000067
Tasks: runnable=54 running=7 finished=66 total=186 complete=true
Load: I/O=3.100000 CPU=3.900000
Submitted task Shuffle s16-31/p6-7 #000073 to 192.168.5.10
Finished task Sort 44 #000066
Tasks: runnable=53 running=7 finished=67 total=186 complete=true
Load: I/O=3.700000 CPU=3.300000
Submitted task Sort 48 #000075 to 192.168.5.10
Finished task Sort 43 #000065
Tasks: runnable=52 running=7 finished=69 total=186 complete=true
Load: I/O=3.700000 CPU=3.300000
Submitted task Shuffle s40-43/p0-7 #000076 to 192.168.5.10
Finished task Shuffle s36-39/p0-7 #000068
Tasks: runnable=51 running=7 finished=70 total=186 complete=true
Load: I/O=3.700000 CPU=3.300000
Submitted task Sort 49 #000077 to 192.168.5.10
Finished task Shuffle s16-31/p0-1 #000070
Tasks: runnable=50 running=7 finished=71 total=186 complete=true
Load: I/O=3.100000 CPU=3.900000
Submitted task Sort 50 #000078 to 192.168.5.10
Finished task Shuffle s16-31/p2-3 #000071
Tasks: runnable=49 running=7 finished=72 total=186 complete=true
Load: I/O=2.500000 CPU=4.500000
Submitted task Sort 51 #000079 to 192.168.5.10
Finished task Sort 51 #000079
Tasks: runnable=48 running=7 finished=73 total=186 complete=true
Load: I/O=2.500000 CPU=4.500000
Submitted task Sort 52 #000080 to 192.168.5.10
Finished task Sort 47 #000074
Tasks: runnable=48 running=7 finished=74 total=186 complete=true
Load: I/O=2.500000 CPU=4.500000
Submitted task Shuffle s44-47/p0-7 #000081 to 192.168.5.10
Finished task Sort 48 #000075
Tasks: runnable=47 running=7 finished=75 total=186 complete=true
Load: I/O=3.100000 CPU=3.900000
Submitted task Sort 53 #000082 to 192.168.5.10
Finished task Shuffle s16-31/p4-5 #000072
Tasks: runnable=46 running=7 finished=76 total=186 complete=true
Load: I/O=2.500000 CPU=4.500000
Submitted task Sort 54 #000083 to 192.168.5.10
Finished task Sort 49 #000077
Tasks: runnable=45 running=7 finished=77 total=186 complete=true
Load: I/O=2.500000 CPU=4.500000
Submitted task Sort 55 #000084 to 192.168.5.10
Finished task Sort 50 #000078
Tasks: runnable=45 running=7 finished=78 total=186 complete=true
Load: I/O=2.500000 CPU=4.500000
Submitted task Shuffle s48-51/p0-7 #000085 to 192.168.5.10
Finished task Shuffle s40-43/p0-7 #000076
Tasks: runnable=44 running=7 finished=79 total=186 complete=true
Load: I/O=2.500000 CPU=4.500000
Submitted task Sort 56 #000086 to 192.168.5.10
Finished task Shuffle s16-31/p6-7 #000073
Tasks: runnable=43 running=7 finished=80 total=186 complete=true
Load: I/O=1.900000 CPU=5.100000
Submitted task Sort 57 #000087 to 192.168.5.10
Finished task Sort 52 #000080
Tasks: runnable=42 running=7 finished=81 total=186 complete=true
Load: I/O=1.900000 CPU=5.100000
Submitted task Sort 58 #000088 to 192.168.5.10
Finished task Sort 53 #000082
Tasks: runnable=41 running=7 finished=82 total=186 complete=true
Load: I/O=1.900000 CPU=5.100000
Submitted task Sort 59 #000089 to 192.168.5.10
Finished task Sort 54 #000083
Tasks: runnable=40 running=7 finished=83 total=186 complete=true
Load: I/O=1.900000 CPU=5.100000
Submitted task Sort 60 #000090 to 192.168.5.10
Finished task Shuffle s44-47/p0-7 #000081
Tasks: runnable=43 running=7 finished=84 total=186 complete=true
Load: I/O=1.300000 CPU=5.700000
Submitted task Shuffle s32-47/p0-1 #000091 to 192.168.5.10
Finished task Sort 55 #000084
Tasks: runnable=43 running=7 finished=85 total=186 complete=true
Load: I/O=1.900000 CPU=5.100000
Submitted task Shuffle s32-47/p2-3 #000092 to 192.168.5.10
Finished task Sort 57 #000087
Tasks: runnable=42 running=7 finished=86 total=186 complete=true
Load: I/O=2.500000 CPU=4.500000
Submitted task Shuffle s32-47/p4-5 #000093 to 192.168.5.10
Finished task Sort 56 #000086
Tasks: runnable=41 running=7 finished=87 total=186 complete=true
Load: I/O=3.100000 CPU=3.900000
Submitted task Shuffle s32-47/p6-7 #000094 to 192.168.5.10
Finished task Shuffle s48-51/p0-7 #000085
Tasks: runnable=40 running=7 finished=88 total=186 complete=true
Load: I/O=3.100000 CPU=3.900000
Submitted task Shuffle s52-55/p0-7 #000095 to 192.168.5.10
Finished task Sort 58 #000088
Tasks: runnable=39 running=7 finished=89 total=186 complete=true
Load: I/O=3.700000 CPU=3.300000
Submitted task Sort 61 #000096 to 192.168.5.10
Finished task Sort 59 #000089
Tasks: runnable=39 running=7 finished=90 total=186 complete=true
Load: I/O=3.700000 CPU=3.300000
Submitted task Shuffle s56-59/p0-7 #000097 to 192.168.5.10
Finished task Sort 60 #000090
Tasks: runnable=38 running=7 finished=91 total=186 complete=true
Load: I/O=4.300000 CPU=2.700000
Submitted task Sort 62 #000098 to 192.168.5.10
Finished task Shuffle s32-47/p0-1 #000091
Tasks: runnable=37 running=7 finished=92 total=186 complete=true
Load: I/O=3.700000 CPU=3.300000
Submitted task Sort 63 #000099 to 192.168.5.10
Finished task Shuffle s32-47/p2-3 #000092
Tasks: runnable=36 running=7 finished=93 total=186 complete=true
Load: I/O=3.100000 CPU=3.900000
Submitted task Sort 64 #000100 to 192.168.5.10
Finished task Sort 61 #000096
Tasks: runnable=35 running=7 finished=94 total=186 complete=true
Load: I/O=3.100000 CPU=3.900000
Submitted task Sort 65 #000101 to 192.168.5.10
Finished task Shuffle s32-47/p4-5 #000093
Tasks: runnable=34 running=7 finished=95 total=186 complete=true
Load: I/O=2.500000 CPU=4.500000
Submitted task Sort 66 #000102 to 192.168.5.10
Finished task Shuffle s32-47/p6-7 #000094
Tasks: runnable=33 running=7 finished=96 total=186 complete=true
Load: I/O=1.900000 CPU=5.100000
Submitted task Sort 67 #000103 to 192.168.5.10
Finished task Sort 62 #000098
Tasks: runnable=32 running=7 finished=97 total=186 complete=true
Load: I/O=1.900000 CPU=5.100000
Submitted task Sort 68 #000104 to 192.168.5.10
Finished task Shuffle s52-55/p0-7 #000095
Tasks: runnable=31 running=7 finished=98 total=186 complete=true
Load: I/O=1.300000 CPU=5.700000
Submitted task Sort 69 #000105 to 192.168.5.10
Finished task Shuffle s56-59/p0-7 #000097
Tasks: runnable=30 running=7 finished=99 total=186 complete=true
Load: I/O=0.700000 CPU=6.300000
Submitted task Sort 70 #000106 to 192.168.5.10
Finished task Sort 63 #000099
Tasks: runnable=30 running=7 finished=100 total=186 complete=true
Load: I/O=0.700000 CPU=6.300000
Submitted task Shuffle s60-63/p0-7 #000107 to 192.168.5.10
Finished task Sort 68 #000104
Tasks: runnable=29 running=7 finished=101 total=186 complete=true
Load: I/O=1.300000 CPU=5.700000
Submitted task Sort 71 #000108 to 192.168.5.10
Finished task Sort 64 #000100
Tasks: runnable=28 running=7 finished=102 total=186 complete=true
Load: I/O=1.300000 CPU=5.700000
Submitted task Sort 72 #000109 to 192.168.5.10
Finished task Sort 66 #000102
Tasks: runnable=27 running=7 finished=103 total=186 complete=true
Load: I/O=1.300000 CPU=5.700000
Submitted task Sort 73 #000110 to 192.168.5.10
Finished task Sort 65 #000101
Tasks: runnable=26 running=7 finished=104 total=186 complete=true
Load: I/O=1.300000 CPU=5.700000
Submitted task Sort 74 #000111 to 192.168.5.10
Finished task Sort 69 #000105
Tasks: runnable=25 running=7 finished=105 total=186 complete=true
Load: I/O=1.300000 CPU=5.700000
Submitted task Sort 75 #000112 to 192.168.5.10
Finished task Sort 67 #000103
Tasks: runnable=25 running=7 finished=106 total=186 complete=true
Load: I/O=1.300000 CPU=5.700000
Submitted task Shuffle s64-67/p0-7 #000113 to 192.168.5.10
Finished task Sort 70 #000106
Tasks: runnable=24 running=7 finished=107 total=186 complete=true
Load: I/O=1.900000 CPU=5.100000
Submitted task Sort 76 #000114 to 192.168.5.10
Finished task Sort 71 #000108
Tasks: runnable=24 running=7 finished=108 total=186 complete=true
Load: I/O=1.900000 CPU=5.100000
Submitted task Shuffle s68-71/p0-7 #000115 to 192.168.5.10
Finished task Shuffle s60-63/p0-7 #000107
Tasks: runnable=27 running=7 finished=109 total=186 complete=true
Load: I/O=1.900000 CPU=5.100000
Submitted task Shuffle s48-63/p0-1 #000116 to 192.168.5.10
Finished task Sort 74 #000111
Tasks: runnable=26 running=7 finished=110 total=186 complete=true
Load: I/O=2.500000 CPU=4.500000
Submitted task Shuffle s48-63/p2-3 #000117 to 192.168.5.10
Finished task Sort 72 #000109
Tasks: runnable=25 running=7 finished=111 total=186 complete=true
Load: I/O=3.100000 CPU=3.900000
Submitted task Shuffle s48-63/p4-5 #000118 to 192.168.5.10
Finished task Sort 73 #000110
Tasks: runnable=24 running=7 finished=112 total=186 complete=true
Load: I/O=3.700000 CPU=3.300000
Submitted task Shuffle s48-63/p6-7 #000119 to 192.168.5.10
Finished task Sort 75 #000112
Tasks: runnable=24 running=7 finished=113 total=186 complete=true
Load: I/O=4.300000 CPU=2.700000
Submitted task Shuffle s72-75/p0-7 #000120 to 192.168.5.10
Finished task Sort 76 #000114
Tasks: runnable=23 running=7 finished=114 total=186 complete=true
Load: I/O=4.900000 CPU=2.100000
Submitted task Sort 77 #000121 to 192.168.5.10
Finished task Shuffle s64-67/p0-7 #000113
Tasks: runnable=22 running=7 finished=115 total=186 complete=true
Load: I/O=4.300000 CPU=2.700000
Submitted task Sort 78 #000122 to 192.168.5.10
Finished task Shuffle s68-71/p0-7 #000115
Tasks: runnable=21 running=7 finished=116 total=186 complete=true
Load: I/O=3.700000 CPU=3.300000
Submitted task Sort 79 #000123 to 192.168.5.10
Finished task Shuffle s48-63/p2-3 #000117
Tasks: runnable=22 running=7 finished=117 total=186 complete=true
Load: I/O=3.100000 CPU=3.900000
Submitted task Shuffle s0-63/p2-2 #000124 to 192.168.5.10
Finished task Shuffle s48-63/p0-1 #000116
Tasks: runnable=23 running=7 finished=118 total=186 complete=true
Load: I/O=3.100000 CPU=3.900000
Submitted task Shuffle s0-63/p0-0 #000125 to 192.168.5.10
Finished task Shuffle s48-63/p4-5 #000118
Tasks: runnable=24 running=7 finished=119 total=186 complete=true
Load: I/O=3.100000 CPU=3.900000
Submitted task Shuffle s0-63/p1-1 #000126 to 192.168.5.10
Finished task Shuffle s48-63/p6-7 #000119
Tasks: runnable=25 running=7 finished=120 total=186 complete=true
Load: I/O=3.100000 CPU=3.900000
Submitted task Shuffle s0-63/p3-3 #000127 to 192.168.5.10
Finished task Sort 78 #000122
Tasks: runnable=24 running=7 finished=121 total=186 complete=true
Load: I/O=3.700000 CPU=3.300000
Submitted task Shuffle s0-63/p4-4 #000128 to 192.168.5.10
Finished task Sort 77 #000121
Tasks: runnable=23 running=7 finished=122 total=186 complete=true
Load: I/O=4.300000 CPU=2.700000
Submitted task Shuffle s0-63/p5-5 #000129 to 192.168.5.10
Finished task Shuffle s72-75/p0-7 #000120
Tasks: runnable=22 running=7 finished=123 total=186 complete=true
Load: I/O=4.300000 CPU=2.700000
Submitted task Shuffle s0-63/p6-6 #000130 to 192.168.5.10
Finished task Sort 79 #000123
Tasks: runnable=22 running=7 finished=124 total=186 complete=true
Load: I/O=4.900000 CPU=2.100000
Submitted task Shuffle s76-79/p0-7 #000131 to 192.168.5.10
Finished task Shuffle s76-79/p0-7 #000131
Tasks: runnable=25 running=7 finished=125 total=186 complete=true
Load: I/O=4.900000 CPU=2.100000
Submitted task Shuffle s64-79/p0-1 #000132 to 192.168.5.10
Finished task Shuffle s0-63/p0-0 #000125
Tasks: runnable=24 running=7 finished=126 total=186 complete=true
Load: I/O=4.900000 CPU=2.100000
Submitted task Shuffle s64-79/p2-3 #000133 to 192.168.5.10
Finished task Shuffle s0-63/p1-1 #000126
Tasks: runnable=23 running=7 finished=127 total=186 complete=true
Load: I/O=4.900000 CPU=2.100000
Submitted task Shuffle s64-79/p4-5 #000134 to 192.168.5.10
Finished task Shuffle s0-63/p2-2 #000124
Tasks: runnable=22 running=7 finished=128 total=186 complete=true
Load: I/O=4.900000 CPU=2.100000
Submitted task Shuffle s64-79/p6-7 #000135 to 192.168.5.10
Finished task Shuffle s0-63/p4-4 #000128
Tasks: runnable=21 running=7 finished=129 total=186 complete=true
Load: I/O=4.900000 CPU=2.100000
Submitted task Shuffle s0-63/p7-7 #000136 to 192.168.5.10
Finished task Shuffle s0-63/p3-3 #000127
Tasks: runnable=20 running=7 finished=130 total=186 complete=true
Load: I/O=4.900000 CPU=2.100000
Submitted task Sort 80 #000137 to 192.168.5.10
Finished task Shuffle s0-63/p5-5 #000129
Tasks: runnable=19 running=7 finished=131 total=186 complete=true
Load: I/O=4.300000 CPU=2.700000
Submitted task Sort 81 #000138 to 192.168.5.10
Finished task Shuffle s0-63/p6-6 #000130
Tasks: runnable=18 running=7 finished=132 total=186 complete=true
Load: I/O=3.700000 CPU=3.300000
Submitted task Sort 82 #000139 to 192.168.5.10
Finished task Shuffle s64-79/p0-1 #000132
Tasks: runnable=17 running=7 finished=133 total=186 complete=true
Load: I/O=3.100000 CPU=3.900000
Submitted task Sort 83 #000140 to 192.168.5.10
Finished task Sort 80 #000137
Tasks: runnable=16 running=7 finished=134 total=186 complete=true
Load: I/O=3.100000 CPU=3.900000
Submitted task Sort 84 #000141 to 192.168.5.10
Finished task Sort 82 #000139
Tasks: runnable=15 running=7 finished=135 total=186 complete=true
Load: I/O=3.100000 CPU=3.900000
Submitted task Sort 85 #000142 to 192.168.5.10
Finished task Sort 81 #000138
Tasks: runnable=14 running=7 finished=136 total=186 complete=true
Load: I/O=3.100000 CPU=3.900000
Submitted task Sort 86 #000143 to 192.168.5.10
Finished task Shuffle s64-79/p2-3 #000133
Tasks: runnable=13 running=7 finished=137 total=186 complete=true
Load: I/O=2.500000 CPU=4.500000
Submitted task Sort 87 #000144 to 192.168.5.10
Finished task Sort 83 #000140
Tasks: runnable=13 running=7 finished=138 total=186 complete=true
Load: I/O=2.500000 CPU=4.500000
Submitted task Shuffle s80-83/p0-7 #000145 to 192.168.5.10
Finished task Shuffle s64-79/p4-5 #000134
Tasks: runnable=12 running=7 finished=139 total=186 complete=true
Load: I/O=2.500000 CPU=4.500000
Submitted task Sort 88 #000146 to 192.168.5.10
Finished task Shuffle s64-79/p6-7 #000135
Tasks: runnable=11 running=7 finished=140 total=186 complete=true
Load: I/O=1.900000 CPU=5.100000
Submitted task Sort 89 #000147 to 192.168.5.10
Finished task Sort 84 #000141
Tasks: runnable=10 running=7 finished=141 total=186 complete=true
Load: I/O=1.900000 CPU=5.100000
Submitted task Sort 90 #000148 to 192.168.5.10
Finished task Sort 85 #000142
Tasks: runnable=9 running=7 finished=142 total=186 complete=true
Load: I/O=1.900000 CPU=5.100000
Submitted task Sort 91 #000149 to 192.168.5.10
Finished task Sort 86 #000143
Tasks: runnable=8 running=7 finished=143 total=186 complete=true
Load: I/O=1.900000 CPU=5.100000
Submitted task Sort 92 #000150 to 192.168.5.10
Finished task Sort 87 #000144
Tasks: runnable=8 running=7 finished=144 total=186 complete=true
Load: I/O=1.900000 CPU=5.100000
Submitted task Shuffle s84-87/p0-7 #000151 to 192.168.5.10
Finished task Sort 88 #000146
Tasks: runnable=7 running=7 finished=145 total=186 complete=true
Load: I/O=2.500000 CPU=4.500000
Submitted task Sort 93 #000152 to 192.168.5.10
Finished task Sort 89 #000147
Tasks: runnable=6 running=7 finished=146 total=186 complete=true
Load: I/O=2.500000 CPU=4.500000
Submitted task Sort 94 #000153 to 192.168.5.10
Finished task Shuffle s0-63/p7-7 #000136
Tasks: runnable=5 running=7 finished=147 total=186 complete=true
Load: I/O=1.900000 CPU=5.100000
Submitted task Sort 95 #000154 to 192.168.5.10
Finished task Shuffle s80-83/p0-7 #000145
Tasks: runnable=4 running=7 finished=148 total=186 complete=true
Load: I/O=1.300000 CPU=5.700000
Submitted task Sort 96 #000155 to 192.168.5.10
Finished task Sort 90 #000148
Tasks: runnable=3 running=7 finished=149 total=186 complete=true
Load: I/O=1.300000 CPU=5.700000
Submitted task Sort 97 #000156 to 192.168.5.10
Finished task Sort 91 #000149
Tasks: runnable=3 running=7 finished=150 total=186 complete=true
Load: I/O=1.300000 CPU=5.700000
Submitted task Shuffle s88-91/p0-7 #000157 to 192.168.5.10
Finished task Sort 92 #000150
Tasks: runnable=2 running=7 finished=151 total=186 complete=true
Load: I/O=1.900000 CPU=5.100000
Submitted task Sort 98 #000158 to 192.168.5.10
Finished task Sort 94 #000153
Tasks: runnable=1 running=7 finished=152 total=186 complete=true
Load: I/O=1.900000 CPU=5.100000
Submitted task Sort 99 #000159 to 192.168.5.10
Finished task Sort 93 #000152
Tasks: runnable=0 running=7 finished=153 total=186 complete=true
Load: I/O=1.900000 CPU=5.100000
Finished task Sort 95 #000154
Tasks: runnable=1 running=6 finished=154 total=186 complete=true
Load: I/O=1.800000 CPU=4.200000
Submitted task Shuffle s92-95/p0-7 #000160 to 192.168.5.10
Finished task Sort 96 #000155
Tasks: runnable=0 running=6 finished=155 total=186 complete=true
Load: I/O=2.400000 CPU=3.600000
Finished task Sort 97 #000156
Tasks: runnable=0 running=5 finished=156 total=186 complete=true
Load: I/O=2.300000 CPU=2.700000
Finished task Shuffle s84-87/p0-7 #000151
Tasks: runnable=0 running=4 finished=157 total=186 complete=true
Load: I/O=1.600000 CPU=2.400000
Finished task Sort 98 #000158
Tasks: runnable=0 running=3 finished=158 total=186 complete=true
Load: I/O=1.500000 CPU=1.500000
Finished task Shuffle s88-91/p0-7 #000157
Tasks: runnable=0 running=2 finished=159 total=186 complete=true
Load: I/O=0.800000 CPU=1.200000
Finished task Sort 99 #000159
Tasks: runnable=1 running=1 finished=160 total=186 complete=true
Load: I/O=0.700000 CPU=0.300000
Submitted task Shuffle s96-99/p0-7 #000161 to 192.168.5.10
Finished task Shuffle s92-95/p0-7 #000160
Tasks: runnable=4 running=1 finished=161 total=186 complete=true
Load: I/O=0.700000 CPU=0.300000
Submitted task Shuffle s80-95/p0-1 #000162 to 192.168.5.10
Submitted task Shuffle s80-95/p2-3 #000163 to 192.168.5.10
Submitted task Shuffle s80-95/p4-5 #000164 to 192.168.5.10
Submitted task Shuffle s80-95/p6-7 #000165 to 192.168.5.10
Finished task Shuffle s96-99/p0-7 #000161
Tasks: runnable=4 running=4 finished=162 total=186 complete=true
Load: I/O=2.800000 CPU=1.200000
Submitted task Shuffle s96-101/p0-1 #000166 to 192.168.5.10
Submitted task Shuffle s96-101/p2-3 #000167 to 192.168.5.10
Submitted task Shuffle s96-101/p4-5 #000168 to 192.168.5.10
Submitted task Shuffle s96-101/p6-7 #000169 to 192.168.5.10
Finished task Shuffle s80-95/p4-5 #000164
Tasks: runnable=0 running=7 finished=163 total=186 complete=true
Load: I/O=4.900000 CPU=2.100000
Finished task Shuffle s96-101/p4-5 #000168
Tasks: runnable=2 running=6 finished=164 total=186 complete=true
Load: I/O=4.200000 CPU=1.800000
Submitted task Shuffle s64-101/p4-4 #000170 to 192.168.5.10
Submitted task Shuffle s64-101/p5-5 #000171 to 192.168.5.10
Finished task Shuffle s80-95/p2-3 #000163
Tasks: runnable=0 running=7 finished=165 total=186 complete=true
Load: I/O=4.900000 CPU=2.100000
Finished task Shuffle s80-95/p6-7 #000165
Tasks: runnable=0 running=6 finished=166 total=186 complete=true
Load: I/O=4.200000 CPU=1.800000
Finished task Shuffle s96-101/p6-7 #000169
Tasks: runnable=2 running=5 finished=167 total=186 complete=true
Load: I/O=3.500000 CPU=1.500000
Submitted task Shuffle s64-101/p6-6 #000172 to 192.168.5.10
Submitted task Shuffle s64-101/p7-7 #000173 to 192.168.5.10
Finished task Shuffle s80-95/p0-1 #000162
Tasks: runnable=0 running=6 finished=168 total=186 complete=true
Load: I/O=4.200000 CPU=1.800000
Finished task Shuffle s96-101/p2-3 #000167
Tasks: runnable=2 running=5 finished=169 total=186 complete=true
Load: I/O=3.500000 CPU=1.500000
Submitted task Shuffle s64-101/p2-2 #000174 to 192.168.5.10
Submitted task Shuffle s64-101/p3-3 #000175 to 192.168.5.10
Finished task Shuffle s96-101/p0-1 #000166
Tasks: runnable=2 running=6 finished=170 total=186 complete=true
Load: I/O=4.200000 CPU=1.800000
Submitted task Shuffle s64-101/p0-0 #000176 to 192.168.5.10
Submitted task Shuffle s64-101/p1-1 #000177 to 192.168.5.10
Finished task Shuffle s64-101/p4-4 #000170
Tasks: runnable=1 running=7 finished=172 total=186 complete=true
Load: I/O=4.700000 CPU=2.300000
Submitted task Shuffle s0-101/p5-5 #000179 to 192.168.5.10
Finished task Shuffle s64-101/p1-1 #000177
Tasks: runnable=1 running=7 finished=173 total=186 complete=true
Load: I/O=4.500000 CPU=2.500000
Submitted task Shuffle s0-101/p1-1 #000180 to 192.168.5.10
Finished task Shuffle s64-101/p6-6 #000172
Tasks: runnable=1 running=7 finished=174 total=186 complete=true
Load: I/O=4.300000 CPU=2.700000
Submitted task Shuffle s0-101/p6-6 #000181 to 192.168.5.10
Finished task Shuffle s64-101/p3-3 #000175
Tasks: runnable=1 running=7 finished=175 total=186 complete=true
Load: I/O=4.100000 CPU=2.900000
Submitted task Shuffle s0-101/p3-3 #000182 to 192.168.5.10
Finished task Shuffle s64-101/p2-2 #000174
Tasks: runnable=1 running=7 finished=176 total=186 complete=true
Load: I/O=3.900000 CPU=3.100000
Submitted task Shuffle s0-101/p2-2 #000183 to 192.168.5.10
Finished task Shuffle s64-101/p0-0 #000176
Tasks: runnable=1 running=7 finished=177 total=186 complete=true
Load: I/O=3.700000 CPU=3.300000
Submitted task Shuffle s0-101/p0-0 #000184 to 192.168.5.10
Finished task Shuffle s64-101/p7-7 #000173
Tasks: runnable=1 running=7 finished=178 total=186 complete=true
Load: I/O=3.500000 CPU=3.500000
Submitted task Shuffle s0-101/p7-7 #000185 to 192.168.5.10
Finished task Shuffle s0-101/p4-4 #000178
Tasks: runnable=0 running=7 finished=179 total=186 complete=true
Load: I/O=3.500000 CPU=3.500000
Finished task Shuffle s0-101/p5-5 #000179
Tasks: runnable=0 running=6 finished=180 total=186 complete=true
Load: I/O=3.000000 CPU=3.000000
Finished task Shuffle s0-101/p1-1 #000180
Tasks: runnable=0 running=5 finished=181 total=186 complete=true
Load: I/O=2.500000 CPU=2.500000
Finished task Shuffle s0-101/p3-3 #000182
Tasks: runnable=0 running=4 finished=182 total=186 complete=true
Load: I/O=2.000000 CPU=2.000000
Finished task Shuffle s0-101/p6-6 #000181
Tasks: runnable=0 running=3 finished=183 total=186 complete=true
Load: I/O=1.500000 CPU=1.500000
Finished task Shuffle s0-101/p7-7 #000185
Tasks: runnable=0 running=2 finished=184 total=186 complete=true
Load: I/O=1.000000 CPU=1.000000
Finished task Shuffle s0-101/p2-2 #000183
Tasks: runnable=0 running=1 finished=185 total=186 complete=true
Load: I/O=0.500000 CPU=0.500000
Finished task Shuffle s0-101/p0-0 #000184
Tasks: runnable=0 running=0 finished=186 total=186 complete=true
Load: I/O=-0.000000 CPU=0.000000
Finished job
Counter write_lines 275003500.00
Counter write_fs_time 171.72
Counter write_bytes 6205145088.00
Counter write_blocks 122209.00
Counter time_underutil 2.82
Counter sort_time 682.73
Counter runtime 434.61
Counter read_lines 329915006.00
Counter read_fs_time 147.02
Counter read_bytes 9641229490.00
Counter read_blocks 147374.00
Counter num_tasks_successful 186.00
Counter num_tasks_misalloc 0.00
Counter num_input_files_nonlocal 0.00
Counter num_input_files 386.00
Counter avg_runqueue_tasks 34.06
Counter avg_running_tasks 7.39
Wallclock runtime: 434.614139 seconds
Job_status: successful
Cleanup...
Sending cleanup tasks
Cleaning rest up
Done clean-up
Post-finish hook...
Job_status: successful
Finished.
