Output of containers.csv file is empty.

[lagefreitas]

Contents of containers.csv file:

CONTAINER,CPU%,MEMUSAGE/LIMIT,MEM%,NETI/O,BLOCKI/O,PIDS_JULIA,PIDS_DOCKER,TIMESTAMP

I ran the prototype at my OSX, Workers can access my local /tmp dir:

julia> nofworkers=1
julia> adddockerworkers(nofworkers,_prototype=true)
02-Oct 21:44:44:INFO:root:Deploying Docker 1 container(s) and initialize their SSH daemon...
02-Oct 21:44:44:INFO:root:Executing command `docker run -tid -v /tmp/results:/DistributedMachineLearningThesis/src/results --cpus 1 -m 2048000000 dmlt`...
02-Oct 21:44:45:INFO:root:Container b52cd40dfe2ea55f25267de5449aebd77869dc010e8e70cc12b757b240364001 is up
02-Oct 21:44:45:INFO:root:Executing command `docker exec b52cd40dfe2ea55f25267de5449aebd77869dc010e8e70cc12b757b240364001 /usr/sbin/sshd`...
02-Oct 21:44:46:INFO:root:Getting containers' IP address(es)...
02-Oct 21:44:46:INFO:root:Executing command `docker inspect '--format={{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}}' b52cd40dfe2ea55f25267de5449aebd77869dc010e8e70cc12b757b240364001`...
02-Oct 21:44:46:INFO:root:Containers' IP address is 172.17.0.3
02-Oct 21:44:46:INFO:root:Creating 1 Worker(s) through SSH...
stdin: is not a tty
02-Oct 21:44:46:INFO:root:Creating 1 Worker(s) through SSH... DONE.
			Workers' PIDs are 
[5]

02-Oct 21:44:46:INFO:root:Getting Workers' container IDs to update the pids-cid Dict...
1-element Array{Int64,1}:
 5

julia> @fetch run(`ls results`)
	From worker 5:	1890883-18-10-02-21:35:24-1234
	From worker 5:	f1-3-20_4_2_MAPE_summary.txt
	From worker 5:	f1-3-20_4_2_MSE_summary.txt
	From worker 5:	f1-3-20_4_2_R2_summary.txt
	From worker 5:	f1-3-20_4_2_node_summary.txt
	From worker 5:	f1-3-20_4_2_time_summary.txt
	From worker 5:	incomplete

julia> @fetch run(`cat results/1890883-18-10-02-21:35:24-1234/containers.csv`)

julia> 

@NaelsonDouglas could you take care of it please?

[NaelsonDouglas]

To execute the experiment and get the output you gotta call 'experiment()'

From the log you only added the workers, but didn't execute any experiment

[NaelsonDouglas]

include("call_experiment.jl")

args =["3", "20", "f1", "1234", "4", "2"]
experiment(args)

you can call only experiment() to use the 'args' values written above (the are default values actually)

[lagefreitas]

@NaelsonDouglas I did it, the output I posted refers to few lines I added to double check if containers could access my local FS. Actually, to double check the _prototype=true parameter ;-)

[NaelsonDouglas]

I executed it on Ubuntu and the result was as expected. I'm not sure what may be causing the error on MACOSX.

Looks like it might be a problem on the function 'generatetable'.

shell> cat results/1890883-18-10-05-05:45:26-1234/system.csv
calculate_maxmin_seconds,clustering_time_seconds,elapsed_time_seconds,create_histogram_seconds,MAPE,MSE,R2,testing_model_seconds,train_global_model_seconds,local_training_seconds
7.47,9.67,76.63,1.73,0.0,0.0,0.0,1.38,6.03,33.91
0.72,0.0,0.0,0.0,1483.7089841570198,0.035304176818130084,-2.3100602969319053,0.0,1.72,25.6
0.72,0.0,0.0,0.0,106.54521236314774,0.009901634293316874,-0.0010837624525064091,0.0,1.68,25.51
0.73,0.0,0.0,0.0,450.16555664841394,0.07847232600163141,0.3140483779722293,0.0,1.7,25.76