Scanning and comparing files in Jotta folders is slow

[andersolav]

I experienced a very slow comparing of files. I have a backup comparing approx. 50.000 files (with jotta-scanner) that used approx. for 4-5 hours to finish. With a proposed changed the same backup took half an hour.

I found that the compare functions makes a request to Jotta for each file. I have suggestion (code) that that reads the files for one whole folder at a time. This should be Ok also considering simultanous changes to the files beeing compared.

Change to scanner.py's filescanner:
if len(bothplaces): log.debug("Caching MD5 hash for all files in Jotta folder %s in one request", jottafolderpath) jfolder = jfs.getObject(jottafolderpath) jfolderfiles = {} for jf in jfolder.files(): jfilekey = jottafolderpath+"/"+jf.name # TODO neccessery to use jottacloud.get_jottapath ? jfolderfiles[jfilekey] = jf

Also jottacloud.py needs to read from the new jfolderfiles and a new return parameter "jottafoldepath" must be passed from the "compare" function.