Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

“Conflict when uploading a folder. It’s going to get cleared!” when creating new folder in Desktop Client #3912

Closed
wonx opened this issue Oct 20, 2021 · 27 comments · Fixed by #3987

Comments

@wonx
Copy link

wonx commented Oct 20, 2021

How to use GitHub

  • Please use the 👍 reaction to show that you are affected by the same issue.
  • Please don't comment if you have no relevant information to add. It's just extra noise for everyone subscribed to this issue.
  • Subscribe to receive notifications on status change and new comments.

Expected behaviour

I have synched my library, most of which from an external storage, with my Ubuntu laptop, and with the experimental virtual filesystem enabled. It's maybe 1.5 o 2TB of data, and a few hundreds of thousands of files.

Once everything was synced (took a few hours) without errors. I decided to test it by moving some files around or creating new ones.

Actual behaviour

It turns out that every time I try to create a folder, I get this error message:
“Conflict when uploading a folder. It’s going to get cleared!”
and the folder immediately disappears. That also happens in the folders not located in external storage.

If I create the folder in the web interface, or directly in the internal storage, it is synced correctly and the folder appears.

Steps to reproduce

  1. Sync nextcloud using virtual filesystem.
  2. Wait until it finishes without errors.
  3. Create new folder in the synced file tree.

Client configuration

Client version: 3.3.5 (appimage)

Operating system: Ubuntu 20.04 LTS

OS language: Catalan

Qt version used by client package (Linux only, see also Settings dialog): (couldn't find it)

Client package (From Nextcloud or distro) (Linux only): Nextcloud-3.3.5-x86_64.AppImage

Installation path of client: /home//Applications/

Server configuration

Nextcloud version: 22.1.0 and mysql

Storage backend (external storage): sftp

Logs

Please use Gist (https://gist.github.com/) or a similar code paster for longer
logs.

@wonx wonx added the bug label Oct 20, 2021
@wonx
Copy link
Author

wonx commented Oct 20, 2021

cleared

@wonx
Copy link
Author

wonx commented Oct 20, 2021

(I can't seem to upload the zip file with the log files...)

@FlexW
Copy link

FlexW commented Oct 20, 2021

@allexzander That might be something you want to have look at. Could that be an issue with the rename logic?

@wonx
Copy link
Author

wonx commented Oct 20, 2021

Btw, I cannot create new folders (they get deleted immediately), but I can rename existing ones without a problem.

@allexzander
Copy link
Contributor

(I can't seem to upload the zip file with the log files...)

@wonx Could you kindly upload your logs here? https://cloud.nextcloud.com/s/cxarZK2aESJxXoq

@wonx
Copy link
Author

wonx commented Oct 29, 2021

Hi. I have uploaded the logs from the desktop client to the url you mentiond. In these logs, I basically started Nextcloud, wait until the icon was green, then created a folder called "Test folder" and waited a couple seconds until it was automatically deleted, then closed the client.

By the way, I noticed it only happens with empty folders. I can copy a folder with files inside, but I the problem appears when it's empty.

@allexzander
Copy link
Contributor

@wonx Thanks. I have studied logs, but, I need more information, hence, I have built a custom build https://cloud.nextcloud.com/s/6pmWAtwjd9sYC9t with more logs in places of my interest. Would you have some time to install this build, then reproduce an issue again using this custom build? I will have more information with those new log statements added which may help me find the root cause of the problem. You can upload logs created with custom build into this link https://cloud.nextcloud.com/s/MRFLJmJaknBmdXg.

@nicx
Copy link

nicx commented Nov 3, 2021

Same problem here with Mac OS Monterey on an Macbook with M1 CPU. Using Nextcloud client version 3.3.6 with virtual filesystem enabled.

@wonx
Copy link
Author

wonx commented Nov 3, 2021

@allexzander I have the issue in my Ubuntu installation (I have not tried it enough in my Windows partition). Do you have a version of the custom build that I can run in linux (maybe .appimage or .deb?)

@Guigxs
Copy link

Guigxs commented Nov 10, 2021

Same problem on my side with Manjaro. Using Nextcloud client 3.3.5 with virtual filesystem enabled.

@ixnextuser
Copy link

Same problem, Big Sur on Intel.

Even if I create a folder and get to put some file in there before the client deletes it the folder is either deleted or the client is unable to sync the folder. You can try to reproduce this behaviour by marking several files and make a new folder with selected files.
I am happy to hear you are already on it!

@fenpaws
Copy link

fenpaws commented Nov 29, 2021

Hi i noticed that this issue is closed, but I still have the Issue in MacOS Monterey (Intel), I use the latest available build, 3.3.6. Also, VFS is enabled for those folders.

@nicx
Copy link

nicx commented Nov 29, 2021

@fenpaws as far as I understand the fix #3987 this should be solved with milestones 3.4.0. So either you have to switch to the current beta or just wait for the release of this version ;)

@fenpaws
Copy link

fenpaws commented Nov 29, 2021

@nicx Well I also tried the Beta and still have the issue, well anyway then I need to wait and disable my sync for a while. Thanks!

@allexzander
Copy link
Contributor

@fenpaws
Copy link

fenpaws commented Nov 29, 2021

@allexzander Okay RC2 fixed it for me, I thought switching the update branch to beta would suffice.

@wonx
Copy link
Author

wonx commented Nov 30, 2021

Thanks for your time in fixing it. I will try as soon as my client updates.

@ghost
Copy link

ghost commented May 11, 2022

@allexzander Just got this issue on Client 3.5 and it been happening on 3.4 also i moved a while folder with a lot a file into a external storage dr via desktop and the client said Conflict when uploading It's going to get removed. I just lost a lot of data this is messed up. Someone needs to fix this ASAP!!!

@ghost
Copy link

ghost commented May 11, 2022

Why is the client deleting data without my approval ? If the data cant be uploaded then it should notify the user and no delete it. Who's going to get all my data now ?

@ghost
Copy link

ghost commented May 11, 2022

Also I put in a trouble ticket about this back in Feb 11 and no one from support even acknowledged it and the bot closed it.

#4269 (comment)

@platima
Copy link

platima commented Jul 1, 2023

I had a random assortment of files and folders wiped due to this. Details: https://www.reddit.com/r/NextCloud/comments/14ngkv8

No idea why.

@platima
Copy link

platima commented Nov 13, 2023

How is this still happening? I paste a source folder into a another folder that is synced to NC, and then it disappears with all the contents, and the log shows sync error "it's going to get cleared". How is permanently erasing data a solution?

@allexzander
Copy link
Contributor

How is this still happening? I paste a source folder into a another folder that is synced to NC, and then it disappears with all the contents, and the log shows sync error "it's going to get cleared". How is permanently erasing data a solution?

You mean you moved a folder from a non-Nextcloud synced location to a Nextcloud synced location it disappeared? Or is it present in the server's trash bin?
What version of the client you are using?
What were previous error messages, could you create a debug archive from the Settings dialog?

@platima
Copy link

platima commented Nov 13, 2023

I mean I am working in a folder which is synced to the server, I go to another folder that is not synced and cut a folder full of items, going back to the synced folder I paste it. A few seconds later it f#$ks off into the ether, and when I check the NC log it shows that it was a conflict and 'cleared'.

Latest client I believe, updated a few days ago and had to reboot my whole dang computer as always.

No other error messages. Oddly that log about "it's going to get cleared" also disappears after not long, as others have also reported.

@lildadou
Copy link

If I cut and paste (or move) a folder then I have the problem.
If I copy-paste a folder then the problem doesn't appear.

@allexzander
Copy link
Contributor

If I cut and paste (or move) a folder then I have the problem. If I copy-paste a folder then the problem doesn't appear.

Is the folder you are moving already in the sync folder or is it outside somewhere on your PC? A PR here will make internal moves into a single DB write operation, mitigating the possibility of problems caused by sequential moves while the previous move is still being written into the DB #6211

@lildadou
Copy link

lildadou commented Feb 28, 2024

Is the folder you are moving already in the sync folder or is it outside somewhere on your PC?

Outside of the sync folder and this only seems to apply to "large files" (tested for >2Gio).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

9 participants