Problem moving files inside directories #3038

amelcon-dot · 2024-12-09T21:28:36Z

amelcon-dot
Dec 9, 2024
Sponsor

Hello,
I have problems when I move a file into a new subdirectory, directly inside Onedrive.

These are the operations I did:

I am running the client in monitor mode with version 2.5.3.
I have a file called Development of a Flexible UHF RFID.odt inside the directory: v1/amelcon/upct/PhdThesis/EKhamlichi/paper1/.
Next, I go to Onedrive and create a new subdirectory v1/amelcon/upct/PhdThesis/EKhamlichi/paper1/ver1.
Next, in Onedrive I move the file into the new subdirectory.

During the next sync cycle, the client gives this error:

[2024-Dec-09 19:10:49.8685579] Moving v1/amelcon/upct/PhdThesis/EKhamlichi/paper1/Development of a Flexible UHF RFID.odt to v1/amelcon/upct/PhdThesis/EKhamlichi/paper1/ver1/Development of a Flexible UHF RFID.odt
[2024-Dec-09 19:10:49.8687851] 
[2024-Dec-09 19:10:49.8688139] ERROR: The local file system returned an error with the following message:
[2024-Dec-09 19:10:49.8688348]   Error Message:    v1/amelcon/upct/PhdThesis/EKhamlichi/paper1/ver1/Development of a Flexible UHF RFID.odt: No such file or directory
[2024-Dec-09 19:10:49.8688555]   Calling Function: applyPotentiallyChangedItem()

Before finishing the synchronization I get:

[2024-Dec-09 19:12:26.5314761] Performing a last examination of the most recent online data within Microsoft OneDrive to complete the reconciliation process
[2024-Dec-09 19:12:26.6514681] Trying to delete local file: v1/amelcon/upct/PhdThesis/EKhamlichi/paper1/Development of a Flexible UHF RFID.odt
[2024-Dec-09 19:12:26.6521287] Deleting local file: v1/amelcon/upct/PhdThesis/EKhamlichi/paper1/Development of a Flexible UHF RFID.odt

It seems it tries to find the file inside v1/amelcon/upct/PhdThesis/EKhamlichi/paper1/ver1, but at this point, the file is not there locally. The file locally is still in v1/amelcon/upct/PhdThesis/EKhamlichi/paper1 because it hasn't been moved yet. At the end, the client finds that the file in Onedrive does not exist in v1/amelcon/upct/PhdThesis/EKhamlichi/paper1, because I manually moved it. So the file is completely eliminated, from both the local system and from Onedrive.
I need to go to the Onedrive trash and then do Restore to recover back the file.
Is there any solution so the file is not eliminated when it is moved inside Onedrive?.
Thank you very much for your help.

abraunegg · 2024-12-09T21:36:52Z

abraunegg
Dec 9, 2024
Maintainer

Please raise a bug report and provide a verbose debug log as per https://github.com/abraunegg/onedrive/wiki/Generate-debug-log-for-support when replicating the issue.

0 replies

abraunegg · 2024-12-09T21:56:14Z

abraunegg
Dec 9, 2024
Maintainer

@amelcon-dot
The other question I have is:

Are you running all these syncs manually ? Or have you set up systemd services to manage your data ?

This is a really important question to answer

8 replies

abraunegg Dec 10, 2024
Maintainer

@amelcon-dot

then I move the file in Onedrive, and I get the error in the next sync cycle

This is the troubling item ... if you are running in --monitor mode the filesystem should be notifying the client via inotify that the move is occurring and that the file / directory structure has moved locally and then is moved online and recorded as being moved all within seconds of the file actually moving locally.

However ... IF your directory v1/amelcon/upct/PhdThesis/AOliva/mttJ24/ lives on:

A Network Share - SMB, NFS or other
Is on an NTFS formatted disk

Both of these do not support inotify - thus the client has no way to fully understand what has moved locally.

Please read: https://github.com/abraunegg/onedrive/blob/master/docs/usage.md#how-to-change-where-my-data-from-microsoft-onedrive-is-stored

amelcon-dot Dec 10, 2024
Author Sponsor

I thought changes occurring locally are detected immediately, but changes occurring in Onedrive need to wait until the next sync cycle controlled by monitor_interval. This is how the client behaves in my system.

abraunegg Dec 10, 2024
Maintainer

@amelcon-dot
Where are you making the change?

Online or Locally ?

Example: local change - move file locally

[M] Local directory created: v1/amelcon/upct/PhdThesis/AOliva/mttJ24/test
Scanning the local file system 'v1/amelcon/upct/PhdThesis/AOliva/mttJ24/test' for new data to upload
New directories to create on Microsoft OneDrive: 1
OneDrive Client requested to create this directory online: v1/amelcon/upct/PhdThesis/AOliva/mttJ24/test
The requested directory to create was not found on OneDrive - creating remote directory: v1/amelcon/upct/PhdThesis/AOliva/mttJ24/test
Successfully created the remote directory v1/amelcon/upct/PhdThesis/AOliva/mttJ24/test on Microsoft OneDrive
[M] Local item moved: v1/amelcon/upct/PhdThesis/AOliva/mttJ24/Graphical_Abstract_TMTT.pptx -> v1/amelcon/upct/PhdThesis/AOliva/mttJ24/test/Graphical_Abstract_TMTT.pptx
Moving v1/amelcon/upct/PhdThesis/AOliva/mttJ24/Graphical_Abstract_TMTT.pptx to v1/amelcon/upct/PhdThesis/AOliva/mttJ24/test/Graphical_Abstract_TMTT.pptx

instantly moved locally and then moved online

amelcon-dot Dec 10, 2024
Author Sponsor

Sorry, my explanation was ambiguous; I move the file Online.

abraunegg Dec 10, 2024
Maintainer

creation of other folder (unfortunatly this was captured first because the next sync kicked in seconds later):

Starting a sync with Microsoft OneDrive
Fetching /delta response from the OneDrive API for Drive ID: b!bO8V7s9SSk6r7mWHpIjURotN33W1W2tEv3OXV_oFIdQimEdOHR-1So7CqeT1MfHA
Processing API Response Bundle: 1 - Quantity of 'changes|items' in this bundle to process: 10
Finished processing /delta JSON response from the OneDrive API
Processing 9 applicable changes and items received from Microsoft OneDrive
Processing OneDrive JSON item batch [1/1] to ensure consistent local state
Creating local directory: ./v1/amelcon/upct/PhdThesis/AOliva/mttJ24/test2
Monitoring directory: v1/amelcon/upct/PhdThesis/AOliva/mttJ24/test2
Performing a database consistency and integrity check on locally stored data
Processing DB entries for this Drive ID: b!bO8V7s9SSk6r7mWHpIjURotN33W1W2tEv3OXV_oFIdQimEdOHR-1So7CqeT1MfHA
Processing: ~/OneDrive
The directory has not changed
Processing: L18N
The directory has not changed
Processing: L18N/α
The directory has not changed
Processing: L18N/เอกสาร
The directory has not changed
Processing: L18N/Bücher
The directory has not changed
Processing: Notebooks
The directory has not changed
Processing: Notebooks/online_notebook
The directory has not changed
Processing: bad_url_decode
The directory has not changed
Processing: bad_url_decode/BTINserye%20Anti-Terror%20Law%20sa%20Wikang%20Filipino%20-%2.mp4
The file has not changed
Processing: session_testing
The directory has not changed
Processing: session_testing/file_under_4Mb
The directory has not changed
Processing: session_testing/file_under_4Mb/file_under_4mb.docx
The file has not changed
Processing: session_testing/non_enrichment_over_4mb
The directory has not changed
Processing: session_testing/non_enrichment_over_4mb/file1.data
The file has not changed
Processing: session_testing/file_over_4Mb
The directory has not changed
Processing: session_testing/file_over_4Mb/file_over_4mb.docx
The file has not changed
Processing: session_testing/non_enrichment_under_4Mb
The directory has not changed
Processing: session_testing/non_enrichment_under_4Mb/file1.data
The file has not changed
Processing: v1
The directory has not changed
Processing: v1/amelcon
The directory has not changed
Processing: v1/amelcon/upct
The directory has not changed
Processing: v1/amelcon/upct/PhdThesis
The directory has not changed
Processing: v1/amelcon/upct/PhdThesis/AOliva
The directory has not changed
Processing: v1/amelcon/upct/PhdThesis/AOliva/mttJ24
The directory has not changed
Processing: v1/amelcon/upct/PhdThesis/AOliva/mttJ24/test
The directory has not changed
Processing: v1/amelcon/upct/PhdThesis/AOliva/mttJ24/test/Graphical_Abstract_TMTT.pptx
The file has not changed
Processing: v1/amelcon/upct/PhdThesis/AOliva/mttJ24/test2
The directory has not changed
Scanning the local file system '~/OneDrive' for new data to upload
Performing a last examination of the most recent online data within Microsoft OneDrive to complete the reconciliation process
Fetching /delta response from the OneDrive API for Drive ID: b!bO8V7s9SSk6r7mWHpIjURotN33W1W2tEv3OXV_oFIdQimEdOHR-1So7CqeT1MfHA
Processing API Response Bundle: 1 - Quantity of 'changes|items' in this bundle to process: 0
Finished processing /delta JSON response from the OneDrive API
No changes or items that can be applied were discovered while processing the data received from Microsoft OneDrive
Sync with Microsoft OneDrive is complete

file moved online to 'test2' folder from 'test' folder:

Successfully reached Microsoft OneDrive Login Service
Starting a sync with Microsoft OneDrive
Fetching /delta response from the OneDrive API for Drive ID: b!bO8V7s9SSk6r7mWHpIjURotN33W1W2tEv3OXV_oFIdQimEdOHR-1So7CqeT1MfHA
Processing API Response Bundle: 1 - Quantity of 'changes|items' in this bundle to process: 9
Finished processing /delta JSON response from the OneDrive API
Processing 8 applicable changes and items received from Microsoft OneDrive
Processing OneDrive JSON item batch [1/1] to ensure consistent local state
WARNING: OneDrive API inconsistency - this file does not have any hash: v1/amelcon/upct/PhdThesis/AOliva/mttJ24/test2/Graphical_Abstract_TMTT.pptx
Moving v1/amelcon/upct/PhdThesis/AOliva/mttJ24/test/Graphical_Abstract_TMTT.pptx to v1/amelcon/upct/PhdThesis/AOliva/mttJ24/test2/Graphical_Abstract_TMTT.pptx
WARNING: OneDrive API inconsistency - this file does not have any hash: v1/amelcon/upct/PhdThesis/AOliva/mttJ24/test2/Graphical_Abstract_TMTT.pptx
Performing a database consistency and integrity check on locally stored data
Processing DB entries for this Drive ID: b!bO8V7s9SSk6r7mWHpIjURotN33W1W2tEv3OXV_oFIdQimEdOHR-1So7CqeT1MfHA
Processing: ~/OneDrive
The directory has not changed
Processing: L18N
The directory has not changed
Processing: L18N/α
The directory has not changed
Processing: L18N/เอกสาร
The directory has not changed
Processing: L18N/Bücher
The directory has not changed
Processing: Notebooks
The directory has not changed
Processing: Notebooks/online_notebook
The directory has not changed
Processing: bad_url_decode
The directory has not changed
Processing: bad_url_decode/BTINserye%20Anti-Terror%20Law%20sa%20Wikang%20Filipino%20-%2.mp4
The file has not changed
Processing: session_testing
The directory has not changed
Processing: session_testing/file_under_4Mb
The directory has not changed
Processing: session_testing/file_under_4Mb/file_under_4mb.docx
The file has not changed
Processing: session_testing/non_enrichment_over_4mb
The directory has not changed
Processing: session_testing/non_enrichment_over_4mb/file1.data
The file has not changed
Processing: session_testing/file_over_4Mb
The directory has not changed
Processing: session_testing/file_over_4Mb/file_over_4mb.docx
The file has not changed
Processing: session_testing/non_enrichment_under_4Mb
The directory has not changed
Processing: session_testing/non_enrichment_under_4Mb/file1.data
The file has not changed
Processing: v1
The directory has not changed
Processing: v1/amelcon
The directory has not changed
Processing: v1/amelcon/upct
The directory has not changed
Processing: v1/amelcon/upct/PhdThesis
The directory has not changed
Processing: v1/amelcon/upct/PhdThesis/AOliva
The directory has not changed
Processing: v1/amelcon/upct/PhdThesis/AOliva/mttJ24
The directory has not changed
Processing: v1/amelcon/upct/PhdThesis/AOliva/mttJ24/test
The directory has not changed
Processing: v1/amelcon/upct/PhdThesis/AOliva/mttJ24/test2
The directory has not changed
Processing: v1/amelcon/upct/PhdThesis/AOliva/mttJ24/test2/Graphical_Abstract_TMTT.pptx
The file has not changed
Scanning the local file system '~/OneDrive' for new data to upload
Performing a last examination of the most recent online data within Microsoft OneDrive to complete the reconciliation process
Fetching /delta response from the OneDrive API for Drive ID: b!bO8V7s9SSk6r7mWHpIjURotN33W1W2tEv3OXV_oFIdQimEdOHR-1So7CqeT1MfHA
Processing API Response Bundle: 1 - Quantity of 'changes|items' in this bundle to process: 0
Finished processing /delta JSON response from the OneDrive API
No changes or items that can be applied were discovered while processing the data received from Microsoft OneDrive
Sync with Microsoft OneDrive is complete

File is moved 100% without issue .........

Create a new folder 'test3' and move file before next sync:

Starting a sync with Microsoft OneDrive
Fetching /delta response from the OneDrive API for Drive ID: b!bO8V7s9SSk6r7mWHpIjURotN33W1W2tEv3OXV_oFIdQimEdOHR-1So7CqeT1MfHA
Processing API Response Bundle: 1 - Quantity of 'changes|items' in this bundle to process: 9
Finished processing /delta JSON response from the OneDrive API
Processing 8 applicable changes and items received from Microsoft OneDrive
Processing OneDrive JSON item batch [1/1] to ensure consistent local state
Creating local directory: ./v1/amelcon/upct/PhdThesis/AOliva/mttJ24/test3
WARNING: OneDrive API inconsistency - this file does not have any hash: v1/amelcon/upct/PhdThesis/AOliva/mttJ24/test3/Graphical_Abstract_TMTT.pptx
Moving v1/amelcon/upct/PhdThesis/AOliva/mttJ24/test2/Graphical_Abstract_TMTT.pptx to v1/amelcon/upct/PhdThesis/AOliva/mttJ24/test3/Graphical_Abstract_TMTT.pptx
WARNING: OneDrive API inconsistency - this file does not have any hash: v1/amelcon/upct/PhdThesis/AOliva/mttJ24/test3/Graphical_Abstract_TMTT.pptx
Monitoring directory: v1/amelcon/upct/PhdThesis/AOliva/mttJ24/test3
Performing a database consistency and integrity check on locally stored data
Processing DB entries for this Drive ID: b!bO8V7s9SSk6r7mWHpIjURotN33W1W2tEv3OXV_oFIdQimEdOHR-1So7CqeT1MfHA
Processing: ~/OneDrive
The directory has not changed
Processing: L18N
The directory has not changed
Processing: L18N/α
The directory has not changed
Processing: L18N/เอกสาร
The directory has not changed
Processing: L18N/Bücher
The directory has not changed
Processing: Notebooks
The directory has not changed
Processing: Notebooks/online_notebook
The directory has not changed
Processing: bad_url_decode
The directory has not changed
Processing: bad_url_decode/BTINserye%20Anti-Terror%20Law%20sa%20Wikang%20Filipino%20-%2.mp4
The file has not changed
Processing: session_testing
The directory has not changed
Processing: session_testing/file_under_4Mb
The directory has not changed
Processing: session_testing/file_under_4Mb/file_under_4mb.docx
The file has not changed
Processing: session_testing/non_enrichment_over_4mb
The directory has not changed
Processing: session_testing/non_enrichment_over_4mb/file1.data
The file has not changed
Processing: session_testing/file_over_4Mb
The directory has not changed
Processing: session_testing/file_over_4Mb/file_over_4mb.docx
The file has not changed
Processing: session_testing/non_enrichment_under_4Mb
The directory has not changed
Processing: session_testing/non_enrichment_under_4Mb/file1.data
The file has not changed
Processing: v1
The directory has not changed
Processing: v1/amelcon
The directory has not changed
Processing: v1/amelcon/upct
The directory has not changed
Processing: v1/amelcon/upct/PhdThesis
The directory has not changed
Processing: v1/amelcon/upct/PhdThesis/AOliva
The directory has not changed
Processing: v1/amelcon/upct/PhdThesis/AOliva/mttJ24
The directory has not changed
Processing: v1/amelcon/upct/PhdThesis/AOliva/mttJ24/test
The directory has not changed
Processing: v1/amelcon/upct/PhdThesis/AOliva/mttJ24/test2
The directory has not changed
Processing: v1/amelcon/upct/PhdThesis/AOliva/mttJ24/test3
The directory has not changed
Processing: v1/amelcon/upct/PhdThesis/AOliva/mttJ24/test3/Graphical_Abstract_TMTT.pptx
The file has not changed
Scanning the local file system '~/OneDrive' for new data to upload
Performing a last examination of the most recent online data within Microsoft OneDrive to complete the reconciliation process
Fetching /delta response from the OneDrive API for Drive ID: b!bO8V7s9SSk6r7mWHpIjURotN33W1W2tEv3OXV_oFIdQimEdOHR-1So7CqeT1MfHA
Processing API Response Bundle: 1 - Quantity of 'changes|items' in this bundle to process: 0
Finished processing /delta JSON response from the OneDrive API
No changes or items that can be applied were discovered while processing the data received from Microsoft OneDrive
Sync with Microsoft OneDrive is complete

Creates the new local directory that was created online
Moves the file that was in-sync from 'test2' to 'test3'

amelcon-dot · 2024-12-11T09:19:01Z

amelcon-dot
Dec 11, 2024
Author Sponsor

Hello,
I send the log file with --verbose --verbose and a brief explanation via E-mail, as requested.

I explain what I did:

I start with a fresh file in:

v1/amelcon/upct/PhdThesis/AOliva/mttJ24/Graphical_Abstract_TMTT.pptx

I start the client in --monitor mode and wait to finish the first sync cycle.

While the client in waiting, I do in a windows machine:

create directory test5
create directory test6

copy the file Graphical_Abstract_TMTT.pptx to test5
move the file Graphical_Abstract_TMTT.pptx to test6

The microsoft Onedrive is running in the windows machine, so the online version is updated with these modifications.

Note that test5 and test6 only exist online. They are not created locally yet.

Wait for the client to perform the next sync cycle.
Result locally is:
The file is correctly copied in test5

The folder test6 is removed
The original file v1/amelcon/upct/PhdThesis/AOliva/mttJ24/Graphical_Abstract_TMTT.pptx is removed.

0 replies

amelcon-dot · 2024-12-11T16:52:19Z

amelcon-dot
Dec 11, 2024
Author Sponsor

Some more information.

I work with the online file system (through a windows machine and the Microsoft Onedrive client).
First I copy the file in test6, then I remove the original file v1/amelcon/upct/PhdThesis/AOliva/mttJ24/Graphical_Abstract_TMTT.pptx, now the file gets moved locally without errors.

0 replies

abraunegg · 2024-12-11T18:24:04Z

abraunegg
Dec 11, 2024
Maintainer

@amelcon-dot
You have a number of issues going on:

Old version of OpenSSL - leaving you vulnerable to OpenSSL issues that cause stability issues with this client
Old version of 'curl / libcurl' - leaving you vulnerable to issues that cause stability issues with this client

Please read https://github.com/abraunegg/onedrive/blob/master/docs/usage.md#compatibility-with-curl - you are impacted with bugs 5 to 13 on your system

You do not implement the work around / HTTP/1.1 downgrade
You are currently using the v2.5.3 release, and you are using 'skip_dir' and there are bugs that have been fixed regarding this option use on how things are matched when using that option.

From the analysis of your debug, I have identified what might be going on, and I need to see if I can reproduce this to confirm this theory.

Please raise a new bug report, providing all the correct details for bug tracking purposes.

0 replies

amelcon-dot · 2024-12-11T18:53:15Z

amelcon-dot
Dec 11, 2024
Author Sponsor

OK, done. Thanks.

0 replies

abraunegg · 2024-12-12T18:17:01Z

abraunegg
Dec 12, 2024
Maintainer

Fixed via #3041 & #3042

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Problem moving files inside directories #3038

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 7 comments 8 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

Select a reply

Problem moving files inside directories #3038

amelcon-dot Dec 9, 2024 Sponsor

Replies: 7 comments · 8 replies

abraunegg Dec 9, 2024 Maintainer

abraunegg Dec 9, 2024 Maintainer

abraunegg Dec 10, 2024 Maintainer

amelcon-dot Dec 10, 2024 Author Sponsor

abraunegg Dec 10, 2024 Maintainer

Example: local change - move file locally

amelcon-dot Dec 10, 2024 Author Sponsor

abraunegg Dec 10, 2024 Maintainer

amelcon-dot Dec 11, 2024 Author Sponsor

amelcon-dot Dec 11, 2024 Author Sponsor

abraunegg Dec 11, 2024 Maintainer

amelcon-dot Dec 11, 2024 Author Sponsor

abraunegg Dec 12, 2024 Maintainer

amelcon-dot
Dec 9, 2024
Sponsor

Replies: 7 comments 8 replies

abraunegg
Dec 9, 2024
Maintainer

abraunegg
Dec 9, 2024
Maintainer

abraunegg Dec 10, 2024
Maintainer

amelcon-dot Dec 10, 2024
Author Sponsor

abraunegg Dec 10, 2024
Maintainer

amelcon-dot Dec 10, 2024
Author Sponsor

abraunegg Dec 10, 2024
Maintainer

amelcon-dot
Dec 11, 2024
Author Sponsor

amelcon-dot
Dec 11, 2024
Author Sponsor

abraunegg
Dec 11, 2024
Maintainer

amelcon-dot
Dec 11, 2024
Author Sponsor

abraunegg
Dec 12, 2024
Maintainer