[Bug]:nextcloudcmd 3.4.2, Delays for ~ 120 sec. on additional execution with database locked warnings on ubuntu 22.04.03. When using "--unsyncedfolders". Also on version 3.7.3 on Ubuntu 23.04 and Debian12

[Skammi]

⚠️ Before submitting, please verify the following: ⚠️

• This is a bug, not a question or a configuration issue.
• This issue is not already reported on Github (I've searched it).
• Nextcloud Server and Desktop Client are up to date. See Server Maintenance and Release Schedule and Desktop Releases for supported versions.
• I agree to follow Nextcloud's Code of Conduct

Bug description

nextcloudcmd exits with database locked warnings for each file for additional times it is executed.
Each warning has a delay of approximately 120 sec.
This when running on ubuntu version: 22.04.03 LTS with nextcloudcmd version: 3.4.2-1ubuntu1

Same command runs fine on ubuntu 20.04.06 LTS with nextcloudcmd version: 2.6.2-1build1

See attached terminal output:

TSO-230926-turtle-nextcloudcmd-failure_username_pwd_removed.txt

EDIT

The delay only occurs when using the --unsyncedfolders option. The format used in the excluded file is the same as used on nextcloudcmd version 2.4.0, which worked. There are no error message regarding the format of the excluded folders file. But I could not find documentation regarding the file format of the exclude file in version 3.4 and 3.7.

TSO-230928-test23-nextcloudcmd-issues-on-UbuntuServer2023_testuser-username_and_pwd_removed.txt

Steps to reproduce

1. rm -r ~/JaCloud/*
2. rm -r ~/JaCloud/.sync*
3. Run: /usr/bin/nextcloudcmd -u USERNAME -p USERPWD --unsyncedfolders /home/jac/.nextcloud/excluded --non-interactive /home/jac/JaCloud https://jacloud.sjakio.com
   exits with database closed
4. Run: /usr/bin/nextcloudcmd -u USERNAME -p USERPWD --unsyncedfolders /home/jac/.nextcloud/excluded --non-interactive /home/jac/JaCloud https://jacloud.sjakio.com
   exits with database locked warnings and approximately 120 sec delay per file to be synced.

Expected behavior

No database locked warnings at successive executions of nextcloudcmd.

Which files are affected by this bug

/usr/bin/nextcloudcmd

Operating system

Linux

Which version of the operating system you are running.

ubuntu 22.04.03 LTS

Package

Appimage

Nextcloud Server version

https://nextcloud.com/

Nextcloud Desktop Client version

nextcloudcmd 3.4.2

Is this bug present after an update or on a fresh install?

Fresh desktop client install

Are you using the Nextcloud Server Encryption module?

Encryption is Disabled

Are you using an external user-backend?

• Default internal user-backend
• LDAP/ Active Directory
• SSO - SAML
• Other

Nextcloud Server logs

{"reqId":"ugWzMW3mUZqP25wDP393","level":3,"time":"2023-09-19T04:35:49+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"Allowed memory size of 536870912 bytes exhausted (tried to allocate 20480 bytes) at /usr/local/www/nextcloud/3rdparty/doctrine/dbal/src/ExpandArrayParameters.php#72","userAgent":"--","version":"27.0.2.1","data":{"app":"PHP"}}
{"reqId":"5sbtF3mqawCw8hS9amj7","level":3,"time":"2023-09-19T16:35:47+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"Allowed memory size of 536870912 bytes exhausted (tried to allocate 20480 bytes) at /usr/local/www/nextcloud/3rdparty/doctrine/dbal/src/ExpandArrayParameters.php#72","userAgent":"--","version":"27.0.2.1","data":{"app":"PHP"}}
{"reqId":"XXwllTZ8ogTZO7uhpyM0","level":3,"time":"2023-09-20T04:35:49+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"Allowed memory size of 536870912 bytes exhausted (tried to allocate 16384 bytes) at /usr/local/www/nextcloud/3rdparty/doctrine/dbal/src/Driver/PDO/Statement.php#101","userAgent":"--","version":"27.0.2.1","data":{"app":"PHP"}}
{"reqId":"HZBjvREPpauSnMX3kkDZ","level":3,"time":"2023-09-20T16:35:48+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"Allowed memory size of 536870912 bytes exhausted (tried to allocate 20480 bytes) at /usr/local/www/nextcloud/3rdparty/doctrine/dbal/src/ExpandArrayParameters.php#72","userAgent":"--","version":"27.0.2.1","data":{"app":"PHP"}}
{"reqId":"gxq9WTZeAWQ7GnnIo167","level":3,"time":"2023-09-21T04:35:52+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"Allowed memory size of 536870912 bytes exhausted (tried to allocate 16384 bytes) at /usr/local/www/nextcloud/3rdparty/doctrine/dbal/src/Driver/PDO/Statement.php#101","userAgent":"--","version":"27.0.2.1","data":{"app":"PHP"}}
{"reqId":"3aiy5sybOyhUcqyALBai","level":3,"time":"2023-09-21T16:35:49+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"Allowed memory size of 536870912 bytes exhausted (tried to allocate 20480 bytes) at /usr/local/www/nextcloud/3rdparty/doctrine/dbal/src/ExpandArrayParameters.php#72","userAgent":"--","version":"27.0.2.1","data":{"app":"PHP"}}
{"reqId":"qYmiBmoUIH1VggjylNwQ","level":3,"time":"2023-09-22T04:35:49+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"Allowed memory size of 536870912 bytes exhausted (tried to allocate 20480 bytes) at /usr/local/www/nextcloud/3rdparty/doctrine/dbal/src/ExpandArrayParameters.php#72","userAgent":"--","version":"27.0.2.1","data":{"app":"PHP"}}
{"reqId":"IIpoQmbM5zBweHJLdqfk","level":3,"time":"2023-09-22T16:35:49+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"Allowed memory size of 536870912 bytes exhausted (tried to allocate 20480 bytes) at /usr/local/www/nextcloud/3rdparty/doctrine/dbal/src/ExpandArrayParameters.php#72","userAgent":"--","version":"27.0.2.1","data":{"app":"PHP"}}
{"reqId":"7TM1pb3varJd6WDS99GP","level":3,"time":"2023-09-23T04:35:49+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"Allowed memory size of 536870912 bytes exhausted (tried to allocate 16384 bytes) at /usr/local/www/nextcloud/3rdparty/doctrine/dbal/src/Driver/PDO/Statement.php#101","userAgent":"--","version":"27.0.2.1","data":{"app":"PHP"}}
{"reqId":"zBF1SOtxi9emx6VW4x1z","level":3,"time":"2023-09-23T16:35:49+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"Allowed memory size of 536870912 bytes exhausted (tried to allocate 20480 bytes) at /usr/local/www/nextcloud/3rdparty/doctrine/dbal/src/ExpandArrayParameters.php#72","userAgent":"--","version":"27.0.2.1","data":{"app":"PHP"}}
{"reqId":"JOGm7CjlMe9yhNe9B9nJ","level":3,"time":"2023-09-24T04:36:36+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"Allowed memory size of 536870912 bytes exhausted (tried to allocate 33554440 bytes) at /usr/local/www/nextcloud/3rdparty/doctrine/dbal/src/Driver/PDO/Result.php#118","userAgent":"--","version":"27.0.2.1","data":{"app":"PHP"}}
{"reqId":"gfFkiRQ2xPN4j3YYjFSn","level":3,"time":"2023-09-24T16:40:46+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"Allowed memory size of 536870912 bytes exhausted (tried to allocate 20480 bytes) at /usr/local/www/nextcloud/3rdparty/doctrine/dbal/src/ExpandArrayParameters.php#72","userAgent":"--","version":"27.0.2.1","data":{"app":"PHP"}}
{"reqId":"7LJ7v1I7cUYAS0GSPdU6","level":3,"time":"2023-09-25T04:40:46+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"Allowed memory size of 536870912 bytes exhausted (tried to allocate 20480 bytes) at /usr/local/www/nextcloud/3rdparty/doctrine/dbal/src/ExpandArrayParameters.php#72","userAgent":"--","version":"27.0.2.1","data":{"app":"PHP"}}
{"reqId":"r5JKf3Pd7rzOAsk3BKQD","level":3,"time":"2023-09-25T16:40:47+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"Allowed memory size of 536870912 bytes exhausted (tried to allocate 20480 bytes) at /usr/local/www/nextcloud/3rdparty/doctrine/dbal/src/ExpandArrayParameters.php#72","userAgent":"--","version":"27.0.2.1","data":{"app":"PHP"}}
{"reqId":"Dvtk8Iv2iJycy42YGcT8","level":3,"time":"2023-09-26T04:40:46+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"Allowed memory size of 536870912 bytes exhausted (tried to allocate 16384 bytes) at /usr/local/www/nextcloud/3rdparty/doctrine/dbal/src/Driver/PDO/Statement.php#101","userAgent":"--","version":"27.0.2.1","data":{"app":"PHP"}}
{"reqId":"o71hnvj4gGiu8021MfM6","level":3,"time":"2023-09-26T16:40:46+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"Allowed memory size of 536870912 bytes exhausted (tried to allocate 20480 bytes) at /usr/local/www/nextcloud/3rdparty/doctrine/dbal/src/ExpandArrayParameters.php#72","userAgent":"--","version":"27.0.2.1","data":{"app":"PHP"}}

Additional info

Same Command-line to same server works fine on ubuntu 20.04.06 with nextcloudcmd 2.4.0.

[claucambra]

Hi @Skammi 3.4.2 is an ancient version of the client, could you try running with the latest version of the client (3.10.0)? Thanks!

[Skammi]

Hi @claucambra, That ancient version is available in the ubuntu 22.04.03 LTS distribution for aarch64. How do I get the version in ubuntu updated to a newer version? Additional I run ubuntu server so: CLI only, no graphical user interface.

[Skammi]

Hi @claucambra, I have done some further trouble shooting.
Did the same exercise on X86 on both ubuntuserver 22 and 23 with version 3.4.2 and 3.7.3, with the same result (~120 sec delay/per file). Run it also on Debian12 / KDE desktop, with version 3.7.3, also the same result (~120 sec delay/per file)
By the way the desktop client on Debian12 / KDE desktop runs fine.

Trying to compile from source gets me in all sorts of problems with availability of the prerequisites.

Is there an AppImage of nextcloudcmd?
Do you want the terminal output of these 3 tests?

[joshtrichards]

Duplicate of #3422