[Bug]: occ files:cleanup is not working -- doesn't remove any of the million+ stale entries

[brianjmurrell]

⚠️ This issue respects the following points: ⚠️

• This is a bug, not a question or a configuration/webserver/proxy issue.
• This issue is not already reported on Github OR Nextcloud Community Forum (I've searched it).
• Nextcloud Server is up to date. See Maintenance and Release Schedule for supported versions.
• I agree to follow Nextcloud's Code of Conduct.

Bug description

I have over 1.4M stale entries in my oc_filecache table under just a single path files/DesktopHome:

# echo 'select count(*) from oc_filecache where storage = 1 and path like "files/DesktopHome/%";' | mysql -t nextclouddb
+----------+
| count(*) |
+----------+
|  1450799 |
+----------+     

Here is the oc_storages table for reference:

+---------------------------------+------------+-----------+--------------+
| id                              | numeric_id | available | last_checked |
+---------------------------------+------------+-----------+--------------+
| home::brian                     |          1 |         1 |         NULL |
| local::/usr/src/owncloud/data/  |          2 |         1 |         NULL |
| home::jennifer                  |          3 |         1 |         NULL |
| home::brianm                    |          4 |         1 |         NULL |
| local::/var/lib/owncloud/data/  |          5 |         1 |         NULL |
| local::/var/lib/nextcloud/data/ |          6 |         1 |         NULL |
+---------------------------------+------------+-----------+--------------+

But under that path on the actual filesystem there is nothing:

[root@server ~]# ls -l /var/lib/nextcloud/data/brian/files/DesktopHome/
total 0

And yet occ files:cleanup does nothing to clean that mess up:

# sudo -u apache php /usr/share/nextcloud/occ files:cleanup
0 orphaned file cache entries deleted
0 orphaned mount entries deleted           

Additionally such file appear in the NC files app but when you try to download or get details on them you get errors about them being non-available. The server also logs:

Mar  3 11:14:41 server Nextcloud[318606]: {"reqId":"ZeSh8KYbHCAExqsm5DVOlQAAABg","level":3,"time":"2024-03-03T16:14:41+00:00","remoteAddr":"10.75.22.192","user":"brian","app":"webdav","method":"GET","url":"/remote.php/dav/files/brian/DesktopHome/3","message":"{\"Exception\":\"Sabre\\\\DAV\\\\Exception\\\\ServiceUnavailable\",\"Message\":\"Could not open file\",\"Code\":0,\"Trace\":[{\"file\":\"/usr/share/nextcloud/3rdparty/sabre/dav/lib/DAV/CorePlugin.php\",\"line\":85,\"function\":\"get\",\"class\":\"OCA\\\\DAV\\\\Connector\\\\Sabre\\\\File\",\"type\":\"->\",\"args\":[]},{\"file\":\"/usr/share/nextcloud/3rdparty/sabre/event/lib/WildcardEmitterTrait.php\",\"line\":89,\"function\":\"httpGet\",\"class\":\"Sabre\\\\DAV\\\\CorePlugin\",\"type\":\"->\",\"args\":[[\"Sabre\\\\HTTP\\\\Request\"],[\"Sabre\\\\HTTP\\\\Response\"]]},{\"file\":\"/usr/share/nextcloud/3rdparty/sabre/dav/lib/DAV/Server.php\",\"line\":472,\"function\":\"emit\",\"class\":\"Sabre\\\\DAV\\\\Server\",\"type\":\"->\",\"args\":[\"method:GET\",[[\"Sabre\\\\HTTP\\\\Request\"],[\"Sabre\\\\HTTP\\\\Response\"]]]},{\"file\":\"/usr/share/nextcloud/3rdparty/sabre/dav/lib/DAV/Server.php\",\"line\":253,\"function\":\"invokeMethod\",\"class\":\"Sabre\\\\DAV\\\\Server\",\"type\":\"->\",\"args\":[[\"Sabre\\\\HTTP\\\\Request\"],[\"Sabre\\\\HTTP\\\\Response\"]]},{\"file\":\"/usr/share/nextcloud/3rdparty/sabre/dav/lib/DAV/Server.php\",\"line\":321,\"function\":\"start\",\"class\":\"Sabre\\\\DAV\\\\Server\",\"type\":\"->\",\"args\":[]},{\"file\":\"/usr/share/nextcloud/apps/dav/lib/Server.php\",\"line\":370,\"function\":\"exec\",\"class\":\"Sabre\\\\DAV\\\\Server\",\"type\":\"->\",\"args\":[]},{\"file\":\"/usr/share/nextcloud/apps/dav/appinfo/v2/remote.php\",\"line\":35,\"function\":\"exec\",\"class\":\"OCA\\\\DAV\\\\Server\",\"type\":\"->\",\"args\":[]},{\"file\":\"/usr/share/nextcloud/remote.php\",\"line\":172,\"args\":[\"/usr/share/nextcloud/apps/dav/appinfo/v2/remote.php\"],\"function\":\"require_once\"}],\"File\":\"/usr/share/nextcloud/apps/dav/lib/Connector/Sabre/File.php\",\"Line\":505,\"message\":\"Could not open file\",\"exception\":{},\"CustomMessage\":\"Could not open file\"}","userAgent":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.0.0 Safari/537.36","version":"28.0.2.5"}

Steps to reproduce

Probably pretty obvious give the description above.

Expected behavior

occ files:cleanup should remove those 1.4M or so stale oc_filecache entries.

Installation method

Other Community project

Nextcloud Server version

29

Operating system

RHEL/CentOS

PHP engine version

PHP 8.0

Web server

Apache (supported)

Database engine version

MariaDB

Is this bug present after an update or on a fresh install?

None

Are you using the Nextcloud Server Encryption module?

None

What user-backends are you using?

• Default user-backend (database)
• LDAP/ Active Directory
• SSO - SAML
• Other

Configuration report

{
    "system": {
        "log_type": "syslog",
        "datadirectory": "***REMOVED SENSITIVE VALUE***",
        "updatechecker": false,
        "check_for_working_htaccess": false,
        "asset-pipeline.enabled": false,
        "assetdirectory": "\/var\/lib\/nextcloud",
        "preview_libreoffice_path": "\/usr\/bin\/libreoffice",
        "apps_paths": [
            {
                "path": "\/usr\/share\/nextcloud\/apps",
                "url": "\/apps",
                "writable": false
            },
            {
                "path": "\/var\/lib\/nextcloud\/apps",
                "url": "\/apps-appstore",
                "writable": true
            }
        ],
        "instanceid": "***REMOVED SENSITIVE VALUE***",
        "passwordsalt": "***REMOVED SENSITIVE VALUE***",
        "secret": "***REMOVED SENSITIVE VALUE***",
        "trusted_domains": [
            "owncloud.example.com",
            "www.example.com"
        ],
        "overwrite.cli.url": "http:\/\/owncloud.example.com\/",
        "dbtype": "mysql",
        "dbname": "***REMOVED SENSITIVE VALUE***",
        "dbhost": "***REMOVED SENSITIVE VALUE***",
        "dbuser": "***REMOVED SENSITIVE VALUE***",
        "dbpassword": "***REMOVED SENSITIVE VALUE***",
        "version": "29.0.0.19",
        "installed": true,
        "theme": "",
        "maintenance": false,
        "forcessl": false,
        "loglevel": 1,
        "log_authfailip": true,
        "mail_from_address": "***REMOVED SENSITIVE VALUE***",
        "mail_smtpmode": "smtp",
        "mail_domain": "***REMOVED SENSITIVE VALUE***",
        "mail_smtphost": "***REMOVED SENSITIVE VALUE***",
        "trashbin_retention_obligation": "auto",
        "htaccess.RewriteBase": "\/",
        "appstore.experimental.enabled": true,
        "mysql.utf8mb4": true
    }
}

List of activated Apps

Enabled:
  - activity: 2.21.1
  - calendar: 4.7.3
  - circles: 29.0.0-dev
  - cloud_federation_api: 1.12.0
  - comments: 1.19.0
  - contacts: 6.0.0
  - contactsinteraction: 1.10.0
  - dashboard: 7.9.0
  - dav: 1.30.1
  - federatedfilesharing: 1.19.0
  - federation: 1.19.0
  - files: 2.1.0
  - files_downloadlimit: 2.0.0
  - files_pdfviewer: 2.10.0
  - files_reminders: 1.2.0
  - files_sharing: 1.21.0
  - files_trashbin: 1.19.0
  - files_versions: 1.22.0
  - firstrunwizard: 2.18.0
  - logreader: 2.14.0
  - lookup_server_connector: 1.17.0
  - nextcloud_announcements: 1.18.0
  - notes: 4.10.0
  - notifications: 2.17.0
  - oauth2: 1.17.0
  - password_policy: 1.19.0
  - photos: 2.5.0
  - privacy: 1.13.0
  - provisioning_api: 1.19.0
  - recommendations: 2.1.0
  - related_resources: 1.4.0
  - serverinfo: 1.19.0
  - settings: 1.12.0
  - sharebymail: 1.19.0
  - support: 1.12.0
  - survey_client: 1.17.0
  - systemtags: 1.19.0
  - text: 3.10.0
  - theming: 2.4.0
  - twofactor_backupcodes: 1.18.0
  - updatenotification: 1.19.1
  - user_status: 1.9.0
  - viewer: 2.3.0
  - weather_status: 1.9.0
  - workflowengine: 2.11.0
Disabled:
  - admin_audit: 1.19.0
  - bruteforcesettings: 2.9.0
  - encryption: 2.17.0
  - files_external: 1.21.0
  - files_rightclick: 0.15.1 (installed 1.6.0)
  - files_texteditor: 2.15.1 (installed 2.15.1)
  - suspicious_login: 7.0.0
  - twofactor_totp: 11.0.0-dev
  - user_ldap: 1.20.0 (installed 1.14.1)

Nextcloud Signing status

No response

Nextcloud Logs

No response

Additional info

No response

[solracsf]

Try to scan instead with occ files:scan --path='brian/files/DesktopHome'.

[kesselb]

local::/usr/src/owncloud/data/
local::/var/lib/owncloud/data/
local::/var/lib/nextcloud/data/

Did you move the datadirectory maybe?

Similar to #43861

[brianjmurrell]

Try to scan instead with occ files:scan --path='brian/files/DesktopHome'.

Seems an odd thing to need to do when there is a specific command (files:cleanup) that appears to be for removing stale/orphaned entries. Is my understanding of files:cleanup incorrect and you are suggesting files:scan as a work-around or is files:scan actually the correct command for this situation? If that's the case what is files:cleanup supposed to do?

In any case, this failed:

Starting scan for user 1 out of 1 (brian)
PHP Fatal error:  Allowed memory size of 536870912 bytes exhausted (tried to allocate 33554440 bytes) in /usr/share/nextcloud/lib/private/Files/Cache/Cache.php on line 596        

Did you move the datadirectory maybe?

Not to my knowledge. I did migrate to NC from OC, a long long time ago however.

Is this relevant in some way?

Doesn't the storage field in oc_filecache relate to the numeric_id of oc_storages? And given that all of the stale data in oc_filecache is in storage 1, are these:

+---------------------------------+------------+-----------+--------------+
| id                              | numeric_id | available | last_checked |
+---------------------------------+------------+-----------+--------------+
| local::/usr/src/owncloud/data/  |          2 |         1 |         NULL |
| local::/var/lib/owncloud/data/  |          5 |         1 |         NULL |
| local::/var/lib/nextcloud/data/ |          6 |         1 |         NULL |
+---------------------------------+------------+-----------+--------------+

Relevant?

How do they relate to the home::* entries?

Clearly there is some old/stale cruft there also. Should I fix oc_storages prior to trying to clean up oc_filecache? If so, how? Can I simply use the mysql CLI to delete the unwanted rows? If so, which rows are wanted and which are unwanted?

Similar to #43861

Except I didn't move my data directory since migrating from OC.

[solracsf]

Well the memory exhaustion shows that your "to-be-deleted" rows are that big and can't fit into the array_merge, otherwise they would be deleted.

Instead of:

$deletedIds = array_merge($deletedIds, $childIds);
$deletedPaths = array_merge($deletedPaths, $childPaths);

change to:

foreach ($childIds as $childId) {
    $deletedIds[] = $childId;
}

foreach ($childPaths as $childPath) {
    $deletedPaths[] = $childPath;
}

Should do the trick, at /usr/share/nextcloud/lib/private/Files/Cache/Cache.php on line 596

[brianjmurrell]

Thanks! That fix goes a bit further:

# sudo -u apache php /usr/share/nextcloud/occ files:scan --path='brian/files/DesktopHome'                                                                           
Starting scan for user 1 out of 1 (brian)
+---------+-------+-----+---------+---------+--------+--------------+
| Folders | Files | New | Updated | Removed | Errors | Elapsed time |
+---------+-------+-----+---------+---------+--------+--------------+
| 1       | 0     | 0   | 0       | 598     | 0      | 00:04:50     |
+---------+-------+-----+---------+---------+--------+--------------+

But as you can see, it's only but a tiny drop in the massive bucket of ~1.4M orphaned/stale oc_filecache entries.

Running it a second time:

# sudo -u apache php /usr/share/nextcloud/occ files:scan --path='brian/files/DesktopHome'
Starting scan for user 1 out of 1 (brian)
+---------+-------+-----+---------+---------+--------+--------------+
| Folders | Files | New | Updated | Removed | Errors | Elapsed time |
+---------+-------+-----+---------+---------+--------+--------------+
| 1       | 0     | 0   | 0       | 0       | 0      | 00:00:01     |
+---------+-------+-----+---------+---------+--------+--------------+

Any further advise or ideas?

[solracsf]

Try to scan the entire instance instead occ files:scan --all?
Otherwise no, besides manual cleaning of DB (if you know what you are doing) no other ideas...

[brianjmurrell]

Try to scan the entire instance instead occ files:scan --all?

So what is the relationship of the oc_storages and the oc_filecache tables?

What is home::brian vs. local::/var/lib/nextcloud/data/ for example?

When I run occ files:scan --path='brian/files/DesktopHome' how does it know which oc_storages to be scanning in.

Otherwise no, besides manual cleaning of DB (if you know what you are doing) no other ideas...

Yes, exactly. Manual cleaning if you know what you are doing. Clearly I am not a NextCloud DB expert.

Clearly, if this situation can exist and the only way to fix it is for some kind of internal NC DB expert manual cleaning something is broken. The expertise to do this cleaning needs to exist in a tool so that everyone doesn't need to be an NC DB expert.

Why is occ files:cleanup not fixing this?

Ultimately this situation is hammering the crap out of my NC database because I am getting a constant stream of:

Mar  4 15:54:01 server Nextcloud[290301]: {"reqId":"4iEvJApBswAez31QD9B9","level":2,"time":"2024-03-04T20:54:01+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"{\"Exception\":\"OCP\\\\Files\\\\GenericFileException\",\"Message\":\"\",\"Code\":0,\"Trace\":[{\"file\":\"/usr/share/nextcloud/apps/photos/lib/Listener/SizeMetadataProvider.php\",\"line\":64,\"function\":\"getContent\",\"class\":\"OC\\\\Files\\\\Node\\\\File\",\"type\":\"->\",\"args\":[]},{\"file\":\"/usr/share/nextcloud/lib/private/EventDispatcher/ServiceEventListener.php\",\"line\":86,\"function\":\"handle\",\"class\":\"OCA\\\\Photos\\\\Listener\\\\SizeMetadataProvider\",\"type\":\"->\",\"args\":[[\"OCP\\\\FilesMetadata\\\\Event\\\\MetadataLiveEvent\"]]},{\"file\":\"/usr/share/nextcloud/3rdparty/symfony/event-dispatcher/EventDispatcher.php\",\"line\":230,\"function\":\"__invoke\",\"class\":\"OC\\\\EventDispatcher\\\\ServiceEventListener\",\"type\":\"->\",\"args\":[[\"OCP\\\\FilesMetadata\\\\Event\\\\MetadataLiveEvent\"],\"OCP\\\\FilesMetadata\\\\Event\\\\MetadataLiveEvent\",[\"Symfony\\\\Component\\\\EventDispatcher\\\\EventDispatcher\"]]},{\"file\":\"/usr/share/nextcloud/3rdparty/symfony/event-dispatcher/EventDispatcher.php\",\"line\":59,\"function\":\"callListeners\",\"class\":\"Symfony\\\\Component\\\\EventDispatcher\\\\EventDispatcher\",\"type\":\"->\",\"args\":[[[\"Closure\"],[\"Closure\"],[\"Closure\"],[\"Closure\"]],\"OCP\\\\FilesMetadata\\\\Event\\\\MetadataLiveEvent\",[\"OCP\\\\FilesMetadata\\\\Event\\\\MetadataLiveEvent\"]]},{\"file\":\"/usr/share/nextcloud/lib/private/EventDispatcher/EventDispatcher.php\",\"line\":94,\"function\":\"dispatch\",\"class\":\"Symfony\\\\Component\\\\EventDispatcher\\\\EventDispatcher\",\"type\":\"->\",\"args\":[[\"OCP\\\\FilesMetadata\\\\Event\\\\MetadataLiveEvent\"],\"OCP\\\\FilesMetadata\\\\Event\\\\MetadataLiveEvent\"]},{\"file\":\"/usr/share/nextcloud/lib/private/EventDispatcher/EventDispatcher.php\",\"line\":106,\"function\":\"dispatch\",\"class\":\"OC\\\\EventDispatcher\\\\EventDispatcher\",\"type\":\"->\",\"args\":[\"OCP\\\\FilesMetadata\\\\Event\\\\MetadataLiveEvent\",[\"OCP\\\\FilesMetadata\\\\Event\\\\MetadataLiveEvent\"]]},{\"file\":\"/usr/share/nextcloud/lib/private/FilesMetadata/FilesMetadataManager.php\",\"line\":115,\"function\":\"dispatchTyped\",\"class\":\"OC\\\\EventDispatcher\\\\EventDispatcher\",\"type\":\"->\",\"args\":[[\"OCP\\\\FilesMetadata\\\\Event\\\\MetadataLiveEvent\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":109,\"function\":\"refreshMetadata\",\"class\":\"OC\\\\FilesMetadata\\\\FilesMetadataManager\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\File\"],3]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":88,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\LazyUserFolder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":74,\"function\":\"scanFilesForUser\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[\"brian\"]},{\"file\":\"/usr/share/nextcloud/lib/public/BackgroundJob/Job.php\",\"line\":81,\"function\":\"run\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[null]},{\"file\":\"/usr/share/nextcloud/lib/public/BackgroundJob/TimedJob.php\",\"line\":102,\"function\":\"start\",\"class\":\"OCP\\\\BackgroundJob\\\\Job\",\"type\":\"->\",\"args\":[[\"OC\\\\BackgroundJob\\\\JobList\"]]},{\"file\":\"/usr/share/nextcloud/lib/public/BackgroundJob/TimedJob.php\",\"line\":92,\"function\":\"start\",\"class\":\"OCP\\\\BackgroundJob\\\\TimedJob\",\"type\":\"->\",\"args\":[[\"OC\\\\BackgroundJob\\\\JobList\"]]},{\"file\":\"/usr/share/nextcloud/cron.php\",\"line\":152,\"function\":\"execute\",\"class\":\"OCP\\\\BackgroundJob\\\\TimedJob\",\"type\":\"->\",\"args\":[[\"OC\\\\BackgroundJob\\\\JobList\"],[\"OC\\\\Log\"]]}],\"File\":\"/usr/share/nextcloud/lib/private/Files/Node/File.php\",\"Line\":56,\"message\":\"Error while generating metadata for fileid 3639031\",\"exception\":{},\"CustomMessage\":\"Error while generating metadata for fileid 3639031\"}","userAgent":"--","version":"28.0.2.5"}
Mar  4 15:54:29 server Nextcloud[290301]: {"reqId":"4iEvJApBswAez31QD9B9","level":3,"time":"2024-03-04T20:54:29+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"file_get_contents(/var/lib/nextcloud/data/brian/files/DesktopHome/.wine.old/fake_windows/users/brian/My Documents/.wine.old/fake_windows/users/brian/My Documents/.wine.old/fake_windows/users/brian/My Documents/.wine.old/fake_windows/users/brian/My Documents/.wine.old/fake_windows/users/brian/My Documents/.wine.old/fake_windows/users/brian/My Documents/.wine.old/fake_windows/users/brian/My Documents/.wine.old/fake_windows/users/brian/My Documents/.wine.old/fake_windows/users/brian/My Documents/.wine.old/dosdevices/e:/.wine.old/dosdevices/z:/net/pc/home/brian/google-earth/res/pal2/icon13.png): Failed to open stream: No such file or directory at /usr/share/nextcloud/lib/private/Files/Storage/Local.php#327","userAgent":"--","version":"28.0.2.5","data":{"app":"PHP"}}
Mar  4 15:54:34 server Nextcloud[290301]: {"reqId":"4iEvJApBswAez31QD9B9","level":2,"time":"2024-03-04T20:54:34+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"{\"Exception\":\"OCP\\\\Files\\\\GenericFileException\",\"Message\":\"\",\"Code\":0,\"Trace\":[{\"file\":\"/usr/share/nextcloud/apps/photos/lib/Listener/SizeMetadataProvider.php\",\"line\":64,\"function\":\"getContent\",\"class\":\"OC\\\\Files\\\\Node\\\\File\",\"type\":\"->\",\"args\":[]},{\"file\":\"/usr/share/nextcloud/lib/private/EventDispatcher/ServiceEventListener.php\",\"line\":86,\"function\":\"handle\",\"class\":\"OCA\\\\Photos\\\\Listener\\\\SizeMetadataProvider\",\"type\":\"->\",\"args\":[[\"OCP\\\\FilesMetadata\\\\Event\\\\MetadataLiveEvent\"]]},{\"file\":\"/usr/share/nextcloud/3rdparty/symfony/event-dispatcher/EventDispatcher.php\",\"line\":230,\"function\":\"__invoke\",\"class\":\"OC\\\\EventDispatcher\\\\ServiceEventListener\",\"type\":\"->\",\"args\":[[\"OCP\\\\FilesMetadata\\\\Event\\\\MetadataLiveEvent\"],\"OCP\\\\FilesMetadata\\\\Event\\\\MetadataLiveEvent\",[\"Symfony\\\\Component\\\\EventDispatcher\\\\EventDispatcher\"]]},{\"file\":\"/usr/share/nextcloud/3rdparty/symfony/event-dispatcher/EventDispatcher.php\",\"line\":59,\"function\":\"callListeners\",\"class\":\"Symfony\\\\Component\\\\EventDispatcher\\\\EventDispatcher\",\"type\":\"->\",\"args\":[[[\"Closure\"],[\"Closure\"],[\"Closure\"],[\"Closure\"]],\"OCP\\\\FilesMetadata\\\\Event\\\\MetadataLiveEvent\",[\"OCP\\\\FilesMetadata\\\\Event\\\\MetadataLiveEvent\"]]},{\"file\":\"/usr/share/nextcloud/lib/private/EventDispatcher/EventDispatcher.php\",\"line\":94,\"function\":\"dispatch\",\"class\":\"Symfony\\\\Component\\\\EventDispatcher\\\\EventDispatcher\",\"type\":\"->\",\"args\":[[\"OCP\\\\FilesMetadata\\\\Event\\\\MetadataLiveEvent\"],\"OCP\\\\FilesMetadata\\\\Event\\\\MetadataLiveEvent\"]},{\"file\":\"/usr/share/nextcloud/lib/private/EventDispatcher/EventDispatcher.php\",\"line\":106,\"function\":\"dispatch\",\"class\":\"OC\\\\EventDispatcher\\\\EventDispatcher\",\"type\":\"->\",\"args\":[\"OCP\\\\FilesMetadata\\\\Event\\\\MetadataLiveEvent\",[\"OCP\\\\FilesMetadata\\\\Event\\\\MetadataLiveEvent\"]]},{\"file\":\"/usr/share/nextcloud/lib/private/FilesMetadata/FilesMetadataManager.php\",\"line\":115,\"function\":\"dispatchTyped\",\"class\":\"OC\\\\EventDispatcher\\\\EventDispatcher\",\"type\":\"->\",\"args\":[[\"OCP\\\\FilesMetadata\\\\Event\\\\MetadataLiveEvent\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":109,\"function\":\"refreshMetadata\",\"class\":\"OC\\\\FilesMetadata\\\\FilesMetadataManager\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\File\"],3]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":99,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\Folder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":88,\"function\":\"scanFolder\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[[\"OC\\\\Files\\\\Node\\\\LazyUserFolder\"]]},{\"file\":\"/usr/share/nextcloud/core/BackgroundJobs/GenerateMetadataJob.php\",\"line\":74,\"function\":\"scanFilesForUser\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[\"brian\"]},{\"file\":\"/usr/share/nextcloud/lib/public/BackgroundJob/Job.php\",\"line\":81,\"function\":\"run\",\"class\":\"OC\\\\Core\\\\BackgroundJobs\\\\GenerateMetadataJob\",\"type\":\"->\",\"args\":[null]},{\"file\":\"/usr/share/nextcloud/lib/public/BackgroundJob/TimedJob.php\",\"line\":102,\"function\":\"start\",\"class\":\"OCP\\\\BackgroundJob\\\\Job\",\"type\":\"->\",\"args\":[[\"OC\\\\BackgroundJob\\\\JobList\"]]},{\"file\":\"/usr/share/nextcloud/lib/public/BackgroundJob/TimedJob.php\",\"line\":92,\"function\":\"start\",\"class\":\"OCP\\\\BackgroundJob\\\\TimedJob\",\"type\":\"->\",\"args\":[[\"OC\\\\BackgroundJob\\\\JobList\"]]},{\"file\":\"/usr/share/nextcloud/cron.php\",\"line\":152,\"function\":\"execute\",\"class\":\"OCP\\\\BackgroundJob\\\\TimedJob\",\"type\":\"->\",\"args\":[[\"OC\\\\BackgroundJob\\\\JobList\"],[\"OC\\\\Log\"]]}],\"File\":\"/usr/share/nextcloud/lib/private/Files/Node/File.php\",\"Line\":56,\"message\":\"Error while generating metadata for fileid 3639021\",\"exception\":{},\"CustomMessage\":\"Error while generating metadata for fileid 3639021\"}","userAgent":"--","version":"28.0.2.5"}
Mar  4 15:55:01 server Nextcloud[290301]: {"reqId":"4iEvJApBswAez31QD9B9","level":3,"time":"2024-03-04T20:55:01+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"file_get_contents(/var/lib/nextcloud/data/brian/files/DesktopHome/.wine.old/fake_windows/users/brian/My Documents/.wine.old/fake_windows/users/brian/My Documents/.wine.old/fake_windows/users/brian/My Documents/.wine.old/fake_windows/users/brian/My Documents/.wine.old/fake_windows/users/brian/My Documents/.wine.old/fake_windows/users/brian/My Documents/.wine.old/fake_windows/users/brian/My Documents/.wine.old/fake_windows/users/brian/My Documents/.wine.old/fake_windows/users/brian/My Documents/.wine.old/dosdevices/e:/.wine.old/dosdevices/z:/net/pc/home/brian/google-earth/res/pal2/icon13s.png): Failed to open stream: No such file or directory at /usr/share/nextcloud/lib/private/Files/Storage/Local.php#327","userAgent":"--","version":"28.0.2.5","data":{"app":"PHP"}}

which seems to be some job hell-bent on trying to touch every single one of those 1.4M orphaned oc_filecache entries.

[brianjmurrell]

Try to scan the entire instance instead occ files:scan --all?

# sudo -u apache php /usr/share/nextcloud/occ files:scan --all
Starting scan for user 1 out of 3 (brian)
…
+---------+-------+-----+---------+---------+--------+--------------+
| Folders | Files | New | Updated | Removed | Errors | Elapsed time |
+---------+-------+-----+---------+---------+--------+--------------+
| 972     | 21262 | 0   | 376     | 2       | 1      | 17:04:16     |
+---------+-------+-----+---------+---------+--------+--------------+

So nothing near the ~1.4M orphaned oc_filecache entries:

# echo 'select count(*) from oc_filecache where storage = 1 and path like "files/DesktopHome/%";' | mysql -t nextclouddb                                            
+----------+
| count(*) |
+----------+
|  1427878 |
+----------+

So still no solution and ultimately occ files:cleanup seems broken as it seems that is what should be able do this cleanup.

[joshtrichards]

occ files:cleanup only cleans up filecache entries that reference storage ids that no longer exist. It doesn't look at what's on-disk at all. Since storage id 1 very much still exists (it's your home directory) there's nothing for it to do in your case:

+---------------------------------+------------+-----------+--------------+
| id                              | numeric_id | available | last_checked |
+---------------------------------+------------+-----------+--------------+
 | home::brian                     |          1 |         1 |         NULL |

The bottom line is that you're trying to update the Nextcloud Server filecache so that its content matches what you have on-disk, correct?

I presume the cause of this is that you bypassed Nextcloud and removed these from your server's disk directly or something?

For this, occ files:scan is what you want.

Clearly, if this situation can exist and the only way to fix it is for some kind of internal NC DB expert manual cleaning something is broken. The expertise to do this cleaning needs to exist in a tool so that everyone doesn't need to be an NC DB expert.

Agreed. Let's figure out what's going on here. A files:scan should catch this, since these files have been removed from disk. Something is going on here causing it not to behave as would otherwise be expected.

# sudo -u apache php /usr/share/nextcloud/occ files:scan --all
Starting scan for user 1 out of 3 (brian)
…
+---------+-------+-----+---------+---------+--------+--------------+
| Folders | Files | New | Updated | Removed | Errors | Elapsed time |
+---------+-------+-----+---------+---------+--------+--------------+
| 972     | 21262 | 0   | 376     | 2       | 1      | 17:04:16     |
+---------+-------+-----+---------+---------+--------+--------------+

Try running with -vvv for verbose mode to get a bit more info.

But as you can see, it's only but a tiny drop in the massive bucket of ~1.4M orphaned/stale oc_filecache entries.

Running it a second time:

Can you share a sampling of a few of the apparently remaining entries? e.g.

SELECT * FROM oc_filecache WHERE storage=1 AND path LIKE "files/DesktopHome/%" LIMIT 5;

/var/lib/nextcloud/data/brian/files/DesktopHome/.wine.old/fake_windows/users/brian/My Documents/.wine.old/fake_windows/users/brian/My Documents/.wine.old/fake_windows/users/brian/My Documents/.wine.old/fake_windows/users/brian/My Documents/.wine.old/fake_windows/users/brian/My Documents/.wine.old/fake_windows/users/brian/My Documents/.wine.old/fake_windows/users/brian/My Documents/.wine.old/fake_windows/users/brian/My Documents/.wine.old/fake_windows/users/brian/My Documents/.wine.old/dosdevices/e:/.wine.old/dosdevices/z:/net/pc/home/brian/google-earth/res/pal2/icon13.png

That is one seriously strange file path. How'd this happen to start with? :)