Skip to content

corruption cleanup? #3173

Description

@stanelie

Steps to reproduce

  1. Setup a sync folder from a SMB share in the Nextcloud client
  2. Wait for it to sync

Expected behaviour

It should sync to the local computer, and I expect the client to keep going even if it encounters an error, and give me a detailed report as to what I should do to correct the error

Actual behaviour

The client gives a "internal server error" error message or An error has occured, operation canceled" or "missing file"and never finishes syncing the folder.

Bonus info

It occurred to me that the file listing inside nextcloud might not match the actual files on the attached smb shares. So, I tried to do a
sudo -u www-data php occ files:scan --path="mrpotato/files/_Budget" on a smb share for one user to see if it would correct. I stopped it after 20 minutes running and it said this :
+---------+-------+--------------+ | Folders | Files | Elapsed time | +---------+-------+--------------+ | 1 | 5 | 00:20:53 | +---------+-------+--------------+
Is this expected behavior? 5 files scanned in 20 minutes?
Also, I notice that the table oc_filecache has 1203617 rows. Looks big to me (about 600GB of files from SMB storage attached to nextcloud). Not sure if this is relevant.

Server configuration

Operating system:
Ubuntu 14.04.5 LTS
Web server:
Apache/2.4.7 (Ubuntu)
Database:
mysql Ver 14.14 Distrib 5.5.53, for debian-linux-gnu (x86_64) using readline 6.3
PHP version:
PHP Version 5.6.29-1+deb.sury.org~trusty+1
Nextcloud version: (see Nextcloud admin page)
11.0.1 (stable)
Updated from an older Nextcloud/ownCloud or fresh install:
Updated
Where did you install Nextcloud from:
The internet
Signing status:

Signing status
No errors have been found.

List of activated apps:

App list
  - activity: 2.4.1
  - admin_audit: 1.1.0
  - audioplayer: 1.4.0
  - calendar: 1.5.0
  - comments: 1.1.0
  - contacts: 1.5.2
  - dav: 1.1.1
  - federatedfilesharing: 1.1.1
  - federation: 1.1.1
  - files: 1.6.1
  - files_downloadactivity: 1.0.0
  - files_external: 1.1.2
  - files_pdfviewer: 1.0.1
  - files_retention: 1.0.1
  - files_sharing: 1.1.1
  - files_texteditor: 2.2
  - files_trashbin: 1.1.0
  - files_versions: 1.4.0
  - files_videoplayer: 1.0.0
  - firstrunwizard: 2.0
  - gallery: 16.0.0
  - logreader: 2.0.0
  - lookup_server_connector: 1.0.0
  - nextcloud_announcements: 1.0
  - notifications: 1.0.1
  - password_policy: 1.1.0
  - provisioning_api: 1.1.0
  - serverinfo: 1.1.1
  - sharebymail: 1.0.1
  - survey_client: 0.1.5
  - systemtags: 1.1.3
  - templateeditor: 0.2
  - theming: 1.1.1
  - twofactor_backupcodes: 1.0.0
  - updatenotification: 1.1.1
  - user_ldap: 1.1.1
  - workflowengine: 1.1.1
Disabled:
  - documents
  - encryption
  - external
  - files_accesscontrol
  - files_automatedtagging
  - files_mv
  - tasks
  - user_external
  - user_saml

The content of config/config.php:

Config report
{
    "system": {
        "instanceid": "och3seedqlz1",
        "passwordsalt": "***REMOVED SENSITIVE VALUE***",
        "secret": "***REMOVED SENSITIVE VALUE***",
        "trusted_domains": [
            "***REMOVED SENSITIVE VALUE***",
            "192.168.0.38",
            "192.168.0.2",
            "***REMOVED SENSITIVE VALUE***",
        ],
        "datadirectory": "\/var\/www\/owncloud\/data",
        "overwrite.cli.url": "https:\/\/***REMOVED SENSITIVE VALUE***",
        "dbtype": "mysql",
        "version": "11.0.1.2",
        "dbname": "owncloud",
        "dbhost": "localhost",
        "dbtableprefix": "oc_",
        "dbuser": "***REMOVED SENSITIVE VALUE***",
        "dbpassword": "***REMOVED SENSITIVE VALUE***",
        "logtimezone": "America\/New_York",
        "installed": true,
        "forcessl": true,
        "overwriteprotocol": "https",
        "mail_smtpmode": "smtp",
        "mail_smtphost": "relais.videotron.ca",
        "mail_from_address": "owncloud",
        "mail_domain": "***REMOVED SENSITIVE VALUE***",
        "ldapIgnoreNamingRules": false,
        "loglevel": 2,
        "memcache.local": "\\OC\\Memcache\\Redis",
        "redis": {
            "host": "localhost",
            "port": 6379
        },
        "memcache.locking": "\\OC\\Memcache\\Redis",
        "theme": "exm",
        "preview_libreoffice_path": "\/usr\/bin\/libreoffice",
        "updatechecker": true,
        "maintenance": false,
        "default_language": "fr",
        "appstore.experimental.enabled": true,
        "htaccess.RewriteBase": "\/",
        "ldapProviderFactory": "\\OCA\\User_LDAP\\LDAPProviderFactory",
        "trusted_proxies": [
            "192.168.0.2"
        ],
        "updater.release.channel": "stable",
        "updater.secret": "***REMOVED SENSITIVE VALUE***"
    }
}

Are you using external storage, if yes which one: local/smb/sftp/...
SMB
Are you using encryption: yes/no
no
Are you using an external user-backend, if yes which one: LDAP/ActiveDirectory/Webdav/...
ActiveDirectory

LDAP configuration (delete this part if not used)

LDAP config
+-------------------------------+-------------------------------------------------------------------------------------------------------                                     ---------------------------------------------------------------------------+
| Configuration                 |                                                                                                                                                                                                                       |
+-------------------------------+-------------------------------------------------------------------------------------------------------                                     ---------------------------------------------------------------------------+
| hasMemberOfFilterSupport      | 1                                                                                                                                                                                                                     |
| hasPagedResultSupport         |                                                                                                                                                                                                                       |
| homeFolderNamingRule          | attr:sAMAccountName                                                                                                                                                                                                   |
| lastJpegPhotoLookup           | 0                                                                                                                                                                                                                     |
| ldapAgentName                 | CN=owncloud,OU=equipmentusers,OU=SBSUsers,OU=Users,OU=MyBusiness,DC=caserne                                                                                                                                           |
| ldapAgentPassword             | ***                                                                                                                                                                                                                   |
| ldapAttributesForGroupSearch  |                                                                                                                                                                                                                       |
| ldapAttributesForUserSearch   |                                                                                                                                                                                                                       |
| ldapBackupHost                |                                                                                                                                                                                                                       |
| ldapBackupPort                |                                                                                                                                                                                                                       |
| ldapBase                      | DC=caserne                                                                                                                                                                                                            |
| ldapBaseGroups                | DC=caserne                                                                                                                                                                                                            |
| ldapBaseUsers                 | DC=caserne                                                                                                                                                                                                            |
| ldapCacheTTL                  | 600                                                                                                                                                                                                                   |
| ldapConfigurationActive       | 1                                                                                                                                                                                                                     |
| ldapDynamicGroupMemberURL     |                                                                                                                                                                                                                       |
| ldapEmailAttribute            | mail                                                                                                                                                                                                                  |
| ldapExperiencedAdmin          | 0                                                                                                                                                                                                                     |
| ldapExpertUUIDGroupAttr       | sAMAccountName                                                                                                                                                                                                        |
| ldapExpertUUIDUserAttr        | samaccountname                                                                                                                                                                                                        |
| ldapExpertUsernameAttr        | samaccountname                                                                                                                                                                                                        |
| ldapGroupDisplayName          | samaccountname                                                                                                                                                                                                        |
| ldapGroupFilter               | (|(cn=owncloud_users)(cn=BUDGETS)(cn=COMMUNICATION)(cn=MBVL)(cn=PRODUCTIONS)(cn=TECHNIQUE)(cn=R&D)(cn=                                     budget_prod))                                                              |
| ldapGroupFilterGroups         | owncloud_users;BUDGETS;COMMUNICATION;MBVL;PRODUCTIONS;TECHNIQUE;R&D;budget_prod                                                                                                                                       |
| ldapGroupFilterMode           | 0                                                                                                                                                                                                                     |
| ldapGroupFilterObjectclass    |                                                                                                                                                                                                                       |
| ldapGroupMemberAssocAttr      | uniqueMember                                                                                                                                                                                                          |
| ldapHost                      | caserne1                                                                                                                                                                                                              |
| ldapIgnoreNamingRules         |                                                                                                                                                                                                                       |
| ldapLoginFilter               | (&(&(|(objectclass=person))(|(|(memberof=CN=owncloud_users,OU=Security Groups,OU=MyBusiness,DC=caserne                                     )(primaryGroupID=5259))))(|(samaccountname=%uid)(|(sAMAccountName=%uid)))) |
| ldapLoginFilterAttributes     | sAMAccountName                                                                                                                                                                                                        |
| ldapLoginFilterEmail          | 0                                                                                                                                                                                                                     |
| ldapLoginFilterMode           | 0                                                                                                                                                                                                                     |
| ldapLoginFilterUsername       | 1                                                                                                                                                                                                                     |
| ldapNestedGroups              | 0                                                                                                                                                                                                                     |
| ldapOverrideMainServer        |                                                                                                                                                                                                                       |
| ldapPagingSize                | 500                                                                                                                                                                                                                   |
| ldapPort                      | 389                                                                                                                                                                                                                   |
| ldapQuotaAttribute            |                                                                                                                                                                                                                       |
| ldapQuotaDefault              |                                                                                                                                                                                                                       |
| ldapTLS                       | 0                                                                                                                                                                                                                     |
| ldapUserDisplayName           | displayName                                                                                                                                                                                                           |
| ldapUserDisplayName2          |                                                                                                                                                                                                                       |
| ldapUserFilter                | (&(|(objectclass=person))(|(|(memberof=CN=owncloud_users,OU=Security Groups,OU=MyBusiness,DC=caserne)(                                     primaryGroupID=5259))))                                                    |
| ldapUserFilterGroups          | owncloud_users                                                                                                                                                                                                        |
| ldapUserFilterMode            | 0                                                                                                                                                                                                                     |
| ldapUserFilterObjectclass     | person                                                                                                                                                                                                                |
| ldapUuidGroupAttribute        | auto                                                                                                                                                                                                                  |
| ldapUuidUserAttribute         | auto                                                                                                                                                                                                                  |
| turnOffCertCheck              | 0                                                                                                                                                                                                                     |
| turnOnPasswordChange          | 0                                                                                                                                                                                                                     |
| useMemberOfToDetectMembership | 1                                                                                                                                                                                                                     |
+-------------------------------+-------------------------------------------------------------------------------------------------------                                     ---------------------------------------------------------------------------+

Client configuration

Browser:
N/A
Operating system:
windows 7 64bits

Logs

Web server error log

Web server error log ``` no errors ```

Nextcloud log (data/nextcloud.log)

Nextcloud log ``` {"reqId":"BEVrjWH8QLG\/9Nc7uPiB","remoteAddr":"24.37.113.93","app":"webdav","message":"Exception: {\"Message\":\"Invalid request for \\\/Copie de Budgets - MCLAREN NBOC VLC.xlsm (NotFoundException)\",\"Exception\":\"Icewind\\\\SMB\\\\Exception\\\\NotFoundException\",\"Code\":0,\"Trace\":\"#0 \\\/var\\\/www\\\/owncloud\\\/apps\\\/files_external\\\/3rdparty\\\/icewind\\\/smb\\\/src\\\/Share.php(398): Icewind\\\\SMB\\\\Parser->checkForError(Array, '\\\/Copie de Budge...')\\n#1 \\\/var\\\/www\\\/owncloud\\\/apps\\\/files_external\\\/3rdparty\\\/icewind\\\/smb\\\/src\\\/Share.php(140): Icewind\\\\SMB\\\\Share->parseOutput(Array, '\\\/Copie de Budge...')\\n#2 \\\/var\\\/www\\\/owncloud\\\/apps\\\/files_external\\\/lib\\\/Lib\\\/Storage\\\/SMB.php(129): Icewind\\\\SMB\\\\Share->stat('\\\/Copie de Budge...')\\n#3 \\\/var\\\/www\\\/owncloud\\\/apps\\\/files_external\\\/lib\\\/Lib\\\/Storage\\\/SMB.php(171): OCA\\\\Files_External\\\\Lib\\\\Storage\\\\SMB->getFileInfo('Copie de Budget...')\\n#4 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Storage\\\/Common.php(175): OCA\\\\Files_External\\\\Lib\\\\Storage\\\\SMB->stat('Copie de Budget...')\\n#5 \\\/var\\\/www\\\/owncloud\\\/apps\\\/files_external\\\/lib\\\/Lib\\\/Storage\\\/SMB.php(230): OC\\\\Files\\\\Storage\\\\Common->filemtime('Copie de Budget...')\\n#6 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Storage\\\/Wrapper\\\/Wrapper.php(374): OCA\\\\Files_External\\\\Lib\\\\Storage\\\\SMB->hasUpdated('Copie de Budget...', 1484851887)\\n#7 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Storage\\\/Wrapper\\\/Availability.php(395): OC\\\\Files\\\\Storage\\\\Wrapper\\\\Wrapper->hasUpdated('Copie de Budget...', 1484851887)\\n#8 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Storage\\\/Wrapper\\\/Wrapper.php(374): OC\\\\Files\\\\Storage\\\\Wrapper\\\\Availability->hasUpdated('Copie de Budget...', 1484851887)\\n#9 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Storage\\\/Wrapper\\\/Wrapper.php(374): OC\\\\Files\\\\Storage\\\\Wrapper\\\\Wrapper->hasUpdated('Copie de Budget...', 1484851887)\\n#10 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Storage\\\/Wrapper\\\/Wrapper.php(374): OC\\\\Files\\\\Storage\\\\Wrapper\\\\Wrapper->hasUpdated('Copie de Budget...', 1484851887)\\n#11 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/Cache\\\/Watcher.php(126): OC\\\\Files\\\\Storage\\\\Wrapper\\\\Wrapper->hasUpdated('Copie de Budget...', 1484851887)\\n#12 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/View.php(1304): OC\\\\Files\\\\Cache\\\\Watcher->needsUpdate('Copie de Budget...', Object(OC\\\\Files\\\\Cache\\\\CacheEntry))\\n#13 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/Files\\\/View.php(1342): OC\\\\Files\\\\View->getCacheEntry(Object(OCA\\\\Files_Trashbin\\\\Storage), 'Copie de Budget...', '_budget_operas\\\/...')\\n#14 \\\/var\\\/www\\\/owncloud\\\/apps\\\/dav\\\/lib\\\/Connector\\\/Sabre\\\/ObjectTree.php(160): OC\\\\Files\\\\View->getFileInfo('_budget_operas\\\/...')\\n#15 \\\/var\\\/www\\\/owncloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/CorePlugin.php(81): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\ObjectTree->getNodeForPath('_budget_operas\\\/...')\\n#16 [internal function]: Sabre\\\\DAV\\\\CorePlugin->httpGet(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#17 \\\/var\\\/www\\\/owncloud\\\/3rdparty\\\/sabre\\\/event\\\/lib\\\/EventEmitterTrait.php(105): call_user_func_array(Array, Array)\\n#18 \\\/var\\\/www\\\/owncloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(479): Sabre\\\\Event\\\\EventEmitter->emit('method:GET', Array)\\n#19 \\\/var\\\/www\\\/owncloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(254): Sabre\\\\DAV\\\\Server->invokeMethod(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#20 \\\/var\\\/www\\\/owncloud\\\/apps\\\/dav\\\/appinfo\\\/v1\\\/webdav.php(60): Sabre\\\\DAV\\\\Server->exec()\\n#21 \\\/var\\\/www\\\/owncloud\\\/remote.php(165): require_once('\\\/var\\\/www\\\/ownclo...')\\n#22 {main}\",\"File\":\"\\\/var\\\/www\\\/owncloud\\\/apps\\\/files_external\\\/3rdparty\\\/icewind\\\/smb\\\/src\\\/Parser.php\",\"Line\":57,\"User\":\"mrpotato\"}","level":4,"time":"2017-01-19T13:56:57-05:00","method":"GET","url":"\/remote.php\/webdav\/_budget_operas\/Copie%20de%20Budgets%20-%20MCLAREN%20NBOC%20VLC.xlsm","user":"mrpotato","version":"11.0.1.2"} root@owncloud:/var/www/owncloud/data# ```

Browser log

Browser log ``` Insert your browser log here, this could for example include:

a) The javascript console log
b) The network log
c) ...

</details>

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions