Can't upgrade synapse (and the upgrade kills fail2ban)

[noccio]

Yunohost stable on a raspberry pi4 running 32 bit version of OS.

If I try to upgrade synapse I get this error:

Warning: ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.

Warning: setuptools-rust 1.5.2 requires setuptools>=62.4, but you have setuptools 60.8.2 which is incompatible.

and a long series of errors (this is the log https://paste.yunohost.org/uxocagurux

And after the failed upgrade fail2ban gives an error (this is the log https://paste.yunohost.org/wuzidociba) and I need to restart manually fail2ban.

P.S.: this problem also in https://forum.yunohost.org/t/cant-upgrade-synapse-and-the-upgrade-kills-fail2ban/24759

[lapineige]

From 1.81 to 1.84, same warning, but the upgrade is completed… 🤔

Yet the service keeps restarting, and the server is not working.

[lapineige]

I installed that setuptools version.

Then in the service log :

Error in configuration at 'a.p.p._.s.e.r.v.i.c.e._.c.o.n.f.i.g._.f.i.l.e.s':
python[285426]:   Expected 'None' to be a list of AS config files:

[lapineige]

I went in the virtual environnement, installed the minimal setuptool version required (62.4.0), v67.8.0 was already here, so I switched back to it… and in the midtime, Synapse was working again. 🤔

[Thatoo]

@lapineige could you share with details (command lines) what you did after (maybe before too) the upgrade please?

[noccio]

I went in the virtual environnement, installed the minimal setuptool version required (62.4.0), v67.8.0 was already here, so I switched back to it… and in the midtime, Synapse was working again. thinking

pip shows me setuptools version 52.0.0

pip show setuptools
Name: setuptools
Version: 52.0.0
Summary: Easily download, build, install, upgrade, and uninstall Python packages
Home-page: https://github.com/pypa/setuptools
Author: Python Packaging Authority
Author-email: distutils-sig@python.org
License: UNKNOWN
Location: /usr/lib/python3/dist-packages
Requires: 
Required-by: 

[Schoebi]

I have a similar issue: https://forum.yunohost.org/t/upgrade-synapse-problem/24890

[lapineige]

@noccio yes I had the same version.

I didn't keep track of the whole set of actions, but if I remember correctly I went to /opt/yunohost/matrix-synapse, activated the venv, then installed a more recent setuptool version.
Roughly the commands are:

cd /opt/yunohost/matrix-synapse/bin
source activate # activate the virtual environment
python -m pip install  setuptools==67.8.0

And reload the service.

[Thatoo]

I went in the virtual environnement, installed the minimal setuptool version required (62.4.0), v67.8.0 was already here, so I switched back to it… and in the midtime, Synapse was working again. thinking

I did exactly the same but synapse keeps restarting...

● matrix-synapse.service - Synapse Matrix homeserver
     Loaded: loaded (/etc/systemd/system/matrix-synapse.service; enabled; vendor preset: enabled)
     Active: activating (start-pre) since Fri 2023-05-26 22:19:02 BST; 2s ago
Cntrl PID: 2833 (python)
      Tasks: 1 (limit: 3933)
        CPU: 1.243s
     CGroup: /system.slice/matrix-synapse.service
             └─2833 /opt/yunohost/matrix-synapse/bin/python -m synapse.app.homeserver --config-path=/etc/matrix-synapse/homeserver.yaml --config-path=/etc/matrix-synapse/conf.d/ --generate-keys

May 26 22:19:02 ger.fr systemd[1]: Starting Synapse Matrix homeserver...

too bad. I'll try to restore.

[Thatoo]

restoration worked ouf

[Thatoo]

forgot to mention that my raspi4 is 64 bit not 32.

[dbflexi]

@Thatoo I have the same problem. First tried to rollback with yunohost backup to "synapse-pre-upgrade1" but this does not work. (The following apps cannot be restored because they are already installed: synapse).
Then I tried @lapineige variant. Unfortunately, this had the same effect: Synapse always restarted anyway.
How did you restore Synapse @Thatoo?

[JimboJoe]

A fix that worked for me:

vi /etc/matrix-synapse/conf.d/app_service.yaml

Change the line to (add brackets):

app_service_config_files: []

Seems linked to a bad factory configuration in the package (need someone to do the PR), and a stricter control of configuration file in upstream version (upstream PR matrix-org/synapse#15425)

[dbflexi]

@JimboJoe that worked for me too :-)

[Thatoo]

@Thatoo I have the same problem. First tried to rollback with yunohost backup to "synapse-pre-upgrade1" but this does not work. (The following apps cannot be restored because they are already installed: synapse). Then I tried @lapineige variant. Unfortunately, this had the same effect: Synapse always restarted anyway. How did you restore Synapse @Thatoo?

I had to delete synapse app first and then restore but you find a way already then.

[Josue-T]

Should be fixed by b1968a5