Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

networking-calico does not work with etcd v3.4 or later, because of URL path change #29

Open
vasilinamatov opened this issue Aug 11, 2020 · 1 comment
Open

networking-calico does not work with etcd v3.4 or later, because of URL path change #29

vasilinamatov opened this issue Aug 11, 2020 · 1 comment

Comments

@vasilinamatov
Copy link

vasilinamatov commented Aug 11, 2020 •
edited by caseydavenport
Loading

Hi, I Installed Calico 3.15 on Ubuntu 18 with Openstack Ussuri and with etcd 3.4.0.
I have the issue with flapping start/stop neutron-server service.

Aug 11 07:10:25 slpr-omb101 systemd[1]: Stopped OpenStack Neutron Server.
Aug 11 07:10:25 slpr-omb101 systemd[1]: Started OpenStack Neutron Server.
Aug 11 07:10:37 slpr-omb101 neutron-server[21533]: /usr/lib/python3/dist-packages/paste/deploy/loadwsgi.py:22: PkgResourcesDeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Aug 11 07:10:37 slpr-omb101 neutron-server[21533]:   return pkg_resources.EntryPoint.parse(“x=” + s).load(False)
Aug 11 07:10:37 slpr-omb101 systemd[1]: neutron-server.service: Main process exited, code=exited, status=1/FAILURE
Aug 11 07:10:42 slpr-omb101 systemd[1]: neutron-server.service: Failed with result ‘exit-code’.
Aug 11 07:10:43 slpr-omb101 systemd[1]: neutron-server.service: Service hold-off time over, scheduling restart.
Aug 11 07:10:43 slpr-omb101 systemd[1]: neutron-server.service: Scheduled restart job, restart counter is at 13.
Aug 11 07:10:43 slpr-omb101 systemd[1]: Stopped OpenStack Neutron Server.
Aug 11 07:10:43 slpr-omb101 systemd[1]: Started OpenStack Neutron Server.

Here is the neutron logs:

2020-08-11 09:16:01.762 43936 INFO neutron.service [-] Neutron service started, listening on 0.0.0.0:9696
2020-08-11 09:16:01.762 44014 INFO neutron.wsgi [-] (44014) wsgi starting up on http://0.0.0.0:9696
2020-08-11 09:16:01.763 43936 INFO oslo_service.service [-] Starting 24 workers
2020-08-11 09:16:01.763 44015 INFO neutron.wsgi [-] (44015) wsgi starting up on http://0.0.0.0:9696
2020-08-11 09:16:01.799 43936 INFO oslo_service.service [-] Starting 1 workers
2020-08-11 09:16:01.803 43936 INFO oslo_service.service [-] Starting 1 workers
2020-08-11 09:16:11.606 43936 INFO networking_calico.plugins.ml2.drivers.calico.mech_calico [-] Doing Calico mechanism driver initialisation in process 43936
2020-08-11 09:16:11.607 43936 INFO networking_calico.plugins.ml2.drivers.calico.mech_calico [-] db = <networking_calico.plugins.calico.plugin.CalicoPlugin object at 0x7fb0abea8da0>
2020-08-11 09:16:11.609 43936 INFO networking_calico.plugins.ml2.drivers.calico.mech_calico [req-7acd41c1-b36c-4d52-bc21-38d1b46f0fa4 - - - - -] Calico mechanism driver initialisation done in process 43936
2020-08-11 09:16:11.609 43936 INFO networking_calico.etcdv3 [-] TLS disabled, using HTTP to connect to etcd.
2020-08-11 09:16:11.613 43936 INFO networking_calico.plugins.ml2.drivers.calico.mech_calico [-] Periodic resync thread started
2020-08-11 09:16:11.614 43936 INFO networking_calico.plugins.ml2.drivers.calico.mech_calico [-] Status updating thread started.
2020-08-11 09:16:11.614 43936 INFO networking_calico.plugins.ml2.drivers.calico.mech_calico [-] Port status write thread started epoch=1
2020-08-11 09:16:11.614 43936 INFO networking_calico.plugins.ml2.drivers.calico.mech_calico [-] Port status write thread started epoch=1
2020-08-11 09:16:11.614 43936 INFO networking_calico.plugins.ml2.drivers.calico.mech_calico [-] Port status write thread started epoch=1
2020-08-11 09:16:11.614 43936 INFO networking_calico.plugins.ml2.drivers.calico.mech_calico [-] Port status write thread started epoch=1
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election [-] Election greenlet exiting: AttributeError(“‘Etcd3Exception’ object has no attribute ‘detail_text’“,): AttributeError: ‘Etcd3Exception’ object has no attribute ‘detail_text’
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election Traceback (most recent call last):
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3.6/dist-packages/networking_calico/plugins/ml2/drivers/calico/election.py”, line 142, in _vote
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     value, mod_revision = etcdv3.get(self._key)
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3.6/dist-packages/networking_calico/etcdv3.py”, line 88, in get
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     results = client.get(key, metadata=True)
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3/dist-packages/etcd3gw/client.py”, line 216, in get
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     json=payload)
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3.6/dist-packages/networking_calico/etcdv3.py”, line 468, in post
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     return super(Etcd3AuthClient, self).post(*args, **kwargs)
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3/dist-packages/etcd3gw/client.py”, line 84, in post
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     raise exceptions.Etcd3Exception(resp.reason)
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election etcd3gw.exceptions.Etcd3Exception: Not Found
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election During handling of the above exception, another exception occurred:
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election Traceback (most recent call last):
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3.6/dist-packages/networking_calico/plugins/ml2/drivers/calico/election.py”, line 110, in _run
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     self._vote()
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3.6/dist-packages/networking_calico/plugins/ml2/drivers/calico/election.py”, line 150, in _vote
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     self._log_exception(“read current master”, e)
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3.6/dist-packages/networking_calico/plugins/ml2/drivers/calico/election.py”, line 324, in _log_exception
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     self._key, exc, exc.detail_text)
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election AttributeError: ‘Etcd3Exception’ object has no attribute ‘detail_text’
2020-08-11 09:16:11.617 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election [-] Failed to step down as master.  Ignoring.: etcd3gw.exceptions.Etcd3Exception: Not Found
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election Traceback (most recent call last):
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3.6/dist-packages/networking_calico/plugins/ml2/drivers/calico/election.py”, line 142, in _vote
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     value, mod_revision = etcdv3.get(self._key)
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3.6/dist-packages/networking_calico/etcdv3.py”, line 88, in get
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     results = client.get(key, metadata=True)
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3/dist-packages/etcd3gw/client.py”, line 216, in get
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     json=payload)
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3.6/dist-packages/networking_calico/etcdv3.py”, line 468, in post
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     return super(Etcd3AuthClient, self).post(*args, **kwargs)
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3/dist-packages/etcd3gw/client.py”, line 84, in post
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     raise exceptions.Etcd3Exception(resp.reason)
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election etcd3gw.exceptions.Etcd3Exception: Not Found
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election During handling of the above exception, another exception occurred:
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election Traceback (most recent call last):
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3.6/dist-packages/networking_calico/plugins/ml2/drivers/calico/election.py”, line 110, in _run
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     self._vote()
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3.6/dist-packages/networking_calico/plugins/ml2/drivers/calico/election.py”, line 150, in _vote
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     self._log_exception(“read current master”, e)
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3.6/dist-packages/networking_calico/plugins/ml2/drivers/calico/election.py”, line 324, in _log_exception
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     self._key, exc, exc.detail_text)
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election AttributeError: ‘Etcd3Exception’ object has no attribute ‘detail_text’
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election During handling of the above exception, another exception occurred:
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election Traceback (most recent call last):
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3.6/dist-packages/networking_calico/plugins/ml2/drivers/calico/election.py”, line 133, in _run
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     sys.exit(1)
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election SystemExit: 1
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election During handling of the above exception, another exception occurred:
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election Traceback (most recent call last):
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3.6/dist-packages/networking_calico/plugins/ml2/drivers/calico/election.py”, line 337, in _attempt_step_down
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     etcdv3.delete(self._key, existing_value=self.id_string)
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3.6/dist-packages/networking_calico/etcdv3.py”, line 221, in delete
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     result = client.transaction(txn)
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3/dist-packages/etcd3gw/client.py”, line 332, in transaction
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     data=json.dumps(txn))
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3.6/dist-packages/networking_calico/etcdv3.py”, line 468, in post
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     return super(Etcd3AuthClient, self).post(*args, **kwargs)
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election   File “/usr/lib/python3/dist-packages/etcd3gw/client.py”, line 84, in post
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election     raise exceptions.Etcd3Exception(resp.reason)
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election etcd3gw.exceptions.Etcd3Exception: Not Found
2020-08-11 09:16:11.619 43936 ERROR networking_calico.plugins.ml2.drivers.calico.election
2020-08-11 09:16:11.852 43955 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting
2020-08-11 09:16:11.852 43953 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting
2020-08-11 09:16:11.852 43978 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting
2020-08-11 09:16:11.852 43952 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting
2020-08-11 09:16:11.852 44012 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting
2020-08-11 09:16:11.852 43970 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting
2020-08-11 09:16:11.852 43981 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting
2020-08-11 09:16:11.852 43962 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting
2020-08-11 09:16:11.852 44015 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting
2020-08-11 09:16:11.852 43984 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting
2020-08-11 09:16:11.852 43972 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting
2020-08-11 09:16:11.852 43979 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting
2020-08-11 09:16:11.852 43982 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting
2020-08-11 09:16:11.852 44006 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting
2020-08-11 09:16:11.852 44010 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting
2020-08-11 09:16:11.852 43976 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting
2020-08-11 09:16:11.852 43985 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting
2020-08-11 09:16:11.852 44001 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting
2020-08-11 09:16:11.852 44013 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting
2020-08-11 09:16:11.853 43966 INFO oslo_service.service [-] Parent process has died unexpectedly, exiting
root@slpr-omb101:~# systemctl status neutron-server
● neutron-server.service - OpenStack Neutron Server
   Loaded: loaded (/lib/systemd/system/neutron-server.service; enabled; vendor preset: enabled)
   Active: deactivating (stop-sigterm) (Result: exit-code) since Tue 2020-08-11 09:23:59 EDT; 2s ago
  Process: 49135 ExecStart=/etc/init.d/neutron-server systemd-start (code=exited, status=1/FAILURE)
 Main PID: 49135 (code=exited, status=1/FAILURE)
    Tasks: 25 (limit: 7372)
   CGroup: /system.slice/neutron-server.service
           ├─361 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─362 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─363 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─364 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─365 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─366 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─367 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─368 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─369 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─370 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─371 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─373 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─374 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─377 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─378 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─379 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─380 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─381 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─382 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─383 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─384 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─385 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─387 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           ├─388 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
           └─389 neutron-server: rpc worker (/usr/bin/python3 /usr/bin/neutron-server --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/ml2_conf.ini --log-file=/var/log/neutron/neutron-server.log)
Aug 11 09:23:47 slpr-omb101 systemd[1]: Started OpenStack Neutron Server.
Aug 11 09:23:59 slpr-omb101 neutron-server[49135]: /usr/lib/python3/dist-packages/paste/deploy/loadwsgi.py:22: PkgResourcesDeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Aug 11 09:23:59 slpr-omb101 neutron-server[49135]:   return pkg_resources.EntryPoint.parse(“x=” + s).load(False)
Aug 11 09:23:59 slpr-omb101 systemd[1]: neutron-server.service: Main process exited, code=exited, status=1/FAILURE

vasili.namatov  3 hours ago
root@slpr-omb101:~# systemctl status calico-dhcp-agent.service
● calico-dhcp-agent.service - Calico DHCP agent
   Loaded: loaded (/lib/systemd/system/calico-dhcp-agent.service; enabled; vendor preset: enabled)
   Active: active (running) since Tue 2020-08-11 09:24:48 EDT; 1s ago
 Main PID: 808 (/usr/bin/python)
    Tasks: 1 (limit: 7372)
   CGroup: /system.slice/calico-dhcp-agent.service
           └─808 /usr/bin/python3 /usr/bin/calico-dhcp-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/dhcp_agent.ini
Aug 11 09:24:49 slpr-omb101 calico-dhcp-agent[808]: 2020-08-11 09:24:49.836 808 ERROR neutron   File “/usr/lib/python3.6/dist-packages/networking_calico/etcdv3.py”, line 348, in get_status
Aug 11 09:24:49 slpr-omb101 calico-dhcp-agent[808]: 2020-08-11 09:24:49.836 808 ERROR neutron     status = client.status()
Aug 11 09:24:49 slpr-omb101 calico-dhcp-agent[808]: 2020-08-11 09:24:49.836 808 ERROR neutron   File “/usr/lib/python3/dist-packages/etcd3gw/client.py”, line 97, in status
Aug 11 09:24:49 slpr-omb101 calico-dhcp-agent[808]: 2020-08-11 09:24:49.836 808 ERROR neutron     json={})
Aug 11 09:24:49 slpr-omb101 calico-dhcp-agent[808]: 2020-08-11 09:24:49.836 808 ERROR neutron   File “/usr/lib/python3.6/dist-packages/networking_calico/etcdv3.py”, line 468, in post
Aug 11 09:24:49 slpr-omb101 calico-dhcp-agent[808]: 2020-08-11 09:24:49.836 808 ERROR neutron     return super(Etcd3AuthClient, self).post(*args, **kwargs)
Aug 11 09:24:49 slpr-omb101 calico-dhcp-agent[808]: 2020-08-11 09:24:49.836 808 ERROR neutron   File “/usr/lib/python3/dist-packages/etcd3gw/client.py”, line 84, in post
Aug 11 09:24:49 slpr-omb101 calico-dhcp-agent[808]: 2020-08-11 09:24:49.836 808 ERROR neutron     raise exceptions.Etcd3Exception(resp.reason)
Aug 11 09:24:49 slpr-omb101 calico-dhcp-agent[808]: 2020-08-11 09:24:49.836 808 ERROR neutron etcd3gw.exceptions.Etcd3Exception: Not Found
Aug 11 09:24:49 slpr-omb101 calico-dhcp-agent[808]: 2020-08-11 09:24:49.836 808 ERROR neutron
root@slpr-omb101:~# systemctl status calico-dhcp-agent.service
● calico-dhcp-agent.service - Calico DHCP agent
   Loaded: loaded (/lib/systemd/system/calico-dhcp-agent.service; enabled; vendor preset: enabled)
   Active: activating (auto-restart) (Result: exit-code) since Tue 2020-08-11 09:24:53 EDT; 17ms ago
  Process: 822 ExecStart=/usr/bin/calico-dhcp-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/dhcp_agent.ini (code=exited, status=1/FAILURE)
 Main PID: 822 (code=exited, status=1/FAILURE)
Aug 11 09:24:53 slpr-omb101 systemd[1]: calico-dhcp-agent.service: Failed with result ‘exit-code’.

vasili.namatov  3 hours ago
root@slpr-omb101:~# systemctl status calico-felix
● calico-felix.service - Calico Felix agent
   Loaded: loaded (/lib/systemd/system/calico-felix.service; enabled; vendor preset: enabled)
   Active: active (running) since Tue 2020-08-11 09:25:37 EDT; 4s ago
  Process: 1118 ExecStartPre=/bin/mkdir -p /var/run/calico (code=exited, status=0/SUCCESS)
 Main PID: 1119 (calico-felix)
    Tasks: 21 (limit: 7372)
   CGroup: /system.slice/calico-felix.service
           └─1119 /usr/bin/calico-felix
Aug 11 09:25:37 slpr-omb101 systemd[1]: Starting Calico Felix agent...
Aug 11 09:25:37 slpr-omb101 systemd[1]: Started Calico Felix agent.

Maybe I’m missing some important configuration which must be in Ussuri.. Cause last time I worked with Rocky and calico 3.12 which was not supported python3 but it worked very well.

root@slpr-omb102:~# apt install python-etcd3gw
Reading package lists... Done
Building dependency tree
Reading state information... Done
python-etcd3gw is already the newest version (0.2.1-1).
0 upgraded, 0 newly installed, 0 to remove and 243 not upgraded.
root@slpr-omb102:~# apt install python3-etcd3gw
Reading package lists... Done
Building dependency tree
Reading state information... Done
python3-etcd3gw is already the newest version (0.2.1-1).
0 upgraded, 0 newly installed, 0 to remove and 243 not upgraded.

You mean I can continue to use 3.3.11 as I used before with calico 3.12?
I mean now I can use the same 3.3.11 with calico 3.15?
Do you think the issue with etcd proper?
@nelljerram
Copy link
Member

@vasilinamatov I believe there are 2 problems here.

Firstly, etcd 3.4 is problematic because they changed URL paths from "v3alpha" to "v3beta". We should update to handle this, but in the meantime I recommend sticking with etcd 3.3.

Secondly, you're using the wrong version of etcd3gw. Please see https://docs.projectcalico.org/getting-started/openstack/installation/ubuntu for how to install the correct version.

Can you let us know if you still see any problem after fixing those two things?

@nelljerram nelljerram changed the title ERROR networking_calico.plugins.ml2.drivers.calico.election [-] Election greenlet exiting: AttributeError(“‘Etcd3Exception’ object has no attribute ‘detail_text’“,): AttributeError: ‘Etcd3Exception’ object has no attribute ‘detail_text’ networking-calico does not work with etcd v3.4 or later, because of URL path change Dec 11, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@nelljerram @vasilinamatov