Hi All,
We have recently upgraded vRealize Operations Manager from version 7.5 to version 8.0, Tenant App version 2.4, vCloud Director Content Pack 5.2, vCloud Director 9.7 and the Tenant App cannot load the plugin. The following error appears in the logs:
2020-07-09 02:08:21,077 - install - INFO - uploading to <https://vcloudoprtaladdress/transfer/7f5161f9-aa1b-4c88-af23-bfc3cf0dab92/plugin.zip>;rel="upload:default";type="application/octet-stream"
2020-07-09 02:08:21,122 - install - INFO - Uploaded Successfully
2020-07-09 02:08:21,122 - install - INFO - Publishing
2020-07-09 02:08:21,169 - install - INFO - published Successfully
2020-07-09 02:10:37,935 - install - ERROR - HTTPSConnectionPool(host='vcloudoprtaladdress', port=443): Max retries exceeded with url: /api/sessions (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f8a578a1d10>: Failed to establish a new connection: [Errno 110] Connection timed out',))
Traceback (most recent call last):
File "publish.py", line 59, in login
loginUrl, headers=headers, data=json.dumps(requestBody), verify=False)
File "/usr/lib/python2.7/site-packages/requests/api.py", line 110, in post
return request('post', url, data=data, json=json, **kwargs)
File "/usr/lib/python2.7/site-packages/requests/api.py", line 56, in request
return session.request(method=method, url=url, **kwargs)
File "/usr/lib/python2.7/site-packages/requests/sessions.py", line 500, in request
resp = self.send(prep, **send_kwargs)
File "/usr/lib/python2.7/site-packages/requests/sessions.py", line 621, in send
r = adapter.send(request, **kwargs)
File "/usr/lib/python2.7/site-packages/requests/adapters.py", line 487, in send
raise ConnectionError(e, request=request)
ConnectionError: HTTPSConnectionPool(host='vcloudoprtaladdress, port=443): Max retries exceeded with url: /api/sessions (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f8a578a1d10>: Failed to establish a new connection: [Errno 110] Connection timed out',))
echo | openssl s_client -connect vcloudportaladdress:443
Error: “verify error:num=20:unable to get local issuer certificate”
curl -vs telnet://cloudportaladdress:443
* Rebuilt URL to: telnet://cloudportaladdress:443/
* Trying 10.10.10.20.
* TCP_NODELAY set
* Connected to portal.nzcc.ihost.com (10.10.10.20) port 443 (#0)
Any idea what could be the problem? It was working perfectly fine when running vROPs 7.5/ Tenant App 2.2/Content Pack 5.1
Thanks
To get more information of the issue run the following commands
1. Login/SSH to tenant app using root user
2. run "docker ps" command. You will be able to see list of running dockers.
3. Get the docker ID of tenant-app-plugin
4. run "docker logs <dockerID>" <dockerID> - is the docker ID taken from step 3
Output
Traceback (most recent call last):\
File "/etc/vmware/bin/vcd_extension.py", line 269, in <module>\
main()\
File "/etc/vmware/bin/vcd_extension.py", line 243, in main\
connection = pika.BlockingConnection(conn_params)\
File "/usr/lib/python2.7/site-packages/pika/adapters/blocking_connection.py", line 359, in __init__\
self._impl = self._create_connection(parameters, _impl_class)\
File "/usr/lib/python2.7/site-packages/pika/adapters/blocking_connection.py", line 450, in _create_connection\
raise self._reap_last_connection_workflow_error(error)\
pika.exceptions.ProbableAuthenticationError: ConnectionClosedByBroker: (403) 'ACCESS_REFUSED - Login was refused using authentication mechanism PLAIN. For details see the broker logfile.'\
Resolution: Recreate rabbitmq user, remove plugin, add the plugin from GUI
Hi,
Pretty hard to say, I would follow the cert error message and try this:
Remove the Tenant and vCloud endpoints from vROPs
(if any) Delete the Tenant/vCloud certs in vROPs (administration -> manage -> certs)
Add the Tenant and vCloud repo's back
G'luck!
To get more information of the issue run the following commands
1. Login/SSH to tenant app using root user
2. run "docker ps" command. You will be able to see list of running dockers.
3. Get the docker ID of tenant-app-plugin
4. run "docker logs <dockerID>" <dockerID> - is the docker ID taken from step 3
Output
Traceback (most recent call last):\
File "/etc/vmware/bin/vcd_extension.py", line 269, in <module>\
main()\
File "/etc/vmware/bin/vcd_extension.py", line 243, in main\
connection = pika.BlockingConnection(conn_params)\
File "/usr/lib/python2.7/site-packages/pika/adapters/blocking_connection.py", line 359, in __init__\
self._impl = self._create_connection(parameters, _impl_class)\
File "/usr/lib/python2.7/site-packages/pika/adapters/blocking_connection.py", line 450, in _create_connection\
raise self._reap_last_connection_workflow_error(error)\
pika.exceptions.ProbableAuthenticationError: ConnectionClosedByBroker: (403) 'ACCESS_REFUSED - Login was refused using authentication mechanism PLAIN. For details see the broker logfile.'\
Resolution: Recreate rabbitmq user, remove plugin, add the plugin from GUI