vROPS Integration problems

[fduranti]

Today I was trying to define some more alarms to send to vrops.

My configuration has 2 loginsight server (1 master + 1 worker) with internal LB and 5 vrops server (1 master+1 replica + 2 data notes + 2 remote collector for 2 sites).

When I go to the alarm definition and try to define the default resource to receive alert the list is Empty and nothing appears so I cannot define an alert.

Going to Integration Administrator on LogInsight  and trying to test the connection to vROPS i get this error:

Connection test failed: host does not seem to be a vRealize Operations Manager server

Trying to change the host to which LogInsight talk to vROPS and doing a test result in the same error.

I've tried to restart the loginsight worker and Master but nothing changed.

Going to loginsight logs and clicking on Open Analysis in vRealize Operations Manager works correctly as it does if I use the action "Search logs in vRealize Log Insight (not sure if correctly it points to the physical master and not to the LB address).

On Environment Overview of vROPS i see those servers... i think that 2 of them are the old ones (itromvlog01 was the old single instance loginsight server while itromvlog11 is the new master of a 2 node configuration.

Log Insight adapter is version 6.0.2338756

Anyone has an idea of what's happening?

[sflanders]

Side note: You did not mention LI version, but if 2.5 then be advised that 2-node clusters are not supported.

If the test connection is failing with an error then something has changed. I would check the LI logs and more specifically /storage/var/loginsight/runtime.log and /storage/var/loginsight/vcenter_operations.log for clues. Is LI pointed to the LB or directly to a vR Ops instance? If LB, then does the test work if you point directly to a node?

[fduranti]

LI is 2.5, you mean I need to install a second worker for LI (to have 1 master + 2 worker) or that it's not supported to point to a vROPs cluster? I'll install it if needed but I don't think this is the problem.

It was working for sure until some days ago and is correctly sending already defined alerts... the problem is to create new alerts and eventually change already configured ones. Integration is working also if test is failing.

I don't have a LB for vROPs. I'm pointing at the single vrops node (master is itromvrops01, replica is itromvrops02, data are 04-05) and the test fail no matter what node i point (the user and password are correct).

I've checked on logs and I don't see any error while doing a test on those files. On vcenter_operations.log I see mostly Open connection to url.

During the test this is what appears on the logs:

[2015-02-18 15:41:57.874+0000] [http-443-9/127.0.0.1 INFO] [com.vmware.loginsight.commons.vcops.VcopsHttpPostSender] [Wed Feb 18 15:41:57 UTC 2015: Creating new VcopsHttpPostSender to send to server https://itromvrops01.q8int.com:443]

[2015-02-18 15:41:57.874+0000] [http-443-9/127.0.0.1 INFO] [com.vmware.loginsight.commons.vcops.VcopsHttpPostSender] [querying using vcops http post adapter with body: action=lookupResource&resourceName=regex%3A.*.*]

[2015-02-18 15:41:58.380+0000] [Thread-36/127.0.0.1 INFO] [com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest] [Open connection to URL https://itromvrops01.q8int.com/suite-api/api/resources/716077a4-2d1d-4d4d-a7db-0d222d3cbb4e/properti...]

[2015-02-18 15:41:58.765+0000] [http-443-9/127.0.0.1 INFO] [com.vmware.loginsight.commons.vcops.VcopsHttpPostSender] [Post (action%3DlookupResource%26resourceName%3Dregex%253A.*.*) sent successfully to vcops.]

[2015-02-18 15:41:59.690+0000] [Thread-36/127.0.0.1 INFO] [com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest] [Open connection to URL https://itromvrops01.q8int.com/suite-api/api/resources/71a78cf5-e445-453c-8a02-12851386bc6e/properti...]

[2015-02-18 15:42:00.916+0000] [Thread-36/127.0.0.1 INFO] [com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest] [Open connection to URL https://itromvrops01.q8int.com/suite-api/api/resources/71bf4b3e-81fd-44c0-8d50-c9989cf7b74f/properti...]

[2015-02-18 15:42:02.368+0000] [Thread-36/127.0.0.1 INFO] [com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest] [Open connection to URL https://itromvrops01.q8int.com/suite-api/api/resources/71c6cde9-9674-47fe-a524-c2be7d36e202/properti...]

and this is the runtime.log

[2015-02-18 15:42:37.910+0000] [Thread-232/127.0.0.1 WARN] [com.vmware.loginsight.commons.executor.ProcessExecutor] [ [[/usr/lib/loginsight/application/3rd_party/bin/java, -cp, /usr/lib/loginsight/application/etc/plugins/vsphere/*, -Xmx1024M, com.vmware.loginsight.vsphere.events.VimEventMonitor, --single-run, --host, localhost, --port, 9240, --url, itromvs01.q8int.com, --username, **********************, --encrypted-password, ********************, --metadata-dir, /storage/core/loginsight/var/plugins/vsphere]] log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.]

[2015-02-18 15:42:39.365+0000] [Indexer-1-Commit-Timer/127.0.0.1 INFO] [com.vmware.loginsight.indexing.Indexer] [Added 522 messages to index.]

[2015-02-18 15:42:39.896+0000] [Indexer-1-Commit-Timer/10.160.30.212 INFO] [com.vmware.loginsight.indexing.Indexer] [Added 608 messages to index.]

[2015-02-18 15:42:41.744+0000] [LeoScheduler-thread-1/127.0.0.1 INFO] [com.vmware.loginsight.spock.leo.LeoManager] [Cluster model updated in 1.259 sec]

[2015-02-18 15:42:41.929+0000] [Indexer-2-Commit-Timer/127.0.0.1 INFO] [com.vmware.loginsight.indexing.Indexer] [Added 846 messages to index.]

[2015-02-18 15:42:42.400+0000] [Indexer-2-Commit-Timer/10.160.30.212 INFO] [com.vmware.loginsight.indexing.Indexer] [Added 790 messages to index.]

[2015-02-18 15:42:43.736+0000] [pool-726-thread-11/127.0.0.1 INFO] [com.vmware.vapi.provider.local.LocalProvider] [call to invokeMethod for com.vmware.loginsight.api.strata.index_messages]

[2015-02-18 15:42:43.798+0000] [pool-726-thread-11/127.0.0.1 INFO] [com.vmware.vapi.provider.local.LocalProvider] [call to invokeMethod for com.vmware.loginsight.api.strata.flush_index]

[2015-02-18 15:42:43.798+0000] [LogImporterService.Processor-thread-11/127.0.0.1 INFO] [com.vmware.loginsight.ingestion.importer.MultiThreadImporterService] [Begin to flush ingestion pipeline, id=2816196863253007865]

[2015-02-18 15:42:43.825+0000] [LogImporterService.Processor-thread-11/127.0.0.1 INFO] [com.vmware.loginsight.ingestion.importer.MultiThreadImporterService] [Flush ingestion pipeline succeeded (id=2816196863253007865)]

[2015-02-18 15:42:43.874+0000] [ScheduledPluginServiceThread/127.0.0.1 INFO] [com.vmware.loginsight.web.background.ScheduledPluginService] [vCenter task and event collection successful for host itromvs01.q8int.com]

[2015-02-18 15:42:43.875+0000] [ScheduledPluginServiceThread/127.0.0.1 INFO] [com.vmware.loginsight.web.background.ScheduledPluginService] [Executing VimEventMonitor with the following command: /usr/lib/loginsight/application/3rd_party/bin/java -cp /usr/lib/loginsight/application/etc/plugins/vsphere/* -Xmx1024M com.vmware.loginsight.vsphere.events.VimEventMonitor --single-run --host localhost --port 9240 --url itnapvs01.q8int.com --username********************** --encrypted-password <redacted> --metadata-dir /storage/core/loginsight/var/plugins/vsphere]

[2015-02-18 15:42:43.972+0000] [Thread-236/127.0.0.1 WARN] [com.vmware.loginsight.commons.executor.ProcessExecutor] [ [[/usr/lib/loginsight/application/3rd_party/bin/java, -cp, /usr/lib/loginsight/application/etc/plugins/vsphere/*, -Xmx1024M, com.vmware.loginsight.vsphere.events.VimEventMonitor, --single-run, --host, localhost, --port, 9240, --url, itnapvs01.q8int.com, --username,**********************, --encrypted-password, **********************, --metadata-dir, /storage/core/loginsight/var/plugins/vsphere]] log4j:WARN No appenders could be found for logger (com.vmware.loginsight.vsphere.events.VimEventMonitor).]

[sflanders]

Side note was that a 2-node LI cluster is not supported -- completely separate from your vR Ops topic, but thought worth mentioning.

What do those logs show when you run the test and get the error? You should see something more specific to the error shown in the UI. The other integrations are likely working as they rely on the vR Ops HTTP post adapter, which is not installed on LI. Based on your symptoms, the issue is LI can no longer properly communicate with vR Ops, which is why resources are not shown.

[fduranti]

Those log I've posted are took during the "connection test".

I've done this now:

1) edit an alarm (standard) that is working correctly.

2) edit the default resource...

3) Gone to all resource and press search.

Nothing appear ... and this is the logs i get :

runtime.log

[2015-02-18 16:32:44.418+0000] [Indexer-1-Commit-Timer/127.0.0.1 INFO] [com.vmware.loginsight.indexing.Indexer] [Added 732 messages to index.]

[2015-02-18 16:32:44.894+0000] [Indexer-1-Commit-Timer/10.160.30.212 INFO] [com.vmware.loginsight.indexing.Indexer] [Added 1028 messages to index.]

[2015-02-18 16:32:45.949+0000] [pool-726-thread-30/127.0.0.1 INFO] [com.vmware.vapi.provider.local.LocalProvider] [call to invokeMethod for com.vmware.loginsight.api.strata.index_messages]

[2015-02-18 16:32:46.010+0000] [pool-726-thread-30/127.0.0.1 INFO] [com.vmware.vapi.provider.local.LocalProvider] [call to invokeMethod for com.vmware.loginsight.api.strata.flush_index]

[2015-02-18 16:32:46.010+0000] [LogImporterService.Processor-thread-30/127.0.0.1 INFO] [com.vmware.loginsight.ingestion.importer.MultiThreadImporterService] [Begin to flush ingestion pipeline, id=3396786106104916563]

[2015-02-18 16:32:46.039+0000] [LogImporterService.Processor-thread-30/127.0.0.1 INFO] [com.vmware.loginsight.ingestion.importer.MultiThreadImporterService] [Flush ingestion pipeline succeeded (id=3396786106104916563)]

[2015-02-18 16:32:46.096+0000] [ScheduledPluginServiceThread/127.0.0.1 INFO] [com.vmware.loginsight.web.background.ScheduledPluginService] [vCenter task and event collection successful for host itromvs01.q8int.com]

[2015-02-18 16:32:46.096+0000] [ScheduledPluginServiceThread/127.0.0.1 INFO] [com.vmware.loginsight.web.background.ScheduledPluginService] [Executing VimEventMonitor with the following command: /usr/lib/loginsight/application/3rd_party/bin/java -cp /usr/lib/loginsight/application/etc/plugins/vsphere/* -Xmx1024M com.vmware.loginsight.vsphere.events.VimEventMonitor --single-run --host localhost --port 9240 --url itnapvs01.q8int.com --username ******************* --encrypted-password <redacted> --metadata-dir /storage/core/loginsight/var/plugins/vsphere]

[2015-02-18 16:32:46.186+0000] [Thread-616/127.0.0.1 WARN] [com.vmware.loginsight.commons.executor.ProcessExecutor] [ [[/usr/lib/loginsight/application/3rd_party/bin/java, -cp, /usr/lib/loginsight/application/etc/plugins/vsphere/*, -Xmx1024M, com.vmware.loginsight.vsphere.events.VimEventMonitor, --single-run, --host, localhost, --port, 9240, --url, itnapvs01.q8int.com, --username, *******************, --encrypted-password, *******************, --metadata-dir, /storage/core/loginsight/var/plugins/vsphere]] log4j:WARN No appenders could be found for logger (com.vmware.loginsight.vsphere.events.VimEventMonitor).]

[2015-02-18 16:32:46.186+0000] [Thread-616/127.0.0.1 WARN] [com.vmware.loginsight.commons.executor.ProcessExecutor] [ [[/usr/lib/loginsight/application/3rd_party/bin/java, -cp, /usr/lib/loginsight/application/etc/plugins/vsphere/*, -Xmx1024M, com.vmware.loginsight.vsphere.events.VimEventMonitor, --single-run, --host, localhost, --port, 9240, --url, itnapvs01.q8int.com, --username, *******************, --encrypted-password, *******************, --metadata-dir, /storage/core/loginsight/var/plugins/vsphere]] log4j:WARN Please initialize the log4j system properly.]

[2015-02-18 16:32:46.187+0000] [Thread-616/127.0.0.1 WARN] [com.vmware.loginsight.commons.executor.ProcessExecutor] [ [[/usr/lib/loginsight/application/3rd_party/bin/java, -cp, /usr/lib/loginsight/application/etc/plugins/vsphere/*, -Xmx1024M, com.vmware.loginsight.vsphere.events.VimEventMonitor, --single-run, --host, localhost, --port, 9240, --url, itnapvs01.q8int.com, --username, *******************, --encrypted-password, *******************, --metadata-dir, /storage/core/loginsight/var/plugins/vsphere]] log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.]

[2015-02-18 16:32:46.870+0000] [Indexer-2-Commit-Timer/127.0.0.1 INFO] [com.vmware.loginsight.indexing.Indexer] [Added 986 messages to index.]

[2015-02-18 16:32:47.395+0000] [Indexer-2-Commit-Timer/10.160.30.212 INFO] [com.vmware.loginsight.indexing.Indexer] [Added 491 messages to index.]

[2015-02-18 16:32:49.035+0000] [Timer-3/10.160.30.212 INFO] [com.vmware.loginsight.daemon.LogInsightDaemon] [Memory usage is 2015472992 bytes (54%)]

[2015-02-18 16:32:49.383+0000] [Indexer-1-Commit-Timer/127.0.0.1 INFO] [com.vmware.loginsight.indexing.Indexer] [Added 789 messages to index.]

[2015-02-18 16:32:49.913+0000] [Indexer-1-Commit-Timer/10.160.30.212 INFO] [com.vmware.loginsight.indexing.Indexer] [Added 790 messages to index.]

[2015-02-18 16:32:51.889+0000] [Indexer-2-Commit-Timer/127.0.0.1 INFO] [com.vmware.loginsight.indexing.Indexer] [Added 997 messages to index.]

[2015-02-18 16:32:52.401+0000] [Indexer-2-Commit-Timer/10.160.30.212 INFO] [com.vmware.loginsight.indexing.Indexer] [Added 1421 messages to index.]

[2015-02-18 16:32:52.554+0000] [pool-726-thread-30/127.0.0.1 INFO] [com.vmware.vapi.provider.local.LocalProvider] [call to invokeMethod for com.vmware.loginsight.api.strata.index_messages]

[2015-02-18 16:32:52.618+0000] [pool-726-thread-30/127.0.0.1 INFO] [com.vmware.vapi.provider.local.LocalProvider] [call to invokeMethod for com.vmware.loginsight.api.strata.flush_index]

[2015-02-18 16:32:52.618+0000] [LogImporterService.Processor-thread-30/127.0.0.1 INFO] [com.vmware.loginsight.ingestion.importer.MultiThreadImporterService] [Begin to flush ingestion pipeline, id=5956090115059980284]

[2015-02-18 16:32:52.818+0000] [LogImporterService.Processor-thread-30/127.0.0.1 INFO] [com.vmware.loginsight.ingestion.importer.MultiThreadImporterService] [Flush ingestion pipeline succeeded (id=5956090115059980284)]

[2015-02-18 16:32:52.877+0000] [ScheduledPluginServiceThread/127.0.0.1 INFO] [com.vmware.loginsight.web.background.ScheduledPluginService] [vCenter task and event collection successful for host itnapvs01.q8int.com]

[2015-02-18 16:32:52.877+0000] [ScheduledPluginServiceThread/127.0.0.1 INFO] [com.vmware.loginsight.web.background.ScheduledPluginService] [Executing VimEventMonitor with the following command: /usr/lib/loginsight/application/3rd_party/bin/java -cp /usr/lib/loginsight/application/etc/plugins/vsphere/* -Xmx1024M com.vmware.loginsight.vsphere.events.VimEventMonitor --single-run --host localhost --port 9240 --url itnapis10.q8int.com --username ******************* --encrypted-password <redacted> --metadata-dir /storage/core/loginsight/var/plugins/vsphere]

[2015-02-18 16:32:52.952+0000] [Thread-620/127.0.0.1 WARN] [com.vmware.loginsight.commons.executor.ProcessExecutor] [ [[/usr/lib/loginsight/application/3rd_party/bin/java, -cp, /usr/lib/loginsight/application/etc/plugins/vsphere/*, -Xmx1024M, com.vmware.loginsight.vsphere.events.VimEventMonitor, --single-run, --host, localhost, --port, 9240, --url, itnapis10.q8int.com, --username, *******************, --encrypted-password, *******************, --metadata-dir, /storage/core/loginsight/var/plugins/vsphere]] log4j:WARN No appenders could be found for logger (com.vmware.loginsight.vsphere.events.VimEventMonitor).]

[2015-02-18 16:32:52.952+0000] [Thread-620/127.0.0.1 WARN] [com.vmware.loginsight.commons.executor.ProcessExecutor] [ [[/usr/lib/loginsight/application/3rd_party/bin/java, -cp, /usr/lib/loginsight/application/etc/plugins/vsphere/*, -Xmx1024M, com.vmware.loginsight.vsphere.events.VimEventMonitor, --single-run, --host, localhost, --port, 9240, --url, itnapis10.q8int.com, --username, *******************, --encrypted-password, *******************, --metadata-dir, /storage/core/loginsight/var/plugins/vsphere]] log4j:WARN Please initialize the log4j system properly.]

[2015-02-18 16:32:52.952+0000] [Thread-620/127.0.0.1 WARN] [com.vmware.loginsight.commons.executor.ProcessExecutor] [ [[/usr/lib/loginsight/application/3rd_party/bin/java, -cp, /usr/lib/loginsight/application/etc/plugins/vsphere/*, -Xmx1024M, com.vmware.loginsight.vsphere.events.VimEventMonitor, --single-run, --host, localhost, --port, 9240, --url, itnapis10.q8int.com, --username, *******************, --encrypted-password, *******************, --metadata-dir, /storage/core/loginsight/var/plugins/vsphere]] log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.]

[2015-02-18 16:32:54.370+0000] [Indexer-1-Commit-Timer/127.0.0.1 INFO] [com.vmware.loginsight.indexing.Indexer] [Added 1083 messages to index.]

[2015-02-18 16:32:54.894+0000] [Indexer-1-Commit-Timer/10.160.30.212 INFO] [com.vmware.loginsight.indexing.Indexer] [Added 1071 messages to index.]

[2015-02-18 16:32:56.890+0000] [Indexer-2-Commit-Timer/127.0.0.1 INFO] [com.vmware.loginsight.indexing.Indexer] [Added 1010 messages to index.]

vcenter_operations.log

[2015-02-18 16:32:42.473+0000] [Thread-36/127.0.0.1 INFO] [com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest] [Open connection to URL https://itromvrops01.q8int.com/suite-api/api/resources/58c4f84c-b0a6-4157-b1e3-040317a42ab9/properti...]

[2015-02-18 16:32:43.726+0000] [Thread-36/127.0.0.1 INFO] [com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest] [Open connection to URL https://itromvrops01.q8int.com/suite-api/api/resources/58d647d4-f824-46b4-8f7f-de32b0566b3c/properti...]

[2015-02-18 16:32:44.273+0000] [http-443-7/127.0.0.1 INFO] [com.vmware.loginsight.commons.vcops.VcopsHttpPostSender] [Wed Feb 18 16:32:44 UTC 2015: Creating new VcopsHttpPostSender to send to server https://itromvrops01.q8int.com:443]

[2015-02-18 16:32:45.560+0000] [Thread-36/127.0.0.1 INFO] [com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest] [Open connection to URL https://itromvrops01.q8int.com/suite-api/api/resources/58e63d9a-a6e9-4fa4-8799-67eb9a10c0ed/properti...]

[2015-02-18 16:32:46.068+0000] [http-443-7/127.0.0.1 INFO] [com.vmware.loginsight.commons.vcops.VcopsHttpPostSender] [Post (action%3DlookupResource%26resourceName%3Dregex%253A.*%255BiI%255D%255BtT%255D%255BrR%255D%255BoO%255D%255BmM%255D%255BiI%255D%255BsS%255D%255B11%255D%255B00%255D.*) sent successfully to vcops.]

[2015-02-18 16:32:46.992+0000] [Thread-36/127.0.0.1 INFO] [com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest] [Open connection to URL https://itromvrops01.q8int.com/suite-api/api/resources/58f17b6d-9f33-44c3-ae18-2be284658d0c/properti...]

[2015-02-18 16:32:47.253+0000] [http-443-7/127.0.0.1 INFO] [com.vmware.loginsight.commons.vcops.VcopsHttpPostSender] [Post (action%3DgetRelationships%26resourceName%3DpoweredOn%253Aall%26getChildren%3Dtrue%26getParents%3Dfalse) sent successfully to vcops.]

[2015-02-18 16:32:48.890+0000] [Thread-36/127.0.0.1 INFO] [com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest] [Open connection to URL https://itromvrops01.q8int.com/suite-api/api/resources/58f6a457-a0a4-4bac-85c5-1a114e3d9466/properti...]

[2015-02-18 16:32:49.595+0000] [http-443-7/127.0.0.1 INFO] [com.vmware.loginsight.commons.vcops.VcopsHttpPostSender] [Wed Feb 18 16:32:49 UTC 2015: Creating new VcopsHttpPostSender to send to server https://itromvrops01.q8int.com:443]

[2015-02-18 16:32:50.418+0000] [Thread-36/127.0.0.1 INFO] [com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest] [Open connection to URL https://itromvrops01.q8int.com/suite-api/api/resources/591f26d7-b4f6-481a-b941-2ee2bbe6158e/properti...]

[2015-02-18 16:32:50.856+0000] [http-443-7/127.0.0.1 INFO] [com.vmware.loginsight.commons.vcops.VcopsHttpPostSender] [Post (action%3DlookupResource%26resourceName%3Dregex%253A.*%255BiI%255D%255BtT%255D%255BrR%255D%255BoO%255D%255BmM%255D%255BiI%255D%255BsS%255D%255B11%255D%255B00%255D.*) sent successfully to vcops.]

[2015-02-18 16:32:51.751+0000] [Thread-36/127.0.0.1 INFO] [com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest] [Open connection to URL https://itromvrops01.q8int.com/suite-api/api/resources/5957cb74-70ad-4f75-ab4b-21238479e06d/properti...]

[2015-02-18 16:32:53.464+0000] [Thread-36/127.0.0.1 INFO] [com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest] [Open connection to URL https://itromvrops01.q8int.com/suite-api/api/resources/596da3a1-6c28-4871-b2d1-d1e7880179e1/properti...]

[2015-02-18 16:32:54.118+0000] [http-443-7/127.0.0.1 INFO] [com.vmware.loginsight.commons.vcops.VcopsHttpPostSender] [Wed Feb 18 16:32:54 UTC 2015: Creating new VcopsHttpPostSender to send to server https://itromvrops01.q8int.com:443]

[2015-02-18 16:32:54.740+0000] [Thread-36/127.0.0.1 INFO] [com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest] [Open connection to URL https://itromvrops01.q8int.com/suite-api/api/resources/596fb875-e058-4a8b-814c-a9c9bb5b4c82/properti...]

[2015-02-18 16:32:55.286+0000] [http-443-7/127.0.0.1 INFO] [com.vmware.loginsight.commons.vcops.VcopsHttpPostSender] [Post (action%3DlookupResource%26resourceName%3Dregex%253A.*%255BiI%255D%255BtT%255D%255BrR%255D%255BoO%255D%255BmM%255D%255BiI%255D%255BsS%255D%255B11%255D%255B00%255D.*) sent successfully to vcops.]

[2015-02-18 16:32:56.405+0000] [Thread-36/127.0.0.1 INFO] [com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest] [Open connection to URL https://itromvrops01.q8int.com/suite-api/api/resources/597c6146-4511-4f45-813b-eab30cd08a59/properti...]

[2015-02-18 16:32:57.726+0000] [Thread-36/127.0.0.1 INFO] [com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest] [Open connection to URL https://itromvrops01.q8int.com/suite-api/api/resources/599f5b01-367b-45fd-ba15-91a8cc3fb347/properti...]

[2015-02-18 16:32:59.376+0000] [Thread-36/127.0.0.1 INFO] [com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest] [Open connection to URL https://itromvrops01.q8int.com/suite-api/api/resources/59a58f34-f4f2-44ea-be63-5df7f838b45e/properti...]

^C

[sflanders]

The connection test failure you see in the UI should also be in the logs and I do not see it from what was posted.

The resources screenshot shows a value entered into the search bar for all resources. If you remove the entry do you see anything displayed?

I think a full support bundle is going to be necessary to see what is going on -- can you open a SR as well so GSS can analyze the support bundle.

[fduranti]

The first logs I've posted was taken during a test so the test itself seems to not appearing in those logs.

If I remove the entry I don't see anything ... I've tried doing a search after taking out the entry nothing appears.

Today or tomorrow I'll also install a second worked node just to be in a supported configuration.

I've done another "test connection" and what i did get is nothing in the runtime.log and this in the vcenter_operations.log

[2015-02-18 17:11:51.364+0000] [Thread-36/127.0.0.1 INFO] [com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest] [Open connection to URL https://itromvrops01.q8int.com/suite-api/api/resources/0b396a70-a36b-4722-a53d-9f7633026e67/properti...]

[2015-02-18 17:11:52.767+0000] [Thread-36/127.0.0.1 INFO] [com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest] [Open connection to URL https://itromvrops01.q8int.com/suite-api/api/resources/0b39cfe1-2d02-4fec-a1b4-535c22c3e75c/properti...]

[2015-02-18 17:11:54.252+0000] [Thread-36/127.0.0.1 INFO] [com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest] [Open connection to URL https://itromvrops01.q8int.com/suite-api/api/resources/0b5777a6-b9ab-4597-a027-1af6a07901e8/properti...]

[2015-02-18 17:11:55.405+0000] [http-443-2/127.0.0.1 INFO] [com.vmware.loginsight.commons.vcops.VcopsHttpPostSender] [Wed Feb 18 17:11:55 UTC 2015: Creating new VcopsHttpPostSender to send to server https://itromvrops01.q8int.com:443]

[2015-02-18 17:11:55.405+0000] [http-443-2/127.0.0.1 INFO] [com.vmware.loginsight.commons.vcops.VcopsHttpPostSender] [querying using vcops http post adapter with body: action=lookupResource&resourceName=regex%3A.*.*]

[2015-02-18 17:11:56.078+0000] [Thread-36/127.0.0.1 INFO] [com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest] [Open connection to URL https://itromvrops01.q8int.com/suite-api/api/resources/0b5f64b2-2fb0-4393-81a8-6062a899e5fb/properti...]

[2015-02-18 17:11:56.145+0000] [http-443-2/127.0.0.1 INFO] [com.vmware.loginsight.commons.vcops.VcopsHttpPostSender] [Post (action%3DlookupResource%26resourceName%3Dregex%253A.*.*) sent successfully to vcops.]

[2015-02-18 17:11:57.533+0000] [Thread-36/127.0.0.1 INFO] [com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest] [Open connection to URL https://itromvrops01.q8int.com/suite-api/api/resources/0b7d2a89-08b1-4bb0-83fc-ad5f9ed0f1e0/properti...]

[2015-02-18 17:11:59.062+0000] [Thread-36/127.0.0.1 INFO] [com.vmware.loginsight.vcopssuite.VcopsSuiteApiRequest] [Open connection to URL https://itromvrops01.q8int.com/suite-api/api/resources/0b7df702-21e8-4a15-b6f2-86b1f3104363/properti...

[fduranti]

I've installed the 3rd node for LI (2nd worker), opened a support call (15607834302)  and uploaded a Support Bundle from master node.

[fduranti]

An update .... probably there was a problem on vrops (it seems he has some).

During the evening I got some errors on vrops... logging on the admin page I saw he was trying to reconfigure and waiting for analytics to go up... HA was not in a degraded state but there was no way to login to the vrops server. I've tried to put the cluster down and after some time the cluster failed completely.

On the primary node the /storage/log disk was full. But this was only happening on master, I was expecting to switch to the replica and get one node down not all cluster failing.

Well I've moved the /storage/log and relinked /data/vcops symlinks as described on Release notes and after I was able to stop correctly the cluster and rebooted/restarted the nodes and the cluster itself.

At this point (after about 30 minutes) LI integration started to work again, now I can test the connection and configure alerts.

I think some strange behaviour is going on with vrops (I also had to redescribe and reinstall all licenses after the restart but it seems this is some kind of know issue).

I'll wait tomorrow to close the case if all is still working correctly.

Thanks for the help.