1 Reply Latest reply on Mar 16, 2017 11:11 AM by solgaeDK

    NFS 4.1 tests in Storage Certification 6.0 fails on any tests involving VM

    solgaeDK Enthusiast

      Hello,

       

      I have been running some NFS 4.1 related tests on our test bed, and am getting an exception that is preventing those tests to perform properly.

       

      Some of the tests affected are: NFS41_VmRebootSnapshot_AuthSys, NFS41_VMRebootSuspendResume_AuthSys, NFS41_VMClone_Authsys

       

      Whenever those tests run, it gets to the point where a new VM is successfully cloned to the NFS 4.1 datastore and powers on, waits for VMware Tools heartbeat, and then tries to trigger the IO process. Then it logs an exception like this:

       

      [Mar 14 2017 18:11:11 : NFS41LAUNC] [0] INFO:  ######  Waiting for IO tools to run #######

       

      [Mar 14 2017 18:11:11 : NFS41LAUNC] [0] DEBUG: 2017-03-14 18:11:11,047 DEBUG h.d.n.s.VMRebootSuspendResume [test:86] [main] - Total VM's are: 1

      [Mar 14 2017 18:11:11 : NFS41LAUNC] [0] DEBUG: 2017-03-14 18:11:11,160 ERROR c.v.v.e.OutcomePrinter [afterInvocation:40] [main] - exception thrown

      [Mar 14 2017 18:11:11 : NFS41LAUNC] [0] DEBUG: java.lang.IllegalAccessError: tried to access method com.google.common.collect.ArrayListMultimap.<init>()V from class com.vmware.vcqa.vim.vm.ioStress.VmIoUtil

      [Mar 14 2017 18:11:11 : NFS41LAUNC] [0] DEBUG:  at com.vmware.vcqa.vim.vm.ioStress.VmIoUtil.<init>(VmIoUtil.java:188) [vcqa.jar:na]

      [Mar 14 2017 18:11:11 : NFS41LAUNC] [0] DEBUG:  at com.vmware.vcqa.vim.vm.ioStress.VmIoUtil.<init>(VmIoUtil.java:181) [vcqa.jar:na]

      [Mar 14 2017 18:11:11 : NFS41LAUNC] [0] DEBUG:  at hostconf.datastoresystem.nfs.nfsextensions.NfsExtensionHelper.runIOToolsParallel(NfsExtensionHelper.java:889) [vctests.jar:na]

      [Mar 14 2017 18:11:11 : NFS41LAUNC] [0] DEBUG:  at hostconf.datastoresystem.nfs.sanity.VMRebootSuspendResume.test(VMRebootSuspendResume.java:87) [vctests.jar:na]

      [Mar 14 2017 18:11:11 : NFS41LAUNC] [0] DEBUG:  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [na:1.7.0_111]

      [Mar 14 2017 18:11:11 : NFS41LAUNC] [0] DEBUG:  at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) [na:1.7.0_111]

      [Mar 14 2017 18:11:11 : NFS41LAUNC] [0] DEBUG:  at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) [na:1.7.0_111]

      [Mar 14 2017 18:11:11 : NFS41LAUNC] [0] DEBUG:  at java.lang.reflect.Method.invoke(Unknown Source) [na:1.7.0_111]

      [Mar 14 2017 18:11:11 : NFS41LAUNC] [0] DEBUG:  at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:80) [testng-6.8-nobsh-guice.jar:6.8-201210030754]

      [Mar 14 2017 18:11:11 : NFS41LAUNC] [0] DEBUG:  at org.testng.internal.Invoker.invokeMethod(Invoker.java:714) [testng-6.8-nobsh-guice.jar:6.8-201210030754]

      [Mar 14 2017 18:11:11 : NFS41LAUNC] [0] DEBUG:  at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:901) [testng-6.8-nobsh-guice.jar:6.8-201210030754]

      [Mar 14 2017 18:11:11 : NFS41LAUNC] [0] DEBUG:  at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1231) [testng-6.8-nobsh-guice.jar:6.8-201210030754]

      [Mar 14 2017 18:11:11 : NFS41LAUNC] [0] DEBUG:  at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:127) [testng-6.8-nobsh-guice.jar:6.8-201210030754]

      [Mar 14 2017 18:11:11 : NFS41LAUNC] [0] DEBUG:  at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:111) [testng-6.8-nobsh-guice.jar:6.8-201210030754]

      [Mar 14 2017 18:11:11 : NFS41LAUNC] [0] DEBUG:  at org.testng.TestRunner.privateRun(TestRunner.java:767) [testng-6.8-nobsh-guice.jar:6.8-201210030754]

      [Mar 14 2017 18:11:11 : NFS41LAUNC] [0] DEBUG:  at org.testng.TestRunner.run(TestRunner.java:617) [testng-6.8-nobsh-guice.jar:6.8-201210030754]

      [Mar 14 2017 18:11:11 : NFS41LAUNC] [0] DEBUG:  at org.testng.SuiteRunner.runTest(SuiteRunner.java:334) [testng-6.8-nobsh-guice.jar:6.8-201210030754]

      [Mar 14 2017 18:11:11 : NFS41LAUNC] [0] DEBUG:  at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:329) [testng-6.8-nobsh-guice.jar:6.8-201210030754]

      [Mar 14 2017 18:11:11 : NFS41LAUNC] [0] DEBUG:  at org.testng.SuiteRunner.privateRun(SuiteRunner.java:291) [testng-6.8-nobsh-guice.jar:6.8-201210030754]

      [Mar 14 2017 18:11:11 : NFS41LAUNC] [0] DEBUG:  at org.testng.SuiteRunner.run(SuiteRunner.java:240) [testng-6.8-nobsh-guice.jar:6.8-201210030754]

      [Mar 14 2017 18:11:11 : NFS41LAUNC] [0] DEBUG:  at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52) [testng-6.8-nobsh-guice.jar:6.8-201210030754]

      [Mar 14 2017 18:11:11 : NFS41LAUNC] [0] DEBUG:  at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86) [testng-6.8-nobsh-guice.jar:6.8-201210030754]

      [Mar 14 2017 18:11:11 : NFS41LAUNC] [0] DEBUG:  at org.testng.TestNG.runSuitesSequentially(TestNG.java:1198) [testng-6.8-nobsh-guice.jar:6.8-201210030754]

      [Mar 14 2017 18:11:11 : NFS41LAUNC] [0] DEBUG:  at org.testng.TestNG.runSuitesLocally(TestNG.java:1123) [testng-6.8-nobsh-guice.jar:6.8-201210030754]

      [Mar 14 2017 18:11:11 : NFS41LAUNC] [0] DEBUG:  at org.testng.TestNG.run(TestNG.java:1031) [testng-6.8-nobsh-guice.jar:6.8-201210030754]

      [Mar 14 2017 18:11:11 : NFS41LAUNC] [0] DEBUG:  at org.testng.TestNG.privateMain(TestNG.java:1338) [testng-6.8-nobsh-guice.jar:6.8-201210030754]

      [Mar 14 2017 18:11:11 : NFS41LAUNC] [0] DEBUG:  at org.testng.TestNG.main(TestNG.java:1307) [testng-6.8-nobsh-guice.jar:6.8-201210030754]

      [Mar 14 2017 18:11:11 : NFS41LAUNC] [0] DEBUG: 2017-03-14 18:11:11,166 INFO  c.v.v.e.OutcomePrinter [afterInvocation:47] [main] - OUTCOME:FAIL

      [Mar 14 2017 18:11:11 : NFS41LAUNC] [0] INFO:  ######  OUTCOME:FAIL #######

       

      I am currently running VMware Workbench 3.5.7 with Storage Cert 6.0 latest build available installed. The test bed is using two ESXi 6.0 GA build hosts, added to vCenter and Workbench using IP address per the Storage Cert 6.0 release notes.

       

      Anyone else ran into this problem?

        • 1. Re: NFS 4.1 tests in Storage Certification 6.0 fails on any tests involving VM
          solgaeDK Enthusiast

          I tried some of the earlier Storage Cert 6.0 builds, and from what I can tell, I'm able to run the tests involving VMs successfully. Looking at the logs, however, it seems the test tries to trigger the IO tools (dt) on the VM and fails, but the test proceeds anyway. From the error message, it seems like it failed on the guest credentials.

           

          Has anyone successfully ran thru the NFS 4.1 tests, and if so, do you have any suggestions on the setup?

           

          UPDATE: so it turns out, the Workbench 3.5.7 build has issues running these tests. Moving to Workbench 3.5.3 with the latest Storage Cert 6.0 build will allow the tests to run without failing in the middle, but the problem with the IO tool not actually firing (or at least it seems like according to logs - the test goes by too quickly for me to find out by logging in to the VM and checking the process) still remains.