Default Values in vmmark 1.0

[polysulfide]

This is my first run a a full tile in vmmark. I'm getting the infamous start-time error in my results. I verified that all workloads completed successfully and have a wrf file.

Opening the webserver0.wrf file I see these errors:

2008-03-13 00:46:14:734 Configuration: You changed the value of (or provided multiple values for) the configuration variable TEST_TYPE

2008-03-13 00:46:14:734 Configuration: You changed the value of (or provided multiple values for) the configuration variable BESIM_INIT_SCRIPT

2008-03-13 00:46:14:734 Configuration: You changed the value of (or provided multiple values for) the configuration variable SMARTY_DIR

2008-03-13 00:46:14:734 Configuration: You changed the value of (or provided multiple values for) the configuration variable SMARTY_ECOMMERCE_DIR

2008-03-13 00:46:14:734 Configuration: You changed the value of (or provided multiple values for) the configuration variable KILL_CLIENT

2008-03-13 00:46:14:734 Configuration: You changed the value of (or provided multiple values for) the configuration variable INTERVAL_POLL_VALUES

2008-03-13 00:46:14:734 Configuration: You changed the value of (or provided multiple values for) the configuration variable POLL_CLIENTS

2008-03-13 00:46:14:734 Configuration: You changed the value of (or provided multiple values for) the configuration variable BEAT_INTERVAL

2008-03-13 00:46:14:734 Configuration: You changed the value of (or provided multiple values for) the configuration variable ITERATIONS

2008-03-13 00:46:14:734 Configuration: You changed the value of (or provided multiple values for) the configuration variable RAMPUP_SECONDS

2008-03-13 00:46:14:734 Configuration: You changed the value of (or provided multiple values for) the configuration variable SIMULTANEOUS_SESSIONS

2008-03-13 00:46:14:734 Configuration: You changed the value of (or provided multiple values for) the configuration variable HIGH_SPEED_DATA_RATE

2008-03-13 00:46:14:734 Configuration: You changed the value of (or provided multiple values for) the configuration variable WARMUP_SECONDS

2008-03-13 00:46:14:734 Configuration: You changed the value of (or provided multiple values for) the configuration variable THREAD_RAMPUP_SECONDS

2008-03-13 00:46:14:734 Configuration: You changed the value of (or provided multiple values for) the configuration variable THREAD_RAMPDOWN_SECONDS

2008-03-13 00:46:14:734 Configuration: You changed the value of (or provided multiple values for) the configuration variable RAMPDOWN_SECONDS

2008-03-13 00:46:14:734 Configuration: You changed the value of (or provided multiple values for) the configuration variable RUN_SECONDS

2008-03-13 00:46:14:734 Configuration: You changed the value of (or provided multiple values for) the configuration variable MAX_OVERTHINK_TIME

2008-03-13 00:46:14:734 Configuration: You changed the value of (or provided multiple values for) the configuration variable CLIENTS

2008-03-13 00:46:14:734 Configuration: You changed the value of (or provided multiple values for) the configuration variable BESIM_SERVER

2008-03-13 00:46:14:734 Configuration: You changed the value of (or provided multiple values for) the configuration variable WEB_SERVER

2008-03-13 00:46:14:766 Configuration: You changed the value of (or provided multiple values for) the configuration variable PADDING_DIR

2008-03-13 00:46:14:766 Configuration: You changed the value of (or provided multiple values for) the configuration variable LG_BUF_SIZE

2008-03-13 00:46:14:766 Configuration: You changed the value of (or provided multiple values for) the configuration variable THINK_TIME

2008-03-13 00:46:14:766 Configuration: You changed the value of (or provided multiple values for) the configuration variable THINK_MAX

2008-03-13 00:46:14:797 Thu Mar 13 00:46:14 GMT 2008

2008-03-13 00:46:14:797 Validator: WARMUP_SECONDS value is: 30; should be 300

2008-03-13 00:46:14:797 Validator: BEAT_INTERVAL value is: 60; should be 10

2008-03-13 00:46:14:797 Validator: RAMPDOWN_SECONDS value is: 30; should be 300

2008-03-13 00:46:14:797 Validator: MAX_OVERTHINK_TIME value is: 121444; should be 20000

2008-03-13 00:46:14:797 Validator: THREAD_RAMPDOWN_SECONDS value is: 30; should be 180

2008-03-13 00:46:14:797 Validator: THINK_MAX value is: 6; should be 150

2008-03-13 00:46:14:797 Validator: RUN_SECONDS value is: 10800; should be 1800

2008-03-13 00:46:14:797 Validator: THREAD_RAMPUP_SECONDS value is: 100; should be 180

2008-03-13 00:46:14:797 Validator: ITERATIONS value is: 1; should be 3

2008-03-13 00:46:14:797 Validator: HIGH_SPEED_DATA_RATE value is: 200000; should be 100000

2008-03-13 00:46:14:797 Validator: THINK_TIME value is: 2; should be 10

2008-03-13 00:46:14:797 Validator: RAMPUP_SECONDS value is: 60; should be 300

2008-03-13 00:46:14:797 Validator: Invalid configuration.

2008-03-13 00:46:14:797 Warning! This is a non-compliant benchmark run.

All of these settings are default in my vmmark.config file and the defaults seem to be the erroneous values.

I also see a warning about unspecified database type, etc. in the database wrf file.

If I cleanse the errors and warnings from the wrf files, I still an not able to generate a score.

Should the webserver values be changed in order to be compliant?

Does the verbosity of DEBUG=1 make it so the tilescore2html can't parse the wrf file?

Any suggestions or sanity to offer? I'm going to turn off debug and run again.

http://communities.vmware.com/blogs/polysulfide

[psmith2006]

Comments below.

2008-03-13 00:46:14:797 Validator: ERROR WARMUP_SECONDS value is: 30; should be 300

2008-03-13 00:46:14:797 Validator: ERROR BEAT_INTERVAL value is: 60; should be 10

2008-03-13 00:46:14:797 Validator: ERROR RAMPDOWN_SECONDS value is: 30; should be 300

2008-03-13 00:46:14:797 Validator: ERROR MAX_OVERTHINK_TIME value is: 121444; should be 20000

2008-03-13 00:46:14:797 Validator: ERROR THREAD_RAMPDOWN_SECONDS value is: 30; should be 180

2008-03-13 00:46:14:797 Validator: ERROR THINK_MAX value is: 6; should be 150

2008-03-13 00:46:14:797 Validator: ERROR RUN_SECONDS value is: 10800; should be 1800

2008-03-13 00:46:14:797 Validator: ERROR THREAD_RAMPUP_SECONDS value is: 100; should be 180

2008-03-13 00:46:14:797 Validator: ERROR ITERATIONS value is: 1; should be 3

2008-03-13 00:46:14:797 Validator: ERROR HIGH_SPEED_DATA_RATE value is: 200000; should be 100000

2008-03-13 00:46:14:797 Validator: ERROR THINK_TIME value is: 2; should be 10

2008-03-13 00:46:14:797 Validator: ERROR RAMPUP_SECONDS value is: 60; should be 300

2008-03-13 00:46:14:797 Validator: ERROR Invalid configuration.

2008-03-13 00:46:14:797 Warning! This is a non-compliant benchmark run.

All of these settings are default in my vmmark.config file and the defaults seem to be the erroneous values.

The VMmark webserver workload is based on the SPECweb workload but it overrides several of the default parameters. For VMmark this is OK.

What version of SPECweb are you using. If you've upgraded to v 1.20 then you'll need to pick up the updated tilescore scripts posted previously.

I also see a warning about unspecified database type, etc. in the database wrf file.

Would need to see the file to figure out what you have

If I cleanse the errors and warnings from the wrf files, I still an not able to generate a score.

The tilescore scripts don't use that information

Should the webserver values be changed in order to be compliant?

No.

Does the verbosity of DEBUG=1 make it so the tilescore2html can't parse the wrf file?

No.

Any suggestions or sanity to offer? I'm going to turn off debug and run again.

Yes, set DEBUGFLAG=1 in the VMMARK.CONFIG file and rerun, then if its still not working you can send a zip of Results_<datastamp> directory to vmmark-info

Also if you are in the US and have not installed:

KB933360 patch for all clients and Windows VMs

then you may be having time sync problems.

[jamesz08]

You are not getting any results in your mailserver file (they show all 0). That is what is causing the failure of the scoring script.

There should be a file called "mailservergetstats_0.stdout" in c:\ of your client. Check to see if there are any error messages in there. Also open loadsim manaually on the client and make sure that it is able to connect to the domain and see the mailstore.

[polysulfide]

The whole mailservergetstats_0.stdout file is kilobytes of spiraling characters followed by completed successfully.

I'm able to connect fine with loadsim. I did notice that it takes a couple of hours for the mailserver process to die down in stax after the other tests are finished. Do you think I should purge and re-initialize the information store?

........................

[/][-][\][|][/][-][\][|][/][-][\][|][/][-][\][|][/][-][\][|][/][-][\][|][/][-][\][|][/][-][\][|][/][-][\][|][/][-][\][|][/][-][\][|][/][-][\][|][/][-][\][|]

Exiting please wait...

The command completed successfully.

[/][-][\][|][/][-][\][|][/][-][\][|][/][-][\][|][/][-][\][|][/][-][\][|][/][-][\][|][/][-][\][|][/][-][\][|][/][-][\][|][/][-][\][|][/][-][\][|][/][-][\][|]

...........................

[jamesz08 · Accepted solution]

That is correct. Can you run a loadsim test manually? Launch loadsim, open the vmmark.sim file and select Run > Run Simulation.

You do have both a vmmark.sim and vmmarktemplate.sim file?

[polysulfide]

There was something whacky going on with my DNS on the email server. The zone was missing and it was only using cached data. After re-creating the zone, it came back fully intact. That was likely the cause. My tile0 email server isn't pristine and isn't built the same as my other tiles. I'm going to recreate it from the same tile templates I'm using now and reconfigure the loadsim.

I'll run it again and see how it goes. I'm curious what the vmmarktemplate.sim file is used for. I do have it but I assumed it was just that; a template for ease of recreating things later or some such.

[polysulfide]

A bit off topic but....

I'm testing VMmark in my lab now but I'm building a prod environment on 3x HP DL380 G5 with 2Gbps Fiber-attached HP EVA SAN.

Can you hazard a guess how many tiles I will need to tax that environment?

[jamesz08]

When the test runs the harness reads in the vmmarktemplate.sim file and writes out to the vmmark.sim file modifying the runtime depending on what the RUNTIME and TILEDELAY variables are set to.

[Shafay2000]

Yes, set DEBUGFLAG=1 in the VMMARK.CONFIG file and rerun, then if its still not working you can send a zip of Results_ directory to vmmark-info

Also if you are in the US and have not installed:

KB933360 patch for all clients and Windows VMs

then you may be having time sync problems.

Shafay Latif

VMware Infrastructure Architect

MTS Systems Corp.

[polysulfide]

Okay... nit-picky minutiae,

When I start loadsim, it automatically loads the most recently saved .sim file. vmmark.sim and vmmarktemplate.sim are identical to begin with but if the vmmark.sim file is changed mid-run, does it matter which file I saved last? Does that batching manage that? I know its a silly question but I like to understand as much of what is going on as I can.

Also, if vmmark.sim is changed mid-run do I need to copy it back from vmmarktemplate.sim before the next run?

Thanks,

[jamesz08]

You only need to setup the .sim files once, no need to copy them over again after runs. The harness specifies the file to open when it launches loadsim so you can ignore the fact that it opens the most recently saved file when launching manually.

[psmith2006]

The vmmarktemplate.sim file to copied to vmmark.sim at the begining of the test by the harness.

These files contain unique encoded info for the particular mailserver they were set up for so vmmarktemplate.sim is used to restore the vmmark.sim file which the harness can use string matching to patch in an updated runtime.