VMware Performance Community
weiweiliang
Contributor
Contributor

ds2webdriver.exe stops working if run from STAX, but works fine if run separately in a cmd window

Hi,

I'm  having an issue with running VMMark 2.1. Each time I launch the STAX  job, ds2webdriver.exe stops working, but if I run the command line  "ds2webdriver.exe --target=DS2WEBA0" separately in a cmd window, it  works fine. Looks likes an issue with STAF and STAX, so I reinstalled  both and reconfigured STAF.cfg according to the benchmarking guide, but  it still doesn't work.

I  've gone through all the threads I can find about this topic (e.g  fixing /etc/hosts file), but got no luck in fixing this problem. 

PLEASE HELP! Any suggestion is recommended. Thanks.

STAF version: 3.4.10

STAX version: 3.4.5

Log from DS2WEBA0

<!--
* DVD Store Common Include PHP Page - dscommon.inc
*
* Copyright (C) 2005 Dell, Inc. <dave_jaffe@dell.com> and <todd_muirhead@dell.com>
*
* Used by DVD Store php pages
*
* Last Updated 5/13/05
*
*  This program is free software; you can redistribute it and/or modify
*  it under the terms of the GNU General Public License as published by
*  the Free Software Foundation; either version 2 of the License, or
*  (at your option) any later version.
*
*  This program is distributed in the hope that it will be useful,
*  but WITHOUT ANY WARRANTY; without even the implied warranty of
*  MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
*  GNU General Public License for more details.
*
*  You should have received a copy of the GNU General Public License
*  along with this program; if not, write to the Free Software
*  Foundation, Inc., 59 Temple Place, Suite 330, Boston, MA  02111-1307  USA
-->


<HTML>
<HEAD><TITLE>DVD Store Login Page</TITLE></HEAD>
<BODY>
<FONT FACE="Arial" COLOR="#0000FF">
<H1 ALIGN=CENTER>DVD Store</H1>
Can't connect to MySQL server on 'DS2-DB' (4)

Thread 5: Error in Login for User user23891095, thread exiting
Thread 9: Login: Username/password incorrect; str_acc length: 1116  str_acc:


<!--
* DVD Store Common Include PHP Page - dscommon.inc
*
* Copyright (C) 2005 Dell, Inc. <dave_jaffe@dell.com> and <todd_muirhead@dell.com>
*
* Used by DVD Store php pages
*
* Last Updated 5/13/05
*
*  This program is free software; you can redistribute it and/or modify
*  it under the terms of the GNU General Public License as published by
*  the Free Software Foundation; either version 2 of the License, or
*  (at your option) any later version.
*
*  This program is distributed in the hope that it will be useful,
*  but WITHOUT ANY WARRANTY; without even the implied warranty of
*  MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
*  GNU General Public License for more details.
*
*  You should have received a copy of the GNU General Public License
*  along with this program; if not, write to the Free Software
*  Foundation, Inc., 59 Temple Place, Suite 330, Boston, MA  02111-1307  USA
-->


<HTML>
<HEAD><TITLE>DVD Store Login Page</TITLE></HEAD>
<BODY>
<FONT FACE="Arial" COLOR="#0000FF">
<H1 ALIGN=CENTER>DVD Store</H1>
Can't connect to MySQL server on 'DS2-DB' (4)

Thread 9: Error in Login for User user6002984, thread exiting

et=    70.0 n_overall=119 opm=101 rt_tot_lastn_max_msec=55469  rt_tot_avg_msec=1830 rt_tot_sampled=-2147483648 rollbacks: n=2 %=  1.7
threads[5].ThreadState= Stopped
threads[9].ThreadState= Stopped
Error  in parsing neworderid: Input string was not in a correct format.;  ind_b= 14  ind_e= 81  str_acc[]= Store Common Include PHP Page -  dscommon.inc
*
* Copyright (C) 2005 Dell, Inc.
Thread 0: Error in Purchase, thread exiting

et=    80.0 n_overall=119 opm=89 rt_tot_lastn_max_msec=55469  rt_tot_avg_msec=1830 rt_tot_sampled=-2147483648 rollbacks: n=2 %=  1.7
threads[0].ThreadState= Stopped
threads[5].ThreadState= Stopped
threads[9].ThreadState= Stopped
Thread 3:  error in parsing response from browse request
Thread 3: Error in Browse by title, thread exiting

Reply
0 Kudos
43 Replies
jpschnee
VMware Employee
VMware Employee

SSH into  ds2weba0.  Once there run "ping ds2-db".  What does it return.

What is in the restore file for your ds2db0 "ConfighDS2DB_0.txt?  This is found in your latest results folder.

-Joshua
Reply
0 Kudos
weiweiliang
Contributor
Contributor

Thanks for your reply.

1) From ds2webA0, I can ping ds2-db without problem.

2) ConfigDS2DB_0.txt shows this:

Prepping DS2DB
Shutting down service MySQL ..done
Starting service MySQL ..done
Reloading DS2 DB's database
DS2DB Reload Completed
Fri Jul 27 14:57:56 PDT 2012

Reply
0 Kudos
jpschnee
VMware Employee
VMware Employee

Could you also check that mysql is actually able to restart after the restore process?  From the output you provided, it seems that it's unable to connect to it. 

-Joshua
Reply
0 Kudos
weiweiliang
Contributor
Contributor

Yes, I tried the following two commands on DS2DB0, both ran ok.

/etc/init.d/mysql stop

/etc/init.d/mysql start

Reply
0 Kudos
weiweiliang
Contributor
Contributor

Also, one thing to note is that after database is restored on DS2DB0, although connectting to mysql within STAX job failed, I could run this command successfully: C:\vclient0\ds2webA>ds2webdriver.exe --target=ds2weba0

Log is attached.

Reply
0 Kudos
jpschnee
VMware Employee
VMware Employee

Well your command isn't exactly what is going to be run by the harness.  The main thing being the size of the db.

Can you manually try the following:

ds2webdriver.exe --think_time=0.085 --target=ds2weba0 --db_size=20gb --warmup_time=0 --n_threads=10 --run_time=300

-Joshua
Reply
0 Kudos
weiweiliang
Contributor
Contributor

Thanks Joshua.

Yes, you are right. The command gave me the same error Smiley Sad Please see the attachment for log.

Reply
0 Kudos
jpschnee
VMware Employee
VMware Employee

Are you sure you followed all of the instructions for setting up the DS2DB?  The section "Prepare the DVD Store 2 Database" should be completed prior to running.

-Joshua
Reply
0 Kudos
weiweiliang
Contributor
Contributor

I think so.

We imporeted the VM from the pre-built template first and then follow steps 4 - 9 of section "Prepare the DVD Store 2 Database" on page 138 to finish the configuration.

Is there any command I can run from DS2WebA0 to verify the connection to mysql db on DS2DB0? Thanks.

Reply
0 Kudos
weiweiliang
Contributor
Contributor

I actually rebuilt DS2DB0 VM yesterday, but still couldn't make ds2webdriver.exe work. DS2WebA0.wrf shows the following error:

****************************************************************

...

<HTML>
<HEAD><TITLE>DVD Store Login Page</TITLE></HEAD>
<BODY>
<FONT FACE="Arial" COLOR="#0000FF">
<H1 ALIGN=CENTER>DVD Store</H1>
Can't connect to MySQL server on 'DS2-DB' (4)

Thread 4: Error in Login for User user7363948, thread exiting
Thread 9: Login: Username/password incorrect; str_acc length: 1116  str_acc:

...

*******************************************************************

To verifiy the above action manually, I launched this page manually on client0 by opening http://DS2WebA0/ds2/index.html.

The page opened asked for a username and password. I then gave "web" and "web", it gave the same error saying "username/password incorrect".

I am just wondering does this page work for you guys if you enter "web" web" there? 

Running "mysql -h localhost -u web -pweb" doesn't give me any error on DS2DB0.

Any suggestion is appreciated! Thanks!

Reply
0 Kudos
jpschnee
VMware Employee
VMware Employee

Can you post your /etc/hosts files from both DS2WebA0 and DS2DB0?

Also, let's check the size of your DS2 database.

1.SSH into your DS2DB.

2.  Create a new file CheckSize.sql

3.  In the file add the following:

SELECT table_schema "*", sum( data_length + index_length ) / 1024 / 1024 "DB (MB)" 
FROM information_schema.TABLES GROUP BY table_schema ;
4. In the ssh console run "mysql < CheckSize.sql"
5. Post output here.

-Joshua
Reply
0 Kudos
weiweiliang
Contributor
Contributor

Thanks Joshua.

Attached are the files.

Reply
0 Kudos
jamesz08
VMware Employee
VMware Employee

To test the DB connection you can copy the attached file to /srv/www/htdocs/ds2/ on your ds2web vm. Make sure it is readable by everyone (chmod +r test-connection.php)

open a browser from the client and open the page:

http://ds2weba0/ds2/test-connection.php

If you get "Connected to MySQL" then your DB connection is working.

Reply
0 Kudos
weiweiliang
Contributor
Contributor

Thanks for the script.

I got "Connected to MySQL", so the connection should be ok.

Anything wrong with the hosts files and db size? What else should I check for? Thanks.

Reply
0 Kudos
jamesz08
VMware Employee
VMware Employee

Your database connection is fine.

It looks like the database may not have fully loaded.  you are going to have to go back and redo the steps under "Prepare the DVD Store 2 Database".

Reply
0 Kudos
weiweiliang
Contributor
Contributor

When I prepared the DVD store 2 Database, I think I strictly followed the steps given in the benchmark Smiley Sad  and I didn't run into any errors.

Just curious, in case I re-create the db, what should be the approximately correct size if DB loading has no issue?

Reply
0 Kudos
jamesz08
VMware Employee
VMware Employee

According to the errors you are getting all the users are not being  loaded into the DB.  After you run the Install_DVDStore_vmmark.pl script  you will have 2 csv files in ds2/data_files/cust which contain all the  users.  Each file should be ~3GB in size.   There should be 3 csv files for each month of the year in the ds2/data_files/orders directory.  These files should be sized ~280MB, ~230MB, and ~90MB each.   Finally there will be 2 csv files in ds2/data_files/prod directory, 3M and 10M.

Incidentally the usernames are user1 - user40000000.  the password is 'password'.  You could manually try logging in with one of these.  web/web is only used on the backend.

Reply
0 Kudos
weiweiliang
Contributor
Contributor

Thanks for the info. I will double check these files.

Reply
0 Kudos
weiweiliang
Contributor
Contributor

I re-created DS2DB0 vm and checked all the .csv files. All the file size are correct. Reloading didn't give me any error either.

But ds2webdriver.exe still stops working. Funny thing is that when I used the user name "user2737279" mentioned below in page http://ds2webb0/ds2/index.html, there is no issue for the user to login and it even shows this user's previous purchases. What can I do? Should I upload my virtual machine files?

<HTML>
<HEAD><TITLE>DVD Store Login Page</TITLE></HEAD>
<BODY>
<FONT FACE="Arial" COLOR="#0000FF">
<H1 ALIGN=CENTER>DVD Store</H1>
Can't connect to MySQL server on 'DS2-DB' (4)

Thread 8: Error in Login for User user2737279, thread exiting
Thread 7: Login: Username/password incorrect; str_acc length: 1116  str_acc:

Reply
0 Kudos