VMware Performance Community
pruchya
Contributor
Contributor

DS3DB0 database take log time to load table = custhist

it take long time to load table custhist i try to recreate again and same 

if  you want any log or anything else  please tell  me 

========================================

 

Sat Jul 3 09:09:44 UTC 2021
============================================================================
============================================================================
==== DS3 database chacker must be run from DS3 host node ====
==== Currently running on host = DS3DB0
============================================================================
PING DS3DB0.vmmark3.eng.vmware.com (127.0.0.1) 56(84) bytes of data.
64 bytes from DS3DB0.vmmark3.eng.vmware.com (127.0.0.1): icmp_seq=1 ttl=64 time=0.096 ms

--- DS3DB0.vmmark3.eng.vmware.com ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 0.096/0.096/0.096/0.000 ms
DS3DB0 is alive
Database DS3 exists. Proceeding with DS3 table checks ...
============================================================================
Table CATEGORIES existance check passed
Table CUSTOMERS existance check passed
Table CUST_HIST existance check passed
Table INVENTORY existance check passed
Table MEMBERSHIP existance check passed
Table ORDERLINES existance check passed
Table ORDERS existance check passed
Table PRODUCTS existance check passed
Table REORDER existance check passed
Table REVIEWS existance check passed
Table REVIEWS_HELPFULNESS existance check passed
PASSED: All DS3 Tables were found to exist. Proceeding with DS3 checks ...
============================================================================
PASSED: DS3 Tables prelim count passed. Proceeding with DS3 checks ...
============================================================================
PASSED: DS3 appears to have web privileges granted. Proceeding with DS3 checks ...
============================================================================
Checking the contents of Tables = category
................All checks passwd checking Table CATEGORIES
Checking the contents of Tables = orders
........................All checks passwd checking Table ORDERS
Checking the contents of Tables = custhist
........ERROR: DS3 value check failed.
============================================================================
--------------------------------------------------------------------------
FAIL: DS3 is either not built completely or not in initialized state.
--------------------------------------------------------------------------

 

===============================================

[root@DS3DB0 ~]# tail -f /ds3/VMmark3-DS3installoutput.txt
1 10000000 jan L 1 0 1000000 200000000

Creating Order CSV file for Month feb !!!
10000001 20000000 feb L 2 0 1000000 200000000

Creating Order CSV file for Month mar !!!
20000001 30000000 mar L 3 0 1000000 200000000

Creating Order CSV file for Month apr !!!
30000001 40000000 apr L 4 0 1000000 200000000


Creating Order CSV file for Month may !!!
40000001 50000000 may L 5 0 1000000 200000000

Creating Order CSV file for Month jun !!!
50000001 60000000 jun L 6 0 1000000 200000000

Creating Order CSV file for Month jul !!!
60000001 70000000 jul L 7 0 1000000 200000000

Creating Order CSV file for Month aug !!!
70000001 80000000 aug L 8 0 1000000 200000000

Creating Order CSV file for Month sep !!!
80000001 90000000 sep L 9 0 1000000 200000000

Creating Order CSV file for Month oct !!!
90000001 100000000 oct L 10 0 1000000 200000000

Creating Order CSV file for Month nov !!!
100000001 110000000 nov L 11 0 1000000 200000000

Creating Order CSV file for Month dec !!!
110000001 120000000 dec L 12 0 1000000 200000000


All Order, Orderlines, Cust_Hist CSV files created !!!

Creating Inventory CSV file!!!!

Inventory CSV file created!!!!

Creating product CSV file!!!!

Product CSV file created!!!!

Creating membership CSV file!!!!

Membership CSV file created!!!!

Creating reviews and reviews helpfulness CSV files!!!!

Reviews and heviews helpfulness CSV files created!!!!

Creating build script for MySQL from templates...

Template files are stored in respective build folders and the output files are also stored in same folder

Template files are named with generic_template at end of their filename and the output files without _template at end

Completed creating and writing build scripts for MySQL database...

All database build scripts(shell and sql) are dumped into their respective folders.

These scripts are created from template files in same folders with '_generic_template' in their name.

Scripts that are created from template files have '_' 100 GB in their name.

User can edit the sql script generated for customizing sql script for more DBFiles per table and change the paths of DBFiles.

Now Run CreateConfigFile.pl perl script in ds2 folder which will generate configuration file used as input to the driver program.

VMmark3: Executing: mysqlds3_create_all.sh
Warning messages about using password via command line are normal......
Creating database
Warning: Using a password on the command line interface can be insecure.
Creating Indexes
Warning: Using a password on the command line interface can be insecure.
Creating Stored Procedures
Warning: Using a password on the command line interface can be insecure.
Loading Customer Data
Warning: Using a password on the command line interface can be insecure.

Loading Orders Data
Warning: Using a password on the command line interface can be insecure.
Loading Orderlines Data
Warning: Using a password on the command line interface can be insecure.
Loading Customer History Data
Warning: Using a password on the command line interface can be insecure.

 

 

 

 

0 Kudos
3 Replies
tyson_anz
Contributor
Contributor

How long have you waited?

It took over 24 hours for mine to complete.

0 Kudos
pruchya
Contributor
Contributor

hi tyson_anz 

 table customer_history  loading data over than 2-3 Hours , Data doesn't  increase  

pruchya_0-1625312758116.png

 

 

pruchya_1-1625312777062.png

 

0 Kudos
tyson_anz
Contributor
Contributor

The manual itself mentions that it takes 12 hours at least for the operation to complete.  I wasn't watching the tables become populated, so I can only imagine there are other processes happening.  For myself the operation took over 24 hours, and my storage is all flash vSAN.  And I was looking at the processing on the VM via CPU and Storage activity,

I have read in these forum posts of one other person saying it took over 36 hours.

I think you just have to leave it running for a long time.