ranvir09
Contributor
Contributor

vmware-vcd-cell is dead, but pidfile exists

vCloud director has stopped working after reboot of the cell...this was working fine last week in my lab Smiley Sad i have uninstalled the vcloud director and again installed it as well but all in vain...

Below are the logs for same..

=========================================================================================

more cell.log

Application startup begins: 5/3/11 3:17 PM
Successfully bound network port: 80 on host address: 10.20.30.28
Successfully bound network port: 443 on host address: 10.20.30.28
Application Initialization: 9% complete. Subsystem 'com.vmware.vcloud.common.core' started
Successfully connected to database: jdbc:oracle:thin:@10.20.30.24:1521/vcloud
Successfully bound network port: 443 on host address: 10.20.30.26
Successfully bound network port: 61616 on host address: 10.20.30.28
Successfully bound network port: 61613 on host address: 10.20.30.28
Uncaught Exception. Originating thread: Thread[SpringOsgiExtenderThread-11,5,spring-osgi-extender[722d95b3]-threads]. Message: Error creating bean with name
'hibernateCacheRegions': Cannot create inner bean 'org.springframework.cache.ehcache.EhCacheFactoryBean#75636731' of type [org.springframework.cache.ehcache.
EhCacheFactoryBean] while setting bean property 'sourceList' with key [0]; nested exception is org.springframework.beans.factory.BeanCreationException: Error
creating bean with name 'org.springframework.cache.ehcache.EhCacheFactoryBean#75636731' defined in URL [bundleentry://159/META-INF/spring/common-persist-con
text-cache.xml]: Cannot resolve reference to bean 'cacheManager' while setting bean property 'cacheManager'; nested exception is org.springframework.beans.fa
ctory.BeanCreationException: Error creating bean with name 'cacheManager' defined in URL [bundleentry://159/META-INF/spring/common-persist-context.xml]: Invo
cation of init method failed; nested exception is net.sf.ehcache.CacheException: Problem creating connections: Error decrypting data.
Application shutdown event: Beginning
*DEBUG* Scheduling task Thread[Configuration Updater,5,main]
Application shutdown event: Application stop requested. Shutting down.

=====================================================================================================

more  vmware-vcd-watchdog.log
2011-05-03 14:54:33 | INFO  | vmware-vcd-watchdog started
2011-05-03 14:54:35 | INFO  | Started vmware-vcd-cell (pid=5667)
2011-05-03 14:55:35 | ALERT | vmware-vcd-cell is dead but /var/run/vmware-vcd-cell.pid exists, attempting to restart it
2011-05-03 14:55:37 | INFO  | Started vmware-vcd-cell (pid=5833)
2011-05-03 14:56:37 | ALERT | vmware-vcd-cell is dead but /var/run/vmware-vcd-cell.pid exists, attempting to restart it
2011-05-03 14:56:40 | INFO  | Started vmware-vcd-cell (pid=5996)
2011-05-03 14:57:40 | ALERT | vmware-vcd-cell is dead but /var/run/vmware-vcd-cell.pid exists, attempting to restart it
2011-05-03 14:57:42 | INFO  | Started vmware-vcd-cell (pid=6158)
2011-05-03 14:58:42 | ALERT | vmware-vcd-cell is dead but /var/run/vmware-vcd-cell.pid exists, attempting to restart it
2011-05-03 14:58:44 | INFO  | Started vmware-vcd-cell (pid=6313)
2011-05-03 14:59:44 | ALERT | vmware-vcd-cell is dead but /var/run/vmware-vcd-cell.pid exists, attempting to restart it
2011-05-03 14:59:47 | INFO  | Started vmware-vcd-cell (pid=6463)
2011-05-03 15:00:47 | ALERT | vmware-vcd-cell is dead but /var/run/vmware-vcd-cell.pid exists, attempting to restart it
2011-05-03 15:00:49 | INFO  | Started vmware-vcd-cell (pid=6614)
2011-05-03 15:01:49 | ALERT | vmware-vcd-cell is dead but /var/run/vmware-vcd-cell.pid exists, attempting to restart it
2011-05-03 15:01:51 | INFO  | Started vmware-vcd-cell (pid=6769)
2011-05-03 15:02:51 | ALERT | vmware-vcd-cell is dead but /var/run/vmware-vcd-cell.pid exists, attempting to restart it

=====================================================================================================

Any help would be very appreciated.

Tags (2)
6 Replies
sjoglekar
Enthusiast
Enthusiast

Please check the vcloud-container-debug.log file and paste any stack trace here. This will help diagnosing the issue.

0 Kudos
_morpheus_
Expert
Expert

If you're sure the cell isn't running (check for the java process) then delete the file /var/run/vmware-vcd-cell.pid and then try to start it

0 Kudos
ranvir09
Contributor
Contributor

please find attached logs as requested.

0 Kudos
ranvir09
Contributor
Contributor

Jesse S@morphrus:As suggested,  I tried deleting the /var/run/vmware-vcd-cell.pid file and then restarted the vmware-vcd service, but no success. ... Smiley SadSmiley Sad

below are some excerpts from  the cell.logs

=============================================================================================\

Application startup begins: 5/4/11 9:16 AM
Successfully bound network port: 80 on host address: 10.20.30.28
Successfully bound network port: 443 on host address: 10.20.30.28
Application Initialization: 9% complete. Subsystem 'com.vmware.vcloud.common.core' started
Successfully connected to database: jdbc:oracle:thin:@10.20.30.24:1521/vcloud
Successfully bound network port: 443 on host address: 10.20.30.26
Successfully bound network port: 61616 on host address: 10.20.30.28
Successfully bound network port: 61613 on host address: 10.20.30.28
Uncaught Exception. Originating thread: Thread[SpringOsgiExtenderThread-11,5,spring-osgi-extender[79226a77]-threads]. Message: Error creating bean with name 'hibernateCacheRegions': Cannot create inner bean 'org.springframework.cache.ehcache.EhCacheFactoryBean#2313b44d' of type [org.springframework.cache.ehcache.EhCacheFactoryBean] while setting bean property 'sourceList' with key [0]; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'org.springframework.cache.ehcache.EhCacheFactoryBean#2313b44d' defined in URL [bundleentry://159/META-INF/spring/common-persist-context-cache.xml]: Cannot resolve reference to bean 'cacheManager' while setting bean property 'cacheManager'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'cacheManager' defined in URL [bundleentry://159/META-INF/spring/common-persist-context.xml]: Invocation of init method failed; nested exception is net.sf.ehcache.CacheException: Problem creating connections: Error decrypting data.
Application shutdown event: Beginning
*DEBUG* Scheduling task Thread[Configuration Updater,5,main]
Application shutdown event: Application stop requested. Shutting down.

====================================================================================

service vmware-vcd status
vmware-vcd-watchdog is running
vmware-vcd-cell is dead, but pidfile exists

=====================================================================

0 Kudos
ranvir09
Contributor
Contributor

Sorry for replying so late...stuck up with work.:(:(:(..Finally i have resolved this issue last week  , but it required me to set up another Database server (oracle 11g on windows this time) . It was surprising for me cause my VCD stopped responding via HTTP when i rebooted this cell and i didnt make any changes at all on my previous database server(Oracle 11g on Linux). Even I rebuilt my vCD cell 3-4 times with no success then finally i tried to use another database server  and installed vcd Cell again which worked like charm. I am confused why so?? Any clue guys....Any help or response would be highly appreciated.


Rgds,

Ranvir

0 Kudos
admin
Immortal
Immortal

Each vCD installation has a unique encryption key that various settings and some data in the DB is encrypted with. If you want a multi-cell set up or to attach a new cell to an existing database you need to use the response file generated from the configuration of the initial cell, which will include the shared encryption key.