VMware

This Question is Answered

1 2 Previous Next 25 Replies Last post: Jun 17, 2008 10:23 AM by wila  

System error posted: Jun 13, 2008 2:36 AM

Click to view wila's profile Virtuoso 3,266 posts since
Jun 27, 2006
Hi,

As replied to Peter_VM's thread, the forums aint OK right now. Well at least not from accessing them down here.
Opening the vmx thread a few lines down took over 20 seconds (I counted this time)
When I went to read the forum blog and clicked on "watch" i got the following stack trace:

System Error

We're sorry but a serious error has occurred in the system. If you are a system administrator please click "more details" below for more information about this error.
More Details

    * Status Code: 500
    * Exception Type: null
    * Error Message:
    * Request URI: /community/vmtn/suggest
    * Stack Trace:
          o com.jivesoftware.base.database.dao.DAOContextFactory.getDAOContext(DAOContextFactory.java:71)
          o com.jivesoftware.community.impl.QueryCache.getBlock(QueryCache.java:125)
          o com.jivesoftware.community.impl.DbCommunity.getThreads(DbCommunity.java:943)
          o com.jivesoftware.community.proxy.CommunityProxy.getThreads(CommunityProxy.java:328)
          o com.jivesoftware.community.action.CommunityAction.execute(CommunityAction.java:177)
          o sun.reflect.GeneratedMethodAccessor672.invoke(Unknown Source)
          o sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
          o java.lang.reflect.Method.invoke(Method.java:585)
          o com.opensymphony.xwork.DefaultActionInvocation.invokeAction(DefaultActionInvocation.java:358)
          o com.opensymphony.xwork.DefaultActionInvocation.invokeActionOnly(DefaultActionInvocation.java:218)
          o com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:192)
          o com.opensymphony.xwork.interceptor.AroundInterceptor.intercept(AroundInterceptor.java:31)
          o com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:190)
          o com.jivesoftware.community.web.webwork.FlashInterceptor.intercept(FlashInterceptor.java:40)
          o com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:190)
          o com.opensymphony.xwork.interceptor.DefaultWorkflowInterceptor.doIntercept(DefaultWorkflowInterceptor.java:175)
          o com.opensymphony.xwork.interceptor.MethodFilterInterceptor.intercept(MethodFilterInterceptor.java:86)
          o com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:190)
          o com.opensymphony.xwork.validator.ValidationInterceptor.doIntercept(ValidationInterceptor.java:115)
          o com.opensymphony.xwork.interceptor.MethodFilterInterceptor.intercept(MethodFilterInterceptor.java:86)
          o com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:190)
          o com.opensymphony.xwork.interceptor.AroundInterceptor.intercept(AroundInterceptor.java:31)
          o com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:190)
          o com.jivesoftware.community.web.webwork.JiveObjectLoaderInterceptor.intercept(JiveObjectLoaderInterceptor.java:55)
          o com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:190)
          o com.opensymphony.xwork.interceptor.AroundInterceptor.intercept(AroundInterceptor.java:31)
          o com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:190)
          o com.opensymphony.xwork.interceptor.AroundInterceptor.intercept(AroundInterceptor.java:31)
          o com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:190)
          o com.opensymphony.webwork.interceptor.FileUploadInterceptor.intercept(FileUploadInterceptor.java:171)
          o com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:190)
          o com.opensymphony.xwork.interceptor.AroundInterceptor.intercept(AroundInterceptor.java:31)
          o com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:190)
          o com.opensymphony.xwork.interceptor.AroundInterceptor.intercept(AroundInterceptor.java:31)
          o com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:190)
          o com.opensymphony.xwork.interceptor.I18nInterceptor.intercept(I18nInterceptor.java:151)
          o com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:190)
          o com.opensymphony.xwork.interceptor.AroundInterceptor.intercept(AroundInterceptor.java:31)
          o com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:190)
          o com.jivesoftware.community.web.webwork.JiveIOCInterceptor.intercept(JiveIOCInterceptor.java:694)
          o com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:190)
          o com.jivesoftware.community.action.LocaleInterceptor.intercept(LocaleInterceptor.java:71)
          o com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:190)
          o com.jivesoftware.community.web.webwork.JiveLoginInterceptor.intercept(JiveLoginInterceptor.java:42)
          o com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:190)
          o com.jivesoftware.community.web.webwork.AuthInterceptor.intercept(AuthInterceptor.java:60)
          o com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:190)
          o com.opensymphony.xwork.interceptor.AroundInterceptor.intercept(AroundInterceptor.java:31)
          o com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:190)
          o com.opensymphony.xwork.interceptor.AroundInterceptor.intercept(AroundInterceptor.java:31)
          o com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:190)
          o com.opensymphony.xwork.interceptor.ExceptionMappingInterceptor.intercept(ExceptionMappingInterceptor.java:186)
          o com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:190)
          o com.jivesoftware.community.web.webwork.ModuleCheckInterceptor.intercept(ModuleCheckInterceptor.java:49)
          o com.opensymphony.xwork.DefaultActionInvocation.invoke(DefaultActionInvocation.java:190)
          o com.opensymphony.xwork.DefaultActionProxy.execute(DefaultActionProxy.java:116)
          o com.opensymphony.webwork.dispatcher.DispatcherUtils.serviceAction(DispatcherUtils.java:225)
          o com.opensymphony.webwork.dispatcher.FilterDispatcher.doFilter(FilterDispatcher.java:202)
          o com.jivesoftware.community.web.webwork.JiveFilterDispatcher.doFilter(JiveFilterDispatcher.java:53)
          o org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
          o org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
          o com.opensymphony.module.sitemesh.filter.PageFilter.parsePage(PageFilter.java:118)
          o com.opensymphony.module.sitemesh.filter.PageFilter.doFilter(PageFilter.java:52)
          o org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
          o org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
          o com.jivesoftware.community.web.JiveActionContextCleanUp.doFilter(JiveActionContextCleanUp.java:46)
          o org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
          o org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
          o com.jivesoftware.community.web.filter.PresenceFilter.doFilter(PresenceFilter.java:106)
          o org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
          o org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
          o org.directwebremoting.servlet.DwrWebContextFilter.doFilter(DwrWebContextFilter.java:91)
          o org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
          o org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
          o com.jivesoftware.community.upgrade.UpgradeFilter.doFilter(UpgradeFilter.java:43)
          o org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
          o org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
          o com.jivesoftware.base.database.dao.DAOContextCleanUpFilter.doFilter(DAOContextCleanUpFilter.java:32)
          o org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
          o org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
          o org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
          o org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:175)
          o org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:128)
          o org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
          o org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:563)
          o org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
          o org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:263)
          o org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:844)
          o org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:584)
          o org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:447)
          o java.lang.Thread.run(Thread.java:595)
    * java.lang.IllegalStateException: could not create DAOContext



It's not pretty is it? ;)

--
Wil

Re: System error

2. Jun 13, 2008 2:45 AM in response to: wila
Click to view oreeh's profile Guru 9,872 posts since
Nov 30, 2005
VMware is already aware of the problem. I assume you'll get some more details from Robert when he's online again.

Re: System error

4. Jun 13, 2008 3:04 AM in response to: wila
Click to view oreeh's profile Guru 9,872 posts since
Nov 30, 2005
Well I wasn't seeing any notes of that on the communities blog, so thought it might help if i started yakking again.
There's a thread in the moderator area dealing with it. You are right it should have been mentioned in a "public" area as well.

(one would almost think I enjoy complaining ;) )
No comment :D

The thing is that it sometimes works OK as well, it s a bit weird.
It has to do with a stage server / mirror server that Google crawls.
Looks like sometimes a user gets redirected to this server instead of the production servers.

Re: System error

5. Jun 13, 2008 7:32 AM in response to: oreeh
Click to view RDellimmagine's profile Virtuoso 1,678 posts since
Jul 19, 2004
There were some intermittent stability issues with some shared infrastructure yesterday that the VMware Communities application runs on. That's why it was working ok sometimes and not working ok other times. I had thought it was resolved when I left the office last night, so I didn't post about it, but apparently not. I've alerted my technical folks about this.

The issue Oliver refers to is a different one. We had a couple of cases where non-production content got into the Akamai cache. This happened because Google crawls a mirrored site to prevent the Google crawls from overloading the production server, and that crawling process adds pages to the cache. The mirror site got populated with some non-production code, which then showed up only when Akamai served cached pages. This problem was short-lived, since the caches clear after 1 hour; and now we've refreshed our mirrored site from production, so that shouldn't happen again.

  • Robert

    Robert Dell'Immagine, Director of VMware Communities

Re: System error

6. Jun 14, 2008 4:54 AM in response to: RDellimmagine
Click to view Peter_vm's profile Guru 9,058 posts since
Feb 1, 2006
RDellimmagine wrote:
... The mirror site got populated with some non-production code, which then showed up only when Akamai served cached pages. This problem was short-lived, since the caches clear after 1 hour; and now we've refreshed our mirrored site from production, so that shouldn't happen again.
Unless that mirror site gets populated with "some non-production code" again.
Do you know why it got populated in such way?

Re: System error

8. Jun 14, 2008 9:19 AM in response to: Peter_vm
Click to view RDellimmagine's profile Virtuoso 1,678 posts since
Jul 19, 2004
Yes, it was a process issue that we are resolving by separating the Google mirror from the stage server. Regards, Robert

Re: System error

11. Jun 15, 2008 3:19 AM in response to: wila
Click to view oreeh's profile Guru 9,872 posts since
Nov 30, 2005
Quote from Robert:

I'll harass my development team again.

Re: System error

12. Jun 15, 2008 12:21 PM in response to: wila
Click to view RDellimmagine's profile Virtuoso 1,678 posts since
Jul 19, 2004
We've identified an issue where some testing for a critical update to VMware Store is "leaking" into VMware Communities and causing the errors you are seeing. We are working to resolve this, but have not yet identified the leak. Because of this, you will need to expect some intermittent problems continuing possibly through June 19.

While I don't want to minimize the disruption this is causing, I am seeing that overall traffic on VMware Communities is still at normal levels, and users continue to post new content. Thank you for your patience, and please know that we continue to work to resolve this as quickly as possible.

Regards, Robert

Robert Dell'Immagine, Director of VMware Communities

Re: System error

14. Jun 15, 2008 7:15 PM in response to: wila
Click to view Peter_vm's profile Guru 9,058 posts since
Feb 1, 2006
Try switching to another Akamai server. From time to time some of them malfunction and do not refresh content reliably.

VMware Developer

SDKs, APIs, Videos, Learn and much more in the Developer community.

Learn More

Developer Sample Code

Increase your developer productivity with VMware API sample code.

Learn More

VMworld Sessions & Labs

Online access to the latest VMworld Sessions & Labs and online services.

Learn more

Purchase PSO Credits Online

Purchase credits to redeem training and consulting services online.

Buy Now

Community Hardware Software

View reported configurations or report your own.

Learn More

VMware vSphere

Come witness the next giant leap in virtualization.

Register Today

Communities