Weblogic and Spring JMS Unable to gracefully shut down application

[Gotosleep3]

Googled for this forever and have not found a resolution.

We are using WLS 10.3 and Spring 2.5.6. When trying to gracefully shutdowns the application we are recieving the following debug stack trace:

2010-04-21 14:19:52,443 DEBUG [tid=41,tgn=Pooled Threads] [org.springframework.jms.listener.DefaultMessageLis tenerContainer.shutdown():190] Shutting down JMS listener container
2010-04-21 14:19:52,444 DEBUG [tid=41,tgn=Pooled Threads] [org.springframework.jms.listener.DefaultMessageLis tenerContainer.doShutdown():481] Waiting for shutdown of message listener invokers
2010-04-21 14:19:52,444 DEBUG [tid=41,tgn=Pooled Threads] [org.springframework.jms.listener.DefaultMessageLis tenerContainer.doShutdown():486] Still waiting for shutdown of 1 message listener invokers

Here is the thread dump from the WLS server.

"jmsContainer-17" id=1026 idx=0x3e8 tid=8377 prio=5 alive, in native, waiting
-- Waiting for notification on: weblogic/rjvm/ResponseImpl@0x24f4dd88[fat lock]
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/ObjectZ(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at weblogic/rjvm/ResponseImpl.waitForData(ResponseImpl.java:87)
^-- Lock released while waiting: weblogic/rjvm/ResponseImpl@0x24f4dd88[fat lock]
at weblogic/rjvm/ResponseImpl.getTxContext(ResponseImpl.java:127)
at weblogic/messaging/dispatcher/DispatcherProxy.unmarshalResponse(DispatcherProxy. java:240)
at weblogic/messaging/dispatcher/DispatcherProxy.dispatchSyncTranFuture(DispatcherP roxy.java:134)
at weblogic/messaging/dispatcher/DispatcherWrapperState.dispatchSyncTran(Dispatcher WrapperState.java:338)
at weblogic/messaging/dispatcher/DispatcherWrapperState.dispatchSyncNoTran(Dispatch erWrapperState.java:386)
at weblogic/jms/dispatcher/DispatcherAdapter.dispatchSyncNoTran(DispatcherAda pter.java:59)
at weblogic/jms/client/JMSSession.receiveMessage(JMSSession.java:870)
at weblogic/jms/client/JMSConsumer.receiveInternal(JMSConsumer.java:644)
at weblogic/jms/client/JMSConsumer.receive(JMSConsumer.java:523)
at weblogic/jms/client/WLConsumerImpl.receive(WLConsumerImpl.java:184)
at org/springframework/jms/listener/AbstractPollingMessageListenerContainer.receiveMes sage(AbstractPollingMessageListenerContainer.java: 405)
at org/springframework/jms/listener/AbstractPollingMessageListenerContainer.doReceiveA ndExecute(AbstractPollingMessageListenerContainer. java:308)
at org/springframework/jms/listener/AbstractPollingMessageListenerContainer.receiveAnd Execute(AbstractPollingMessageListenerContainer.ja va:261)
at org/springframework/jms/listener/DefaultMessageListenerContainer$AsyncMessageListen erInvoker.invokeListener(DefaultMessageListenerCon tainer.java:982)
at org/springframework/jms/listener/DefaultMessageListenerContainer$AsyncMessageListen erInvoker.executeOngoingLoop(DefaultMessageListene rContainer.java:974)
at org/springframework/jms/listener/DefaultMessageListenerContainer$AsyncMessageListen erInvoker.run(DefaultMessageListenerContainer.java :876)
at java/lang/Thread.run(Thread.java:619)[optimized]
at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
-- end of trace

Any suggestions or help would be greatfully appreciated.

[OLibutzki]

Hi everyone,

looks like a bug in Spring 2.5.6 as I get the same deadlock (using WebSphere).
Maybe someone can open a new jira ticket?

Kind regards
Oliver

at java/lang/Object.wait(Native Method) 
at java/lang/Object.wait(Object.java:199) 
at org/springframework/jms/listener/DefaultMessageListenerContainer.doShutdown(DefaultMessageListenerContainer.java:489) 
at org/springframework/jms/listener/AbstractJmsListeningContainer.shutdown(AbstractJmsListeningContainer.java:211) 
at org/springframework/jms/listener/AbstractJmsListeningContainer.destroy(AbstractJmsListeningContainer.java:149) 
at org/springframework/beans/factory/support/DisposableBeanAdapter.destroy(DisposableBeanAdapter.java:151) 
at org/springframework/beans/factory/support/DefaultSingletonBeanRegistry.destroyBean(DefaultSingletonBeanRegistry.java:487) 
at org/springframework/beans/factory/support/DefaultSingletonBeanRegistry.destroySingleton(DefaultSingletonBeanRegistry.java:462) 
at org/springframework/beans/factory/support/DefaultSingletonBeanRegistry.destroySingletons(DefaultSingletonBeanRegistry.java:430) 
at org/springframework/context/support/AbstractApplicationContext.destroyBeans(AbstractApplicationContext.java:853) 
at org/springframework/context/support/AbstractApplicationContext.doClose(AbstractApplicationContext.java:831) 
at org/springframework/context/support/AbstractApplicationContext.close(AbstractApplicationContext.java:794) 
at org/springframework/web/context/ContextLoader.closeWebApplicationContext(ContextLoader.java:361) 
at org/springframework/web/context/ContextLoaderListener.contextDestroyed(ContextLoaderListener.java:70) 
at com/ibm/ws/wswebcontainer/webapp/WebApp.notifyServletContextDestroyed(WebApp.java:739) 
at com/ibm/ws/webcontainer/webapp/WebApp.destroy(WebApp.java:2804) 
at com/ibm/ws/wswebcontainer/webapp/WebApp.destroy(WebApp.java:1090) 
at com/ibm/ws/container/AbstractContainer.destroy(AbstractContainer.java:82) 
at com/ibm/ws/webcontainer/webapp/WebGroup.destroy(WebGroup.java:196) 
at com/ibm/ws/webcontainer/webapp/WebGroup.removeWebApplication(WebGroup.java:234) 
at com/ibm/ws/webcontainer/VirtualHost.removeWebApplication(VirtualHost.java:323) 
at com/ibm/ws/wswebcontainer/VirtualHost.removeWebApplication(VirtualHost.java:215) 
at com/ibm/ws/wswebcontainer/WebContainer.removeWebApplication(WebContainer.java:743) 
at com/ibm/ws/webcontainer/component/WebContainerImpl.uninstall(WebContainerImpl.java:359) 
at com/ibm/ws/webcontainer/component/WebContainerImpl.stop(WebContainerImpl.java:562) 
at com/ibm/ws/runtime/component/ApplicationMgrImpl.stop(ApplicationMgrImpl.java:1273) 
at com/ibm/ws/runtime/component/DeployedApplicationImpl.fireDeployedObjectStop(DeployedApplicationImpl.java:1145) 
at com/ibm/ws/runtime/component/DeployedModuleImpl.stop(DeployedModuleImpl.java:602) 
at com/ibm/ws/runtime/component/DeployedApplicationImpl.stop(DeployedApplicationImpl.java:893) 
at com/ibm/ws/runtime/component/ApplicationMgrImpl.stopApplication(ApplicationMgrImpl.java:1055) 
at com/ibm/ws/runtime/component/ApplicationMgrImpl$2.run(ApplicationMgrImpl.java:1537) 
at com/ibm/ws/security/auth/ContextManagerImpl.runAs(ContextManagerImpl.java:4158) 
at com/ibm/ws/security/auth/ContextManagerImpl.runAsSystem(ContextManagerImpl.java:4255) 
at com/ibm/ws/security/core/SecurityContext.runAsSystem(SecurityContext.java:245) 
at com/ibm/ws/runtime/component/ApplicationMgrImpl.stopApplication(ApplicationMgrImpl.java:1543) 
at sun/reflect/NativeMethodAccessorImpl.invoke0(Native Method) 
at sun/reflect/NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:79(Compiled Code)) 
at sun/reflect/DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43(Compiled Code)) 
at java/lang/reflect/Method.invoke(Method.java:618(Compiled Code)) 
at sun/reflect/misc/Trampoline.invoke(MethodUtil.java:68) 
at sun/reflect/GeneratedMethodAccessor25.invoke(Bytecode PC:40) 
at sun/reflect/DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43(Compiled Code)) 
at java/lang/reflect/Method.invoke(Method.java:618(Compiled Code)) 
at sun/reflect/misc/MethodUtil.invoke(MethodUtil.java:271) 
at javax/management/modelmbean/RequiredModelMBean.invokeMethod(RequiredModelMBean.java:1092) 
at javax/management/modelmbean/RequiredModelMBean.invoke(RequiredModelMBean.java:973) 
at com/sun/jmx/mbeanserver/DynamicMetaDataImpl.invoke(DynamicMetaDataImpl.java:231) 
at com/sun/jmx/mbeanserver/MetaDataImpl.invoke(MetaDataImpl.java:238) 
at com/sun/jmx/interceptor/DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:833) 
at com/sun/jmx/mbeanserver/JmxMBeanServer.invoke(JmxMBeanServer.java:802) 
at com/ibm/ws/management/AdminServiceImpl$1.run(AdminServiceImpl.java:1139) 
at com/ibm/ws/security/util/AccessController.doPrivileged(AccessController.java:118(Compiled Code)) 
at com/ibm/ws/management/AdminServiceImpl.invoke(AdminServiceImpl.java:1032) 
at com/ibm/ws/management/application/sync/StopDeploymentTask.stopJavaEEObject(StopDeploymentTask.java:401) 
at com/ibm/ws/management/application/sync/StopDeploymentTask.stopApp(StopDeploymentTask.java:336) 
at com/ibm/ws/management/application/sync/StopDeploymentTask.fullAppUpdate(StopDeploymentTask.java:307) 
at com/ibm/ws/management/application/sync/StopDeploymentTask.performTask(StopDeploymentTask.java:130) 
at com/ibm/ws/management/application/sync/AppBinaryProcessor$AppBinThread.run(AppBinaryProcessor.java:1063) 
at com/ibm/ws/management/application/sync/AppBinaryProcessor.postProcess(AppBinaryProcessor.java:672) 
at com/ibm/ws/management/application/sync/AppBinaryProcessor._onChangeCompletion(AppBinaryProcessor.java:480) 
at com/ibm/ws/management/application/sync/AppBinaryProcessor$2.run(AppBinaryProcessor.java:441) 
at com/ibm/ws/security/util/AccessController.doPrivileged(AccessController.java:118(Compiled Code)) 
at com/ibm/ws/management/application/sync/AppBinaryProcessor.onChangeCompletion(AppBinaryProcessor.java:428) 
at com/ibm/ws/management/repository/FileRepository.postNotify(FileRepository.java:1764) 
at com/ibm/ws/management/repository/FileRepository.update(FileRepository.java:1309) 
at com/ibm/ws/management/repository/client/LocalConfigRepositoryClient.update(LocalConfigRepositoryClient.java:189) 
at com/ibm/ws/sm/workspace/impl/WorkSpaceMasterRepositoryAdapter.update(WorkSpaceMasterRepositoryAdapter.java:637) 
at com/ibm/ws/sm/workspace/impl/RepositoryContextImpl.update(RepositoryContextImpl.java:1886) 
at com/ibm/ws/sm/workspace/impl/RepositoryContextImpl.synch(RepositoryContextImpl.java:1831) 
at com/ibm/ws/sm/workspace/impl/WorkSpaceImpl.synch(WorkSpaceImpl.java:479) 
at com/ibm/ws/management/configservice/ConfigServiceImpl.save(ConfigServiceImpl.java:638) 
at sun/reflect/NativeMethodAccessorImpl.invoke0(Native Method) 
at sun/reflect/NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:79(Compiled Code)) 
at sun/reflect/DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43(Compiled Code)) 
at java/lang/reflect/Method.invoke(Method.java:618(Compiled Code)) 
at sun/reflect/misc/Trampoline.invoke(MethodUtil.java:68) 
at sun/reflect/GeneratedMethodAccessor25.invoke(Bytecode PC:40) 
at sun/reflect/DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43(Compiled Code)) 
at java/lang/reflect/Method.invoke(Method.java:618(Compiled Code)) 
at sun/reflect/misc/MethodUtil.invoke(MethodUtil.java:271) 
at javax/management/modelmbean/RequiredModelMBean.invokeMethod(RequiredModelMBean.java:1092) 
at javax/management/modelmbean/RequiredModelMBean.invoke(RequiredModelMBean.java:973) 
at com/sun/jmx/mbeanserver/DynamicMetaDataImpl.invoke(DynamicMetaDataImpl.java:231) 
at com/sun/jmx/mbeanserver/MetaDataImpl.invoke(MetaDataImpl.java:238) 
at com/sun/jmx/interceptor/DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:833) 
at com/sun/jmx/mbeanserver/JmxMBeanServer.invoke(JmxMBeanServer.java:802) 
at com/ibm/ws/management/AdminServiceImpl$1.run(AdminServiceImpl.java:1139) 
at com/ibm/ws/security/util/AccessController.doPrivileged(AccessController.java:118(Compiled Code)) 
at com/ibm/ws/management/AdminServiceImpl.invoke(AdminServiceImpl.java:1032) 
at com/ibm/ws/management/connector/AdminServiceDelegator.invoke(AdminServiceDelegator.java:139) 
at sun/reflect/NativeMethodAccessorImpl.invoke0(Native Method) 
at sun/reflect/NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:79(Compiled Code)) 
at sun/reflect/DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43(Compiled Code)) 
at java/lang/reflect/Method.invoke(Method.java:618(Compiled Code)) 
at com/ibm/ws/management/connector/soap/SOAPConnector.invoke(SOAPConnector.java:361) 
at com/ibm/ws/management/connector/soap/SOAPConnector.service(SOAPConnector.java:217) 
at com/ibm/ws/management/connector/soap/SOAPConnection.handleRequest(SOAPConnection.java:64) 
at com/ibm/ws/http/HttpConnection.readAndHandleRequest(HttpConnection.java:742) 
at com/ibm/ws/http/HttpConnection.run(HttpConnection.java:528) 
at com/ibm/ws/util/ThreadPool$Worker.run(ThreadPool.java:1497)