AMQP inbound gateway, unAck message count goes up, Messages not read by consumers

Hi all

We're using a the AMQP inbound gateway to read the messages from the queue and route those messages back to a web service API by using a WS outbound gateway. We noticed a strange behavior where after some time the messages do not reach the consumers at all. And the unacknowledged message count goes up.

We do not see any exceptions or warnings in the log, The only fix to recover from this state is to restart the module which will create queues once again. There are no straight forward steps to reproduce this, The system just gets in to this state on its own.

Appreciate any tips to troubleshoot this issue further.

Thanks

Best guess is the consumer threads are hung up someplace.

Next time it happens, take a thread dump (e.g. using jstack, or visualvm).