Modifying spring Batch to use Zookeeper

[tnine]

Hi all,
I'm new to Spring Batch, but I've used Quartz quite a bit in the past. We have a distributed environment that uses ZooKeeper to perform leader election, as well as keep grid jobs synchronized across our cluster. I've had a quick read of the documentation, has anyone implemented a grid partitioner that will work with Zookeeper? If not, where can I start?

Thanks,
Todd

[Dave Syer]

I never saw anyone using ZooKeeper for partitioning, but I'd be interested to see if it works. You would probably only need to implement the PartitionHandler interface. There is one implementation in the framework, one in Spring Batch Integration (https://src.springframework.org/svn/...ion/partition/ trunk is broken right now during an upgrade to Spring Integration 2.0, but the 1.0 release works), and a couple at http://github.com/dsyer, if you want to browse and see how they work. It is normally pretty simple (I've done about 6 or 7 implementations and none was more than a few lines).

[erezmazor]

Wrote a blog post about leader election with Zookeeper and Spring which also includes quartz support.