What are you wiring up? If you are wiring up extremely fine grained Swing components, you're really using Spring XML for something it was not intended to be used for.
I would recommend at least taking a look at how the Spring Rich project recommends externalizing GUI configuration (via the Petclinic sample), as it strikes a nice balance--one leveraging Spring's configuration mechanism for the declarative definition of application command bars and views (somewhat coarse grained), while delegating to java-coded component factories encapsulating creation of complex controls assembled from lower-level Swing widgets. Even if you don't use it now, you can take away a considerable amount of lessons learned on building Swing apps atop Spring's IoC container.
Core Spring Development Team