SFTP outbound channel adapter - delete source files?

[kay]

Is it possible to wire things up in a way that an SFTP outbound channel adapter will delete the source files after uploading them?

I am aware of the file transformer trick, but since the files I'm uploading are several hundred MB in size, I'd rather not convert them to bytes/string prior to uploading

[oleg.zhurakousky]

You can do this

<int:publish-subscribe-channel id="inputChannel"/>
	
<int-sftp:outbound-channel-adapter id="sftpOutboundAdapterWithExpression"
				session-factory="sftpSessionFactory"
				channel="inputChannel"
				order="1" . . ./>
				
<int:service-activator input-channel="inputChannel" order="2" expression="payload.delete()"/>

In the above, the input-channel is a synchronous pub-sub with two subscribers.
However as you can see the order of the Message dispatch to the subscribers is maintained via 'order' attribute of the two subscribers. In other words SFTP adapter will always be the first one to receive the Message and the deleting service-activator will always be the second and *only* after the first one completes successfully otherwise the message won't even reach the service-activator.
Give it a shot and let me know.
Although I am thinking we might need to make it simpler, so feel free to raise a feature request and we'll see how it goes

[oleg.zhurakousky]

Actually i just realized that file.delete() method returns boolean which means service-activator will be looking to where to send a reply message. So here you can do to things. If you want to ignore the boolean value then simply define your output-channel as 'nullChannel'

<int:service-activator input-channel="inputChannel" output-channel="nullChannel" order="2" expression="payload.delete()"/>

Or if you do care you can send it to a predefined channel where you can check for boolean value and do whatever it is you want with it.

[kay]

Thank you for the quick reply! My sftp XSD (using 2.0.3.RELEASE?) doesn't seem to have an order attribute defined, and only setting order="2" on the service-activator didn't seem to have the desired effect.

However I could implement the same idea with two channels and a wire-tap like so:

    <integration:channel id="outboundFiles">
        <integration:interceptors>
            <integration:wire-tap channel="outboundFilesToSftp"/>
        </integration:interceptors>
    </integration:channel>

    <integration:channel id="outboundFilesToSftp"/>

    <sftp:outbound-channel-adapter id="sftpOutboundAdapter"
                                   session-factory="sftpSessionFactory"
                                   channel="outboundFilesToSftp"
                                   charset="UTF-8"
                                   remote-directory="output-dir"/>

    <integration:service-activator id="cleanupAfterUpload"
                                   input-channel="outboundFiles"
                                   expression="payload.delete()"
                                   output-channel="nullChannel"/>

The wire-tap copies the message in preSend, therefore the "tap" channel will receive its copy first - that must be our outbound channel adapter.

Thanks again!

[Gary Russell]

'order' was added to the (s)ftp adapters recently...

https://jira.springsource.org/browse/INT-1848

If you can update to 2.0.4.BUILD-SNAPSHOT you should be able to use it.

[oleg.zhurakousky]

Thanks Gary!

Yeah, wiretap would work, but we generally don't recommend to use wiretap for things other then logging/auditing. See if you can use snapshot build as Gary suggested. We'll be releasing 2.0.4 in few days anyway.

[kay]

Thanks! I think I can wait until 2.0.4 is out anyway.

Is there a good way to go and pick up *specific* named files from a remote SFTP / FTP location from a trigger event? One way to do it is to build a service activator that opens a session directly on receipt of a list of files to fetch. It could even be built as an content enricher type filter which receives a list of file names and adds the files to the outgoing message. Is there anything along these lines already in SI?

[rcrathore]

Thanks Oleg. The pub-sub channel with 2 subscribers approach works great! I am using 2.0.5.