Loading specific records using SFTP

[Ms. E]

Is there a way to customize the SFTP task to only ready records that
are greater than the last confirmed load date? Right now it's loading
everything old and new. Thanks.

[Ivan Peev]

Hi Erica,

Yes, it is possible. Here is one way you can accomplish the
requirement:

1. Insert SFTP Task and select action "Get remote files list". Select
variable (type object) to store result list.
2. Insert "for each container" and select to iterate over the variable
from step 1.
3. Setup variable of type object and use this variable as iterator
item in the container. Each iterated item is of type IFileInfo
interface. The documentation is available here:
http://www.cozyroc.com/ssis/common-api#IFileInfo
4. Setup a boolean variable called "DownloadFile".
5. Insert a script inside the container, which will analyze current
iterated item ModifiedTime. If the date is greater than last confirmed
load date, set "DownloadFile" variable to TRUE. Otherwise set to
FALSE.
6. Insert SFTP Task inside the container and select "Receive files"
action. Select IsRemoteVariable to TRUE and for "RemoteVariable"
parameter select the current iterated item variable (from step 3).
7. Connect the script from step 5 with success constraint to the SFTP
Task from step 6. Right-click on the constraint and select Edit. For
Evaluation operation select: Expression and Constraint. For the
expression specify: @DownloadFile

You may also check this sample package for demonstration how to
iterate over remote file information: http://www.cozyroc.com/download/SampleSftpIteration.zip