WCF-SAP vs SFTP Adapter

Question

Hi All,
We've an existing interface that picks up IDocs from SAP using WCF-SAP adapter, these IDocs contain updates to data that are in turn subscribed by two other SAP systems via couple of Send Ports using the same WCF-SAP adapter. In production we've been facing
performance issues with this design as when there are mass updates in SAP, they push up to 7 to 10K IDocs through, which BizTalk struggles with and that also creates issues for SAP as the queue is not read in quick time which starts building up and creates
issues on the source system.
Now one of the solution proposed for above problem is to use a file based adapter like FILE, SFTP etc. where SAP will publish IDocs as flat files, I believe that'll solve the problem of backlog building on SAP queue and SAP can continue to write files without
impacting by BizTalk not picking them up but would it help in inside BizTalk performance as well? or we'll have to batch the files in using adapter properties (i think it works on SFTP adapter) say take in 100 files every 30 seconds? Any other solution which
can speed this up?
Thanks
Syed

Answer 1

I was just reading this
Restrict the number files Picked up by BizTalk FTP Adapter msdn
thread and it says
"Not possible, the Maximum Files setting only controls how BizTalk creates the message batch
to write them into SQL.  This also applies to the File adapters Number of messages in a batch"
So , you need to implement some kind of controller pattern in your solution to manage this floodgate. 
Have a read of
How to implement Concurrent FIFO Processing in BizTalk technet wiki article, this for FIFO but this may give some idea to write a controller.
Greetings,HTH
Naushad Alam
When you see answers and helpful posts, please click Vote As Helpful, Propose As Answer, and/or
Mark As Answer
alamnaushad.wordpress.com