WCF-Custom performance problem with large response messages

Question

We're trying to debug a performance issue in Biztalk 2013 when using a WCF-Custom adapter to call en external WCF-enpoint.
From a Biztalk orchestration we're calling en external WCF-service to retrieve an xml message sometimes containing a lot of Base64 encoded data. The response message can be up to 10Mb in size. The send port is very slow in retrieving the response
and a 10Mb message can take up to 3min to retrieve. For comparison we've made a console program with the same service reference and binding as the Biztalk adapter uses and we can retrieve the same message in about 3 seconds.
The WCF is using binary encoding over http and we've set the maxMessageSize, maxBufferSize and maxBufferPoolSize to Int32-MaxValue. We realise that using Biztalk there will be overhead because the message is put into the message box but we're unsure how
to improve the performance of the send port.
Any suggestions?

Answer 1

Hello,
There are certain Optimization you can do with your BizTalk.
1)The first thing that I would do is to check the BizTalk SQL server jobs are running correctly
 (SQL Sever Mgmt Studio –> SQL Server Agent –> Jobs). Lookout for the jobs with the word “CleanUp” in them.
2)Another check that you could do is to verify the entries in the Spool table
 (Database[@Name='BizTalkMsgBoxDb']/Table[@Name='Spool']). Ideally, the number of entries should not be HUGE
 (as in not over 100/200 entries)
3) Create seperate host and host handler for your send Port.
4) Set The MaxReceiveInterval from adm_service(BizTalk Management DB) class table 100 ms from 500(By default).
5)Increased the Throttling Settings Internal message queue size to 1000 from 100 In new Application Host.
6)Set the Maximum number of messaging engine threads per CPU to 40 (By default it is 20).
7) Add Max connection in your BTSNTSVC.exe.config file
<system.net>
            <connectionManagement>
                        <add address
= “*” maxConnections = “300” />
            </connectionManagement>
</system.net>
For other setting you can look for BizTalk Optimization Guide
http://www.microsoft.com/en-ca/download/details.aspx?id=10855 
Above setting are for generic performance enhancement purpose.
Note: You can verify through Orchestration debugger or Orchestration tracing how much time send port is and pipeline is taking to publish the message to Biz Talk again .
These will give you better picture what more settings you need to apply .
Thanks
Abhishek