WCF called from Sharepoint - thread abort exception

Question

Hello,
we have an SP web part calling WCF service using simple http binding. SP and WCF are located on different servers in different countries, so not at the same machine. Using WCF we send/receive some files, which are processed at the WCF server site, parsed
and stored to database. It takes some time, of course, but usually not more than minute or 2. On development server it works normally but on production server we are facing problems like
System.Threading.ThreadAbortException: Thread was being aborted. at System.Net.UnsafeNclNativeMethods.OSSOCK.recv(IntPtr socketHandle, Byte* pinnedBuffer, Int32 len, SocketFlags socketFlags) at System.Net.Sockets.Socket.Receive(Byte[] buffer, Int32 offset,
Int32 size, SocketFlags socketFlags, SocketError& errorCode) at System.Net.Sockets.NetworkStream.Read(Byte[] buffer, Int32 offset, Int32 size) at System.Net.PooledStream.Read(Byte[] buffer, Int32 offset, Int32 size) at System.Net.Connection.SyncRead(HttpWebRequest
request, Boolean userRetrievedStream, Boolean probeRead) at System.Net.ConnectStream.ProcessWriteCallDone(ConnectionReturnResult returnResult) at System.Net.HttpWebRequest.GetResponse() at System.ServiceModel.Channels.HttpChannelFactory`1.HttpRequestChannel.HttpChannelRequest.WaitForReply(TimeSpan
timeout) at System.ServiceModel.Channels.RequestChannel.Request(Message message, TimeSpan timeout) at System.ServiceModel.Channels.ServiceChannel.Call(String action, Boolean oneway, ProxyOperationRuntime operation, Object[] ins, Object[] outs, TimeSpan timeout)
at System.ServiceModel.Channels.ServiceChannelProxy.InvokeService(IMethodCallMessage methodCall, ProxyOperationRuntime operation) at System.ServiceModel.Channels.ServiceChannelProxy.Invoke(IMessage message) at System.Runtime.Remoting.Proxies.RealProxy.PrivateInvoke(MessageData&
msgData, Int32 type) at DHI.FRMP.Sharepoint.Tasks.MCSPConnector.IMCSPConnector.TaskUpdate(TaskUpdateRequest request) at DHI.FRMP.Sharepoint.Tasks.TaskEditSave.TaskEditSave.btnSaveChanges_Click(Object sender, ImageClickEventArgs e)
or
System.Threading.ThreadAbortException: Thread was being aborted. at System.Threading.WaitHandle.WaitOneNative(SafeHandle waitableSafeHandle, UInt32 millisecondsTimeout, Boolean hasThreadAffinity, Boolean exitContext) at System.Threading.WaitHandle.InternalWaitOne(SafeHandle
waitableSafeHandle, Int64 millisecondsTimeout, Boolean hasThreadAffinity, Boolean exitContext) at System.Net.LazyAsyncResult.WaitForCompletion(Boolean snap) at System.Net.Connection.SubmitRequest(HttpWebRequest request, Boolean forcedsubmit) at System.Net.ServicePoint.SubmitRequest(HttpWebRequest
request, String connName) at System.Net.HttpWebRequest.SubmitRequest(ServicePoint servicePoint) at System.Net.HttpWebRequest.GetRequestStream(TransportContext& context) at System.Net.HttpWebRequest.GetRequestStream() at System.ServiceModel.Channels.HttpOutput.WebRequestHttpOutput.GetOutputStream()
at System.ServiceModel.Channels.HttpOutput.Send(TimeSpan timeout) at System.ServiceModel.Channels.HttpChannelFactory`1.HttpRequestChannel.HttpChannelRequest.SendRequest(Message message, TimeSpan timeout) at System.ServiceModel.Channels.RequestChannel.Request(Message
message, TimeSpan timeout) at System.ServiceModel.Channels.ServiceChannel.Call(String action, Boolean oneway, ProxyOperationRuntime operation, Object[] ins, Object[] outs, TimeSpan timeout) at System.ServiceModel.Channels.ServiceChannelProxy.InvokeService(IMethodCallMessage
methodCall, ProxyOperationRuntime operation) at System.ServiceModel.Channels.ServiceChannelProxy.Invoke(IMessage message) at System.Runtime.Remoting.Proxies.RealProxy.PrivateInvoke(MessageData& msgData, Int32 type) at DHI.FRMP.Sharepoint.Tasks.MCSPConnector.IMCSPConnector.GetTaskCatchmentList(GetTaskCatchmentListRequest
request) at DHI.FRMP.Sharepoint.Tasks.TaskAdd.ddlWaterRegion_SelectedIndexChanged(Object sender, EventArgs e)
We have already checked that the client is properly closed and disposed. We also know that the web service call is processed correctly (from the logs).
Streams are closed.
Sharepoint timeout for long operation is set to 3600.
WCF is hosted in windows service application, used .NET 4.0. WCF config:
<system.serviceModel>
<client />
<bindings>
<basicHttpBinding>
<binding name="StreamedHTTP" closeTimeout="04:01:00" openTimeout="04:01:00"
receiveTimeout="04:10:00" sendTimeout="04:01:00" maxBufferSize="2147483647"
maxReceivedMessageSize="2147483647" messageEncoding="Mtom" transferMode="Streamed">
<readerQuotas maxDepth="2147483647" maxStringContentLength="2147483647"
maxArrayLength="2147483647" maxBytesPerRead="2147483647" maxNameTableCharCount="2147483647" />
</binding>
</basicHttpBinding>
</bindings>
<services>
<service name="DHI.FRMP.MCSPConnector.MCSPConnector">
<endpoint address="" binding="basicHttpBinding" bindingConfiguration="StreamedHTTP"
contract="DHI.FRMP.MCSPConnector.IMCSPConnector">
<identity>
<dns value="localhost" />
</identity>
</endpoint>
<endpoint address="mex" binding="mexHttpBinding" contract="IMetadataExchange" />
</service>
</services>
<behaviors>
<serviceBehaviors>
<behavior>
<!-- To avoid disclosing metadata information,
set the values below to false before deployment -->
<serviceMetadata httpGetEnabled="True" httpsGetEnabled="False"/>
<!-- To receive exception details in faults for debugging purposes,
set the value below to true. Set to false before deployment
to avoid disclosing exception information -->
<serviceDebug includeExceptionDetailInFaults="True"/>
</behavior>
</serviceBehaviors>
</behaviors>
Client creation code
public static IMCSPConnectorChannel CreateWCFclient(out ChannelFactory<IMCSPConnectorChannel> factory)
BasicHttpBinding myBinding = new BasicHttpBinding();
TimeSpan timeOut = new TimeSpan(4, 1, 0);
int maxSize = 2147483647;
myBinding.CloseTimeout = timeOut;
myBinding.OpenTimeout = timeOut;
myBinding.ReceiveTimeout = timeOut;
myBinding.SendTimeout = timeOut;
myBinding.AllowCookies = false;
myBinding.BypassProxyOnLocal = false;
myBinding.HostNameComparisonMode = HostNameComparisonMode.StrongWildcard;
myBinding.MaxBufferSize = maxSize;
myBinding.MaxBufferPoolSize = maxSize;
myBinding.MaxReceivedMessageSize = maxSize;
myBinding.MessageEncoding = WSMessageEncoding.Mtom;
myBinding.TextEncoding = System.Text.Encoding.UTF8;
myBinding.TransferMode = TransferMode.Streamed;
myBinding.UseDefaultWebProxy = true;
myBinding.ReaderQuotas.MaxDepth = 128;
myBinding.ReaderQuotas.MaxStringContentLength = maxSize;
myBinding.ReaderQuotas.MaxArrayLength = maxSize;
myBinding.ReaderQuotas.MaxBytesPerRead = maxSize;
myBinding.ReaderQuotas.MaxNameTableCharCount = maxSize;
ChannelFactory<IMCSPConnectorChannel> myFactory = null;
//SPSecurity.RunWithElevatedPrivileges(delegate()
var constants = new Settings(SPContext.Current.Site);//siteelev);
string endpointAddress = constants.WcfUrl;
EndpointAddress myEndpoint = new EndpointAddress(endpointAddress);
myFactory = new ChannelFactory<IMCSPConnectorChannel>(myBinding, myEndpoint);
IMCSPConnectorChannel channel = myFactory.CreateChannel();
factory = myFactory;
return channel;
Client and factory are both disposed after each usage.
this is the simplified code with some comments
IMCSPConnectorChannel channel = CommonFunctions.CreateWCFclient();
using (var proxy = channel.Wrap<IMCSPConnectorChannel>())
var svcClient = proxy.BaseObject;
try
// do something - works ok
if (success)
//try update
try
//time consuming WCF method - sometimes 2 minutes, however it passes and in the WCF log is record about it just a second before it crashes back here
svcClient.TaskUpdate(new TaskUpdateRequest(_taskID));
catch (FaultException fe)
//some processing here - not reached
catch (Exception ue)
//here it goes to - exception is caught and
success = false;
siteelev.WriteLogError(String.Format("Task '{0}' - task update fail on general exception: {1}", _taskID, ue.ToStringWithInnerExceptions()));
//previos line is processesd, no more code exists after that
//go back to folder if WCF returns success
if (success)
//not reached (success has been set to false when it crashed)
else
siteelev.WriteLogInfo("Some log text");
//this is ALSO NOT reached!! why, I don't understand
catch (Exception ee)
// it goes to here!! why ? - the exception has been already handled!
throw;;
I don't understand why it goes to the second catch when the exception has been already hadled in previous catch and why it doesn't go into success=false block.
Any idea what can be wrong?
Many thanks
Filip

Answer 1

Hi,
thanks for your reply. Now it seems that everything works (I'm still keepng my fingers crossed ;-)
What we did:
1) to the page I added 
protected void Page_Load(object sender, EventArgs e)
                this.Page.Server.ScriptTimeout = 3600;
2) to WCF confing at server side we added 
 <serviceThrottling maxConcurrentCalls="100" maxConcurrentSessions="100"/>
But if this is what helped, I don't know. The timeout had to be already set in cofig files, but this is only what the SP server administrator claimed, I haven't done it personally. This seems to be much clear
for me.