Delayed loads appears to be IDoc related

Question

Experts
We have begun to have issues with loads taking much longer times than normal on random occurrences.  We have processes that generally take 5-10 minutes but in the past couple weeks they can sometimes take over and hour for BI to start recieving records.  
What I have observed is the InfoPackage  kicks off the BIREQU_* job starts in ECC within a few second.  This job runs for 30-90 seconds and completely successfully.  Then as I monitor in RSMO no records are passed and the Extraction (messages):... is not updated for over an hour then all the data shows up all at once and finishes processing in a couple of minutes.  We are not recieving many records in general 1,000 - 50,000 records.
My question what could be causing this delay and where should I look to see the hang up?  Originally we thought it was because we didnt have load balancing configured but that change in went in over the weekend and we are still having the issue.

Answer 1

Hello Alex,
The problem may be caused by insufficient number of DIA work        
processes defined in your systems. You must make sure that you have a     
sufficient number of dialog work processes available to process the       
IDOC's.                                                                               
You will need to add more DIA work processes to your BW and R/3 systems.  
DIA work processes are necessary for the processing of IDOC's. If there   
are not sufficient DIA work processes, the load may not finish, and stay  
in status 'yellow'. SAP Note 561880 gives more information about this:                                                                               
1. Make sure there is always sufficient DIA, that is, at least 1 DIA    
     more than all other work processes altogether, for example, 8 DIA    
     for a total of 15 work processes (see also note 74141).              
Best Regards,
Des