Advice needed on large volume of data coming from aRFC.

Question

Hi Experts,
Using NWDS 7.0.18, EP 7.00 SPS 18
I am calling an rfc to bring back a table structure to the front end and then I am building a tree hierarchy out of it. Everything was fine with small amounts of records (100-200).
But in real life, we will have approx 300,000 records coming in. As a test, we tried it with just 50,000 but the application wasnt able to cope. I just got the web dynpro spinning wheel for almost an hour and then nothing!
Can anyone provide me with some advice on how this can be resolved? Is there a way to preload the data before the user accesses the app? Can I bulk load small sections of data at a time?
Thanks in advance.
Marshall.

Answer 1

Hi,
As per my guess,
Most of the time is taking at recursive call and inner for loop at UI side.
Just put these statements and calcuate the time taking as below for both BAPI call and logic at WD side.
long before=System.currentTimeMillis();
long after=System.currentTimeMillis();
long totalTimeTaken=System.currentTimeMillis();
For example your method is
getDatafromBackend()
//Code for model execution
long before=System.currentTimeMillis();
long after=System.currentTimeMillis();
long totalTimeTaken=System.currentTimeMillis();
Similarly for your recursive logic also.
Using these checks you can findout..where is the issue.
Note if you are facing issue for 50,000 records..then check for 40000 first.
As per my analysis if you are calling the method recursively for 50,000 records.
*Then the for loop will execute 50,000 * 50,000 times. This is very minimum. There are many chances like one parent can have many childs. Those childs can have again childs. So this number will increate drastically based on the parent and child relationships in the data.*
Better not to use recursive for this much of data records. So dont populate the records at the beginning. Populate when user expands the parent.
Regards,
Charan