Using RSCRM_BAPI with Huge Data Volume

Hi,
I am using RSCRM_BAPI to extract a query output into a database table. But, the query returns a large volume of data. I am not sure whether RSCRM_BAPI works fine when data volume is huge. Please suggest whether using this will be a good design or any other method is available to take care of such a scenario.
Regards,
Dibyendu

I have used RSCRM_BAPI when the records were exceeding 65000(limitations of excel) and it worked for me...
I think should work for you also....
But there are some limitations....
like u cannot see texts etc,,,,
Assign point if it helps,
Ajay

Similar Messages

Anyone using durable topics with high data volumes?

We're evaluating JMS implementations, and our requirements call for durable subscribers, where subscribers can go down for several hours, while the MQ server accumulates a large number of messages.
Is anyone using Sun MQ in a similar scenario? How is it holding up?
Sun folks, do you know of production installations that use durable topics with high data volumes?
thanks,
-am

We are using a cluster of Sun�s JMS MQ 3.6 with durable message queues and persistent topics. In a 4 hour window each night we run over 20,000 messages through a queue. The cluster sits on two Windows servers, the producer client is on a AIX box and the consumer is running on a iSeries. Within the 20,000 messages are over 400,000 transactions. Each message can have many transactions. Yes, the iSeries client has gone down twice and the producer continued with the message queue pilling up, as it should. We just use the topic to send and receive command and status inquiries to the clients. So every thing works fine. We have only had a couple issues with a client locking and that maybe fixed with sp3, we are in the process of installing that. The only other issue we have had is that once in a while the producer tries to send an object message with to many transactions and it throws and JMS exceptions. So we put a cap on the size of the messages, if its over a set number of transactions it send each transaction as separately, otherwise it sends all the transactions in one object type (linked list of transactions) message. Compare the cost of this JMS system with Tibco or Sonic and you�re looking at big savings.

Error while using RSCRM_BAPI with remote cubes

Hi,
We are getting short dump while trying to use RSCRM_BAPI with hierarchies i.e.display hierarchies to extract data to a flat file.
We do get a warning that display hierachies are not longer supported in 2004s with RSCRM_BAPI and have been going on and on with SAP development. They are saying we need to find alternatives.
I wanted to know if anybody has tried using display hierarchies with RSCRM_BAPI in 2004s if not then I would like to know what are my options in getting a flat hierarchy report on to a flat file?
I dont think infospoke supports flat hierarchy extracts as infoproviders dont store hierarchy information.
Thanks

Heres my thought -
to use Bex Broadcaster to download the information,am not sure if RSCRM_BAPI is replaced by new functionality ,might wait for SAP to confirm.
<b>Key capabilities:-</b>
1)The right information:Based on BExqueries, views, workbooks, Web applications & enterprise reports
2)In different formats:HTML, MHTML, PDF, ZIP, printer formats, online links, SAP alerts
3)To the right people:e.g., single users, groups, distribution lists, user-specific or role-specific (incl. non-SAP users)
4)In different channels:e-mail, Portal, BExPortfolio (unified access based on Knowledge Management folders), collaboration rooms, Universal Work List
At the right time:event driven, exception driven, ad-hoc, scheduled
Bex Broadcaster + Information Broadcasting
Note 760775 - Settings for Information Broadcasting
Functions of Bex broadcaster
http://help.sap.com/saphelp_nw04/helpdata/en/bf/220c40ac368f5ce10000000a155106/frameset.htm
Hope it Helps
Chetan
@CP..

Huge data volume

Hi All,
My scenario Portal-PI-ECC.
A huge volume data (6-8 GB) need to be transferred between Portal to ECC(Asynchronous).Could anyone suggest me on which method is the best to go .
Portal=WSDL or JAVA Proxies?
ECC=RFC/ABAP Proxies?
Thanks in Advance.
Regards,
Lavanya.B

Hi,
6-8 GB is really lot of data. Is it possible to chunk it into piecesa and send?
It is better to control at sending side to avoid facing performance related issues in PI.
Have a look at this discussion: Re: File with huge data
Regards
Ramesh

Use of "with master data & with out master data" at DTP update level

Hello experts,
In DTP, I check "with out master data". When I try to send corresponding transactional data, It is showing SID related error. Can anybody suggest what is the use of "with master data & with out master data" at DTP level.
Thanks in advance,
Zakir.

HI
HI in DTP level If you set this indicator, the system terminates the update of the request if no values are available for a data record.
Load the relevant master data before you load the transaction data.
If you set this indicator, the system terminates activation if master data is missing and produces an error message.
If you do not set this indicator, the system generates any missing SID values during activation.
In DataStore maintenance, if you do not set the SIDs Generation upon Activation indicator, the No Update without Master Data indicator in the DTP has no effect.
thx
vijju

Any Examples of using ActiveCollectionModelDecorator with POJO data control

Are there any Examples of using ActiveCollectionModelDecorator with POJO data control in any of the sample packs?

OK, here's an quick example. Create a new Windows Forms application and add a ScatterGraph and a Label to the form. Add a cursor to the ScatterGraph, then add the code below to the form. This generates 50 random data points when the form is loaded and plots them, then uses the cursor's AfterMove event to display the current X and Y positions in the label. Here's the code:
Private Sub OnFormLoad(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles MyBase.Load
Const dataLength As Integer = 50
Dim xData(dataLength - 1) As Double
Dim yData(dataLength - 1) As Double
Dim rnd As Random = New Random
For i As Integer = 0 To dataLength - 1
xData(i) = i
yData(i) = rnd.NextDouble() * 10
Next
ScatterGraph1.PlotXY(xData, yData)
End Sub
Private Sub OnAfterMoveXYCursor(ByVal sender As Object, ByVal e As NationalInstruments.UI.AfterMoveXYCursorEventArgs) Handles XyCursor1.AfterMove
Label1.Text = String.Format("({0}, {1})", e.XPosition, e.YPosition)
End Sub
Hope this helps.
- Elton

Misalignement in Excel sheet,while downloading reports with huge data

Hi,
While downloading reports in excel with huge volume of data ,we are getting misalignments in the excel sheet(some data comes in wrong rows). Can you please suggest what could be the reason and how to correct it.
Regards,
Roopak

Hi,
If you are using Office 2003, then you cannot download morethan 65000+. However if you use Office 2007, I think it gives you somewhere around 400000 records. (I didnt scroll below that!!!). Also the columns are morethan IV.
However assuming that, even that version can have limitation, you can always download your data in a wordpad/notepad/textpad etc which are basically text editing tools. They dont have any such row or column restrictions.
Once downloaded, you can randomly split them into some x number of files, based on the number of records and then open the same documents using xls sheet using tab value as delimiter. Now the alignment will be perfect in the excel sheet.

Using RSCRM_BAPI to convert data from Query and load into PSA to DSO

Hi Experts,
I have a complex query which is being executed in BeX.
I need to go in the reverse direction and extract the data from the Query and load into the PSA and then to a DSO.
I am using RSCRM_BAPI for this purpose and have got data into the extract table successfully.
But , my query has some variable screen wherein we need to give some inputs for selection.
I have create those Infoobjects and put them in the DSO.
How do I capture these inputs of the selection screen for storing in fields of my DSO as the Extract table does not store these inputs ???

write the whole insert query desired by you with the help of excel formulas.they are very easy or google 'how to use excel formulas".
then copy the fromula to whole set of data in excel fields.
run the insert query in excel as batch.
i hope this helps.

In labview 64bit, Use PostLVUserEvent with user data cluster, unhandled exception occured.

My labview is Labview 2009 64 bit, I use PostLVUserEvent to post message with cluster data to labview. The following is the struct in dll:
typedef struct {
   int32 dimSize;
   uInt8 elt[1];
} TD1DINT8;
typedef TD1DINT8 **TD1DINT8Hdl;
typedef struct{
   int32       interruptSource;
   TD1DINT8Hdl portData;
}DIInterruptData, *PDIInterruptData, **HDIInterruptData;
In labview, the DIInterruptData corresponds to a cluster, in which there are a int32 integer and a uint8 array.
It works well in labview 32bit. But in labview 64bit, unhanlded exception occured. why?

Hi Danil,
when complaining about double-posts one should provide a link to the other thread to guide other users...
Best regards,
GerdW
CLAD, using 2009SP1 + LV2011SP1 + LV2014SP1 on WinXP+Win7+cRIO
Kudos are welcome

How to update a table with huge data

Hi,
I have a scenario where I need to update tables that are having huge data (each table is having more than 10,00000)
I am writing this update in PLSQL block.
Is there any way to improve the performance of this update statement? Please suggest...
Thanks.

user10403630 wrote:
I am storing all tables and columns that needs to be updated in tab_list and forming a dynamic qry.
for i in (select * from tab_list)
loop
v_qry := 'update '||i.table_name||' set '|| i.column_name ' = '''||new_value||'''' ||' where '||i.column_name = ''||old_value||'''';
execute immediate v_qry;
end loop;Sorry to say so but this code is aweful!
Well the only thing to make this even more slow would be to add a commit inside the loop.
Some advices. But I'm not sure which one works in your case.
The fastest way to update a million rows is: write a single update statement. On typical systems this should only run for like a couple of minutes.
if you need to update several tables then write a single update for each table.
If you have different values that need to be updated then find a way how to consider those different values in a single update or merge statement. Either by joining another table or by using some in-lists.
e.g.
update myTable
set mycolumn = decode(mycolumn
                                 ,'oldValue1','newvalue1'
                                 ,'oldValue2','newvalue2'
                                 ,'oldValue3','newvalue3')
where mycolumn in ('oldValue1','oldvalue2','oldvalue3'....);If you need to do this in pl/sql then
1) use bind variables to avoid hard parsing the same statement again and again
2) use bulk binding to avoid pl/sql context switches

I Want to graph useing MSGraph with array data

Hi..
I need to skill to graph using the msgraph with array data
My forte version 2.0h
E-MAIL ADDRESS : [email protected]
TEL(C) : 02)273-3131(5233), 0331)40-8366(ÇöÀç ¿©±â ÀÖ½¿)
PAGER : 015-959-9390
HAND PHONE : 011-411-9395
To unsubscribe, email '[email protected]' with
'unsubscribe forte-users' as the body of the message.
Searchable thread archive <URL:http://pinehurst.sageit.com/listarchive/>

This #pdfloc data is generated by RMSDK when user highlight (annotation) pdf and keep it in XML format in file system: E.g.
<annotation y="-116" isvisible="False" x="-110" width="220" height="100">
        <dc:identifier>urn:uuid:DF061693-A668-49DF-A20B-DE243C463919</dc:identifier>
        <dc:date>2015-03-02T12:04:53Z</dc:date>
        <dc:creator>creator id</dc:creator>
        <dc:title>Page 4, 02-Mar-2015 5:34 pm</dc:title>
        <target>
            <fragment start="#pdfloc(7f54,3,37,0,0,0,0,1)" end="#pdfloc(7f54,3,37,3,1,0,1,1)">
                <text>by Matt</text>
            </fragment>
        </target>
        <content>
            <dc:date>2015-03-02T12:04:53Z</dc:date>
            <text></text>
        </content>
</annotation>

Unable to use transactions with System.Data.OracleClient data provider

I am using VS2008, System.Data.OracleClient, Oracle 10g, and ODAC 10.2.0.20. I haven't been able to get transactions to work. When I use 'connection.BeginTransaction()', the rollback doesn't work. When I use TransactionScope, the output parameter is always DBNull. Any ideas/comments?
Here's the sample code:
// #define ENABLE_TRANSACTION // failure is 'rollback not working'
#define ENABLE_TRANSACTION_SCOPE // failure is 'no output parameter value'
using System;
using System.Collections.Generic;
using System.Data;
using System.Text;
using System.Data.OracleClient;
#if ENABLE_TRANSACTION_SCOPE
using System.Transactions;
#endif
namespace TestOracleTransaction
class Program
static void Main(string[] args)
#if ENABLE_TRANSACTION_SCOPE
using (TransactionScope scope = new TransactionScope())
#endif
string connectionString = "Data Source=ORADEV;User ID=user;Password=pwd";
using (OracleConnection connection = new OracleConnection(connectionString))
try
connection.Open();
#if ENABLE_TRANSACTION
using (OracleTransaction transaction = connection.BeginTransaction())
#endif
try
#if ENABLE_TRANSACTION_SCOPE
if (Transaction.Current == null)
throw new ArgumentException("no ambient transaction found for OracleClient");
#endif
OracleCommand command = connection.CreateCommand();
#if ENABLE_TRANSACTION
command.Transaction = transaction;
#endif
command.CommandType = CommandType.StoredProcedure;
command.CommandText = "TIS.P_TIS_GATEWAY_INFO_ADD";
OracleParameter param = command.CreateParameter();
param.ParameterName = "p_gateway_id";
param.Direction = ParameterDirection.Input;
param.DbType = DbType.Int64;
param.Value = 18;
command.Parameters.Add(param);
param = command.CreateParameter();
param.ParameterName = "p_info_id";
param.Direction = ParameterDirection.Input;
param.DbType = DbType.Int64;
param.Value = 79;
command.Parameters.Add(param);
param = command.CreateParameter();
param.ParameterName = "p_user";
param.Direction = ParameterDirection.Input;
param.DbType = DbType.String;
param.Value = "spms";
command.Parameters.Add(param);
param = command.CreateParameter();
param.ParameterName = "p_gateway_info_id";
param.Direction = ParameterDirection.Output;
param.DbType = DbType.Int64;
param.Size = sizeof(Int64);
command.Parameters.Add(param);
int count = command.ExecuteNonQuery();
object value = command.Parameters["p_gateway_info_id"].Value;
long id = (value == DBNull.Value) ? -1 : Convert.ToInt64(value);
if (id < 0)
// FAILURE - no output parameter value when TransactionScope enabled
throw new ArgumentException("no return value");
#if ENABLE_TRANSACTION
// FAILURE - rollback doesn't work when Transaction enabled
transaction.Rollback();
#endif
#if ENABLE_TRANSACTION_SCOPE
scope.Complete();
#endif
catch (Exception ex)
System.Console.WriteLine("ERROR: " + ex.Message);
#if ENABLE_TRANSACTION
transaction.Rollback();
#endif
finally
if (connection.State == ConnectionState.Open)
connection.Close();
}

Hi,
First, this is not the place for questions with System.Data.OracleClient, this is the Oracle Data Provider for .NET forum. Having said that I went ahead and tested your code with some slight modifications because you did not provide the stored procedure information. I am assuming your stored procedure is doing some sort of DML since you are using transactions and attempting to commit and rollback.
I tested the following with both Transaction scope and a local transaction object and it worked fine with System.Data.OracleClient. I provided the create table and stored procedure I used.
Observations
========
When using transaction scope, a distributed transactions was executed and the data was inserted and returned in the output variable.
From console
p1 value is Hello World
From SQL Plus
SQL> select * from foo;
C1
Hello World
When using a local transaction, the DML was not inserted when calling rollback and when I changed it to commit, the row was inserted successfully.
Maybe you can test the simple foo example below to see if it works for you. Maybe there is something going on in your SP that is causing your specific observations.
The code I posted at this point is using local transaction and calling transaction.commit(), rollback is commented out. But I tested all scenarios and they worked as expected.
HTH
Jenny
#define ENABLE_TRANSACTION // failure is 'rollback not working'
//#define ENABLE_TRANSACTION_SCOPE // failure is 'no output parameter value'
using System;
using System.Collections.Generic;
using System.Data;
using System.Text;
using System.Data.OracleClient;
#if ENABLE_TRANSACTION_SCOPE
using System.Transactions;
#endif
create table foo (c1 varchar2(50));
create or replace procedure getstr (p1 out varchar2) as
begin
insert into foo(c1) values ('Hello World') returning c1 into p1;
end;
namespace TestOracleTransaction
class Program
static void Main(string[] args)
#if ENABLE_TRANSACTION_SCOPE
using (TransactionScope scope = new TransactionScope())
#endif
string connectionString = "Data Source=orcl;User ID=scott;Password=tiger";
using (OracleConnection connection = new OracleConnection(connectionString))
try
connection.Open();
#if ENABLE_TRANSACTION
using (OracleTransaction transaction = connection.BeginTransaction())
#endif
try
#if ENABLE_TRANSACTION_SCOPE
if (Transaction.Current == null)
throw new ArgumentException("no ambient transaction found for OracleClient");
#endif
OracleCommand command = connection.CreateCommand();
#if ENABLE_TRANSACTION
command.Transaction = transaction;
#endif
command.CommandType = CommandType.StoredProcedure;
command.CommandText = "SCOTT.GETSTR";
OracleParameter param = command.CreateParameter();
param.ParameterName = "p1";
param.Direction = ParameterDirection.Output;
param.DbType = DbType.AnsiString;
param.Size = 20;
command.Parameters.Add(param);
int count = command.ExecuteNonQuery();
object value = command.Parameters["p1"].Value;
Console.WriteLine("p1 value is {0}",value.ToString());
#if ENABLE_TRANSACTION
// FAILURE - rollback doesn't work when Transaction enabled
transaction.Commit();
//transaction.Rollback();
#endif
#if ENABLE_TRANSACTION_SCOPE
scope.Complete();
#endif
catch (Exception ex)
System.Console.WriteLine("ERROR: " + ex.Message);
#if ENABLE_TRANSACTION
transaction.Rollback();
#endif
finally
if (connection.State == ConnectionState.Open)
connection.Close();
}

Performance: How to manage large reports with high data volume

Hi everybody,
we actually make some tests on our BO server system, to define limitations and oppertunities. Among other things we constructed a large report with a high data volume (about 250.000 data records).
When executing the query in SAP Query Designer it takes about 10 minutes to display it. In Crystal Reports we rebult the row and column structure of the query. The data retrieval in Crystal Reports Designer last about 9 minutes - even faster as in the query.
Unfortunately in BO InfoView the report is not displayed. After 30 minutes of loading time we get a timeout error RCIRAS0244.
com.crystaldecisions.sdk.occa.managedreports.ras.internal.ManagedRASException:
Cannot open report document. ---
The request timed out because there has been no reply from the server for 600.000 milliseconds.
Also a refresh of an report with saved data is not possible.
Now we are asking us some questions:
1. Where can we set the timeout for InfoView to a value larger than 30 minutes?
2. Why is InfoView so slow compared to Crystal Designer? Where is the bottleneck?
3. Whats the impact of SAP single sign-on compared to Enterprise logon on the performance?
Thanks for any helps and comments!
Sebastian

Hi Ingo,
thank you for your reply.
I will check the servers and maybe change the time limits.
Unfortunately we have a quite slow server system that probably cause this timeout. In CR Designer we have no problems, its really quick. Is it to expect that CR Designer and InfoView have almost the same performance?
Another nice point: When we execute the query in SAP BEx Query Designer it takes about 10 minutes to open it, in Crystal Designer it needs just about 5-6 minutes. We integrated exactly the same fields in the report, which exist in die SAP BEx query.
What may cause the difference?
- Exceptions and conditions in the query?
- Free characteristics in the query?
- anything else?
Best regards,
Sebastian

Using LoadVars with XML data

All the examples in the text books, etc. show the LoadVars
object being used with a .txt file. Can I use it with a .xml file
or not? I have tried but the output panel just shows rubbish
data!

LoadVars is not XML. You need to get a textbook that
discusses XML and
Flash.
The Flash documentation has excellent example for both
LoadVars and XML.
LoadVars:
http://livedocs.macromedia.com/flash/8/main/00002336.html
XML:
http://livedocs.macromedia.com/flash/8/main/00002879.html
With XML you have the additional task of parsing out the
data.
Lon Hosford
www.lonhosford.com
Flash, Actionscript and Flash Media Server examples:
http://flashexamples.hosfordusa.com
May many happy bits flow your way!
"Goo101" <[email protected]> wrote in
message
news:ec1iu6$m6j$[email protected]..
> All the examples in the text books, etc. show the
LoadVars object being
> used with a .txt file. Can I use it with a .xml file or
not? I have tried
> but the output panel just shows rubbish data!

How to use EVS with different data in each row, in a Java Web Dynpro table?

Hi all,
I am using EVS in a column of java web dynpro table.
Let's say the name, and context attribute, of this column is column1.
It's filled dynamically using an RFC, that uses as input parameter the value of another column, and related context attribute, from the same table (Let's call it column2). Obviously, from the same row. So, in other words: the values of the EVS in column1 of row1, are dependent of the value of column2 of row1. And the values of the EVS in column1 of row2, are dependent of the value of column2 of row2. And so on... Hope i could explain myself ok.
The code I'm using works great for filling the EVS dynamically:
IWDAttributeInfo attrInfo = wdContext.nodeDetail().getNodeInfo().getAttribute(nodeElement.COLUMN1);
ISimpleTypeModifiable siType = attrInfo.getModifiableSimpleType();
IModifiableSimpleValueSet<String> value = siType.getSVServices().getModifiableSimpleValueSet();
value.clear();
if(this.initRFC_Input(nodeElement.getColumn2())){
     for (int i = 0; i < wdContext.nodeRFCresult().size(); i++){
          value.put(wdContext.nodeRFCresult().getRFCresultElementAt(i).getLgort()
             , wdContext.nodeRFCresult().getRFCresultElementAt(i).getLgobe());
In this code, nodeElement is the context row of the table that is passed dynamically to the method when the value of colum2 is changed.
HOWEVER, the problem I'm having is that after executing this code, EACH NEW ROW that is added to the table has by default the same values as the first row, in the column1 EVS. And, for example, if I refresh the values of the column1 EVS in row 2, all EVS values in the other rows are also refreshed with the same values as the ones of EVS in row 2.
How can I make sure each row EVS has its own set of independent values, so they don't mess with each other?
Hope you guys can help me. And please, let me know if I didn't explain myself correctly!
Thanks!

I just did as you said (I think), but it's still having the same behaviour as before (same data for all EVS in the table).
Here´s what I did:
I
In node "Detail" (cardinality 0...n, singleton set to true), which is binded to the table, I created a child node named "Column1Values" wth cardinality 1...1 and singleton set to false.
"Column1Values" node has an attribute called "column1", of type String.
I did the binding between attribute "column1" and the column1 inputfield celleditor in the table.
I created an event called Column2Changed and binded it to the column2 celleditor of the table. I added a parameter called nodeElement of type IPrivateCompView.IDetailElement to this event, and mapped it to the column2 editor in the table so that I can dynamically get the nodeElement that is being affected.
I added the following code to the onActionColumn2Changed(wdEvent, nodeElement) method that gets created in the view:
IWDAttributeInfo attrInfo = nodeElement.nodeColumn1Values().getNodeInfo().getAttribute("column1");
ISimpleTypeModifiable siType = attrInfo.getModifiableSimpleType();
IModifiableSimpleValueSet<String> value = siType.getSVServices().getModifiableSimpleValueSet();
if(this.initRFC_Input(nodeElement.getColumn2())){
     for(int i =0; i < wdContext.nodeRFCresults().size(); i++){
          value.put(wdContext.nodeRFCresults().getRFCresultsElementAt(i).getId(),
                              wdContext.nodeRFCresults().getRFCresultsElementAt(i).getDesc());
And with this, I still get the original problem... When the EVS of one row is updated, ALL other EVS of the table get also updated with the same values.
What am I missing? Sorry Govardan, I bet I'm not seeing something really obvious... hopefully you can point me in the right direction.
Thanks!

Using RSCRM_BAPI with Huge Data Volume

Similar Messages

Maybe you are looking for