Extraction of data from CRM to BW for datasource 0crm_quotation_I

Hi,
Extraction of data from CRM to BW for data source 0CRM_QUOTATION_I is taking 27 hours of time to load data into ODS for 1 million records.
Here I am doing FULL LOAD with 4 Infopackages in parllel with different select-options.Even I tried DELTA load but it hasn't worked out properly.
Is there any solution to reduce time from Datasource to ODS with FULL LOAD. Please help me.

Hi krishna,
yes we did enhancement to this data source. In PRDOCTION its taking 27 hours time to load data.
For extraction from source system (CRM) its taking nearly 24 hours time as per JOb LOG .
08/05/2010 11:53:08 Call customer enhancement EXIT_SAPLRSAP_001 (CMOD) with 10,849 records
08/05/2010 12:02:02 Result of customer enhancement: 10,849 records
08/05/2010 12:02:03 PSA=0 USING & STARTING SAPI SCHEDULER
08/05/2010 12:02:03 Asynchronous send of data package 1 in task 0002 (1 parallel tasks)
08/05/2010 12:02:06 IDOC: Info IDoc 2, IDoc No. 1576298, Duration 00:00:01
08/05/2010 12:02:06 IDoc: Start = 08/05/2010 10:26:37, End = 08/05/2010 10:26:38
08/05/2010 13:02:38 Call customer enhancement EXIT_SAPLRSAP_001 (CMOD) with 10,958 records
08/05/2010 13:11:48 Result of customer enhancement: 10,958 records
08/05/2010 13:11:52 Asynchronous send of data package 2 in task 0003 (1 parallel tasks)
08/05/2010 13:11:53 tRFC: Data Package = 1, TID = 0AA00D0301984C5AEE8E44DB, Duration = 00:16:
08/05/2010 13:11:53 tRFC: Start = 08/05/2010 12:02:19, End = 08/05/2010 12:18:27
08/05/2010 14:30:13 Call customer enhancement EXIT_SAPLRSAP_001 (CMOD) with 11,296 records
08/05/2010 14:39:53 Result of customer enhancement: 11,296 records
like this its taking 24 hours in extraction its self.
Edited by: kotha123 on Aug 10, 2010 12:08 PM
Edited by: kotha123 on Aug 10, 2010 12:09 PM

Similar Messages

Request: Problem in Extraction of data from CRM to BW

Hi Gurus
I have problems in extracting the data from CRM to BW.I thought you are the one who can solve them:
1) When I check the data in the datasource in RSA3 i can see all records as well as i can see complete data in that but when i extract and check the data in cube i can see all records but i cannot see the complete data i.e some data is missing.
2)And another problem is that In report i have 2 characteristics(DATS) start date and end date now i am trying to get number of days from start date to end date.
I appreciate you in advance. If u find any good documentation please send me to [email protected]
With regards
Nagamani.

Hi krishna,
yes we did enhancement to this data source. In PRDOCTION its taking 27 hours time to load data.
For extraction from source system (CRM) its taking nearly 24 hours time as per JOb LOG .
08/05/2010 11:53:08 Call customer enhancement EXIT_SAPLRSAP_001 (CMOD) with 10,849 records
08/05/2010 12:02:02 Result of customer enhancement: 10,849 records
08/05/2010 12:02:03 PSA=0 USING & STARTING SAPI SCHEDULER
08/05/2010 12:02:03 Asynchronous send of data package 1 in task 0002 (1 parallel tasks)
08/05/2010 12:02:06 IDOC: Info IDoc 2, IDoc No. 1576298, Duration 00:00:01
08/05/2010 12:02:06 IDoc: Start = 08/05/2010 10:26:37, End = 08/05/2010 10:26:38
08/05/2010 13:02:38 Call customer enhancement EXIT_SAPLRSAP_001 (CMOD) with 10,958 records
08/05/2010 13:11:48 Result of customer enhancement: 10,958 records
08/05/2010 13:11:52 Asynchronous send of data package 2 in task 0003 (1 parallel tasks)
08/05/2010 13:11:53 tRFC: Data Package = 1, TID = 0AA00D0301984C5AEE8E44DB, Duration = 00:16:
08/05/2010 13:11:53 tRFC: Start = 08/05/2010 12:02:19, End = 08/05/2010 12:18:27
08/05/2010 14:30:13 Call customer enhancement EXIT_SAPLRSAP_001 (CMOD) with 11,296 records
08/05/2010 14:39:53 Result of customer enhancement: 11,296 records
like this its taking 24 hours in extraction its self.
Edited by: kotha123 on Aug 10, 2010 12:08 PM
Edited by: kotha123 on Aug 10, 2010 12:09 PM

Extracting text data from CRM

Hi,
We have a NOTE section/field in CRM, which is used to enter some notes by the users on Activities. We need to pull it into BW.How to do it. NOTE can be any long!

Thanks to Eugene Khusainov
Long texts in SAP BW: Modeling Follow Up
Of course the clever way would be to publish to a KM document then attach the document a BLOB object to the master data - but you can figure out how to that yourself (and don;t forget to write a blog about it)

Need to extract the data from the CRM table : SCAPPTSEG

Hi BW Experts,
I want to extract the Data from CRM Table "SCAPPTSEG" to BW. The dates are stored in UTC Format.So for getting the date in CET format, we have used the Function Module "IB_CONVERT_FROM_TIMESTAMP".
I want to create a datasource for extracting the data from "SCAPPTSEG" table and i need to use the function module for getting the date in CET Format.
Can i achieve this action through Generic Extraction.
please provide me the steps to achieve this.
Thanks,
Shahina.A

not answered

0CRM_SALES_ACT_1 takes a long time to extract data from CRM system

Hi gurus,
I am using the datasource 0CRM_SALES_ACT_1 to extract activities data from CRM side. However, it is taking too long time to get any information there.
I applied the SAP NOTE 829397 (Activity extraction takes a long time: 0crm_sales_act_1) but it did not solve my problem.
Does anybody knows something about that?
Thanks in advance,
Silvio Messias.

Hi Silvio,
I've experienced a similar problem with this extractor. I attempted to Initialize Delta with Data Transfer to no avail. The job ran for 12+ hours and stayed in "yellow" status (0 records extracted). The following steps worked for me:
1. Initialize Delta without Data Transfer
2. Run Delta Update
3. Run Full Update and Indicate Request as Repair Request
Worked like a champ, data load finished in less than 2 minutes.
Hopefully this will help.
Regards.
Jason

Sales Order data from CRM

Hi all,
I want to upload Sales Order data from CRM to BW with DataSource "0CRM_SALES_ORDER_I".
The upload fails due to missing information that are needed in the first update rule of the Sales ODS "0CRM_SALO". In this update rule some formulars on data field level are created that require this information.
Examples of fields that are not delivered from the CRM:
0CRMLREQSCH     L. Req. Deliv. Date
0CRM_DLVSCH     Last Delivery Date
0CRMPAVSCHW     MAD (Requested)
0CRMPAVSCHC     MAD (Confirmation)
0CRMPGISCHW     Pl. GI Date (Req.)
0CRMPGISCHC     Pl. GI Date (Conf.)
So what is to do? Enhance the extractor or are there alternatives.
Cheers
jb

Hello jb,
Were you able to resolve your problems with Sale Order?
      thanks,
          dmitriy.

Error while extracting data from CRM to 0BPARTNER

Hi All,
We are extracting   daily data from SAP CRM to 0BPARTNER using 0BPARTNER_ATTR(Delta mode) . While loading the data upto PSA, it showed the total number of records as * 50033 from 50033*. But the total and technical status are yellow . When checked the step by step analysis , *Processing error in source system reported * is red and rest all are green.When I saw the application Log it is writtern as * There is a discrepancy between confirmation and deletion of qrfc-LUWs*.
In the Details tab ,we got the following messages.
1)*Extraction (messages): Errors occurred *
   19485 Records sent ( 19485 Records received ) .
2)*Transfer (IDocs and TRFC): Missing messages or warnings *
    *IDoc : sent, not arrived ; Data passed to port OK * and rest every thing is green.
But all the data packets are fine.
WeI have checked using BD87, WE02, WE05   in BW and source systems for I DOCS . But none of the t-codes provide any IDOCS with warnings or errors.
So we have changed the Total l status to Green. Please note that still the technical status is showing as Yellow only.
We started to updating the data target from PSA. Now again, both statues are showing yellow only.So what should we do inorder to resolve this ?
Thanks in advance,
Babu Vasamsetti.
Edited by: babu vasamsetti on Jan 11, 2010 5:54 PM
Edited by: babu vasamsetti on Jan 11, 2010 5:55 PM
Edited by: babu vasamsetti on Jan 11, 2010 5:55 PM

Hi
please check sm58 in souce system side trfc may be strucked... to press f6 to run manually
first make a request a red.. in IP
hope u clear it
thx
viijender

Error while extracting data from CRM

Dear all,
I have used some standard and generic datasources to extract data from CRM. These were working fine for more than a year and are scheduled in Process chains. For the past few days I am getting Caller 09 error as shown below, only for the generic datasources. I have checked the connection,replicated the datasources and activated them, reinitialized and have tried all the solutions that were posted earlier, but still the process chain fails. When I execute the process chain for generic datasources manually, it is working fine.
When I tried in RSA3 for both standard and generic datasources in CRM with update mode D, I get a message 'Error occured during the extraction',
Kindly suggest what can be the problem.
Error message from the source system
Diagnosis
An error occurred in the source system.
System Response
Caller 09 contains an error message.
Further analysis:
The error occurred in Extractor .
Refer to the error message.
Procedure
How you remove the error depends on the error message.
Note
If the source system is a Client Workstation, then it is possible that the file that you wanted to load was being edited at the time of the data request. Make sure that the file is in the specified directory, that it is not being processed at the moment, and restart the request.
Thanks all in advance.
Regards
Adhira Anand

Hi Meyappan,
I have checked SM37, SM21 and ST22. There are no errors.
in SM37 the below log is displayed.
Job started
Step 001 started (program SBIE0001, variant &0000000005420, user ID ALEREMOTE)
Asynchronous transmission of info IDoc 2 in task 0001 (0 parallel tasks)
DATASOURCE = ZCRM_SRV_DEFECT
RLOGSYS    = CLNT645BIP
REQUNR     = REQU_4JHQ8HH6KA40JHC1TYLYIV2W2
UPDMODE    = D
LANGUAGES = *
         Current Values for Selected Profile Parameters               *
abap/heap_area_nondia......... 2000000000                              *
abap/heap_area_total.......... 2000000000                              *
abap/heaplimit................ 40000000                                *
zcsa/installed_languages...... DE                                      *
zcsa/system_language.......... E                                       *
ztta/max_memreq_MB............ 2047                                    *
ztta/roll_area................ 6500000                                 *
ztta/roll_extension........... 2000000000                              *
1 LUWs confirmed and 1 LUWs to be deleted with function module RSC2_QOUT_CONFIRM_DATA
IDOC: Info IDoc 2, IDoc No. 101415, Duration 00:00:00
IDoc: Start = 13.10.2010 22:51:39, End = 13.10.2010 22:51:39
Synchronized transmission of info IDoc 3 (0 parallel tasks)
IDOC: Info IDoc 3, IDoc No. 101416, Duration 00:00:00
IDoc: Start = 13.10.2010 22:51:42, End = 13.10.2010 22:51:42
Job finished

Extract data from CRM to SAP R/3

Hi Experts,
I Facing Problem to Extract the data from database table BUT000 in CRM 2.0 System to SAP R/3 whether its possible to update the data directly in R/3 system from CRM. whether any functional module exists?
Plz Provide me details about it

Why do you need to copy it? The data is easily available from R/3 via RFC.
Rob

When extracting SD data from R/3, err in tRFC raised that "No service for."

Hello fellows,
when I'm extracting SD data from R/3, an error raised about IDOC that "No service for system SAPSB2, client 100 in Integration Directory", and there is no work processing working in the R/3 system, could anybody help? Thanks!
Jennifer

Hi,
You are extracting Data from ECC, so here no way related to XI, I think, the problem is with Parner Profile and IDoc settings, so chek it in WE20.
or
take IDoc nos from BW-->RSMO (in the detailed tab bottom you can find OLTP IDoc nos) and then goto ECC, BD87 and give that IDoc and check,
And also check in WE05 what is the Idoc Statu, this is connection problem only, so check with BAsis team.
Thanks
reddy

Extract data from ECC6 to Netweaver2004s for BI7.0

Hi Guru's,
I have two systems ECC 6 and Netweaver2004s.For BI7.0 in Netweaver2004s i want to Extract the data from ECC6 into Netweaver2004s BI 7.0.
1.How can i make ECC6 as a Source System for the Netweaver2004s.
2. In Netweaver2004s for BW 3.5 i am getting the Administrator Workbench but objects are still showing the 7.0 properties. How can i over come this issue.
Kindly help me out on this issues.
Thanks in Advance
Regards
Prem

Hello Prem,
1. Basically Tcode RSA1 - Modeling - Source Systems - right click the "Source Systems" on the right - Create - Automitically create SAP system
2. Haven't heard of BW 3.5 based on NW 2004s... Please check the release of BI_CONT component from menu System - Status - Component info. Likely you find 7.0.x instead of 3.5.x
Best regards,
Victor

Trying to Extract data from CRM Table(BUT100)

Hi Gurus,
         I have big problem while loading data from Table BUT100 through Generic Datasource, situation like this I have table in the CRM system BUT100 with BPartner and BPRole contains Duplicate Records which we need to bring load this duplicate record to BW where I am loading data through Master data it has given error with duplicate records and tried with ODS here it has loaded but it brought ubique values because we have only two fields which we should put 1 key field and 1 data field,
So Is there any way to bring this data to BW, Please suggest me.

Hi Gupta,
         Than Q for gave response, see in the CRM system I have table like BUT100 with only two fields Business patner and Business Role, this data exists like this
BPPartner   BProle
0035        crm00
0035        bup01
045         bup02
045         bup03
like this data exists in the system, how can we bring this data, is it possible to get through timedependence masterdata, kindly suggest me.
With Regards,
Ravi Kumar Arikatla.

Problem with upload data from CRM to BI system

When I try to perform full upload data from CRM to BI system with data source 0BPARTNER_ATTR (active version: Excutable). I waited for a long time but there are not any records were transfered (total records need to upload are 130) . I checked the log and can't find any errors.
Pls help me solve this problem.
Thanks and regard

Hi,
on the next day, the process finished with status not success.
The detail errors is:
Extraction(messages): Missing messages
          Missing message: Request received
          Missing message: Number of sent records
          Missing message: Selection completed
Transfer (IDocs and TRFC): Errors occurred
          Data package 1: arrived in BW; Processing: Selected number does not agree with transferred n
          Request IDoc: Application document posted
          Info IDoc 2: sent, not arrived; Data passed to port OK
          Info IDoc 1: sent, not arrived; Data passed to port OK
          Info IDoc 3: sent, not arrived; Data passed to port OK
          Info IDoc 4: sent, not arrived; Data passed to port OK
However, the data has been uploaded to infoobject. Pls explain to me about this error and why the data can be uploaded with this error.
Regard

Stages when pulling data from CRM datasource?

Hi,
We are pulling data from CRM.Please explain me the steps while pulling data from CRM.

Hi,
Data from CRM to BW is divided into diiferant Data sources.
First need to find data source name.
Use the following seps
First of all, activate the CRM DSs by scenario:
1) Activate the application component hierarchy (tcode RSA9). Changes made to the application component hierarchy in the CRM system can be transferred to the BW using the "Edit Application Component Hierarchy" (SBIW - Postprocessing of DataSources).
SAP Note 434886 must be implemented in CRM 3.0 before the application component hierarchy is activated.
2) Activate the Business Content DataSources (tcode RSA5).
Select/enter the application component and choose Execute (F8).
To compare the shipped and active versions, choose the 'Select Delta' pushbutton. If there is no active version of the DataSource, it is selected automatically.
To activate the shipped version, choose the 'Transfer DataSources' pushbutton.
3) Management of the versions of the BW-Adapter metadata (tcode BWA5). All DataSources are displayed that are managed by the BW Adapter.
As in transaction RSA5 (Service API Metadata Activation), the 'Select Delta' function can be used to select the inactive DataSources or compare shipped and active versions.
You can also go directly to the screen for maintaining DataSources that are managed by the BW Adapter.
The 'Compare Version' function makes a detailed comparison of the shipped and active versions.
All BW-Adapter metadata is considered when versions are compared:
Header information (Table SMOXHEAD)
Mapping information (Table SMOXRELP)
Global selection conditions (Table SMOXGSEL)
Attribute key fields (Table SMOXAFLD)
It is depends if you want to use in BW some ready made (Business Content) data analysis models.If so, you need to find your data source in RSA5 in CRM and activate it. See this link http://help.sap.com/saphelp_nw2004s/helpdata/en/04/47a46e4e81ab4281bfb3bbd14825ca/frameset.htm to find Cube you want to analyze in BW, and Data Source connected to it.
BW CRM analysis.
http://help.sap.com/bp_biv135/html/bw.htm
CRM Extraction
Pls chk this link for Crm enhancement
Enhance standard data sources in CRM
BWA1 is for all standard crm datsource maintaince
rsa2 for generic datasource
BWA5 i think we use this Tcode after RSA5 activation additionally.
yes(incase of delta)
BWA7 do we have to use this tcode along with BWA1 for standard datasources also or else only for generic datasource.
irrespective of the type of dtasource,use it if you want to load delta(you need to delta enable the datasource here)
So we don't need to put the code as we traditionally do it for R/3 , if we just mapp the fields that would bring the data for these fields.
as i told in CRM we willwrite code in BADI in case you have done enhancement
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/com.sap.km.cm.docs/library/biw/a-c/customer%20enhancements%20and%20userexits%20in%20bw%20-%20sap%20netweaver%20%20know-how%20network%20webinar.pdf
also chk this(credit goes to the writer)
CRm enhancement:
1. Enhance Extract Structure with the required fields. (Create & include an append structure to the extract structure via transaction RSA6).
2.a) Release the fields of the append for usage. ( To do this, double click on the Datasource and remove the flags in the column 'Hide Field' for all fields of Append).
2.b) If the new fields cannot be seen in the extract structure of the transaction BWA1 then change and save the datasource, and then activate it in RSA6.
3. Define your mappings in BADI (CRM_BWA_MFLOW) to fill these fields.
Goto SPRO . Follow the path ->SAP Implementation guide ->Implementation with other mySAP components ->Data transfer to the Business Information Warehouse-> Settings for the application specific datasources (CRM)->Settings for BW adapter-> Badi :BW adapter :Enhancement of datasources in messaging flow.
4. Replicate the new Datasource to BW.
5. Expand the Communication Structure in BW.
6. Maintain transfer Rules for the new Datasource.
7. Activate the trasfer rules and perform the upload.
Refer to the SAP Note 692195 for more info ......
pls Check this links..
regarding bw crm extraction
http://help.sap.com/bp_biv235/BI_EN/html/BW/CRMAnalytics.htm
http://help.sap.com/saphelp_nw2004s/helpdata/en/be/92fb3b28904f73e10000000a114084/frameset.htm
CRM extraction
Hope this helps,
Regards
CSM Reddy

Not able to extract performance data from .ETL file using xperf commands. getting error "Events were lost in this trace. Data may be unreliable ..."

Not able to extract performance data from .ETL file using xperf commands.
Xperf Commands:
xperf –i C:\TempFolder\Test.etl -o C:\TempFolder\BootData.csv –a process
Getting following error after executing above command:
"33288636 Events were lost
in this trace.
Data may be unreliable
This is usually caused
by insufficient disk bandwidth for ETW lo
gging.
Please try increasing the minimum
and maximum number of buffers
and/or
the buffer size.
Doubling these values would be a good first at
tempt.
Please note, though, that
this action increases the amount of me
mory
reserved
for ETW buffers, increasing memory pressure on your sce
nario.
See "xperf -help start"
for the associated command line options."
I changed page size file but its does not work for me.
Any one have idea, how to solve this problem and extract ETL file data.

I want to mention one point here. I have total 4 machines out of these 3 machines above
commands working properly. Only one machine has this problem.<o:p></o:p>
Hi,
I consider that you can try to use xperf to collect the trace etl file and see if it can be extracted on this computer:
Refer to following articles:
start
http://msdn.microsoft.com/en-us/library/windows/hardware/hh162977.aspx
Using Xperf to take a Trace (updated)
http://blogs.msdn.com/b/pigscanfly/archive/2008/02/16/using-xperf-to-take-a-trace.aspx
Kate Li
TechNet Community Support

Extraction of data from CRM to BW for datasource 0crm_quotation_I

Similar Messages

Maybe you are looking for