MDMGX - After Data Extraction

Hi,
I am new for MDM Generic Extraction concept and understand the process up to generation of XSD and XML file generation. Below are the doubts in my mind. Please help me to get clear.
1. What is the use of XSD file generation. Is it used for source template for MDM import manager?
2. What is the use of Time out option in 'Define Repositories and FTP Server Details'.
3. How will import generated multiple XML files into MDM server via Import Manager. For Ex
1. Repository Fields :
Product ID -- UNIQUE Key FIELD
Product Desc
Country
Counry Description
ISO Code
Field1
Field2
2. Extracted XML files from MDMGX will be
File1 --> Product ID & Desc
File2 ---> Country & Country Desc
Please take the above ex or any valid examples and explain.
Thanks in advance.

Hi Rakesh,
SAP has delivered standard extraction for Reference Data and for Master Data
The T-Code MDMGX is for Reference Data and it is used to load the Sub Table of MDM
The MDM business content contains the standard ports and maps which is required for reference data
The below thread explains the procedure to configure the MDMGX
Extract Data usnig MDMGX
There are sequences in extarcting the data.You can load only the revelant sub tables which is used in your repository using the selection creteria.
There is no XI/PI required as you can configure FTP or you can download it your desktop and manually load
Master Data Extraction
The T-Code MDM_CLNT_EXTR is used for the Master Data Extraction.
The distribution model is required for this and the configuration at PI is required
Follow the below link for more details
MDM_CLNT_EXTR
Regards,
Antony

Similar Messages

Open data extraction orders - Applying Support Packs

Dear All,
I have done the IDES 4.6C SR2 installation.
While updating the support packs, i get the message saying
CHECK_REQUIREMENTS phase.
Open data extraction orders
There are still open data extraction orders in the system
process these before the start of the object import because changes to the ABAP Dictionary structures could lead to data extraction orders not being able to be read after the import and their processing terminating
For more details about this problem, see Note 328181.
Go to the Customizing cockpit for data extraction and start the processing of all open extraction orders.
I have checked the Note.
But this is something m facing for the first time.
Any suggestion!!!
Rgds,
NK

The exact message is :
Phase CHECK_REQUIREMENTS: Explanation of the Errors
Open Data Extraction Requests
The system has found a number of open data extraction requests. These
should be processed before starting the object import process, as
changes to DDIC structures could prevent data extraction requests from
being read after the import, thus causing them to terminate. You can
find more information about this problem in SAP Note 328181.
Call the Customizing Cockpit data extraction transaction and process all
open extraction requests.

R/3 SP Import:Open data Extraction requests Error

We are getting the below error when Basis doing the upgrade support packeage in R/3 source system.
Open Data Extraction Requests
The system has found a number of open data extraction requests. These
should be processed before starting the object import process, as
changes to DDIC structures could prevent data extraction requests from
being read after the import, thus causing them to terminate. You can
find more information about this problem in SAP Note 328181.
Call the Customizing Cockpit data extraction transaction and process all
open extraction requests.
Intially we have cleared the entries in LBWQ,RSA7 and SM13.But after clearing these entries also we are getting the same above error.
For support package upgrade in R/3 do we need to delete the SETUP table also in production environment?.
Is there any other way around without deleting the setup table to upgrade support package in R/3 system?
Please help us with your inputs urgently..
Thanks
Message was edited by:
Ganesh S

Thanks Siggi for the suggestion.
We have already cleared the v3 updates by running RMBWV* job manually.After clearing all the entries in LBWQ,RSA7 and SM13 still we have got the same above error.
When we imported In R/3 development system after deleting the setup table we didn't get the above error.But we are concerned about deleting the setup table in production system
though already deltas are running fine.
Is there any other way around? or deleting the setup table is the only option?
Please help...

[sap-bw] SAP HR data extraction errors....into BI 7.0 ...from ECC 6.0..

Hi Gurus,
We are doing HR data extraction with the following details:
Cube: 0PT_C01 - Time and Labor
data source: 0HR_PT_1 - Times from personal work schedule
Records in ECC: 15mill +.
"Init load with Data "is being loaded in packets of 40K records (400 packets approx).
Each time we load (we tried reloading after deleting data and reinit) it is loading same records. But it is giving the following error. Surprisingly this error is coming for different packets in different loads. for ex: 1st time packet 6...2nd time packet 58....3rd time 122 etc.....it keeps changing...
Processing end : Errors occurred
Error when generating the update program
Diagnosis
An error occurred during program generation for InfoSource 0HR_PT_1 and
InfoProvider 0PT_C01 . This may be extrapolated to incorrect update
rules.
Procedure
Check and correct your update rules and then generate the update program
again. You can find help on the error in the error log.
We reactivated and verfieid update rules. But no use.
Appreciate any kind of help.
thanks in advance.
J.

Oscar,
Thanks for the help.
We tried the following one by one.
1. Delete and recreate update rules. To be frank....there is no CODING or complication in there...
     It did not work.
2. Tried loading only to PSA. It loaded 15mill records perfectly. But when we tried updating target cube,
    same story with many more errors.....earlier we had 10 packages failed out of 387.......
     this time almost every alternate package is marked red and same error....update generating update
     program.....
Hope somebody will come up with a solution.

Field symbols and data extract

hi frenz,
Can anybody please give me details about field symbols and data extracts what is the purpose of using them and regarding the performance issues for the two.....
if some one explains with an example its going to be fine......
Please don tell me to refer the 980 or help document.....
Please help me out

Field symbols offer functionlity similar to pointers in other programming languages. It does not occupy memory for the data object, it points to the object that has been assigned to the field symbol. You use the assign command to relate to the data object. After the assign operation you can work with field symbol in the same way as with the object itself.
You define the field symbol as: field-symbols <fs>.
field-symbol <fs>.
data field value 'X'.
asssign field to <fs>.
The field symbol <fs> now inherits all the properties from the assigned field, and you can work with the field symbol in the same way as with the field itself.

Data Extraction from AR Aging Tables to Acess

Hi
I used to work on developing the reports.But I am a new to the Data Extraction from AR Aging Tables into Acess and the data is upload from Acess to SAP.
Can anybody help me to relove this issue.I really appreciate to you.After mapping then the data is loaded to SAP.

Hi
I used to work on developing the reports.But I am a new to the Data Extraction from AR Aging Tables into Acess and the data is upload from Acess to SAP.
Can anybody help me to relove this issue.I really appreciate to you.After mapping then the data is loaded to SAP.

DATA EXTRACTION FROM ORACLE & SYBASE

Hello members...
Good day. This is my first posting in this site. I am new to Oracle and have a question regarding Data extraction from Oracle and Sybase.
My project has two applications one having Oracle as the database and the other has Sybase as the database. On the proposed production schedule, there would be a interface data update from the Oracle database to the Sybase database.
My aim is to check if the data update is in sync after the update. We plan to extract the data from the two databases (Oracle and Sybase) and compare in a Third Party tool. We have the tool to compare. Can any of you suggest a nice data extraction tool. I have to set this data extraction as a batch in the nightly batch schedule.
Thanks in advance,
Regards,
Krishna Kumar...

Sybase provides the best data extraction utility called BCP. You can load and extract data. It is very user friendly. From your unix prompt if you type in BCP ? you will all the switches and
help messages you need to use. It is so simple.
Oracle dosn't have such a utility to extract data from table.
You need to write a Stored procedure and use UTF_FILE package to
extract data from table and write into a file.

Delta in Generic data extraction

Hi all,
I have a doubt here,
What is the delta in Generic Data extraction?
What are the types?
and what are their significances?
Please give reply.
Thanks
Surya.

Hi Surya,
If a field (date, progressive document number, timestamp) exists in the extract structure of a DataSource that contains values which increase monotonously over time, you can define delta capability for this DataSource. If such a delta-relevant field exists in the extract structure, such as a timestamp, the system determines the data volume transferred in the delta method by comparing the maximum value transferred with the last load with the amount of data that has since entered the system. Only the data that has newly arrived is transferred.
To get the delta, generic delta management translates the update mode into a selection criterion. The selection of the request is enhanced with an interval for the delta-relevant field. The lower limit of the interval is known from the previous extraction. The upper limit is taken from the current value, such as the timestamp or the time of extraction. You can use security intervals to ensure that all data is taken into consideration in the extractions (The purpose of a security interval is to make the system take into consideration records that appear during the extraction process but which remain unextracted -since they have yet to be saved- during the next extraction; you have the option of adding a security interval to the upper limit/lower limit of the interval).
After the data request was transferred to the extractor, and the data was extracted, the extractor then informs generic delta management that the pointer can be set to the upper limit of the previously returned interval.
Hope now is clearer...
Bye,
Roberto

Can any one pls tell me the procedure of crm datasourse data extraction r/3

hi
pls can any one pls tell me the procedure of crm datasourse data extraction from r/3
regards
subbu

Subbu,
First off please don't post the same question twice. I have locked your other question due to it being a duplicate.
Second off: don't expect an answer to your question immediately.
Third off: You need to read the rules of engagement before posting any more questions here:
https://www.sdn.sap.com/irj/scn/wiki?path=/display/home/rulesofEngagement
Fourth: You question is way too vague and honestly if you would have done a search or read some introductory material on CRM, you would have learnt that the CRM middleware handles the data transfer.
Last: I'm locking this thread because your question is way too vague, please take a look at the CRM wiki and help.sap.com and read all the associated documentation about CRM on those sites.
CRM wiki
https://www.sdn.sap.com/irj/scn/wiki?path=/display/crm/home
Then you can come back here if you have a detailed question after reading those materials.
Take care,
Stephen
CRM Forum Moderator

Data Extraction is Stuck

Hi. We have a process extracting data from an Oracle database via JDBC connection. In general, the process takes more than 4 hours to extract 7-8 millions rows of data into a flat file. At the first 2-3 hours, the entire process is totally idle, and total rows were 32k. During that period of time, the temp tablespace is fine; the session is still active, but CPU is idle. Does anyone have any clues the root cause of data extraction is stuck?
Thanks.

>
Hi. We have a process extracting data from an Oracle database via JDBC connection. In general, the process takes more than 4 hours to extract 7-8 millions rows of data into a flat file.
>
Then your process is doing something terribly wrong. But since you didn't post any information about whay your process is doing or the Java code that is doing it there isn't any way to help you.
This thread should be reposted in the JDBC forum
https://forums.oracle.com/forums/category.jspa?categoryID=288
When you post provide your 4 digit Oracle version, full Java version, JDBC jar file name and version and the Java code that is doing the extract.
Make sure you post the code that shows the query being executed, the batch settings that are made and how the data from the result set is being processed and written to the file.
>
At the first 2-3 hours, the entire process is totally idle, and total rows were 32k. During that period of time, the temp tablespace is fine; the session is still active, but CPU is idle. Does anyone have any clues the root cause of data extraction is stuck?
>
Since 32k rows can be extracted and written in a matter of seconds those metrics should convince you that you have a serious problem with your methodology.
You need to do some basic troubleshooting to see if the problem is in the DB, the network, or writing the data to the file system.
1. Run your query manually using a tool like sql developer or Toad to see how long it takes to return the first 50/500 rows in the result.
2. Modify your app to quit after executing the query to see how long it takes to return from the EXECUTE statement.
3. Modify your app to do nothing at all with the result set (do NOT write it or access it at all) except iterate it using ResultSet.next(). How long does that take?
4. Stop working with millions of rows until your app actually works properly. That indicates that you did not do any testing or you would have known there was a problem before now.

ECC Data extraction

Hello All,
I have a situation in my department where I need to extract the ECC data to third party database (MS SQL). Initially we were thinking of using SAP BW extractors for extraction through SAP PI to push the data out but this doesn't seem to be feasible. Is this a fair assessment of the situation?
What other methods we can use for data extraction? We are evaluating options for ABAP programs, SAP Queries and BAPIs. Is there any other way we can extract this data set. The data set is required for sd,fi-ar/ap,mm,pp.
We donot need data fro real time time basis, but on the same lines of a data warehouse extraction like SAP BW.
Appreciate your help.
Thanks

Hi
I recently figured out what to do and here is what we do :
Not many would like to allow you to extract data directly from SAP R/3. But we have been successful in extracting data for our in-house implementation of BI at ORG level. You need to understand which tables of R/3 would give you what information.
If that information could be gathered. Then extracting data on BODS is very simple. Though it is a bit tricky and it is not direct. But a we do it as a process of different stages.
We use BODS 3.1
Step 1 :
You need to create 2 connections on SAP R/3 Datastore :
1) conn 1 :
Use the option generate and execute - ABAP Execution option
data transfer mtd : direct download
working directory on SAP Sever : here give local path on which BODS server is running e.g. ; d:\bods
local directory : : d:\bods
Generated ABAP directory : d:\bods.
execute in bg : no
Create data flow :
SAPR/3 >>> (sap r/3 table>>>query transformation>>data transport (dat file))
||__query transformation >> target database (we have chosen oracle) . You could create a datastore for sql server.
And Import that table table under this connection.
Even for SAP R/3. Import that table immediately after you create the SAP R/3 datastore.
We have used the option of replace file in data transport option in dat file
So that each time you run the job the file gets replaced.
Step 2 :
Create a job for this work flow
Run the job.
It will create a dat file and a ABAP File on the specified D: Bods folder.
Step 3 :
Send the ABAP File : to sap bw / sap team - requesting them to create this ABAP program. and make it available on your SAP R/3 System.
(We found this is easy to do for anyone, all that you need is to copy paste and activiate and do the transport to the sap r/3 system and does not require any time to do any ABAP programming - as such)
Note : For the data store creations of SAP R/3 : THE user name being used. Need to have access to all the required tables of SAP R/3. Otherwise data access will not happen. You can chek the data flow at each stage and it will say, not authorised. If you dont have access.
Step 4 :
Now create another SAP R/3 Connection conn2 ;
This connection will use the option : execute preloaded (abab execution option)
execute in bg : no
data transfer method : shared directory
working directory on sap server : d:\bi_share
(Create a shared folder on sap r/3 server : :\BI_SHARE (the user on data store should have complete access of read and write on this shared folder)
application path to share directory :
sapservername
bi_share
Step 5 :
Now if you have the ABAP Prog already available on your R/3 system.
Re-run the job finally using the new data store for execute - preloaded.
which is pointing to the shared directory of sap server itself.
And this job can be scheduled on production BODS server finally.
======================================================
Wherever required, import the tables under the related data store.
Although it might sound a lengthy process. Actually, it hardly takes a very little time, compared to the time involved in trying to ask someone on ABAP to code / or take help of BW or whatever.
We have done things on DEV BODS tested the same.
then we have moved everything into production.
And till date : it has been successful for us.
We have taken help of ABAP programers only when we explicity required some customised logical programming. Which was not available directly on SAP R/3 system.
Otherwise if we generally pull all the fields once we take any table from SAP R/3 so that i could be used any time later. Even if not required today.
And SO with a little effort, even a person who is new to SAP R/3 or BW or BODS.... like me, is able to manage. So, it is not difficult i suppose.
Good Luck.
We have used oracle for reporting database. And sql server should also work the same way.
We use sql server only for meta data information.
like BO Repository or BODS repository
Cheers
Indu
Edited by: Indumathy Narayanan on Jul 27, 2011 8:23 AM
Edited by: Indumathy Narayanan on Jul 27, 2011 8:24 AM
Edited by: Indumathy Narayanan on Jul 27, 2011 8:27 AM

SPAM/SAINT - Open Data Extraction Requests

Hello All i am getting an warning during implementing patches for netweaver 701 sp3 and sp4.
" Phase CHECK_REQUIREMENTS: Explanation of Errors
Open Data Extraction Requests
The system has found a number of open data extraction requests. These
should be processed before starting the object import process, as
changes to DDIC structures could prevent data extraction requests from
being read after the import, thus causing them to terminate. You can
find more information about this problem in the SAP Notes 1081287,
1083709 and 328181.
Call the Customizing Cockpit data extraction transaction and process all "
i checked listed note and implemented the same but still its showing me something in LBWE. i deleted all setup data for all the application data using tcode LBWG but its still showing in LBWE tcode.
this is the error i am getting after runing program 'RMCEXCHK'
Struct. appl. 04 cannot be changed due to setup table -> Long text
Message no. MCEX141
Diagnosis
Changing the extract structure for application 04 is not permitted, because the restructure table MC04P_0ARBSETUP for the extractor still contains data in 800.
You cannot change the structure in this status, because when you load an InfoPackage from BW, this leads to errors.
Procedure
Delete the entries for all restructure tables for application 04.
Any reply will be highly appreciated.
Mani

Hi Mani
I am also facing the same issue. Can you please tell me how you have resolved the issue.
Thanks & Regards
Venkat

Classification data extraction questions

Hai All,
I have few questions regarding the classification data extraction from R/3 to BW.
Does anybody know if I can do the following(classification data sources in CTBW):
1. Extraction of Characters that permit multiple value valuations
2. Extraction of characters intended for intervals
3. I know that only FULL update is supported for classification data as of BW 2x. Does anybody know if deltas are supported in any of the new versions upto BI 7.0?
I appreciate if any body can answer these questions or refer to documentation or SAP notes.
Thank you very much.

hi,
please take a look
1. oss note 604412
Symptom
The selection after the key field during the extraction of the classification data from the class type that permits several objects (MULTOBJ = .X in table TCLA) does not work. The selection only works in such a case if an object number (CUOBJ from table INOB) is entered as a selection criterion.
Other terms
OBJEK, CTBW, RSA3, extractor checker
Reason and Prerequisites
This is caused by a program error.
Solution
Implement the source code corrections.
3. delta should be supported since 'old' version, see 'old' oss note 323412-Create change pointers for BW
(other notes for delta problem 410741, 413130)
DataSources, Symptom
You must implement this correction if you also want to use the DataSources of the classification, that are created using Transaction CTBW, for delta uploads.
Additional key words
CTBW_BW_CHANGE_POINTERS, ALE
Cause and prerequisites
Making DataSources delta compatable for the BW.
Solution
Program enhancement in update of the classification.

Problems query data after data migration to Hana

Hi We currently have 2 BW environments: Release: 701 SP-Level: 0014 Support Package: SAPKW70114 DB: No Hana Release: 740 SP-Level: 0005 Support Package: SAPKW74005 DB: Hana It was necessary to migrate data cubes BW 701 -> BW 740, because in ECC only history of the last 18 months is maintained. After this migration, when I make a query in Query Designer and I use between in "Filters and Restrictions" no returned values, but if I include the value and not use the between the values are displayed. For example: I created a query with: one key figure, Comp_Code, Material and Fiscper. On filters and restrictions I informed that should return only the materials between 0001 and 0003. When running the query does not return values, but if I change the filter to only return materials 0001, 0002 and 0003, the query returns data. Note .: This problem occurs only with the migrated data from the BW 701, loads of ECC deltas are functioning normally. Could you help me solve this issue? Best Regards

Important point: I found that if you run the query in RSRT "Execute + Debug" button and do not use the option "Do not use SAP HANA / BWA Index (0)" the query runs without problems.
Additional Information:
- BW on Hana environment 740 is a new installation.
- To load the historical data for the BW on Hana was created an RFC with the BW 701, classic BW as source system to new BW HANA.
- BW 701 was generated Export Data Sources ( From cube to cube, from DSO to DSO) and we used of data sources to migrate historical data.
- Then BW on Hana is a new installation, but only the historical data were extracted from the BW 701 (no Hana)
- Export Data source generated on DSO data is ok, but the Data source of export from a cube, data is not ok. After data load this historical data, when I make a query in Query Designer and I use between in "Filters and Restrictions" no returned values, but if I include the value and not use the between the values are displayed, but the problem occurs only in the query on the Cube.
- Are there any recommended when historical data is extracted on the Cube by Export Data Source?

SAP Data Extraction requirements - mySAP SCM SPP/ ERP

Hello All,
Could you please explain me how to start for this requirement?.
Business Summary:
For MM Planning to have a substantial range of Master and Transactional data to get extracted from the SAP system for reporting and analysis purposes. A list of the data requested for extraction for the SCM.
Functional Discription:
There is a general MM Planning requirement to have most Master and Transactional data extracted from SAP-APO for reporting and analysis purposes in order to support following business tasks:
 process evaluation and optimization
 error analyzes
 ad-hoc reporting
 planning processes out of scope for SCM launch (e.g. ATR process)
The data need to be automatically extracted on regular basis (i.e.: daily/weekly/monthly/yearly: this will be defined during the next steps for every single set of data) and made available in a structured environment to the SCM Planning Team for the above mentioned processes.
The requirement for data availability outside of SAP APO comprises both current data and historical data.
FoE: today no "final" report is generated by the SCM Planning team directly within the current data warehouse environment. Most data are extracted from the current data warehouse to external tools. Current assumption is that this will remain unchanged.
Some regular reports (MBB, Inventory Dashboard) may be directly developed in Business Warehouse in future if this offers any improvement (flexibility, design, handling.). This will be investigated by the SCM Planning Team after go-live.
FUS: For the analyses and the planning processes that are out of scope, the data will need to be extracted so that it is available for use in analytical tools that are powerful enough to process the data and appropriate calculations.
Regular reports may be directly developed in the BW if it is determined that that is the most appropriate location and tool. Otherwise, the data will need to be integrated into reports generated using tools outside of SAP. That determination will needs to be completed based on the type of data being reported.
Thanks & Regards
PRadeep
Message was edited by:
 Pradeep Reddy

Hi,
You can download all the master guides from the SAP service marketplace (http//service.sap.com/instguides).
Cheers,
Mike.

MDMGX - After Data Extraction

Similar Messages

Maybe you are looking for