Data Integrator Questions

Hello,
I was hoping for some guidence on how i can access sap data without using a BW system. The Data Integrator and RapidMarts seemed to be the main option. Just wondered if this was a suitable appraoch for my scenario.
Im the UK, our clients sap infrastructure is based in Germany. We do all our development on that system and it holds all our custom tables which i need to report from.
I initially installed the SAP Integration Tools for Crystal. I can build a report and dircetly see Tables and Function Modules, but the speed is really bad and prone to crashing.
My new plan is to install Data Integrator on our Network. Then use that to pull all the tables and data we need into a RapidMart on our network. Then i can use our BO XI 3.1 edge installation to host all the reports / dashboards built off the mart.
Is this a reasonable approach, am i missing anything or is this all theoretically possible??
Any advice is great appreciated.
Carston.

One at the time....
A RapidMart is nothing else than a jump-start. Imagine this: I have been asked to build a Data Warehouse for Cost Center Accounting. So I have asked:
"What kind of reports?" "Costs per CostCenter, CostElement, Period".
"Where does the data come from?" "This and that SAP table"
"How can I implement the delta logic" "Using this approach...."
"Are you fine with this Data Model to support your reports?"
"Are you okay with the Naming Conventions I invented?"
At the end I had a very good working Data Warehouse project for my customer. Then I got another Customer engagement where I again had to build a Cost Center Accounting Data Warehouse. Same questions, very similar answers. But instead of developing the data model, the ETL flow,.... all from scratch, I would have reused the previous code.
In other words, a Rapid Mart is us running through a very professional Data Warehouse project with a couple of customers simultaniously and then we provide the code to you. So you are trading investment costs against Consulting costs and time and uncertainty. You might not like the Data Model, feel free to modify it. You need more, its just a first version of your Data Warehouse. You can't use 90% of wha we did - don't by the RapidMart but take your time to implement the Data Warehouse yourself.

Similar Messages

How to call text file using Script in Data Integrator

Dear All,
Can any one assit me in how to call a text file using script with the help of Data Integrator.
and one question ?
M having 32 csv files i want to club thos 32 csv files into one table with the help of Data Integrator, can
any one assist me.

mary,
since you knew the file name ,when clicked in name send to server,read the file and write to servlet outputstream.
I think this would help you.
If anything wrong in mycode ..forums will help you further
BufferedInputStream bis=null;
BufferedOutputStream bos=null;
int bytesRead=0;
byte buff[]=new byte[1024];
File f=new File(test.txt);
try{
     bis= new BufferedInputStream(new FileInputStream(f));
     bytesRead=bis.read(buff,0,buff.length);
     if(bytesRead!=-1){
          // create a BufferedOutputStream from ServletOutputStream
          bos=new BufferedInputStream(response.getOutputStream());
          do{
               bos.write(buff,0,bytesRead);
          }while((bytesRead=bis.read(buff,0,buff.length))!=-1)
}catch(Exception e){
     ////error handling
     }

HOW TO CREATE STORED PROCEDURE IN DATA INTEGRATOR

Hi to every one,
Can any one help in giving me a solution for creating stored procedure in Data Integrator.
I m new to this field

Hi nath,
Firstly are you using MYSQL or Oracle as the database,if its oracle database then follow this
http://obiee101.blogspot.com/2008/01/obiee-using-oracle-stored-procedure-to.html
http://oraclebizint.wordpress.com/2008/02/20/oracle-bi-ee-101332-executing-stored-proceduresfunctions-before-reports-before-report-triggers-and-global-temporary-tables/
EXEC [DATABASE_NAME].[SCHEMA_NAME].[PROCEDURE_NAME][DATABASE_NAME] --> is the database name your creating your procedure
[SCHEMA_NAME]-->is the user with which your creating
[PROCEDURE_NAME] --> the name given to procedure
You dont know how to get those run this SQL in TOAD and see select sys_context('userenv','db_name'), sys_context('userenv','session_user') from dual
(OR) open you connection pool properties window in RPD,you will get the DB name and the user name as the schema name
hope answered your question.
CHeers,
KK

"Oracle Data Integrator" with "Total Recall"

Hi all,
We are planning to use Oracle Data Integrator 11g for performing ELT in Oracle 11g database. We are also planning to enable the "total recall" (flashback) technology and house all our tables on it.
Question I have in my mind right now is, will ODI and Total Recall work well together?
Background
Say we have an interface defined with the target data store defined on a tablespace with flashback enabled. Say there are 100 rows in the source, of which 10 rows violated the check constraint . The "bad" data, violating the constraint, will be moved to the E$ table while the rest of the 90 rows are loaded into the target.
Questions*
1) If our business rule dictates zero tolerance for errors and a ROLLBACK is issued, what will happen to the data in the E$ table?
2) Say we have committed* the 90 rows and want to use a flashback transaction query to undo the changes, how will it affect the E$ table?
3) Will the rows be deleted from the E$ table also along with rolling back of the changes in the target?
4) If the errors in E$ are recycled and this interface is restarted after the rollback is performed, will the I$ table contain 110 rows i.e. source data + data from E$?
5) How does ODI handle recycling / reprocessing of the violations in E$ table?
Please advice.
Thank you.
CC

1.) The data in E$ will remain there
2.) The data in E$ will remain there
3.) The data in E$ will remain there
4.) 90 rows. The recycled will still error out
5.) To me the recycling feature is pretty lame. You need to fix the errors in the E$ table and then recycle will load the data.

Data Integration Kit and SAP BI

Hi Guys,
Have a quick question.
My understanding was we use Data Integration kit in order to integrate Crystal Report and SAP BI. To create an Universe , we dont need Data Integration Kit.
Can anyone please confirm?
Regards

Moved to a different forum.

Regarding data integrity for XI file/jdbc adapter

I have several questions about XI data integrity for file/jdbc adapter.
Question 1 is: if the destinate file or DB is not reachable or other technical problems occur, do I have to send the message again or not?
Usually we design an bpm to comfirm whether the database or file is completed according to a response message. But it's a little complicated.
Question 2:when I use jdbc send adapter and configure select and update SQL clauses. Does XI only update the records which it select automatically? or Select and Update don;t have any relationship?
Very appreciated if you have any experience to share me.
Regards
Shen Peng

Hi
Question 1 is: if the destinate file or DB is not reachable or other technical problems occur, do I have to send the message again or not?
If the DB is not reachable then message will be found in the inbound side. you can found them in the adapter. Goto RWB -> Message monitoring -> select status System error and search . there you will find your messages. select you message and resend them
Question 2:when I use jdbc send adapter and configure select and update SQL clauses. Does XI only update the records which it select automatically? or Select and Update don;t have any relationship?
XI never does updation automatically, Update is done only based on the SQL update query which you have written in the sender channel.
SELECT statement is used just to pick the values from the table and based upon the query which you want to UPDATE in SQL . data is updated
Regards,
sandeep

Data Integrity Manager & Synchronize Objects

Hi there,
I have 2 questions regading data integrity and synchronization. If any of you can help me out, I would really appreciate it.
1) Synchronize Objects (R3AS4): Is this only used to sync the customizing objects or can it be used to sync master data objects as well? When I run this transaction, I get the message tat "Synchronization Ware not activated". Do any of you know how to activate this?
2) Data Integrity Manager: How do I choose betweeen a header level comparison and detail comparison. When I try to run it , nothing seems to happen, and I just get the message "0 objects are equal" and "0 objects are not equal" when I run it. I am just using the DIMA wizard to start the comparison. Do any of you have the "Data Integrity Manager Cookbook"? If so, can you please send ot to me?
Thanks in advance
Max

Hello Max,
Here are the steps that I just did in my system:
- transaction SDIMA
- New DIMa Instance wizard
- name = customer / object = customer
- RFC destination = <R/3> / filter mode = All filter / flag to start compare on wizard completion
- no filter settings
- complete
So the compare start as soon as the wizard is finished.
You can see the status of the job in the right of the screen. (it takes some time for BP). When the status is green, the job is finished.
Maybe you will have the message "0 objects are equal, 0 objects are not equal" but you should also have just above a message like "421 object(s) exist in both systems".
I don't think that the fact that you are not sending BP back to R/3 is a problem to use DIMA.
Hope this will help you.
Regards,
Frédéric

Text fields being converted to Long in Data Integrator v 11.7

I am a new user to BODI, and I recently experienced an issue with source "TEXT" fields being converted to "LONG" in the Query and Target datastores respectively. I am using Data Integrator v 11.7 and my question is does anyone know whether or not this issue has been resolved in Data Services XI 3..x? if so, can you also provide documentation on this exact issue? Thanks in advance.
Lonnie

Yes, we did some changes in DI 12.0. But what is the problem? A SQL Server TEXT datatype is a text with unlimited length whereas a varchar(maxsize) is limited. In Oracle a CLOB is the same thing. And in DI we call a text of unlimited size a LONG datatype.

How to install File Operations components in Data Integrator

Hello Endeca Forum,
I'm interested in using the File Operations components in Data Integrator, but getting and installing them is surprisingly obscure.
I'm talking about...
http://doc.cloveretl.com/documentation/UserGuide/index.jsp?topic=/com.cloveretl.gui.docs/docs/file-operations.html
The Clover documentation (http://doc.cloveretl.com/documentation/UserGuide/index.jsp?topic=/com.cloveretl.gui.docs/docs/components.html) states...
"+Note if you cannot see this component category, navigate to Window → Preferences → CloverETL → Components in Palette and tick both checkboxes next to File Operations+"
However, when I go to Window --> Preferences --> CloverETL --> Components in Palette, I don't even see File Operations. This tells me that the version of Clover packaged with OEID doesn't have the components installed.
Going to Help --> Check for Updates also didn't yield anything that looked like the File Operations components.
I'm hoping someone here is familiar with the necessary steps to get these components installed...
Thanks,
Jerome

I see what you're saying Purvesh, thanks for the clarification.
Again, it's a little challenging to find this out, but there's a Clover support team member who mentions here...
http://forum.cloveretl.com/viewtopic.php?f=4&t=6428&view=previous
... that the File Operations were introduced in the 3.3.0 M3 release.
Guess this means we're out of luck, which is unfortunate.
I'm fully aware that the SystemExecute component is an option for file management, but it's not the best fit for what I need to do. In any case, my question has been answered.
Thanks!
Jerome

Shared Variable Data Integrity

I am using Network Shared Variables for a project and have a question about if there are any data integrity checks that are built into the NI-PSP protocol.
I'm more of a hardware engineer and I am just wondering if there is any way that data can be corrupted when using Network Shared Variables. I could probably just cast the data to U8 and then CRC it on both ends, but wanted to check about integrity inherent to Labview for this. Because we mainly develop medical devices, any Labview code needs to be validated if used for verification testing.
If there is NI documentation/studies on data integrity for this, I'd appreciate it if someone could point me to it.
Thanks!
Thad

Hi Thad,
The following article talks a little about data integrity when using shared variables.
http://www.ni.com/white-paper/4679/en/
I hope it helps.
Regards,
kruiz17

Oracle Data Integrator (ODI) vs Oracle Golden Gate

We are about to start a new data warehouse project, which will require a data integration product and have the following questions:
- ODI provides near real-time data warehousing support: - What is the difference between ODI's near-realtime data warehousing features and Oracle Golden Gate's real-time data integration?
- How does Oracle Golden Gate achieve Real-time Data Integration? (What kind of non-invasive techniquire/procedures/processes does it use to achieve Real-time Data Integration?
- Obviously with Oracle Golden Gate being the superior Data Integration product, what is the future of ODI?
- Is there any product convergence planned for ODI and Oracle Golden Gate by Oracle corp. in the near/far future?
- Most importantly, what product should we use to implement the new project: ODI or Oracle Golden Gate?
- What is the easier product to learn/implement: ODI or Oracle Golden Gate?
Others, please feel free to add to the above questions/concerns.
Thanks for all your help.

Hi,
I tried to install the essbase driver adapter on ODI, but I can't connect to Essbase using topology manager. Anyone know about essbase drivers for ODI. I used ODI 10.1.3.4.
Thanks all.
Regards,
Sumardi

Data Integrator and Rapid marts

Hello Friends,
i am new to Data Integrator and Rapid marts. as per muy knowledge Data Integrator is a reporting tool.
i have few questions.. plz give me the solutions..
1) When we go for Data Integrator and Rapid marts
2) What is the importance of Data Integrator
3) Can you give a scenario for Data Integrator and Rapid marts..
4) what are the basics required to know Data Integrator
5) What is the land scape of Data Integrator
6) What are Advatages and Dis advantages of Data Integrator reproting.
7) What are Advantages of Rapid marts
Plz dont give links...
Regards

First of all, Data Integrator is not a reporting tool, it is an ETL tool from SAP BO.
1) When we go for Data Integrator and Rapid marts
2) What is the importance of Data Integrator
3) Can you give a scenario for Data Integrator and Rapid marts..
Rapid Mart is a pre-built information component, that use DI as an ETL tool which extracts data
from different source systems like SAP, Peoplesoft, Oracle, Siebel & JD Edwards, integrating and
loading into datamarts.
The analytic datamarts(pre defined data warehouse application) focused on different subject areas..
such as Sales, HR, Inventory, Accounts etc..
4) what are the basics required to know Data Integrator
Data Warehouse and ETL concepts.
5) What is the land scape of Data Integrator
6) What are Advatages and Dis advantages of Data Integrator.
Data Integrator allows to develop data warehouse applications in both Batch and Real-Time job mode
Data Integrator manages the data from heterogeneous and homogeneous sources and transforms the data
according to business logic, integrates into single data source for analysis.
It extracts the data from operational source systems and external source systems typically like RDBMS,
Flat files, XML files, XML Messages, SAP IDocu2019s, PeopleSoft, Siebel etc
7) What are Advantages of Rapid marts
RM can customize easily and Immediate ROI

Data Integration conection in Transaction SAP

Hi people
I use Data Integration X 3.1 and I can conect with RFC SAP and function SAP but I can´t conect with a SAP Transacion. Does anyone know if this is possible?

1. If you are trying to execute a transaction i think you can try creating the variant of that and try executing the FM based on which the transaction is based and run it.
2. What you can also try is create a FM with passing all parameters as mentioned above and call it or run it.
This is when you want to execute something.
Now if you want the result after execution, i think as per my knowledge, you need to dump the output in a table and then take/ read that table.
Please do close the thread if that answers your questions. Please help us keep the forums clean and open useful information only.
For more information search on help.sap.com and you will get lots of material.
Regards.
Den

ODI-1241: Oracle Data Integrator tool execution fails.

Hi
I'm getting the following error while running the OdiOSCommand command. I'm running dos2unix command to convert text files from dos to unix format.
Application tier is on a different host to the ODI setup. Getting the following error. Please help resolve this issue.
Error : ODI-1226: Step OdiOSCommand fails after 1 attempt(s).
ODI-1241: Oracle Data Integrator tool execution fails.
Caused By: com.sunopsis.dwg.function.SnpsFunctionBaseException: ODI-30038: OS command returned 1.

The issue was with the value set for the OUTPUT_DIR variable. It was pointing to the wrong location.
After setting it correctly the package completed successfully.
Thanks for all your replies.
To anwser your question. We are finding junk data and need to run the command to remove them from the input files which are coming from a different source.
Edited by: user761125 on Jun 3, 2012 11:38 PM

Someone has nomenclature (naming conventions) for oracle data integrator?

Someone has nomenclature (naming conventions) for oracle data integrator?

You should really move this question over to the Oracle Data Integrator forum(Data Integrator for a more expedient response.

Data Integrator Questions

Similar Messages

Maybe you are looking for