A question on ODI Performence

Guys,
Iam loading the data from AS/400 TO ORACLE Using ODI interface.
Iam using LKM SQL TO ORACLE AND IKM SQL CONTROL APPEND.
I have set the array fetch size and Batch update size to 200 and ODI_INIT_HEAP=256m ODI_MAX_HEAP=4096m
Iam trying to load 4.5 millions into oracle and it is taking around 13mnts.
I thaught it is slightly slower.is it any way we can increase the performence?Any ideas?
Cheers

13 minutes seems to be good for 4.5 million records. Still issues means you have go into database level to see the execution plan, statistics etc etc. ODI level i dont think there is anything that can improve the performance.
refer this post of Uli
http://www.business-intelligence-quotient.com/?p=1205

Similar Messages

Questions about ODI Agent

Being new to ODI, I have some simple questions.
ODI server is installed on Windows-2008 machine. Its repository is on MS-SQL-Server database which is also on a Windows-2008 machine.
A non-ODI process is creating files on a Unix server, which needs to be picked up by ODI and loaded into a MS-SQL-Server table.
*(Q 1):* Do we need to install ODI Agent on Unix, so that ODI can "see" the unix files? OR is there another simpler way??
*(Q 2):* Is there an Oracle link about installing ODI11g Agent on Unix? I only see documents talking about installing ODI Agent on Windows.
*(Q 3):* What minimum ODI components need to be installed on Unix, so that ODI Agent runs on Unix?

Nasar Ali-Khan wrote:
Being new to ODI, I have some simple questions.
ODI server is installed on Windows-2008 machine. Its repository is on MS-SQL-Server database which is also on a Windows-2008 machine.
A non-ODI process is creating files on a Unix server, which needs to be picked up by ODI and loaded into a MS-SQL-Server table.
*(Q 1):* Do we need to install ODI Agent on Unix, so that ODI can "see" the unix files? OR is there another simpler way??
You need to install ODI agent on Unix or go for accessing UNIX file from WINDOWS application eg Samba
*(Q 2):* Is there an Oracle link about installing ODI11g Agent on Unix? I only see documents talking about installing ODI Agent on Windows.
The Agent installation process is basically same
*(Q 3):* What minimum ODI components need to be installed on Unix, so that ODI Agent runs on Unix?Go for AGENT only installation
Thanks,
Sutirtha

ODI Performence

Guys,
Iam loading the data from AS/400 TO ORACLE Using ODI interface.
Iam using LKM SQL TO ORACLE AND IKM SQL CONTROL APPEND.
I have set the array fetch size and Batch update size to 200 and ODI_INIT_HEAP=256m ODI_MAX_HEAP=4096m
Iam trying to load 4.5 millions into oracle and it is taking around 13mnts.
I thaught it is slightly slower.is it any way we can increase the performence?Any ideas?
Cheers

any help here guys

XML/XSD question (using ODI)

Hi all.
I have posted this in the ODI forum as well, but this may be a more proper place to ask for help.
I'm working on a new dwh solution where the main source of data will come from XML-files. The problem is that we are having difficulties with the use of abstract types in the xsd-file. We currently use ODI to read the XML-files and to store the data in our database, but all fields from the XML-files are not visible in the target tables.
The problem can be simplified like this example:
We have a main element, testElement, which can contain one or more publications.
Publication is of type PublicationType, and PublicationType is an abstract that contains title, author and date.
We have four other types which extends PublicationType; BookType, MagazineType, NewspaperType and AdsType. They all contain additional fields.
XSD-file
<?xml version="1.0" encoding="UTF-8"?>
<schema xmlns="http://www.w3.org/2001/XMLSchema"
targetNamespace="urn:testing:kontroll:example:oppgave:v1"
xmlns:tns="urn:testing:kontroll:example:oppgave:v1"
xmlns:xdb="http://xmlns.oracle.com/xdb"
elementFormDefault="qualified">
<element name="testElement" type="tns:TestElementType" xdb:defaultTable="TEST_TAB" />
<complexType name="TestElementType">
<sequence>
<element name="publication" type="tns:PublicationType" minOccurs="1"
maxOccurs="unbounded" />
</sequence>
</complexType>
<complexType name="PublicationType" abstract="true">
<sequence>
<element name="title" type="string"/>
<element name="author" type="string" minOccurs="0"
maxOccurs="unbounded" />
<element name="date" type="string"/>
</sequence>
</complexType>
<complexType name="BookType">
<complexContent>
<extension base="tns:PublicationType">
<sequence>
<element name="ISBN" type="string"/>
<element name="publisher" type="string"/>
</sequence>
</extension>
</complexContent>
</complexType>
<complexType name="MagazineType">
<complexContent>
<extension base="tns:PublicationType">
<sequence>
<element name="editor" type="string"/>
<element name="period" type="string" minOccurs="0"
maxOccurs="1"/>
</sequence>
</extension>
</complexContent>
</complexType>
<complexType name="NewspaperType">
<complexContent>
<extension base="tns:PublicationType">
<sequence>
<element name="daily" type="boolean"/>
<element name="owner" type="string" minOccurs="0"
maxOccurs="1"/>
</sequence>
</extension>
</complexContent>
</complexType>
<complexType name="AdsType">
<complexContent>
<extension base="tns:PublicationType">
<sequence>
<element name="company" type="string"/>
<element name="article" type="string" />
</sequence>
</extension>
</complexContent>
</complexType>
</schema>
XML-file
<?xml version="1.0" encoding="UTF-8"?>
<tns:testElement xmlns:tns="urn:testing:kontroll:example:oppgave:v1" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="urn:testing:kontroll:example:oppgave:v1 ExampleXMLSchema.xsd ">
<tns:publication xsi:type="tns:BookType">
<tns:title>Boken</tns:title>
<tns:author>Arne Svendsen</tns:author>
<tns:date>2001</tns:date>
<tns:ISBN>78979797</tns:ISBN>
<tns:publisher>The Company Ltd</tns:publisher>
</tns:publication>
<tns:publication xsi:type="tns:MagazineType">
<tns:title>Fancy Magazine</tns:title>
<tns:author>Mads Madsen</tns:author>
<tns:date>2011</tns:date>
<tns:editor>Svante Svantesen</tns:editor>
<tns:period>weekly</tns:period>
</tns:publication>
</tns:testElement>
When tables are generated in the database through ODI I'm not getting all the attributes present in the xml-file.
Can anybody tell me if this should work (and, if yes, why it doesn`t)? Or if the XSD/XML looks wrong in some way?
Is this a known limitation in Oracle or ODI etc.?
Any pointers to documentation describing similar problems would also be helpful.
Thanks,
Bjørn

Hi, Bjørn,
When tables are generated in the database through ODI I'm not getting all the attributes present in the xml-file.I don't know ODI, so I'm just curious here : what tables are generated? Is there one table per extented type (+ child tables for repeating elements), or just one Publication table with missing columns?
I've looked at the other thread you mentioned on the ODI forum, and saw that you'd also want to store XML files in an XMLType table.
I tested the schema registration in the database to see how Oracle reacts to the structure, and it looks OK, type extensions are supported.
SQL> begin
2   dbms_xmlschema.registerSchema(
3     schemaURL => 'ExampleXMLSchema.xsd'
4   , schemaDoc => bfilename('TEST_DIR', 'ExampleXMLSchema.xsd')
5   , local => true
6   , genTypes => true
7   , genTables => true
8   , enableHierarchy => dbms_xmlschema.ENABLE_HIERARCHY_NONE
9   );
10 end;
11 /
PL/SQL procedure successfully completed
SQL> insert into test_tab
2 values (xmltype('<?xml version="1.0" encoding="UTF-8"?>
3 <tns:testElement xmlns:tns="urn:testing:kontroll:example:oppgave:v1"
4                   xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
5                   xsi:schemaLocation="urn:testing:kontroll:example:oppgave:v1 ExampleXMLSchema.xsd ">
6    <tns:publication xsi:type="tns:BookType">
7      <tns:title>Boken</tns:title>
8      <tns:author>Arne Svendsen</tns:author>
9      <tns:date>2001</tns:date>
10      <tns:ISBN>78979797</tns:ISBN>
11      <tns:publisher>The Company Ltd</tns:publisher>
12    </tns:publication>
13    <tns:publication xsi:type="tns:MagazineType">
14      <tns:title>Fancy Magazine</tns:title>
15      <tns:author>Mads Madsen</tns:author>
16      <tns:author>Arne Svendsen</tns:author>
17      <tns:date>2011</tns:date>
18      <tns:editor>Svante Svantesen</tns:editor>
19      <tns:period>weekly</tns:period>
20    </tns:publication>
21 </tns:testElement>'))
22 ;
1 row inserted
Querying as relational data :
SQL> select x.*
2 from test_tab t
3     , xmltable(xmlnamespaces(default 'urn:testing:kontroll:example:oppgave:v1'),
4       'for $i in /testElement/publication
5        return element r {
6          $i/child::*
7        , element pubtype {
8            typeswitch($i)
9              case element(publication, BookType)      return "Book"
10              case element(publication, MagazineType) return "Magazine"
11              case element(publication, AdsType)       return "Ads"
12              case element(publication, NewspaperType) return "Newspaper"
13              default return "Publication"
14          }
15        }'
16       passing t.object_value
17       columns title   varchar2(500) path 'title'
18             , authors varchar2(500) path 'string-join(author,",")'
19             , pubdate number(4)     path 'date'
20             , isbn    number(13)    path 'ISBN'
21             , editor varchar2(500) path 'editor'
22             , period varchar2(500) path 'period'
23             , pubtype varchar2(30) path 'pubtype'
24       ) x
25 ;
TITLE                 AUTHORS                        PUBDATE           ISBN EDITOR                PERIOD      PUBTYPE
Boken                 Arne Svendsen                     2001       78979797                                   Book
Fancy Magazine        Mads Madsen,Arne Svendsen         2011                Svante Svantesen      weekly      Magazine

Question about ODI execution log

Hi guys,
I need to delete the result of the execution of a package I'm referring to get in a table if the scenario runs with status of warning, mistake or sucess. I can see the values in the operation.
Do you know uin which table ODI stores this values?
Thanks in advance.

ORV wrote:
Hi guys,
I need to delete the result of the execution of a package I'm referring to get in a table if the scenario runs with status of warning, mistake or sucess. I can see the values in the operation.
Do you know uin which table ODI stores this values?
Look for SNP_SESSION
SNP_STEP_LOG
Thanks in advance.

Question on ODI Model.

HI All,
I am using ODI 11.6.
I have a Data file which is Fixed width.
There is a confusion over a “EMAIL” column
In data file the position of OTHER_INFO overlaps the position of EMAIL value.
The value in EMAIL is capture in OTHER_INFO too.
PA_FLAG POSITION(448:448) CHAR,
EMAIL POSITION(489:499) CHAR,
OTHER_INFO POSITION(451:674) CHAR,
SCENE_ID POSITION(501:516) CHAR
EMAIL POSITION(489:499) CHAR,
OTHER_INFO POSITION(451:674) CHAR,
Please let us know how to implement this in Model.
Thanks,
Lony

lony wrote:
Yes Sutirtha,always we are getting Fixed files.But in this particular case this is Overlap.
Need to know what kind of coding/steps we need to process to overlap files.Do you have a PK on the data in the file? If you do, treat the file as seperate datastores on the same file to get around the overlap, process each datastore as required (1st datastore is loaded, 2nd datestore is 'updated' onto the row from the 1st datastore).
Or get the jython book out and build something to clean the file pre -load as suggested.

Some Basic Questions in ODI

Hi,
I am a fresher in ODI That's why I have some basic query On ODI:-
*1)What are the importances of Physical and Logical Architecture in ODI(In Topology).Mainly what are the basic differences of the contents of these architecture so that we need both of them??*
*2)What are the importances of the Master and Work Repository???And some basic information about their contents??*
Please help;
Thank You in advance
Anindya
Edited by: Anindya Chatterjee on Apr 25, 2012 3:50 AM

>
*1)What are the importances of Physical and Logical Architecture in ODI(In Topology).Mainly what are the basic differences of the contents of these architecture so that we need both of them??*
Physical Architecture holds the real information to your dataserver .
For example ,if your server address has changed then you need to modify the Physical Architecture so that it reflects the current/corrent address
Logical Architecture connects to your Physical Architecture via context . Entire ODI code works on Logical Architecture .
For example ,if your server address has changed then you need to modify the Physical Architecture so that it reflects the current/corrent address and there is no need to change any thing in your ODI code.
*2)What are the importances of the Master and Work Repository???And some basic information about their contents??*
These are the most important thing in ODI. Entire ODI application depends on these.
Master repository holds all metadata stuff like information about topology , technology
Work repository holds all design related info like interface, package etc.
Thanks,
Sutirtha

Question about the performence of Java Card

Could anyone here tell me how slow running algorithms, like rc4�Ades3 or rsa, on an 8k EEPROM JavaCard?
thanx in advance
rong

Hi:
The performance of javacard is no direct relation with chips. At present most chips is still 8 bit processor. 16 bit processor has more higher price. The reason of running algorithm slow is same as the java applet running on PC platform. Any java and javacard applet must be interpreted by java VM or javacard VM. This way is different from common application windows-based running. This kind application is machine code which can be understanded by hardware directly. But bytecode of java applet is not. It must be translated into machine code by VM. So running speed must slow down. As I konw, some mainstream chip maker is developing javachip. It can run java applet several times faster than software implementation.
Chen Song
Beijing

Query Regarding Updation/Migration of ODI 10g To ODI 11g.

Hi All,
Currently I am using ODI 10g Version & Repositories ( Work & Master) have been installed on Oracle database version "Oracle Database 10g Enterprise Edition Release 10.2.0.4.0 - 64bi"
We are thinking to migrate from ODI 10g to ODI 11g Version 11.1.1.5 & i have some queries which are metioned below.
1. Can we install ODI 11g Version 11.1.1.5 version with Repositories ( Work & Master) on Oracle Database 10g Enterprise Edition Release 10.2.0.4.0 - 64bi" or do i need to upgrade my database version to 11G?.
2. If yes then, Can i upgrade or use exting Repositoires ( 10g one) for ODI 11g OR i have to create new Repositoires & move/migrate the objects of 10G repositories as mentioned in the Oracle installation doc.
3. Currently I am using OBIEE 10g for reposrting purpose & if i switch to ODI 11g , Do i need to use OBIEE 11g?
ODI gurus, I need your reponse ASAP & i have to share it on urgent basis.
Thanks
Edited by: neeraj_singh on May 15, 2013 9:58 PM

neeraj_singh wrote:
Hi All,
Currently I am using ODI 10g Version & Repositories ( Work & Master) have been installed on Oracle database version "Oracle Database 10g Enterprise Edition Release 10.2.0.4.0 - 64bi"
We are thinking to migrate from ODI 10g to ODI 11g Version 11.1.1.5 & i have some queries which are metioned below.
1. Can we install ODI 11g Version 11.1.1.5 version with Repositories ( Work & Master) on Oracle Database 10g Enterprise Edition Release 10.2.0.4.0 - 64bi" or do i need to upgrade my database version to 11G?.You can install ODI 11.1.1.5 but you have to upgrade your repositories using upgrade assistant
refer http://docs.oracle.com/cd/E23943_01/upgrade.1111/e12642/tasklist.htm#CIHGIDFG
2. If yes then, Can i upgrade or use exting Repositoires ( 10g one) for ODI 11g OR i have to create new Repositoires & move/migrate the objects of 10G repositories as mentioned in the Oracle installation doc.No need to create new repositories. You just upgrade them. But you need to takecare of certain things as you are a 10g user. Refer below link for the prerequisite
http://docs.oracle.com/cd/E23943_01/upgrade.1111/e12642/prevusers.htm
3. Currently I am using OBIEE 10g for reposrting purpose & if i switch to ODI 11g , Do i need to use OBIEE 11g?Not clear about the question ?
>
ODI gurus, I need your reponse ASAP & i have to share it on urgent basis.
Thanks
Edited by: neeraj_singh on May 15, 2013 9:58 PM

Getting Error Out Of Memory while importing the work repository in ODI 10g

I exported the work repository from topology of ODI 10g of one DB and tried importing it in the another ODI 10g topology of another DB.While importing i got the error 'Out of Memory' .
Can somebody suggest me ,how to solve the heap size out of memory issue while importing in ODI 10g.
Thanks in Advance.

Hi,
you have to post your question in ODI forum
Data Integrator
Suresh

How to do Setup and Security implementation in ODI

HI Friends,
I have few question regarding ODI installations.I am using
Oracle DB version is Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
ODI is ODI 11.1.1.5 version.
While installing can we go for
One Master repository for Dev and UAT, mainly because we have one physical server for UAT connecting to UAT DB and Dev DB. And a separate Master repository for Production?
We have 2 groups of users .One is developer and One is tester.
Tester donot have a permission to use or check the development codes.They have only the Run permission in operator.
How to do this security implementation in ODI while installing.
Plz confirm me on this.
Thanks,
Lony

The way I did it is,
Created an Execution Mode work repository for the QA purpose and thus only Scenarios & Load Plans were deployed on this QA repo. This had its own Master Repo as well.
For dev the Dev mode work repo is created where all the interfaces, packages, procedures can be developed or modified as and when required.
Thus, the testers have access only to the QA environment.
Otherwise you can assign roles to the users after the installation in the security tab. Give the operator, connect role to the testers.

Transaction Management in ODI in distributed Environment

Dear All,
I would like to understand how does ODI manages distributed transations so that the logical unit of work is either completely committed successfully or rolledback.
Eg. If I have to develop interface(s) in such a way that, the transaction is distributed that means the data is comming from more one source systems (SQL server, oracle , DB2 and so on) , and the data comming from three systems form a logical unit of work and one the system fails to provide the data, then how does ODI internally manages to rollback complete transaction or complete the transaction successfylly if all three sources provide the necessory data to complte the logical unit of work.
How would ODI implement concept of two phase commit?
Thanks in Advance

I have exactly the same question about ODI integration with multiple systems and the way he deals with failures!
Let's hope for some light :-)

ODI private conversion problem

Hi ODI gurus!
Today I have question about ODIs private conversion. Is is is possible to enforce ODI during conversion to use specific number and date mask? Lets say odi always converts numbers using '.' instead of ','.
If yes please let me know how ;)
Thanks in advance.
With regards,
PsmakR

Thanks for your quick reply.
Oh...Didnt know that...thanks a bit :) But in case of date ? You also can set mask ? like yyyy-mm-dd ??
Edit:
In logical format box I can see the format is dd/mm/yyyy and helps says its java date format based on my local machine settings. Is there a way to change it to yyyy-mm-dd?
Regards,
PsmakR
Edited by: PsmakR@ on Nov 4, 2009 1:59 PM

Loading data including Smart Lists data using ODI Planning KM

Hi all,
a question regarding ODI loading Smart Lists Data...
Can somebody confirm if we can load data from a source file which has the smart lists labels, instead of the smart list values id (ex: YES instead of 1)? i suppose Planning will do the conversion when loading to essbase
By the way, is Outline load utility working in the same way?
Thanks in advance

Hi John,
not because your site was blocked by the customer's firewall :-(
by the way I was referring to loading data containing smart lists accounts. In any case, I have seend that you have other blog entry where you were loading data using labels instead of keys
http://john-goodwin.blogspot.com/2009/05/odi-series-loading-smart-list-data-into.html
This is what I was looking for.
Another question, in outline load we have the chance of putting driver members in the source file which makes the process more flexible. Think if our driver members (Accounts) change dynamically.
Wuold it be any customization possible to add the same functionality to the ODI Planning KM?
We are not likely to use Essbase KM and joins with Plannign repository tables as our source data has dates, free text, figures,smarlists accounts, etc.
Thanks!

ODI Hyperion Planning Integration

I have one question on ODI. If my application has 3 database and all of them have different accounts and entity dimension. How will i tell the ODI to update a particular database dimension and not all. Example below
If I have application called : Sample
3 database : Plan1, Plan2, Plan3
All these have accounts and entity dimension but all of them have different accounts and entities. How will i tell the ODI to update which accounts dimension?

You use the target columns - Plan Type (Plan1), Plan Type (Plan2),Plan Type (Plan3)
A True or 1 means to use that plan type, False or 0 means not to use that plan type.
Cheers
John
http://john-goodwin.blogspot.com/

A question on ODI Performence

Similar Messages

Maybe you are looking for