Ordering in ODI
I am using ODI to create Flat file from another flat file. No transformation. But everytime I run the interface its changing the order of the content. Is there a setting in Interface I can select that avoids the order change issue.
-app
If there is no transformation, then why cant you use OdiFileCopy instead ?
Interfaces do all processing on relational tables and there is no notion of a order in relational algebra.
But if you insist, then you will have to modify the KMs to specify the order clause. There is no switch in an interface to do that.
Similar Messages
-
How to Handle sorting stage in datastage on ODI level?
Hi,
How to handle sorting stage in datastage on ODI level ?
Need to do KM customization..
if yes how?
else what to do?
Thanks.Hi,
In Datastage, there is sorting stage specially sort the data after applying the transormations and filters seperately.
My requirement is we need to apply sorting on Target Database after applying some transformations,Aggregations and filters on source database *(Before Loading into Target data should be in the sorted Order)*
In odi,there is no sorting stage separtely for those requirement sorting the data either Ascending / Descending order *(how can i approach sorting stage in ODI)*
Thanks in Advance
Edited by: anu on Oct 11, 2011 6:10 AM -
Help using oracle syntax "SUM(col1) over (order by col2)" using ODI
Hi all
I want to load data from oracle to ESSBASE using ODI, and I know oracle have such syntax sum(col1) over (order by col2,col3) which can get the accumulation data, e.g
Oracle data table
col1, col2, value
A 2009-1 10
A 2009-2 10
A 2009-3 10
And the essbase need
col1 col2 value
A 2009-1 10
A 2009-2 20
A 2009-3 30
However after i try this in ODI, error occur:
org.apache.bsf.BSFException: exception from Jython:
Traceback (innermost last):
File "<string>", line 32, in ?
java.sql.SQLException: ORA-00979: not a GROUP BY expression
and the original generated SQl by ODI :
select 'HSP_InputValue' "HSP_Rates",MAP_KMDZ_TABLE.BUD_DYKM "Account",MAP_MONTH.ESS_MONTH "Period",MAP_YEAR.ESS_YEAR "Year",'Actual' "Scenario",'Draft' "Version",TEMP_LIRUN.CURRENCY "Currency",MAP_COMPANYCODE.ESS_COMPCODE "Entity",substr(MAP_KMDZ_TABLE.BUD_BUSINESSOBJECT,1,80) "BusinessObject",'Route_NoRoute' "Route",MAP_TRANSPORT.ESS_TRANSPORT "Transport",substr(MAP_KMDZ_TABLE.BUD_BUSINESSACTIVITY,1,80) "BusinessActivity",substr(MAP_KMDZ_TABLE.BUD_CHANNEL,1,80) "Source",'NoCounterparty' "Counterparty",sum(TEMP_LIRUN.DATAVALUE) over (order by MAP_KMDZ_TABLE.BUD_DYKM,MAP_YEAR.ESS_YEAR,MAP_MONTH.ESS_MONTH,TEMP_LIRUN.CURRENCY,MAP_COMPANYCODE.ESS_COMPCODE,MAP_TRANSPORT.ESS_TRANSPORT,MAP_KMDZ_TABLE.BUD_BUSINESSACTIVITY,MAP_KMDZ_TABLE.BUD_BUSINESSOBJECT,MAP_KMDZ_TABLE.BUD_CHANNEL) "Data" from ETL_DEV.TEMP_LIRUN TEMP_LIRUN, ETL_DEV.MAP_KMDZ_TABLE MAP_KMDZ_TABLE, ETL_DEV.MAP_MONTH MAP_MONTH, ETL_DEV.MAP_YEAR MAP_YEAR, ETL_DEV.MAP_COMPANYCODE MAP_COMPANYCODE, ETL_DEV.MAP_TRANSPORT MAP_TRANSPORT where (1=1) And (TEMP_LIRUN.COSTELMNT=MAP_KMDZ_TABLE.SAP_ZZKM)
AND (TEMP_LIRUN.FISCYEAR=MAP_YEAR.SAP_YEAR)
AND (TEMP_LIRUN.FISCPER3=MAP_MONTH.SAP_MONTH)
AND (TEMP_LIRUN.COMP_CODE=MAP_COMPANYCODE.SAP_COMPCODE)
AND (TEMP_LIRUN.WWHC=MAP_TRANSPORT.SAP_WWHC) Group By MAP_KMDZ_TABLE.BUD_DYKM,
MAP_MONTH.ESS_MONTH,
MAP_YEAR.ESS_YEAR,
TEMP_LIRUN.CURRENCY,
MAP_COMPANYCODE.ESS_COMPCODE,
substr(MAP_KMDZ_TABLE.BUD_BUSINESSOBJECT,1,80),
MAP_TRANSPORT.ESS_TRANSPORT,
substr(MAP_KMDZ_TABLE.BUD_BUSINESSACTIVITY,1,80),
substr(MAP_KMDZ_TABLE.BUD_CHANNEL,1,80)
I know ODI think sum.. over must append group by , however it's not! How to solve this problem.
Thank All for your attention
SOS!
EthanHi Ethan,
In my exeprnc I faced a similar kind of situation.
Two work arounds.
1. Write one procedure and execute the same using ODI procedure.
2. Customize a Km and use that KM in your interface.
I guess in your query Group by function is not needed. (if this is the case you can achive this by a smple customization step in KM)
for example : your current KM will generate a query like this:-
select x,y, sum(x) over (order by y) as sumx FROM TestTable group by x, y
and you need a query like this
select x,y, sum(x) over (order by y) as sumx FROM TestTable
go to your KM (duplicate the KM which you are using and rename _withoutGroup )
remove the group by function from select query
(remove the API function <%=snpRef.getGrpBy()%> from insert into i$ table step)
please let me know if you need more help on this
regards,
Rathish -
In what order what components needed to be configured in ODI?
I will be migrating data from TXT files to Oracle 10g.
In what order what components/objects (e.g. Project, Models, topology, data store, metadata, schema etc) needed to be configured in ODI?
This will help me go through ODI manual in a logical order.Hi,
Have a look as a kick off,
http://www.oracle.com/technology/obe/fusion_middleware/odi/ODIproject_flatfile-to-table/ODIproject_flatfile-to-table.htm
Thanks,
Guru -
ODI-1228: ORA-22950: cannot ORDER objects without MAP or ORDER method
Simple interface between two schemas in the same oracle database (10g)
I am trying to copy one table and do one simple lookup (in a table located in 3rd schema on the same database)
Integration task fails on
ODI-1228: Task messagexml_document (Integration) fails on the target ORACLE connection S2_P1.
Caused By: java.sql.SQLException: ORA-22950: cannot ORDER objects without MAP or ORDER method
Can anybody tell me, what I am doing wrong? Code that generate this error is just a simple INSERT with SELECT and sub SELECT with JOIN?
I just can't find anything about this error.
I'm stuck :-(I discovered that one of my fields is an XMLType field and is a part of comparison ODI do when it tries to do incremental update. The error message here is just a message from db that it can't compare XMLType fields to each other.
Is there any way to learn ODI to not to compare by XMLType field? -
Hyperion Planning- Account dimension - Sort Order Issue with ODI 11.1.1.5
Hello Experts,
First of all, I thank you everybody in this forum for posting their valuable suggestions.
I am facing a strange issue with ODI (Version 11.1.1.5) while loading metadata to Planning ACCOUNT dimension (Version 11.1.2.x). I am using a Oracle view to load metadata to this dimension. I have defined the sort order in the view and enabled SORT_ORDER_BY_INPUT. For the fresh load to the dimension, everything is working fine. But, when I move a member from one parent to another parent, and define it as the top member of new parent, it is missing its sort order.
But it is working fine if you define it as the second, third...or last member under new parent. I have tried all the possible ways by flipping all the properties but unable to fix it.
Please help me here to resolve this issue.
Your help is greatly appreciated!!
Thanks
Edited by: user11965311 on Sep 20, 2011 7:07 PMTo be honest I think you are best logging it with Oracle because it sounds like you are doing everything correctly so it could be a bug.
Have you tested this on any previous versions of ODI or is it a new installation?
If it does get logged with Oracle please keep me informed of the outcome as I would be interested to hear.
Cheers
John
http://john-goodwin.blogspot.com/ -
ODI-15605: Multiple ordered joins in this dataset use the same order number.
I get this error but only have 3 ordered joins numbered 10, 25 and 30; I also have ten lookups specified as left-outer joins.
I presume the lookup joins also have order numbers. Does anyone know how to find out those order numbers?
(For the moment I'm using a work-around of doing the lookups in the staging area, which seems to avoid the problem.)
ODI version: 11.1.1, Build ODI_11.1.1.5.0_GENERIC_110422.1001
Java: 1.6.0_45
Windows: 7 Pro SP 1, 64-bit
Keith H.Forgot to mention, I get this error when I save the interface, not when I run it. K
-
Hello Friends,
We are extracting data from oracle table to Essbase target, we need to in-corporate Order By clause on source while extracting data.
Ex: Select xxxx, WEEK_NUM from aaaaa
where xxxx = yyy
ORDER BY WEEK_NUM asc
Can you suggest how to do this?
Thanks.Hi Can you please check the below thread
Sorting or Order By on ODI
may be this what you looking for. -
We are building our EssbaseASO cube using FlatFiles which are pushed to EPMA via interface tables and then the EPMA Essbase app is deployed to Essbase, this entire job is done through a ODI interface/package. The problem I am facing is the Order in which members in EPMA appear, even though the FlatFile has the right sorting order, by the time the hierarchies arrive into the EPMA interface table the sort order is changed randomly.
I am using the File to SQL control append IKM in ODI and some where on the way I saw a suggestion to add a new option to insert "ORDER BY" into the IKM. I successfully did this and it did change the sort order but even this is not the right order(order in which my flatfile has the dimensions).
I can't understand why Oracle/ODI needs to randomize the rows without being asked to do so! Please let me know if anyone has faced this issue before and if they were able to resolve it.The EPMA interface tables have a SORTORDER column. Make sure this is populated with numeric values sequencing the order you want your members to appear in the EPMA hierarchies and when you import from the interface tables this order will be respected. Prior to this feature being introduced the workaround was to create a view referencing the interface tables imposing the required ORDER BY clause but this isn't required in 11.1.2.1 just use the SORTORDER column
-
ODI re-ordering hierarchy when updating an attribute
Hi,
I have a daily time period custom dimension with a number of attributes on it. One of these attributes needs to be updated on a single member daily (the current day's member). I created a source with one record in it - the daily time period member (which is based on the system date) and the attribute value. I created an interface to update this member. The interface works fine, except it puts the member that was updated at the bottom of its hierarchy, which I don't want. I need all of the members to remain in their original order. Does anyone know of any way to prevent the move from occurring?
SabrinaI believe that is the default way it works, if you would like to operate differently then you should contact Oracle and put forward an enhancement request.
Cheers
John
http://john-goodwin.blogspot.com/ -
ODI: Order records before processing
Hi All,
We have a requirement where the records has to ordered and processed through various scenarios based on the value
Ex) I have a data like this.
EMPNo DEPT
0001 A
0002 B
0003 A
0004 A
0005 A
0006 B
I have to order this table data based on department and process the emp data under department A through Scenario A, and under department B through Scenario B.
Please advise me whats the best way to implement it.
Note: The solution should fit to CDC scenario as well.in the interface select the UD flag for dept mapping and in the KM just put the order by clause.
ORDER BY
<%=snpRef.getColList("","[EXPRESSION]","","","UD1")%>
You can refer this also
http://odiexperts.com/order-by/
Bhabani
http://dwteam.in -
Hi,
I have two datasets (each contain three tables joined together, different filter criteria in each dataset) in my ODI interface on which I perform the MINUS SET commad. The results from this are to be written to a file. When I run the pure SQL in a SQL editor I get the result set back I am expecting. However, when I run my ODI interface I get no results. When I look at the generated SQL all I have is a SQL statement based on a single table from my dataset with no reference to the joined tables and no reference to the 2nd dataset or MINUS command. ODI version is 11.1.1.6. Is there an issue with the dataset feature?IKM SQL to PLanning which has a small customization to include an order by
-
Unable to load data to Hyperion planning application using odi
Hi All,
When I try to load data into planning using odi, the odi process completes successfully with the following status in the operator ReportStatistics as shown below but the data doesn't seem to appear in the planning data form or essbase
can anyone please help
org.apache.bsf.BSFException: exception from Jython:
Traceback (most recent call last):
File "<string>", line 2, in <module>
Planning Writer Load Summary:
Number of rows successfully processed: 20
Number of rows rejected: 0
source is oracle database
target account dimension
LKM SQL TO SQL
IKM SQL TO HYPERION PLANNING is used
In Target the following columns were mapped
Account(load dimension)
Data load cube name
driverdimensionmetadata
Point of view
LOG FILE
2012-08-27 09:46:43,214 INFO [SimpleAsyncTaskExecutor-3]: Oracle Data Integrator Adapter for Hyperion Planning
2012-08-27 09:46:43,214 INFO [SimpleAsyncTaskExecutor-3]: Connecting to planning application [OPAPP] on [mcg-b055]:[11333] using username [admin].
2012-08-27 09:46:43,277 INFO [SimpleAsyncTaskExecutor-3]: Successfully connected to the planning application.
2012-08-27 09:46:43,277 INFO [SimpleAsyncTaskExecutor-3]: The load options for the planning load are
Dimension Name: Account Sort Parent Child : false
Load Order By Input : false
Refresh Database : false
2012-08-27 09:46:43,339 INFO [SimpleAsyncTaskExecutor-3]: Begining the load process.
2012-08-27 09:46:43,355 DEBUG [SimpleAsyncTaskExecutor-3]: Number of columns in the source result set does not match the number of planning target columns.
2012-08-27 09:46:43,371 INFO [SimpleAsyncTaskExecutor-3]: Load type is [Load dimension member].
2012-08-27 09:46:43,996 INFO [SimpleAsyncTaskExecutor-3]: Load process completed.Do any members exist in the account dimension before the load? if not can you try adding one member manually then trying the load again.
Cheers
John
http://john-goodwin.blogspot.com/ -
Unable to load metada into Hyperion Planning using ODI
HI All,
I am using ODI 11g and trying to load the metadata for Hyperion Planning application 11.1.2.1. But I couldnt load all the Product members in Product Dimension.
Could able to load few members but was able to run the interface successfully but thrown error while loading few members(Most of the members are shared members, verified that base members existed). Please find the below error log.
2011-11-17 06:18:06,534 INFO [SimpleAsyncTaskExecutor-2]: Oracle Data Integrator Adapter for Hyperion Planning
2011-11-17 06:18:06,550 INFO [SimpleAsyncTaskExecutor-2]: Connecting to planning application [xxxx] on [xxxx]:[11333] using username [xxxx].
2011-11-17 06:18:06,675 INFO [SimpleAsyncTaskExecutor-2]: Successfully connected to the planning application.
2011-11-17 06:18:06,706 INFO [SimpleAsyncTaskExecutor-2]: The load options for the planning load are
Dimension Name: Product Sort Parent Child : false
Load Order By Input : false
Refresh Database : false
2011-11-17 06:18:06,768 INFO [SimpleAsyncTaskExecutor-2]: Begining the load process.
2011-11-17 06:18:06,878 DEBUG [SimpleAsyncTaskExecutor-2]: Number of columns in the source result set does not match the number of planning target columns.
2011-11-17 06:18:07,440 INFO [SimpleAsyncTaskExecutor-2]: Load type is [Load dimension member].
2011-11-17 06:18:07,487 ERROR [SimpleAsyncTaskExecutor-2]: Record [[D090, Mobile Mice Cordless_Prod type, D090-Flores DJ, null, Shared, null, null, null, null, null, null, null, +, null]] was rejected by the Planning Server.
2011-11-17 06:18:07,503 ERROR [SimpleAsyncTaskExecutor-2]: Record [[D091, Mobile Mice Cordless_Prod type, D091-Fiji BT, null, Shared, null, null, null, null, null, null, null, +, null]] was rejected by the Planning Server.
2011-11-17 06:18:07,518 ERROR [SimpleAsyncTaskExecutor-2]: Record [[D093, Mobile Mice Cordless_Prod type, D093-New York, null, Shared, null, null, null, null, null, null, null, +, null]] was rejected by the Planning Server.
2011-11-17 06:18:07,550 ERROR [SimpleAsyncTaskExecutor-2]: Record [[D060, Mobile Mice Cordless_Prod type, D060-Corbusier Vista, null, Shared, null, null, null, null, null, null, null, +, null]] was rejected by the Planning Server.
2011-11-17 06:18:07,565 ERROR [SimpleAsyncTaskExecutor-2]: Record [[D064, Mobile Mice Cordless_Prod type, D064-Sardinia Laser, null, Shared, null, null, null, null, null, null, null, +, null]] was rejected by the Planning Server.
2011-11-17 06:18:07,581 ERROR [SimpleAsyncTaskExecutor-2]: Record [[D065, Mobile Mice Cordless_Prod type, D065-Ibiza Optical, null, Shared, null, null, null, null, null, null, null, +, null]] was rejected by the Planning Server.
Regards,
SPCan you check the error log file as you have posted the log file, it should give more information to why the records were rejected.
Cheers
John
http://john-goodwin.blogspot.com/ -
Unable to load Dimension into Hyperion planning using ODI ?
Hi All
We are trying to load Dimension into hyperion planning Ver. 11.1.2 using ODI. We have created the interface and mapped the source csv file to target planmning application using ODI KM.
LKM file to SQL
IKM SQL to Planning
We get success in ODI's Operator but the Dimension is not updated nor new data is insreted.
We get this message in Error file:-
+
Retail Format,Parent,Alias: Default,Data Storage,Two Pass Calculation,Smart List,Data Type,Plan Type (APlan),Error_Reason
ABC,Total Format,,StoreData,,,,Aplan,Cannot load dimension member, error message is: java.lang.RuntimeException: Fetch of saved member "ABC" failed.
+
We get this message in log files:-
+
2010-07-22 07:04:06,550 INFO [DwgCmdExecutionThread]: Oracle Data Integrator Adapter for Hyperion Planning - Release 9.3.1.1
2010-07-22 07:04:06,550 INFO [DwgCmdExecutionThread]: Connecting to planning application [******] on [********]:[11333] using username [admin].
2010-07-22 07:04:06,597 INFO [DwgCmdExecutionThread]: Successfully connected to the planning application.
2010-07-22 07:04:06,597 INFO [DwgCmdExecutionThread]: The load options for the planning load are
Dimension Name: Retail Format Sort Parent Child : false
Load Order By Input : false
Refresh Database : true
2010-07-22 07:04:06,612 INFO [DwgCmdExecutionThread]: Begining the load process.
2010-07-22 07:04:06,612 DEBUG [DwgCmdExecutionThread]: Number of columns in the source result set does not match the number of planning target columns.
2010-07-22 07:04:06,659 INFO [DwgCmdExecutionThread]: Load type is [Load dimension member].
2010-07-22 07:04:06,675 ERROR [DwgCmdExecutionThread]: Record [[ABC, Total Format, null, null, StoreData, null, null, null, null, null, null, null, null, null, Aplan, null, null, null]] was rejected by the Planning Server.
2010-07-22 07:04:06,675 INFO [DwgCmdExecutionThread]: Planing cube refresh operation initiated.
2010-07-22 07:04:08,425 INFO [DwgCmdExecutionThread]: Planning cube refresh operation completed successfully.
2010-07-22 07:04:08,425 INFO [DwgCmdExecutionThread]: Load process completed.
+
Please help out .....Can you check the error log file as you have posted the log file, it should give more information to why the records were rejected.
Cheers
John
http://john-goodwin.blogspot.com/
Maybe you are looking for
-
Uploading a video to youtube?
how do you upload a video to youtube from the iPhone 4
-
Color issues while printing photos
I recently was able to successfully set up my iBook G4 wirelessly to my Windows-based Dell PC printer network (HP all-in-one printer). I've been printing documents and color banners etc. and everything looks great I have also added my HP Photosmart 7
-
Hello, We have some metadata, stored in database tables, populated using SQL and which does not change at runtime. This metadata captures a hierarchical structure. There is only one level in the hierarchy. X - X1 - X2 - X3 Y - Y1 - Y2 Z - Z1 - Z1 Now
-
Relationship b/w sga configuration and boot.ini in windows platforms
hi all, i have doubt on sga configuration and boot.ini settings. assume the following configuration's 1.Db is 10g r2. 2.OS is Windows server 2003 ,RAM is 8gb 3.SGA_max_size=4gb,SGA_atrget=4gb 1.For the above settings i must initialize the /3g /PAE in
-
Metadata Integrator not displayin cms details
Hi, I can successfully access Impact And Lineage from the DI Management Console, but all I can see on the left hand side pane are the repository and the datastores. CMS information is not being displayed. Nothing at all is displayed in the right ha