Data quality in ODI 11g

Hi all,
I want to use DQ tool for validating the source(comlex file). My all validations are mathmetical and complicated.
So it possible by doing with Oracle data quality tool which in ODI11g?
Regards,
Suresh

I once used a small ETL tool esProc to combined with Data Quality( to analyse the stock data).
It is famous for handling the complicated mathematical computation and statistical analysis, and its performance is also acceptable.
Check here for details about esProc

Similar Messages

Oracle Enterprise Data Quality for ODI

Hi,
1.     Can we install the below EDQ products on single machine
-Enterprise Data Quality Profiling for Oracle Data Integrator
-Enterprise Data Quality Batch Processing for Oracle Data Integrator
2.     How do we size EDQ ? and what is the preferred architecture ?
3.     Does “Enterprise Data Quality Profiling for Oracle Data Integrator” & “Enterprise Data Quality Batch Processing for Oracle Data Integrator” have same installation media ?
Thanks & Regards,
NC

You should find all you need in the Getting Started guide in the online help.
I recommend using the introductory wizard when first launching Director- this will take you through creating a project, connecting to some data, and creating a profiling process.

Error Inserting Data from Procedure ODI 11g (No data)

Hi everyone!
I have a problem inserting data from a procedure, the procedure works "fine" (no errors), on the log counter shows the number of rows inserted, but, on the database rows does not exists, an easy sample is:
TARGET: ORACLE
insert into table_t
(desc)
values
(:description)
SOURCE: ORACLE
select description from table_s
I check (ODI), the conection (works fine), modules (works fine), "select from table" (works fine).
I check (Database), inserting rows direct (works fine).
What can i check?
Thanks for your response.

Hi
Try below 2 things
First
In target:oracle
insert into table_t
(desc)
values
('#descpt');
Second
In target:oracle
insert into table_t
(desc)
values
('#Proc_Var');
Note: For alias name (*descpt* ) or Project variable (*Proc_Var*) with # symbol and single quotes
Regards,
Phanikanth

Not able to select physicalschema directory for file data server in ODI 11g

Hi,
I am a beginner to ODI tech and stuck up with an error while doing a tutorial (mentioned in this link - http://st-curriculum.oracle.com/obe/fmw/odi/odi_11g/ODIproject_ff-to-ff/ODIproject_flatfile-to-flatfile.htm).
While creating a physical schema for default file server(FILE_GENERIC) , I am not able to select schema directories and the name field with value 'FILE_GENERIC.Directory' is grayed out (non editable)
I have gone through many documents but could not find any relevant information for this.
So could you please let me know if any configurations required for this?
Thanks,
Anusha

Hi Oleg,
Thanks for your reply.
While creation of physical schema , Name field is grayed out , is that the default behaviour of the screen? because in the tutorial I could see the name filead is pointing to a file directory path.
Thanks,
Anusha

ODI 11g : JMS Queue XML Data Server creation

Hi Everybody,
I am facing a problem while i am trying to create a JMS Queue XML data server in ODI 11g. I have
the following details of the queue.
QueueManager=xxx;
TransportType=1;
HostName=ab.cde.fe.com;Port=77777;
Channel=CLIENT.TO.xxx1
destination name : SU.BH.RAJY.OTI.UPDATE_ITEM_RESPONSE.01
user : xyz
password : 123
I have sussefully created an jms datasouce in weblogic name 'eis/jms/abc' and also I have successfully
retrived the xml message from queue in BPEL
(using a jms adapter where
JMS Provider : Third Party,
Jms Provider Jndi Name -eis/jms/abc,
Operation name : consume_message,
destinamtion name is queue:///SU.BH.RAJY.OTI.UPDATE_ITEM_RESPONSE.01?targetClient=1).
But the new reqirement is to retive the xml data in ODI using "JMS Queue XML data server".I have tried
several ways(reading from internet) but failed to configure physical dataserver and reverse the xml message.
Also failed to understand properly the oracle post (http://docs.oracle.com/cd/E21764_01/integrate.1111/e12644/jms_xml.htm#CHDFCFBI).
Speically this portion "JNDI URL: <JMS_RESOURCE>?d=<DTD_FILE>&s=<SCHEMA>&JMS_DESTINATION=<JMS_DESTINATION_NAME>.".
What will be the "JMS_RESOURCE" in my case.
How can I configure JMS Queue XML?
Please help!
Note : I don't have the XML message structure of the Queue(also DTD file). So , I have to reverse it.
Thanks & Regards,
Subhra
Message was edited by: SubhrajyotiKundu

Hi Everybody,
I am facing a problem while i am trying to create a JMS Queue XML data server in ODI 11g. I have
the following details of the queue.
QueueManager=xxx;
TransportType=1;
HostName=ab.cde.fe.com;Port=77777;
Channel=CLIENT.TO.xxx1
destination name : SU.BH.RAJY.OTI.UPDATE_ITEM_RESPONSE.01
user : xyz
password : 123
I have sussefully created an jms datasouce in weblogic name 'eis/jms/abc' and also I have successfully
retrived the xml message from queue in BPEL
(using a jms adapter where
JMS Provider : Third Party,
Jms Provider Jndi Name -eis/jms/abc,
Operation name : consume_message,
destinamtion name is queue:///SU.BH.RAJY.OTI.UPDATE_ITEM_RESPONSE.01?targetClient=1).
But the new reqirement is to retive the xml data in ODI using "JMS Queue XML data server".I have tried
several ways(reading from internet) but failed to configure physical dataserver and reverse the xml message.
Also failed to understand properly the oracle post (http://docs.oracle.com/cd/E21764_01/integrate.1111/e12644/jms_xml.htm#CHDFCFBI).
Speically this portion "JNDI URL: <JMS_RESOURCE>?d=<DTD_FILE>&s=<SCHEMA>&JMS_DESTINATION=<JMS_DESTINATION_NAME>.".
What will be the "JMS_RESOURCE" in my case.
How can I configure JMS Queue XML?
Please help!
Note : I don't have the XML message structure of the Queue(also DTD file). So , I have to reverse it.
Thanks & Regards,
Subhra
Message was edited by: SubhrajyotiKundu

Odi-data quality and data profiling

Would odi-ee license be sufficient to use,odi data quality and data profiling.
We plan to use odi to migrate data from legacy databases to oracle 11g data base.
Do we have to use odi data quality and profiling.

Hi after 11.1.1.3 version of ODI release, oracle no longer supports ODP/ODQ which is a trillium software product and this not owned by oracle. Oracle is recommending the usage OEDQ for quality purposes. It's better if you could spend time on OEDQ rather than trying to learn and implement ODP/ODQ in ODI

Can we preview data after RKM in SAP in ODI 11g

can we able to right click and view data in models after reverse engineering in SAP in ODI 11g ??
Edited by: Drona on Mar 16, 2012 1:06 PM

No we cannot preview the data as SAP connection is made using Jco adapter.
We can only preview the data for data servers which are connected using jdbc.

ODI Data Profiling and Data Quality

Hi experts,
Searching about ODI features for data profiling and data quality I found (I think) many ... extensions? for the product, that confuse me. Cause I think there are at least three diferents ways to do data profiling and data quality:
In first place, I found that ODI has out of the box features for data profiling and data quality, but, acording to the paper, this features are too limited.
The second way I found was the product Oracle Data Profiling and Oracle Data Quality for Oracle Data Integrator 11gR1 (11.1.1.3.0) that is in the download page of ODI. Acording to the page, this product extends the existing inline Data Quality and Data profiling features of ODI.
Finally, the third way is Oracle Enterprise Data Quality that is another product that can be integrated to ODI.
I dont know if I understood good my alternatives. But, in fact, I need a general explanation of what ODI offer to do Data Quality and Data profiling. Can you help me to understand this?
Very thanks in advance.

Hi after 11.1.1.3 version of ODI release, oracle no longer supports ODP/ODQ which is a trillium software product and this not owned by oracle. Oracle is recommending the usage OEDQ for quality purposes. It's better if you could spend time on OEDQ rather than trying to learn and implement ODP/ODQ in ODI

DATE Format Error in ODI-11g(11.1.1.3)

I am using ETL transformations in ODI-11g. There's a dominant issue regarding date formattings when I map an ODI variable (storing date) with a TGT column(datatype=date) mappings.
In all the src-tgt mappings I am formatting the date by using TO_DATE() functions. But still getting the error:
"ORA-01830: date format picture ends before converting entire input string".
A point to Note: The same ETL in other env are ruuning fine but in my new dev env it's giving this date error.
I had checked with the DBA folks and they confirmed they set equal DATE settings in all the env.
The ODI Variable is defined as an "Alphanumeric".
Tx Used: #BUSINESS_CURRENT_DT=TO_DATE('Date','YYYY-MM-DD')
Require some urgent advice...Please let me know

Hi,
W store name-value pair in the Control table from where we exctract our data. Both (param name and param value) are varchars.
Well this looks pretty strange in 11g! Here's what we found out...
If you are trying to retrieve a date variable by using TO_DATE() in the refresh query the ODI Java driver (JDK 1.6) would call java.sql.timestamp and gracefully attach HH:MI:SS.NS along with the date (YYYY-MM-DD HH:MI:SS.NS). My target ia a date always..!
So, when I do: TO_DATE('20101010','YYYY-MM-DD) in the refresh query ODI stores it as '2010-10-10 00:00:00.0'
For this the Load always fails as Oracle would not be able to interpret a timestamp by suing TO_DATE()
The Java driver does this damage. However, it may be wise to store as a timestamp rather as a date if in case u do a Data capture and want the exact time credentials.
Unfortunately not a req, as of now for us so I had to chop-off the timestamp..!
Let me know if you find any other details...
Thanks.!

Odi 11g - IKM SQL to Hyperion Essbase (DATA) log file always empty

In odi 11g when using *"IKM SQL to Hyperion Essbase (DATA)"* setting the the "LOG_ENABLED" = true,
only an empty file are generated.
Just "LOG_ERRORS" file (if errors occurs) are created.
Is this just an my issue?
Can someone help me?
p.s.: the same issue, I got even with the *"IKM SQL to Hyperion Planning"*
Thx in advance, Paolo

Thanks John for your suggestion.
here the patch *"Patch 10302682: IKM SQL TO PLANNING: LOG FILE IS CREATED BUT NOTHING INSIDE."*
I didn't see any other about Essbase...
I try to check all day on support site.
Paolo
Edited by: Paolo on 19-apr-2011 8.44

Default Data Server for Hypersonic SQL in ODI 11g

Hi All,
I installed ODI 11g 11.1.1.6.0 for Win 7 with 10g DB R2 and WLS 10.3.5 successfully without any issues.
Created DEV_ODI_REPO Repository also without any issues.
Created Master Repository snpm1 and Work Repository as snpw1.
Created the Agents (Physical and Logical) and tested successfully.
Created the data servers for respective technologies
1) Technology Oracle -
    Data Server - ORACLE_ORCL_LOCAL
    Physical Schemas - SALES_DEV & SALES_PROD and
    Logical Schema as ORACLE_ORCL_LOCAL_SALES
2) Technology FILE -
    Data Server - FILE_GENERIC
    Physical Schema - FILE_GENERIC.E:/oracle/Middleware/Oracle_ODI1/oracledi/demo/file
    Logical Schema - FILE_DEMO_SRC
3) Technology - XML
     Data Server - XML FILE
     Physical Schema - GEO_D
    Logical Schema - GEO_DIM
4) Technology - Hypersonic SQL
     Data Server - HSQL   (Is this the correct name or some other name is recommended ? )
     Physical Schema - HSQL_LOCALHOST_20001_Default and HSQL_LOCALHOST_20001_Default
    Logical Schema - HSQL_DEMO_SRC and HSQL_DEMO_TARG
All the Mappings are done properly using Development & Production context for Physical and Logical Schemas.
I am able to create the Models for Oracle, FIle and XML with successful Reverse Engineering (standard with development context )
with all the data displayed correctly.
The issue starts here
The Main issue is for Hypersonic SQL where I am not able to get the Reverse Engineering.
Technology - Hypersonic SQL I have defined the data server as HSQL
Is this correct data server or some other name for data server is suggested ?
I am able to start the startdemo.bat file successfully opening the 3 dos prompt windows as
a) Oracle DI Demo - Repository Server
b) Oracle DI Demo - Source Server
c) Oracle DI Demo - Target Server
Later I make entries on the JDBC tab od HSQL - Data Server as
JDBC Driver : org.hsqldb.jdbc.JDBCDriver
JDBC Url : jdbc:hsqldb:hsql://localhost
Test Connection - ok with successful connection.
Prior to this I already run the script created schemas and inserted data to the SRC_ tables in my 10g Database as
ORDERS - containing the Tables as SRC_CITY, SRC_CUSTOMER, SRC_PRODUCT, SRC_REGION.....
In the Designer I create a new Model as HSQL_SRC
Technology - Hypersonic SQL
Logical Schema - HSQL_DEMO_SRC as defined earlier in logical schema.
Reverse Engineer Tab - Selected as Standard   Context selected as Development from drop down list.
When I right click on HSQL_SRC model for reverse engineer, it executes, however it does not display any tables inserted
as shown for ORDERS Schema.
Please correct me where I am wrong in giving the name for data server ? or some other place.
Thanks
Ajaz

Hi,
according to docs
http://docs.oracle.com/cd/E23943_01/integrate.1111/e12644/hypersonic_sql.htm#ODIKM590
i see
JDBC Driver: org.hsqldb.jdbcDriver
JDBC URL: jdbc:hsqldb:hsql://<host>:<port>
could you modify
JDBC Driver : org.hsqldb.jdbc.JDBCDriver
JDBC Url : jdbc:hsqldb:hsql://localhost
according to docs?
Thanks

How to fetch the Date column(or Month column) from the file name from the specified path in ODI 11g

Hi ALL,
Can any one help us regarding How to fecth the Date column(or month column) from the file name specified in the path in a generalized way .
For example :
file name is :subscribers (Cost) Sep13.csv is specified in the below path
E:\Accounting\documents\subscribers (Cost) Sep13.csv
here I need to fetch the "Sep13" as a Date column in the ODI 11g in the generalized way.
Can any one help us in this case as early as possible.

I would suggest using a piece of Jython code for this. Something like this...
import os
import os.path
filelist = os.listdir(E:\Accounting\documents\)
for file in filelist:
datestr = file[19:-4]
You'd need to work out what to do with datestr next... perhaps write it to a table or update an ODI variable with it.
Hope this is of some help.

ODI 11g 11.1.1.7 with Win64 bit OS : Starange problem : Right click does not work for Create new data server in Topology.

ODI 11g 11.1.1.7 with Win64 bit OS : Strange problem : Right click does not work for Create new data server in Topology.
On right click nothing happens at all. I have reinstall the ODI multiple times with right installer. issue persist.
Please help.

Hi,
Did you use the generic installer or the win32 one ? You should use the former with Win64.
You can also check that your version of Java is supported in the certification matrix.
Regards,
JeromeFr

Odi 11g - malformed numeric constant thru view data

Hi All,
From ODI 11g in the Designer Tab - Models
In the models where I have the Reverse Engineered tables.
From the reverse engineered tables I select one of the table as SRC_CUSTOMER to see its data I right click and select view data
I get the message popped up as malformed numeric constant
When I click on the stack Trace I get
com.borland.dx.dataset.DataSetException: malformed numeric constant (this is the selected error)
The entire stack trace has the following details.
See com.borland.dx.dataset.DataSetException error code: BASE+66
com.borland.dx.dataset.DataSetException: malformed numeric constant
    at com.borland.dx.dataset.DataSetException.a(Unknown Source)
    at com.borland.dx.dataset.DataSetException.throwException(Unknown Source)
    at com.borland.dx.dataset.DataSetException.SQLException(Unknown Source)
    at com.borland.dx.sql.dataset.Database.createPreparedStatement(Unknown Source)
    at com.borland.dx.sql.dataset.o.a(Unknown Source)
    at com.borland.dx.sql.dataset.o.d(Unknown Source)
    at com.borland.dx.sql.dataset.o.f(Unknown Source)
    at com.borland.dx.sql.dataset.QueryProvider.e(Unknown Source)
    at com.borland.dx.sql.dataset.JdbcProvider.provideData(Unknown Source)
    at com.borland.dx.dataset.StorageDataSet.refresh(Unknown Source)
    at com.borland.dx.sql.dataset.QueryDataSet.refresh(Unknown Source)
    at com.sunopsis.graphical.frame.edit.AbstractEditFrameGridBorland.initialize(AbstractEditFrameGridBorland.java:628)
    at com.sunopsis.graphical.frame.edit.AbstractEditFrameGridBorland.<init>(AbstractEditFrameGridBorland.java:868)
    at com.sunopsis.graphical.frame.edit.EditFrameTableData.<init>(EditFrameTableData.java:50)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
    at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
    at oracle.odi.ui.editor.AbstractOdiEditor$1.run(AbstractOdiEditor.java:176)
    at oracle.ide.dialogs.ProgressBar.run(ProgressBar.java:655)
    at java.lang.Thread.run(Thread.java:662)
Chained exception:
java.sql.SQLException: malformed numeric constant
    at org.hsqldb.jdbc.Util.sqlException(Unknown Source)
    at org.hsqldb.jdbc.JDBCPreparedStatement.<init>(Unknown Source)
    at org.hsqldb.jdbc.JDBCConnection.prepareStatement(Unknown Source)
    at sun.reflect.GeneratedMethodAccessor67.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at oracle.odi.core.datasource.dwgobject.support.OnConnectOnDisconnectDataSourceAdapter$OnDisconnectCommandExecutionHandler.invoke(OnConnectOnDisconnectDataSourceAdapter.java:200)
    at $Proxy2.prepareStatement(Unknown Source)
    at com.borland.dx.sql.dataset.Database.createPreparedStatement(Unknown Source)
    at com.borland.dx.sql.dataset.o.a(Unknown Source)
    at com.borland.dx.sql.dataset.o.d(Unknown Source)
    at com.borland.dx.sql.dataset.o.f(Unknown Source)
    at com.borland.dx.sql.dataset.QueryProvider.e(Unknown Source)
    at com.borland.dx.sql.dataset.JdbcProvider.provideData(Unknown Source)
    at com.borland.dx.dataset.StorageDataSet.refresh(Unknown Source)
    at com.borland.dx.sql.dataset.QueryDataSet.refresh(Unknown Source)
    at com.sunopsis.graphical.frame.edit.AbstractEditFrameGridBorland.initialize(AbstractEditFrameGridBorland.java:628)
    at com.sunopsis.graphical.frame.edit.AbstractEditFrameGridBorland.<init>(AbstractEditFrameGridBorland.java:868)
    at com.sunopsis.graphical.frame.edit.EditFrameTableData.<init>(EditFrameTableData.java:50)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
    at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
    at oracle.odi.ui.editor.AbstractOdiEditor$1.run(AbstractOdiEditor.java:176)
    at oracle.ide.dialogs.ProgressBar.run(ProgressBar.java:655)
    at java.lang.Thread.run(Thread.java:662)
What can be the root cause of this error. Has anything to do with the datatype of the selected tables.
Because from the model this error occurs for all of the reverse engineered tables.
Thanks
Ahmed

Hi, give a read at this.
https://forums.oracle.com/thread/666595
Which technology are you using? Basically error means that you are trying to read number where you have fluff (alphanumeric, null etc)
Have you checked your table? How have you defined your table?

Regd: Oracle Enterprise Data Quality 11g Installation

Hi All,
I am trying to install Oracle Enterprise Data Quality 11g (11.1.1.7.4 ) on Oracle Linux 6.5.
Weblogic server installation done successfully but when i tried to invoke Installer for EDQ
it it giving message "INST-07248:specified Middleware home location is not valid location"
I have no idea why it is not picking the Middleware path.
Can anyone please help regarding the same ASAP.
Thanks,
DD

Hi Valerie,
ODEQ is tool which we are using for data cleansing and its oracle Product .
In order install Oracle Enterprise Data Quality 11G we required "Weblogic server"
I did installation of Weblogic server 12C but when i tried to install ODEQ its not allow me complete the installation.
it it giving an error message "INST-07248:specified Middleware home location is not valid location"
Here is the link to download ODEQ.
http://www.oracle.com/technetwork/middleware/oedq/downloads/index.html
Thanks ,
DD

Data quality in ODI 11g

Similar Messages

Maybe you are looking for