Reverse-Engineer Teradata ETL?
Is it possible to take hand-cranked Teradata ETL and migrate to ODI as if each app had been created with ODI in the first place?
I don't think so, but you never know!
Thanks,
Paul Johnson
[VLDB Solutions Ltd|http://www.vldbsolutions.com]
Hi Paul
Don't engage in it if you can avoid it (or unless someone is prepared to pay an enormous amount of money). Just doing the self same thing at the moment - nightmarish task.
You can only realistically do this manually, by replatforming (rewriting) the original app. Remember too that (in the main) ODI wants to use JDBC, so CLI- (BTEQ-) specific functionality is not available 'out of the box' (MSRs were not available until very recently, IIRC). You could get around this by writing a KM to execute BTEQs, but what's the point...?
As Bos says, ODI procedures are perhaps the easiest way, but then you will have no visibility of the data mappings and you won't have CLI-flavoured niceness to work with (if that's what you would call it!).
All the best
James G.
Similar Messages
-
Not able to see executions in operator - Reverse engineer problem
Hi All,
I´m starting a new project, this is the situation. I've created the agent (physical and logical), it's running as a service (OPMN instance). When I execute the test, "Agent test Successfull". So I guess that is not the problem.
I'm creating a new model, I've already created the Data server (SQL server), connection test is Ok, I've also created the physical and Logical Schema. The problem is after creating a new model, when I select reverse engineer option, everything looks like that data is being correctly retrieve, however data do not appear in the model. When I go to the operator to check the log, nothing is there. Any idea?
Thanks in advance,
Gonzalo.->
The problem is after creating a new model, when I select reverse engineer option, everything looks like that data is being correctly retrieve, however data do not appear in the model. When I go to the operator to check the log, nothing is there. Any idea?
>
Do you mean to to say that uou are not finding any infor about the reverse engineering process in Operator ?
If yes then please note Standard reverse engineering does not list down the operation performed in Operator.
If you are using some RKM then only it will display the steps performed in Operator -
Reverse engineer using DBMS_METADATA
Hi,
Can I use DBMS_METADATA package to reverse engineer a scheduled job from the database. I tried running below statement but it only returns the first job no matter what I do:
select JOB,WHAT,dbms_metadata.get_ddl('JOB',USER) FROM DBA_JOBS
I even used a where clause to make sure that I am using a specific job but the output remains same I mean I get statement generated only for first job.
Any thought?
OnkarSolomon Yakobson wrote:
Gokhan Atil wrote:
You may try to use DBMS_JOB.USER_EXPORT:I don't believe DBMS_JOB.USER_EXPORT is available in 9i.
SY.Tested or guessing? Anyway, you can believe that it's available:
BANNER
Oracle9i Enterprise Edition Release 9.2.0.8.0 - 64bit Production
PL/SQL Release 9.2.0.8.0 - Production
CORE 9.2.0.8.0 Production
TNS for Solaris: Version 9.2.0.8.0 - Production
NLSRTL Version 9.2.0.8.0 - Production
FUNCTION BACKGROUND_PROCESS RETURNS BOOLEAN
PROCEDURE BROKEN
Argument Name Type In/Out Default?
JOB BINARY_INTEGER IN
BROKEN BOOLEAN IN
NEXT_DATE DATE IN DEFAULT
PROCEDURE CHANGE
Argument Name Type In/Out Default?
JOB BINARY_INTEGER IN
WHAT VARCHAR2 IN
NEXT_DATE DATE IN
INTERVAL VARCHAR2 IN
INSTANCE BINARY_INTEGER IN DEFAULT
FORCE BOOLEAN IN DEFAULT
PROCEDURE INSTANCE
Argument Name Type In/Out Default?
JOB BINARY_INTEGER IN
INSTANCE BINARY_INTEGER IN
FORCE BOOLEAN IN DEFAULT
PROCEDURE INTERVAL
Argument Name Type In/Out Default?
JOB BINARY_INTEGER IN
INTERVAL VARCHAR2 IN
FUNCTION IS_JOBQ RETURNS BOOLEAN
PROCEDURE ISUBMIT
Argument Name Type In/Out Default?
JOB BINARY_INTEGER IN
WHAT VARCHAR2 IN
NEXT_DATE DATE IN
INTERVAL VARCHAR2 IN DEFAULT
NO_PARSE BOOLEAN IN DEFAULT
PROCEDURE NEXT_DATE
Argument Name Type In/Out Default?
JOB BINARY_INTEGER IN
NEXT_DATE DATE IN
PROCEDURE REMOVE
Argument Name Type In/Out Default?
JOB BINARY_INTEGER IN
PROCEDURE RUN
Argument Name Type In/Out Default?
JOB BINARY_INTEGER IN
FORCE BOOLEAN IN DEFAULT
PROCEDURE SUBMIT
Argument Name Type In/Out Default?
JOB BINARY_INTEGER OUT
WHAT VARCHAR2 IN
NEXT_DATE DATE IN DEFAULT
INTERVAL VARCHAR2 IN DEFAULT
NO_PARSE BOOLEAN IN DEFAULT
INSTANCE BINARY_INTEGER IN DEFAULT
FORCE BOOLEAN IN DEFAULT
PROCEDURE USER_EXPORT
Argument Name Type In/Out Default?
JOB BINARY_INTEGER IN
MYCALL VARCHAR2 IN/OUT
PROCEDURE USER_EXPORT
Argument Name Type In/Out Default?
JOB BINARY_INTEGER IN
MYCALL VARCHAR2 IN/OUT
MYINST VARCHAR2 IN/OUT
PROCEDURE WHAT
Argument Name Type In/Out Default?
JOB BINARY_INTEGER IN
WHAT VARCHAR2 INRegards
Gokhan -
Enquiry: Any tool to reverse engineer an existing db schema in Oracle 8i
Dear All,
Do you know whether Oracle SQL Developer Data Modeler (3.1.1.703) supports Oracle 8i? If not, is there any tool that can be used to reverse engineer an existing database schema in Oracle 8i?
Your early reply is appreciated.
Thanks a lot.
LAWRENCE CHOWThat's a pity. The initial version of Data Modeler used to support import from Oracle 8i.
You could try setting up an ODBC connection to your database and using the JDBC tab (rather than the Oracle tab) when entering the Connection details into Data Modeler.
Alternatively, if you can get hold of an earlier version of Data Modeler (e.g. version 3.0 or earlier), you could try this (and if it works you could then upgrade your model to the current version).
David -
Reverse engineer Toplink mapping to a ERM diagram
Hi,
We have a Toplink mapping for our application, the problem is that in the database no foreign keys relationship are defined, thus the relations
are only in our Toplink model and not in our database. Id like to create a ERM model with for instance the new "Oracle SQL Developer Data Modeler".
Is there a way do reverse engineer a Toplink model to a ERM diagram?
Regards Jonas.Hi Jonas,
unfortunately there is no support for Toplink.
Regards,
Philip -
Error reverseing a teradata table
dear all,
i m facing a problem when reverseing a teradata table,
com.ncr.teradata.jdbc_4.util.JDBCException: [NCR] [Teradata DBMS] [TeraJDBC 03.04.00.06] The user does not have SELECT access to DBC.TablesX.
and i have all right on teradata table.Hi,
I have used the following KMs in my transformation with the following options:
IKM SQL Incremental Update
INSERT <Default>:true
UPDATE <Default>:true
COMMIT <Default>:true
SYNC_JRN_DELETE <Default>:true
FLOW_CONTROL <Default>:true
RECYCLE_ERRORS <Default>:false
STATIC_CONTROL <Default>:false
TRUNCATE <Default>:false
DELETE_ALL <Default>:false
CREATE_TARG_TABLE <Default>:false
DELETE_TEMPORARY_OBJECTS <Default>:true
LKM SQL to SQL
DELETE_TEMPORARY_OBJECTS <Default>:true
CKM Oracle
DROP_ERROR_TABLE <Default>:false
DROP_CHECK_TABLE <Default>:false
CREATE_ERROR_INDEX <Default>:true
COMPATIBLE <Default>:9
VALIDATE <Default>:false
ENABLE_EDITION_SUPPORT <Default>:false
UPGRADE_ERROR_TABLE true -
Reverse engineer issues in ODI 11g
Hello gurus,
We are testing ODI upgrade and we have an issue while reversing a data model.Its an existing sql server table and in ODI when we click on the reverse engineer ODI datastore doesnt sync with sql server DB table.
Please help ?
Thanks,
Mastan.Thank you so much for your reply....Yes thats exactly right it is not considering the deleted columns....when i try to remove the the data store it gives me an error saying
"object column : workflow_activity_identifier is referenced by: Txt CrossRef : 12142111, Txt CrossRef : 20617111
Cannot remove"
i think i have to edit my interfaces which is using the data store ? is there any way i can know how many interfaces are using this data store?
Thanks for your help. -
Reverse Engineer / Import Selected Objects
Hello All,
I am new to ODI tool and trying to understand, how to reverse engineer / import selected objects? I am unable to do this.
For instance, I have 10 tables in database, I want to import/reverse engineer 3 of them, how do I this in one go? I am able to do this, one by one.
Your Help is appreciated.
Thanks,
Andy.Hi
Create a model.--> click on selective reverse engineering---> check New Datastore and object to reverse engineer. then you can select 3 tables out of 10 tables.
what do you mean by import here ?
Are you trying to import 3 tables from ODI ?
Thanks -
Reverse-Engineer Java Code using JDeveloper
Hi,
Is it possible to reverse-engineer java code and produce class diagrams in JDeveloper? If so , how?
I have JDeveloper 10g.
ThanksYes you can.
Just open the java classes in a JDeveloper project, create a new class diagram and drag the classes onto the empty diagram. -
Reverse Engineer Models Using DB Links ?
Hi,
I have tables that reside in database A.
I can access those tables from Database B using db link.
Is it possible to reverse engineer the tables belonging to database A in a model. If yes How?
Please reply.
Urgent Requirement
Regards,
PrernaHi Prerna Vij,
Yes you will.
- In topology, create a physical schema in your dataserver B. Put the name of the source schema on A and enter the dblink name you want to use.
- Create a logical schema and map it to the physical schema through contexts
- In Designer, create a new model using the logical schema you just created and build all the datastore manually
- Use these datastore as source in your interfaces and choose LKM Oracle to Oracle (DBLINK)
Hope it helps.
Regards,
Jerome -
Reverse Engineering Legacy ETL processes
How easy is it to use ODI to reverse engineer legacy DW processes (Tables and PL/SQL).
We're looking to carry out all new DW development into a standardised ODI configuration, and wondered if it would also be easy enough to add in legacy processes using a reverse engineer approach. Is it easy to do? Its all Oracle within several schemas on the same instance.ODI is able to reverse engineer the tables, but not to understand your PL/SQL.
It can call your PL/SQL though the use of procedures, but there is no magic dust "PL/SQL to ODI" -
When i reverse engineer CSV file into datastore It is not diplaying coloums
Hi All,
When am trying to do reverse engineer the CSV file in the datastore it is not displaying all the Coloums at a time.
Can anyone suggest me , how to do it
Thanks & Regards:
VamsiHi,
Unfortunately there is no way of changing the delimiter from within DM. It's comma and that's it. I've logged a bug on that.
Here is a workaround though. Open CSV file with text editor and use Replace functionality.For search mode you have to select Regular Expression, Type this:
search string : (?![^(]+\)),
replace string : ;
This will replace all commas with semicolons, except those in brackets.
I've tested it with Notepad++ (it's free). I think it can be used for all opened files at same time.
Hope it helps
When exporting, could you check that null pointer exception in log file and post stack trace here? Not entire file of course, just first 20-30 lines. Thanks
Edited by: Dimitar Slavov on Mar 25, 2013 2:40 AM -
ODI - Java Error when trying to reverse engineer - Hyperion Planning
Hi,
I am receiving the error below when I am attempting reverse engineer the emission members into the models tab in the ODI Designer. In topology manager I get connection successful in both Synopsis memory engine and in File technology and I have checked all my settings and everything looks correct compared to the test environment. We are actually testing the Production install with a very simple Hyperion Planning dimension build. Does anyone have any ideas why I am receiving the error below.
Thank you in advance for the help!!
org.apache.bsf.BSFException: exception from Jython:
Traceback (innermost last):
File "<string>", line 1, in ?
ImportError: no module named java
at org.apache.bsf.engines.jython.JythonEngine.exec(JythonEngine.java:146)
at com.sunopsis.dwg.codeinterpretor.k.a(k.java)
at com.sunopsis.dwg.dbobj.SnpSessTaskSql.scripting(SnpSessTaskSql.java)
at com.sunopsis.dwg.dbobj.SnpSessTaskSql.execScriptingOrders(SnpSessTaskSql.java)
at com.sunopsis.dwg.dbobj.SnpSessTaskSql.execScriptingOrders(SnpSessTaskSql.java)
at com.sunopsis.dwg.dbobj.SnpSessTaskSql.treatTaskTrt(SnpSessTaskSql.java)
at com.sunopsis.dwg.dbobj.SnpSessTaskSqlC.treatTaskTrt(SnpSessTaskSqlC.java)
at com.sunopsis.dwg.dbobj.SnpSessTaskSql.treatTask(SnpSessTaskSql.java)
at com.sunopsis.dwg.dbobj.SnpSessStep.treatSessStep(SnpSessStep.java)
at com.sunopsis.dwg.dbobj.SnpSession.treatSession(SnpSession.java)
at com.sunopsis.dwg.cmd.DwgCommandSession.treatCommand(DwgCommandSession.java)
at com.sunopsis.dwg.cmd.DwgCommandBase.execute(DwgCommandBase.java)
at com.sunopsis.dwg.cmd.e.i(e.java)
at com.sunopsis.dwg.cmd.g.y(g.java)
at com.sunopsis.dwg.cmd.e.run(e.java)
at java.lang.Thread.run(Unknown Source)Hi,
It looks as though we got it to work. However the way we got it to work is a bit confusing. We had someone just login and try it. The only difference is they used the admin username instead of the one we were using. They successfully ran the reverse. Then we re-logged in with the other username we were using before and it worked.
I just realized however before they did that, I was on the Prod server trying to open and view the odiparams.bat file. I accidentally ran the file by choosing 'open' instead of 'edit'. Thus I'm thinking that running that odiparams.bat file actually fixed the issue rather than logging in with admin account.
What would your professional opinion be on this as we can't recreate the issue and figure out which one fixed it.
Thanks, -
Reverse Engineer in models doesnt give the right structure from Essbase
Hi,
I have created Hyperion essbase(source)/Oracle(target) Data sources,Physical Schemas,Logical Scemas and have linked them with the context.
When I create a model - I hadTechnology as Essbaseand the right physical schema -
In the reverse engineer tab, I have correctly selected RKM Hyperion Essbase,Types pf objects is table.I had set True to multipls columns and had given the data column as Accounts - and the data column members as "Sales","Cogs"
Now when I reverse engineer, I assumed the columns should be populated as (dim1,dim2,Sales,Cogs) - But what i get is (dim1,dim2,Account,Sales,Cogs,Data) - The account member and data also comes along in the column. Any idea where i am missing out this?
Eventually when i execute the interface, I am ending up in an error "com.hyperion.odi.essbase.ODIEssbaseException: com.hyperion.odi.essbase.ODIEssbaseException: Invalid column in the source"
Please share your thoughts...
Leo jose.Hi,
Please ignore, it is just that when a model is reverse engineered, it is having the old in memory and the new changes made in the model is getting appended along with the old dimension information creating some confusion.just did it with a different application and is giving desired results.I asked and I answered :) -
EBS reverse engineer table/view names
In SQL developer I connected to EBS and created some hierarchies from these tables - fnd_flex_value_hierarchies, fnd_flex_values_tl,FND_FLEX_VALUE_CHILDREN_V
Now I am using the trying to reverse engineer in ODI using the EBS knowledge module, but I can't find these tables.
...I was told by an EBS person I should be using the above tables to build my account hierarchy...is this correct? Or are there other tables I should be using?
Thank you,
JzHi Frank,
I assume you imported your Table definitions from a DDL file.
Column datatypes appear in dialogs in the way you have described if Domains are set up during the import and the Columns are associated with these Domains.
You can change this by opening the Preferences dialog (select Preferences from the Tools menu) and selecting Data Modeler/DDL in the tree.
On the Data Modeler/DDL page of the Preferences you should unset the option "Create Domains During Import".
David
Maybe you are looking for
-
Unclear about requirements/information for Edge vs Contract plans.
I am currently on a 8GB/70 Shared data plan with a corporate discount. I have 4 smart phones and 2 iPads. My total bill is $241.60 + Taxes. Our contract on all 4 phones is now up as of 2/1/15. I have been asking questions about switching to the e
-
3GS with ios 4 always lost wifi credentials
Upgrading iPhone 3GS to ios 4 was hard (recovery mode, reinstall iTunes and AMDS, using two computers) but did it and got all information back. I've internet access in 3G and with wifi; however everytime i try to connect wifi i have to select the net
-
I am having problems printing using my HP Laserjet 2100. The Mac recognized the printer and installed the driver, however, nothing prints. Instead I get a "Waiting for device" message. I went to HP and downloaded another driver from their site. When
-
64-bit version for windows not working
ive installed the 64-bit version for windows, i connect my 5s and it tells me to uninstall itunes and reinstall the 64-bit because the itunes isnt the right version
-
Display using matrox triple head to go with 2 monitors
I'm using a Thunderbolt to DVI adaptor to output the display to a Matrox Triple Head to Go unit running 2 monitors. The second monitor does not display. I've tried all combinations I can think of.