ODI DEF

Hi ,
Oracle Data Integrator is a comprehensive data integration platform that covers all data integration requirements: from high-volume, high-performance batch loadss, to event-driven, trickle-feed integration processes, to SOA-enabled data services.
What is batch loads ?
What is event driven?
What is trickle-feed integration?
What is SOA-enabled data services?
Please explain me as iam new to the ODI environment
Thanks in advance!

What is batch loads ?You have data coming in bulk from a system maybe in form of nightly batch of files. These maybe millions of records which are integrated into the system as a batch.
ODI has support for batch loads of data.
What is event driven?ODI Wait components can wait for events to happen and then trigger an integration process. Eg. OdiFileWait component can keep scanning a directory for a file and when the file arrives, it can start the integration process. Similarly, odiWatForData can ping a table to see if the number of records have been inserted into it and then initiate an integration process.
What is trickle-feed integration?ODI has support for Messaging Queues like MQ. More theory can be found [ here| http://technology.amis.nl/blog/2409/the-trickle-feed-integration-pattern ]
What is SOA-enabled data services?Webservices can be used to perform data integration tasks.
HTH

Similar Messages

Error during call sqlldr - ODI version 11.1.1.3 and java 1.6.0_30

Hey All,
I have scroll thru forums for resolution of similar issue but no luck. Here is the problem this is working fine in ODI version 11.1.1.5, Except the file is mapped to local drive.
Now below is the error message from ODI 11.1.1.3, Trying to use LKM File to Oracle(SQLLDR) and here is the error
ODI-1226: Step LD_PARTNER_USING_SQLLDR fails after 1 attempt(s).
ODI-1240: Flow LD_PARTNER_USING_SQLLDR fails while performing a Loading operation. This flow loads target table DRM_USER_PARTNER_NEW.
Caused By: org.apache.bsf.BSFException: exception from Jython:
Traceback (innermost last):
File "<string>", line 33, in ?
Load Error: See \\Cdpwa01a0600\e$\Hyperion\DRM\Loadfile/LD_USER_PARTNER.log for details
here is the generated code from call sqlldr session task
import java.lang.String
import java.lang.Runtime as Runtime
from jarray import array
import java.io.File
import os
import re
def reportnbrows():
 f = open(r"\\Cdpwa01a0600\e$\Hyperion\DRM\Loadfile/LD_USER_PARTNER.log", 'r')
 try:
 for line in f.readlines():
 if line.find("MAXIMUM ERROR COUNT EXCEEDED")>=0 :
 raise "MAXIMUM ERROR COUNT EXCEEDED", "See %s for details" % logfile
 finally:
 f.close()
ctlfile = r"""\\Cdpwa01a0600\e$\Hyperion\DRM\Loadfile/LD_USER_PARTNER.ctl"""
logfile = r"""\\Cdpwa01a0600\e$\Hyperion\DRM\Loadfile/LD_USER_PARTNER.log"""
outfile = r"""\\Cdpwa01a0600\e$\Hyperion\DRM\Loadfile/LD_USER_PARTNER.out"""
oracle_sid=''
if len('d1odi1')>0: oracle_sid = '@'+'d1odi1'
loadcmd = r"""D:\Oracle\product\11.2.0\client_1\bin\sqlldr 'MDM_STAGE/<@=snpRef.getInfo("DEST_PASS") @>%s' control='%s' log='%s' > "%s" """ % (oracle_sid,ctlfile, logfile, outfile)
rc = os.system(loadcmd)
if rc <> 0 and rc <> 2:
raise "Load Error", "See %s for details" % logfile
if rc==2:
reportnbrows()
what am i missing?
Thanks.
Shri.

thanks for you reply.. this is what i have hardcoded in the KM for testing purpose. gives me back the error
org.apache.bsf.BSFException: exception from Jython:
Traceback (innermost last):
File "<string>", line 13, in ?
Load Error, error in the sqlldr step
import java.lang.String
import java.lang.Runtime as Runtime
from jarray import array
import java.io.File
import os
import re
ospath=(r'D:\Oracle\product\11.2.0\client_1\bin\sqlldr control=e:\Hyperion\DRM\Loadfile\LD_USER_PARTNER.ctl log=e:\Hyperion\DRM\Loadfile\LD_USER_PARTNER.log userid=mdm_stage/xxxxxx@d1odi1')
rc=os.system(ospath)
if rc <> 0 and rc <> 2:
raise "Load Error, error in the sqlldr step"
Thanks.

How to handle error for a Db Table to Db table transform in ODI

Hi,
I have created two table in two different schema source and target, where there is a field for e.g.- place where the datatype is varchar2 and data inserted is string.
In designer model of ODI i have put the type of place as number in both source and target and accordingly done the mapping.
When it is executed it should give an error, but it got completed but no data is inserted neither in target table nor in error table in the target schema(E$_TARGET_TEST which is created automatically).
Why the error is not given and how to handle such type of error..
Please help.
The codes for source and target tables are as follows:
source table code:
CREATE TABLE "DEF"."SOURCE_TEST"
 "EMP_ID" NUMBER(9,0),
 "EMP_NAME" VARCHAR2(20 BYTE),
 "SAL" NUMBER(9,0),
 "PLACE" VARCHAR2(10 BYTE),
 PRIMARY KEY ("EMP_ID") USING INDEX PCTFREE 10 INITRANS 2 MAXTRANS 255 STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645 PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT FLASH_CACHE DEFAULT CELL_FLASH_CACHE DEFAULT) TABLESPACE "USERS" ENABLE
inserted data:
INSERT INTO "DEF"."SOURCE_TEST" (EMP_ID, EMP_NAME, SAL, PLACE) VALUES ('1', 'ani', '12000', 'kol')
INSERT INTO "DEF"."SOURCE_TEST" (EMP_ID, EMP_NAME, SAL, PLACE) VALUES ('2', 'priya', '15000', 'jad')
target table code:
CREATE TABLE "ABC"."TARGET_TEST"
 "EMP_ID" NUMBER(9,0),
 "EMP_NAME" VARCHAR2(20 BYTE),
 "YEARLY_SAL" NUMBER(9,0),
 "BONUS" NUMBER(9,0),
 "PLACE" VARCHAR2(10 BYTE),
 PRIMARY KEY ("EMP_ID") USING INDEX PCTFREE 10 INITRANS 2 MAXTRANS 255 STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645 PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT FLASH_CACHE DEFAULT CELL_FLASH_CACHE DEFAULT) TABLESPACE "USERS" ENABLE

Hi,
I have used the following KMs in my transformation with the following options:
IKM SQL Incremental Update
INSERT <Default>:true
UPDATE <Default>:true
COMMIT <Default>:true
SYNC_JRN_DELETE <Default>:true
FLOW_CONTROL <Default>:true
RECYCLE_ERRORS <Default>:false
STATIC_CONTROL <Default>:false
TRUNCATE <Default>:false
DELETE_ALL <Default>:false
CREATE_TARG_TABLE <Default>:false
DELETE_TEMPORARY_OBJECTS <Default>:true
LKM SQL to SQL
DELETE_TEMPORARY_OBJECTS <Default>:true
CKM Oracle
DROP_ERROR_TABLE <Default>:false
DROP_CHECK_TABLE <Default>:false
CREATE_ERROR_INDEX <Default>:true
COMPATIBLE <Default>:9
VALIDATE <Default>:false
ENABLE_EDITION_SUPPORT <Default>:false
UPGRADE_ERROR_TABLE true

ODI installation out of Oracle home

Hi,
I have to install Oracle Data Integrator on a development server where EPM 11.1.2 is already installed. I encounter the following error after setting the install folder (I leave it to default: D:\Oracle\Middleware\EPMSystem11R1):
OUI-10044: The selected Oracle Home location already contains an Oracle Home
or APPL_TOP created while running a different OS
I've done some research and found [ that post|http://gerardnico.com/wiki/database/oracle/oui-10044], which didn't help much.
Basically my ODI file shiphomeproperties.xml shows an OS id 233, which is good.
The problem might be that I have two Oracle folders under C:/. One under "Program Files(x86)" that shows an OS id of 912 and another under "Program Files" which shows an OS id 233. Now I'm guessing that the Oracle installer looks into the wrong file...
Now I might have a workaround, if I change the default install folder, for example to Oracle1, I can access the next step.
My question is to know if it's ok to installl ODI in another Oracle home, is it ok to have two oracle home ?
thanks for your help.
cyril

Check out Metalink Note:191567.1
(http://metalink.oracle.com/metalink/plsql/ml2_documents.showDocument?p_database_id=NOT&p_id=191567.1)
Step 11.
11. Error in invoking target relink of makefile
/home/ias/infrastructure/precomp/lib/ins_precomp.mk
To fix it:
As ias go to $ORACLE_HOME/bin
vi genclntsh
change line LD_SELF_CONTAINED="-z defs" to LD_SELF_CONTAINED="" (line 147 of 200)
save genclntsh file
./genclntsh
Created /home/ias/infrastructure/lib/libclntst9.a
Click "Retry" at error popup window. Installer will continue.
Link successful.

Regarding odi send mail

Hi all,
There is problem with odi send mail error, after the all suggestions, i get answer for it requires jython procedure, and i downloaded from oracle site also...
can any one please teach me where should need to implement/kept for sending mails.
please help me....
our network is popmail.bizmail.yahoo.com...
please share any docs/links to this mail id: [email protected]
Regards,
surya.

Here are two ways to send an e-mail
1) Use the ODISendMail function in an ODI Package.
To use this function drag the ODISendMail reference onto the Package window, join it to the Package flow, click on the function icon and supply Mail Server (SMTP Server Name), From (Me), To (Distribution), CC (Copy), BCC (Blind Copy), Subject, Attachment, and Message Body in the window that appears.
I use this function to signal success or failure of a package or package step.
To do this I only supply only the Mail Server, From, To and Subject. I don't need anything else to report success or failure.
Here's a sample Subject:
<%=snpRef.getSession("CONTEXT_NAME")%> <%=snpRef.getSession( "SESS_NAME" )%> <%=snpRef.getStep("STEP_NAME")%>
The STEP_NAME holds the success/failure message
I don't use the Message Body or Attachment.
2) The procedure shown in the reply defines a Jython function to send an e-mail with Subject and Message Body using Mail Server, From and To values stored in a Jython dictionary. The Jython version is very old (release 2.1 or 2.2) so there are more elegant ways to write the function. Jython uses white space to control program flow which the Form editor deletes. Here's a verson of the code with leading periods in the code to preserve the white space and with comments on each line. Comments start with a # character and extend to the end of the line.
Dict = {} # This holds the global parameters
Dict['ToString'] = '[email protected]' # you supply the value
Dict['FromString'] = 'FromFromFrom' # you supply the value
Dict['SMTP'] = 'My Mail Server' # you supply the value
import smtplib #These are the Jython library routines needed to send the e-mail
def SendMail(MessageSubject,MessageLines): # This is the function definition
. global Dict # Point to the Dictionary
. Subject = '%s %s %s' % (Dict['Context'],Dict['Session'],MessageSubject) #Build the Subject Line
. MessageString = '' #Initialize the Message String
. for ReportLine in MessageLines: # Add the callers message lines to the Message String (each line here ends in a newline \n)
. MessageString = '%s%s' % (MessageString,ReportLine)
# The next statement builds the actual e-mail message according to a very strict format. Understanding the format is hard
. Message="From: %s\r\nTo: %s\r\nSubject: %s\r\n\r\n%s" % (Dict['FromString'],Dict['ToString'],Subject,MessageString)
. server = smtplib.SMTP(Dict['SMTP']) # Setup the Mail Server
. server.sendmail(Dict['FromString'],Dict['ToString'],Message) # Send The Message
. server.quit() # Stop
# Here we build a sample message
ReportSubject = 'This is a Test Message'
Report = []
Report.append('First Line\n')
Report.append('Second Line\n')
Report.append('Last Line\n')
# Send the Message
SendMail(ReportSubject,Report)
If you're not familiar with Jython, this still won't make much sense, but Jython is not hard to learn, and this example is not very complicated.

Data Loss in DB to DB Transformation in ODI

Hi,
I am facing data loss when I am trying a transformation for a DB to DB mapping in ODI.
I have two tables in two different schemas with the following specifications. In ODI designer model of i have put the type of place as number in target and place as varchar2 for source and accordingly done the mapping.It works successfully when i am putting the data as ('12', 'ani', '12000', '55').
Now for testing I am giving the datas as ('1', 'ani', '12000', '55') and ('2', 'priya', '15000', '65t') and when I am executing it is giving the error as expected(ORA-01722: invalid number) in the task (Insert flow into I$ table). My C$ table is populated with the datas from source. But E$,I$ and target tables are not populated with the data.
Now when I am puttting data in source as ('3', 'shubham', '12000', '56') and ('4', 'shan', '12000', '59') it is getting completed successfully , datas from C$ tables are deleted and data is inserted into the target table.
Now my question is where are the datas ('1', 'ani', '12000', '55') and ('2', 'priya', '15000', '65t') gone. If they are lost what is the recoverable table so that no data loss takes place.
The codes for source and target tables are as follows:
source table code:
CREATE TABLE "DEF"."SOURCE_TEST"
    "EMP_ID"   NUMBER(9,0),
    "EMP_NAME" VARCHAR2(20 BYTE),
    "SAL"      NUMBER(9,0),
    "PLACE"    VARCHAR2(10 BYTE),
    PRIMARY KEY ("EMP_ID") USING INDEX PCTFREE 10 INITRANS 2 MAXTRANS 255 STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645 PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT FLASH_CACHE DEFAULT CELL_FLASH_CACHE DEFAULT) TABLESPACE "USERS" ENABLE
inserted data:
INSERT INTO "DEF"."SOURCE_TEST" (EMP_ID, EMP_NAME, SAL, PLACE) VALUES ('1', 'ani', '12000', '55')
INSERT INTO "DEF"."SOURCE_TEST" (EMP_ID, EMP_NAME, SAL, PLACE) VALUES ('2', 'priya', '15000', '65t')
Target table code:
CREATE TABLE "ABC"."TARGET_TEST"
    "EMP_ID"     NUMBER(9,0),
    "EMP_NAME"   VARCHAR2(20 BYTE),
    "YEARLY_SAL" NUMBER(9,0),
    "BONUS"      NUMBER(9,0),
    "PLACE"      NUMBER(9,0),
    PRIMARY KEY ("EMP_ID") USING INDEX PCTFREE 10 INITRANS 2 MAXTRANS 255 STORAGE(INITIAL 65536 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645 PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT FLASH_CACHE DEFAULT CELL_FLASH_CACHE DEFAULT) TABLESPACE "USERS" ENABLE
Thanks.

So, first you have data in "DEF"."SOURCE_TEST".
You then run your interface, and the data is moved into "ABC"."TARGET_TEST" if the interface executes successfully with no errors.
Correct? - no data loss
But if you're saying that you need to handle records which are going to cause the "invalid number" error, then you should read up on 'flow' and 'static' control and how to flag errors before loading them. Flow and Static Control allows ODI to identify erroneous records prior to loading - they'll be put in the E$ table for you to deal with later.
If you haven't already, I'd encourage you to take a look at the documentation on this:
Implementing Data Quality Control

ODI Groovy Script to create an interface

Hi,
I'm working on ODI 11.1.16 and trying to create an interface using Groovy Scripts. It throws me an error "java.lang.IllegalArgumentException: DataStore shouldn't be null "
Below are my assumptions
Source datastore : Groovy_Source
Target datastore : Groovy_Trgt
Context : Global
Stndrd conn: localhost,1521,orcl
def file = new File('c:/interfaces.txt')
def s = 0
Interfaces.txt contains : TEST1,SOURCE,DUMMY_GROOVY_SOURCE,STAGING,DUMMY_GROOVY_TRGT
DataSet dataSet = odiInterface.getDataSets().get(0);
OdiDataStore odiDatastore1 = ((IOdiDataStoreFinder)odiInstance.getTransactionalEntityManager().getFinder(OdiDataStore.class)).findByName(DUMMY_GROOVY_SOURCE,Oracle);
OdiDataStore targetDatastore = ((IOdiDataStoreFinder)odiInstance.getTransactionalEntityManager().getFinder(OdiDataStore.class)).findByName(DUMMY_GROOVY_TRGT,Oracle);
It throws an error here any help is appreciated
Thanks
VIB

Hi Michael,
Below is my entire code.. Picked it up from one of the blogs just trying to fine tune it. Thanks for your reply.
//Created by ODI Studio
// Context operators:
import oracle.odi.domain.topology.OdiContext
import oracle.odi.domain.topology.finder.IOdiContextFinder
// Folder operators:
import oracle.odi.domain.project.OdiFolder
import oracle.odi.domain.project.finder.IOdiFolderFinder
// Interface operators:
import oracle.odi.domain.project.OdiInterface
// Interface helpers:
import oracle.odi.interfaces.interactive.support.InteractiveInterfaceHelperWithActions
import oracle.odi.interfaces.interactive.support.targetkeychoosers.TargetKeyChooserPrimaryKey
import oracle.odi.interfaces.interactive.support.mapping.automap.AutoMappingComputerLazy
import oracle.odi.interfaces.interactive.support.mapping.matchpolicy.MappingMatchPolicyLazy
import oracle.odi.interfaces.interactive.support.actions.InterfaceActionSetTargetDataStore
import oracle.odi.interfaces.interactive.support.aliascomputers.AliasComputerDoubleChecker
import oracle.odi.interfaces.interactive.support.clauseimporters.ClauseImporterLazy
import oracle.odi.interfaces.interactive.support.actions.InterfaceActionAddSourceDataStore
import oracle.odi.interfaces.interactive.support.actions.InterfaceActionOnTargetDataStoreComputeAutoMapping;
// Transaction operators:
import oracle.odi.core.persistence.transaction.support.DefaultTransactionDefinition;
import oracle.odi.core.persistence.transaction.ITransactionDefinition;
import oracle.odi.core.persistence.transaction.ITransactionManager;
import oracle.odi.core.persistence.transaction.ITransactionStatus;
// Data set:
import oracle.odi.domain.project.interfaces.DataSet;
// Data store:
import oracle.odi.domain.model.OdiDataStore;
import oracle.odi.domain.model.finder.IOdiDataStoreFinder;
// Define VARS:
def project = new String("Test") // What is the target project?
def folder = new String("Test Subfolder") // Which folder in target project?
def file = new File('c:/interfaces.txt')
def s = 0
// Get default context:
OdiContext context = ((IOdiContextFinder)odiInstance.getTransactionalEntityManager().getFinder(OdiContext.class)).findDefaultContext();
// Get Folder:
Collection odiFolders = ((IOdiFolderFinder)odiInstance.getTransactionalEntityManager().getFinder(OdiFolder.class)).findByName(folder);
if (odiFolders.size() == 0)
println("Error: cannot find folder "+folder+" in project "+project)
OdiFolder odiFolder = (OdiFolder) (odiFolders.toArray()[0]);
// Print default settings:
println ("Context used = " + context.getName())
println ("Folder for interface = " + odiFolder.getName())
file.eachLine { line ->
s++
toks = line.split(",")
if (toks.length != 5)
println("Error in input, line: "+s)
else
iname = toks[0]
Oracle = toks[1]
DUMMY_GROOVT_SOURCE = toks[2]
Oracle = toks[3]
DUMMY_GROOVY_TRGT = toks[4]
// Transactie:
ITransactionDefinition txnDef = new DefaultTransactionDefinition()
ITransactionManager tm = odiInstance.getTransactionManager()
ITransactionStatus txnStatus = tm.getTransaction(txnDef)
OdiInterface odiInterface = new OdiInterface(odiFolder, iname, context);
InteractiveInterfaceHelperWithActions interactiveHelper = new InteractiveInterfaceHelperWithActions(odiInterface, odiInstance, odiInstance.getTransactionalEntityManager());
DataSet dataSet = odiInterface.getDataSets().get(0);
OdiDataStore odiDatastore1 = ((IOdiDataStoreFinder)odiInstance.getTransactionalEntityManager().getFinder(OdiDataStore.class)).findByName("DUMMY_GROOVY_SOURCE", Oracle);
OdiDataStore targetDatastore = ((IOdiDataStoreFinder)odiInstance.getTransactionalEntityManager().getFinder(OdiDataStore.class)).findByName("DUMMY_GROOVY_TRGT", Oracle);
interactiveHelper.performAction(new InterfaceActionAddSourceDataStore(odiDatastore1, dataSet, new AliasComputerDoubleChecker(), new ClauseImporterLazy(), new AutoMappingComputerLazy()));
interactiveHelper.performAction(new InterfaceActionSetTargetDataStore(targetDatastore, new MappingMatchPolicyLazy(), new AutoMappingComputerLazy(), new AutoMappingComputerLazy(), new TargetKeyChooserPrimaryKey()));
interactiveHelper.performAction(new InterfaceActionOnTargetDataStoreComputeAutoMapping())
interactiveHelper.computeSourceSets()
interactiveHelper.preparePersist()
tm.commit(txnStatus)
Edited by: VIB on Feb 18, 2013 10:46 AM

How to get the Interface inserted rows fom ODI Reporsitory

hi,
I need select query that will select the Interface inserted rows
(Count) from ODI repository tables. because I want to maintain these records into another Oracle tables?????

import datetime
import sys
import optparse
document = []
def docprint(string):
document.append('%s' % string)n
def docprintnocr(string):
document.append('%s' % string)
p = optparse.OptionParser()
p.add_option('-a','--server',dest='server',default='XXX',help='The server with the ODI_W catalog')
p.add_option('-b','--beginningday',dest='beginningday',type=int,default=1,help='The day to begin retrieval')
p.add_option('-e','--endingday',dest='endingday',type=int,default=0,help='The day to end retrieval')
p.add_option('-n','--session',dest='session',default='',help='Session to retrieve')
p.add_option('-s','--step',dest='step',action='store_true',help='Print the step data')
p.add_option('-t','--task',dest='task',action='store_true',help='Print the task data')
p.add_option('-x','--recipientlist',dest='recipientlist',default='XXX',help='report recipient(s)')
p.add_option('-y','--mailserver',dest='mailserver',default='XXX',help='mail server')
p.add_option('-z','--mailuser',dest='mailuser',default='XXX',help='mail user')
p.add_option('-p','--printonly',dest='printonly',action='store_true',help='Print, no e-mail')
options,args = p.parse_args()
docprint( '%s %s' \
'\n\tserver=%s' \
'\n\tbeginningday=%s' \
'\n\tendingday=%s' \
'\n\tsession=%s' \
'\n\tstep=%s' \
'\n\ttask=%s' \
'\n\tprintonly=%s'
sys.argv[0]
,datetime.datetime.now().strftime('%Y-%m-%d %H:%M:%S')
,options.server
,options.beginningday
,options.endingday
,options.session
,options.step
,options.task
,options.printonly
if options.server.upper() in ('XXX','YYY'):
catalog = 'ODI_W'
elif options.server in ('WWW','ZZZ'):
catalog = 'SNP_W'
else:
print 'Unknown server %s' % options.server
sys.exit(1)
TimeEnd = datetime.datetime.now() - datetime.timedelta(options.endingday)
TimeBegin = datetime.datetime.now() - datetime.timedelta(options.beginningday)
TimeFormat = '%Y-%m-%d %H:%M:%S'
if options.task:
options.step = True
docprint( '\n%s between %s and %s' %(
options.server
,TimeBegin.strftime(TimeFormat)
,TimeEnd.strftime(TimeFormat)
OptionString = ''
if options.session:
OptionString = '\nPrinting session %s' % options.session
else:
OptionString = '\nPrinting all sessions'
if options.step:
OptionString = '%s %s' % (OptionString,'with step detail')
if options.task:
OptionString = '%s %s' % (OptionString, 'and task detail')
docprint(OptionString)
import pyodbc
ConnectString = 'DRIVER={SQL SERVER};SERVER=%s;DATABASE=%s;Trusted_Connection=yes' % (options.server.upper(),catalog)
try:
Connection = pyodbc.connect(ConnectString,autocommit=False)
Cursor = Connection.cursor()
except Exception, e:
raise RuntimeError, '%s %s connect failed\n%s' % (options.server,catalog,e)
SelectSession = """
select
S.SESS_NO
,S.SESS_NAME
,S.SESS_BEG
,S.SESS_END
,coalesce(S.SESS_DUR,0)
,S.SESS_STATUS
,S.CONTEXT_CODE
from SNP_SESSION as S
where S.SESS_BEG between ? and ?
and S.SESS_BEG = (
select max(SESS_BEG)
from SNP_SESSION
where SESS_NAME = S.SESS_NAME)
order by S.SESS_BEG ASC
SelectSessionHistory = """
select Top 3
SESS_NO
,SESS_NAME
,SESS_BEG
,SESS_END
,coalesce(SESS_DUR,0)
,SESS_STATUS
,CONTEXT_CODE
from SNP_SESSION
where SESS_NAME = ?
and SESS_NO <> ?
order by SESS_BEG DESC
SESS_NO = 0
SESS_NAME = 1
SESS_BEG = 2
SESS_END = 3
SESS_DUR = 4
SESS_STATUS = 5
CONTEXT_CODE = 6
SelectStep = """
select
LOG.STEP_BEG
,LOG.STEP_END
,coalesce(LOG.STEP_DUR,0)
,LOG.STEP_STATUS
,coalesce(LOG.NB_ROW,0)
,coalesce(LOG.NB_INS,0)
,coalesce(LOG.NB_UPD,0)
,coalesce(LOG.NB_DEL,0)
,coalesce(LOG.NB_ERR,0)
,STEP.STEP_NAME
,STEP.NNO
from SNP_STEP_LOG LOG
inner join SNP_SESS_STEP STEP
on STEP.SESS_NO = LOG.SESS_NO
and STEP.NNO = LOG.NNO
WHERE LOG.SESS_NO = ?
ORDER BY STEP.NNO
STEP_BEG = 0
STEP_END = 1
STEP_DUR = 2
STEP_STATUS = 3
NB_ROW = 4
NB_INS = 5
NB_UPD = 6
NB_DEL = 7
NB_ERR = 8
STEP_NAME = 9
STEP_NO = 10
SelectTask = """
select
LOG.TASK_BEG
,LOG.TASK_END
,coalesce(LOG.TASK_DUR,0)
,LOG.TASK_STATUS
,coalesce(LOG.NB_ROW,0)
,coalesce(LOG.NB_INS,0)
,coalesce(LOG.NB_UPD,0)
,coalesce(LOG.NB_DEL,0)
,coalesce(LOG.NB_ERR,0)
,TASK.TASK_NAME3
from SNP_SESS_TASK_LOG LOG
inner join SNP_SESS_TASK TASK
on TASK.SESS_NO = LOG.SESS_NO
and TASK.NNO = LOG.NNO
and TASK.SCEN_TASK_NO = LOG.SCEN_TASK_NO
WHERE LOG.SESS_NO = ?
AND LOG.NNO = ?
ORDER BY LOG.SCEN_TASK_NO
TASK_BEG = 0
TASK_END = 1
TASK_DUR = 2
TASK_STATUS = 3
TASK_ROW = 4
TASK_INS = 5
TASK_UPD = 6
TASK_DEL = 7
TASK_ERR = 8
TASK_NAME = 9
SessionStatuses = {'M':'Warning','E':'Err','D':'Done','R':'Run'}
StepStatuses = {'M':'Warn','E':'Err','D':'Done','W':'Wait','R':'Run'}
SessionRows =Cursor.execute(SelectSession,(TimeBegin,TimeEnd)).fetchall()
for SessionRow in SessionRows:
if options.session and options.session.upper() != SessionRow[SESS_NAME].upper():
# Not requested
continue
if SessionRow[SESS_NAME] in ('SOCKETSERVER','PROCESSHUB'):
# Skip these utilities
continue
if SessionRow[SESS_STATUS] == 'R':
# Still running, nothing to print(
docprint( '\n%s, status %s' % (
SessionRow[SESS_NAME]
,SessionStatuses[SessionRow[SESS_STATUS]]
continue
if SessionRow[SESS_END]:
SessionEnd = SessionRow[SESS_END].strftime(TimeFormat)
else:
SessionEnd = ' '
SessionHistories = Cursor.execute(SelectSessionHistory,(SessionRow[SESS_NAME],SessionRow[SESS_NO])).fetchall()
docprintnocr( '\n%-20s\n\t%s / %s %6i secs %s' % (
SessionRow[SESS_NAME][:20]
,SessionRow[SESS_BEG].strftime(TimeFormat)
,SessionEnd
,SessionRow[SESS_DUR]
,SessionStatuses[SessionRow[SESS_STATUS]]
for SessionHistory in SessionHistories:
if SessionHistory[SESS_END]:
SessionHistoryEnd = SessionHistory[SESS_END].strftime(TimeFormat)
else:
SessionHistoryEnd = ' '
docprintnocr( '\t%s / %s %6i secs %s' % (
SessionHistory[SESS_BEG].strftime(TimeFormat)
,SessionHistoryEnd
,SessionHistory[SESS_DUR]
,SessionStatuses[SessionHistory[SESS_STATUS]]
if not options.step:
# Step detail not requested
continue
docprint( '\n %-22s %5s %4s %8s %8s %8s %8s %8s' % (
,'Secs'
,'Stat'
,'Rows'
,'Inserts'
,'Updates'
,'Deletes'
,'Errors'
for StepRow in Cursor.execute(SelectStep,SessionRow[SESS_NO]).fetchall():
try:
docprint( ' %-22s %5i %-4s %8i %8i %8i %8i %8i' % (
StepRow[STEP_NAME][:22]
,StepRow[STEP_DUR]
,StepStatuses[StepRow[STEP_STATUS]]
,StepRow[NB_ROW]
,StepRow[NB_INS]
,StepRow[NB_UPD]
,StepRow[NB_DEL]
,StepRow[NB_ERR]))
except Exception, e:
docprint(e)
continue
if not options.task:
# Task detail not requested
continue
try:
for TaskRow in Cursor.execute(SelectTask,(SessionRow[SESS_NO],StepRow[STEP_NO])).fetchall():
docprint( ' %-21s %5i %-4s %8i %8i %8i %8i %8i' % (
TaskRow[TASK_NAME][:21]
,TaskRow[TASK_DUR]
,TaskRow[TASK_STATUS]
,TaskRow[TASK_ROW]
,TaskRow[TASK_INS]
,TaskRow[TASK_UPD]
,TaskRow[TASK_DEL]
,TaskRow[TASK_ERR]
except Exception, e:
docprint( e )
docprint( '\nEnd of report')
Connection.close()
if options.printonly:
for line in document:
print line
sys.exit(0)
import smtplib
Message = """From: %s
To: %s
MIME-Version: 1.0
Content-type: text/html
Subject: %s
%s
options.mailuser
,options.recipientlist
,'Session Report'
,' '.join(document).replace('\n',' ').replace('\t',' ').replace(' ',' ')
server = smtplib.SMTP(options.mailserver)
server.sendmail(options.mailuser,options.recipientlist,Message)
server.quit()

Jython and Odi Error with Colon...

Hi there's somthing weird with ODI and jithon..
i create a procedure
with jython techology .. i dont't know why .. my principal purpose y to make a connection to the BD..
but it fails
i'm testing with easy code .. and the same..
the code is this ..
s = 'Hello World %d'
for i in range(4):
j = i * 2
print s % j
and also probe with this one ...
if fav == “mundogeek.net”:
print “Tienes buen gusto!”
print “Gracias”
i always get the same error:.....
org.apache.bsf.BSFException: exception from Jython:
Traceback (innermost last):
(no code object) at line 0
SyntaxError: ('invalid syntax', ('<string>', 3, 1, 'j = i * 2'))
 at org.apache.bsf.engines.jython.JythonEngine.exec(JythonEngine.java:146)
 at com.sunopsis.dwg.codeinterpretor.k.a(k.java)
 at com.sunopsis.dwg.dbobj.SnpSessTaskSql.scripting(SnpSessTaskSql.java)
 at com.sunopsis.dwg.dbobj.SnpSessTaskSql.execScriptingOrders(SnpSessTaskSql.java)
 at com.sunopsis.dwg.dbobj.SnpSessTaskSql.execScriptingOrders(SnpSessTaskSql.java)
 at com.sunopsis.dwg.dbobj.SnpSessTaskSql.treatTaskTrt(SnpSessTaskSql.java)
 at com.sunopsis.dwg.dbobj.SnpSessTaskSqlS.treatTaskTrt(SnpSessTaskSqlS.java)
 at com.sunopsis.dwg.dbobj.SnpSessTaskSql.treatTask(SnpSessTaskSql.java)
 at com.sunopsis.dwg.dbobj.SnpSessStep.treatSessStep(SnpSessStep.java)
 at com.sunopsis.dwg.dbobj.SnpSession.treatSession(SnpSession.java)
 at com.sunopsis.dwg.cmd.DwgCommandSession.treatCommand(DwgCommandSession.java)
 at com.sunopsis.dwg.cmd.DwgCommandBase.execute(DwgCommandBase.java)
 at com.sunopsis.dwg.cmd.e.i(e.java)
 at com.sunopsis.dwg.cmd.g.y(g.java)
 at com.sunopsis.dwg.cmd.e.run(e.java)
 at java.lang.Thread.run(Unknown Source)
I make a debug ... and the intructions without ":"... are correct..!!! for example.. i cant use if():.. while(): .. def func: because they use ":".... I'm desesperating...
somebody of u Knows how to solve this issue ? ...
Thanks !!!

This is really jython issue and there are suitable forums in internet that should address this issue. Your first code should be:
s = 'Hello World %d'
for i in range(4):
 j = i * 2
print s % j
You missed the tab indentation under for block and forgot to close the for loop with a new line. The second code block should be:
if fav == “mundogeek.net”:
 print “Tienes buen gusto!”
print “Gracias”
The variable "fav" must be declared before hand.
More edit -> OTN forum is eating the tabs that I provided. Third line in first block and 2nd line in 2nd code block should start with a tab.
Edited by: siddhartha@eastcoast on Apr 27, 2010 3:04 PM

READ ME Before you decide to use IKM Oracle Multi-Insert in ODI 12c

Ok, I've decided to write this to help out others who may be heading down this twisted mess and hope they can benefit from my pain.
If using a sequence, do not use this IKM.
The primary reason is Oracle's INSERT ALL statement is NOT atomic. This means it WILL eventually give "ORA-02291: integrity constraint (XXX) violated - parent key not found" when it attempts to insert rows into the child table first. To make it work, the constraint(s) in question must be disabled or set to deferred. However, if either is done, there is no need to use the INSERT ALL because the multiple inserts can now be done in any order without error as long as everything is kosher at the time the constraint is enabled or set to immediate. So the very fix for the IKM makes its use unnecessary.
The second reason is it burns sequence numbers. The IKM has a tendency of grabbing the filter (no matter how buried) right before it and putting it in the WHEN statement of the INSERT ALL. This will burn sequence numbers because the rows are not filtered prior to being feed into the insert. Not an issue for small rowsets, but for large rowsets or frequently run mappings the burn can be quite substantial. This can be fixed by manipulating hints and/or the physical tab, but may result in poorer performance than just using a different IKM that doesn't burn sequence numbers.
If you are doing anything else besides the multi-insert in the same mapping, beware! This IKM does not allow ODI to respect the Target Load Order specified on the mapping. I've found that it usually puts the multi-insert last in sequence. It can be fixed by working on the physical tab, and making multiple targets but it also crashed several times when I was using it. Additionally it resisted doing what seemed like simple tasks (like dragging multiple items at a time or trying to drag items off to the right of the execution units). As I've said elsewhere, I think this is a bug and it will probably be fixed in the future.
So my advice is avoid using this IKM at all costs. Just disable or defer your constraints and use the other IKMs.
BTW, if you want to defer the constraints, I've found you can set the On Connect command of the Physical topology to:
ALTER SESSION SET CONSTRAINTS = DEFERRED
and then select all the transactions in the list. Trying it in the Begin Mapping Command of the mapping does not appear to work.
Please let me know if I got anything wrong,
Scott

This is not the first instance of KM load strategy that has had the nasty side effect of burning sequence numbers - see the following:
ODI Oracle Merge Incremental Update burns sequence values - jason's hyperion blog
However, at least this one does now seem to have been modified to try and address this issue.

How can I move the ODI Work Repository from one server to another server?

How can I move the ODI Work Repository from one server to another server?

Hi,
If you would like to move your source models, target models and project contents from Work repository 1 to another work repository.
I.e. Dev. server to Prod Server.
1. Firstly, replicate the master repository connections i.e. with same naming conventions manually
2. Go to Dev. Server work repository -> File Tab -> Click on Export work repository (save it in a folder)
3. After exporting, you can view the xml files in the folders.
4. Now, Open the Prod. server and make sure you already replicated mas. rep. details.
5. Now, right click on model and import source model in synonym mode insert_update (select source model from the folder where your xml file located)
6. Similarily, import again target then Project.
Now, check. It should work.
Thank you.

Standard def STB repeatedly blacks out for a second or 2

A site search on "black out" does not turn up a similar issue, of course it may be my search skills are lacking.
New subsciber since Sep 2010. I have 3 boxes, 2 standard QIP2500 phase 3 (basement/MBR) and 1 hi-def (LR). Hi def TV in MBR, standard in other 2. Both standards would on occassion 'black out' for just a second or 2 ever since original install. No problem with the hi-def. One standard is wired with coax, one with s-video, the hi-def with HDMI. When the black out occurs, the screen will freeze for an instant, then the screen goes black, then it comes back. The information on the box does not black out, the TVs don't power-off and restart. It's just the screen goes blank and then comes back. It happens without any seeming warning, and will happen at any time of day. Sometimes it will happen repeatedly, sometimes it won't happen for a long time. Both boxes have been repeatedly reset and rebooted with no improvement. During one tech call the tech had me relocate one of the standard boxes to the hi-def location to isolate that it wasn't a location (in-house cable) problem. I thought it curious since it was happening at 2 different locations but went through the drill anyway. The relocated standard worked for a few minutes, then went black for a second as the problem does. Plugging the high-def back in resolved the issue at that location. The tech said he would send 2 new standard boxes. The replacement boxes have not resolved the issue. Any suggestions?

if it's doing that on two different boxes using both coax and s-video then I think that leaves a possibility of the coax. that would be a unusual symptom of a bad coax/splitter but try this.
Wait for it to start acting up - when it starts acting up, stay tuned to that station, and hit your menu > customer support > in home agent > network diagnostics and click ok to start.
check the video signal using that menu selection. after it's done running it will give you a general message like "you're video signals are not in the optimal range" after you see that, hit info and then look at the SNR DB it should give you a number.
32-36 is optimal, below that is questionable.
If it is below that then it's probably going to be a problem with the splitter at your house, and you would either replace it yourself, or call verizon to replace it. be sure to tell them the DB

Assigning a Jython variable value to an ODI variable

I have to implement database cursor functionality in ODI.
For storing the returned values from database, I am using a Jython list.
The next functionality that I have to implement is as follows:
(i) For each value in the Jython list, I have to pass that value as a variable to an interface and then execute the interface
(ii) Return back to the Jython list to get the next value in it
(iii) Execute the interface for the new value from Jython list
(iv) Have to execute the interface for as many values as in the list and stop when list is over.

Hi,
Thanks for your replies.
I tried your method of using source as a query in procedure and using ODI startScen in the Target of the same procedure. But the scenario runs only once, and then stops even though the Source query returns 4 rows.
Do we have to write Source and Target in separate steps of the procedure?
Does ODI store the many records returned into some internal variables?
I need to implement a cursor functionality so what is the best approach?
Can i pass array variable value to some odi variables and do a loop?
I used a workaround....it works but dont know if that's a good way of doing things:
I retrieved all the different values that I need in a string by appending the values(this was done using Java loop).
In my next step in the procedure I call a scenario(package which has some variables and my interface), which passes this long variable from Java as <@...@>
Then in the package I use an iteration variable which is used to find out the SubString position so that I can extract the correct string to use for my Interface in the next step of the Package.
It is working fine as of now.....but things could be made simpler if I could call the scenario in the Java loop, then I wouldn't need the iteration variable etc.

Error encountered while assigning a value to a variable in ODI.

we are getting the below error while trying to assign the o/p of the below query to a variable in ODI.THis error is encountered when the Table1 is empty....
select b.res from (select (select CEIL((select count(1) from Table1)/2) - #SMARTS.loop_variable from dual) result from dual) a, (select CEIL((select count(1) from cst_dsa.m_pb_cable_data)/2) res from dual) b where a.result >= 0
java.lang.Exception: Error: No value to affect to this variable for DefDate:2012-05-22 13:57:07.0
DefN:null
DefV:null
IndStore:H
ITxtDefT:null
ITxtVar:null
SessNo:800100
VarDatatype:N
VarName:SMARTS.total_loop_count_cable
     at com.sunopsis.dwg.dbobj.SnpSessTaskSqlV.execStdOrders(SnpSessTaskSqlV.java)
     at com.sunopsis.dwg.dbobj.SnpSessTaskSql.treatTaskTrt(SnpSessTaskSql.java)
     at com.sunopsis.dwg.dbobj.SnpSessTaskSqlV.treatTaskTrt(SnpSessTaskSqlV.java)
     at com.sunopsis.dwg.dbobj.SnpSessTaskSql.treatTask(SnpSessTaskSql.java)
     at com.sunopsis.dwg.dbobj.SnpSessTaskSqlV.treatTask(SnpSessTaskSqlV.java)
     at com.sunopsis.dwg.dbobj.SnpSessStep.treatSessStep(SnpSessStep.java)
     at com.sunopsis.dwg.dbobj.SnpSession.treatSession(SnpSession.java)
     at com.sunopsis.dwg.cmd.DwgCommandSession.treatCommand(DwgCommandSession.java)
     at com.sunopsis.dwg.cmd.DwgCommandBase.execute(DwgCommandBase.java)
     at com.sunopsis.dwg.cmd.e.i(e.java)
     at com.sunopsis.dwg.cmd.g.y(g.java)
     at com.sunopsis.dwg.cmd.e.run(e.java)
     at java.lang.Thread.run(Unknown Source)
can somebody pls let me know ,how to handle this exception..

This error means that there is no value to assign to your variable, because specified query doesn't return result row. You should rewrite your query to guarantee that it would return row in any case.
For example, select nvl(min(b.res), -1) from (select (select CEIL((select count(1) from Table1)/2) - #SMARTS.loop_variable from dual) result from dual) a, (select CEIL((select count(1) from cst_dsa.m_pb_cable_data)/2) res from dual) b where a.result >= 0 group by a,b
Edited by: apiminov on 15.06.2012 8:18
Edited by: apiminov on 15.06.2012 8:19

ERROR WHILE RUNNING ODI SCENARIO FROM BAM ALERT

We are using oracle data integrator 11g and have created an ODI Scenario and able to run the scenario from ODI studio client.
We have done the configuration for BAM-ODI integration as mentioned in http://docs.oracle.com/cd/E21764_01/integration.1111/e10224/bam_odi.htm#BABEJIGD
We have started ODI Agent, soa and bam servers. Created a BAM alert -> select action - Run ODI Scenario -> selected the same scenario.
Alert ran at scheduled time but failed with following error:
java.io.IOException : truncated data integrator frame received
Error Message (if any)
[2012-08-06T11:24:21.046+05:30] [bam_server1] [WARNING] []
[oracle.bam.eventengine] [tid: bam-pool-Action-thread-1] [userId:
OracleSystemUser] [ecid:
3576f9092ef9497a:-743c430a:138fa7450c3:-8000-00000000000000a8,1:23453] [APP:
oracle-bam#11.1.1] EventEngine: Error occured while running a ODI Scenario.
[2012-08-06T11:24:21.250+05:30] [bam_server1] [ERROR] []
[oracle.bam.eventengine] [tid: bam-pool-Action-thread-1] [userId:
OracleSystemUser] [ecid:
3576f9092ef9497a:-743c430a:138fa7450c3:-8000-00000000000000a8,1:23453] [APP:
oracle-bam#11.1.1] EventEngine: Action exception: EEInstEv2 EEInstAct1 Rule
Id: 2 exception: java.io.IOException: truncated Data Integrator Frame
received
[2012-08-06T11:24:21.250+05:30] [bam_server1] [WARNING] []
[oracle.bam.eventengine] [tid: bam-pool-Action-thread-1] [userId:
OracleSystemUser] [ecid:
3576f9092ef9497a:-743c430a:138fa7450c3:-8000-00000000000000a8,1:23453] [APP:
oracle-bam#11.1.1] EventEngine: Exception stack trace: [[
at
oracle.bam.eventengine.engine.event.action.RunScenario.invokeScenario(RunScena
rio.java:145)
at
oracle.bam.eventengine.engine.event.action.ActionProcessor.runScenario(ActionP
rocessor.java:891)
at
oracle.bam.eventengine.engine.event.action.ActionProcessor.actionHandler(Actio
nProcessor.java:337)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.j
ava:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at oracle.bam.system.Delegate$Sink.invoke(Delegate.java:80)
at oracle.bam.system.Delegate.dynamicInvoke(Delegate.java:186)
at
oracle.bam.common.threading.threadpool.ThreadPoolController$PoolQueueItem.proc
essWorkRequest(ThreadPoolController.java:155)
at
oracle.bam.common.threading.threadpool.ThreadPoolController$PoolQueueItem.run(
ThreadPoolController.java:128)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java
:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908
at java.lang.Thread.run(Thread.java:619)
Any help on this is highly appreciated...
Thanks
Rajdip Mukherjee

Hi,
Forgot to include the ODI classes RunScenario.invokeScenario() is invoking odi scenario using odi sdk api. Please see the below stack trace :-
java.io.IOException: truncated Data Integrator Frame received
at
oracle.odi.sdk.invocation.internal.AgentNetworkCmd.readCmd(AgentNetworkCmd.java:303)
at
oracle.odi.sdk.invocation.OdiInvocation.invokeCommand(OdiInvocation.java:176)
at
oracle.bam.eventengine.engine.event.action.RunScenario.invokeScenario(RunScenario.java:140)
at
oracle.bam.eventengine.engine.event.action.ActionProcessor.runScenario(ActionProcessor.java:891)
at
oracle.bam.eventengine.engine.event.action.ActionProcessor.actionHandler(ActionProcessor.java:337)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
Thanks
Rajdip Mukherjee

ODI DEF

Similar Messages

Maybe you are looking for