ODI File Datastore
Hi All,
I have a confusion regarding physical and logical length in ODI file datastore.
I have a fixed width file where a col c2 had datatype as string(30).
I defined that column in datastore as string>Physical length 30 >Logical length 30
My interface failed with error as"
ORA-12899: value too large for column "S0_IDM"."C$_0S0_EAGLE_DWHCDC_CHRG_MST"."C2_CHARGE_DESC" (actual: 31, maximum: 30)"
When I increased the logical length to 255,the interface worked fine.
Physical length still being the same 30.
How different is this?
Any help on this will be appreciated.
Thanks and Regards
Reshma
This is not from any official documentation, but here is my take after a few moments thought
Everything you do in the ODI designer is based on the logical architecture. Only at runtime is this manifested into a physical implementation i.e. connection strings are materialized etc. When you perform an integration ODI generally creates a few temporary tables prefixed with C$, I$ etc to be able to perform the necessary data movement and transformations required to, for example, populate a target datastore (table). In your example, your flat file will be materialized into such a temporary table before its contents are manipulated (or not) and loaded to the target datastore. When ODI generates this code it is using the logical length issued in the DDL that generates the temporary table column lengths, the physical column is ignored.
Now in your scenario this is not a problem as constraints such as these do not matter to the physical version of the file i.e. if you were to write back to the file it would not matter if you wrote back 255 characters or 31. This could be a problem if you were using database tables and varying the logical vs. physical lengths but usually you reverse engineer database tables using ODI rather than doing it manually so this mitigates that.
Anyway, in short, I think the logical lengths should be taken as representing what will be manifested in the materialization of the temporary objects used to manged / transform data from the source models (C$tables) and target models (I$tables) whereas the physical lengths indicate what the underlying physical representation of those models actually are.
EDIT: After reading a bit of documentation logical actually represents the length whereas physical is related to the number of bytes required to store the data. Therefore you could have a situation with multi-byte characters where the physical length could be greater than the logical length but not really the other way around.
Similar Messages
-
Unable to upload delimited flat file (Datastore)
Dear All,
Drilling down the tutorial: ODI11g: Creating an ODI Project and Interface: Exporting a Flat File to a Flat File
facing quite a problem while reverse-engineering delimited flat file (Datastore ->Model). No matter which type of delimited flat file is uploaded (txt, csv,prn), the system stayes intact while pressing "Reverse Engineering" button. Changing to Fixed Flat File option reveals that the system uploads correctly only the first row - Header of the columns (second option from the top)..and ...of cource, all the rest of the rows were placed in the first column.
I was preparing delimited flat files using Excel 2007 and 2010, in both cases no success. I tryied to create Fixed Flat File with Excel....confused completely since I could not realise how doing that?!
Properties are below. Please, help!
About
Oracle Data Integrator 11g 11.1.1
Standalone Edition Version 11.1.1
Build ODI_11.1.1.6.0_GENERIC_111219.1055
Copyright (c) 1997, 2011 Oracle. All Rights Reserved.
IDE Version: 11.1.1.6.38.61.92
Product ID: oracle.odi
Product Version: 11.1.1.6.0.0.0
Version
Component Version
========= =======
Java(TM) Platform 1.6.0_21
Oracle IDE 11.1.1.6.0
Properties
Name Value
==== =====
awt.toolkit sun.awt.windows.WToolkit
class.load.environment oracle.ide.boot.IdeClassLoadEnvironment
class.load.log.level CONFIG
class.transfer delegate
eclipselink.xml.platform org.eclipse.persistence.platform.xml.jaxp.JAXPPlatform
file.encoding Cp1251
file.encoding.pkg sun.io
file.separator \
ice.browser.forcegc false
ice.pilots.html4.ignoreNonGenericFonts true
ice.pilots.html4.tileOptThreshold 0
ide.AssertCheckingDisabled true
ide.AssertTracingDisabled true
ide.bootstrap.start 14794412430839
ide.build ODI_11.1.1.6.0_GENERIC_111219.1055
ide.conf C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi\client\odi\bin\odi.conf
ide.config_pathname C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi\client\odi\bin\odi.conf
ide.debugbuild false
ide.devbuild false
ide.extension.search.path jdev/extensions
ide.firstrun true
ide.java.minversion 1.6.0_04
ide.launcherProcessId 2932
ide.main.class oracle.ide.boot.IdeLauncher
ide.patches.dir ide/lib/patches
ide.pref.dir C:\Users\Администратор\AppData\Roaming\odi
ide.pref.dir.base C:\Users\Администратор\AppData\Roaming
ide.product oracle.odi
ide.shell.enableFileTypeAssociation C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi\client\odi64.exe
ide.splash.screen splash.gif
ide.startingArg0 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi\client\odi64.exe
ide.startingcwd C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi\client
ide.user.dir C:\Users\Администратор\AppData\Roaming\odi
ide.user.dir.var IDE_USER_DIR
ide.work.dir C:\Users\Администратор\Documents\odi
ide.work.dir.base C:\Users\Администратор\Documents
ilog.propagatesPropertyEditors false
java.awt.graphicsenv sun.awt.Win32GraphicsEnvironment
java.awt.printerjob sun.awt.windows.WPrinterJob
java.class.path ..\..\ide\lib\ide-boot.jar;..\..\..\..\oracledi.sdk\lib\ojdl.jar;..\..\..\..\oracledi.sdk\lib\dms.jar;..\..\jdev\extensions\oracle.odi.navigator\lib\log4j-1.2.8.jar;..\..\jdev\extensions\oracle.odi.navigator\lib\odi_hfm.jar;..\..\jdev\extensions\oracle.odi.navigator\lib\odihapp_common.jar;..\..\jdev\extensions\oracle.odi.navigator\lib\ess_es_server.jar;..\..\jdev\extensions\oracle.odi.navigator\lib\ess_japi.jar;..\..\jdev\extensions\oracle.odi.navigator\lib\odihapp_essbase.jar;..\..\jdev\extensions\oracle.odi.navigator\lib\odihapp_planning.jar
java.class.version 50.0
java.endorsed.dirs C:\Java\jre\lib\endorsed
java.ext.dirs C:\Java\jre\lib\ext;C:\Windows\Sun\Java\lib\ext
java.home C:\Java\jre
java.io.tmpdir c:\Temp\
java.library.path C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi\client;.;C:\Windows\Sun\Java\bin;C:\Windows\system32;C:\Windows;C:\app\master\product\11.2.0\dbhome_1\bin;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\
java.naming.factory.initial oracle.javatools.jndi.LocalInitialContextFactory
java.protocol.handler.pkgs null|oracle.odi.ui.url
java.runtime.name Java(TM) SE Runtime Environment
java.runtime.version 1.6.0_21-b07
java.specification.name Java Platform API Specification
java.specification.vendor Sun Microsystems Inc.
java.specification.version 1.6
java.util.logging.config.class oracle.core.ojdl.logging.LoggingConfiguration
java.vendor Sun Microsystems Inc.
java.vendor.url http://java.sun.com/
java.vendor.url.bug http://java.sun.com/cgi-bin/bugreport.cgi
java.version 1.6.0_21
java.vm.info mixed mode
java.vm.name Java HotSpot(TM) 64-Bit Server VM
java.vm.specification.name Java Virtual Machine Specification
java.vm.specification.vendor Sun Microsystems Inc.
java.vm.specification.version 1.0
java.vm.vendor Sun Microsystems Inc.
java.vm.version 17.0-b17
line.separator \r\n
LOG_FILE studio.log
native.canonicalization false
ODI_ORACLE_HOME C:\oracle\product\11.1.1\Oracle_ODI_1\
oracle.core.ojdl.logging.config.file ODI-logging-config.xml
oracle.home C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi\client
oracle.odi.studio.ess false
oracle.odi.wls.template.generator.agentEarLocation C:\oracle\product\11.1.1\Oracle_ODI_1\setup\manual\oracledi-agent\oraclediagent.ear
oracle.security.jps.config ./jps-config.xml
oracle.translated.locales de,es,fr,it,ja,ko,pt_BR,zh_CN,zh_TW
oracle.xdkjava.compatibility.version 9.0.4
org.apache.commons.logging.Log org.apache.commons.logging.impl.Jdk14Logger
os.arch amd64
os.name Windows Server 2008 R2
os.version 6.1
path.separator ;
python.cachedir c:\Temp\cachedir
python.home C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi\client\jdev\extensions\oracle.odi.navigator\scripting
python.packages.paths java.class.path,sun.boot.class.path,odi.class.path
reserved_filenames con,aux,prn,lpt1,lpt2,lpt3,lpt4,lpt5,lpt6,lpt7,lpt8,lpt9,com1,com2,com3,com4,com5,com6,com7,com8,com9,conin$,conout,conout$
sun.arch.data.model 64
sun.boot.class.path C:\Java\jre\lib\resources.jar;C:\Java\jre\lib\rt.jar;C:\Java\jre\lib\sunrsasign.jar;C:\Java\jre\lib\jsse.jar;C:\Java\jre\lib\jce.jar;C:\Java\jre\lib\charsets.jar;C:\Java\jre\classes;C:\Java\lib\tools.jar;C:\Java\lib\dt.jar
sun.boot.library.path C:\Java\jre\bin
sun.cpu.endian little
sun.cpu.isalist amd64
sun.desktop windows
sun.io.unicode.encoding UnicodeLittle
sun.java2d.noddraw true
sun.jnu.encoding Cp1251
sun.management.compiler HotSpot 64-Bit Server Compiler
sun.os.patch.level Service Pack 1
user.country RU
user.dir C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi\client\odi\bin
user.home C:\Users\Администратор
user.language ru
user.name master
user.timezone Europe/Moscow
user.variant
windows.shell.font.languages en
External Components
Name Version Path
==== ======= ====
HspJS.jar 11.1.1.1.0 Build 137 Built with CIS Drop 27 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi.sdk\lib\HspJS.jar
HspJS.jar 11.1.1.1.0 Build 137 Built with CIS Drop 27 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi\client\jdev\extensions\oracle.odi.navigator\lib\HspJS.jar
HspJS_11.1.2.0.jar 11.1.2.0.01.10 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi.sdk\lib\HspJS_11.1.2.0.jar
HspJS_11.1.2.0.jar 11.1.2.0.01.10 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi\client\jdev\extensions\oracle.odi.navigator\lib\HspJS_11.1.2.0.jar
activation.jar 1.1 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi.sdk\lib\activation.jar
binding-2.0.2.jar 2.0.2 2008-01-18 10:01:08 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi\client\jdev\extensions\oracle.odi.navigator\lib\binding-2.0.2.jar
coherence.jar 3.7.1.1 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi.sdk\lib\coherence.jar
commons-beanutils-1.7.0.jar 1.6 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi.sdk\lib\commons-beanutils-1.7.0.jar
commons-codec-1.3.jar 1.3 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi.sdk\lib\commons-codec-1.3.jar
commons-collections-3.2.jar 3.2 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi.sdk\lib\commons-collections-3.2.jar
commons-discovery-0.4.jar 0.4 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi.sdk\lib\commons-discovery-0.4.jar
commons-io-1.2.jar 1.2 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi.sdk\lib\commons-io-1.2.jar
commons-lang-2.2.jar 2.2 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi.sdk\lib\commons-lang-2.2.jar
commons-logging-1.1.1.jar 1.1.1 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi.sdk\lib\commons-logging-1.1.1.jar
commons-net-1.4.1.jar 1.4.1 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi.sdk\lib\commons-net-1.4.1.jar
commons-vfs-1.0.jar 1.0 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi.sdk\lib\commons-vfs-1.0.jar
cpld.jar Version 11.1.2.0.00, Build 589, March 25 2010 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi.sdk\lib\cpld.jar
cpld.jar Version 11.1.2.0.00, Build 589, March 25 2010 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi\client\jdev\extensions\oracle.odi.navigator\lib\cpld.jar
dbswing.jar 011.000.044.108 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi\client\jdev\extensions\oracle.odi.navigator\lib\dbswing.jar
dx.jar 007.001.175.112 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi\client\jdev\extensions\oracle.odi.navigator\lib\dx.jar
eclipselink.jar 2.3.1.v20111018-r10243 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi.sdk\lib\eclipselink.jar
enterprise_data_quality.jar 11.1.1.6.0 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi.sdk\lib\enterprise_data_quality.jar
enterprise_data_quality.jar 11.1.1.6.0 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi\client\jdev\extensions\oracle.odi.navigator\lib\enterprise_data_quality.jar
ess_es_server.jar 11.1.2.0.0.615 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi\client\jdev\extensions\oracle.odi.navigator\lib\ess_es_server.jar
ess_es_server.jar 11.1.2.0.0.615 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi.sdk\lib\ess_es_server.jar
ess_japi.jar 11.1.2.0.0.615 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi.sdk\lib\ess_japi.jar
ess_japi.jar 11.1.2.0.0.615 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi\client\jdev\extensions\oracle.odi.navigator\lib\ess_japi.jar
fmwgenerictoken.jar 1.0.0.0 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi\client\jdev\extensions\oracle.odi.navigator\..\..\..\..\..\odi_misc\fmwgenerictoken.jar
forms-1.2.0.jar 1.2.0 2008-02-23 08:37:50 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi\client\jdev\extensions\oracle.odi.navigator\lib\forms-1.2.0.jar
groovy-all-1.7.4.jar 1.7.4 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi\client\jdev\extensions\oracle.odi.navigator\scripting\groovy-all-1.7.4.jar
hsqldb.jar 2.0.0 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi.sdk\lib\hsqldb.jar
http_client.jar December 9 2011 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi.sdk\lib\http_client.jar
javax.security.jacc_1.0.0.0_1-1.jar 1.1 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi.sdk\lib\javax.security.jacc_1.0.0.0_1-1.jar
mail.jar 1.4 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi.sdk\lib\mail.jar
odi-sap.jar 10.1.3.12 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi.sdk\lib\odi-sap.jar
odi_hfm.jar 11.1.1.6.0 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi.sdk\lib\odi_hfm.jar
odi_hfm.jar 11.1.1.6.0 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi\client\jdev\extensions\oracle.odi.navigator\lib\odi_hfm.jar
odihapp_essbase.jar 11.1.1.6.0 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi\client\jdev\extensions\oracle.odi.navigator\lib\odihapp_essbase.jar
odihapp_essbase.jar 11.1.1.6.0 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi.sdk\lib\odihapp_essbase.jar
odihapp_planning.jar 11.1.1.6.0 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi.sdk\lib\odihapp_planning.jar
odihapp_planning.jar 11.1.1.6.0 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi\client\jdev\extensions\oracle.odi.navigator\lib\odihapp_planning.jar
odihapp_planning_11.1.2.0.jar 11.1.1.6.0 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi.sdk\lib\odihapp_planning_11.1.2.0.jar
odihapp_planning_11.1.2.0.jar 11.1.1.6.0 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi\client\jdev\extensions\oracle.odi.navigator\lib\odihapp_planning_11.1.2.0.jar
ojdbc6dms.jar 11.2.0.3.0 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi\client\jdev\extensions\oracle.odi.navigator\lib\ojdbc6dms.jar
oracle.ucp_11.1.0.jar 11.2.0.3.0 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi.sdk\lib\oracle.ucp_11.1.0.jar
pop3.jar 1.1.1 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi.sdk\lib\pop3.jar
spring-aop.jar 2.0.3 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi.sdk\lib\spring-aop.jar
spring-beans.jar 2.0.3 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi.sdk\lib\spring-beans.jar
spring-context.jar 2.0.3 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi.sdk\lib\spring-context.jar
spring-core.jar 2.0.3 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi.sdk\lib\spring-core.jar
spring-dao.jar 2.0.3 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi.sdk\lib\spring-dao.jar
spring-jdbc.jar 2.0.3 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi.sdk\lib\spring-jdbc.jar
spring-jmx.jar 2.0.3 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi.sdk\lib\spring-jmx.jar
spring-jpa.jar 2.0.3 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi.sdk\lib\spring-jpa.jar
spring-web.jar 2.0.3 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi.sdk\lib\spring-web.jar
trove.jar 2.1.0 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi.sdk\lib\trove.jar
wlthint3client.jar 10.3.5.0 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi.sdk\lib\wlthint3client.jar
woodstox.jar 3.2.1 C:\oracle\product\11.1.1\Oracle_ODI_1\oracledi\client\jdev\extensions\oracle.odi.navigator\lib\woodstox.jar
Extensions
Name Identifier Version Status
==== ========== ======= ======
BM metamodel framework oracle.bm.meta 11.1.1.6.38.61.92 Loaded
Code Editor oracle.ide.ceditor 11.1.1.6.38.61.92 Loaded
Diagram Framework oracle.diagram 11.1.1.6.38.61.92 Loaded
Diagram Javadoc Extension oracle.diagram.javadoc 11.1.1.6.38.61.92 Loaded
Diagram Thumbnail oracle.diagram.thumbnail 11.1.1.6.38.61.92 Loaded
Extended IDE Platform oracle.javacore 11.1.1.6.38.61.92 Loaded
Groovy Support oracle.ide.groovy 11.1.1.4.37.58.91 Loaded
Help System oracle.ide.help 11.1.1.6.38.61.92 Loaded
Import/Export Support oracle.ide.importexport 11.1.1.6.38.61.92 Loaded
Index Migrator support oracle.ideimpl.indexing-migrator 11.1.1.6.38.61.92 Loaded
JViews Registration Addin oracle.diagram.registration 11.1.1.6.38.61.92 Loaded
Log Window oracle.ide.log 11.1.1.6.38.61.92 Loaded
Modeler Framework oracle.modeler 11.1.1.6.38.61.92 Loaded
Modeler Framework Common Layer oracle.modeler.common 11.1.1.6.38.61.92 Loaded
Navigator oracle.ide.navigator 11.1.1.6.38.61.92 Loaded
ODI Navigator oracle.odi.navigator 11.1.1.6.0.0.0 Loaded
Object Gallery oracle.ide.gallery 11.1.1.6.38.61.92 Loaded
Oracle Data Integrator oracle.odi 11.1.1.6.0.0.0 Loaded
Oracle IDE oracle.ide 11.1.1.6.38.61.92 Loaded
Peek oracle.ide.peek 11.1.1.6.38.61.92 Loaded
Persistent Storage oracle.ide.persistence 11.1.1.6.38.61.92 Loaded
Property Inspector oracle.ide.inspector 11.1.1.6.38.61.92 Loaded
Runner oracle.ide.runner 11.1.1.6.38.61.92 Loaded
Virtual File System oracle.ide.vfs 11.1.1.6.38.61.92 Loaded
Web Browser and Proxy oracle.ide.webbrowser 11.1.1.6.38.61.92 Loaded
audit oracle.ide.audit 11.1.1.6.38.61.92 Loaded
jdukshare oracle.bm.jdukshare 11.1.1.6.38.61.92 Loaded
mof-xmi oracle.mof.xmi 11.1.1.6.38.61.92 Loaded
oracle.ide.indexing oracle.ide.indexing 11.1.1.6.38.61.92 Loaded
palette2 oracle.ide.palette2 11.1.1.6.38.61.92 LoadedYou might want to look at the documentation related to Microsoft Excel Microsoft Excel - 11g Release 1 (11.1.1)
-
11g issue in handling file datastore from different server
Hi All,
In ODI 11g we have standalone agent as well as weblogic server agent. In our case master/workrep and weblogic server agent is installed in one of the linux server Say (A).
We have a scenario to pick the file from one of the different linux box SAY (B). We have child agent running on that box and it is associated with the main weblogic agent under load balancing.
While setting the topology information for file datastore it just need the driver name and path. At run time how odi will pick the respective file from that server
Eg:File in location: /app/soa/uo1/testfile/test.txt(B)
File path:/app/soa/uo1/testfile/test.txt(B)
ODI Client will start the execution using the Server A weblogic agent. How ODI will route the control to child agent and try to find the file in ServerB and not in server A.
in my case it is going to server A and saying file doesnot exist......
Is it really possible to assign the proper server detail, so that we can make sure that execution will happen properly. I am not sure about the weblogic agent and how it control the execution. I think in my case its weblogic agent which is trying to look for the file in server A, where it is installed and thus failing.
Control is not passing to the proper child agent as expected?
Any idea?There is a difference in your understanding of the load balancing and the way it is implemented in ODI agents.
In your case, the weblogic agent exists on Server A and hence it expects that the file also be visible to the agent and be local to server A.
Load balancing comes into picture when there are too many connections for Agent A and it shares its load with other agents. This logic of passing control is within the agent and when file systems come into picture, the filesystem should be visible to all the agents.
There is no concept of parent-child agents. The agents are simply load-share agents.
So, Load balancing is not going to give you what you want.
In your case, you should execute the job using Agent on server B so that appropriate filesystem can be accessed. -
Date format in the file datastore
Hi,
I have source as file, in which I have date column. While creating the file datastore, I have selected the datatype as date & have given the source date format in the format column and it is working fine.
But I have source file coming with different date formats for the same column.
My question is whether i can give multiple date formats in the format column??
1. If yes how to separate the formats i.e with comma or semi-colon or etc...
2. If No, thn how to achieve it. as I can use to_date function, but in that also I have to give all the date formats.Assuming Oracle is target database..
Try this...
1. In your file data store make the column as Varchar2
2. In the interface mapping -- specify the following string in the target column mapping
TO_DATE(REPLACE('2011-06-01','-',''),'YYYYMMDD')
If your target column is date, Oracle will convert database proper format and insert the date..
Hope this works out....
Thanks
Satish
Edited by: user12826256 on 01-Jul-2011 02:15 -
Hi..experts..
How to move files from one directory to other directory???
Suppose E:\ODI\FILES directory contains 2000 files and I want to move 1000 files to E:\ODI\FILES_NEW directory.
How to do it???
Please suggest..
ThanksPlease look into OdiFileMove http://docs.oracle.com/cd/E21764_01/integrate.1111/e12643/appendix_a.htm#autoId39
Provide the appropriate Mask for the files to be moved. -
File datastore creation problem from window installed ODI in AIX server
HI all,
My question is how to represent file folder name of that server
my file folder in AIX server and i want to access that file in window s machine.
* is this the right way to represent the data folder in physical schema declaration
file:///<aix server IP>/usr/oracledi/oracldi/dataHI Julien,
It's really working ..........
Thanx a lot
For other people it will be helpfull info
Only change that I have made for that task are
1. I have created an new agent for that AIX machine
2. I have updated the ODIPARAM.bat
3. I have changed record separator as UNIX while creating data store for that file
4. While executing particular interface ,I have used the agent which is local to AIX machine ..................
Steps for execution:
At the time of designing you must have local copy of that file so that you can perform your mapping once it's executing well wid your local or no agent .
then come to the Topology manager change the location for that folder in physical schema declaration of that file server of AIX machine.
Now execute the same wid ur AIX agent u have created earlier..............
while U have changed the data store location from local directory to other AIX directory don't try to reverse the same otherwise u'll get "Execution query failed "or file not found kinda error as because odi system system searching local systems file.................
Julien can u provide me ur mail Id so that I can contact U for further assistance ofcourse
if u want................
regards
palash -
URGENT: ODI- File delete in a session.
I have Query regarding "odifiledelete".
I have a scenario where i generate a file using interface n map it to a odi package and then i want to delete it through ODIFILEDELETE tool, with interface being the first step.
But it throws a error of "unable to delete".
My understanding is..
The file is in a session where it is generating and deleting in same session.
Hence it cant be deleted because it is using by odi.exe.
Please correct me if i am wrong and provide me with some solution.
Thanks ..Thanks for your quick reply.
Its correct also.
But I have a little different scenario..
1.) I have a package of lets say 7 steps.
2.) Two of the steps is two interface writing into a same file.
3.) one step is for logging the success of both interface.
4.)one step to delete the file in case if one interface writes data in file and other interface aborted.
5.) one step to log the failure of the interface and "ODIFILEDELETE" step.
So ODIFILEDELETE steps comes in between of these steps.
Now even if my deleting file step fails.., it gets logged into a file. Hence my end to end flow works in any scenario.
Now If i do it your way then my file gets deleted even wen my both of the interface worked.
I want a logic which detects error in abortion of any step in scenario and then delete file in another scenario.
I hope I could make my points clear.
Thanks. -
How to Read file name which we are dealing with ODI File tool
Hi,
We are using ODi10g version and we have requirement to move file from one place to another place. We are using ODIFileMove utility but we also want to read file name.
Any help.
Thanks in Advance.You can accomplish this with a fairly simple Jython script. Use the os.listdir(<directory>) command to get the name of files in a given directory.
You can then (still in the Jython script) loop through the files and move them to a desired location (bypassing the OdiFileMove tool) OR use the Jython script to write the file names to a SQL table. Then, use an ODI procedure to loop through the newly inserted records and store the file name in an ODI variable that you can then use in your OdiFileMove tool etc.
I often refer to this blog entry from Gurcan Orhan as a starting point for this kind of task: Loading multiple files with ODI | Gurcan Orhan&#039;s Oracle Data Integrator Blog -
ODI file append with unix command problem
Hi everyone,
I will apennd multiple files to a main file in a directory.I wrote jython code like this:
import os
sourceDirectory = "/home/oracle1/Desktop/test"
inFileNames = "#FILE_NAMES"
inFileNamesList = inFileNames.split(" ")
inFileIDS = *"'a','1','2','3'"*
inFileIDSList = inFileIDS.split(",")
i = 0
for item in inFileNamesList:
command ="awk 'BEGIN {OFS=\"" + "#FILE_DELIMITER\"" + "} {print $0,\"[|]\"" + *inFileIDSList* + ",\"[|]\"NR}' " + sourceDirectory + os.sep + item + " >> " + sourceDirectory + os.sep + "#SESS_CURR_TS"
os.system(command)
i = i + 1
Now my problem is here :
Yu can seee my inFileIDS values.Ana I have splitted comma and then first I will write file then *inFileIDSList[i]* and at the and NR
But character a is not written.Number values is appended but character values is not appended.
Why it can be so ?
someone has an idea about this problem
Coluld anyone help me to solve this problem?
Regardsimport os
sourceDirectory = "#SOURCE_DIRECTORY"
inFileNames = "#FILE_NAMES"
inFileNamesList = inFileNames.split(" ")
inFileIDS = "#FILE_IDS"
inFileIDSList = inFileIDS.split(",")
i = 0
for item in inFileNamesList:
command ="awk 'BEGIN {OFS=\"" + "#FILE_DELIMITER\"" + "} {print $0,\"\"*FILENAME*}' " + sourceDirectory + os.sep + item + " >> " + sourceDirectory + os.sep + "#SESS_CURR_TS"
os.system(command)
i = i + 1
My original code is above.Now I am printing file datas and I want to print file name that are being ready.
First print$0(all line) and field_delimiter(;) and then I will print filename which file is processed.My output file will be like this:
all line;FILENAME
But I write FILENAME into awk command it returns with path .So for example likie this:/d102/odi/uca/arrival/data/T02344903302310.txt .But I want to print only file name without paths.
I want to print T02344903302310.txt so my output file will be like this:
all_line;T02344903302310.txt and there are many files like this.
Could anyone has an idea? -
ODI File Model gives a java error
Hi everyone,
I get the following error when I try to view data for a very simple text file Model. I have tried changing the file delimiter but to no avail. It seems like some java classpath is missing somewhere.
Also, does any one know where can I find the odiparams.bat file in ODI 11. I am using ODI 11 on Windows.
Thanks
oracle.odi.core.exception.OdiRuntimeException: java.lang.RuntimeException: java.lang.IllegalArgumentException: url must not be empty
at oracle.odi.core.datasource.dwgobject.support.DataSourceDefinitionFactory.getDataSourceDefinition(DataSourceDefinitionFactory.java:47)
at oracle.odi.core.datasource.dwgobject.support.DwgConnectConnectionCreatorImpl.createDwgConnectConnection(DwgConnectConnectionCreatorImpl.java:36)
at com.sunopsis.graphical.frame.edit.EditFrameTableData.snpsInitializeSnpsComponentsSpecificRules(EditFrameTableData.java:86)
at com.sunopsis.graphical.frame.SnpsEditFrame.snpsInitialize(SnpsEditFrame.java:1592)
at com.sunopsis.graphical.frame.edit.AbstractEditFrameGridBorland.initialize(AbstractEditFrameGridBorland.java:595)Firstly install the odi agent as stated in the following link
[click here to read the step by step guide to install agent|http://www.oracle.com/webfolder/technetwork/tutorials/obe/fmw/odi/odi_11g/setup_odi_agent/setup_odi_agent.htm]
Then you can find the odiparams.bat under <ODI11g_HOME>\oracledi\agent\bin
Thanks Guru
Ram kumar Lanke
www.odiguru.com -
Odi file jdbc driver for HDFS files required
In ODI what is the driver to be used in the file technology for HDFS files. i have used the genereic file jdbc driver which is not accepted by ODI.
thanks
PradeepHi,
This Forum is related to creator.Please post this on a appropriate forum
Regards
Ct -
Hi all,
I have a problem indexing files residing on a different server from the one where oracle system resides. I can however load the files into BLOB field using SQLLDR and later index them using CTXSYS.CONTEXT type.
The problem is when using file_datastore to index the files remotely rather than copying them to the database
As shown below:
exec ctx_ddl.create_preference('My_user_datastore', 'FILE_DATASTORE');
exec ctx_ddl.create_preference('My_index_storage', 'BASIC_STORAGE');
exec ctx_ddl.set_attribute('My_index_storage', 'I_TABLE_CLAUSE','tablespace indx storage (initial 1m)');
exec ctx_ddl.set_attribute('My_index_storage', 'K_TABLE_CLAUSE','tablespace indx storage (initial 1m)');
exec ctx_ddl.set_attribute('My_index_storage', 'R_TABLE_CLAUSE','tablespace indx storage (initial 1m)');
exec ctx_ddl.set_attribute('My_index_storage', 'N_TABLE_CLAUSE','tablespace indx storage (initial 1m)');
exec ctx_ddl.set_attribute('My_index_storage', 'I_INDEX_CLAUSE','tablespace indx storage (initial 1m)');
Then create the index as:
CREATE INDEX FILES_INDX
ON FILES_TABLE(FILE_PATH)
INDEXTYPE IS CTXSYS.CONTEXT
parameters ('datastore My_user_datastore storage My_index_storage memory 1m');
This creates a ghost index.
Can anybody help?
Thanks in advance
Regards
NehroIf you use Windows platform it's possible
because Oracle does not support BFILE work with UNC paths.
You can use USER_DATASTORE and read files through HTTP protocol or using Java procedure for loading files from
remote host.
If you want I can send you my Java stored procedure for
work with files. -
Odi-Diagram-datastore from another model.
hi,
i created a diagram for a model.
I dropped in it a data store dept[table] from another model.i got the option, "create a copy of this datastore in the current model". I changed the columns of the table and saved it.I linked the added columns as the foreign key-primary key relation to other tables[check1,check2,check3] in the diagram.
I want to create the "generate interface in" for this table.
When i do that only the original table "dept" appears in the sorce tables.heck1,check2,check3 did not appear as the source tables in the interface.
Will the table with foreign key reference also appear in the interface?
or will only the orgibal table be reflected as source in the interface.Try to add at least one column of each source table to your target table in the diagram view. This should add the other source tables to the interfaces when generated again.
-
Hi John,
When i tried reversing a file, i got the below error
java.sql.SQLException: ORA-12899: value too large for column "ODIWORK"."SNP_REV_COL"."COL_NAME" (actual: 481, maximum: 100)
Also, in the datatype field i am seeing many other options like ebcdic signed zero, unsigned packed... etc etc. I ahve chosen com.sunopsis.jdbc.driver.file.FileDriver in the jdbc for the file.
Please help me out.It means that you are trying to reverse a column that is too wide, this can also happen if you have not set the delimiters or seperators correctly.
You should review your file source.
Cheers
John
http://john-goodwin.blogspot.com/ -
Hi,
I'm using the ODIFileAppend tool to merge the content of 2 files ito one. Structure of the 2 files is identical. My issue is that in the new merged file the content of the second file does not start on a new line but on the same line as the last line from the first file but seperated by a / character. This causes issues when I import the file to my staging table as it breaks the expected file format. Can I make the append do what I logocally thought it would do i.e. put the first line of the appended file on a new line? If not is there another way to handle this elegantly?Hi,
See if you find any help from here OdiFileAppend tool issue with new line character?
Thanks,
Sutirtha
Maybe you are looking for
-
Configuring Appraisal template to ESS/MSS
Hi Friends, I have created a appraisal template. But I am not able to see it in either MSS or in ESS. How to configure the appraisal template is for which Managers and to which employee group/sub group Thanks Vimal
-
can ios 5.0.1 (9A406) install on my ipad 1, (9A405) causing no sim card detectted............. HELP ME
-
Lr 5.4 inserts red stripes and dots, please help
Hi all, I was loading some pics in Lr and noticed some red stripes that do not belong (see attached screenshot). - it is not visible while viewing RAW CR2 files in "Library" mode, only in "Develop" - exported to jpeg files look ok - it happens with d
-
Transport of Notes/Documents of a query
Is there a mean to transport notes associated to a BW query ? Thxs. LauQ
-
MacBookPro is now very very slow.
My 3 yr old MacBookPro has become extremely slow. Formatted, installed Yosemite - but no apparent benefit. Any suggestions?