Loading file with empty/blank values

My datas are in a file and my target is a DB2 table wich contains numeric columns, date columns, text columns (CHAR, VARCHAR)...
If I load this file with Sunopsis with "KLM File to SQL", when the value of the column is blank in the file, the colum in the target table is null
Now, with ODI and "LKM File to SQL", when the value of the colum is blank in the file, the data in the target table is :
- null if it's a date
- "0" if it's a numeric column
- spaces if it's a text column
Can you explain me why the result is different with the 2 tools ? I want that ODI make the same thing than Sunopsis.
Thanks.

For those who are interested, the problem come from the differents drivers used for files :
In Sunopsis, by default :
-     driver :     com.sunopsis.jdbc.driver.FileDriver
-     url jdbc :      jdbc:snps:file
In ODI
-     driver :      com.sunopsis.jdbc.driver.file.FileDriver
-     url jdbc :      jdbc:snps:dbfile
Problem solved.

Similar Messages

FileAdapter Write file with empty payload always error

Hi All ,
I run on 10.1.3.3.1 with patch Patch 7375080 only esb not have bpel.I have to use webservice for verify data.
and response with set of objects.
I have 2 important questions about write file with FileAdapter.
1. I want to not create file if not have error from validate data but
with this xsl tranform if I uncomment when value of condition is 'N' that will error cause single line payload.
<xsl:for-each select="/tns:populateYFRIResponseElement/tns:result/tns:wrongLines">

<imp1:Child-Element>
<imp1:FrameNo>
<xsl:value-of select="concat('"',tns:frameNo,'"')"/>
</imp1:FrameNo>
<imp1:EngineNo>
<xsl:value-of select="concat('"',tns:engineNo,'"')"/>
</imp1:EngineNo>
</imp1:Child-Element>

</xsl:for-each>
but if I comment if condition 'Y' FileAdapter create csv files with empty like "","" .
2.
I must write log file with FileAdapter . I want to append file so I add attribute Append=true
to wsdl
<jca:operation
LogicalDirectory="outgoingfile"
InteractionSpec="oracle.tip.adapter.file.outbound.FileInteractionSpec"
FileNamingConvention="YFRI%yyMMdd%.log"
NumberMessages="1"
Append = "true"
>
but when run that throws errors cause properties append not found.
I view class FileInteractionSpec that have append properties .I very confuse.
Any help would be appreciated.
Regards,
Weerawat

Hi
Thank for good answer.I am newbies in esb so I don't know that have routing expression before.
I'm so glad your answer very helpful before routing but same question 1 if I have detail must not write data like below
,import file name YFRI20090616165654.DAT at Tue Jun 16 16:59:26 GMT+07:00 2009 with number of data is 2 correct line is 2
"D",0,0,
,import file name YFRI20090616170202.DAT at Tue Jun 16 17:04:40 GMT+07:00 2009 with number of data is 12 correct line is 12
"D",0,0,
YFRI.txt,import file name YFRI.txt at Tue Jun 16 19:53:48 GMT+07:00 2009 with number of data is 2 error line is 2
"D",1,3,MTOCCode:ZE8839LZ SAA is not have in DB
"D",2,3,MTOCCode:ZE8839LZ SAA is not have in DB
with
<xsd:element name="LogFile">
<xsd:complexType>
<xsd:sequence>
<xsd:element name="FileName" type="xsd:string" nxsd:style="terminated" nxsd:terminatedBy="," nxsd:quotedBy=""">
</xsd:element>
<xsd:element name="Desc" type="xsd:string" nxsd:style="terminated" nxsd:terminatedBy="${eol}" nxsd:quotedBy=""">
</xsd:element>
<xsd:element name="Detail" nxsd:startsWith=""D"," maxOccurs="unbounded">
<xsd:complexType>
<xsd:sequence nxsd:style="array" nxsd:arrayTerminatedBy="${eol}">
<xsd:element name="line" type="xsd:string" nxsd:style="terminated" nxsd:terminatedBy="," nxsd:quotedBy="""/>
<xsd:element name="column" type="xsd:string" nxsd:style="terminated" nxsd:terminatedBy="," nxsd:quotedBy="""/>
<xsd:element name="desc" type="xsd:string" nxsd:style="terminated" nxsd:terminatedBy="${eol}" nxsd:quotedBy="""/>
</xsd:sequence>
</xsd:complexType>
</xsd:element>
</xsd:sequence>
</xsd:complexType>
</xsd:element>
ESB will display error payload If import not have verify error detail so I have to write 'D',0,0 (Detail,Line,Column).
In this situation how am I to do ?
In question 2 .Now I can append with
<jca:operation
LogicalDirectory="outgoingfile"
InteractionSpec="oracle.tip.adapter.file.outbound.FileInteractionSpec"
FileNamingConvention="YFRI%yyMMdd%.log"
NumberMessages="1"
OpaqueSchema="false"
Append="true"
>
</jca:operation>
Thank you
Weerawat

Show row/column with empty dimension values.

I have 2 columns where 1 column is dimension and 1 column is measure. I need to hide the row when the dimension is empty.
What I did is at the block I UN-TICK "Show row/column with empty dimension values". But it didnt works.
Thanks.

click on the block and add a filter with condition dimension isnotnull. this will eliminate the dimension rows with empty values.
Thanks,
karthik

Load File with wildcards?

Hello,
how could I load files with this pattern:
ausw_[name]_[date].xls (without the brackets)
Workbook workbook = Workbook.getWorkbook(new File("C:\\extracts/ausw_[name]_[date].xls"));
Could it be work with Regular Expressions?
Has anyone an idee?
Greetings
Marco

Check java.io.FilenameFilter and java.io.File.listFiles (FilenameFilter) or search the forum.

Files open empty/blank

I am working with the most recient version of Dreamweaver CC(13.2 build 6466) on Mac os 10.9.2. Most of my files reside on servers in the building connected through eithernet. I have editied these file on the file servers for years and not had a problem. All of a sudden when I try to edit them, while they are on the server, Dreamweaver opens them to empty/blank files. I know they are not blank because I can open them in other text editors and the code is there. When I copy the files to my desktop the file opens with out a problem. I don't have my pages setup as sites because that dosn't work in my Magento work flow. As far as I know nothing about my network has changed.

I Deleted the cache and then renamed the Configuration folder and neither had any effect. I have a virtual Windows 7 machine on this system. The Win 7 system is hosted with Parallels. I relized that the file(s) that I was trying to access was not on a server, those files seem to work, it was on this virtual win 7 system. I have recently upgraded the Mac OS to Marverics and in that proccess I updated Parallels. I am going to check with Parallels to see if the issue resides with them.

URGENT: Problems Loading files with SQL Loader into a BLOB column

Hi friends,
I read a lot about how to load files into blob columns, but I found errors that I can't solve.
I've read several notes in these forums, ine of them:
sql loader: loading external file into blob
and tried the solutions but without good results.
Here are some of my tests:
With this .ctl:
LOAD DATA
INFILE *
INTO TABLE mytable
REPLACE
FIELDS TERMINATED BY ','
number1 INTEGER EXTERNAL,
cad1 CHAR(250),
image1 LOBFILE(cad1) TERMINATED BY EOF
BEGINDATA
1153,/opt/oracle/appl/myapp/1.0.0/img/1153.JPG,
the error when I execute sqlldr is:
SQL*Loader-350: Syntax error at line 9.
Expecting "," or ")", found "LOBFILE".
image1 LOBFILE(cad1) TERMINATED BY EOF
^
What problem exists with LOBFILE ??
(mytable of course has number1 as a NUMBER, cad1 as VARCHAR2(250) and image1 as BLOB
I tried too with :
LOAD DATA
INFILE sample.dat
INTO TABLE mytable
FIELDS TERMINATED BY ','
(cad1 CHAR(3),
cad2 FILLER CHAR(30),
image1 BFILE(CONSTANT "/opt/oracle/appl/myapp/1.0.0/img/", cad2))
sample.dat is:
1153,1153.JPEG,
and error is:
SQL*Loader-350: Syntax error at line 6.
Expecting "," or ")", found "FILLER".
cad2 FILLER CHAR(30),
^
I tried too with a procedure, but without results...
Any idea about this error messages?
Thanks a lot.
Jose L.

> So you think that if one person put an "urgent" in the subject is screwing the problems of
other people?
Absolutely. As you are telling them "My posting is more important than yours and deserve faster attention and resolution than yours!".
So what could a typical response be? Someone telling you that his posting is more important by using the phrase "VERY URGENT!". And the next poster may decide that, no, his problem is evern more import - and use "EXTREMELY URGENT!!" as the subject. And the next one then raises the stakes by claiming his problem is "CODE RED! CRITICAL. DEFCON 4. URGENT!!!!".
Stupid, isn't it? As stupid as your instance that there is nothing wrong with your pitiful clamoring for attention to your problem by saying it is urgent.
What does the RFC's say about a meaningful title/subject in a public forum? I trust that you know what a RFC is? After all, you claim to have used public forums on the Internet for some years now..
The RFC on "public forums" is called The Usenet Article Format. This is what it has to say about the SUBJECT of a public posting:
=
The "Subject" line (formerly "Title") tells what the message is about. It should be suggestive enough of the contents of the message to enable a reader to make a decision whether to read the message based on the subject alone. If the message is submitted in response to another message (e.g., is a follow-up) the default subject should begin with the four characters "Re: ", and the "References" line is required. For follow-ups, the use of the "Summary" line is encouraged.
=
([url http://www.cs.tut.fi/~jkorpela/rfc/1036.html]RFC 1036, the Usenet article format)
Or how about [url http://www.cs.tut.fi/~jkorpela/usenet/dont.html]The seven don'ts of Usenet?
Point 7 of the Don'ts:
Don't try to catch attention by typing something foolish like "PLEASE HELP ME!!!! URGENT!!! I NEED YOUR HELP!!!" into the Subject line. Instead, type something informative (using normal mixed case!) that describes the subject matter.
Please tell me that you are not too thick to understand the basic principles of netiquette, or to argue with the RFCs that governs the very fabric of the Internet.
As for when I have an "urgent" problem? In my "real" work? I take it up with Oracle Support on Metalink by filing an iTAR/SR. As any non-idiot should do with a real-life Oracle crisis problem.
I do not barge into a public forum like you do, jump up and down, and demand quick attention by claiming that my problem is more important and more urgent and more deserving of attention that other people's problem in the very same forum.

Problem with loading file with SQL loader

i am getting a problem with loading a file with SQL loader. The loading is getting
terminated after around 2000 rows whereas there are around 2700000 rows in the file.
The file is like
919879086475,11/17/2004,11/20/2004
919879698625,11/17/2004,11/17/2004
919879698628,11/17/2004,11/17/2004
the control file, i am using is like:-
load data
infile 'c:\ran\temp\pps_fc.txt'
into table bm_05oct06
fields terminated by ","
(mobile_no, fcal, frdate )
I hope, my question is clear. Please help, in solving the doubt.
regards.

So which thread is telling the truth?
Doubt with SQL loader file wih spaces
Are the fields delimited with spaces or with commas?
Perhaps they are a mixture of delimiters and that is where the error is coming in?

LOAD FILE with xml

HI
I want to load an xml file into a RDBMS table, using sunopsis xml driver.
I try to use an other xml file than the initial that is defined in the driver url.
I cannot run this instruction in a XML treatment before the interface :
LOAD FILE "C:/AXYUS/SURSAUD/entree/sosmed1.xml" WITH DTD "C:/AXYUS/SURSAUD/entree/sosmed.dtd" REPLACE READONLY AUTO_UNLOCK
the file doesn't change at alll and I always load the initial file ( sosmed.xml )
any idea ?

Make sure that you issue your LOAD FILE command
- on the SAME Transaction (0, 1, 2, etc...) than the one used in the LKM,
- with the SAME logical schema as the source table logical schema
- and with the SAME Context (if you use the execution context - leave it unset).
This should do the trick, and the connection created in the procedure will be reused in the interface, provided that you chain both in a package.
Regards,
-FX

Find files with empty properties

Hi experts,
We use SAP KM and have some properties which are mandatory when you upload a file.
Now we have the problem, that there are still some files in the KM with empty (mandatory) properties, e.g. when they are uploaded with the portal drive.
Is there a way to find these files? With a KM report, with the TREX (is it possible to search for NULL in the fields), ...?
Best regards,
Manuel

Hi,
You can ofcourse write a KM Report, which iterates through all KM Resources and check for this property for null.
Check this to know, how to create custom KM Report:
https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/9ddf91ce-0201-0010-3a86-9f4162bd348f
If you still have questions, let me know.
Regards,
Praveen Gudapati

Order By Clause with Empty Field values !

Hello,
In Oracle , the order by clause does not return the expected query result, if any of the field value in the order by clause has an empty string.
Oracle treats the empty string as null value and ORDER BY gives a result with the empty string field values listed at last.
For example :
test is a sample table containing "name" field.
Query: "select name from test order by name"
In SQL Server/Access
Result (1)
NAME
(blank)
(blank)
User1
User2
User3
In Oracle
Result (2)
NAME
User1
User2
User3
(blank)
(blank)
I know some of the Work arounds for this as listed below :
1) To use NVL in Order By Clause.
i.e., the modified query
"select name from test order by nvl(name,0)"
gives the result same as Result (1).
2) To have single blank space in the field value if it is empty.
I dont want to use either of these two options b'se it would lead to a mass change in my existing code.
Is there any way i can do a
collation order settings in the Oracle databases to get the results as in MS SQL/Access.
Can Any help me out in Solving this?
Thanks
Devi Shankar
null

Bharath,
I am moving this question to the SQL forum.
Regards,
Geoff

Import ASCII file with empty fields

Hi,
I need to import an ASCII file that for the INTCO dimension has a blank field when the source system does not provide a value. I need a conversion file to convert the other values delivered anyway, so I added EXTERNAL: *EmptyField -> INTERNAL: I_NONE at the end, but that generates an error.
Does anyone know what the correct syntax is to use for an empty field in a conversion table?
Thanks

Hi,
In that case, I would request you to delete the empty column from the flat file and then use *NEWCOL in the transformation file.
Hope this helps.

SQLLDR: Loading files with no extension

Does the Sql*Loader mandates extensions in file? I'm providing data file in the argument like
sqlldr CONTROL=test.ctl data=/whatever/AFileWithNoExtension
It errors out with AFileWithNoExtension.dat not found.
Thanks

If you don't specify an extension sqlldr assumes as default extension .dat
http://download-west.oracle.com/docs/cd/B10501_01/server.920/a96652/ch04.htm#1004744
You need to rename your file before running sqlldr

Populating a PDF file with Database Field values - URGENT PLEASE REPLY

I have a requirement where in I hae PDF files as templates. The data for these templates is the database.
Example : a.pdf
Name :
Database table : name varchar(20)
What I want to do is read this PDF template and populate the Name with the value in the table.
Any Ideas on how to do this. Pointers/Source code would be appreciated. Hve been scrambling my head for quite a while without any luck

not a portal question..
u will need some pdf library / api - such as itext, etc

How to load file with seperators

Hi, I am attempting to load a CSV file. Currently the first column has data in the format '101-000-12345-345' where
101 is the entity
000 is the Custom1
12345 is account
345 is ICP. There are other columns in the file for C2, C3 etc. My problem is that I need help on how to define an Import format which can (in the above example) pick up 101 for entity, 000 for Custom 1 etc. Please note the length for ENtity, C1, Account and ICP is fixed.
Please advise

Hi,
It sounds like you need to define "-" as your delimiter for that specific Import Group.
When you first create your Import Group you will need to define the delimiter. Once you have done this, you can then begin to define your Dimensions - here you are defining the format of your datafile. You have a couple options here - my recommendation would be to use the Import Format Builder - it will let you drag and drop sections to define your dimension. This will get you a bit more familiar with how this works.
I would strongly recommend taking a look at the FDM Admin Guide, there is an entire section dedicated to creating an Import Group. Here is the link to the 11.1.2.2 doc - though you may be on a different version: http://docs.oracle.com/cd/E17236_01/epm.1112/fdm_admin.pdf
Good luck!

How to load file with 500M into noncontiguous memory and visit them

My data file consist of a serial of 2d images. Each image is 174*130*2 butes and the total images in the file is up to 11000, which takes almost 500M bytes. I hope to load them into memory in one turn since I need to visit either image many times in random order during the data processing. When I load them into one big 3d array, the error of "out of memory" happended frequenctly.
First I tried to use QUEUE to load big chunk of data into noncontiguous memory. Queue structure is a good way to load and unload data into noncontiguous memory. But it dosn't fit here since I may need to visit any of the all the images at anytime. And it is not pratical if I dequeue one image and enqueue it into the opposite end, since the image visited may be not in sequential order.
Another choice is to put the whole file into multiple small arrays. In my case, I may load the data file into 11000 small 2d arrays and each array holds the data of one image. But I don't know how to visit these 2d array and I didn't get any cues in the posters here.
Any suggestion?
PC with 4G physical memory, Labview 7.1 and Win XP.
Thanks.

I'll try to get the ball rolling here -- hopefully there's some better ideas than mine out there.
1. I've never used IMAQ, but I suspect that it offers more efficient methods than stuff I dream up in standard LabVIEW. Of course, maybe you don't use it either -- just sayin'...
2. Since you can't make a contiguous 11000-image 3D array, and don't know how to manage 11000 individual 2D arrays, how about a compromise? Like, say, 11 3D arrays holding 1000 images each?   Then you just need ~50 MB chunks of contiguous memory.
3. I'm picturing a partially hardcoded solution in which there are a bunch of cloned "functional globals" which each hold 1000 images of data.  This kind of thing can be done using (A) Reentrant vi's or (B) Template vi's.  You may need to use VI Server to instantiate them at run-time.
4. Then I'd build an "Action Engine" wrapper around that whole bunch of stuff. It'd have an input for image #, for example, image # 6789. From there it would do a quotient & remainder with 1000 to split 6789 into a quotient of 6 and remainder of 789. Then the wrapper would access function global #6 and address image # 789 from it.
5. Specific details and trade offs depend a lot on the nature of your data processing.  My assumption was that you'd primarily need random access to images 1 or 2 at a time.
I hope to learn some better ideas from other posters...
-Kevin P.
P.S. Maybe I can be one of those "other posters" -- I just had another idea that should be much simpler. Create a typedef custom control out of a cluster which contains a 2D image array. Now make an 11000 element array of these clusters. If I recall correctly, LabVIEW will allocate 11000 pointers. The clusters that they point to will *not* need to be contiguous one after the other. Now you can retrieve an image by indexing into the array of 11000 clusters and simply unbundling the 2D image data from the cluster element.

Loading file with empty/blank values

Similar Messages

Maybe you are looking for