Unable to read chinese characters in a flat file to external table

Hi All,
We have a flat file containing data in chinese. We are using external table to read data in files. When i do select <coulmn-name> from <table> it displays box for the chinese characters. The column is of type varchar2.
The NLS_LANGUAGE is AMERICAN and NLS_CHARACTERSET is AL32UTF8.
The character set is mentioed as UTF8 in external table defnition.
Is the external table not reading these charcters properly? Should any patch be installed or some settings should be changed for sql developer to to display chinese character?

The NLS_LANG environment variable/registry string variable (You are just one of the 1000s of 'anonymous' users refusing to post platform and version), so NOT NLS_LANGUAGE, on the server hosting the file, should be set to anything ending in .AL32UTF8
Sybrand Bakker
Senior Oracle DBA

Similar Messages

Can we cleanse and transform data at flat file or external table level?

Hi,
I have some data that I want to cleanse and transform. I don't want to cleanse it after i populate the external table, I want to get done with it at flat file level or while populating the external table. Can we cleanse and transform data at flat file or external table level through Oracle or OWB 11.2? Is it possible to run a conditional load (i.e. having a where clause or if-else-then) for an external table? Can we call oracle functions for an external table at the time of creation?
Thanks in advance.
Regards,
Ann.

Hi Oleg,
Thanks a lot for the clarification. :)
So is there a way that I can clease the data within the text file through Oracle or OWB? I have datatype mismatches in the data and most of my data is getting rejected because of that. The way I can think of, for solving this problem, is to create the external table with all fields with datatype varchar and then cleansing the data. But it doesn't seem very effecient plus it will get very complicated because I have almost 80-90 fields.
Any help?
Thanks and regards,
Ann.

Reading special characters from a flat file and inserting into DB

I'm reading data with special characters like . etc from a flat file , assigning the data to variable in my anonymous block and inserting into my DB. But the show up as inverted ? s. Any clues about how to do this?
If i try to do the insert directly it works. It seems like the error occurs when reading this data into a variable
thanks for the help
Lalit Bhatia

lalit, this is probably an character set problem, the default on Database creation tends to be 7bit Ascii which does not support special characters, it's been a while since I set up a db in this way, but you need to change settings in oracle.ini. The db will need to be restarted for this. Also, to check current settings try:
select * from NLS_DATABASE_PARAMETERS
You want an 8bit, unicode or multibyte character set. Sorry I cannot remember moer off the top of my head, try searching on NLS or character set

Short dump while reading a currency field from Flat file into internal tabl

Hi,
I am getting a short dump........saying number conversion dump (while reading a currency value into field in internal table from a fixed lenght flat file).........
Do I need to use a string variable to get the value from flat file or how ??
Please suggest.

Santosh,
Thanks for your inputs,
But my internal table type is of DEC (5,2) , I am getting that... it needs to be of type 'C'. Can you suggest.
Ex :
MOVE wa_temp-infile_string+106(8) TO wa_item-QT_PERCENT
This didnt work
so i tried moving into a seperate variable
MOVE wa_temp-infile_string+106(8) TO v_percent.
and then write to
WRITE v_percent to wa_item-QT_PERCENT.

Flat file created ,external table created, deployed successfully but...

hi everyone,
I have a problems :
I have created a flat file through flat file module from a text file.
i've done it successfully,
then i create an external table through external table module for the same
flat file , went successfully,
then velidation went successfull,
and i carried out deployement for the same, that also done successfully.
but when i tried to check the database through SQL-Plus :
i came across with the following error :
SQL> CONNECT TARGET_SCHEMA/TARGET_SCHEMA
Connected.
SQL> SELECT * FROM CUMMINS_EXT;
SELECT * FROM CUMMINS_EXT
ERROR at line 1:
ORA-29913: error in executing ODCIEXTTABLEOPEN callout
ORA-29400: data cartridge error
KUP-04040: file Cumminsparts.txt in TARGET_LOC_CUMMINS_LOC not found
ORA-06512: at "SYS.ORACLE_LOADER", line 19
ORA-06512: at line 1
Please someone guide me to resolve this prob.
Thanking you,

Thanks to you all,
I had created a new file location in OWB to create
a flat file module but I dont know somewhere
i missed something while creating the new file location
that is why it was not loading data inspite of deploy successed ,
but when i put the same file to one of existing file location
and i deployed it and i got the data.
now i am exploring the existing file location for what was that
i missed during creation of new location.
Guys i am new to OWB so i dont know how to go about , if you have any
easy way to get hands on OWB, please let me know
Once again thanks everybody.

Sqlldr flat file to external table using shell scripts

Hi,
Has anyone done this before? Please give me a hand.
Thanks!

Thanks Justin.
When do I need to create the external table EMP_STAGING ?
These are my steps so far:
- shell script to crate the flat file (but I need to change the table name to EMP_STAGING)
- use a script to call sqlldr to load the flat file into the external table
- then the script will call the MERGE sql script to merge the data from the external table into the database table
Am I on the right track?
In which stage should I create and drop the external table?
Thanks!

XSL-FO unable to read special characters from the XML file

Team,
please help on issue, when trying to read the text from XML file (Special characters like bullet). It is displaying as Question mark(?) in output in place of bullet..please proved any soultion.

The "?" signals a character set mismatch issue - http://www.oracle.com/technetwork/database/globalization/nls-lang-099431.html - between client and database software

How to read specific lines from a text file using external table or any other method?

Hi,
I have a text file with delimited data, I have to pick only odd number rows and load into a table...
Ex:
row1: 1,2,2,3,3,34,4,4,4,5,5,5,,,5 ( have to load only this row)
row2:   8,9,878,78,657,575,7,5,,,7,7
Hope this is enough..
I am using Oracle 11.2.0 version...
Thanks

There are various ways to do this. I would be inclined to use SQL*Loader. That way you can load it from the client or the server and you can use a SQL*Loader sequence to preserve the row order in the text file. I would load the whole row as a varray into a staging table, then use the TABLE and MOD functions to load the individual numbers from only the odd rows. Please see the demonstration below.
SCOTT@orcl12c> HOST TYPE text_file.csv
1,2,2,3,3,34,4,4,4,5,5,5,,,5
8,9,878,78,657,575,7,5,,,7,7
101,201
102,202
SCOTT@orcl12c> HOST TYPE test.ctl
LOAD DATA
INFILE text_file.csv
INTO TABLE staging
FIELDS TERMINATED BY ','
TRAILING NULLCOLS
(whole_row VARRAY TERMINATED BY '/n' (x INTEGER EXTERNAL),
rn SEQUENCE)
SCOTT@orcl12c> CREATE TABLE staging
2    (rn         NUMBER,
3     whole_row SYS.OdciNumberList)
4 /
Table created.
SCOTT@orcl12c> HOST SQLLDR scott/tiger CONTROL=test.ctl LOG=test.log
SQL*Loader: Release 12.1.0.1.0 - Production on Tue Aug 27 13:48:37 2013
Copyright (c) 1982, 2013, Oracle and/or its affiliates. All rights reserved.
Path used:      Conventional
Commit point reached - logical record count 4
Table STAGING:
4 Rows successfully loaded.
Check the log file:
test.log
for more information about the load.
SCOTT@orcl12c> CREATE TABLE a_table
2    (rn       NUMBER,
3     data NUMBER)
4 /
Table created.
SCOTT@orcl12c> INSERT INTO a_table (rn, data)
2 SELECT s.rn,
3         t.COLUMN_VALUE data
4 FROM   staging s,
5         TABLE (s.whole_row) t
6 WHERE MOD (rn, 2) != 0
7 /
17 rows created.
SCOTT@orcl12c> SELECT * FROM a_table
2 /
        RN       DATA
         1          1
         1          2
         1          2
         1          3
         1          3
         1         34
         1          4
         1          4
         1          4
         1          5
         1          5
         1          5
         1
         1
         1          5
         3        101
         3        201
17 rows selected.

How to read Chinese Characters in iTunes?

Hi all,
Is there anyone who can enlighten me on how I can read chinese characters in iTunes? I have quite a number of Chinese songs that I wish to be played in iTunes, but I noticed that it does not read the chinese song titles and had small rectangles in place of the chinese characters.
I tried using a third-party software lke NJStar, but the chinese characters resulted were crammed together and were not legible.
Please help. Thanks.

now instead of small
little squares, there are funny symbols and letters
that don't make any sense whenever there are
supposedly chinese characters.
That probably means that the id3 tags on your songs are not encoded correctly. I understand that the program ConvertZ can help fix this.

How can Mail of OS X Mountain Lion read Chinese Characters?

Mail cannot read Chinese characters. Message looks like a series of "??????". However, Safari can read Chinese characters. What setting can make Mail read Chinese Characters?

Pippi10 wrote:
Mail cannot read Chinese characters. Message looks like a series of "??????".
Normally that indicates an encoding glitch, where the email headers are not telling Mail the right encoding to use. The first thing to try is Message > Text Encoding and see if UTF-8 or one of the various Chinese encodings give the right display.
Also go to View > Message > Raw Source and tell us what you see in the headers that say "charset= ".

Tomcat unable to read accented characters from MySQL

Folks,
Can anyone help with me this problem?
It seems that my version of Tomcat is unable to read accented characters from my MySQL Database.
I've checked in the Database and the characters are all correctly represented there. But when, in my servlet code, I do:
String author = results.getString("author_surname");If the String contains any accented character then the character shows as a '?'. (Even before it gets to the JSP - I'm writing the results straight to catalina.out).
Looking around these forums I found that some people suggested adding
?useUnicode=TRUE&characterEncoding=UTF-8;to the end of my jdbc url. As in:
<ResourceParams name="jdbc/connection">
//a whole load of other params
<parameter>
<name>url</name>
<value>jdbc:mysql://localhost:3306/bookshop?useUnicode=TRUE&characterEncoding=UTF-8</value>
</parameter>
</ResourceParams>inside my server.xml
But it doesn't seem to make any difference. In addition, I doubt I even need to use Unicode as the accents I need are only: �� etc.
(Incidentally, writing that line into my server.xml, tomcat complains that it should finish with a semi-colon. Is that correct? Even if I put in the semi-colon, it still complains!!)
Any suggestions on this would be much appreciated. Thank you.

user13109986 wrote:
HI,
From http://download.oracle.com/docs/cd/B10501_01/server.920/a96529/ch9.htm
My understanding is the JDBC Api converts the string from the database to UTF-16.. If so is there any way to disable the UTF-16 encoding at JDBC API?That's exactly what it's supposed to do. There isn't even any concept of what it would mean to disable that: Java characters are UTF-16 representations of Unicode code-points, so there isn't anything else it could do.
I still suspect the JDBC part is working correctly and your writing-to-file isn't. I found this quote in the Wikipedia article on Windows-1256:
Windows-1256 is a code page used to write Arabic (and possibly some other languages that use Arabic script, like Persian) under Microsoft Windows. This code page is not compatible with ISO 8859-6 and MacArabic encodings.So was there a particular reason you chose Cp1256 and not ISO-8859-6 as the charset to write to the file with?

Reading and loading a flat file to a table by line by line

Hi All
My requirement is like this, i receive a daily a file which are having transaction realted data,
For ex: The first row will also have the transaction num and the second and third rows will be transaction realted infomation and in the 4th record i will have new transaction num and the following rows are realted to 2nd trans num details In the flat file i able to identify which record is transn num related data, now the issue will be the following will not have the transaction num informations, blindly 2 and 3 rows are having transaction num1 info only
TRAN123
'SALE'
'450'
TRAN245
'SALE'
'123'
my output : TRAN123 is having a sale of 450 and TRAN245 is having a sale 123
For this i need to read the data from the flat file by an order only
Thanks
Ranga

Ranganathan wrote:
Hi All
My requirement is like this, i receive a daily a file which are having transaction realted data,
For ex: The first row will also have the transaction num and the second and third rows will be transaction realted infomation and in the 4th record i will have new transaction num and the following rows are realted to 2nd trans num details In the flat file i able to identify which record is transn num related data, now the issue will be the following will not have the transaction num informations, blindly 2 and 3 rows are having transaction num1 info only
TRAN123
'SALE'
'450'
TRAN245
'SALE'
'123'
my output : TRAN123 is having a sale of 450 and TRAN245 is having a sale 123
For this i need to read the data from the flat file by an order only
Thanks
RangaUTL_FILE
but consider using EXTERNAL TABLE instead

Flat file to target table map in 11G

Hi,
I am havin many problem with my 10G R1 map that have been migrated to 11G.
all that my 10G map has is mapping from flat file to stage table. It also had one constant operator. i am getting error coz of this constant that i am setting up in the map.
when i validate this constant variable i get error mess:
API8534:Validation no supported for language SQLLOADER,property Expression for SAASD_MAP
-- Generator Version : 11.1.0.7.0
-- Created Date : Mon May 11 21:16:25 CDT 2009
-- Modified Date : Mon May 11 21:16:25 CDT 2009
-- Created By : OWB_WUSER
-- Modified By : OWB_WUSER
-- Generated Object Type : SQL*Loader Control File
-- Generated Object Name : "SADAD_MAP"
-- Copyright © 2000, 2007, Oracle. All rights reserved.
OPTIONS (BINDSIZE=50000,ERRORS=50,ROWS=200,READSIZE=65536)
LOAD DATA
CHARACTERSET WE8MSWIN1252
INFILE '{{ETL_FILE_LOC.RootPath}}{{}}dgp.dat'
BADFILE '{{ETL_FILE_LOC.RootPath}}{{}}dgp.bad'
DISCARDFILE '{{ETL_FILE_LOC.RootPath}}{{}}dgp.dis'
CONCATENATE 1
INTO TABLE "STAGING"."DGP_STAGG"
APPEND
REENABLE DISABLED_CONSTRAINTS
WHEN (1:2) = 'EM'
"PHONE_COUNTRY" CONSTANT ''Asia'',
"MRI" POSITION(1:2) CHAR(2) ,
if you note 11G some how does not allow me to have constant operator in flat file maps. and the constant for PHONE_COUNTRY column is enclosed in double quotes insted of single quotes.[should be 'Asia' and not ''Asia'']
can any one tell me why this is heppening?...i also have problem with the READ BUFFER property. which in 10G used to be defulted to '4' but ignored which generating the .ctl but in 11G this property creates READ BUFFERS statement in .ctl....any help in this will be grt.
Edited by: user591315 on May 12, 2009 7:39 AM

if you note 11G some how does not allow me to have constant operator in flat file maps. and the constant for >PHONE_COUNTRY column is enclosed in double quotes insted of single quotes.Hi
Please open the same mapping in 10g R2 its same .
It use Double code around the column name.
By the way execute the mapping and then check are you getting desired result.

Extracting a flat file from oracle table

I have moved the knowledge module KIM ISO SQL to FileAppend from the Metadata to my project folder.
But when I create an interface mapping the oracle table and a flat file on a different unix server, in the drop down menu , it shows only KIM SQL TO SQL and KIM Control Append.It does not show up the SQL to FileAppend knowledge module option.
What should I do to extract a flat file from oracle table?
Thanks
Hima
Overstock.com

All IKM in the Drop Down Menu are dependent of the target technology.
A question, at this interface, is your target table a file ?

Map FLAT file to oracle table using 9.04 version - PLS HELP!!!!

Hello all
I am having a problem with mapping a flat file to oracle table. The validation is successful, when I go to Project/Deployment manager. Try to deploy the mapping itself and the target table. It said succesful, and the last step is another "Deploy", this one is fail. Saying could not locate the file (which is a flat file) , but it is there on the server.
I have read all the help on line and follow what they show me, but still not work
Any ideas? Please provide detail answer if you know it.
Thank in advance

Hallo,
just give a rights on connector
Variant 1
1. connect to user sys
2. grant read,write on directory <connector_name> to <target_schema>;
or
Variant 2
1. as user sys or system give CREATE_ANY_DIRECTORY to <target_schema>
2. manualy make CREATE DIRECTORY <connector_name> as '<full_path_to_directory>';
and enjoy :)
PS: <connector_name> you can take from script CREATE_TABLE wisch in Generation phase was created!
Kirill

Unable to read chinese characters in a flat file to external table

Similar Messages

Maybe you are looking for