Problem loading Kanji(Chinse) characters

Hi,
I am having problem in loading Kanji characters in the database (Oracle 10g).
Background
There is an application which I am working on which provides the functionality to upload spreadsheets directly into the database. For this, we are utilizing a JAVA parser which parses the file into .txt and subsequently into a .dat file and then uploads it in the database.
Problem Statement
If a spreadsheet contains Kanji chracters, it is displayed as inverted question marks when it is loaded in the database. The data is loaded via SQL Loader.
I have checked the database parameters and they are as follows:
NLS_LANG AMERICAN_AMERICA.UTF8
NLS_LANGUAGE AMERICAN
NLS_CHARACTERSET UTF8
NLS_TERRITORY AMERICA
Please help!
Thanks,
Manas

DomBrooks,
Thanks for the quick reply.
I found that there is no issue on the database side.
The NLS_LANG was not set correctly for the user id I was logging with. I set it up manually.
After that I tried to do a manual insert into the table with a Kanji value and it got inserted absolutely fine!
However, I tried the methods you mentioned and got the following results:
1. For a Kanji value 朝阳区, the DUMP function returned the values Typ=1 Len=6: 63,63,63,63,63,63 which clearly shows the ASCII value for ?. I am not sure what is meant by Typ 1. But one thing is sure that the data that is coming after parsing the spreadsheet is itself corrupted.
Now I looked into the JAVA parser. It first converts the spreadsheet into a .txt file and then by mv it renames it to a .txt.data file.
While converting to .txt file we are specifying encoding as 'UTF-8' like the example below.
Writer out = new BufferedWriter(new OutputStreamWriter(
new FileOutputStream("outfilename"), "UTF8"));
However I am not sure if converting this .txt file to a .txt.data file changes the encoding.
Another issue is that we are loading the data through SQL uploader. There we have put a TRIM function on the column which contains Kanji characters. Can this be the issue?
Thanks,
Manas

Similar Messages

  • Problem with Icelandic special characters on Mac

    Hello
    I am working on a Flash publication for students, and I want it to run on Mac as well as PC. Everything goes fine, except a problem with three special characters in my language, Icelandic. I am working on a registration and login page where I am using text boxes and text input boxes. Everything looks correct on PC, but on Mac the characters Þ Ð Ý are lost.
    I have tried different fonts etc.
    Any idea what is wrong?
    Jónas Helgason

    Hello Jónas,
    Did you ever figure this out ?
    I have a similar problem except only with two letters (both upper and lower case).  These two Icelandic letters can't be entered into a Flex TextInput box in the Flex apps I am creating when they are loaded on a Mac.  The letters are known as &Eth, &eth, &Thorn and &thorn in HTML terminology.  Typing these characters on the keyboard results in the following:  { [ ? /
    However I can copy the characters in question from some other app like TextEdit and paste them into a TextInput box in my Flex app and all is well, they show up correctly.
    This happens regardless of the Mac browser used and the Flash plugin version used (have tried both 9 and 10) and also happens in the standalone Flash Player application.
    Does anyone have any idea how to fix this or is this a bug in Flash Player ?  This is really annoying as it makes text input into Flex apps on Icelandic Macs very difficult.
    There must be something wrong with the mapping of keyboard key codes into character codes on the Mac that is causing this.
    Btw, I just heard from a friend that this problem does not exist in MacOS 10.6.  I am running 10.4 and have tested this on 10.5 and it exists on both of those OS versions.
    Rgds,
    Hordur Thordarson
    Lausn hugbunadur
    http://lausn.is

  • Problem loading XML-file using SQL*Loader

    Hello,
    I'm using 9.2 and tryin to load a XML-file using SQL*Loader.
    Loader control-file:
    LOAD DATA
    INFILE *
    INTO TABLE BATCH_TABLE TRUNCATE
    FIELDS TERMINATED BY ','
    FILENAME char(255),
    XML_DATA LOBFILE (FILENAME) TERMINATED BY EOF
    BEGINDATA
    data.xml
    The BATCH_TABLE is created as:
    CREATE TABLE BATCH_TABLE (
    FILENAME VARCHAR2 (50),
    XML_DATA SYS.XMLTYPE ) ;
    And the data.xml contains the following lines:
    <?xml version="2.0" encoding="UTF-8"?>
    <!DOCTYPE databatch SYSTEM "databatch.dtd">
    <batch>
    <record>
    <data>
    <type>10</type>
    </data>
    </record>
    <record>
    <data>
    <type>20</type>
    </data>
    </record>
    </batch>
    However, the sqlldr gives me an error:
    Record 1: Rejected - Error on table BATCH_TABLE, column XML_DATA.
    ORA-21700: object does not exist or is marked for delete
    ORA-06512: at "SYS.XMLTYPE", line 0
    ORA-06512: at line 1
    If I remove the first two lines
    "<?xml version="2.0" encoding="UTF-8"?>"
    and
    "<!DOCTYPE databatch SYSTEM "databatch.dtd">"
    from data.xml everything works, and the contentents of data.xml are loaded into the table.
    Any idea what I'm missing here? Likely the problem is with special characters.
    Thanks in advance,

    I'm able to load your file just by removing the second line <!DOCTYPE databatch SYSTEM "databatch.dtd">. I dont have your dtd file, so skipped that line. Can you check if it's problem with ur DTD?

  • Problem loading material master (IS Mill) data from ECC to BI

    Hi Gurus,
    We have a problem loading Material master data from ECC to BI 7.0 SP 18.
    The scenario is :
    The ECC is with IS Mill... due to which the Material field MATNR is of length 40 instead of standard 18 characters.
    That is data element MATNR has 18 chars and its output length is 40 chars.
    When is table MARA browsed using SE16, the material with more than 18 chars.... shows only first 18 characters and are ended with !.
    OMSL setting shows length as 40.
    When the extractor checker runs 0MATERIAL_TEXT or 0MATERIAL_ATTR it gives correct output ..... which is more than 18 characters... not ended with !
    Till here no problem.
    On BI side, after replication of the datasource, i checked data element MATNR ... but it has length as 18 chars and output length as 18 chars.
    OMSL setting cannot be set more than 18.
    Infopackage has pulled data till PSA successfully. I checked the PSA data .... here to the material with more than 18 chars is ended with !.
    When the data is further pushed to 0MATERIAL infoobject, it throws following error for all materials irrespetive of its length (example below):
    0MATERIAL : Data record 768 ('SIT_PL_B01L_10_01!E '): Version 'SIT_PL_B01L_10_01! ' is not valid
    0MATERIAL : Data record 165 ('RLIRS52 E '): Version 'RLIRS52 ' is not valid
    Diagnosis
         Data record 768 & with the key 'SIT_PL_B01L_10_01!E &' is invalid in value 'SIT_PL_B01L_10_01! &' of the attribute/characteristic 0MATERIAL.
    System Response
         The system has recognized that the value mentioned above is invalid, and has processed this general error message. A subsequent message may give  you more information on the error. This message refers to the same value, even though it does not state this explicitly.
    I did search for SAP note related to this... but could not find any.
    There is one SAP note (Note 960868) which mentions about this, but the correction was then shipped with BI SP 9.... we are running on SP 18.
    Requesting you all experts for help.
    Best Regards,
    Deepak

    Hi,
    follow bellow steps:
    1. you need to activate the Datasouce in BI side.
    Goto RSA1>  Datasource> Select Datasource> Double click> Check fileds and Activate.
    2. Replicate the Datasource into BI side.
    3. Check the RFC connections by useing SM59.
    Regards.

  • Problem – loading HTMLtext from a text file

    Problem – loading HTMLtext from a text file
    Hi, I have a dynamic text set up to render text as HTML and I
    am loading the text into the text object by using the code below.
    var loadText:LoadVars = new LoadVars();
    loadText.load("Nyheter.txt");
    loadText.onLoad = function(success){
    if(success){
    Nyheter_txt.htmlText = this.VariabelTekst;
    The textfile looks like:
    VariabelTekst=<p align
    ="Right">(13.11.2006)</p><p><b><font
    size="12">This is the tittle</b></p><p>Here
    comes the text</p>
    It works almost fine but the first problem is that the
    paragraph text in the textfile should be written in Norwegian. This
    involves some Nordic characters. By default these characters are
    just shown as small square in the text control when running the
    flash file. If I try to enter these characters in the textbox
    “Include these characters” within the dialog for
    embedding, the text within the bold tag of the text file is not
    shown when the text is rendered. It looks as if it effect the HTML
    rendering of the text. The Nordic characters are still not showing
    but instead the small square placeholders for the characters are
    gone.
    Am I doing it wrong, or is there a work around for solving
    this problem?
    Any ideas?
    TIRislaa

    Problem – loading HTMLtext from a text file
    Hi, I have a dynamic text set up to render text as HTML and I
    am loading the text into the text object by using the code below.
    var loadText:LoadVars = new LoadVars();
    loadText.load("Nyheter.txt");
    loadText.onLoad = function(success){
    if(success){
    Nyheter_txt.htmlText = this.VariabelTekst;
    The textfile looks like:
    VariabelTekst=<p align
    ="Right">(13.11.2006)</p><p><b><font
    size="12">This is the tittle</b></p><p>Here
    comes the text</p>
    It works almost fine but the first problem is that the
    paragraph text in the textfile should be written in Norwegian. This
    involves some Nordic characters. By default these characters are
    just shown as small square in the text control when running the
    flash file. If I try to enter these characters in the textbox
    “Include these characters” within the dialog for
    embedding, the text within the bold tag of the text file is not
    shown when the text is rendered. It looks as if it effect the HTML
    rendering of the text. The Nordic characters are still not showing
    but instead the small square placeholders for the characters are
    gone.
    Am I doing it wrong, or is there a work around for solving
    this problem?
    Any ideas?
    TIRislaa

  • When I try to open contacts from the icloud control panel on my windows 7 PC, I get an error message: can't load contacts. There was a problem loading the application.

    When I try to open contacts from the icloud control panel on my windows 7 PC, I get an error message: can't load contacts. There was a problem loading the application.

  • Cannot directly open the browser from the icon. "problem loading webpage" and "timed out" are the messages. Access was accomplished by using yahoo messenger and opening my email. if I attempt to open a new page, I recieve the aforementioned warnings.

    no link to open access to the internet. I used Yahoo Messenger, clicked on the 'mail icon' and since Firefox is my default it opened and I was able to continue from there. If I try to click File, open New Page, I get the "problem loading webpage" and "connection timed out" messages

    changed my homepage to Yahoo. Now Firrefox works but still cannot access ANYTHING 'Google"!

  • I get problem loading page (error 404) it says the page cannot be found when i try to access the game Mobsters through my mysapce account and i cannot access it no longer through firefox and i want to find out why i cant, can you guys please help?

    i cant access my mobsters account through myspace. every time i try to access it i get "problem loading page" "this page cannot be found" "404 error" and it wont let me access it. myspace works fine but as soon as i click on the mobsters app i get the 404 error, this page cannot be found, problem loading page! can you please help?
    == This happened ==
    Every time Firefox opened
    == i try to access mobsters game through myspace

    I dont understand the answer
    '''''""The problem can be solved by opening FF and choosing Tools...Add On's...select the SEARCH addon and choose UNINSTALL...restart FF browser when asked, then reload Mobsters. This worked for me. The suggestion on the 404 that says to remove Search via Add/Remove Programs is completely BS, as Search doesnt show there. ""'''''

  • A lot of tabs loads and tells me there was a problem loading the page. How can I stop all the tabs loading because ist slows down Firefox.

    When I open Firefox, a lot of tabs try to open at the same time. They all say Problem loading the page. It happened after I tried to download a owners manual for Harley Davidson motor cycles. How can I stop all but one tab from opening.

    This can be a problem with the file [http://kb.mozillazine.org/sessionstore.js sessionstore.js] and sessionstore.bak in the [http://kb.mozillazine.org/Profile_folder_-_Firefox Profile Folder]
    Delete [http://kb.mozillazine.org/sessionstore.js sessionstore.js] and sessionstore.bak in the [http://kb.mozillazine.org/Profile_folder_-_Firefox Profile Folder]
    If you see files sessionstore-##.js with a number in the left part of the name like sessionstore-1.js then delete those as well.
    See:
    * http://kb.mozillazine.org/Session_Restore

  • Problem loading Query Designer Add-in

    Hi All,
    Can anyone please help me on my below issue.
    Whenever user is trying to start a new query in Essbase , he is getting below error message. It will not allow user to build a fresh Essbase pull
    Problem loading Query Designer Add-in. Workbook Activate,open & close operations may not be fully propogated
    Thanks in advance.
    Regards
    Vishal

    Hi Vishal,
    1) Try to remove the addin and then add again.(Before doing this close all the excel process from the task Manager)
    2) Check weather essexcln.xll and essxleqd.xla are corrupted.

  • Problem loading data into write optimized dso.....

    Hi ,
    I am having problem loading the data from PSA to write optimised DSO
    I have changed the normal DSO into a Write Optimised DSO. I have 2 data sources to be loaded into the write optimized DSO. One for Demand and one for Inventory.
    The loading of Demand data from PSA to DSO happens fine with out any error.
    Now while loading the Inventory data from PSA to DSO , i get the below errors
    "Data Structures were changed. Start Transaction before hand"
    Execption CX_RS_FAILED Logged
    I have tried reactivating the DSO, Transformation, DTP and tried to load the data again to the write optimised DSO, but no luck, I get the above error message always.
    Can some one please suggest me what could be done to avoid the above error messages and load the data successfully.
    Thanks in advance.

    Hi,
    Check the transformations is there any routines written.
    Check your Data struture of cube and DS as well.
    Is there any changes in structure.
    Data will load upto PSA normally, if is there any changes in struture of DSO, then the error may occur.just check it.
    Check the below blog:
    /people/martin.mouilpadeti/blog/2007/08/24/sap-netweaver-70-bi-new-datastore-write-optimized-dso
    Let us know status.........
    Reg
    Pra

  • TS3212 Is anyone else having problems loading the newest version of iTunes (10.6.3) on Windows?

    Is anyone having problems loading the newest version of iTunes (10.6.3) using Windows Vista? My current iTunes program version 10.6.1 keeps telling me there is an update but when I try to load it the information box goes away and nothing happens.  I have tried downloading the new version from Apple web site but it brings up a warning screen of " iTunes setup.exe is not commonly downloaded and could harm your computer." I select the action of run anyway and get the next error "iTunes Setup.exe is not a valid Win32 application."  What Gives?

    I select the action of run anyway and get the next error "iTunes Setup.exe is not a valid Win32 application."
    In the course of your troubleshooting to date have you worked through the following document?
    iTunes: Windows reports that "iTunesSetup.exe is not a valid Win32 application"

  • . I am new to IPods. I have a Classic 160GB and I can't figure out how to load my music videos to it. I have had no problem loading my music CD's but no go with the music videos I have. Please HELP. Thanks maxsdad

    Hello:
    I am new to IPods. I have a Classic 160GB and I can't figure out how to load Music Videos to iTunes or the IPod. I have had no problem loading my CD's to iTunes and to the IPod, but no go on the Music Videos.
    Please Help
    maxsdad

    B-Rock:
    Ok. Here's the results. I tried all the music videos I wanted to put onto the IPod and the results were:
    I was able to get good results with 2 full length music videos and 2 video singles(only 2 videos on each disk). For a total of 4 videos.
    I was able to encode 5 full length music videos, but the results were distorted (video and audio).
    I was unable to copy 2 full length videos due to error failures. 1 was a "No Title Found" error, the other was a "NAVDAT" error.
    I guess my next question is: Do you know of any other program(s) that I might try, to see if I can get good results with the videos that didn't work with Handbrake?
    Thanks again for all your help.
    maxsdad

  • Loading Non-English Characters using VBA and BAPI

    Hi Experts,
    I am trying to load Non-English characters (Chinese, Korean, Japanese, etc.) into a SAP Table using BAPI and VBA. I have set the connection language and codepage values but when I run the tool, the non-English characters display as ????? or #####. Do you know how to fix this issue?
    Thanks!

    If your language is a unicode tehn you need to change the options  like IN SAP you need to change it to unicode  in the initial screen Customize local layout(ALT F12) options 118  --> Encoding ....

  • "Problem with Trial - problem loading trial period for Adobe Photoshop CS3"

    Hello,
    I installed Photoshop CS3 Trial and whenever I run it and choose to begin my trial period I get the following error message:
    "Problem with Trial - problem loading trial period for Adobe Photoshop CS3".
    I tried uninstalling and reinstalling, and even ran the Adobe CS3Clean Script but nothing seems to help.
    I should note I never installed any earlier version of Photoshop on my system (I use a fresh copy of Windows XP with only a few programs installed).
    Any suggestions will be appreciated.
    Thanks,
    David

    i had the trial of photoshop on and the trial has run out my friend has given me a disk with adobe photoshop on and i cant do it beacause of the regestry code the photoshop puts in after the trial has ended to tell my pc that i cant have photoshop on my computer again :(:( now i have herd that you can remove the codes but it is quite hard well iam willing for this challenge and if anyone could help me i would reall welcome your help or if anybody has got the link to a tutorial to tell me hoe to do it i would aprecitae that to thank you all very much and post bak soon please

Maybe you are looking for

  • 9.2.0.6 runInstaller cannot write into its own installation directory

    I would like to install the 9.2.0.6 patchset on a freshly installed 9.2.0.4_linux_x86_64 (AMD). The system is RedHat EL AS 3. I have installed j2re1.4.2_07 (because the Java brought by Oracle does not even start the VM ...) and edited the ./install/o

  • Calling GUI Scripting from ABAP program

    Is it possible to call GUI Scripting from ABAP and thus to use GUI Scripting as an alternative to CALL TRANSACTION? Is the class CL_JAVA_SCRIPT suitable to access GUI Scripting engine? Accessing ABAP data object would work as well in this case as i t

  • Compile JSP in Oracle BPM 10g

    Hi Everyone, Could you let me know how to compile jsp using Oracle BPM 10gR3 studio. Thanks in adavance...

  • Unable to completely restore an iCloud backup on iOS 7.02

    I have upgraded to iOS 7 and have 2 backups of my iPhone under this iOS. Having problems in calendar, Safari and Setup applications, I decided to restore from an iCloud backup. I could never complete the restore. It hangs after 1h30 restoring (80%).

  • Picture of the day (Thread)

    Please share your pictures of the day! You can share as much as you like. You can share your music as pictures, your trip, your bike etc. For great start, my picture is here! Houkkalammi lake in Lempäälä, Finland. 16.11.2014.