SQLLOAD with various Charactersets

Hello,
I am working on an Oracle EBS project (version 11i) with Oracle DB 11G hosted on Oracle Linux.
Character set is UTF8 on the database since we have some Polish users.
Our ERP is logically interfaced with many systems from which we receive ASCII datafiles that we need to upload in our DB using SQLLOAD utility.
The problem we have is that depending on the sending system, the characterset of a datafile can vary among following values :
- EE8MSWIN1250 => files sent by our Polish Subsidiary
- WE8MSWIN1252 => files sent by WINDOWS systems
- WE8ISO8859P1 => files sent by some Unix Systems
We have developped a specific Linux shell that submits SQLLOAD for datafiles with the appropriate control file "CHARACTERSET" option.
The problem is that until now I was not able to detect precisely the character set of a given datafile.
- the Linux command "file -i" returns "text/plain; charset=iso-8859-1" even for a windows file encoded with WINDOWS-1252 or WINDOWS-1250
- I also tried the linux command iconv to convert the file to UTF8 but this command is successfull whatever the "from" characterset we specify (ISO-8859-1 / WINDOWS-1252 / WINDOWS-1250)
My Question :
How can I determine precisely the characterset of a given ASCII datafile in order to set correctly the CHARACTERSET option of SQLLOAD control file ?
(in batch mode on Linux)
Browsers as IE, Chrome or Firefox are able to do that (detect the character set of a web page to display it correctly) so I suppose that a tool or command should exist for that purpose.
Thanks in advance for helping and sharing experience.
Karim Helali
Toshiba France

Thank you Sergiusz : the lcsscan tools gives quite good results and it may be a solution for us.
The only issue is that lcsscan is only available on last oracle DB releases (10 and 11 ).
Although our database server is on release 11G, the EBS applications server is on oracle 8i due to Oracle Forms restrictions.
As the SQLLOAD is run from the applications server, I have to run the lcsscan tool by SSH on the DB server
So I let the question open a few days again in case someone knows a Linux command or tool that does the same control as lcsscan
Note: We are also considering the other solution you mention eg to assign to each sending system an agreed characterset .
Thank you again and best regards
Karim Helali

Similar Messages

I have an apple iphone 4gs... It is synced with my outlook exchange in the office. If I do a search for emails that also checks the server then all of a sudden I end up with various amounts unread email with the inbox saying "Inbox 71" ..which is not true

I have an apple iphone 4gs... It is synced with my outlook exchange in the office. If I do a search for emails that also checks the server then all of a sudden I end up with various amounts unread email with the inbox saying "Inbox 71" ..which is not true. The only way to make the inbox on the iphone back to 0 is to delete the account then re install it.
Anyone have any ideas

We need to know more about your system, please download EtreCheck and run the report and please post it on your next reply. Then we can see how your system is configured, what apps are on it and look for anything obvious. We will look forward to seeing your report.

I am getting a "connection timeout" message when trying to access my Airport Extreme with various laptops, Play Station 3 and Wii. My Airport Extreme is about a month old; it was working fine until about a week ago. C

I am getting a "connection timeout" message when trying to access my Airport Extreme with various laptops, Play Station 3 and Wii. My Airport Extreme is about a month old; it was working fine until about a week ago. Suddenly, the "timeout" is not allowing me to connect to my wireless network.

It could be that there's a new source of interference.
Use the advice in the second message of this thread to investigate the signal and noise levels that each client sees:
http://discussions.apple.com/thread.jspa?threadID=2347845&start=1
By the way, you've been misled by the poor field labeling into trying to type your entire message into the subject field, instead of putting a one-line topic description there.

Regarding BB Messenger, I have used it with various cont...

Regarding BB Messenger, I have used it with various contacts in the past. Now, I am trying to connect with (removed personal information) and I can't accept her request to add and she accepts my request, I don't appear in her contact list. She's still listed in my "Pending." We've been going back and forth for a week! Please help!!! I've gone to the forums and all that first, but nothing's worked! Thanks!!!
Message Edited by thundergeek on 07-29-2009 04:00 PM

The backup will overwrite your existing backup (although Apple states that it will retain your last 3 backups, space permitting). As a result, if you delete photos from your phone and continue backing up, the backup containing the deleted photos will be overwritten by one that doesn't, and they will be lost.
To keep them permanently, either add them to a shared stream and invite yourself as a subscriber, or better yet, import them to your computer from the camer roll as explained here: http://support.apple.com/kb/HT4083.

1) I have multiple accounts at the iTunes store and none are now associated with my purchases...I think because passwords have been associated with various id's and I can't log in and access those purchases. I want to get back to being able to use one i

1) I have multiple accounts at the iTunes store and none are now associated with my purchases...I think because passwords have been associated with various id’s and I can’t log in and access those purchases. I want to get back to being able to use one id and password and be able to access those purchases.
2) When I upgraded my iPhone 3gs, to the latest version 5.0.1 (9A405), is when I noticed that i couldn’t update my applications. There are two names/accounts on the phone and prior to the update there was just the one. I have tried entering every conceivable password that I have ever used and get the incorrect password error every time. The apps on the iPhone are apparently associated with several/different accounts. I just want to get everything back to the way it was. One id and one password with purchases associated with just one account that can be updated on my computer as well as my iPhone.

Hello sadiepix,
The following article details several things that can be done to quell iTunes' constant need for authorization.
iTunes repeatedly prompts to authorize computer to play iTunes Store purchases
http://support.apple.com/kb/TS1389
Cheers,
Allen

How can I download itunes when I get the following errors...have installed and uninstalled a dozen times with various fixes...b noir for example and used Revo to clean up..ituneshelper did not install correctly error 7

How can I download itunes when I get the following errors ..ituneshelper did not install correctly error 7..I .have installed and uninstalled a dozen times with various fixes...b noir for example and used Revo to clean up.
This has been a problem for 6 weeks now, I retry when I have time and patience and use my other laptop which is also Windows 7 and runs with no problem.
Every attempt fails when all seems fine on the desktop and I try to log on to Itunes I get the errors.
Any help greatly appreciated.
billymac

Go to Control Panel > Add or Remove Programs (Win XP) or Programs and Features(Later)
Remove all of these items in the following order:
iTunes
Apple Software Update
Apple Mobile Device Support (If this won't uninstall press on)
Bonjour
Apple Application Support
Reboot, download iTunes, then reinstall, either using an account with administrative rights, or right-clicking the downloaded installer and selecting Run as Administrator.
See also HT1925: Removing and Reinstalling iTunes for Windows XP or HT1923: Removing and reinstalling iTunes for Windows Vista, Windows 7, or Windows 8
Should you get the error iTunes.exe - Entry Point Not Found after the above reinstall then copy QTMovieWin.dll from:
C:\Program Files (x86)\Common Files\Apple\Apple Application Support
and paste into:
C:\Program Files (x86)\iTunes
The above paths would be for a 64-bit machine. Hopefully the same fix with the " (x86)" omitted would work on 32-bit systems with the same error.
tt2

PDF printing with UTF8 characterset

Hi,
Stats:
E-BIZ version :- 11.5.10.2
DB:- 10.2.0.3
Report BUilder :- 6i
Character Set :- UTF8.
I have some doubt while viewing/printing pdf reports from Oralce Application. Can you please suggest if it is possible to print pdf's from oracle apps with UTF8 characterset and without having 3rd party software to convert pdf report to postscript and a printer that can understand postscript. We do have PASTA and IX configured in our enviornment.Reports created are in BI/XML publisher.
Actually we have one 3rd party tool for printing and wanted to get rid of it due to financial constraints. Can you please suggest if it is possible to print pdf's from oracle apps without having 3rd party tool. I have read lot of document and completely lost. Oracle some where says it is possible and at other place says 'If you are on UTF8 chacterset then you need to have XML/BI publisher with PASTA and 3rd party software' but in my enviornment we have some pdf reports that are bypassing 3rd party software for printing. I am just lost.
Any help would be appreciated
Thanks,
JD

Hi,
This line confuses me, do i require 3rd party software to print from oracle apps if my characterset is UTF8(althoug i am using XML publisher), I believe yes -- See (Note: 422508.1 - About Oracle XML Publisher Release 5.6.3), Step 8 Enable PDF Printing in Oracle Applications. (System Administrator)
Workaround section says
6. From Oracle Applications via the Adobe Acrobat Reader, a PDF output file can be viewed and
printed.>>>> NO i not want to use it.This is a workaround to print PDF directly from the application. If you do not want to use this approach, use the other one mentioned above.
7.Although, it may be possible to create a custom print driver or print program using the Adobe
Acrobat Distiller, viable instructions on how to perform such a custom setup is very scarce, see
Note 262657.1--intended for Latin 1 character set environments.>>>> I am on UTF8
I would not recommend this approach as this may (or may not) work.
8. Use Pasta, an Oracle post printing program, to change a copy of the report output file to the
desired or printable output format.>>>>>> I have PASTA but does that mean i can print all my pdf reports using it. Don't i need 3rd party tool now.See (Note: 239196.1 - PASTA 3.0 Release Information).
9. Lastly, use another format like Postscript, that is fully supported for viewing and printing>>>>> How to use it? Can anyone please explain.Change the output of the concurrent program to Postscript (Concurrent > Program > Define), and you can view the output using Ghost Viewer.
Note: 117112.1 - How to read Postscript File Formats on a MS Windows Operating System and Convert To Another File Format
Thanks,
Hussein

Problem finding docs using content index in DB with different charactersets

Sorry for duplicating thread from [url http://forums.oracle.com/forums/thread.jspa?threadID=653067&tstart=0]this thread in Oracle Text forum, but it seems quite slow compared to this one, so probably someone has some suggestion.
Problem explanation:
DB version 10.2.0.1 SE on windows
database characterset AL32UTF8
I am creating following context index:
create index myindex on g(Content)
indextype is ctxsys.context
parameters('filter ctxsys.auto_filter
section group ctxsys.null_SECTION_GROUP');With following query:
SELECT distinct filename FROM g f
WHERE contains(F.Content, 'latiinju') >0;I can find latin symbols in ansi, utf-8 encoded text documents and msword and msexcel documents.
With following query:
SELECT distinct filename FROM g f
WHERE contains(F.Content, 'latviešu') >0;I can find latvian symbols in utf-8 encoded text documents and msword and msexcel documents, which basically is OK.
However there is another unfortunately already production database
10.2.0.3.0 SE on windows
with characterset BLT8CP921
and with index as defined above queries find absolutely nothing for both latin and latvian texts.
As soon as I've added another column "cset" in the table and filled it up with AL32UTF8 I can find latin characters for the same cases as in db above.
Index in this case is as follows:
create index myindex on g(Content)
indextype is ctxsys.context
parameters('filter ctxsys.auto_filter
section group ctxsys.null_SECTION_GROUP
charset column cset');However the problem is that for latvian characters it can find only UTF-8 encoded text files, but not doc and xls files and that's absolutely not OK.
I've tried also another charactersets in cset columns, but without any success.
So the question is - is there any possibility somehow to create the content index that it is possible to find also latvian specific symbols in doc and xls files in DB with characterset BLT8CP921?
Of course the ultimate solution would be to recreate db with AL32UTF8 characterset but I'd like to avoid that if possible.
TIA
Gints Plivna

I have applied performance tuning steps, like JAVA_POOL_SIZE, SGA_MAX_SIZE, increase table spaces size and change some other DB parameters. After applied, problematic index has been created without error and application is running fine without any error. Many thanks for your prompt suggestion, by which I could narrow down my problem. So, as my problem has been resolved, so please close this thread.
Regards,
Farhan Mazhar

Balances of sevaral profit centers with various currencies in same report?

Experts,
Is there any report where we can see Profit Center wise and Currency Wise balances as of any mid period (Say Fortnightly) but in the same report?
i.e; Balances of sevaral profit centers with various currencies in the same report.
- Nilesh

Nilesh,
You can refer to drill down reports in Profit center accounting :-
http://help.sap.com/saphelp_46c/helpdata/en/cc/36428094f311d2b47a006094b9b0a5/content.htm
Thanks
Nishan D

Multiple oracle database instances with different characterset on the same server

Hello,
Is it possible to have 2 database instances running with different charactersets,one with AL32UTF8 and the other with WE8MSWIN1252.?
Are there any setup requirements to be performed prior to setting up the database instances?
The 3rd party utility that we want to use does not support AL32UTF8 and insists on using a database with character set WE8MSWIN1252.
Kindly help.
Thanks,
Ram.

Hello Zhe,
I guess I posted my question in a wrong forum. I tried my best to find a suitable forum and thought this was the best and closest I found. Apparently not. Can you please let me know the right forum for my question?
The below is the breif of what we are currently facing:
We are in the process of finalizing plans to install Automic for our Retail applications to schedule jobs. In the process came to know that Automic does not support AL32UTF8.
Right now we have RMS and UC4 (now called Automic) run on the database server as UC4 supports AL32UTF8 and schema for UC4 is inside the RMS database.
Going forward it is recommended to have a separate database instance on the same server as that of RMS database and with a different characterset which is WE8MSWIN1252.
Please let me know what forum to post in, I will repost the question.
Thanks,
Ram.

File with various field lengths non - fixed cardinalities problem

Hallo all,
we have the following problem.
we implemented a scenario as sown in this blog
/people/venkat.donela/blog/2005/06/08/how-to-send-a-flat-file-with-various-field-lengths-and-variable-substructures-to-xi-30
but there is a problem.
If the file structure is declared as :
Header,1,Items,*
then the adapter does not even read the file from the directory (so I assume that for some reason the file structure is not as expected).
If on the other had the structured is declared as :
Header,1,Items,3
everything works.
Obviously though, this is not satisfying since we need variable cardinalities.
Any suggestions and help is appreciated
Thank you .

Well, I will write the main tests we tried, in case that the situation could be cleared :
I have a specific file in a standard directory, called xi_input. The file is edited straight into that directory, so there can't be filename errors etc.
If the file is left empty :
Nothing happens . No message of any kind in sxmb_moni/monitoring xml messages .
If the file contains the following (data is random) , where 'H' is the key for the header and 'I' is the key for the items :
H     20060403     16     3     316001     kapou     lalla     morellala     20060403     F3     23
I     277101010     2
I     277101011     3
I     277101012     4
There are to cases :
if the file structure is declared as :
Header,1,Items,*
Then nothing happens .
If on the other had the structured is declared as :
Header,1,Items,3
everything works .
I guess there is now a more clear picture of the problem.
As for whether the file adapter does care about the file contents or not, I think that if the Message Protocol is "Message Content Conversion", then it does check the structure.

Problem with various programs freezing/not working

I'm not sure if it's a problem with the computer itself or with the software, but perhaps someone on here can help me.
For about a week now I've been having problems with various programs on my iMac. These programs include iTunes, Force Quit, Shut Down, Safari, Finder, and certain functions on the keyboard.
The problems I've been having revolve around the programs freezing up when you either first try to operate them or after opening the programs and trying to click on things within the program itself.
A good example: I haven't been able to use iTunes past the point of opening it up. Once I try to play a song, it freezes up and the rainbow wheel comes up and just keeps on spinning for eternity, or until I manually reboot the computer via the power button.
The volume controls on the keyboard don't work at all. When I first boot up the computer, I can press a volume button and the symbol will appear on the screen, but the level won't move up or down and if you press it again after that disappears then it doesn't reappear.
Force Quit and other applications tend to stay on the screen after you click the quit button or other end/cancel button and won't go away until iMac is rebooted manually by button on back.
Safari gets stuck on occasion depending on which site I go to. It happened once when I went to MySpace.com, but only cos of one of the flash sites they were advertising. I went to the same site an hour later and it was fine since it was advertising something else. I have a job site I can't access because when I click on the 'jobs' link to look for a job, it gets 3/4 of the way through the upload and freezes.
And right now I can't tell you which model I have since I can't access the 'About This Mac' info, other than to tell you it's the 20" with 320 GB with Leopard software, Mac OS X v10.5. It gets regular updates.
So... if there's anyone who could help me, I would greatly appreciate it.
Please note, I don't have Apple Care since I can't afford it yet, and I just bought my computer in October 2007. Thanks!

Start with http://www.thexlab.com/faqs/multipleappsquit.html

Just got a new Airport Express to replace an old ond that dropped off a lot. Works great with various Apple and Androids but Win 8 computer sees the network but can't connect.

Just got a new Airport Express to replace an old one that dropped off all the time. The new one works with various Apple and Android devices but will not connect to Wen 8 computer. The computer sees the network but can't connect.

Hello lucky3480;
I don't know what else to do. I'm thinking of possibly returning the unit and purchasing a wireless internet card to install in the tower. Any help you can provide would be great. Even suggesting a good wireless card at this point
Well it looks like you're not having any luck at all with this AX set up but please don't give on it just yet, it's a good choice for extending your Network. Your on the right path, just going backwards and in the wrong direction. You'll learn a lot about stuff this way but may lead to other issues.
Before I continue, let me know if you have returned the AX or still need help. Here's a link to Apple's PDF about [Designing AirPort Networks|http://manuals.info.apple.com/enUS/Designing_AirPort_Networks10.5-Windows.pdf] Click on it to open in Safari but then save it to your desktop. Now open it from your desktop and start reading Chapter 3, page 42.
Later...
Buzz

HT4898 What happens to my "Dock"? I use that every time I open my computer(s), along with various mail accounts, and even the Widgets?.

What happens to my "Dock"? I use that every time I open my computer(s), along with various mail accounts, and even the Widgets?. Thanks.

Using iCloud will not affect your dock or your widgets. If you upgrade to iCloud, your MobileMe mail account will be updated to an iCloud account, but that is all that will happen. What exactly is it that you are worried about.

TAGS with various formats

Happy Holdays folks,,
TAGS with various formats...
I have some CD's to digitize. I am curious of the best way to do this...
For me I am thinking that I will create 256 Stereo AAC files for IOS, but also then create .aif files to store for desktop players etc.
I didn't know that .aif's can store tag info....
It seems that .aif files can store the TAG info that come in through iTunes - but where is the info stored:
1 - right on the .aif file?
2 - just in iTunes database?
3 - just Spotlight?
4 - or ?????
If I copy the file to another hard drive on another computer - will it retain the tag info with aif?
I seems that when I try that save tag info with .wav format - that it doesn't store it - is that true?
I am curious to find out about tags with .aif - .wav etc.....

revDAVE wrote:
Happy Holdays folks,,
TAGS with various formats...
I have some CD's to digitize. I am curious of the best way to do this...
For me I am thinking that I will create 256 Stereo AAC files for IOS, but also then create .aif files to store for desktop players etc.
RIP them as AIFF (or ALAC).
For syncing to iDevice, just use the option to convert to 128, 192, 256 AAC when you sync them. No need to RIP them as 256 and have multiple copies of same song in different formats.

SQLLOAD with various Charactersets

Similar Messages

Maybe you are looking for