Moving from US7ASCII to UTF8

We are using "standard installed" database. The language only used is (US) english. We are going to add texts in different languages to the database scheme. It means that in some table we want to keep a column that is able to store text in different languages. The answer is UTF8. My questions are follow:
* How i migrate my database to UTF8 character set ?
* Can i leave it as it is and use NVARCHAR2 with UTF8 character set for multilanguage columns ?
* What is happening to search indices ? Do i have to build special indices for tables with NVARCHAR2 columns in UTF8 if i want to search by the column or it works like ordinal string search index ?
* How i store or read data on client/front end ? In what format must data come to Oracle database ? I am talking about Windows WIDE CHAR format mostly.
Thank you.

Dear Sir
I am glad to see that you sincerely wanted to help me. But to make your help efficient it is very desirable to read a question first! I asked about US7ASCII to UTF8 migration and not anything else. As well the rest of questions were also very important and related to the subject. Therefore i will be glad to accept any help, also yours, in the case it will relate to the subject of the question.
Thank you for your time.
P.S. Would you be so kind and left your attributes in place of BT unregistered.
BT is a name of cigaretts

Similar Messages

Problem in Database convertion from US7ASCII to UTF8

Hi,
We are facing the following problem while converting the database from US7ASCII to UTF8:
We have recently changed the database character set from US7ASCII to UTF8 for the internationalization
purpose. We ran the Character set scanner utility and it did report that some data may pose problems.
We followed the the below mentioned process to convert into UTF8 -
1) alter database character set utf8
2) alter database national character set utf8.
Now we find some problem while working with the old data in our application which is java based.
We are getting the following error "java.sql.SQLException: Fail to convert between UTF8 and UCS2: failUTF8Conv".
We further analyzed our data and found some interesting things :
e.g.
DB - UTF8.
NL_LANG also set to UTF8.
Select name from t1 where name like 'Gen%';
NAME
Genhve
But when we find out the length of the same data it show like this
NAME LENGTH(NAME) VSIZE(NAME)
Genhve 4 6
The question is why is it showing length as 4 only and when we try to use a substr function
its extracting like the following :-
select name,substr(name,4,1) from t1 where name like 'Gen%';
NAME SUB
Genhve hve
We have execute the above queries on US7ASCII DB and it is working fine, length it shows 6
and using SUBSTR it extracts just 'h' as well.
We also used dump function on the UTF8 Db for the above query,,this is the result :-
select name,length(name),vsize(name),dump(name) from t1 where name like 'Gen%';
NAME LENGTH(NAME) VSIZE(NAME) DUMP(NAME)
Genhve 4 6 Typ=1 Len=6: 71,101,110,232,118,101
We checked a lot with the data and it seems 'h' (accented e) is posing the problem.
We want to know where is the problem and how to overcome this.
Further, we tried all of the following :
1)
Export Server: US7ASCII
Export Client: did not set NLS_LANG / NLS_CHAR, so presumably US7ASCII as well
Import Client: did not set NLS_LANG / NLS_CHAR, so presumably US7ASCII as well
Import Server: UTF8
RESULT: Acute e became h
2)
Export Server: US7ASCII
Export Client: did not set NLS_LANG / NLS_CHAR, so presumably US7ASCII as well
Import Client: NLS_LANG=AMERICAN_AMERICA.UTF8 and NLS_CHAR=UTF8
Import Server: UTF8
RESULT: IMP 00016 error
3)
Export Server: US7ASCII
Export Client: NLS_LANG=AMERICAN_AMERICA.UTF8 and NLS_CHAR=UTF8
Import Client: did not set NLS_LANG / NLS_CHAR, so presumably US7ASCII as well
Import Server: UTF8
RESULT: Acute E became h
4)
Export Server: US7ASCII
Export Client: NLS_LANG=AMERICAN_AMERICA.UTF8 and NLS_CHAR=UTF8
Import Client: NLS_LANG=AMERICAN_AMERICA.UTF8 and NLS_CHAR=UTF8
Import Server: UTF8
RESULT: Acute e became h
5)
Tried using Update sys.props$
set value$='UTF8'
where name='NLS_CHARACTERSET'
RESULT: Acute e shows properly but it gives problem in the application
"java.sql.SQLException: Fail to convert between UTF8 and UCS2: failUTF8Conv"
Looking further it was observed the following:
when you try this command on a column 'city' in a table which contains 'Genhva' (note the acute e after n), it shows
command: select length(city), vsize(city),substr(city,4,1),city from cities
Result: 4 6 hva Genhva
if you see the value of substr(city,4,1) , you will see the problem. Also note that the length shows 4 and size shows 6. Moreover, when these records are selected through JDBC Driver, it starts giving problems.
6)
Actually the above (point no. 5) is similar to changing the character set of the database with 'ALTER DATABASE CHARACTER SET UTF8'. Same problem is observed then too.
7)
We have also tried to with another method, that is by changing the third byte of the export file which specifies the character set, to the UTF8 code by editing the export file with a Hexdecimal editor. After import the same problem has been observed as defined in (5) and (6) above.
We have no more ideas how to migrate without corrupting the data. Of course we have known the records where these characters occur through the Oracle's cssacn utility but we do not want to manually rectify each and every record by replacing it with an ASCII character. Any other idea as to how this can be accomplised?
Thanx
Ashok

The problem you have is that although your original database is defined as US7ASCII, the data it contains is more than is covered by this code page (as the reply on Sept 4 to the previous posting already said).
This has probably happened because the client was also defined as US7ASCII, and when the DB and client are defined as having the same character set no conversion (or checdking) takes place when data is passed between them. However if you are using a Windows client then it will in fact be using Windows code page 1252 (Latin-1) or similar, and this allows many more characters, including h (accented e). So a user can enter all these characters and store them in the database, and similarly read them from the database, because data transfer is transparent.
When you did ALTER DATABASE CHARACTER SET UTF8 this will only change the label on the database, but not affect the contents. However only part of the contents are valid UTF8, any character above 7F (like h) is invalid. If your original client now uses the database, code page transformation will take place because the client and DB have different character sets defined. The invalid codes can then cause problems.
Without being able to explain what has happened in detail, it may help to see what your h (dec 232, x'E8') looks like. The actual data has not changed (you can see this as it is reported as 232). However the binary code there (11101000) is invalid UTF8. UTF8 encodes a character in 1 to 4 bytes, and the first bits in a UTF8 character tell how many bytes it uses. 0xxx tell it is one byte (same as the corresponding USASCII character), 110x that it uses 2 bytes, 1110 that it uses 3 bytes etc. So if you interpret what is there as UTF8 it looks like the first byte of a 3-byte character, which explains why the substringing is giving you the other 2 bytes as well.
Can you fix this without losing data? I believe yes. First you should check what other characters are being flagged by the scan. See if these are contained in another standard character set. If they are only Western European accentet characters then WE8ISO8859P1 is probably ok, but watch out for the euro sign which Windows has at x'80', an undefined character in ISO8859-1.
You can see the contents of the Microsoft Windows Codepage 1252 at: http://www.microsoft.com/globaldev/reference/sbcs/1252.htm
For a listing of the US-ASCII defined characters see http://czyborra.com/charsets/iso646.html and for ISO 8859-1 see http://czyborra.com/charsets/iso8859.html#ISO-8859-1
If all is well, you can first ALTER DATABASE CHARACTER SET to WE8ISO8859P1. This will not change any data, but ensure that all the data gets exported. Then export the DB and import it to a UTF8 DB. This will convert the non-US-ASCII characters to Unicode. You will also have to change the clients character set to something other than USASCII or they will just see ? for the other characters.
Good Luck!

Clarification on Character set migration from US7ASCII to UTF8

Hi,
I need clarification on the below.
I need to migrate the database from US7ASCII to UTF8.
For this I ran csscan for user "TEST" as well as against full database.
Below log is the csscan output against full database. but my application is depended on TEST schema only. Shall I need to migrate SYS objects data as shown below or it's not required?. If required how to migrate these objects data?
Looking forward you help.
USER.TABLE Convertible Exceptional
SYS.METASTYLESHEET 58 TEST.Table_1 9 0
TEST.Table_2 11 0
TEST.Table_3 17 0
TEST.Table_4 11 0
[Distribution of Convertible Data per Column]
USER.TABLE|COLUMN Convertible Exceptional
SYS.METASTYLESHEET|STYLESHEET 58 0
Thanks,
Sankar

I think you need to migrate all schemas data not only one application schema because
the database character set is common to all CHAR, VARCHAR2, LONG and CLOB colums
for any tables in any schema.
In your case (US7ASCII to UTF8), you need to use export/import because:
Another restriction of the ALTER DATABASE CHARACTER SET statement is that it can be used only when the character set migration is between two single-byte character sets or between two multibyte character sets. If the planned character set migration is from a single-byte character set to a multibyte character set, then use the Export and Import utilities.
(see http://download-uk.oracle.com/docs/cd/B10501_01/server.920/a96529/ch10.htm#1009904)

Database migration from US7ASCII to UTF8

Hi All,
As a part of Data migration we need to change the existing database
character set from US7ASCII to UTF8. My Database is running on Oracle 9.2.0.6.
In my database I have 5 schemas.
1) Can any body suggest how to migrate the character set from US7ASCII to UTF8?
2) How to migrate all schemas data from US7ASCII to UTF8?
Thanks in advance

You may want to consider the character sets of your clients and the settings used up until now to store and retrieve data. Did you have true ascii-only clients/apps? The general idea is data quality analysis and management. You can find more info about this in the doc in the link given above.

Converting to UTF8 from US7ASCII

This is what I did to change the characterset of my PeopleSoft HRMS database to change the character set from US7ASCII to UTF8.Everything seems to have gone well but there is one value that is still not right.I am not sure how to change this or if I let it remain as it is, how is it going to affect the data.
Stop all queues with dbms_aqadm.stop_queue( queue_name => '<queue name>');
SHUTDOWN IMMEDIATE;
STARTUP MOUNT;
ALTER SYSTEM ENABLE RESTRICTED SESSION;
ALTER SYSTEM SET JOB_QUEUE_PROCESSES=0;
ALTER SYSTEM SET AQ_TM_PROCESSES=0;
ALTER DATABASE OPEN;
select value from nls_database_parameters where parameter='NLS_CHARACTERSET';
TRUNCATE TABLE SYS.METASTYLESHEET; ---to get rid of ORA-12716 per Metalink Note - 213015.1
ALTER DATABASE CHARACTER SET UTF8;
--ALTER DATABASE CHARACTER SET INTERNAL_USE UTF8;
SHUTDOWN IMMEDIATE;
STARTUP;
@$ORACLE_HOME/rdbms/admin/catmet.sql
SHUTDOWN IMMEDIATE;
STARTUP;
Start all queues with dbms_aqadm.start_queue( queue_name => '<queue name>');
Now when I query for the nls parameters in the database, this is what I get:
DICT.BASE     2
DBTIMEZONE     0:00
NLS_LANGUAGE     AMERICAN
NLS_TERRITORY     AMERICA
NLS_CURRENCY     $
NLS_ISO_CURRENCY     AMERICA
NLS_NUMERIC_CHARACTERS     .,
NLS_CHARACTERSET     UTF8
NLS_CALENDAR     GREGORIAN
NLS_DATE_FORMAT     DD-MON-RR
NLS_DATE_LANGUAGE     AMERICAN
NLS_SORT     BINARY
NLS_TIME_FORMAT     HH.MI.SSXFF AM
NLS_TIMESTAMP_FORMAT     DD-MON-RR HH.MI.SSXFF AM
NLS_TIME_TZ_FORMAT     HH.MI.SSXFF AM TZH:TZM
NLS_TIMESTAMP_TZ_FORMAT     DD-MON-RR HH.MI.SSXFF AM TZH:TZM
NLS_DUAL_CURRENCY     $
NLS_COMP     BINARY
NLS_NCHAR_CHARACTERSET     UTF8
GLOBAL_DB_NAME     HRDEV
EXPORT_VIEWS_VERSION     8
NLS_TIME_FORMAT     HH.MI.SSXFF AM
NLS_TIMESTAMP_FORMAT     DD-MON-RR HH.MI.SSXFF AM
NLS_TIME_TZ_FORMAT     HH.MI.SSXFF AM TZH:TZM
NLS_TIMESTAMP_TZ_FORMAT     DD-MON-RR HH.MI.SSXFF AM TZH:TZM
NLS_LENGTH_SEMANTICS     BYTE
NLS_NCHAR_CONV_EXCP     FALSE
NLS_RDBMS_VERSION     9.2.0.4.0
DEFAULT_TEMP_TABLESPACE     SYSTEM
NLS_SAVED_NCHAR_CS     US7ASCII
I am concerned about this value NLS_SAVED_NCHAR_CS which still is US7ASCII.Will this affect the application data anyway.

I would be too.
But given that this is PeopleSoft this is not the kind of thing where you should be taking advice from strangers at a website.
Open an SR with Oracle metalink and get advice supported by Oracle Corp.

Import from US7ASCII to AL32UTF8

Database version: 9.2.0.8 on SUN Solaris
I'm encountered the below error when impoting the data from US7ASCII to AL31UTF8. There are three tables hit with this error and these three tables have multiple VARCHAR2(4000) columns. How can I resolve this issue?. Is this issue exist on 10.2.0.3 too?.
IMP-00058: ORACLE error 1461 encountered
ORA-01461: can bind a LONG value only for insert into a LONG column
IMP-00028: partial import of previous table rolled back: 2679 rows rolled back

I have already gone through the Metalink Note 444171.1. But, my Oracle version is 9.2.0.8. Also, the mentioned cause will not be my case.
Cause
This is because of Bug 6167249. To confirm the Bug:
1) Table must be having at least one LOB column.
2) Table is precreated in destination database and Import is done with ignore=y parameter.
The two reasons are not true for my case. There are no LOB or LONG datatypes. The datatypes in columns are NUMBER and VARCHAR2 only. But, few columns are with VARCHAR2(4000). When, it's trying to to convert to UTF8, the columns with the length over 1333 may raise this error. Is any workaround for this issue.

Form button does not work when a program is moved from Windows 8.2 to Windows 7

Hi,
I have a few Excel programs which use the ODBC to get data from Access and which have macros which writes data to an external program, MYOB.
When the macros tries to write the data to MYOB it fails if I am not running the program in administrator mode.   It seems that Windows 8.2 has a different level of security than Windows 7 and must be run in administrator mode for the ODBC to work.
I have had issues after running the program in administrator mode (testing) if I simply do a save (in administrator mode) and then send it to the customer.   The issue is that it just will not work on the customer's site.   I have gotten
around this in the past by saving any changes, going back out of excel, loading the program again (not in administrator mode) and saving it - before sending it to the customer.   This worked until now.
For some unknown reason, the last time I sent a program to the customer and carried out the above process, the program stopped working. Originally I thought that the macro just wouldn't work on windows 7, but eventually found that it is the form button
that will no longer work when the program is moved from 8.2 to 7.
Does anyone know why there is an incompatibility between 8.2 and Windows 7 and what I should be doing to ensure that my programs work in my customers environment(windows7)?
In the meanwhile, I have changed the form button to an activex button and the program works fine in both environments.
Thanking you in advance,

there is some OP report after Windows update Dec 2014 macro stop responding ( I cant confirm if this is also related to your issue) its because security update for Office maybe conflict with the active-x that you are installed
try to
Close Excel
Start Windows Explorer.
Select your system drive (usually C:)
Use the Search box to search for *.exd
Delete all the files it finds.
Start Excel again
Open that file and save it, and try open at Windows 7
to get more detail about this issue, I suggest also contact Office forum
this case also will be solve installing kb3025036
good luck

HT4101 Once pictures are moved from your camera to your iPad (using the camera connection kit), how do you get the photos off of the iPad? They do not show up in my photo stream or my iCloud.

Once pictures are moved from your camera to your iPad (using the camera connection kit), how do you get the photos off of the iPad? They do not show up in my photo stream or my iCloud. I am able to see any photo I took on the iPad using the iPad camera (in iTunes, photo stream, or when I open windows explorer and browse the iPad director), however I cannot see any photos transfered from my camera to the iPad. The camera connection kit must have put my photos in a directory I cannot get to and cannot sync.

The links below have instructions for deleting photos.
iOS and iPod: Syncing photos using iTunes
http://support.apple.com/kb/HT4236
iPad Tip: How to Delete Photos from Your iPad in the Photos App
http://ipadacademy.com/2011/08/ipad-tip-how-to-delete-photos-from-your-ipad-in-t he-photos-app
Another Way to Quickly Delete Photos from Your iPad (Mac Only)
http://ipadacademy.com/2011/09/another-way-to-quickly-delete-photos-from-your-ip ad-mac-only
How to Delete Photos from iPad
http://www.wondershare.com/apple-idevice/how-to-delete-photos-from-ipad.html
How to: Batch Delete Photos on the iPad
http://www.lifeisaprayer.com/blog/2010/how-batch-delete-photos-ipad
(With iOS 5.1, use 2 fingers)
How to Delete Photos from iCloud’s Photo Stream
http://www.cultofmac.com/124235/how-to-delete-photos-from-iclouds-photo-stream/
 Cheers, Tom

I have the iPhone 5 and have with 6.0.1 software version. Although I had them when I moved from iPhone 4 to the 5, the latest update has most of my songs on the phone listed in grey (over 95% of them) and I can't play them. They are still listed though.

I have the iPhone 5 and have with 6.0.1 software version. Although I had them when I moved from iPhone 4 to the 5 (could play them), the latest update has most of my songs on the phone listed in grey (over 95% of them) and I can't play them. They are still listed in the iTunes library. When I look in the Summary for the iPhone, it shows Audio as only .16 GB - I have over 5 GB of songs, so what gives?
P.S. When I look at my Playlists most of the songs are greyed out. However, at the bottom of the list there is a cloud icon with a downward facing arrow. When I click on it each song starts to "load" and after a few minutes I have the songs back on in the list. I have to do this to all my playlists (I had over 100) in order to get access to all my songs. Then I did a sync and it happened again!
I use iCloud for documents and some other things (calendar, contact, etc.) but am not aware that I have anything music-wise in the cloud. Any thougnts?

You may have to try deleting all the music from your phone (by going to Settings>General>Usage>Music, swipping All Music and tapping Delete), then sync it all back on with iTunes in order to fix this.

Mac desktop. 10.6.8. Text edit. Not locked. Read and write. Still, documents are locking when they are moved from desktop to another folder on the server. Techies can't figure it out here. What am I not doing?

Mac desktop. 10.6.8. Text edit. Not locked. Read and write, not read only. Documents are locking when they are moved from desktop to another folder or saved directly into that folder on the server. Not happening with anyone else but me and the boss's computer so has to be in the properties for my text edit software. Techies can't figure it out after trying for two weeks. Boss can do a cut and paste and put into a new document, but that's starting to become a problem.

Mac desktop. 10.6.8. Text edit. Not locked. Read and write, not read only. Documents are locking when they are moved from desktop to another folder or saved directly into that folder on the server. Not happening with anyone else but me and the boss's computer so has to be in the properties for my text edit software. Techies can't figure it out after trying for two weeks. Boss can do a cut and paste and put into a new document, but that's starting to become a problem.

We just moved from the United States to Costa Rica. The first two days my mac worked great. Then all of a sudden I was trying to use a game application and the screen went black and there is a white cursor which I can move around, but I can't escape it

We just moved from the United States to Costa Rica. The first two days my mac worked great. Then all of a sudden I was trying to use a game application and the screen went black and there is a white cursor which I can move around, but I can't escape it. When I restart it seems okay and I see my main screen, but only for a second and then it goes black again.
This computer was brand new in June. Is it the humidity??? What can I do. Please help!!!!

No guarantess but try smc and pram resets,

Report for material moved from blocked stock to unrestricted stock

Hi,
Is there a standard report in WM showing list and qty of materials moved from blocked stock to unrestricted stock.
Regards,
Pratap

It would have been easy if there was a specific WM movement type for such transfer but due to the reason that the WM 309 is connected to various IM movement types, there is no direct report to get this information.
Conversely, you may use MB51 with the combination of the WM managed storage location and movement type for your purpose. If there are multiple storage locations assinged to the same warehouse then you may put a range in the selection criteria.

I'm moving from windows notebook to MacBook Pro. When teaching I use a USB quality pointer device and want to know it the MacBook works with it

Greetings,
After using only Windows computers at work and home our company leadership now allows us to purchase Mac Pro Books if we desire. I am VERY excited!!!
Both of our sons work as engineers in Silicon Valley and will not purchase anything but Macs for years. Both son's schedules hinder me to get the answers quickly from them so I am seeking advice from you.
I love the idea of finally getting a Mac but have some questions and need to find a source to answer my questions before I send in the request for the new computer. If any of you could respond to these "beginner" Mac questions it would be wonderful.
1. I teach a large variety of classes using Powerpoint style presentations. I own a very nice wireless USB remote that I use to move between slides. Will the ProBook allow me the ability to use my remote? If so is there anything I need to know to make it work?
2. What are the tradeoffs of the 13 inch ProBook versus the 15 inch model?
3. What external devices/equipment should I plan to have available to be effective in an office environment?
4. In moving from Windows to Mac what is the best was to bridge the learning curve so I can become effective as quickly and effectively as possible?
I am very excited to make this change and your advice would be so appreciated.
Blessings,
David

David,
Have you checked the Web site of the manufacturer of your wireless USB remote, to see if their product supports MacBook Pros?
In general, the 13-inch MacBook Pro has less powerful hardware than the 15-inch model. A detailed comparison can be found in the right-hand column of the table here.
Which external devices/equipment do you currently have to be effective in an office environment with your Windows computer? The list is likely to be similar with a computer that runs OS X.
Which applications do you currently depend upon under Windows? That might be the best guide to providing advice on how to best adapt to OS X.

HT1918 i have recently moved from the uk to australia and cancelled my uk debit before the payment was processed for songs i bought in itunes. i have tried to edit my billing info with australian debit details but the site says 'invalid card' how can i fi

i have recently moved from the uk to australia and cancelled my uk debit before the payment was processed for songs i bought in itunes. i have tried to edit my billing info with australian debit details but the site says 'invalid card' how can i fix this?

Contact iTunes Customer Service and request assistance
Use this Link > Apple Support iTunes Store Contact

I have just moved from MobileMe, where I had a 'Family account' (with unique email addresses for my wife and myself) to iCloud. We share the Cal and Contacts on our iMac. How do we sync to multiple devices - we each have iPads and iPhones? Mine sync OK...

We have just moved from MobileMe, where we had a 'Family account' (and we each have our own @me.com email addresses) to iCloud. We share the Cal and Contacts on our iMac. How do we sync to multiple devices - we each have an iPad and an iPhone, but with different accounts set up for mail. Mine syncs OK to Cal and Contacts, but hers doesn't. There must be a way! Please help.

According the this: http://www.apple.com/mobileme/transition.html, "After moving to iCloud, family member accounts are no longer linked to the master account." You can share an iCloud calendar (see http://support.apple.com/kb/PH2690), but I don't think you will be able to share iCloud contacts unless you are signed into the same iCloud account on both phones.

Moving from US7ASCII to UTF8

Similar Messages

Maybe you are looking for