Migration from SqlServer 2005 very slow... Number of Commits very big!

Halllo,
I migrate from SQL Server 2005 to Oracle 10g using SQL Developer 1.2.1 (latest Build). I have 2 tables, with 27 million rows and 29 million rows.
1% data move needs 4-5 Hours!...
- no indexes or constraints
- Options: 10 000 rows to commit after. Tries: 500 000 does not help also.
- tables have not LONG, BFILE, REF, ROWID,UROWID, or
TIMESTAMP columns (I have readed, for tables containing this types columns, rows are inserted individually, with commit for each row).
In "DETAILED ADDM REPORT FOR TASK XYZ" at Oracle server kann I read:
(translated from germany, sorry for bad english...):
Waits on event "log file sync" during the execution from COMMIT-and rolling forecastle processes have booked essential data bank time.
RECOMMENDATION 1: Application analysis, 97% benefit (467900 seconds)
ACTION: Check the application logic for a possible reduction of the number of COMMIT processes by enlargement of the transactions.
RATIONAL ONES: The application has explained 2596 transactions per minute by an average Redo size of 824 bytes per transaction.
It looks thus each row is committed, why?
Any insight to tune it to go faster.
Please help, I have many searched, but no solution found.
Thanks,
Julia
null

Hello Julia,
Moving large amounts of data "online" using JDBC is not recommended for the issues you outlined.
Its better to move large data sets using SQL Servers BCP tool to dump out the data from SQL Server into dat files, and then use Oracles SQL*Loader to load up the dat files into the Oracle database.
Luckily SQL Developer Migration Workbench can help you setup the scripts.
The feature is called "Offline Data Move".
See this viewlet
http://www.oracle.com/technology/tech/migration/workbench/viewlets/ofdm.html
Obliviously you will need enough disk space to create a file large enough to hold millions of rows.
I hope this helps
Dermot.

Similar Messages

Migration from Sqlserver 2005 to Oracle 10g

Hi all,
does anyone know a tool good to migrate a sqlserver 2005 database to oracle 10g ?
I tried Sqldeveloper and the migration of tables and datas are ok, but when I try to migrate views, functions and procedures the sqldeveloper hangs.
regards,.
Wander (Brazil)

Quite frankly forget using tools for all but the simplest migration: The best you will get from a tool, provided it works, is mediocrity.
Moving tables and data with tools works if you are using basic data types. Once you get past this, in all seriousness, it is time to roll up your sleeves and start writing code.
The differences between the two products is profound. What constitutes a transaction different, locking different, logging different, security models different, etc.
No tool can turn Transact SQL into nested BULK COLLECT and FORALL statements. And for many years into the future ... none will.

Migration from sqlserver 2005 to 2012

Hi Friends,
As we migrating our sqlserver database from 2005 to 2012, copy and attach sqlserver 2005 to 2012 database which is optimized way, or we should export data rows by table in new server is best way or just copy from sqlserver 2005 to attached
to sqlserver 2012 and change backup compbality parameter.
thank you.
regards,
asad
asad

Hello there,
Please follow the steps below:
Run upgrade advisor on the databases for the instance you want to upgrade.
If any issues are found, talk to your dev team/ Vendor for fixing the same.
If issues are fixed proceed with the actual upgrade. -- Do check for the other dependencies on the database which might effect the functionality if the instance gets
upgraded or something like that.
Get the downtime for the database.
Create the latest full backup of the database -- any other strategy will also work, just make sure you can recover the database.
Take a clone of the server if it's a virtual server to roll back any changes.
Run the upgrade on the sql 2005 instance from the 2012 set up. -- do check the pre-requirements for upgrade to sql 2012.
If everything is fine then you have an upgraded instance.
Also check the compatibility of the databases.
If all is fine then congratulations, you have upgraded your SQL server!

Migration from sqlserver 2005 to Oracle 10.1.0.3

I'm new to the migration workbench. But I was successful in converting our sqlserver 2005 db to Oracle 10.1.0.3 using the Offline capture method. This isn't a terribly complex db - 100 tables, many are empty. The trouble started when I tried to convert it a second time. True, there was an additional table, and several tables were populated with more data, but I didn't even get past the 'Load Database Capture Scrpt Output' step.
In preparation for the 2nd migration, I dropped all the SS2K5 tables from the Oracle id I was using to house the migration repository. I deleted the repository as well. So the userid was 'clean'. I set up a new directory to house the scripts that are generated.
1. Created a new repository. Checked that the MD% tables were indeed created.
2. Ran 'Create Database Capture Scripts'. Checked the files - they were fine.
3. Ran the omwb_offline_capture script against the Sqlserver db, from the directory where the scripts were created. .ERR files all empty. .DAT files exist - things are fine.
4. Logged on to the Oracle connection where the repository resides. Clicked on 'Load Database Capture scripts'. In the popup, I provided the directory path & name of the .ocp file. And the 'Capturing Database' popup displays, but the progress bar isn't moving back & forth. But, if I check in the directories where the .DAT files were generated (in 3.), I see that the .XML files now exist, with the proper timestamp. Also, if I log on to the repository userid, I see that the SS2K5 tables have now been created. So something did indeed happen. But I don't see any list of things being created. (On the original successful migration, I would see entries for nn Tables, nn Foreign Keys, etc.). One point I noticed on the successful migration - the foreign keys part of this step took 2 hours. There's only 224 foreign keys, so I thought that was odd.
I don't know how to go further here. Anyone have any ideas?

Hi there, and thanks for the reply.
I'm using sqldeveloper 1.5.0.53
I tried it with a new Oracle schema as the migration repository. Same result.
Running sqldeveloper.exe from the command line doesn't give any error. Is there a file somewhere that an error might be written to, and I'm not seeing it?
I left the 'Data Capture' popup running overnight & this morning, it was in the same state - no progress bar action, no messages about items being captured, nothing in the 'Captured Objects' pane. So I hit 'Close', and in the message log at the bottom of the screen, I get
oracle.dbtools.metadata.persistence.PersistableObject.doInsert(PersistableObject.java:238) <timestamp in here>
" (the above line is repeated forever). I eventually have to kill Sqldeveloper 'hard' - eg clicking the 'x' in the upper right corner.
Prior to killing, I can scroll to the bottom of the list of 'forever' lines, and the following 2 lines are displayed:
OALL8 is in an inconsistent state                                                  <timestamp in here>
oracle.dbtools.metadata.persistence.PersistenceException: Protocol violation               <timestamp in here>
On the Logging tab I see this:
Level          Sequence     Elapsed          Source                                   Message
SEVERE     32          0          oracle.dbtools.raptor.nls.OracleNLSProvider     Error loading nls:Protocol violation
I'm completely lost!
Would I get this kind of problem if, for some reason, no db objects were present in the output generated on the Sqlserver side?
I notice that, after shutting Sqldeveloper down hard, it doesn't restart easily. I get the product screen, then a blank screen with the 'Sqldeveloper' title bar at the top. Have to close that down hard. If I wait 10-ish minutes, I can start the product up again. This seems odd.

Migrate tables and stored proc from SQLServer 2005 Express to Oracle10G

How to migrate tables and stored procedures from SQLServer 2005 Express to Oracle10G using SQLDeveloper? thank you very much

Using Oracle SQL Developer Migration Workbench
http://www.oracle.com/technology/tech/migration/workbench/index_sqldev_omwb.html

Poor Processing Performance after Migration from SSRS 2005 to SSRS 2014

Hello all,
a customer is moving from SQL Server 2005 to SQL Server 2014 (clean install on a new machine). There are a lot of reports against an Analysis Services database. I have converted and deployed the reports. Most of them are showing a significant performance
improvement, but some of them became very slow.
Analyzing the report server's execution log I have discovered that the rendering time has increased very much (see picture for a specific report below - above the blue line is SSRS 2005 on an older machine, below is SSRS 2014 on a new machine).
Do you have any hints what I can do?
Thanks in advance and best regards,
Gerald

Thank you for your reply. Cumulative Update 4 has already been installed (I have just compared the installed version number with the list on
sqlserverbuilds.blogspot.com).
My first suspicion was also a rdl conversion problem. But as even reports with a blank page where showing this rendering performance problem I began to look at the datasets (although they are executed very fast according to the report server's
execution log view).
All MDX queries have been designed using the
Analysis Services MDX Query Designer. The option for not showing empty cells is activated to supress empty rows. But this option always applies to both axes (when usings the query designer). Thus columns for measures with null values in all rows are omitted
from the result set. When rendering a report the rsMissingFieldInDataSet-Error is shown, but in SSRS 2005 and also in the Data Tools for SQL Server 2014 this has no further impact.
But SSRS 2014 is performing very bad in this case. If I remove the NON EMPTY clause for the columns (which only works when switching to the text query builder, so the customer is not able to modify the queries anymore) the report performance will be as expected.
So far there're only two reports left where this does not solve the performance issue.
During testing I have also observered the BIDS - SQL 2008 R2 Warnings not clearing-bug which can be reproduced by everyone except
Microsoft ;)
Regards,
Gerald

Migration from SQLServer

I have to migrate a database from SQLServer 7.0 to Oracle 8i.
I make it from the SQLServer console,and there's no problem.But there are some tables with several "Long" type fields,and there's an error showing me that Oracle only supports one "Long" field per table...
What can I do?
I don't have Oracle Migration Worbench...I tried to get the demo form otn.oracle.com,but it doesn't work,because that's for Oracle 9i,and I have 8i.
Thanks in advance

Additionally Lara, Oracle do not recommend using the LONG datatype anymore - you should migrate any LONG data to Oracle LOBs.

Very slow start up and very slow response

Hi guys,
SOS
My iMac is so slow to boot or start up. It takes about an 1-2 hours. It has very slow and very delayed response when doing tasks. I'm not sure what happened.
I have tried safe mode but it has not worked. I tried the disk utility but it was saying that my DVD (possibly because it is for snow leopard) is outdated. I think I updated to Lion.
Do you have any suggestions? I will try any other tricks. Do you recommend to back up before doing repair etc.?
thanks in advance!!

Tried to reset the RAM but did not get through. It went to disk utility again. Tried repair but it still saying to back up and restore files. Maybe the HD has been toasted. =(...
It says: Invalid key lenght. Volume Mac HD could not be verifried completely.. then it says Error: disk utilityu can't repair close back disk out, restoere etc..
In disk utillity as well, Mac OS X base system appeared- I dont know the purpose of this. It has some files on it. Dont know whether to restore it or what?..Mac HD seems like the it's empty..
Thanks again guys...It feels like I'm in a maze..

Deprecated Code - Migration from SQL 2005 to 2012

Hi,
We're planning to upgrade our database from SQL Server 2005 to 2012. Based on this
link, it seems there's no code conversion needed in terms of Data Type, Keywords in creating SPs, Function, trigger.
The only thing that concerns me is this
Set options
SET ROWCOUNT for INSERT, UPDATE, and DELETE statements
TOP keyword
SET ROWCOUNT
109
But other than that, it should be good.
I would also like to get any feedback from other user who migrated their database from 2005 to 2012. What were the issues encountered during the process. Any tips and suggestion will be much appreciated.
Many Thanks.

What is your mode of upgrade
1. In place
2. Side by side
You must also read
Breaking changes to DB engine features in SQL Server 2012
Breaking changes to SQL Server features in SQL Server 2012
If you are just using DB engine features and SSIS I would advise you to first run upgrade advisor and look for breaking changes or unsupported scenarios. make sure you mitigate all such issues.
There is also a feature where you can side by side upgrade database by backup restore to SQL Server 2012 and still keep
compatibility level to 90
(but that is not advised)
I have migrated database from 2008 to 2012 but not from 2005 but above documents were very handy and would work quite well.
Please mark this reply as answer if it solved your issue or vote as helpful if it helped so that other forum members can benefit from it
My Technet Wiki Article
MVP

Is DDL is suported in ogg from sqlserver 2005 to oracle 11g xe

Hi !
i want to use ogg to trasfer all tables and sp from sql server 2005 to oracle 11g xe. (using windows 2008,ogg112101_ggs_Windows_x86_ora11g_32bit.zip)
is it suported? becasue i read "Extraction or replication of DDL (data definition language) operations.Non-supported objects and operations for SQL Server" in
from SQL Server Installation and Setup Guide
11g Release 2 Patch Set 1 (11.2.1.0.1)
yours sincerely

Does that mean even i cant migragte MSSQL stored procedure to oracle 11g xe also?Correct. You can't do that with GoldenGate. However, as Steve mentioned, you should look into SQL Developer migration capabilities (formally Migration Workbench). It can convert some T-SQL to PL/SQL but you'll need to do some (probably a lot) of custom code changes. Porting application logic from one language to another is basically a holy grail for IT systems. OGG will convert datatypes on the fly but it will never port application logic on the fly.
Good luck,
-joe

Run DDL error when migration from sqlserver 2000 to Oracle

Hello:
DDL was generated from Oracle SQL developer. However, it always has some errors when running the script.
Error starting at line 6 in command:
CREATE OR REPLACE PACKAGE sqlserver_utilities AS
FUNCTION convert(dataType VARCHAR2,num NUMBER) RETURN NUMBER;
FUNCTION convert(dataType VARCHAR2,date DATE, num NUMBER ) RETURN VARCHAR2;
END sqlserver_utilities;
Error report:
Incorrect syntax near the keyword 'OR'.
Error starting at line 34 in command:
CREATE SEQUENCE tableName_id_SEQ
MINVALUE 1 MAXVALUE 999999999999999999999999 INCREMENT BY 1 NOCYCLE
Error at Command Line:34 Column:0
Error report:
SQL Error: Line 1: Incorrect syntax near 'SEQUENCE'
Thanks

Hello, Dermot.
Thanks for the help. I have MD_Packages, MD_Sequences, other MD tables and some MIGR tables created in the target oracle database. How could I know if it was created successful? Except those tables, no other tables(SQL server tables) were created in the target oracle database. The others errors in DDL scripts are:
Error starting at line 370 in command:
CREATE TABLE table_name1(
ID NUMBER(10,0),
Part_Activity VARCHAR2(20)
Error at Command Line:370 Column:0
Error report:
SQL Error: Column or parameter #1: Cannot find data type NUMBER.
Error starting at line 376 in command:
ALTER TABLE table_name1
ADD CONSTRAINT PK_table_name1 PRIMARY KEY
ID
ENABLE
Error report:
SQL Error: Line 6: Incorrect syntax near 'ENABLE'.
Error starting at line 413 in command:
CREATE TABLE table_name2 (
ID VARCHAR2(6) NOT NULL,
COMPETITION NUMBER(10,0)
Error at Command Line:413 Column:0
Error report:
SQL Error: Column or parameter #1: Cannot find data type VARCHAR2.
Error starting at line 2,800 in command:
CREATE TABLE table_name3 (
Prefix NVARCHAR2(510),
Type NVARCHAR2(510),
ProductGroup NVARCHAR2(510)
Error at Command Line:2,800 Column:0
Error report:
SQL Error: Column or parameter #1: Cannot find data type NVARCHAR2.
Error starting at line 2,808 in command:
CREATE TABLE table_name4 (
id NUMBER(10,0),
bldg VARCHAR2(50),
queue VARCHAR2(50),
location VARCHAR2(50),
type VARCHAR2(50),
maxsize VARCHAR2(50),
color VARCHAR2(50),
empid VARCHAR2(50),
serial VARCHAR2(50),
duplex VARCHAR2(50),
server VARCHAR2(15) DEFAULT 'Server'
Error at Command Line:2,808 Column:0
Error report:
SQL Error: Column or parameter #1: Cannot find data type NUMBER.
Thank you very much for the helo.
Halfmoon

SQL 2005 x64 poor performance after migration from SQL 2005 x86

Recently We've migrated SQL 2005 x86 SP1 Enterprise running on Windows 2003 Enterprise to new hardware where is running Windows 2008 SP2 and SQL 2005 x64 SP4 with CU3.
In the work day, there are sometime SQL excpetions like this below. On other hand i can also tell that we already found some queries which has some inner joins and where clauses on nvarchar fileds, because of the nature of application. Such a query
is running for about 11 seconds on old SQL server, and about 6 minutes on new SQL server. My main question if is this possible just with a change to new architecture of SQL and more last patches and updates for SQL 2005. Is there any way how to get
this queries running faster, without rewritng them with new ones? Is this also possible this could be also cause for SQL exceptions, which we are facing on SQL server?
About new hardware, for now we can't find it something wrong. There is basic configuration:
Cisco UCS C220 M3S (1U server)
32GB RAM
Intel(R)Xeon® CPU [email protected], 6 core
Disk system: 4xSAS 300GB in RAID5 (OS and DATA) and 2xSATA 1TB in RAID1 (SQL backup)
RAID controller: LSI MegaRAID SAS 9271-8i (with latest driver and firmware)
Part of log of dump file:
2014-05-09 08:30:07.08 spid86      Error: 17311, Severity: 16, State: 1.
2014-05-09 08:30:07.08 spid86      SQL Server is terminating because of fatal exception c0000264. This error may be caused by an unhandled Win32 or C++ exception, or by an access violation encountered during exception handling.
Check the SQL error log for any related stack dumps or messages. This exception forces SQL Server to shutdown. To recover from this error, restart the server (unless SQLAgent is configured to auto restart).
2014-05-09 08:30:07.08 spid86      Using 'dbghelp.dll' version '4.0.5'
2014-05-09 08:30:07.08 spid86      **Dump thread - spid = 86, PSS = 0x0000000132A67ED0, EC = 0x0000000132A67EE0
2014-05-09 08:30:07.08 spid86      ***Stack Dump being sent to D:\MSSQL.1\MSSQL\LOG\SQLDump0087.txt
2014-05-09 08:30:07.08 spid86      * *******************************************************************************
2014-05-09 08:30:07.08 spid86      *
Thanks for any help,
Matjaž

>Is there any way how to get this queries running faster, without rewriting them with new ones?
You need to perform basic performance tuning steps in the new environment.
Software optimization:
http://www.sqlusa.com/articles/query-optimization/
Disk optimization:
http://www.sqlusa.com/bestpractices/configureharddisk/
Memory optimization:
http://www.sqlusa.com/bestpractices/memory-configuration/
REBUILD INDEXES, eliminate missing indexes & UPDATE STATISTICS.
If there is still a problem, look in Activity Monitor for expensive queries. Optimize them. As a general rule, you don't want to have expensive queries in RDBMS.
Kalman Toth Database & OLAP Architect
SQL Server 2014 Design & Programming
New Book / Kindle: Exam 70-461 Bootcamp: Querying Microsoft SQL Server 2012

Query from sqlserver 2005

Dear Sir,
I connect to sql server 2005 from oracle 11g release 2. my database link name erp.
I run below query is no problem.
select * from events@erp
but when i run below query
select cardno from events@erp
show invalid identifier (ora-00904).
Thanks
MH.BD

here is the structure.
SQL> desc events@erp;
Name Null? Type
EventID NOT NULL NUMBER(10)
EventTime DATE
EventType NUMBER(5)
EventSubType NUMBER(5)
Address NUMBER(10)
SubAddr NUMBER(5)
UserID NUMBER(10)
CardNo NUMBER(10)
Details VARCHAR2(255 CHAR)
LinkedEvent NUMBER(10)
IOBoardID NUMBER(10)
InputID NUMBER(10)
OutputID NUMBER(10)
SQL> select Cardno from events@erp;
select Cardno from events@erp
ERROR at line 1:
ORA-00904: "CARDNO": invalid identifier
I think it's may be unicode related setting problem. Need your expertise advice.

Migration from SqlServer to Oracle

I am using Sqldeveloper 1.2.1
I am trying to migrate sql server 2000 data to Oracle..
For that i had created two connections for oracle & SqlServer.
SqlServer and Oracle connections were made sucessfully, i am able to view the database and table.
Now i am doing migration process..
In Oracle conn i had selected Create Repository then
in SqlServer conn i selected "Capture Microsoft SqlServer".
Now Capturing Database is running long time.
No messsage is displayed..
Is my way is correct?
Pls provide solution.

Hi Shivasha,
If you are using 11g, the the solution is here (the 3rd post):
Re: SQL Developer in Oracle 11g
Andrei

4.1 EA2 Migration from SQLServer: can't change schema name?

I try to convert a SQL Server database to Oracle.
As I wanted to insert into an existing schema (with not the same name as on SQL Server) I followed this guideline:
A SQL Developer ... @dermotoneill: Migrate to Existing Oracle Users
I first captured the source and then tried to Convert the naming.
but the tab does not exist:
(you can see it really is showing pre-captured data as I can select the "Show only data types used in source model" checkbox)
Is there a new way now how to map the schema?
thank you,
Martin

Hi Martin,
That object naming page has been removed from the migration wizard.
The functionality is now available in the object migration report.
Its easier to work with the report as you can filter and order the objects based on your requirements.
In this case you can just show the OBJECT_TYPE='SCHEMA'.
So the steps are.
1) Capture and Convert you source database
2) Open the Object report (left click on the "Converted Database Objects" node) and change the SCHEMA objects TARGET_OBJECT_NAME to your desired target name. Commit changes.
3) Translate and Generate the Oracle database (right click on the "Converted Database Objects" node)
Regards,
Dermot.
SQL Developer Team.

Migration from SqlServer 2005 very slow... Number of Commits very big!

Similar Messages

Maybe you are looking for