SQL Server 2005 huge data migration. Taking more than 18 hours ...

Hi,
We are migrating an SQL server 2005 DB to Oracle 10 g 64 bit 10.2.0.5. The source sql server DB has few tables (<10) and only few stored procedure(<5). However one table of source is very huge, it has 70 million records in it. I started the migration process; it was running till 18 hours passed away then I cancelled it. I am using SQL Developer 3.1.0.7 with online migration.
Kindly let me know if I choose offline migration will it reduce the data move time. Is there some other tool by oracle that can migrate huge data (records in millions) quickly. Is there some configuration in SQL Developer that can catalyses the process?
Kindly help.
Best Regards!
Irfan

I tried using SQL Loader to move data. The file exported by SQL server for the transaction table is of size around 17 GB. The sql loader stopped giving error on file size limit. The error is given below:
SQL*Loader: Release 10.2.0.5.0 - Production on Thu Mar 22 15:15:28 2012
Copyright (c) 1982, 2007, Oracle. All rights reserved.
SQL*Loader-510: Physical record in data file (E:/mssqldata/transaction.txt) is longer than the maximum(1048576)
SQL*Loader-2026: the load was aborted because SQL Loader cannot continue.
C:\Users\Administrator\Desktop\wuimig\datamove\wuimig\2012-03-22_14-20-29\WUI\dbo\control>
Please help me out how do I move such huge data to oracle from sql server.
Best Regards!

Similar Messages

Creating Sql Server 2005 External Data Source

Hey guys, I'm trying to connect to an SQL Server 2005 database directly from the BAM external Data Source.
I have the driver name and the connection string, login and password. I also have the driver, but BAM doesn't seem to have a "drivers" folder. So when I try to connect, I get:
BAM-00008: Invalid Oracle driver name
Source: "java.lang.ClasssNotFoundException: com.microsoft.sqlserver.jdbc.SQLServerDriver" ID: "InvalidOracleDriverName"
Has anyone done this before? Am I only allowed to connect to an Oracle Database from BAM? Thanx!

Hi,
I use BAM with SQL Server External Data Source and works fine.
In the Architect set this parameters on conection with SQL Server (EXTERNAL DATA SOURCE):
Driver: SQL Server
Connection string / URL: SERVER=<host>;DATABASE=<name_db>;
<host> = ip or name of the server
<name_db> = name of the database on the SQL Server
I use BAM 10.1.3.3.0 with SQL Server 2005
Regards

SQL Server 2005 Views data automated.

Hi Team,
Very Good morning to you. I am Asif Ali working as Software Engineer in TESCO HSC, Bangalore, India.
We are using SQL Server 2005 as our database. From the production environment every week I need to fetch weekly data from 3 different views and put into an excel sheet and then I have to mail this. This is a manual work. Is there any way to automate it so
that every week automatically the report should be sent to email ids, OR is there any way at least every week automatically data is pasted to excel sheet and then manually can be emailed to recipients. Till now: fetching data from view, paste data into an
excel sheet and then mail that sheet, all three activities are manual. I want to automate this at least at some extent. I am new to SQL Server world. I have knowledge of Java, VB Script and little bit of .NET.
Please help me on this.
Thanks in Advance
Regards,
Asif Ali
Contact # +91- 7204574734, [email protected]

You can use a SSIS Package to export the data from SQL to a excel sheet, Here is a simple project you can have a look at it
http://www.codeproject.com/Articles/402958/SSIS-Package-Export-Data-from-Database-Daily-to-Ne
Later after you design the SSIS package , you can schedule a SQL Agent job
1. The first step will be to run the SSIS package
2. Second step to send the email.
Configure SQL Server Agent
to know about sending emails from SQL Server have a look at this link
Send email from SQL
Satheesh
My Blog |
How to ask questions in technical forum

Datetime from SQL server 2005 to Crystal Reports 11 subtracting 6 hours

I have a view that I build a report from in crystal reports 11. in the view in SQL server 2005 I have a date field that returns 2008-12-15 00:00:00.000 but when I view this in Crystal Reports it shows up as 12/14/08 6:00 pm. Any suggestions why this is happening?

never mind this post. looks like it is the oledb provider we are using that has the issue.

Data Load taking more than 24 hrs

Hi All,
We are in the process of loading the data from R3 to BW. Its taking more than 24hrs to load 1 yr data. This is because of complexity of ABAP code its taking this much time. We did all the possible ways to improve the performance of the code. But no luck.
In case if the same thing happened in the production system, then how should I forward with the data load as its taking more than 24 hrs for 1 yr data.
I m Planning to load int with out data transfer 1st and then Full load.
Please correct if I m wrong.
Thanks,
RS.

Hi,
where is your ABAP code complexity loacted? in R/3 or in BW?
Are you talking about loading in empty cube taking long time? extraction time?
Analyze the different steps in your monitor and tell us where is the bottleneck;
If you already know the above and you have performed all the tunings (e.g. number range buffereing when filling an empty cube...) then you're correct; init without data and then full loads.
As suggested you could segment your full loads and even run them in paralel...
hope this helps...
Olivier.

Sybase ASE 11.9 to SQL Server 2012/2014 Data Migration

I am given a task of migrating the Sybase ASE 11.9 server databases to SQL Server 2012/2014.
We have Sybase server installed on Windows server 2000.
We are going to setup a SQL Server 2012 on another server machine.
We are planning the migration using SSMA Version 6.0.
My questions are as below:
1. Do i need to install the SSMA Sybase Client tool on both the servers?
2. The database is quite huge, so they want us to perform the migration on a Copy of Sybase database. Is it possible?
Also please let me know what are the requirements for all this process so we can take care of it before doing actual migration.

Hi Lydia ,
Thanks a lot for making it clear to me.
So as per my understanding i will install both the client
application of SSMA for Sybase and the
Server extension pack on Windows Server 2012.
So, if i can access the Sybase Server from Windows Server 2012(Sql Server Destination) then no
need to install the client application of SSMA for Sybase on Windows Server 2000(Sybase
Source).
Thanks

SQL Server 2005 Hierarchical Data concatenation

Hi Folks,
Please help me on the following data concatenation using hierarchical Query
Table Data:
Level Id   ParentTbl     PatCol
    ChildTbl ChildCol
1
A
a
B            b
1
A                  a          C c
2
C    c           D            d
3
D d E e
Excepted Result:
Level Id   ParentTbl     PatCol
    ChildTbl ChildCol SQLString
1
A
a
B            b A.a =B.b
1
A                  a          C c A.a
= C.c
2
C    c           D            d
A.a = C.c =D.d
3
D d           E e
A.a = C.c = D.d =E.e
Thanks
Narendran
Narendran

Declare @SampleData Table ([Level Id] int, ParentTbl varchar(256), PatCol varchar(256), ChildTbl varchar(256), ChildCol varchar(256));
Insert @SampleData([Level Id], ParentTbl, PatCol, ChildTbl, ChildCol)
Select 1,                   'A',                  'a',           'B',            'b'
Union All Select 1,                   'A',                  'a',           'C',            'c'
Union All Select 2,                   'C',                  'c',           'D',            'd'
Union All Select 3,                   'D',                  'd',           'E',            'e';
;With cte As
(Select [Level Id], ParentTbl, PatCol, ChildTbl, ChildCol, Cast(ParentTbl + '.' + PatCol + ' = ' + ChildTbl + '.' + ChildCol As varchar(max)) As SQlString
From @SampleData
Where [Level Id] = 1
Union All
Select s.[Level Id], s.ParentTbl, s.PatCol, s.ChildTbl, s.ChildCol, c.SQlString + ' = ' + s.ChildTbl + '.' + s.ChildCol
From cte c
Inner Join @SampleData s On s.[Level Id] = c.[Level Id] + 1 And s.ParentTbl = c.ChildTbl And s.PatCol = c.ChildCol
Select [Level Id], ParentTbl, PatCol, ChildTbl, ChildCol, SQlString
From cte;
Tom

SQL SERVER 2005 - part of the tables where migrated

Hello.
I'm trying to convert a SQL SERVER2005 DB to ORACLE 10g.
The sql-developer is converting all the objects from the DB, but builds DDL comands for 43 table insted of 320 tables .
All the tables are on schema dbo.
The user connecting to the sql server 2005 is data base owner (dbo).
After building the repository, on MD_TABLES there are only 43 records.
Any idea where to search the problem?
Thanks
Reuven
Message was edited by: reuven
user533419
Message was edited by: reuven
user533419
Message was edited by: reuven
user533419

Reuven,
We are finalizing our production release and would like to get to the bottom of the problem.
-You can run the workbench/SQLDeveloper so that you can see Java 'Stack traces' from exceptions (errors) in the output:
[from the SQLDeveloper forum under Unable to start sql developer :]
There is another [sqldeveloper.exe] that you should try from the command line:
<sqldevroot>\sqldeveloper\sqldeveloper\bin\sqldeveloper.exe
This will run in debug mode.
If all else fails, try the .bat file in that same folder.
-Are you using a case sensitive database?
-For the pre-production release workbench currently uses SQL Server 2000 views rather than SQL Server 2005 altered to take allowance for the user/schema separation, this may cause unforeseen problems.
-Can you send a test database to us with this problem?
Regards,
Turloch
Oracle Migration Workbench Team

SQL Server 2005 High Availability and Disaster Recovery options

Hi, We are are working on a High Availability & Disaster Recovery Planning solution for an application database which is on SQL Server 2005. What different options have we got to implement this for SQL Server 2005 and after we have everything setup how
do we test the failover is working?
Thanks in advance.........
Ione

DR : Disaster recovery is the best option for the business to minimize their data loss and downtime. The SQL server has a number of native options. But, everything is depends upon your recovery time objective RTO and recovery point objective RPO.
1. Data center disaster
Geo Clustering
2. Server(Host)/Drive (Except shared drive) disaster
Clustering
3. Database/Drive disaster
Database mirroring
Log shipping
Replication
Log shipping
Log shipping is the process of automating the full database backup and transaction log on a production server and then automatically restores them on to the secondary (standby) server.
Log shipping will work either Full or Bulk logged recovery model.
You can also configure log shipping in the single SQL instance.
The Stand by database can be either restoring or read only (standby).
The manual fail over is required to bring the database online.
Some data can be lost (15 minutes).
Peer-to-Peer Transactional Replication
Peer-to-peer transactional replication is designed for applications that might read or might modify the data in any database that participates in replication. Additionally, if any servers that host the databases are unavailable, you can modify the application
to route traffic to the remaining servers. The remaining servers contain same copies of the data.
Clustering
Clustering is a combination of one or more servers it will automatically allow one physical server to take over the tasks of another physical server that has failed. Its not a real disaster recovery solution because if the shared drive unavailable we cannot
bring the database to online.
Clustering is best option it provides a minimum downtime (like 5 minutes) and data loss in case any data center (Geo) or server failure.
Clustering needs extra hardware/server and it’s more expensive.
Database mirroring
Database mirroring introduced in 2005 onwards. Database Mirroring maintain an exact copy of a database on a different server. It has automatic fail over option and mainly helps to increase the database availability too.
Database mirroring only works FULL recovery model.
This needs two instances.
Mirror database always in restoring state.
http://msdn.microsoft.com/en-us/library/ms151196%28v=sql.90%29.aspx
http://blogs.technet.com/b/wbaer/archive/2008/04/19/high-availability-and-disaster-recovery-with-microsoft-sql-server-2005-database-mirroring-and-microsoft-sql-server-2005-log-shipping-for-microsoft-sharepoint-products-and-technologies.aspx
http://www.slideshare.net/rajib_kundu/disaster-recovery-in-sql-server
HADR Considerations
Need to Understand the business motivations and regulatory requirements that are driving the customer's HA/DR requirements. Understand how your customer categorizes the workload from an HA/DR perspective. There is likely to be an alignment between the needs
and categorization.
Check for both the recovery time objective (RTO) and the recovery point objective (RPO) for different workload categories, for both a failure within a data center (local high availability) and a total data center failure (disaster recovery). While RPO and
RTO vary for different workloads because of business, cost, or technological considerations, customers may prefer a single technical solution for ease in operations. However, a single technical solution may require trade-offs that need to be discussed with
customers so that their expectations are set appropriately.
Check and understand if there is an organizational preference for a particular HA/DR technology. Customers may have a preference because of previous experiences, established operational procedures, or simply the desire for uniformity across databases from
different vendors. Understand the motives behind a preference: A customers' preference for HA/DR may not be because of the functions and features of the HA/DR technology. For example, a customer may decide to adopt a third-party solution for DR to maintain
a single operational procedure. For this reason, using HA/DR technology provided by a SAN vendor (such as EMC SRDF) is a popular approach.
To design and adopt an HA/DR solution it is also important to understand the implications of applying maintenance to both hardware and software (including Windows security patching). Database mirroring is often adopted to minimize the service disruption
to achieve this objective.
HADR Options :
Failover clustering for HA and database mirroring for DR.
Synchronous database mirroring for HA/DR and log shipping for additional DR.
Geo-cluster for HA/DR and log shipping for additional DR.
Failover clustering for HA and storage area network (SAN)-based replication for DR.
Peer-to-peer replication for HA and DR (and reporting).
Backup & Restore ( DR)
keep your server DB backups in network location ( DR)
Always keep your sql server 2005 upto date, in case if you are not getting any official support from MS then you have to take care of any critical issues and more..
Raju Rasagounder Sr MSSQL DBA

Automating Data Migration from SQL Server 2005

Hi All,
I need to migrate data from SQL Server 2005 to Oracle DB ( Datawarehouse). The data migration involves updating Dimensions and Fact table. I have got painful job of switching topology to point to over 100 different weekly SQL DBs ( in sequence) and pull the data into DW. How can I automate my ODI process to switch from one after the other.
Any Ideas?
KS

ODI Variables are there to help you with this. Please go through this post at [http://blogs.oracle.com/dataintegration/2009/05/using_odi_variables_in_topolog.html] .
This will show you how to use a variable Oracle data server.
On similar lines you should be able to switch to any of your 100 weekly SQL server DBs.
And loop in a sequence to load data from all of them.
Hope that helps

Migration from sql server 2005 tables to oracle tables.

Hi,
Kindly give the steps to migrate from sql server 2005 tables to oracle tables.
Kindly advise
Oracle database version:
Oracle Database 10g Release 10.2.0.1.0 - Production
PL/SQL Release 10.2.0.1.0 - Production
"CORE 10.2.0.1.0 Production"
TNS for 32-bit Windows: Version 10.2.0.1.0 - Production
NLSRTL Version 10.2.0.1.0 - Production
Edited by: 873127 on Jul 18, 2011 9:46 PM

Are you migrating or taking continual updates?
If migrating it might be worth considering The SQLDeveloper Migration Workbench (which moves more than just data)..
http://www.oracle.com/technetwork/database/migration/sqldevmigrationworkbench-132899.pdf
Cheers
David

DB Migration from MS SQL Server 2005 to Oracle 9i

Hi Guys
I want to migrate the data from Microsoft SQL Server 2005 to Oracle 9i.
Could ou please suggest me the how to proceed.
I can simply extract the das in CSV format as their are Foreign key , Primary key concept is there. So what will be the best way to proceed ....
regards
Macky

Macky,
In the coming months we will add support for SQL Server 2005 to the Oracle Migration Workbench. See our statement of direction on OTN for more details.
If you have extracted the data into a csv file format, you could construct a SQL Loader control file to load this data, assuming you have already created the table on the Oracle side.
Donal

Error in adding PRIMARY Data file of SQL Server 2005

Hi Experts,
I am using SQL 2005 as back end database for SAP ECC6. Due to Space problem in PRD data volume, i have added PRDDATA4.ndf file in SSMS ( SQL Server Management Studio) and saved. But, suddenly i got one more idea and extended the file size of exisiting PRDDATA1.mdf, PRDDATA2.ndf & PRDDATA3.ndf immediately i removed the PRDDATA4.ndf file before starting the service. But, while seeing in SAP using ST04 it showing the PRDDATA4.ndf with error message of file missing. What i have to do now? How can i delete the information showing in ST04. But it is not showing in SSMS.
Please help how to solve this.
Regards,
B.Sudharsan

Hi,
Following solution might help you to resolve the issue.
Solution1:
Issue happens because universe connection to the Database is not responding and the Data Source Name is not configured to write SQL Server 2005 database.
Resolution
Created new DSN connection under SYSTEM DSN to SQL Server 2005 Database.
Import the universe from the designer.
Go to File->Parameters.
Edit Connection.
On the Database Middleware Page expand SQl Server 2005->Select SQL Server 2005 driver.
Change the DSN to new DSN connection
Test the connection.
Save the Universe and Export it to the repository.
Solution2:
I am taking Oracle as an example over here.
This can be caused when the SQLNET.ora is located in a remote location using mapped drives.
Resolution
To resolve,
check the registry [HKLM\SOFTWARE\ORACLE] you should see a folder called HOME0
look for any paths that contain a mapped drive partition
Change the mapped drive letter to a UNC path (
server\folder)
Open a command prompt and do a tnsping using the tnsname and verify the location of the SQLNET.ora or TNSNAMES.ora
If the path is not updated to the new path
Reboot the server
Regards,
Sarbhjeet Kaur

MIGRATE ODI FROM SQL SERVER 2005 TO ORACLE

Hello,
Presently we have our master and work repositories in sql server 2005.We also have our source tables in sql server 2005.We are planning to migrate our repositories from sql server 2005 to oracle 10g.We are also migrating our source tables from sql server 2005 to oracle.Do we need to redo all our development in oracle.Can any body help with the steps to migrate our repositories and development work from sql server 2005 to oracle 10 g.
Thanks,
Revanth

dbf it's not sql server.
>
SQL Server databases have three types of files:
Primary data files
The primary data file is the starting point of the database and points to the other files in the database. Every database has one primary data file. The recommended file name extension for primary data files is .mdf.
Secondary data files
Secondary data files make up all the data files, other than the primary data file. Some databases may not have any secondary data files, while others have several secondary data files. The recommended file name extension for secondary data files is .ndf.
Log files
Log files hold all the log information that is used to recover the database. There must be at least one log file for each database, although there can be more than one. The recommended file name extension for log files is .ldf.
>
for dbf to oracle see http://asktom.oracle.com/pls/asktom/f?p=100:11:0::::P11_QUESTION_ID:711825134415

Export SharePoint List data to SQL Server 2005 Database

Hello Everybody,
I am presently working on a project which handles much larger amount of data. The architecture of the application demands extracting records from the SharePoint (WSS 3.0) and insert into a SQL Server 2005 database. I need to run this job as daily basis. I am thinking of using SSIS (SQL Server Integration Service) for this purpose. But I am new to this technology and I'd like to know how effective this idea to do the job.
I'd also like to know more about SharePoint's ability to handle huge amount of data when it comes to Reporting.
thank you,
Arun

For Reporting Services, There are web parts available which can be used to render a reporting service report in sharepoint. I have also used a reporting service report directly using Page Viewer Web Part so displaying a reporting services report in sharepoint is very simple task. Important part is to transfer data from Sharepoint list to SQL 2005. so if you want to use SSIS package and there is only one or two list then approach is to write a simple query based on your list id and extract information from sharepoint content database from UserData table, since it is a read only operation so it can work this way. Another way to do it is to write a Sharepoint Timer JOB which runs on a defined schedule and will read your list values and will transfer to your SQL 2005, Another way could be to write your custom web service and write code to transfer from list to SQL 2005. Custom code you will write inside timer or web service will be same code so it is just a different shell you can say. in case of web service, use it in some other application as a regular web service.
Let me know if you need further help, You did not mention how many list you have?
Regards,
BizWorld.

SQL Server 2005 huge data migration. Taking more than 18 hours ...

Similar Messages

Maybe you are looking for