Data Migration - SSIS Transfer SQL Server Objects Task or something else

Can someone please kindly help me with this.
Scenario
I have a requirement to transfer selected tables and views (with a specific schema) between two databases which reside in two different servers. In the interest of clarity I will call my databases DB_A and DB_B respectively. Please note that these databases
are NOT on the same server.
Transfer of these objects (tables & views) happens once a month. 99% of the objects in question will be of the same name and schema between the two databases as the ones migrated from the previous month. However, metadata definitions may change on DB_A
and those changes are supposed to be reflected on DB_B along with the associated data. This therefore means that each time a transfer/migration happens; objects in DB_B are dropped first and completely replaced by objects from DB_A.
Problem
What is the best way to achieve this?
My first attempt has been a go on the Transfer SQL Server Objects Task
in SSIS. The problem that I have is that when using Transfer SQL Server Objects Task
I don’t know how to filter objects in DB_A so that only objects with a specified schema can be migrated.
Transfer SQL Server Objects Task appears to be the best solution to me to accomplish my requirement but I can’t filter the desired objects by schema. Someone suggested using C# but my C# skills are not that eloquent.
May someone kindly help please, or possibly suggest any other way which can be handy to fulfil my requirements.
Many thanks,
Mpumelelo

Hi Prashanth
Thanks for your response. There is one problem though in my case. I’m sorry I forgot to mention this in the original question. When the objects are moved from BD_A to DB_B the schema in DB_B changes. That is, schemas are not the same between the source and
the destination database. How do I handle that with the solution that you have suggested?
Many thanks,
Mpumelelo

Similar Messages

Is there any way to activate the keep identity setting when using a Transfer SQL Server Object Task?

Is there any way to add the "Keep Identity" option to the tables selected for transfer in a Transfer SQL Server Object Task? It seems that would be very useful, yet I can't find an easily available setting for it. I would prefer to
accomplish this within the Transfer SQL Server Object Task since it can copy any new fields added to the source tables, as opposed to having to rebuild a custom Data Flow Task any time a table structure is altered. I thought setting "CopyPrimaryKeys"
to True would do the trick, but I found that only ensures that the column settings are transferred; when the transfer happens, the destination id column is populated based on the specified seed and increment value, not what's actually in the source table.
I'd like to point out that replication isn't really an option here. This is a package that runs a few times a day to keep some data on our website up to date with data in our protected corporate environment.

IIRW there is FastLoadKeepIdentity specifies
whether to keep an identity in OLEDB destination
Best Regards,Uri Dimant SQL Server MVP,
http://sqlblog.com/blogs/uri_dimant/
MS SQL optimization: MS SQL Development and Optimization
MS SQL Consulting:
Large scale of database and data cleansing
Remote DBA Services:
Improves MS SQL Database Performance
SQL Server Integration Services:
Business Intelligence

Error at the time of using "Transfer SQL Server Objects Task"

Hi all,
I am creating a task for coping the structure of one database to another but there is some issues which are disturbing me
i am unable to get how to fix it any one can help me please
I have one Source database and destination database
Errors are like
[Transfer SQL Server Objects Task] Error: Execution failed with the following error: "An error occurred while transferring data. See the inner exception for details.".
[Transfer SQL Server Objects Task] Error: Execution failed with the following error: "Invalid filegroup 'SFG_1_Application' specified.".
Niraj Sevalkar

[Transfer SQL Server Objects Task] Error: Execution failed with the following error: "Invalid filegroup
'SFG_1_Application' specified.".
Hello Niraj,
Seems in the source database a filegroup is used, which is not available in the Destination database.
Olaf Helper
[ Blog] [ Xing] [ MVP]

Transfer SQL Server Objects Timeout

Hello
I have created a Transfer SQL Server Objects Task with the following settings:
DropObjectsFirst = True
CopyData = True
CopySchema = True
CopyAllObjects = False
TablesList = (1 table in collection)
CopyIndexes = True
It copies a large table (13 million rows). The data transfers across fine, however it fails when trying to create the indexes giving the error "Timeout expired. The timeout period elapsed prior to
completion of the operation or the server is not responding.The statement has been terminated."
I can however create these indexes in SSMS either using T-SQL or using the GUI with no problem. What could be causing this timeout?
Thanks

You will need to use CopyIndexes = False
Then an extra script to add the index
I suspect that the target may have a slow disk subsystem yet being a Standard SQL Server where the indexing is resource consuming and the built in time out (that you cannot override) is not long enough.
Arthur
MyBlog
Twitter

Log for "Transfer SQL Server Objects" (SSIS 2008)

We are transferring several large tables (Data only) and the Transfer SQL Server Objects Control has remained yellow "state" for six hours. Is there a log file or other approach we can use tell what is happening? (For example, I found the
process spid and ran dbcc inputbuffer(<spid>) but the results are not too helpful. Repeatedly running "sp_who2" show the process as suspended but the CPU\DiskIO numbers are constantly increasing. Go figure)
TIA,
edm2

Use Adam's great procedure
Who Is Active? v10.00 (2010-10-21)
(C) 2007-2010, Adam Machanic
Feedback: mailto:[email protected]
Updates: http://sqlblog.com/blogs/adam_machanic/archive/tags/who+is+active/default.aspx
"Beta" Builds: http://sqlblog.com/files/folders/beta/tags/who+is+active/default.aspx
License:
Who is Active? is free to download and use for personal, educational, and internal
corporate purposes, provided that this header is preserved. Redistribution or sale
of Who is Active?, in whole or in part, is prohibited without the author's express
written consent.
Best Regards,Uri Dimant SQL Server MVP,
http://sqlblog.com/blogs/uri_dimant/
MS SQL optimization: MS SQL Development and Optimization
MS SQL Consulting:
Large scale of database and data cleansing
Remote DBA Services:
Improves MS SQL Database Performance
SQL Server Integration Services:
Business Intelligence

Data migrated from MS SQL Server 2k to Oracle8i is not the same :(

I'm trying to help a customer here who is trying to migrate a
table from MS SQL Server 2000 with column WORD of type varchar
(100) to Oracle8i (8.1.7.2) using Oracle Migration Workbench
1.4.0.1 using MS SQL Server 2000 plugin. That column has unique
values and has a primary key enabled on it. When migrated, the
table on Oracle will have duplicate and incorrect data as well
as ORA-2437: cannot validate (JAVAFARM.PK_IDX_WORD) - primary
key violated.
The data on both tables look like this :
ss2k value oracle value
========== ============
€ ┐
… ┐
’ ┐
– ┐
ƒ ┐
Y= ┐
4 ┐
–0 ┐
— ┐
& ┐
‘ ┐
Any idea what could be wrong or how to fix such thing?
Thanks :)
Fawaz.

otn.oracle.com -> technologies -> Migration Workbench ->
Oracle Migration Workbench Release 1.4.1.0.0 for Windows (yes
even for 14101 beta) -> Agree to export/license conditions ->
enter email or ignore -> Scroll down page to beta versions ->
download omwb14101.exe (or download it piece by piece) and
sqlserver2000.exe
Regards,
Jim.

Data Migration for MS SQL Server 7 to Oracle 8.0.l5

I have tried to migrate the DB Structure from MS SQL Server 7 to Oracle 8.0.5 but I am only able to convert the system table of SQL Server 7.
I was suggested to user Oracle Migration Workbench 1.2.5.0.0 for this but I can not find a sample version of this tools. If anyone is aware of this ,pl. get back to me.
Thanks,
Jeevan

Answered in previous message

System.Data.SqlClient.SqlException (0x80131904): SQL Server detected a logical consistency-based I/O error: incorrect checksum

Hello,
I am migrating client's database to my hosted environment, the client runs
SQL Server 2008 R2, and we run SQL Server 2014.
I am stuck on restoring one log file, which left below error message when I restore it:
Restoring files
DBFile_20150401030954.trn
Error Message: System.Data.SqlClient.SqlException (0x80131904): SQL Server detec
ted a logical consistency-based I/O error: incorrect checksum (expected: 0x512cb
ec3; actual: 0x512dbec3). It occurred during a read of page (1:827731)
in databa
se ID 49 at offset 0x000001942a6000 in file 'F:\MSSQL12.INSTANCE9\MSSQL\Data\Ody
sseyTSIAKL_Data.mdf'. Additional messages in the SQL Server error log or system
event log may provide more detail. This is a severe error condition that threat
ens database integrity and must be corrected immediately. Complete a full databa
se consistency check (DBCC CHECKDB). This error can be caused by many factors; f
or more information, see SQL Server Books Online.
RESTORE LOG is terminating abnormally.
at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolea
n breakConnection, Action`1 wrapCloseInAction)
at System.Data.SqlClient.SqlInternalConnection.OnError(SqlException exception
, Boolean breakConnection, Action`1 wrapCloseInAction)
at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObj
ect stateObj, Boolean callerHasConnectionLock, Boolean asyncClose)
at System.Data.SqlClient.TdsParser.TryRun(RunBehavior runBehavior, SqlCommand
cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler,
TdsParserStateObject stateObj, Boolean& dataReady)
at System.Data.SqlClient.SqlDataReader.TryConsumeMetaData()
at System.Data.SqlClient.SqlDataReader.get_MetaData()
at System.Data.SqlClient.SqlCommand.FinishExecuteReader(SqlDataReader ds, Run
Behavior runBehavior, String resetOptionsString)
at System.Data.SqlClient.SqlCommand.RunExecuteReaderTds(CommandBehavior cmdBe
havior, RunBehavior runBehavior, Boolean returnStream, Boolean async, Int32 time
out, Task& task, Boolean asyncWrite, SqlDataReader ds)
at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehav
ior, RunBehavior runBehavior, Boolean returnStream, String method, TaskCompletio
nSource`1 completion, Int32 timeout, Task& task, Boolean asyncWrite)
at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehav
ior, RunBehavior runBehavior, Boolean returnStream, String method)
at System.Data.SqlClient.SqlCommand.ExecuteScalar()
at OnBoardingTrnRestore.FileRestorer.FileIsRestored(SqlConnection connection,
String sourceBackupFileName, String sourceDatabaseName, String destinationDatab
aseName, String databaseName, String strFileName) in c:\Dev\WiseCloud\OnBoarding
TrnRestore\OnBoardingTrnRestore\FileRestorer.cs:line 223
ClientConnectionId:6f583f98-9c23-4936-af45-0d7e9a9949ea
Finished
I have run restore filelistonly and verifyonly in both client and my box, and both worked well:
XXX_Data D:\Program Files (x86)\XXX\Data\YYY_Data.mdf
restore filelistonly:
D PRIMARY
70922469376 35184372080640
1 0
0 00000000-0000-0000-0000-000000000000
0 0
0 512 1
NULL 279441000014839500242
66CC6D17-575C-41E5-BB58-3FB4D33E288C
0 1 NULL
XXX_Log E:\Program Files (x86)\XXX\Log\YYY_Log.ldf
L NULL
31985762304 35184372080640
2 0
0 00000000-0000-0000-0000-000000000000
0 0
0 512 0
NULL 0
00000000-0000-0000-0000-000000000000 0
1 NULL
restore verifyonly:
Attempting to restore this backup may encounter storage space problems. Subsequent messages will provide details.
The path specified by "D:\Program Files (x86)\XXX\Data\YYY_Data.mdf" is not in a valid directory.
Directory lookup for the file "E:\Program Files (x86)\XXX\Log\YYY_Log.ldf" failed with the operating system error 3(The system cannot find the path specified.).
The backup set on file 1 is valid.
Dbcc checkdb also confirmed there is no error in client sql server database.
dbcc checkdb (XXX, NOINDEX)
Results as follows:
DBCC results for 'XXX'.
Warning: NO_INDEX option of checkdb being used. Checks on non-system indexes will be skipped.
Service Broker Msg 9675, State 1: Message Types analyzed: 17.
Service Broker Msg 9676, State 1: Service Contracts analyzed: 9.
Service Broker Msg 9667, State 1: Services analyzed: 7.
Service Broker Msg 9668, State 1: Service Queues analyzed: 7.
Service Broker Msg 9669, State 1: Conversation Endpoints analyzed: 0.
Service Broker Msg 9674, State 1: Conversation Groups analyzed: 0.
Service Broker Msg 9670, State 1: Remote Service Bindings analyzed: 0.
Service Broker Msg 9605, State 1: Conversation Priorities analyzed: 0.
DBCC results for 'sys.sysrscols'.
There are 23808 rows in 350 pages for object "sys.sysrscols".
DBCC results for 'BMBoard'.
There are 0 rows in 0 pages for object "BMBoard".
DBCC results for 'CusOutturnHeader'.
There are 0 rows in 0 pages for object "CusOutturnHeader".
CHECKDB found 0 allocation errors and 0 consistency errors in database 'XXX'.
DBCC execution completed. If DBCC printed error messages, contact your system administrator.
We use ftp to transfer the log files from the another country to here, I confirmed the file's MD5(checksum) is same as the copy in client's environment, we have tried to upload the file a couple of times, same outcome.
The full backup is fine, I have successfully restored a series log backups prior to this file.
Has anyone seen this issue before? It is strange, all information indicates the file is good,but somehow it goes wrong.
Below are the version details:
Client:
MICROSOFT SQL SERVER 2008 R2 (SP2) - 10.50.4000.0 (X64)
My environment:
Microsoft SQL Server 2014 - 12.0.2480.0 (X64)
Jan 28 2015 18:53:20
Copyright (c) Microsoft Corporation
Enterprise Edition (64-bit) on Windows NT 6.3 <X64> (Build 9600: )
Thanks,
Albert

Error Message: System.Data.SqlClient.SqlException (0x80131904): SQL Server detec
ted a logical consistency-based I/O error: incorrect checksum (expected: 0x512cb
ec3; actual: 0x512dbec3). It occurred during a read of page (1:827731)
in databa
se ID 49 at offset 0x000001942a6000 in file 'F:\MSSQL12.INSTANCE9\MSSQL\Data\Ody
sseyTSIAKL_Data.mdf'. Additional messages in the SQL Server error log or system
event log may provide more detail. This is a severe error condition that threat
ens database integrity and must be corrected immediately.
Hi Albert,
The above error message usually indicates that there is a problem with underlying storage system or the hardware or a driver that is in the path of the I/O request. You can encounter this error when there are inconsistencies in the file system or if the database
file is damaged.
Besides other suggestions, consider to use the
SQLIOSim utility to find out if these errors can be reproduced outside of regular SQL Server I/O requests and change
your databases to use the PAGE_VERIFY CHECKSUM option.
Reference:
http://support.microsoft.com/en-us/kb/2015756
https://msdn.microsoft.com/en-us/library/aa337274.aspx?f=255&MSPPError=-2147217396
Thanks,
Lydia Zhang
Lydia Zhang
TechNet Community Support

Error logging when running SSIS on SQL Server Agent

I have SSIS package running on SQL Server Agent Job.
When I'm running it, I get error and I'm urget to see History Logs.
When look Error logs in SQL Server Object Explorer, I don't find errors on this day.
Where should I look for error messages related to SSIS. Any thing to be configured on Management Studio or Data Tool?
Kenny_I

Hi Kenny_I,
As Russ posted, you need to expand the toggle to see the detailed information when viewing the Job history. Please see the screenshot below:
Besides, you can also edit the Job step, and switch to the Advanced tab to specify a job output file to log the detailed package execution failure information. The screenshot is for your reference:
Regards,
Mike Yin
If you have any feedback on our support, please click here<o:p></o:p>
Mike Yin
TechNet Community Support

Does xcelsius access data model in MS sql server 2000

have the following scenario: I need to create a dashboard which will be accessed through a Microsoft Office SharePoint server portal. This dashboard will be used for analysis of Agencies and Underwriters; they should be able to drill down to policy level details.
The data will originate from a Data Warehouse (Relational Schema) which resides on a Microsoft SQL server 2000 platform.
Q) Does Xcelsius work off a relational model or does the data model need to be converted to a Dimensional Star schema? Do you have to create Cubes?
A)
Q) It was mentioned in the book that Xcelsius can connect to a Microsoft SharePoint server using web part, however there is no information in the help menu to do that task?
A)
My thought) I was also thinking that the data model build on MS SQL SERVER 2000 can be used to create a Universe, which then can link to Live Office using Query as a Web Service (QAAWS) and used to build Xcelsius model. (Does one have to go this route, or can one access the data model created on SQL SERVER 2000?)
Any Feedback)

I need to create a dashboard which will be accessed through a Microsoft Office SharePoint server portal. This dashboard will be used for analysis of Agencies and Underwriters; they should be able to drill down to policy level details.
The data will originate from a Data Warehouse (Relational Schema) which resides on a Microsoft SQL server 2000 platform.
Q) Does Xcelsius work off a relational model or does the data model need to be converted to a Dimensional Star schema? Do you have to create Cubes?
A) Xcelsius works on an X/Y (Column/Row) table model, strictly based on the Excel structure. Though the underlying data model is a table, it is not inherently relational as it does not impose any BC Normal Form requirements.
Xcelsius works primarily with data embedded in an integrated Excel workbook. Data can be input to the workbook by a variety of methods, from importing a premade Excel workbook into the the model to retrieving data from flat files (.txt, .xml, .etc) to getting data from a connection such as a WebService.
There is no capability to connect directly, 1:1, to a database source and execute SQL queries. An intermediary is required to retrieve data from a database, such as a WebService or an XML Data connection.

Migrating from MS-SQL Server to Oracle

Hi,
Is there any Java Tool to migrate from MS-SQL Server to Oralce?
(My Organization's data is already stored in MS-SQL Server database, now we want to migrate to Oracle;
is there any easy way to pull data from MS-SQL Server and push into Oracle database)
thanks,

I think u should use a third party help to resolve this problem, i use dbload to solve it when i was migrated my data, it can migrate almost any data, it helps me to convert MSSQL to MYSQL, MS access to MSSQL, mysql, csv loader, foxpro and MSSQL to MS access, MYSQl, CSV, foxpro etc. i found it on google search.
Download Free : http://www.dbload.com

Can not extract data into BW from SQL SERVER

Dear All,
I meet a problem to extract data from database(MS SQL Server 2000(sp3)) into BW now and can not extract data into BW ODS, even PSA, In the monitor, display yellow light(0 from 0 record), detail message just display message "data request arranged" "confirmed with: confirmation" in requests(message) step; "missing message: request received" in extract (message) step; "no data" in processing(data packet) step and so on. but in fact, there are two records in my database test table and DB connection is OK. Even I can extract data from another test oracle database into BW ODS successfully.
Our BW system has two BW applicaton server and use oracle database. the one application server locates on IBM AIX host. the another one locates on one NT server. the application server on NT server is used for data extration from MS SQL SERVER database into BW oracle database. and MS SQL SERVER and NT platform application server locate on same one host. DBSL was installed on the NT application server already. and DB connector also was created successfully for MS SQL SERVER and datasource also was generated. DBSL type is Kernel640-WIN-IA32bit-unicode. my BW system is ECC5.0/UNICODE/ORACLE. all table/view/field name of MS SQL server is upcase and have not any specific character. for example: ZDEMO etc.
wait your help.
Thanks in advance.
Billy

Hi Ravi,
Could you help me to get knowledge about the followings:
approximately how many records extracting and transfering from SAP R/3 to BIW in an organisation. for that how much time will take .
How to extract data from two are three source system to BIW. Kindly help me with step by step explanation .If any screen shots with documents pls fwd to my ID. "[email protected]"
Your help highly appreciated.
Thanks.
Hema

Date column in OBIEE-SQL Server

Hi expert,
I have created date (datetime)column in sql server cube. Now I wat it inmy OBIEE as date. how to do that.
When we import,there are only three option->Double,Varchar,Unknown.

Something wrong.... once you import table in rpd the column should have Type as DATETIME or DATE.
If its not the case then you can change the format in rpd.
If helps pls mark

Migrating from MS SQL Server 2005 database to Oracle 10g

Hello,
I wanted the full procedure or steps to Migrate the MS SQL Server 2005 database to Oracle 10g. Is there a known procedure to do this or is there a tool which is used?
I have not done migration of database from MS SQL Server to Oracle. Any help is appreciated. Thanks a lot for the time.
Regards,
RPS

Wrong forum, go to the database forum!
cu
Andreas

Data Source for MS SQL SERVER

Need Help on how to add a data source from MS SQL Server. Please give an example using PUB as the database and the server is N12345\SQLSERVER. Thanks.

Connecting to SQL 2000 server worked very easily. Make sure you start the SQL Server and the Sun Java Studio Creator IDE. In the Server Navigator pane, right click on the 'Data Sources' node and pick up the menu item' Add Source'. This brings up a dialogue box wherein you need to insert info regarding the hostname, password, database information etc. For a detailed screen shots of this you see my page at
http://www.mysorian.com/htek. The last item in the scrolling page is the one you should look for.

Data Migration - SSIS Transfer SQL Server Objects Task or something else

Similar Messages

Maybe you are looking for