SQL SERVER BULK FETCH AND INSERT/UPDATE?

Hi All,
       I am currently working with C and SQL Server 2012. My requirement is to Bulk fetch the records and Insert/Update the same in the other table with some business logic?
       How do i do this?
       Thanks in Advance.
Regards
Yogesh.B

> is there a possibility that I can do a bulk fetch and place it in an array, even inside a stored procedure ?
You can use Temporary tables or Table variables and have them indexes as well
>After I have processed my records, tell me a way that I will NOT go, RECORD by RECORD basis, even inside a stored procedure ?
As i said earlier, you can perform UPDATE these temporary tables or table variables and finally INSERT/ UPDATE your base table
>Arrays are used just to minimize the traffic between the server and the program area. They are used for efficient processing.
In your case you will first have to populate the array (Using some of your queries from the server) which means you will first load the arrary, do some updates, and then send them back to server therefore
network engagement
So I just gave you some thoughts I feel could be useful for your implementation, like we say, there are many ways so pick the one that works good for you in the long run with good scalability
Good Luck! Please Mark This As Answer if it solved your issue. Please Vote This As Helpful if it helps to solve your issue

Similar Messages

SAP List of Supported SQL Server Service Packs and Cumulative Updates

Does SAP provide a list of SQL Server Service Packs and Cumulative Updates that will work with BPC 7.0 and 7.5? I see that CU 12 is out for SP1 and CU 2 is out for SP2. I would like to know if I can move the SP2 CU2 or SP1 CU12. My install docs are outdated specifying SP1 CU6.
Any direction is appreciated.
Joe

Hi,
Please take a look at the below list of the supported OS: This excerpt is from the installation guide.
SP04 or later: Windows Server 2008 R2 Standard or Enterprise Edition with or without Hyper-V
Windows Server 2008 Standard or Enterprise Edition with or without Hyper-V, or
Windows Server 2008 Data Center with or without Hyper-V
Windows Server 2003 Standard or Enterprise Edition SP2
Windows Server 2003 Standard configured on the SQL database or OLAP server components only
Windows Server 2003 R2 Standard or Enterprise Edition SP2
SAP recommends using Windows Server 2008 64 bit over Windows Server 2003 64 bit. Otherwise, supportability is limited.
I am not sure what did you mean by the front end. Having said that, 32 bit is supported both on the server and the client machines.
Hope this helps.

Sql Server bulk update

Hi
I have a datatable (in .net Application) which has a huge data.
I need to update/insert the data in to the Sql server database table.
(Upadte if the data exist in the table and insert if the data does not exist in the table).
just I wanted to know Is there any option for bulk insert or update rather than checking each row in (using cursor - SP) the table and inserting/updating..
Samproo

Hi Samproo, You will never use a cursor to check the existence of a record to whether update it or insert it. It will cost a lot to you when huge data stars flowing in.
Just use the Exists statement as below.
IF EXISTS(SELECT 1 FROM Table_Name WHERE condition = Value)
BEGIN
......UPDATE DATA Statemet.....
END
ELSE
BEGIN
.......INSERT DATA Statement.......
END
And Yes, you can use this inside any stored procedure the same way it is.
or if you doing matches between two tables then you can use MERGE as well...
Please mark as answer, if this has helped you solve the issue.
Good Luck :) .. visit www.sqlsaga.com for more t-sql code snippets and BI related how to articles.

Welcome to the SQL Server Disaster Recovery and Availability Forum

(Edited 8/14/2009 to correct links - Paul)
Hello everyone and welcome to the SQL Server Disaster Recovery and Availability forum. The goal of this Forum is to offer a gathering place for SQL Server users to discuss:
Using backup and restore
Using DBCC, including interpreting output from CHECKDB and related commands
Diagnosing and recovering from hardware issues
Planning/executing a disaster recovery and/or high-availability strategy, including choosing technologies to use
The forum will have Microsoft experts in all these areas and so we should be able to answer any question. Hopefully everyone on the forum will contribute not only questions, but opinions and answers as well. I’m looking forward to seeing this becoming a vibrant forum.
This post has information to help you understand what questions to post here, and where to post questions about other technologies as well as some tips to help you find answers to your questions more quickly and how to ask a good question. See you in the group!
Paul Randal
Lead Program Manager, SQL Storage Engine and SQL Express
Be a good citizen of the Forum
When an answer resolves your problem, please mark the thread as Answered. This makes it easier for others to find the solution to this problem when they search for it later. If you find a post particularly helpful, click the link indicating that it was helpful
What to post in this forum
It seems obvious, but this forum is for discussion and questions around disaster recovery and availability using SQL Server. When you want to discuss something that is specific to those areas, this is the place to be. There are several other forums related to specific technologies you may be interested in, so if your question falls into one of these areas where there is a better batch of experts to answer your question, we’ll just move your post to that Forum so those experts can answer. Any alerts you set up will move with the post, so you’ll still get notification. Here are a few of the other forums that you might find interesting:
SQL Server Setup & Upgrade – This is where to ask all your setup and upgrade related questions. (http://social.msdn.microsoft.com/Forums/en-US/sqlsetupandupgrade/threads)
Database Mirroring – This is the best place to ask Database Mirroring how-to questions. (http://social.msdn.microsoft.com/Forums/en-US/sqldatabasemirroring/threads)
SQL Server Replication – If you’ve already decided to use Replication, check out this forum. (http://social.msdn.microsoft.com/Forums/en-US/sqlreplication/threads)
SQL Server Database Engine – Great forum for general information about engine issues such as performance, FTS, etc. (http://social.msdn.microsoft.com/Forums/en-US/sqldatabaseengine/threads)
How to find your answer faster
There is a wealth of information already available to help you answer your questions. Finding an answer via a few quick searches is much quicker than posting a question and waiting for an answer. Here are some great places to start your research:
SQL Server 2005 Books Onlinne
Search it online at http://msdn2.microsoft.com
Download the full version of the BOL from here
Microsoft Support Knowledge Base:
Search it online at http://support.microsoft.com
Search the SQL Storage Engine PM Team Blog:
The blog is located at https://blogs.msdn.com/sqlserverstorageengine/default.aspx
Search other SQL Forums and Web Sites:
MSN Search: http://www.bing.com/
Or use your favorite search engine
How to ask a good question
Make sure to give all the pertinent information that people will need to answer your question. Questions like “I got an IO error, any ideas?” or “What’s the best technology for me to use?” will likely go unanswered, or at best just result in a request for more information. Here are some ideas of what to include:
For the “I got an IO error, any ideas?” scenario:
The exact error message. (The SQL Errorlog and Windows Event Logs can be a rich source of information. See the section on error logs below.)
What were you doing when you got the error message?
When did this start happening?
Any troubleshooting you’ve already done. (e.g. “I’ve already checked all the firmware and it’s up-to-date” or "I've run SQLIOStress and everything looks OK" or "I ran DBCC CHECKDB and the output is <blah>")
Any unusual occurrences before the error occurred (e.g. someone tripped the power switch, a disk in a RAID5 array died)
If relevant, the output from ‘DBCC CHECKDB (yourdbname) WITH ALL_ERRORMSGS, NO_INFOMSGS’
The SQL Server version and service pack level
For the “What’s the best technology for me to use?” scenario:
What exactly are you trying to do? Enable local hardware redundancy? Geo-clustering? Instance-level failover? Minimize downtime during recovery from IO errors with a single-system?
What are the SLAs (Service Level Agreements) you must meet? (e.g. an uptime percentage requirement, a minimum data-loss in the event of a disaster requirement, a maximum downtime in the event of a disaster requirement)
What hardware restrictions do you have? (e.g. “I’m limited to a single system” or “I have several worldwide mirror sites but the size of the pipe between them is limited to X Mbps”)
What kind of workload does you application have? (or is it a mixture of applications consolidated on a single server, each with different SLAs) How much transaction log volume is generated?
What kind of regular maintenance does your workload demand that you perform (e.g. “the update pattern of my main table is such that fragmentation increases in the clustered index, slowing down the most common queries so there’s a need to perform some fragmentation removal regularly”)
Finding the Logs
You will often find more information about an error by looking in the Error and Event logs. There are two sets of logs that are interesting:
SQL Error Log: default location: C:\Program Files\Microsoft SQL Server\MSSQL.#\MSSQL\LOG (Note: The # changes depending on the ID number for the installed Instance. This is 1 for the first installation of SQL Server, but if you have mulitple instances, you will need to determine the ID number you’re working with. See the BOL for more information about Instance ID numbers.)
Windows Event Log: Go to the Event Viewer in the Administrative Tools section of the Start Menu. The System event log will show details of IO subsystem problems. The Application event log will show details of SQL Server problems.

hi,I have a question on sql database high availability. I have tried using database mirroring, where I am using sql standard edition, in this database mirroring of synchronous mode is the only option available, and it is giving problem, like sql time out errors on my applicatons since i had put in the database mirroring, as asynchronous is only available on enterprise version, is there any suggestions on this. thanks ---vijay

XML PARASE and insert /update in corresponding tables

Hi,
I have a XML in which master details tables 3 tables.I want to separate element and insert/update in corresponding tables dynamically.
Table invlovled in A,B,C
Thanks
Reena

Reena
The easiest way to do this is along the following lines..
(1) register an XML Schema that describes the XML you wish to process with theh database.
(2). create a relational view for the top level elements and for each repeating element (element where maxOccurs > 1 in the XML Schema)
(3) Use 'insert as select' or other SQL type processing to update your relational tables from the contents of the view
It is normally recommended that you add the following annotations to the XML Schema before registering it with the database
(1) At the schema level set xdb:storeVarrayAsTable="true".
(2) At the complexType level set xdb:maintainDOM="fasle".
If you search the forum you will find a lot of examples of creating relational views of XML content stored in the XML database. Typically these examples will include key words like 'create or replace view' and 'table(xmlsequence(extract' or 'xmltable'.
Hope this helps...
-Mark

Howto take SQL Server 2005 Cluster AND Cluster Group Offline

I need to update firmware on the backend storage used by our Active/Passive SQL Server 2005 Cluster. The first step in the process states that all I/O to the disks should be stopped. Per that, I need to take the the SQL Server cluster offline AND the cluster group; however, I then need to use one of the servers that participates in the cluster to perform the upgrade on the storage array. Using the process (which doesn't account for having to use one of clustered servers to perform updates) outlined at http://forums.microsoft.com/MSDN/ShowPost.aspx?PostID=1550288&SiteID=1 as a basis, below is my best guess regarding what I will need to do:
Shutdown:
1. Backup all of your databases prior to the outage and ensure they are in a safe place (NOT on the disk drives in the cluster)
2. Take the SQL Server group OFFLINE. This will cleanly shutdown the SQL Server and it will remain offline when you power the machine back on.
3. Once SQL Server is offline, power off the node which does NOT have the cluster resource currently running on it
4. Save the node which is running the cluster group for last - make a note of this machine as it will be the first one you power back on. MY ADDITION: Before powering it down, set the cluster service to manual so that when you restart the server to perform the storage array maintenance, the cluster will not be running - and likewise not generating I/O against the disk array.
MY ADDITION: 5. Restart the server from step 4. Takes the cluster offline "cleanly" and brings the server back on line so that the storage array maintenance can be performed.
6. Update the firmware on the storage array. After that is complete, set the cluster service back to "Automatic".
Start up:
1. Restart the server. Per the previous steps, the server to be restarted will be the server that last hosted the cluster group and the one used to update the firmware on the storage array.
2. RDP into the node, open cluster administrator, and verify that the cluster came back online successfully and everything looks clean
3. Power on the second node.
4. Failover the cluster group across each node in the cluster and validate that everything looks OK
5. Bring your SQL Server groups back online
6. Validate that everything is operational
Is there a better way to do this or official documentation for the process?
Thanks.

FYI: I did use the process outlined above to briing the cluster offline, perform updates, and bring it back online. It worked as I had hoped. As a test, I had also done the same on a test [non-SQL] cluster prior to making the updates to our SQL cluster. Is it the best way to do it? Who knows. Did it work? Yes.

Maintaining the structure of a SQL Server staging area and dwh aligned with the Oracle data source

Hi,
I'm working in a context where the data source system, in Oracle, is a continuos work in progress. Each 1-2-3 weeks the data source system in the prod environment is updated with new tables or updated table (with new columns or altered columns). So, it is
important to apply in a rapid manner the related changes in the data structure of the SQL Server staging area and dwh.
The issues to solve are:
a. maintaining SQL Server data structure of the staging area aligned with the data structure of the Oracle data source;
b. maintaing SQL Server data structure of the staging area aligned with the data structure of the SQL Server staging area.
In order to solve these issues it could be useful to think to an authomatic manner to alert when a data structure change occurs and a simple manner to apply the changes on SQL Server data structure.
Any suggests, please? Many thanks

We use Oracle CDC service in SQLServer. It has a flag to indicate the schema changes happening at the Oracle end. We track the schema changes using it and then apply changes to sqlserver side. And regarding automation you can use Biml as suggested or .NET
scripts inside script task.
Please Mark This As Answer if it helps to solve the issue Visakh ---------------------------- http://visakhm.blogspot.com/ https://www.facebook.com/VmBlogs

How to install BIDS for SQL Server 2008 R2 and Visual Studio 2008(SSRS,SSIS)

Hi,
I want to install SQL Server 2008 R2 and Visual Studio to use SSRS tool, where to download these application. And my System Configuration is Window 8.1,64 Bit.
Please share step by step information to download and installation. Kindly Reply soon.
Thank you
Pravesh Kumar

Hi Pravesh Kumar,
As Visakh16 suggestted that you can download sql 2008 r2 standard and developer editon.
If you have a subscription associated with your Microsoft account, you can download sql 2008 r2 standard and developer editon from below link, but these two editions are not for free:
https://msdn.microsoft.com/subscriptions/securedownloads/
Microsoft also provide the evaluation edition for free use of 180 days. This software is for evaluation and testing purposes. The evaluation is available in ISO format. Web, Standard, Enterprise and Datacenter editions are available via the same download:
http://www.microsoft.com/en-us/download/details.aspx?id=11093
More details information about the feature supported by different editions in the article below:
Features Supported by the Editions of SQL Server 2008 R2
If you still have any problem, please feel free to ask.
Regards,
Vicky Liu
Vicky Liu
TechNet Community Support

Sql server reporting services and coldfusion

I want to using sql server reporting services ,and create report after i want to call this reports in my coldfusion page.is it possible

Hi,
Please try setting the credentials of the datasource.
1. Double click and open the datasource in your project.
2. Click on the credentials tab, and click on option button 'Use this username and password'
3. Enter the username and password to connect to the datasource
4. Deploy or upload the datasource to the report server and try accessing the reports.
Hope this helps.
Please click "Mark as Answer" if this resolves your problem or "Vote as Helpful" if you find it helpful.
BH

I'm new to SQL Server Integration Services and I need help on how to begin learning SSIS. Is there any training for it besides msdn?

I'm new to SQL Server Integration Services and I need help on how to begin learning SSIS. Is there any training for it besides msdn?

Check this thread where people have already given their suggestion on learning SSIS
http://social.msdn.microsoft.com/Forums/sqlserver/en-US/f2cc1cf3-204d-454a-a189-47df87a3aa23/i-want-to-learn-ssis?forum=sqlintegrationservices
I would suggest to go for You tube videos (type learn SSIS or begin SSIS step by step) you will get lot of good tutorials to start with.
Happy Learning!!
If this post answers your query, please click "Mark As Answer" or "Vote as Helpful".

System Center 2012 R2 install: SQL server Data file and log file

This might be a dumb question, but I can't find the answer anywhere.
I'm installing a new instance of System Center 2012 R2 on a new server, I'm stuck on the SQL Server data file section. Everytime I put in a path, it says that tne path does not exist. I'm I supposed to be creating some sort of SQL Server
data file and log file before this installation, I didn't get this prompt when installing System Center 2012 SP1 or hen I upgraded from System Center 2012 SP1 to System Center 2012 R2
My SQL is on a different server
Thank you in advanced

Have you reviewed the setup.log?
On a side note, why would you put the database file on the same drive as the OS? That defeats the whole purpose of having a remote SQL Server. Why use a remote SQL Server in the first place.
Jason | http://blog.configmgrftw.com

Automatically start SQL Agent service after SQL Server service fails and starts.

Hi!
I have SQL Server 2008 R2 with two main services - SQL Server and SQL Agent.
I'll try to describe my situation. It happens very occasionally, but sometimes SQL Server service terminates unexpectedly. It's my log:
09/13/2013 10:46:21,Service Control Manager,Error,The SQL Server (MSSQLSERVER) service terminated unexpectedly. It has done this 1 time(s). The following corrective action will be taken in 120000 milliseconds: Restart the service.
09/13/2013 10:46:21,,Error,[359] The local host server is not running,,,,
09/13/2013 10:46:22,MSSQLSERVER,Error,The MSSQLSERVER service terminated unexpectedly.,Server,1073760843,,
09/13/2013 10:46:22,,Warning,[139] AutoRestart: Attempting to restart the MSSQLSERVER service (attempt #1)...,,,,
09/13/2013 10:46:27,,Warning,[139] AutoRestart: Attempting to restart the MSSQLSERVER service (attempt #2)...,,,,
09/13/2013 10:46:32,,Warning,[139] AutoRestart: Attempting to restart the MSSQLSERVER service (attempt #3)...,,,,
09/13/2013 10:46:32,,Error,[140] AutoRestart: The MSSQLSERVER service could not be restarted after 3 attempts,,,,
09/13/2013 10:46:32,,Warning,[360] SQLServerAgent initiating shutdown following MSSQLSERVER shutdown,,,,
As you can see, SQL Server service terminates unexpectedly. Then SQL Agent service tries to start SQL Server service. After unsuccessfully attempts to start SQL Server service, SQL Agent service stops itself. I have the option setting in SQL Server
service to start itself after unexpectedly stop within 2 minutes and it is works well. But I have to start my SQL Agent service after this manually. Unfortunately, I can't investigate the reason of my SQL Server stops unexpectedly and in this case I just want
to make the settings to start both of my services SQL Server and SQL Agent automatically after this. How can I set up this? How can I make my SQL Agent service starts after SQL Server service?

Hello,
SQL server agent service depends on SQL server service so unless SQL server service comes online agent will not come online so agent is depended on SQL server not the other wise.
Now is your server 2008 R2 patched to latest service pack (SP2).If not please upgrade it to latest SP.Some fixes are there in Sp which will subside this issue.Can you paste output of
select @@version
>>Then SQL Agent service tries to start SQL Server service.No this is not the case
>>Unfortunately, I can't investigate the reason of my SQL Server stops unexpectedly
Did you checked sql server errorlog and windows event log completely.Please do so and paste if you find some more info
Please mark this reply as the answer or vote as helpful, as appropriate, to make it useful for other readers

SQL Server Agent Job And Database Mail - Error formatting query, probably invalid paramters

We have a stored procedure that we are trying to call with a SQL Server Agent Job. The stored procedure calls Database Mail. This is SQL 2008. The execute task is simply:
USE [Production]
GO
EXEC [dbo].[JOB_EMAIL_SCHEDULED_REPORTS]
GO
When the job runs, it is erroring out immediately, with the error:
Execute as user: NT AUTHORITY\NETWORK SERVICE. Error formatting query, probably invalid paramters [SQLSTATE 42000] (Error 22050). The step failed.
When we go into SQL Server Manager and just execute the SQL query, it works though. Something within the SQL Server Agent job, and Database Mail is causing problems. Any ideas? Thanks.

Justin,
If you use SSMS then the procedure is executed under a different user when compared to running using a SQL Server Agent Job.
Isolate the problem by running a SQL Server agent job that sends a mail. Also check if the NT Authority\Network Service account is
in good standing. Look at the below thread with a similar problem that had an expired account.
http://social.msdn.microsoft.com/Forums/en/sqltools/thread/bac7ecee-a156-4313-b532-ba15813a0700
http://SankarReddy.com/

Service cannot be started. Microsoft.VirtualManager.DB.CarmineSqlException: Unable to connect to the VMM database. Ensure that the SQL Server is running and configured correctly

Hi All,
I am setting up SCVMM 2012 R2 in a production environment. Whenever I restart the SCVMM virtual machine the VMM service doesn't start automatically, I have to manually start it. I checked the VMM logs and in the event viewer i find the below error,
Service cannot be started. Microsoft.VirtualManager.DB.CarmineSqlException: Unable to connect to the VMM database. Ensure that the SQL Server is running and configured correctly. ---> System.Data.SqlClient.SqlException: Cannot open database "VirtualManagerDB"
requested by the login. The login failed. Login failed for user 'NXTRA\VMMSVC'. at System.Data.SqlClient.SqlInternalConnection.OnError(SqlException exception, Boolean breakConnection, Action`1 wrapCloseInAction) at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject
stateObj, Boolean callerHasConnectionLock, Boolean asyncClose) at System.Data.SqlClient.TdsParser.TryRun(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj, Boolean&
dataReady) at System.Data.SqlClient.TdsParser.Run(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj) at System.Data.Sq...
I added the 'VMMSVC' account as db_owner and sysadmin and also NT_Authority\System with same permissions still the service doesn't start on the start up.
I googled a lot and I find the threads with the error containing "General failure" but not with the above. Can someone please help me to find out why this error is occuring.
Thanks,
Ravi

It's often only a problem of the service dependencies. SCVMM starts to fast, SQL server on the same machine in not initialized yet. Here are working service dependencies to ensure SQL server is initializes before SCVMM starts.
You can set the service dependencies directly in regedit (as always: be careful modifying the registry ...)
Here is the content of a reg file setting the dependency.
Windows Registry Editor Version 5.00
[HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\SCVMMService]
"DependOnService"=hex(7):53,00,51,00,4c,00,53,00,45,00,52,00,56,00,45,00,52,00,\
41,00,47,00,45,00,4e,00,54,00,00,00,53,00,51,00,4c,00,42,00,72,00,6f,00,77,\
00,73,00,65,00,72,00,00,00,53,00,51,00,4c,00,57,00,72,00,69,00,74,00,65,00,\
72,00,00,00,4d,00,53,00,53,00,51,00,4c,00,46,00,44,00,4c,00,61,00,75,00,6e,\
00,63,00,68,00,65,00,72,00,00,00,00,00

Does SAP use SQL server's snapshot and transactional replication?

Gurus:
Could you help with this?
Does SAP use SQL server's snapshot and transactional replication?
Thanks!

Hi Christy,
no, SAP does not directly leverage these functions.
But none the less, it is up to you to use these on your system. I regulary use the snapshot functionality when applying Support Packages. In case somehing goes wrong a snapshot is the easiest way to roll back the import process (not exactly the best choice when talking about production and users keep on working while importing).
Have a look at this [document |http://download.microsoft.com/download/d/9/4/d948f981-926e-40fa-a026-5bfcf076d9b9/SAP_SQL2005_Best Practices.doc]. It deals with Best Practices and also covers snapshot, replication and mirroring.
Sven

SQL SERVER BULK FETCH AND INSERT/UPDATE?

Similar Messages

Maybe you are looking for