30 M rows in SQL Server 2008 R2- View or Table for faster performance

Hello,
I am creating a SSRS 2008 report that currently is using a view. It's a view made out of one table and is not indexed.
There are 70 some columns that I am displaying in the report with 10 or so parameters that I am passing through a procedure from SSRS to SQL Server.
When the report runs in Server or in development mode, the report gets out of memory error - which could be a totally different issue as it is trying to bring in a couple million rows amd runs for 15- 20 mins.. and errors out.
My question is if it is sourcing a single table, will a view be better with the right index or a table with index.
Clustered, non clustered? Any suggestions or input would be greatly appreciated.
Thank You.

What is the exact error message?
In SSRS you can use a stored procedure with parameters as data source. You can use a query in the sp, you don't need a view.
>it is trying to bring in a couple million rows amd runs 20 mins.. and errors out.
Indexing not likely to help you. You have a huge return set problem.
Kalman Toth Database & OLAP Architect
SELECT Query Video Tutorial 4 Hours
New Book / Kindle: Exam 70-461 Bootcamp: Querying Microsoft SQL Server 2012

Similar Messages

Restore deleted rows in sql server 2008

Hi,
I have problem, I used import and export wizard in sql server 2008, and select wrong database in source data and wrong database in destination data (i Reflect databases) and in editing mapping i make check for delete rows in destination table.
the step final complete and i lost my data and i don't have backup
how i can restore my data

its not a straight forward activity if you don't have backups, first thing you need to do is to create proper maintenance plan for you databases. You can refer below links which could give some clue about your probles.
http://social.msdn.microsoft.com/Forums/sqlserver/en-US/86befdbe-9806-4d96-9e9f-ead753d0fc20/recover-deleted-rows-from-sql-server-database?forum=transactsql
http://sqlserver2000.databases.aspfaq.com/how-do-i-recover-data-from-sql-server-s-log-files.html
Please mark solved if I've answered your question, vote for it as helpful to help other users find a solution quicker
Praveen Dsa | MCITP - Database Administrator 2008 |
My Blog | My Page

Set SPN for a local SQL Server 2008 R2 Express database used for local "Offline Mode" application

Hi - I have tried searching the web for tips on this situation. Basically, I am trying to recreate a previous employee's client Image. This image is used for one of our companies client application that features and "Offline Mode" where it connects
(Using Kerberos) to the local DB instead of the central DB server.
The custom image connects without issue. I cannot seem to recreate his configuration. I am sure of these things:
- Both images are using the same SQL Server 2008 R2 Express version.
- Both images have the same user accounts setup.
- Both images have "Remote Connections" setup with TCP/IP enabled in the Configuration Manager.
- Both images are joined to the same Domain server currently.
- Both images has the SQLServer service set to use "NETWORK SERVICE" account.
This is the error message I get when SQL starts up for the non-working image:
The SQL Network Interface library could not register the Service Principal Name (SPN) for the SQL Server service. Error: 0x54b, state: 3. Failure to register an SPN may
cause integrated authentication to fall back to NTLM instead of Kerberos. This is an informational message. Further action is only required if Kerberos authentication is required by authentication policies.
Thank you for any assistance given.

Hi Gribbled,
Could you please change the SQL Server Service to run under 'LocalSystem' account and restart SQL Server? Then check if the error still occurs. When the SQL Server service account is configured to use the LocalSystem account, the server will automatically
publish the SPN.
Alternatively, to work around this issue, you can manually create the SPN for the SQL Server Service account using the SETSPN tool. For more details, please review this
blog.
Thanks,
Lydia Zhang

Upgrading from SQL Server 2005 Compact Edition [ENU] to SQL Server 2008 Express Edition OR HIGHER for Microsoft Security Compliance Manager

I have downloaded the MS Security Compliance Manager, which is in two parts: MS SQL Server 2008 Express Edition & the SCM. The install instructions state the the server needs to be install before the SCM. So as the install continues I get
an error message, which cancels the installation. So, I am trying to install SQL 2008 EE separate from SCM. My question is:
Can I upgrade from my current SQL Server 2005 Compact Edition [ENU]
directly to SQL Server 2008 Express Edition (or higher)?

So as the install continues I get an error message, which cancels the installation.
And which error message did you got?
SQL Server Compact Edition is something different then SQL Server Express (or Standard) Edition, you can't upgrade it as you asked for,.
Olaf Helper
[ Blog] [ Xing] [ MVP]

Require help with Pivot table query in SQL Server 2008

Hi,
I have a query regarding converting columns to rows in SQL Server 2008. Please look at the table below.
I need the output to look something like this :
The columns for the children can be dynamic or fixed ( max of 6 children) based on the Family_ID. For Example: A family can have 1 child or more than 1 child.
Not sure how to go about it. Would appreciate your help :)

Looks like you need dynamic pivot on multiple columns. I have two articles on this topic, start from this one
T-SQL:
Dynamic Pivot on Multiple Columns
It has reference to my other blog post.
For every expert, there is an equal and opposite expert. - Becker's Law
My blog
My TechNet articles

Create linked server between MS SQL Server 2008 standard edition to MS SQL Server 2008 express edition

For the captioned issue, is it possible? We have successfully created linked server between 2 MS SQL server 2008 standard edition, but failed for the standard and express edition. Is there any trick to setup? Thanks.

Hello,
SQL Server Management Studio Express Edition may not allow to create a linked server, but the workaround is to use the T-SQL. You can use sp_addlinkedserver and sp_addlinkedsrvlogin.
Hope this helps.
Regards,
Alberto Morillo
SQLCoffee.com

SQL Server 2008 R2 Licensing Query

Hi,
If i have SQL Server 2008 R2 Enterprise License key for a single instance and I am installing all the shared features from the setup. Then is my license counted as being used or no?
Or is it only used when i install Database Engine?
Please mark the answer as helpful if i have answered your query. Thanks and Regards, Kartar Rana

No, a separate license is not required for
Management Tools.
However, any device that has SQL Server tools or technologies installed must have a valid SQL Server license.
Hope this clears your question..
Raju Rasagounder Sr MSSQL DBA

Unhandled exception when installing SQL Server 2008 R2

I tried to download SQL Server 2008 R2 Express it ran for about 30 minutes and then gave a Net Framework error stating that "an Unhandled exception has occurred in your
application. If you click Continue, the application will ignore this error and attempt to continue....." Once I clicked Continue and it did continue to run and then brought up an info screen with no semblance of the download having worked. I had successfully
installed SQL Server 2005 Express previously. I uninstalled it along with the Studio Manager. Do I need to uninstall .NET Framework 3.5 SP1 and .NET Framework 4 Client Profile which are still currently installed before I can install 2008?

Sorry I have to reopen this. But I have a similar, but not the same problem.
I have Windows 7 64bit Ultimate, with VS 2010 professional on my notebook, quad core processor with 8gb of ram and plenty of disk space. I am trying to install SQL Server 2008 R2 Developer edition on my computer. .Net 4.0 was installed, as was .Net 3.5.1
(from the "Turn Windows Features On/Off" of Programs and Features Control Panel applet).
When I try to install, I get a Dialog labelled "Microsoft .NET Framework", then the error is "Unhandled exception has occurred in your application. If you click on Continue, the application will ignore this error and attempt to continue. If you click Quit,
the application will close immediately. An error occurred create the configuration section handler for userSettings/Microsoft.SqlServer. Configuration.LandingPage.Properties.Settings: Could not load file or assembly 'System.Version=4.0.0.0.Culture-neutral.
PublicKey Token-b77a5c561934e089' or one of its dependencies. The system cannot find the file specified. (C:\users\myname\AppData\Local\Microsoft_Corporation\Landing Page.exe_StrongName_rspccglaxmt4nhlj5z3thycltsvyyx\10.0.0.0\user. config
I have removed .Net 4, I have removed .Net 3.5.1 and readded it, rebooting after each step.
any help on this would be appreciated.
Thanks

SQL Server 2008 - Best Practices Analyzer

Is there a version of SQL Server 2008 Best Practices Analyzer available for download? If not, can I use BPA for SQL Server 2005 to run a DB assessment on a SQL Server 2008 database? Please let me know what your recommendation is?
Thanks

Microsoft® SQL Server® 2008 R2 Best Practices Analyzer has been released for few months.
More details here
http://www.microsoft.com/downloads/en/details.aspx?displaylang=en&FamilyID=0fd439d7-4bff-4df7-a52f-9a1be8725591

Incompatible SQL backup on SQL Server 2008 R2

I installed SQL Server 2008 R2 from MSDN download for testing on a development server. I copied a backup from a live SQL Server 2008 R2 server and when I tried to restore the database on the MSDN downloaded copy of SQL the following error was generated...
"The database was backed up on server version 10.50.4033. That version is incompatible with this server, which is running version 10.00.2531....."
Any suggestions on a solution?

NO possibilities of backing up from higher to lower version.
only lower to higher is possible.
you can do this
upgrade this instance to SQL Server 2008 R2 or
restore the backup you have on a SQL Server 2008 R2 instance, export all the data and import it on a SQL Server 2008 database.
Mark as answer if it is useful

How to convert rows to columns in sql server 2008

How to convert rows to columns in sql server 2008 using the GROUP BY function? (only one query allowed)

Lookup the Pivot transformation. From BOL:
The Pivot transformation makes a normalized data set into a less normalized
but more compact version by pivoting the input data on a column value. For
example, a normalized Orders data set that lists customer name, product, and quantity purchased typically has multiple rows for any customer who purchased multiple products, with each row for that customer showing order
details for a different product. By pivoting the data set on the product column, the Pivot transformation can output a data set with a
single row per customer. That single row lists all the purchases by the customer, with the product names shown as column names, and the quantity shown as a value in the product column. Because not every customer purchases every product, many columns may contain
null values.
When a dataset is pivoted, input columns perform different roles in the pivoting process. A column can participate in the following ways:
The column is passed through unchanged to the output. Because many input rows
can result only in one output row, the transformation copies only the first
input value for the column.
The column acts as the key or part of the key that identifies a set of
records.
The column defines the pivot. The values in this column are associated with
columns in the pivoted dataset.
The column contains values that are placed in the columns that the pivot
creates.
Paul

Why is the LookUp object in the Flow Task of my SSIS package going red (and not working) ? Sql Server 2008 R2

I have been working with the Sql Server 2008 R2 SSIS Tutorial at
https://msdn.microsoft.com/en-us/library/ms170419(v=sql.105).aspx
--specifically -- Lesson 1. I have been having some problems with this lesson where the source data from the samples download doesn’t exactly match the data described in the tutorial, and the tables in the tutorial are different from what
is contained in AdventureWorksDW (tutorial refers to DimTime – AdventureWorksDW contains DimDate and no DimTime).
So, after futzing in BI with this tutorial so that I can at least get it to run in Debug – it errors out on the 2nd LookUp object.
Rather than looking for a fix to the problem(s) that I am having between the tutorial and the stuff I downloaded in the samples --
I want “Adapt” the tutorial so I can use the stuff I downloaded and hopefully learn how to use SSIS with the elements (source data and tables) that are present on my workstation.
Here is a description of what is going on for me – which I really don’t understand what is going on in BI – based on the images below – like what columns (from what tables) are they associating to in the OleDB Destination?
Note: the sql in the LookUps here is the sql that I copied from the tutorial.
I probably need to modify these sql statements – so -- the help I am requesting is to make the required modifications/changes
so that I can adapt this tutorial with the stuff that’s on my workstation.
I downloaded the samples and the AdventureWorksDW mdf for Sql Server 2008 R2.
It turns out that in the tutorial it wants me to select a DimTime table, but the version of the AdventureWorksDW db does not contain a DimTime table.
Instead, it contains a DimDate table. So I tried adapting DimDate for the tutorial.
Additionally, the sample data file -- SampleCurrencyData.txt -- has slightly different data types than the types described in the tutorial, so I selected data types for the columns in the datasource text file that would work in BI would to
connect column from source data file to the table.
After finishing all the steps for Lesson 1 -- when I tried debugging the package – and it error'd out on the 2nd Lookup object whichwent red.
 I edited the lookups and the sample Ole DB Destination to "ignore on fail” and I did all
green but the FactCurrencyRate table is not being populated -- as described in the tutorial, so I reset the on error back to default (Fail on error option). And based on this tutorial -- I believe FactCurrencyRate
table is the table which is supposed to be populated with the data from SampleCurrencyData.txt?
In the sample data file that downloaded with all the samples I removed all the data from the text file except for 6 rows, so instead of the original 1100 or so rows, I have only 6 rows of data in the source data file (just to keep things
simple for debugging for now). I did not modify the data itself.
Here is what the (raw) data contained in SampleCurrencyData.txt looks like (from the samples that I downloaded from codeplex) – it’s supposed to be 4 columns of data – float, nvarchar, datetime, float:
0.281690141 USD
6/26/2004 0:00 0.281713948
0.281690141 USD
6/27/2004 0:00 0.281642539
0.281690141 USD
6/28/2004 0:00 0.281761573
0.283286119 USD
6/29/2004 0:00 0.283221933
0.283286119 USD
6/30/2004 0:00 0.283358363
0.281690141 USD
7/1/2004 0:00 0.281682206
Below are images of my BI Layout for Lesson 1 from this tutorial -- the FlatFile and configurations for On Fail Error, A Flow task, the 2 LookUps (CurrencyKey and DataKey), the OleDB Destination configuration, the Design view of the associated tables and
the Debug Run of Lesson 1, and the following error messages. My goal is to figure out what is going on in BI for this tutorial.
Error: 0xC020901E at Extract Sample Currency Data, Lookup Datakey [51]: Row yielded no match during lookup.
Error: 0xC0209029 at Extract Sample Currency Data, Lookup Datakey [51]: SSIS Error Code DTS_E_INDUCEDTRANSFORMFAILUREONERROR.
The "component "Lookup Datakey" (51)" failed because error code 0xC020901E occurred, and the error row disposition on "output "Lookup Match Output" (53)" specifies failure on error. An error occurred on the specified
object of the specified component. There may be error messages posted before this with more information about the failure.
Error: 0xC0047022 at Extract Sample Currency Data, SSIS.Pipeline: SSIS Error Code DTS_E_PROCESSINPUTFAILED.
The ProcessInput method on component "Lookup Datakey" (51) failed with error code 0xC0209029 while processing input "Lookup Input" (52). The identified component returned an error from the ProcessInput method. The error is specific
to the component, but the error is fatal and will cause the Data Flow task to stop running.
There may be error messages posted before this with more information about the failure.
--this is the flat file
-- SampleCurrencyData.txt (which only contains 6 data rows for my purposes)
--and here is where I assign the data types for the colums of -- SampleCurrencyData.txt
This is the first LookUp Object -- LookUp Currency Key – The DB contains DimCurrency table.
I copied the sql from the tutorial here.
I actually have a DimCurrency table in my copy of AdventureWorksDW.
Here’s the design view of DimCurrency and a sample of the data contained in DimCurrency and the On Fail configuration
I actually have a DimCurrency table in my copy of AdventureWorksDW.
Here’s the design view of DimCurrency and a sample of the data contained in DimCurrency and the On Fail configuration
--Here is what the data looks like in the DimCurrency table
--2nd LookUp object -- LookUp Data Key – this is the LookUp
where BI errors out on Debug
--it appears this lookup is referencing the DimDate table – which I DO have in the DB.
--I can’t find the following sql in the tutorial, so I suppose BI added the sql (did it?)
--Here's how I configured for On Error
--Here is DimDate table in Design view
--Here is a sample of the original data contained in DimData
OleDB Destination
--Here is where I get lost a bit – what is going on in the destination here?
--Here's my On Error configuraino
--and here is the FactCurrencyRate table
--and here is a sample of the data contained in FactCurrencyRate
Rich P

Thank you for your reply. I changed the error handling as you suggested on the 2nd lookup to redirect to unmatched rows. Now I get all greet. I don't have the conditional split as in your diagram. But also, nothing appears to have
happened in the DB. Aren't the rows in my text file supposed to be added to the FactCurrencyRate table?
How do I get a conditional split?
Rich P
OK, sorry I forgot to reply you back.
Conditional Split was just dummy task. Ignore it.
Manipulate the data in such way that you get matching records.
Inside Source, for first 2 rows I put the dates which are available in DimDate.
1.00010001,ARS,7/1/2005 0:00,0.99960016
1.00010001,ARS,2/5/2006 0:00,1.001001001
1.00020004,ARS,9/5/2001 0:00,0.99990001
1.00020004,ARS,9/6/2001 0:00,1.00040016
1.00050025,ARS,9/7/2001 0:00,0.99990001
1.00050025,ARS,9/8/2001 0:00,1.001001001
Then in OLE DB Destination, I loaded the rows to TestFactTable.
(Now, you don't even need NO MATCH OUTPUT as there are matching records here)
Cheers,
Vaibhav Chaudhari
[MCTS],
[MCP]

SSIS Package developed in SQL Server 2008 R2 Using BIDS 2008 is not working in SQL Server 2012

I am working in a Product based company.
We have given a Pre-requisites to our customers like SQL Server version should be 2008 or later.
I have developed and deployed my SSIS package in SQL Server 2008 R2 with BIDS 2008.
I have used "Script Component" in my package.
We will take only DTSX package file to the customer places and run using SQL Agent Job daily.
Who are all(Customer Environments) using SQL 2008 or R2 my package is running fine.
Who are all(Customer Environments) using SQL 2012, I am facing the below issue
The component metadata for “Script Component, clsid {874F7595-FB5F-4OFF-9BAF-FBFF825OE3EF}” could not be upgraded to the newer version of the component. The PerformUpgrade method failed.
Still the same package is running fine for some of the customers having SQL 2012.
I am getting the above error only for few customers.
Can someone please guide me how to proceed on this. Is there any solution to go without upgrading the package to SQL 2012. Because we need to maintain only one package for all customers

Hi Katherine,
I am just using the script component only for generating Identity column purpose. I will get the maximum count from the table and using this count value as Input (JurisCount in my below code) for script component and increment the counter for new records.
Finally I am mapping the Script component output value (JurisKey in my below code) to Key column of the table. That's all I am doing with Script Component.
Here is my Simple .net code
/* Microsoft SQL Server Integration Services Script Component
* Write scripts using Microsoft Visual C# 2008.
* ScriptMain is the entry point class of the script.*/
using System;
using System.Data;
using Microsoft.SqlServer.Dts.Pipeline.Wrapper;
using Microsoft.SqlServer.Dts.Runtime.Wrapper;
[Microsoft.SqlServer.Dts.Pipeline.SSISScriptComponentEntryPointAttribute]
public class ScriptMain : UserComponent
public override void PreExecute()
base.PreExecute();
Add your code here for preprocessing or remove if not needed
public override void PostExecute()
base.PostExecute();
Add your code here for postprocessing or remove if not needed
You can set read/write variables here, for example:
Variables.MyIntVar = 100
int counter = 0;
public override void Input0_ProcessInputRow(Input0Buffer Row)
if (counter == 0)
counter = Convert.ToInt32(Row.JurisCount);
Row.JurisKey = counter;
counter = counter + 1;
PAVAN MSBI

Backup Restore With SQL Server 2008 R2 although it succeeded with SQL Server 2008

Dears;
I have a Full backup of some DB of around 417 GB within SQL Server 2008 R2 , and when I tried to restore it , i get stuck several times with the error below :
Restore failed for Server (Microsoft.SqlServer.SmoExtended)
A system assertion check has failed. Check the SQL Server error log for details. Typically, an assertion failure is caused by a software bug or data corruption. To check for database corruption, consider
running DBCC CHECKDB. If you agreed to send dumps to Microsoft during setup, a mini dump will be sent to Microsoft. An update might be available from Microsoft in the latest Service Pack or in a QFE from Technical
Although I have restored
successfully other several Full+ Deferential backups for the same DB while it was in SQL Server 2008 not 2008 R2.
And so I have rounded all different possible assumptions for such common know error by Microsoft for SQL Server 2000, 2005, 2008 but
no way as next:
1-
I have attempted to restore it within 2 environments clustered and non-clustered of SQL Server 2008 R2.
2-
I have attempted to restore verify it and it was so fine .
3-
I have attempted to restore it using Continue_after_error ,no_checksum but no way.
4-
I have attempted to move Backup file to another Storage but no way.
5-
I have scheduled jobs to DBCC
Checkdb the live DB and it wasn’t any errors since long time right now
6-
I have also DBCC check all master +msdb+model+Tempdb ,and they are so fine
7-
I have also checked all I/O subsystem of SAN and Network controllers , but they are fine evidenced much more by my trial on 2 different environments.
8-
I have also checked Memory and it is so fine all the time since I have 128 GB memory and I control it also so well.
For DB Design +Structure :
It has 20 Files containing tables partitioned horizontal +Vertically
(Schema Partitioning +File Stream partitioning ) through these 20 files.
I have Data compression of the required tables only.
I have one table of more than 300 GB alone which is partitioned as mentioned above.
I have implemented Read Committed Snapshot isolation level using row versioning integrated so well with File stream technology since it is a new feature of SQL 2008 R2.
DB is in simple recovery model for garbage collection of all file stream data as a result of much Delete /update in images themselves.
So any one has any idea about such case..How to solve it…?

Hi Ashwin,
When i searched with no answers these are listed out. So i thought this is still existing. Now on wards let me check the data and time of latest reply. Thanks for guidance.
It was happening by oversight. Thanks for guidance.
Regards, Pradyothana DP. Please Mark This As Answer if it solved your issue. Please Mark This As Helpful if it helps to solve your issue. ========================================================== http://www.dbainhouse.blogspot.in/

SQL Server 2008 R2 Replication - not applying snapshot and not updating all repliacted columns

We are using transactional replicating on SQL Server 2008 R2 (SP1) using a remote distributor. We are replicating from BaanLN, which is an ERP application to up to 5 subscribers, all using push publications.
Tables can range from a couple million rows to 12 million rows and 100's of GBs in size.
And it's due to the size of the tables that it was designed with a one publisher to one table architecture.
Until recently it has been working very smooth (last four years)) but we have come across two issues I have never encountered.
While this has happen a half dozen times before, it last occurred a couple weeks ago when I was adding three new publications, again a one table per publication architecture.
We use standard SS repl proc calls to create the publications, which have been successful for years.
On this occasion replication created the three publications, assigned the subscribers and even generated the new snapshot for all three new publications.
However, while it appeared that replication had created all the publications correctly from end to end, it actually only applied one of the three snapshot and created the new table on both of the new subscribers (two on each of the
publications). It only applied the snapshot to one of the two subscribers for the second publications, and did not apply to any on the third.
I let it run for three hours to see if it was a back log issue.
Replication was showing commands coming across when looking at the sync verification at the publisher and
it would even successfully pass a tracer token through each of the three new publications, despite there not being tables on either subscriber on one of the publishers and missing on one of the subscribers on another.
I ended up attempting to reinitialize roughly a dozen times, spanning a day, and one of the two remaining publications was correctly reinitialized and the snapshot applied, but the second of the two (failed) again had the same mysterious result, and
again looked like it was successful based on all the monitoring.
So I kept reinitializing the last and after multiple attempts spanning a day, it too finally was built correctly.
Now the story only get a little stranger. We just found out yesterday that on Friday the 17th
at 7:45, the approximate time started the aforementioned deployment of the three new publications,
we also had three transaction from a stable and vetted publication send over all changes except for a single status column.
This publication has 12 million rows and is very active, with thousands of changes daily.
, The three rows did not replicate a status change from a 5 to a 6.
We verified that the status was in fact 6 on the publisher, and
5 on both subscribers, yet no messages or errors. All the other rows successfully updated.
We fixed it by updating the publication from 6 back to 5 then back to 6 again on those specific rows and it worked.
The CPU is low and overall latency is minimal on the distributor.
From all accounts the replication is stable and smooth, but very busy.
The issues above have only recently started. I am not sure where to look for a problem, and to that end, a solution.

I suspect the problem with the new publication/subscriptions not initializing may have been a result of timeouts but it is hard to say for sure. The fact that it eventually succeeded after multiple attempts leads me to believe this. If this happens
again, enable verbose agent logging for the Distribution Agent to see if you are getting query timeouts. Add the parameters
-OutputVerboseLevel 2 -Output C:\TEMP\DistributionAgent.log to the Distribution Agent Run Agent job step, rerun the agent, and collect the log.
If you are getting query timeouts, try increasing the Distribution Agent -QueryTimeOut parameter. The default is 1800 seconds. Try bumping this up to 3600 seconds.
Regarding the three transactions not replicating, inspect MSrepl_errors in the distribution database for the time these transactions occurred and see if any errors occurred.
Brandon Williams (blog |
linkedin)

30 M rows in SQL Server 2008 R2- View or Table for faster performance

Similar Messages

Maybe you are looking for